2024-09-10T20:54:48.847 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T20:54:48.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T20:54:48.973 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899662 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/fs/test_o_trunc}} email: hyelloji@redhat.com first_in_suite: false job_id: '7899662' kernel: client: sha1: distro flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt dry_run: true install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7kk7WHmyyFzS5Irm9tSP5+zvkqYxjdPA9bUneWCKu+4hnRFELJedaYOhE1b0VHvU4EjhHMJQad5vfQbSwKm8E= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIL8I6h5LLEEmzhogDIev+0LQ1XvFQJ+MRNHkfqw5AmO1bMjbw1U5Rewej8L2BMxEc9VzfJB70CyhVtDg0GIgwc= smithi192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLJ7QxT+gVkuxWOZhFb2Xtg9zRoAUhfvkZ6zli8RE+pK+/jk/DyGeN3ciy054hkp0m5Y5gfW1rgUCFlvvZHnzN0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - workunit: clients: all: - fs/test_o_trunc.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T20:54:48.973 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-10T20:54:48.974 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-10T20:54:48.974 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T20:54:48.976 INFO:teuthology.task.internal:Checking packages... 2024-09-10T20:54:48.996 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-10T20:54:48.996 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T20:54:48.996 INFO:teuthology.packaging:ref: None 2024-09-10T20:54:48.996 INFO:teuthology.packaging:tag: None 2024-09-10T20:54:48.996 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-10T20:54:48.997 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T20:54:48.997 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-10T20:54:49.144 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-10T20:54:49.145 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T20:54:49.156 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T20:54:49.156 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T20:54:49.164 INFO:teuthology.task.internal:Saving configuration 2024-09-10T20:54:49.183 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T20:54:49.191 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T20:54:49.232 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899662', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 20:49:38.882561', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7kk7WHmyyFzS5Irm9tSP5+zvkqYxjdPA9bUneWCKu+4hnRFELJedaYOhE1b0VHvU4EjhHMJQad5vfQbSwKm8E='} 2024-09-10T20:54:49.259 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899662', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 20:49:38.884849', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIL8I6h5LLEEmzhogDIev+0LQ1XvFQJ+MRNHkfqw5AmO1bMjbw1U5Rewej8L2BMxEc9VzfJB70CyhVtDg0GIgwc='} 2024-09-10T20:54:49.287 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899662', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 20:49:38.883810', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLJ7QxT+gVkuxWOZhFb2Xtg9zRoAUhfvkZ6zli8RE+pK+/jk/DyGeN3ciy054hkp0m5Y5gfW1rgUCFlvvZHnzN0='} 2024-09-10T20:54:49.288 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T20:54:49.296 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-10T20:54:49.296 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-10T20:54:49.296 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-10T20:54:49.296 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T20:54:49.410 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0eef550af0>, signals=[15]) 2024-09-10T20:54:49.410 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T20:54:49.416 INFO:teuthology.task.internal:Opening connections... 2024-09-10T20:54:49.417 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2024-09-10T20:54:49.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:54:49.519 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T20:54:49.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:54:49.601 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2024-09-10T20:54:49.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:54:49.687 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T20:54:49.693 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2024-09-10T20:54:49.712 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2024-09-10T20:54:49.712 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-09-10T20:54:49.769 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2024-09-10T20:54:49.769 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2024-09-10T20:54:49.769 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2024-09-10T20:54:49.769 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2024-09-10T20:54:49.769 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2024-09-10T20:54:49.769 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2024-09-10T20:54:49.770 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T20:54:49.770 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2024-09-10T20:54:49.770 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2024-09-10T20:54:49.770 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T20:54:49.770 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2024-09-10T20:54:49.770 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T20:54:49.770 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T20:54:49.770 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T20:54:49.771 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-09-10T20:54:49.827 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-09-10T20:54:49.845 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-09-10T20:54:49.845 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-09-10T20:54:49.903 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-09-10T20:54:49.903 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2024-09-10T20:54:49.904 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-09-10T20:54:49.904 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-09-10T20:54:49.904 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2024-09-10T20:54:49.904 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2024-09-10T20:54:49.904 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T20:54:49.904 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-09-10T20:54:49.904 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2024-09-10T20:54:49.904 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T20:54:49.904 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-09-10T20:54:49.904 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T20:54:49.904 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T20:54:49.904 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T20:54:49.905 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-09-10T20:54:49.935 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2024-09-10T20:54:49.954 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2024-09-10T20:54:49.954 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-09-10T20:54:50.012 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2024-09-10T20:54:50.012 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2024-09-10T20:54:50.012 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2024-09-10T20:54:50.012 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2024-09-10T20:54:50.012 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2024-09-10T20:54:50.012 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2024-09-10T20:54:50.012 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T20:54:50.012 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-09-10T20:54:50.013 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2024-09-10T20:54:50.013 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T20:54:50.013 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2024-09-10T20:54:50.013 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T20:54:50.013 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T20:54:50.013 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T20:54:50.013 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-09-10T20:54:50.043 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T20:54:50.053 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T20:54:50.070 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T20:54:50.070 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2024-09-10T20:54:50.073 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-09-10T20:54:50.075 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2024-09-10T20:54:50.092 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T20:54:50.102 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T20:54:50.103 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2024-09-10T20:54:50.130 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-09-10T20:54:50.133 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2024-09-10T20:54:50.221 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T20:54:50.329 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T20:54:50.346 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-10T20:54:50.346 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-10T20:54:50.346 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-10T20:54:50.346 DEBUG:teuthology.orchestra.run.smithi059:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T20:54:50.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:54:50.364 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2024-09-10T20:54:50.421 INFO:teuthology.orchestra.run.smithi059.stdout:5.14.0-503.el9.x86_64 2024-09-10T20:54:50.422 INFO:teuthology.task.kernel:Running kernel on smithi059: 5.14.0-503.el9.x86_64 2024-09-10T20:54:50.422 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum install -y kernel 2024-09-10T20:54:52.907 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-10T20:54:59.891 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - AppStream 3.5 MB/s | 20 MB 00:05 2024-09-10T20:55:04.867 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - CRB 6.3 MB/s | 6.5 MB 00:01 2024-09-10T20:55:06.259 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - Extras packages 134 kB/s | 19 kB 00:00 2024-09-10T20:55:07.371 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-10T20:55:12.911 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-10T20:55:15.026 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T20:55:15.026 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T20:55:15.124 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-10T20:55:15.133 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-10T20:55:15.133 INFO:teuthology.orchestra.run.smithi059.stdout: Package Architecture Version Repository Size 2024-09-10T20:55:15.133 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-10T20:55:15.133 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-10T20:55:15.133 INFO:teuthology.orchestra.run.smithi059.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T20:55:15.133 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-09-10T20:55:15.134 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T20:55:15.134 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T20:55:15.134 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T20:55:15.134 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T20:55:15.134 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-10T20:55:15.134 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2024-09-10T20:55:15.134 INFO:teuthology.orchestra.run.smithi059.stdout:Install 4 Packages 2024-09-10T20:55:15.134 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T20:55:15.134 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 79 M 2024-09-10T20:55:15.135 INFO:teuthology.orchestra.run.smithi059.stdout:Installed size: 126 M 2024-09-10T20:55:15.135 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-10T20:55:15.337 INFO:teuthology.orchestra.run.smithi059.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 147 kB/s | 23 kB 00:00 2024-09-10T20:55:16.196 INFO:teuthology.orchestra.run.smithi059.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-09-10T20:55:16.754 INFO:teuthology.orchestra.run.smithi059.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 20 MB/s | 29 MB 00:01 2024-09-10T20:55:17.054 INFO:teuthology.orchestra.run.smithi059.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 18 MB/s | 35 MB 00:01 2024-09-10T20:55:17.055 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-10T20:55:17.055 INFO:teuthology.orchestra.run.smithi059.stdout:Total 41 MB/s | 79 MB 00:01 2024-09-10T20:55:17.770 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-10T20:55:18.181 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-10T20:55:18.181 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-10T20:55:19.161 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-10T20:55:19.162 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-10T20:55:21.727 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-10T20:55:22.407 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T20:55:22.504 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T20:55:25.298 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T20:55:25.433 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T20:55:30.566 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T20:55:30.609 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T20:55:35.748 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T20:56:14.679 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T20:56:14.721 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T20:56:15.055 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T20:56:15.055 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T20:56:15.056 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T20:56:15.056 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T20:56:15.933 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T20:56:15.933 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T20:56:15.933 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-10T20:56:15.933 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T20:56:15.933 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T20:56:15.933 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T20:56:15.934 INFO:teuthology.orchestra.run.smithi059.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T20:56:15.934 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T20:56:15.934 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-10T20:56:16.260 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T20:56:16.344 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T20:56:16.344 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T20:56:16.345 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T20:56:16.345 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T20:56:16.345 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T20:56:16.345 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-10T20:56:16.345 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi059.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T20:56:16.346 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T20:56:16.404 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T20:56:16.405 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T20:56:16.405 DEBUG:teuthology.orchestra.run.smithi059:> sudo rpm -qi grub2-tools 2024-09-10T20:56:16.436 INFO:teuthology.orchestra.run.smithi059.stdout:Name : grub2-tools 2024-09-10T20:56:16.437 INFO:teuthology.orchestra.run.smithi059.stdout:Epoch : 1 2024-09-10T20:56:16.437 INFO:teuthology.orchestra.run.smithi059.stdout:Version : 2.06 2024-09-10T20:56:16.437 INFO:teuthology.orchestra.run.smithi059.stdout:Release : 82.el9 2024-09-10T20:56:16.437 INFO:teuthology.orchestra.run.smithi059.stdout:Architecture: x86_64 2024-09-10T20:56:16.437 INFO:teuthology.orchestra.run.smithi059.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T20:56:16.437 INFO:teuthology.orchestra.run.smithi059.stdout:Group : Unspecified 2024-09-10T20:56:16.437 INFO:teuthology.orchestra.run.smithi059.stdout:Size : 8274670 2024-09-10T20:56:16.437 INFO:teuthology.orchestra.run.smithi059.stdout:License : GPLv3+ 2024-09-10T20:56:16.437 INFO:teuthology.orchestra.run.smithi059.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T20:56:16.437 INFO:teuthology.orchestra.run.smithi059.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T20:56:16.438 INFO:teuthology.orchestra.run.smithi059.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T20:56:16.438 INFO:teuthology.orchestra.run.smithi059.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T20:56:16.438 INFO:teuthology.orchestra.run.smithi059.stdout:Packager : builder@centos.org 2024-09-10T20:56:16.438 INFO:teuthology.orchestra.run.smithi059.stdout:Vendor : CentOS 2024-09-10T20:56:16.438 INFO:teuthology.orchestra.run.smithi059.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T20:56:16.438 INFO:teuthology.orchestra.run.smithi059.stdout:Summary : Support tools for GRUB. 2024-09-10T20:56:16.438 INFO:teuthology.orchestra.run.smithi059.stdout:Description : 2024-09-10T20:56:16.438 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T20:56:16.438 INFO:teuthology.orchestra.run.smithi059.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T20:56:16.438 INFO:teuthology.orchestra.run.smithi059.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T20:56:16.438 INFO:teuthology.orchestra.run.smithi059.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T20:56:16.438 INFO:teuthology.orchestra.run.smithi059.stdout:hardware devices. 2024-09-10T20:56:16.438 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T20:56:16.438 INFO:teuthology.orchestra.run.smithi059.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T20:56:16.439 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T20:56:16.439 INFO:teuthology.task.kernel:Updating grub on smithi059 to boot 5.14.0-505.el9.x86_64 2024-09-10T20:56:16.439 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T20:56:17.091 INFO:teuthology.orchestra.run.smithi059.stderr:Generating grub configuration file ... 2024-09-10T20:56:18.402 INFO:teuthology.orchestra.run.smithi059.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T20:56:18.438 INFO:teuthology.orchestra.run.smithi059.stderr:done 2024-09-10T20:56:18.441 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2024-09-10T20:56:18.456 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.8UPvfBJpey 2024-09-10T20:56:18.456 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8UPvfBJpey 2024-09-10T20:56:18.530 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.8UPvfBJpey 2024-09-10T20:56:18.677 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.8UPvfBJpey is 6KB 2024-09-10T20:56:18.697 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.8UPvfBJpey 2024-09-10T20:56:18.711 DEBUG:teuthology.orchestra.run.smithi059:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T20:56:18.772 INFO:teuthology.orchestra.run.smithi059.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T20:56:18.773 INFO:teuthology.orchestra.run.smithi059.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T20:56:18.773 INFO:teuthology.orchestra.run.smithi059.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T20:56:18.773 INFO:teuthology.orchestra.run.smithi059.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T20:56:18.774 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T20:56:18.943 DEBUG:teuthology.orchestra.run.smithi059:> sudo shutdown -r now 2024-09-10T20:56:48.945 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T20:56:48.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-10T20:56:48.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:57:07.389 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-09-10T20:57:16.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-10T20:57:16.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:58:16.402 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T20:58:28.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-10T20:58:28.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T20:58:28.737 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-09-10T20:58:29.056 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-10T20:58:29.056 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-10T20:58:29.056 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2024-09-10T20:58:29.072 INFO:teuthology.orchestra.run.smithi059.stdout:5.14.0-505.el9.x86_64 2024-09-10T20:58:29.073 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T20:58:29.073 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T20:58:29.073 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T20:58:30.074 DEBUG:teuthology.parallel:result is None 2024-09-10T20:58:30.074 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T20:58:30.081 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T20:58:30.081 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T20:58:30.084 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T20:58:30.086 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T20:58:30.105 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T20:58:30.123 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T20:58:30.134 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T20:58:30.135 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T20:58:30.143 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T20:58:30.145 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T20:58:30.246 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T20:58:30.254 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T20:58:30.254 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T20:58:30.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:58:30.272 DEBUG:teuthology.orchestra.run.smithi192:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T20:58:30.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:58:30.291 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T20:58:30.293 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T20:58:30.315 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T20:58:30.375 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:58:30.380 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:58:30.391 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:58:30.391 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:58:30.401 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:58:30.409 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T20:58:30.411 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T20:58:30.418 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T20:58:30.418 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T20:58:30.421 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T20:58:30.423 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T20:58:30.450 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T20:58:30.459 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T20:58:30.459 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T20:58:30.490 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T20:58:30.492 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T20:58:30.509 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:58:30.600 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:58:30.653 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:58:30.714 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:58:30.748 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T20:58:30.748 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T20:58:30.815 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:58:30.867 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:58:30.908 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:58:30.998 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:58:31.032 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T20:58:31.033 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T20:58:31.098 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:58:31.151 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T20:58:31.195 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:58:31.288 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T20:58:31.324 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T20:58:31.324 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T20:58:31.390 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2024-09-10T20:58:31.393 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-09-10T20:58:31.396 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2024-09-10T20:58:31.425 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T20:58:31.437 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T20:58:31.477 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T20:58:31.951 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T20:58:31.960 INFO:teuthology.task.internal:Starting timer... 2024-09-10T20:58:31.961 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T20:58:31.974 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T20:58:31.982 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-10T20:58:31.982 DEBUG:teuthology.orchestra.run.smithi059:> sudo service auditd rotate 2024-09-10T20:58:32.061 INFO:teuthology.orchestra.run.smithi059.stdout:Rotating logs: 2024-09-10T20:58:32.063 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2024-09-10T20:58:32.117 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: 2024-09-10T20:58:32.119 DEBUG:teuthology.orchestra.run.smithi192:> sudo service auditd rotate 2024-09-10T20:58:32.179 INFO:teuthology.orchestra.run.smithi192.stdout:Rotating logs: 2024-09-10T20:58:32.181 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T20:58:32.181 DEBUG:teuthology.orchestra.run.smithi059:> /usr/sbin/getenforce 2024-09-10T20:58:32.206 INFO:teuthology.orchestra.run.smithi059.stdout:Permissive 2024-09-10T20:58:32.206 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2024-09-10T20:58:32.226 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2024-09-10T20:58:32.227 DEBUG:teuthology.orchestra.run.smithi192:> /usr/sbin/getenforce 2024-09-10T20:58:32.248 INFO:teuthology.orchestra.run.smithi192.stdout:Permissive 2024-09-10T20:58:32.248 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi059.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi154.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi192.front.sepia.ceph.com': 'permissive'} 2024-09-10T20:58:32.248 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T20:58:32.277 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:58:32.277 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T20:58:32.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:58:32.305 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T20:58:32.331 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T20:58:32.332 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T20:58:32.332 DEBUG:teuthology.orchestra.run.smithi059:> sudo /usr/sbin/setenforce permissive 2024-09-10T20:58:32.365 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2024-09-10T20:58:32.398 DEBUG:teuthology.orchestra.run.smithi192:> sudo /usr/sbin/setenforce permissive 2024-09-10T20:58:32.428 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T20:58:32.438 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T20:58:32.449 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T20:58:32.450 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi059.front.sepia.ceph.com,smithi154.front.sepia.ceph.com,smithi192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T21:02:30.552 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi059.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com'), Remote(name='ubuntu@smithi192.front.sepia.ceph.com')] 2024-09-10T21:02:30.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-10T21:02:30.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:02:30.640 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-09-10T21:02:30.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-10T21:02:30.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-10T21:02:30.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:02:30.819 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-10T21:02:30.900 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-10T21:02:30.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-10T21:02:30.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:02:30.987 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-09-10T21:02:31.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-10T21:02:31.065 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T21:02:31.081 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T21:02:31.081 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T21:02:31.082 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T21:02:31.084 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T21:02:31.085 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T21:02:31.087 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T21:02:31.087 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T21:02:31.114 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T21:02:31.117 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T21:02:31.128 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T21:02:31.133 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T21:02:31.134 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T21:02:31.149 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T21:02:31.152 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2024-09-10T21:02:31.161 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: ntpd: command not found 2024-09-10T21:02:31.163 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2024-09-10T21:02:31.173 INFO:teuthology.orchestra.run.smithi059.stdout:506 Cannot talk to daemon 2024-09-10T21:02:31.174 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: ntpd: command not found 2024-09-10T21:02:31.178 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T21:02:31.185 INFO:teuthology.orchestra.run.smithi192.stdout:506 Cannot talk to daemon 2024-09-10T21:02:31.189 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T21:02:31.192 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T21:02:31.199 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T21:02:31.204 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T21:02:31.213 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T21:02:31.259 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-09-10T21:02:31.261 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2024-09-10T21:02:31.263 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T21:02:31.263 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-09-10T21:02:31.263 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:31.263 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:31.263 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:31.263 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:31.265 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T21:02:31.265 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2024-09-10T21:02:31.265 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:31.265 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:31.265 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:31.265 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:31.279 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2024-09-10T21:02:31.282 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T21:02:31.282 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-09-10T21:02:31.282 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:31.282 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:31.283 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:31.283 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:02:31.283 INFO:teuthology.run_tasks:Running task install... 2024-09-10T21:02:31.293 DEBUG:teuthology.task.install:project ceph 2024-09-10T21:02:31.293 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-10T21:02:31.293 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T21:02:31.293 INFO:teuthology.task.install:Using flavor: default 2024-09-10T21:02:31.298 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T21:02:31.298 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T21:02:31.298 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T21:02:31.299 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:02:31.301 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T21:02:31.301 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:02:31.302 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T21:02:31.303 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:02:31.485 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T21:02:31.485 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T21:02:31.498 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T21:02:31.498 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T21:02:31.499 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T21:02:31.499 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T21:02:31.606 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T21:02:31.606 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T21:02:31.606 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T21:02:31.618 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T21:02:31.618 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T21:02:31.618 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T21:02:31.624 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T21:02:31.624 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T21:02:31.624 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T21:02:31.634 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T21:02:31.634 DEBUG:teuthology.orchestra.run.smithi059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T21:02:31.644 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T21:02:31.644 DEBUG:teuthology.orchestra.run.smithi192:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T21:02:31.650 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T21:02:31.650 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T21:02:31.701 DEBUG:teuthology.orchestra.run.smithi059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T21:02:31.709 DEBUG:teuthology.orchestra.run.smithi192:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T21:02:31.718 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T21:02:31.778 DEBUG:teuthology.orchestra.run.smithi059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T21:02:31.785 DEBUG:teuthology.orchestra.run.smithi192:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T21:02:31.793 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T21:02:31.844 INFO:teuthology.orchestra.run.smithi059.stdout:check_obsoletes = 1 2024-09-10T21:02:31.846 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum clean all 2024-09-10T21:02:31.849 INFO:teuthology.orchestra.run.smithi192.stdout:check_obsoletes = 1 2024-09-10T21:02:31.851 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum clean all 2024-09-10T21:02:31.858 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2024-09-10T21:02:31.859 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2024-09-10T21:02:32.073 INFO:teuthology.orchestra.run.smithi192.stdout:45 files removed 2024-09-10T21:02:32.083 INFO:teuthology.orchestra.run.smithi059.stdout:45 files removed 2024-09-10T21:02:32.087 INFO:teuthology.orchestra.run.smithi154.stdout:45 files removed 2024-09-10T21:02:32.100 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T21:02:32.110 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T21:02:32.114 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T21:02:32.642 INFO:teuthology.orchestra.run.smithi192.stdout:ceph packages for x86_64 319 kB/s | 84 kB 00:00 2024-09-10T21:02:32.657 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 322 kB/s | 84 kB 00:00 2024-09-10T21:02:32.683 INFO:teuthology.orchestra.run.smithi059.stdout:ceph packages for x86_64 308 kB/s | 84 kB 00:00 2024-09-10T21:02:32.942 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-10T21:02:32.950 INFO:teuthology.orchestra.run.smithi192.stdout:ceph noarch packages 90 kB/s | 24 kB 00:00 2024-09-10T21:02:32.967 INFO:teuthology.orchestra.run.smithi059.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-10T21:02:33.209 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-10T21:02:33.234 INFO:teuthology.orchestra.run.smithi192.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-10T21:02:33.243 INFO:teuthology.orchestra.run.smithi059.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-10T21:02:34.192 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - BaseOS 9.0 MB/s | 8.2 MB 00:00 2024-09-10T21:02:34.376 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - BaseOS 7.4 MB/s | 8.2 MB 00:01 2024-09-10T21:02:36.585 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-10T21:02:37.210 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 2.1 MB/s | 8.2 MB 00:03 2024-09-10T21:02:38.511 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - AppStream 6.5 MB/s | 20 MB 00:03 2024-09-10T21:02:39.002 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-10T21:02:41.186 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - CRB 9.2 MB/s | 6.5 MB 00:00 2024-09-10T21:02:42.703 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 19 kB 00:00 2024-09-10T21:02:43.228 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 6.5 MB 00:00 2024-09-10T21:02:43.741 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-10T21:02:43.744 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 7.0 MB/s | 6.5 MB 00:00 2024-09-10T21:02:45.056 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 19 kB 00:00 2024-09-10T21:02:45.111 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 134 kB/s | 19 kB 00:00 2024-09-10T21:02:46.191 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-10T21:02:46.276 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-10T21:02:49.205 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-09-10T21:02:51.491 INFO:teuthology.orchestra.run.smithi192.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T21:02:51.491 INFO:teuthology.orchestra.run.smithi192.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T21:02:51.502 INFO:teuthology.orchestra.run.smithi192.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T21:02:51.503 INFO:teuthology.orchestra.run.smithi192.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T21:02:51.504 INFO:teuthology.orchestra.run.smithi192.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T21:02:51.505 INFO:teuthology.orchestra.run.smithi192.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T21:02:51.506 INFO:teuthology.orchestra.run.smithi192.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T21:02:51.509 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T21:02:51.510 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T21:02:51.571 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-10T21:02:51.596 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2024-09-10T21:02:51.596 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-10T21:02:51.596 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2024-09-10T21:02:51.596 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-10T21:02:51.596 INFO:teuthology.orchestra.run.smithi192.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T21:02:51.597 INFO:teuthology.orchestra.run.smithi192.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T21:02:51.597 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T21:02:51.597 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T21:02:51.597 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T21:02:51.597 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T21:02:51.597 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T21:02:51.597 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T21:02:51.597 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T21:02:51.597 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T21:02:51.597 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T21:02:51.597 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T21:02:51.598 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T21:02:51.598 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T21:02:51.598 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T21:02:51.598 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T21:02:51.598 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T21:02:51.598 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T21:02:51.598 INFO:teuthology.orchestra.run.smithi192.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T21:02:51.598 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T21:02:51.598 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T21:02:51.598 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T21:02:51.598 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T21:02:51.598 INFO:teuthology.orchestra.run.smithi192.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T21:02:51.598 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T21:02:51.599 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T21:02:51.599 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T21:02:51.599 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T21:02:51.599 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T21:02:51.599 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T21:02:51.599 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T21:02:51.599 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T21:02:51.599 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T21:02:51.599 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T21:02:51.599 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T21:02:51.599 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T21:02:51.599 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T21:02:51.599 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrading: 2024-09-10T21:02:51.600 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T21:02:51.600 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T21:02:51.600 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T21:02:51.600 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T21:02:51.600 INFO:teuthology.orchestra.run.smithi192.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T21:02:51.600 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T21:02:51.600 INFO:teuthology.orchestra.run.smithi192.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T21:02:51.600 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T21:02:51.600 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-10T21:02:51.600 INFO:teuthology.orchestra.run.smithi192.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T21:02:51.600 INFO:teuthology.orchestra.run.smithi192.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T21:02:51.600 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T21:02:51.601 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T21:02:51.601 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T21:02:51.601 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T21:02:51.601 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T21:02:51.601 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T21:02:51.601 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T21:02:51.601 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T21:02:51.601 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T21:02:51.601 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T21:02:51.601 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T21:02:51.601 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T21:02:51.601 INFO:teuthology.orchestra.run.smithi192.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T21:02:51.601 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T21:02:51.602 INFO:teuthology.orchestra.run.smithi192.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T21:02:51.602 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T21:02:51.602 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T21:02:51.602 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T21:02:51.602 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T21:02:51.602 INFO:teuthology.orchestra.run.smithi192.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T21:02:51.602 INFO:teuthology.orchestra.run.smithi192.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T21:02:51.602 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T21:02:51.602 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T21:02:51.602 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T21:02:51.602 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T21:02:51.602 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T21:02:51.602 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T21:02:51.603 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T21:02:51.603 INFO:teuthology.orchestra.run.smithi192.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T21:02:51.603 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T21:02:51.603 INFO:teuthology.orchestra.run.smithi192.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T21:02:51.603 INFO:teuthology.orchestra.run.smithi192.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T21:02:51.603 INFO:teuthology.orchestra.run.smithi192.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T21:02:51.603 INFO:teuthology.orchestra.run.smithi192.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T21:02:51.603 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T21:02:51.603 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T21:02:51.603 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T21:02:51.603 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T21:02:51.603 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T21:02:51.603 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T21:02:51.604 INFO:teuthology.orchestra.run.smithi192.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T21:02:51.604 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T21:02:51.604 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T21:02:51.604 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T21:02:51.604 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T21:02:51.604 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T21:02:51.604 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T21:02:51.604 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T21:02:51.604 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T21:02:51.604 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T21:02:51.604 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T21:02:51.604 INFO:teuthology.orchestra.run.smithi192.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T21:02:51.604 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T21:02:51.605 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T21:02:51.605 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T21:02:51.605 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T21:02:51.605 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T21:02:51.605 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T21:02:51.605 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T21:02:51.605 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T21:02:51.605 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T21:02:51.605 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T21:02:51.605 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T21:02:51.605 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T21:02:51.605 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T21:02:51.606 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T21:02:51.606 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T21:02:51.606 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T21:02:51.606 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T21:02:51.606 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T21:02:51.606 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T21:02:51.606 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T21:02:51.606 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T21:02:51.606 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T21:02:51.607 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T21:02:51.607 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T21:02:51.607 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T21:02:51.607 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T21:02:51.607 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T21:02:51.607 INFO:teuthology.orchestra.run.smithi192.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T21:02:51.607 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T21:02:51.607 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T21:02:51.607 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T21:02:51.607 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T21:02:51.607 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T21:02:51.607 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T21:02:51.607 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T21:02:51.607 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T21:02:51.608 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T21:02:51.608 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T21:02:51.608 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T21:02:51.608 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T21:02:51.608 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T21:02:51.608 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T21:02:51.608 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T21:02:51.608 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T21:02:51.608 INFO:teuthology.orchestra.run.smithi192.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T21:02:51.608 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T21:02:51.608 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T21:02:51.608 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T21:02:51.609 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T21:02:51.609 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T21:02:51.609 INFO:teuthology.orchestra.run.smithi192.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T21:02:51.609 INFO:teuthology.orchestra.run.smithi192.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T21:02:51.609 INFO:teuthology.orchestra.run.smithi192.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T21:02:51.609 INFO:teuthology.orchestra.run.smithi192.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T21:02:51.609 INFO:teuthology.orchestra.run.smithi192.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T21:02:51.609 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T21:02:51.609 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T21:02:51.609 INFO:teuthology.orchestra.run.smithi192.stdout:Installing weak dependencies: 2024-09-10T21:02:51.609 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T21:02:51.609 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:02:51.609 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-10T21:02:51.609 INFO:teuthology.orchestra.run.smithi192.stdout:======================================================================================= 2024-09-10T21:02:51.610 INFO:teuthology.orchestra.run.smithi192.stdout:Install 149 Packages 2024-09-10T21:02:51.610 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrade 8 Packages 2024-09-10T21:02:51.610 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:02:51.610 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 240 M 2024-09-10T21:02:51.610 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-10T21:02:51.654 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 49 kB/s | 1.7 kB 00:00 2024-09-10T21:02:52.207 INFO:teuthology.orchestra.run.smithi192.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 49 kB/s | 6.6 kB 00:00 2024-09-10T21:02:52.440 INFO:teuthology.orchestra.run.smithi192.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 3.8 MB/s | 900 kB 00:00 2024-09-10T21:02:52.507 INFO:teuthology.orchestra.run.smithi192.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 2.1 MB/s | 145 kB 00:00 2024-09-10T21:02:52.599 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 3.9 kB/s | 1.7 kB 00:00 2024-09-10T21:02:52.607 INFO:teuthology.orchestra.run.smithi192.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 10 MB/s | 5.5 MB 00:00 2024-09-10T21:02:52.741 INFO:teuthology.orchestra.run.smithi192.stdout:(5/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-10T21:02:52.791 INFO:teuthology.orchestra.run.smithi192.stdout:(6/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 8.4 MB/s | 2.4 MB 00:00 2024-09-10T21:02:53.033 INFO:teuthology.orchestra.run.smithi192.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 16 MB/s | 4.8 MB 00:00 2024-09-10T21:02:53.258 INFO:teuthology.orchestra.run.smithi192.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 18 MB/s | 22 MB 00:01 2024-09-10T21:02:53.317 INFO:teuthology.orchestra.run.smithi192.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 433 kB/s | 25 kB 00:00 2024-09-10T21:02:53.726 INFO:teuthology.orchestra.run.smithi192.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 16 MB/s | 11 MB 00:00 2024-09-10T21:02:53.776 INFO:teuthology.orchestra.run.smithi192.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 4.4 MB/s | 225 kB 00:00 2024-09-10T21:02:53.835 INFO:teuthology.orchestra.run.smithi192.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 465 kB/s | 27 kB 00:00 2024-09-10T21:02:53.893 INFO:teuthology.orchestra.run.smithi192.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 548 kB/s | 32 kB 00:00 2024-09-10T21:02:53.967 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T21:02:53.968 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T21:02:53.981 INFO:teuthology.orchestra.run.smithi154.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T21:02:53.982 INFO:teuthology.orchestra.run.smithi154.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T21:02:53.983 INFO:teuthology.orchestra.run.smithi154.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T21:02:53.984 INFO:teuthology.orchestra.run.smithi154.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T21:02:53.986 INFO:teuthology.orchestra.run.smithi154.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T21:02:53.989 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T21:02:53.990 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T21:02:54.052 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-09-10T21:02:54.070 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-09-10T21:02:54.070 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-09-10T21:02:54.070 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-09-10T21:02:54.070 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-09-10T21:02:54.070 INFO:teuthology.orchestra.run.smithi154.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T21:02:54.070 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T21:02:54.070 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T21:02:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T21:02:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T21:02:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T21:02:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T21:02:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T21:02:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T21:02:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T21:02:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T21:02:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T21:02:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T21:02:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T21:02:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T21:02:54.071 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T21:02:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T21:02:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T21:02:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T21:02:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T21:02:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T21:02:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T21:02:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T21:02:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T21:02:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T21:02:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T21:02:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T21:02:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T21:02:54.072 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T21:02:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T21:02:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T21:02:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T21:02:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T21:02:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T21:02:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T21:02:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T21:02:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T21:02:54.073 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2024-09-10T21:02:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T21:02:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T21:02:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T21:02:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T21:02:54.073 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T21:02:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T21:02:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T21:02:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T21:02:54.074 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-09-10T21:02:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T21:02:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T21:02:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T21:02:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T21:02:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T21:02:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T21:02:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T21:02:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T21:02:54.074 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T21:02:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T21:02:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T21:02:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T21:02:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T21:02:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T21:02:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T21:02:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T21:02:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T21:02:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T21:02:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T21:02:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T21:02:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T21:02:54.075 INFO:teuthology.orchestra.run.smithi154.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T21:02:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T21:02:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T21:02:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T21:02:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T21:02:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T21:02:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T21:02:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T21:02:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T21:02:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T21:02:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T21:02:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T21:02:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T21:02:54.076 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T21:02:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T21:02:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T21:02:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T21:02:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T21:02:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T21:02:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T21:02:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T21:02:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T21:02:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T21:02:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T21:02:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T21:02:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T21:02:54.077 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T21:02:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T21:02:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T21:02:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T21:02:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T21:02:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T21:02:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T21:02:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T21:02:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T21:02:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T21:02:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T21:02:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T21:02:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T21:02:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T21:02:54.078 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T21:02:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T21:02:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T21:02:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T21:02:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T21:02:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T21:02:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T21:02:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T21:02:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T21:02:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T21:02:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T21:02:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T21:02:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T21:02:54.079 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T21:02:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T21:02:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T21:02:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T21:02:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T21:02:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T21:02:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T21:02:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T21:02:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T21:02:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T21:02:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T21:02:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T21:02:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T21:02:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T21:02:54.080 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T21:02:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T21:02:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T21:02:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T21:02:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T21:02:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T21:02:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T21:02:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T21:02:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T21:02:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T21:02:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T21:02:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T21:02:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T21:02:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T21:02:54.081 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T21:02:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T21:02:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T21:02:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T21:02:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T21:02:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T21:02:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T21:02:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T21:02:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T21:02:54.082 INFO:teuthology.orchestra.run.smithi154.stdout:Installing weak dependencies: 2024-09-10T21:02:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T21:02:54.082 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T21:02:54.082 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-09-10T21:02:54.082 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-09-10T21:02:54.082 INFO:teuthology.orchestra.run.smithi154.stdout:Install 149 Packages 2024-09-10T21:02:54.083 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 8 Packages 2024-09-10T21:02:54.083 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T21:02:54.083 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 240 M 2024-09-10T21:02:54.083 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-09-10T21:02:54.085 INFO:teuthology.orchestra.run.smithi192.stdout:(14/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 13 MB/s | 17 MB 00:01 2024-09-10T21:02:54.118 INFO:teuthology.orchestra.run.smithi192.stdout:(15/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 3.3 MB/s | 755 kB 00:00 2024-09-10T21:02:54.143 INFO:teuthology.orchestra.run.smithi192.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.7 MB/s | 162 kB 00:00 2024-09-10T21:02:54.160 INFO:teuthology.orchestra.run.smithi192.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 3.0 MB/s | 127 kB 00:00 2024-09-10T21:02:54.194 INFO:teuthology.orchestra.run.smithi192.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 9.9 MB/s | 507 kB 00:00 2024-09-10T21:02:54.253 INFO:teuthology.orchestra.run.smithi192.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 778 kB/s | 45 kB 00:00 2024-09-10T21:02:54.311 INFO:teuthology.orchestra.run.smithi192.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 2.4 MB/s | 143 kB 00:00 2024-09-10T21:02:54.370 INFO:teuthology.orchestra.run.smithi192.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 2.7 MB/s | 161 kB 00:00 2024-09-10T21:02:54.437 INFO:teuthology.orchestra.run.smithi192.stdout:(22/157): python3-rados-19.3.0-4854.g8f219c47.e 4.7 MB/s | 321 kB 00:00 2024-09-10T21:02:54.504 INFO:teuthology.orchestra.run.smithi192.stdout:(23/157): python3-rbd-19.3.0-4854.g8f219c47.el9 4.5 MB/s | 306 kB 00:00 2024-09-10T21:02:54.563 INFO:teuthology.orchestra.run.smithi192.stdout:(24/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.7 MB/s | 99 kB 00:00 2024-09-10T21:02:54.613 INFO:teuthology.orchestra.run.smithi192.stdout:(25/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-10T21:02:54.705 INFO:teuthology.orchestra.run.smithi192.stdout:(26/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 10 MB/s | 5.5 MB 00:00 2024-09-10T21:02:54.763 INFO:teuthology.orchestra.run.smithi192.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 2.9 MB/s | 171 kB 00:00 2024-09-10T21:02:54.822 INFO:teuthology.orchestra.run.smithi192.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 585 kB/s | 34 kB 00:00 2024-09-10T21:02:54.873 INFO:teuthology.orchestra.run.smithi192.stdout:(29/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 12 MB/s | 3.2 MB 00:00 2024-09-10T21:02:54.898 INFO:teuthology.orchestra.run.smithi192.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.0 MB/s | 154 kB 00:00 2024-09-10T21:02:54.914 INFO:teuthology.orchestra.run.smithi154.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 46 kB/s | 6.6 kB 00:00 2024-09-10T21:02:55.079 INFO:teuthology.orchestra.run.smithi059.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T21:02:55.080 INFO:teuthology.orchestra.run.smithi059.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T21:02:55.093 INFO:teuthology.orchestra.run.smithi059.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T21:02:55.094 INFO:teuthology.orchestra.run.smithi059.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T21:02:55.095 INFO:teuthology.orchestra.run.smithi059.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T21:02:55.096 INFO:teuthology.orchestra.run.smithi059.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T21:02:55.098 INFO:teuthology.orchestra.run.smithi059.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T21:02:55.101 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T21:02:55.102 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T21:02:55.170 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-10T21:02:55.185 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================= 2024-09-10T21:02:55.186 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-09-10T21:02:55.186 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================= 2024-09-10T21:02:55.186 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-10T21:02:55.186 INFO:teuthology.orchestra.run.smithi059.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T21:02:55.186 INFO:teuthology.orchestra.run.smithi059.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T21:02:55.186 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T21:02:55.186 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T21:02:55.186 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T21:02:55.186 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T21:02:55.186 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T21:02:55.186 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T21:02:55.187 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T21:02:55.187 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T21:02:55.187 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T21:02:55.187 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T21:02:55.187 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T21:02:55.187 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T21:02:55.187 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T21:02:55.187 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T21:02:55.187 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T21:02:55.187 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T21:02:55.187 INFO:teuthology.orchestra.run.smithi059.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T21:02:55.187 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T21:02:55.188 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T21:02:55.188 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T21:02:55.188 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T21:02:55.188 INFO:teuthology.orchestra.run.smithi059.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T21:02:55.188 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T21:02:55.188 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T21:02:55.188 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T21:02:55.188 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T21:02:55.188 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T21:02:55.188 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T21:02:55.188 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T21:02:55.188 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T21:02:55.188 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T21:02:55.189 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T21:02:55.189 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T21:02:55.189 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T21:02:55.189 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T21:02:55.189 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2024-09-10T21:02:55.189 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T21:02:55.189 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T21:02:55.189 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T21:02:55.189 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T21:02:55.189 INFO:teuthology.orchestra.run.smithi059.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T21:02:55.189 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T21:02:55.190 INFO:teuthology.orchestra.run.smithi059.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T21:02:55.190 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T21:02:55.190 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-09-10T21:02:55.190 INFO:teuthology.orchestra.run.smithi059.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T21:02:55.190 INFO:teuthology.orchestra.run.smithi059.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T21:02:55.190 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T21:02:55.190 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T21:02:55.190 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T21:02:55.191 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T21:02:55.191 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T21:02:55.191 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T21:02:55.191 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T21:02:55.191 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T21:02:55.191 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T21:02:55.192 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T21:02:55.192 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T21:02:55.192 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T21:02:55.192 INFO:teuthology.orchestra.run.smithi059.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T21:02:55.192 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T21:02:55.192 INFO:teuthology.orchestra.run.smithi059.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T21:02:55.192 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T21:02:55.192 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T21:02:55.192 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T21:02:55.192 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T21:02:55.193 INFO:teuthology.orchestra.run.smithi059.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T21:02:55.193 INFO:teuthology.orchestra.run.smithi059.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T21:02:55.193 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T21:02:55.193 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T21:02:55.193 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T21:02:55.193 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T21:02:55.193 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T21:02:55.193 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T21:02:55.193 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T21:02:55.193 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T21:02:55.193 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T21:02:55.193 INFO:teuthology.orchestra.run.smithi059.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T21:02:55.194 INFO:teuthology.orchestra.run.smithi059.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T21:02:55.194 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T21:02:55.194 INFO:teuthology.orchestra.run.smithi059.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T21:02:55.194 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T21:02:55.194 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T21:02:55.194 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T21:02:55.194 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T21:02:55.194 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T21:02:55.194 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T21:02:55.194 INFO:teuthology.orchestra.run.smithi059.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T21:02:55.194 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T21:02:55.195 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T21:02:55.195 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T21:02:55.195 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T21:02:55.195 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T21:02:55.195 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T21:02:55.195 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T21:02:55.195 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T21:02:55.195 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T21:02:55.195 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T21:02:55.195 INFO:teuthology.orchestra.run.smithi059.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T21:02:55.195 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T21:02:55.195 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T21:02:55.195 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T21:02:55.196 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T21:02:55.196 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T21:02:55.196 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T21:02:55.196 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T21:02:55.196 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T21:02:55.196 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T21:02:55.196 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T21:02:55.196 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T21:02:55.196 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T21:02:55.196 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T21:02:55.196 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T21:02:55.196 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T21:02:55.197 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T21:02:55.197 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T21:02:55.197 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T21:02:55.197 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T21:02:55.197 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T21:02:55.197 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T21:02:55.197 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T21:02:55.197 INFO:teuthology.orchestra.run.smithi059.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T21:02:55.197 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T21:02:55.197 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T21:02:55.197 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T21:02:55.198 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T21:02:55.198 INFO:teuthology.orchestra.run.smithi059.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T21:02:55.198 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T21:02:55.198 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T21:02:55.198 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T21:02:55.198 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T21:02:55.198 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T21:02:55.198 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T21:02:55.198 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T21:02:55.199 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T21:02:55.199 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T21:02:55.199 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T21:02:55.199 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T21:02:55.199 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T21:02:55.199 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T21:02:55.199 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T21:02:55.199 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T21:02:55.199 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T21:02:55.199 INFO:teuthology.orchestra.run.smithi059.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T21:02:55.199 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T21:02:55.199 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T21:02:55.199 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T21:02:55.199 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T21:02:55.200 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T21:02:55.200 INFO:teuthology.orchestra.run.smithi059.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T21:02:55.200 INFO:teuthology.orchestra.run.smithi059.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T21:02:55.200 INFO:teuthology.orchestra.run.smithi059.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T21:02:55.200 INFO:teuthology.orchestra.run.smithi059.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T21:02:55.200 INFO:teuthology.orchestra.run.smithi059.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T21:02:55.200 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T21:02:55.200 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T21:02:55.200 INFO:teuthology.orchestra.run.smithi059.stdout:Installing weak dependencies: 2024-09-10T21:02:55.201 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T21:02:55.201 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:02:55.201 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-10T21:02:55.201 INFO:teuthology.orchestra.run.smithi059.stdout:======================================================================================= 2024-09-10T21:02:55.201 INFO:teuthology.orchestra.run.smithi059.stdout:Install 149 Packages 2024-09-10T21:02:55.201 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 8 Packages 2024-09-10T21:02:55.201 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:02:55.202 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 240 M 2024-09-10T21:02:55.202 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-10T21:02:55.348 INFO:teuthology.orchestra.run.smithi154.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 2.0 MB/s | 900 kB 00:00 2024-09-10T21:02:55.414 INFO:teuthology.orchestra.run.smithi154.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 2.1 MB/s | 145 kB 00:00 2024-09-10T21:02:55.582 INFO:teuthology.orchestra.run.smithi192.stdout:(31/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 22 MB/s | 50 MB 00:02 2024-09-10T21:02:55.632 INFO:teuthology.orchestra.run.smithi192.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 5.7 MB/s | 291 kB 00:00 2024-09-10T21:02:55.690 INFO:teuthology.orchestra.run.smithi192.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 853 kB/s | 49 kB 00:00 2024-09-10T21:02:55.782 INFO:teuthology.orchestra.run.smithi192.stdout:(34/157): ceph-mgr-diskprediction-local-19.3.0- 8.3 MB/s | 7.4 MB 00:00 2024-09-10T21:02:55.799 INFO:teuthology.orchestra.run.smithi192.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 151 kB/s | 16 kB 00:00 2024-09-10T21:02:55.807 INFO:teuthology.orchestra.run.smithi154.stdout:(4/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 6.1 MB/s | 2.4 MB 00:00 2024-09-10T21:02:55.841 INFO:teuthology.orchestra.run.smithi192.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 4.8 MB/s | 285 kB 00:00 2024-09-10T21:02:55.884 INFO:teuthology.orchestra.run.smithi059.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 46 kB/s | 6.6 kB 00:00 2024-09-10T21:02:55.974 INFO:teuthology.orchestra.run.smithi154.stdout:(5/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 4.6 MB/s | 5.5 MB 00:01 2024-09-10T21:02:56.008 INFO:teuthology.orchestra.run.smithi192.stdout:(37/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 12 MB/s | 14 MB 00:01 2024-09-10T21:02:56.033 INFO:teuthology.orchestra.run.smithi192.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 95 kB/s | 18 kB 00:00 2024-09-10T21:02:56.040 INFO:teuthology.orchestra.run.smithi154.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 6.5 MB/s | 1.5 MB 00:00 2024-09-10T21:02:56.067 INFO:teuthology.orchestra.run.smithi192.stdout:(39/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 2.9 MB/s | 783 kB 00:00 2024-09-10T21:02:56.117 INFO:teuthology.orchestra.run.smithi059.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 3.8 MB/s | 900 kB 00:00 2024-09-10T21:02:56.167 INFO:teuthology.orchestra.run.smithi192.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 504 kB/s | 80 kB 00:00 2024-09-10T21:02:56.200 INFO:teuthology.orchestra.run.smithi059.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.7 MB/s | 145 kB 00:00 2024-09-10T21:02:56.209 INFO:teuthology.orchestra.run.smithi192.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-10T21:02:56.251 INFO:teuthology.orchestra.run.smithi192.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-10T21:02:56.268 INFO:teuthology.orchestra.run.smithi059.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 10 MB/s | 5.5 MB 00:00 2024-09-10T21:02:56.284 INFO:teuthology.orchestra.run.smithi192.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.1 MB/s | 801 kB 00:00 2024-09-10T21:02:56.309 INFO:teuthology.orchestra.run.smithi192.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-10T21:02:56.335 INFO:teuthology.orchestra.run.smithi192.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-10T21:02:56.360 INFO:teuthology.orchestra.run.smithi192.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-10T21:02:56.386 INFO:teuthology.orchestra.run.smithi192.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-10T21:02:56.401 INFO:teuthology.orchestra.run.smithi059.stdout:(5/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-10T21:02:56.507 INFO:teuthology.orchestra.run.smithi154.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 9.0 MB/s | 4.8 MB 00:00 2024-09-10T21:02:56.519 INFO:teuthology.orchestra.run.smithi192.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 4.0 MB/s | 1.2 MB 00:00 2024-09-10T21:02:56.685 INFO:teuthology.orchestra.run.smithi059.stdout:(6/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 4.9 MB/s | 2.4 MB 00:00 2024-09-10T21:02:56.694 INFO:teuthology.orchestra.run.smithi192.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 689 kB 00:00 2024-09-10T21:02:56.753 INFO:teuthology.orchestra.run.smithi192.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 458 kB/s | 107 kB 00:00 2024-09-10T21:02:56.760 INFO:teuthology.orchestra.run.smithi059.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 13 MB/s | 4.8 MB 00:00 2024-09-10T21:02:56.778 INFO:teuthology.orchestra.run.smithi192.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 260 kB/s | 22 kB 00:00 2024-09-10T21:02:56.837 INFO:teuthology.orchestra.run.smithi192.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 563 kB/s | 33 kB 00:00 2024-09-10T21:02:56.862 INFO:teuthology.orchestra.run.smithi192.stdout:(53/157): bison-3.7.4-5.el9.x86_64.rpm 1.9 MB/s | 943 kB 00:00 2024-09-10T21:02:56.887 INFO:teuthology.orchestra.run.smithi192.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-10T21:02:56.912 INFO:teuthology.orchestra.run.smithi192.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-10T21:02:56.938 INFO:teuthology.orchestra.run.smithi192.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-10T21:02:56.996 INFO:teuthology.orchestra.run.smithi192.stdout:(57/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-10T21:02:57.021 INFO:teuthology.orchestra.run.smithi192.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-10T21:02:57.056 INFO:teuthology.orchestra.run.smithi192.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 770 kB/s | 45 kB 00:00 2024-09-10T21:02:57.181 INFO:teuthology.orchestra.run.smithi192.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 4.6 MB/s | 581 kB 00:00 2024-09-10T21:02:57.239 INFO:teuthology.orchestra.run.smithi192.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 420 kB/s | 24 kB 00:00 2024-09-10T21:02:57.298 INFO:teuthology.orchestra.run.smithi192.stdout:(62/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 816 kB/s | 47 kB 00:00 2024-09-10T21:02:57.323 INFO:teuthology.orchestra.run.smithi192.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 2.1 MB/s | 662 kB 00:00 2024-09-10T21:02:57.390 INFO:teuthology.orchestra.run.smithi192.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-10T21:02:57.415 INFO:teuthology.orchestra.run.smithi192.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-10T21:02:57.449 INFO:teuthology.orchestra.run.smithi192.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 658 kB/s | 38 kB 00:00 2024-09-10T21:02:57.508 INFO:teuthology.orchestra.run.smithi192.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.5 MB/s | 3.0 MB 00:00 2024-09-10T21:02:57.619 INFO:teuthology.orchestra.run.smithi059.stdout:(8/157): ceph-radosgw-19.3.0-4854.g8f219c47.el9 13 MB/s | 11 MB 00:00 2024-09-10T21:02:57.649 INFO:teuthology.orchestra.run.smithi154.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 7.5 MB/s | 22 MB 00:02 2024-09-10T21:02:57.669 INFO:teuthology.orchestra.run.smithi059.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 506 kB/s | 25 kB 00:00 2024-09-10T21:02:57.741 INFO:teuthology.orchestra.run.smithi192.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-09-10T21:02:57.774 INFO:teuthology.orchestra.run.smithi154.stdout:(9/157): ceph-radosgw-19.3.0-4854.g8f219c47.el9 8.6 MB/s | 11 MB 00:01 2024-09-10T21:02:57.800 INFO:teuthology.orchestra.run.smithi154.stdout:(10/157): ceph-selinux-19.3.0-4854.g8f219c47.el 167 kB/s | 25 kB 00:00 2024-09-10T21:02:57.875 INFO:teuthology.orchestra.run.smithi192.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-10T21:02:57.883 INFO:teuthology.orchestra.run.smithi154.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 2.6 MB/s | 225 kB 00:00 2024-09-10T21:02:57.933 INFO:teuthology.orchestra.run.smithi192.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-10T21:02:57.967 INFO:teuthology.orchestra.run.smithi154.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 324 kB/s | 27 kB 00:00 2024-09-10T21:02:58.000 INFO:teuthology.orchestra.run.smithi192.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 8.0 MB/s | 4.4 MB 00:00 2024-09-10T21:02:58.125 INFO:teuthology.orchestra.run.smithi192.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-09-10T21:02:58.136 INFO:teuthology.orchestra.run.smithi059.stdout:(10/157): ceph-common-19.3.0-4854.g8f219c47.el9 9.1 MB/s | 22 MB 00:02 2024-09-10T21:02:58.175 INFO:teuthology.orchestra.run.smithi154.stdout:(13/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 8.0 MB/s | 17 MB 00:02 2024-09-10T21:02:58.184 INFO:teuthology.orchestra.run.smithi192.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-10T21:02:58.186 INFO:teuthology.orchestra.run.smithi059.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 4.4 MB/s | 225 kB 00:00 2024-09-10T21:02:58.200 INFO:teuthology.orchestra.run.smithi154.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 136 kB/s | 32 kB 00:00 2024-09-10T21:02:58.261 INFO:teuthology.orchestra.run.smithi059.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 361 kB/s | 27 kB 00:00 2024-09-10T21:02:58.276 INFO:teuthology.orchestra.run.smithi154.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.1 MB/s | 162 kB 00:00 2024-09-10T21:02:58.309 INFO:teuthology.orchestra.run.smithi154.stdout:(16/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 5.5 MB/s | 755 kB 00:00 2024-09-10T21:02:58.318 INFO:teuthology.orchestra.run.smithi192.stdout:(74/157): openblas-openmp-0.3.26-2.el9.x86_64.r 5.5 MB/s | 4.9 MB 00:00 2024-09-10T21:02:58.328 INFO:teuthology.orchestra.run.smithi059.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 476 kB/s | 32 kB 00:00 2024-09-10T21:02:58.343 INFO:teuthology.orchestra.run.smithi154.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 1.9 MB/s | 127 kB 00:00 2024-09-10T21:02:58.369 INFO:teuthology.orchestra.run.smithi192.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-10T21:02:58.385 INFO:teuthology.orchestra.run.smithi154.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 6.6 MB/s | 507 kB 00:00 2024-09-10T21:02:58.452 INFO:teuthology.orchestra.run.smithi192.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 11 MB/s | 5.8 MB 00:00 2024-09-10T21:02:58.468 INFO:teuthology.orchestra.run.smithi154.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 541 kB/s | 45 kB 00:00 2024-09-10T21:02:58.470 INFO:teuthology.orchestra.run.smithi059.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 5.2 MB/s | 755 kB 00:00 2024-09-10T21:02:58.501 INFO:teuthology.orchestra.run.smithi192.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-09-10T21:02:58.552 INFO:teuthology.orchestra.run.smithi154.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.7 MB/s | 143 kB 00:00 2024-09-10T21:02:58.562 INFO:teuthology.orchestra.run.smithi059.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 1.7 MB/s | 162 kB 00:00 2024-09-10T21:02:58.619 INFO:teuthology.orchestra.run.smithi154.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 2.4 MB/s | 161 kB 00:00 2024-09-10T21:02:58.629 INFO:teuthology.orchestra.run.smithi192.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.4 MB/s | 248 kB 00:00 2024-09-10T21:02:58.646 INFO:teuthology.orchestra.run.smithi059.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 1.5 MB/s | 127 kB 00:00 2024-09-10T21:02:58.660 INFO:teuthology.orchestra.run.smithi192.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 161 kB/s | 26 kB 00:00 2024-09-10T21:02:58.686 INFO:teuthology.orchestra.run.smithi192.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 337 kB/s | 19 kB 00:00 2024-09-10T21:02:58.711 INFO:teuthology.orchestra.run.smithi154.stdout:(22/157): python3-rados-19.3.0-4854.g8f219c47.e 3.4 MB/s | 321 kB 00:00 2024-09-10T21:02:58.719 INFO:teuthology.orchestra.run.smithi192.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-10T21:02:58.745 INFO:teuthology.orchestra.run.smithi192.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-09-10T21:02:58.771 INFO:teuthology.orchestra.run.smithi059.stdout:(17/157): libradosstriper1-19.3.0-4854.g8f219c4 4.0 MB/s | 507 kB 00:00 2024-09-10T21:02:58.803 INFO:teuthology.orchestra.run.smithi154.stdout:(23/157): python3-rbd-19.3.0-4854.g8f219c47.el9 3.3 MB/s | 306 kB 00:00 2024-09-10T21:02:58.829 INFO:teuthology.orchestra.run.smithi192.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 9.3 MB/s | 6.0 MB 00:00 2024-09-10T21:02:58.845 INFO:teuthology.orchestra.run.smithi192.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-10T21:02:58.887 INFO:teuthology.orchestra.run.smithi192.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-10T21:02:58.903 INFO:teuthology.orchestra.run.smithi154.stdout:(24/157): python3-rgw-19.3.0-4854.g8f219c47.el9 995 kB/s | 99 kB 00:00 2024-09-10T21:02:58.912 INFO:teuthology.orchestra.run.smithi192.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-10T21:02:58.946 INFO:teuthology.orchestra.run.smithi192.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 723 kB/s | 42 kB 00:00 2024-09-10T21:02:58.971 INFO:teuthology.orchestra.run.smithi192.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-10T21:02:58.978 INFO:teuthology.orchestra.run.smithi154.stdout:(25/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 8.7 MB/s | 5.5 MB 00:00 2024-09-10T21:02:58.997 INFO:teuthology.orchestra.run.smithi192.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-10T21:02:59.003 INFO:teuthology.orchestra.run.smithi154.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 851 kB/s | 85 kB 00:00 2024-09-10T21:02:59.064 INFO:teuthology.orchestra.run.smithi192.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-09-10T21:02:59.088 INFO:teuthology.orchestra.run.smithi059.stdout:(18/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 7.1 MB/s | 17 MB 00:02 2024-09-10T21:02:59.095 INFO:teuthology.orchestra.run.smithi154.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 1.8 MB/s | 171 kB 00:00 2024-09-10T21:02:59.098 INFO:teuthology.orchestra.run.smithi192.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 506 kB/s | 51 kB 00:00 2024-09-10T21:02:59.123 INFO:teuthology.orchestra.run.smithi192.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 914 kB/s | 54 kB 00:00 2024-09-10T21:02:59.163 INFO:teuthology.orchestra.run.smithi059.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 602 kB/s | 45 kB 00:00 2024-09-10T21:02:59.179 INFO:teuthology.orchestra.run.smithi154.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 409 kB/s | 34 kB 00:00 2024-09-10T21:02:59.198 INFO:teuthology.orchestra.run.smithi192.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-10T21:02:59.224 INFO:teuthology.orchestra.run.smithi192.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-10T21:02:59.249 INFO:teuthology.orchestra.run.smithi192.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-09-10T21:02:59.255 INFO:teuthology.orchestra.run.smithi059.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.5 MB/s | 143 kB 00:00 2024-09-10T21:02:59.271 INFO:teuthology.orchestra.run.smithi154.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.6 MB/s | 154 kB 00:00 2024-09-10T21:02:59.282 INFO:teuthology.orchestra.run.smithi192.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-10T21:02:59.308 INFO:teuthology.orchestra.run.smithi192.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 614 kB/s | 36 kB 00:00 2024-09-10T21:02:59.330 INFO:teuthology.orchestra.run.smithi059.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 2.1 MB/s | 161 kB 00:00 2024-09-10T21:02:59.338 INFO:teuthology.orchestra.run.smithi154.stdout:(30/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 8.8 MB/s | 3.2 MB 00:00 2024-09-10T21:02:59.341 INFO:teuthology.orchestra.run.smithi192.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-09-10T21:02:59.367 INFO:teuthology.orchestra.run.smithi192.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-10T21:02:59.400 INFO:teuthology.orchestra.run.smithi192.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-09-10T21:02:59.422 INFO:teuthology.orchestra.run.smithi059.stdout:(22/157): python3-rados-19.3.0-4854.g8f219c47.e 3.4 MB/s | 321 kB 00:00 2024-09-10T21:02:59.425 INFO:teuthology.orchestra.run.smithi192.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-10T21:02:59.459 INFO:teuthology.orchestra.run.smithi192.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-10T21:02:59.484 INFO:teuthology.orchestra.run.smithi192.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-09-10T21:02:59.498 INFO:teuthology.orchestra.run.smithi059.stdout:(23/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 7.6 MB/s | 5.5 MB 00:00 2024-09-10T21:02:59.518 INFO:teuthology.orchestra.run.smithi192.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 381 kB/s | 22 kB 00:00 2024-09-10T21:02:59.522 INFO:teuthology.orchestra.run.smithi059.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 3.0 MB/s | 306 kB 00:00 2024-09-10T21:02:59.590 INFO:teuthology.orchestra.run.smithi059.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.1 MB/s | 99 kB 00:00 2024-09-10T21:02:59.601 INFO:teuthology.orchestra.run.smithi192.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-10T21:02:59.615 INFO:teuthology.orchestra.run.smithi059.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 925 kB/s | 85 kB 00:00 2024-09-10T21:02:59.652 INFO:teuthology.orchestra.run.smithi192.stdout:(106/157): protobuf-compiler-3.14.0-13.el9.x86_ 5.0 MB/s | 863 kB 00:00 2024-09-10T21:02:59.678 INFO:teuthology.orchestra.run.smithi192.stdout:(107/157): gperftools-libs-2.9.1-2.el9.x86_64.r 4.0 MB/s | 309 kB 00:00 2024-09-10T21:02:59.715 INFO:teuthology.orchestra.run.smithi059.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 1.7 MB/s | 171 kB 00:00 2024-09-10T21:02:59.719 INFO:teuthology.orchestra.run.smithi192.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 292 kB/s | 19 kB 00:00 2024-09-10T21:02:59.744 INFO:teuthology.orchestra.run.smithi192.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T21:02:59.778 INFO:teuthology.orchestra.run.smithi192.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-10T21:02:59.807 INFO:teuthology.orchestra.run.smithi059.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 374 kB/s | 34 kB 00:00 2024-09-10T21:02:59.937 INFO:teuthology.orchestra.run.smithi192.stdout:(111/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-10T21:02:59.961 INFO:teuthology.orchestra.run.smithi192.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 367 kB/s | 67 kB 00:00 2024-09-10T21:03:00.020 INFO:teuthology.orchestra.run.smithi192.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-09-10T21:03:00.087 INFO:teuthology.orchestra.run.smithi192.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-10T21:03:00.099 INFO:teuthology.orchestra.run.smithi059.stdout:(29/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 6.2 MB/s | 3.2 MB 00:00 2024-09-10T21:03:00.112 INFO:teuthology.orchestra.run.smithi192.stdout:(115/157): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-09-10T21:03:00.138 INFO:teuthology.orchestra.run.smithi192.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 865 kB/s | 43 kB 00:00 2024-09-10T21:03:00.163 INFO:teuthology.orchestra.run.smithi192.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-10T21:03:00.188 INFO:teuthology.orchestra.run.smithi192.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-10T21:03:00.213 INFO:teuthology.orchestra.run.smithi192.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-10T21:03:00.224 INFO:teuthology.orchestra.run.smithi059.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 370 kB/s | 154 kB 00:00 2024-09-10T21:03:00.281 INFO:teuthology.orchestra.run.smithi192.stdout:(120/157): libarrow-9.0.0-11.el9.x86_64.rpm 7.4 MB/s | 4.4 MB 00:00 2024-09-10T21:03:00.314 INFO:teuthology.orchestra.run.smithi192.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-09-10T21:03:00.339 INFO:teuthology.orchestra.run.smithi192.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-09-10T21:03:00.365 INFO:teuthology.orchestra.run.smithi192.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-10T21:03:00.400 INFO:teuthology.orchestra.run.smithi192.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-10T21:03:00.413 INFO:teuthology.orchestra.run.smithi154.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 6.9 MB/s | 7.4 MB 00:01 2024-09-10T21:03:00.415 INFO:teuthology.orchestra.run.smithi192.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-10T21:03:00.432 INFO:teuthology.orchestra.run.smithi192.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 531 kB/s | 18 kB 00:00 2024-09-10T21:03:00.458 INFO:teuthology.orchestra.run.smithi192.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 552 kB/s | 23 kB 00:00 2024-09-10T21:03:00.483 INFO:teuthology.orchestra.run.smithi192.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-10T21:03:00.505 INFO:teuthology.orchestra.run.smithi154.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 3.1 MB/s | 291 kB 00:00 2024-09-10T21:03:00.508 INFO:teuthology.orchestra.run.smithi192.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-10T21:03:00.533 INFO:teuthology.orchestra.run.smithi192.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T21:03:00.567 INFO:teuthology.orchestra.run.smithi192.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-10T21:03:00.589 INFO:teuthology.orchestra.run.smithi154.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 590 kB/s | 49 kB 00:00 2024-09-10T21:03:00.600 INFO:teuthology.orchestra.run.smithi192.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-10T21:03:00.659 INFO:teuthology.orchestra.run.smithi192.stdout:(133/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.9 MB/s | 2.0 MB 00:00 2024-09-10T21:03:00.672 INFO:teuthology.orchestra.run.smithi154.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 197 kB/s | 16 kB 00:00 2024-09-10T21:03:00.693 INFO:teuthology.orchestra.run.smithi192.stdout:(134/157): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2024-09-10T21:03:00.718 INFO:teuthology.orchestra.run.smithi192.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-10T21:03:00.743 INFO:teuthology.orchestra.run.smithi192.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-10T21:03:00.756 INFO:teuthology.orchestra.run.smithi154.stdout:(35/157): ceph-volume-19.3.0-4854.g8f219c47.el9 3.3 MB/s | 285 kB 00:00 2024-09-10T21:03:00.769 INFO:teuthology.orchestra.run.smithi192.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-10T21:03:00.794 INFO:teuthology.orchestra.run.smithi192.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-10T21:03:00.819 INFO:teuthology.orchestra.run.smithi192.stdout:(139/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-09-10T21:03:00.844 INFO:teuthology.orchestra.run.smithi192.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-10T21:03:00.870 INFO:teuthology.orchestra.run.smithi192.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-10T21:03:00.881 INFO:teuthology.orchestra.run.smithi154.stdout:(36/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 6.1 MB/s | 783 kB 00:00 2024-09-10T21:03:00.895 INFO:teuthology.orchestra.run.smithi192.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-10T21:03:00.920 INFO:teuthology.orchestra.run.smithi192.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-09-10T21:03:00.945 INFO:teuthology.orchestra.run.smithi192.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T21:03:00.949 INFO:teuthology.orchestra.run.smithi154.stdout:(37/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 273 kB/s | 18 kB 00:00 2024-09-10T21:03:00.971 INFO:teuthology.orchestra.run.smithi192.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-10T21:03:00.996 INFO:teuthology.orchestra.run.smithi192.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-10T21:03:01.021 INFO:teuthology.orchestra.run.smithi192.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T21:03:01.048 INFO:teuthology.orchestra.run.smithi154.stdout:(38/157): fuse-2.9.9-16.el9.x86_64.rpm 801 kB/s | 80 kB 00:00 2024-09-10T21:03:01.055 INFO:teuthology.orchestra.run.smithi192.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-10T21:03:01.122 INFO:teuthology.orchestra.run.smithi192.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-10T21:03:01.141 INFO:teuthology.orchestra.run.smithi059.stdout:(31/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 14 MB/s | 50 MB 00:03 2024-09-10T21:03:01.165 INFO:teuthology.orchestra.run.smithi154.stdout:(39/157): libgfortran-11.5.0-2.el9.x86_64.rpm 6.7 MB/s | 801 kB 00:00 2024-09-10T21:03:01.216 INFO:teuthology.orchestra.run.smithi059.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 3.8 MB/s | 291 kB 00:00 2024-09-10T21:03:01.232 INFO:teuthology.orchestra.run.smithi154.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-10T21:03:01.292 INFO:teuthology.orchestra.run.smithi059.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 659 kB/s | 49 kB 00:00 2024-09-10T21:03:01.307 INFO:teuthology.orchestra.run.smithi154.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-10T21:03:01.367 INFO:teuthology.orchestra.run.smithi059.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 220 kB/s | 16 kB 00:00 2024-09-10T21:03:01.416 INFO:teuthology.orchestra.run.smithi154.stdout:(42/157): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-10T21:03:01.467 INFO:teuthology.orchestra.run.smithi059.stdout:(35/157): ceph-volume-19.3.0-4854.g8f219c47.el9 2.8 MB/s | 285 kB 00:00 2024-09-10T21:03:01.491 INFO:teuthology.orchestra.run.smithi154.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-10T21:03:01.609 INFO:teuthology.orchestra.run.smithi154.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-10T21:03:01.664 INFO:teuthology.orchestra.run.smithi192.stdout:(150/157): librados2-19.3.0-4854.g8f219c47.el9. 5.4 MB/s | 3.5 MB 00:00 2024-09-10T21:03:01.675 INFO:teuthology.orchestra.run.smithi154.stdout:(45/157): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-10T21:03:01.705 INFO:teuthology.orchestra.run.smithi192.stdout:(151/157): NetworkManager-1.49.90-1.el9.x86_64. 4.0 MB/s | 2.3 MB 00:00 2024-09-10T21:03:01.734 INFO:teuthology.orchestra.run.smithi059.stdout:(36/157): ceph-mgr-diskprediction-local-19.3.0- 4.9 MB/s | 7.4 MB 00:01 2024-09-10T21:03:01.759 INFO:teuthology.orchestra.run.smithi154.stdout:(46/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-10T21:03:01.776 INFO:teuthology.orchestra.run.smithi059.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 2.5 MB/s | 783 kB 00:00 2024-09-10T21:03:01.789 INFO:teuthology.orchestra.run.smithi192.stdout:(152/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 4.4 MB/s | 3.2 MB 00:00 2024-09-10T21:03:01.801 INFO:teuthology.orchestra.run.smithi059.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 274 kB/s | 18 kB 00:00 2024-09-10T21:03:01.814 INFO:teuthology.orchestra.run.smithi192.stdout:(153/157): NetworkManager-team-1.49.90-1.el9.x8 375 kB/s | 41 kB 00:00 2024-09-10T21:03:01.923 INFO:teuthology.orchestra.run.smithi192.stdout:(154/157): NetworkManager-tui-1.49.90-1.el9.x86 1.8 MB/s | 249 kB 00:00 2024-09-10T21:03:02.001 INFO:teuthology.orchestra.run.smithi154.stdout:(47/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 5.2 MB/s | 14 MB 00:02 2024-09-10T21:03:02.010 INFO:teuthology.orchestra.run.smithi059.stdout:(39/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 7.4 MB/s | 14 MB 00:01 2024-09-10T21:03:02.043 INFO:teuthology.orchestra.run.smithi059.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 299 kB/s | 80 kB 00:00 2024-09-10T21:03:02.090 INFO:teuthology.orchestra.run.smithi192.stdout:(155/157): NetworkManager-libnm-1.49.90-1.el9.x 4.2 MB/s | 1.8 MB 00:00 2024-09-10T21:03:02.093 INFO:teuthology.orchestra.run.smithi154.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 689 kB 00:00 2024-09-10T21:03:02.143 INFO:teuthology.orchestra.run.smithi154.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-10T21:03:02.185 INFO:teuthology.orchestra.run.smithi059.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-10T21:03:02.198 INFO:teuthology.orchestra.run.smithi192.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 1.4 MB 00:00 2024-09-10T21:03:02.219 INFO:teuthology.orchestra.run.smithi059.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 801 kB 00:00 2024-09-10T21:03:02.244 INFO:teuthology.orchestra.run.smithi059.stdout:(43/157): libquadmath-11.5.0-2.el9.x86_64.rpm 818 kB/s | 191 kB 00:00 2024-09-10T21:03:02.251 INFO:teuthology.orchestra.run.smithi154.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 201 kB/s | 22 kB 00:00 2024-09-10T21:03:02.311 INFO:teuthology.orchestra.run.smithi059.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-09-10T21:03:02.335 INFO:teuthology.orchestra.run.smithi154.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-10T21:03:02.336 INFO:teuthology.orchestra.run.smithi059.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-10T21:03:02.386 INFO:teuthology.orchestra.run.smithi154.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 654 kB/s | 33 kB 00:00 2024-09-10T21:03:02.386 INFO:teuthology.orchestra.run.smithi059.stdout:(46/157): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-10T21:03:02.411 INFO:teuthology.orchestra.run.smithi154.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 1.9 MB/s | 313 kB 00:00 2024-09-10T21:03:02.412 INFO:teuthology.orchestra.run.smithi059.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-10T21:03:02.437 INFO:teuthology.orchestra.run.smithi059.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-09-10T21:03:02.440 INFO:teuthology.orchestra.run.smithi192.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 4.6 MB/s | 2.4 MB 00:00 2024-09-10T21:03:02.446 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-10T21:03:02.447 INFO:teuthology.orchestra.run.smithi192.stdout:Total 22 MB/s | 240 MB 00:10 2024-09-10T21:03:02.469 INFO:teuthology.orchestra.run.smithi154.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-09-10T21:03:02.504 INFO:teuthology.orchestra.run.smithi059.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 5.7 MB/s | 689 kB 00:00 2024-09-10T21:03:02.519 INFO:teuthology.orchestra.run.smithi154.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-10T21:03:02.529 INFO:teuthology.orchestra.run.smithi059.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-09-10T21:03:02.563 INFO:teuthology.orchestra.run.smithi059.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 6.1 MB/s | 943 kB 00:00 2024-09-10T21:03:02.588 INFO:teuthology.orchestra.run.smithi059.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 259 kB/s | 22 kB 00:00 2024-09-10T21:03:02.603 INFO:teuthology.orchestra.run.smithi154.stdout:(56/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2024-09-10T21:03:02.613 INFO:teuthology.orchestra.run.smithi059.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-10T21:03:02.664 INFO:teuthology.orchestra.run.smithi059.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 326 kB/s | 33 kB 00:00 2024-09-10T21:03:02.687 INFO:teuthology.orchestra.run.smithi154.stdout:(57/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-10T21:03:02.697 INFO:teuthology.orchestra.run.smithi059.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 218 kB/s | 18 kB 00:00 2024-09-10T21:03:02.729 INFO:teuthology.orchestra.run.smithi154.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-10T21:03:02.741 INFO:teuthology.orchestra.run.smithi059.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-10T21:03:02.789 INFO:teuthology.orchestra.run.smithi059.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.8 MB/s | 171 kB 00:00 2024-09-10T21:03:02.857 INFO:teuthology.orchestra.run.smithi059.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-10T21:03:02.882 INFO:teuthology.orchestra.run.smithi059.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-10T21:03:02.907 INFO:teuthology.orchestra.run.smithi059.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 386 kB/s | 45 kB 00:00 2024-09-10T21:03:02.946 INFO:teuthology.orchestra.run.smithi154.stdout:(59/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-09-10T21:03:02.982 INFO:teuthology.orchestra.run.smithi059.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-10T21:03:03.007 INFO:teuthology.orchestra.run.smithi059.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 244 kB/s | 24 kB 00:00 2024-09-10T21:03:03.033 INFO:teuthology.orchestra.run.smithi059.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-09-10T21:03:03.058 INFO:teuthology.orchestra.run.smithi059.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-10T21:03:03.088 INFO:teuthology.orchestra.run.smithi154.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.3 MB/s | 3.0 MB 00:00 2024-09-10T21:03:03.100 INFO:teuthology.orchestra.run.smithi059.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-10T21:03:03.125 INFO:teuthology.orchestra.run.smithi059.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-10T21:03:03.142 INFO:teuthology.orchestra.run.smithi059.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-10T21:03:03.147 INFO:teuthology.orchestra.run.smithi154.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 2.8 MB/s | 581 kB 00:00 2024-09-10T21:03:03.164 INFO:teuthology.orchestra.run.smithi154.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-10T21:03:03.189 INFO:teuthology.orchestra.run.smithi154.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-10T21:03:03.256 INFO:teuthology.orchestra.run.smithi154.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-10T21:03:03.275 INFO:teuthology.orchestra.run.smithi059.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-10T21:03:03.401 INFO:teuthology.orchestra.run.smithi059.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-10T21:03:03.426 INFO:teuthology.orchestra.run.smithi059.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 5.9 MB/s | 910 kB 00:00 2024-09-10T21:03:03.501 INFO:teuthology.orchestra.run.smithi059.stdout:(71/157): openblas-openmp-0.3.26-2.el9.x86_64.r 12 MB/s | 4.9 MB 00:00 2024-09-10T21:03:03.527 INFO:teuthology.orchestra.run.smithi059.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-10T21:03:03.594 INFO:teuthology.orchestra.run.smithi059.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-09-10T21:03:03.619 INFO:teuthology.orchestra.run.smithi059.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 953 kB/s | 87 kB 00:00 2024-09-10T21:03:03.690 INFO:teuthology.orchestra.run.smithi154.stdout:(65/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 8.5 MB/s | 50 MB 00:05 2024-09-10T21:03:03.701 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-10T21:03:03.702 INFO:teuthology.orchestra.run.smithi059.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 21 MB/s | 5.8 MB 00:00 2024-09-10T21:03:03.715 INFO:teuthology.orchestra.run.smithi154.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 359 kB/s | 188 kB 00:00 2024-09-10T21:03:03.727 INFO:teuthology.orchestra.run.smithi059.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 565 kB/s | 61 kB 00:00 2024-09-10T21:03:03.740 INFO:teuthology.orchestra.run.smithi154.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 79 kB/s | 38 kB 00:00 2024-09-10T21:03:03.786 INFO:teuthology.orchestra.run.smithi059.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-10T21:03:03.820 INFO:teuthology.orchestra.run.smithi059.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-10T21:03:03.853 INFO:teuthology.orchestra.run.smithi059.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 384 kB/s | 26 kB 00:00 2024-09-10T21:03:03.854 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-10T21:03:03.854 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-10T21:03:03.929 INFO:teuthology.orchestra.run.smithi059.stdout:(80/157): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-09-10T21:03:03.954 INFO:teuthology.orchestra.run.smithi059.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 143 kB/s | 19 kB 00:00 2024-09-10T21:03:03.979 INFO:teuthology.orchestra.run.smithi059.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-10T21:03:04.005 INFO:teuthology.orchestra.run.smithi059.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-09-10T21:03:04.071 INFO:teuthology.orchestra.run.smithi059.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-10T21:03:04.097 INFO:teuthology.orchestra.run.smithi059.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-10T21:03:04.107 INFO:teuthology.orchestra.run.smithi154.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 4.3 MB/s | 1.6 MB 00:00 2024-09-10T21:03:04.172 INFO:teuthology.orchestra.run.smithi059.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-09-10T21:03:04.197 INFO:teuthology.orchestra.run.smithi059.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 422 kB/s | 42 kB 00:00 2024-09-10T21:03:04.222 INFO:teuthology.orchestra.run.smithi059.stdout:(88/157): python3-packaging-20.9-5.el9.noarch.r 512 kB/s | 77 kB 00:00 2024-09-10T21:03:04.247 INFO:teuthology.orchestra.run.smithi059.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-10T21:03:04.290 INFO:teuthology.orchestra.run.smithi059.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-09-10T21:03:04.315 INFO:teuthology.orchestra.run.smithi059.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 762 kB/s | 51 kB 00:00 2024-09-10T21:03:04.315 INFO:teuthology.orchestra.run.smithi154.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 4.3 MB/s | 910 kB 00:00 2024-09-10T21:03:04.340 INFO:teuthology.orchestra.run.smithi059.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-09-10T21:03:04.374 INFO:teuthology.orchestra.run.smithi154.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-10T21:03:04.382 INFO:teuthology.orchestra.run.smithi059.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 584 kB/s | 54 kB 00:00 2024-09-10T21:03:04.407 INFO:teuthology.orchestra.run.smithi059.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 622 kB/s | 42 kB 00:00 2024-09-10T21:03:04.466 INFO:teuthology.orchestra.run.smithi059.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 529 kB/s | 44 kB 00:00 2024-09-10T21:03:04.493 INFO:teuthology.orchestra.run.smithi059.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-10T21:03:04.525 INFO:teuthology.orchestra.run.smithi059.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 615 kB/s | 36 kB 00:00 2024-09-10T21:03:04.558 INFO:teuthology.orchestra.run.smithi059.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 710 kB/s | 47 kB 00:00 2024-09-10T21:03:04.625 INFO:teuthology.orchestra.run.smithi059.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 868 kB/s | 58 kB 00:00 2024-09-10T21:03:04.749 INFO:teuthology.orchestra.run.smithi154.stdout:(71/157): openblas-openmp-0.3.26-2.el9.x86_64.r 4.7 MB/s | 4.9 MB 00:01 2024-09-10T21:03:04.792 INFO:teuthology.orchestra.run.smithi059.stdout:(100/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-10T21:03:04.817 INFO:teuthology.orchestra.run.smithi059.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 499 kB/s | 96 kB 00:00 2024-09-10T21:03:04.842 INFO:teuthology.orchestra.run.smithi059.stdout:(102/157): socat-1.7.4.1-6.el9.x86_64.rpm 957 kB/s | 304 kB 00:00 2024-09-10T21:03:04.868 INFO:teuthology.orchestra.run.smithi059.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 846 kB/s | 64 kB 00:00 2024-09-10T21:03:04.893 INFO:teuthology.orchestra.run.smithi059.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 595 kB/s | 45 kB 00:00 2024-09-10T21:03:04.908 INFO:teuthology.orchestra.run.smithi154.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-09-10T21:03:04.958 INFO:teuthology.orchestra.run.smithi154.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 4.8 MB/s | 1.0 MB 00:00 2024-09-10T21:03:04.977 INFO:teuthology.orchestra.run.smithi059.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-10T21:03:04.983 INFO:teuthology.orchestra.run.smithi154.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-10T21:03:05.002 INFO:teuthology.orchestra.run.smithi059.stdout:(106/157): lua-devel-5.4.4-4.el9.x86_64.rpm 140 kB/s | 22 kB 00:00 2024-09-10T21:03:05.033 INFO:teuthology.orchestra.run.smithi154.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-10T21:03:05.044 INFO:teuthology.orchestra.run.smithi059.stdout:(107/157): gperftools-libs-2.9.1-2.el9.x86_64.r 4.5 MB/s | 309 kB 00:00 2024-09-10T21:03:05.069 INFO:teuthology.orchestra.run.smithi059.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 291 kB/s | 19 kB 00:00 2024-09-10T21:03:05.094 INFO:teuthology.orchestra.run.smithi059.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T21:03:05.117 INFO:teuthology.orchestra.run.smithi154.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-10T21:03:05.119 INFO:teuthology.orchestra.run.smithi059.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T21:03:05.153 INFO:teuthology.orchestra.run.smithi059.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-10T21:03:05.195 INFO:teuthology.orchestra.run.smithi059.stdout:(112/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.6 MB/s | 863 kB 00:00 2024-09-10T21:03:05.209 INFO:teuthology.orchestra.run.smithi154.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-10T21:03:05.237 INFO:teuthology.orchestra.run.smithi059.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-09-10T21:03:05.259 INFO:teuthology.orchestra.run.smithi154.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-09-10T21:03:05.304 INFO:teuthology.orchestra.run.smithi059.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 8.3 MB/s | 548 kB 00:00 2024-09-10T21:03:05.309 INFO:teuthology.orchestra.run.smithi154.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-09-10T21:03:05.321 INFO:teuthology.orchestra.run.smithi059.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-10T21:03:05.338 INFO:teuthology.orchestra.run.smithi059.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-10T21:03:05.380 INFO:teuthology.orchestra.run.smithi059.stdout:(117/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.4 MB/s | 839 kB 00:00 2024-09-10T21:03:05.397 INFO:teuthology.orchestra.run.smithi059.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 242 kB/s | 14 kB 00:00 2024-09-10T21:03:05.402 INFO:teuthology.orchestra.run.smithi154.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-10T21:03:05.430 INFO:teuthology.orchestra.run.smithi059.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-10T21:03:05.464 INFO:teuthology.orchestra.run.smithi059.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-10T21:03:05.477 INFO:teuthology.orchestra.run.smithi154.stdout:(81/157): postgresql-server-13.16-1.el9.x86_64. 5.2 MB/s | 5.8 MB 00:01 2024-09-10T21:03:05.489 INFO:teuthology.orchestra.run.smithi059.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-10T21:03:05.502 INFO:teuthology.orchestra.run.smithi154.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 346 kB/s | 35 kB 00:00 2024-09-10T21:03:05.514 INFO:teuthology.orchestra.run.smithi059.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T21:03:05.548 INFO:teuthology.orchestra.run.smithi059.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-10T21:03:05.586 INFO:teuthology.orchestra.run.smithi154.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-10T21:03:05.615 INFO:teuthology.orchestra.run.smithi059.stdout:(124/157): libarrow-9.0.0-11.el9.x86_64.rpm 7.8 MB/s | 4.4 MB 00:00 2024-09-10T21:03:05.640 INFO:teuthology.orchestra.run.smithi059.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-09-10T21:03:05.666 INFO:teuthology.orchestra.run.smithi059.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-10T21:03:05.669 INFO:teuthology.orchestra.run.smithi154.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-10T21:03:05.691 INFO:teuthology.orchestra.run.smithi059.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-10T21:03:05.716 INFO:teuthology.orchestra.run.smithi059.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-10T21:03:05.728 INFO:teuthology.orchestra.run.smithi154.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-10T21:03:05.741 INFO:teuthology.orchestra.run.smithi059.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-10T21:03:05.744 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-10T21:03:05.744 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-10T21:03:05.766 INFO:teuthology.orchestra.run.smithi059.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T21:03:05.779 INFO:teuthology.orchestra.run.smithi154.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 846 kB/s | 42 kB 00:00 2024-09-10T21:03:05.800 INFO:teuthology.orchestra.run.smithi059.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-10T21:03:05.834 INFO:teuthology.orchestra.run.smithi059.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-09-10T21:03:05.850 INFO:teuthology.orchestra.run.smithi059.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-10T21:03:05.867 INFO:teuthology.orchestra.run.smithi059.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 986 kB/s | 16 kB 00:00 2024-09-10T21:03:05.879 INFO:teuthology.orchestra.run.smithi154.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-09-10T21:03:05.901 INFO:teuthology.orchestra.run.smithi059.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.6 MB/s | 90 kB 00:00 2024-09-10T21:03:05.927 INFO:teuthology.orchestra.run.smithi059.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-10T21:03:05.937 INFO:teuthology.orchestra.run.smithi154.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-10T21:03:05.943 INFO:teuthology.orchestra.run.smithi059.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 675 kB/s | 28 kB 00:00 2024-09-10T21:03:05.968 INFO:teuthology.orchestra.run.smithi059.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 740 kB/s | 31 kB 00:00 2024-09-10T21:03:06.011 INFO:teuthology.orchestra.run.smithi059.stdout:(139/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.9 MB/s | 2.0 MB 00:00 2024-09-10T21:03:06.013 INFO:teuthology.orchestra.run.smithi154.stdout:(89/157): python3-babel-2.9.1-2.el9.noarch.rpm 5.7 MB/s | 6.0 MB 00:01 2024-09-10T21:03:06.052 INFO:teuthology.orchestra.run.smithi059.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 708 kB/s | 59 kB 00:00 2024-09-10T21:03:06.063 INFO:teuthology.orchestra.run.smithi154.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-10T21:03:06.078 INFO:teuthology.orchestra.run.smithi059.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 535 kB/s | 36 kB 00:00 2024-09-10T21:03:06.097 INFO:teuthology.orchestra.run.smithi154.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-09-10T21:03:06.103 INFO:teuthology.orchestra.run.smithi059.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-10T21:03:06.122 INFO:teuthology.orchestra.run.smithi154.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 911 kB/s | 54 kB 00:00 2024-09-10T21:03:06.128 INFO:teuthology.orchestra.run.smithi059.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-10T21:03:06.153 INFO:teuthology.orchestra.run.smithi059.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-10T21:03:06.172 INFO:teuthology.orchestra.run.smithi154.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 836 kB/s | 42 kB 00:00 2024-09-10T21:03:06.179 INFO:teuthology.orchestra.run.smithi059.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 797 kB/s | 20 kB 00:00 2024-09-10T21:03:06.204 INFO:teuthology.orchestra.run.smithi059.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-10T21:03:06.229 INFO:teuthology.orchestra.run.smithi059.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T21:03:06.255 INFO:teuthology.orchestra.run.smithi059.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T21:03:06.264 INFO:teuthology.orchestra.run.smithi154.stdout:(94/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.5 MB/s | 5.1 MB 00:00 2024-09-10T21:03:06.281 INFO:teuthology.orchestra.run.smithi154.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 407 kB/s | 44 kB 00:00 2024-09-10T21:03:06.315 INFO:teuthology.orchestra.run.smithi154.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-10T21:03:06.321 INFO:teuthology.orchestra.run.smithi059.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-10T21:03:06.332 INFO:teuthology.orchestra.run.smithi154.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-10T21:03:06.424 INFO:teuthology.orchestra.run.smithi154.stdout:(98/157): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-09-10T21:03:06.440 INFO:teuthology.orchestra.run.smithi154.stdout:(99/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 378 kB/s | 47 kB 00:00 2024-09-10T21:03:06.464 INFO:teuthology.orchestra.run.smithi059.stdout:(150/157): NetworkManager-1.49.90-1.el9.x86_64. 16 MB/s | 2.3 MB 00:00 2024-09-10T21:03:06.466 INFO:teuthology.orchestra.run.smithi154.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-10T21:03:06.508 INFO:teuthology.orchestra.run.smithi154.stdout:(101/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-10T21:03:06.533 INFO:teuthology.orchestra.run.smithi154.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.0 MB/s | 96 kB 00:00 2024-09-10T21:03:06.550 INFO:teuthology.orchestra.run.smithi154.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-09-10T21:03:06.555 INFO:teuthology.orchestra.run.smithi059.stdout:(151/157): NetworkManager-libnm-1.49.90-1.el9.x 20 MB/s | 1.8 MB 00:00 2024-09-10T21:03:06.592 INFO:teuthology.orchestra.run.smithi154.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 380 kB/s | 22 kB 00:00 2024-09-10T21:03:06.606 INFO:teuthology.orchestra.run.smithi059.stdout:(152/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 9.2 MB/s | 3.2 MB 00:00 2024-09-10T21:03:06.631 INFO:teuthology.orchestra.run.smithi059.stdout:(153/157): NetworkManager-team-1.49.90-1.el9.x8 543 kB/s | 41 kB 00:00 2024-09-10T21:03:06.659 INFO:teuthology.orchestra.run.smithi154.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-10T21:03:06.681 INFO:teuthology.orchestra.run.smithi059.stdout:(154/157): librados2-19.3.0-4854.g8f219c47.el9. 7.7 MB/s | 3.5 MB 00:00 2024-09-10T21:03:06.692 INFO:teuthology.orchestra.run.smithi154.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T21:03:06.706 INFO:teuthology.orchestra.run.smithi059.stdout:(155/157): NetworkManager-tui-1.49.90-1.el9.x86 2.4 MB/s | 249 kB 00:00 2024-09-10T21:03:06.718 INFO:teuthology.orchestra.run.smithi154.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 784 kB/s | 19 kB 00:00 2024-09-10T21:03:06.748 INFO:teuthology.orchestra.run.smithi059.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-10T21:03:06.798 INFO:teuthology.orchestra.run.smithi059.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-09-10T21:03:06.804 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-10T21:03:06.804 INFO:teuthology.orchestra.run.smithi059.stdout:Total 21 MB/s | 240 MB 00:11 2024-09-10T21:03:06.818 INFO:teuthology.orchestra.run.smithi154.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.2 MB/s | 863 kB 00:00 2024-09-10T21:03:06.885 INFO:teuthology.orchestra.run.smithi154.stdout:(109/157): libarrow-9.0.0-11.el9.x86_64.rpm 26 MB/s | 4.4 MB 00:00 2024-09-10T21:03:06.910 INFO:teuthology.orchestra.run.smithi154.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-10T21:03:06.935 INFO:teuthology.orchestra.run.smithi154.stdout:(111/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 222 kB/s | 26 kB 00:00 2024-09-10T21:03:06.961 INFO:teuthology.orchestra.run.smithi154.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-10T21:03:06.986 INFO:teuthology.orchestra.run.smithi154.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-10T21:03:07.036 INFO:teuthology.orchestra.run.smithi154.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-10T21:03:07.061 INFO:teuthology.orchestra.run.smithi154.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T21:03:07.087 INFO:teuthology.orchestra.run.smithi154.stdout:(116/157): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-09-10T21:03:07.112 INFO:teuthology.orchestra.run.smithi154.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-10T21:03:07.137 INFO:teuthology.orchestra.run.smithi154.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-10T21:03:07.162 INFO:teuthology.orchestra.run.smithi154.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-10T21:03:07.188 INFO:teuthology.orchestra.run.smithi154.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-10T21:03:07.213 INFO:teuthology.orchestra.run.smithi154.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-10T21:03:07.238 INFO:teuthology.orchestra.run.smithi154.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T21:03:07.272 INFO:teuthology.orchestra.run.smithi154.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-10T21:03:07.297 INFO:teuthology.orchestra.run.smithi154.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-10T21:03:07.323 INFO:teuthology.orchestra.run.smithi154.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-09-10T21:03:07.348 INFO:teuthology.orchestra.run.smithi154.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-10T21:03:07.373 INFO:teuthology.orchestra.run.smithi154.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 784 kB/s | 19 kB 00:00 2024-09-10T21:03:07.399 INFO:teuthology.orchestra.run.smithi154.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 787 kB/s | 20 kB 00:00 2024-09-10T21:03:07.449 INFO:teuthology.orchestra.run.smithi154.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.6 MB/s | 2.0 MB 00:00 2024-09-10T21:03:07.474 INFO:teuthology.orchestra.run.smithi154.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T21:03:07.508 INFO:teuthology.orchestra.run.smithi154.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-10T21:03:07.533 INFO:teuthology.orchestra.run.smithi154.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T21:03:07.575 INFO:teuthology.orchestra.run.smithi154.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-10T21:03:07.592 INFO:teuthology.orchestra.run.smithi154.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 987 kB/s | 16 kB 00:00 2024-09-10T21:03:07.617 INFO:teuthology.orchestra.run.smithi154.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-10T21:03:07.643 INFO:teuthology.orchestra.run.smithi154.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-10T21:03:07.660 INFO:teuthology.orchestra.run.smithi154.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 676 kB/s | 28 kB 00:00 2024-09-10T21:03:07.677 INFO:teuthology.orchestra.run.smithi154.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 917 kB/s | 31 kB 00:00 2024-09-10T21:03:07.694 INFO:teuthology.orchestra.run.smithi154.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-10T21:03:07.719 INFO:teuthology.orchestra.run.smithi154.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-10T21:03:07.744 INFO:teuthology.orchestra.run.smithi154.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 716 kB/s | 36 kB 00:00 2024-09-10T21:03:07.769 INFO:teuthology.orchestra.run.smithi154.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-10T21:03:07.795 INFO:teuthology.orchestra.run.smithi154.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-10T21:03:07.828 INFO:teuthology.orchestra.run.smithi154.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-10T21:03:07.854 INFO:teuthology.orchestra.run.smithi154.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 805 kB/s | 20 kB 00:00 2024-09-10T21:03:07.879 INFO:teuthology.orchestra.run.smithi154.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-10T21:03:07.904 INFO:teuthology.orchestra.run.smithi154.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-10T21:03:07.971 INFO:teuthology.orchestra.run.smithi154.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-10T21:03:08.062 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-10T21:03:08.233 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-10T21:03:08.233 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-10T21:03:08.271 INFO:teuthology.orchestra.run.smithi154.stdout:(149/157): librados2-19.3.0-4854.g8f219c47.el9. 9.4 MB/s | 3.5 MB 00:00 2024-09-10T21:03:08.330 INFO:teuthology.orchestra.run.smithi154.stdout:(150/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 9.0 MB/s | 3.2 MB 00:00 2024-09-10T21:03:08.397 INFO:teuthology.orchestra.run.smithi154.stdout:(151/157): NetworkManager-1.49.90-1.el9.x86_64. 19 MB/s | 2.3 MB 00:00 2024-09-10T21:03:08.456 INFO:teuthology.orchestra.run.smithi154.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 700 kB/s | 41 kB 00:00 2024-09-10T21:03:08.522 INFO:teuthology.orchestra.run.smithi154.stdout:(153/157): NetworkManager-libnm-1.49.90-1.el9.x 9.4 MB/s | 1.8 MB 00:00 2024-09-10T21:03:08.548 INFO:teuthology.orchestra.run.smithi154.stdout:(154/157): NetworkManager-tui-1.49.90-1.el9.x86 2.6 MB/s | 249 kB 00:00 2024-09-10T21:03:08.632 INFO:teuthology.orchestra.run.smithi154.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-09-10T21:03:08.799 INFO:teuthology.orchestra.run.smithi154.stdout:(156/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.0 MB/s | 16 MB 00:02 2024-09-10T21:03:08.841 INFO:teuthology.orchestra.run.smithi154.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 4.3 MB/s | 1.4 MB 00:00 2024-09-10T21:03:08.846 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-09-10T21:03:08.846 INFO:teuthology.orchestra.run.smithi154.stdout:Total 16 MB/s | 240 MB 00:14 2024-09-10T21:03:10.103 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-09-10T21:03:10.254 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-09-10T21:03:10.255 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-09-10T21:03:10.636 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-10T21:03:10.637 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-10T21:03:12.133 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-09-10T21:03:12.133 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-09-10T21:03:12.243 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-10T21:03:12.327 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T21:03:12.366 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T21:03:12.428 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T21:03:12.461 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T21:03:12.487 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T21:03:12.537 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T21:03:12.863 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T21:03:12.971 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:03:13.077 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:03:13.106 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:03:13.206 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:03:13.235 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T21:03:13.264 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T21:03:13.421 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T21:03:13.474 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T21:03:13.502 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:03:13.606 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:03:13.636 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T21:03:13.699 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T21:03:13.720 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T21:03:13.740 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T21:03:13.955 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T21:03:14.113 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T21:03:14.202 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T21:03:14.290 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:03:14.378 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:03:14.618 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:03:14.724 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T21:03:14.765 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T21:03:14.800 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T21:03:14.865 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T21:03:14.910 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T21:03:14.941 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T21:03:14.993 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T21:03:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T21:03:15.054 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T21:03:15.122 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T21:03:15.176 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T21:03:15.206 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T21:03:15.242 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T21:03:15.320 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T21:03:15.353 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T21:03:15.396 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T21:03:15.425 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T21:03:15.495 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T21:03:15.540 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T21:03:15.615 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T21:03:15.752 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T21:03:15.809 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T21:03:16.353 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T21:03:16.431 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T21:03:16.459 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T21:03:16.501 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T21:03:16.539 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T21:03:16.581 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T21:03:16.764 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T21:03:16.821 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T21:03:16.920 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T21:03:16.993 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T21:03:17.067 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T21:03:17.098 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T21:03:17.133 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T21:03:17.180 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T21:03:17.216 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T21:03:17.259 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T21:03:17.301 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T21:03:17.421 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-10T21:03:17.438 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T21:03:17.528 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T21:03:17.567 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T21:03:17.629 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T21:03:17.670 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T21:03:17.695 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T21:03:17.712 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T21:03:17.746 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T21:03:17.848 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T21:03:17.987 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T21:03:18.029 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T21:03:18.068 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T21:03:18.094 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T21:03:18.119 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T21:03:18.157 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T21:03:18.196 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T21:03:18.221 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:03:18.322 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T21:03:18.346 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:03:18.361 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T21:03:18.372 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:03:18.388 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T21:03:18.423 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T21:03:18.462 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T21:03:18.464 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:03:18.494 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T21:03:18.503 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T21:03:18.524 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T21:03:18.540 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T21:03:18.558 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T21:03:18.592 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T21:03:18.633 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T21:03:18.668 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T21:03:18.723 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T21:03:18.729 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-09-10T21:03:18.754 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T21:03:18.783 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T21:03:18.798 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T21:03:18.810 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:03:18.827 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T21:03:18.829 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T21:03:18.916 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:03:18.926 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T21:03:18.932 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T21:03:18.951 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T21:03:18.988 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T21:03:18.997 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T21:03:19.019 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T21:03:19.027 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T21:03:19.047 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T21:03:19.053 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T21:03:19.078 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T21:03:19.129 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T21:03:19.230 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T21:03:19.407 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T21:03:19.469 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T21:03:19.533 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T21:03:19.588 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:03:19.653 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:03:19.712 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:03:19.718 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T21:03:19.735 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:03:19.739 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:03:19.769 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T21:03:19.803 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T21:03:19.813 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:03:19.843 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T21:03:19.873 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T21:03:19.905 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T21:03:19.966 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T21:03:19.971 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:03:20.011 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T21:03:20.026 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T21:03:20.076 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T21:03:20.082 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T21:03:20.100 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T21:03:20.106 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T21:03:20.110 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:03:20.130 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T21:03:20.140 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T21:03:20.215 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:03:20.216 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T21:03:20.244 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T21:03:20.267 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T21:03:20.305 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T21:03:20.307 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T21:03:20.316 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T21:03:20.327 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T21:03:20.337 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T21:03:20.350 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T21:03:20.357 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T21:03:20.383 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T21:03:20.405 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T21:03:20.410 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T21:03:20.483 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T21:03:20.543 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T21:03:20.555 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T21:03:20.572 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T21:03:20.619 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T21:03:20.684 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T21:03:20.711 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T21:03:20.743 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T21:03:20.786 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T21:03:20.802 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T21:03:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T21:03:20.889 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T21:03:20.894 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:03:20.939 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T21:03:20.978 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:03:21.017 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T21:03:21.061 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T21:03:21.176 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T21:03:21.180 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T21:03:21.199 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T21:03:21.233 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T21:03:21.308 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T21:03:21.332 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T21:03:21.367 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T21:03:21.440 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T21:03:21.493 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T21:03:21.525 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T21:03:21.568 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T21:03:21.601 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T21:03:21.629 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T21:03:21.697 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T21:03:21.776 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T21:03:21.790 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T21:03:21.814 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T21:03:21.850 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T21:03:21.879 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T21:03:21.914 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T21:03:21.927 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T21:03:21.958 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T21:03:21.961 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T21:03:21.995 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T21:03:22.004 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T21:03:22.033 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T21:03:22.038 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T21:03:22.103 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T21:03:22.148 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T21:03:22.202 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T21:03:22.222 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T21:03:22.273 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T21:03:22.356 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T21:03:22.367 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T21:03:22.408 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T21:03:22.415 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T21:03:22.439 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T21:03:22.506 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T21:03:22.512 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T21:03:22.534 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T21:03:22.550 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T21:03:22.567 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T21:03:22.586 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T21:03:22.849 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T21:03:22.886 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T21:03:22.922 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T21:03:22.931 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T21:03:22.945 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T21:03:22.989 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T21:03:23.021 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T21:03:23.023 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T21:03:23.031 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T21:03:23.053 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T21:03:23.096 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T21:03:23.134 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T21:03:23.144 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T21:03:23.176 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T21:03:23.177 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T21:03:23.196 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T21:03:23.231 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T21:03:23.283 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T21:03:23.334 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T21:03:23.379 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T21:03:23.395 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T21:03:23.415 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T21:03:23.455 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T21:03:23.485 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T21:03:23.487 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T21:03:23.512 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T21:03:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T21:03:23.610 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T21:03:23.623 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T21:03:23.655 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T21:03:23.686 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T21:03:23.691 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T21:03:23.716 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T21:03:23.738 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T21:03:23.743 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T21:03:23.770 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T21:03:23.773 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T21:03:23.786 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T21:03:23.801 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T21:03:23.817 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T21:03:23.823 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T21:03:23.859 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T21:03:23.863 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T21:03:23.904 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T21:03:23.944 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T21:03:23.974 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T21:03:23.997 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T21:03:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T21:03:24.033 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T21:03:24.075 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T21:03:24.109 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T21:03:24.194 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T21:03:24.198 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T21:03:24.237 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T21:03:24.248 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T21:03:24.304 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T21:03:24.340 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T21:03:24.378 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T21:03:24.411 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T21:03:24.426 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T21:03:24.451 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T21:03:24.472 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T21:03:24.476 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T21:03:24.559 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T21:03:24.687 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T21:03:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T21:03:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T21:03:24.796 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T21:03:24.834 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T21:03:24.866 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T21:03:24.896 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T21:03:24.931 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T21:03:24.964 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T21:03:25.006 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T21:03:25.040 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T21:03:25.127 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T21:03:25.170 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T21:03:25.201 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T21:03:25.230 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T21:03:25.272 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T21:03:25.305 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T21:03:25.306 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T21:03:25.361 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T21:03:25.409 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T21:03:25.461 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T21:03:25.506 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T21:03:25.596 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T21:03:25.633 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T21:03:25.824 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T21:03:25.854 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T21:03:25.934 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T21:03:26.087 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T21:03:26.133 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T21:03:26.152 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:03:26.166 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T21:03:26.180 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:03:26.268 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T21:03:26.321 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T21:03:26.366 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T21:03:26.453 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T21:03:26.485 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T21:03:26.620 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T21:03:26.669 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T21:03:26.710 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T21:03:26.739 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:03:26.739 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T21:03:26.776 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T21:03:26.787 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T21:03:26.868 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T21:03:26.868 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T21:03:26.868 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T21:03:26.868 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:03:26.910 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T21:03:27.422 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T21:03:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T21:03:28.053 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T21:03:28.139 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T21:03:28.168 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T21:03:28.201 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T21:03:28.549 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T21:03:28.597 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T21:03:28.672 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T21:03:28.702 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T21:03:28.739 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T21:03:28.747 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T21:03:28.838 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T21:03:28.866 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T21:03:28.899 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T21:03:29.223 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T21:03:29.259 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T21:03:29.271 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T21:03:29.291 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T21:03:29.361 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T21:03:29.362 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T21:03:29.384 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T21:03:29.392 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T21:03:29.427 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T21:03:29.925 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T21:03:29.948 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T21:03:30.019 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T21:03:30.050 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T21:03:32.130 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:03:32.164 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:03:32.350 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:03:32.388 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:03:32.765 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:03:32.800 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T21:03:32.897 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T21:03:32.897 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T21:03:32.897 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T21:03:32.897 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:03:32.935 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T21:03:32.947 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T21:03:32.983 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T21:03:33.076 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T21:03:33.076 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T21:03:33.076 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T21:03:33.077 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T21:03:33.109 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T21:03:39.089 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T21:03:39.089 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /sys 2024-09-10T21:03:39.089 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /proc 2024-09-10T21:03:39.089 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /mnt 2024-09-10T21:03:39.089 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /var/tmp 2024-09-10T21:03:39.089 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /home 2024-09-10T21:03:39.089 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /root 2024-09-10T21:03:39.090 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /tmp 2024-09-10T21:03:39.090 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:03:39.271 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T21:03:39.287 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T21:03:39.288 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:39.288 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T21:03:39.288 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:03:40.782 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T21:03:40.809 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T21:03:40.809 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:40.809 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T21:03:40.809 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T21:03:40.810 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T21:03:40.810 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:03:41.033 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T21:03:41.057 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T21:03:41.057 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:41.057 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T21:03:41.057 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T21:03:41.057 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T21:03:41.057 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:03:41.500 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T21:03:41.524 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T21:03:41.524 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:41.524 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T21:03:41.524 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T21:03:41.524 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T21:03:41.524 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:03:41.639 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T21:03:41.696 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T21:03:41.760 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T21:03:41.948 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T21:03:42.001 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T21:03:42.079 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T21:03:42.169 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T21:03:42.327 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T21:03:42.376 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T21:03:42.425 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T21:03:42.452 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T21:03:42.865 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T21:03:42.892 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T21:03:42.924 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T21:03:42.983 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T21:03:43.007 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T21:03:45.055 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T21:03:45.055 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /sys 2024-09-10T21:03:45.055 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /proc 2024-09-10T21:03:45.055 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /mnt 2024-09-10T21:03:45.055 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /var/tmp 2024-09-10T21:03:45.055 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /home 2024-09-10T21:03:45.055 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /root 2024-09-10T21:03:45.055 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /tmp 2024-09-10T21:03:45.055 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:03:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T21:03:45.164 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2024-09-10T21:03:45.164 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2024-09-10T21:03:45.164 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2024-09-10T21:03:45.164 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2024-09-10T21:03:45.164 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2024-09-10T21:03:45.165 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /root 2024-09-10T21:03:45.165 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2024-09-10T21:03:45.165 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T21:03:45.246 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T21:03:45.263 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T21:03:45.263 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:45.263 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T21:03:45.263 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:03:45.345 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T21:03:45.362 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T21:03:45.363 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:45.363 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T21:03:45.363 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T21:03:46.227 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T21:03:46.288 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T21:03:46.824 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T21:03:46.853 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T21:03:46.853 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:46.853 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T21:03:46.853 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T21:03:46.853 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T21:03:46.853 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:03:46.881 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T21:03:46.909 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T21:03:46.909 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:46.909 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T21:03:46.909 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T21:03:46.909 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T21:03:46.909 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T21:03:47.100 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T21:03:47.125 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T21:03:47.125 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:47.125 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T21:03:47.125 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T21:03:47.125 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T21:03:47.125 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:03:47.140 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T21:03:47.164 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T21:03:47.164 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:47.164 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T21:03:47.164 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T21:03:47.164 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T21:03:47.164 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T21:03:47.254 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T21:03:47.280 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T21:03:47.398 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T21:03:47.567 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T21:03:47.590 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T21:03:47.601 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T21:03:47.615 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T21:03:47.615 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:47.615 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T21:03:47.615 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T21:03:47.615 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T21:03:47.615 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:03:47.616 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T21:03:47.626 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T21:03:47.626 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:47.626 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T21:03:47.626 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T21:03:47.626 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T21:03:47.626 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:03:47.640 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T21:03:47.640 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:47.640 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T21:03:47.640 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T21:03:47.640 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T21:03:47.641 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T21:03:47.666 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T21:03:47.678 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T21:03:47.732 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T21:03:47.746 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T21:03:47.776 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T21:03:47.789 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T21:03:47.803 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T21:03:47.823 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T21:03:47.853 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T21:03:47.858 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T21:03:48.047 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T21:03:48.055 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T21:03:48.092 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T21:03:48.101 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T21:03:48.169 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T21:03:48.182 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T21:03:48.258 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T21:03:48.272 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T21:03:48.416 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T21:03:48.421 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T21:03:48.458 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T21:03:48.485 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T21:03:48.499 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T21:03:48.517 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T21:03:48.526 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T21:03:48.544 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T21:03:48.781 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T21:03:48.810 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T21:03:48.835 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T21:03:48.835 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:48.835 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T21:03:48.835 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T21:03:48.835 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T21:03:48.835 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:03:48.878 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T21:03:48.901 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T21:03:48.901 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:48.901 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T21:03:48.901 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:03:48.945 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T21:03:48.969 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T21:03:48.969 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:48.969 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T21:03:48.969 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T21:03:48.969 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T21:03:48.969 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:03:48.989 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T21:03:48.994 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T21:03:49.016 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T21:03:49.017 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T21:03:49.048 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T21:03:49.058 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T21:03:49.124 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T21:03:49.127 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T21:03:49.155 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T21:03:49.156 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T21:03:49.279 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T21:03:49.303 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T21:03:49.303 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:49.303 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T21:03:49.303 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T21:03:49.303 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T21:03:49.303 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:03:52.391 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T21:03:52.454 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T21:03:52.519 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T21:03:52.587 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T21:03:53.428 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T21:03:53.462 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T21:03:53.579 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T21:03:53.601 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T21:03:53.629 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T21:03:53.752 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T21:03:53.784 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T21:03:53.814 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T21:03:53.839 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T21:03:53.839 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:53.839 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T21:03:53.839 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T21:03:53.839 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T21:03:53.839 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T21:03:53.890 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T21:03:53.903 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T21:03:53.915 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T21:03:53.939 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T21:03:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T21:03:53.964 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:53.965 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T21:03:53.965 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T21:03:53.965 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T21:03:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:03:53.966 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T21:03:54.000 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T21:03:54.007 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T21:03:54.015 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T21:03:54.027 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T21:03:54.048 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T21:03:54.063 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T21:03:54.080 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T21:03:54.107 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T21:03:54.132 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T21:03:54.186 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T21:03:54.293 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T21:03:54.338 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T21:03:54.367 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T21:03:54.397 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T21:03:54.435 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T21:03:55.042 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T21:03:55.071 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:03:55.076 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T21:03:55.101 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T21:03:55.101 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:55.101 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T21:03:55.101 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T21:03:55.101 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T21:03:55.101 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T21:03:55.107 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:03:55.129 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:03:55.143 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T21:03:55.166 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T21:03:55.166 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:55.167 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T21:03:55.167 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T21:03:55.196 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T21:03:55.219 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T21:03:55.226 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T21:03:55.243 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T21:03:55.243 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:55.243 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T21:03:55.243 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T21:03:55.243 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T21:03:55.244 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T21:03:55.251 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T21:03:55.251 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:55.251 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T21:03:55.251 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T21:03:55.251 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T21:03:55.251 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:03:55.293 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T21:03:55.318 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T21:03:55.318 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:55.318 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T21:03:55.318 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:03:55.385 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T21:03:55.410 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T21:03:55.410 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:55.410 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T21:03:55.410 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T21:03:55.410 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T21:03:55.410 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:03:55.561 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T21:03:55.585 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T21:03:55.585 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:55.585 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T21:03:55.585 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T21:03:55.586 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T21:03:55.586 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T21:03:55.736 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T21:03:55.761 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T21:03:55.761 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T21:03:55.761 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T21:03:55.761 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T21:03:55.761 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T21:03:55.761 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:03:55.974 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T21:03:56.070 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T21:03:56.111 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T21:03:56.202 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T21:03:56.232 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T21:03:56.257 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T21:03:56.283 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T21:03:56.283 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T21:03:56.375 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T21:03:56.376 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T21:03:56.459 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T21:03:56.484 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T21:03:56.490 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:03:56.490 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:03:56.669 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:03:56.670 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T21:03:56.754 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T21:03:56.818 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:04:00.311 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T21:04:00.356 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T21:04:00.405 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T21:04:00.446 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T21:04:00.473 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T21:04:00.657 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T21:04:00.711 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T21:04:00.733 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T21:04:00.741 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T21:04:00.771 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T21:04:00.790 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T21:04:00.817 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T21:04:00.831 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T21:04:00.862 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T21:04:00.890 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T21:04:01.088 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T21:04:01.136 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T21:04:01.166 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T21:04:01.196 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T21:04:01.242 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T21:04:01.421 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:04:01.476 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:04:01.497 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:04:01.837 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:04:01.872 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:04:01.893 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T21:04:02.356 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T21:04:02.453 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T21:04:02.494 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T21:04:02.575 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T21:04:02.614 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T21:04:02.639 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T21:04:02.673 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T21:04:02.674 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T21:04:02.766 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T21:04:02.766 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T21:04:02.792 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T21:04:02.851 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T21:04:02.876 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T21:04:02.881 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:04:02.881 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:04:02.893 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T21:04:02.942 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T21:04:03.028 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T21:04:03.063 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T21:04:03.069 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:04:03.069 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T21:04:03.088 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T21:04:03.114 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T21:04:03.114 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T21:04:03.153 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T21:04:03.181 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:04:03.181 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T21:04:03.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T21:04:03.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T21:04:03.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T21:04:03.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T21:04:03.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T21:04:03.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T21:04:03.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:04:03.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:04:03.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T21:04:03.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T21:04:03.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T21:04:03.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T21:04:03.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:04:03.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T21:04:03.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T21:04:03.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T21:04:03.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T21:04:03.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T21:04:03.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T21:04:03.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T21:04:03.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T21:04:03.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T21:04:03.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T21:04:03.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T21:04:03.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T21:04:03.184 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T21:04:03.184 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T21:04:03.184 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T21:04:03.195 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T21:04:03.196 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T21:04:03.196 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T21:04:03.196 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T21:04:03.196 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T21:04:03.196 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T21:04:03.196 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T21:04:03.196 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T21:04:03.196 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T21:04:03.196 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T21:04:03.196 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T21:04:03.196 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T21:04:03.196 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T21:04:03.197 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T21:04:03.197 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T21:04:03.197 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T21:04:03.197 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T21:04:03.197 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T21:04:03.197 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T21:04:03.197 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T21:04:03.197 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T21:04:03.197 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T21:04:03.197 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T21:04:03.197 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T21:04:03.197 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T21:04:03.197 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T21:04:03.198 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T21:04:03.198 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T21:04:03.198 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T21:04:03.198 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T21:04:03.198 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T21:04:03.198 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T21:04:03.198 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T21:04:03.198 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T21:04:03.198 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T21:04:03.198 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T21:04:03.198 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T21:04:03.198 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T21:04:03.198 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T21:04:03.199 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T21:04:03.199 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T21:04:03.199 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T21:04:03.199 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T21:04:03.199 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T21:04:03.199 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T21:04:03.199 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T21:04:03.199 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T21:04:03.199 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T21:04:03.199 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T21:04:03.199 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T21:04:03.199 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T21:04:03.199 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T21:04:03.199 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T21:04:03.200 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T21:04:03.200 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T21:04:03.200 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T21:04:03.200 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T21:04:03.200 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T21:04:03.200 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T21:04:03.200 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T21:04:03.200 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T21:04:03.200 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T21:04:03.200 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T21:04:03.200 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T21:04:03.200 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T21:04:03.200 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T21:04:03.201 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T21:04:03.201 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T21:04:03.201 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T21:04:03.201 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T21:04:03.201 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T21:04:03.201 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T21:04:03.201 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T21:04:03.201 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T21:04:03.201 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T21:04:03.201 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T21:04:03.201 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T21:04:03.201 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T21:04:03.201 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T21:04:03.202 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T21:04:03.202 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T21:04:03.202 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T21:04:03.202 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T21:04:03.202 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T21:04:03.202 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T21:04:03.202 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T21:04:03.202 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T21:04:03.202 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T21:04:03.202 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T21:04:03.202 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T21:04:03.202 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T21:04:03.202 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T21:04:03.203 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T21:04:03.203 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T21:04:03.203 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T21:04:03.203 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T21:04:03.203 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T21:04:03.203 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T21:04:03.203 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T21:04:03.203 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T21:04:03.203 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T21:04:03.204 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T21:04:03.204 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T21:04:03.204 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T21:04:03.204 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T21:04:03.204 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T21:04:03.204 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T21:04:03.204 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T21:04:03.204 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T21:04:03.204 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T21:04:03.204 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T21:04:03.204 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T21:04:03.204 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T21:04:03.204 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T21:04:03.205 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T21:04:03.205 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T21:04:03.205 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T21:04:03.205 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T21:04:03.205 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T21:04:03.205 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T21:04:03.205 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T21:04:03.205 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T21:04:03.205 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T21:04:03.205 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T21:04:03.205 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T21:04:03.205 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T21:04:03.206 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T21:04:03.206 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T21:04:03.206 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T21:04:03.206 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T21:04:03.206 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T21:04:03.206 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T21:04:03.206 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T21:04:03.206 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T21:04:03.206 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T21:04:03.207 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T21:04:03.207 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T21:04:03.224 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:04:03.299 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T21:04:03.324 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T21:04:03.329 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:04:03.329 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:04:03.517 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T21:04:03.517 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T21:04:03.585 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T21:04:03.653 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:04:05.714 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:04:05.714 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:04:05.714 INFO:teuthology.orchestra.run.smithi192.stdout:Upgraded: 2024-09-10T21:04:05.714 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:05.714 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:05.714 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:05.714 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:05.714 INFO:teuthology.orchestra.run.smithi192.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.715 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.715 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T21:04:05.715 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T21:04:05.715 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-10T21:04:05.715 INFO:teuthology.orchestra.run.smithi192.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T21:04:05.715 INFO:teuthology.orchestra.run.smithi192.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T21:04:05.715 INFO:teuthology.orchestra.run.smithi192.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T21:04:05.715 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T21:04:05.715 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.715 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.715 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.715 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.716 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:05.716 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.716 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.716 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.716 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:05.716 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:05.716 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:05.716 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:05.716 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:05.716 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.716 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.717 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:05.717 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.717 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.717 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.717 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:05.717 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:05.717 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.717 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.717 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:05.717 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T21:04:05.717 INFO:teuthology.orchestra.run.smithi192.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T21:04:05.717 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T21:04:05.718 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T21:04:05.718 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T21:04:05.718 INFO:teuthology.orchestra.run.smithi192.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T21:04:05.718 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T21:04:05.718 INFO:teuthology.orchestra.run.smithi192.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T21:04:05.718 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T21:04:05.718 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T21:04:05.718 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T21:04:05.718 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.718 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.718 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.718 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T21:04:05.718 INFO:teuthology.orchestra.run.smithi192.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T21:04:05.719 INFO:teuthology.orchestra.run.smithi192.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T21:04:05.719 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T21:04:05.719 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T21:04:05.719 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T21:04:05.719 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.719 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.719 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T21:04:05.719 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.719 INFO:teuthology.orchestra.run.smithi192.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T21:04:05.719 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T21:04:05.719 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T21:04:05.719 INFO:teuthology.orchestra.run.smithi192.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T21:04:05.719 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T21:04:05.720 INFO:teuthology.orchestra.run.smithi192.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T21:04:05.720 INFO:teuthology.orchestra.run.smithi192.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T21:04:05.720 INFO:teuthology.orchestra.run.smithi192.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T21:04:05.720 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T21:04:05.720 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T21:04:05.720 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T21:04:05.720 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T21:04:05.720 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T21:04:05.720 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T21:04:05.720 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T21:04:05.720 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T21:04:05.720 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T21:04:05.720 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T21:04:05.721 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T21:04:05.721 INFO:teuthology.orchestra.run.smithi192.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T21:04:05.721 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T21:04:05.721 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T21:04:05.721 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T21:04:05.721 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.721 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.721 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.721 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T21:04:05.721 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T21:04:05.721 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T21:04:05.721 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T21:04:05.721 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T21:04:05.722 INFO:teuthology.orchestra.run.smithi192.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T21:04:05.722 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T21:04:05.722 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T21:04:05.722 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T21:04:05.722 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T21:04:05.722 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T21:04:05.722 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T21:04:05.722 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T21:04:05.722 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T21:04:05.722 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T21:04:05.722 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T21:04:05.722 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T21:04:05.722 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T21:04:05.722 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T21:04:05.723 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T21:04:05.723 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T21:04:05.723 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T21:04:05.723 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T21:04:05.723 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T21:04:05.723 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T21:04:05.723 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T21:04:05.723 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T21:04:05.723 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T21:04:05.723 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T21:04:05.723 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T21:04:05.723 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T21:04:05.723 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T21:04:05.724 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T21:04:05.724 INFO:teuthology.orchestra.run.smithi192.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T21:04:05.724 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T21:04:05.724 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T21:04:05.724 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T21:04:05.724 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T21:04:05.724 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T21:04:05.724 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T21:04:05.724 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.724 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.724 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T21:04:05.724 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T21:04:05.725 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T21:04:05.725 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.725 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T21:04:05.725 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T21:04:05.725 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T21:04:05.725 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T21:04:05.725 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T21:04:05.725 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T21:04:05.725 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T21:04:05.725 INFO:teuthology.orchestra.run.smithi192.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T21:04:05.725 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T21:04:05.725 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T21:04:05.725 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T21:04:05.726 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T21:04:05.726 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T21:04:05.726 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T21:04:05.726 INFO:teuthology.orchestra.run.smithi192.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T21:04:05.726 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.726 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.726 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:05.726 INFO:teuthology.orchestra.run.smithi192.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T21:04:05.726 INFO:teuthology.orchestra.run.smithi192.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T21:04:05.726 INFO:teuthology.orchestra.run.smithi192.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T21:04:05.726 INFO:teuthology.orchestra.run.smithi192.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T21:04:05.726 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T21:04:05.726 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T21:04:05.727 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T21:04:05.727 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:04:05.727 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-10T21:04:06.116 DEBUG:teuthology.parallel:result is None 2024-09-10T21:04:09.672 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:04:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T21:04:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T21:04:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T21:04:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T21:04:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T21:04:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T21:04:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T21:04:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:04:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:04:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T21:04:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T21:04:09.673 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T21:04:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T21:04:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:04:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T21:04:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T21:04:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T21:04:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T21:04:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T21:04:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T21:04:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T21:04:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T21:04:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T21:04:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T21:04:09.674 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T21:04:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T21:04:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T21:04:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T21:04:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T21:04:09.675 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T21:04:09.687 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T21:04:09.687 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T21:04:09.687 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T21:04:09.687 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T21:04:09.687 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T21:04:09.687 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T21:04:09.687 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T21:04:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T21:04:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T21:04:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T21:04:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T21:04:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T21:04:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T21:04:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T21:04:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T21:04:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T21:04:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T21:04:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T21:04:09.688 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T21:04:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T21:04:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T21:04:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T21:04:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T21:04:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T21:04:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T21:04:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T21:04:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T21:04:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T21:04:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T21:04:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T21:04:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T21:04:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T21:04:09.689 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T21:04:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T21:04:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T21:04:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T21:04:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T21:04:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T21:04:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T21:04:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T21:04:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T21:04:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T21:04:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T21:04:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T21:04:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T21:04:09.690 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T21:04:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T21:04:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T21:04:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T21:04:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T21:04:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T21:04:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T21:04:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T21:04:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T21:04:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T21:04:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T21:04:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T21:04:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T21:04:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T21:04:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T21:04:09.691 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T21:04:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T21:04:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T21:04:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T21:04:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T21:04:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T21:04:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T21:04:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T21:04:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T21:04:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T21:04:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T21:04:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T21:04:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T21:04:09.692 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T21:04:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T21:04:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T21:04:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T21:04:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T21:04:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T21:04:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T21:04:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T21:04:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T21:04:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T21:04:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T21:04:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T21:04:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T21:04:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T21:04:09.693 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T21:04:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T21:04:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T21:04:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T21:04:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T21:04:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T21:04:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T21:04:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T21:04:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T21:04:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T21:04:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T21:04:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T21:04:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T21:04:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T21:04:09.694 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T21:04:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T21:04:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T21:04:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T21:04:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T21:04:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T21:04:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T21:04:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T21:04:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T21:04:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T21:04:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T21:04:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T21:04:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T21:04:09.695 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T21:04:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T21:04:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T21:04:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T21:04:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T21:04:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T21:04:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T21:04:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T21:04:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T21:04:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T21:04:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T21:04:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T21:04:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T21:04:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T21:04:09.696 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T21:04:09.697 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T21:04:09.697 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T21:04:09.697 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T21:04:09.697 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T21:04:09.697 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T21:04:09.757 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:04:09.757 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T21:04:09.757 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T21:04:09.758 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T21:04:09.758 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T21:04:09.758 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T21:04:09.758 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T21:04:09.758 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T21:04:09.758 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T21:04:09.758 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T21:04:09.758 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T21:04:09.758 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T21:04:09.758 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T21:04:09.758 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T21:04:09.758 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T21:04:09.758 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T21:04:09.758 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T21:04:09.759 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T21:04:09.759 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T21:04:09.759 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T21:04:09.759 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T21:04:09.759 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T21:04:09.759 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T21:04:09.759 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T21:04:09.759 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T21:04:09.759 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T21:04:09.759 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T21:04:09.759 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T21:04:09.759 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T21:04:09.759 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T21:04:09.760 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T21:04:09.760 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T21:04:09.773 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T21:04:09.773 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T21:04:09.773 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T21:04:09.773 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T21:04:09.773 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T21:04:09.773 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T21:04:09.773 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T21:04:09.773 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T21:04:09.774 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T21:04:09.774 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T21:04:09.774 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T21:04:09.774 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T21:04:09.774 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T21:04:09.774 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T21:04:09.774 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T21:04:09.774 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T21:04:09.774 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T21:04:09.774 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T21:04:09.774 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T21:04:09.774 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T21:04:09.774 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T21:04:09.775 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T21:04:09.775 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T21:04:09.775 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T21:04:09.775 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T21:04:09.775 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T21:04:09.775 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T21:04:09.775 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T21:04:09.775 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T21:04:09.775 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T21:04:09.775 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T21:04:09.775 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T21:04:09.775 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T21:04:09.775 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T21:04:09.776 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T21:04:09.776 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T21:04:09.776 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T21:04:09.776 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T21:04:09.776 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T21:04:09.776 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T21:04:09.776 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T21:04:09.776 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T21:04:09.776 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T21:04:09.776 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T21:04:09.776 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T21:04:09.776 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T21:04:09.777 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T21:04:09.777 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T21:04:09.777 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T21:04:09.777 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T21:04:09.777 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T21:04:09.777 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T21:04:09.777 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T21:04:09.777 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T21:04:09.777 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T21:04:09.777 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T21:04:09.777 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T21:04:09.777 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T21:04:09.777 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T21:04:09.777 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T21:04:09.778 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T21:04:09.778 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T21:04:09.778 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T21:04:09.778 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T21:04:09.778 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T21:04:09.778 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T21:04:09.778 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T21:04:09.778 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T21:04:09.778 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T21:04:09.778 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T21:04:09.778 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T21:04:09.778 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T21:04:09.778 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T21:04:09.778 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T21:04:09.779 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T21:04:09.779 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T21:04:09.779 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T21:04:09.779 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T21:04:09.779 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T21:04:09.779 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T21:04:09.779 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T21:04:09.779 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T21:04:09.779 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T21:04:09.779 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T21:04:09.779 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T21:04:09.779 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T21:04:09.779 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T21:04:09.779 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T21:04:09.780 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T21:04:09.780 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T21:04:09.780 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T21:04:09.780 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T21:04:09.780 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T21:04:09.780 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T21:04:09.780 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T21:04:09.780 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T21:04:09.780 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T21:04:09.780 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T21:04:09.780 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T21:04:09.780 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T21:04:09.780 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T21:04:09.780 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T21:04:09.781 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T21:04:09.781 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T21:04:09.781 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T21:04:09.781 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T21:04:09.781 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T21:04:09.781 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T21:04:09.781 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T21:04:09.781 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T21:04:09.781 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T21:04:09.781 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T21:04:09.781 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T21:04:09.781 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T21:04:09.781 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T21:04:09.782 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T21:04:09.782 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T21:04:09.782 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T21:04:09.782 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T21:04:09.782 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T21:04:09.782 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T21:04:09.782 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T21:04:09.782 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T21:04:09.782 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T21:04:09.782 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T21:04:09.782 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T21:04:09.782 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T21:04:09.782 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T21:04:09.782 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T21:04:09.782 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T21:04:09.783 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T21:04:09.783 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T21:04:09.783 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T21:04:12.405 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:04:12.405 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:04:12.405 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2024-09-10T21:04:12.405 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:12.405 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:12.405 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:12.405 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:12.405 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.405 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.406 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T21:04:12.406 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T21:04:12.406 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-10T21:04:12.406 INFO:teuthology.orchestra.run.smithi059.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T21:04:12.406 INFO:teuthology.orchestra.run.smithi059.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T21:04:12.406 INFO:teuthology.orchestra.run.smithi059.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T21:04:12.406 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T21:04:12.406 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.406 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.406 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.406 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.406 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.407 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.407 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.407 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.407 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.407 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.407 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.407 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.407 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.407 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.407 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.407 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.407 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T21:04:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T21:04:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T21:04:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T21:04:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T21:04:12.408 INFO:teuthology.orchestra.run.smithi059.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T21:04:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T21:04:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T21:04:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T21:04:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T21:04:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T21:04:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T21:04:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T21:04:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T21:04:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T21:04:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T21:04:12.409 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T21:04:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T21:04:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T21:04:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T21:04:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T21:04:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T21:04:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T21:04:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T21:04:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T21:04:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T21:04:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T21:04:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T21:04:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T21:04:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T21:04:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T21:04:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T21:04:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T21:04:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T21:04:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T21:04:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T21:04:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T21:04:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T21:04:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T21:04:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T21:04:12.411 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T21:04:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T21:04:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T21:04:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T21:04:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T21:04:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T21:04:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T21:04:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T21:04:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T21:04:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T21:04:12.412 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T21:04:12.413 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T21:04:12.413 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T21:04:12.413 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T21:04:12.413 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T21:04:12.413 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T21:04:12.413 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T21:04:12.416 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T21:04:12.416 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T21:04:12.416 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T21:04:12.416 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T21:04:12.416 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T21:04:12.416 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T21:04:12.416 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T21:04:12.416 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T21:04:12.416 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T21:04:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T21:04:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T21:04:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T21:04:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T21:04:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T21:04:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T21:04:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T21:04:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T21:04:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T21:04:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T21:04:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T21:04:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T21:04:12.417 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T21:04:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T21:04:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T21:04:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T21:04:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T21:04:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T21:04:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T21:04:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T21:04:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T21:04:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T21:04:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T21:04:12.418 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T21:04:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T21:04:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T21:04:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T21:04:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T21:04:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T21:04:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T21:04:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T21:04:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T21:04:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T21:04:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.419 INFO:teuthology.orchestra.run.smithi059.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T21:04:12.420 INFO:teuthology.orchestra.run.smithi059.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T21:04:12.420 INFO:teuthology.orchestra.run.smithi059.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T21:04:12.420 INFO:teuthology.orchestra.run.smithi059.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T21:04:12.420 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T21:04:12.420 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T21:04:12.420 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T21:04:12.421 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:04:12.421 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-10T21:04:12.421 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T21:04:12.421 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T21:04:12.421 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2024-09-10T21:04:12.421 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:12.421 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:12.421 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:12.421 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T21:04:12.421 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.422 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.422 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T21:04:12.422 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T21:04:12.422 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-09-10T21:04:12.422 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T21:04:12.422 INFO:teuthology.orchestra.run.smithi154.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T21:04:12.422 INFO:teuthology.orchestra.run.smithi154.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T21:04:12.422 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T21:04:12.422 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.422 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.422 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.422 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.422 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.422 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.423 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.423 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.423 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.423 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.423 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.423 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.423 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.423 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.423 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.423 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.424 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.424 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.424 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.424 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.424 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.424 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.424 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.424 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T21:04:12.424 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T21:04:12.424 INFO:teuthology.orchestra.run.smithi154.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T21:04:12.424 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T21:04:12.424 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T21:04:12.425 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T21:04:12.425 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T21:04:12.425 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T21:04:12.425 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T21:04:12.425 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T21:04:12.425 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T21:04:12.425 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T21:04:12.425 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.425 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.425 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.425 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T21:04:12.425 INFO:teuthology.orchestra.run.smithi154.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T21:04:12.425 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T21:04:12.425 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T21:04:12.426 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T21:04:12.426 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T21:04:12.426 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.426 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.426 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T21:04:12.426 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.426 INFO:teuthology.orchestra.run.smithi154.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T21:04:12.426 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T21:04:12.426 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T21:04:12.426 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T21:04:12.426 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T21:04:12.426 INFO:teuthology.orchestra.run.smithi154.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T21:04:12.426 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T21:04:12.427 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T21:04:12.427 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T21:04:12.427 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T21:04:12.427 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T21:04:12.427 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T21:04:12.427 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T21:04:12.427 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T21:04:12.427 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T21:04:12.427 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T21:04:12.427 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T21:04:12.427 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T21:04:12.427 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T21:04:12.427 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T21:04:12.428 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T21:04:12.428 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T21:04:12.428 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T21:04:12.428 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.428 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.428 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.428 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T21:04:12.428 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T21:04:12.428 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T21:04:12.428 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T21:04:12.428 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T21:04:12.428 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T21:04:12.428 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T21:04:12.428 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T21:04:12.429 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T21:04:12.429 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T21:04:12.429 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T21:04:12.429 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T21:04:12.429 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T21:04:12.429 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T21:04:12.429 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T21:04:12.429 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T21:04:12.429 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T21:04:12.429 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T21:04:12.429 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T21:04:12.429 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T21:04:12.429 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T21:04:12.429 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T21:04:12.430 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T21:04:12.430 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T21:04:12.430 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T21:04:12.430 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T21:04:12.430 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T21:04:12.430 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T21:04:12.430 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T21:04:12.430 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T21:04:12.430 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T21:04:12.430 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T21:04:12.430 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T21:04:12.430 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T21:04:12.430 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T21:04:12.431 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T21:04:12.431 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T21:04:12.431 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T21:04:12.431 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T21:04:12.431 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T21:04:12.431 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.431 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.431 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T21:04:12.431 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T21:04:12.431 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T21:04:12.431 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.431 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T21:04:12.431 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T21:04:12.431 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T21:04:12.432 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T21:04:12.432 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T21:04:12.432 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T21:04:12.432 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T21:04:12.432 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T21:04:12.432 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T21:04:12.432 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T21:04:12.432 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T21:04:12.432 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T21:04:12.432 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T21:04:12.432 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T21:04:12.432 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T21:04:12.432 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.432 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.433 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T21:04:12.433 INFO:teuthology.orchestra.run.smithi154.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T21:04:12.433 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T21:04:12.433 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T21:04:12.433 INFO:teuthology.orchestra.run.smithi154.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T21:04:12.433 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T21:04:12.433 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T21:04:12.433 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T21:04:12.433 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T21:04:12.433 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-09-10T21:04:12.850 DEBUG:teuthology.parallel:result is None 2024-09-10T21:04:12.955 DEBUG:teuthology.parallel:result is None 2024-09-10T21:04:12.956 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:04:13.116 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T21:04:13.141 INFO:teuthology.orchestra.run.smithi059.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T21:04:13.142 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T21:04:13.142 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T21:04:13.143 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:04:13.290 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T21:04:13.314 INFO:teuthology.orchestra.run.smithi154.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T21:04:13.314 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T21:04:13.314 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T21:04:13.316 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:04:13.463 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T21:04:13.490 INFO:teuthology.orchestra.run.smithi192.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T21:04:13.490 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T21:04:13.490 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T21:04:13.492 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T21:04:13.492 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T21:04:13.492 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T21:04:13.526 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T21:04:13.526 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T21:04:13.556 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T21:04:13.556 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T21:04:13.588 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T21:04:13.588 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T21:04:13.588 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T21:04:13.619 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T21:04:13.689 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T21:04:13.690 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T21:04:13.715 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T21:04:13.782 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T21:04:13.782 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T21:04:13.811 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T21:04:13.879 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T21:04:13.879 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T21:04:13.880 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T21:04:13.910 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T21:04:13.979 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T21:04:13.980 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T21:04:14.005 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T21:04:14.071 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T21:04:14.072 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T21:04:14.101 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T21:04:14.169 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T21:04:14.170 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T21:04:14.170 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T21:04:14.201 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T21:04:14.270 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T21:04:14.271 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T21:04:14.297 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T21:04:14.362 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T21:04:14.362 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T21:04:14.390 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T21:04:14.458 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T21:04:14.560 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-10T21:04:14.560 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:04:14.561 INFO:tasks.cephadm:Cluster fsid is 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:04:14.561 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T21:04:14.561 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.59', 'mon.b': '172.21.15.154', 'mon.c': '172.21.15.192'} 2024-09-10T21:04:14.561 INFO:tasks.cephadm:First mon is mon.a on smithi059 2024-09-10T21:04:14.561 INFO:tasks.cephadm:First mgr is x 2024-09-10T21:04:14.562 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T21:04:14.562 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname $(hostname -s) 2024-09-10T21:04:14.593 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname $(hostname -s) 2024-09-10T21:04:14.620 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname $(hostname -s) 2024-09-10T21:04:14.648 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-10T21:04:14.649 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:04:14.800 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82938/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4854-g8f219c47', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4854.g8f219c47'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 09:27:13.215997', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-hemanth-testing-2024-09-10-0723', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-10T21:04:14.947 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-hemanth-testing-2024-09-10-0723, sha1 8f219c476cb4f26fc5719c661c0323719a45cb30 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:04:14.949 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T21:04:14.949 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T21:04:14.949 DEBUG:teuthology.orchestra.run.smithi059:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T21:04:15.334 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 21:04 /home/ubuntu/cephtest/cephadm 2024-09-10T21:04:15.334 DEBUG:teuthology.orchestra.run.smithi154:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T21:04:15.707 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 21:04 /home/ubuntu/cephtest/cephadm 2024-09-10T21:04:15.708 DEBUG:teuthology.orchestra.run.smithi192:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T21:04:16.064 INFO:teuthology.orchestra.run.smithi192.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 21:04 /home/ubuntu/cephtest/cephadm 2024-09-10T21:04:16.064 DEBUG:teuthology.orchestra.run.smithi059:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T21:04:16.085 DEBUG:teuthology.orchestra.run.smithi154:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T21:04:16.105 DEBUG:teuthology.orchestra.run.smithi192:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T21:04:16.144 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 on all hosts... 2024-09-10T21:04:16.144 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T21:04:16.146 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T21:04:16.149 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T21:04:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T21:04:17.774 INFO:teuthology.orchestra.run.smithi192.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T21:04:17.794 INFO:teuthology.orchestra.run.smithi154.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T21:04:51.057 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-10T21:04:51.057 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T21:04:51.058 INFO:teuthology.orchestra.run.smithi192.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T21:04:51.058 INFO:teuthology.orchestra.run.smithi192.stdout: "repo_digests": [ 2024-09-10T21:04:51.058 INFO:teuthology.orchestra.run.smithi192.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T21:04:51.058 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-10T21:04:51.058 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-10T21:04:52.501 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:04:52.501 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T21:04:52.502 INFO:teuthology.orchestra.run.smithi059.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T21:04:52.502 INFO:teuthology.orchestra.run.smithi059.stdout: "repo_digests": [ 2024-09-10T21:04:52.502 INFO:teuthology.orchestra.run.smithi059.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T21:04:52.502 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T21:04:52.502 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:05:06.047 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-10T21:05:06.047 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T21:05:06.047 INFO:teuthology.orchestra.run.smithi154.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T21:05:06.047 INFO:teuthology.orchestra.run.smithi154.stdout: "repo_digests": [ 2024-09-10T21:05:06.047 INFO:teuthology.orchestra.run.smithi154.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T21:05:06.047 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-09-10T21:05:06.047 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-10T21:05:06.072 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph 2024-09-10T21:05:06.107 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph 2024-09-10T21:05:06.135 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph 2024-09-10T21:05:06.169 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /etc/ceph 2024-09-10T21:05:06.199 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /etc/ceph 2024-09-10T21:05:06.224 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /etc/ceph 2024-09-10T21:05:06.253 INFO:tasks.cephadm:Writing seed config... 2024-09-10T21:05:06.254 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-10T21:05:06.254 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-10T21:05:06.254 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-10T21:05:06.255 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-10T21:05:06.255 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T21:05:06.255 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T21:05:06.255 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T21:05:06.255 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T21:05:06.255 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T21:05:06.255 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T21:05:06.255 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T21:05:06.255 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-10T21:05:06.255 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-10T21:05:06.255 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-10T21:05:06.255 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-10T21:05:06.255 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-10T21:05:06.255 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-10T21:05:06.256 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-10T21:05:06.256 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T21:05:06.256 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T21:05:06.256 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-10T21:05:06.256 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-10T21:05:06.256 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-10T21:05:06.256 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-10T21:05:06.256 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-10T21:05:06.256 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-10T21:05:06.256 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-10T21:05:06.256 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-10T21:05:06.257 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T21:05:06.257 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T21:05:06.275 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 3c26b952-6fb8-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2024-09-10T21:05:06.276 DEBUG:teuthology.orchestra.run.smithi059:mon.a> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mon.a.service 2024-09-10T21:05:06.318 DEBUG:teuthology.orchestra.run.smithi059:mgr.x> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mgr.x.service 2024-09-10T21:05:06.360 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T21:05:06.361 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 -v bootstrap --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.59 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T21:05:06.578 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-10T21:05:06.578 INFO:teuthology.orchestra.run.smithi059.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', '-v', 'bootstrap', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.59', '--skip-admin-label'] 2024-09-10T21:05:06.579 INFO:teuthology.orchestra.run.smithi059.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T21:05:06.579 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying podman|docker is present... 2024-09-10T21:05:06.604 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stdout 5.2.2 2024-09-10T21:05:06.604 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying lvm2 is present... 2024-09-10T21:05:06.604 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying time synchronization is in place... 2024-09-10T21:05:06.612 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T21:05:06.612 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T21:05:06.619 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T21:05:06.619 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout inactive 2024-09-10T21:05:06.626 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout enabled 2024-09-10T21:05:06.633 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout active 2024-09-10T21:05:06.634 INFO:teuthology.orchestra.run.smithi059.stdout:Unit chronyd.service is enabled and running 2024-09-10T21:05:06.634 INFO:teuthology.orchestra.run.smithi059.stdout:Repeating the final host check... 2024-09-10T21:05:06.658 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stdout 5.2.2 2024-09-10T21:05:06.658 INFO:teuthology.orchestra.run.smithi059.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T21:05:06.658 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl is present 2024-09-10T21:05:06.658 INFO:teuthology.orchestra.run.smithi059.stdout:lvcreate is present 2024-09-10T21:05:06.665 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T21:05:06.665 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T21:05:06.672 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T21:05:06.672 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout inactive 2024-09-10T21:05:06.680 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout enabled 2024-09-10T21:05:06.687 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout active 2024-09-10T21:05:06.687 INFO:teuthology.orchestra.run.smithi059.stdout:Unit chronyd.service is enabled and running 2024-09-10T21:05:06.687 INFO:teuthology.orchestra.run.smithi059.stdout:Host looks OK 2024-09-10T21:05:06.687 INFO:teuthology.orchestra.run.smithi059.stdout:Cluster fsid: 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:05:06.688 INFO:teuthology.orchestra.run.smithi059.stdout:Acquiring lock 140305740645232 on /run/cephadm/3c26b952-6fb8-11ef-bcea-c7b262605968.lock 2024-09-10T21:05:06.688 INFO:teuthology.orchestra.run.smithi059.stdout:Lock 140305740645232 acquired on /run/cephadm/3c26b952-6fb8-11ef-bcea-c7b262605968.lock 2024-09-10T21:05:06.688 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying IP 172.21.15.59 port 3300 ... 2024-09-10T21:05:06.688 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying IP 172.21.15.59 port 6789 ... 2024-09-10T21:05:06.688 INFO:teuthology.orchestra.run.smithi059.stdout:Base mon IP(s) is [172.21.15.59:3300, 172.21.15.59:6789], mon addrv is [v2:172.21.15.59:3300,v1:172.21.15.59:6789] 2024-09-10T21:05:06.692 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.59 metric 100 2024-09-10T21:05:06.692 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.59 metric 100 2024-09-10T21:05:06.694 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T21:05:06.695 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-10T21:05:06.695 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1796sec hoplimit 64 pref medium 2024-09-10T21:05:06.697 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T21:05:06.697 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T21:05:06.697 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T21:05:06.697 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-10T21:05:06.698 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-09-10T21:05:06.698 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T21:05:06.698 INFO:teuthology.orchestra.run.smithi059.stdout:Mon IP `172.21.15.59` is in CIDR network `172.21.0.0/20` 2024-09-10T21:05:06.698 INFO:teuthology.orchestra.run.smithi059.stdout:Mon IP `172.21.15.59` is in CIDR network `172.21.0.0/20` 2024-09-10T21:05:06.698 INFO:teuthology.orchestra.run.smithi059.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T21:05:06.699 INFO:teuthology.orchestra.run.smithi059.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T21:05:06.699 INFO:teuthology.orchestra.run.smithi059.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T21:05:09.914 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stdout 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T21:05:09.915 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T21:05:09.915 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T21:05:09.915 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stderr Copying blob sha256:edd8cbe4deb828f809e8d76f308301dd93e971948e909d25cc03015fed1fd796 2024-09-10T21:05:09.915 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-10T21:05:09.915 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stderr Copying config sha256:589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T21:05:09.915 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T21:05:11.237 INFO:teuthology.orchestra.run.smithi059.stdout:ceph: stdout ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T21:05:11.237 INFO:teuthology.orchestra.run.smithi059.stdout:Ceph version: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T21:05:11.237 INFO:teuthology.orchestra.run.smithi059.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T21:05:12.067 INFO:teuthology.orchestra.run.smithi059.stdout:stat: stdout 167 167 2024-09-10T21:05:12.067 INFO:teuthology.orchestra.run.smithi059.stdout:Creating initial keys... 2024-09-10T21:05:12.898 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph-authtool: stdout AQCItOBmR/KyFBAA5fpAXVNJvFepyJnIh2F65Q== 2024-09-10T21:05:13.745 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph-authtool: stdout AQCJtOBmm5QgDRAA769Tw+HmqJhbqCUybOHWkQ== 2024-09-10T21:05:14.558 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph-authtool: stdout AQCKtOBm5q+EAxAAPtslq7b+KvEJqU6j0FVhhQ== 2024-09-10T21:05:14.559 INFO:teuthology.orchestra.run.smithi059.stdout:Creating initial monmap... 2024-09-10T21:05:15.516 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T21:05:15.516 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-10T21:05:15.517 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:05:15.517 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T21:05:15.517 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool for a [v2:172.21.15.59:3300,v1:172.21.15.59:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T21:05:15.517 INFO:teuthology.orchestra.run.smithi059.stdout:setting min_mon_release = quincy 2024-09-10T21:05:15.517 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/monmaptool: set fsid to 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:05:15.517 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T21:05:15.517 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:05:15.517 INFO:teuthology.orchestra.run.smithi059.stdout:Creating mon... 2024-09-10T21:05:16.723 INFO:teuthology.orchestra.run.smithi059.stdout:create mon.a on 2024-09-10T21:05:16.952 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T21:05:17.113 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T21:05:17.295 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-3c26b952-6fb8-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-3c26b952-6fb8-11ef-bcea-c7b262605968.target. 2024-09-10T21:05:17.295 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-3c26b952-6fb8-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-3c26b952-6fb8-11ef-bcea-c7b262605968.target. 2024-09-10T21:05:17.539 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mon.a 2024-09-10T21:05:17.539 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-10T21:05:17.711 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3c26b952-6fb8-11ef-bcea-c7b262605968.target.wants/ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@.service. 2024-09-10T21:05:18.202 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:18 smithi059 podman[30500]: 2024-09-10 21:05:18.157955644 +0000 UTC m=+0.329766611 container start f5a738ed269f3c636885d154648ec13c2cdce6ce88cb353b0c4d12a47f499d39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T21:05:18.203 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:18 smithi059 ceph-mon[30520]: mkfs 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:05:18.246 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T21:05:18.247 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout disabled 2024-09-10T21:05:18.253 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T21:05:18.254 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout inactive 2024-09-10T21:05:18.254 INFO:teuthology.orchestra.run.smithi059.stdout:firewalld.service is not enabled 2024-09-10T21:05:18.254 INFO:teuthology.orchestra.run.smithi059.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T21:05:18.254 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for mon to start... 2024-09-10T21:05:18.254 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for mon... 2024-09-10T21:05:18.493 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:18 smithi059 ceph-mon[30520]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T21:05:18.493 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:18 smithi059 bash[30500]: f5a738ed269f3c636885d154648ec13c2cdce6ce88cb353b0c4d12a47f499d39 2024-09-10T21:05:18.493 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:18 smithi059 systemd[1]: Started Ceph mon.a for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:05:19.285 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T21:05:19.285 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout id: 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:05:19.285 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T21:05:19.285 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T21:05:19.285 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout services: 2024-09-10T21:05:19.285 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.563338s) 2024-09-10T21:05:19.285 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T21:05:19.286 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T21:05:19.286 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T21:05:19.286 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout data: 2024-09-10T21:05:19.286 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T21:05:19.286 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T21:05:19.286 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T21:05:19.286 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T21:05:19.286 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T21:05:19.286 INFO:teuthology.orchestra.run.smithi059.stdout:mon is available 2024-09-10T21:05:19.286 INFO:teuthology.orchestra.run.smithi059.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T21:05:19.398 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:19 smithi059 ceph-mon[30520]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T21:05:19.399 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:19 smithi059 ceph-mon[30520]: monmap epoch 1 2024-09-10T21:05:19.399 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:19 smithi059 ceph-mon[30520]: fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:05:19.399 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:19 smithi059 ceph-mon[30520]: last_changed 2024-09-10T21:05:14.912724+0000 2024-09-10T21:05:19.399 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:19 smithi059 ceph-mon[30520]: created 2024-09-10T21:05:14.912724+0000 2024-09-10T21:05:19.399 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:19 smithi059 ceph-mon[30520]: min_mon_release 19 (squid) 2024-09-10T21:05:19.399 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:19 smithi059 ceph-mon[30520]: election_strategy: 1 2024-09-10T21:05:19.399 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:19 smithi059 ceph-mon[30520]: 0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-09-10T21:05:19.399 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:19 smithi059 ceph-mon[30520]: fsmap 2024-09-10T21:05:19.399 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:19 smithi059 ceph-mon[30520]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T21:05:19.399 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:19 smithi059 ceph-mon[30520]: mgrmap e1: no daemons active 2024-09-10T21:05:19.399 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:19 smithi059 ceph-mon[30520]: from='client.? 172.21.15.59:0/3524692140' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-10T21:05:20.292 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T21:05:20.292 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T21:05:20.292 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout fsid = 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:05:20.292 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T21:05:20.292 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.59:3300,v1:172.21.15.59:6789] 2024-09-10T21:05:20.293 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T21:05:20.293 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T21:05:20.293 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T21:05:20.293 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T21:05:20.293 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T21:05:20.293 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T21:05:20.293 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T21:05:20.293 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T21:05:20.293 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T21:05:20.293 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-10T21:05:20.293 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T21:05:20.293 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T21:05:20.293 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T21:05:20.294 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T21:05:20.294 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T21:05:20.294 INFO:teuthology.orchestra.run.smithi059.stdout:Generating new minimal ceph.conf... 2024-09-10T21:05:20.405 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:20 smithi059 ceph-mon[30520]: from='client.? 172.21.15.59:0/1251885229' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T21:05:20.405 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:20 smithi059 ceph-mon[30520]: from='client.? 172.21.15.59:0/1251885229' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T21:05:21.330 INFO:teuthology.orchestra.run.smithi059.stdout:Restarting the monitor... 2024-09-10T21:05:21.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:21 smithi059 ceph-mon[30520]: from='client.? 172.21.15.59:0/3698980437' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:05:21.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:21 smithi059 systemd[1]: Stopping Ceph mon.a for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:05:21.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:21 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-a[30516]: 2024-09-10T21:05:21.626+0000 7fa5b04f7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:05:21.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:21 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-a[30516]: 2024-09-10T21:05:21.626+0000 7fa5b04f7640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T21:05:21.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:21 smithi059 podman[30762]: 2024-09-10 21:05:21.71991917 +0000 UTC m=+0.220944185 container died f5a738ed269f3c636885d154648ec13c2cdce6ce88cb353b0c4d12a47f499d39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:05:22.222 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 podman[30762]: 2024-09-10 21:05:22.035222357 +0000 UTC m=+0.536247371 container cleanup f5a738ed269f3c636885d154648ec13c2cdce6ce88cb353b0c4d12a47f499d39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:05:22.223 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 bash[30762]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-a 2024-09-10T21:05:22.557 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 podman[30775]: 2024-09-10 21:05:22.219498235 +0000 UTC m=+0.494914767 container remove f5a738ed269f3c636885d154648ec13c2cdce6ce88cb353b0c4d12a47f499d39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T21:05:22.557 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 systemd[1]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T21:05:22.557 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 systemd[1]: Stopped Ceph mon.a for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:05:22.557 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 systemd[1]: Starting Ceph mon.a for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:05:22.843 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 podman[30869]: 2024-09-10 21:05:22.553847524 +0000 UTC m=+0.098843100 container create 6c68aa69a9170330616bd4718b2c0bf6e6d1e5ed0380f3924209fb03f65c5889 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-10T21:05:22.843 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 podman[30869]: 2024-09-10 21:05:22.47156535 +0000 UTC m=+0.016560890 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:05:22.843 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 podman[30869]: 2024-09-10 21:05:22.756348278 +0000 UTC m=+0.301343820 container init 6c68aa69a9170330616bd4718b2c0bf6e6d1e5ed0380f3924209fb03f65c5889 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:05:22.843 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 podman[30869]: 2024-09-10 21:05:22.759927953 +0000 UTC m=+0.304923488 container start 6c68aa69a9170330616bd4718b2c0bf6e6d1e5ed0380f3924209fb03f65c5889 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T21:05:22.843 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T21:05:22.843 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-10T21:05:22.843 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: pidfile_write: ignore empty --pid-file 2024-09-10T21:05:22.843 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: load: jerasure load: lrc 2024-09-10T21:05:22.844 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: RocksDB version: 7.9.2 2024-09-10T21:05:22.844 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Git sha 0 2024-09-10T21:05:22.844 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-10T21:05:22.844 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: DB SUMMARY 2024-09-10T21:05:22.844 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: DB Session ID: GOCJULTIUDOT981A1IQ0 2024-09-10T21:05:22.844 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: CURRENT file: CURRENT 2024-09-10T21:05:22.844 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T21:05:22.844 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T21:05:22.844 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T21:05:22.844 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 96034 ; 2024-09-10T21:05:22.845 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.error_if_exists: 0 2024-09-10T21:05:22.845 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.create_if_missing: 0 2024-09-10T21:05:22.845 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.paranoid_checks: 1 2024-09-10T21:05:22.845 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T21:05:22.845 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T21:05:22.845 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T21:05:22.845 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.env: 0x557693b7a180 2024-09-10T21:05:22.846 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T21:05:22.846 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.info_log: 0x557696365700 2024-09-10T21:05:22.846 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T21:05:22.846 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.statistics: (nil) 2024-09-10T21:05:22.846 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.use_fsync: 0 2024-09-10T21:05:22.846 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_log_file_size: 0 2024-09-10T21:05:22.846 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T21:05:22.846 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T21:05:22.846 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T21:05:22.846 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T21:05:22.846 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.allow_fallocate: 1 2024-09-10T21:05:22.846 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T21:05:22.846 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T21:05:22.847 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.use_direct_reads: 0 2024-09-10T21:05:22.847 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T21:05:22.847 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T21:05:22.847 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.db_log_dir: 2024-09-10T21:05:22.847 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.wal_dir: 2024-09-10T21:05:22.847 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T21:05:22.847 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T21:05:22.847 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T21:05:22.847 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T21:05:22.847 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T21:05:22.847 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T21:05:22.847 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T21:05:22.847 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T21:05:22.848 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.write_buffer_manager: 0x557696369b80 2024-09-10T21:05:22.848 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T21:05:22.848 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T21:05:22.848 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T21:05:22.848 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T21:05:22.848 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T21:05:22.848 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T21:05:22.848 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T21:05:22.848 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T21:05:22.848 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.unordered_write: 0 2024-09-10T21:05:22.848 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T21:05:22.848 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T21:05:22.848 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T21:05:22.848 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T21:05:22.849 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.row_cache: None 2024-09-10T21:05:22.849 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.wal_filter: None 2024-09-10T21:05:22.849 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T21:05:22.849 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T21:05:22.849 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.two_write_queues: 0 2024-09-10T21:05:22.849 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T21:05:22.849 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.wal_compression: 0 2024-09-10T21:05:22.849 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.atomic_flush: 0 2024-09-10T21:05:22.849 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T21:05:22.849 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T21:05:22.849 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T21:05:22.849 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.log_readahead_size: 0 2024-09-10T21:05:22.849 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T21:05:22.850 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T21:05:22.850 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T21:05:22.850 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T21:05:22.850 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T21:05:22.850 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T21:05:22.850 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T21:05:22.850 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_background_jobs: 2 2024-09-10T21:05:22.850 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_background_compactions: -1 2024-09-10T21:05:22.850 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_subcompactions: 1 2024-09-10T21:05:22.850 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T21:05:22.850 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T21:05:22.850 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T21:05:22.850 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T21:05:22.850 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T21:05:22.850 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T21:05:22.851 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T21:05:22.851 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T21:05:22.851 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_open_files: -1 2024-09-10T21:05:22.851 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T21:05:22.851 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T21:05:22.851 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T21:05:22.851 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T21:05:22.851 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_background_flushes: -1 2024-09-10T21:05:22.851 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Compression algorithms supported: 2024-09-10T21:05:22.851 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: kZSTD supported: 0 2024-09-10T21:05:22.851 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: kXpressCompression supported: 0 2024-09-10T21:05:22.851 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: kBZip2Compression supported: 0 2024-09-10T21:05:22.851 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T21:05:22.852 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: kLZ4Compression supported: 1 2024-09-10T21:05:22.852 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: kZlibCompression supported: 1 2024-09-10T21:05:22.852 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T21:05:22.852 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: kSnappyCompression supported: 1 2024-09-10T21:05:22.852 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T21:05:22.852 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T21:05:22.852 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-10T21:05:22.852 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T21:05:22.852 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T21:05:22.852 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.merge_operator: 2024-09-10T21:05:22.852 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compaction_filter: None 2024-09-10T21:05:22.852 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T21:05:22.852 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T21:05:22.853 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T21:05:22.853 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T21:05:22.853 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557696365320) 2024-09-10T21:05:22.853 INFO:journalctl@ceph.mon.a.smithi059.stdout: cache_index_and_filter_blocks: 1 2024-09-10T21:05:22.853 INFO:journalctl@ceph.mon.a.smithi059.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T21:05:22.853 INFO:journalctl@ceph.mon.a.smithi059.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T21:05:22.853 INFO:journalctl@ceph.mon.a.smithi059.stdout: pin_top_level_index_and_filter: 1 2024-09-10T21:05:22.853 INFO:journalctl@ceph.mon.a.smithi059.stdout: index_type: 0 2024-09-10T21:05:22.853 INFO:journalctl@ceph.mon.a.smithi059.stdout: data_block_index_type: 0 2024-09-10T21:05:22.853 INFO:journalctl@ceph.mon.a.smithi059.stdout: index_shortening: 1 2024-09-10T21:05:22.853 INFO:journalctl@ceph.mon.a.smithi059.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T21:05:22.853 INFO:journalctl@ceph.mon.a.smithi059.stdout: checksum: 4 2024-09-10T21:05:22.853 INFO:journalctl@ceph.mon.a.smithi059.stdout: no_block_cache: 0 2024-09-10T21:05:22.853 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_cache: 0x557696359610 2024-09-10T21:05:22.854 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_cache_name: BinnedLRUCache 2024-09-10T21:05:22.854 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_cache_options: 2024-09-10T21:05:22.854 INFO:journalctl@ceph.mon.a.smithi059.stdout: capacity : 536870912 2024-09-10T21:05:22.854 INFO:journalctl@ceph.mon.a.smithi059.stdout: num_shard_bits : 4 2024-09-10T21:05:22.854 INFO:journalctl@ceph.mon.a.smithi059.stdout: strict_capacity_limit : 0 2024-09-10T21:05:22.854 INFO:journalctl@ceph.mon.a.smithi059.stdout: high_pri_pool_ratio: 0.000 2024-09-10T21:05:22.854 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_cache_compressed: (nil) 2024-09-10T21:05:22.854 INFO:journalctl@ceph.mon.a.smithi059.stdout: persistent_cache: (nil) 2024-09-10T21:05:22.854 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_size: 4096 2024-09-10T21:05:22.854 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_size_deviation: 10 2024-09-10T21:05:22.854 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_restart_interval: 16 2024-09-10T21:05:22.854 INFO:journalctl@ceph.mon.a.smithi059.stdout: index_block_restart_interval: 1 2024-09-10T21:05:22.854 INFO:journalctl@ceph.mon.a.smithi059.stdout: metadata_block_size: 4096 2024-09-10T21:05:22.854 INFO:journalctl@ceph.mon.a.smithi059.stdout: partition_filters: 0 2024-09-10T21:05:22.854 INFO:journalctl@ceph.mon.a.smithi059.stdout: use_delta_encoding: 1 2024-09-10T21:05:22.855 INFO:journalctl@ceph.mon.a.smithi059.stdout: filter_policy: bloomfilter 2024-09-10T21:05:22.855 INFO:journalctl@ceph.mon.a.smithi059.stdout: whole_key_filtering: 1 2024-09-10T21:05:22.855 INFO:journalctl@ceph.mon.a.smithi059.stdout: verify_compression: 0 2024-09-10T21:05:22.855 INFO:journalctl@ceph.mon.a.smithi059.stdout: read_amp_bytes_per_bit: 0 2024-09-10T21:05:22.855 INFO:journalctl@ceph.mon.a.smithi059.stdout: format_version: 5 2024-09-10T21:05:22.855 INFO:journalctl@ceph.mon.a.smithi059.stdout: enable_index_compression: 1 2024-09-10T21:05:22.855 INFO:journalctl@ceph.mon.a.smithi059.stdout: block_align: 0 2024-09-10T21:05:22.855 INFO:journalctl@ceph.mon.a.smithi059.stdout: max_auto_readahead_size: 262144 2024-09-10T21:05:22.855 INFO:journalctl@ceph.mon.a.smithi059.stdout: prepopulate_block_cache: 0 2024-09-10T21:05:22.855 INFO:journalctl@ceph.mon.a.smithi059.stdout: initial_auto_readahead_size: 8192 2024-09-10T21:05:22.855 INFO:journalctl@ceph.mon.a.smithi059.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T21:05:22.855 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T21:05:22.855 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T21:05:22.855 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compression: NoCompression 2024-09-10T21:05:22.856 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T21:05:22.856 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T21:05:22.856 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T21:05:22.856 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.num_levels: 7 2024-09-10T21:05:22.856 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T21:05:22.856 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T21:05:22.856 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T21:05:22.856 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T21:05:22.856 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T21:05:22.856 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T21:05:22.856 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T21:05:22.856 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T21:05:22.856 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T21:05:22.857 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T21:05:22.857 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T21:05:22.857 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T21:05:22.857 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T21:05:22.857 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T21:05:22.857 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T21:05:22.857 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T21:05:22.857 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T21:05:22.857 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T21:05:22.857 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T21:05:22.857 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T21:05:22.857 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T21:05:22.858 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T21:05:22.858 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T21:05:22.858 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T21:05:22.858 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T21:05:22.859 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T21:05:22.859 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T21:05:22.859 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T21:05:22.859 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T21:05:22.859 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T21:05:22.859 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T21:05:22.859 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T21:05:22.859 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T21:05:22.859 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T21:05:22.859 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T21:05:22.859 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T21:05:22.859 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T21:05:22.859 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T21:05:22.859 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T21:05:22.860 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T21:05:22.860 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T21:05:22.860 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T21:05:22.860 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T21:05:22.860 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T21:05:22.860 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T21:05:22.860 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T21:05:22.860 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T21:05:22.860 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T21:05:22.860 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T21:05:22.860 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T21:05:22.860 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T21:05:22.860 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T21:05:22.860 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T21:05:22.861 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T21:05:22.861 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.inplace_update_support: 0 2024-09-10T21:05:22.861 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T21:05:22.861 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T21:05:22.861 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T21:05:22.861 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T21:05:22.861 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.bloom_locality: 0 2024-09-10T21:05:22.861 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.max_successive_merges: 0 2024-09-10T21:05:22.861 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T21:05:22.861 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T21:05:22.861 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T21:05:22.861 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T21:05:22.861 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.ttl: 2592000 2024-09-10T21:05:22.861 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T21:05:22.862 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T21:05:22.862 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T21:05:22.862 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.enable_blob_files: false 2024-09-10T21:05:22.862 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.min_blob_size: 0 2024-09-10T21:05:22.862 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T21:05:22.862 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T21:05:22.862 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T21:05:22.862 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T21:05:22.862 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T21:05:22.862 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T21:05:22.862 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T21:05:22.862 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T21:05:22.862 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T21:05:22.862 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T21:05:22.862 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 117e9e3e-3884-42e1-9ead-122a97cb743b 2024-09-10T21:05:22.863 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726002322786082, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T21:05:22.863 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T21:05:22.863 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726002322787080, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 92097, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 289, "table_properties": {"data_size": 90138, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11922, "raw_average_key_size": 48, "raw_value_size": 83439, "raw_average_value_size": 336, "num_data_blocks": 12, "num_entries": 248, "num_filter_entries": 248, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726002322, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "117e9e3e-3884-42e1-9ead-122a97cb743b", "db_session_id": "GOCJULTIUDOT981A1IQ0", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T21:05:22.863 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726002322787177, "job": 1, "event": "recovery_finished"} 2024-09-10T21:05:22.863 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T21:05:22.863 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T21:05:22.863 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557696388e00 2024-09-10T21:05:22.863 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: DB pointer 0x55769648a000 2024-09-10T21:05:22.863 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T21:05:22.863 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T21:05:22.863 INFO:journalctl@ceph.mon.a.smithi059.stdout: ** DB Stats ** 2024-09-10T21:05:22.863 INFO:journalctl@ceph.mon.a.smithi059.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T21:05:22.863 INFO:journalctl@ceph.mon.a.smithi059.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T21:05:22.864 INFO:journalctl@ceph.mon.a.smithi059.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T21:05:22.864 INFO:journalctl@ceph.mon.a.smithi059.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T21:05:22.864 INFO:journalctl@ceph.mon.a.smithi059.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T21:05:22.864 INFO:journalctl@ceph.mon.a.smithi059.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T21:05:22.864 INFO:journalctl@ceph.mon.a.smithi059.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T21:05:22.864 INFO:journalctl@ceph.mon.a.smithi059.stdout: 2024-09-10T21:05:22.864 INFO:journalctl@ceph.mon.a.smithi059.stdout: ** Compaction Stats [default] ** 2024-09-10T21:05:22.864 INFO:journalctl@ceph.mon.a.smithi059.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T21:05:22.864 INFO:journalctl@ceph.mon.a.smithi059.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T21:05:22.864 INFO:journalctl@ceph.mon.a.smithi059.stdout: L0 2/0 91.80 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 138.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T21:05:22.864 INFO:journalctl@ceph.mon.a.smithi059.stdout: Sum 2/0 91.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 138.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T21:05:22.864 INFO:journalctl@ceph.mon.a.smithi059.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 138.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T21:05:22.864 INFO:journalctl@ceph.mon.a.smithi059.stdout: 2024-09-10T21:05:22.864 INFO:journalctl@ceph.mon.a.smithi059.stdout: ** Compaction Stats [default] ** 2024-09-10T21:05:22.864 INFO:journalctl@ceph.mon.a.smithi059.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T21:05:22.865 INFO:journalctl@ceph.mon.a.smithi059.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T21:05:22.865 INFO:journalctl@ceph.mon.a.smithi059.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 138.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T21:05:22.865 INFO:journalctl@ceph.mon.a.smithi059.stdout: 2024-09-10T21:05:22.865 INFO:journalctl@ceph.mon.a.smithi059.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T21:05:22.865 INFO:journalctl@ceph.mon.a.smithi059.stdout: 2024-09-10T21:05:22.865 INFO:journalctl@ceph.mon.a.smithi059.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T21:05:22.865 INFO:journalctl@ceph.mon.a.smithi059.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T21:05:22.865 INFO:journalctl@ceph.mon.a.smithi059.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T21:05:22.865 INFO:journalctl@ceph.mon.a.smithi059.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T21:05:22.865 INFO:journalctl@ceph.mon.a.smithi059.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T21:05:22.865 INFO:journalctl@ceph.mon.a.smithi059.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T21:05:22.865 INFO:journalctl@ceph.mon.a.smithi059.stdout: Cumulative compaction: 0.00 GB write, 27.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T21:05:22.865 INFO:journalctl@ceph.mon.a.smithi059.stdout: Interval compaction: 0.00 GB write, 27.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T21:05:22.865 INFO:journalctl@ceph.mon.a.smithi059.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T21:05:22.866 INFO:journalctl@ceph.mon.a.smithi059.stdout: Block cache BinnedLRUCache@0x557696359610#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T21:05:22.866 INFO:journalctl@ceph.mon.a.smithi059.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-10T21:05:22.866 INFO:journalctl@ceph.mon.a.smithi059.stdout: 2024-09-10T21:05:22.866 INFO:journalctl@ceph.mon.a.smithi059.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T21:05:22.866 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: starting mon.a rank 0 at public addrs [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] at bind addrs [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:05:22.866 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: mon.a@-1(???) e1 preinit fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:05:22.866 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: mon.a@-1(???).mds e1 new map 2024-09-10T21:05:22.866 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: mon.a@-1(???).mds e1 print_map 2024-09-10T21:05:22.866 INFO:journalctl@ceph.mon.a.smithi059.stdout: e1 2024-09-10T21:05:22.866 INFO:journalctl@ceph.mon.a.smithi059.stdout: btime 2024-09-10T21:05:18:196680+0000 2024-09-10T21:05:22.866 INFO:journalctl@ceph.mon.a.smithi059.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T21:05:22.866 INFO:journalctl@ceph.mon.a.smithi059.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T21:05:22.866 INFO:journalctl@ceph.mon.a.smithi059.stdout: legacy client fscid: -1 2024-09-10T21:05:22.866 INFO:journalctl@ceph.mon.a.smithi059.stdout: 2024-09-10T21:05:22.867 INFO:journalctl@ceph.mon.a.smithi059.stdout: No filesystems configured 2024-09-10T21:05:22.867 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T21:05:22.867 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T21:05:22.867 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T21:05:22.867 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T21:05:22.867 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T21:05:22.867 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 bash[30869]: 6c68aa69a9170330616bd4718b2c0bf6e6d1e5ed0380f3924209fb03f65c5889 2024-09-10T21:05:22.867 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 systemd[1]: Started Ceph mon.a for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:05:22.867 INFO:teuthology.orchestra.run.smithi059.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T21:05:23.128 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T21:05:23.129 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: monmap epoch 1 2024-09-10T21:05:23.129 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:05:23.129 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: last_changed 2024-09-10T21:05:14.912724+0000 2024-09-10T21:05:23.129 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: created 2024-09-10T21:05:14.912724+0000 2024-09-10T21:05:23.129 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: min_mon_release 19 (squid) 2024-09-10T21:05:23.129 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: election_strategy: 1 2024-09-10T21:05:23.129 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: 0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-09-10T21:05:23.129 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: fsmap 2024-09-10T21:05:23.129 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T21:05:23.129 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:22 smithi059 ceph-mon[30888]: mgrmap e1: no daemons active 2024-09-10T21:05:23.835 INFO:teuthology.orchestra.run.smithi059.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T21:05:23.857 INFO:teuthology.orchestra.run.smithi059.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T21:05:23.857 INFO:teuthology.orchestra.run.smithi059.stdout:Creating mgr... 2024-09-10T21:05:23.857 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T21:05:23.858 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T21:05:24.117 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mgr.x 2024-09-10T21:05:24.117 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-10T21:05:24.270 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3c26b952-6fb8-11ef-bcea-c7b262605968.target.wants/ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@.service. 2024-09-10T21:05:24.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:24 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1441742022' entity='client.admin' 2024-09-10T21:05:24.412 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:24 smithi059 systemd[1]: Starting Ceph mgr.x for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:05:24.828 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:24 smithi059 podman[31098]: 2024-09-10 21:05:24.417366935 +0000 UTC m=+0.016642395 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:05:24.829 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:24 smithi059 podman[31098]: 2024-09-10 21:05:24.556582992 +0000 UTC m=+0.155858449 container create c1d7dced6f3a4909e5af2b10e98f3e31ecf89a7cebf57d82b20a341666c66b71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T21:05:24.829 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:24 smithi059 podman[31098]: 2024-09-10 21:05:24.750465189 +0000 UTC m=+0.349740638 container init c1d7dced6f3a4909e5af2b10e98f3e31ecf89a7cebf57d82b20a341666c66b71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-10T21:05:24.829 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:24 smithi059 podman[31098]: 2024-09-10 21:05:24.753345169 +0000 UTC m=+0.352620628 container start c1d7dced6f3a4909e5af2b10e98f3e31ecf89a7cebf57d82b20a341666c66b71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-10T21:05:24.829 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:24 smithi059 bash[31098]: c1d7dced6f3a4909e5af2b10e98f3e31ecf89a7cebf57d82b20a341666c66b71 2024-09-10T21:05:24.845 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T21:05:24.845 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout disabled 2024-09-10T21:05:24.851 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T21:05:24.851 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout inactive 2024-09-10T21:05:24.851 INFO:teuthology.orchestra.run.smithi059.stdout:firewalld.service is not enabled 2024-09-10T21:05:24.851 INFO:teuthology.orchestra.run.smithi059.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T21:05:24.861 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T21:05:24.861 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout disabled 2024-09-10T21:05:24.870 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T21:05:24.870 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout inactive 2024-09-10T21:05:24.870 INFO:teuthology.orchestra.run.smithi059.stdout:firewalld.service is not enabled 2024-09-10T21:05:24.870 INFO:teuthology.orchestra.run.smithi059.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-10T21:05:24.870 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for mgr to start... 2024-09-10T21:05:24.870 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for mgr... 2024-09-10T21:05:25.089 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:24 smithi059 systemd[1]: Started Ceph mgr.x for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:05:25.652 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:25 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2064673317' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T21:05:25.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T21:05:25.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2024-09-10T21:05:25.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "fsid": "3c26b952-6fb8-11ef-bcea-c7b262605968", 2024-09-10T21:05:25.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T21:05:25.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T21:05:25.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T21:05:25.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T21:05:25.991 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:25.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T21:05:25.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T21:05:25.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 0 2024-09-10T21:05:25.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2024-09-10T21:05:25.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T21:05:25.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T21:05:25.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2024-09-10T21:05:25.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-10T21:05:25.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T21:05:25.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:05:25.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T21:05:25.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T21:05:25.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:25.992 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T21:05:25.993 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:05:25.993 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T21:05:25.993 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T21:05:25.993 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T21:05:25.993 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T21:05:25.993 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T21:05:25.993 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T21:05:25.996 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:25.996 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T21:05:25.996 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T21:05:25.997 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T21:05:25.997 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T21:05:25.997 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T21:05:25.997 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T21:05:25.997 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T21:05:25.997 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T21:05:25.997 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T21:05:25.997 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:25.997 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T21:05:25.997 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:05:25.997 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T21:05:18:196680+0000", 2024-09-10T21:05:25.997 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T21:05:25.997 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T21:05:25.998 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:25.998 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T21:05:25.998 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T21:05:25.998 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T21:05:25.998 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T21:05:25.998 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T21:05:25.998 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T21:05:25.998 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T21:05:25.998 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2024-09-10T21:05:25.998 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T21:05:25.998 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:25.998 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T21:05:25.998 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:05:25.998 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T21:05:18.197362+0000", 2024-09-10T21:05:25.998 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T21:05:25.998 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:25.999 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T21:05:25.999 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2024-09-10T21:05:25.999 INFO:teuthology.orchestra.run.smithi059.stdout:mgr not available, waiting (1/15)... 2024-09-10T21:05:28.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:28 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1136255555' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T21:05:29.047 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T21:05:29.047 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2024-09-10T21:05:29.047 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "fsid": "3c26b952-6fb8-11ef-bcea-c7b262605968", 2024-09-10T21:05:29.047 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T21:05:29.047 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T21:05:29.047 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T21:05:29.047 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T21:05:29.047 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:29.047 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T21:05:29.048 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T21:05:29.048 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 0 2024-09-10T21:05:29.048 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2024-09-10T21:05:29.048 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T21:05:29.048 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T21:05:29.048 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2024-09-10T21:05:29.048 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-10T21:05:29.048 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T21:05:29.048 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:05:29.048 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T21:05:29.048 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T21:05:29.048 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:29.048 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T21:05:29.049 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:05:29.049 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T21:05:29.049 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T21:05:29.049 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T21:05:29.049 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T21:05:29.049 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T21:05:29.049 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T21:05:29.053 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:29.053 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T21:05:29.053 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T21:05:29.053 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T21:05:29.053 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T21:05:29.053 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T21:05:29.053 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T21:05:29.053 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T21:05:29.053 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T21:05:29.053 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T21:05:29.053 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:29.054 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T21:05:29.054 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:05:29.054 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T21:05:18:196680+0000", 2024-09-10T21:05:29.054 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T21:05:29.054 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T21:05:29.054 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:29.054 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T21:05:29.054 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T21:05:29.054 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T21:05:29.054 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T21:05:29.054 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T21:05:29.054 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T21:05:29.054 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T21:05:29.054 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2024-09-10T21:05:29.055 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T21:05:29.055 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:29.055 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T21:05:29.055 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:05:29.055 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T21:05:18.197362+0000", 2024-09-10T21:05:29.055 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T21:05:29.055 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:29.055 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T21:05:29.055 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2024-09-10T21:05:29.055 INFO:teuthology.orchestra.run.smithi059.stdout:mgr not available, waiting (2/15)... 2024-09-10T21:05:30.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:30 smithi059 ceph-mon[30888]: Activating manager daemon x 2024-09-10T21:05:30.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:30 smithi059 ceph-mon[30888]: mgrmap e2: x(active, starting, since 0.00327781s) 2024-09-10T21:05:30.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:30 smithi059 ceph-mon[30888]: from='mgr.14100 172.21.15.59:0/2782313095' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T21:05:30.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:30 smithi059 ceph-mon[30888]: from='mgr.14100 172.21.15.59:0/2782313095' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T21:05:30.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:30 smithi059 ceph-mon[30888]: from='mgr.14100 172.21.15.59:0/2782313095' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T21:05:30.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:30 smithi059 ceph-mon[30888]: from='mgr.14100 172.21.15.59:0/2782313095' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:05:30.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:30 smithi059 ceph-mon[30888]: from='mgr.14100 172.21.15.59:0/2782313095' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T21:05:30.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:30 smithi059 ceph-mon[30888]: Manager daemon x is now available 2024-09-10T21:05:30.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:30 smithi059 ceph-mon[30888]: from='mgr.14100 172.21.15.59:0/2782313095' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T21:05:30.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:30 smithi059 ceph-mon[30888]: from='mgr.14100 172.21.15.59:0/2782313095' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T21:05:30.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:30 smithi059 ceph-mon[30888]: from='mgr.14100 172.21.15.59:0/2782313095' entity='mgr.x' 2024-09-10T21:05:30.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:30 smithi059 ceph-mon[30888]: from='mgr.14100 172.21.15.59:0/2782313095' entity='mgr.x' 2024-09-10T21:05:30.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:30 smithi059 ceph-mon[30888]: from='mgr.14100 172.21.15.59:0/2782313095' entity='mgr.x' 2024-09-10T21:05:32.406 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:32 smithi059 ceph-mon[30888]: mgrmap e3: x(active, since 1.00766s) 2024-09-10T21:05:32.407 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:32 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/105151982' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T21:05:32.412 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T21:05:32.412 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2024-09-10T21:05:32.412 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "fsid": "3c26b952-6fb8-11ef-bcea-c7b262605968", 2024-09-10T21:05:32.413 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T21:05:32.413 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T21:05:32.413 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T21:05:32.413 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T21:05:32.413 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:32.413 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T21:05:32.413 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T21:05:32.413 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 0 2024-09-10T21:05:32.413 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2024-09-10T21:05:32.413 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T21:05:32.413 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T21:05:32.413 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2024-09-10T21:05:32.413 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-10T21:05:32.413 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T21:05:32.414 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:05:32.414 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T21:05:32.414 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T21:05:32.414 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:32.414 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T21:05:32.414 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:05:32.414 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T21:05:32.414 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T21:05:32.414 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T21:05:32.414 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T21:05:32.414 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T21:05:32.414 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T21:05:32.417 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:32.417 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T21:05:32.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T21:05:32.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T21:05:32.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T21:05:32.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T21:05:32.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T21:05:32.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T21:05:32.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T21:05:32.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T21:05:32.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:32.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T21:05:32.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:05:32.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T21:05:18:196680+0000", 2024-09-10T21:05:32.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T21:05:32.418 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T21:05:32.419 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:32.419 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T21:05:32.419 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T21:05:32.419 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T21:05:32.419 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T21:05:32.419 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T21:05:32.419 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T21:05:32.419 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T21:05:32.419 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ], 2024-09-10T21:05:32.419 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T21:05:32.419 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:32.419 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T21:05:32.419 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T21:05:32.419 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T21:05:18.197362+0000", 2024-09-10T21:05:32.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T21:05:32.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout }, 2024-09-10T21:05:32.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T21:05:32.420 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2024-09-10T21:05:32.420 INFO:teuthology.orchestra.run.smithi059.stdout:mgr is available 2024-09-10T21:05:33.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:33 smithi059 ceph-mon[30888]: mgrmap e4: x(active, since 2s) 2024-09-10T21:05:33.675 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T21:05:33.676 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T21:05:33.676 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout fsid = 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:05:33.676 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T21:05:33.676 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.59:3300,v1:172.21.15.59:6789] 2024-09-10T21:05:33.676 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T21:05:33.676 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T21:05:33.676 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T21:05:33.676 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T21:05:33.676 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T21:05:33.677 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T21:05:33.677 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T21:05:33.677 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 2024-09-10T21:05:33.677 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T21:05:33.677 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-10T21:05:33.677 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T21:05:33.677 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T21:05:33.677 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T21:05:33.677 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T21:05:33.677 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T21:05:33.677 INFO:teuthology.orchestra.run.smithi059.stdout:Enabling cephadm module... 2024-09-10T21:05:34.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:34 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/336644951' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T21:05:35.370 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:35 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/370108303' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-10T21:05:35.370 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:35 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: ignoring --setuser ceph since I am not root 2024-09-10T21:05:35.370 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:35 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: ignoring --setgroup ceph since I am not root 2024-09-10T21:05:36.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:36 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/370108303' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T21:05:36.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:36 smithi059 ceph-mon[30888]: mgrmap e5: x(active, since 5s) 2024-09-10T21:05:36.979 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2024-09-10T21:05:36.979 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T21:05:36.979 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T21:05:36.979 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T21:05:36.979 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T21:05:36.980 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2024-09-10T21:05:36.980 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for the mgr to restart... 2024-09-10T21:05:36.980 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for mgr epoch 5... 2024-09-10T21:05:37.295 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:37 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/919490751' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T21:05:40.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:40 smithi059 ceph-mon[30888]: Active manager daemon x restarted 2024-09-10T21:05:40.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:40 smithi059 ceph-mon[30888]: Activating manager daemon x 2024-09-10T21:05:40.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:40 smithi059 ceph-mon[30888]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T21:05:40.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:40 smithi059 ceph-mon[30888]: mgrmap e6: x(active, starting, since 0.00329664s) 2024-09-10T21:05:40.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:40 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:05:40.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:40 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T21:05:40.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:40 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T21:05:40.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:40 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T21:05:40.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:40 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T21:05:40.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:40 smithi059 ceph-mon[30888]: Manager daemon x is now available 2024-09-10T21:05:41.906 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2024-09-10T21:05:41.906 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T21:05:41.906 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T21:05:41.906 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2024-09-10T21:05:41.906 INFO:teuthology.orchestra.run.smithi059.stdout:mgr epoch 5 is available 2024-09-10T21:05:41.906 INFO:teuthology.orchestra.run.smithi059.stdout:Setting orchestrator backend to cephadm... 2024-09-10T21:05:42.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:42 smithi059 ceph-mon[30888]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T21:05:42.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:42 smithi059 ceph-mon[30888]: mgrmap e7: x(active, since 1.00507s) 2024-09-10T21:05:42.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:42 smithi059 ceph-mon[30888]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T21:05:42.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:42 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' 2024-09-10T21:05:42.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:42 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' 2024-09-10T21:05:42.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:42 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' 2024-09-10T21:05:42.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:42 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' 2024-09-10T21:05:42.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:42 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:05:42.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:42 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:05:42.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:42 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T21:05:42.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:42 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T21:05:43.713 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:43 smithi059 ceph-mon[30888]: Found migration_current of "None". Setting to last migration. 2024-09-10T21:05:43.713 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:43 smithi059 ceph-mon[30888]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:05:43.713 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:43 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' 2024-09-10T21:05:43.713 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:43 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:05:43.714 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:43 smithi059 ceph-mon[30888]: mgrmap e8: x(active, since 2s) 2024-09-10T21:05:44.303 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: 2024-09-10T21:05:44.001+0000 7fd28eb1f640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:21:05:44] ENGINE Error in HTTPServer.serve 2024-09-10T21:05:44.304 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: Traceback (most recent call last): 2024-09-10T21:05:44.304 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T21:05:44.304 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: self._connections.run(self.expiration_interval) 2024-09-10T21:05:44.304 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T21:05:44.304 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: self._run(expiration_interval) 2024-09-10T21:05:44.304 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T21:05:44.304 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T21:05:44.304 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T21:05:44.304 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T21:05:44.304 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T21:05:44.304 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: s = self.context.wrap_socket( 2024-09-10T21:05:44.304 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T21:05:44.305 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: return self.sslsocket_class._create( 2024-09-10T21:05:44.305 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T21:05:44.305 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: self.do_handshake() 2024-09-10T21:05:44.305 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T21:05:44.305 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: self._sslobj.do_handshake() 2024-09-10T21:05:44.305 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T21:05:44.305 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: 2024-09-10T21:05:44.305 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T21:05:44.306 INFO:teuthology.orchestra.run.smithi059.stdout:Generating ssh key... 2024-09-10T21:05:44.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-mon[30888]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:05:44.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-mon[30888]: [10/Sep/2024:21:05:43] ENGINE Bus STARTING 2024-09-10T21:05:44.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-mon[30888]: [10/Sep/2024:21:05:43] ENGINE Serving on https://172.21.15.59:7150 2024-09-10T21:05:44.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-mon[30888]: [10/Sep/2024:21:05:44] ENGINE Error in HTTPServer.serve 2024-09-10T21:05:44.911 INFO:journalctl@ceph.mon.a.smithi059.stdout: Traceback (most recent call last): 2024-09-10T21:05:44.911 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T21:05:44.911 INFO:journalctl@ceph.mon.a.smithi059.stdout: self._connections.run(self.expiration_interval) 2024-09-10T21:05:44.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T21:05:44.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: self._run(expiration_interval) 2024-09-10T21:05:44.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T21:05:44.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T21:05:44.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T21:05:44.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T21:05:44.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T21:05:44.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: s = self.context.wrap_socket( 2024-09-10T21:05:44.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T21:05:44.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: return self.sslsocket_class._create( 2024-09-10T21:05:44.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T21:05:44.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: self.do_handshake() 2024-09-10T21:05:44.912 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T21:05:44.913 INFO:journalctl@ceph.mon.a.smithi059.stdout: self._sslobj.do_handshake() 2024-09-10T21:05:44.913 INFO:journalctl@ceph.mon.a.smithi059.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T21:05:44.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-mon[30888]: [10/Sep/2024:21:05:44] ENGINE Serving on http://172.21.15.59:8765 2024-09-10T21:05:44.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-mon[30888]: [10/Sep/2024:21:05:44] ENGINE Bus STARTED 2024-09-10T21:05:44.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:05:45.325 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: Generating public/private rsa key pair. 2024-09-10T21:05:45.326 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: Your identification has been saved in /tmp/tmp30_5rxd3/key 2024-09-10T21:05:45.326 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: Your public key has been saved in /tmp/tmp30_5rxd3/key.pub 2024-09-10T21:05:45.326 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: The key fingerprint is: 2024-09-10T21:05:45.326 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: SHA256:tc1KSVj/08O0W+sQD2Btj7wOgsKUcEV6zkUD9xV4/Ys ceph-3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:05:45.326 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: The key's randomart image is: 2024-09-10T21:05:45.326 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: +---[RSA 3072]----+ 2024-09-10T21:05:45.326 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: | .+.+. .oo | 2024-09-10T21:05:45.326 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: | o ooooo. . | 2024-09-10T21:05:45.326 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: | . o ...o+oo ..| 2024-09-10T21:05:45.326 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: | o = .o.=+.=.o| 2024-09-10T21:05:45.326 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: | o oS + o=+=+| 2024-09-10T21:05:45.326 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: | o .. . E=o=| 2024-09-10T21:05:45.327 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: | o . ... o + | 2024-09-10T21:05:45.327 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: | . . o o | 2024-09-10T21:05:45.327 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: | . . | 2024-09-10T21:05:45.327 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: +----[SHA256]-----+ 2024-09-10T21:05:46.232 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:45 smithi059 ceph-mon[30888]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:05:46.232 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:45 smithi059 ceph-mon[30888]: Generating ssh key... 2024-09-10T21:05:46.233 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:45 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' 2024-09-10T21:05:46.233 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:45 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' 2024-09-10T21:05:46.802 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+xpQRgn1aY1jOfZnwWH0oWhQApGrDIZxoifdzF+4uuZ93teB7ps80HaGCdGn9If+w81rtGMaCYlJllFWOx8FYQy8VQGkCZl/hHbvFdFJQcU3ykXcWSzc0B9aChBgfhjN3n0DViq7wlUywzR6fnqIgoUqnydrdbQCXv4Ea57unWzQRdvH2LPuf5AT/cGF+5IC5ayVQKhaEuaYbQxuic7BrAA4CCp23GeWYfvWPqfcYcaGbyeafpirTKBfJu4kT4emdF7cmRe7CKznV/V5I4b/NnH8LkTw1rmJsoXCmeOwicndqGs9HzZ6h8YbZUjlgLpoLf44wa3j75ZHDxw+60iD8HWkIvuMO4rxI+wiDKNzj9joJdQJzoNbn/gysoUjyK8Gnb7uEHFuAXqODi3zgqReKNuPMUheA4h5PJ7h5FKddBlHIomP+VZRjNkA8cwKZUOgdT0cKXoePemBsFiPgE26G8FhjE1zomDxCMXNQgl7dgcDUUYmzBNgRaHQB8x68Pb0= ceph-3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:05:46.803 INFO:teuthology.orchestra.run.smithi059.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T21:05:46.803 INFO:teuthology.orchestra.run.smithi059.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T21:05:46.810 INFO:teuthology.orchestra.run.smithi059.stdout:Adding host smithi059... 2024-09-10T21:05:47.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:47 smithi059 ceph-mon[30888]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:05:48.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:48 smithi059 ceph-mon[30888]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi059", "addr": "172.21.15.59", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:05:49.392 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:49 smithi059 ceph-mon[30888]: Deploying cephadm binary to smithi059 2024-09-10T21:05:51.943 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout Added host 'smithi059' with addr '172.21.15.59' 2024-09-10T21:05:51.943 INFO:teuthology.orchestra.run.smithi059.stdout:Deploying unmanaged mon service... 2024-09-10T21:05:52.542 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:52 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' 2024-09-10T21:05:52.542 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:52 smithi059 ceph-mon[30888]: Added host smithi059 2024-09-10T21:05:52.542 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:52 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:05:53.813 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:53 smithi059 ceph-mon[30888]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:05:53.814 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:53 smithi059 ceph-mon[30888]: Saving service mon spec with placement count:5 2024-09-10T21:05:53.814 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:53 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' 2024-09-10T21:05:54.310 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T21:05:54.311 INFO:teuthology.orchestra.run.smithi059.stdout:Deploying unmanaged mgr service... 2024-09-10T21:05:55.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:54 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' 2024-09-10T21:05:55.140 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:54 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' 2024-09-10T21:05:55.769 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T21:05:56.118 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:55 smithi059 ceph-mon[30888]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:05:56.118 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:55 smithi059 ceph-mon[30888]: Saving service mgr spec with placement count:2 2024-09-10T21:05:56.118 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:55 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' 2024-09-10T21:05:57.635 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:57 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' 2024-09-10T21:05:57.635 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:57 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/225736725' entity='client.admin' 2024-09-10T21:05:57.635 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:57 smithi059 ceph-mon[30888]: from='mgr.14118 172.21.15.59:0/3377279440' entity='mgr.x' 2024-09-10T21:05:58.485 INFO:teuthology.orchestra.run.smithi059.stdout:Enabling the dashboard module... 2024-09-10T21:05:59.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:58 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2557091472' entity='client.admin' 2024-09-10T21:05:59.899 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:05:59 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1734178888' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-10T21:06:00.161 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:59 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: ignoring --setuser ceph since I am not root 2024-09-10T21:06:00.161 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:05:59 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: ignoring --setgroup ceph since I am not root 2024-09-10T21:06:01.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:00 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1734178888' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T21:06:01.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:00 smithi059 ceph-mon[30888]: mgrmap e9: x(active, since 19s) 2024-09-10T21:06:01.871 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2024-09-10T21:06:01.871 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T21:06:01.871 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T21:06:01.871 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T21:06:01.871 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T21:06:01.871 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2024-09-10T21:06:01.871 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for the mgr to restart... 2024-09-10T21:06:01.871 INFO:teuthology.orchestra.run.smithi059.stdout:Waiting for mgr epoch 9... 2024-09-10T21:06:02.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:01 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/352617503' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T21:06:05.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:05 smithi059 ceph-mon[30888]: Active manager daemon x restarted 2024-09-10T21:06:05.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:05 smithi059 ceph-mon[30888]: Activating manager daemon x 2024-09-10T21:06:05.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:05 smithi059 ceph-mon[30888]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T21:06:05.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:05 smithi059 ceph-mon[30888]: mgrmap e10: x(active, starting, since 0.00403538s) 2024-09-10T21:06:05.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:06:05.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T21:06:05.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T21:06:05.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T21:06:05.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T21:06:05.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:05 smithi059 ceph-mon[30888]: Manager daemon x is now available 2024-09-10T21:06:06.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:06:06.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T21:06:06.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T21:06:06.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:06 smithi059 ceph-mon[30888]: mgrmap e11: x(active, since 1.00635s) 2024-09-10T21:06:06.761 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout { 2024-09-10T21:06:06.761 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T21:06:06.761 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T21:06:06.761 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout } 2024-09-10T21:06:06.761 INFO:teuthology.orchestra.run.smithi059.stdout:mgr epoch 9 is available 2024-09-10T21:06:06.762 INFO:teuthology.orchestra.run.smithi059.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-10T21:06:07.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-mon[30888]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T21:06:07.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-mon[30888]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T21:06:07.912 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: 2024-09-10T21:06:07.530+0000 7f4117c9d640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:21:06:07] ENGINE Error in HTTPServer.serve 2024-09-10T21:06:07.912 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: Traceback (most recent call last): 2024-09-10T21:06:07.912 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T21:06:07.913 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: self._connections.run(self.expiration_interval) 2024-09-10T21:06:07.913 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T21:06:07.913 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: self._run(expiration_interval) 2024-09-10T21:06:07.913 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T21:06:07.913 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T21:06:07.913 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T21:06:07.913 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T21:06:07.913 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T21:06:07.913 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: s = self.context.wrap_socket( 2024-09-10T21:06:07.913 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T21:06:07.913 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: return self.sslsocket_class._create( 2024-09-10T21:06:07.913 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T21:06:07.914 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: self.do_handshake() 2024-09-10T21:06:07.914 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T21:06:07.914 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: self._sslobj.do_handshake() 2024-09-10T21:06:07.914 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T21:06:07.914 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:06:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: 2024-09-10T21:06:08.542 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:08 smithi059 ceph-mon[30888]: mgrmap e12: x(active, since 2s) 2024-09-10T21:06:08.542 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:08 smithi059 ceph-mon[30888]: [10/Sep/2024:21:06:07] ENGINE Bus STARTING 2024-09-10T21:06:08.542 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:08 smithi059 ceph-mon[30888]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:06:08.542 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:08 smithi059 ceph-mon[30888]: [10/Sep/2024:21:06:07] ENGINE Serving on https://172.21.15.59:7150 2024-09-10T21:06:08.542 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:08 smithi059 ceph-mon[30888]: [10/Sep/2024:21:06:07] ENGINE Error in HTTPServer.serve 2024-09-10T21:06:08.543 INFO:journalctl@ceph.mon.a.smithi059.stdout: Traceback (most recent call last): 2024-09-10T21:06:08.543 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T21:06:08.543 INFO:journalctl@ceph.mon.a.smithi059.stdout: self._connections.run(self.expiration_interval) 2024-09-10T21:06:08.543 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T21:06:08.543 INFO:journalctl@ceph.mon.a.smithi059.stdout: self._run(expiration_interval) 2024-09-10T21:06:08.543 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T21:06:08.543 INFO:journalctl@ceph.mon.a.smithi059.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T21:06:08.543 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T21:06:08.543 INFO:journalctl@ceph.mon.a.smithi059.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T21:06:08.543 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T21:06:08.543 INFO:journalctl@ceph.mon.a.smithi059.stdout: s = self.context.wrap_socket( 2024-09-10T21:06:08.543 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T21:06:08.544 INFO:journalctl@ceph.mon.a.smithi059.stdout: return self.sslsocket_class._create( 2024-09-10T21:06:08.544 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T21:06:08.544 INFO:journalctl@ceph.mon.a.smithi059.stdout: self.do_handshake() 2024-09-10T21:06:08.544 INFO:journalctl@ceph.mon.a.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T21:06:08.544 INFO:journalctl@ceph.mon.a.smithi059.stdout: self._sslobj.do_handshake() 2024-09-10T21:06:08.544 INFO:journalctl@ceph.mon.a.smithi059.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T21:06:08.544 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:08 smithi059 ceph-mon[30888]: [10/Sep/2024:21:06:07] ENGINE Serving on http://172.21.15.59:8765 2024-09-10T21:06:08.544 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:08 smithi059 ceph-mon[30888]: [10/Sep/2024:21:06:07] ENGINE Bus STARTED 2024-09-10T21:06:08.544 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:08 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:08.787 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUO85HRUDuuTzz/Zhpr+XaNhBa9XYwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkxMDIxMDYwOFoXDTM0\nMDkxMTIxMDYwOFowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjU5MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEA7o8ELOzcZ3Tw/0eSN97nPiJdLhNXZts2ltkz\nvLkDlp+lHESumyDZJsQaFJHtxArx81Rdhv+2dgjT17iCFsKjbjq+z3c3gw2IJxFD\nsYPH7J59rbfLMEfNmnSYf7snNLBlPRuq3msANAWvh2MPQhzjN7AKupUMYHYYeFFz\nKG3d3DlQ5I8OOZw6J4KbDL4nM6YjIVyqoBC/4fFrONDOVpYVXV7SIYZHrsgfdyuX\nCVbcbhBoSB4AoXzHrP0rPE9q/UPnl/JKGscK02/TIG5OrI+Ch1seKU6tuysUCiSJ\nupkOWhuQFZg51Wz5AtafB7LjfLKLLUJXWxxDpSwWSAHxJEq+WKOHhsi4uEO+WYxM\nU76lzlymaZSxvQspPeWsVYCyY5ClcGAchxy1kKBgr3dMMzgDDl58X3eKJm9aVzIG\n+dlII4/UtMl4hMU9iW3fHwQQBEdZcVLQAm4vO5MJun4S7xRPKPkd5nEWUNDv05Af\nTkVe39QZ8+VMA8c29CY6mWYSf5mlOfR6aR0iDrfOpXQz0wwzp87gxcqkuVdmOuC9\nBhgJaNtd+c6geM2Sg8shjVr2HUmhRe6WPiOyUdLIOirrr917OR8PXffLNHuROsOC\ncu3M/q3z1TWbnxvpZhoyxLGHSCPXDUyNLbxwP9aFXPIbPLSftZ/x2h8ta2rok9fd\nQERupQkCAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDU5ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPOzAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQDG\nbrZnoMcUmWnVgRzAtpGcAq+T3SaAGUV+/8MFbu0JElU9ue6gn2SjkzG2n3flgVIB\nUDB0O+S2ZK9XZ4HKzyj4EILBrG1Kn9Gc97LAp8wVTfzTfcoRjTYTbte5JSnWB991\nahxWo7OIgRIKa7G1RB8Kh2PtamekQXnUmutkaTuexR/PciM0lKr2J7ZY9hR2ECUj\n5tyWHp6hn3ydT2vJIDJZr+Ep7mj5/nTVC4bJoWKS/oOHpFHt0l/lmjUscrJRlLq+\nHN7YPL+UJv9z44WTospkavXepgdZoBNhFsYYBjzacZ4K5uNvDFcWSjooRzpN67H8\nZeDe+qVaiFrdu6nRzUDACZ82QqKvolYDFXdeQz1VxWjmM6mNy3XKc/NWc522cXZT\nEi/PFfBDIN5zsL9HROWQ16yQ1QxjMi8E/HJwaZ5QXCFg3EDPfVBlg5srAx7iK65C\n8cKIPwhS02E/ML42iuxNbAfRqaeJWMRpDDZC18O/ITjGWXwIdB9XVC1CJ9guMMJb\nV/RYEuRuymlTForRABLBjlPw3MXeVXtRwkJdwwE5sp9qFdD+CCH1wIA8b/g3RSCr\nSL2qKmx7pxC9EE+OJXLNGMJClLClmSRXW+zjDHlp6qRzJ6gpCbENDExnjCu6h+f7\nk7Uma3Qo9kqZYovTO/k+zgae4aTPzyMrY7fDmMwhEg==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJJwIBAAKCAgEA7o8ELOzcZ3Tw/0eSN97nPiJdLhNXZts2ltkzvLkDlp+lHESu\nmyDZJsQaFJHtxArx81Rdhv+2dgjT17iCFsKjbjq+z3c3gw2IJxFDsYPH7J59rbfL\nMEfNmnSYf7snNLBlPRuq3msANAWvh2MPQhzjN7AKupUMYHYYeFFzKG3d3DlQ5I8O\nOZw6J4KbDL4nM6YjIVyqoBC/4fFrONDOVpYVXV7SIYZHrsgfdyuXCVbcbhBoSB4A\noXzHrP0rPE9q/UPnl/JKGscK02/TIG5OrI+Ch1seKU6tuysUCiSJupkOWhuQFZg5\n1Wz5AtafB7LjfLKLLUJXWxxDpSwWSAHxJEq+WKOHhsi4uEO+WYxMU76lzlymaZSx\nvQspPeWsVYCyY5ClcGAchxy1kKBgr3dMMzgDDl58X3eKJm9aVzIG+dlII4/UtMl4\nhMU9iW3fHwQQBEdZcVLQAm4vO5MJun4S7xRPKPkd5nEWUNDv05AfTkVe39QZ8+VM\nA8c29CY6mWYSf5mlOfR6aR0iDrfOpXQz0wwzp87gxcqkuVdmOuC9BhgJaNtd+c6g\neM2Sg8shjVr2HUmhRe6WPiOyUdLIOirrr917OR8PXffLNHuROsOCcu3M/q3z1TWb\nnxvpZhoyxLGHSCPXDUyNLbxwP9aFXPIbPLSftZ/x2h8ta2rok9fdQERupQkCAwEA\nAQKCAgBvW8pesEiocKHJAJ9kPkSisAbgKb4scNr4Krboe1MN/kLkQbliB8DmRDdK\nb95WG6fa5wBrsrV5PuCou+PZ/QyuOXT1wphisC/k0L3RQQtTzJ4tN/T8+h+jYJcJ\nVRNVmJwBnQczoS4smpTX9albOsHkLmSruUTYSHheveKsNjERCp5UuuSwhtlstR5s\nod0J0p1mhuvNIVR5A6mCEZKoP5IEjm03ogeXMqrhhbMQ9H+cT0Nmmr6/o1BQU7PZ\niNcQF6ElwD/QZSaMEZCz/Fn0Wl9bkPCw5p3Zl5/Ypjq2pJja/i/RrMgedSp+JTKC\nNQLVJEEspOHDUZvQIBbckS+AOfXE4ux+9yagh30xlnf7ZN60rJ6uPEta9Iovj0bY\nDpxC6mmd0PJ8ANicHjNh95P35HGRD35hXJESXOf/8IUZVnUZGcbcFbkiDeR4aw7K\nXqZdAHM0U236RU94fgOguhrWhNE+Jhk+DGL7l68Mfx3kmDXrQBf8J6Dz68ATzjo1\nv3LngBnd61rx8aJudtWECslyjw/s8nmJdz57zfB2KMtuKHUgHIo7HHr+As0yqk0a\nAi1mQjMnkeZt1464ZeMB2AIsVIsp2/RwA0CAdNXObcK4WhY/rsrpzEHdfxNdv/Hv\nKZlPy3mZ/pFBWea1f0dImBtIoHzpwQECfxc8FultF2VCzVIIywKCAQEA/mHfDY+W\nACAcWHsNRyBUc0ILxIL73KdcOQJTAEhbplB6K+8Y0a9RiO/rjUtB8Y7GIpQWa8KB\nq9wh25u9A3A+eUMzrEsL2peNQM31PccYyYqmaSVPmmxyTUFG53PkW1nAFz04J8jY\nxph+ezAK+Z3mts2cQrpUqtBXI2BxKSexjTzAgypHvp+YVkRDdsOXMMlo27LWYBMo\nMX13UzSxgAVQcU+kiXUTzoJ+lcuE5A+ufyZTYT/b5r4mmUDT2P6BvRVWE56IUsz9\nP8n/O6u4g3qo93CMdQyk+pl1bKGgBUNmHL5/bMIFGOpKXLwY13oW/J3fqhG3VEEj\nnFLvg4CCBPmvTwKCAQEA8BNia99cByT6EGc7bBoygAXJoboAVQdPOr8LVrNuYX89\nTXNgLoaorEqmyyWg2blgknAVX6hfa/9neHFwh1BT23X8tJVXwPVeyx8M84VJLGjv\nKpEkC3ChVgytsszX7ECvVZrOZc/17q3oJix7W11Dhe42SqHjbBTgtu/dOJs7vtD7\no7TlZQRPEM0sa1cpAxrZgTTfcpo19kFME1/yUfkR4sRB+dGDYevP397sczTWf+z8\nNVjldTQRWHh6PXVDU0JXFWm69yz4d01iCSQPioNBpnDvuzW/DEN4EQUWCF9m9dvL\nP5OYcXLCXAkOjbMjAEYAAJawfP5SDn7Y50ThRZAQJwKCAQAgp7W3ivApkfWxkhJR\nSCAvL5JNJrdoSv+2vcqj5aYGQpx8WVQpTsU7u/jUCY4skTR0Keh66tw0kKy0AVkR\nQO50KKFQg83AwOW8JPRPeuh+rtLP+p8uZq+BpViRy7nL1Eipcw1rZggV7muGKtOt\n2YxNeTWPB1ZpGxekjfPY4aSUSfE4pUvSd7BZmqfCbjdRZvmUAnAsoyjsuXuA7em/\nUm9SLHQlxSbGws+3MQodMLoozmWzvTvgchaIY98OIxXKjRugpyA+6Nu1vZuLMG8e\nSbe5E/Sj7fybwullCZZ+Nnm8ROQctQdsfF8RaoAR4TVkNmwI6/9JzJbisW7Xxb5r\nHxZXAoIBAD0KQLD6tnRek3IOPU6MDqD8V7rWBvWXiS5/mottzbfeWSDTH/ZUaJh9\n1pC6PX5+Iq647sZGkhRseMtn1FujMd8PzbPAcPJvsK1mdK2KCwPOnlitVIPQHEU7\nrgJTEOdRvwK9/JJoYLhR4T+reaXOPbfUzFsHdEJrwILi09VrqrImgoSqHtUjVlMI\nR633GEdg0UKHxfRmfyfgjE40y/DJqiGFEt1IxuXjxhO+o1HbclpOUAXkV1sIZQyg\nfTwZD4ggyvF304C7H2V9+FoooAbwvoVqG5n23V9p3CI/r81rLEuAmdnNVioqKn6q\nEtg2XsTYB3Ie3jq5kvV6jP2oRrqgGWsCggEAOfDsJm8CG/rXRTI2HIgj0se9RB7O\n8VWtfw2mC/fY8xuGIHCtvfSKy92TVaT1kToNWWDssPBtsQPDG4DKxFUDNfGfVJck\nZqFmKOMjjJz+eP99BOP0BJOozkQA6y4XnBi46Pp6wBN2fxudwJiSiQcGvn4GzFNJ\n7VfsZUg+eAj30A2VtVIb0r3FAR/BPFzjoDwXMn4jSyUUa/XEwtBXBVASjvXjAmkd\nNtEeoCeIezBaxzLaBZCRn5SFxBgyaqC5v7Y5tJy8JsHiFGagMg7G8JsMCi0uB0RE\n2IhoPwcPHpQ2bqfmFbQofHeaL1nfzmTpy13n4IH64BaQ11gWi5YxQdbJ4g==\n-----END RSA PRIVATE KEY-----\n"} 2024-09-10T21:06:10.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:09 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:10.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:09 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:10.448 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-10T21:06:11.096 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:10 smithi059 ceph-mon[30888]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:06:11.749 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-10T21:06:11.749 INFO:teuthology.orchestra.run.smithi059.stdout:Creating initial admin user... 2024-09-10T21:06:12.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:12 smithi059 ceph-mon[30888]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:06:12.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:12 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:13.163 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$QM5g14NUklPiuxe57PW0kO1gzk.9lIRlJ13O5jkQuPMLmAatzWAOO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726002372, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T21:06:13.163 INFO:teuthology.orchestra.run.smithi059.stdout:Fetching dashboard port number... 2024-09-10T21:06:13.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:13 smithi059 ceph-mon[30888]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:06:13.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:13 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:14.302 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T21:06:14.313 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T21:06:14.313 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout disabled 2024-09-10T21:06:14.321 INFO:teuthology.orchestra.run.smithi059.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T21:06:14.321 INFO:teuthology.orchestra.run.smithi059.stdout:systemctl: stdout inactive 2024-09-10T21:06:14.321 INFO:teuthology.orchestra.run.smithi059.stdout:firewalld.service is not enabled 2024-09-10T21:06:14.321 INFO:teuthology.orchestra.run.smithi059.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T21:06:14.323 INFO:teuthology.orchestra.run.smithi059.stdout:Ceph Dashboard is now available at: 2024-09-10T21:06:14.323 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:06:14.323 INFO:teuthology.orchestra.run.smithi059.stdout: URL: https://smithi059.front.sepia.ceph.com:8443/ 2024-09-10T21:06:14.323 INFO:teuthology.orchestra.run.smithi059.stdout: User: admin 2024-09-10T21:06:14.323 INFO:teuthology.orchestra.run.smithi059.stdout: Password: zalbykjqgc 2024-09-10T21:06:14.323 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:06:14.323 INFO:teuthology.orchestra.run.smithi059.stdout:Saving cluster configuration to /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/config directory 2024-09-10T21:06:14.728 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:14 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/757650318' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-10T21:06:15.668 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T21:06:15.668 INFO:teuthology.orchestra.run.smithi059.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T21:06:15.668 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:06:15.668 INFO:teuthology.orchestra.run.smithi059.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T21:06:15.668 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:06:15.668 INFO:teuthology.orchestra.run.smithi059.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T21:06:15.668 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:06:15.669 INFO:teuthology.orchestra.run.smithi059.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T21:06:15.669 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:06:15.669 INFO:teuthology.orchestra.run.smithi059.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T21:06:15.669 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:06:15.669 INFO:teuthology.orchestra.run.smithi059.stdout: ceph telemetry on 2024-09-10T21:06:15.669 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:06:15.669 INFO:teuthology.orchestra.run.smithi059.stdout:For more information see: 2024-09-10T21:06:15.669 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:06:15.669 INFO:teuthology.orchestra.run.smithi059.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T21:06:15.669 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:06:15.669 INFO:teuthology.orchestra.run.smithi059.stdout:Bootstrap complete. 2024-09-10T21:06:15.707 INFO:tasks.cephadm:Fetching config... 2024-09-10T21:06:15.707 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T21:06:15.707 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T21:06:15.723 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T21:06:15.723 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T21:06:15.723 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T21:06:15.779 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T21:06:15.779 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T21:06:15.779 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-10T21:06:15.844 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T21:06:15.844 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T21:06:15.844 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T21:06:15.899 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T21:06:15.899 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+xpQRgn1aY1jOfZnwWH0oWhQApGrDIZxoifdzF+4uuZ93teB7ps80HaGCdGn9If+w81rtGMaCYlJllFWOx8FYQy8VQGkCZl/hHbvFdFJQcU3ykXcWSzc0B9aChBgfhjN3n0DViq7wlUywzR6fnqIgoUqnydrdbQCXv4Ea57unWzQRdvH2LPuf5AT/cGF+5IC5ayVQKhaEuaYbQxuic7BrAA4CCp23GeWYfvWPqfcYcaGbyeafpirTKBfJu4kT4emdF7cmRe7CKznV/V5I4b/NnH8LkTw1rmJsoXCmeOwicndqGs9HzZ6h8YbZUjlgLpoLf44wa3j75ZHDxw+60iD8HWkIvuMO4rxI+wiDKNzj9joJdQJzoNbn/gysoUjyK8Gnb7uEHFuAXqODi3zgqReKNuPMUheA4h5PJ7h5FKddBlHIomP+VZRjNkA8cwKZUOgdT0cKXoePemBsFiPgE26G8FhjE1zomDxCMXNQgl7dgcDUUYmzBNgRaHQB8x68Pb0= ceph-3c26b952-6fb8-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T21:06:15.975 INFO:teuthology.orchestra.run.smithi059.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+xpQRgn1aY1jOfZnwWH0oWhQApGrDIZxoifdzF+4uuZ93teB7ps80HaGCdGn9If+w81rtGMaCYlJllFWOx8FYQy8VQGkCZl/hHbvFdFJQcU3ykXcWSzc0B9aChBgfhjN3n0DViq7wlUywzR6fnqIgoUqnydrdbQCXv4Ea57unWzQRdvH2LPuf5AT/cGF+5IC5ayVQKhaEuaYbQxuic7BrAA4CCp23GeWYfvWPqfcYcaGbyeafpirTKBfJu4kT4emdF7cmRe7CKznV/V5I4b/NnH8LkTw1rmJsoXCmeOwicndqGs9HzZ6h8YbZUjlgLpoLf44wa3j75ZHDxw+60iD8HWkIvuMO4rxI+wiDKNzj9joJdQJzoNbn/gysoUjyK8Gnb7uEHFuAXqODi3zgqReKNuPMUheA4h5PJ7h5FKddBlHIomP+VZRjNkA8cwKZUOgdT0cKXoePemBsFiPgE26G8FhjE1zomDxCMXNQgl7dgcDUUYmzBNgRaHQB8x68Pb0= ceph-3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:06:15.988 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+xpQRgn1aY1jOfZnwWH0oWhQApGrDIZxoifdzF+4uuZ93teB7ps80HaGCdGn9If+w81rtGMaCYlJllFWOx8FYQy8VQGkCZl/hHbvFdFJQcU3ykXcWSzc0B9aChBgfhjN3n0DViq7wlUywzR6fnqIgoUqnydrdbQCXv4Ea57unWzQRdvH2LPuf5AT/cGF+5IC5ayVQKhaEuaYbQxuic7BrAA4CCp23GeWYfvWPqfcYcaGbyeafpirTKBfJu4kT4emdF7cmRe7CKznV/V5I4b/NnH8LkTw1rmJsoXCmeOwicndqGs9HzZ6h8YbZUjlgLpoLf44wa3j75ZHDxw+60iD8HWkIvuMO4rxI+wiDKNzj9joJdQJzoNbn/gysoUjyK8Gnb7uEHFuAXqODi3zgqReKNuPMUheA4h5PJ7h5FKddBlHIomP+VZRjNkA8cwKZUOgdT0cKXoePemBsFiPgE26G8FhjE1zomDxCMXNQgl7dgcDUUYmzBNgRaHQB8x68Pb0= ceph-3c26b952-6fb8-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T21:06:16.032 INFO:teuthology.orchestra.run.smithi154.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+xpQRgn1aY1jOfZnwWH0oWhQApGrDIZxoifdzF+4uuZ93teB7ps80HaGCdGn9If+w81rtGMaCYlJllFWOx8FYQy8VQGkCZl/hHbvFdFJQcU3ykXcWSzc0B9aChBgfhjN3n0DViq7wlUywzR6fnqIgoUqnydrdbQCXv4Ea57unWzQRdvH2LPuf5AT/cGF+5IC5ayVQKhaEuaYbQxuic7BrAA4CCp23GeWYfvWPqfcYcaGbyeafpirTKBfJu4kT4emdF7cmRe7CKznV/V5I4b/NnH8LkTw1rmJsoXCmeOwicndqGs9HzZ6h8YbZUjlgLpoLf44wa3j75ZHDxw+60iD8HWkIvuMO4rxI+wiDKNzj9joJdQJzoNbn/gysoUjyK8Gnb7uEHFuAXqODi3zgqReKNuPMUheA4h5PJ7h5FKddBlHIomP+VZRjNkA8cwKZUOgdT0cKXoePemBsFiPgE26G8FhjE1zomDxCMXNQgl7dgcDUUYmzBNgRaHQB8x68Pb0= ceph-3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:06:16.043 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+xpQRgn1aY1jOfZnwWH0oWhQApGrDIZxoifdzF+4uuZ93teB7ps80HaGCdGn9If+w81rtGMaCYlJllFWOx8FYQy8VQGkCZl/hHbvFdFJQcU3ykXcWSzc0B9aChBgfhjN3n0DViq7wlUywzR6fnqIgoUqnydrdbQCXv4Ea57unWzQRdvH2LPuf5AT/cGF+5IC5ayVQKhaEuaYbQxuic7BrAA4CCp23GeWYfvWPqfcYcaGbyeafpirTKBfJu4kT4emdF7cmRe7CKznV/V5I4b/NnH8LkTw1rmJsoXCmeOwicndqGs9HzZ6h8YbZUjlgLpoLf44wa3j75ZHDxw+60iD8HWkIvuMO4rxI+wiDKNzj9joJdQJzoNbn/gysoUjyK8Gnb7uEHFuAXqODi3zgqReKNuPMUheA4h5PJ7h5FKddBlHIomP+VZRjNkA8cwKZUOgdT0cKXoePemBsFiPgE26G8FhjE1zomDxCMXNQgl7dgcDUUYmzBNgRaHQB8x68Pb0= ceph-3c26b952-6fb8-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T21:06:16.084 INFO:teuthology.orchestra.run.smithi192.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+xpQRgn1aY1jOfZnwWH0oWhQApGrDIZxoifdzF+4uuZ93teB7ps80HaGCdGn9If+w81rtGMaCYlJllFWOx8FYQy8VQGkCZl/hHbvFdFJQcU3ykXcWSzc0B9aChBgfhjN3n0DViq7wlUywzR6fnqIgoUqnydrdbQCXv4Ea57unWzQRdvH2LPuf5AT/cGF+5IC5ayVQKhaEuaYbQxuic7BrAA4CCp23GeWYfvWPqfcYcaGbyeafpirTKBfJu4kT4emdF7cmRe7CKznV/V5I4b/NnH8LkTw1rmJsoXCmeOwicndqGs9HzZ6h8YbZUjlgLpoLf44wa3j75ZHDxw+60iD8HWkIvuMO4rxI+wiDKNzj9joJdQJzoNbn/gysoUjyK8Gnb7uEHFuAXqODi3zgqReKNuPMUheA4h5PJ7h5FKddBlHIomP+VZRjNkA8cwKZUOgdT0cKXoePemBsFiPgE26G8FhjE1zomDxCMXNQgl7dgcDUUYmzBNgRaHQB8x68Pb0= ceph-3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:06:16.097 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T21:06:16.260 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:16 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2560665302' entity='client.admin' 2024-09-10T21:06:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:06:18.070 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T21:06:18.070 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T21:06:18.366 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:18 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2238773373' entity='client.admin' 2024-09-10T21:06:18.367 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:18 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:18.367 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:18 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:18.367 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:18 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi059", "name": "osd_memory_target"} : dispatch 2024-09-10T21:06:18.367 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:18 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:18.367 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:18 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:06:18.367 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:18 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:18.527 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:06:19.249 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:19 smithi059 ceph-mon[30888]: mgrmap e13: x(active, since 12s) 2024-09-10T21:06:20.008 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi154 2024-09-10T21:06:20.009 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T21:06:20.009 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.conf 2024-09-10T21:06:20.029 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T21:06:20.029 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:06:20.088 INFO:tasks.cephadm:Adding host smithi154 to orchestrator... 2024-09-10T21:06:20.089 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch host add smithi154 2024-09-10T21:06:20.505 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:20 smithi059 ceph-mon[30888]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:06:20.505 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:20 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:20.505 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:20 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:06:20.505 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:20 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:06:20.505 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:20 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:06:20.505 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:20 smithi059 ceph-mon[30888]: Updating smithi059:/etc/ceph/ceph.conf 2024-09-10T21:06:20.506 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:20 smithi059 ceph-mon[30888]: Updating smithi059:/var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:06:20.506 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:20 smithi059 ceph-mon[30888]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:06:20.506 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:20 smithi059 ceph-mon[30888]: Updating smithi059:/var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T21:06:20.506 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:20 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:20.506 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:20 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:20.506 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:20 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:20.534 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:06:22.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:21 smithi059 ceph-mon[30888]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:06:23.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:22 smithi059 ceph-mon[30888]: Deploying cephadm binary to smithi154 2024-09-10T21:06:24.992 INFO:teuthology.orchestra.run.smithi059.stdout:Added host 'smithi154' with addr '172.21.15.154' 2024-09-10T21:06:25.617 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T21:06:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:06:26.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:25 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:26.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:25 smithi059 ceph-mon[30888]: Added host smithi154 2024-09-10T21:06:26.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:25 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:06:26.274 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:25 smithi059 ceph-mon[30888]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:26.274 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:25 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:26.274 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:25 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:26.508 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:06:26.508 INFO:teuthology.orchestra.run.smithi059.stdout:[{"addr": "172.21.15.59", "hostname": "smithi059", "labels": [], "status": ""}, {"addr": "172.21.15.154", "hostname": "smithi154", "labels": [], "status": ""}] 2024-09-10T21:06:27.101 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi192 2024-09-10T21:06:27.101 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T21:06:27.101 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/etc/ceph/ceph.conf 2024-09-10T21:06:27.119 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T21:06:27.119 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:06:27.175 INFO:tasks.cephadm:Adding host smithi192 to orchestrator... 2024-09-10T21:06:27.176 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch host add smithi192 2024-09-10T21:06:27.443 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:06:27.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:27 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:27.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:27 smithi059 ceph-mon[30888]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:06:28.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:28 smithi059 ceph-mon[30888]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:29.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:29 smithi059 ceph-mon[30888]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi192", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:06:29.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:29.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:29.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:29.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:29.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"} : dispatch 2024-09-10T21:06:29.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:06:29.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:06:30.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:30 smithi059 ceph-mon[30888]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:30.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:30 smithi059 ceph-mon[30888]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-10T21:06:30.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:30 smithi059 ceph-mon[30888]: Deploying cephadm binary to smithi192 2024-09-10T21:06:30.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:30 smithi059 ceph-mon[30888]: Updating smithi154:/var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:06:30.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:30 smithi059 ceph-mon[30888]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:06:30.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:30 smithi059 ceph-mon[30888]: Updating smithi154:/var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T21:06:30.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:30 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:30.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:30 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:30.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:30 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:31.999 INFO:teuthology.orchestra.run.smithi059.stdout:Added host 'smithi192' with addr '172.21.15.192' 2024-09-10T21:06:32.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:32 smithi059 ceph-mon[30888]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:32.698 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:32 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:32.698 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:32 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:06:32.698 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:32 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:32.799 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T21:06:33.054 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:06:33.692 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:06:33.693 INFO:teuthology.orchestra.run.smithi059.stdout:[{"addr": "172.21.15.59", "hostname": "smithi059", "labels": [], "status": ""}, {"addr": "172.21.15.154", "hostname": "smithi154", "labels": [], "status": ""}, {"addr": "172.21.15.192", "hostname": "smithi192", "labels": [], "status": ""}] 2024-09-10T21:06:33.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:33 smithi059 ceph-mon[30888]: Added host smithi192 2024-09-10T21:06:33.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:33 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:33.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:33 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:34.286 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T21:06:34.287 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T21:06:34.537 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:06:34.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:34 smithi059 ceph-mon[30888]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:34.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:34 smithi059 ceph-mon[30888]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:06:35.605 INFO:teuthology.orchestra.run.smithi059.stderr:adjusted tunables profile to default 2024-09-10T21:06:35.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:35 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1433878155' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T21:06:36.237 INFO:tasks.cephadm:Adding mon.a on smithi059 2024-09-10T21:06:36.237 INFO:tasks.cephadm:Adding mon.b on smithi154 2024-09-10T21:06:36.237 INFO:tasks.cephadm:Adding mon.c on smithi192 2024-09-10T21:06:36.237 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi059:172.21.15.59=a;smithi154:172.21.15.154=b;smithi192:172.21.15.192=c' 2024-09-10T21:06:36.481 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T21:06:36.528 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T21:06:36.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:36 smithi059 ceph-mon[30888]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:36.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:36 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1433878155' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T21:06:36.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:36 smithi059 ceph-mon[30888]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T21:06:36.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:36 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:36.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:36 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:36.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:36 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:36.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:36 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:36.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:36 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi192", "name": "osd_memory_target"} : dispatch 2024-09-10T21:06:36.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:36 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:06:36.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:36 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:06:37.218 INFO:teuthology.orchestra.run.smithi192.stdout:Scheduled mon update... 2024-09-10T21:06:37.755 DEBUG:teuthology.orchestra.run.smithi154:mon.b> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mon.b.service 2024-09-10T21:06:37.758 DEBUG:teuthology.orchestra.run.smithi192:mon.c> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mon.c.service 2024-09-10T21:06:37.761 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T21:06:37.761 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T21:06:37.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:37 smithi059 ceph-mon[30888]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-10T21:06:37.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:37 smithi059 ceph-mon[30888]: Updating smithi192:/var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:06:37.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:37 smithi059 ceph-mon[30888]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:06:37.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:37 smithi059 ceph-mon[30888]: Updating smithi192:/var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T21:06:37.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:37 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:37.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:37 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:37.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:37 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:37.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:37 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:37.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:37 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:06:37.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:37 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:06:37.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:37 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:06:37.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:37 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:37.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:37 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:06:37.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:37 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:06:38.462 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:06:38.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:38 smithi059 ceph-mon[30888]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:38.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:38 smithi059 ceph-mon[30888]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi059:172.21.15.59=a;smithi154:172.21.15.154=b;smithi192:172.21.15.192=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:06:38.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:38 smithi059 ceph-mon[30888]: Saving service mon spec with placement smithi059:172.21.15.59=a;smithi154:172.21.15.154=b;smithi192:172.21.15.192=c;count:3 2024-09-10T21:06:38.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:38 smithi059 ceph-mon[30888]: Deploying daemon mon.c on smithi192 2024-09-10T21:06:39.095 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:06:39.095 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"3c26b952-6fb8-11ef-bcea-c7b262605968","modified":"2024-09-10T21:05:14.912724Z","created":"2024-09-10T21:05:14.912724Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T21:06:39.095 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-10T21:06:39.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:39 smithi059 ceph-mon[30888]: from='client.? 172.21.15.192:0/590042984' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T21:06:40.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:40 smithi059 ceph-mon[30888]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:42.033 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T21:06:42.033 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T21:06:42.056 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:41 smithi192 systemd[1]: Started Ceph mon.c for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:06:42.287 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:06:47.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:47.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:06:47.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: mon.a calling monitor election 2024-09-10T21:06:47.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:06:47.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:06:47.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:47.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:06:47.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: mon.c calling monitor election 2024-09-10T21:06:47.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:06:47.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:47.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:06:47.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:06:47.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T21:06:47.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: monmap epoch 2 2024-09-10T21:06:47.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:06:47.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: last_changed 2024-09-10T21:06:41.931456+0000 2024-09-10T21:06:47.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: created 2024-09-10T21:05:14.912724+0000 2024-09-10T21:06:47.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: min_mon_release 19 (squid) 2024-09-10T21:06:47.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: election_strategy: 1 2024-09-10T21:06:47.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: 0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-09-10T21:06:47.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-10T21:06:47.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: fsmap 2024-09-10T21:06:47.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T21:06:47.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: mgrmap e13: x(active, since 41s) 2024-09-10T21:06:47.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: overall HEALTH_OK 2024-09-10T21:06:47.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:47.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:47.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:47.331 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:06:47.331 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:06:47.376 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:06:47.376 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":2,"fsid":"3c26b952-6fb8-11ef-bcea-c7b262605968","modified":"2024-09-10T21:06:41.931456Z","created":"2024-09-10T21:05:14.912724Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:3300","nonce":0},{"type":"v1","addr":"172.21.15.192:6789","nonce":0}]},"addr":"172.21.15.192:6789/0","public_addr":"172.21.15.192:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T21:06:47.376 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 2 2024-09-10T21:06:47.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:47.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:06:47.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: mon.a calling monitor election 2024-09-10T21:06:47.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:06:47.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:06:47.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:47.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:06:47.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: mon.c calling monitor election 2024-09-10T21:06:47.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:06:47.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:47.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:06:47.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:06:47.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T21:06:47.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: monmap epoch 2 2024-09-10T21:06:47.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:06:47.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: last_changed 2024-09-10T21:06:41.931456+0000 2024-09-10T21:06:47.413 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: created 2024-09-10T21:05:14.912724+0000 2024-09-10T21:06:47.413 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: min_mon_release 19 (squid) 2024-09-10T21:06:47.413 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: election_strategy: 1 2024-09-10T21:06:47.413 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: 0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-09-10T21:06:47.413 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-10T21:06:47.413 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: fsmap 2024-09-10T21:06:47.413 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T21:06:47.413 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: mgrmap e13: x(active, since 41s) 2024-09-10T21:06:47.413 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: overall HEALTH_OK 2024-09-10T21:06:47.413 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:47.413 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:47.413 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:47.413 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:06:47.414 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:06:48.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:48 smithi059 ceph-mon[30888]: Deploying daemon mon.b on smithi154 2024-09-10T21:06:48.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:48 smithi059 ceph-mon[30888]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:48.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:48 smithi059 ceph-mon[30888]: from='client.? 172.21.15.192:0/1574967360' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T21:06:48.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:48 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:06:48.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:48 smithi192 ceph-mon[35363]: Deploying daemon mon.b on smithi154 2024-09-10T21:06:48.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:48 smithi192 ceph-mon[35363]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:48.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:48 smithi192 ceph-mon[35363]: from='client.? 172.21.15.192:0/1574967360' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T21:06:48.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:48 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:06:48.945 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T21:06:48.945 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T21:06:49.199 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:06:49.883 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:06:49.883 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":2,"fsid":"3c26b952-6fb8-11ef-bcea-c7b262605968","modified":"2024-09-10T21:06:41.931456Z","created":"2024-09-10T21:05:14.912724Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:3300","nonce":0},{"type":"v1","addr":"172.21.15.192:6789","nonce":0}]},"addr":"172.21.15.192:6789/0","public_addr":"172.21.15.192:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T21:06:49.883 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 2 2024-09-10T21:06:50.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:50 smithi192 ceph-mon[35363]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:50.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:50 smithi192 ceph-mon[35363]: from='client.? 172.21.15.192:0/1102645641' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T21:06:50.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:50 smithi059 ceph-mon[30888]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:50.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:50 smithi059 ceph-mon[30888]: from='client.? 172.21.15.192:0/1102645641' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T21:06:50.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:50 smithi154 systemd[1]: Started Ceph mon.b for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:06:51.429 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T21:06:51.429 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T21:06:51.680 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:06:55.973 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:06:55.973 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":3,"fsid":"3c26b952-6fb8-11ef-bcea-c7b262605968","modified":"2024-09-10T21:06:50.661741Z","created":"2024-09-10T21:05:14.912724Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:3300","nonce":0},{"type":"v1","addr":"172.21.15.192:6789","nonce":0}]},"addr":"172.21.15.192:6789/0","public_addr":"172.21.15.192:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-10T21:06:55.973 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 3 2024-09-10T21:06:55.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:06:55.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: mon.a calling monitor election 2024-09-10T21:06:55.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:55.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:06:55.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: mon.c calling monitor election 2024-09-10T21:06:55.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:55.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:55.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:55.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: mon.b calling monitor election 2024-09-10T21:06:55.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:55.986 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:55.986 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:55.986 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:55.986 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T21:06:55.986 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: monmap epoch 3 2024-09-10T21:06:55.986 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:06:55.986 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: last_changed 2024-09-10T21:06:50.661741+0000 2024-09-10T21:06:55.986 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: created 2024-09-10T21:05:14.912724+0000 2024-09-10T21:06:55.986 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: min_mon_release 19 (squid) 2024-09-10T21:06:55.986 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: election_strategy: 1 2024-09-10T21:06:55.986 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: 0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-09-10T21:06:55.986 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-10T21:06:55.986 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: 2: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-10T21:06:55.987 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: fsmap 2024-09-10T21:06:55.987 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T21:06:55.987 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: mgrmap e13: x(active, since 50s) 2024-09-10T21:06:55.987 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: overall HEALTH_OK 2024-09-10T21:06:55.987 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:55.987 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:55.987 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:55.987 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:56.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:06:56.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: mon.a calling monitor election 2024-09-10T21:06:56.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:56.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:06:56.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: mon.c calling monitor election 2024-09-10T21:06:56.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:56.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:56.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:56.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: mon.b calling monitor election 2024-09-10T21:06:56.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:56.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:56.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:56.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:56.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T21:06:56.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: monmap epoch 3 2024-09-10T21:06:56.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:06:56.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: last_changed 2024-09-10T21:06:50.661741+0000 2024-09-10T21:06:56.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: created 2024-09-10T21:05:14.912724+0000 2024-09-10T21:06:56.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: min_mon_release 19 (squid) 2024-09-10T21:06:56.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: election_strategy: 1 2024-09-10T21:06:56.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: 0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-09-10T21:06:56.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-10T21:06:56.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: 2: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-10T21:06:56.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: fsmap 2024-09-10T21:06:56.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T21:06:56.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: mgrmap e13: x(active, since 50s) 2024-09-10T21:06:56.164 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: overall HEALTH_OK 2024-09-10T21:06:56.164 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:56.164 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:56.164 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:56.164 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:56.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:06:56.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: mon.a calling monitor election 2024-09-10T21:06:56.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:56.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:06:56.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: mon.c calling monitor election 2024-09-10T21:06:56.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:56.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:56.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:56.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: mon.b calling monitor election 2024-09-10T21:06:56.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:56.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:56.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:56.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:56.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T21:06:56.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: monmap epoch 3 2024-09-10T21:06:56.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:06:56.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: last_changed 2024-09-10T21:06:50.661741+0000 2024-09-10T21:06:56.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: created 2024-09-10T21:05:14.912724+0000 2024-09-10T21:06:56.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: min_mon_release 19 (squid) 2024-09-10T21:06:56.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: election_strategy: 1 2024-09-10T21:06:56.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: 0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-09-10T21:06:56.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.c 2024-09-10T21:06:56.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: 2: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-10T21:06:56.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: fsmap 2024-09-10T21:06:56.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T21:06:56.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: mgrmap e13: x(active, since 50s) 2024-09-10T21:06:56.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: overall HEALTH_OK 2024-09-10T21:06:56.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:56.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:56.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:56.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:56.559 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T21:06:56.559 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T21:06:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:06:56.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:56 smithi059 ceph-mon[30888]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:56.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:56 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:06:56.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:56 smithi059 ceph-mon[30888]: from='client.? 172.21.15.192:0/48285466' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T21:06:56.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:56 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:57.072 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:56 smithi192 ceph-mon[35363]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:57.072 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:56 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:06:57.072 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:56 smithi192 ceph-mon[35363]: from='client.? 172.21.15.192:0/48285466' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T21:06:57.072 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:56 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:57.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:56 smithi154 ceph-mon[35041]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:57.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:56 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:06:57.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:56 smithi154 ceph-mon[35041]: from='client.? 172.21.15.192:0/48285466' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T21:06:57.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:56 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:06:57.631 INFO:teuthology.orchestra.run.smithi059.stdout:# minimal ceph.conf for 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:06:57.631 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2024-09-10T21:06:57.631 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:06:57.631 INFO:teuthology.orchestra.run.smithi059.stdout: mon_host = [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] 2024-09-10T21:06:58.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:57 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:58.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:57 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:58.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:57 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:58.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:57 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:58.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:57 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:06:58.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:57 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:06:58.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:57 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/462687682' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:06:58.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:57 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:58.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:57 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:58.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:57 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:58.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:57 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:58.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:57 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:06:58.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:57 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:06:58.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:57 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/462687682' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:06:58.267 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T21:06:58.268 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T21:06:58.268 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T21:06:58.297 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T21:06:58.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:06:58.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:57 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:58.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:57 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:58.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:57 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:58.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:57 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:58.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:57 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:06:58.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:57 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:06:58.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:57 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/462687682' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:06:58.364 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T21:06:58.364 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T21:06:58.392 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T21:06:58.392 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:06:58.457 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T21:06:58.457 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T21:06:58.484 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T21:06:58.484 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T21:06:58.549 INFO:tasks.cephadm:Adding mgr.x on smithi059 2024-09-10T21:06:58.549 INFO:tasks.cephadm:Adding mgr.y on smithi154 2024-09-10T21:06:58.549 INFO:tasks.cephadm:Adding mgr.z on smithi192 2024-09-10T21:06:58.549 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi059=x;smithi154=y;smithi192=z' 2024-09-10T21:06:58.826 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:06:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: Updating smithi059:/etc/ceph/ceph.conf 2024-09-10T21:06:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-10T21:06:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-10T21:06:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: Updating smithi192:/var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:06:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: Updating smithi154:/var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:06:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: Updating smithi059:/var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:06:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:06:59.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T21:06:59.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:06:59.223 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:59.224 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: Updating smithi059:/etc/ceph/ceph.conf 2024-09-10T21:06:59.224 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-10T21:06:59.224 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-10T21:06:59.224 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: Updating smithi192:/var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:06:59.224 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: Updating smithi154:/var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:06:59.224 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: Updating smithi059:/var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:06:59.224 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.224 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.224 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.224 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.224 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.224 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.225 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.225 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.225 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.225 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.225 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.225 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:06:59.225 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T21:06:59.225 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:06:59.386 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:06:59.386 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: Updating smithi059:/etc/ceph/ceph.conf 2024-09-10T21:06:59.386 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: Updating smithi154:/etc/ceph/ceph.conf 2024-09-10T21:06:59.386 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-10T21:06:59.386 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: Updating smithi192:/var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:06:59.386 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: Updating smithi154:/var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:06:59.386 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: Updating smithi059:/var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T21:06:59.386 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.386 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.386 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.386 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.386 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.386 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:06:59.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:06:59.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T21:06:59.387 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:06:59.430 INFO:teuthology.orchestra.run.smithi192.stdout:Scheduled mgr update... 2024-09-10T21:06:59.929 DEBUG:teuthology.orchestra.run.smithi154:mgr.y> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mgr.y.service 2024-09-10T21:06:59.932 DEBUG:teuthology.orchestra.run.smithi192:mgr.z> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mgr.z.service 2024-09-10T21:06:59.935 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-10T21:06:59.935 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-10T21:06:59.940 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-10T21:06:59.940 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set client debug_client 20 2024-09-10T21:06:59.983 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-10T21:06:59.984 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set client debug_ms 1 2024-09-10T21:07:00.026 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-10T21:07:00.027 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-10T21:07:00.070 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-10T21:07:00.070 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-10T21:07:00.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:59 smithi059 ceph-mon[30888]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T21:07:00.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:59 smithi059 ceph-mon[30888]: Reconfiguring daemon mon.a on smithi059 2024-09-10T21:07:00.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:59 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:00.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:59 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:00.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:59 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:00.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:59 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T21:07:00.090 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:59 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T21:07:00.091 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:06:59 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:00.091 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-10T21:07:00.091 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-10T21:07:00.134 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-10T21:07:00.134 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-10T21:07:00.178 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-10T21:07:00.178 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-10T21:07:00.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:59 smithi154 ceph-mon[35041]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T21:07:00.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:59 smithi154 ceph-mon[35041]: Reconfiguring daemon mon.a on smithi059 2024-09-10T21:07:00.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:59 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:00.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:59 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:00.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:59 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:00.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:59 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T21:07:00.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:59 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T21:07:00.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:06:59 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:00.221 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-10T21:07:00.221 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-10T21:07:00.264 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-10T21:07:00.264 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-09-10T21:07:00.307 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-10T21:07:00.307 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-09-10T21:07:00.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:59 smithi192 ceph-mon[35363]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T21:07:00.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:59 smithi192 ceph-mon[35363]: Reconfiguring daemon mon.a on smithi059 2024-09-10T21:07:00.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:59 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:00.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:59 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:00.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:59 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:00.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:59 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T21:07:00.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:59 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T21:07:00.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:06:59 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:00.350 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-10T21:07:00.350 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-09-10T21:07:00.405 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-10T21:07:00.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-10T21:07:00.457 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-10T21:07:00.457 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-10T21:07:00.505 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-10T21:07:00.505 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-10T21:07:00.548 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-10T21:07:00.548 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-10T21:07:00.595 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-10T21:07:00.595 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-10T21:07:00.638 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T21:07:00.638 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-10T21:07:00.683 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T21:07:00.683 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-10T21:07:00.730 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-10T21:07:00.730 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-10T21:07:00.775 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T21:07:00.775 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T21:07:00.825 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-10T21:07:00.825 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-10T21:07:00.876 DEBUG:tasks.cephadm:set 22 configs 2024-09-10T21:07:00.876 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi059') 2024-09-10T21:07:00.941 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:00 smithi059 ceph-mon[30888]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:00.941 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:00 smithi059 ceph-mon[30888]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi059=x;smithi154=y;smithi192=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:07:00.941 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:00 smithi059 ceph-mon[30888]: Saving service mgr spec with placement smithi059=x;smithi154=y;smithi192=z;count:3 2024-09-10T21:07:00.942 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:00 smithi059 ceph-mon[30888]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T21:07:00.942 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:00 smithi059 ceph-mon[30888]: Reconfiguring daemon mgr.x on smithi059 2024-09-10T21:07:00.942 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:00 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:01.130 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:01.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:00 smithi192 ceph-mon[35363]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:01.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:00 smithi192 ceph-mon[35363]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi059=x;smithi154=y;smithi192=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:07:01.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:00 smithi192 ceph-mon[35363]: Saving service mgr spec with placement smithi059=x;smithi154=y;smithi192=z;count:3 2024-09-10T21:07:01.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:00 smithi192 ceph-mon[35363]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T21:07:01.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:00 smithi192 ceph-mon[35363]: Reconfiguring daemon mgr.x on smithi059 2024-09-10T21:07:01.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:00 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:01.396 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:00 smithi154 ceph-mon[35041]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:01.396 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:00 smithi154 ceph-mon[35041]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi059=x;smithi154=y;smithi192=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:07:01.396 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:00 smithi154 ceph-mon[35041]: Saving service mgr spec with placement smithi059=x;smithi154=y;smithi192=z;count:3 2024-09-10T21:07:01.396 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:00 smithi154 ceph-mon[35041]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T21:07:01.396 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:00 smithi154 ceph-mon[35041]: Reconfiguring daemon mgr.x on smithi059 2024-09-10T21:07:01.396 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:00 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:01.703 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:01.708 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:01.709 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:01.718 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:02.317 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:02 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:02.317 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:02 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:02.317 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:02 smithi154 ceph-mon[35041]: Reconfiguring mon.b (monmap changed)... 2024-09-10T21:07:02.317 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:02 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:07:02.317 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:02 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T21:07:02.317 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:02 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:02.317 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:02 smithi154 ceph-mon[35041]: Reconfiguring daemon mon.b on smithi154 2024-09-10T21:07:02.318 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:02 smithi154 ceph-mon[35041]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:02.318 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:02 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/702330993' entity='client.admin' 2024-09-10T21:07:02.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:02 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:02.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:02 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:02.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:02 smithi192 ceph-mon[35363]: Reconfiguring mon.b (monmap changed)... 2024-09-10T21:07:02.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:02 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:07:02.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:02 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T21:07:02.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:02 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:02.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:02 smithi192 ceph-mon[35363]: Reconfiguring daemon mon.b on smithi154 2024-09-10T21:07:02.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:02 smithi192 ceph-mon[35363]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:02.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:02 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/702330993' entity='client.admin' 2024-09-10T21:07:02.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:02 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:02.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:02 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:02.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:02 smithi059 ceph-mon[30888]: Reconfiguring mon.b (monmap changed)... 2024-09-10T21:07:02.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:02 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:07:02.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:02 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T21:07:02.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:02 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:02.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:02 smithi059 ceph-mon[30888]: Reconfiguring daemon mon.b on smithi154 2024-09-10T21:07:02.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:02 smithi059 ceph-mon[30888]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:02.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:02 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/702330993' entity='client.admin' 2024-09-10T21:07:03.633 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:03 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:03.633 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:03 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:03.633 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:03 smithi192 ceph-mon[35363]: Reconfiguring mon.c (monmap changed)... 2024-09-10T21:07:03.633 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:03 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:07:03.633 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:03 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T21:07:03.633 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:03 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:03.633 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:03 smithi192 ceph-mon[35363]: Reconfiguring daemon mon.c on smithi192 2024-09-10T21:07:03.660 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:03 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:03.660 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:03 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:03.660 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:03 smithi059 ceph-mon[30888]: Reconfiguring mon.c (monmap changed)... 2024-09-10T21:07:03.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:03 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:07:03.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:03 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T21:07:03.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:03 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:03.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:03 smithi059 ceph-mon[30888]: Reconfiguring daemon mon.c on smithi192 2024-09-10T21:07:03.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:03 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:03.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:03 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:03.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:03 smithi154 ceph-mon[35041]: Reconfiguring mon.c (monmap changed)... 2024-09-10T21:07:03.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:03 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T21:07:03.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:03 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T21:07:03.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:03 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:03.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:03 smithi154 ceph-mon[35041]: Reconfiguring daemon mon.c on smithi192 2024-09-10T21:07:04.769 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:04 smithi059 ceph-mon[30888]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:04.769 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:04 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/742534261' entity='client.admin' 2024-09-10T21:07:04.769 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:04 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2501287040' entity='client.admin' 2024-09-10T21:07:04.769 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:04.769 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:04.769 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:07:04.770 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:04.770 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:07:04.770 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:04.770 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T21:07:04.770 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T21:07:04.770 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T21:07:04.770 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:04.770 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:04 smithi059 ceph-mon[30888]: Deploying daemon mgr.z on smithi192 2024-09-10T21:07:04.770 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:04 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1787042278' entity='client.admin' 2024-09-10T21:07:04.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:04 smithi192 ceph-mon[35363]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:04.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:04 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/742534261' entity='client.admin' 2024-09-10T21:07:04.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:04 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2501287040' entity='client.admin' 2024-09-10T21:07:04.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:04.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:04.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:07:04.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:04.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:07:04.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:04.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T21:07:04.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T21:07:04.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T21:07:04.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:04.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:04 smithi192 ceph-mon[35363]: Deploying daemon mgr.z on smithi192 2024-09-10T21:07:04.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:04 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1787042278' entity='client.admin' 2024-09-10T21:07:04.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:04 smithi154 ceph-mon[35041]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:04.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:04 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/742534261' entity='client.admin' 2024-09-10T21:07:04.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:04 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2501287040' entity='client.admin' 2024-09-10T21:07:04.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:04.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:04.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:07:04.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:04.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:07:04.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:04.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T21:07:04.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T21:07:04.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T21:07:04.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:04.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:04 smithi154 ceph-mon[35041]: Deploying daemon mgr.z on smithi192 2024-09-10T21:07:04.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:04 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1787042278' entity='client.admin' 2024-09-10T21:07:05.781 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 10 21:07:05 smithi192 systemd[1]: Starting Ceph mgr.z for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:07:06.078 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 10 21:07:05 smithi192 podman[36924]: 2024-09-10 21:07:05.680241525 +0000 UTC m=+0.016085888 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:07:06.078 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 10 21:07:05 smithi192 podman[36924]: 2024-09-10 21:07:05.779073574 +0000 UTC m=+0.114917937 container create 71c1ee07190ee290cdb1d2bb8cbfb4a6a746bd34dae1c2c0f06094dc71ff6b6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-z, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T21:07:06.078 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 10 21:07:05 smithi192 podman[36924]: 2024-09-10 21:07:05.976972008 +0000 UTC m=+0.312816372 container init 71c1ee07190ee290cdb1d2bb8cbfb4a6a746bd34dae1c2c0f06094dc71ff6b6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-z, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-09-10T21:07:06.078 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 10 21:07:05 smithi192 podman[36924]: 2024-09-10 21:07:05.979929865 +0000 UTC m=+0.315774229 container start 71c1ee07190ee290cdb1d2bb8cbfb4a6a746bd34dae1c2c0f06094dc71ff6b6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-z, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-10T21:07:06.078 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 10 21:07:06 smithi192 ceph-mgr[36943]: -- 172.21.15.192:0/1762041806 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5617057b10e0 con 0x56170578f400 2024-09-10T21:07:06.578 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 10 21:07:06 smithi192 bash[36924]: 71c1ee07190ee290cdb1d2bb8cbfb4a6a746bd34dae1c2c0f06094dc71ff6b6b 2024-09-10T21:07:06.578 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 10 21:07:06 smithi192 systemd[1]: Started Ceph mgr.z for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:07:06.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:06 smithi059 ceph-mon[30888]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:06.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:06 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3418576827' entity='client.admin' 2024-09-10T21:07:06.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:06.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:06.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:06.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T21:07:06.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T21:07:06.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T21:07:06.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:06.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:06 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2633276076' entity='client.admin' 2024-09-10T21:07:06.919 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:06 smithi154 ceph-mon[35041]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:06.919 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:06 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3418576827' entity='client.admin' 2024-09-10T21:07:06.919 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:06.920 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:06.920 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:06.920 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T21:07:06.920 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T21:07:06.920 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T21:07:06.920 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:06.920 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:06 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2633276076' entity='client.admin' 2024-09-10T21:07:07.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:06 smithi192 ceph-mon[35363]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:07.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:06 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3418576827' entity='client.admin' 2024-09-10T21:07:07.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:07.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:07.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:07.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T21:07:07.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T21:07:07.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T21:07:07.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:07.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:06 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2633276076' entity='client.admin' 2024-09-10T21:07:07.159 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:07.160 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:07.160 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:07.167 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:07.168 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:07.168 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:07.168 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:07.178 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:07.179 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:07.179 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:07.182 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:07.809 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:07 smithi059 ceph-mon[30888]: Deploying daemon mgr.y on smithi154 2024-09-10T21:07:08.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:07 smithi192 ceph-mon[35363]: Deploying daemon mgr.y on smithi154 2024-09-10T21:07:08.085 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:07 smithi154 ceph-mon[35041]: Deploying daemon mgr.y on smithi154 2024-09-10T21:07:08.085 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 21:07:07 smithi154 systemd[1]: Starting Ceph mgr.y for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:07:08.338 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 21:07:08 smithi154 podman[36159]: 2024-09-10 21:07:07.984410035 +0000 UTC m=+0.015894939 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:07:08.338 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 21:07:08 smithi154 podman[36159]: 2024-09-10 21:07:08.096127959 +0000 UTC m=+0.127612850 container create 8868cafc2947df0743b3442df100635a49ae5af98f2e0dabc5b0938593bc62ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:07:08.338 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 21:07:08 smithi154 podman[36159]: 2024-09-10 21:07:08.332007538 +0000 UTC m=+0.363492430 container init 8868cafc2947df0743b3442df100635a49ae5af98f2e0dabc5b0938593bc62ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-y, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-10T21:07:08.338 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 21:07:08 smithi154 podman[36159]: 2024-09-10 21:07:08.334989637 +0000 UTC m=+0.366474537 container start 8868cafc2947df0743b3442df100635a49ae5af98f2e0dabc5b0938593bc62ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-y, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:07:08.682 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 21:07:08 smithi154 ceph-mgr[36179]: -- 172.21.15.154:0/349989188 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563e2bec50e0 con 0x563e2bea3000 2024-09-10T21:07:08.683 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 21:07:08 smithi154 bash[36159]: 8868cafc2947df0743b3442df100635a49ae5af98f2e0dabc5b0938593bc62ff 2024-09-10T21:07:08.683 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 21:07:08 smithi154 systemd[1]: Started Ceph mgr.y for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:07:08.953 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:08 smithi059 ceph-mon[30888]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:08.954 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:08 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:08.954 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:08 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:08.954 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:08 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:08.954 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:08 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:08.955 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:08 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:07:09.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:08 smithi192 ceph-mon[35363]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:09.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:08 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:09.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:08 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:09.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:08 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:09.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:08 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:09.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:08 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:07:09.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:08 smithi154 ceph-mon[35041]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:09.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:08 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:09.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:08 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:09.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:08 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:09.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:08 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:09.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:08 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:07:09.730 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:09.730 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:09.730 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:09.731 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:10.134 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:09 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/553312820' entity='client.admin' 2024-09-10T21:07:10.134 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:09 smithi059 ceph-mon[30888]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:10.134 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:09 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:10.134 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:09 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:10.135 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:09 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:10.135 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:09 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:10.135 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:09 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:10.135 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:09 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:07:10.135 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:09 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:10.135 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:09 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/598478292' entity='client.admin' 2024-09-10T21:07:10.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:09 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/553312820' entity='client.admin' 2024-09-10T21:07:10.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:09 smithi192 ceph-mon[35363]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:10.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:09 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:10.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:09 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:10.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:09 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:10.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:09 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:10.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:09 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:10.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:09 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:07:10.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:09 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:10.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:09 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/598478292' entity='client.admin' 2024-09-10T21:07:10.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:09 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/553312820' entity='client.admin' 2024-09-10T21:07:10.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:09 smithi154 ceph-mon[35041]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:10.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:09 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:10.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:09 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:10.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:09 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:10.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:09 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:10.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:09 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:10.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:09 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:07:10.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:09 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:10.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:09 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/598478292' entity='client.admin' 2024-09-10T21:07:11.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:07:11.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:11.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:07:11.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:11.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:10 smithi059 ceph-mon[30888]: from='client.? ' entity='client.admin' 2024-09-10T21:07:11.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:11.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:07:11.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:11.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:07:11.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:11.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:10 smithi192 ceph-mon[35363]: from='client.? ' entity='client.admin' 2024-09-10T21:07:11.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:11.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:07:11.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:11.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:07:11.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:11.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:10 smithi154 ceph-mon[35041]: from='client.? ' entity='client.admin' 2024-09-10T21:07:11.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:12.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:11 smithi059 ceph-mon[30888]: Standby manager daemon z started 2024-09-10T21:07:12.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:11 smithi059 ceph-mon[30888]: from='mgr.? 172.21.15.192:0/4275137428' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T21:07:12.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:11 smithi059 ceph-mon[30888]: from='mgr.? 172.21.15.192:0/4275137428' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T21:07:12.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:11 smithi059 ceph-mon[30888]: from='mgr.? 172.21.15.192:0/4275137428' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T21:07:12.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:11 smithi059 ceph-mon[30888]: from='mgr.? 172.21.15.192:0/4275137428' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T21:07:12.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:11 smithi059 ceph-mon[30888]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:12.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:11 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3589365974' entity='client.admin' 2024-09-10T21:07:12.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:11 smithi192 ceph-mon[35363]: Standby manager daemon z started 2024-09-10T21:07:12.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:11 smithi192 ceph-mon[35363]: from='mgr.? 172.21.15.192:0/4275137428' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T21:07:12.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:11 smithi192 ceph-mon[35363]: from='mgr.? 172.21.15.192:0/4275137428' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T21:07:12.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:11 smithi192 ceph-mon[35363]: from='mgr.? 172.21.15.192:0/4275137428' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T21:07:12.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:11 smithi192 ceph-mon[35363]: from='mgr.? 172.21.15.192:0/4275137428' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T21:07:12.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:11 smithi192 ceph-mon[35363]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:12.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:11 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3589365974' entity='client.admin' 2024-09-10T21:07:12.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:11 smithi154 ceph-mon[35041]: Standby manager daemon z started 2024-09-10T21:07:12.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:11 smithi154 ceph-mon[35041]: from='mgr.? 172.21.15.192:0/4275137428' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T21:07:12.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:11 smithi154 ceph-mon[35041]: from='mgr.? 172.21.15.192:0/4275137428' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T21:07:12.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:11 smithi154 ceph-mon[35041]: from='mgr.? 172.21.15.192:0/4275137428' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T21:07:12.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:11 smithi154 ceph-mon[35041]: from='mgr.? 172.21.15.192:0/4275137428' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T21:07:12.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:11 smithi154 ceph-mon[35041]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:12.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:11 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3589365974' entity='client.admin' 2024-09-10T21:07:13.115 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:12 smithi059 ceph-mon[30888]: mgrmap e14: x(active, since 66s), standbys: z 2024-09-10T21:07:13.115 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:12 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T21:07:13.115 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:12 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3713956147' entity='client.admin' 2024-09-10T21:07:13.115 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:12 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/167966117' entity='client.admin' 2024-09-10T21:07:13.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:12 smithi192 ceph-mon[35363]: mgrmap e14: x(active, since 66s), standbys: z 2024-09-10T21:07:13.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:12 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T21:07:13.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:12 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3713956147' entity='client.admin' 2024-09-10T21:07:13.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:12 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/167966117' entity='client.admin' 2024-09-10T21:07:13.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:12 smithi154 ceph-mon[35041]: mgrmap e14: x(active, since 66s), standbys: z 2024-09-10T21:07:13.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:12 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T21:07:13.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:12 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3713956147' entity='client.admin' 2024-09-10T21:07:13.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:12 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/167966117' entity='client.admin' 2024-09-10T21:07:13.965 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:13 smithi059 ceph-mon[30888]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:13.965 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:13 smithi059 ceph-mon[30888]: Standby manager daemon y started 2024-09-10T21:07:13.965 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:13 smithi059 ceph-mon[30888]: from='mgr.? 172.21.15.154:0/1304520814' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T21:07:13.965 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:13 smithi059 ceph-mon[30888]: from='mgr.? 172.21.15.154:0/1304520814' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T21:07:13.965 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:13 smithi059 ceph-mon[30888]: from='mgr.? 172.21.15.154:0/1304520814' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T21:07:13.965 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:13 smithi059 ceph-mon[30888]: from='mgr.? 172.21.15.154:0/1304520814' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T21:07:13.965 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:13 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2900226730' entity='client.admin' 2024-09-10T21:07:13.966 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:13 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/628498489' entity='client.admin' 2024-09-10T21:07:14.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:13 smithi192 ceph-mon[35363]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:14.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:13 smithi192 ceph-mon[35363]: Standby manager daemon y started 2024-09-10T21:07:14.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:13 smithi192 ceph-mon[35363]: from='mgr.? 172.21.15.154:0/1304520814' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T21:07:14.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:13 smithi192 ceph-mon[35363]: from='mgr.? 172.21.15.154:0/1304520814' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T21:07:14.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:13 smithi192 ceph-mon[35363]: from='mgr.? 172.21.15.154:0/1304520814' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T21:07:14.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:13 smithi192 ceph-mon[35363]: from='mgr.? 172.21.15.154:0/1304520814' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T21:07:14.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:13 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2900226730' entity='client.admin' 2024-09-10T21:07:14.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:13 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/628498489' entity='client.admin' 2024-09-10T21:07:14.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:13 smithi154 ceph-mon[35041]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:14.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:13 smithi154 ceph-mon[35041]: Standby manager daemon y started 2024-09-10T21:07:14.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:13 smithi154 ceph-mon[35041]: from='mgr.? 172.21.15.154:0/1304520814' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T21:07:14.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:13 smithi154 ceph-mon[35041]: from='mgr.? 172.21.15.154:0/1304520814' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T21:07:14.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:13 smithi154 ceph-mon[35041]: from='mgr.? 172.21.15.154:0/1304520814' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T21:07:14.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:13 smithi154 ceph-mon[35041]: from='mgr.? 172.21.15.154:0/1304520814' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T21:07:14.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:13 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2900226730' entity='client.admin' 2024-09-10T21:07:14.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:13 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/628498489' entity='client.admin' 2024-09-10T21:07:15.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:14 smithi192 ceph-mon[35363]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-09-10T21:07:15.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:14 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T21:07:15.328 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:14 smithi059 ceph-mon[30888]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-09-10T21:07:15.328 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:14 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T21:07:15.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:14 smithi154 ceph-mon[35041]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-09-10T21:07:15.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:14 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T21:07:16.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.391+0000 7f088d586640 1 -- 172.21.15.59:0/2337749044 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f08880fe740 con 0x7f0888105b80 2024-09-10T21:07:16.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.397+0000 7f086ffff640 1 -- 172.21.15.59:0/2337749044 <== mon.0 v2:172.21.15.59:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v28)=0 v28) ==== 106+0+0 (secure 0 0 0) 0x7f087c0b5670 con 0x7f0888105b80 2024-09-10T21:07:16.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.399+0000 7f088d586640 1 -- 172.21.15.59:0/2337749044 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f08700b5250 msgr2=0x7f08700b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:16.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.399+0000 7f088d586640 1 --2- 172.21.15.59:0/2337749044 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f08700b5250 0x7f08700b7710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0878005fd0 tx=0x7f0878005850 comp rx=0 tx=0).stop 2024-09-10T21:07:16.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.399+0000 7f088d586640 1 -- 172.21.15.59:0/2337749044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0888105b80 msgr2=0x7f0888199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:16.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.399+0000 7f088d586640 1 --2- 172.21.15.59:0/2337749044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0888105b80 0x7f0888199310 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f087c00d740 tx=0x7f087c00dc00 comp rx=0 tx=0).stop 2024-09-10T21:07:16.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.399+0000 7f088d586640 1 -- 172.21.15.59:0/2337749044 shutdown_connections 2024-09-10T21:07:16.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.399+0000 7f088d586640 1 --2- 172.21.15.59:0/2337749044 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f08700b5250 0x7f08700b7710 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:16.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.399+0000 7f088d586640 1 --2- 172.21.15.59:0/2337749044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0888108730 0x7f0888199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:16.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.399+0000 7f088d586640 1 --2- 172.21.15.59:0/2337749044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0888105b80 0x7f0888199310 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:16.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.399+0000 7f088d586640 1 --2- 172.21.15.59:0/2337749044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f088806b6e0 0x7f0888198cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:16.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.399+0000 7f088d586640 1 -- 172.21.15.59:0/2337749044 >> 172.21.15.59:0/2337749044 conn(0x7f08880fd1e0 msgr2=0x7f0888103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:16.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.399+0000 7f088d586640 1 -- 172.21.15.59:0/2337749044 shutdown_connections 2024-09-10T21:07:16.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.399+0000 7f088d586640 1 -- 172.21.15.59:0/2337749044 wait complete. 2024-09-10T21:07:16.664 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:16 smithi059 ceph-mon[30888]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:16.665 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:16 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1834409816' entity='client.admin' 2024-09-10T21:07:16.665 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:16 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1451868251' entity='client.admin' 2024-09-10T21:07:16.665 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:16 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/4019351414' entity='client.admin' 2024-09-10T21:07:16.665 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:16 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1364956210' entity='client.admin' 2024-09-10T21:07:16.665 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:16 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2337749044' entity='client.admin' 2024-09-10T21:07:16.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:16 smithi154 ceph-mon[35041]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:16.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:16 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1834409816' entity='client.admin' 2024-09-10T21:07:16.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:16 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1451868251' entity='client.admin' 2024-09-10T21:07:16.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:16 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/4019351414' entity='client.admin' 2024-09-10T21:07:16.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:16 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1364956210' entity='client.admin' 2024-09-10T21:07:16.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:16 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2337749044' entity='client.admin' 2024-09-10T21:07:17.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:16 smithi192 ceph-mon[35363]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:17.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:16 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1834409816' entity='client.admin' 2024-09-10T21:07:17.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:16 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1451868251' entity='client.admin' 2024-09-10T21:07:17.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:16 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/4019351414' entity='client.admin' 2024-09-10T21:07:17.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:16 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1364956210' entity='client.admin' 2024-09-10T21:07:17.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:16 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2337749044' entity='client.admin' 2024-09-10T21:07:18.768 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi059') 2024-09-10T21:07:18.903 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi059') 2024-09-10T21:07:18.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:18 smithi059 ceph-mon[30888]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:18.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:18 smithi154 ceph-mon[35041]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:19.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:18 smithi192 ceph-mon[35363]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:19.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.273+0000 7f180ce9e640 1 -- 172.21.15.59:0/186964116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1808103ba0 msgr2=0x7f1808104020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.273+0000 7f180ce9e640 1 --2- 172.21.15.59:0/186964116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1808103ba0 0x7f1808104020 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f17f0009930 tx=0x7f17f002a420 comp rx=0 tx=0).stop 2024-09-10T21:07:19.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.273+0000 7f180ce9e640 1 -- 172.21.15.59:0/186964116 shutdown_connections 2024-09-10T21:07:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.273+0000 7f180ce9e640 1 --2- 172.21.15.59:0/186964116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1808104560 0x7f180810aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.273+0000 7f180ce9e640 1 --2- 172.21.15.59:0/186964116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1808103ba0 0x7f1808104020 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.273+0000 7f180ce9e640 1 --2- 172.21.15.59:0/186964116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1808102a40 0x7f1808102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.273+0000 7f180ce9e640 1 -- 172.21.15.59:0/186964116 >> 172.21.15.59:0/186964116 conn(0x7f18080fe2f0 msgr2=0x7f1808100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.273+0000 7f180ce9e640 1 -- 172.21.15.59:0/186964116 shutdown_connections 2024-09-10T21:07:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.273+0000 7f180ce9e640 1 -- 172.21.15.59:0/186964116 wait complete. 2024-09-10T21:07:19.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.274+0000 7f180ce9e640 1 Processor -- start 2024-09-10T21:07:19.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.274+0000 7f180ce9e640 1 -- start start 2024-09-10T21:07:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.274+0000 7f180ce9e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1808102a40 0x7f1808076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.274+0000 7f180ce9e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1808103ba0 0x7f1808075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.274+0000 7f180ce9e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1808104560 0x7f1808075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.274+0000 7f180ce9e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f180810e6f0 con 0x7f1808104560 2024-09-10T21:07:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.274+0000 7f180ce9e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f180810e570 con 0x7f1808103ba0 2024-09-10T21:07:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.274+0000 7f180ce9e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f180810e870 con 0x7f1808102a40 2024-09-10T21:07:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.274+0000 7f1806d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1808104560 0x7f1808075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.274+0000 7f1806d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1808104560 0x7f1808075a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52960/0 (socket says 172.21.15.59:52960) 2024-09-10T21:07:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.274+0000 7f1806d9d640 1 -- 172.21.15.59:0/1678523075 learned_addr learned my addr 172.21.15.59:0/1678523075 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:07:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.274+0000 7f180659c640 1 --2- 172.21.15.59:0/1678523075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1808102a40 0x7f1808076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.274+0000 7f1805d9b640 1 --2- 172.21.15.59:0/1678523075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1808103ba0 0x7f1808075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.274+0000 7f1806d9d640 1 -- 172.21.15.59:0/1678523075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1808102a40 msgr2=0x7f1808076cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.274+0000 7f1806d9d640 1 --2- 172.21.15.59:0/1678523075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1808102a40 0x7f1808076cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.274+0000 7f1806d9d640 1 -- 172.21.15.59:0/1678523075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1808103ba0 msgr2=0x7f1808075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.274+0000 7f1806d9d640 1 --2- 172.21.15.59:0/1678523075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1808103ba0 0x7f1808075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.274+0000 7f1806d9d640 1 -- 172.21.15.59:0/1678523075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1808076340 con 0x7f1808104560 2024-09-10T21:07:19.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.275+0000 7f1806d9d640 1 --2- 172.21.15.59:0/1678523075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1808104560 0x7f1808075a80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f17f800eb10 tx=0x7f17f800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:19.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.275+0000 7f17ff7fe640 1 -- 172.21.15.59:0/1678523075 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f8004b20 con 0x7f1808104560 2024-09-10T21:07:19.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.275+0000 7f17ff7fe640 1 -- 172.21.15.59:0/1678523075 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17f8004cc0 con 0x7f1808104560 2024-09-10T21:07:19.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.275+0000 7f180ce9e640 1 -- 172.21.15.59:0/1678523075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18081a2f10 con 0x7f1808104560 2024-09-10T21:07:19.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.275+0000 7f17ff7fe640 1 -- 172.21.15.59:0/1678523075 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f8010670 con 0x7f1808104560 2024-09-10T21:07:19.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.275+0000 7f180ce9e640 1 -- 172.21.15.59:0/1678523075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18081a3370 con 0x7f1808104560 2024-09-10T21:07:19.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.276+0000 7f180ce9e640 1 -- 172.21.15.59:0/1678523075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1808109d60 con 0x7f1808104560 2024-09-10T21:07:19.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.278+0000 7f17ff7fe640 1 -- 172.21.15.59:0/1678523075 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f17f8005020 con 0x7f1808104560 2024-09-10T21:07:19.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.279+0000 7f17ff7fe640 1 --2- 172.21.15.59:0/1678523075 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f17f40b5250 0x7f17f40b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.279+0000 7f180659c640 1 --2- 172.21.15.59:0/1678523075 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f17f40b5250 0x7f17f40b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:19.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.279+0000 7f17ff7fe640 1 -- 172.21.15.59:0/1678523075 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f17f80e4460 con 0x7f1808104560 2024-09-10T21:07:19.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.279+0000 7f180659c640 1 --2- 172.21.15.59:0/1678523075 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f17f40b5250 0x7f17f40b7710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1800009bd0 tx=0x7f1800005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:19.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.283+0000 7f17ff7fe640 1 -- 172.21.15.59:0/1678523075 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f17f80acff0 con 0x7f1808104560 2024-09-10T21:07:19.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.485+0000 7f180ce9e640 1 -- 172.21.15.59:0/1678523075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f1808063d80 con 0x7f1808104560 2024-09-10T21:07:19.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.490+0000 7f17ff7fe640 1 -- 172.21.15.59:0/1678523075 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v29)=0 v29) ==== 121+0+0 (secure 0 0 0) 0x7f17f80ac8f0 con 0x7f1808104560 2024-09-10T21:07:19.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.492+0000 7f180ce9e640 1 -- 172.21.15.59:0/1678523075 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f17f40b5250 msgr2=0x7f17f40b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.492+0000 7f180ce9e640 1 --2- 172.21.15.59:0/1678523075 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f17f40b5250 0x7f17f40b7710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1800009bd0 tx=0x7f1800005f90 comp rx=0 tx=0).stop 2024-09-10T21:07:19.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.492+0000 7f180ce9e640 1 -- 172.21.15.59:0/1678523075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1808104560 msgr2=0x7f1808075a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.492+0000 7f180ce9e640 1 --2- 172.21.15.59:0/1678523075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1808104560 0x7f1808075a80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f17f800eb10 tx=0x7f17f800c2d0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.492+0000 7f180ce9e640 1 -- 172.21.15.59:0/1678523075 shutdown_connections 2024-09-10T21:07:19.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.492+0000 7f180ce9e640 1 --2- 172.21.15.59:0/1678523075 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f17f40b5250 0x7f17f40b7710 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.492+0000 7f180ce9e640 1 --2- 172.21.15.59:0/1678523075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1808104560 0x7f1808075a80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.492+0000 7f180ce9e640 1 --2- 172.21.15.59:0/1678523075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1808103ba0 0x7f1808075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.492+0000 7f180ce9e640 1 --2- 172.21.15.59:0/1678523075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1808102a40 0x7f1808076cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.492+0000 7f180ce9e640 1 -- 172.21.15.59:0/1678523075 >> 172.21.15.59:0/1678523075 conn(0x7f18080fe2f0 msgr2=0x7f1808106f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:19.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.493+0000 7f180ce9e640 1 -- 172.21.15.59:0/1678523075 shutdown_connections 2024-09-10T21:07:19.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.493+0000 7f180ce9e640 1 -- 172.21.15.59:0/1678523075 wait complete. 2024-09-10T21:07:19.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.495+0000 7f60f17fd640 1 -- 172.21.15.59:0/82020601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60ec10a940 msgr2=0x7f60ec10ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.495+0000 7f60f17fd640 1 --2- 172.21.15.59:0/82020601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60ec10a940 0x7f60ec10ce00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009ca0 tx=0x7f60e402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.495+0000 7f60f17fd640 1 -- 172.21.15.59:0/82020601 shutdown_connections 2024-09-10T21:07:19.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.495+0000 7f60f17fd640 1 --2- 172.21.15.59:0/82020601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60ec10a940 0x7f60ec10ce00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.495+0000 7f60f17fd640 1 --2- 172.21.15.59:0/82020601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60ec107f30 0x7f60ec10a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.495+0000 7f60f17fd640 1 --2- 172.21.15.59:0/82020601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60ec06b5d0 0x7f60ec1079f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.495+0000 7f60f17fd640 1 -- 172.21.15.59:0/82020601 >> 172.21.15.59:0/82020601 conn(0x7f60ec0fd1e0 msgr2=0x7f60ec0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:19.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.495+0000 7f60f17fd640 1 -- 172.21.15.59:0/82020601 shutdown_connections 2024-09-10T21:07:19.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.495+0000 7f60f17fd640 1 -- 172.21.15.59:0/82020601 wait complete. 2024-09-10T21:07:19.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.496+0000 7f60f17fd640 1 Processor -- start 2024-09-10T21:07:19.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.496+0000 7f60f17fd640 1 -- start start 2024-09-10T21:07:19.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.496+0000 7f60f17fd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60ec06b5d0 0x7f60ec19af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.496+0000 7f60f17fd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60ec107f30 0x7f60ec19b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.496+0000 7f60f17fd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60ec10a940 0x7f60ec19c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.496+0000 7f60f17fd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec110890 con 0x7f60ec107f30 2024-09-10T21:07:19.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.496+0000 7f60f17fd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec110710 con 0x7f60ec10a940 2024-09-10T21:07:19.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.496+0000 7f60f17fd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec110a10 con 0x7f60ec06b5d0 2024-09-10T21:07:19.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.496+0000 7f60ea7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60ec107f30 0x7f60ec19b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:19.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.496+0000 7f60ea7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60ec107f30 0x7f60ec19b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52978/0 (socket says 172.21.15.59:52978) 2024-09-10T21:07:19.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.496+0000 7f60ea7fc640 1 -- 172.21.15.59:0/1455958343 learned_addr learned my addr 172.21.15.59:0/1455958343 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:07:19.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.496+0000 7f60eb7fe640 1 --2- 172.21.15.59:0/1455958343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60ec10a940 0x7f60ec19c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:19.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.496+0000 7f60eaffd640 1 --2- 172.21.15.59:0/1455958343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60ec06b5d0 0x7f60ec19af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:19.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.497+0000 7f60ea7fc640 1 -- 172.21.15.59:0/1455958343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60ec06b5d0 msgr2=0x7f60ec19af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.497+0000 7f60ea7fc640 1 --2- 172.21.15.59:0/1455958343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60ec06b5d0 0x7f60ec19af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.497+0000 7f60ea7fc640 1 -- 172.21.15.59:0/1455958343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60ec10a940 msgr2=0x7f60ec19c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.497+0000 7f60ea7fc640 1 --2- 172.21.15.59:0/1455958343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60ec10a940 0x7f60ec19c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.497+0000 7f60ea7fc640 1 -- 172.21.15.59:0/1455958343 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ec19ca80 con 0x7f60ec107f30 2024-09-10T21:07:19.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.497+0000 7f60eaffd640 1 --2- 172.21.15.59:0/1455958343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60ec06b5d0 0x7f60ec19af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:07:19.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.497+0000 7f60eb7fe640 1 --2- 172.21.15.59:0/1455958343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60ec10a940 0x7f60ec19c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:07:19.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.497+0000 7f60ea7fc640 1 --2- 172.21.15.59:0/1455958343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60ec107f30 0x7f60ec19b5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f60e000e9c0 tx=0x7f60e000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:19.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.497+0000 7f60d3fff640 1 -- 172.21.15.59:0/1455958343 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e000cd80 con 0x7f60ec107f30 2024-09-10T21:07:19.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.497+0000 7f60d3fff640 1 -- 172.21.15.59:0/1455958343 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60e00054d0 con 0x7f60ec107f30 2024-09-10T21:07:19.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.497+0000 7f60f17fd640 1 -- 172.21.15.59:0/1455958343 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60ec19cd70 con 0x7f60ec107f30 2024-09-10T21:07:19.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.497+0000 7f60d3fff640 1 -- 172.21.15.59:0/1455958343 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e0010430 con 0x7f60ec107f30 2024-09-10T21:07:19.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.497+0000 7f60f17fd640 1 -- 172.21.15.59:0/1455958343 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60ec1a3450 con 0x7f60ec107f30 2024-09-10T21:07:19.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.498+0000 7f60f17fd640 1 -- 172.21.15.59:0/1455958343 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60d80052c0 con 0x7f60ec107f30 2024-09-10T21:07:19.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.500+0000 7f60d3fff640 1 -- 172.21.15.59:0/1455958343 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f60e0005020 con 0x7f60ec107f30 2024-09-10T21:07:19.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.501+0000 7f60d3fff640 1 --2- 172.21.15.59:0/1455958343 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f60d40b52d0 0x7f60d40b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:19.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.501+0000 7f60eaffd640 1 --2- 172.21.15.59:0/1455958343 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f60d40b52d0 0x7f60d40b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:19.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.501+0000 7f60d3fff640 1 -- 172.21.15.59:0/1455958343 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f60e00e4270 con 0x7f60ec107f30 2024-09-10T21:07:19.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.501+0000 7f60eaffd640 1 --2- 172.21.15.59:0/1455958343 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f60d40b52d0 0x7f60d40b7790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009c20 tx=0x7f60dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:19.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.505+0000 7f60d3fff640 1 -- 172.21.15.59:0/1455958343 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f60e00ace00 con 0x7f60ec107f30 2024-09-10T21:07:19.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.693+0000 7f60f17fd640 1 -- 172.21.15.59:0/1455958343 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f60d80055b0 con 0x7f60ec107f30 2024-09-10T21:07:19.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.697+0000 7f60d3fff640 1 -- 172.21.15.59:0/1455958343 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7f60e00ac700 con 0x7f60ec107f30 2024-09-10T21:07:19.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.699+0000 7f60f17fd640 1 -- 172.21.15.59:0/1455958343 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f60d40b52d0 msgr2=0x7f60d40b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.699+0000 7f60f17fd640 1 --2- 172.21.15.59:0/1455958343 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f60d40b52d0 0x7f60d40b7790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009c20 tx=0x7f60dc005f90 comp rx=0 tx=0).stop 2024-09-10T21:07:19.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.699+0000 7f60f17fd640 1 -- 172.21.15.59:0/1455958343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60ec107f30 msgr2=0x7f60ec19b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:19.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.699+0000 7f60f17fd640 1 --2- 172.21.15.59:0/1455958343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60ec107f30 0x7f60ec19b5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f60e000e9c0 tx=0x7f60e000ee80 comp rx=0 tx=0).stop 2024-09-10T21:07:19.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.699+0000 7f60f17fd640 1 -- 172.21.15.59:0/1455958343 shutdown_connections 2024-09-10T21:07:19.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.699+0000 7f60f17fd640 1 --2- 172.21.15.59:0/1455958343 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f60d40b52d0 0x7f60d40b7790 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.699+0000 7f60f17fd640 1 --2- 172.21.15.59:0/1455958343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60ec10a940 0x7f60ec19c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.699+0000 7f60f17fd640 1 --2- 172.21.15.59:0/1455958343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60ec107f30 0x7f60ec19b5a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.699+0000 7f60f17fd640 1 --2- 172.21.15.59:0/1455958343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60ec06b5d0 0x7f60ec19af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:19.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.699+0000 7f60f17fd640 1 -- 172.21.15.59:0/1455958343 >> 172.21.15.59:0/1455958343 conn(0x7f60ec0fd1e0 msgr2=0x7f60ec108b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:19.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.699+0000 7f60f17fd640 1 -- 172.21.15.59:0/1455958343 shutdown_connections 2024-09-10T21:07:19.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:19.699+0000 7f60f17fd640 1 -- 172.21.15.59:0/1455958343 wait complete. 2024-09-10T21:07:20.123 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:20.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:20 smithi192 ceph-mon[35363]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:20.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:20 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1678523075' entity='client.admin' 2024-09-10T21:07:20.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:20 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1455958343' entity='client.admin' 2024-09-10T21:07:20.878 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:20 smithi059 ceph-mon[30888]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:20.879 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:20 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1678523075' entity='client.admin' 2024-09-10T21:07:20.879 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:20 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1455958343' entity='client.admin' 2024-09-10T21:07:20.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:20 smithi154 ceph-mon[35041]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:20.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:20 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1678523075' entity='client.admin' 2024-09-10T21:07:20.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:20 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1455958343' entity='client.admin' 2024-09-10T21:07:21.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.330+0000 7f2e38670640 1 -- 172.21.15.59:0/1798584509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e30108730 msgr2=0x7f2e3010abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:21.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.330+0000 7f2e38670640 1 --2- 172.21.15.59:0/1798584509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e30108730 0x7f2e3010abf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009900 tx=0x7f2e2802a410 comp rx=0 tx=0).stop 2024-09-10T21:07:21.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.330+0000 7f2e38670640 1 -- 172.21.15.59:0/1798584509 shutdown_connections 2024-09-10T21:07:21.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.330+0000 7f2e38670640 1 --2- 172.21.15.59:0/1798584509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e30108730 0x7f2e3010abf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:21.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.330+0000 7f2e38670640 1 --2- 172.21.15.59:0/1798584509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e30105b80 0x7f2e30107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:21.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.330+0000 7f2e38670640 1 --2- 172.21.15.59:0/1798584509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e3006b6e0 0x7f2e301055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:21.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.330+0000 7f2e38670640 1 -- 172.21.15.59:0/1798584509 >> 172.21.15.59:0/1798584509 conn(0x7f2e300fd1e0 msgr2=0x7f2e300ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:21.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.330+0000 7f2e38670640 1 -- 172.21.15.59:0/1798584509 shutdown_connections 2024-09-10T21:07:21.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.330+0000 7f2e38670640 1 -- 172.21.15.59:0/1798584509 wait complete. 2024-09-10T21:07:21.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.331+0000 7f2e38670640 1 Processor -- start 2024-09-10T21:07:21.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.331+0000 7f2e38670640 1 -- start start 2024-09-10T21:07:21.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.331+0000 7f2e38670640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e3006b6e0 0x7f2e30102d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:21.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.331+0000 7f2e38670640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e30105b80 0x7f2e30101590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:21.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.331+0000 7f2e38670640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e30108730 0x7f2e30101ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:21.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.331+0000 7f2e38670640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3010e6d0 con 0x7f2e3006b6e0 2024-09-10T21:07:21.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.331+0000 7f2e38670640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3010e550 con 0x7f2e30105b80 2024-09-10T21:07:21.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.331+0000 7f2e38670640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3010e850 con 0x7f2e30108730 2024-09-10T21:07:21.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.331+0000 7f2e3640c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e3006b6e0 0x7f2e30102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:21.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.331+0000 7f2e3640c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e3006b6e0 0x7f2e30102d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52982/0 (socket says 172.21.15.59:52982) 2024-09-10T21:07:21.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.331+0000 7f2e3640c640 1 -- 172.21.15.59:0/1277906214 learned_addr learned my addr 172.21.15.59:0/1277906214 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:07:21.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.331+0000 7f2e35c0b640 1 --2- 172.21.15.59:0/1277906214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e30105b80 0x7f2e30101590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:21.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.331+0000 7f2e36c0d640 1 --2- 172.21.15.59:0/1277906214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e30108730 0x7f2e30101ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:21.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.331+0000 7f2e3640c640 1 -- 172.21.15.59:0/1277906214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e30108730 msgr2=0x7f2e30101ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:21.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.331+0000 7f2e3640c640 1 --2- 172.21.15.59:0/1277906214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e30108730 0x7f2e30101ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:21.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.331+0000 7f2e3640c640 1 -- 172.21.15.59:0/1277906214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e30105b80 msgr2=0x7f2e30101590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:21.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.331+0000 7f2e3640c640 1 --2- 172.21.15.59:0/1277906214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e30105b80 0x7f2e30101590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:21.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.331+0000 7f2e3640c640 1 -- 172.21.15.59:0/1277906214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e30102390 con 0x7f2e3006b6e0 2024-09-10T21:07:21.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.332+0000 7f2e36c0d640 1 --2- 172.21.15.59:0/1277906214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e30108730 0x7f2e30101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:07:21.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.332+0000 7f2e3640c640 1 --2- 172.21.15.59:0/1277906214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e3006b6e0 0x7f2e30102d20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00db80 tx=0x7f2e2c00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:21.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.332+0000 7f2e277fe640 1 -- 172.21.15.59:0/1277906214 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c017070 con 0x7f2e3006b6e0 2024-09-10T21:07:21.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.332+0000 7f2e277fe640 1 -- 172.21.15.59:0/1277906214 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e2c003b70 con 0x7f2e3006b6e0 2024-09-10T21:07:21.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.332+0000 7f2e277fe640 1 -- 172.21.15.59:0/1277906214 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c0106c0 con 0x7f2e3006b6e0 2024-09-10T21:07:21.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.332+0000 7f2e38670640 1 -- 172.21.15.59:0/1277906214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e301a2e50 con 0x7f2e3006b6e0 2024-09-10T21:07:21.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.332+0000 7f2e38670640 1 -- 172.21.15.59:0/1277906214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e301a32a0 con 0x7f2e3006b6e0 2024-09-10T21:07:21.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.333+0000 7f2e38670640 1 -- 172.21.15.59:0/1277906214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e300fecd0 con 0x7f2e3006b6e0 2024-09-10T21:07:21.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.335+0000 7f2e277fe640 1 -- 172.21.15.59:0/1277906214 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f2e2c023060 con 0x7f2e3006b6e0 2024-09-10T21:07:21.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.336+0000 7f2e277fe640 1 --2- 172.21.15.59:0/1277906214 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2e1c0b5250 0x7f2e1c0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:21.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.336+0000 7f2e277fe640 1 -- 172.21.15.59:0/1277906214 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2e2c0e40a0 con 0x7f2e3006b6e0 2024-09-10T21:07:21.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.336+0000 7f2e35c0b640 1 --2- 172.21.15.59:0/1277906214 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2e1c0b5250 0x7f2e1c0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:21.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.336+0000 7f2e35c0b640 1 --2- 172.21.15.59:0/1277906214 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2e1c0b5250 0x7f2e1c0b7710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2e20005fd0 tx=0x7f2e20005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:21.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.339+0000 7f2e277fe640 1 -- 172.21.15.59:0/1277906214 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2e2c0acc30 con 0x7f2e3006b6e0 2024-09-10T21:07:21.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.528+0000 7f2e38670640 1 -- 172.21.15.59:0/1277906214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f2e3002e5c0 con 0x7f2e3006b6e0 2024-09-10T21:07:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.531+0000 7f2e277fe640 1 -- 172.21.15.59:0/1277906214 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v31)=0 v31) ==== 127+0+0 (secure 0 0 0) 0x7f2e2c0ac530 con 0x7f2e3006b6e0 2024-09-10T21:07:21.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.534+0000 7f2e38670640 1 -- 172.21.15.59:0/1277906214 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2e1c0b5250 msgr2=0x7f2e1c0b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:21.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.534+0000 7f2e38670640 1 --2- 172.21.15.59:0/1277906214 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2e1c0b5250 0x7f2e1c0b7710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2e20005fd0 tx=0x7f2e20005850 comp rx=0 tx=0).stop 2024-09-10T21:07:21.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.534+0000 7f2e38670640 1 -- 172.21.15.59:0/1277906214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e3006b6e0 msgr2=0x7f2e30102d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:21.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.534+0000 7f2e38670640 1 --2- 172.21.15.59:0/1277906214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e3006b6e0 0x7f2e30102d20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00db80 tx=0x7f2e2c00b630 comp rx=0 tx=0).stop 2024-09-10T21:07:21.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.534+0000 7f2e38670640 1 -- 172.21.15.59:0/1277906214 shutdown_connections 2024-09-10T21:07:21.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.534+0000 7f2e38670640 1 --2- 172.21.15.59:0/1277906214 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2e1c0b5250 0x7f2e1c0b7710 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:21.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.534+0000 7f2e38670640 1 --2- 172.21.15.59:0/1277906214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e30108730 0x7f2e30101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:21.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.534+0000 7f2e38670640 1 --2- 172.21.15.59:0/1277906214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e30105b80 0x7f2e30101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:21.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.534+0000 7f2e38670640 1 --2- 172.21.15.59:0/1277906214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e3006b6e0 0x7f2e30102d20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:21.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.534+0000 7f2e38670640 1 -- 172.21.15.59:0/1277906214 >> 172.21.15.59:0/1277906214 conn(0x7f2e300fd1e0 msgr2=0x7f2e30103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:21.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.534+0000 7f2e38670640 1 -- 172.21.15.59:0/1277906214 shutdown_connections 2024-09-10T21:07:21.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:21.534+0000 7f2e38670640 1 -- 172.21.15.59:0/1277906214 wait complete. 2024-09-10T21:07:22.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.323+0000 7fed7eb15640 1 -- 172.21.15.59:0/1364956210 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fed680b52d0 msgr2=0x7fed680b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:22.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.323+0000 7fed7eb15640 1 --2- 172.21.15.59:0/1364956210 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fed680b52d0 0x7fed680b7790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fed6c009fc0 tx=0x7fed6c005f90 comp rx=0 tx=0).stop 2024-09-10T21:07:22.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.323+0000 7fed7eb15640 1 -- 172.21.15.59:0/1364956210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed78108730 msgr2=0x7fed78101ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:22.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.323+0000 7fed7eb15640 1 --2- 172.21.15.59:0/1364956210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed78108730 0x7fed78101ad0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fed70003ba0 tx=0x7fed70003bd0 comp rx=0 tx=0).stop 2024-09-10T21:07:22.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.323+0000 7fed7eb15640 1 -- 172.21.15.59:0/1364956210 shutdown_connections 2024-09-10T21:07:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.323+0000 7fed7eb15640 1 --2- 172.21.15.59:0/1364956210 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fed680b52d0 0x7fed680b7790 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.323+0000 7fed7eb15640 1 --2- 172.21.15.59:0/1364956210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed78108730 0x7fed78101ad0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.323+0000 7fed7eb15640 1 --2- 172.21.15.59:0/1364956210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fed78105b80 0x7fed78101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.323+0000 7fed7eb15640 1 --2- 172.21.15.59:0/1364956210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fed7806b6e0 0x7fed78102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.323+0000 7fed7eb15640 1 -- 172.21.15.59:0/1364956210 >> 172.21.15.59:0/1364956210 conn(0x7fed780fd1e0 msgr2=0x7fed78103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.323+0000 7fed7eb15640 1 -- 172.21.15.59:0/1364956210 shutdown_connections 2024-09-10T21:07:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:16.323+0000 7fed7eb15640 1 -- 172.21.15.59:0/1364956210 wait complete. 2024-09-10T21:07:22.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:22 smithi192 ceph-mon[35363]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:22.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:22 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1277906214' entity='client.admin' 2024-09-10T21:07:22.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:22 smithi059 ceph-mon[30888]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:22.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:22 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1277906214' entity='client.admin' 2024-09-10T21:07:22.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:22 smithi154 ceph-mon[35041]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:22.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:22 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1277906214' entity='client.admin' 2024-09-10T21:07:23.212 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi059') 2024-09-10T21:07:23.212 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi059') 2024-09-10T21:07:23.212 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi059') 2024-09-10T21:07:23.213 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi059') 2024-09-10T21:07:23.213 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi059') 2024-09-10T21:07:23.213 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi059') 2024-09-10T21:07:23.594 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi059') 2024-09-10T21:07:23.594 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi059') 2024-09-10T21:07:23.594 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi059') 2024-09-10T21:07:23.595 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi059') 2024-09-10T21:07:23.595 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi059') 2024-09-10T21:07:23.595 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi059') 2024-09-10T21:07:23.595 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi059') 2024-09-10T21:07:23.595 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi059') 2024-09-10T21:07:23.595 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi059') 2024-09-10T21:07:23.595 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi059') 2024-09-10T21:07:23.595 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi059') 2024-09-10T21:07:23.596 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi059') 2024-09-10T21:07:23.596 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '3c26b952-6fb8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi059') 2024-09-10T21:07:23.596 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T21:07:23.596 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T21:07:23.596 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T21:07:23.615 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T21:07:23.615 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 2024-09-10T21:07:23.673 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T21:07:23.673 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:07:23.674 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-10T21:07:23.674 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:07:23.674 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:07:23.674 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-10 21:06:18.800198561 +0000 2024-09-10T21:07:23.674 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-10 21:02:05.862964912 +0000 2024-09-10T21:07:23.674 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-10 21:02:05.862964912 +0000 2024-09-10T21:07:23.674 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-09-10 21:02:05.862964912 +0000 2024-09-10T21:07:23.674 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T21:07:23.742 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-10T21:07:23.742 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-10T21:07:23.742 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000213911 s, 2.4 MB/s 2024-09-10T21:07:23.743 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T21:07:23.801 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 2024-09-10T21:07:23.858 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T21:07:23.858 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:07:23.858 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-10T21:07:23.858 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:07:23.859 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:07:23.859 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-10 21:06:18.833198136 +0000 2024-09-10T21:07:23.859 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-10 21:02:06.214960427 +0000 2024-09-10T21:07:23.859 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-10 21:02:06.214960427 +0000 2024-09-10T21:07:23.859 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-09-10 21:02:06.214960427 +0000 2024-09-10T21:07:23.859 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T21:07:23.924 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-10T21:07:23.925 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-10T21:07:23.925 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.00020605 s, 2.5 MB/s 2024-09-10T21:07:23.926 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T21:07:23.983 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 2024-09-10T21:07:24.040 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T21:07:24.041 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:07:24.041 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-10T21:07:24.041 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:07:24.041 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:07:24.041 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-10 21:06:18.864197737 +0000 2024-09-10T21:07:24.041 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-10 21:02:06.544956221 +0000 2024-09-10T21:07:24.041 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-10 21:02:06.544956221 +0000 2024-09-10T21:07:24.041 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-09-10 21:02:06.544956221 +0000 2024-09-10T21:07:24.041 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T21:07:24.107 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-10T21:07:24.107 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-10T21:07:24.107 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000198909 s, 2.6 MB/s 2024-09-10T21:07:24.108 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T21:07:24.166 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 2024-09-10T21:07:24.223 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T21:07:24.223 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:07:24.224 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-10T21:07:24.224 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:07:24.224 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:07:24.224 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-10 21:06:18.896197325 +0000 2024-09-10T21:07:24.224 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-10 21:02:06.893951773 +0000 2024-09-10T21:07:24.224 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-10 21:02:06.893951773 +0000 2024-09-10T21:07:24.224 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-09-10 21:02:06.893951773 +0000 2024-09-10T21:07:24.224 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T21:07:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-10T21:07:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-10T21:07:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000191086 s, 2.7 MB/s 2024-09-10T21:07:24.291 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T21:07:24.348 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-10T21:07:24.348 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T21:07:24.369 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T21:07:24.369 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-09-10T21:07:24.427 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T21:07:24.427 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:07:24.427 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-10T21:07:24.428 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:07:24.428 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:07:24.428 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-10 21:07:07.808009462 +0000 2024-09-10T21:07:24.428 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-10 21:02:07.724710720 +0000 2024-09-10T21:07:24.428 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-10 21:02:07.724710720 +0000 2024-09-10T21:07:24.428 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-10 21:02:07.724710720 +0000 2024-09-10T21:07:24.428 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T21:07:24.497 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-10T21:07:24.498 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-10T21:07:24.498 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000284171 s, 1.8 MB/s 2024-09-10T21:07:24.499 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T21:07:24.557 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-09-10T21:07:24.614 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T21:07:24.614 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:07:24.614 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-10T21:07:24.614 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:07:24.614 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:07:24.614 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-10 21:07:07.808009462 +0000 2024-09-10T21:07:24.614 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-10 21:02:08.058701813 +0000 2024-09-10T21:07:24.614 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-10 21:02:08.058701813 +0000 2024-09-10T21:07:24.615 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-10 21:02:08.058701813 +0000 2024-09-10T21:07:24.615 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T21:07:24.679 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-10T21:07:24.679 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-10T21:07:24.679 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000228623 s, 2.2 MB/s 2024-09-10T21:07:24.680 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T21:07:24.738 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-09-10T21:07:24.795 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T21:07:24.795 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:07:24.796 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-10T21:07:24.796 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:07:24.796 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:07:24.796 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-10 21:07:07.809009436 +0000 2024-09-10T21:07:24.796 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-10 21:02:08.378693279 +0000 2024-09-10T21:07:24.796 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-10 21:02:08.378693279 +0000 2024-09-10T21:07:24.796 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-10 21:02:08.378693279 +0000 2024-09-10T21:07:24.796 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T21:07:24.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:24 smithi192 ceph-mon[35363]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:24.858 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:24 smithi154 ceph-mon[35041]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:24.861 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-10T21:07:24.861 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-10T21:07:24.861 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.00022825 s, 2.2 MB/s 2024-09-10T21:07:24.862 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T21:07:24.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:24 smithi059 ceph-mon[30888]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:24.920 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-09-10T21:07:24.976 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T21:07:24.976 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:07:24.976 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-10T21:07:24.976 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:07:24.976 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:07:24.976 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-10 21:07:07.809009436 +0000 2024-09-10T21:07:24.976 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-10 21:02:08.700684693 +0000 2024-09-10T21:07:24.976 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-10 21:02:08.700684693 +0000 2024-09-10T21:07:24.977 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-09-10 21:02:08.700684693 +0000 2024-09-10T21:07:24.977 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T21:07:25.039 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-10T21:07:25.040 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-10T21:07:25.040 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000189583 s, 2.7 MB/s 2024-09-10T21:07:25.041 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T21:07:25.097 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-10T21:07:25.097 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T21:07:25.118 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T21:07:25.118 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_1 2024-09-10T21:07:25.176 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T21:07:25.176 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:07:25.177 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-10T21:07:25.177 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:07:25.177 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:07:25.177 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-10 21:07:05.497516064 +0000 2024-09-10T21:07:25.177 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-10 21:02:11.153391452 +0000 2024-09-10T21:07:25.177 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-10 21:02:11.153391452 +0000 2024-09-10T21:07:25.177 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-10 21:02:11.153391452 +0000 2024-09-10T21:07:25.177 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T21:07:25.247 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-10T21:07:25.247 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-10T21:07:25.248 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000288947 s, 1.8 MB/s 2024-09-10T21:07:25.249 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T21:07:25.308 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_2 2024-09-10T21:07:25.366 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T21:07:25.366 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:07:25.366 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-10T21:07:25.366 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:07:25.367 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:07:25.367 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-10 21:07:05.497516064 +0000 2024-09-10T21:07:25.367 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-10 21:02:11.488384842 +0000 2024-09-10T21:07:25.367 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-10 21:02:11.488384842 +0000 2024-09-10T21:07:25.367 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-10 21:02:11.488384842 +0000 2024-09-10T21:07:25.368 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T21:07:25.433 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-10T21:07:25.433 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-10T21:07:25.433 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000273945 s, 1.9 MB/s 2024-09-10T21:07:25.434 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T21:07:25.492 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_3 2024-09-10T21:07:25.549 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T21:07:25.549 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:07:25.549 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-10T21:07:25.549 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:07:25.549 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:07:25.549 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-10 21:07:05.498516045 +0000 2024-09-10T21:07:25.550 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-10 21:02:11.817378350 +0000 2024-09-10T21:07:25.550 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-10 21:02:11.817378350 +0000 2024-09-10T21:07:25.550 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-10 21:02:11.817378350 +0000 2024-09-10T21:07:25.550 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T21:07:25.614 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-10T21:07:25.614 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-10T21:07:25.614 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000238841 s, 2.1 MB/s 2024-09-10T21:07:25.616 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T21:07:25.672 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_4 2024-09-10T21:07:25.728 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T21:07:25.728 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T21:07:25.728 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-10T21:07:25.728 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:07:25.728 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T21:07:25.728 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-10 21:07:05.498516045 +0000 2024-09-10T21:07:25.729 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-10 21:02:12.153371720 +0000 2024-09-10T21:07:25.729 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-10 21:02:12.153371720 +0000 2024-09-10T21:07:25.729 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-10 21:02:12.153371720 +0000 2024-09-10T21:07:25.729 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T21:07:25.792 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-10T21:07:25.792 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-10T21:07:25.792 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000213457 s, 2.4 MB/s 2024-09-10T21:07:25.793 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T21:07:25.850 INFO:tasks.cephadm:Deploying osd.0 on smithi059 with /dev/vg_nvme/lv_4... 2024-09-10T21:07:25.850 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T21:07:26.113 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:26.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:26 smithi192 ceph-mon[35363]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:26.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:26 smithi059 ceph-mon[30888]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:26.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:26 smithi154 ceph-mon[35041]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:28.469 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:07:28.497 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_4 2024-09-10T21:07:28.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:28 smithi059 ceph-mon[30888]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:28.757 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:07:28.811 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:28 smithi192 ceph-mon[35363]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:28.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:28 smithi154 ceph-mon[35041]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:29.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.210+0000 7fe284fe7640 1 -- 172.21.15.59:0/4268600831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe280108720 msgr2=0x7fe28010abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:29.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.210+0000 7fe284fe7640 1 --2- 172.21.15.59:0/4268600831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe280108720 0x7fe28010abe0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe278009ca0 tx=0x7fe27802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:07:29.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.210+0000 7fe284fe7640 1 -- 172.21.15.59:0/4268600831 shutdown_connections 2024-09-10T21:07:29.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.210+0000 7fe284fe7640 1 --2- 172.21.15.59:0/4268600831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe280108720 0x7fe28010abe0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:29.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.210+0000 7fe284fe7640 1 --2- 172.21.15.59:0/4268600831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe280105b90 0x7fe280107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:29.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.210+0000 7fe284fe7640 1 --2- 172.21.15.59:0/4268600831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe28006b680 0x7fe280105650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:29.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.210+0000 7fe284fe7640 1 -- 172.21.15.59:0/4268600831 >> 172.21.15.59:0/4268600831 conn(0x7fe2800fd1e0 msgr2=0x7fe2800ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:29.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.210+0000 7fe284fe7640 1 -- 172.21.15.59:0/4268600831 shutdown_connections 2024-09-10T21:07:29.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.210+0000 7fe284fe7640 1 -- 172.21.15.59:0/4268600831 wait complete. 2024-09-10T21:07:29.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.211+0000 7fe284fe7640 1 Processor -- start 2024-09-10T21:07:29.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.211+0000 7fe284fe7640 1 -- start start 2024-09-10T21:07:29.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.211+0000 7fe284fe7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe28006b680 0x7fe280198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:29.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.211+0000 7fe284fe7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe280105b90 0x7fe2801994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:29.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.211+0000 7fe284fe7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe280108720 0x7fe28019a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:29.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.211+0000 7fe284fe7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe28010e6f0 con 0x7fe280105b90 2024-09-10T21:07:29.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.212+0000 7fe284fe7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe28010e570 con 0x7fe28006b680 2024-09-10T21:07:29.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.212+0000 7fe284fe7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe28010e870 con 0x7fe280108720 2024-09-10T21:07:29.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.212+0000 7fe27dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe280105b90 0x7fe2801994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:29.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.212+0000 7fe27dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe280105b90 0x7fe2801994c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45282/0 (socket says 172.21.15.59:45282) 2024-09-10T21:07:29.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.212+0000 7fe27dd9b640 1 -- 172.21.15.59:0/2544551238 learned_addr learned my addr 172.21.15.59:0/2544551238 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:07:29.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.212+0000 7fe27ed9d640 1 --2- 172.21.15.59:0/2544551238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe280108720 0x7fe28019a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:29.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.212+0000 7fe27e59c640 1 --2- 172.21.15.59:0/2544551238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe28006b680 0x7fe280198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.212+0000 7fe27dd9b640 1 -- 172.21.15.59:0/2544551238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe280108720 msgr2=0x7fe28019a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.212+0000 7fe27dd9b640 1 --2- 172.21.15.59:0/2544551238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe280108720 0x7fe28019a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.212+0000 7fe27dd9b640 1 -- 172.21.15.59:0/2544551238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe28006b680 msgr2=0x7fe280198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.212+0000 7fe27dd9b640 1 --2- 172.21.15.59:0/2544551238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe28006b680 0x7fe280198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.212+0000 7fe27dd9b640 1 -- 172.21.15.59:0/2544551238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28019a930 con 0x7fe280105b90 2024-09-10T21:07:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.212+0000 7fe27ed9d640 1 --2- 172.21.15.59:0/2544551238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe280108720 0x7fe28019a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:07:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.212+0000 7fe27dd9b640 1 --2- 172.21.15.59:0/2544551238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe280105b90 0x7fe2801994c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe27400b4a0 tx=0x7fe27400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.212+0000 7fe26f7fe640 1 -- 172.21.15.59:0/2544551238 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe274014070 con 0x7fe280105b90 2024-09-10T21:07:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.212+0000 7fe284fe7640 1 -- 172.21.15.59:0/2544551238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28019ac20 con 0x7fe280105b90 2024-09-10T21:07:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.212+0000 7fe26f7fe640 1 -- 172.21.15.59:0/2544551238 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe274010ac0 con 0x7fe280105b90 2024-09-10T21:07:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.212+0000 7fe26f7fe640 1 -- 172.21.15.59:0/2544551238 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe274017c30 con 0x7fe280105b90 2024-09-10T21:07:29.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.213+0000 7fe284fe7640 1 -- 172.21.15.59:0/2544551238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2801a1300 con 0x7fe280105b90 2024-09-10T21:07:29.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.213+0000 7fe284fe7640 1 -- 172.21.15.59:0/2544551238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2800fecd0 con 0x7fe280105b90 2024-09-10T21:07:29.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.216+0000 7fe26f7fe640 1 -- 172.21.15.59:0/2544551238 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7fe274010610 con 0x7fe280105b90 2024-09-10T21:07:29.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.216+0000 7fe26f7fe640 1 --2- 172.21.15.59:0/2544551238 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe2680b5250 0x7fe2680b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:29.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.217+0000 7fe27e59c640 1 --2- 172.21.15.59:0/2544551238 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe2680b5250 0x7fe2680b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:29.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.217+0000 7fe26f7fe640 1 -- 172.21.15.59:0/2544551238 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe2740e3680 con 0x7fe280105b90 2024-09-10T21:07:29.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.217+0000 7fe27e59c640 1 --2- 172.21.15.59:0/2544551238 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe2680b5250 0x7fe2680b7710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe270009bd0 tx=0x7fe270005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:29.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.219+0000 7fe26f7fe640 1 -- 172.21.15.59:0/2544551238 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe2740abbc0 con 0x7fe280105b90 2024-09-10T21:07:29.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:29.419+0000 7fe284fe7640 1 -- 172.21.15.59:0/2544551238 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe280063590 con 0x7fe2680b5250 2024-09-10T21:07:29.796 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:07:29.796 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:07:29.796 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:29.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:29 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:07:29.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:29 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:07:29.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:29 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:29.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:29 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:07:29.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:29 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:07:29.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:29 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:30.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:30 smithi192 ceph-mon[35363]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:30.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:30 smithi192 ceph-mon[35363]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:07:30.842 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:30 smithi059 ceph-mon[30888]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:30.842 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:30 smithi059 ceph-mon[30888]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:07:30.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:30 smithi154 ceph-mon[35041]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:30.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:30 smithi154 ceph-mon[35041]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:07:32.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:32 smithi059 ceph-mon[30888]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:32.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:32 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/629455685' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4e88abf3-8592-4b5f-8ba9-5969e01e12d6"} : dispatch 2024-09-10T21:07:32.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:32 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/629455685' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e88abf3-8592-4b5f-8ba9-5969e01e12d6"}]': finished 2024-09-10T21:07:32.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:32 smithi059 ceph-mon[30888]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T21:07:32.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:32 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:32.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:32 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/287948999' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:07:32.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:32 smithi192 ceph-mon[35363]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:32.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:32 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/629455685' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4e88abf3-8592-4b5f-8ba9-5969e01e12d6"} : dispatch 2024-09-10T21:07:32.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:32 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/629455685' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e88abf3-8592-4b5f-8ba9-5969e01e12d6"}]': finished 2024-09-10T21:07:32.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:32 smithi192 ceph-mon[35363]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T21:07:32.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:32 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:32.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:32 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/287948999' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:07:32.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:32 smithi154 ceph-mon[35041]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:32.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:32 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/629455685' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4e88abf3-8592-4b5f-8ba9-5969e01e12d6"} : dispatch 2024-09-10T21:07:32.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:32 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/629455685' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e88abf3-8592-4b5f-8ba9-5969e01e12d6"}]': finished 2024-09-10T21:07:32.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:32 smithi154 ceph-mon[35041]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T21:07:32.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:32 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:32.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:32 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/287948999' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:07:34.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:34 smithi192 ceph-mon[35363]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:34.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:34 smithi059 ceph-mon[30888]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:34.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:34 smithi154 ceph-mon[35041]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:36.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:36 smithi192 ceph-mon[35363]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:36.858 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:36 smithi059 ceph-mon[30888]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:36.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:36 smithi154 ceph-mon[35041]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:38.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:38 smithi192 ceph-mon[35363]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:38.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:38 smithi059 ceph-mon[30888]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:38.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:38 smithi154 ceph-mon[35041]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:40.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:40 smithi192 ceph-mon[35363]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:40.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T21:07:40.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:40.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:40 smithi059 ceph-mon[30888]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:40.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T21:07:40.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:40.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:40 smithi154 ceph-mon[35041]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:40.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T21:07:40.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:41.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:41 smithi192 ceph-mon[35363]: Deploying daemon osd.0 on smithi059 2024-09-10T21:07:41.886 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:41 smithi059 ceph-mon[30888]: Deploying daemon osd.0 on smithi059 2024-09-10T21:07:41.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:41 smithi154 ceph-mon[35041]: Deploying daemon osd.0 on smithi059 2024-09-10T21:07:42.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:42 smithi192 ceph-mon[35363]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:42.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:42 smithi059 ceph-mon[30888]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:42.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:42 smithi154 ceph-mon[35041]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:44.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:44 smithi192 ceph-mon[35363]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:44.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:44 smithi059 ceph-mon[30888]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:44.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:44 smithi154 ceph-mon[35041]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:46.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:46 smithi192 ceph-mon[35363]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:46.907 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:46 smithi059 ceph-mon[30888]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:46.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:46 smithi154 ceph-mon[35041]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:47.861 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:47 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:07:47.861 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:47 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:47.861 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:47 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:47.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:47 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:07:47.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:47 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:47.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:47 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:48.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:47 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:07:48.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:47 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:48.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:47 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:48.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:48 smithi059 ceph-mon[30888]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:48.834 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:48 smithi154 ceph-mon[35041]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:49.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:48 smithi192 ceph-mon[35363]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:50.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:50 smithi192 ceph-mon[35363]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:50.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:50.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:50.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:50.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:07:50.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:50.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:50 smithi059 ceph-mon[30888]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:50.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:50.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:50.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:50.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:07:50.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:50.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:50 smithi154 ceph-mon[35041]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:50.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:50.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:50.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:50.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:07:50.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:51.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:51.390+0000 7fe26f7fe640 1 -- 172.21.15.59:0/2544551238 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe280063590 con 0x7fe2680b5250 2024-09-10T21:07:51.395 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 0 on host 'smithi059' 2024-09-10T21:07:51.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:51.394+0000 7fe284fe7640 1 -- 172.21.15.59:0/2544551238 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe2680b5250 msgr2=0x7fe2680b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:51.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:51.394+0000 7fe284fe7640 1 --2- 172.21.15.59:0/2544551238 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe2680b5250 0x7fe2680b7710 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe270009bd0 tx=0x7fe270005f90 comp rx=0 tx=0).stop 2024-09-10T21:07:51.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:51.394+0000 7fe284fe7640 1 -- 172.21.15.59:0/2544551238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe280105b90 msgr2=0x7fe2801994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:51.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:51.394+0000 7fe284fe7640 1 --2- 172.21.15.59:0/2544551238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe280105b90 0x7fe2801994c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe27400b4a0 tx=0x7fe27400b960 comp rx=0 tx=0).stop 2024-09-10T21:07:51.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:51.394+0000 7fe284fe7640 1 -- 172.21.15.59:0/2544551238 shutdown_connections 2024-09-10T21:07:51.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:51.394+0000 7fe284fe7640 1 --2- 172.21.15.59:0/2544551238 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe2680b5250 0x7fe2680b7710 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:51.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:51.394+0000 7fe284fe7640 1 --2- 172.21.15.59:0/2544551238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe280108720 0x7fe28019a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:51.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:51.394+0000 7fe284fe7640 1 --2- 172.21.15.59:0/2544551238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe280105b90 0x7fe2801994c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:51.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:51.394+0000 7fe284fe7640 1 --2- 172.21.15.59:0/2544551238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe28006b680 0x7fe280198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:51.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:51.394+0000 7fe284fe7640 1 -- 172.21.15.59:0/2544551238 >> 172.21.15.59:0/2544551238 conn(0x7fe2800fd1e0 msgr2=0x7fe280103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:51.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:51.394+0000 7fe284fe7640 1 -- 172.21.15.59:0/2544551238 shutdown_connections 2024-09-10T21:07:51.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:07:51.394+0000 7fe284fe7640 1 -- 172.21.15.59:0/2544551238 wait complete. 2024-09-10T21:07:52.048 DEBUG:teuthology.orchestra.run.smithi059:osd.0> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T21:07:52.050 INFO:tasks.cephadm:Deploying osd.1 on smithi154 with /dev/vg_nvme/lv_4... 2024-09-10T21:07:52.051 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T21:07:52.306 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:07:52.360 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:52 smithi059 ceph-mon[30888]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:52.360 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:52 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:07:52.360 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:52 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:52.360 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:52 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:52.427 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:52 smithi154 ceph-mon[35041]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:52.427 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:52 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:07:52.427 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:52 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:52.427 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:52 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:52.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:52 smithi192 ceph-mon[35363]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:52.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:52 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:07:52.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:52 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:52.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:52 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:53.363 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:53 smithi059 ceph-mon[30888]: from='osd.0 [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T21:07:53.363 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:07:53 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-0[47096]: 2024-09-10T21:07:52.999+0000 7f678f879640 -1 osd.0 0 log_to_monitors true 2024-09-10T21:07:53.546 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:53 smithi154 ceph-mon[35041]: from='osd.0 [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T21:07:53.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:53 smithi192 ceph-mon[35363]: from='osd.0 [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T21:07:54.419 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:54 smithi154 ceph-mon[35041]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:54.420 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:54 smithi154 ceph-mon[35041]: from='osd.0 [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T21:07:54.420 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:54 smithi154 ceph-mon[35041]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T21:07:54.420 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:54 smithi154 ceph-mon[35041]: from='osd.0 [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-09-10T21:07:54.420 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:54 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:54.502 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:54 smithi059 ceph-mon[30888]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:54.502 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:54 smithi059 ceph-mon[30888]: from='osd.0 [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T21:07:54.502 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:54 smithi059 ceph-mon[30888]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T21:07:54.502 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:54 smithi059 ceph-mon[30888]: from='osd.0 [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-09-10T21:07:54.502 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:54 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:54.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:54 smithi192 ceph-mon[35363]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:54.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:54 smithi192 ceph-mon[35363]: from='osd.0 [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T21:07:54.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:54 smithi192 ceph-mon[35363]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T21:07:54.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:54 smithi192 ceph-mon[35363]: from='osd.0 [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-09-10T21:07:54.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:54 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:54.735 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T21:07:54.761 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_4 2024-09-10T21:07:55.017 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:07:55.394 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:55 smithi154 ceph-mon[35041]: from='osd.0 [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T21:07:55.394 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:55 smithi154 ceph-mon[35041]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T21:07:55.394 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:55.394 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:55.394 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:55 smithi154 ceph-mon[35041]: Detected new or changed devices on smithi059 2024-09-10T21:07:55.394 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:55.394 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:55.394 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:07:55.394 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:55 smithi154 ceph-mon[35041]: Adjusting osd_memory_target on smithi059 to 17092M 2024-09-10T21:07:55.394 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:55.394 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:55.395 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:07:55.395 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:55 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:55.395 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:55 smithi154 ceph-mon[35041]: from='osd.0 [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951]' entity='osd.0' 2024-09-10T21:07:55.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.474+0000 7f591b23e640 1 -- 172.21.15.154:0/1303345251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5914101950 msgr2=0x7f5914101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:55.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.474+0000 7f591b23e640 1 --2- 172.21.15.154:0/1303345251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5914101950 0x7f5914101d50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f590c009930 tx=0x7f590c02a420 comp rx=0 tx=0).stop 2024-09-10T21:07:55.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.474+0000 7f591b23e640 1 -- 172.21.15.154:0/1303345251 shutdown_connections 2024-09-10T21:07:55.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.474+0000 7f591b23e640 1 --2- 172.21.15.154:0/1303345251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5914103470 0x7f5914109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:55.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.474+0000 7f591b23e640 1 --2- 172.21.15.154:0/1303345251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5914102ab0 0x7f5914102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:55.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.474+0000 7f591b23e640 1 --2- 172.21.15.154:0/1303345251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5914101950 0x7f5914101d50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:55.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.474+0000 7f591b23e640 1 -- 172.21.15.154:0/1303345251 >> 172.21.15.154:0/1303345251 conn(0x7f59140fd200 msgr2=0x7f59140ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:07:55.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.474+0000 7f591b23e640 1 -- 172.21.15.154:0/1303345251 shutdown_connections 2024-09-10T21:07:55.502 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.474+0000 7f591b23e640 1 -- 172.21.15.154:0/1303345251 wait complete. 2024-09-10T21:07:55.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.475+0000 7f591b23e640 1 Processor -- start 2024-09-10T21:07:55.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.475+0000 7f591b23e640 1 -- start start 2024-09-10T21:07:55.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.475+0000 7f591b23e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5914101950 0x7f5914198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:55.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.475+0000 7f591b23e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5914102ab0 0x7f5914199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:55.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.475+0000 7f591b23e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5914103470 0x7f591419a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:55.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.475+0000 7f591b23e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f591410e6c0 con 0x7f5914102ab0 2024-09-10T21:07:55.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.475+0000 7f591b23e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f591410e540 con 0x7f5914103470 2024-09-10T21:07:55.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.475+0000 7f591b23e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f591410e840 con 0x7f5914101950 2024-09-10T21:07:55.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.475+0000 7f59197db640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5914103470 0x7f591419a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:55.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.475+0000 7f59197db640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5914103470 0x7f591419a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:44044/0 (socket says 172.21.15.154:44044) 2024-09-10T21:07:55.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.475+0000 7f59197db640 1 -- 172.21.15.154:0/1149322184 learned_addr learned my addr 172.21.15.154:0/1149322184 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T21:07:55.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.475+0000 7f5918fda640 1 --2- 172.21.15.154:0/1149322184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5914101950 0x7f5914198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:55.503 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.475+0000 7f5913fff640 1 --2- 172.21.15.154:0/1149322184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5914102ab0 0x7f5914199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:55.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.475+0000 7f59197db640 1 -- 172.21.15.154:0/1149322184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5914101950 msgr2=0x7f5914198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:55.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.475+0000 7f59197db640 1 --2- 172.21.15.154:0/1149322184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5914101950 0x7f5914198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:55.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.475+0000 7f59197db640 1 -- 172.21.15.154:0/1149322184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5914102ab0 msgr2=0x7f5914199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:07:55.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.475+0000 7f59197db640 1 --2- 172.21.15.154:0/1149322184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5914102ab0 0x7f5914199490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:07:55.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.475+0000 7f59197db640 1 -- 172.21.15.154:0/1149322184 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591419a900 con 0x7f5914103470 2024-09-10T21:07:55.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.475+0000 7f59197db640 1 --2- 172.21.15.154:0/1149322184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5914103470 0x7f591419a060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00e970 tx=0x7f58fc00ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:55.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.476+0000 7f5911ffb640 1 -- 172.21.15.154:0/1149322184 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58fc00ccc0 con 0x7f5914103470 2024-09-10T21:07:55.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.476+0000 7f5911ffb640 1 -- 172.21.15.154:0/1149322184 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58fc00ce60 con 0x7f5914103470 2024-09-10T21:07:55.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.476+0000 7f591b23e640 1 -- 172.21.15.154:0/1149322184 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f591419abf0 con 0x7f5914103470 2024-09-10T21:07:55.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.476+0000 7f5911ffb640 1 -- 172.21.15.154:0/1149322184 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58fc010430 con 0x7f5914103470 2024-09-10T21:07:55.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.476+0000 7f591b23e640 1 -- 172.21.15.154:0/1149322184 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59141a12d0 con 0x7f5914103470 2024-09-10T21:07:55.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.477+0000 7f591b23e640 1 -- 172.21.15.154:0/1149322184 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5914108c70 con 0x7f5914103470 2024-09-10T21:07:55.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.478+0000 7f5911ffb640 1 -- 172.21.15.154:0/1149322184 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f58fc004ff0 con 0x7f5914103470 2024-09-10T21:07:55.504 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.479+0000 7f5911ffb640 1 --2- 172.21.15.154:0/1149322184 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f59000b52d0 0x7f59000b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:07:55.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.480+0000 7f5911ffb640 1 -- 172.21.15.154:0/1149322184 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f58fc0e4500 con 0x7f5914103470 2024-09-10T21:07:55.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.480+0000 7f5918fda640 1 --2- 172.21.15.154:0/1149322184 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f59000b52d0 0x7f59000b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:07:55.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.480+0000 7f5918fda640 1 --2- 172.21.15.154:0/1149322184 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f59000b52d0 0x7f59000b7790 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f590c006010 tx=0x7f590c031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:07:55.505 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.484+0000 7f5911ffb640 1 -- 172.21.15.154:0/1149322184 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f58fc0acf50 con 0x7f5914103470 2024-09-10T21:07:55.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:55 smithi192 ceph-mon[35363]: from='osd.0 [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T21:07:55.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:55 smithi192 ceph-mon[35363]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T21:07:55.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:55.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:55.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:55 smithi192 ceph-mon[35363]: Detected new or changed devices on smithi059 2024-09-10T21:07:55.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:55.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:55.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:07:55.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:55 smithi192 ceph-mon[35363]: Adjusting osd_memory_target on smithi059 to 17092M 2024-09-10T21:07:55.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:55.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:55.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:07:55.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:55 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:55.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:55 smithi192 ceph-mon[35363]: from='osd.0 [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951]' entity='osd.0' 2024-09-10T21:07:55.661 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:07:55 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-0[47096]: 2024-09-10T21:07:55.174+0000 7f678b7fc640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T21:07:55.661 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:07:55 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-0[47096]: 2024-09-10T21:07:55.304+0000 7f678361b640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:07:55.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:55 smithi059 ceph-mon[30888]: from='osd.0 [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T21:07:55.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:55 smithi059 ceph-mon[30888]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T21:07:55.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:55.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:55.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:55 smithi059 ceph-mon[30888]: Detected new or changed devices on smithi059 2024-09-10T21:07:55.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:55.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:55.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:07:55.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:55 smithi059 ceph-mon[30888]: Adjusting osd_memory_target on smithi059 to 17092M 2024-09-10T21:07:55.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:55.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:55.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:07:55.663 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:55 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:07:55.663 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:55 smithi059 ceph-mon[30888]: from='osd.0 [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951]' entity='osd.0' 2024-09-10T21:07:55.673 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:07:55.668+0000 7f591b23e640 1 -- 172.21.15.154:0/1149322184 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5914063590 con 0x7f59000b52d0 2024-09-10T21:07:56.321 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:56 smithi154 ceph-mon[35041]: purged_snaps scrub starts 2024-09-10T21:07:56.321 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:56 smithi154 ceph-mon[35041]: purged_snaps scrub ok 2024-09-10T21:07:56.321 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:56 smithi154 ceph-mon[35041]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:56.321 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:56 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:56.322 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:56 smithi154 ceph-mon[35041]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:07:56.322 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:56 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:07:56.322 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:56 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:07:56.322 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:56 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:56.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:56 smithi192 ceph-mon[35363]: purged_snaps scrub starts 2024-09-10T21:07:56.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:56 smithi192 ceph-mon[35363]: purged_snaps scrub ok 2024-09-10T21:07:56.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:56 smithi192 ceph-mon[35363]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:56.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:56 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:56.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:56 smithi192 ceph-mon[35363]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:07:56.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:56 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:07:56.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:56 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:07:56.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:56 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:56.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:56 smithi059 ceph-mon[30888]: purged_snaps scrub starts 2024-09-10T21:07:56.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:56 smithi059 ceph-mon[30888]: purged_snaps scrub ok 2024-09-10T21:07:56.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:56 smithi059 ceph-mon[30888]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:56.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:56 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:56.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:56 smithi059 ceph-mon[30888]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:07:56.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:56 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:07:56.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:56 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:07:56.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:56 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:07:57.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:57 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:57.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:57 smithi154 ceph-mon[35041]: osd.0 [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951] boot 2024-09-10T21:07:57.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:57 smithi154 ceph-mon[35041]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T21:07:57.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:57 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:57.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:57 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:57.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:57 smithi192 ceph-mon[35363]: osd.0 [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951] boot 2024-09-10T21:07:57.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:57 smithi192 ceph-mon[35363]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T21:07:57.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:57 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:57.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:57 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:57.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:57 smithi059 ceph-mon[30888]: osd.0 [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951] boot 2024-09-10T21:07:57.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:57 smithi059 ceph-mon[30888]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T21:07:57.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:57 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T21:07:58.377 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:58 smithi154 ceph-mon[35041]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:58.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:58 smithi154 ceph-mon[35041]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T21:07:58.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:58 smithi154 ceph-mon[35041]: from='client.? 172.21.15.154:0/65604987' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7908eefd-bbfa-4fe4-9db9-7a92d0e77acb"} : dispatch 2024-09-10T21:07:58.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:58 smithi154 ceph-mon[35041]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7908eefd-bbfa-4fe4-9db9-7a92d0e77acb"} : dispatch 2024-09-10T21:07:58.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:58 smithi154 ceph-mon[35041]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7908eefd-bbfa-4fe4-9db9-7a92d0e77acb"}]': finished 2024-09-10T21:07:58.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:58 smithi154 ceph-mon[35041]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T21:07:58.378 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:07:58.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:58 smithi192 ceph-mon[35363]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:58.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:58 smithi192 ceph-mon[35363]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T21:07:58.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:58 smithi192 ceph-mon[35363]: from='client.? 172.21.15.154:0/65604987' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7908eefd-bbfa-4fe4-9db9-7a92d0e77acb"} : dispatch 2024-09-10T21:07:58.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:58 smithi192 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7908eefd-bbfa-4fe4-9db9-7a92d0e77acb"} : dispatch 2024-09-10T21:07:58.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:58 smithi192 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7908eefd-bbfa-4fe4-9db9-7a92d0e77acb"}]': finished 2024-09-10T21:07:58.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:58 smithi192 ceph-mon[35363]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T21:07:58.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:07:58.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:58 smithi059 ceph-mon[30888]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T21:07:58.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:58 smithi059 ceph-mon[30888]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T21:07:58.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:58 smithi059 ceph-mon[30888]: from='client.? 172.21.15.154:0/65604987' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7908eefd-bbfa-4fe4-9db9-7a92d0e77acb"} : dispatch 2024-09-10T21:07:58.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:58 smithi059 ceph-mon[30888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7908eefd-bbfa-4fe4-9db9-7a92d0e77acb"} : dispatch 2024-09-10T21:07:58.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:58 smithi059 ceph-mon[30888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7908eefd-bbfa-4fe4-9db9-7a92d0e77acb"}]': finished 2024-09-10T21:07:58.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:58 smithi059 ceph-mon[30888]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T21:07:58.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:07:59.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:07:59 smithi192 ceph-mon[35363]: from='client.? 172.21.15.154:0/1409827492' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:07:59.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:07:59 smithi059 ceph-mon[30888]: from='client.? 172.21.15.154:0/1409827492' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:07:59.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:07:59 smithi154 ceph-mon[35041]: from='client.? 172.21.15.154:0/1409827492' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:08:00.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:00 smithi192 ceph-mon[35363]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:00.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:00 smithi059 ceph-mon[30888]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:00.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:00 smithi154 ceph-mon[35041]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:02.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:02 smithi192 ceph-mon[35363]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:02.622 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:02 smithi154 ceph-mon[35041]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:02.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:02 smithi059 ceph-mon[30888]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:04.538 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:04 smithi154 ceph-mon[35041]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:04.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:04 smithi192 ceph-mon[35363]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:04.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:04 smithi059 ceph-mon[30888]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:06.543 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:06 smithi154 ceph-mon[35041]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:06.543 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T21:08:06.543 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:06.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:06 smithi192 ceph-mon[35363]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:06.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T21:08:06.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:06.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:06 smithi059 ceph-mon[30888]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:06.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T21:08:06.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:07.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:07 smithi192 ceph-mon[35363]: Deploying daemon osd.1 on smithi154 2024-09-10T21:08:07.614 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:07 smithi154 ceph-mon[35041]: Deploying daemon osd.1 on smithi154 2024-09-10T21:08:07.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:07 smithi059 ceph-mon[30888]: Deploying daemon osd.1 on smithi154 2024-09-10T21:08:08.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:08 smithi192 ceph-mon[35363]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:08.598 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:08 smithi154 ceph-mon[35041]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:08.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:08 smithi059 ceph-mon[30888]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:10.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:10 smithi192 ceph-mon[35363]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:10.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:10 smithi059 ceph-mon[30888]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:10.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:10 smithi154 ceph-mon[35041]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:12.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:12 smithi154 ceph-mon[35041]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:12.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:12 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:08:12.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:12 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:12.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:12 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:12.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:12 smithi192 ceph-mon[35363]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:12.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:12 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:08:12.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:12 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:12.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:12 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:12.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:12 smithi059 ceph-mon[30888]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:12.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:12 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:08:12.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:12 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:12.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:12 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:14.549 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:14 smithi154 ceph-mon[35041]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:14.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:14 smithi192 ceph-mon[35363]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:14.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:14 smithi059 ceph-mon[30888]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:15.901 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:08:15.897+0000 7f5911ffb640 1 -- 172.21.15.154:0/1149322184 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5914063590 con 0x7f59000b52d0 2024-09-10T21:08:15.901 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 1 on host 'smithi154' 2024-09-10T21:08:15.903 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:08:15.899+0000 7f591b23e640 1 -- 172.21.15.154:0/1149322184 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f59000b52d0 msgr2=0x7f59000b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:15.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:08:15.899+0000 7f591b23e640 1 --2- 172.21.15.154:0/1149322184 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f59000b52d0 0x7f59000b7790 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f590c006010 tx=0x7f590c031430 comp rx=0 tx=0).stop 2024-09-10T21:08:15.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:08:15.899+0000 7f591b23e640 1 -- 172.21.15.154:0/1149322184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5914103470 msgr2=0x7f591419a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:15.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:08:15.899+0000 7f591b23e640 1 --2- 172.21.15.154:0/1149322184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5914103470 0x7f591419a060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00e970 tx=0x7f58fc00ed70 comp rx=0 tx=0).stop 2024-09-10T21:08:15.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:08:15.899+0000 7f591b23e640 1 -- 172.21.15.154:0/1149322184 shutdown_connections 2024-09-10T21:08:15.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:08:15.899+0000 7f591b23e640 1 --2- 172.21.15.154:0/1149322184 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f59000b52d0 0x7f59000b7790 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:15.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:08:15.899+0000 7f591b23e640 1 --2- 172.21.15.154:0/1149322184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5914103470 0x7f591419a060 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:15.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:08:15.899+0000 7f591b23e640 1 --2- 172.21.15.154:0/1149322184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5914102ab0 0x7f5914199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:15.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:08:15.899+0000 7f591b23e640 1 --2- 172.21.15.154:0/1149322184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5914101950 0x7f5914198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:15.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:08:15.899+0000 7f591b23e640 1 -- 172.21.15.154:0/1149322184 >> 172.21.15.154:0/1149322184 conn(0x7f59140fd200 msgr2=0x7f5914105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:08:15.904 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:08:15.899+0000 7f591b23e640 1 -- 172.21.15.154:0/1149322184 shutdown_connections 2024-09-10T21:08:15.905 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:08:15.899+0000 7f591b23e640 1 -- 172.21.15.154:0/1149322184 wait complete. 2024-09-10T21:08:16.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:15 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:16.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:15 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:16.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:15 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:16.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:15 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:08:16.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:15 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:16.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:15 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:16.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:15 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:16.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:15 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:16.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:15 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:08:16.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:15 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:16.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:15 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:16.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:15 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:16.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:15 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:16.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:15 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:08:16.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:15 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:16.577 DEBUG:teuthology.orchestra.run.smithi154:osd.1> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T21:08:16.579 INFO:tasks.cephadm:Deploying osd.2 on smithi192 with /dev/vg_nvme/lv_4... 2024-09-10T21:08:16.580 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T21:08:16.833 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:08:17.144 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:16 smithi192 ceph-mon[35363]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:17.144 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:16 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:08:17.144 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:16 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:17.144 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:16 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:17.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:16 smithi059 ceph-mon[30888]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:17.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:16 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:08:17.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:16 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:17.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:16 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:17.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:16 smithi154 ceph-mon[35041]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:17.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:16 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:08:17.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:16 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:17.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:16 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:18.864 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:08:18 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-1[39506]: 2024-09-10T21:08:18.583+0000 7f07ac15e640 -1 osd.1 0 log_to_monitors true 2024-09-10T21:08:19.146 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:18 smithi192 ceph-mon[35363]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:19.146 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:18 smithi192 ceph-mon[35363]: from='osd.1 [v2:172.21.15.154:6800/3376412264,v1:172.21.15.154:6801/3376412264]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T21:08:19.146 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:18 smithi192 ceph-mon[35363]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T21:08:19.149 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:08:19.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:18 smithi059 ceph-mon[30888]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:19.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:18 smithi059 ceph-mon[30888]: from='osd.1 [v2:172.21.15.154:6800/3376412264,v1:172.21.15.154:6801/3376412264]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T21:08:19.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:18 smithi059 ceph-mon[30888]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T21:08:19.176 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_4 2024-09-10T21:08:19.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:18 smithi154 ceph-mon[35041]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:19.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:18 smithi154 ceph-mon[35041]: from='osd.1 [v2:172.21.15.154:6800/3376412264,v1:172.21.15.154:6801/3376412264]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T21:08:19.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:18 smithi154 ceph-mon[35041]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T21:08:19.422 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:08:19.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.845+0000 7f4736f89640 1 -- 172.21.15.192:0/3971382835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4730103b90 msgr2=0x7f4730104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:19.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.845+0000 7f4736f89640 1 --2- 172.21.15.192:0/3971382835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4730103b90 0x7f4730104010 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f471c009960 tx=0x7f471c02a460 comp rx=0 tx=0).stop 2024-09-10T21:08:19.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.845+0000 7f4736f89640 1 -- 172.21.15.192:0/3971382835 shutdown_connections 2024-09-10T21:08:19.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.845+0000 7f4736f89640 1 --2- 172.21.15.192:0/3971382835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4730104550 0x7f473010aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:19.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.845+0000 7f4736f89640 1 --2- 172.21.15.192:0/3971382835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4730103b90 0x7f4730104010 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:19.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.845+0000 7f4736f89640 1 --2- 172.21.15.192:0/3971382835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4730102a30 0x7f4730102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:19.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.845+0000 7f4736f89640 1 -- 172.21.15.192:0/3971382835 >> 172.21.15.192:0/3971382835 conn(0x7f47300fe320 msgr2=0x7f4730100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:08:19.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.845+0000 7f4736f89640 1 -- 172.21.15.192:0/3971382835 shutdown_connections 2024-09-10T21:08:19.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.845+0000 7f4736f89640 1 -- 172.21.15.192:0/3971382835 wait complete. 2024-09-10T21:08:19.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.846+0000 7f4736f89640 1 Processor -- start 2024-09-10T21:08:19.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.846+0000 7f4736f89640 1 -- start start 2024-09-10T21:08:19.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.846+0000 7f4736f89640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4730102a30 0x7f4730198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:19.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.846+0000 7f4736f89640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4730103b90 0x7f4730199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:19.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.846+0000 7f4736f89640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4730104550 0x7f473019a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:19.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.846+0000 7f4736f89640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f473010e730 con 0x7f4730102a30 2024-09-10T21:08:19.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.846+0000 7f4736f89640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f473010e5b0 con 0x7f4730104550 2024-09-10T21:08:19.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.846+0000 7f4736f89640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f473010e8b0 con 0x7f4730103b90 2024-09-10T21:08:19.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.846+0000 7f472ffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4730103b90 0x7f4730199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:08:19.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.846+0000 7f472ffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4730103b90 0x7f4730199510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39174/0 (socket says 172.21.15.192:39174) 2024-09-10T21:08:19.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.846+0000 7f472ffff640 1 -- 172.21.15.192:0/2193708178 learned_addr learned my addr 172.21.15.192:0/2193708178 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T21:08:19.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.847+0000 7f472ffff640 1 -- 172.21.15.192:0/2193708178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4730104550 msgr2=0x7f473019a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:19.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.847+0000 7f472ffff640 1 --2- 172.21.15.192:0/2193708178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4730104550 0x7f473019a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:19.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.847+0000 7f472ffff640 1 -- 172.21.15.192:0/2193708178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4730102a30 msgr2=0x7f4730198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:19.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.847+0000 7f472ffff640 1 --2- 172.21.15.192:0/2193708178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4730102a30 0x7f4730198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:19.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.847+0000 7f472ffff640 1 -- 172.21.15.192:0/2193708178 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473019a9f0 con 0x7f4730103b90 2024-09-10T21:08:19.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.847+0000 7f472ffff640 1 --2- 172.21.15.192:0/2193708178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4730103b90 0x7f4730199510 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f471c006010 tx=0x7f471c0042e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:08:19.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.847+0000 7f472dffb640 1 -- 172.21.15.192:0/2193708178 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c03f030 con 0x7f4730103b90 2024-09-10T21:08:19.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.847+0000 7f472dffb640 1 -- 172.21.15.192:0/2193708178 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f471c003aa0 con 0x7f4730103b90 2024-09-10T21:08:19.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.847+0000 7f4736f89640 1 -- 172.21.15.192:0/2193708178 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473019ac80 con 0x7f4730103b90 2024-09-10T21:08:19.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.847+0000 7f472dffb640 1 -- 172.21.15.192:0/2193708178 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c035070 con 0x7f4730103b90 2024-09-10T21:08:19.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.847+0000 7f4736f89640 1 -- 172.21.15.192:0/2193708178 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47301a1270 con 0x7f4730103b90 2024-09-10T21:08:19.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.848+0000 7f4736f89640 1 -- 172.21.15.192:0/2193708178 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4730109d90 con 0x7f4730103b90 2024-09-10T21:08:19.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.850+0000 7f472dffb640 1 -- 172.21.15.192:0/2193708178 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f471c003c50 con 0x7f4730103b90 2024-09-10T21:08:19.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.850+0000 7f472dffb640 1 --2- 172.21.15.192:0/2193708178 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f47200b5250 0x7f47200b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:19.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.850+0000 7f472dffb640 1 -- 172.21.15.192:0/2193708178 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7f471c104ee0 con 0x7f4730103b90 2024-09-10T21:08:19.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.851+0000 7f4734d25640 1 --2- 172.21.15.192:0/2193708178 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f47200b5250 0x7f47200b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:08:19.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.851+0000 7f4734d25640 1 --2- 172.21.15.192:0/2193708178 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f47200b5250 0x7f47200b7710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4724005fd0 tx=0x7f4724005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:08:19.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:19.853+0000 7f472dffb640 1 -- 172.21.15.192:0/2193708178 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f471c0cd790 con 0x7f4730103b90 2024-09-10T21:08:20.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:20.040+0000 7f4736f89640 1 -- 172.21.15.192:0/2193708178 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4730063590 con 0x7f47200b5250 2024-09-10T21:08:20.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:19 smithi059 ceph-mon[30888]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T21:08:20.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:19 smithi059 ceph-mon[30888]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T21:08:20.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:19 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:08:20.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:19 smithi059 ceph-mon[30888]: from='osd.1 [v2:172.21.15.154:6800/3376412264,v1:172.21.15.154:6801/3376412264]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:08:20.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:19 smithi059 ceph-mon[30888]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:08:20.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:19 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:20.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:19 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:20.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:19 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:08:20.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:19 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:20.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:19 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:20.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:19 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:08:20.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:19 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:20.183 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:08:19 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-1[39506]: 2024-09-10T21:08:19.872+0000 7f07a80e1640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T21:08:20.183 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:08:19 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-1[39506]: 2024-09-10T21:08:19.877+0000 7f07a3f08640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:08:20.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:19 smithi154 ceph-mon[35041]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T21:08:20.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:19 smithi154 ceph-mon[35041]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T21:08:20.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:19 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:08:20.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:19 smithi154 ceph-mon[35041]: from='osd.1 [v2:172.21.15.154:6800/3376412264,v1:172.21.15.154:6801/3376412264]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:08:20.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:19 smithi154 ceph-mon[35041]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:08:20.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:19 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:20.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:19 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:20.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:19 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:08:20.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:19 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:20.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:19 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:20.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:19 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:08:20.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:19 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:20.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:19 smithi192 ceph-mon[35363]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T21:08:20.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:19 smithi192 ceph-mon[35363]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T21:08:20.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:19 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:08:20.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:19 smithi192 ceph-mon[35363]: from='osd.1 [v2:172.21.15.154:6800/3376412264,v1:172.21.15.154:6801/3376412264]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:08:20.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:19 smithi192 ceph-mon[35363]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:08:20.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:19 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:20.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:19 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:20.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:19 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:08:20.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:19 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:20.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:19 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:20.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:19 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:08:20.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:19 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:21.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:20 smithi192 ceph-mon[35363]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:21.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:20 smithi192 ceph-mon[35363]: Detected new or changed devices on smithi154 2024-09-10T21:08:21.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:20 smithi192 ceph-mon[35363]: Adjusting osd_memory_target on smithi154 to 17088M 2024-09-10T21:08:21.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:20 smithi192 ceph-mon[35363]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T21:08:21.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:20 smithi192 ceph-mon[35363]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T21:08:21.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:20 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:08:21.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:20 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:08:21.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:20 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:08:21.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:20 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:08:21.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:20 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:21.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:20 smithi059 ceph-mon[30888]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:21.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:20 smithi059 ceph-mon[30888]: Detected new or changed devices on smithi154 2024-09-10T21:08:21.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:20 smithi059 ceph-mon[30888]: Adjusting osd_memory_target on smithi154 to 17088M 2024-09-10T21:08:21.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:20 smithi059 ceph-mon[30888]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T21:08:21.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:20 smithi059 ceph-mon[30888]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T21:08:21.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:20 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:08:21.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:20 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:08:21.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:20 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:08:21.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:20 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:08:21.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:20 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:21.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:20 smithi154 ceph-mon[35041]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:21.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:20 smithi154 ceph-mon[35041]: Detected new or changed devices on smithi154 2024-09-10T21:08:21.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:20 smithi154 ceph-mon[35041]: Adjusting osd_memory_target on smithi154 to 17088M 2024-09-10T21:08:21.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:20 smithi154 ceph-mon[35041]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T21:08:21.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:20 smithi154 ceph-mon[35041]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T21:08:21.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:20 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:08:21.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:20 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:08:21.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:20 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:08:21.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:20 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:08:21.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:20 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:22.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:21 smithi192 ceph-mon[35363]: purged_snaps scrub starts 2024-09-10T21:08:22.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:21 smithi192 ceph-mon[35363]: purged_snaps scrub ok 2024-09-10T21:08:22.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:21 smithi192 ceph-mon[35363]: from='client.24259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:08:22.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:21 smithi192 ceph-mon[35363]: osd.1 [v2:172.21.15.154:6800/3376412264,v1:172.21.15.154:6801/3376412264] boot 2024-09-10T21:08:22.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:21 smithi192 ceph-mon[35363]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T21:08:22.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:21 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:08:22.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:21 smithi059 ceph-mon[30888]: purged_snaps scrub starts 2024-09-10T21:08:22.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:21 smithi059 ceph-mon[30888]: purged_snaps scrub ok 2024-09-10T21:08:22.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:21 smithi059 ceph-mon[30888]: from='client.24259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:08:22.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:21 smithi059 ceph-mon[30888]: osd.1 [v2:172.21.15.154:6800/3376412264,v1:172.21.15.154:6801/3376412264] boot 2024-09-10T21:08:22.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:21 smithi059 ceph-mon[30888]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T21:08:22.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:21 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:08:22.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:21 smithi154 ceph-mon[35041]: purged_snaps scrub starts 2024-09-10T21:08:22.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:21 smithi154 ceph-mon[35041]: purged_snaps scrub ok 2024-09-10T21:08:22.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:21 smithi154 ceph-mon[35041]: from='client.24259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:08:22.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:21 smithi154 ceph-mon[35041]: osd.1 [v2:172.21.15.154:6800/3376412264,v1:172.21.15.154:6801/3376412264] boot 2024-09-10T21:08:22.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:21 smithi154 ceph-mon[35041]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T21:08:22.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:21 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T21:08:23.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:22 smithi192 ceph-mon[35363]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:23.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:22 smithi192 ceph-mon[35363]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T21:08:23.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:22 smithi192 ceph-mon[35363]: from='client.? 172.21.15.192:0/1816840575' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2351b9f0-bca1-48b2-afb8-0e2b7856c52e"} : dispatch 2024-09-10T21:08:23.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:22 smithi192 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2351b9f0-bca1-48b2-afb8-0e2b7856c52e"} : dispatch 2024-09-10T21:08:23.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:22 smithi192 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2351b9f0-bca1-48b2-afb8-0e2b7856c52e"}]': finished 2024-09-10T21:08:23.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:22 smithi192 ceph-mon[35363]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T21:08:23.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:22 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:08:23.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:22 smithi192 ceph-mon[35363]: from='client.? 172.21.15.192:0/450547444' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:08:23.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:22 smithi059 ceph-mon[30888]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:23.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:22 smithi059 ceph-mon[30888]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T21:08:23.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:22 smithi059 ceph-mon[30888]: from='client.? 172.21.15.192:0/1816840575' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2351b9f0-bca1-48b2-afb8-0e2b7856c52e"} : dispatch 2024-09-10T21:08:23.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:22 smithi059 ceph-mon[30888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2351b9f0-bca1-48b2-afb8-0e2b7856c52e"} : dispatch 2024-09-10T21:08:23.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:22 smithi059 ceph-mon[30888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2351b9f0-bca1-48b2-afb8-0e2b7856c52e"}]': finished 2024-09-10T21:08:23.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:22 smithi059 ceph-mon[30888]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T21:08:23.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:22 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:08:23.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:22 smithi059 ceph-mon[30888]: from='client.? 172.21.15.192:0/450547444' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:08:23.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:22 smithi154 ceph-mon[35041]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-10T21:08:23.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:22 smithi154 ceph-mon[35041]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T21:08:23.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:22 smithi154 ceph-mon[35041]: from='client.? 172.21.15.192:0/1816840575' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2351b9f0-bca1-48b2-afb8-0e2b7856c52e"} : dispatch 2024-09-10T21:08:23.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:22 smithi154 ceph-mon[35041]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2351b9f0-bca1-48b2-afb8-0e2b7856c52e"} : dispatch 2024-09-10T21:08:23.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:22 smithi154 ceph-mon[35041]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2351b9f0-bca1-48b2-afb8-0e2b7856c52e"}]': finished 2024-09-10T21:08:23.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:22 smithi154 ceph-mon[35041]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T21:08:23.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:22 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:08:23.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:22 smithi154 ceph-mon[35041]: from='client.? 172.21.15.192:0/450547444' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:08:25.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:24 smithi059 ceph-mon[30888]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:25.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:24 smithi154 ceph-mon[35041]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:25.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:24 smithi192 ceph-mon[35363]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:27.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:26 smithi059 ceph-mon[30888]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:27.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:26 smithi154 ceph-mon[35041]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:27.289 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:26 smithi192 ceph-mon[35363]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:29.124 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:28 smithi192 ceph-mon[35363]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:29.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:28 smithi059 ceph-mon[30888]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:29.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:28 smithi154 ceph-mon[35041]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:30.992 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:30 smithi192 ceph-mon[35363]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:31.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:30 smithi059 ceph-mon[30888]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:31.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:30 smithi154 ceph-mon[35041]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:32.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T21:08:32.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:32.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T21:08:32.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:32.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T21:08:32.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:33.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:32 smithi059 ceph-mon[30888]: Deploying daemon osd.2 on smithi192 2024-09-10T21:08:33.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:32 smithi059 ceph-mon[30888]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:33.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:32 smithi154 ceph-mon[35041]: Deploying daemon osd.2 on smithi192 2024-09-10T21:08:33.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:32 smithi154 ceph-mon[35041]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:33.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:32 smithi192 ceph-mon[35363]: Deploying daemon osd.2 on smithi192 2024-09-10T21:08:33.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:32 smithi192 ceph-mon[35363]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:35.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:34 smithi059 ceph-mon[30888]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:35.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:34 smithi154 ceph-mon[35041]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:35.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:34 smithi192 ceph-mon[35363]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:37.115 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:36 smithi192 ceph-mon[35363]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:37.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:36 smithi154 ceph-mon[35041]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:37.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:36 smithi059 ceph-mon[30888]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:38.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:37 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:08:38.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:37 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:38.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:37 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:38.250 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:37 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:08:38.250 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:37 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:38.250 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:37 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:38.290 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:37 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:08:38.291 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:37 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:38.291 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:37 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:39.176 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:38 smithi192 ceph-mon[35363]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:39.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:38 smithi154 ceph-mon[35041]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:39.246 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:38 smithi059 ceph-mon[30888]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:41.039 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:40 smithi192 ceph-mon[35363]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:41.039 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:41.039 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:41.040 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:41.040 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:08:41.040 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:41.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:40 smithi059 ceph-mon[30888]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:41.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:41.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:41.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:41.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:08:41.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:41.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:40 smithi154 ceph-mon[35041]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:41.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:41.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:41.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:41.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:08:41.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:41.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:41.318+0000 7f472dffb640 1 -- 172.21.15.192:0/2193708178 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4730063590 con 0x7f47200b5250 2024-09-10T21:08:41.323 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 2 on host 'smithi192' 2024-09-10T21:08:41.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:41.320+0000 7f4736f89640 1 -- 172.21.15.192:0/2193708178 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f47200b5250 msgr2=0x7f47200b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:41.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:41.320+0000 7f4736f89640 1 --2- 172.21.15.192:0/2193708178 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f47200b5250 0x7f47200b7710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4724005fd0 tx=0x7f4724005850 comp rx=0 tx=0).stop 2024-09-10T21:08:41.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:41.320+0000 7f4736f89640 1 -- 172.21.15.192:0/2193708178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4730103b90 msgr2=0x7f4730199510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:41.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:41.320+0000 7f4736f89640 1 --2- 172.21.15.192:0/2193708178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4730103b90 0x7f4730199510 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f471c006010 tx=0x7f471c0042e0 comp rx=0 tx=0).stop 2024-09-10T21:08:41.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:41.320+0000 7f4736f89640 1 -- 172.21.15.192:0/2193708178 shutdown_connections 2024-09-10T21:08:41.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:41.320+0000 7f4736f89640 1 --2- 172.21.15.192:0/2193708178 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f47200b5250 0x7f47200b7710 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:41.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:41.320+0000 7f4736f89640 1 --2- 172.21.15.192:0/2193708178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4730104550 0x7f473019a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:41.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:41.320+0000 7f4736f89640 1 --2- 172.21.15.192:0/2193708178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4730103b90 0x7f4730199510 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:41.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:41.320+0000 7f4736f89640 1 --2- 172.21.15.192:0/2193708178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4730102a30 0x7f4730198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:41.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:41.321+0000 7f4736f89640 1 -- 172.21.15.192:0/2193708178 >> 172.21.15.192:0/2193708178 conn(0x7f47300fe320 msgr2=0x7f4730106f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:08:41.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:41.321+0000 7f4736f89640 1 -- 172.21.15.192:0/2193708178 shutdown_connections 2024-09-10T21:08:41.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:08:41.321+0000 7f4736f89640 1 -- 172.21.15.192:0/2193708178 wait complete. 2024-09-10T21:08:41.964 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:41 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:08:41.964 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:41 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:41.964 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:41 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:42.039 DEBUG:teuthology.orchestra.run.smithi192:osd.2> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T21:08:42.041 INFO:tasks.cephadm:Deploying osd.3 on smithi059 with /dev/vg_nvme/lv_3... 2024-09-10T21:08:42.042 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T21:08:42.072 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:41 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:08:42.073 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:41 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:42.073 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:41 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:42.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:41 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:08:42.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:41 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:42.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:41 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:42.307 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:08:43.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:42 smithi192 ceph-mon[35363]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:43.164 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:42 smithi059 ceph-mon[30888]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:43.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:42 smithi154 ceph-mon[35041]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:43.471 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:08:43 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-2[40332]: 2024-09-10T21:08:43.220+0000 7fa81e6e6640 -1 osd.2 0 log_to_monitors true 2024-09-10T21:08:44.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:43 smithi192 ceph-mon[35363]: from='osd.2 [v2:172.21.15.192:6800/440750253,v1:172.21.15.192:6801/440750253]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T21:08:44.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:43 smithi192 ceph-mon[35363]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T21:08:44.079 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:43 smithi059 ceph-mon[30888]: from='osd.2 [v2:172.21.15.192:6800/440750253,v1:172.21.15.192:6801/440750253]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T21:08:44.079 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:43 smithi059 ceph-mon[30888]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T21:08:44.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:43 smithi154 ceph-mon[35041]: from='osd.2 [v2:172.21.15.192:6800/440750253,v1:172.21.15.192:6801/440750253]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T21:08:44.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:43 smithi154 ceph-mon[35041]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T21:08:44.784 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:08:44.813 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_3 2024-09-10T21:08:45.078 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:08:44 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-2[40332]: 2024-09-10T21:08:44.832+0000 7fa81a669640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T21:08:45.078 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:08:44 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-2[40332]: 2024-09-10T21:08:44.837+0000 7fa816490640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:08:45.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:44 smithi192 ceph-mon[35363]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:45.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:44 smithi192 ceph-mon[35363]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T21:08:45.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:44 smithi192 ceph-mon[35363]: from='osd.2 [v2:172.21.15.192:6800/440750253,v1:172.21.15.192:6801/440750253]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:08:45.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:44 smithi192 ceph-mon[35363]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T21:08:45.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:44 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:08:45.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:44 smithi192 ceph-mon[35363]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:08:45.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:44 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:45.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:44 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:45.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:44 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:08:45.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:44 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:45.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:44 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:45.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:44 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:08:45.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:44 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:45.104 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:08:45.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:44 smithi059 ceph-mon[30888]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:45.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:44 smithi059 ceph-mon[30888]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T21:08:45.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:44 smithi059 ceph-mon[30888]: from='osd.2 [v2:172.21.15.192:6800/440750253,v1:172.21.15.192:6801/440750253]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:08:45.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:44 smithi059 ceph-mon[30888]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T21:08:45.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:44 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:08:45.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:44 smithi059 ceph-mon[30888]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:08:45.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:44 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:45.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:44 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:45.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:44 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:08:45.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:44 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:45.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:44 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:45.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:44 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:08:45.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:44 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:45.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:44 smithi154 ceph-mon[35041]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:45.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:44 smithi154 ceph-mon[35041]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T21:08:45.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:44 smithi154 ceph-mon[35041]: from='osd.2 [v2:172.21.15.192:6800/440750253,v1:172.21.15.192:6801/440750253]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:08:45.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:44 smithi154 ceph-mon[35041]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T21:08:45.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:44 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:08:45.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:44 smithi154 ceph-mon[35041]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:08:45.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:44 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:45.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:44 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:45.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:44 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:08:45.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:44 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:45.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:44 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:45.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:44 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:08:45.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:44 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:45.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.549+0000 7f838b1c2640 1 -- 172.21.15.59:0/3342480675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8384104560 msgr2=0x7f838410aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:45.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.549+0000 7f838b1c2640 1 --2- 172.21.15.59:0/3342480675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8384104560 0x7f838410aee0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f837c009cd0 tx=0x7f837c02a8e0 comp rx=0 tx=0).stop 2024-09-10T21:08:45.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.549+0000 7f838b1c2640 1 -- 172.21.15.59:0/3342480675 shutdown_connections 2024-09-10T21:08:45.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.549+0000 7f838b1c2640 1 --2- 172.21.15.59:0/3342480675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8384104560 0x7f838410aee0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:45.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.549+0000 7f838b1c2640 1 --2- 172.21.15.59:0/3342480675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8384103ba0 0x7f8384104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:45.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.549+0000 7f838b1c2640 1 --2- 172.21.15.59:0/3342480675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8384102a40 0x7f8384102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.549+0000 7f838b1c2640 1 -- 172.21.15.59:0/3342480675 >> 172.21.15.59:0/3342480675 conn(0x7f83840fe2f0 msgr2=0x7f8384100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:08:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.549+0000 7f838b1c2640 1 -- 172.21.15.59:0/3342480675 shutdown_connections 2024-09-10T21:08:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.549+0000 7f838b1c2640 1 -- 172.21.15.59:0/3342480675 wait complete. 2024-09-10T21:08:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.550+0000 7f838b1c2640 1 Processor -- start 2024-09-10T21:08:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.550+0000 7f838b1c2640 1 -- start start 2024-09-10T21:08:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.550+0000 7f838b1c2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8384102a40 0x7f838419af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.550+0000 7f838b1c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8384103ba0 0x7f838419b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.550+0000 7f838b1c2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8384104560 0x7f838419c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.550+0000 7f838b1c2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f838410e6c0 con 0x7f8384102a40 2024-09-10T21:08:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.550+0000 7f838b1c2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f838410e540 con 0x7f8384103ba0 2024-09-10T21:08:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.550+0000 7f838b1c2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f838410e840 con 0x7f8384104560 2024-09-10T21:08:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.550+0000 7f8388f5e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8384102a40 0x7f838419af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:08:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.550+0000 7f8388f5e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8384102a40 0x7f838419af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47418/0 (socket says 172.21.15.59:47418) 2024-09-10T21:08:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.550+0000 7f8388f5e640 1 -- 172.21.15.59:0/1783303097 learned_addr learned my addr 172.21.15.59:0/1783303097 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:08:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.550+0000 7f8383fff640 1 --2- 172.21.15.59:0/1783303097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8384103ba0 0x7f838419b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:08:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.550+0000 7f838975f640 1 --2- 172.21.15.59:0/1783303097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8384104560 0x7f838419c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:08:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.550+0000 7f8388f5e640 1 -- 172.21.15.59:0/1783303097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8384104560 msgr2=0x7f838419c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.550+0000 7f8388f5e640 1 --2- 172.21.15.59:0/1783303097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8384104560 0x7f838419c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.550+0000 7f8388f5e640 1 -- 172.21.15.59:0/1783303097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8384103ba0 msgr2=0x7f838419b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:08:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.550+0000 7f8388f5e640 1 --2- 172.21.15.59:0/1783303097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8384103ba0 0x7f838419b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:08:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.550+0000 7f8388f5e640 1 -- 172.21.15.59:0/1783303097 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838419caa0 con 0x7f8384102a40 2024-09-10T21:08:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.550+0000 7f838975f640 1 --2- 172.21.15.59:0/1783303097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8384104560 0x7f838419c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:08:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.551+0000 7f8388f5e640 1 --2- 172.21.15.59:0/1783303097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8384102a40 0x7f838419af70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f837400c920 tx=0x7f837400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:08:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.551+0000 7f8381ffb640 1 -- 172.21.15.59:0/1783303097 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8374007c70 con 0x7f8384102a40 2024-09-10T21:08:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.551+0000 7f8381ffb640 1 -- 172.21.15.59:0/1783303097 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8374007e10 con 0x7f8384102a40 2024-09-10T21:08:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.551+0000 7f838b1c2640 1 -- 172.21.15.59:0/1783303097 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838419cd90 con 0x7f8384102a40 2024-09-10T21:08:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.551+0000 7f8381ffb640 1 -- 172.21.15.59:0/1783303097 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8374018820 con 0x7f8384102a40 2024-09-10T21:08:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.551+0000 7f838b1c2640 1 -- 172.21.15.59:0/1783303097 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83841a3470 con 0x7f8384102a40 2024-09-10T21:08:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.552+0000 7f838b1c2640 1 -- 172.21.15.59:0/1783303097 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83841a3640 con 0x7f8384102a40 2024-09-10T21:08:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.553+0000 7f8381ffb640 1 -- 172.21.15.59:0/1783303097 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 15) ==== 153194+0+0 (secure 0 0 0) 0x7f837400f450 con 0x7f8384102a40 2024-09-10T21:08:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.554+0000 7f8381ffb640 1 --2- 172.21.15.59:0/1783303097 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f836c0b52d0 0x7f836c0b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:08:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.554+0000 7f8383fff640 1 --2- 172.21.15.59:0/1783303097 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f836c0b52d0 0x7f836c0b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:08:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.554+0000 7f8381ffb640 1 -- 172.21.15.59:0/1783303097 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f83740e4660 con 0x7f8384102a40 2024-09-10T21:08:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.555+0000 7f8383fff640 1 --2- 172.21.15.59:0/1783303097 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f836c0b52d0 0x7f836c0b7790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8378009bd0 tx=0x7f8378005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:08:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.558+0000 7f8381ffb640 1 -- 172.21.15.59:0/1783303097 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8374014030 con 0x7f8384102a40 2024-09-10T21:08:45.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:45.755+0000 7f838b1c2640 1 -- 172.21.15.59:0/1783303097 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f83841a3810 con 0x7f836c0b52d0 2024-09-10T21:08:46.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:45 smithi059 ceph-mon[30888]: Detected new or changed devices on smithi192 2024-09-10T21:08:46.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:45 smithi059 ceph-mon[30888]: Adjusting osd_memory_target on smithi192 to 17088M 2024-09-10T21:08:46.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:45 smithi059 ceph-mon[30888]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-10T21:08:46.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:45 smithi059 ceph-mon[30888]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T21:08:46.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:45 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:08:46.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:45 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:08:46.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:45 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:08:46.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:45 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:08:46.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:45 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:46.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:45 smithi154 ceph-mon[35041]: Detected new or changed devices on smithi192 2024-09-10T21:08:46.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:45 smithi154 ceph-mon[35041]: Adjusting osd_memory_target on smithi192 to 17088M 2024-09-10T21:08:46.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:45 smithi154 ceph-mon[35041]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-10T21:08:46.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:45 smithi154 ceph-mon[35041]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T21:08:46.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:45 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:08:46.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:45 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:08:46.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:45 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:08:46.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:45 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:08:46.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:45 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:46.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:45 smithi192 ceph-mon[35363]: Detected new or changed devices on smithi192 2024-09-10T21:08:46.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:45 smithi192 ceph-mon[35363]: Adjusting osd_memory_target on smithi192 to 17088M 2024-09-10T21:08:46.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:45 smithi192 ceph-mon[35363]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-10T21:08:46.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:45 smithi192 ceph-mon[35363]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T21:08:46.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:45 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:08:46.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:45 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:08:46.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:45 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:08:46.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:45 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:08:46.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:45 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:46.999 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:46 smithi059 ceph-mon[30888]: purged_snaps scrub starts 2024-09-10T21:08:46.999 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:46 smithi059 ceph-mon[30888]: purged_snaps scrub ok 2024-09-10T21:08:46.999 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:46 smithi059 ceph-mon[30888]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:46.999 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:46 smithi059 ceph-mon[30888]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:08:46.999 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:08:46.999 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:46 smithi059 ceph-mon[30888]: osd.2 [v2:172.21.15.192:6800/440750253,v1:172.21.15.192:6801/440750253] boot 2024-09-10T21:08:46.999 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:46 smithi059 ceph-mon[30888]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T21:08:47.000 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:08:47.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:46 smithi154 ceph-mon[35041]: purged_snaps scrub starts 2024-09-10T21:08:47.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:46 smithi154 ceph-mon[35041]: purged_snaps scrub ok 2024-09-10T21:08:47.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:46 smithi154 ceph-mon[35041]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:47.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:46 smithi154 ceph-mon[35041]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:08:47.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:46 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:08:47.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:46 smithi154 ceph-mon[35041]: osd.2 [v2:172.21.15.192:6800/440750253,v1:172.21.15.192:6801/440750253] boot 2024-09-10T21:08:47.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:46 smithi154 ceph-mon[35041]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T21:08:47.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:46 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:08:47.232 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:46 smithi192 ceph-mon[35363]: purged_snaps scrub starts 2024-09-10T21:08:47.232 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:46 smithi192 ceph-mon[35363]: purged_snaps scrub ok 2024-09-10T21:08:47.233 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:46 smithi192 ceph-mon[35363]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-10T21:08:47.233 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:46 smithi192 ceph-mon[35363]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:08:47.233 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:08:47.233 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:46 smithi192 ceph-mon[35363]: osd.2 [v2:172.21.15.192:6800/440750253,v1:172.21.15.192:6801/440750253] boot 2024-09-10T21:08:47.233 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:46 smithi192 ceph-mon[35363]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T21:08:47.233 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T21:08:48.086 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:47 smithi059 ceph-mon[30888]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T21:08:48.086 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:47 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T21:08:48.154 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:47 smithi154 ceph-mon[35041]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T21:08:48.155 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:47 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T21:08:48.220 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:47 smithi192 ceph-mon[35363]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T21:08:48.220 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:47 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T21:08:48.358 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 sudo[51639]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T21:08:48.358 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 sudo[51639]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:08:48.358 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 sudo[51639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:08:48.358 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 sudo[51639]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:08:48.358 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 sudo[51645]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T21:08:48.358 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 sudo[51645]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:08:48.358 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 sudo[51645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:08:48.359 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 sudo[51645]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:08:48.359 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:08:48 smithi059 sudo[51628]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T21:08:48.359 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:08:48 smithi059 sudo[51628]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:08:48.359 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:08:48 smithi059 sudo[51628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:08:48.359 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:08:48 smithi059 sudo[51628]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:08:48.359 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:08:48 smithi059 sudo[51633]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T21:08:48.359 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:08:48 smithi059 sudo[51633]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:08:48.359 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:08:48 smithi059 sudo[51633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:08:48.359 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:08:48 smithi059 sudo[51633]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:08:48.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 sudo[43520]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T21:08:48.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 sudo[43520]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:08:48.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 sudo[43520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:08:48.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 sudo[43520]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:08:48.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 sudo[43523]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T21:08:48.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 sudo[43523]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:08:48.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 sudo[43523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:08:48.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 sudo[43523]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:08:48.434 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:08:48 smithi154 sudo[43514]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T21:08:48.434 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:08:48 smithi154 sudo[43514]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:08:48.434 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:08:48 smithi154 sudo[43514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:08:48.434 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:08:48 smithi154 sudo[43514]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:08:48.434 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:08:48 smithi154 sudo[43517]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T21:08:48.434 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:08:48 smithi154 sudo[43517]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:08:48.434 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:08:48 smithi154 sudo[43517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:08:48.434 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:08:48 smithi154 sudo[43517]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:08:48.473 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 sudo[43974]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T21:08:48.473 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 sudo[43974]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:08:48.473 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 sudo[43974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:08:48.473 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 sudo[43974]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:08:48.473 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 sudo[43977]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T21:08:48.473 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 sudo[43977]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:08:48.473 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 sudo[43977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:08:48.473 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 sudo[43977]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:08:48.473 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:08:48 smithi192 sudo[43968]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T21:08:48.474 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:08:48 smithi192 sudo[43968]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:08:48.474 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:08:48 smithi192 sudo[43968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:08:48.474 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:08:48 smithi192 sudo[43968]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:08:48.474 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:08:48 smithi192 sudo[43971]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T21:08:48.474 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:08:48 smithi192 sudo[43971]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T21:08:48.474 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:08:48 smithi192 sudo[43971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T21:08:48.474 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:08:48 smithi192 sudo[43971]: pam_unix(sudo:session): session closed for user root 2024-09-10T21:08:48.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: pgmap v90: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:08:48.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T21:08:48.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T21:08:48.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T21:08:48.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3329703138' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f26969d1-7b48-4f20-9077-c55c59775ed7"} : dispatch 2024-09-10T21:08:48.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T21:08:48.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3329703138' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f26969d1-7b48-4f20-9077-c55c59775ed7"}]': finished 2024-09-10T21:08:48.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T21:08:48.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:08:48.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:48.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:48.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:48.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T21:08:48.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T21:08:48.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:08:48.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:08:48.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:08:48.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T21:08:48.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:08:48.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:08:48.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:08:48.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T21:08:48.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T21:08:48.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:08:48.914 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:08:48.914 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:08:48.914 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T21:08:48.914 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:48 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1143286624' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:08:49.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: pgmap v90: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:08:49.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T21:08:49.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T21:08:49.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T21:08:49.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3329703138' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f26969d1-7b48-4f20-9077-c55c59775ed7"} : dispatch 2024-09-10T21:08:49.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T21:08:49.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3329703138' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f26969d1-7b48-4f20-9077-c55c59775ed7"}]': finished 2024-09-10T21:08:49.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T21:08:49.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:08:49.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:49.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:49.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:49.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T21:08:49.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T21:08:49.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:08:49.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:08:49.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:08:49.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T21:08:49.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:08:49.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:08:49.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:08:49.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T21:08:49.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T21:08:49.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:08:49.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:08:49.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:08:49.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T21:08:49.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:48 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1143286624' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:08:49.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: pgmap v90: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:08:49.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T21:08:49.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T21:08:49.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T21:08:49.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3329703138' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f26969d1-7b48-4f20-9077-c55c59775ed7"} : dispatch 2024-09-10T21:08:49.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T21:08:49.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3329703138' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f26969d1-7b48-4f20-9077-c55c59775ed7"}]': finished 2024-09-10T21:08:49.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T21:08:49.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:08:49.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:49.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:49.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:08:49.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T21:08:49.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T21:08:49.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:08:49.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:08:49.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:08:49.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T21:08:49.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:08:49.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:08:49.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:08:49.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T21:08:49.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T21:08:49.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T21:08:49.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T21:08:49.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T21:08:49.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T21:08:49.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:48 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1143286624' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:08:50.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:08:50.063+0000 7f8381ffb640 1 -- 172.21.15.59:0/1783303097 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f83740a8740 con 0x7f8384102a40 2024-09-10T21:08:50.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:50 smithi192 ceph-mon[35363]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T21:08:50.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:08:50.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:50 smithi192 ceph-mon[35363]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:08:50.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:50 smithi059 ceph-mon[30888]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T21:08:50.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:08:50.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:50 smithi059 ceph-mon[30888]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:08:50.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:50 smithi154 ceph-mon[35041]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T21:08:50.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:08:50.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:50 smithi154 ceph-mon[35041]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:08:51.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:51 smithi192 ceph-mon[35363]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T21:08:51.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:51 smithi059 ceph-mon[30888]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T21:08:51.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:51 smithi154 ceph-mon[35041]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T21:08:52.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:52 smithi192 ceph-mon[35363]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:08:52.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:52 smithi059 ceph-mon[30888]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:08:52.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:52 smithi154 ceph-mon[35041]: pgmap v95: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:08:54.485 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:54 smithi059 ceph-mon[30888]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:08:54.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:54 smithi192 ceph-mon[35363]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:08:54.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:54 smithi154 ceph-mon[35041]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:08:56.500 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:56 smithi059 ceph-mon[30888]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:08:56.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:56 smithi192 ceph-mon[35363]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:08:56.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:56 smithi154 ceph-mon[35041]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:08:57.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:57 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T21:08:57.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:57 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:57.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:57 smithi059 ceph-mon[30888]: Deploying daemon osd.3 on smithi059 2024-09-10T21:08:57.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:57 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T21:08:57.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:57 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:57.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:57 smithi192 ceph-mon[35363]: Deploying daemon osd.3 on smithi059 2024-09-10T21:08:57.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:57 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T21:08:57.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:57 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:08:57.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:57 smithi154 ceph-mon[35041]: Deploying daemon osd.3 on smithi059 2024-09-10T21:08:58.471 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:08:58 smithi059 ceph-mon[30888]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:08:58.544 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:08:58 smithi192 ceph-mon[35363]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:08:58.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:08:58 smithi154 ceph-mon[35041]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:00.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:00 smithi059 ceph-mon[30888]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:00.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:00 smithi192 ceph-mon[35363]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:00.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:00 smithi154 ceph-mon[35041]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:02.397 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:02 smithi059 ceph-mon[30888]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:02.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:02 smithi192 ceph-mon[35363]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:02.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:02 smithi154 ceph-mon[35041]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:03.345 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:03 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:09:03.345 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:03 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:03.345 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:03 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:03.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:03 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:09:03.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:03 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:03.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:03 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:03.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:03 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:09:03.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:03 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:03.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:03 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:04.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:04 smithi059 ceph-mon[30888]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:04.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:04 smithi154 ceph-mon[35041]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:05.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:04 smithi192 ceph-mon[35363]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:06.398 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:06 smithi059 ceph-mon[30888]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:06.398 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:06.398 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:06.399 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:06.399 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:09:06.399 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:06.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:09:06.434+0000 7f8381ffb640 1 -- 172.21.15.59:0/1783303097 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f83841a3810 con 0x7f836c0b52d0 2024-09-10T21:09:06.441 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 3 on host 'smithi059' 2024-09-10T21:09:06.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:09:06.437+0000 7f838b1c2640 1 -- 172.21.15.59:0/1783303097 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f836c0b52d0 msgr2=0x7f836c0b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:09:06.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:09:06.437+0000 7f838b1c2640 1 --2- 172.21.15.59:0/1783303097 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f836c0b52d0 0x7f836c0b7790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8378009bd0 tx=0x7f8378005f90 comp rx=0 tx=0).stop 2024-09-10T21:09:06.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:09:06.437+0000 7f838b1c2640 1 -- 172.21.15.59:0/1783303097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8384102a40 msgr2=0x7f838419af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:09:06.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:09:06.437+0000 7f838b1c2640 1 --2- 172.21.15.59:0/1783303097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8384102a40 0x7f838419af70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f837400c920 tx=0x7f837400cde0 comp rx=0 tx=0).stop 2024-09-10T21:09:06.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:09:06.437+0000 7f838b1c2640 1 -- 172.21.15.59:0/1783303097 shutdown_connections 2024-09-10T21:09:06.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:09:06.437+0000 7f838b1c2640 1 --2- 172.21.15.59:0/1783303097 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f836c0b52d0 0x7f836c0b7790 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:06.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:09:06.437+0000 7f838b1c2640 1 --2- 172.21.15.59:0/1783303097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8384104560 0x7f838419c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:06.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:09:06.437+0000 7f838b1c2640 1 --2- 172.21.15.59:0/1783303097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8384103ba0 0x7f838419b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:06.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:09:06.437+0000 7f838b1c2640 1 --2- 172.21.15.59:0/1783303097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8384102a40 0x7f838419af70 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:06.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:09:06.437+0000 7f838b1c2640 1 -- 172.21.15.59:0/1783303097 >> 172.21.15.59:0/1783303097 conn(0x7f83840fe2f0 msgr2=0x7f8384075380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:09:06.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:09:06.437+0000 7f838b1c2640 1 -- 172.21.15.59:0/1783303097 shutdown_connections 2024-09-10T21:09:06.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:09:06.437+0000 7f838b1c2640 1 -- 172.21.15.59:0/1783303097 wait complete. 2024-09-10T21:09:06.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:06 smithi192 ceph-mon[35363]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:06.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:06.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:06.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:06.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:09:06.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:06.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:06 smithi154 ceph-mon[35041]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:06.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:06.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:06.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:06.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:09:06.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:07.085 DEBUG:teuthology.orchestra.run.smithi059:osd.3> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T21:09:07.088 INFO:tasks.cephadm:Deploying osd.4 on smithi154 with /dev/vg_nvme/lv_3... 2024-09-10T21:09:07.088 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T21:09:07.317 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:07 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:09:07.317 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:07 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:07.317 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:07 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:07.348 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:09:07.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:07 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:09:07.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:07 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:07.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:07 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:07.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:07 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:09:07.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:07 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:07.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:07 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:08.562 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:08 smithi059 ceph-mon[30888]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:08.562 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 21:09:08 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-3[53650]: 2024-09-10T21:09:08.432+0000 7f73ff93e640 -1 osd.3 0 log_to_monitors true 2024-09-10T21:09:08.650 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:08 smithi154 ceph-mon[35041]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:08.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:08 smithi192 ceph-mon[35363]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:09.578 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:09 smithi059 ceph-mon[30888]: from='osd.3 [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T21:09:09.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:09 smithi154 ceph-mon[35041]: from='osd.3 [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T21:09:09.732 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T21:09:09.758 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_3 2024-09-10T21:09:09.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:09 smithi192 ceph-mon[35363]: from='osd.3 [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T21:09:10.011 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:09:10.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.449+0000 7f4230e38640 1 -- 172.21.15.154:0/2637339050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f422c108740 msgr2=0x7f422c10ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:09:10.453 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.449+0000 7f4230e38640 1 --2- 172.21.15.154:0/2637339050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f422c108740 0x7f422c10ac00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4224009ca0 tx=0x7f422402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:09:10.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.449+0000 7f4230e38640 1 -- 172.21.15.154:0/2637339050 shutdown_connections 2024-09-10T21:09:10.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.449+0000 7f4230e38640 1 --2- 172.21.15.154:0/2637339050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f422c108740 0x7f422c10ac00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:10.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.449+0000 7f4230e38640 1 --2- 172.21.15.154:0/2637339050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f422c105b90 0x7f422c108000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:10.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.449+0000 7f4230e38640 1 --2- 172.21.15.154:0/2637339050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f422c06c060 0x7f422c105600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:10.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.449+0000 7f4230e38640 1 -- 172.21.15.154:0/2637339050 >> 172.21.15.154:0/2637339050 conn(0x7f422c0fd210 msgr2=0x7f422c0ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:09:10.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.449+0000 7f4230e38640 1 -- 172.21.15.154:0/2637339050 shutdown_connections 2024-09-10T21:09:10.454 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.449+0000 7f4230e38640 1 -- 172.21.15.154:0/2637339050 wait complete. 2024-09-10T21:09:10.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.450+0000 7f4230e38640 1 Processor -- start 2024-09-10T21:09:10.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.450+0000 7f4230e38640 1 -- start start 2024-09-10T21:09:10.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.450+0000 7f4230e38640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f422c06c060 0x7f422c198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:09:10.456 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.450+0000 7f4230e38640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f422c105b90 0x7f422c1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:09:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.450+0000 7f4230e38640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f422c108740 0x7f422c19a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:09:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.450+0000 7f4230e38640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f422c10e6b0 con 0x7f422c105b90 2024-09-10T21:09:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.450+0000 7f4230e38640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f422c10e530 con 0x7f422c108740 2024-09-10T21:09:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.450+0000 7f4230e38640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f422c10e830 con 0x7f422c06c060 2024-09-10T21:09:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.450+0000 7f422ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f422c108740 0x7f422c19a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:09:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.450+0000 7f422ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f422c108740 0x7f422c19a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:32892/0 (socket says 172.21.15.154:32892) 2024-09-10T21:09:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.450+0000 7f422ad9d640 1 -- 172.21.15.154:0/1171514566 learned_addr learned my addr 172.21.15.154:0/1171514566 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T21:09:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.451+0000 7f422a59c640 1 --2- 172.21.15.154:0/1171514566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f422c06c060 0x7f422c198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:09:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.451+0000 7f4229d9b640 1 --2- 172.21.15.154:0/1171514566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f422c105b90 0x7f422c1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:09:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.451+0000 7f422ad9d640 1 -- 172.21.15.154:0/1171514566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f422c06c060 msgr2=0x7f422c198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:09:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.451+0000 7f422ad9d640 1 --2- 172.21.15.154:0/1171514566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f422c06c060 0x7f422c198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.451+0000 7f422ad9d640 1 -- 172.21.15.154:0/1171514566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f422c105b90 msgr2=0x7f422c1993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:09:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.451+0000 7f422ad9d640 1 --2- 172.21.15.154:0/1171514566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f422c105b90 0x7f422c1993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:10.457 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.451+0000 7f422ad9d640 1 -- 172.21.15.154:0/1171514566 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f422c19a8d0 con 0x7f422c108740 2024-09-10T21:09:10.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.451+0000 7f422ad9d640 1 --2- 172.21.15.154:0/1171514566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f422c108740 0x7f422c19a030 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f42240097b0 tx=0x7f4224031840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:09:10.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.451+0000 7f421b7fe640 1 -- 172.21.15.154:0/1171514566 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4224003bf0 con 0x7f422c108740 2024-09-10T21:09:10.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.451+0000 7f421b7fe640 1 -- 172.21.15.154:0/1171514566 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4224003d90 con 0x7f422c108740 2024-09-10T21:09:10.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.451+0000 7f4230e38640 1 -- 172.21.15.154:0/1171514566 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f422c19ab60 con 0x7f422c108740 2024-09-10T21:09:10.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.451+0000 7f421b7fe640 1 -- 172.21.15.154:0/1171514566 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422402fc70 con 0x7f422c108740 2024-09-10T21:09:10.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.451+0000 7f4230e38640 1 -- 172.21.15.154:0/1171514566 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f422c1a12a0 con 0x7f422c108740 2024-09-10T21:09:10.458 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.452+0000 7f4230e38640 1 -- 172.21.15.154:0/1171514566 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f422c0fed00 con 0x7f422c108740 2024-09-10T21:09:10.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.453+0000 7f421b7fe640 1 -- 172.21.15.154:0/1171514566 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f4224004040 con 0x7f422c108740 2024-09-10T21:09:10.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.454+0000 7f421b7fe640 1 --2- 172.21.15.154:0/1171514566 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f42140b5360 0x7f42140b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:09:10.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.454+0000 7f421b7fe640 1 -- 172.21.15.154:0/1171514566 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3389+0+0 (secure 0 0 0) 0x7f4224105d00 con 0x7f422c108740 2024-09-10T21:09:10.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.454+0000 7f422a59c640 1 --2- 172.21.15.154:0/1171514566 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f42140b5360 0x7f42140b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:09:10.459 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.455+0000 7f422a59c640 1 --2- 172.21.15.154:0/1171514566 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f42140b5360 0x7f42140b7820 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f421c005fd0 tx=0x7f421c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:09:10.461 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.457+0000 7f421b7fe640 1 -- 172.21.15.154:0/1171514566 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f42240cdf00 con 0x7f422c108740 2024-09-10T21:09:10.649 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:10.645+0000 7f4230e38640 1 -- 172.21.15.154:0/1171514566 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f422c063590 con 0x7f42140b5360 2024-09-10T21:09:10.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:10 smithi154 ceph-mon[35041]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:10.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:10 smithi154 ceph-mon[35041]: from='osd.3 [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T21:09:10.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:10 smithi154 ceph-mon[35041]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T21:09:10.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:10 smithi154 ceph-mon[35041]: from='osd.3 [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-09-10T21:09:10.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:09:10.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:10 smithi154 ceph-mon[35041]: Detected new or changed devices on smithi059 2024-09-10T21:09:10.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:10.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:10.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:09:10.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:09:10.684 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:10 smithi154 ceph-mon[35041]: Adjusting osd_memory_target on smithi059 to 8546M 2024-09-10T21:09:10.684 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:10.684 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:10.684 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:09:10.684 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:10.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:10 smithi192 ceph-mon[35363]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:10.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:10 smithi192 ceph-mon[35363]: from='osd.3 [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T21:09:10.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:10 smithi192 ceph-mon[35363]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T21:09:10.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:10 smithi192 ceph-mon[35363]: from='osd.3 [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-09-10T21:09:10.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:09:10.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:10 smithi192 ceph-mon[35363]: Detected new or changed devices on smithi059 2024-09-10T21:09:10.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:10.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:10.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:09:10.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:09:10.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:10 smithi192 ceph-mon[35363]: Adjusting osd_memory_target on smithi059 to 8546M 2024-09-10T21:09:10.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:10.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:10.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:09:10.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:10.911 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 21:09:10 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-3[53650]: 2024-09-10T21:09:10.448+0000 7f73fb8c1640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T21:09:10.911 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 21:09:10 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-3[53650]: 2024-09-10T21:09:10.454+0000 7f73f76e8640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:09:10.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:10 smithi059 ceph-mon[30888]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:10.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:10 smithi059 ceph-mon[30888]: from='osd.3 [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T21:09:10.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:10 smithi059 ceph-mon[30888]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T21:09:10.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:10 smithi059 ceph-mon[30888]: from='osd.3 [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-09-10T21:09:10.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:09:10.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:10 smithi059 ceph-mon[30888]: Detected new or changed devices on smithi059 2024-09-10T21:09:10.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:10.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:10.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:09:10.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:09:10.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:10 smithi059 ceph-mon[30888]: Adjusting osd_memory_target on smithi059 to 8546M 2024-09-10T21:09:10.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:10.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:10.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:09:10.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:11.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:11 smithi154 ceph-mon[35041]: purged_snaps scrub starts 2024-09-10T21:09:11.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:11 smithi154 ceph-mon[35041]: purged_snaps scrub ok 2024-09-10T21:09:11.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:11 smithi154 ceph-mon[35041]: from='osd.3 [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T21:09:11.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:11 smithi154 ceph-mon[35041]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T21:09:11.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:11 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:09:11.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:11 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:09:11.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:11 smithi154 ceph-mon[35041]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:09:11.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:11 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:09:11.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:11 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:09:11.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:11 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:11.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:11 smithi192 ceph-mon[35363]: purged_snaps scrub starts 2024-09-10T21:09:11.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:11 smithi192 ceph-mon[35363]: purged_snaps scrub ok 2024-09-10T21:09:11.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:11 smithi192 ceph-mon[35363]: from='osd.3 [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T21:09:11.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:11 smithi192 ceph-mon[35363]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T21:09:11.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:11 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:09:11.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:11 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:09:11.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:11 smithi192 ceph-mon[35363]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:09:11.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:11 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:09:11.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:11 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:09:11.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:11 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:11.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:11 smithi059 ceph-mon[30888]: purged_snaps scrub starts 2024-09-10T21:09:11.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:11 smithi059 ceph-mon[30888]: purged_snaps scrub ok 2024-09-10T21:09:11.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:11 smithi059 ceph-mon[30888]: from='osd.3 [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T21:09:11.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:11 smithi059 ceph-mon[30888]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T21:09:11.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:11 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:09:11.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:11 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:09:11.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:11 smithi059 ceph-mon[30888]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:09:11.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:11 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:09:11.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:11 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:09:11.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:11 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:12.581 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:12 smithi154 ceph-mon[35041]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:12.581 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:12 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:09:12.581 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:12 smithi154 ceph-mon[35041]: osd.3 [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393] boot 2024-09-10T21:09:12.581 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:12 smithi154 ceph-mon[35041]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T21:09:12.581 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:12 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:09:12.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:12 smithi192 ceph-mon[35363]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:12.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:12 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:09:12.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:12 smithi192 ceph-mon[35363]: osd.3 [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393] boot 2024-09-10T21:09:12.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:12 smithi192 ceph-mon[35363]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T21:09:12.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:12 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:09:12.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:12 smithi059 ceph-mon[30888]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-10T21:09:12.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:12 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:09:12.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:12 smithi059 ceph-mon[30888]: osd.3 [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393] boot 2024-09-10T21:09:12.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:12 smithi059 ceph-mon[30888]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T21:09:12.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:12 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T21:09:13.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:13 smithi192 ceph-mon[35363]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T21:09:13.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:13 smithi192 ceph-mon[35363]: from='client.? 172.21.15.154:0/3555736913' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21e1a472-1ae1-454b-aee5-2ad92f6eff17"} : dispatch 2024-09-10T21:09:13.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:13 smithi192 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21e1a472-1ae1-454b-aee5-2ad92f6eff17"} : dispatch 2024-09-10T21:09:13.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:13 smithi192 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21e1a472-1ae1-454b-aee5-2ad92f6eff17"}]': finished 2024-09-10T21:09:13.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:13 smithi192 ceph-mon[35363]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T21:09:13.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:13 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:09:13.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:13 smithi059 ceph-mon[30888]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T21:09:13.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:13 smithi059 ceph-mon[30888]: from='client.? 172.21.15.154:0/3555736913' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21e1a472-1ae1-454b-aee5-2ad92f6eff17"} : dispatch 2024-09-10T21:09:13.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:13 smithi059 ceph-mon[30888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21e1a472-1ae1-454b-aee5-2ad92f6eff17"} : dispatch 2024-09-10T21:09:13.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:13 smithi059 ceph-mon[30888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21e1a472-1ae1-454b-aee5-2ad92f6eff17"}]': finished 2024-09-10T21:09:13.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:13 smithi059 ceph-mon[30888]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T21:09:13.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:13 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:09:13.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:13 smithi154 ceph-mon[35041]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T21:09:13.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:13 smithi154 ceph-mon[35041]: from='client.? 172.21.15.154:0/3555736913' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21e1a472-1ae1-454b-aee5-2ad92f6eff17"} : dispatch 2024-09-10T21:09:13.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:13 smithi154 ceph-mon[35041]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "21e1a472-1ae1-454b-aee5-2ad92f6eff17"} : dispatch 2024-09-10T21:09:13.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:13 smithi154 ceph-mon[35041]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21e1a472-1ae1-454b-aee5-2ad92f6eff17"}]': finished 2024-09-10T21:09:13.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:13 smithi154 ceph-mon[35041]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T21:09:13.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:13 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:09:14.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:14 smithi192 ceph-mon[35363]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:09:14.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:14 smithi192 ceph-mon[35363]: from='client.? 172.21.15.154:0/3146483641' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:09:14.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:14 smithi059 ceph-mon[30888]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:09:14.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:14 smithi059 ceph-mon[30888]: from='client.? 172.21.15.154:0/3146483641' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:09:14.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:14 smithi154 ceph-mon[35041]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:09:14.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:14 smithi154 ceph-mon[35041]: from='client.? 172.21.15.154:0/3146483641' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:09:16.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:16 smithi192 ceph-mon[35363]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:09:16.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:16 smithi059 ceph-mon[30888]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:09:16.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:16 smithi154 ceph-mon[35041]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:09:18.679 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:18 smithi154 ceph-mon[35041]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T21:09:18.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:18 smithi192 ceph-mon[35363]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T21:09:18.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:18 smithi059 ceph-mon[30888]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T21:09:20.667 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:20 smithi154 ceph-mon[35041]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-10T21:09:20.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:20 smithi192 ceph-mon[35363]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-10T21:09:20.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:20 smithi059 ceph-mon[30888]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-10T21:09:21.795 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:21 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T21:09:21.795 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:21 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:21.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:21 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T21:09:21.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:21 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:21.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:21 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T21:09:21.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:21 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:22.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:22 smithi154 ceph-mon[35041]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T21:09:22.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:22 smithi154 ceph-mon[35041]: Deploying daemon osd.4 on smithi154 2024-09-10T21:09:22.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:22 smithi192 ceph-mon[35363]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T21:09:22.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:22 smithi192 ceph-mon[35363]: Deploying daemon osd.4 on smithi154 2024-09-10T21:09:22.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:22 smithi059 ceph-mon[30888]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-10T21:09:22.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:22 smithi059 ceph-mon[30888]: Deploying daemon osd.4 on smithi154 2024-09-10T21:09:24.717 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:24 smithi154 ceph-mon[35041]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-10T21:09:24.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:24 smithi192 ceph-mon[35363]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-10T21:09:24.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:24 smithi059 ceph-mon[30888]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-10T21:09:26.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:26 smithi192 ceph-mon[35363]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:09:26.880 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:26 smithi154 ceph-mon[35041]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:09:26.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:26 smithi059 ceph-mon[30888]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:09:28.780 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:28 smithi154 ceph-mon[35041]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:09:28.781 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:28 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:09:28.781 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:28 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:28.781 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:28 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:28.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:28 smithi192 ceph-mon[35363]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:09:28.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:28 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:09:28.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:28 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:28.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:28 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:28.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:28 smithi059 ceph-mon[30888]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:09:28.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:28 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:09:28.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:28 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:28.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:28 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:31.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:30 smithi154 ceph-mon[35041]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:09:31.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:30 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:31.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:30 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:31.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:30 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:31.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:30 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:09:31.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:30 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:31.265 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:31.260+0000 7f421b7fe640 1 -- 172.21.15.154:0/1171514566 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f422c063590 con 0x7f42140b5360 2024-09-10T21:09:31.266 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 4 on host 'smithi154' 2024-09-10T21:09:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:31.262+0000 7f4230e38640 1 -- 172.21.15.154:0/1171514566 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f42140b5360 msgr2=0x7f42140b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:09:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:31.262+0000 7f4230e38640 1 --2- 172.21.15.154:0/1171514566 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f42140b5360 0x7f42140b7820 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f421c005fd0 tx=0x7f421c00b390 comp rx=0 tx=0).stop 2024-09-10T21:09:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:31.262+0000 7f4230e38640 1 -- 172.21.15.154:0/1171514566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f422c108740 msgr2=0x7f422c19a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:09:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:31.262+0000 7f4230e38640 1 --2- 172.21.15.154:0/1171514566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f422c108740 0x7f422c19a030 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f42240097b0 tx=0x7f4224031840 comp rx=0 tx=0).stop 2024-09-10T21:09:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:31.262+0000 7f4230e38640 1 -- 172.21.15.154:0/1171514566 shutdown_connections 2024-09-10T21:09:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:31.262+0000 7f4230e38640 1 --2- 172.21.15.154:0/1171514566 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f42140b5360 0x7f42140b7820 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:31.262+0000 7f4230e38640 1 --2- 172.21.15.154:0/1171514566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f422c108740 0x7f422c19a030 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:31.262+0000 7f4230e38640 1 --2- 172.21.15.154:0/1171514566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f422c105b90 0x7f422c1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:31.262+0000 7f4230e38640 1 --2- 172.21.15.154:0/1171514566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f422c06c060 0x7f422c198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:31.263+0000 7f4230e38640 1 -- 172.21.15.154:0/1171514566 >> 172.21.15.154:0/1171514566 conn(0x7f422c0fd210 msgr2=0x7f422c103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:09:31.267 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:31.263+0000 7f4230e38640 1 -- 172.21.15.154:0/1171514566 shutdown_connections 2024-09-10T21:09:31.268 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:09:31.263+0000 7f4230e38640 1 -- 172.21.15.154:0/1171514566 wait complete. 2024-09-10T21:09:31.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:30 smithi192 ceph-mon[35363]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:09:31.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:30 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:31.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:30 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:31.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:30 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:31.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:30 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:09:31.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:30 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:31.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:30 smithi059 ceph-mon[30888]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:09:31.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:30 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:31.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:30 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:31.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:30 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:31.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:30 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:09:31.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:30 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:31.888 DEBUG:teuthology.orchestra.run.smithi154:osd.4> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T21:09:31.890 INFO:tasks.cephadm:Deploying osd.5 on smithi192 with /dev/vg_nvme/lv_3... 2024-09-10T21:09:31.890 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T21:09:32.136 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:09:32.137 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:32.137 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:32.146 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:09:32.267 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:09:32.267 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:32.267 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:32.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:09:32.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:32.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:33.117 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:32 smithi154 ceph-mon[35041]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:09:33.118 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 21:09:33 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-4[46282]: 2024-09-10T21:09:33.044+0000 7f9c9b643640 -1 osd.4 0 log_to_monitors true 2024-09-10T21:09:33.217 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:32 smithi192 ceph-mon[35363]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:09:33.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:32 smithi059 ceph-mon[30888]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:09:34.281 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:33 smithi192 ceph-mon[35363]: from='osd.4 [v2:172.21.15.154:6808/1817188525,v1:172.21.15.154:6809/1817188525]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T21:09:34.281 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:33 smithi192 ceph-mon[35363]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T21:09:34.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:33 smithi059 ceph-mon[30888]: from='osd.4 [v2:172.21.15.154:6808/1817188525,v1:172.21.15.154:6809/1817188525]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T21:09:34.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:33 smithi059 ceph-mon[30888]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T21:09:34.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:33 smithi154 ceph-mon[35041]: from='osd.4 [v2:172.21.15.154:6808/1817188525,v1:172.21.15.154:6809/1817188525]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T21:09:34.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:33 smithi154 ceph-mon[35041]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T21:09:34.560 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:09:34.588 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_3 2024-09-10T21:09:34.840 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:09:35.182 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 21:09:34 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-4[46282]: 2024-09-10T21:09:34.940+0000 7f9c975c6640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T21:09:35.183 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 21:09:34 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-4[46282]: 2024-09-10T21:09:34.946+0000 7f9c933ed640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:09:35.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:34 smithi154 ceph-mon[35041]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:09:35.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:34 smithi154 ceph-mon[35041]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T21:09:35.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:34 smithi154 ceph-mon[35041]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T21:09:35.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:09:35.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:34 smithi154 ceph-mon[35041]: from='osd.4 [v2:172.21.15.154:6808/1817188525,v1:172.21.15.154:6809/1817188525]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:09:35.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:34 smithi154 ceph-mon[35041]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:09:35.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:35.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:35.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:09:35.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:09:35.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:35.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:35.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:09:35.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:35.202 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:34 smithi192 ceph-mon[35363]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:09:35.202 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:34 smithi192 ceph-mon[35363]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T21:09:35.202 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:34 smithi192 ceph-mon[35363]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T21:09:35.202 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:09:35.202 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:34 smithi192 ceph-mon[35363]: from='osd.4 [v2:172.21.15.154:6808/1817188525,v1:172.21.15.154:6809/1817188525]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:09:35.202 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:34 smithi192 ceph-mon[35363]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:09:35.203 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:35.203 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:35.203 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:09:35.203 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:09:35.203 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:35.203 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:35.203 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:09:35.203 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:35.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.288+0000 7f62a586d640 1 -- 172.21.15.192:0/2708386640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62a0104550 msgr2=0x7f62a010aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:09:35.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.288+0000 7f62a586d640 1 --2- 172.21.15.192:0/2708386640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62a0104550 0x7f62a010aed0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6298009d00 tx=0x7f629802a910 comp rx=0 tx=0).stop 2024-09-10T21:09:35.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.288+0000 7f62a586d640 1 -- 172.21.15.192:0/2708386640 shutdown_connections 2024-09-10T21:09:35.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.288+0000 7f62a586d640 1 --2- 172.21.15.192:0/2708386640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62a0104550 0x7f62a010aed0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:35.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.288+0000 7f62a586d640 1 --2- 172.21.15.192:0/2708386640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62a0103b90 0x7f62a0104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:35.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.288+0000 7f62a586d640 1 --2- 172.21.15.192:0/2708386640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62a0102a30 0x7f62a0102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:35.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.288+0000 7f62a586d640 1 -- 172.21.15.192:0/2708386640 >> 172.21.15.192:0/2708386640 conn(0x7f62a00fe320 msgr2=0x7f62a0100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:09:35.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.288+0000 7f62a586d640 1 -- 172.21.15.192:0/2708386640 shutdown_connections 2024-09-10T21:09:35.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.288+0000 7f62a586d640 1 -- 172.21.15.192:0/2708386640 wait complete. 2024-09-10T21:09:35.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.288+0000 7f62a586d640 1 Processor -- start 2024-09-10T21:09:35.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.288+0000 7f62a586d640 1 -- start start 2024-09-10T21:09:35.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.288+0000 7f62a586d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62a0102a30 0x7f62a0198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:09:35.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.288+0000 7f62a586d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62a0103b90 0x7f62a0199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:09:35.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.288+0000 7f62a586d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62a0104550 0x7f62a019a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:09:35.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f62a586d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f62a010e730 con 0x7f62a0102a30 2024-09-10T21:09:35.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f62a586d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f62a010e5b0 con 0x7f62a0104550 2024-09-10T21:09:35.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f62a586d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f62a010e8b0 con 0x7f62a0103b90 2024-09-10T21:09:35.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f6297fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62a0103b90 0x7f62a0199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:09:35.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f6297fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62a0103b90 0x7f62a0199500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57770/0 (socket says 172.21.15.192:57770) 2024-09-10T21:09:35.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f6297fff640 1 -- 172.21.15.192:0/359593904 learned_addr learned my addr 172.21.15.192:0/359593904 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T21:09:35.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f629f7fe640 1 --2- 172.21.15.192:0/359593904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62a0104550 0x7f62a019a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:09:35.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f629effd640 1 --2- 172.21.15.192:0/359593904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62a0102a30 0x7f62a0198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:09:35.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f6297fff640 1 -- 172.21.15.192:0/359593904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62a0104550 msgr2=0x7f62a019a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:09:35.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f6297fff640 1 --2- 172.21.15.192:0/359593904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62a0104550 0x7f62a019a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:35.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f6297fff640 1 -- 172.21.15.192:0/359593904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62a0102a30 msgr2=0x7f62a0198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:09:35.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f6297fff640 1 --2- 172.21.15.192:0/359593904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62a0102a30 0x7f62a0198eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:35.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f6297fff640 1 -- 172.21.15.192:0/359593904 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a019a970 con 0x7f62a0103b90 2024-09-10T21:09:35.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f629effd640 1 --2- 172.21.15.192:0/359593904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62a0102a30 0x7f62a0198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:09:35.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f6297fff640 1 --2- 172.21.15.192:0/359593904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62a0103b90 0x7f62a0199500 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f628800d770 tx=0x7f628800dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:09:35.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f62a486b640 1 -- 172.21.15.192:0/359593904 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6288017070 con 0x7f62a0103b90 2024-09-10T21:09:35.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f62a486b640 1 -- 172.21.15.192:0/359593904 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62880054d0 con 0x7f62a0103b90 2024-09-10T21:09:35.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f62a586d640 1 -- 172.21.15.192:0/359593904 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a019ac60 con 0x7f62a0103b90 2024-09-10T21:09:35.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f62a486b640 1 -- 172.21.15.192:0/359593904 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6288004c30 con 0x7f62a0103b90 2024-09-10T21:09:35.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.289+0000 7f62a586d640 1 -- 172.21.15.192:0/359593904 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a00755d0 con 0x7f62a0103b90 2024-09-10T21:09:35.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.290+0000 7f62a586d640 1 -- 172.21.15.192:0/359593904 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62a0109d50 con 0x7f62a0103b90 2024-09-10T21:09:35.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.292+0000 7f62a486b640 1 -- 172.21.15.192:0/359593904 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f6288004e10 con 0x7f62a0103b90 2024-09-10T21:09:35.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.292+0000 7f62a486b640 1 --2- 172.21.15.192:0/359593904 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f628c0b53e0 0x7f628c0b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:09:35.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.293+0000 7f62a486b640 1 -- 172.21.15.192:0/359593904 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3821+0+0 (secure 0 0 0) 0x7f62880e4560 con 0x7f62a0103b90 2024-09-10T21:09:35.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.293+0000 7f629effd640 1 --2- 172.21.15.192:0/359593904 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f628c0b53e0 0x7f628c0b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:09:35.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.293+0000 7f629effd640 1 --2- 172.21.15.192:0/359593904 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f628c0b53e0 0x7f628c0b78a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6290006fd0 tx=0x7f6290008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:09:35.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.297+0000 7f62a486b640 1 -- 172.21.15.192:0/359593904 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f62880ac510 con 0x7f62a0103b90 2024-09-10T21:09:35.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:34 smithi059 ceph-mon[30888]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:09:35.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:34 smithi059 ceph-mon[30888]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T21:09:35.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:34 smithi059 ceph-mon[30888]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T21:09:35.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:09:35.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:34 smithi059 ceph-mon[30888]: from='osd.4 [v2:172.21.15.154:6808/1817188525,v1:172.21.15.154:6809/1817188525]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:09:35.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:34 smithi059 ceph-mon[30888]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:09:35.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:35.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:35.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:09:35.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:09:35.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:35.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:35.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:09:35.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:35.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:35.483+0000 7f62a586d640 1 -- 172.21.15.192:0/359593904 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f62a0063590 con 0x7f628c0b53e0 2024-09-10T21:09:36.213 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:35 smithi192 ceph-mon[35363]: Detected new or changed devices on smithi154 2024-09-10T21:09:36.213 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:35 smithi192 ceph-mon[35363]: Adjusting osd_memory_target on smithi154 to 8544M 2024-09-10T21:09:36.213 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:35 smithi192 ceph-mon[35363]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T21:09:36.214 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:35 smithi192 ceph-mon[35363]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T21:09:36.214 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:35 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:09:36.214 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:35 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:09:36.214 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:35 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:09:36.214 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:35 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:09:36.214 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:35 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:36.313 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:35 smithi059 ceph-mon[30888]: Detected new or changed devices on smithi154 2024-09-10T21:09:36.313 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:35 smithi059 ceph-mon[30888]: Adjusting osd_memory_target on smithi154 to 8544M 2024-09-10T21:09:36.313 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:35 smithi059 ceph-mon[30888]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T21:09:36.313 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:35 smithi059 ceph-mon[30888]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T21:09:36.313 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:35 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:09:36.314 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:35 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:09:36.314 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:35 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:09:36.314 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:35 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:09:36.314 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:35 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:36.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:35 smithi154 ceph-mon[35041]: Detected new or changed devices on smithi154 2024-09-10T21:09:36.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:35 smithi154 ceph-mon[35041]: Adjusting osd_memory_target on smithi154 to 8544M 2024-09-10T21:09:36.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:35 smithi154 ceph-mon[35041]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T21:09:36.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:35 smithi154 ceph-mon[35041]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T21:09:36.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:35 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:09:36.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:35 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:09:36.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:35 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:09:36.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:35 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:09:36.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:35 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:37.158 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:36 smithi192 ceph-mon[35363]: purged_snaps scrub starts 2024-09-10T21:09:37.158 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:36 smithi192 ceph-mon[35363]: purged_snaps scrub ok 2024-09-10T21:09:37.158 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:36 smithi192 ceph-mon[35363]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:09:37.158 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:36 smithi192 ceph-mon[35363]: from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:09:37.158 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:36 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:09:37.158 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:36 smithi192 ceph-mon[35363]: osd.4 [v2:172.21.15.154:6808/1817188525,v1:172.21.15.154:6809/1817188525] boot 2024-09-10T21:09:37.158 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:36 smithi192 ceph-mon[35363]: osdmap e30: 5 total, 5 up, 5 in 2024-09-10T21:09:37.158 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:36 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:09:37.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:36 smithi059 ceph-mon[30888]: purged_snaps scrub starts 2024-09-10T21:09:37.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:36 smithi059 ceph-mon[30888]: purged_snaps scrub ok 2024-09-10T21:09:37.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:36 smithi059 ceph-mon[30888]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:09:37.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:36 smithi059 ceph-mon[30888]: from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:09:37.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:36 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:09:37.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:36 smithi059 ceph-mon[30888]: osd.4 [v2:172.21.15.154:6808/1817188525,v1:172.21.15.154:6809/1817188525] boot 2024-09-10T21:09:37.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:36 smithi059 ceph-mon[30888]: osdmap e30: 5 total, 5 up, 5 in 2024-09-10T21:09:37.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:36 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:09:37.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:36 smithi154 ceph-mon[35041]: purged_snaps scrub starts 2024-09-10T21:09:37.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:36 smithi154 ceph-mon[35041]: purged_snaps scrub ok 2024-09-10T21:09:37.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:36 smithi154 ceph-mon[35041]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-10T21:09:37.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:36 smithi154 ceph-mon[35041]: from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:09:37.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:36 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:09:37.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:36 smithi154 ceph-mon[35041]: osd.4 [v2:172.21.15.154:6808/1817188525,v1:172.21.15.154:6809/1817188525] boot 2024-09-10T21:09:37.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:36 smithi154 ceph-mon[35041]: osdmap e30: 5 total, 5 up, 5 in 2024-09-10T21:09:37.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:36 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T21:09:38.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:37 smithi192 ceph-mon[35363]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T21:09:38.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:37 smithi192 ceph-mon[35363]: from='client.? 172.21.15.192:0/3959155797' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6191b10a-5cbd-4225-b0ec-70d05023d5d6"} : dispatch 2024-09-10T21:09:38.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:37 smithi192 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6191b10a-5cbd-4225-b0ec-70d05023d5d6"} : dispatch 2024-09-10T21:09:38.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:37 smithi192 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6191b10a-5cbd-4225-b0ec-70d05023d5d6"}]': finished 2024-09-10T21:09:38.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:37 smithi192 ceph-mon[35363]: osdmap e32: 6 total, 5 up, 6 in 2024-09-10T21:09:38.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:37 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:09:38.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:37 smithi059 ceph-mon[30888]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T21:09:38.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:37 smithi059 ceph-mon[30888]: from='client.? 172.21.15.192:0/3959155797' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6191b10a-5cbd-4225-b0ec-70d05023d5d6"} : dispatch 2024-09-10T21:09:38.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:37 smithi059 ceph-mon[30888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6191b10a-5cbd-4225-b0ec-70d05023d5d6"} : dispatch 2024-09-10T21:09:38.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:37 smithi059 ceph-mon[30888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6191b10a-5cbd-4225-b0ec-70d05023d5d6"}]': finished 2024-09-10T21:09:38.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:37 smithi059 ceph-mon[30888]: osdmap e32: 6 total, 5 up, 6 in 2024-09-10T21:09:38.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:37 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:09:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:37 smithi154 ceph-mon[35041]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T21:09:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:37 smithi154 ceph-mon[35041]: from='client.? 172.21.15.192:0/3959155797' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6191b10a-5cbd-4225-b0ec-70d05023d5d6"} : dispatch 2024-09-10T21:09:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:37 smithi154 ceph-mon[35041]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6191b10a-5cbd-4225-b0ec-70d05023d5d6"} : dispatch 2024-09-10T21:09:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:37 smithi154 ceph-mon[35041]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6191b10a-5cbd-4225-b0ec-70d05023d5d6"}]': finished 2024-09-10T21:09:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:37 smithi154 ceph-mon[35041]: osdmap e32: 6 total, 5 up, 6 in 2024-09-10T21:09:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:37 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:09:39.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:38 smithi192 ceph-mon[35363]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:39.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:38 smithi192 ceph-mon[35363]: from='client.? 172.21.15.192:0/2655886390' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:09:39.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:38 smithi059 ceph-mon[30888]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:39.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:38 smithi059 ceph-mon[30888]: from='client.? 172.21.15.192:0/2655886390' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:09:39.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:38 smithi154 ceph-mon[35041]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:39.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:38 smithi154 ceph-mon[35041]: from='client.? 172.21.15.192:0/2655886390' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:09:40.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:39 smithi192 ceph-mon[35363]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:40.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:39 smithi059 ceph-mon[30888]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:40.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:39 smithi154 ceph-mon[35041]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:42.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:42 smithi192 ceph-mon[35363]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:42.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:42 smithi059 ceph-mon[30888]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:42.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:42 smithi154 ceph-mon[35041]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:44.552 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:44 smithi192 ceph-mon[35363]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:44.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:44 smithi059 ceph-mon[30888]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:44.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:44 smithi154 ceph-mon[35041]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:46.346 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:46 smithi192 ceph-mon[35363]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:46.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:46 smithi059 ceph-mon[30888]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:46.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:46 smithi154 ceph-mon[35041]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:47.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:47 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T21:09:47.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:47 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:47.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:47 smithi192 ceph-mon[35363]: Deploying daemon osd.5 on smithi192 2024-09-10T21:09:47.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:47 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T21:09:47.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:47 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:47.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:47 smithi059 ceph-mon[30888]: Deploying daemon osd.5 on smithi192 2024-09-10T21:09:47.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:47 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T21:09:47.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:47 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:47.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:47 smithi154 ceph-mon[35041]: Deploying daemon osd.5 on smithi192 2024-09-10T21:09:48.319 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:48 smithi192 ceph-mon[35363]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:48.584 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:48 smithi154 ceph-mon[35041]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:48.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:48 smithi059 ceph-mon[30888]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:50.507 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:50 smithi192 ceph-mon[35363]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:50.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:50 smithi059 ceph-mon[30888]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:50.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:50 smithi154 ceph-mon[35041]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:52.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:52 smithi192 ceph-mon[35363]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:52.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:52 smithi059 ceph-mon[30888]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:52.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:52 smithi154 ceph-mon[35041]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:53.381 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:53 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:09:53.381 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:53 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:53.381 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:53 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:53.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:53 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:09:53.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:53 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:53.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:53 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:53.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:53 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:09:53.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:53 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:53.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:53 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:54.927 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:54 smithi192 ceph-mon[35363]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:54.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:54 smithi154 ceph-mon[35041]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:55.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:54 smithi059 ceph-mon[30888]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:56.469 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:56 smithi192 ceph-mon[35363]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:56.469 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:56 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:56.469 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:56 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:56.469 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:56 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:56.469 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:56 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:09:56.469 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:56 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:56.510 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 5 on host 'smithi192' 2024-09-10T21:09:56.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:56.506+0000 7f62a486b640 1 -- 172.21.15.192:0/359593904 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f62a0063590 con 0x7f628c0b53e0 2024-09-10T21:09:56.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:56.508+0000 7f62a586d640 1 -- 172.21.15.192:0/359593904 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f628c0b53e0 msgr2=0x7f628c0b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:09:56.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:56.508+0000 7f62a586d640 1 --2- 172.21.15.192:0/359593904 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f628c0b53e0 0x7f628c0b78a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6290006fd0 tx=0x7f6290008040 comp rx=0 tx=0).stop 2024-09-10T21:09:56.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:56.508+0000 7f62a586d640 1 -- 172.21.15.192:0/359593904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62a0103b90 msgr2=0x7f62a0199500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:09:56.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:56.508+0000 7f62a586d640 1 --2- 172.21.15.192:0/359593904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62a0103b90 0x7f62a0199500 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f628800d770 tx=0x7f628800dc30 comp rx=0 tx=0).stop 2024-09-10T21:09:56.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:56.508+0000 7f62a586d640 1 -- 172.21.15.192:0/359593904 shutdown_connections 2024-09-10T21:09:56.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:56.508+0000 7f62a586d640 1 --2- 172.21.15.192:0/359593904 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f628c0b53e0 0x7f628c0b78a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:56.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:56.508+0000 7f62a586d640 1 --2- 172.21.15.192:0/359593904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62a0104550 0x7f62a019a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:56.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:56.508+0000 7f62a586d640 1 --2- 172.21.15.192:0/359593904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f62a0103b90 0x7f62a0199500 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:56.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:56.508+0000 7f62a586d640 1 --2- 172.21.15.192:0/359593904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62a0102a30 0x7f62a0198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:09:56.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:56.508+0000 7f62a586d640 1 -- 172.21.15.192:0/359593904 >> 172.21.15.192:0/359593904 conn(0x7f62a00fe320 msgr2=0x7f62a0106f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:09:56.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:56.508+0000 7f62a586d640 1 -- 172.21.15.192:0/359593904 shutdown_connections 2024-09-10T21:09:56.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:09:56.508+0000 7f62a586d640 1 -- 172.21.15.192:0/359593904 wait complete. 2024-09-10T21:09:56.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:56 smithi059 ceph-mon[30888]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:56.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:56 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:56.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:56 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:56.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:56 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:56.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:56 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:09:56.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:56 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:56.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:56 smithi154 ceph-mon[35041]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:56.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:56 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:56.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:56 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:56.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:56 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:09:56.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:56 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:09:56.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:56 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:57.101 DEBUG:teuthology.orchestra.run.smithi192:osd.5> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T21:09:57.103 INFO:tasks.cephadm:Deploying osd.6 on smithi059 with /dev/vg_nvme/lv_2... 2024-09-10T21:09:57.104 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T21:09:57.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:57 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:09:57.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:57 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:57.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:57 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:57.376 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:09:57.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:57 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:09:57.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:57 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:57.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:57 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:57.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:57 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:09:57.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:57 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:57.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:57 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:09:58.732 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:58 smithi192 ceph-mon[35363]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:58.824 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:58 smithi059 ceph-mon[30888]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:58.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:58 smithi154 ceph-mon[35041]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:09:59.078 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:09:58 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:09:58.946+0000 7fa5301e5640 -1 osd.5 0 log_to_monitors true 2024-09-10T21:09:59.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:59 smithi154 ceph-mon[35041]: from='osd.5 [v2:172.21.15.192:6808/1221386274,v1:172.21.15.192:6809/1221386274]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T21:09:59.684 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:09:59 smithi154 ceph-mon[35041]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T21:09:59.696 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:59 smithi059 ceph-mon[30888]: from='osd.5 [v2:172.21.15.192:6808/1221386274,v1:172.21.15.192:6809/1221386274]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T21:09:59.696 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:09:59 smithi059 ceph-mon[30888]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T21:09:59.794 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:59 smithi192 ceph-mon[35363]: from='osd.5 [v2:172.21.15.192:6808/1221386274,v1:172.21.15.192:6809/1221386274]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T21:09:59.794 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:09:59 smithi192 ceph-mon[35363]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T21:09:59.986 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:10:00.013 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_2 2024-09-10T21:10:00.273 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:10:00.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:00 smithi059 ceph-mon[30888]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:10:00.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:00 smithi059 ceph-mon[30888]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T21:10:00.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:00 smithi059 ceph-mon[30888]: from='osd.5 [v2:172.21.15.192:6808/1221386274,v1:172.21.15.192:6809/1221386274]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:10:00.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:00 smithi059 ceph-mon[30888]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T21:10:00.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:00 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:10:00.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:00 smithi059 ceph-mon[30888]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:10:00.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:00 smithi059 ceph-mon[30888]: Detected new or changed devices on smithi192 2024-09-10T21:10:00.663 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:00 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:00.663 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:00 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:00.663 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:00 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:00.663 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:00 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:00.663 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:00 smithi059 ceph-mon[30888]: Adjusting osd_memory_target on smithi192 to 8544M 2024-09-10T21:10:00.663 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:00 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:00.663 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:00 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:00.663 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:00 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:10:00.663 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:00 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:00.663 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:00 smithi059 ceph-mon[30888]: overall HEALTH_OK 2024-09-10T21:10:00.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.786+0000 7ff1a7828640 1 -- 172.21.15.59:0/4282061701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a0108720 msgr2=0x7ff1a010abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:10:00.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.786+0000 7ff1a7828640 1 --2- 172.21.15.59:0/4282061701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a0108720 0x7ff1a010abe0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff190009ca0 tx=0x7ff19002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:10:00.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.786+0000 7ff1a7828640 1 -- 172.21.15.59:0/4282061701 shutdown_connections 2024-09-10T21:10:00.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.786+0000 7ff1a7828640 1 --2- 172.21.15.59:0/4282061701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a0108720 0x7ff1a010abe0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:00.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.786+0000 7ff1a7828640 1 --2- 172.21.15.59:0/4282061701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1a0105bd0 0x7ff1a0107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:00.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.786+0000 7ff1a7828640 1 --2- 172.21.15.59:0/4282061701 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1a006b640 0x7ff1a0105690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:00.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.786+0000 7ff1a7828640 1 -- 172.21.15.59:0/4282061701 >> 172.21.15.59:0/4282061701 conn(0x7ff1a00fd1e0 msgr2=0x7ff1a00ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:10:00.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.786+0000 7ff1a7828640 1 -- 172.21.15.59:0/4282061701 shutdown_connections 2024-09-10T21:10:00.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.786+0000 7ff1a7828640 1 -- 172.21.15.59:0/4282061701 wait complete. 2024-09-10T21:10:00.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.786+0000 7ff1a7828640 1 Processor -- start 2024-09-10T21:10:00.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.787+0000 7ff1a7828640 1 -- start start 2024-09-10T21:10:00.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.787+0000 7ff1a7828640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a006b640 0x7ff1a0198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:10:00.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.787+0000 7ff1a7828640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1a0105bd0 0x7ff1a0199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:10:00.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.787+0000 7ff1a7828640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1a0108720 0x7ff1a019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:10:00.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.787+0000 7ff1a7828640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a010e750 con 0x7ff1a006b640 2024-09-10T21:10:00.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.787+0000 7ff1a7828640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a010e5d0 con 0x7ff1a0105bd0 2024-09-10T21:10:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.787+0000 7ff1a7828640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a010e8d0 con 0x7ff1a0108720 2024-09-10T21:10:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.787+0000 7ff1a55c4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a006b640 0x7ff1a0198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:10:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.787+0000 7ff1a55c4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a006b640 0x7ff1a0198f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52592/0 (socket says 172.21.15.59:52592) 2024-09-10T21:10:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.787+0000 7ff1a55c4640 1 -- 172.21.15.59:0/2048441229 learned_addr learned my addr 172.21.15.59:0/2048441229 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:10:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.787+0000 7ff1a4dc3640 1 --2- 172.21.15.59:0/2048441229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1a0105bd0 0x7ff1a0199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:10:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.787+0000 7ff1a5dc5640 1 --2- 172.21.15.59:0/2048441229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1a0108720 0x7ff1a019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:10:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.787+0000 7ff1a55c4640 1 -- 172.21.15.59:0/2048441229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1a0108720 msgr2=0x7ff1a019a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:10:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.787+0000 7ff1a55c4640 1 --2- 172.21.15.59:0/2048441229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1a0108720 0x7ff1a019a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.787+0000 7ff1a55c4640 1 -- 172.21.15.59:0/2048441229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1a0105bd0 msgr2=0x7ff1a0199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:10:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.787+0000 7ff1a55c4640 1 --2- 172.21.15.59:0/2048441229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1a0105bd0 0x7ff1a0199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.787+0000 7ff1a55c4640 1 -- 172.21.15.59:0/2048441229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a019aa30 con 0x7ff1a006b640 2024-09-10T21:10:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.787+0000 7ff1a4dc3640 1 --2- 172.21.15.59:0/2048441229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1a0105bd0 0x7ff1a0199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:10:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.787+0000 7ff1a55c4640 1 --2- 172.21.15.59:0/2048441229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a006b640 0x7ff1a0198f00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff19800b4a0 tx=0x7ff19800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:10:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.788+0000 7ff19e7fc640 1 -- 172.21.15.59:0/2048441229 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198014070 con 0x7ff1a006b640 2024-09-10T21:10:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.788+0000 7ff19e7fc640 1 -- 172.21.15.59:0/2048441229 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff198010ac0 con 0x7ff1a006b640 2024-09-10T21:10:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.788+0000 7ff1a7828640 1 -- 172.21.15.59:0/2048441229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a019ad20 con 0x7ff1a006b640 2024-09-10T21:10:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.788+0000 7ff19e7fc640 1 -- 172.21.15.59:0/2048441229 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198017c30 con 0x7ff1a006b640 2024-09-10T21:10:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.788+0000 7ff1a7828640 1 -- 172.21.15.59:0/2048441229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a01a1400 con 0x7ff1a006b640 2024-09-10T21:10:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.789+0000 7ff1a7828640 1 -- 172.21.15.59:0/2048441229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a00fecd0 con 0x7ff1a006b640 2024-09-10T21:10:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.790+0000 7ff19e7fc640 1 -- 172.21.15.59:0/2048441229 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7ff198010610 con 0x7ff1a006b640 2024-09-10T21:10:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.791+0000 7ff19e7fc640 1 --2- 172.21.15.59:0/2048441229 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff1880b5360 0x7ff1880b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:10:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.791+0000 7ff1a4dc3640 1 --2- 172.21.15.59:0/2048441229 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff1880b5360 0x7ff1880b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:10:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.791+0000 7ff19e7fc640 1 -- 172.21.15.59:0/2048441229 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4253+0+0 (secure 0 0 0) 0x7ff1980e45b0 con 0x7ff1a006b640 2024-09-10T21:10:00.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.791+0000 7ff1a4dc3640 1 --2- 172.21.15.59:0/2048441229 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff1880b5360 0x7ff1880b7820 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff194009930 tx=0x7ff194008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:10:00.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.794+0000 7ff19e7fc640 1 -- 172.21.15.59:0/2048441229 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff1980ac450 con 0x7ff1a006b640 2024-09-10T21:10:00.828 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:10:00 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:10:00.523+0000 7fa52c168640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T21:10:00.828 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:10:00 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:10:00.531+0000 7fa527f8f640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:10:00.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:00 smithi192 ceph-mon[35363]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:10:00.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:00 smithi192 ceph-mon[35363]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T21:10:00.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:00 smithi192 ceph-mon[35363]: from='osd.5 [v2:172.21.15.192:6808/1221386274,v1:172.21.15.192:6809/1221386274]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:10:00.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:00 smithi192 ceph-mon[35363]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T21:10:00.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:00 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:10:00.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:00 smithi192 ceph-mon[35363]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:10:00.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:00 smithi192 ceph-mon[35363]: Detected new or changed devices on smithi192 2024-09-10T21:10:00.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:00 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:00.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:00 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:00.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:00 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:00.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:00 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:00.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:00 smithi192 ceph-mon[35363]: Adjusting osd_memory_target on smithi192 to 8544M 2024-09-10T21:10:00.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:00 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:00.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:00 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:00.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:00 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:10:00.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:00 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:00.830 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:00 smithi192 ceph-mon[35363]: overall HEALTH_OK 2024-09-10T21:10:00.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:00 smithi154 ceph-mon[35041]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:10:00.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:00 smithi154 ceph-mon[35041]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T21:10:00.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:00 smithi154 ceph-mon[35041]: from='osd.5 [v2:172.21.15.192:6808/1221386274,v1:172.21.15.192:6809/1221386274]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:10:00.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:00 smithi154 ceph-mon[35041]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T21:10:00.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:00 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:10:00.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:00 smithi154 ceph-mon[35041]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:10:00.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:00 smithi154 ceph-mon[35041]: Detected new or changed devices on smithi192 2024-09-10T21:10:00.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:00 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:00.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:00 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:00.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:00 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:00.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:00 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:00.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:00 smithi154 ceph-mon[35041]: Adjusting osd_memory_target on smithi192 to 8544M 2024-09-10T21:10:00.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:00 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:00.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:00 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:00.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:00 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:10:00.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:00 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:00.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:00 smithi154 ceph-mon[35041]: overall HEALTH_OK 2024-09-10T21:10:00.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:00.991+0000 7ff1a7828640 1 -- 172.21.15.59:0/2048441229 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff1a0063590 con 0x7ff1880b5360 2024-09-10T21:10:01.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:01 smithi059 ceph-mon[30888]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-10T21:10:01.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:01 smithi059 ceph-mon[30888]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T21:10:01.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:01 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:10:01.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:01 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:10:01.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:01 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:10:01.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:01 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:10:01.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:01 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:01.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:01 smithi192 ceph-mon[35363]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-10T21:10:01.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:01 smithi192 ceph-mon[35363]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T21:10:01.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:01 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:10:01.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:01 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:10:01.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:01 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:10:01.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:01 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:10:01.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:01 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:01.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:01 smithi154 ceph-mon[35041]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-10T21:10:01.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:01 smithi154 ceph-mon[35041]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T21:10:01.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:01 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:10:01.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:01 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:10:01.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:01 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:10:01.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:01 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:10:01.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:01 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:02.794 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:02 smithi059 ceph-mon[30888]: purged_snaps scrub starts 2024-09-10T21:10:02.794 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:02 smithi059 ceph-mon[30888]: purged_snaps scrub ok 2024-09-10T21:10:02.794 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:02 smithi059 ceph-mon[30888]: from='client.14484 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:10:02.794 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:02 smithi059 ceph-mon[30888]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:10:02.795 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:02 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:10:02.795 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:02 smithi059 ceph-mon[30888]: osd.5 [v2:172.21.15.192:6808/1221386274,v1:172.21.15.192:6809/1221386274] boot 2024-09-10T21:10:02.795 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:02 smithi059 ceph-mon[30888]: osdmap e35: 6 total, 6 up, 6 in 2024-09-10T21:10:02.795 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:02 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:10:02.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:02 smithi192 ceph-mon[35363]: purged_snaps scrub starts 2024-09-10T21:10:02.848 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:02 smithi192 ceph-mon[35363]: purged_snaps scrub ok 2024-09-10T21:10:02.849 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:02 smithi192 ceph-mon[35363]: from='client.14484 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:10:02.849 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:02 smithi192 ceph-mon[35363]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:10:02.849 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:02 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:10:02.849 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:02 smithi192 ceph-mon[35363]: osd.5 [v2:172.21.15.192:6808/1221386274,v1:172.21.15.192:6809/1221386274] boot 2024-09-10T21:10:02.849 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:02 smithi192 ceph-mon[35363]: osdmap e35: 6 total, 6 up, 6 in 2024-09-10T21:10:02.849 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:02 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:10:02.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:02 smithi154 ceph-mon[35041]: purged_snaps scrub starts 2024-09-10T21:10:02.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:02 smithi154 ceph-mon[35041]: purged_snaps scrub ok 2024-09-10T21:10:02.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:02 smithi154 ceph-mon[35041]: from='client.14484 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:10:02.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:02 smithi154 ceph-mon[35041]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-10T21:10:02.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:02 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:10:02.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:02 smithi154 ceph-mon[35041]: osd.5 [v2:172.21.15.192:6808/1221386274,v1:172.21.15.192:6809/1221386274] boot 2024-09-10T21:10:02.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:02 smithi154 ceph-mon[35041]: osdmap e35: 6 total, 6 up, 6 in 2024-09-10T21:10:02.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:02 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T21:10:03.793 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:03 smithi059 ceph-mon[30888]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T21:10:03.793 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:03 smithi059 ceph-mon[30888]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T21:10:03.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:03 smithi192 ceph-mon[35363]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T21:10:03.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:03 smithi192 ceph-mon[35363]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T21:10:03.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:03 smithi154 ceph-mon[35041]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T21:10:03.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:03 smithi154 ceph-mon[35041]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T21:10:04.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:04 smithi192 ceph-mon[35363]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:04.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:04 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/4152287869' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "609c11f7-ce82-4714-bf73-a4f16f4483ad"} : dispatch 2024-09-10T21:10:04.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:04 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/4152287869' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "609c11f7-ce82-4714-bf73-a4f16f4483ad"}]': finished 2024-09-10T21:10:04.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:04 smithi192 ceph-mon[35363]: osdmap e38: 7 total, 6 up, 7 in 2024-09-10T21:10:04.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:10:04.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:04 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/881149234' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:10:04.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:04 smithi059 ceph-mon[30888]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:04.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:04 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/4152287869' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "609c11f7-ce82-4714-bf73-a4f16f4483ad"} : dispatch 2024-09-10T21:10:04.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:04 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/4152287869' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "609c11f7-ce82-4714-bf73-a4f16f4483ad"}]': finished 2024-09-10T21:10:04.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:04 smithi059 ceph-mon[30888]: osdmap e38: 7 total, 6 up, 7 in 2024-09-10T21:10:04.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:10:04.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:04 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/881149234' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:10:04.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:04 smithi154 ceph-mon[35041]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:04.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:04 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/4152287869' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "609c11f7-ce82-4714-bf73-a4f16f4483ad"} : dispatch 2024-09-10T21:10:04.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:04 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/4152287869' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "609c11f7-ce82-4714-bf73-a4f16f4483ad"}]': finished 2024-09-10T21:10:04.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:04 smithi154 ceph-mon[35041]: osdmap e38: 7 total, 6 up, 7 in 2024-09-10T21:10:04.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:10:04.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:04 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/881149234' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:10:06.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:06 smithi059 ceph-mon[30888]: pgmap v148: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:06.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:06 smithi154 ceph-mon[35041]: pgmap v148: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:07.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:06 smithi192 ceph-mon[35363]: pgmap v148: 1 pgs: 1 remapped+peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:08.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:08 smithi059 ceph-mon[30888]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-09-10T21:10:08.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:08 smithi154 ceph-mon[35041]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-09-10T21:10:09.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:08 smithi192 ceph-mon[35363]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-09-10T21:10:10.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:10 smithi059 ceph-mon[30888]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-10T21:10:10.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:10 smithi154 ceph-mon[35041]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-10T21:10:11.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:10 smithi192 ceph-mon[35363]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-10T21:10:12.886 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:12 smithi059 ceph-mon[30888]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T21:10:12.886 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:12 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T21:10:12.886 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:12 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:12.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:12 smithi154 ceph-mon[35041]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T21:10:12.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:12 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T21:10:12.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:12 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:13.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:12 smithi192 ceph-mon[35363]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T21:10:13.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:12 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T21:10:13.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:12 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:13.897 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:13 smithi059 ceph-mon[30888]: Deploying daemon osd.6 on smithi059 2024-09-10T21:10:13.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:13 smithi154 ceph-mon[35041]: Deploying daemon osd.6 on smithi059 2024-09-10T21:10:14.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:13 smithi192 ceph-mon[35363]: Deploying daemon osd.6 on smithi059 2024-09-10T21:10:14.778 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:14 smithi059 ceph-mon[30888]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-10T21:10:14.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:14 smithi154 ceph-mon[35041]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-10T21:10:15.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:14 smithi192 ceph-mon[35363]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-10T21:10:16.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:16 smithi059 ceph-mon[30888]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-10T21:10:16.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:16 smithi154 ceph-mon[35041]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-10T21:10:17.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:16 smithi192 ceph-mon[35363]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-10T21:10:18.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:18 smithi059 ceph-mon[30888]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:10:18.708 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:18 smithi154 ceph-mon[35041]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:10:18.880 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:18 smithi192 ceph-mon[35363]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:10:19.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:19 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:10:19.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:19 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:19.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:19 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:19.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:19 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:10:19.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:19 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:19.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:19 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:20.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:19 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:10:20.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:19 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:20.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:19 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:20.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:20 smithi059 ceph-mon[30888]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:20.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:20 smithi154 ceph-mon[35041]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:21.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:20 smithi192 ceph-mon[35363]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:22.458 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 6 on host 'smithi059' 2024-09-10T21:10:22.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:22.454+0000 7ff19e7fc640 1 -- 172.21.15.59:0/2048441229 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff1a0063590 con 0x7ff1880b5360 2024-09-10T21:10:22.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:22.456+0000 7ff1a7828640 1 -- 172.21.15.59:0/2048441229 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff1880b5360 msgr2=0x7ff1880b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:10:22.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:22.456+0000 7ff1a7828640 1 --2- 172.21.15.59:0/2048441229 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff1880b5360 0x7ff1880b7820 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff194009930 tx=0x7ff194008040 comp rx=0 tx=0).stop 2024-09-10T21:10:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:22.456+0000 7ff1a7828640 1 -- 172.21.15.59:0/2048441229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a006b640 msgr2=0x7ff1a0198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:10:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:22.456+0000 7ff1a7828640 1 --2- 172.21.15.59:0/2048441229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a006b640 0x7ff1a0198f00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff19800b4a0 tx=0x7ff19800b960 comp rx=0 tx=0).stop 2024-09-10T21:10:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:22.456+0000 7ff1a7828640 1 -- 172.21.15.59:0/2048441229 shutdown_connections 2024-09-10T21:10:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:22.456+0000 7ff1a7828640 1 --2- 172.21.15.59:0/2048441229 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff1880b5360 0x7ff1880b7820 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:22.456+0000 7ff1a7828640 1 --2- 172.21.15.59:0/2048441229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff1a0108720 0x7ff1a019a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:22.456+0000 7ff1a7828640 1 --2- 172.21.15.59:0/2048441229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1a0105bd0 0x7ff1a0199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:22.456+0000 7ff1a7828640 1 --2- 172.21.15.59:0/2048441229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a006b640 0x7ff1a0198f00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:22.456+0000 7ff1a7828640 1 -- 172.21.15.59:0/2048441229 >> 172.21.15.59:0/2048441229 conn(0x7ff1a00fd1e0 msgr2=0x7ff1a0103f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:10:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:22.457+0000 7ff1a7828640 1 -- 172.21.15.59:0/2048441229 shutdown_connections 2024-09-10T21:10:22.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:10:22.457+0000 7ff1a7828640 1 -- 172.21.15.59:0/2048441229 wait complete. 2024-09-10T21:10:22.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:22 smithi059 ceph-mon[30888]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:22.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:22 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:22.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:22 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:22.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:22 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:22.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:22 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:10:22.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:22 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:22.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:22 smithi154 ceph-mon[35041]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:22.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:22 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:22.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:22 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:22.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:22 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:22.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:22 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:10:22.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:22 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:22.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:22 smithi192 ceph-mon[35363]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:22.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:22 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:22.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:22 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:22.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:22 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:22.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:22 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:10:22.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:22 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:23.065 DEBUG:teuthology.orchestra.run.smithi059:osd.6> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.6.service 2024-09-10T21:10:23.068 INFO:tasks.cephadm:Deploying osd.7 on smithi154 with /dev/vg_nvme/lv_2... 2024-09-10T21:10:23.068 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T21:10:23.325 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:10:23.565 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:23 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:10:23.566 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:23 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:23.566 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:23 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:23.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:23 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:10:23.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:23 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:23.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:23 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:23.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:23 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:10:23.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:23 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:23.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:23 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:24.621 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:24 smithi059 ceph-mon[30888]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:24.768 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:24 smithi154 ceph-mon[35041]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:24.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:24 smithi192 ceph-mon[35363]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:24.911 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:10:24 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:10:24.722+0000 7f6d93aeb640 -1 osd.6 0 log_to_monitors true 2024-09-10T21:10:25.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:25 smithi059 ceph-mon[30888]: from='osd.6 [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T21:10:25.800 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:25 smithi154 ceph-mon[35041]: from='osd.6 [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T21:10:25.803 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T21:10:25.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:25 smithi192 ceph-mon[35363]: from='osd.6 [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T21:10:25.829 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_2 2024-09-10T21:10:26.075 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:10:26.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.510+0000 7f51ffff2640 1 -- 172.21.15.154:0/495975903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f8102a70 msgr2=0x7f51f8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:10:26.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.510+0000 7f51ffff2640 1 --2- 172.21.15.154:0/495975903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f8102a70 0x7f51f8102ef0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009930 tx=0x7f51ec02a420 comp rx=0 tx=0).stop 2024-09-10T21:10:26.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.510+0000 7f51ffff2640 1 -- 172.21.15.154:0/495975903 shutdown_connections 2024-09-10T21:10:26.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.510+0000 7f51ffff2640 1 --2- 172.21.15.154:0/495975903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51f8103430 0x7f51f8109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:26.516 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.510+0000 7f51ffff2640 1 --2- 172.21.15.154:0/495975903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f8102a70 0x7f51f8102ef0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.510+0000 7f51ffff2640 1 --2- 172.21.15.154:0/495975903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f8101910 0x7f51f8101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.510+0000 7f51ffff2640 1 -- 172.21.15.154:0/495975903 >> 172.21.15.154:0/495975903 conn(0x7f51f80fd1e0 msgr2=0x7f51f80ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:10:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.510+0000 7f51ffff2640 1 -- 172.21.15.154:0/495975903 shutdown_connections 2024-09-10T21:10:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.510+0000 7f51ffff2640 1 -- 172.21.15.154:0/495975903 wait complete. 2024-09-10T21:10:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.510+0000 7f51ffff2640 1 Processor -- start 2024-09-10T21:10:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.511+0000 7f51ffff2640 1 -- start start 2024-09-10T21:10:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.511+0000 7f51ffff2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f8101910 0x7f51f8198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:10:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.511+0000 7f51ffff2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51f8102a70 0x7f51f8199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:10:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.511+0000 7f51ffff2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f8103430 0x7f51f819a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:10:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.511+0000 7f51ffff2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f51f810d5f0 con 0x7f51f8103430 2024-09-10T21:10:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.511+0000 7f51ffff2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51f810d470 con 0x7f51f8101910 2024-09-10T21:10:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.511+0000 7f51ffff2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f51f810d770 con 0x7f51f8102a70 2024-09-10T21:10:26.517 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.511+0000 7f51fdd8e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f8101910 0x7f51f8198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:10:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.511+0000 7f51fdd8e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f8101910 0x7f51f8198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:43700/0 (socket says 172.21.15.154:43700) 2024-09-10T21:10:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.511+0000 7f51fdd8e640 1 -- 172.21.15.154:0/1147600993 learned_addr learned my addr 172.21.15.154:0/1147600993 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T21:10:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.511+0000 7f51fe58f640 1 --2- 172.21.15.154:0/1147600993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f8103430 0x7f51f819a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:10:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.511+0000 7f51fd58d640 1 --2- 172.21.15.154:0/1147600993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51f8102a70 0x7f51f8199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:10:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.511+0000 7f51fdd8e640 1 -- 172.21.15.154:0/1147600993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51f8102a70 msgr2=0x7f51f8199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:10:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.511+0000 7f51fdd8e640 1 --2- 172.21.15.154:0/1147600993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51f8102a70 0x7f51f8199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.511+0000 7f51fdd8e640 1 -- 172.21.15.154:0/1147600993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f8103430 msgr2=0x7f51f819a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:10:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.511+0000 7f51fdd8e640 1 --2- 172.21.15.154:0/1147600993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f8103430 0x7f51f819a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.511+0000 7f51fdd8e640 1 -- 172.21.15.154:0/1147600993 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f819a960 con 0x7f51f8101910 2024-09-10T21:10:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.511+0000 7f51fdd8e640 1 --2- 172.21.15.154:0/1147600993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f8101910 0x7f51f8198e30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f51f000d950 tx=0x7f51f000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:10:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.512+0000 7f51f6ffd640 1 -- 172.21.15.154:0/1147600993 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f0017070 con 0x7f51f8101910 2024-09-10T21:10:26.518 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.512+0000 7f51ffff2640 1 -- 172.21.15.154:0/1147600993 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f819ac50 con 0x7f51f8101910 2024-09-10T21:10:26.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.512+0000 7f51f6ffd640 1 -- 172.21.15.154:0/1147600993 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51f0009c30 con 0x7f51f8101910 2024-09-10T21:10:26.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.512+0000 7f51f6ffd640 1 -- 172.21.15.154:0/1147600993 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f000f620 con 0x7f51f8101910 2024-09-10T21:10:26.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.512+0000 7f51ffff2640 1 -- 172.21.15.154:0/1147600993 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f81a1330 con 0x7f51f8101910 2024-09-10T21:10:26.519 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.513+0000 7f51ffff2640 1 -- 172.21.15.154:0/1147600993 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51f81a1500 con 0x7f51f8101910 2024-09-10T21:10:26.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.515+0000 7f51f6ffd640 1 -- 172.21.15.154:0/1147600993 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f51f0010460 con 0x7f51f8101910 2024-09-10T21:10:26.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.515+0000 7f51f6ffd640 1 --2- 172.21.15.154:0/1147600993 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f51e00b52e0 0x7f51e00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:10:26.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.516+0000 7f51f6ffd640 1 -- 172.21.15.154:0/1147600993 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4685+0+0 (secure 0 0 0) 0x7f51f00e4930 con 0x7f51f8101910 2024-09-10T21:10:26.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.516+0000 7f51fd58d640 1 --2- 172.21.15.154:0/1147600993 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f51e00b52e0 0x7f51e00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:10:26.520 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.516+0000 7f51fd58d640 1 --2- 172.21.15.154:0/1147600993 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f51e00b52e0 0x7f51e00b77a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009900 tx=0x7f51ec031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:10:26.522 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.518+0000 7f51f6ffd640 1 -- 172.21.15.154:0/1147600993 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f51f0009de0 con 0x7f51f8101910 2024-09-10T21:10:26.708 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:26.704+0000 7f51ffff2640 1 -- 172.21.15.154:0/1147600993 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f51f80ff340 con 0x7f51e00b52e0 2024-09-10T21:10:26.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:26 smithi192 ceph-mon[35363]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:26.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:26 smithi192 ceph-mon[35363]: from='osd.6 [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T21:10:26.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:26 smithi192 ceph-mon[35363]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T21:10:26.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:26 smithi192 ceph-mon[35363]: from='osd.6 [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-09-10T21:10:26.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:26 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:10:26.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:26 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:26.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:26 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:26.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:26 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:26.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:26 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:26.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:26 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:26.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:26 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:26.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:26 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:26.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:26 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:10:26.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:26 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:26.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:26 smithi059 ceph-mon[30888]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:26.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:26 smithi059 ceph-mon[30888]: from='osd.6 [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T21:10:26.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:26 smithi059 ceph-mon[30888]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T21:10:26.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:26 smithi059 ceph-mon[30888]: from='osd.6 [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-09-10T21:10:26.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:26 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:10:26.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:26 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:26.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:26 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:26.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:26 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:26.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:26 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:26.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:26 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:26.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:26 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:26.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:26 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:26.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:26 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:10:26.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:26 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:26.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:26 smithi154 ceph-mon[35041]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:26.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:26 smithi154 ceph-mon[35041]: from='osd.6 [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T21:10:26.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:26 smithi154 ceph-mon[35041]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T21:10:26.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:26 smithi154 ceph-mon[35041]: from='osd.6 [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-09-10T21:10:26.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:26 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:10:26.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:26 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:26.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:26 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:26.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:26 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:26.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:26 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:26.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:26 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:26.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:26 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:26.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:26 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:26.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:26 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:10:26.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:26 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:27.662 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:10:27 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:10:27.374+0000 7f6d8fa6e640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T21:10:27.662 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:10:27 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:10:27.434+0000 7f6d8788d640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:10:27.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:27 smithi059 ceph-mon[30888]: Detected new or changed devices on smithi059 2024-09-10T21:10:27.663 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:27 smithi059 ceph-mon[30888]: Adjusting osd_memory_target on smithi059 to 5697M 2024-09-10T21:10:27.663 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:27 smithi059 ceph-mon[30888]: from='osd.6 [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T21:10:27.663 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:27 smithi059 ceph-mon[30888]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T21:10:27.663 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:27 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:10:27.663 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:27 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:10:27.664 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:27 smithi059 ceph-mon[30888]: from='client.24368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:10:27.664 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:27 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:10:27.664 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:27 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:10:27.664 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:27 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:27.664 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:27 smithi059 ceph-mon[30888]: from='osd.6 [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566]' entity='osd.6' 2024-09-10T21:10:27.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:27 smithi154 ceph-mon[35041]: Detected new or changed devices on smithi059 2024-09-10T21:10:27.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:27 smithi154 ceph-mon[35041]: Adjusting osd_memory_target on smithi059 to 5697M 2024-09-10T21:10:27.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:27 smithi154 ceph-mon[35041]: from='osd.6 [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T21:10:27.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:27 smithi154 ceph-mon[35041]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T21:10:27.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:27 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:10:27.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:27 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:10:27.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:27 smithi154 ceph-mon[35041]: from='client.24368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:10:27.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:27 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:10:27.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:27 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:10:27.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:27 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:27.684 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:27 smithi154 ceph-mon[35041]: from='osd.6 [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566]' entity='osd.6' 2024-09-10T21:10:27.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:27 smithi192 ceph-mon[35363]: Detected new or changed devices on smithi059 2024-09-10T21:10:27.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:27 smithi192 ceph-mon[35363]: Adjusting osd_memory_target on smithi059 to 5697M 2024-09-10T21:10:27.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:27 smithi192 ceph-mon[35363]: from='osd.6 [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T21:10:27.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:27 smithi192 ceph-mon[35363]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T21:10:27.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:27 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:10:27.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:27 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:10:27.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:27 smithi192 ceph-mon[35363]: from='client.24368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:10:27.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:27 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:10:27.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:27 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:10:27.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:27 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:27.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:27 smithi192 ceph-mon[35363]: from='osd.6 [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566]' entity='osd.6' 2024-09-10T21:10:28.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:28 smithi192 ceph-mon[35363]: purged_snaps scrub starts 2024-09-10T21:10:28.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:28 smithi192 ceph-mon[35363]: purged_snaps scrub ok 2024-09-10T21:10:28.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:28 smithi192 ceph-mon[35363]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:28.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:28 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:10:28.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:28 smithi192 ceph-mon[35363]: osd.6 [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566] boot 2024-09-10T21:10:28.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:28 smithi192 ceph-mon[35363]: osdmap e41: 7 total, 7 up, 7 in 2024-09-10T21:10:28.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:28 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:10:28.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:28 smithi059 ceph-mon[30888]: purged_snaps scrub starts 2024-09-10T21:10:28.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:28 smithi059 ceph-mon[30888]: purged_snaps scrub ok 2024-09-10T21:10:28.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:28 smithi059 ceph-mon[30888]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:28.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:28 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:10:28.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:28 smithi059 ceph-mon[30888]: osd.6 [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566] boot 2024-09-10T21:10:28.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:28 smithi059 ceph-mon[30888]: osdmap e41: 7 total, 7 up, 7 in 2024-09-10T21:10:28.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:28 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:10:28.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:28 smithi154 ceph-mon[35041]: purged_snaps scrub starts 2024-09-10T21:10:28.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:28 smithi154 ceph-mon[35041]: purged_snaps scrub ok 2024-09-10T21:10:28.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:28 smithi154 ceph-mon[35041]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-10T21:10:28.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:28 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:10:28.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:28 smithi154 ceph-mon[35041]: osd.6 [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566] boot 2024-09-10T21:10:28.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:28 smithi154 ceph-mon[35041]: osdmap e41: 7 total, 7 up, 7 in 2024-09-10T21:10:28.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:28 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T21:10:29.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:29 smithi192 ceph-mon[35363]: from='client.? 172.21.15.154:0/745232433' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bff3a29f-47cc-4e66-92e4-14e9b7faf498"} : dispatch 2024-09-10T21:10:29.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:29 smithi192 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bff3a29f-47cc-4e66-92e4-14e9b7faf498"} : dispatch 2024-09-10T21:10:29.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:29 smithi192 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bff3a29f-47cc-4e66-92e4-14e9b7faf498"}]': finished 2024-09-10T21:10:29.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:29 smithi192 ceph-mon[35363]: osdmap e42: 8 total, 7 up, 8 in 2024-09-10T21:10:29.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:29 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:10:29.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:29 smithi059 ceph-mon[30888]: from='client.? 172.21.15.154:0/745232433' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bff3a29f-47cc-4e66-92e4-14e9b7faf498"} : dispatch 2024-09-10T21:10:29.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:29 smithi059 ceph-mon[30888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bff3a29f-47cc-4e66-92e4-14e9b7faf498"} : dispatch 2024-09-10T21:10:29.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:29 smithi059 ceph-mon[30888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bff3a29f-47cc-4e66-92e4-14e9b7faf498"}]': finished 2024-09-10T21:10:29.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:29 smithi059 ceph-mon[30888]: osdmap e42: 8 total, 7 up, 8 in 2024-09-10T21:10:29.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:10:29.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:29 smithi154 ceph-mon[35041]: from='client.? 172.21.15.154:0/745232433' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bff3a29f-47cc-4e66-92e4-14e9b7faf498"} : dispatch 2024-09-10T21:10:29.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:29 smithi154 ceph-mon[35041]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bff3a29f-47cc-4e66-92e4-14e9b7faf498"} : dispatch 2024-09-10T21:10:29.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:29 smithi154 ceph-mon[35041]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bff3a29f-47cc-4e66-92e4-14e9b7faf498"}]': finished 2024-09-10T21:10:29.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:29 smithi154 ceph-mon[35041]: osdmap e42: 8 total, 7 up, 8 in 2024-09-10T21:10:29.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:29 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:10:30.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:30 smithi192 ceph-mon[35363]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:30.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:30 smithi192 ceph-mon[35363]: from='client.? 172.21.15.154:0/3202015754' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:10:30.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:30 smithi059 ceph-mon[30888]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:30.913 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:30 smithi059 ceph-mon[30888]: from='client.? 172.21.15.154:0/3202015754' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:10:30.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:30 smithi154 ceph-mon[35041]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:30.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:30 smithi154 ceph-mon[35041]: from='client.? 172.21.15.154:0/3202015754' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:10:32.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:32 smithi192 ceph-mon[35363]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:32.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:32 smithi059 ceph-mon[30888]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:32.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:32 smithi154 ceph-mon[35041]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:34.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:34 smithi154 ceph-mon[35041]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:34.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:34 smithi192 ceph-mon[35363]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:34.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:34 smithi059 ceph-mon[30888]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:36.749 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:36 smithi154 ceph-mon[35041]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:36.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:36 smithi192 ceph-mon[35363]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:36.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:36 smithi059 ceph-mon[30888]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:38.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:38 smithi154 ceph-mon[35041]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:38.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:38 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T21:10:38.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:38 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:38.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:38 smithi154 ceph-mon[35041]: Deploying daemon osd.7 on smithi154 2024-09-10T21:10:38.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:38 smithi192 ceph-mon[35363]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:38.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:38 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T21:10:38.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:38 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:38.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:38 smithi192 ceph-mon[35363]: Deploying daemon osd.7 on smithi154 2024-09-10T21:10:38.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:38 smithi059 ceph-mon[30888]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:38.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:38 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T21:10:38.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:38 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:38.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:38 smithi059 ceph-mon[30888]: Deploying daemon osd.7 on smithi154 2024-09-10T21:10:40.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:40 smithi154 ceph-mon[35041]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:40.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:40 smithi192 ceph-mon[35363]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:40.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:40 smithi059 ceph-mon[30888]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:42.678 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:42 smithi154 ceph-mon[35041]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:42.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:42 smithi192 ceph-mon[35363]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:42.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:42 smithi059 ceph-mon[30888]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:43.800 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:43 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:10:43.800 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:43 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:43.800 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:43 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:43.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:43 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:10:43.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:43 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:43.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:43 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:43.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:43 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:10:43.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:43 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:43.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:43 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:44.612 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:44 smithi154 ceph-mon[35041]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:44.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:44 smithi192 ceph-mon[35363]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:44.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:44 smithi059 ceph-mon[30888]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:46.714 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 7 on host 'smithi154' 2024-09-10T21:10:46.715 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:46.710+0000 7f51f6ffd640 1 -- 172.21.15.154:0/1147600993 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f51f80ff340 con 0x7f51e00b52e0 2024-09-10T21:10:46.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:46.712+0000 7f51ffff2640 1 -- 172.21.15.154:0/1147600993 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f51e00b52e0 msgr2=0x7f51e00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:10:46.716 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:46.712+0000 7f51ffff2640 1 --2- 172.21.15.154:0/1147600993 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f51e00b52e0 0x7f51e00b77a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009900 tx=0x7f51ec031430 comp rx=0 tx=0).stop 2024-09-10T21:10:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:46.712+0000 7f51ffff2640 1 -- 172.21.15.154:0/1147600993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f8101910 msgr2=0x7f51f8198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:10:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:46.712+0000 7f51ffff2640 1 --2- 172.21.15.154:0/1147600993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f8101910 0x7f51f8198e30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f51f000d950 tx=0x7f51f000de10 comp rx=0 tx=0).stop 2024-09-10T21:10:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:46.712+0000 7f51ffff2640 1 -- 172.21.15.154:0/1147600993 shutdown_connections 2024-09-10T21:10:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:46.712+0000 7f51ffff2640 1 --2- 172.21.15.154:0/1147600993 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f51e00b52e0 0x7f51e00b77a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:46.712+0000 7f51ffff2640 1 --2- 172.21.15.154:0/1147600993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f8103430 0x7f51f819a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:46.712+0000 7f51ffff2640 1 --2- 172.21.15.154:0/1147600993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51f8102a70 0x7f51f8199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:46.712+0000 7f51ffff2640 1 --2- 172.21.15.154:0/1147600993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51f8101910 0x7f51f8198e30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:46.712+0000 7f51ffff2640 1 -- 172.21.15.154:0/1147600993 >> 172.21.15.154:0/1147600993 conn(0x7f51f80fd1e0 msgr2=0x7f51f80fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:10:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:46.712+0000 7f51ffff2640 1 -- 172.21.15.154:0/1147600993 shutdown_connections 2024-09-10T21:10:46.717 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:10:46.712+0000 7f51ffff2640 1 -- 172.21.15.154:0/1147600993 wait complete. 2024-09-10T21:10:47.034 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:46 smithi154 ceph-mon[35041]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:47.034 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:46 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:47.034 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:46 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:47.034 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:46 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:47.034 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:46 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:10:47.035 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:46 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:47.035 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:46 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:10:47.035 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:46 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:47.035 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:46 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:47.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:46 smithi192 ceph-mon[35363]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:47.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:47.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:47.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:47.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:10:47.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:47.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:10:47.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:47.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:47.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:46 smithi059 ceph-mon[30888]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:47.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:47.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:47.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:47.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:10:47.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:47.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:10:47.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:47.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:47.380 DEBUG:teuthology.orchestra.run.smithi154:osd.7> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.7.service 2024-09-10T21:10:47.383 INFO:tasks.cephadm:Deploying osd.8 on smithi192 with /dev/vg_nvme/lv_2... 2024-09-10T21:10:47.383 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T21:10:47.641 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:10:48.866 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:48 smithi192 ceph-mon[35363]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:49.087 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:48 smithi059 ceph-mon[30888]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:49.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:48 smithi154 ceph-mon[35041]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:49.183 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:10:48 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:10:48.823+0000 7f4f828ea640 -1 osd.7 0 log_to_monitors true 2024-09-10T21:10:49.924 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:49 smithi154 ceph-mon[35041]: from='osd.7 [v2:172.21.15.154:6816/175260385,v1:172.21.15.154:6817/175260385]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T21:10:49.924 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:49 smithi154 ceph-mon[35041]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T21:10:50.008 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:10:50.035 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_2 2024-09-10T21:10:50.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:49 smithi192 ceph-mon[35363]: from='osd.7 [v2:172.21.15.154:6816/175260385,v1:172.21.15.154:6817/175260385]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T21:10:50.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:49 smithi192 ceph-mon[35363]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T21:10:50.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:49 smithi059 ceph-mon[30888]: from='osd.7 [v2:172.21.15.154:6816/175260385,v1:172.21.15.154:6817/175260385]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T21:10:50.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:49 smithi059 ceph-mon[30888]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T21:10:50.286 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:10:50.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.737+0000 7fcdcebd3640 1 -- 172.21.15.192:0/1723798197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdc8101950 msgr2=0x7fcdc8101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:10:50.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.737+0000 7fcdcebd3640 1 --2- 172.21.15.192:0/1723798197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdc8101950 0x7fcdc8101d50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc009d00 tx=0x7fcdbc02a910 comp rx=0 tx=0).stop 2024-09-10T21:10:50.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.737+0000 7fcdcebd3640 1 -- 172.21.15.192:0/1723798197 shutdown_connections 2024-09-10T21:10:50.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.737+0000 7fcdcebd3640 1 --2- 172.21.15.192:0/1723798197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdc8103470 0x7fcdc8109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:50.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.737+0000 7fcdcebd3640 1 --2- 172.21.15.192:0/1723798197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdc8102ab0 0x7fcdc8102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:50.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.737+0000 7fcdcebd3640 1 --2- 172.21.15.192:0/1723798197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdc8101950 0x7fcdc8101d50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:50.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.737+0000 7fcdcebd3640 1 -- 172.21.15.192:0/1723798197 >> 172.21.15.192:0/1723798197 conn(0x7fcdc80fd200 msgr2=0x7fcdc80ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:10:50.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.737+0000 7fcdcebd3640 1 -- 172.21.15.192:0/1723798197 shutdown_connections 2024-09-10T21:10:50.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.737+0000 7fcdcebd3640 1 -- 172.21.15.192:0/1723798197 wait complete. 2024-09-10T21:10:50.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.737+0000 7fcdcebd3640 1 Processor -- start 2024-09-10T21:10:50.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.737+0000 7fcdcebd3640 1 -- start start 2024-09-10T21:10:50.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.738+0000 7fcdcebd3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdc8101950 0x7fcdc8198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:10:50.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.738+0000 7fcdcebd3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdc8102ab0 0x7fcdc8199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:10:50.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.738+0000 7fcdcebd3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdc8103470 0x7fcdc819a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:10:50.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.738+0000 7fcdcebd3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc810d650 con 0x7fcdc8101950 2024-09-10T21:10:50.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.738+0000 7fcdcebd3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc810d4d0 con 0x7fcdc8102ab0 2024-09-10T21:10:50.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.738+0000 7fcdcebd3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc810d7d0 con 0x7fcdc8103470 2024-09-10T21:10:50.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.738+0000 7fcdcd170640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdc8103470 0x7fcdc819a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:10:50.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.738+0000 7fcdc7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdc8102ab0 0x7fcdc8199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:10:50.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.738+0000 7fcdcd170640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdc8103470 0x7fcdc819a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37910/0 (socket says 172.21.15.192:37910) 2024-09-10T21:10:50.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.738+0000 7fcdcd170640 1 -- 172.21.15.192:0/1164789957 learned_addr learned my addr 172.21.15.192:0/1164789957 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T21:10:50.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.738+0000 7fcdcc96f640 1 --2- 172.21.15.192:0/1164789957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdc8101950 0x7fcdc8198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:10:50.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.738+0000 7fcdcd170640 1 -- 172.21.15.192:0/1164789957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdc8102ab0 msgr2=0x7fcdc8199540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:10:50.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.738+0000 7fcdcd170640 1 --2- 172.21.15.192:0/1164789957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdc8102ab0 0x7fcdc8199540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:50.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.738+0000 7fcdcd170640 1 -- 172.21.15.192:0/1164789957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdc8101950 msgr2=0x7fcdc8198ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:10:50.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.738+0000 7fcdcd170640 1 --2- 172.21.15.192:0/1164789957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdc8101950 0x7fcdc8198ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:10:50.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.738+0000 7fcdcd170640 1 -- 172.21.15.192:0/1164789957 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc819aa20 con 0x7fcdc8103470 2024-09-10T21:10:50.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.738+0000 7fcdcd170640 1 --2- 172.21.15.192:0/1164789957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdc8103470 0x7fcdc819a180 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009fd0 tx=0x7fcdc000b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:10:50.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.738+0000 7fcdc5ffb640 1 -- 172.21.15.192:0/1164789957 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0011830 con 0x7fcdc8103470 2024-09-10T21:10:50.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.739+0000 7fcdcebd3640 1 -- 172.21.15.192:0/1164789957 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdc819ad10 con 0x7fcdc8103470 2024-09-10T21:10:50.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.739+0000 7fcdc5ffb640 1 -- 172.21.15.192:0/1164789957 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdc0016070 con 0x7fcdc8103470 2024-09-10T21:10:50.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.739+0000 7fcdc5ffb640 1 -- 172.21.15.192:0/1164789957 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0010de0 con 0x7fcdc8103470 2024-09-10T21:10:50.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.739+0000 7fcdcebd3640 1 -- 172.21.15.192:0/1164789957 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdc81a13f0 con 0x7fcdc8103470 2024-09-10T21:10:50.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.740+0000 7fcdcebd3640 1 -- 172.21.15.192:0/1164789957 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdc8101d50 con 0x7fcdc8103470 2024-09-10T21:10:50.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.741+0000 7fcdc5ffb640 1 -- 172.21.15.192:0/1164789957 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fcdc00119d0 con 0x7fcdc8103470 2024-09-10T21:10:50.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.742+0000 7fcdc5ffb640 1 --2- 172.21.15.192:0/1164789957 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcdb80b52e0 0x7fcdb80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:10:50.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.742+0000 7fcdc5ffb640 1 -- 172.21.15.192:0/1164789957 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5101+0+0 (secure 0 0 0) 0x7fcdc00e4510 con 0x7fcdc8103470 2024-09-10T21:10:50.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.742+0000 7fcdcc96f640 1 --2- 172.21.15.192:0/1164789957 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcdb80b52e0 0x7fcdb80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:10:50.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.742+0000 7fcdcc96f640 1 --2- 172.21.15.192:0/1164789957 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcdb80b52e0 0x7fcdb80b77a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc005fe0 tx=0x7fcdbc000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:10:50.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.746+0000 7fcdc5ffb640 1 -- 172.21.15.192:0/1164789957 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcdc00ac060 con 0x7fcdc8103470 2024-09-10T21:10:50.932 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:10:50 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:10:50.833+0000 7f4f7e86d640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T21:10:50.933 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:10:50 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:10:50.845+0000 7f4f7a694640 -1 osd.7 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:10:50.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:50 smithi154 ceph-mon[35041]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:50.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:50 smithi154 ceph-mon[35041]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T21:10:50.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:50 smithi154 ceph-mon[35041]: osdmap e43: 8 total, 7 up, 8 in 2024-09-10T21:10:50.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:10:50.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:50 smithi154 ceph-mon[35041]: from='osd.7 [v2:172.21.15.154:6816/175260385,v1:172.21.15.154:6817/175260385]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:10:50.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:50 smithi154 ceph-mon[35041]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:10:50.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:50 smithi154 ceph-mon[35041]: Detected new or changed devices on smithi154 2024-09-10T21:10:50.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:50.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:50.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:50.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:50.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:50.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:50 smithi154 ceph-mon[35041]: Adjusting osd_memory_target on smithi154 to 5696M 2024-09-10T21:10:50.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:50.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:50.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:10:50.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:50.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:10:50.933+0000 7fcdcebd3640 1 -- 172.21.15.192:0/1164789957 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fcdc80ff3c0 con 0x7fcdb80b52e0 2024-09-10T21:10:50.937 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:50 smithi192 ceph-mon[35363]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:50.937 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:50 smithi192 ceph-mon[35363]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T21:10:50.937 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:50 smithi192 ceph-mon[35363]: osdmap e43: 8 total, 7 up, 8 in 2024-09-10T21:10:50.937 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:10:50.937 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:50 smithi192 ceph-mon[35363]: from='osd.7 [v2:172.21.15.154:6816/175260385,v1:172.21.15.154:6817/175260385]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:10:50.937 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:50 smithi192 ceph-mon[35363]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:10:50.937 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:50 smithi192 ceph-mon[35363]: Detected new or changed devices on smithi154 2024-09-10T21:10:50.937 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:50.937 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:50.937 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:50.937 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:50.938 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:50.938 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:50 smithi192 ceph-mon[35363]: Adjusting osd_memory_target on smithi154 to 5696M 2024-09-10T21:10:50.938 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:50.938 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:50.938 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:10:50.938 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:51.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:50 smithi059 ceph-mon[30888]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:51.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:50 smithi059 ceph-mon[30888]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T21:10:51.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:50 smithi059 ceph-mon[30888]: osdmap e43: 8 total, 7 up, 8 in 2024-09-10T21:10:51.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:10:51.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:50 smithi059 ceph-mon[30888]: from='osd.7 [v2:172.21.15.154:6816/175260385,v1:172.21.15.154:6817/175260385]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:10:51.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:50 smithi059 ceph-mon[30888]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:10:51.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:50 smithi059 ceph-mon[30888]: Detected new or changed devices on smithi154 2024-09-10T21:10:51.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:51.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:51.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:51.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:51.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T21:10:51.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:50 smithi059 ceph-mon[30888]: Adjusting osd_memory_target on smithi154 to 5696M 2024-09-10T21:10:51.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:51.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:51.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:10:51.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:10:51.952 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:51 smithi192 ceph-mon[35363]: purged_snaps scrub starts 2024-09-10T21:10:51.953 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:51 smithi192 ceph-mon[35363]: purged_snaps scrub ok 2024-09-10T21:10:51.953 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:51 smithi192 ceph-mon[35363]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T21:10:51.953 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:51 smithi192 ceph-mon[35363]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T21:10:51.953 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:51 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:10:51.953 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:51 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:10:51.953 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:51 smithi192 ceph-mon[35363]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:10:51.953 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:51 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:10:51.953 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:51 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:10:51.953 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:51 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:52.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:51 smithi059 ceph-mon[30888]: purged_snaps scrub starts 2024-09-10T21:10:52.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:51 smithi059 ceph-mon[30888]: purged_snaps scrub ok 2024-09-10T21:10:52.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:51 smithi059 ceph-mon[30888]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T21:10:52.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:51 smithi059 ceph-mon[30888]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T21:10:52.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:51 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:10:52.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:51 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:10:52.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:51 smithi059 ceph-mon[30888]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:10:52.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:51 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:10:52.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:51 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:10:52.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:51 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:52.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:51 smithi154 ceph-mon[35041]: purged_snaps scrub starts 2024-09-10T21:10:52.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:51 smithi154 ceph-mon[35041]: purged_snaps scrub ok 2024-09-10T21:10:52.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:51 smithi154 ceph-mon[35041]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T21:10:52.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:51 smithi154 ceph-mon[35041]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T21:10:52.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:51 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:10:52.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:51 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:10:52.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:51 smithi154 ceph-mon[35041]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:10:52.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:51 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:10:52.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:51 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:10:52.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:51 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:10:53.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:52 smithi059 ceph-mon[30888]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:53.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:52 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:10:53.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:52 smithi059 ceph-mon[30888]: osd.7 [v2:172.21.15.154:6816/175260385,v1:172.21.15.154:6817/175260385] boot 2024-09-10T21:10:53.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:52 smithi059 ceph-mon[30888]: osdmap e45: 8 total, 8 up, 8 in 2024-09-10T21:10:53.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:52 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:10:53.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:52 smithi154 ceph-mon[35041]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:53.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:52 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:10:53.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:52 smithi154 ceph-mon[35041]: osd.7 [v2:172.21.15.154:6816/175260385,v1:172.21.15.154:6817/175260385] boot 2024-09-10T21:10:53.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:52 smithi154 ceph-mon[35041]: osdmap e45: 8 total, 8 up, 8 in 2024-09-10T21:10:53.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:52 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:10:53.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:52 smithi192 ceph-mon[35363]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-09-10T21:10:53.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:52 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:10:53.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:52 smithi192 ceph-mon[35363]: osd.7 [v2:172.21.15.154:6816/175260385,v1:172.21.15.154:6817/175260385] boot 2024-09-10T21:10:53.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:52 smithi192 ceph-mon[35363]: osdmap e45: 8 total, 8 up, 8 in 2024-09-10T21:10:53.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:52 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T21:10:54.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:53 smithi192 ceph-mon[35363]: osdmap e46: 8 total, 8 up, 8 in 2024-09-10T21:10:54.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:53 smithi192 ceph-mon[35363]: from='client.? 172.21.15.192:0/3701243666' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "56dabafd-9bb9-409a-88cd-4b5b5ecf810a"} : dispatch 2024-09-10T21:10:54.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:53 smithi192 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "56dabafd-9bb9-409a-88cd-4b5b5ecf810a"} : dispatch 2024-09-10T21:10:54.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:53 smithi192 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56dabafd-9bb9-409a-88cd-4b5b5ecf810a"}]': finished 2024-09-10T21:10:54.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:53 smithi192 ceph-mon[35363]: osdmap e47: 9 total, 8 up, 9 in 2024-09-10T21:10:54.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:53 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:10:54.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:53 smithi192 ceph-mon[35363]: from='client.? 172.21.15.192:0/3076749993' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:10:54.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:53 smithi059 ceph-mon[30888]: osdmap e46: 8 total, 8 up, 8 in 2024-09-10T21:10:54.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:53 smithi059 ceph-mon[30888]: from='client.? 172.21.15.192:0/3701243666' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "56dabafd-9bb9-409a-88cd-4b5b5ecf810a"} : dispatch 2024-09-10T21:10:54.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:53 smithi059 ceph-mon[30888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "56dabafd-9bb9-409a-88cd-4b5b5ecf810a"} : dispatch 2024-09-10T21:10:54.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:53 smithi059 ceph-mon[30888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56dabafd-9bb9-409a-88cd-4b5b5ecf810a"}]': finished 2024-09-10T21:10:54.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:53 smithi059 ceph-mon[30888]: osdmap e47: 9 total, 8 up, 9 in 2024-09-10T21:10:54.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:53 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:10:54.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:53 smithi059 ceph-mon[30888]: from='client.? 172.21.15.192:0/3076749993' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:10:54.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:53 smithi154 ceph-mon[35041]: osdmap e46: 8 total, 8 up, 8 in 2024-09-10T21:10:54.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:53 smithi154 ceph-mon[35041]: from='client.? 172.21.15.192:0/3701243666' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "56dabafd-9bb9-409a-88cd-4b5b5ecf810a"} : dispatch 2024-09-10T21:10:54.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:53 smithi154 ceph-mon[35041]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "56dabafd-9bb9-409a-88cd-4b5b5ecf810a"} : dispatch 2024-09-10T21:10:54.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:53 smithi154 ceph-mon[35041]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56dabafd-9bb9-409a-88cd-4b5b5ecf810a"}]': finished 2024-09-10T21:10:54.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:53 smithi154 ceph-mon[35041]: osdmap e47: 9 total, 8 up, 9 in 2024-09-10T21:10:54.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:53 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:10:54.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:53 smithi154 ceph-mon[35041]: from='client.? 172.21.15.192:0/3076749993' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:10:55.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:54 smithi059 ceph-mon[30888]: pgmap v181: 1 pgs: 1 remapped; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:10:55.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:54 smithi059 ceph-mon[30888]: osdmap e48: 9 total, 8 up, 9 in 2024-09-10T21:10:55.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:54 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:10:55.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:54 smithi154 ceph-mon[35041]: pgmap v181: 1 pgs: 1 remapped; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:10:55.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:54 smithi154 ceph-mon[35041]: osdmap e48: 9 total, 8 up, 9 in 2024-09-10T21:10:55.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:54 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:10:55.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:54 smithi192 ceph-mon[35363]: pgmap v181: 1 pgs: 1 remapped; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:10:55.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:54 smithi192 ceph-mon[35363]: osdmap e48: 9 total, 8 up, 9 in 2024-09-10T21:10:55.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:54 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:10:57.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:56 smithi059 ceph-mon[30888]: pgmap v183: 1 pgs: 1 remapped; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:10:57.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:56 smithi154 ceph-mon[35041]: pgmap v183: 1 pgs: 1 remapped; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:10:57.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:56 smithi192 ceph-mon[35363]: pgmap v183: 1 pgs: 1 remapped; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:10:59.125 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:10:58 smithi192 ceph-mon[35363]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:10:59.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:10:58 smithi059 ceph-mon[30888]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:10:59.230 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:10:58 smithi154 ceph-mon[35041]: pgmap v184: 1 pgs: 1 remapped; 577 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:11:01.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:00 smithi192 ceph-mon[35363]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 181 KiB/s, 0 objects/s recovering 2024-09-10T21:11:01.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:00 smithi059 ceph-mon[30888]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 181 KiB/s, 0 objects/s recovering 2024-09-10T21:11:01.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:00 smithi154 ceph-mon[35041]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 181 KiB/s, 0 objects/s recovering 2024-09-10T21:11:02.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:01 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T21:11:02.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:01 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:02.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:01 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T21:11:02.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:01 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:02.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:01 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T21:11:02.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:01 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:03.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:02 smithi059 ceph-mon[30888]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T21:11:03.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:02 smithi059 ceph-mon[30888]: Deploying daemon osd.8 on smithi192 2024-09-10T21:11:03.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:02 smithi154 ceph-mon[35041]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T21:11:03.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:02 smithi154 ceph-mon[35041]: Deploying daemon osd.8 on smithi192 2024-09-10T21:11:03.194 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:02 smithi192 ceph-mon[35363]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T21:11:03.194 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:02 smithi192 ceph-mon[35363]: Deploying daemon osd.8 on smithi192 2024-09-10T21:11:04.996 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:04 smithi192 ceph-mon[35363]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-10T21:11:05.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:04 smithi059 ceph-mon[30888]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-10T21:11:05.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:04 smithi154 ceph-mon[35041]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-09-10T21:11:07.143 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:06 smithi192 ceph-mon[35363]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-10T21:11:07.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:06 smithi059 ceph-mon[30888]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-10T21:11:07.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:06 smithi154 ceph-mon[35041]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-10T21:11:08.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:07 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:11:08.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:07 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:08.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:07 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:08.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:07 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:11:08.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:07 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:08.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:07 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:08.188 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:07 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:11:08.189 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:07 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:08.189 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:07 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:09.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:08 smithi059 ceph-mon[30888]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T21:11:09.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:08 smithi154 ceph-mon[35041]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T21:11:09.191 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:08 smithi192 ceph-mon[35363]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T21:11:10.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:11:10.938+0000 7fcdc5ffb640 1 -- 172.21.15.192:0/1164789957 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcdc80ff3c0 con 0x7fcdb80b52e0 2024-09-10T21:11:10.942 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 8 on host 'smithi192' 2024-09-10T21:11:10.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:11:10.940+0000 7fcdcebd3640 1 -- 172.21.15.192:0/1164789957 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcdb80b52e0 msgr2=0x7fcdb80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:11:10.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:11:10.940+0000 7fcdcebd3640 1 --2- 172.21.15.192:0/1164789957 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcdb80b52e0 0x7fcdb80b77a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc005fe0 tx=0x7fcdbc000f40 comp rx=0 tx=0).stop 2024-09-10T21:11:10.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:11:10.940+0000 7fcdcebd3640 1 -- 172.21.15.192:0/1164789957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdc8103470 msgr2=0x7fcdc819a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:11:10.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:11:10.940+0000 7fcdcebd3640 1 --2- 172.21.15.192:0/1164789957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdc8103470 0x7fcdc819a180 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009fd0 tx=0x7fcdc000b8e0 comp rx=0 tx=0).stop 2024-09-10T21:11:10.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:11:10.941+0000 7fcdcebd3640 1 -- 172.21.15.192:0/1164789957 shutdown_connections 2024-09-10T21:11:10.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:11:10.941+0000 7fcdcebd3640 1 --2- 172.21.15.192:0/1164789957 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcdb80b52e0 0x7fcdb80b77a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:11:10.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:11:10.941+0000 7fcdcebd3640 1 --2- 172.21.15.192:0/1164789957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdc8103470 0x7fcdc819a180 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:11:10.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:11:10.941+0000 7fcdcebd3640 1 --2- 172.21.15.192:0/1164789957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcdc8102ab0 0x7fcdc8199540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:11:10.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:11:10.941+0000 7fcdcebd3640 1 --2- 172.21.15.192:0/1164789957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdc8101950 0x7fcdc8198ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:11:10.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:11:10.941+0000 7fcdcebd3640 1 -- 172.21.15.192:0/1164789957 >> 172.21.15.192:0/1164789957 conn(0x7fcdc80fd200 msgr2=0x7fcdc80fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:11:10.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:11:10.941+0000 7fcdcebd3640 1 -- 172.21.15.192:0/1164789957 shutdown_connections 2024-09-10T21:11:10.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:11:10.941+0000 7fcdcebd3640 1 -- 172.21.15.192:0/1164789957 wait complete. 2024-09-10T21:11:10.946 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:10 smithi192 ceph-mon[35363]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T21:11:11.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:10 smithi059 ceph-mon[30888]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T21:11:11.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:10 smithi154 ceph-mon[35041]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T21:11:11.575 DEBUG:teuthology.orchestra.run.smithi192:osd.8> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.8.service 2024-09-10T21:11:11.618 INFO:tasks.cephadm:Deploying osd.9 on smithi059 with /dev/vg_nvme/lv_1... 2024-09-10T21:11:11.618 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T21:11:11.892 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:11:12.261 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:11 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:12.261 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:11 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:12.261 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:11 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:12.261 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:11 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:12.272 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:11 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:12.272 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:11 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:12.272 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:11 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:12.272 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:11 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:12.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:11 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:12.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:11 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:12.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:11 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:12.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:11 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:13.088 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:12 smithi192 ceph-mon[35363]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:11:13.294 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:12 smithi059 ceph-mon[30888]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:11:13.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:12 smithi154 ceph-mon[35041]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:11:13.828 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:11:13 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:11:13.532+0000 7f99e534c640 -1 osd.8 0 log_to_monitors true 2024-09-10T21:11:14.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:13 smithi059 ceph-mon[30888]: from='osd.8 [v2:172.21.15.192:6816/3138189462,v1:172.21.15.192:6817/3138189462]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T21:11:14.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:13 smithi059 ceph-mon[30888]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T21:11:14.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:13 smithi192 ceph-mon[35363]: from='osd.8 [v2:172.21.15.192:6816/3138189462,v1:172.21.15.192:6817/3138189462]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T21:11:14.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:13 smithi192 ceph-mon[35363]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T21:11:14.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:13 smithi154 ceph-mon[35041]: from='osd.8 [v2:172.21.15.192:6816/3138189462,v1:172.21.15.192:6817/3138189462]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T21:11:14.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:13 smithi154 ceph-mon[35041]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T21:11:14.810 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:11:14.837 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_1 2024-09-10T21:11:15.111 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:11:15.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:14 smithi059 ceph-mon[30888]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:11:15.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:14 smithi059 ceph-mon[30888]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T21:11:15.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:14 smithi059 ceph-mon[30888]: from='osd.8 [v2:172.21.15.192:6816/3138189462,v1:172.21.15.192:6817/3138189462]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:11:15.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:14 smithi059 ceph-mon[30888]: osdmap e49: 9 total, 8 up, 9 in 2024-09-10T21:11:15.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:14 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:11:15.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:14 smithi059 ceph-mon[30888]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:11:15.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:14 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:15.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:14 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:15.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:14 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:15.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:14 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:15.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:14 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:15.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:14 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:15.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:14 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:15.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:14 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:11:15.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:14 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:15.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:14 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:11:15.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:14 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:15.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:14 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:11:15.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:14 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:15.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:14 smithi192 ceph-mon[35363]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:11:15.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:14 smithi192 ceph-mon[35363]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T21:11:15.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:14 smithi192 ceph-mon[35363]: from='osd.8 [v2:172.21.15.192:6816/3138189462,v1:172.21.15.192:6817/3138189462]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:11:15.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:14 smithi192 ceph-mon[35363]: osdmap e49: 9 total, 8 up, 9 in 2024-09-10T21:11:15.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:14 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:11:15.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:14 smithi192 ceph-mon[35363]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:11:15.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:14 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:15.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:14 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:15.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:14 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:15.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:14 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:15.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:14 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:15.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:14 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:15.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:14 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:15.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:14 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:11:15.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:14 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:15.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:14 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:11:15.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:14 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:15.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:14 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:11:15.330 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:14 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:15.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:14 smithi154 ceph-mon[35041]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:11:15.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:14 smithi154 ceph-mon[35041]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T21:11:15.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:14 smithi154 ceph-mon[35041]: from='osd.8 [v2:172.21.15.192:6816/3138189462,v1:172.21.15.192:6817/3138189462]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:11:15.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:14 smithi154 ceph-mon[35041]: osdmap e49: 9 total, 8 up, 9 in 2024-09-10T21:11:15.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:14 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:11:15.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:14 smithi154 ceph-mon[35041]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:11:15.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:14 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:15.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:14 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:15.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:14 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:15.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:14 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:15.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:14 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:15.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:14 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:15.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:14 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:15.435 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:14 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:11:15.435 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:14 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:15.435 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:14 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:11:15.435 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:14 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:15.435 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:14 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:11:15.436 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:14 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:15.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.611+0000 7f49df7ce640 1 -- 172.21.15.59:0/213839164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d810a960 msgr2=0x7f49d810ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:11:15.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.611+0000 7f49df7ce640 1 --2- 172.21.15.59:0/213839164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d810a960 0x7f49d810ce00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009900 tx=0x7f49d002a410 comp rx=0 tx=0).stop 2024-09-10T21:11:15.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.611+0000 7f49df7ce640 1 -- 172.21.15.59:0/213839164 shutdown_connections 2024-09-10T21:11:15.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.611+0000 7f49df7ce640 1 --2- 172.21.15.59:0/213839164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d810a960 0x7f49d810ce00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:11:15.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.611+0000 7f49df7ce640 1 --2- 172.21.15.59:0/213839164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49d8075b20 0x7f49d8075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:11:15.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.611+0000 7f49df7ce640 1 --2- 172.21.15.59:0/213839164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49d8076f80 0x7f49d80755e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:11:15.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.611+0000 7f49df7ce640 1 -- 172.21.15.59:0/213839164 >> 172.21.15.59:0/213839164 conn(0x7f49d80fe320 msgr2=0x7f49d8100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:11:15.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.611+0000 7f49df7ce640 1 -- 172.21.15.59:0/213839164 shutdown_connections 2024-09-10T21:11:15.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.611+0000 7f49df7ce640 1 -- 172.21.15.59:0/213839164 wait complete. 2024-09-10T21:11:15.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.611+0000 7f49df7ce640 1 Processor -- start 2024-09-10T21:11:15.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.611+0000 7f49df7ce640 1 -- start start 2024-09-10T21:11:15.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49df7ce640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49d8075b20 0x7f49d819aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:11:15.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49df7ce640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d8076f80 0x7f49d819b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:11:15.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49df7ce640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49d810a960 0x7f49d819c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:11:15.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49df7ce640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f49d8110870 con 0x7f49d8076f80 2024-09-10T21:11:15.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49df7ce640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f49d81106f0 con 0x7f49d810a960 2024-09-10T21:11:15.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49df7ce640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f49d81109f0 con 0x7f49d8075b20 2024-09-10T21:11:15.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49dcd69640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d8076f80 0x7f49d819b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:11:15.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49dcd69640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d8076f80 0x7f49d819b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41290/0 (socket says 172.21.15.59:41290) 2024-09-10T21:11:15.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49dcd69640 1 -- 172.21.15.59:0/3412925685 learned_addr learned my addr 172.21.15.59:0/3412925685 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:11:15.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49dd56a640 1 --2- 172.21.15.59:0/3412925685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49d8075b20 0x7f49d819aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:11:15.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49ddd6b640 1 --2- 172.21.15.59:0/3412925685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49d810a960 0x7f49d819c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:11:15.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49dcd69640 1 -- 172.21.15.59:0/3412925685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49d8075b20 msgr2=0x7f49d819aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:11:15.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49dcd69640 1 --2- 172.21.15.59:0/3412925685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49d8075b20 0x7f49d819aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:11:15.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49dcd69640 1 -- 172.21.15.59:0/3412925685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49d810a960 msgr2=0x7f49d819c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:11:15.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49dcd69640 1 --2- 172.21.15.59:0/3412925685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49d810a960 0x7f49d819c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:11:15.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49dcd69640 1 -- 172.21.15.59:0/3412925685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d819ca00 con 0x7f49d8076f80 2024-09-10T21:11:15.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49ddd6b640 1 --2- 172.21.15.59:0/3412925685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49d810a960 0x7f49d819c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:11:15.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49dcd69640 1 --2- 172.21.15.59:0/3412925685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d8076f80 0x7f49d819b520 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00c920 tx=0x7f49cc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:11:15.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49d67fc640 1 -- 172.21.15.59:0/3412925685 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc007c70 con 0x7f49d8076f80 2024-09-10T21:11:15.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49d67fc640 1 -- 172.21.15.59:0/3412925685 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49cc007e10 con 0x7f49d8076f80 2024-09-10T21:11:15.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.612+0000 7f49df7ce640 1 -- 172.21.15.59:0/3412925685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d819ccf0 con 0x7f49d8076f80 2024-09-10T21:11:15.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.613+0000 7f49d67fc640 1 -- 172.21.15.59:0/3412925685 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc018820 con 0x7f49d8076f80 2024-09-10T21:11:15.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.613+0000 7f49df7ce640 1 -- 172.21.15.59:0/3412925685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d81a33d0 con 0x7f49d8076f80 2024-09-10T21:11:15.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.614+0000 7f49df7ce640 1 -- 172.21.15.59:0/3412925685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49d81a3660 con 0x7f49d8076f80 2024-09-10T21:11:15.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.615+0000 7f49d67fc640 1 -- 172.21.15.59:0/3412925685 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f49cc00f450 con 0x7f49d8076f80 2024-09-10T21:11:15.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.616+0000 7f49d67fc640 1 --2- 172.21.15.59:0/3412925685 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f49c00b5360 0x7f49c00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:11:15.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.616+0000 7f49dd56a640 1 --2- 172.21.15.59:0/3412925685 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f49c00b5360 0x7f49c00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:11:15.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.616+0000 7f49d67fc640 1 -- 172.21.15.59:0/3412925685 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5549+0+0 (secure 0 0 0) 0x7f49cc0e5430 con 0x7f49d8076f80 2024-09-10T21:11:15.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.616+0000 7f49dd56a640 1 --2- 172.21.15.59:0/3412925685 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f49c00b5360 0x7f49c00b7820 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f49c8005fd0 tx=0x7f49c8009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:11:15.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.619+0000 7f49d67fc640 1 -- 172.21.15.59:0/3412925685 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f49cc014030 con 0x7f49d8076f80 2024-09-10T21:11:15.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:15.814+0000 7f49df7ce640 1 -- 172.21.15.59:0/3412925685 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f49d80fef60 con 0x7f49c00b5360 2024-09-10T21:11:16.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:15 smithi059 ceph-mon[30888]: Detected new or changed devices on smithi192 2024-09-10T21:11:16.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:15 smithi059 ceph-mon[30888]: Adjusting osd_memory_target on smithi192 to 5696M 2024-09-10T21:11:16.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:15 smithi059 ceph-mon[30888]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-10T21:11:16.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:15 smithi059 ceph-mon[30888]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T21:11:16.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:15 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:11:16.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:15 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:11:16.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:15 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:11:16.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:15 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:11:16.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:15 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:16.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:15 smithi059 ceph-mon[30888]: from='osd.8 ' entity='osd.8' 2024-09-10T21:11:16.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:15 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:11:16.328 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:11:15 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:11:15.824+0000 7f99e12cf640 -1 osd.8 0 waiting for initial osdmap 2024-09-10T21:11:16.328 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:11:15 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:11:15.935+0000 7f99d90ee640 -1 osd.8 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:11:16.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:15 smithi192 ceph-mon[35363]: Detected new or changed devices on smithi192 2024-09-10T21:11:16.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:15 smithi192 ceph-mon[35363]: Adjusting osd_memory_target on smithi192 to 5696M 2024-09-10T21:11:16.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:15 smithi192 ceph-mon[35363]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-10T21:11:16.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:15 smithi192 ceph-mon[35363]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T21:11:16.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:15 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:11:16.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:15 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:11:16.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:15 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:11:16.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:15 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:11:16.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:15 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:16.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:15 smithi192 ceph-mon[35363]: from='osd.8 ' entity='osd.8' 2024-09-10T21:11:16.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:15 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:11:16.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:15 smithi154 ceph-mon[35041]: Detected new or changed devices on smithi192 2024-09-10T21:11:16.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:15 smithi154 ceph-mon[35041]: Adjusting osd_memory_target on smithi192 to 5696M 2024-09-10T21:11:16.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:15 smithi154 ceph-mon[35041]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-10T21:11:16.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:15 smithi154 ceph-mon[35041]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T21:11:16.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:15 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:11:16.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:15 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:11:16.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:15 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:11:16.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:15 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:11:16.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:15 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:16.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:15 smithi154 ceph-mon[35041]: from='osd.8 ' entity='osd.8' 2024-09-10T21:11:16.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:15 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:11:17.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:16 smithi059 ceph-mon[30888]: purged_snaps scrub starts 2024-09-10T21:11:17.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:16 smithi059 ceph-mon[30888]: purged_snaps scrub ok 2024-09-10T21:11:17.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:16 smithi059 ceph-mon[30888]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:11:17.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:16 smithi059 ceph-mon[30888]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:11:17.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:16 smithi059 ceph-mon[30888]: osd.8 [v2:172.21.15.192:6816/3138189462,v1:172.21.15.192:6817/3138189462] boot 2024-09-10T21:11:17.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:16 smithi059 ceph-mon[30888]: osdmap e51: 9 total, 9 up, 9 in 2024-09-10T21:11:17.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:16 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:11:17.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:16 smithi192 ceph-mon[35363]: purged_snaps scrub starts 2024-09-10T21:11:17.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:16 smithi192 ceph-mon[35363]: purged_snaps scrub ok 2024-09-10T21:11:17.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:16 smithi192 ceph-mon[35363]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:11:17.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:16 smithi192 ceph-mon[35363]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:11:17.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:16 smithi192 ceph-mon[35363]: osd.8 [v2:172.21.15.192:6816/3138189462,v1:172.21.15.192:6817/3138189462] boot 2024-09-10T21:11:17.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:16 smithi192 ceph-mon[35363]: osdmap e51: 9 total, 9 up, 9 in 2024-09-10T21:11:17.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:16 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:11:17.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:16 smithi154 ceph-mon[35041]: purged_snaps scrub starts 2024-09-10T21:11:17.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:16 smithi154 ceph-mon[35041]: purged_snaps scrub ok 2024-09-10T21:11:17.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:16 smithi154 ceph-mon[35041]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-10T21:11:17.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:16 smithi154 ceph-mon[35041]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:11:17.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:16 smithi154 ceph-mon[35041]: osd.8 [v2:172.21.15.192:6816/3138189462,v1:172.21.15.192:6817/3138189462] boot 2024-09-10T21:11:17.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:16 smithi154 ceph-mon[35041]: osdmap e51: 9 total, 9 up, 9 in 2024-09-10T21:11:17.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:16 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T21:11:18.229 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:17 smithi192 ceph-mon[35363]: osdmap e52: 9 total, 9 up, 9 in 2024-09-10T21:11:18.229 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:17 smithi192 ceph-mon[35363]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T21:11:18.334 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:17 smithi154 ceph-mon[35041]: osdmap e52: 9 total, 9 up, 9 in 2024-09-10T21:11:18.334 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:17 smithi154 ceph-mon[35041]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T21:11:18.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:17 smithi059 ceph-mon[30888]: osdmap e52: 9 total, 9 up, 9 in 2024-09-10T21:11:18.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:17 smithi059 ceph-mon[30888]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T21:11:19.245 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:18 smithi192 ceph-mon[35363]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:19.245 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:18 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3996914363' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "044f934d-3df5-47aa-85f5-c3b63b267ecd"} : dispatch 2024-09-10T21:11:19.245 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:18 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3996914363' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "044f934d-3df5-47aa-85f5-c3b63b267ecd"}]': finished 2024-09-10T21:11:19.246 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:18 smithi192 ceph-mon[35363]: osdmap e54: 10 total, 9 up, 10 in 2024-09-10T21:11:19.246 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:18 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:11:19.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:18 smithi059 ceph-mon[30888]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:19.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:18 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3996914363' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "044f934d-3df5-47aa-85f5-c3b63b267ecd"} : dispatch 2024-09-10T21:11:19.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:18 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3996914363' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "044f934d-3df5-47aa-85f5-c3b63b267ecd"}]': finished 2024-09-10T21:11:19.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:18 smithi059 ceph-mon[30888]: osdmap e54: 10 total, 9 up, 10 in 2024-09-10T21:11:19.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:18 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:11:19.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:18 smithi154 ceph-mon[35041]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:19.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:18 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3996914363' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "044f934d-3df5-47aa-85f5-c3b63b267ecd"} : dispatch 2024-09-10T21:11:19.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:18 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3996914363' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "044f934d-3df5-47aa-85f5-c3b63b267ecd"}]': finished 2024-09-10T21:11:19.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:18 smithi154 ceph-mon[35041]: osdmap e54: 10 total, 9 up, 10 in 2024-09-10T21:11:19.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:18 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:11:20.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:19 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3136326946' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:11:20.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:19 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3136326946' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:11:20.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:19 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3136326946' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:11:21.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:20 smithi192 ceph-mon[35363]: pgmap v201: 1 pgs: 1 peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:21.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:20 smithi059 ceph-mon[30888]: pgmap v201: 1 pgs: 1 peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:21.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:20 smithi154 ceph-mon[35041]: pgmap v201: 1 pgs: 1 peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:22.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:21 smithi192 ceph-mon[35363]: pgmap v202: 1 pgs: 1 peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:22.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:21 smithi059 ceph-mon[30888]: pgmap v202: 1 pgs: 1 peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:22.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:21 smithi154 ceph-mon[35041]: pgmap v202: 1 pgs: 1 peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:24.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:24 smithi192 ceph-mon[35363]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T21:11:24.627 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:24 smithi059 ceph-mon[30888]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T21:11:24.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:24 smithi154 ceph-mon[35041]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T21:11:26.360 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:26 smithi059 ceph-mon[30888]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T21:11:26.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:26 smithi192 ceph-mon[35363]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T21:11:26.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:26 smithi154 ceph-mon[35041]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T21:11:28.531 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:28 smithi059 ceph-mon[30888]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T21:11:28.531 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:28 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T21:11:28.531 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:28 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:28.532 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:28 smithi059 ceph-mon[30888]: Deploying daemon osd.9 on smithi059 2024-09-10T21:11:28.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:28 smithi192 ceph-mon[35363]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T21:11:28.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:28 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T21:11:28.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:28 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:28.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:28 smithi192 ceph-mon[35363]: Deploying daemon osd.9 on smithi059 2024-09-10T21:11:28.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:28 smithi154 ceph-mon[35041]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T21:11:28.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:28 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T21:11:28.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:28 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:28.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:28 smithi154 ceph-mon[35041]: Deploying daemon osd.9 on smithi059 2024-09-10T21:11:30.557 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:30 smithi059 ceph-mon[30888]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T21:11:30.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:30 smithi192 ceph-mon[35363]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T21:11:30.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:30 smithi154 ceph-mon[35041]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T21:11:32.549 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:32 smithi059 ceph-mon[30888]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:11:32.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:32 smithi192 ceph-mon[35363]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:11:32.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:32 smithi154 ceph-mon[35041]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:11:33.569 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:33 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:11:33.569 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:33 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:33.569 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:33 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:33.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:33 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:11:33.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:33 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:33.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:33 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:33.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:33 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:11:33.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:33 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:33.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:33 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:34.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:34 smithi192 ceph-mon[35363]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:11:34.641 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:34 smithi059 ceph-mon[30888]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:11:34.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:34 smithi154 ceph-mon[35041]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:11:36.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:36.127+0000 7f49d67fc640 1 -- 172.21.15.59:0/3412925685 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f49d80fef60 con 0x7f49c00b5360 2024-09-10T21:11:36.131 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 9 on host 'smithi059' 2024-09-10T21:11:36.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:36.129+0000 7f49df7ce640 1 -- 172.21.15.59:0/3412925685 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f49c00b5360 msgr2=0x7f49c00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:11:36.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:36.129+0000 7f49df7ce640 1 --2- 172.21.15.59:0/3412925685 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f49c00b5360 0x7f49c00b7820 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f49c8005fd0 tx=0x7f49c8009760 comp rx=0 tx=0).stop 2024-09-10T21:11:36.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:36.129+0000 7f49df7ce640 1 -- 172.21.15.59:0/3412925685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d8076f80 msgr2=0x7f49d819b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:11:36.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:36.129+0000 7f49df7ce640 1 --2- 172.21.15.59:0/3412925685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d8076f80 0x7f49d819b520 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00c920 tx=0x7f49cc00cde0 comp rx=0 tx=0).stop 2024-09-10T21:11:36.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:36.129+0000 7f49df7ce640 1 -- 172.21.15.59:0/3412925685 shutdown_connections 2024-09-10T21:11:36.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:36.129+0000 7f49df7ce640 1 --2- 172.21.15.59:0/3412925685 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f49c00b5360 0x7f49c00b7820 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:11:36.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:36.129+0000 7f49df7ce640 1 --2- 172.21.15.59:0/3412925685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49d810a960 0x7f49d819c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:11:36.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:36.129+0000 7f49df7ce640 1 --2- 172.21.15.59:0/3412925685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49d8076f80 0x7f49d819b520 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:11:36.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:36.129+0000 7f49df7ce640 1 --2- 172.21.15.59:0/3412925685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49d8075b20 0x7f49d819aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:11:36.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:36.129+0000 7f49df7ce640 1 -- 172.21.15.59:0/3412925685 >> 172.21.15.59:0/3412925685 conn(0x7f49d80fe320 msgr2=0x7f49d80fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:11:36.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:36.129+0000 7f49df7ce640 1 -- 172.21.15.59:0/3412925685 shutdown_connections 2024-09-10T21:11:36.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:11:36.129+0000 7f49df7ce640 1 -- 172.21.15.59:0/3412925685 wait complete. 2024-09-10T21:11:36.372 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:36 smithi059 ceph-mon[30888]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:36.372 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:36 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:36.372 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:36 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:36.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:36 smithi192 ceph-mon[35363]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:36.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:36 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:36.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:36 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:36.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:36 smithi154 ceph-mon[35041]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:36.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:36 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:36.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:36 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:36.992 DEBUG:teuthology.orchestra.run.smithi059:osd.9> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.9.service 2024-09-10T21:11:36.994 INFO:tasks.cephadm:Deploying osd.10 on smithi154 with /dev/vg_nvme/lv_1... 2024-09-10T21:11:36.994 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T21:11:37.256 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:11:38.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:38 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:38.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:38 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:38.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:38 smithi059 ceph-mon[30888]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:38 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:38 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:38 smithi154 ceph-mon[35041]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:38.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:38 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:38.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:38 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:38.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:38 smithi192 ceph-mon[35363]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:39.779 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-10T21:11:39.801 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:11:39 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:11:39.435+0000 7f72d6b32640 -1 osd.9 0 log_to_monitors true 2024-09-10T21:11:39.806 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_1 2024-09-10T21:11:40.057 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:11:40.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:40 smithi059 ceph-mon[30888]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:40.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:40 smithi059 ceph-mon[30888]: from='osd.9 [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T21:11:40.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:40.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:40.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:40.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:40.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:40.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:40.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:40.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:40.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:11:40.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:40.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:40 smithi154 ceph-mon[35041]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:40.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:40 smithi154 ceph-mon[35041]: from='osd.9 [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T21:11:40.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:40.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:40.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:40.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:40.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:40.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:40.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:40.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:40.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:11:40.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:40.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.545+0000 7fc56c086640 1 -- 172.21.15.154:0/2828871088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc564103b90 msgr2=0x7fc564104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:11:40.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.545+0000 7fc56c086640 1 --2- 172.21.15.154:0/2828871088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc564103b90 0x7fc564104010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc560009930 tx=0x7fc56002a420 comp rx=0 tx=0).stop 2024-09-10T21:11:40.554 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.545+0000 7fc56c086640 1 -- 172.21.15.154:0/2828871088 shutdown_connections 2024-09-10T21:11:40.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.545+0000 7fc56c086640 1 --2- 172.21.15.154:0/2828871088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc564104550 0x7fc56410aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:11:40.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.545+0000 7fc56c086640 1 --2- 172.21.15.154:0/2828871088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc564103b90 0x7fc564104010 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:11:40.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.545+0000 7fc56c086640 1 --2- 172.21.15.154:0/2828871088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc564102a30 0x7fc564102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:11:40.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.545+0000 7fc56c086640 1 -- 172.21.15.154:0/2828871088 >> 172.21.15.154:0/2828871088 conn(0x7fc5640fe320 msgr2=0x7fc564100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:11:40.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.545+0000 7fc56c086640 1 -- 172.21.15.154:0/2828871088 shutdown_connections 2024-09-10T21:11:40.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.545+0000 7fc56c086640 1 -- 172.21.15.154:0/2828871088 wait complete. 2024-09-10T21:11:40.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.546+0000 7fc56c086640 1 Processor -- start 2024-09-10T21:11:40.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.546+0000 7fc56c086640 1 -- start start 2024-09-10T21:11:40.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.546+0000 7fc56c086640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc564102a30 0x7fc564076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:11:40.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.546+0000 7fc56c086640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc564103b90 0x7fc564075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:11:40.555 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.546+0000 7fc56c086640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc564104550 0x7fc564075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:11:40.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.546+0000 7fc56c086640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc56410e690 con 0x7fc564104550 2024-09-10T21:11:40.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.546+0000 7fc56c086640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc56410e510 con 0x7fc564102a30 2024-09-10T21:11:40.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.546+0000 7fc56c086640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc56410e810 con 0x7fc564103b90 2024-09-10T21:11:40.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.546+0000 7fc569e22640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc564102a30 0x7fc564076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:11:40.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.546+0000 7fc569e22640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc564102a30 0x7fc564076cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38078/0 (socket says 172.21.15.154:38078) 2024-09-10T21:11:40.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.546+0000 7fc569e22640 1 -- 172.21.15.154:0/2926638528 learned_addr learned my addr 172.21.15.154:0/2926638528 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-09-10T21:11:40.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.546+0000 7fc56a623640 1 --2- 172.21.15.154:0/2926638528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc564104550 0x7fc564075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:11:40.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.546+0000 7fc569e22640 1 -- 172.21.15.154:0/2926638528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc564103b90 msgr2=0x7fc564075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:11:40.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.546+0000 7fc569e22640 1 --2- 172.21.15.154:0/2926638528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc564103b90 0x7fc564075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:11:40.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.546+0000 7fc569e22640 1 -- 172.21.15.154:0/2926638528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc564104550 msgr2=0x7fc564075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:11:40.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.546+0000 7fc569e22640 1 --2- 172.21.15.154:0/2926638528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc564104550 0x7fc564075a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:11:40.556 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.546+0000 7fc569e22640 1 -- 172.21.15.154:0/2926638528 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc564076340 con 0x7fc564102a30 2024-09-10T21:11:40.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.546+0000 7fc56a623640 1 --2- 172.21.15.154:0/2926638528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc564104550 0x7fc564075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:11:40.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.547+0000 7fc569e22640 1 --2- 172.21.15.154:0/2926638528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc564102a30 0x7fc564076cd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc55400c920 tx=0x7fc55400cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:11:40.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.547+0000 7fc55affd640 1 -- 172.21.15.154:0/2926638528 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc554007c70 con 0x7fc564102a30 2024-09-10T21:11:40.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.547+0000 7fc56c086640 1 -- 172.21.15.154:0/2926638528 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5641a2dc0 con 0x7fc564102a30 2024-09-10T21:11:40.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.547+0000 7fc55affd640 1 -- 172.21.15.154:0/2926638528 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc554007e10 con 0x7fc564102a30 2024-09-10T21:11:40.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.547+0000 7fc55affd640 1 -- 172.21.15.154:0/2926638528 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc554018820 con 0x7fc564102a30 2024-09-10T21:11:40.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.547+0000 7fc56c086640 1 -- 172.21.15.154:0/2926638528 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5641a3210 con 0x7fc564102a30 2024-09-10T21:11:40.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.548+0000 7fc56c086640 1 -- 172.21.15.154:0/2926638528 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc564109d50 con 0x7fc564102a30 2024-09-10T21:11:40.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.549+0000 7fc55affd640 1 -- 172.21.15.154:0/2926638528 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fc55400f450 con 0x7fc564102a30 2024-09-10T21:11:40.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.550+0000 7fc55affd640 1 --2- 172.21.15.154:0/2926638528 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc5500b52e0 0x7fc5500b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:11:40.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.550+0000 7fc55affd640 1 -- 172.21.15.154:0/2926638528 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5965+0+0 (secure 0 0 0) 0x7fc5540e56b0 con 0x7fc564102a30 2024-09-10T21:11:40.557 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.550+0000 7fc569621640 1 --2- 172.21.15.154:0/2926638528 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc5500b52e0 0x7fc5500b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:11:40.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.551+0000 7fc569621640 1 --2- 172.21.15.154:0/2926638528 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc5500b52e0 0x7fc5500b77a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc5600096c0 tx=0x7fc560000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:11:40.558 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.553+0000 7fc55affd640 1 -- 172.21.15.154:0/2926638528 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc554014030 con 0x7fc564102a30 2024-09-10T21:11:40.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:40 smithi192 ceph-mon[35363]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:40.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:40 smithi192 ceph-mon[35363]: from='osd.9 [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T21:11:40.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:40.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:40.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:40.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:40.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:40.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T21:11:40.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:40.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:40.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:11:40.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:40.744 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:11:40.740+0000 7fc56c086640 1 -- 172.21.15.154:0/2926638528 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc564063590 con 0x7fc5500b52e0 2024-09-10T21:11:41.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:41 smithi154 ceph-mon[35041]: Detected new or changed devices on smithi059 2024-09-10T21:11:41.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:41 smithi154 ceph-mon[35041]: Adjusting osd_memory_target on smithi059 to 4273M 2024-09-10T21:11:41.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:41 smithi154 ceph-mon[35041]: from='osd.9 [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T21:11:41.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:41 smithi154 ceph-mon[35041]: osdmap e55: 10 total, 9 up, 10 in 2024-09-10T21:11:41.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:41 smithi154 ceph-mon[35041]: from='osd.9 [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-09-10T21:11:41.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:41 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:11:41.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:41 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:11:41.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:41 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:41.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:41 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:11:41.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:41 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:41.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:41 smithi154 ceph-mon[35041]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:11:41.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:41 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:11:41.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:41 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:11:41.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:41 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:41.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:41 smithi154 ceph-mon[35041]: from='osd.9 [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T21:11:41.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:41 smithi192 ceph-mon[35363]: Detected new or changed devices on smithi059 2024-09-10T21:11:41.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:41 smithi192 ceph-mon[35363]: Adjusting osd_memory_target on smithi059 to 4273M 2024-09-10T21:11:41.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:41 smithi192 ceph-mon[35363]: from='osd.9 [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T21:11:41.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:41 smithi192 ceph-mon[35363]: osdmap e55: 10 total, 9 up, 10 in 2024-09-10T21:11:41.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:41 smithi192 ceph-mon[35363]: from='osd.9 [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-09-10T21:11:41.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:41 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:11:41.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:41 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:11:41.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:41 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:41.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:41 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:11:41.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:41 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:41.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:41 smithi192 ceph-mon[35363]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:11:41.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:41 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:11:41.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:41 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:11:41.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:41 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:41.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:41 smithi192 ceph-mon[35363]: from='osd.9 [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T21:11:41.661 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:11:41 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:11:41.272+0000 7f72d2ab5640 -1 osd.9 0 waiting for initial osdmap 2024-09-10T21:11:41.661 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:11:41 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:11:41.290+0000 7f72ce8dc640 -1 osd.9 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:11:41.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:41 smithi059 ceph-mon[30888]: Detected new or changed devices on smithi059 2024-09-10T21:11:41.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:41 smithi059 ceph-mon[30888]: Adjusting osd_memory_target on smithi059 to 4273M 2024-09-10T21:11:41.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:41 smithi059 ceph-mon[30888]: from='osd.9 [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T21:11:41.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:41 smithi059 ceph-mon[30888]: osdmap e55: 10 total, 9 up, 10 in 2024-09-10T21:11:41.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:41 smithi059 ceph-mon[30888]: from='osd.9 [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi059", "root=default"]} : dispatch 2024-09-10T21:11:41.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:41 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:11:41.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:41 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:11:41.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:41 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:41.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:41 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:11:41.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:41 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:41.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:41 smithi059 ceph-mon[30888]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:11:41.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:41 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:11:41.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:41 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:11:41.663 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:41 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:41.663 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:41 smithi059 ceph-mon[30888]: from='osd.9 [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-10T21:11:42.393 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:42 smithi154 ceph-mon[35041]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:42.393 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:42 smithi154 ceph-mon[35041]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T21:11:42.393 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:42 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:11:42.394 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:42 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:11:42.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:42 smithi192 ceph-mon[35363]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:42.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:42 smithi192 ceph-mon[35363]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T21:11:42.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:42 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:11:42.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:42 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:11:42.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:42 smithi059 ceph-mon[30888]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:42.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:42 smithi059 ceph-mon[30888]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T21:11:42.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:42 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:11:42.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:42 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:11:43.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:43 smithi192 ceph-mon[35363]: purged_snaps scrub starts 2024-09-10T21:11:43.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:43 smithi192 ceph-mon[35363]: purged_snaps scrub ok 2024-09-10T21:11:43.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:43 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:11:43.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:43 smithi192 ceph-mon[35363]: osd.9 [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753] boot 2024-09-10T21:11:43.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:43 smithi192 ceph-mon[35363]: osdmap e57: 10 total, 10 up, 10 in 2024-09-10T21:11:43.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:43 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:11:43.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:43 smithi192 ceph-mon[35363]: from='client.? 172.21.15.154:0/597768724' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8d3b735b-e4fe-4a8e-8c75-a49313c6fabb"} : dispatch 2024-09-10T21:11:43.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:43 smithi192 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8d3b735b-e4fe-4a8e-8c75-a49313c6fabb"} : dispatch 2024-09-10T21:11:43.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:43 smithi192 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d3b735b-e4fe-4a8e-8c75-a49313c6fabb"}]': finished 2024-09-10T21:11:43.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:43 smithi192 ceph-mon[35363]: osdmap e58: 11 total, 10 up, 11 in 2024-09-10T21:11:43.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:43 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:11:43.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:43 smithi059 ceph-mon[30888]: purged_snaps scrub starts 2024-09-10T21:11:43.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:43 smithi059 ceph-mon[30888]: purged_snaps scrub ok 2024-09-10T21:11:43.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:43 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:11:43.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:43 smithi059 ceph-mon[30888]: osd.9 [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753] boot 2024-09-10T21:11:43.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:43 smithi059 ceph-mon[30888]: osdmap e57: 10 total, 10 up, 10 in 2024-09-10T21:11:43.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:43 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:11:43.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:43 smithi059 ceph-mon[30888]: from='client.? 172.21.15.154:0/597768724' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8d3b735b-e4fe-4a8e-8c75-a49313c6fabb"} : dispatch 2024-09-10T21:11:43.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:43 smithi059 ceph-mon[30888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8d3b735b-e4fe-4a8e-8c75-a49313c6fabb"} : dispatch 2024-09-10T21:11:43.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:43 smithi059 ceph-mon[30888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d3b735b-e4fe-4a8e-8c75-a49313c6fabb"}]': finished 2024-09-10T21:11:43.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:43 smithi059 ceph-mon[30888]: osdmap e58: 11 total, 10 up, 11 in 2024-09-10T21:11:43.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:43 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:11:43.663 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:43 smithi154 ceph-mon[35041]: purged_snaps scrub starts 2024-09-10T21:11:43.663 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:43 smithi154 ceph-mon[35041]: purged_snaps scrub ok 2024-09-10T21:11:43.664 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:43 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:11:43.664 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:43 smithi154 ceph-mon[35041]: osd.9 [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753] boot 2024-09-10T21:11:43.664 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:43 smithi154 ceph-mon[35041]: osdmap e57: 10 total, 10 up, 10 in 2024-09-10T21:11:43.664 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:43 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T21:11:43.664 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:43 smithi154 ceph-mon[35041]: from='client.? 172.21.15.154:0/597768724' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8d3b735b-e4fe-4a8e-8c75-a49313c6fabb"} : dispatch 2024-09-10T21:11:43.664 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:43 smithi154 ceph-mon[35041]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8d3b735b-e4fe-4a8e-8c75-a49313c6fabb"} : dispatch 2024-09-10T21:11:43.664 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:43 smithi154 ceph-mon[35041]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d3b735b-e4fe-4a8e-8c75-a49313c6fabb"}]': finished 2024-09-10T21:11:43.664 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:43 smithi154 ceph-mon[35041]: osdmap e58: 11 total, 10 up, 11 in 2024-09-10T21:11:43.664 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:43 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:11:44.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:44 smithi192 ceph-mon[35363]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:44.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:44 smithi192 ceph-mon[35363]: from='client.? 172.21.15.154:0/3830812876' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:11:44.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:44 smithi059 ceph-mon[30888]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:44.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:44 smithi059 ceph-mon[30888]: from='client.? 172.21.15.154:0/3830812876' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:11:44.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:44 smithi154 ceph-mon[35041]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-09-10T21:11:44.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:44 smithi154 ceph-mon[35041]: from='client.? 172.21.15.154:0/3830812876' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:11:46.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:46 smithi192 ceph-mon[35363]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:46.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:46 smithi059 ceph-mon[30888]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:46.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:46 smithi154 ceph-mon[35041]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:48.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:48 smithi154 ceph-mon[35041]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:48.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:48 smithi192 ceph-mon[35363]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:48.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:48 smithi059 ceph-mon[30888]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:50.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:50 smithi192 ceph-mon[35363]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:50.629 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:50 smithi154 ceph-mon[35041]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:50.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:50 smithi059 ceph-mon[30888]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:52.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:52 smithi192 ceph-mon[35363]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:52.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:52 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T21:11:52.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:52 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:52.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:52 smithi192 ceph-mon[35363]: Deploying daemon osd.10 on smithi154 2024-09-10T21:11:52.580 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:52 smithi154 ceph-mon[35041]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:52.580 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:52 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T21:11:52.580 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:52 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:52.580 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:52 smithi154 ceph-mon[35041]: Deploying daemon osd.10 on smithi154 2024-09-10T21:11:52.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:52 smithi059 ceph-mon[30888]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:52.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:52 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T21:11:52.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:52 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:11:52.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:52 smithi059 ceph-mon[30888]: Deploying daemon osd.10 on smithi154 2024-09-10T21:11:54.450 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:54 smithi154 ceph-mon[35041]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:54.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:54 smithi192 ceph-mon[35363]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:54.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:54 smithi059 ceph-mon[30888]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:56.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:56 smithi192 ceph-mon[35363]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:56.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:56 smithi059 ceph-mon[30888]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:56.665 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:56 smithi154 ceph-mon[35041]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:58.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:58 smithi192 ceph-mon[35363]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:58.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:11:58.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:58.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:11:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:58.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:58 smithi059 ceph-mon[30888]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:58.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:11:58.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:58.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:11:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:58.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:58 smithi154 ceph-mon[35041]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:11:58.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:11:58.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:11:58.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:11:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:00.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:00 smithi154 ceph-mon[35041]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:12:00.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:00 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:00.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:00 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:00.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:00 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:00.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:00 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:12:00.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:00 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:00.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:00 smithi059 ceph-mon[30888]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:12:00.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:00 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:00.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:00 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:00.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:00 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:00.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:00 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:12:00.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:00 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:00.823 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 10 on host 'smithi154' 2024-09-10T21:12:00.824 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:12:00.819+0000 7fc55affd640 1 -- 172.21.15.154:0/2926638528 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fc564063590 con 0x7fc5500b52e0 2024-09-10T21:12:00.825 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:12:00.821+0000 7fc56c086640 1 -- 172.21.15.154:0/2926638528 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc5500b52e0 msgr2=0x7fc5500b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:00.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:12:00.821+0000 7fc56c086640 1 --2- 172.21.15.154:0/2926638528 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc5500b52e0 0x7fc5500b77a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc5600096c0 tx=0x7fc560000bc0 comp rx=0 tx=0).stop 2024-09-10T21:12:00.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:12:00.821+0000 7fc56c086640 1 -- 172.21.15.154:0/2926638528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc564102a30 msgr2=0x7fc564076cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:00.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:12:00.821+0000 7fc56c086640 1 --2- 172.21.15.154:0/2926638528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc564102a30 0x7fc564076cd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc55400c920 tx=0x7fc55400cde0 comp rx=0 tx=0).stop 2024-09-10T21:12:00.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:12:00.822+0000 7fc56c086640 1 -- 172.21.15.154:0/2926638528 shutdown_connections 2024-09-10T21:12:00.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:12:00.822+0000 7fc56c086640 1 --2- 172.21.15.154:0/2926638528 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc5500b52e0 0x7fc5500b77a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:00.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:12:00.822+0000 7fc56c086640 1 --2- 172.21.15.154:0/2926638528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc564104550 0x7fc564075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:00.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:12:00.822+0000 7fc56c086640 1 --2- 172.21.15.154:0/2926638528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc564103b90 0x7fc564075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:00.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:12:00.822+0000 7fc56c086640 1 --2- 172.21.15.154:0/2926638528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc564102a30 0x7fc564076cd0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:00.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:12:00.822+0000 7fc56c086640 1 -- 172.21.15.154:0/2926638528 >> 172.21.15.154:0/2926638528 conn(0x7fc5640fe320 msgr2=0x7fc564106f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:00.826 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:12:00.822+0000 7fc56c086640 1 -- 172.21.15.154:0/2926638528 shutdown_connections 2024-09-10T21:12:00.827 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-10T21:12:00.822+0000 7fc56c086640 1 -- 172.21.15.154:0/2926638528 wait complete. 2024-09-10T21:12:00.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:00 smithi192 ceph-mon[35363]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:12:00.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:00 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:00.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:00 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:00.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:00 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:00.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:00 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:12:00.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:00 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:01.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:01 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:12:01.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:01 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:01.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:01 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:01.561 DEBUG:teuthology.orchestra.run.smithi154:osd.10> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.10.service 2024-09-10T21:12:01.564 INFO:tasks.cephadm:Deploying osd.11 on smithi192 with /dev/vg_nvme/lv_1... 2024-09-10T21:12:01.564 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T21:12:01.592 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:01 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:12:01.592 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:01 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:01.592 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:01 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:01.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:01 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:12:01.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:01 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:01.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:01 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:01.821 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:12:02.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:02 smithi154 ceph-mon[35041]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:12:03.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:02 smithi192 ceph-mon[35363]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:12:03.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:02 smithi059 ceph-mon[30888]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:12:03.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:03 smithi154 ceph-mon[35041]: from='osd.10 [v2:172.21.15.154:6824/1139781446,v1:172.21.15.154:6825/1139781446]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T21:12:03.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:03 smithi154 ceph-mon[35041]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T21:12:03.933 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:12:03 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:12:03.633+0000 7f2667638640 -1 osd.10 0 log_to_monitors true 2024-09-10T21:12:04.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:03 smithi059 ceph-mon[30888]: from='osd.10 [v2:172.21.15.154:6824/1139781446,v1:172.21.15.154:6825/1139781446]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T21:12:04.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:03 smithi059 ceph-mon[30888]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T21:12:04.323 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:03 smithi192 ceph-mon[35363]: from='osd.10 [v2:172.21.15.154:6824/1139781446,v1:172.21.15.154:6825/1139781446]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T21:12:04.323 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:03 smithi192 ceph-mon[35363]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T21:12:04.744 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-10T21:12:04.771 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi192:vg_nvme/lv_1 2024-09-10T21:12:05.072 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:12:05.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:04 smithi192 ceph-mon[35363]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:12:05.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:04 smithi192 ceph-mon[35363]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T21:12:05.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:04 smithi192 ceph-mon[35363]: osdmap e59: 11 total, 10 up, 11 in 2024-09-10T21:12:05.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:04 smithi192 ceph-mon[35363]: from='osd.10 [v2:172.21.15.154:6824/1139781446,v1:172.21.15.154:6825/1139781446]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:12:05.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:12:05.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:04 smithi192 ceph-mon[35363]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:12:05.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:05.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:05.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:05.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:05.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:05.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:05.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:05.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:05.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:12:05.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:04 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:05.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:04 smithi059 ceph-mon[30888]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:12:05.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:04 smithi059 ceph-mon[30888]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T21:12:05.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:04 smithi059 ceph-mon[30888]: osdmap e59: 11 total, 10 up, 11 in 2024-09-10T21:12:05.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:04 smithi059 ceph-mon[30888]: from='osd.10 [v2:172.21.15.154:6824/1139781446,v1:172.21.15.154:6825/1139781446]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:12:05.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:12:05.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:04 smithi059 ceph-mon[30888]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:12:05.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:05.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:05.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:05.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:05.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:05.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:05.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:05.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:05.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:12:05.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:04 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:05.184 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:12:04 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:12:04.834+0000 7f26635bb640 -1 osd.10 0 waiting for initial osdmap 2024-09-10T21:12:05.184 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:12:04 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:12:04.849+0000 7f265f3e2640 -1 osd.10 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:12:05.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:04 smithi154 ceph-mon[35041]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:12:05.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:04 smithi154 ceph-mon[35041]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T21:12:05.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:04 smithi154 ceph-mon[35041]: osdmap e59: 11 total, 10 up, 11 in 2024-09-10T21:12:05.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:04 smithi154 ceph-mon[35041]: from='osd.10 [v2:172.21.15.154:6824/1139781446,v1:172.21.15.154:6825/1139781446]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:12:05.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:12:05.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:04 smithi154 ceph-mon[35041]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]} : dispatch 2024-09-10T21:12:05.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:05.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:05.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:05.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:05.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:05.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:05.185 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:05.186 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:05.186 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:12:05.186 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:04 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:05.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.566+0000 7fc9ccb26640 1 -- 172.21.15.192:0/761467696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9c8103b90 msgr2=0x7fc9c8104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:05.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.566+0000 7fc9ccb26640 1 --2- 172.21.15.192:0/761467696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9c8103b90 0x7fc9c8104010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009960 tx=0x7fc9bc02a460 comp rx=0 tx=0).stop 2024-09-10T21:12:05.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.567+0000 7fc9ccb26640 1 -- 172.21.15.192:0/761467696 shutdown_connections 2024-09-10T21:12:05.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.567+0000 7fc9ccb26640 1 --2- 172.21.15.192:0/761467696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c8104550 0x7fc9c810aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:05.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.567+0000 7fc9ccb26640 1 --2- 172.21.15.192:0/761467696 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9c8103b90 0x7fc9c8104010 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:05.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.567+0000 7fc9ccb26640 1 --2- 172.21.15.192:0/761467696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9c8102a30 0x7fc9c8102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:05.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.567+0000 7fc9ccb26640 1 -- 172.21.15.192:0/761467696 >> 172.21.15.192:0/761467696 conn(0x7fc9c80fe320 msgr2=0x7fc9c8100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:05.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.567+0000 7fc9ccb26640 1 -- 172.21.15.192:0/761467696 shutdown_connections 2024-09-10T21:12:05.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.567+0000 7fc9ccb26640 1 -- 172.21.15.192:0/761467696 wait complete. 2024-09-10T21:12:05.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.567+0000 7fc9ccb26640 1 Processor -- start 2024-09-10T21:12:05.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.567+0000 7fc9ccb26640 1 -- start start 2024-09-10T21:12:05.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9ccb26640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c8102a30 0x7fc9c8198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:05.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9ccb26640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9c8103b90 0x7fc9c81994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:05.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9ccb26640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9c8104550 0x7fc9c819a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:05.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9ccb26640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c810e6b0 con 0x7fc9c8102a30 2024-09-10T21:12:05.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9ccb26640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c810e530 con 0x7fc9c8104550 2024-09-10T21:12:05.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9ccb26640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c810e830 con 0x7fc9c8103b90 2024-09-10T21:12:05.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9c5d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9c8103b90 0x7fc9c81994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:05.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9c5d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9c8103b90 0x7fc9c81994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:46152/0 (socket says 172.21.15.192:46152) 2024-09-10T21:12:05.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9c5d9b640 1 -- 172.21.15.192:0/2670519800 learned_addr learned my addr 172.21.15.192:0/2670519800 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T21:12:05.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9c659c640 1 --2- 172.21.15.192:0/2670519800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c8102a30 0x7fc9c8198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:05.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9c5d9b640 1 -- 172.21.15.192:0/2670519800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9c8104550 msgr2=0x7fc9c819a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:05.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9c5d9b640 1 --2- 172.21.15.192:0/2670519800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9c8104550 0x7fc9c819a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:05.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9c5d9b640 1 -- 172.21.15.192:0/2670519800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c8102a30 msgr2=0x7fc9c8198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:05.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9c5d9b640 1 --2- 172.21.15.192:0/2670519800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c8102a30 0x7fc9c8198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:05.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9c5d9b640 1 -- 172.21.15.192:0/2670519800 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c819a960 con 0x7fc9c8103b90 2024-09-10T21:12:05.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9c5d9b640 1 --2- 172.21.15.192:0/2670519800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9c8103b90 0x7fc9c81994f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc006010 tx=0x7fc9bc0042e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:05.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9b77fe640 1 -- 172.21.15.192:0/2670519800 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc03f030 con 0x7fc9c8103b90 2024-09-10T21:12:05.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9b77fe640 1 -- 172.21.15.192:0/2670519800 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9bc003aa0 con 0x7fc9c8103b90 2024-09-10T21:12:05.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9ccb26640 1 -- 172.21.15.192:0/2670519800 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c819abf0 con 0x7fc9c8103b90 2024-09-10T21:12:05.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9b77fe640 1 -- 172.21.15.192:0/2670519800 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc035070 con 0x7fc9c8103b90 2024-09-10T21:12:05.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.568+0000 7fc9ccb26640 1 -- 172.21.15.192:0/2670519800 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c81a1160 con 0x7fc9c8103b90 2024-09-10T21:12:05.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.570+0000 7fc9ccb26640 1 -- 172.21.15.192:0/2670519800 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c8109e10 con 0x7fc9c8103b90 2024-09-10T21:12:05.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.571+0000 7fc9b77fe640 1 -- 172.21.15.192:0/2670519800 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fc9bc003c50 con 0x7fc9c8103b90 2024-09-10T21:12:05.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.572+0000 7fc9b77fe640 1 --2- 172.21.15.192:0/2670519800 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc9b00b52e0 0x7fc9b00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:05.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.572+0000 7fc9b77fe640 1 -- 172.21.15.192:0/2670519800 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6414+0+0 (secure 0 0 0) 0x7fc9bc106190 con 0x7fc9c8103b90 2024-09-10T21:12:05.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.572+0000 7fc9c659c640 1 --2- 172.21.15.192:0/2670519800 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc9b00b52e0 0x7fc9b00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:05.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.572+0000 7fc9c659c640 1 --2- 172.21.15.192:0/2670519800 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc9b00b52e0 0x7fc9b00b77a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80058c0 tx=0x7fc9b800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:05.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.575+0000 7fc9b77fe640 1 -- 172.21.15.192:0/2670519800 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc9bc0cd720 con 0x7fc9c8103b90 2024-09-10T21:12:05.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:05.767+0000 7fc9ccb26640 1 -- 172.21.15.192:0/2670519800 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc9c8063590 con 0x7fc9b00b52e0 2024-09-10T21:12:06.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:05 smithi192 ceph-mon[35363]: Detected new or changed devices on smithi154 2024-09-10T21:12:06.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:05 smithi192 ceph-mon[35363]: Adjusting osd_memory_target on smithi154 to 4272M 2024-09-10T21:12:06.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:05 smithi192 ceph-mon[35363]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T21:12:06.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:05 smithi192 ceph-mon[35363]: osdmap e60: 11 total, 10 up, 11 in 2024-09-10T21:12:06.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:12:06.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:12:06.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:12:06.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:12:06.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:06.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:05 smithi192 ceph-mon[35363]: osd.10 [v2:172.21.15.154:6824/1139781446,v1:172.21.15.154:6825/1139781446] boot 2024-09-10T21:12:06.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:05 smithi192 ceph-mon[35363]: osdmap e61: 11 total, 11 up, 11 in 2024-09-10T21:12:06.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:12:06.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:05 smithi059 ceph-mon[30888]: Detected new or changed devices on smithi154 2024-09-10T21:12:06.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:05 smithi059 ceph-mon[30888]: Adjusting osd_memory_target on smithi154 to 4272M 2024-09-10T21:12:06.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:05 smithi059 ceph-mon[30888]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T21:12:06.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:05 smithi059 ceph-mon[30888]: osdmap e60: 11 total, 10 up, 11 in 2024-09-10T21:12:06.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:12:06.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:12:06.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:12:06.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:12:06.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:06.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:05 smithi059 ceph-mon[30888]: osd.10 [v2:172.21.15.154:6824/1139781446,v1:172.21.15.154:6825/1139781446] boot 2024-09-10T21:12:06.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:05 smithi059 ceph-mon[30888]: osdmap e61: 11 total, 11 up, 11 in 2024-09-10T21:12:06.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:12:06.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:05 smithi154 ceph-mon[35041]: Detected new or changed devices on smithi154 2024-09-10T21:12:06.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:05 smithi154 ceph-mon[35041]: Adjusting osd_memory_target on smithi154 to 4272M 2024-09-10T21:12:06.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:05 smithi154 ceph-mon[35041]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-09-10T21:12:06.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:05 smithi154 ceph-mon[35041]: osdmap e60: 11 total, 10 up, 11 in 2024-09-10T21:12:06.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:12:06.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:12:06.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T21:12:06.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T21:12:06.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:06.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:05 smithi154 ceph-mon[35041]: osd.10 [v2:172.21.15.154:6824/1139781446,v1:172.21.15.154:6825/1139781446] boot 2024-09-10T21:12:06.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:05 smithi154 ceph-mon[35041]: osdmap e61: 11 total, 11 up, 11 in 2024-09-10T21:12:06.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T21:12:07.109 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:06 smithi192 ceph-mon[35363]: purged_snaps scrub starts 2024-09-10T21:12:07.109 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:06 smithi192 ceph-mon[35363]: purged_snaps scrub ok 2024-09-10T21:12:07.109 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:06 smithi192 ceph-mon[35363]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:12:07.109 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:06 smithi192 ceph-mon[35363]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:12:07.109 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:06 smithi192 ceph-mon[35363]: osdmap e62: 11 total, 11 up, 11 in 2024-09-10T21:12:07.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:06 smithi059 ceph-mon[30888]: purged_snaps scrub starts 2024-09-10T21:12:07.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:06 smithi059 ceph-mon[30888]: purged_snaps scrub ok 2024-09-10T21:12:07.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:06 smithi059 ceph-mon[30888]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:12:07.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:06 smithi059 ceph-mon[30888]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:12:07.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:06 smithi059 ceph-mon[30888]: osdmap e62: 11 total, 11 up, 11 in 2024-09-10T21:12:07.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:06 smithi154 ceph-mon[35041]: purged_snaps scrub starts 2024-09-10T21:12:07.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:06 smithi154 ceph-mon[35041]: purged_snaps scrub ok 2024-09-10T21:12:07.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:06 smithi154 ceph-mon[35041]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-10T21:12:07.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:06 smithi154 ceph-mon[35041]: from='client.24436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:12:07.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:06 smithi154 ceph-mon[35041]: osdmap e62: 11 total, 11 up, 11 in 2024-09-10T21:12:09.080 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:08 smithi192 ceph-mon[35363]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:12:09.080 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:08 smithi192 ceph-mon[35363]: osdmap e63: 11 total, 11 up, 11 in 2024-09-10T21:12:09.080 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:08 smithi192 ceph-mon[35363]: from='client.? 172.21.15.192:0/3515507725' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fd6a6d06-c6aa-42e3-aa38-fc583319f6bb"} : dispatch 2024-09-10T21:12:09.080 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:08 smithi192 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fd6a6d06-c6aa-42e3-aa38-fc583319f6bb"} : dispatch 2024-09-10T21:12:09.080 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:08 smithi192 ceph-mon[35363]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd6a6d06-c6aa-42e3-aa38-fc583319f6bb"}]': finished 2024-09-10T21:12:09.080 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:08 smithi192 ceph-mon[35363]: osdmap e64: 12 total, 11 up, 12 in 2024-09-10T21:12:09.080 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:08 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:12:09.081 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:08 smithi192 ceph-mon[35363]: from='client.? 172.21.15.192:0/2436077921' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:12:09.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:08 smithi059 ceph-mon[30888]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:12:09.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:08 smithi059 ceph-mon[30888]: osdmap e63: 11 total, 11 up, 11 in 2024-09-10T21:12:09.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:08 smithi059 ceph-mon[30888]: from='client.? 172.21.15.192:0/3515507725' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fd6a6d06-c6aa-42e3-aa38-fc583319f6bb"} : dispatch 2024-09-10T21:12:09.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:08 smithi059 ceph-mon[30888]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fd6a6d06-c6aa-42e3-aa38-fc583319f6bb"} : dispatch 2024-09-10T21:12:09.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:08 smithi059 ceph-mon[30888]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd6a6d06-c6aa-42e3-aa38-fc583319f6bb"}]': finished 2024-09-10T21:12:09.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:08 smithi059 ceph-mon[30888]: osdmap e64: 12 total, 11 up, 12 in 2024-09-10T21:12:09.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:08 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:12:09.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:08 smithi059 ceph-mon[30888]: from='client.? 172.21.15.192:0/2436077921' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:12:09.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:08 smithi154 ceph-mon[35041]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:12:09.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:08 smithi154 ceph-mon[35041]: osdmap e63: 11 total, 11 up, 11 in 2024-09-10T21:12:09.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:08 smithi154 ceph-mon[35041]: from='client.? 172.21.15.192:0/3515507725' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fd6a6d06-c6aa-42e3-aa38-fc583319f6bb"} : dispatch 2024-09-10T21:12:09.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:08 smithi154 ceph-mon[35041]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fd6a6d06-c6aa-42e3-aa38-fc583319f6bb"} : dispatch 2024-09-10T21:12:09.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:08 smithi154 ceph-mon[35041]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd6a6d06-c6aa-42e3-aa38-fc583319f6bb"}]': finished 2024-09-10T21:12:09.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:08 smithi154 ceph-mon[35041]: osdmap e64: 12 total, 11 up, 12 in 2024-09-10T21:12:09.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:08 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:12:09.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:08 smithi154 ceph-mon[35041]: from='client.? 172.21.15.192:0/2436077921' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T21:12:11.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:10 smithi059 ceph-mon[30888]: pgmap v236: 1 pgs: 1 activating; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T21:12:11.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:10 smithi154 ceph-mon[35041]: pgmap v236: 1 pgs: 1 activating; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T21:12:11.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:10 smithi192 ceph-mon[35363]: pgmap v236: 1 pgs: 1 activating; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T21:12:13.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:12 smithi059 ceph-mon[30888]: pgmap v237: 1 pgs: 1 activating; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T21:12:13.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:12 smithi154 ceph-mon[35041]: pgmap v237: 1 pgs: 1 activating; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T21:12:13.306 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:12 smithi192 ceph-mon[35363]: pgmap v237: 1 pgs: 1 activating; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-10T21:12:15.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:14 smithi192 ceph-mon[35363]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-10T21:12:15.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:14 smithi059 ceph-mon[30888]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-10T21:12:15.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:14 smithi154 ceph-mon[35041]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-10T21:12:17.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:16 smithi192 ceph-mon[35363]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T21:12:17.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:16 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T21:12:17.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:16 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:17.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:16 smithi059 ceph-mon[30888]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T21:12:17.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:16 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T21:12:17.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:16 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:17.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:16 smithi154 ceph-mon[35041]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T21:12:17.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:16 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T21:12:17.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:16 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:18.126 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:17 smithi192 ceph-mon[35363]: Deploying daemon osd.11 on smithi192 2024-09-10T21:12:18.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:17 smithi059 ceph-mon[30888]: Deploying daemon osd.11 on smithi192 2024-09-10T21:12:18.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:17 smithi154 ceph-mon[35041]: Deploying daemon osd.11 on smithi192 2024-09-10T21:12:19.127 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:18 smithi192 ceph-mon[35363]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-10T21:12:19.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:18 smithi059 ceph-mon[30888]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-10T21:12:19.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:18 smithi154 ceph-mon[35041]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-10T21:12:21.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:20 smithi192 ceph-mon[35363]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T21:12:21.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:20 smithi059 ceph-mon[30888]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T21:12:21.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:20 smithi154 ceph-mon[35041]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T21:12:22.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:22 smithi192 ceph-mon[35363]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:12:22.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:22 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:12:22.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:22 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:22.985 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:22 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:23.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:22 smithi059 ceph-mon[30888]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:12:23.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:22 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:12:23.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:22 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:23.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:22 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:23.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:22 smithi154 ceph-mon[35041]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:12:23.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:22 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:12:23.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:22 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:23.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:22 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:24.891 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:24 smithi192 ceph-mon[35363]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:12:25.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:24 smithi059 ceph-mon[30888]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:12:25.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:24 smithi154 ceph-mon[35041]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T21:12:25.524 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 11 on host 'smithi192' 2024-09-10T21:12:25.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:25.519+0000 7fc9b77fe640 1 -- 172.21.15.192:0/2670519800 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fc9c8063590 con 0x7fc9b00b52e0 2024-09-10T21:12:25.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:25.522+0000 7fc9ccb26640 1 -- 172.21.15.192:0/2670519800 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc9b00b52e0 msgr2=0x7fc9b00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:25.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:25.522+0000 7fc9ccb26640 1 --2- 172.21.15.192:0/2670519800 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc9b00b52e0 0x7fc9b00b77a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80058c0 tx=0x7fc9b800a250 comp rx=0 tx=0).stop 2024-09-10T21:12:25.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:25.522+0000 7fc9ccb26640 1 -- 172.21.15.192:0/2670519800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9c8103b90 msgr2=0x7fc9c81994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:25.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:25.522+0000 7fc9ccb26640 1 --2- 172.21.15.192:0/2670519800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9c8103b90 0x7fc9c81994f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc006010 tx=0x7fc9bc0042e0 comp rx=0 tx=0).stop 2024-09-10T21:12:25.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:25.522+0000 7fc9ccb26640 1 -- 172.21.15.192:0/2670519800 shutdown_connections 2024-09-10T21:12:25.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:25.522+0000 7fc9ccb26640 1 --2- 172.21.15.192:0/2670519800 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc9b00b52e0 0x7fc9b00b77a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:25.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:25.522+0000 7fc9ccb26640 1 --2- 172.21.15.192:0/2670519800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc9c8104550 0x7fc9c819a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:25.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:25.522+0000 7fc9ccb26640 1 --2- 172.21.15.192:0/2670519800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9c8103b90 0x7fc9c81994f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:25.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:25.522+0000 7fc9ccb26640 1 --2- 172.21.15.192:0/2670519800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9c8102a30 0x7fc9c8198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:25.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:25.522+0000 7fc9ccb26640 1 -- 172.21.15.192:0/2670519800 >> 172.21.15.192:0/2670519800 conn(0x7fc9c80fe320 msgr2=0x7fc9c8106fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:25.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:25.522+0000 7fc9ccb26640 1 -- 172.21.15.192:0/2670519800 shutdown_connections 2024-09-10T21:12:25.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:25.523+0000 7fc9ccb26640 1 -- 172.21.15.192:0/2670519800 wait complete. 2024-09-10T21:12:26.144 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:25 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:26.144 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:25 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:26.144 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:25 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:26.144 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:25 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:12:26.144 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:25 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:26.144 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:25 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:12:26.144 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:25 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:26.144 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:25 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:26.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:25 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:26.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:25 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:26.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:25 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:26.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:25 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:12:26.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:25 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:26.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:25 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:12:26.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:25 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:26.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:25 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:26.172 DEBUG:teuthology.orchestra.run.smithi192:osd.11> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.11.service 2024-09-10T21:12:26.174 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-10T21:12:26.174 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T21:12:26.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:25 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:26.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:25 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:26.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:25 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:26.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:25 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:12:26.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:25 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:26.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:25 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:12:26.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:25 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:26.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:25 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:26.447 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:12:26.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.841+0000 7f441686c640 1 -- 172.21.15.59:0/869706756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4410102a40 msgr2=0x7f4410102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:26.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.841+0000 7f441686c640 1 --2- 172.21.15.59:0/869706756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4410102a40 0x7f4410102e40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4400009930 tx=0x7f440002a420 comp rx=0 tx=0).stop 2024-09-10T21:12:26.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.841+0000 7f441686c640 1 -- 172.21.15.59:0/869706756 shutdown_connections 2024-09-10T21:12:26.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.841+0000 7f441686c640 1 --2- 172.21.15.59:0/869706756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4410104560 0x7f441010aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:26.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.841+0000 7f441686c640 1 --2- 172.21.15.59:0/869706756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4410103ba0 0x7f4410104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:26.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.841+0000 7f441686c640 1 --2- 172.21.15.59:0/869706756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4410102a40 0x7f4410102e40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:26.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.841+0000 7f441686c640 1 -- 172.21.15.59:0/869706756 >> 172.21.15.59:0/869706756 conn(0x7f44100fe2f0 msgr2=0x7f4410100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:26.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.842+0000 7f441686c640 1 -- 172.21.15.59:0/869706756 shutdown_connections 2024-09-10T21:12:26.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.842+0000 7f441686c640 1 -- 172.21.15.59:0/869706756 wait complete. 2024-09-10T21:12:26.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.842+0000 7f441686c640 1 Processor -- start 2024-09-10T21:12:26.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.842+0000 7f441686c640 1 -- start start 2024-09-10T21:12:26.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.843+0000 7f441686c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4410102a40 0x7f441019b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.843+0000 7f441686c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4410103ba0 0x7f441019b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.843+0000 7f441686c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4410104560 0x7f441019c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.843+0000 7f441686c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f441010e6a0 con 0x7f4410104560 2024-09-10T21:12:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.843+0000 7f441686c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f441010e520 con 0x7f4410103ba0 2024-09-10T21:12:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.843+0000 7f441686c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f441010e820 con 0x7f4410102a40 2024-09-10T21:12:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.843+0000 7f4414e09640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4410104560 0x7f441019c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.843+0000 7f440ffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4410102a40 0x7f441019b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.843+0000 7f440ffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4410102a40 0x7f441019b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:60016/0 (socket says 172.21.15.59:60016) 2024-09-10T21:12:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.843+0000 7f4414e09640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4410104560 0x7f441019c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34564/0 (socket says 172.21.15.59:34564) 2024-09-10T21:12:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.843+0000 7f440ffff640 1 -- 172.21.15.59:0/2300742056 learned_addr learned my addr 172.21.15.59:0/2300742056 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:12:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.843+0000 7f440f7fe640 1 --2- 172.21.15.59:0/2300742056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4410103ba0 0x7f441019b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.843+0000 7f4414e09640 1 -- 172.21.15.59:0/2300742056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4410102a40 msgr2=0x7f441019b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.843+0000 7f4414e09640 1 --2- 172.21.15.59:0/2300742056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4410102a40 0x7f441019b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:26.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.843+0000 7f4414e09640 1 -- 172.21.15.59:0/2300742056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4410103ba0 msgr2=0x7f441019b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:26.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.843+0000 7f4414e09640 1 --2- 172.21.15.59:0/2300742056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4410103ba0 0x7f441019b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:26.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.843+0000 7f4414e09640 1 -- 172.21.15.59:0/2300742056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441019cb70 con 0x7f4410104560 2024-09-10T21:12:26.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.843+0000 7f4414e09640 1 --2- 172.21.15.59:0/2300742056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4410104560 0x7f441019c2d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f440800ca30 tx=0x7f440800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:26.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.844+0000 7f440d7fa640 1 -- 172.21.15.59:0/2300742056 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4408007d90 con 0x7f4410104560 2024-09-10T21:12:26.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.844+0000 7f441686c640 1 -- 172.21.15.59:0/2300742056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f441019ce60 con 0x7f4410104560 2024-09-10T21:12:26.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.844+0000 7f440d7fa640 1 -- 172.21.15.59:0/2300742056 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4408005020 con 0x7f4410104560 2024-09-10T21:12:26.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.844+0000 7f440d7fa640 1 -- 172.21.15.59:0/2300742056 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440800f690 con 0x7f4410104560 2024-09-10T21:12:26.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.844+0000 7f441686c640 1 -- 172.21.15.59:0/2300742056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44101a3540 con 0x7f4410104560 2024-09-10T21:12:26.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.845+0000 7f441686c640 1 -- 172.21.15.59:0/2300742056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44101a3710 con 0x7f4410104560 2024-09-10T21:12:26.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.847+0000 7f440d7fa640 1 -- 172.21.15.59:0/2300742056 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f44080054f0 con 0x7f4410104560 2024-09-10T21:12:26.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.848+0000 7f440d7fa640 1 --2- 172.21.15.59:0/2300742056 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43f80b52e0 0x7f43f80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:26.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.848+0000 7f440ffff640 1 --2- 172.21.15.59:0/2300742056 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43f80b52e0 0x7f43f80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:26.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.848+0000 7f440d7fa640 1 -- 172.21.15.59:0/2300742056 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6809+0+0 (secure 0 0 0) 0x7f44080e5bf0 con 0x7f4410104560 2024-09-10T21:12:26.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.848+0000 7f440ffff640 1 --2- 172.21.15.59:0/2300742056 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43f80b52e0 0x7f43f80b77a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4400005ec0 tx=0x7f4400031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:26.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:26.851+0000 7f440d7fa640 1 -- 172.21.15.59:0/2300742056 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4408014070 con 0x7f4410104560 2024-09-10T21:12:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:27.041+0000 7f441686c640 1 -- 172.21.15.59:0/2300742056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f44101a38e0 con 0x7f4410104560 2024-09-10T21:12:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:27.041+0000 7f440d7fa640 1 -- 172.21.15.59:0/2300742056 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v64) ==== 74+0+133 (secure 0 0 0) 0x7f44080aca40 con 0x7f4410104560 2024-09-10T21:12:27.046 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:12:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:27.043+0000 7f441686c640 1 -- 172.21.15.59:0/2300742056 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43f80b52e0 msgr2=0x7f43f80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:27.043+0000 7f441686c640 1 --2- 172.21.15.59:0/2300742056 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43f80b52e0 0x7f43f80b77a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4400005ec0 tx=0x7f4400031430 comp rx=0 tx=0).stop 2024-09-10T21:12:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:27.043+0000 7f441686c640 1 -- 172.21.15.59:0/2300742056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4410104560 msgr2=0x7f441019c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:27.043+0000 7f441686c640 1 --2- 172.21.15.59:0/2300742056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4410104560 0x7f441019c2d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f440800ca30 tx=0x7f440800cef0 comp rx=0 tx=0).stop 2024-09-10T21:12:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:27.044+0000 7f441686c640 1 -- 172.21.15.59:0/2300742056 shutdown_connections 2024-09-10T21:12:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:27.044+0000 7f441686c640 1 --2- 172.21.15.59:0/2300742056 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43f80b52e0 0x7f43f80b77a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:27.044+0000 7f441686c640 1 --2- 172.21.15.59:0/2300742056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4410104560 0x7f441019c2d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:27.044+0000 7f441686c640 1 --2- 172.21.15.59:0/2300742056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4410103ba0 0x7f441019b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:27.044+0000 7f441686c640 1 --2- 172.21.15.59:0/2300742056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4410102a40 0x7f441019b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:27.044+0000 7f441686c640 1 -- 172.21.15.59:0/2300742056 >> 172.21.15.59:0/2300742056 conn(0x7f44100fe2f0 msgr2=0x7f4410075380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:27.044+0000 7f441686c640 1 -- 172.21.15.59:0/2300742056 shutdown_connections 2024-09-10T21:12:27.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:27.044+0000 7f441686c640 1 -- 172.21.15.59:0/2300742056 wait complete. 2024-09-10T21:12:27.123 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:26 smithi059 ceph-mon[30888]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:12:27.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:26 smithi154 ceph-mon[35041]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:12:27.234 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:26 smithi192 ceph-mon[35363]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:12:27.811 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":64,"num_osds":12,"num_up_osds":11,"osd_up_since":1726002725,"num_in_osds":12,"osd_in_since":1726002728,"num_remapped_pgs":0} 2024-09-10T21:12:28.143 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:27 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2300742056' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T21:12:28.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:27 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2300742056' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T21:12:28.193 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:27 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2300742056' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T21:12:28.549 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:12:28 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:12:28.316+0000 7fb48ece6640 -1 osd.11 0 log_to_monitors true 2024-09-10T21:12:28.812 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T21:12:29.087 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:12:29.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:28 smithi059 ceph-mon[30888]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:12:29.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:28 smithi059 ceph-mon[30888]: from='osd.11 [v2:172.21.15.192:6824/1041494458,v1:172.21.15.192:6825/1041494458]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T21:12:29.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:28 smithi059 ceph-mon[30888]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T21:12:29.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:28 smithi154 ceph-mon[35041]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:12:29.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:28 smithi154 ceph-mon[35041]: from='osd.11 [v2:172.21.15.192:6824/1041494458,v1:172.21.15.192:6825/1041494458]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T21:12:29.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:28 smithi154 ceph-mon[35041]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T21:12:29.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:28 smithi192 ceph-mon[35363]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:12:29.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:28 smithi192 ceph-mon[35363]: from='osd.11 [v2:172.21.15.192:6824/1041494458,v1:172.21.15.192:6825/1041494458]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T21:12:29.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:28 smithi192 ceph-mon[35363]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T21:12:29.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.531+0000 7f9f03f91640 1 -- 172.21.15.59:0/1989090023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9efc075b20 msgr2=0x7f9efc075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:29.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.531+0000 7f9f03f91640 1 --2- 172.21.15.59:0/1989090023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9efc075b20 0x7f9efc075fa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9eec009900 tx=0x7f9eec02a3f0 comp rx=0 tx=0).stop 2024-09-10T21:12:29.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.531+0000 7f9f03f91640 1 -- 172.21.15.59:0/1989090023 shutdown_connections 2024-09-10T21:12:29.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.531+0000 7f9f03f91640 1 --2- 172.21.15.59:0/1989090023 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9efc10a970 0x7f9efc10ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:29.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.531+0000 7f9f03f91640 1 --2- 172.21.15.59:0/1989090023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9efc075b20 0x7f9efc075fa0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:29.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.531+0000 7f9f03f91640 1 --2- 172.21.15.59:0/1989090023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9efc076f80 0x7f9efc0755e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:29.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.531+0000 7f9f03f91640 1 -- 172.21.15.59:0/1989090023 >> 172.21.15.59:0/1989090023 conn(0x7f9efc0fe2f0 msgr2=0x7f9efc100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:29.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.531+0000 7f9f03f91640 1 -- 172.21.15.59:0/1989090023 shutdown_connections 2024-09-10T21:12:29.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.531+0000 7f9f03f91640 1 -- 172.21.15.59:0/1989090023 wait complete. 2024-09-10T21:12:29.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.532+0000 7f9f03f91640 1 Processor -- start 2024-09-10T21:12:29.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.532+0000 7f9f03f91640 1 -- start start 2024-09-10T21:12:29.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.532+0000 7f9f03f91640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9efc075b20 0x7f9efc19aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:29.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.532+0000 7f9f03f91640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9efc076f80 0x7f9efc19b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:29.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.532+0000 7f9f03f91640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9efc10a970 0x7f9efc19c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:29.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.532+0000 7f9f03f91640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc110880 con 0x7f9efc10a970 2024-09-10T21:12:29.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.532+0000 7f9f03f91640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc110700 con 0x7f9efc076f80 2024-09-10T21:12:29.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.532+0000 7f9f03f91640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc110a00 con 0x7f9efc075b20 2024-09-10T21:12:29.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.532+0000 7f9f0252e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9efc10a970 0x7f9efc19c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:29.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.532+0000 7f9f0252e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9efc10a970 0x7f9efc19c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54402/0 (socket says 172.21.15.59:54402) 2024-09-10T21:12:29.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.532+0000 7f9f0252e640 1 -- 172.21.15.59:0/971271770 learned_addr learned my addr 172.21.15.59:0/971271770 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:12:29.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.532+0000 7f9f0152c640 1 --2- 172.21.15.59:0/971271770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9efc076f80 0x7f9efc19b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:29.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.532+0000 7f9f01d2d640 1 --2- 172.21.15.59:0/971271770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9efc075b20 0x7f9efc19aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:29.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.532+0000 7f9f0252e640 1 -- 172.21.15.59:0/971271770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9efc075b20 msgr2=0x7f9efc19aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.532+0000 7f9f0252e640 1 --2- 172.21.15.59:0/971271770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9efc075b20 0x7f9efc19aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.532+0000 7f9f0252e640 1 -- 172.21.15.59:0/971271770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9efc076f80 msgr2=0x7f9efc19b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.532+0000 7f9f0252e640 1 --2- 172.21.15.59:0/971271770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9efc076f80 0x7f9efc19b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.532+0000 7f9f0252e640 1 -- 172.21.15.59:0/971271770 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9efc19ca20 con 0x7f9efc10a970 2024-09-10T21:12:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.533+0000 7f9f0252e640 1 --2- 172.21.15.59:0/971271770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9efc10a970 0x7f9efc19c180 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400cce0 tx=0x7f9ef400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.533+0000 7f9ef2ffd640 1 -- 172.21.15.59:0/971271770 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef400f450 con 0x7f9efc10a970 2024-09-10T21:12:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.533+0000 7f9ef2ffd640 1 -- 172.21.15.59:0/971271770 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ef400faa0 con 0x7f9efc10a970 2024-09-10T21:12:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.533+0000 7f9f03f91640 1 -- 172.21.15.59:0/971271770 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9efc19cd10 con 0x7f9efc10a970 2024-09-10T21:12:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.533+0000 7f9ef2ffd640 1 -- 172.21.15.59:0/971271770 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4018b70 con 0x7f9efc10a970 2024-09-10T21:12:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.533+0000 7f9f03f91640 1 -- 172.21.15.59:0/971271770 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9efc1a33f0 con 0x7f9efc10a970 2024-09-10T21:12:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.534+0000 7f9f03f91640 1 -- 172.21.15.59:0/971271770 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9efc109780 con 0x7f9efc10a970 2024-09-10T21:12:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.535+0000 7f9ef2ffd640 1 -- 172.21.15.59:0/971271770 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f9ef400f5f0 con 0x7f9efc10a970 2024-09-10T21:12:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.536+0000 7f9ef2ffd640 1 --2- 172.21.15.59:0/971271770 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9ee80b52e0 0x7f9ee80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.536+0000 7f9f01d2d640 1 --2- 172.21.15.59:0/971271770 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9ee80b52e0 0x7f9ee80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:29.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.536+0000 7f9ef2ffd640 1 -- 172.21.15.59:0/971271770 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6831+0+0 (secure 0 0 0) 0x7f9ef40e5ee0 con 0x7f9efc10a970 2024-09-10T21:12:29.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.537+0000 7f9f01d2d640 1 --2- 172.21.15.59:0/971271770 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9ee80b52e0 0x7f9ee80b77a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8005e10 tx=0x7f9ef8005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:29.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.539+0000 7f9ef2ffd640 1 -- 172.21.15.59:0/971271770 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9ef4014030 con 0x7f9efc10a970 2024-09-10T21:12:29.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.726+0000 7f9f03f91640 1 -- 172.21.15.59:0/971271770 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f9efc02e830 con 0x7f9efc10a970 2024-09-10T21:12:29.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.726+0000 7f9ef2ffd640 1 -- 172.21.15.59:0/971271770 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v65) ==== 74+0+133 (secure 0 0 0) 0x7f9ef40ad400 con 0x7f9efc10a970 2024-09-10T21:12:29.730 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:12:29.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.728+0000 7f9f03f91640 1 -- 172.21.15.59:0/971271770 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9ee80b52e0 msgr2=0x7f9ee80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:29.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.728+0000 7f9f03f91640 1 --2- 172.21.15.59:0/971271770 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9ee80b52e0 0x7f9ee80b77a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8005e10 tx=0x7f9ef8005da0 comp rx=0 tx=0).stop 2024-09-10T21:12:29.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.728+0000 7f9f03f91640 1 -- 172.21.15.59:0/971271770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9efc10a970 msgr2=0x7f9efc19c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:29.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.728+0000 7f9f03f91640 1 --2- 172.21.15.59:0/971271770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9efc10a970 0x7f9efc19c180 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400cce0 tx=0x7f9ef400a620 comp rx=0 tx=0).stop 2024-09-10T21:12:29.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.728+0000 7f9f03f91640 1 -- 172.21.15.59:0/971271770 shutdown_connections 2024-09-10T21:12:29.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.728+0000 7f9f03f91640 1 --2- 172.21.15.59:0/971271770 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9ee80b52e0 0x7f9ee80b77a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:29.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.728+0000 7f9f03f91640 1 --2- 172.21.15.59:0/971271770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9efc10a970 0x7f9efc19c180 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:29.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.728+0000 7f9f03f91640 1 --2- 172.21.15.59:0/971271770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9efc076f80 0x7f9efc19b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:29.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.728+0000 7f9f03f91640 1 --2- 172.21.15.59:0/971271770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9efc075b20 0x7f9efc19aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:29.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.728+0000 7f9f03f91640 1 -- 172.21.15.59:0/971271770 >> 172.21.15.59:0/971271770 conn(0x7f9efc0fe2f0 msgr2=0x7f9efc106950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:29.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.728+0000 7f9f03f91640 1 -- 172.21.15.59:0/971271770 shutdown_connections 2024-09-10T21:12:29.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:29.728+0000 7f9f03f91640 1 -- 172.21.15.59:0/971271770 wait complete. 2024-09-10T21:12:30.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:29 smithi059 ceph-mon[30888]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T21:12:30.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:29 smithi059 ceph-mon[30888]: Detected new or changed devices on smithi192 2024-09-10T21:12:30.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:29 smithi059 ceph-mon[30888]: osdmap e65: 12 total, 11 up, 12 in 2024-09-10T21:12:30.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:12:30.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:29 smithi059 ceph-mon[30888]: from='osd.11 [v2:172.21.15.192:6824/1041494458,v1:172.21.15.192:6825/1041494458]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:12:30.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:29 smithi059 ceph-mon[30888]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:12:30.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:30.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:30.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:30.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:30.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:30.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:30.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:29 smithi059 ceph-mon[30888]: Adjusting osd_memory_target on smithi192 to 4272M 2024-09-10T21:12:30.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:30.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:30.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:12:30.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:30.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:29 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/971271770' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T21:12:30.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:29 smithi154 ceph-mon[35041]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T21:12:30.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:29 smithi154 ceph-mon[35041]: Detected new or changed devices on smithi192 2024-09-10T21:12:30.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:29 smithi154 ceph-mon[35041]: osdmap e65: 12 total, 11 up, 12 in 2024-09-10T21:12:30.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:29 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:12:30.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:29 smithi154 ceph-mon[35041]: from='osd.11 [v2:172.21.15.192:6824/1041494458,v1:172.21.15.192:6825/1041494458]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:12:30.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:29 smithi154 ceph-mon[35041]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:12:30.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:29 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:30.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:29 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:30.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:29 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:30.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:29 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:30.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:29 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:30.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:29 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:30.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:29 smithi154 ceph-mon[35041]: Adjusting osd_memory_target on smithi192 to 4272M 2024-09-10T21:12:30.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:29 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:30.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:29 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:30.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:29 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:12:30.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:29 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:30.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:29 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/971271770' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T21:12:30.234 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:29 smithi192 ceph-mon[35363]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T21:12:30.234 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:29 smithi192 ceph-mon[35363]: Detected new or changed devices on smithi192 2024-09-10T21:12:30.234 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:29 smithi192 ceph-mon[35363]: osdmap e65: 12 total, 11 up, 12 in 2024-09-10T21:12:30.234 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:29 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:12:30.234 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:29 smithi192 ceph-mon[35363]: from='osd.11 [v2:172.21.15.192:6824/1041494458,v1:172.21.15.192:6825/1041494458]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:12:30.234 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:29 smithi192 ceph-mon[35363]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-10T21:12:30.234 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:29 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:30.234 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:29 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:30.234 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:29 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:30.235 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:29 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:30.235 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:29 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:30.235 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:29 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T21:12:30.235 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:29 smithi192 ceph-mon[35363]: Adjusting osd_memory_target on smithi192 to 4272M 2024-09-10T21:12:30.235 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:29 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:30.235 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:29 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:30.235 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:29 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:12:30.235 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:29 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:30.235 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:29 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/971271770' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T21:12:30.444 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":65,"num_osds":12,"num_up_osds":11,"osd_up_since":1726002725,"num_in_osds":12,"osd_in_since":1726002728,"num_remapped_pgs":0} 2024-09-10T21:12:31.078 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:12:30 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:12:30.815+0000 7fb48ac69640 -1 osd.11 0 waiting for initial osdmap 2024-09-10T21:12:31.078 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:12:30 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:12:30.967+0000 7fb482a88640 -1 osd.11 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T21:12:31.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:30 smithi192 ceph-mon[35363]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:12:31.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:30 smithi192 ceph-mon[35363]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-10T21:12:31.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:30 smithi192 ceph-mon[35363]: osdmap e66: 12 total, 11 up, 12 in 2024-09-10T21:12:31.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:30 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:12:31.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:30 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:12:31.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:30 smithi192 ceph-mon[35363]: from='osd.11 ' entity='osd.11' 2024-09-10T21:12:31.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:30 smithi154 ceph-mon[35041]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:12:31.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:30 smithi154 ceph-mon[35041]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-10T21:12:31.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:30 smithi154 ceph-mon[35041]: osdmap e66: 12 total, 11 up, 12 in 2024-09-10T21:12:31.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:30 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:12:31.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:30 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:12:31.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:30 smithi154 ceph-mon[35041]: from='osd.11 ' entity='osd.11' 2024-09-10T21:12:31.413 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:30 smithi059 ceph-mon[30888]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:12:31.413 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:30 smithi059 ceph-mon[30888]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-10T21:12:31.413 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:30 smithi059 ceph-mon[30888]: osdmap e66: 12 total, 11 up, 12 in 2024-09-10T21:12:31.413 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:30 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:12:31.413 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:30 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:12:31.413 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:30 smithi059 ceph-mon[30888]: from='osd.11 ' entity='osd.11' 2024-09-10T21:12:31.446 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T21:12:31.715 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:12:32.126 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:31 smithi059 ceph-mon[30888]: purged_snaps scrub starts 2024-09-10T21:12:32.126 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:31 smithi059 ceph-mon[30888]: purged_snaps scrub ok 2024-09-10T21:12:32.126 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:12:32.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:31 smithi154 ceph-mon[35041]: purged_snaps scrub starts 2024-09-10T21:12:32.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:31 smithi154 ceph-mon[35041]: purged_snaps scrub ok 2024-09-10T21:12:32.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:12:32.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.204+0000 7f1c430d0640 1 -- 172.21.15.59:0/3775327518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c3c103ba0 msgr2=0x7f1c3c104020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:32.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.204+0000 7f1c430d0640 1 --2- 172.21.15.59:0/3775327518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c3c103ba0 0x7f1c3c104020 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009cd0 tx=0x7f1c2c02a8e0 comp rx=0 tx=0).stop 2024-09-10T21:12:32.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.204+0000 7f1c430d0640 1 -- 172.21.15.59:0/3775327518 shutdown_connections 2024-09-10T21:12:32.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.204+0000 7f1c430d0640 1 --2- 172.21.15.59:0/3775327518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c3c104560 0x7f1c3c10aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:32.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.204+0000 7f1c430d0640 1 --2- 172.21.15.59:0/3775327518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c3c103ba0 0x7f1c3c104020 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:32.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.204+0000 7f1c430d0640 1 --2- 172.21.15.59:0/3775327518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c3c102a40 0x7f1c3c102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:32.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.204+0000 7f1c430d0640 1 -- 172.21.15.59:0/3775327518 >> 172.21.15.59:0/3775327518 conn(0x7f1c3c0fe2f0 msgr2=0x7f1c3c100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.204+0000 7f1c430d0640 1 -- 172.21.15.59:0/3775327518 shutdown_connections 2024-09-10T21:12:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.204+0000 7f1c430d0640 1 -- 172.21.15.59:0/3775327518 wait complete. 2024-09-10T21:12:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.205+0000 7f1c430d0640 1 Processor -- start 2024-09-10T21:12:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.205+0000 7f1c430d0640 1 -- start start 2024-09-10T21:12:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.205+0000 7f1c430d0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c3c102a40 0x7f1c3c198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.205+0000 7f1c430d0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c3c103ba0 0x7f1c3c1994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.205+0000 7f1c430d0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c3c104560 0x7f1c3c19a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.205+0000 7f1c430d0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3c10e6c0 con 0x7f1c3c102a40 2024-09-10T21:12:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.205+0000 7f1c430d0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3c10e540 con 0x7f1c3c104560 2024-09-10T21:12:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.205+0000 7f1c430d0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3c10e840 con 0x7f1c3c103ba0 2024-09-10T21:12:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.205+0000 7f1c40e6c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c3c102a40 0x7f1c3c198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.205+0000 7f1c40e6c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c3c102a40 0x7f1c3c198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54428/0 (socket says 172.21.15.59:54428) 2024-09-10T21:12:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.205+0000 7f1c40e6c640 1 -- 172.21.15.59:0/683987633 learned_addr learned my addr 172.21.15.59:0/683987633 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:12:32.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.205+0000 7f1c3bfff640 1 --2- 172.21.15.59:0/683987633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c3c103ba0 0x7f1c3c1994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:32.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.205+0000 7f1c4166d640 1 --2- 172.21.15.59:0/683987633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c3c104560 0x7f1c3c19a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:32.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.205+0000 7f1c40e6c640 1 -- 172.21.15.59:0/683987633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c3c103ba0 msgr2=0x7f1c3c1994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:32.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.205+0000 7f1c40e6c640 1 --2- 172.21.15.59:0/683987633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c3c103ba0 0x7f1c3c1994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:32.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.205+0000 7f1c40e6c640 1 -- 172.21.15.59:0/683987633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c3c104560 msgr2=0x7f1c3c19a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:32.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.205+0000 7f1c40e6c640 1 --2- 172.21.15.59:0/683987633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c3c104560 0x7f1c3c19a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:32.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.205+0000 7f1c40e6c640 1 -- 172.21.15.59:0/683987633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3c19a990 con 0x7f1c3c102a40 2024-09-10T21:12:32.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.205+0000 7f1c4166d640 1 --2- 172.21.15.59:0/683987633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c3c104560 0x7f1c3c19a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:12:32.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.206+0000 7f1c40e6c640 1 --2- 172.21.15.59:0/683987633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c3c102a40 0x7f1c3c198e60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400d770 tx=0x7f1c2400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:32.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.206+0000 7f1c39ffb640 1 -- 172.21.15.59:0/683987633 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c24017070 con 0x7f1c3c102a40 2024-09-10T21:12:32.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.206+0000 7f1c430d0640 1 -- 172.21.15.59:0/683987633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c3c19ac80 con 0x7f1c3c102a40 2024-09-10T21:12:32.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.206+0000 7f1c39ffb640 1 -- 172.21.15.59:0/683987633 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c240054d0 con 0x7f1c3c102a40 2024-09-10T21:12:32.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.206+0000 7f1c39ffb640 1 -- 172.21.15.59:0/683987633 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c24004c30 con 0x7f1c3c102a40 2024-09-10T21:12:32.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.206+0000 7f1c430d0640 1 -- 172.21.15.59:0/683987633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c3c1a1360 con 0x7f1c3c102a40 2024-09-10T21:12:32.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.207+0000 7f1c430d0640 1 -- 172.21.15.59:0/683987633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c3c109d40 con 0x7f1c3c102a40 2024-09-10T21:12:32.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.208+0000 7f1c39ffb640 1 -- 172.21.15.59:0/683987633 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f1c24004e10 con 0x7f1c3c102a40 2024-09-10T21:12:32.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.209+0000 7f1c39ffb640 1 --2- 172.21.15.59:0/683987633 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1c280b52e0 0x7f1c280b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:32.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.209+0000 7f1c3bfff640 1 --2- 172.21.15.59:0/683987633 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1c280b52e0 0x7f1c280b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:32.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.209+0000 7f1c39ffb640 1 -- 172.21.15.59:0/683987633 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7127+0+0 (secure 0 0 0) 0x7f1c240e52d0 con 0x7f1c3c102a40 2024-09-10T21:12:32.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.210+0000 7f1c3bfff640 1 --2- 172.21.15.59:0/683987633 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1c280b52e0 0x7f1c280b77a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c006010 tx=0x7f1c2c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:32.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.213+0000 7f1c39ffb640 1 -- 172.21.15.59:0/683987633 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1c240ac590 con 0x7f1c3c102a40 2024-09-10T21:12:32.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:31 smithi192 ceph-mon[35363]: purged_snaps scrub starts 2024-09-10T21:12:32.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:31 smithi192 ceph-mon[35363]: purged_snaps scrub ok 2024-09-10T21:12:32.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:12:32.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.399+0000 7f1c430d0640 1 -- 172.21.15.59:0/683987633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1c3c063d50 con 0x7f1c3c102a40 2024-09-10T21:12:32.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.399+0000 7f1c39ffb640 1 -- 172.21.15.59:0/683987633 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7f1c240abe90 con 0x7f1c3c102a40 2024-09-10T21:12:32.404 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:12:32.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.402+0000 7f1c430d0640 1 -- 172.21.15.59:0/683987633 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1c280b52e0 msgr2=0x7f1c280b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:32.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.402+0000 7f1c430d0640 1 --2- 172.21.15.59:0/683987633 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1c280b52e0 0x7f1c280b77a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c006010 tx=0x7f1c2c004a40 comp rx=0 tx=0).stop 2024-09-10T21:12:32.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.402+0000 7f1c430d0640 1 -- 172.21.15.59:0/683987633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c3c102a40 msgr2=0x7f1c3c198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:32.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.402+0000 7f1c430d0640 1 --2- 172.21.15.59:0/683987633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c3c102a40 0x7f1c3c198e60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400d770 tx=0x7f1c2400dc30 comp rx=0 tx=0).stop 2024-09-10T21:12:32.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.402+0000 7f1c430d0640 1 -- 172.21.15.59:0/683987633 shutdown_connections 2024-09-10T21:12:32.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.402+0000 7f1c430d0640 1 --2- 172.21.15.59:0/683987633 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1c280b52e0 0x7f1c280b77a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:32.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.402+0000 7f1c430d0640 1 --2- 172.21.15.59:0/683987633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c3c104560 0x7f1c3c19a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:32.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.402+0000 7f1c430d0640 1 --2- 172.21.15.59:0/683987633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1c3c103ba0 0x7f1c3c1994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:32.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.402+0000 7f1c430d0640 1 --2- 172.21.15.59:0/683987633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c3c102a40 0x7f1c3c198e60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:32.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.402+0000 7f1c430d0640 1 -- 172.21.15.59:0/683987633 >> 172.21.15.59:0/683987633 conn(0x7f1c3c0fe2f0 msgr2=0x7f1c3c106f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:32.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.402+0000 7f1c430d0640 1 -- 172.21.15.59:0/683987633 shutdown_connections 2024-09-10T21:12:32.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:32.402+0000 7f1c430d0640 1 -- 172.21.15.59:0/683987633 wait complete. 2024-09-10T21:12:33.041 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":67,"num_osds":12,"num_up_osds":12,"osd_up_since":1726002751,"num_in_osds":12,"osd_in_since":1726002728,"num_remapped_pgs":0} 2024-09-10T21:12:33.042 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:12:33.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:32 smithi059 ceph-mon[30888]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:12:33.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:32 smithi059 ceph-mon[30888]: osd.11 [v2:172.21.15.192:6824/1041494458,v1:172.21.15.192:6825/1041494458] boot 2024-09-10T21:12:33.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:32 smithi059 ceph-mon[30888]: osdmap e67: 12 total, 12 up, 12 in 2024-09-10T21:12:33.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:32 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:12:33.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:32 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/683987633' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T21:12:33.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:32 smithi154 ceph-mon[35041]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:12:33.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:32 smithi154 ceph-mon[35041]: osd.11 [v2:172.21.15.192:6824/1041494458,v1:172.21.15.192:6825/1041494458] boot 2024-09-10T21:12:33.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:32 smithi154 ceph-mon[35041]: osdmap e67: 12 total, 12 up, 12 in 2024-09-10T21:12:33.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:32 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:12:33.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:32 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/683987633' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T21:12:33.297 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:12:33.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:32 smithi192 ceph-mon[35363]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T21:12:33.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:32 smithi192 ceph-mon[35363]: osd.11 [v2:172.21.15.192:6824/1041494458,v1:172.21.15.192:6825/1041494458] boot 2024-09-10T21:12:33.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:32 smithi192 ceph-mon[35363]: osdmap e67: 12 total, 12 up, 12 in 2024-09-10T21:12:33.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:32 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T21:12:33.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:32 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/683987633' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T21:12:33.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.736+0000 7f7fe47fd640 1 -- 172.21.15.59:0/43357222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fdc102dc0 msgr2=0x7f7fdc1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:33.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.736+0000 7f7fe47fd640 1 --2- 172.21.15.59:0/43357222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fdc102dc0 0x7f7fdc1031a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8009900 tx=0x7f7fd802a410 comp rx=0 tx=0).stop 2024-09-10T21:12:33.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.737+0000 7f7fe47fd640 1 -- 172.21.15.59:0/43357222 shutdown_connections 2024-09-10T21:12:33.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.737+0000 7f7fe47fd640 1 --2- 172.21.15.59:0/43357222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fdc109150 0x7f7fdc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:33.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.737+0000 7f7fe47fd640 1 --2- 172.21.15.59:0/43357222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fdc1087d0 0x7f7fdc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:33.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.737+0000 7f7fe47fd640 1 --2- 172.21.15.59:0/43357222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fdc102dc0 0x7f7fdc1031a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:33.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.737+0000 7f7fe47fd640 1 -- 172.21.15.59:0/43357222 >> 172.21.15.59:0/43357222 conn(0x7f7fdc0fe830 msgr2=0x7f7fdc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:33.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.737+0000 7f7fe47fd640 1 -- 172.21.15.59:0/43357222 shutdown_connections 2024-09-10T21:12:33.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.737+0000 7f7fe47fd640 1 -- 172.21.15.59:0/43357222 wait complete. 2024-09-10T21:12:33.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.737+0000 7f7fe47fd640 1 Processor -- start 2024-09-10T21:12:33.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.737+0000 7f7fe47fd640 1 -- start start 2024-09-10T21:12:33.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.738+0000 7f7fe47fd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fdc102dc0 0x7f7fdc199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:33.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.738+0000 7f7fe47fd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fdc1087d0 0x7f7fdc199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:33.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.738+0000 7f7fe47fd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fdc109150 0x7f7fdc19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:33.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.738+0000 7f7fe47fd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc112dd0 con 0x7f7fdc102dc0 2024-09-10T21:12:33.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.738+0000 7f7fe47fd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc112c50 con 0x7f7fdc109150 2024-09-10T21:12:33.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.738+0000 7f7fe47fd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc112f50 con 0x7f7fdc1087d0 2024-09-10T21:12:33.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.738+0000 7f7fe2599640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fdc102dc0 0x7f7fdc199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:33.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.738+0000 7f7fe2599640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fdc102dc0 0x7f7fdc199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54446/0 (socket says 172.21.15.59:54446) 2024-09-10T21:12:33.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.738+0000 7f7fe2599640 1 -- 172.21.15.59:0/2405862602 learned_addr learned my addr 172.21.15.59:0/2405862602 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:12:33.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.738+0000 7f7fe1d98640 1 --2- 172.21.15.59:0/2405862602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fdc1087d0 0x7f7fdc199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:33.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.738+0000 7f7fe2d9a640 1 --2- 172.21.15.59:0/2405862602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fdc109150 0x7f7fdc19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:33.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.738+0000 7f7fe2599640 1 -- 172.21.15.59:0/2405862602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fdc1087d0 msgr2=0x7f7fdc199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:33.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.738+0000 7f7fe2599640 1 --2- 172.21.15.59:0/2405862602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fdc1087d0 0x7f7fdc199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:33.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.738+0000 7f7fe2599640 1 -- 172.21.15.59:0/2405862602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fdc109150 msgr2=0x7f7fdc19eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:33.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.738+0000 7f7fe2599640 1 --2- 172.21.15.59:0/2405862602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fdc109150 0x7f7fdc19eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:33.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.738+0000 7f7fe2599640 1 -- 172.21.15.59:0/2405862602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fdc19f2f0 con 0x7f7fdc102dc0 2024-09-10T21:12:33.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.739+0000 7f7fe2599640 1 --2- 172.21.15.59:0/2405862602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fdc102dc0 0x7f7fdc199240 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8005940 tx=0x7f7fd80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:33.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.739+0000 7f7fd37fe640 1 -- 172.21.15.59:0/2405862602 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd803f030 con 0x7f7fdc102dc0 2024-09-10T21:12:33.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.739+0000 7f7fd37fe640 1 -- 172.21.15.59:0/2405862602 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fd8003cb0 con 0x7f7fdc102dc0 2024-09-10T21:12:33.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.739+0000 7f7fe47fd640 1 -- 172.21.15.59:0/2405862602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fdc19f580 con 0x7f7fdc102dc0 2024-09-10T21:12:33.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.739+0000 7f7fd37fe640 1 -- 172.21.15.59:0/2405862602 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8035070 con 0x7f7fdc102dc0 2024-09-10T21:12:33.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.739+0000 7f7fe47fd640 1 -- 172.21.15.59:0/2405862602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fdc1a5ca0 con 0x7f7fdc102dc0 2024-09-10T21:12:33.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.740+0000 7f7fe47fd640 1 -- 172.21.15.59:0/2405862602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fdc1031a0 con 0x7f7fdc102dc0 2024-09-10T21:12:33.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.741+0000 7f7fd37fe640 1 -- 172.21.15.59:0/2405862602 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f7fd8003800 con 0x7f7fdc102dc0 2024-09-10T21:12:33.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.742+0000 7f7fd37fe640 1 --2- 172.21.15.59:0/2405862602 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7fc80b5360 0x7f7fc80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:33.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.742+0000 7f7fe1d98640 1 --2- 172.21.15.59:0/2405862602 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7fc80b5360 0x7f7fc80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:33.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.742+0000 7f7fd37fe640 1 -- 172.21.15.59:0/2405862602 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f7fd8105e80 con 0x7f7fdc102dc0 2024-09-10T21:12:33.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.742+0000 7f7fe1d98640 1 --2- 172.21.15.59:0/2405862602 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7fc80b5360 0x7f7fc80b7820 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc005e10 tx=0x7f7fcc005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:33.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.746+0000 7f7fd37fe640 1 -- 172.21.15.59:0/2405862602 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7fd80cd1e0 con 0x7f7fdc102dc0 2024-09-10T21:12:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.934+0000 7f7fe47fd640 1 -- 172.21.15.59:0/2405862602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7fdc10af30 con 0x7f7fdc102dc0 2024-09-10T21:12:33.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.936+0000 7f7fd37fe640 1 -- 172.21.15.59:0/2405862602 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+18493 (secure 0 0 0) 0x7f7fd80ccae0 con 0x7f7fdc102dc0 2024-09-10T21:12:33.940 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:12:33.941 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":68,"fsid":"3c26b952-6fb8-11ef-bcea-c7b262605968","created":"2024-09-10T21:05:18.196881+0000","modified":"2024-09-10T21:12:32.918905+0000","last_up_change":"2024-09-10T21:12:31.909004+0000","last_in_change":"2024-09-10T21:12:08.116727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:08:47.611285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e88abf3-8592-4b5f-8ba9-5969e01e12d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6803","nonce":1237328951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6805","nonce":1237328951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6809","nonce":1237328951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6807","nonce":1237328951}]},"public_addr":"172.21.15.59:6803/1237328951","cluster_addr":"172.21.15.59:6805/1237328951","heartbeat_back_addr":"172.21.15.59:6809/1237328951","heartbeat_front_addr":"172.21.15.59:6807/1237328951","state":["exists","up"]},{"osd":1,"uuid":"7908eefd-bbfa-4fe4-9db9-7a92d0e77acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6801","nonce":3376412264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6803","nonce":3376412264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6807","nonce":3376412264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6805","nonce":3376412264}]},"public_addr":"172.21.15.154:6801/3376412264","cluster_addr":"172.21.15.154:6803/3376412264","heartbeat_back_addr":"172.21.15.154:6807/3376412264","heartbeat_front_addr":"172.21.15.154:6805/3376412264","state":["exists","up"]},{"osd":2,"uuid":"2351b9f0-bca1-48b2-afb8-0e2b7856c52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6801","nonce":440750253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6803","nonce":440750253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6807","nonce":440750253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6805","nonce":440750253}]},"public_addr":"172.21.15.192:6801/440750253","cluster_addr":"172.21.15.192:6803/440750253","heartbeat_back_addr":"172.21.15.192:6807/440750253","heartbeat_front_addr":"172.21.15.192:6805/440750253","state":["exists","up"]},{"osd":3,"uuid":"f26969d1-7b48-4f20-9077-c55c59775ed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6811","nonce":1483798393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6813","nonce":1483798393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6817","nonce":1483798393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6815","nonce":1483798393}]},"public_addr":"172.21.15.59:6811/1483798393","cluster_addr":"172.21.15.59:6813/1483798393","heartbeat_back_addr":"172.21.15.59:6817/1483798393","heartbeat_front_addr":"172.21.15.59:6815/1483798393","state":["exists","up"]},{"osd":4,"uuid":"21e1a472-1ae1-454b-aee5-2ad92f6eff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6809","nonce":1817188525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6811","nonce":1817188525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6815","nonce":1817188525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6813","nonce":1817188525}]},"public_addr":"172.21.15.154:6809/1817188525","cluster_addr":"172.21.15.154:6811/1817188525","heartbeat_back_addr":"172.21.15.154:6815/1817188525","heartbeat_front_addr":"172.21.15.154:6813/1817188525","state":["exists","up"]},{"osd":5,"uuid":"6191b10a-5cbd-4225-b0ec-70d05023d5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6809","nonce":1221386274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6811","nonce":1221386274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6815","nonce":1221386274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6813","nonce":1221386274}]},"public_addr":"172.21.15.192:6809/1221386274","cluster_addr":"172.21.15.192:6811/1221386274","heartbeat_back_addr":"172.21.15.192:6815/1221386274","heartbeat_front_addr":"172.21.15.192:6813/1221386274","state":["exists","up"]},{"osd":6,"uuid":"609c11f7-ce82-4714-bf73-a4f16f4483ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6819","nonce":3006857566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6821","nonce":3006857566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6825","nonce":3006857566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6823","nonce":3006857566}]},"public_addr":"172.21.15.59:6819/3006857566","cluster_addr":"172.21.15.59:6821/3006857566","heartbeat_back_addr":"172.21.15.59:6825/3006857566","heartbeat_front_addr":"172.21.15.59:6823/3006857566","state":["exists","up"]},{"osd":7,"uuid":"bff3a29f-47cc-4e66-92e4-14e9b7faf498","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6817","nonce":175260385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6819","nonce":175260385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6823","nonce":175260385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6821","nonce":175260385}]},"public_addr":"172.21.15.154:6817/175260385","cluster_addr":"172.21.15.154:6819/175260385","heartbeat_back_addr":"172.21.15.154:6823/175260385","heartbeat_front_addr":"172.21.15.154:6821/175260385","state":["exists","up"]},{"osd":8,"uuid":"56dabafd-9bb9-409a-88cd-4b5b5ecf810a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6817","nonce":3138189462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6819","nonce":3138189462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6823","nonce":3138189462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6821","nonce":3138189462}]},"public_addr":"172.21.15.192:6817/3138189462","cluster_addr":"172.21.15.192:6819/3138189462","heartbeat_back_addr":"172.21.15.192:6823/3138189462","heartbeat_front_addr":"172.21.15.192:6821/3138189462","state":["exists","up"]},{"osd":9,"uuid":"044f934d-3df5-47aa-85f5-c3b63b267ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6827","nonce":2446500753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6829","nonce":2446500753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6833","nonce":2446500753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6831","nonce":2446500753}]},"public_addr":"172.21.15.59:6827/2446500753","cluster_addr":"172.21.15.59:6829/2446500753","heartbeat_back_addr":"172.21.15.59:6833/2446500753","heartbeat_front_addr":"172.21.15.59:6831/2446500753","state":["exists","up"]},{"osd":10,"uuid":"8d3b735b-e4fe-4a8e-8c75-a49313c6fabb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6825","nonce":1139781446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6827","nonce":1139781446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6831","nonce":1139781446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6829","nonce":1139781446}]},"public_addr":"172.21.15.154:6825/1139781446","cluster_addr":"172.21.15.154:6827/1139781446","heartbeat_back_addr":"172.21.15.154:6831/1139781446","heartbeat_front_addr":"172.21.15.154:6829/1139781446","state":["exists","up"]},{"osd":11,"uuid":"fd6a6d06-c6aa-42e3-aa38-fc583319f6bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6825","nonce":1041494458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6827","nonce":1041494458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6831","nonce":1041494458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6829","nonce":1041494458}]},"public_addr":"172.21.15.192:6825/1041494458","cluster_addr":"172.21.15.192:6827/1041494458","heartbeat_back_addr":"172.21.15.192:6831/1041494458","heartbeat_front_addr":"172.21.15.192:6829/1041494458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:07:53.974382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:19.552358+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:44.251670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:09.430992+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:34.043343+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:59.903679+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:25.733171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:49.795257+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:14.485648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:40.485165+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:04.655475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:29.308456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/212243638":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/3305207692":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6801/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/2965147556":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/1174570395":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/2934865748":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:6801/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/3377179776":"2024-09-11T21:05:40.304807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:12:33.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.939+0000 7f7fe47fd640 1 -- 172.21.15.59:0/2405862602 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7fc80b5360 msgr2=0x7f7fc80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:33.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.939+0000 7f7fe47fd640 1 --2- 172.21.15.59:0/2405862602 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7fc80b5360 0x7f7fc80b7820 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc005e10 tx=0x7f7fcc005da0 comp rx=0 tx=0).stop 2024-09-10T21:12:33.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.939+0000 7f7fe47fd640 1 -- 172.21.15.59:0/2405862602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fdc102dc0 msgr2=0x7f7fdc199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:33.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.939+0000 7f7fe47fd640 1 --2- 172.21.15.59:0/2405862602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fdc102dc0 0x7f7fdc199240 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8005940 tx=0x7f7fd80042f0 comp rx=0 tx=0).stop 2024-09-10T21:12:33.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.939+0000 7f7fe47fd640 1 -- 172.21.15.59:0/2405862602 shutdown_connections 2024-09-10T21:12:33.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.939+0000 7f7fe47fd640 1 --2- 172.21.15.59:0/2405862602 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7fc80b5360 0x7f7fc80b7820 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:33.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.939+0000 7f7fe47fd640 1 --2- 172.21.15.59:0/2405862602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7fdc109150 0x7f7fdc19eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:33.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.939+0000 7f7fe47fd640 1 --2- 172.21.15.59:0/2405862602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fdc1087d0 0x7f7fdc199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:33.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.939+0000 7f7fe47fd640 1 --2- 172.21.15.59:0/2405862602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fdc102dc0 0x7f7fdc199240 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:33.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.939+0000 7f7fe47fd640 1 -- 172.21.15.59:0/2405862602 >> 172.21.15.59:0/2405862602 conn(0x7f7fdc0fe830 msgr2=0x7f7fdc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:33.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.939+0000 7f7fe47fd640 1 -- 172.21.15.59:0/2405862602 shutdown_connections 2024-09-10T21:12:33.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:33.939+0000 7f7fe47fd640 1 -- 172.21.15.59:0/2405862602 wait complete. 2024-09-10T21:12:34.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:33 smithi059 ceph-mon[30888]: osdmap e68: 12 total, 12 up, 12 in 2024-09-10T21:12:34.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:33 smithi192 ceph-mon[35363]: osdmap e68: 12 total, 12 up, 12 in 2024-09-10T21:12:34.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:33 smithi154 ceph-mon[35041]: osdmap e68: 12 total, 12 up, 12 in 2024-09-10T21:12:34.602 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T21:08:47.611285+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T21:12:34.602 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T21:12:34.859 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:12:35.239 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:34 smithi059 ceph-mon[30888]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:35.239 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:34 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2405862602' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:12:35.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:34 smithi192 ceph-mon[35363]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:35.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:34 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2405862602' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:12:35.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.319+0000 7fb0ddc88640 1 -- 172.21.15.59:0/2925110276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d81076a0 msgr2=0x7fb0d8107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:35.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.319+0000 7fb0ddc88640 1 --2- 172.21.15.59:0/2925110276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d81076a0 0x7fb0d8107ae0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0009900 tx=0x7fb0c002a410 comp rx=0 tx=0).stop 2024-09-10T21:12:35.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.319+0000 7fb0ddc88640 1 -- 172.21.15.59:0/2925110276 shutdown_connections 2024-09-10T21:12:35.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.319+0000 7fb0ddc88640 1 --2- 172.21.15.59:0/2925110276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d8108020 0x7fb0d810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:35.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.319+0000 7fb0ddc88640 1 --2- 172.21.15.59:0/2925110276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d81076a0 0x7fb0d8107ae0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:35.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.319+0000 7fb0ddc88640 1 --2- 172.21.15.59:0/2925110276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0d8101c90 0x7fb0d8102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:35.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.319+0000 7fb0ddc88640 1 -- 172.21.15.59:0/2925110276 >> 172.21.15.59:0/2925110276 conn(0x7fb0d80fd700 msgr2=0x7fb0d80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:35.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.319+0000 7fb0ddc88640 1 -- 172.21.15.59:0/2925110276 shutdown_connections 2024-09-10T21:12:35.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.319+0000 7fb0ddc88640 1 -- 172.21.15.59:0/2925110276 wait complete. 2024-09-10T21:12:35.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.320+0000 7fb0ddc88640 1 Processor -- start 2024-09-10T21:12:35.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.320+0000 7fb0ddc88640 1 -- start start 2024-09-10T21:12:35.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.320+0000 7fb0ddc88640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d8101c90 0x7fb0d81992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:35.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.320+0000 7fb0ddc88640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d81076a0 0x7fb0d8199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:35.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.320+0000 7fb0ddc88640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0d8108020 0x7fb0d819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:35.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.320+0000 7fb0ddc88640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d8111ca0 con 0x7fb0d8101c90 2024-09-10T21:12:35.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.320+0000 7fb0ddc88640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d8111b20 con 0x7fb0d8108020 2024-09-10T21:12:35.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.320+0000 7fb0ddc88640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d8111e20 con 0x7fb0d81076a0 2024-09-10T21:12:35.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.321+0000 7fb0d77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d8101c90 0x7fb0d81992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:35.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.321+0000 7fb0d77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d8101c90 0x7fb0d81992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54452/0 (socket says 172.21.15.59:54452) 2024-09-10T21:12:35.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.321+0000 7fb0d77fe640 1 -- 172.21.15.59:0/89704538 learned_addr learned my addr 172.21.15.59:0/89704538 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:12:35.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.321+0000 7fb0d7fff640 1 --2- 172.21.15.59:0/89704538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0d8108020 0x7fb0d819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:35.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.321+0000 7fb0d6ffd640 1 --2- 172.21.15.59:0/89704538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d81076a0 0x7fb0d8199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:35.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.321+0000 7fb0d77fe640 1 -- 172.21.15.59:0/89704538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d81076a0 msgr2=0x7fb0d8199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:35.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.321+0000 7fb0d77fe640 1 --2- 172.21.15.59:0/89704538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d81076a0 0x7fb0d8199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:35.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.321+0000 7fb0d77fe640 1 -- 172.21.15.59:0/89704538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0d8108020 msgr2=0x7fb0d819eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:35.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.321+0000 7fb0d77fe640 1 --2- 172.21.15.59:0/89704538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0d8108020 0x7fb0d819eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:35.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.321+0000 7fb0d77fe640 1 -- 172.21.15.59:0/89704538 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d819f370 con 0x7fb0d8101c90 2024-09-10T21:12:35.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.321+0000 7fb0d77fe640 1 --2- 172.21.15.59:0/89704538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d8101c90 0x7fb0d81992c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb0c800eab0 tx=0x7fb0c800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:35.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.321+0000 7fb0d4ff9640 1 -- 172.21.15.59:0/89704538 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c800ce40 con 0x7fb0d8101c90 2024-09-10T21:12:35.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.321+0000 7fb0d4ff9640 1 -- 172.21.15.59:0/89704538 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0c8011920 con 0x7fb0d8101c90 2024-09-10T21:12:35.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.321+0000 7fb0ddc88640 1 -- 172.21.15.59:0/89704538 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d819f660 con 0x7fb0d8101c90 2024-09-10T21:12:35.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.321+0000 7fb0d4ff9640 1 -- 172.21.15.59:0/89704538 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8010a30 con 0x7fb0d8101c90 2024-09-10T21:12:35.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.321+0000 7fb0ddc88640 1 -- 172.21.15.59:0/89704538 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d81a5ef0 con 0x7fb0d8101c90 2024-09-10T21:12:35.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.323+0000 7fb0ddc88640 1 -- 172.21.15.59:0/89704538 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d8102070 con 0x7fb0d8101c90 2024-09-10T21:12:35.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.324+0000 7fb0d4ff9640 1 -- 172.21.15.59:0/89704538 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fb0c800f040 con 0x7fb0d8101c90 2024-09-10T21:12:35.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.324+0000 7fb0d4ff9640 1 --2- 172.21.15.59:0/89704538 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb0c40b5360 0x7fb0c40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:35.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.325+0000 7fb0d6ffd640 1 --2- 172.21.15.59:0/89704538 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb0c40b5360 0x7fb0c40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:35.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.325+0000 7fb0d4ff9640 1 -- 172.21.15.59:0/89704538 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fb0c80e5a60 con 0x7fb0d8101c90 2024-09-10T21:12:35.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.325+0000 7fb0d6ffd640 1 --2- 172.21.15.59:0/89704538 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb0c40b5360 0x7fb0c40b7820 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0031440 tx=0x7fb0c00095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:35.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.329+0000 7fb0d4ff9640 1 -- 172.21.15.59:0/89704538 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb0c8016030 con 0x7fb0d8101c90 2024-09-10T21:12:35.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:34 smithi154 ceph-mon[35041]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:35.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:34 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2405862602' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:12:35.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.514+0000 7fb0ddc88640 1 -- 172.21.15.59:0/89704538 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb0d81a6190 con 0x7fb0d8101c90 2024-09-10T21:12:35.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.514+0000 7fb0d4ff9640 1 -- 172.21.15.59:0/89704538 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) ==== 93+0+10 (secure 0 0 0) 0x7fb0c80acd20 con 0x7fb0d8101c90 2024-09-10T21:12:35.518 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-09-10T21:12:35.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.516+0000 7fb0ddc88640 1 -- 172.21.15.59:0/89704538 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb0c40b5360 msgr2=0x7fb0c40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:35.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.516+0000 7fb0ddc88640 1 --2- 172.21.15.59:0/89704538 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb0c40b5360 0x7fb0c40b7820 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0031440 tx=0x7fb0c00095f0 comp rx=0 tx=0).stop 2024-09-10T21:12:35.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.516+0000 7fb0ddc88640 1 -- 172.21.15.59:0/89704538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d8101c90 msgr2=0x7fb0d81992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:35.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.516+0000 7fb0ddc88640 1 --2- 172.21.15.59:0/89704538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d8101c90 0x7fb0d81992c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb0c800eab0 tx=0x7fb0c800ef70 comp rx=0 tx=0).stop 2024-09-10T21:12:35.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.516+0000 7fb0ddc88640 1 -- 172.21.15.59:0/89704538 shutdown_connections 2024-09-10T21:12:35.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.516+0000 7fb0ddc88640 1 --2- 172.21.15.59:0/89704538 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb0c40b5360 0x7fb0c40b7820 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:35.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.516+0000 7fb0ddc88640 1 --2- 172.21.15.59:0/89704538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0d8108020 0x7fb0d819eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:35.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.516+0000 7fb0ddc88640 1 --2- 172.21.15.59:0/89704538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d81076a0 0x7fb0d8199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:35.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.516+0000 7fb0ddc88640 1 --2- 172.21.15.59:0/89704538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0d8101c90 0x7fb0d81992c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:35.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.516+0000 7fb0ddc88640 1 -- 172.21.15.59:0/89704538 >> 172.21.15.59:0/89704538 conn(0x7fb0d80fd700 msgr2=0x7fb0d81047a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:35.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.516+0000 7fb0ddc88640 1 -- 172.21.15.59:0/89704538 shutdown_connections 2024-09-10T21:12:35.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:35.517+0000 7fb0ddc88640 1 -- 172.21.15.59:0/89704538 wait complete. 2024-09-10T21:12:36.151 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:35 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/89704538' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T21:12:36.182 INFO:tasks.cephadm:Adding mds.a on smithi059 2024-09-10T21:12:36.182 INFO:tasks.cephadm:Adding mds.d on smithi059 2024-09-10T21:12:36.182 INFO:tasks.cephadm:Adding mds.g on smithi059 2024-09-10T21:12:36.182 INFO:tasks.cephadm:Adding mds.j on smithi059 2024-09-10T21:12:36.182 INFO:tasks.cephadm:Adding mds.b on smithi154 2024-09-10T21:12:36.182 INFO:tasks.cephadm:Adding mds.e on smithi154 2024-09-10T21:12:36.182 INFO:tasks.cephadm:Adding mds.h on smithi154 2024-09-10T21:12:36.183 INFO:tasks.cephadm:Adding mds.k on smithi154 2024-09-10T21:12:36.183 INFO:tasks.cephadm:Adding mds.c on smithi192 2024-09-10T21:12:36.183 INFO:tasks.cephadm:Adding mds.f on smithi192 2024-09-10T21:12:36.183 INFO:tasks.cephadm:Adding mds.i on smithi192 2024-09-10T21:12:36.183 INFO:tasks.cephadm:Adding mds.l on smithi192 2024-09-10T21:12:36.183 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l' 2024-09-10T21:12:36.211 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:35 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/89704538' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T21:12:36.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:35 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/89704538' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T21:12:36.442 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:12:36.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.858+0000 7fd226dba640 1 -- 172.21.15.192:0/1188060059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd220102a30 msgr2=0x7fd220102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:36.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.858+0000 7fd226dba640 1 --2- 172.21.15.192:0/1188060059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd220102a30 0x7fd220102e30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd214009960 tx=0x7fd21402a460 comp rx=0 tx=0).stop 2024-09-10T21:12:36.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.858+0000 7fd226dba640 1 -- 172.21.15.192:0/1188060059 shutdown_connections 2024-09-10T21:12:36.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.858+0000 7fd226dba640 1 --2- 172.21.15.192:0/1188060059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd220104550 0x7fd22010aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:36.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.858+0000 7fd226dba640 1 --2- 172.21.15.192:0/1188060059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd220103b90 0x7fd220104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:36.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.858+0000 7fd226dba640 1 --2- 172.21.15.192:0/1188060059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd220102a30 0x7fd220102e30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.858+0000 7fd226dba640 1 -- 172.21.15.192:0/1188060059 >> 172.21.15.192:0/1188060059 conn(0x7fd2200fe320 msgr2=0x7fd220100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.858+0000 7fd226dba640 1 -- 172.21.15.192:0/1188060059 shutdown_connections 2024-09-10T21:12:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.858+0000 7fd226dba640 1 -- 172.21.15.192:0/1188060059 wait complete. 2024-09-10T21:12:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.859+0000 7fd226dba640 1 Processor -- start 2024-09-10T21:12:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.859+0000 7fd226dba640 1 -- start start 2024-09-10T21:12:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.859+0000 7fd226dba640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd220102a30 0x7fd22019b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.859+0000 7fd226dba640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd220103b90 0x7fd22019b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.859+0000 7fd226dba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd220104550 0x7fd22019c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.859+0000 7fd226dba640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd22010e710 con 0x7fd220102a30 2024-09-10T21:12:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.859+0000 7fd226dba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd22010e590 con 0x7fd220104550 2024-09-10T21:12:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.859+0000 7fd226dba640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd22010e890 con 0x7fd220103b90 2024-09-10T21:12:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.859+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd220103b90 0x7fd22019b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.859+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd220103b90 0x7fd22019b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53212/0 (socket says 172.21.15.192:53212) 2024-09-10T21:12:36.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.859+0000 7fd21ffff640 1 -- 172.21.15.192:0/1370396491 learned_addr learned my addr 172.21.15.192:0/1370396491 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-10T21:12:36.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.859+0000 7fd224b56640 1 --2- 172.21.15.192:0/1370396491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd220102a30 0x7fd22019b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:36.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.859+0000 7fd225357640 1 --2- 172.21.15.192:0/1370396491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd220104550 0x7fd22019c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:36.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.859+0000 7fd21ffff640 1 -- 172.21.15.192:0/1370396491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd220104550 msgr2=0x7fd22019c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:36.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.859+0000 7fd21ffff640 1 --2- 172.21.15.192:0/1370396491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd220104550 0x7fd22019c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:36.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.859+0000 7fd21ffff640 1 -- 172.21.15.192:0/1370396491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd220102a30 msgr2=0x7fd22019b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:36.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.859+0000 7fd21ffff640 1 --2- 172.21.15.192:0/1370396491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd220102a30 0x7fd22019b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:36.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.859+0000 7fd21ffff640 1 -- 172.21.15.192:0/1370396491 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd22019cc00 con 0x7fd220103b90 2024-09-10T21:12:36.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.859+0000 7fd21ffff640 1 --2- 172.21.15.192:0/1370396491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd220103b90 0x7fd22019b720 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00c890 tx=0x7fd20c00cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:36.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.860+0000 7fd21dffb640 1 -- 172.21.15.192:0/1370396491 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c004220 con 0x7fd220103b90 2024-09-10T21:12:36.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.860+0000 7fd226dba640 1 -- 172.21.15.192:0/1370396491 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd22019cef0 con 0x7fd220103b90 2024-09-10T21:12:36.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.860+0000 7fd21dffb640 1 -- 172.21.15.192:0/1370396491 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd20c0043c0 con 0x7fd220103b90 2024-09-10T21:12:36.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.860+0000 7fd21dffb640 1 -- 172.21.15.192:0/1370396491 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c004a00 con 0x7fd220103b90 2024-09-10T21:12:36.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.860+0000 7fd226dba640 1 -- 172.21.15.192:0/1370396491 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2201a35d0 con 0x7fd220103b90 2024-09-10T21:12:36.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.861+0000 7fd226dba640 1 -- 172.21.15.192:0/1370396491 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2201a3860 con 0x7fd220103b90 2024-09-10T21:12:36.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.862+0000 7fd21dffb640 1 -- 172.21.15.192:0/1370396491 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fd20c0079b0 con 0x7fd220103b90 2024-09-10T21:12:36.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.863+0000 7fd21dffb640 1 --2- 172.21.15.192:0/1370396491 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2100b52e0 0x7fd2100b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:36.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.863+0000 7fd21dffb640 1 -- 172.21.15.192:0/1370396491 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fd20c0e54b0 con 0x7fd220103b90 2024-09-10T21:12:36.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.863+0000 7fd224b56640 1 --2- 172.21.15.192:0/1370396491 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2100b52e0 0x7fd2100b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:36.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.864+0000 7fd224b56640 1 --2- 172.21.15.192:0/1370396491 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2100b52e0 0x7fd2100b77a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd214006010 tx=0x7fd214005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:36.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:36.867+0000 7fd21dffb640 1 -- 172.21.15.192:0/1370396491 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd20c014030 con 0x7fd220103b90 2024-09-10T21:12:37.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:37.063+0000 7fd226dba640 1 -- 172.21.15.192:0/1370396491 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}) -- 0x7fd220109a30 con 0x7fd2100b52e0 2024-09-10T21:12:37.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:37.072+0000 7fd21dffb640 1 -- 172.21.15.192:0/1370396491 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fd220109a30 con 0x7fd2100b52e0 2024-09-10T21:12:37.077 INFO:teuthology.orchestra.run.smithi192.stdout:Scheduled mds.all update... 2024-09-10T21:12:37.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:37.075+0000 7fd226dba640 1 -- 172.21.15.192:0/1370396491 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2100b52e0 msgr2=0x7fd2100b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:37.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:37.075+0000 7fd226dba640 1 --2- 172.21.15.192:0/1370396491 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2100b52e0 0x7fd2100b77a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd214006010 tx=0x7fd214005d50 comp rx=0 tx=0).stop 2024-09-10T21:12:37.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:37.075+0000 7fd226dba640 1 -- 172.21.15.192:0/1370396491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd220103b90 msgr2=0x7fd22019b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:37.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:37.075+0000 7fd226dba640 1 --2- 172.21.15.192:0/1370396491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd220103b90 0x7fd22019b720 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00c890 tx=0x7fd20c00cd50 comp rx=0 tx=0).stop 2024-09-10T21:12:37.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:37.075+0000 7fd226dba640 1 -- 172.21.15.192:0/1370396491 shutdown_connections 2024-09-10T21:12:37.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:37.075+0000 7fd226dba640 1 --2- 172.21.15.192:0/1370396491 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2100b52e0 0x7fd2100b77a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:37.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:37.075+0000 7fd226dba640 1 --2- 172.21.15.192:0/1370396491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd220104550 0x7fd22019c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:37.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:37.075+0000 7fd226dba640 1 --2- 172.21.15.192:0/1370396491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd220103b90 0x7fd22019b720 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:37.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:37.075+0000 7fd226dba640 1 --2- 172.21.15.192:0/1370396491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd220102a30 0x7fd22019b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:37.080 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:36 smithi192 ceph-mon[35363]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:37.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:37.075+0000 7fd226dba640 1 -- 172.21.15.192:0/1370396491 >> 172.21.15.192:0/1370396491 conn(0x7fd2200fe320 msgr2=0x7fd220109320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:37.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:37.075+0000 7fd226dba640 1 -- 172.21.15.192:0/1370396491 shutdown_connections 2024-09-10T21:12:37.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-10T21:12:37.075+0000 7fd226dba640 1 -- 172.21.15.192:0/1370396491 wait complete. 2024-09-10T21:12:37.206 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:36 smithi059 ceph-mon[30888]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:37.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:36 smithi154 ceph-mon[35041]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:37.820 DEBUG:teuthology.orchestra.run.smithi059:mds.a> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.a.service 2024-09-10T21:12:37.823 DEBUG:teuthology.orchestra.run.smithi059:mds.d> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.d.service 2024-09-10T21:12:37.867 DEBUG:teuthology.orchestra.run.smithi059:mds.g> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.g.service 2024-09-10T21:12:37.910 DEBUG:teuthology.orchestra.run.smithi059:mds.j> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.j.service 2024-09-10T21:12:37.953 DEBUG:teuthology.orchestra.run.smithi154:mds.b> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.b.service 2024-09-10T21:12:37.958 DEBUG:teuthology.orchestra.run.smithi154:mds.e> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.e.service 2024-09-10T21:12:38.002 DEBUG:teuthology.orchestra.run.smithi154:mds.h> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.h.service 2024-09-10T21:12:38.045 DEBUG:teuthology.orchestra.run.smithi154:mds.k> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.k.service 2024-09-10T21:12:38.088 DEBUG:teuthology.orchestra.run.smithi192:mds.c> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.c.service 2024-09-10T21:12:38.090 DEBUG:teuthology.orchestra.run.smithi192:mds.f> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.f.service 2024-09-10T21:12:38.133 DEBUG:teuthology.orchestra.run.smithi192:mds.i> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.i.service 2024-09-10T21:12:38.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:38 smithi059 ceph-mon[30888]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:12:38.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:38 smithi059 ceph-mon[30888]: Saving service mds.all spec with placement smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-09-10T21:12:38.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:38 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:38.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:38 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:12:38.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:38 smithi059 ceph-mon[30888]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:38.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:38 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:38.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:38 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:12:38.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:38 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:38.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:38 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:38.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:38 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:38.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:38 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:38.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:38 smithi059 ceph-mon[30888]: Deploying daemon mds.l on smithi192 2024-09-10T21:12:38.176 DEBUG:teuthology.orchestra.run.smithi192:mds.l> sudo journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.l.service 2024-09-10T21:12:38.220 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-10T21:12:38.221 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:12:38.268 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:38 smithi192 ceph-mon[35363]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:12:38.268 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:38 smithi192 ceph-mon[35363]: Saving service mds.all spec with placement smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-09-10T21:12:38.268 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:38 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:38.268 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:38 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:12:38.268 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:38 smithi192 ceph-mon[35363]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:38.268 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:38 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:38.268 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:38 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:12:38.268 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:38 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:38.268 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:38 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:38.268 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:38 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:38.269 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:38 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:38.269 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:38 smithi192 ceph-mon[35363]: Deploying daemon mds.l on smithi192 2024-09-10T21:12:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:38 smithi154 ceph-mon[35041]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:12:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:38 smithi154 ceph-mon[35041]: Saving service mds.all spec with placement smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-09-10T21:12:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:38 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:38 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:12:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:38 smithi154 ceph-mon[35041]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:38 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:38 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:12:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:38 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:38 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:38 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:38.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:38 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:38.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:38 smithi154 ceph-mon[35041]: Deploying daemon mds.l on smithi192 2024-09-10T21:12:38.482 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:12:38.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.917+0000 7f384a2c7640 1 -- 172.21.15.59:0/2561514199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3844102dc0 msgr2=0x7f38441031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:38.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.917+0000 7f384a2c7640 1 --2- 172.21.15.59:0/2561514199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3844102dc0 0x7f38441031a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3834009900 tx=0x7f383402a410 comp rx=0 tx=0).stop 2024-09-10T21:12:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.917+0000 7f384a2c7640 1 -- 172.21.15.59:0/2561514199 shutdown_connections 2024-09-10T21:12:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.917+0000 7f384a2c7640 1 --2- 172.21.15.59:0/2561514199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3844109150 0x7f384410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.917+0000 7f384a2c7640 1 --2- 172.21.15.59:0/2561514199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38441087d0 0x7f3844108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.917+0000 7f384a2c7640 1 --2- 172.21.15.59:0/2561514199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3844102dc0 0x7f38441031a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.917+0000 7f384a2c7640 1 -- 172.21.15.59:0/2561514199 >> 172.21.15.59:0/2561514199 conn(0x7f38440fe830 msgr2=0x7f3844100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.917+0000 7f384a2c7640 1 -- 172.21.15.59:0/2561514199 shutdown_connections 2024-09-10T21:12:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.918+0000 7f384a2c7640 1 -- 172.21.15.59:0/2561514199 wait complete. 2024-09-10T21:12:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.918+0000 7f384a2c7640 1 Processor -- start 2024-09-10T21:12:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.918+0000 7f384a2c7640 1 -- start start 2024-09-10T21:12:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.918+0000 7f384a2c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3844102dc0 0x7f3844199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f384a2c7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38441087d0 0x7f38441998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f384a2c7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3844109150 0x7f384419ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f384a2c7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3844112e10 con 0x7f3844109150 2024-09-10T21:12:38.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f384a2c7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3844112c90 con 0x7f3844102dc0 2024-09-10T21:12:38.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f384a2c7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3844112f90 con 0x7f38441087d0 2024-09-10T21:12:38.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f3848864640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3844109150 0x7f384419ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:38.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f3848864640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3844109150 0x7f384419ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54468/0 (socket says 172.21.15.59:54468) 2024-09-10T21:12:38.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f3848864640 1 -- 172.21.15.59:0/137595622 learned_addr learned my addr 172.21.15.59:0/137595622 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:12:38.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f3843fff640 1 --2- 172.21.15.59:0/137595622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3844102dc0 0x7f3844199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:38.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f38437fe640 1 --2- 172.21.15.59:0/137595622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38441087d0 0x7f38441998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:38.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f3848864640 1 -- 172.21.15.59:0/137595622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38441087d0 msgr2=0x7f38441998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:38.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f3848864640 1 --2- 172.21.15.59:0/137595622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38441087d0 0x7f38441998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:38.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f3848864640 1 -- 172.21.15.59:0/137595622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3844102dc0 msgr2=0x7f3844199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:38.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f3848864640 1 --2- 172.21.15.59:0/137595622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3844102dc0 0x7f3844199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:38.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f3848864640 1 -- 172.21.15.59:0/137595622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f384419f410 con 0x7f3844109150 2024-09-10T21:12:38.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f38437fe640 1 --2- 172.21.15.59:0/137595622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38441087d0 0x7f38441998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:12:38.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f3843fff640 1 --2- 172.21.15.59:0/137595622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3844102dc0 0x7f3844199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:12:38.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f3848864640 1 --2- 172.21.15.59:0/137595622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3844109150 0x7f384419ec40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f383c00eb10 tx=0x7f383c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:38.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f38417fa640 1 -- 172.21.15.59:0/137595622 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c004b20 con 0x7f3844109150 2024-09-10T21:12:38.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f38417fa640 1 -- 172.21.15.59:0/137595622 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f383c004cc0 con 0x7f3844109150 2024-09-10T21:12:38.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f38417fa640 1 -- 172.21.15.59:0/137595622 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c010670 con 0x7f3844109150 2024-09-10T21:12:38.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.919+0000 7f384a2c7640 1 -- 172.21.15.59:0/137595622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f384419f700 con 0x7f3844109150 2024-09-10T21:12:38.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.920+0000 7f384a2c7640 1 -- 172.21.15.59:0/137595622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38441a5dc0 con 0x7f3844109150 2024-09-10T21:12:38.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.921+0000 7f384a2c7640 1 -- 172.21.15.59:0/137595622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38441031a0 con 0x7f3844109150 2024-09-10T21:12:38.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.922+0000 7f38417fa640 1 -- 172.21.15.59:0/137595622 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f383c005000 con 0x7f3844109150 2024-09-10T21:12:38.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.923+0000 7f38417fa640 1 --2- 172.21.15.59:0/137595622 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f382c0b52e0 0x7f382c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:38.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.923+0000 7f3843fff640 1 --2- 172.21.15.59:0/137595622 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f382c0b52e0 0x7f382c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:38.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.923+0000 7f38417fa640 1 -- 172.21.15.59:0/137595622 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f383c0e5e50 con 0x7f3844109150 2024-09-10T21:12:38.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.923+0000 7f3843fff640 1 --2- 172.21.15.59:0/137595622 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f382c0b52e0 0x7f382c0b77a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3834031440 tx=0x7f3834005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:38.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:38.926+0000 7f38417fa640 1 -- 172.21.15.59:0/137595622 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f383c056220 con 0x7f3844109150 2024-09-10T21:12:39.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:39.161+0000 7f384a2c7640 1 -- 172.21.15.59:0/137595622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f384402e5c0 con 0x7f3844109150 2024-09-10T21:12:39.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:39.161+0000 7f38417fa640 1 -- 172.21.15.59:0/137595622 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f383c0a8020 con 0x7f3844109150 2024-09-10T21:12:39.165 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:12:39.166 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":1,"btime":"2024-09-10T21:05:18:196680+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-10T21:12:39.166 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 1 2024-09-10T21:12:39.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:39.163+0000 7f384a2c7640 1 -- 172.21.15.59:0/137595622 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f382c0b52e0 msgr2=0x7f382c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:39.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:39.163+0000 7f384a2c7640 1 --2- 172.21.15.59:0/137595622 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f382c0b52e0 0x7f382c0b77a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3834031440 tx=0x7f3834005b50 comp rx=0 tx=0).stop 2024-09-10T21:12:39.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:39.163+0000 7f384a2c7640 1 -- 172.21.15.59:0/137595622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3844109150 msgr2=0x7f384419ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:39.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:39.163+0000 7f384a2c7640 1 --2- 172.21.15.59:0/137595622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3844109150 0x7f384419ec40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f383c00eb10 tx=0x7f383c00c2d0 comp rx=0 tx=0).stop 2024-09-10T21:12:39.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:39.164+0000 7f384a2c7640 1 -- 172.21.15.59:0/137595622 shutdown_connections 2024-09-10T21:12:39.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:39.164+0000 7f384a2c7640 1 --2- 172.21.15.59:0/137595622 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f382c0b52e0 0x7f382c0b77a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:39.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:39.164+0000 7f384a2c7640 1 --2- 172.21.15.59:0/137595622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3844109150 0x7f384419ec40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:39.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:39.164+0000 7f384a2c7640 1 --2- 172.21.15.59:0/137595622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38441087d0 0x7f38441998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:39.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:39.164+0000 7f384a2c7640 1 --2- 172.21.15.59:0/137595622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3844102dc0 0x7f3844199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:39.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:39.164+0000 7f384a2c7640 1 -- 172.21.15.59:0/137595622 >> 172.21.15.59:0/137595622 conn(0x7f38440fe830 msgr2=0x7f3844100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:39.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:39.164+0000 7f384a2c7640 1 -- 172.21.15.59:0/137595622 shutdown_connections 2024-09-10T21:12:39.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:39.164+0000 7f384a2c7640 1 -- 172.21.15.59:0/137595622 wait complete. 2024-09-10T21:12:39.259 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:39 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/137595622' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:12:39.578 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 10 21:12:39 smithi192 systemd[1]: Starting Ceph mds.l for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:12:39.625 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:39 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/137595622' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:12:39.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:39 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/137595622' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:12:39.910 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 10 21:12:39 smithi192 podman[64140]: 2024-09-10 21:12:39.620210813 +0000 UTC m=+0.091934048 container create 28fd568548958029a72f975c57e24d6e5d3b8669b46a12956ed174354e8d1721 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:12:39.910 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 10 21:12:39 smithi192 podman[64140]: 2024-09-10 21:12:39.544187245 +0000 UTC m=+0.015910484 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:12:39.910 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 10 21:12:39 smithi192 podman[64140]: 2024-09-10 21:12:39.81443401 +0000 UTC m=+0.286157254 container init 28fd568548958029a72f975c57e24d6e5d3b8669b46a12956ed174354e8d1721 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-l, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T21:12:39.910 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 10 21:12:39 smithi192 podman[64140]: 2024-09-10 21:12:39.817276328 +0000 UTC m=+0.288999562 container start 28fd568548958029a72f975c57e24d6e5d3b8669b46a12956ed174354e8d1721 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-l, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-09-10T21:12:39.910 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 10 21:12:39 smithi192 ceph-mds[64159]: -- 172.21.15.192:0/1136306350 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563b76b3d860 con 0x563b76b1b000 2024-09-10T21:12:39.910 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 10 21:12:39 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-l[64155]: starting mds.l at 2024-09-10T21:12:39.910 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 10 21:12:39 smithi192 bash[64140]: 28fd568548958029a72f975c57e24d6e5d3b8669b46a12956ed174354e8d1721 2024-09-10T21:12:40.328 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 10 21:12:39 smithi192 systemd[1]: Started Ceph mds.l for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:12:41.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:40 smithi059 ceph-mon[30888]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:41.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:40 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.192:6832/2513372486,v1:172.21.15.192:6833/2513372486] up:boot 2024-09-10T21:12:41.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:40 smithi059 ceph-mon[30888]: fsmap 1 up:standby 2024-09-10T21:12:41.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T21:12:41.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:41.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:41.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:41.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:41.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:41.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:40 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:41.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:40 smithi059 ceph-mon[30888]: Deploying daemon mds.k on smithi154 2024-09-10T21:12:41.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:40 smithi154 ceph-mon[35041]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:41.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:40 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.192:6832/2513372486,v1:172.21.15.192:6833/2513372486] up:boot 2024-09-10T21:12:41.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:40 smithi154 ceph-mon[35041]: fsmap 1 up:standby 2024-09-10T21:12:41.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T21:12:41.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:41.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:41.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:41.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:41.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:41.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:40 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:41.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:40 smithi154 ceph-mon[35041]: Deploying daemon mds.k on smithi154 2024-09-10T21:12:41.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:40 smithi192 ceph-mon[35363]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:41.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:40 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.192:6832/2513372486,v1:172.21.15.192:6833/2513372486] up:boot 2024-09-10T21:12:41.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:40 smithi192 ceph-mon[35363]: fsmap 1 up:standby 2024-09-10T21:12:41.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T21:12:41.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:41.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:41.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:41.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:41.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:41.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:40 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:41.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:40 smithi192 ceph-mon[35363]: Deploying daemon mds.k on smithi154 2024-09-10T21:12:42.032 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:12:42.079 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 21:12:41 smithi154 systemd[1]: Starting Ceph mds.k for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:12:42.302 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:12:42.398 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 21:12:42 smithi154 podman[64006]: 2024-09-10 21:12:42.075257594 +0000 UTC m=+0.113614199 container create c0f664d5812a441020cda453daf5880f79fcccbcca4292ac08b01bdddb829ea5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-k, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:12:42.398 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 21:12:42 smithi154 podman[64006]: 2024-09-10 21:12:41.978309223 +0000 UTC m=+0.016665839 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:12:42.398 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 21:12:42 smithi154 podman[64006]: 2024-09-10 21:12:42.294442135 +0000 UTC m=+0.332798738 container init c0f664d5812a441020cda453daf5880f79fcccbcca4292ac08b01bdddb829ea5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T21:12:42.398 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 21:12:42 smithi154 podman[64006]: 2024-09-10 21:12:42.297321131 +0000 UTC m=+0.335677742 container start c0f664d5812a441020cda453daf5880f79fcccbcca4292ac08b01bdddb829ea5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-k, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-10T21:12:42.398 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 21:12:42 smithi154 ceph-mds[64025]: -- 172.21.15.154:0/3695643934 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f2d7b53860 con 0x55f2d7b31400 2024-09-10T21:12:42.398 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 21:12:42 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-k[64021]: starting mds.k at 2024-09-10T21:12:42.398 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 21:12:42 smithi154 bash[64006]: c0f664d5812a441020cda453daf5880f79fcccbcca4292ac08b01bdddb829ea5 2024-09-10T21:12:42.682 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 21:12:42 smithi154 systemd[1]: Started Ceph mds.k for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:12:42.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.749+0000 7ff7fc484640 1 -- 172.21.15.59:0/1934820192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7f41087d0 msgr2=0x7ff7f4108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:42.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.749+0000 7ff7fc484640 1 --2- 172.21.15.59:0/1934820192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7f41087d0 0x7ff7f4108c10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4009900 tx=0x7ff7e402a410 comp rx=0 tx=0).stop 2024-09-10T21:12:42.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.749+0000 7ff7fc484640 1 -- 172.21.15.59:0/1934820192 shutdown_connections 2024-09-10T21:12:42.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.749+0000 7ff7fc484640 1 --2- 172.21.15.59:0/1934820192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7f4109150 0x7ff7f410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:42.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.749+0000 7ff7fc484640 1 --2- 172.21.15.59:0/1934820192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7f41087d0 0x7ff7f4108c10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:42.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.749+0000 7ff7fc484640 1 --2- 172.21.15.59:0/1934820192 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f4102dc0 0x7ff7f41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:42.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.749+0000 7ff7fc484640 1 -- 172.21.15.59:0/1934820192 >> 172.21.15.59:0/1934820192 conn(0x7ff7f40fe830 msgr2=0x7ff7f4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:42.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.749+0000 7ff7fc484640 1 -- 172.21.15.59:0/1934820192 shutdown_connections 2024-09-10T21:12:42.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.749+0000 7ff7fc484640 1 -- 172.21.15.59:0/1934820192 wait complete. 2024-09-10T21:12:42.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.750+0000 7ff7fc484640 1 Processor -- start 2024-09-10T21:12:42.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.750+0000 7ff7fc484640 1 -- start start 2024-09-10T21:12:42.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.750+0000 7ff7fc484640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7f4102dc0 0x7ff7f4199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:42.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.750+0000 7ff7fc484640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7f41087d0 0x7ff7f4199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:42.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.750+0000 7ff7fc484640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f4109150 0x7ff7f419ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:42.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.750+0000 7ff7fc484640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f4112ea0 con 0x7ff7f4102dc0 2024-09-10T21:12:42.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.750+0000 7ff7fc484640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f4112d20 con 0x7ff7f41087d0 2024-09-10T21:12:42.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.750+0000 7ff7fc484640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f4113020 con 0x7ff7f4109150 2024-09-10T21:12:42.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.750+0000 7ff7fa220640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7f4102dc0 0x7ff7f4199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:42.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.750+0000 7ff7fa220640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7f4102dc0 0x7ff7f4199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38490/0 (socket says 172.21.15.59:38490) 2024-09-10T21:12:42.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.750+0000 7ff7fa220640 1 -- 172.21.15.59:0/545369597 learned_addr learned my addr 172.21.15.59:0/545369597 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:12:42.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.750+0000 7ff7f9a1f640 1 --2- 172.21.15.59:0/545369597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7f41087d0 0x7ff7f4199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:42.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.751+0000 7ff7fa220640 1 -- 172.21.15.59:0/545369597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f4109150 msgr2=0x7ff7f419ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:42.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.751+0000 7ff7fa220640 1 --2- 172.21.15.59:0/545369597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f4109150 0x7ff7f419ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:42.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.751+0000 7ff7fa220640 1 -- 172.21.15.59:0/545369597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7f41087d0 msgr2=0x7ff7f4199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:42.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.751+0000 7ff7fa220640 1 --2- 172.21.15.59:0/545369597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7f41087d0 0x7ff7f4199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:42.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.751+0000 7ff7fa220640 1 -- 172.21.15.59:0/545369597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f419f4c0 con 0x7ff7f4102dc0 2024-09-10T21:12:42.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.751+0000 7ff7fa220640 1 --2- 172.21.15.59:0/545369597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7f4102dc0 0x7ff7f4199410 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000b4a0 tx=0x7ff7f000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:42.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.751+0000 7ff7eb7fe640 1 -- 172.21.15.59:0/545369597 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0014070 con 0x7ff7f4102dc0 2024-09-10T21:12:42.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.751+0000 7ff7eb7fe640 1 -- 172.21.15.59:0/545369597 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7f0010ac0 con 0x7ff7f4102dc0 2024-09-10T21:12:42.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.751+0000 7ff7fc484640 1 -- 172.21.15.59:0/545369597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f419f7b0 con 0x7ff7f4102dc0 2024-09-10T21:12:42.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.751+0000 7ff7eb7fe640 1 -- 172.21.15.59:0/545369597 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0017c30 con 0x7ff7f4102dc0 2024-09-10T21:12:42.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.751+0000 7ff7fc484640 1 -- 172.21.15.59:0/545369597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f41a5e70 con 0x7ff7f4102dc0 2024-09-10T21:12:42.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.752+0000 7ff7fc484640 1 -- 172.21.15.59:0/545369597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f4103220 con 0x7ff7f4102dc0 2024-09-10T21:12:42.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.753+0000 7ff7eb7fe640 1 -- 172.21.15.59:0/545369597 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7ff7f0010610 con 0x7ff7f4102dc0 2024-09-10T21:12:42.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.755+0000 7ff7eb7fe640 1 --2- 172.21.15.59:0/545369597 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff7e00b52e0 0x7ff7e00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:42.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.755+0000 7ff7f9a1f640 1 --2- 172.21.15.59:0/545369597 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff7e00b52e0 0x7ff7e00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:42.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.755+0000 7ff7eb7fe640 1 -- 172.21.15.59:0/545369597 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7ff7f00e5200 con 0x7ff7f4102dc0 2024-09-10T21:12:42.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.755+0000 7ff7f9a1f640 1 --2- 172.21.15.59:0/545369597 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff7e00b52e0 0x7ff7e00b77a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4000c00 tx=0x7ff7e4031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:42.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.758+0000 7ff7eb7fe640 1 -- 172.21.15.59:0/545369597 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff7f00ac4c0 con 0x7ff7f4102dc0 2024-09-10T21:12:42.976 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:42 smithi059 ceph-mon[30888]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:42.976 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:42 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:42.976 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:42 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:42.976 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:42 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:42.976 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:42 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:42.976 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:42 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:42.976 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:42 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:42.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.989+0000 7ff7fc484640 1 -- 172.21.15.59:0/545369597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7f402e5c0 con 0x7ff7f4102dc0 2024-09-10T21:12:42.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.989+0000 7ff7eb7fe640 1 -- 172.21.15.59:0/545369597 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7ff7f00abdc0 con 0x7ff7f4102dc0 2024-09-10T21:12:42.993 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:12:42.993 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":3,"btime":"2024-09-10T21:12:42:849684+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24499,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T21:12:42.994 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 3 2024-09-10T21:12:42.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.991+0000 7ff7fc484640 1 -- 172.21.15.59:0/545369597 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff7e00b52e0 msgr2=0x7ff7e00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.991+0000 7ff7fc484640 1 --2- 172.21.15.59:0/545369597 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff7e00b52e0 0x7ff7e00b77a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4000c00 tx=0x7ff7e4031400 comp rx=0 tx=0).stop 2024-09-10T21:12:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.991+0000 7ff7fc484640 1 -- 172.21.15.59:0/545369597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7f4102dc0 msgr2=0x7ff7f4199410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.991+0000 7ff7fc484640 1 --2- 172.21.15.59:0/545369597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7f4102dc0 0x7ff7f4199410 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000b4a0 tx=0x7ff7f000b960 comp rx=0 tx=0).stop 2024-09-10T21:12:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.992+0000 7ff7fc484640 1 -- 172.21.15.59:0/545369597 shutdown_connections 2024-09-10T21:12:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.992+0000 7ff7fc484640 1 --2- 172.21.15.59:0/545369597 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff7e00b52e0 0x7ff7e00b77a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.992+0000 7ff7fc484640 1 --2- 172.21.15.59:0/545369597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f4109150 0x7ff7f419ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.992+0000 7ff7fc484640 1 --2- 172.21.15.59:0/545369597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7f41087d0 0x7ff7f4199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.992+0000 7ff7fc484640 1 --2- 172.21.15.59:0/545369597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7f4102dc0 0x7ff7f4199410 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.992+0000 7ff7fc484640 1 -- 172.21.15.59:0/545369597 >> 172.21.15.59:0/545369597 conn(0x7ff7f40fe830 msgr2=0x7ff7f4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.992+0000 7ff7fc484640 1 -- 172.21.15.59:0/545369597 shutdown_connections 2024-09-10T21:12:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:42.992+0000 7ff7fc484640 1 -- 172.21.15.59:0/545369597 wait complete. 2024-09-10T21:12:43.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:42 smithi154 ceph-mon[35041]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:43.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:42 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:43.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:42 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:43.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:42 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:43.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:42 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:43.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:42 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:43.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:42 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:43.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:42 smithi192 ceph-mon[35363]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:43.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:42 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:43.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:42 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:43.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:42 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:43.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:42 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:43.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:42 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:43.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:42 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:44.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:43 smithi059 ceph-mon[30888]: Deploying daemon mds.j on smithi059 2024-09-10T21:12:44.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:43 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.154:6832/2006948406,v1:172.21.15.154:6833/2006948406] up:boot 2024-09-10T21:12:44.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:43 smithi059 ceph-mon[30888]: fsmap 2 up:standby 2024-09-10T21:12:44.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:43 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T21:12:44.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:43 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/545369597' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:12:44.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:43 smithi154 ceph-mon[35041]: Deploying daemon mds.j on smithi059 2024-09-10T21:12:44.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:43 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.154:6832/2006948406,v1:172.21.15.154:6833/2006948406] up:boot 2024-09-10T21:12:44.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:43 smithi154 ceph-mon[35041]: fsmap 2 up:standby 2024-09-10T21:12:44.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:43 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T21:12:44.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:43 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/545369597' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:12:44.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:43 smithi192 ceph-mon[35363]: Deploying daemon mds.j on smithi059 2024-09-10T21:12:44.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:43 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.154:6832/2006948406,v1:172.21.15.154:6833/2006948406] up:boot 2024-09-10T21:12:44.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:43 smithi192 ceph-mon[35363]: fsmap 2 up:standby 2024-09-10T21:12:44.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:43 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T21:12:44.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:43 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/545369597' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:12:44.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:44 smithi059 ceph-mon[30888]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:44.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:44 smithi154 ceph-mon[35041]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:45.317 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 21:12:45 smithi059 systemd[1]: Starting Ceph mds.j for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:12:45.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:44 smithi192 ceph-mon[35363]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:45.627 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 21:12:45 smithi059 podman[72486]: 2024-09-10 21:12:45.313065428 +0000 UTC m=+0.107471098 container create 5956a89a0aebf4fcdc3d92e784292f549413f066888bd6072188aecc3b312a7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-j, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-10T21:12:45.627 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 21:12:45 smithi059 podman[72486]: 2024-09-10 21:12:45.222000768 +0000 UTC m=+0.016406445 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:12:45.628 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 21:12:45 smithi059 podman[72486]: 2024-09-10 21:12:45.523958173 +0000 UTC m=+0.318363840 container init 5956a89a0aebf4fcdc3d92e784292f549413f066888bd6072188aecc3b312a7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-10T21:12:45.628 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 21:12:45 smithi059 podman[72486]: 2024-09-10 21:12:45.526887393 +0000 UTC m=+0.321293058 container start 5956a89a0aebf4fcdc3d92e784292f549413f066888bd6072188aecc3b312a7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-j, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-10T21:12:45.628 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 21:12:45 smithi059 ceph-mds[72505]: -- 172.21.15.59:0/3090148618 <== mon.0 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5645ff0db860 con 0x5645ff0b9400 2024-09-10T21:12:45.628 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 21:12:45 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-j[72501]: starting mds.j at 2024-09-10T21:12:45.628 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 21:12:45 smithi059 bash[72486]: 5956a89a0aebf4fcdc3d92e784292f549413f066888bd6072188aecc3b312a7b 2024-09-10T21:12:45.911 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 21:12:45 smithi059 systemd[1]: Started Ceph mds.j for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:12:46.289 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:12:46.680 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:12:46.768 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:46 smithi059 ceph-mon[30888]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:46.769 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:46.769 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:46.769 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:46.769 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:46.769 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:46.769 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:46.769 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:46 smithi059 ceph-mon[30888]: Deploying daemon mds.d on smithi059 2024-09-10T21:12:46.769 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:46 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.59:6834/1242047500,v1:172.21.15.59:6835/1242047500] up:boot 2024-09-10T21:12:46.769 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:46 smithi059 ceph-mon[30888]: fsmap 3 up:standby 2024-09-10T21:12:46.769 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:46 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T21:12:46.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:46 smithi154 ceph-mon[35041]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:46.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:46 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:46.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:46 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:46.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:46 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:46.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:46 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:46.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:46 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:46.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:46 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:46.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:46 smithi154 ceph-mon[35041]: Deploying daemon mds.d on smithi059 2024-09-10T21:12:46.935 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:46 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.59:6834/1242047500,v1:172.21.15.59:6835/1242047500] up:boot 2024-09-10T21:12:46.935 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:46 smithi154 ceph-mon[35041]: fsmap 3 up:standby 2024-09-10T21:12:46.935 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:46 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T21:12:47.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:46 smithi192 ceph-mon[35363]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:47.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:47.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:47.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:47.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:47.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:47.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:47.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:46 smithi192 ceph-mon[35363]: Deploying daemon mds.d on smithi059 2024-09-10T21:12:47.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:46 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.59:6834/1242047500,v1:172.21.15.59:6835/1242047500] up:boot 2024-09-10T21:12:47.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:46 smithi192 ceph-mon[35363]: fsmap 3 up:standby 2024-09-10T21:12:47.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:46 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T21:12:47.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.643+0000 7f04c689f640 1 -- 172.21.15.59:0/250162989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c0104530 msgr2=0x7f04c010cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:47.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.643+0000 7f04c689f640 1 --2- 172.21.15.59:0/250162989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c0104530 0x7f04c010cb10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f04b4009900 tx=0x7f04b402a410 comp rx=0 tx=0).stop 2024-09-10T21:12:47.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.644+0000 7f04c689f640 1 -- 172.21.15.59:0/250162989 shutdown_connections 2024-09-10T21:12:47.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.644+0000 7f04c689f640 1 --2- 172.21.15.59:0/250162989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04c010d0e0 0x7f04c010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:47.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.644+0000 7f04c689f640 1 --2- 172.21.15.59:0/250162989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c0104530 0x7f04c010cb10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:47.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.644+0000 7f04c689f640 1 --2- 172.21.15.59:0/250162989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04c0103b30 0x7f04c0103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:47.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.644+0000 7f04c689f640 1 -- 172.21.15.59:0/250162989 >> 172.21.15.59:0/250162989 conn(0x7f04c00fd700 msgr2=0x7f04c00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:47.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.644+0000 7f04c689f640 1 -- 172.21.15.59:0/250162989 shutdown_connections 2024-09-10T21:12:47.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.644+0000 7f04c689f640 1 -- 172.21.15.59:0/250162989 wait complete. 2024-09-10T21:12:47.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.644+0000 7f04c689f640 1 Processor -- start 2024-09-10T21:12:47.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.644+0000 7f04c689f640 1 -- start start 2024-09-10T21:12:47.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.645+0000 7f04c689f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04c0103b30 0x7f04c0199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.645+0000 7f04c689f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c0104530 0x7f04c0199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.645+0000 7f04c689f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04c010d0e0 0x7f04c019eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.645+0000 7f04c689f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f04c0112d60 con 0x7f04c0104530 2024-09-10T21:12:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.645+0000 7f04c689f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f04c0112be0 con 0x7f04c0103b30 2024-09-10T21:12:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.645+0000 7f04c689f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f04c0112ee0 con 0x7f04c010d0e0 2024-09-10T21:12:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.645+0000 7f04bf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c0104530 0x7f04c0199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.645+0000 7f04bf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c0104530 0x7f04c0199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38538/0 (socket says 172.21.15.59:38538) 2024-09-10T21:12:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.645+0000 7f04bf7fe640 1 -- 172.21.15.59:0/2323036934 learned_addr learned my addr 172.21.15.59:0/2323036934 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:12:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.645+0000 7f04bffff640 1 --2- 172.21.15.59:0/2323036934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04c0103b30 0x7f04c0199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.645+0000 7f04c4e3c640 1 --2- 172.21.15.59:0/2323036934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04c010d0e0 0x7f04c019eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.645+0000 7f04bf7fe640 1 -- 172.21.15.59:0/2323036934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04c010d0e0 msgr2=0x7f04c019eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.645+0000 7f04bf7fe640 1 --2- 172.21.15.59:0/2323036934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04c010d0e0 0x7f04c019eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:47.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.645+0000 7f04bf7fe640 1 -- 172.21.15.59:0/2323036934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04c0103b30 msgr2=0x7f04c0199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.645+0000 7f04bf7fe640 1 --2- 172.21.15.59:0/2323036934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04c0103b30 0x7f04c0199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.645+0000 7f04bf7fe640 1 -- 172.21.15.59:0/2323036934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c019f300 con 0x7f04c0104530 2024-09-10T21:12:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.645+0000 7f04bf7fe640 1 --2- 172.21.15.59:0/2323036934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c0104530 0x7f04c0199790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f04b4005940 tx=0x7f04b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.646+0000 7f04bd7fa640 1 -- 172.21.15.59:0/2323036934 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b403f030 con 0x7f04c0104530 2024-09-10T21:12:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.646+0000 7f04bd7fa640 1 -- 172.21.15.59:0/2323036934 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04b4003cb0 con 0x7f04c0104530 2024-09-10T21:12:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.646+0000 7f04c689f640 1 -- 172.21.15.59:0/2323036934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04c019f590 con 0x7f04c0104530 2024-09-10T21:12:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.646+0000 7f04bd7fa640 1 -- 172.21.15.59:0/2323036934 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b4035070 con 0x7f04c0104530 2024-09-10T21:12:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.646+0000 7f04c689f640 1 -- 172.21.15.59:0/2323036934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04c01a5cb0 con 0x7f04c0104530 2024-09-10T21:12:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.647+0000 7f04c689f640 1 -- 172.21.15.59:0/2323036934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04c0103f10 con 0x7f04c0104530 2024-09-10T21:12:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.649+0000 7f04bd7fa640 1 -- 172.21.15.59:0/2323036934 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f04b403bbf0 con 0x7f04c0104530 2024-09-10T21:12:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.650+0000 7f04bd7fa640 1 --2- 172.21.15.59:0/2323036934 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f04a80b52e0 0x7f04a80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.650+0000 7f04bffff640 1 --2- 172.21.15.59:0/2323036934 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f04a80b52e0 0x7f04a80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.650+0000 7f04bd7fa640 1 -- 172.21.15.59:0/2323036934 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f04b4106480 con 0x7f04c0104530 2024-09-10T21:12:47.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.651+0000 7f04bffff640 1 --2- 172.21.15.59:0/2323036934 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f04a80b52e0 0x7f04a80b77a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f04b0005d00 tx=0x7f04b000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:47.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.653+0000 7f04bd7fa640 1 -- 172.21.15.59:0/2323036934 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f04b40cd190 con 0x7f04c0104530 2024-09-10T21:12:47.890 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:12:47.890 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":4,"btime":"2024-09-10T21:12:45:867419+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24499,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T21:12:47.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.885+0000 7f04c689f640 1 -- 172.21.15.59:0/2323036934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04c0108130 con 0x7f04c0104530 2024-09-10T21:12:47.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.885+0000 7f04bd7fa640 1 -- 172.21.15.59:0/2323036934 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7f04b40d1bc0 con 0x7f04c0104530 2024-09-10T21:12:47.891 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 4 2024-09-10T21:12:47.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.888+0000 7f04c689f640 1 -- 172.21.15.59:0/2323036934 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f04a80b52e0 msgr2=0x7f04a80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:47.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.888+0000 7f04c689f640 1 --2- 172.21.15.59:0/2323036934 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f04a80b52e0 0x7f04a80b77a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f04b0005d00 tx=0x7f04b000b410 comp rx=0 tx=0).stop 2024-09-10T21:12:47.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.888+0000 7f04c689f640 1 -- 172.21.15.59:0/2323036934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c0104530 msgr2=0x7f04c0199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:47.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.888+0000 7f04c689f640 1 --2- 172.21.15.59:0/2323036934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c0104530 0x7f04c0199790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f04b4005940 tx=0x7f04b40042f0 comp rx=0 tx=0).stop 2024-09-10T21:12:47.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.888+0000 7f04c689f640 1 -- 172.21.15.59:0/2323036934 shutdown_connections 2024-09-10T21:12:47.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.888+0000 7f04c689f640 1 --2- 172.21.15.59:0/2323036934 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f04a80b52e0 0x7f04a80b77a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:47.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.888+0000 7f04c689f640 1 --2- 172.21.15.59:0/2323036934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04c010d0e0 0x7f04c019eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:47.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.888+0000 7f04c689f640 1 --2- 172.21.15.59:0/2323036934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04c0104530 0x7f04c0199790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:47.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.888+0000 7f04c689f640 1 --2- 172.21.15.59:0/2323036934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f04c0103b30 0x7f04c0199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:47.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.888+0000 7f04c689f640 1 -- 172.21.15.59:0/2323036934 >> 172.21.15.59:0/2323036934 conn(0x7f04c00fd700 msgr2=0x7f04c00fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:47.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.888+0000 7f04c689f640 1 -- 172.21.15.59:0/2323036934 shutdown_connections 2024-09-10T21:12:47.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:47.888+0000 7f04c689f640 1 -- 172.21.15.59:0/2323036934 wait complete. 2024-09-10T21:12:48.842 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:48 smithi192 ceph-mon[35363]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:48.843 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:48 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2323036934' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:12:48.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:48 smithi154 ceph-mon[35041]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:48.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:48 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2323036934' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:12:48.954 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:48 smithi059 ceph-mon[30888]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:48.954 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:48 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2323036934' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:12:48.955 INFO:journalctl@ceph.mds.d.smithi059.stdout:Sep 10 21:12:48 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-d[72911]: starting mds.d at 2024-09-10T21:12:49.412 INFO:journalctl@ceph.mds.d.smithi059.stdout:Sep 10 21:12:48 smithi059 bash[72883]: d195de98ee051cbedeb958b934258e4eb61e02f423b6e607fbba2ee8ed4b2e2e 2024-09-10T21:12:49.412 INFO:journalctl@ceph.mds.d.smithi059.stdout:Sep 10 21:12:48 smithi059 systemd[1]: Started Ceph mds.d for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:12:50.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:50.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:50.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:50.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:50.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:50.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:50.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:50 smithi192 ceph-mon[35363]: Deploying daemon mds.e on smithi154 2024-09-10T21:12:50.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:50 smithi192 ceph-mon[35363]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:50.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:50 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.59:6836/90543201,v1:172.21.15.59:6837/90543201] up:boot 2024-09-10T21:12:50.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:50 smithi192 ceph-mon[35363]: fsmap 4 up:standby 2024-09-10T21:12:50.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:50 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T21:12:50.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:50.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:50.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:50.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:50.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:50.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:50.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:50 smithi154 ceph-mon[35041]: Deploying daemon mds.e on smithi154 2024-09-10T21:12:50.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:50 smithi154 ceph-mon[35041]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:50.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:50 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.59:6836/90543201,v1:172.21.15.59:6837/90543201] up:boot 2024-09-10T21:12:50.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:50 smithi154 ceph-mon[35041]: fsmap 4 up:standby 2024-09-10T21:12:50.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:50 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T21:12:50.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:50.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:50.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:50.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:50.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:50.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:50.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:50 smithi059 ceph-mon[30888]: Deploying daemon mds.e on smithi154 2024-09-10T21:12:50.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:50 smithi059 ceph-mon[30888]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:50.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:50 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.59:6836/90543201,v1:172.21.15.59:6837/90543201] up:boot 2024-09-10T21:12:50.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:50 smithi059 ceph-mon[30888]: fsmap 4 up:standby 2024-09-10T21:12:50.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:50 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T21:12:50.717 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:12:50.992 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:12:51.117 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 21:12:50 smithi154 systemd[1]: Starting Ceph mds.e for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:12:51.384 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 21:12:51 smithi154 podman[64319]: 2024-09-10 21:12:51.015990919 +0000 UTC m=+0.016218104 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:12:51.384 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 21:12:51 smithi154 podman[64319]: 2024-09-10 21:12:51.144799594 +0000 UTC m=+0.145026777 container create 0611dfb906c69e8f3b84fa810d4abf085622a1d5b04f491c4d95bb4fd1d7e2a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:12:51.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.462+0000 7fba8c1ad640 1 -- 172.21.15.59:0/971163539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba8410f420 msgr2=0x7fba84111810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:51.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.462+0000 7fba8c1ad640 1 --2- 172.21.15.59:0/971163539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba8410f420 0x7fba84111810 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009ca0 tx=0x7fba7c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:12:51.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.462+0000 7fba8c1ad640 1 -- 172.21.15.59:0/971163539 shutdown_connections 2024-09-10T21:12:51.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.462+0000 7fba8c1ad640 1 --2- 172.21.15.59:0/971163539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba8410f420 0x7fba84111810 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:51.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.462+0000 7fba8c1ad640 1 --2- 172.21.15.59:0/971163539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba84102190 0x7fba8410eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:51.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.462+0000 7fba8c1ad640 1 --2- 172.21.15.59:0/971163539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba84101870 0x7fba84101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:51.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.462+0000 7fba8c1ad640 1 -- 172.21.15.59:0/971163539 >> 172.21.15.59:0/971163539 conn(0x7fba840fd700 msgr2=0x7fba840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:51.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.463+0000 7fba8c1ad640 1 -- 172.21.15.59:0/971163539 shutdown_connections 2024-09-10T21:12:51.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.463+0000 7fba8c1ad640 1 -- 172.21.15.59:0/971163539 wait complete. 2024-09-10T21:12:51.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.463+0000 7fba8c1ad640 1 Processor -- start 2024-09-10T21:12:51.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.463+0000 7fba8c1ad640 1 -- start start 2024-09-10T21:12:51.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.463+0000 7fba8c1ad640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba84101870 0x7fba8419b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:51.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.463+0000 7fba8c1ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba84102190 0x7fba8419b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:51.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.463+0000 7fba8c1ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba8410f420 0x7fba841a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:51.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.463+0000 7fba8c1ad640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fba84114f60 con 0x7fba8410f420 2024-09-10T21:12:51.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.463+0000 7fba8c1ad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba84114de0 con 0x7fba84102190 2024-09-10T21:12:51.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.463+0000 7fba8c1ad640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fba841150e0 con 0x7fba84101870 2024-09-10T21:12:51.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.464+0000 7fba8a74a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba8410f420 0x7fba841a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:51.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.464+0000 7fba8a74a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba8410f420 0x7fba841a0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51894/0 (socket says 172.21.15.59:51894) 2024-09-10T21:12:51.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.464+0000 7fba8a74a640 1 -- 172.21.15.59:0/2077249197 learned_addr learned my addr 172.21.15.59:0/2077249197 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:12:51.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.464+0000 7fba89748640 1 --2- 172.21.15.59:0/2077249197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba84102190 0x7fba8419b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:51.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.464+0000 7fba89f49640 1 --2- 172.21.15.59:0/2077249197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba84101870 0x7fba8419b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:51.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.464+0000 7fba8a74a640 1 -- 172.21.15.59:0/2077249197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba84101870 msgr2=0x7fba8419b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:51.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.464+0000 7fba8a74a640 1 --2- 172.21.15.59:0/2077249197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba84101870 0x7fba8419b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:51.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.464+0000 7fba8a74a640 1 -- 172.21.15.59:0/2077249197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba84102190 msgr2=0x7fba8419b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:51.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.464+0000 7fba8a74a640 1 --2- 172.21.15.59:0/2077249197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba84102190 0x7fba8419b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:51.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.464+0000 7fba8a74a640 1 -- 172.21.15.59:0/2077249197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba841a14e0 con 0x7fba8410f420 2024-09-10T21:12:51.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.464+0000 7fba8a74a640 1 --2- 172.21.15.59:0/2077249197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba8410f420 0x7fba841a0d10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0319f0 tx=0x7fba7c031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:51.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.464+0000 7fba7affd640 1 -- 172.21.15.59:0/2077249197 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c003bf0 con 0x7fba8410f420 2024-09-10T21:12:51.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.464+0000 7fba7affd640 1 -- 172.21.15.59:0/2077249197 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba7c003d90 con 0x7fba8410f420 2024-09-10T21:12:51.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.464+0000 7fba7affd640 1 -- 172.21.15.59:0/2077249197 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c02fc00 con 0x7fba8410f420 2024-09-10T21:12:51.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.464+0000 7fba8c1ad640 1 -- 172.21.15.59:0/2077249197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba841a1770 con 0x7fba8410f420 2024-09-10T21:12:51.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.464+0000 7fba8c1ad640 1 -- 172.21.15.59:0/2077249197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba841a7e90 con 0x7fba8410f420 2024-09-10T21:12:51.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.465+0000 7fba8c1ad640 1 -- 172.21.15.59:0/2077249197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba84101c50 con 0x7fba8410f420 2024-09-10T21:12:51.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.467+0000 7fba7affd640 1 -- 172.21.15.59:0/2077249197 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fba7c004610 con 0x7fba8410f420 2024-09-10T21:12:51.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.467+0000 7fba7affd640 1 --2- 172.21.15.59:0/2077249197 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fba700b5360 0x7fba700b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:51.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.468+0000 7fba89f49640 1 --2- 172.21.15.59:0/2077249197 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fba700b5360 0x7fba700b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:51.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.468+0000 7fba7affd640 1 -- 172.21.15.59:0/2077249197 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fba7c106bd0 con 0x7fba8410f420 2024-09-10T21:12:51.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.468+0000 7fba89f49640 1 --2- 172.21.15.59:0/2077249197 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fba700b5360 0x7fba700b7820 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fba8000bbe0 tx=0x7fba8000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:51.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.471+0000 7fba7affd640 1 -- 172.21.15.59:0/2077249197 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fba7c0cde90 con 0x7fba8410f420 2024-09-10T21:12:51.683 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 21:12:51 smithi154 podman[64319]: 2024-09-10 21:12:51.38123068 +0000 UTC m=+0.381457863 container init 0611dfb906c69e8f3b84fa810d4abf085622a1d5b04f491c4d95bb4fd1d7e2a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-10T21:12:51.683 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 21:12:51 smithi154 podman[64319]: 2024-09-10 21:12:51.384090053 +0000 UTC m=+0.384317237 container start 0611dfb906c69e8f3b84fa810d4abf085622a1d5b04f491c4d95bb4fd1d7e2a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-e, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:12:51.683 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 21:12:51 smithi154 ceph-mds[64338]: -- 172.21.15.154:0/1041020528 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a87a507860 con 0x55a87a4e5000 2024-09-10T21:12:51.683 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 21:12:51 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-e[64334]: starting mds.e at 2024-09-10T21:12:51.683 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 21:12:51 smithi154 bash[64319]: 0611dfb906c69e8f3b84fa810d4abf085622a1d5b04f491c4d95bb4fd1d7e2a8 2024-09-10T21:12:51.683 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 21:12:51 smithi154 systemd[1]: Started Ceph mds.e for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:12:51.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.696+0000 7fba8c1ad640 1 -- 172.21.15.59:0/2077249197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba841a8120 con 0x7fba8410f420 2024-09-10T21:12:51.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.697+0000 7fba7affd640 1 -- 172.21.15.59:0/2077249197 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7fba7c0098b0 con 0x7fba8410f420 2024-09-10T21:12:51.701 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:12:51.701 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":5,"btime":"2024-09-10T21:12:49:677640+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24499,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T21:12:51.701 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 5 2024-09-10T21:12:51.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.699+0000 7fba8c1ad640 1 -- 172.21.15.59:0/2077249197 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fba700b5360 msgr2=0x7fba700b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:51.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.699+0000 7fba8c1ad640 1 --2- 172.21.15.59:0/2077249197 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fba700b5360 0x7fba700b7820 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fba8000bbe0 tx=0x7fba8000b390 comp rx=0 tx=0).stop 2024-09-10T21:12:51.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.699+0000 7fba8c1ad640 1 -- 172.21.15.59:0/2077249197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba8410f420 msgr2=0x7fba841a0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:51.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.699+0000 7fba8c1ad640 1 --2- 172.21.15.59:0/2077249197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba8410f420 0x7fba841a0d10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0319f0 tx=0x7fba7c031a20 comp rx=0 tx=0).stop 2024-09-10T21:12:51.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.699+0000 7fba8c1ad640 1 -- 172.21.15.59:0/2077249197 shutdown_connections 2024-09-10T21:12:51.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.699+0000 7fba8c1ad640 1 --2- 172.21.15.59:0/2077249197 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fba700b5360 0x7fba700b7820 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:51.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.699+0000 7fba8c1ad640 1 --2- 172.21.15.59:0/2077249197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba8410f420 0x7fba841a0d10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:51.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.699+0000 7fba8c1ad640 1 --2- 172.21.15.59:0/2077249197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba84102190 0x7fba8419b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:51.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.699+0000 7fba8c1ad640 1 --2- 172.21.15.59:0/2077249197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba84101870 0x7fba8419b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:51.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.699+0000 7fba8c1ad640 1 -- 172.21.15.59:0/2077249197 >> 172.21.15.59:0/2077249197 conn(0x7fba840fd700 msgr2=0x7fba840ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:51.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.699+0000 7fba8c1ad640 1 -- 172.21.15.59:0/2077249197 shutdown_connections 2024-09-10T21:12:51.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:51.699+0000 7fba8c1ad640 1 -- 172.21.15.59:0/2077249197 wait complete. 2024-09-10T21:12:52.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:52 smithi059 ceph-mon[30888]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:52.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:52 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:52.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:52 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:52.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:52 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:52.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:52 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:52.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:52 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:52.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:52 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:52.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:52 smithi059 ceph-mon[30888]: Deploying daemon mds.f on smithi192 2024-09-10T21:12:52.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:52 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2077249197' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:12:52.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:52 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.154:6834/294213384,v1:172.21.15.154:6835/294213384] up:boot 2024-09-10T21:12:52.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:52 smithi059 ceph-mon[30888]: fsmap 5 up:standby 2024-09-10T21:12:52.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:52 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T21:12:52.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:52 smithi192 ceph-mon[35363]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:52.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:52 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:52.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:52 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:52.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:52 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:52.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:52 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:52.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:52 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:52.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:52 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:52.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:52 smithi192 ceph-mon[35363]: Deploying daemon mds.f on smithi192 2024-09-10T21:12:52.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:52 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2077249197' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:12:52.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:52 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.154:6834/294213384,v1:172.21.15.154:6835/294213384] up:boot 2024-09-10T21:12:52.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:52 smithi192 ceph-mon[35363]: fsmap 5 up:standby 2024-09-10T21:12:52.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:52 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T21:12:52.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:52 smithi154 ceph-mon[35041]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:52.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:52 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:52.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:52 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:52.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:52 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:52.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:52 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:52.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:52 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:52.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:52 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:52.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:52 smithi154 ceph-mon[35041]: Deploying daemon mds.f on smithi192 2024-09-10T21:12:52.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:52 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2077249197' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:12:52.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:52 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.154:6834/294213384,v1:172.21.15.154:6835/294213384] up:boot 2024-09-10T21:12:52.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:52 smithi154 ceph-mon[35041]: fsmap 5 up:standby 2024-09-10T21:12:52.934 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:52 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T21:12:53.568 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:12:53 smithi192 systemd[1]: Starting Ceph mds.f for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:12:53.828 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:12:53 smithi192 podman[64451]: 2024-09-10 21:12:53.564085538 +0000 UTC m=+0.103772902 container create 107fe9555a11651252cddaaa6d59dcedf7593be085dca1976ee5e3562392f8db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-f, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-09-10T21:12:53.828 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:12:53 smithi192 podman[64451]: 2024-09-10 21:12:53.476390867 +0000 UTC m=+0.016078230 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:12:53.828 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:12:53 smithi192 podman[64451]: 2024-09-10 21:12:53.758186961 +0000 UTC m=+0.297874326 container init 107fe9555a11651252cddaaa6d59dcedf7593be085dca1976ee5e3562392f8db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-f, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-10T21:12:53.828 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:12:53 smithi192 podman[64451]: 2024-09-10 21:12:53.760879611 +0000 UTC m=+0.300566976 container start 107fe9555a11651252cddaaa6d59dcedf7593be085dca1976ee5e3562392f8db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-f, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:12:53.828 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:12:53 smithi192 ceph-mds[64470]: -- 172.21.15.192:0/1800982288 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563f2185d860 con 0x563f2183a800 2024-09-10T21:12:53.828 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:12:53 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-f[64466]: starting mds.f at 2024-09-10T21:12:54.328 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:12:53 smithi192 bash[64451]: 107fe9555a11651252cddaaa6d59dcedf7593be085dca1976ee5e3562392f8db 2024-09-10T21:12:54.328 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:12:53 smithi192 systemd[1]: Started Ceph mds.f for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:12:54.421 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:12:54.694 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:12:55.115 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:54 smithi059 ceph-mon[30888]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:55.115 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:54 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:55.115 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:54 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:55.115 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:54 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:55.115 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:54 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:55.115 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:54 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:55.115 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:54 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:55.115 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:54 smithi059 ceph-mon[30888]: Deploying daemon mds.c on smithi192 2024-09-10T21:12:55.116 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:54 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] up:boot 2024-09-10T21:12:55.116 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:54 smithi059 ceph-mon[30888]: fsmap 6 up:standby 2024-09-10T21:12:55.116 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:54 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T21:12:55.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:54 smithi154 ceph-mon[35041]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:55.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:54 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:55.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:54 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:55.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:54 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:55.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:54 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:55.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:54 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:55.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:54 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:55.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:54 smithi154 ceph-mon[35041]: Deploying daemon mds.c on smithi192 2024-09-10T21:12:55.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:54 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] up:boot 2024-09-10T21:12:55.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:54 smithi154 ceph-mon[35041]: fsmap 6 up:standby 2024-09-10T21:12:55.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:54 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T21:12:55.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.193+0000 7fdf96cad640 1 -- 172.21.15.59:0/1577836787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf90109150 msgr2=0x7fdf9010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.193+0000 7fdf96cad640 1 --2- 172.21.15.59:0/1577836787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf90109150 0x7fdf9010f950 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009ca0 tx=0x7fdf8802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:12:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.193+0000 7fdf96cad640 1 -- 172.21.15.59:0/1577836787 shutdown_connections 2024-09-10T21:12:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.193+0000 7fdf96cad640 1 --2- 172.21.15.59:0/1577836787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf90109150 0x7fdf9010f950 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.193+0000 7fdf96cad640 1 --2- 172.21.15.59:0/1577836787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf901087d0 0x7fdf90108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.193+0000 7fdf96cad640 1 --2- 172.21.15.59:0/1577836787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf90102dc0 0x7fdf901031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.193+0000 7fdf96cad640 1 -- 172.21.15.59:0/1577836787 >> 172.21.15.59:0/1577836787 conn(0x7fdf900fe830 msgr2=0x7fdf90100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.193+0000 7fdf96cad640 1 -- 172.21.15.59:0/1577836787 shutdown_connections 2024-09-10T21:12:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.193+0000 7fdf96cad640 1 -- 172.21.15.59:0/1577836787 wait complete. 2024-09-10T21:12:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.194+0000 7fdf96cad640 1 Processor -- start 2024-09-10T21:12:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.194+0000 7fdf96cad640 1 -- start start 2024-09-10T21:12:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.194+0000 7fdf96cad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf90102dc0 0x7fdf90199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.194+0000 7fdf96cad640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf901087d0 0x7fdf901997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.194+0000 7fdf96cad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf90109150 0x7fdf9019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.194+0000 7fdf96cad640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdf90112dd0 con 0x7fdf90102dc0 2024-09-10T21:12:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.194+0000 7fdf96cad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdf90112c50 con 0x7fdf90109150 2024-09-10T21:12:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.194+0000 7fdf96cad640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdf90112f50 con 0x7fdf901087d0 2024-09-10T21:12:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.194+0000 7fdf94a49640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf90102dc0 0x7fdf90199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.194+0000 7fdf94a49640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf90102dc0 0x7fdf90199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51908/0 (socket says 172.21.15.59:51908) 2024-09-10T21:12:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.194+0000 7fdf94a49640 1 -- 172.21.15.59:0/598458784 learned_addr learned my addr 172.21.15.59:0/598458784 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:12:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.194+0000 7fdf8ffff640 1 --2- 172.21.15.59:0/598458784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf901087d0 0x7fdf901997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.194+0000 7fdf9524a640 1 --2- 172.21.15.59:0/598458784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf90109150 0x7fdf9019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.194+0000 7fdf94a49640 1 -- 172.21.15.59:0/598458784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf901087d0 msgr2=0x7fdf901997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.194+0000 7fdf94a49640 1 --2- 172.21.15.59:0/598458784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf901087d0 0x7fdf901997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.194+0000 7fdf94a49640 1 -- 172.21.15.59:0/598458784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf90109150 msgr2=0x7fdf9019eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.194+0000 7fdf94a49640 1 --2- 172.21.15.59:0/598458784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf90109150 0x7fdf9019eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.194+0000 7fdf94a49640 1 -- 172.21.15.59:0/598458784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9019f310 con 0x7fdf90102dc0 2024-09-10T21:12:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.194+0000 7fdf8ffff640 1 --2- 172.21.15.59:0/598458784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf901087d0 0x7fdf901997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:12:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.195+0000 7fdf94a49640 1 --2- 172.21.15.59:0/598458784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf90102dc0 0x7fdf90199260 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400c920 tx=0x7fdf8400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.195+0000 7fdf8dffb640 1 -- 172.21.15.59:0/598458784 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf84007c70 con 0x7fdf90102dc0 2024-09-10T21:12:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.195+0000 7fdf96cad640 1 -- 172.21.15.59:0/598458784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf9019f600 con 0x7fdf90102dc0 2024-09-10T21:12:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.195+0000 7fdf8dffb640 1 -- 172.21.15.59:0/598458784 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf84007e10 con 0x7fdf90102dc0 2024-09-10T21:12:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.195+0000 7fdf8dffb640 1 -- 172.21.15.59:0/598458784 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf84018820 con 0x7fdf90102dc0 2024-09-10T21:12:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.195+0000 7fdf96cad640 1 -- 172.21.15.59:0/598458784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf901a5e90 con 0x7fdf90102dc0 2024-09-10T21:12:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.196+0000 7fdf96cad640 1 -- 172.21.15.59:0/598458784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf901031a0 con 0x7fdf90102dc0 2024-09-10T21:12:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.197+0000 7fdf8dffb640 1 -- 172.21.15.59:0/598458784 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fdf8400f450 con 0x7fdf90102dc0 2024-09-10T21:12:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.198+0000 7fdf8dffb640 1 --2- 172.21.15.59:0/598458784 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdf800b52e0 0x7fdf800b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:55.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.198+0000 7fdf8ffff640 1 --2- 172.21.15.59:0/598458784 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdf800b52e0 0x7fdf800b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:55.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.198+0000 7fdf8dffb640 1 -- 172.21.15.59:0/598458784 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fdf840e5a00 con 0x7fdf90102dc0 2024-09-10T21:12:55.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.199+0000 7fdf8ffff640 1 --2- 172.21.15.59:0/598458784 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdf800b52e0 0x7fdf800b77a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c005fd0 tx=0x7fdf7c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:55.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.202+0000 7fdf8dffb640 1 -- 172.21.15.59:0/598458784 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdf84014030 con 0x7fdf90102dc0 2024-09-10T21:12:55.236 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:54 smithi192 ceph-mon[35363]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:55.236 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:54 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:55.236 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:54 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:55.236 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:54 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:55.236 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:54 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:55.236 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:54 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:55.236 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:54 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:55.237 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:54 smithi192 ceph-mon[35363]: Deploying daemon mds.c on smithi192 2024-09-10T21:12:55.237 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:54 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] up:boot 2024-09-10T21:12:55.237 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:54 smithi192 ceph-mon[35363]: fsmap 6 up:standby 2024-09-10T21:12:55.237 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:54 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T21:12:55.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.427+0000 7fdf96cad640 1 -- 172.21.15.59:0/598458784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf901a6060 con 0x7fdf90102dc0 2024-09-10T21:12:55.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.428+0000 7fdf8dffb640 1 -- 172.21.15.59:0/598458784 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5563 (secure 0 0 0) 0x7fdf840accc0 con 0x7fdf90102dc0 2024-09-10T21:12:55.432 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:12:55.432 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":7,"btime":"2024-09-10T21:12:54:532621+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24499,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24524,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24529,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-10T21:12:55.432 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 7 2024-09-10T21:12:55.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.430+0000 7fdf96cad640 1 -- 172.21.15.59:0/598458784 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdf800b52e0 msgr2=0x7fdf800b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:55.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.430+0000 7fdf96cad640 1 --2- 172.21.15.59:0/598458784 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdf800b52e0 0x7fdf800b77a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c005fd0 tx=0x7fdf7c005850 comp rx=0 tx=0).stop 2024-09-10T21:12:55.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.430+0000 7fdf96cad640 1 -- 172.21.15.59:0/598458784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf90102dc0 msgr2=0x7fdf90199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:55.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.430+0000 7fdf96cad640 1 --2- 172.21.15.59:0/598458784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf90102dc0 0x7fdf90199260 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400c920 tx=0x7fdf8400cde0 comp rx=0 tx=0).stop 2024-09-10T21:12:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.430+0000 7fdf96cad640 1 -- 172.21.15.59:0/598458784 shutdown_connections 2024-09-10T21:12:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.430+0000 7fdf96cad640 1 --2- 172.21.15.59:0/598458784 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdf800b52e0 0x7fdf800b77a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.430+0000 7fdf96cad640 1 --2- 172.21.15.59:0/598458784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf90109150 0x7fdf9019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.430+0000 7fdf96cad640 1 --2- 172.21.15.59:0/598458784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf901087d0 0x7fdf901997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.430+0000 7fdf96cad640 1 --2- 172.21.15.59:0/598458784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf90102dc0 0x7fdf90199260 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.430+0000 7fdf96cad640 1 -- 172.21.15.59:0/598458784 >> 172.21.15.59:0/598458784 conn(0x7fdf900fe830 msgr2=0x7fdf900ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.430+0000 7fdf96cad640 1 -- 172.21.15.59:0/598458784 shutdown_connections 2024-09-10T21:12:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:55.430+0000 7fdf96cad640 1 -- 172.21.15.59:0/598458784 wait complete. 2024-09-10T21:12:55.828 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 10 21:12:55 smithi192 systemd[1]: Starting Ceph mds.c for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:12:56.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:55 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/598458784' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:12:56.167 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:55 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/598458784' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:12:56.168 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 10 21:12:55 smithi192 podman[64752]: 2024-09-10 21:12:55.816325821 +0000 UTC m=+0.015821409 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:12:56.168 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 10 21:12:55 smithi192 podman[64752]: 2024-09-10 21:12:55.934602416 +0000 UTC m=+0.134097994 container create f6a5aacb6973b71ed575f74592f5e04bd187239d529aa4de300e9aa4e08ff5c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-c, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:12:56.168 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 10 21:12:56 smithi192 podman[64752]: 2024-09-10 21:12:56.161934211 +0000 UTC m=+0.361429790 container init f6a5aacb6973b71ed575f74592f5e04bd187239d529aa4de300e9aa4e08ff5c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:12:56.168 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 10 21:12:56 smithi192 podman[64752]: 2024-09-10 21:12:56.164774121 +0000 UTC m=+0.364269710 container start f6a5aacb6973b71ed575f74592f5e04bd187239d529aa4de300e9aa4e08ff5c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS) 2024-09-10T21:12:56.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:55 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/598458784' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:12:56.578 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 10 21:12:56 smithi192 ceph-mds[64771]: -- 172.21.15.192:0/572894084 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55652f859860 con 0x55652f837400 2024-09-10T21:12:56.578 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 10 21:12:56 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-c[64767]: starting mds.c at 2024-09-10T21:12:56.578 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 10 21:12:56 smithi192 bash[64752]: f6a5aacb6973b71ed575f74592f5e04bd187239d529aa4de300e9aa4e08ff5c2 2024-09-10T21:12:56.578 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 10 21:12:56 smithi192 systemd[1]: Started Ceph mds.c for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:12:57.099 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:56 smithi154 ceph-mon[35041]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:57.099 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:56 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:57.099 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:56 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:57.099 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:56 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:57.099 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:56 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:57.099 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:56 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:57.100 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:56 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:57.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:56 smithi192 ceph-mon[35363]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:57.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:56 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:57.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:56 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:57.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:56 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:57.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:56 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:57.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:56 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:57.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:56 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:57.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:56 smithi059 ceph-mon[30888]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:57.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:56 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:57.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:56 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:57.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:56 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:57.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:56 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:57.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:56 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:57.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:56 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:58.054 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:57 smithi154 ceph-mon[35041]: Deploying daemon mds.h on smithi154 2024-09-10T21:12:58.054 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:57 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] up:boot 2024-09-10T21:12:58.054 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:57 smithi154 ceph-mon[35041]: fsmap 7 up:standby 2024-09-10T21:12:58.054 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:57 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T21:12:58.162 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:12:58.190 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:57 smithi059 ceph-mon[30888]: Deploying daemon mds.h on smithi154 2024-09-10T21:12:58.190 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:57 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] up:boot 2024-09-10T21:12:58.190 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:57 smithi059 ceph-mon[30888]: fsmap 7 up:standby 2024-09-10T21:12:58.190 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:57 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T21:12:58.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:57 smithi192 ceph-mon[35363]: Deploying daemon mds.h on smithi154 2024-09-10T21:12:58.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:57 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] up:boot 2024-09-10T21:12:58.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:57 smithi192 ceph-mon[35363]: fsmap 7 up:standby 2024-09-10T21:12:58.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:57 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T21:12:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:12:58.432 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 21:12:58 smithi154 systemd[1]: Starting Ceph mds.h for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:12:58.754 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 21:12:58 smithi154 podman[64620]: 2024-09-10 21:12:58.357138031 +0000 UTC m=+0.015921010 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:12:58.754 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 21:12:58 smithi154 podman[64620]: 2024-09-10 21:12:58.464850572 +0000 UTC m=+0.123633542 container create d9b31ea9966a2525469ea04e3d1f9c6f807fb990af91402e5fb46a86651be376 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-10T21:12:58.754 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 21:12:58 smithi154 podman[64620]: 2024-09-10 21:12:58.667643029 +0000 UTC m=+0.326425999 container init d9b31ea9966a2525469ea04e3d1f9c6f807fb990af91402e5fb46a86651be376 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-h, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:12:58.754 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 21:12:58 smithi154 podman[64620]: 2024-09-10 21:12:58.670520121 +0000 UTC m=+0.329303099 container start d9b31ea9966a2525469ea04e3d1f9c6f807fb990af91402e5fb46a86651be376 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-h, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T21:12:58.755 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 21:12:58 smithi154 ceph-mds[64639]: -- 172.21.15.154:0/3617604516 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561cf4223860 con 0x561cf4200800 2024-09-10T21:12:58.755 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 21:12:58 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-h[64635]: starting mds.h at 2024-09-10T21:12:58.755 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 21:12:58 smithi154 bash[64620]: d9b31ea9966a2525469ea04e3d1f9c6f807fb990af91402e5fb46a86651be376 2024-09-10T21:12:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.927+0000 7f5cc72ef640 1 -- 172.21.15.59:0/870207934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc0108020 msgr2=0x7f5cc010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.927+0000 7f5cc72ef640 1 --2- 172.21.15.59:0/870207934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc0108020 0x7f5cc010e820 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009ca0 tx=0x7f5cb802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:12:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.927+0000 7f5cc72ef640 1 -- 172.21.15.59:0/870207934 shutdown_connections 2024-09-10T21:12:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.927+0000 7f5cc72ef640 1 --2- 172.21.15.59:0/870207934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc0108020 0x7f5cc010e820 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.927+0000 7f5cc72ef640 1 --2- 172.21.15.59:0/870207934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cc01076a0 0x7f5cc0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.927+0000 7f5cc72ef640 1 --2- 172.21.15.59:0/870207934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cc0101c90 0x7f5cc0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.927+0000 7f5cc72ef640 1 -- 172.21.15.59:0/870207934 >> 172.21.15.59:0/870207934 conn(0x7f5cc00fd700 msgr2=0x7f5cc00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.928+0000 7f5cc72ef640 1 -- 172.21.15.59:0/870207934 shutdown_connections 2024-09-10T21:12:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.928+0000 7f5cc72ef640 1 -- 172.21.15.59:0/870207934 wait complete. 2024-09-10T21:12:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.928+0000 7f5cc72ef640 1 Processor -- start 2024-09-10T21:12:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.928+0000 7f5cc72ef640 1 -- start start 2024-09-10T21:12:58.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.928+0000 7f5cc72ef640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc0101c90 0x7f5cc019b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.928+0000 7f5cc72ef640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cc01076a0 0x7f5cc019b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.928+0000 7f5cc72ef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cc0108020 0x7f5cc01a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.928+0000 7f5cc72ef640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc0111ca0 con 0x7f5cc0101c90 2024-09-10T21:12:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.928+0000 7f5cc72ef640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc0111b20 con 0x7f5cc0108020 2024-09-10T21:12:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.928+0000 7f5cc72ef640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc0111e20 con 0x7f5cc01076a0 2024-09-10T21:12:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.929+0000 7f5cc508b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc0101c90 0x7f5cc019b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.929+0000 7f5cc508b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc0101c90 0x7f5cc019b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51928/0 (socket says 172.21.15.59:51928) 2024-09-10T21:12:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.929+0000 7f5cc508b640 1 -- 172.21.15.59:0/3272496690 learned_addr learned my addr 172.21.15.59:0/3272496690 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:12:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.929+0000 7f5cc488a640 1 --2- 172.21.15.59:0/3272496690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cc01076a0 0x7f5cc019b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.929+0000 7f5cc588c640 1 --2- 172.21.15.59:0/3272496690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cc0108020 0x7f5cc01a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.929+0000 7f5cc508b640 1 -- 172.21.15.59:0/3272496690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cc01076a0 msgr2=0x7f5cc019b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:58.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.929+0000 7f5cc508b640 1 --2- 172.21.15.59:0/3272496690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cc01076a0 0x7f5cc019b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.929+0000 7f5cc508b640 1 -- 172.21.15.59:0/3272496690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cc0108020 msgr2=0x7f5cc01a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.929+0000 7f5cc508b640 1 --2- 172.21.15.59:0/3272496690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cc0108020 0x7f5cc01a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.929+0000 7f5cc508b640 1 -- 172.21.15.59:0/3272496690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc01a14f0 con 0x7f5cc0101c90 2024-09-10T21:12:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.929+0000 7f5cc588c640 1 --2- 172.21.15.59:0/3272496690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cc0108020 0x7f5cc01a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:12:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.929+0000 7f5cc508b640 1 --2- 172.21.15.59:0/3272496690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc0101c90 0x7f5cc019b440 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00e9f0 tx=0x7f5cbc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.929+0000 7f5cb67fc640 1 -- 172.21.15.59:0/3272496690 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc00cd80 con 0x7f5cc0101c90 2024-09-10T21:12:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.929+0000 7f5cc72ef640 1 -- 172.21.15.59:0/3272496690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cc01a17e0 con 0x7f5cc0101c90 2024-09-10T21:12:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.929+0000 7f5cb67fc640 1 -- 172.21.15.59:0/3272496690 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cbc0054d0 con 0x7f5cc0101c90 2024-09-10T21:12:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.929+0000 7f5cb67fc640 1 -- 172.21.15.59:0/3272496690 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc010690 con 0x7f5cc0101c90 2024-09-10T21:12:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.929+0000 7f5cc72ef640 1 -- 172.21.15.59:0/3272496690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cc01a7ea0 con 0x7f5cc0101c90 2024-09-10T21:12:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.931+0000 7f5cc72ef640 1 -- 172.21.15.59:0/3272496690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cc0102070 con 0x7f5cc0101c90 2024-09-10T21:12:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.935+0000 7f5cb67fc640 1 -- 172.21.15.59:0/3272496690 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f5cbc004e50 con 0x7f5cc0101c90 2024-09-10T21:12:58.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.936+0000 7f5cb67fc640 1 --2- 172.21.15.59:0/3272496690 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5cac0b52e0 0x7f5cac0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:12:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.936+0000 7f5cc488a640 1 --2- 172.21.15.59:0/3272496690 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5cac0b52e0 0x7f5cac0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:12:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.936+0000 7f5cb67fc640 1 -- 172.21.15.59:0/3272496690 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f5cbc0e5e20 con 0x7f5cc0101c90 2024-09-10T21:12:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.937+0000 7f5cc488a640 1 --2- 172.21.15.59:0/3272496690 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5cac0b52e0 0x7f5cac0b77a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5cc010ec50 tx=0x7f5cb000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:12:58.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:58.939+0000 7f5cb67fc640 1 -- 172.21.15.59:0/3272496690 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5cbc056220 con 0x7f5cc0101c90 2024-09-10T21:12:59.135 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:58 smithi059 ceph-mon[30888]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:59.135 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:59.136 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:59.136 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:59.136 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:59.136 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:59.136 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:58 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:59.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:59.166+0000 7f5cc72ef640 1 -- 172.21.15.59:0/3272496690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cc019c570 con 0x7f5cc0101c90 2024-09-10T21:12:59.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:59.166+0000 7f5cb67fc640 1 -- 172.21.15.59:0/3272496690 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7216 (secure 0 0 0) 0x7f5cbc0ad0e0 con 0x7f5cc0101c90 2024-09-10T21:12:59.171 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:12:59.172 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"btime":"2024-09-10T21:12:58:928246+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24499,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24524,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24529,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24542,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T21:12:59.173 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 9 2024-09-10T21:12:59.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:59.168+0000 7f5cc72ef640 1 -- 172.21.15.59:0/3272496690 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5cac0b52e0 msgr2=0x7f5cac0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:59.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:59.168+0000 7f5cc72ef640 1 --2- 172.21.15.59:0/3272496690 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5cac0b52e0 0x7f5cac0b77a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5cc010ec50 tx=0x7f5cb000b390 comp rx=0 tx=0).stop 2024-09-10T21:12:59.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:59.168+0000 7f5cc72ef640 1 -- 172.21.15.59:0/3272496690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc0101c90 msgr2=0x7f5cc019b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:12:59.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:59.168+0000 7f5cc72ef640 1 --2- 172.21.15.59:0/3272496690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc0101c90 0x7f5cc019b440 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00e9f0 tx=0x7f5cbc00edf0 comp rx=0 tx=0).stop 2024-09-10T21:12:59.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:59.169+0000 7f5cc72ef640 1 -- 172.21.15.59:0/3272496690 shutdown_connections 2024-09-10T21:12:59.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:59.169+0000 7f5cc72ef640 1 --2- 172.21.15.59:0/3272496690 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5cac0b52e0 0x7f5cac0b77a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:59.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:59.169+0000 7f5cc72ef640 1 --2- 172.21.15.59:0/3272496690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cc0108020 0x7f5cc01a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:59.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:59.169+0000 7f5cc72ef640 1 --2- 172.21.15.59:0/3272496690 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cc01076a0 0x7f5cc019b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:59.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:59.169+0000 7f5cc72ef640 1 --2- 172.21.15.59:0/3272496690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc0101c90 0x7f5cc019b440 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:12:59.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:59.169+0000 7f5cc72ef640 1 -- 172.21.15.59:0/3272496690 >> 172.21.15.59:0/3272496690 conn(0x7f5cc00fd700 msgr2=0x7f5cc006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:12:59.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:59.169+0000 7f5cc72ef640 1 -- 172.21.15.59:0/3272496690 shutdown_connections 2024-09-10T21:12:59.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:12:59.169+0000 7f5cc72ef640 1 -- 172.21.15.59:0/3272496690 wait complete. 2024-09-10T21:12:59.182 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 21:12:58 smithi154 systemd[1]: Started Ceph mds.h for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:12:59.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:58 smithi154 ceph-mon[35041]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:58 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:12:59.261 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:58 smithi192 ceph-mon[35363]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:12:59.262 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:59.262 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:59.262 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:12:59.262 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:12:59.262 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:12:59.262 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:58 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:13:00.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:59 smithi059 ceph-mon[30888]: Deploying daemon mds.i on smithi192 2024-09-10T21:13:00.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:59 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] up:boot 2024-09-10T21:13:00.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:59 smithi059 ceph-mon[30888]: fsmap 8 up:standby 2024-09-10T21:13:00.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:59 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T21:13:00.137 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:12:59 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3272496690' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:13:00.155 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:59 smithi192 ceph-mon[35363]: Deploying daemon mds.i on smithi192 2024-09-10T21:13:00.155 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:59 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] up:boot 2024-09-10T21:13:00.155 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:59 smithi192 ceph-mon[35363]: fsmap 8 up:standby 2024-09-10T21:13:00.155 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:59 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T21:13:00.155 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:12:59 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3272496690' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:13:00.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:59 smithi154 ceph-mon[35041]: Deploying daemon mds.i on smithi192 2024-09-10T21:13:00.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:59 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] up:boot 2024-09-10T21:13:00.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:59 smithi154 ceph-mon[35041]: fsmap 8 up:standby 2024-09-10T21:13:00.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:59 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T21:13:00.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:12:59 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3272496690' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:13:00.825 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:13:00 smithi192 systemd[1]: Starting Ceph mds.i for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:13:01.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:00 smithi192 ceph-mon[35363]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:01.078 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:13:00 smithi192 podman[65054]: 2024-09-10 21:13:00.820816497 +0000 UTC m=+0.099313724 container create eeea3014e75f9a683e5be85ec08b91aa3c54c430ed498830defe1c0f00853e48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:13:01.079 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:13:00 smithi192 podman[65054]: 2024-09-10 21:13:00.737486674 +0000 UTC m=+0.015983904 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:13:01.079 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:13:01 smithi192 podman[65054]: 2024-09-10 21:13:01.031533104 +0000 UTC m=+0.310030341 container init eeea3014e75f9a683e5be85ec08b91aa3c54c430ed498830defe1c0f00853e48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-10T21:13:01.079 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:13:01 smithi192 podman[65054]: 2024-09-10 21:13:01.034784703 +0000 UTC m=+0.313281945 container start eeea3014e75f9a683e5be85ec08b91aa3c54c430ed498830defe1c0f00853e48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:13:01.079 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:13:01 smithi192 ceph-mds[65073]: -- 172.21.15.192:0/64759683 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dee0865860 con 0x55dee0843400 2024-09-10T21:13:01.079 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:13:01 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-i[65069]: starting mds.i at 2024-09-10T21:13:01.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:00 smithi059 ceph-mon[30888]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:01.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:00 smithi154 ceph-mon[35041]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:01.578 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:13:01 smithi192 bash[65054]: eeea3014e75f9a683e5be85ec08b91aa3c54c430ed498830defe1c0f00853e48 2024-09-10T21:13:01.578 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:13:01 smithi192 systemd[1]: Started Ceph mds.i for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:13:01.822 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:13:02.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:02 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:02.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:02 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:02.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:02 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:02.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:02 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:13:02.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:02 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:13:02.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:02 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:13:02.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:02 smithi154 ceph-mon[35041]: Deploying daemon mds.g on smithi059 2024-09-10T21:13:02.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:02 smithi154 ceph-mon[35041]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:02.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:02 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] up:boot 2024-09-10T21:13:02.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:02 smithi154 ceph-mon[35041]: fsmap 9 up:standby 2024-09-10T21:13:02.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:02 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T21:13:02.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:02 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:02.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:02 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:02.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:02 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:02.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:02 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:13:02.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:02 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:13:02.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:02 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:13:02.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:02 smithi059 ceph-mon[30888]: Deploying daemon mds.g on smithi059 2024-09-10T21:13:02.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:02 smithi059 ceph-mon[30888]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:02.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:02 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] up:boot 2024-09-10T21:13:02.533 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:02 smithi059 ceph-mon[30888]: fsmap 9 up:standby 2024-09-10T21:13:02.534 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:02 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T21:13:02.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:02 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:02.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:02 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:02.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:02 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:02.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:02 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:13:02.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:02 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:13:02.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:02 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:13:02.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:02 smithi192 ceph-mon[35363]: Deploying daemon mds.g on smithi059 2024-09-10T21:13:02.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:02 smithi192 ceph-mon[35363]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:02.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:02 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] up:boot 2024-09-10T21:13:02.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:02 smithi192 ceph-mon[35363]: fsmap 9 up:standby 2024-09-10T21:13:02.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:02 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T21:13:02.649 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:03.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.225+0000 7f7be525d640 1 -- 172.21.15.59:0/276508255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7be0101870 msgr2=0x7f7be0101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:03.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.225+0000 7f7be525d640 1 --2- 172.21.15.59:0/276508255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7be0101870 0x7f7be0101c50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0009900 tx=0x7f7bd002a410 comp rx=0 tx=0).stop 2024-09-10T21:13:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.225+0000 7f7be525d640 1 -- 172.21.15.59:0/276508255 shutdown_connections 2024-09-10T21:13:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.225+0000 7f7be525d640 1 --2- 172.21.15.59:0/276508255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be010f420 0x7f7be0111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.225+0000 7f7be525d640 1 --2- 172.21.15.59:0/276508255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7be0102190 0x7f7be010eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.225+0000 7f7be525d640 1 --2- 172.21.15.59:0/276508255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7be0101870 0x7f7be0101c50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.225+0000 7f7be525d640 1 -- 172.21.15.59:0/276508255 >> 172.21.15.59:0/276508255 conn(0x7f7be00fd700 msgr2=0x7f7be00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.225+0000 7f7be525d640 1 -- 172.21.15.59:0/276508255 shutdown_connections 2024-09-10T21:13:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.226+0000 7f7be525d640 1 -- 172.21.15.59:0/276508255 wait complete. 2024-09-10T21:13:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.226+0000 7f7be525d640 1 Processor -- start 2024-09-10T21:13:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.226+0000 7f7be525d640 1 -- start start 2024-09-10T21:13:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.226+0000 7f7be525d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be0101870 0x7f7be019b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.226+0000 7f7be525d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7be0102190 0x7f7be019ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.226+0000 7f7be525d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7be010f420 0x7f7be01a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:03.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.226+0000 7f7be525d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7be0114ff0 con 0x7f7be010f420 2024-09-10T21:13:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.227+0000 7f7be525d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7be0114e70 con 0x7f7be0102190 2024-09-10T21:13:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.227+0000 7f7be525d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7be0115170 con 0x7f7be0101870 2024-09-10T21:13:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.227+0000 7f7bdf59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7be010f420 0x7f7be01a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.227+0000 7f7bdf59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7be010f420 0x7f7be01a0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40592/0 (socket says 172.21.15.59:40592) 2024-09-10T21:13:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.227+0000 7f7bded9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be0101870 0x7f7be019b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.227+0000 7f7bdf59e640 1 -- 172.21.15.59:0/2684502348 learned_addr learned my addr 172.21.15.59:0/2684502348 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.227+0000 7f7bd7fff640 1 --2- 172.21.15.59:0/2684502348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7be0102190 0x7f7be019ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.227+0000 7f7bdf59e640 1 -- 172.21.15.59:0/2684502348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be0101870 msgr2=0x7f7be019b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.227+0000 7f7bdf59e640 1 --2- 172.21.15.59:0/2684502348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be0101870 0x7f7be019b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.227+0000 7f7bdf59e640 1 -- 172.21.15.59:0/2684502348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7be0102190 msgr2=0x7f7be019ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.227+0000 7f7bdf59e640 1 --2- 172.21.15.59:0/2684502348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7be0102190 0x7f7be019ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.227+0000 7f7bdf59e640 1 -- 172.21.15.59:0/2684502348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be01a15b0 con 0x7f7be010f420 2024-09-10T21:13:03.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.227+0000 7f7bd7fff640 1 --2- 172.21.15.59:0/2684502348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7be0102190 0x7f7be019ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:13:03.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.227+0000 7f7bdf59e640 1 --2- 172.21.15.59:0/2684502348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7be010f420 0x7f7be01a0de0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800ccb0 tx=0x7f7bd800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:03.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.227+0000 7f7bdcd99640 1 -- 172.21.15.59:0/2684502348 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8003970 con 0x7f7be010f420 2024-09-10T21:13:03.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.227+0000 7f7bdcd99640 1 -- 172.21.15.59:0/2684502348 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bd8004030 con 0x7f7be010f420 2024-09-10T21:13:03.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.227+0000 7f7be525d640 1 -- 172.21.15.59:0/2684502348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be01a18a0 con 0x7f7be010f420 2024-09-10T21:13:03.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.227+0000 7f7bdcd99640 1 -- 172.21.15.59:0/2684502348 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800f6b0 con 0x7f7be010f420 2024-09-10T21:13:03.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.227+0000 7f7be525d640 1 -- 172.21.15.59:0/2684502348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be01a7fe0 con 0x7f7be010f420 2024-09-10T21:13:03.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.229+0000 7f7be525d640 1 -- 172.21.15.59:0/2684502348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be0101c50 con 0x7f7be010f420 2024-09-10T21:13:03.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.231+0000 7f7bdcd99640 1 -- 172.21.15.59:0/2684502348 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f7bd8003b10 con 0x7f7be010f420 2024-09-10T21:13:03.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.231+0000 7f7bdcd99640 1 --2- 172.21.15.59:0/2684502348 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7bcc0b52e0 0x7f7bcc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:03.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.232+0000 7f7bdcd99640 1 -- 172.21.15.59:0/2684502348 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f7bd80e57a0 con 0x7f7be010f420 2024-09-10T21:13:03.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.232+0000 7f7bded9d640 1 --2- 172.21.15.59:0/2684502348 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7bcc0b52e0 0x7f7bcc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:03.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.232+0000 7f7bded9d640 1 --2- 172.21.15.59:0/2684502348 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7bcc0b52e0 0x7f7bcc0b77a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0031440 tx=0x7f7bd0005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:03.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.237+0000 7f7bdcd99640 1 -- 172.21.15.59:0/2684502348 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7bd8014070 con 0x7f7be010f420 2024-09-10T21:13:03.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.488+0000 7f7be525d640 1 -- 172.21.15.59:0/2684502348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7be01a82d0 con 0x7f7be010f420 2024-09-10T21:13:03.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.488+0000 7f7bdcd99640 1 -- 172.21.15.59:0/2684502348 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8043 (secure 0 0 0) 0x7f7bd80acb00 con 0x7f7be010f420 2024-09-10T21:13:03.493 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:13:03.493 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":10,"btime":"2024-09-10T21:13:01:956262+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24499,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24524,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24529,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24542,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T21:13:03.493 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 10 2024-09-10T21:13:03.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.490+0000 7f7be525d640 1 -- 172.21.15.59:0/2684502348 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7bcc0b52e0 msgr2=0x7f7bcc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.490+0000 7f7be525d640 1 --2- 172.21.15.59:0/2684502348 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7bcc0b52e0 0x7f7bcc0b77a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0031440 tx=0x7f7bd0005e80 comp rx=0 tx=0).stop 2024-09-10T21:13:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.490+0000 7f7be525d640 1 -- 172.21.15.59:0/2684502348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7be010f420 msgr2=0x7f7be01a0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.490+0000 7f7be525d640 1 --2- 172.21.15.59:0/2684502348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7be010f420 0x7f7be01a0de0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800ccb0 tx=0x7f7bd800a620 comp rx=0 tx=0).stop 2024-09-10T21:13:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.490+0000 7f7be525d640 1 -- 172.21.15.59:0/2684502348 shutdown_connections 2024-09-10T21:13:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.490+0000 7f7be525d640 1 --2- 172.21.15.59:0/2684502348 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7bcc0b52e0 0x7f7bcc0b77a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.490+0000 7f7be525d640 1 --2- 172.21.15.59:0/2684502348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7be010f420 0x7f7be01a0de0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.490+0000 7f7be525d640 1 --2- 172.21.15.59:0/2684502348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7be0102190 0x7f7be019ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.490+0000 7f7be525d640 1 --2- 172.21.15.59:0/2684502348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be0101870 0x7f7be019b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.490+0000 7f7be525d640 1 -- 172.21.15.59:0/2684502348 >> 172.21.15.59:0/2684502348 conn(0x7f7be00fd700 msgr2=0x7f7be0111610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.491+0000 7f7be525d640 1 -- 172.21.15.59:0/2684502348 shutdown_connections 2024-09-10T21:13:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:03.491+0000 7f7be525d640 1 -- 172.21.15.59:0/2684502348 wait complete. 2024-09-10T21:13:04.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:04 smithi059 ceph-mon[30888]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:04.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:04 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2684502348' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:13:04.412 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 21:13:04 smithi059 systemd[1]: Started Ceph mds.g for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:13:04.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:04 smithi192 ceph-mon[35363]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:04.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:04 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2684502348' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:13:04.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:04 smithi154 ceph-mon[35041]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:04.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:04 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2684502348' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:13:05.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:05.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:05.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:05.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:13:05.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:13:05.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:13:05.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:05 smithi154 ceph-mon[35041]: Deploying daemon mds.a on smithi059 2024-09-10T21:13:05.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:05 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.59:6838/4138885833,v1:172.21.15.59:6839/4138885833] up:boot 2024-09-10T21:13:05.684 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:05 smithi154 ceph-mon[35041]: fsmap 10 up:standby 2024-09-10T21:13:05.684 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T21:13:05.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:05.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:05.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:05.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:13:05.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:13:05.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:13:05.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:05 smithi192 ceph-mon[35363]: Deploying daemon mds.a on smithi059 2024-09-10T21:13:05.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:05 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.59:6838/4138885833,v1:172.21.15.59:6839/4138885833] up:boot 2024-09-10T21:13:05.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:05 smithi192 ceph-mon[35363]: fsmap 10 up:standby 2024-09-10T21:13:05.829 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T21:13:05.834 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:05.834 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:05.834 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:05.834 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:13:05.834 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:13:05.834 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:13:05.834 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:05 smithi059 ceph-mon[30888]: Deploying daemon mds.a on smithi059 2024-09-10T21:13:05.834 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:05 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.59:6838/4138885833,v1:172.21.15.59:6839/4138885833] up:boot 2024-09-10T21:13:05.835 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:05 smithi059 ceph-mon[30888]: fsmap 10 up:standby 2024-09-10T21:13:05.835 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T21:13:06.190 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:13:06.411 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:13:06 smithi059 systemd[1]: Starting Ceph mds.a for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:13:06.698 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:06 smithi059 ceph-mon[30888]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:06.698 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:13:06 smithi059 podman[73991]: 2024-09-10 21:13:06.448628994 +0000 UTC m=+0.018023323 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:13:06.698 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:13:06 smithi059 podman[73991]: 2024-09-10 21:13:06.566386297 +0000 UTC m=+0.135780615 container create a31d4854ededf69a0df2b1a7b62a8310f9cdbe3bd2c1e905e328e1d1b89e3078 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS) 2024-09-10T21:13:06.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:06 smithi192 ceph-mon[35363]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:06.902 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:06.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:06 smithi154 ceph-mon[35041]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:07.162 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:13:06 smithi059 podman[73991]: 2024-09-10 21:13:06.810558514 +0000 UTC m=+0.379952832 container init a31d4854ededf69a0df2b1a7b62a8310f9cdbe3bd2c1e905e328e1d1b89e3078 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-a, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-10T21:13:07.162 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:13:06 smithi059 podman[73991]: 2024-09-10 21:13:06.813449901 +0000 UTC m=+0.382844227 container start a31d4854ededf69a0df2b1a7b62a8310f9cdbe3bd2c1e905e328e1d1b89e3078 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-10T21:13:07.162 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:13:06 smithi059 ceph-mds[74036]: -- 172.21.15.59:0/4013674379 <== mon.0 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556ce85ed860 con 0x556ce85cb000 2024-09-10T21:13:07.162 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:13:06 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-a[74032]: starting mds.a at 2024-09-10T21:13:07.162 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:13:06 smithi059 bash[73991]: a31d4854ededf69a0df2b1a7b62a8310f9cdbe3bd2c1e905e328e1d1b89e3078 2024-09-10T21:13:07.162 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:13:06 smithi059 systemd[1]: Started Ceph mds.a for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:13:07.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.388+0000 7f390d1e3640 1 -- 172.21.15.59:0/1827827676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39081087d0 msgr2=0x7f3908108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:07.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.388+0000 7f390d1e3640 1 --2- 172.21.15.59:0/1827827676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39081087d0 0x7f3908108c10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f38f0009900 tx=0x7f38f002a410 comp rx=0 tx=0).stop 2024-09-10T21:13:07.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.388+0000 7f390d1e3640 1 -- 172.21.15.59:0/1827827676 shutdown_connections 2024-09-10T21:13:07.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.388+0000 7f390d1e3640 1 --2- 172.21.15.59:0/1827827676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3908109150 0x7f390810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:07.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.388+0000 7f390d1e3640 1 --2- 172.21.15.59:0/1827827676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39081087d0 0x7f3908108c10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:07.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.388+0000 7f390d1e3640 1 --2- 172.21.15.59:0/1827827676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3908102dc0 0x7f39081031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:07.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.388+0000 7f390d1e3640 1 -- 172.21.15.59:0/1827827676 >> 172.21.15.59:0/1827827676 conn(0x7f39080fe830 msgr2=0x7f3908100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:07.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.388+0000 7f390d1e3640 1 -- 172.21.15.59:0/1827827676 shutdown_connections 2024-09-10T21:13:07.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.388+0000 7f390d1e3640 1 -- 172.21.15.59:0/1827827676 wait complete. 2024-09-10T21:13:07.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.389+0000 7f390d1e3640 1 Processor -- start 2024-09-10T21:13:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.389+0000 7f390d1e3640 1 -- start start 2024-09-10T21:13:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.389+0000 7f390d1e3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3908102dc0 0x7f3908199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.389+0000 7f390d1e3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39081087d0 0x7f39081997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.389+0000 7f390d1e3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3908109150 0x7f390819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.389+0000 7f390d1e3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3908112e10 con 0x7f39081087d0 2024-09-10T21:13:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.389+0000 7f390d1e3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3908112c90 con 0x7f3908102dc0 2024-09-10T21:13:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.389+0000 7f390d1e3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3908112f90 con 0x7f3908109150 2024-09-10T21:13:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.389+0000 7f390659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39081087d0 0x7f39081997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.389+0000 7f390659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39081087d0 0x7f39081997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40636/0 (socket says 172.21.15.59:40636) 2024-09-10T21:13:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.389+0000 7f390659c640 1 -- 172.21.15.59:0/3665537631 learned_addr learned my addr 172.21.15.59:0/3665537631 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.390+0000 7f3906d9d640 1 --2- 172.21.15.59:0/3665537631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3908102dc0 0x7f3908199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.390+0000 7f390759e640 1 --2- 172.21.15.59:0/3665537631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3908109150 0x7f390819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.390+0000 7f390659c640 1 -- 172.21.15.59:0/3665537631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3908109150 msgr2=0x7f390819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.390+0000 7f390659c640 1 --2- 172.21.15.59:0/3665537631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3908109150 0x7f390819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.390+0000 7f390659c640 1 -- 172.21.15.59:0/3665537631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3908102dc0 msgr2=0x7f3908199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.390+0000 7f390659c640 1 --2- 172.21.15.59:0/3665537631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3908102dc0 0x7f3908199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.390+0000 7f390659c640 1 -- 172.21.15.59:0/3665537631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390819f310 con 0x7f39081087d0 2024-09-10T21:13:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.390+0000 7f390759e640 1 --2- 172.21.15.59:0/3665537631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3908109150 0x7f390819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:13:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.390+0000 7f390659c640 1 --2- 172.21.15.59:0/3665537631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39081087d0 0x7f39081997a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f38f0005940 tx=0x7f38f00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.390+0000 7f38fffff640 1 -- 172.21.15.59:0/3665537631 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f003f030 con 0x7f39081087d0 2024-09-10T21:13:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.390+0000 7f390d1e3640 1 -- 172.21.15.59:0/3665537631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f390819f5a0 con 0x7f39081087d0 2024-09-10T21:13:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.390+0000 7f38fffff640 1 -- 172.21.15.59:0/3665537631 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38f0003cb0 con 0x7f39081087d0 2024-09-10T21:13:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.390+0000 7f38fffff640 1 -- 172.21.15.59:0/3665537631 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f0035070 con 0x7f39081087d0 2024-09-10T21:13:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.390+0000 7f390d1e3640 1 -- 172.21.15.59:0/3665537631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39081a5cc0 con 0x7f39081087d0 2024-09-10T21:13:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.391+0000 7f390d1e3640 1 -- 172.21.15.59:0/3665537631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39081031a0 con 0x7f39081087d0 2024-09-10T21:13:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.393+0000 7f38fffff640 1 -- 172.21.15.59:0/3665537631 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f38f003bbf0 con 0x7f39081087d0 2024-09-10T21:13:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.393+0000 7f38fffff640 1 --2- 172.21.15.59:0/3665537631 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f38f40b52e0 0x7f38f40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.393+0000 7f3906d9d640 1 --2- 172.21.15.59:0/3665537631 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f38f40b52e0 0x7f38f40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:07.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.393+0000 7f38fffff640 1 -- 172.21.15.59:0/3665537631 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f38f01063a0 con 0x7f39081087d0 2024-09-10T21:13:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.394+0000 7f3906d9d640 1 --2- 172.21.15.59:0/3665537631 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f38f40b52e0 0x7f38f40b77a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f38f8005fd0 tx=0x7f38f8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:07.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.398+0000 7f38fffff640 1 -- 172.21.15.59:0/3665537631 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f38f00cd700 con 0x7f39081087d0 2024-09-10T21:13:07.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.618+0000 7f390d1e3640 1 -- 172.21.15.59:0/3665537631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f390810af30 con 0x7f39081087d0 2024-09-10T21:13:07.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.619+0000 7f38fffff640 1 -- 172.21.15.59:0/3665537631 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9695 (secure 0 0 0) 0x7f38f00cd000 con 0x7f39081087d0 2024-09-10T21:13:07.624 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:13:07.624 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":12,"btime":"2024-09-10T21:13:07:443479+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14709,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24499,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24524,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24529,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24542,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-10T21:13:07.625 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 12 2024-09-10T21:13:07.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.621+0000 7f390d1e3640 1 -- 172.21.15.59:0/3665537631 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f38f40b52e0 msgr2=0x7f38f40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.621+0000 7f390d1e3640 1 --2- 172.21.15.59:0/3665537631 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f38f40b52e0 0x7f38f40b77a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f38f8005fd0 tx=0x7f38f8005850 comp rx=0 tx=0).stop 2024-09-10T21:13:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.621+0000 7f390d1e3640 1 -- 172.21.15.59:0/3665537631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39081087d0 msgr2=0x7f39081997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.621+0000 7f390d1e3640 1 --2- 172.21.15.59:0/3665537631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39081087d0 0x7f39081997a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f38f0005940 tx=0x7f38f00042f0 comp rx=0 tx=0).stop 2024-09-10T21:13:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.621+0000 7f390d1e3640 1 -- 172.21.15.59:0/3665537631 shutdown_connections 2024-09-10T21:13:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.621+0000 7f390d1e3640 1 --2- 172.21.15.59:0/3665537631 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f38f40b52e0 0x7f38f40b77a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.621+0000 7f390d1e3640 1 --2- 172.21.15.59:0/3665537631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3908109150 0x7f390819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.621+0000 7f390d1e3640 1 --2- 172.21.15.59:0/3665537631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39081087d0 0x7f39081997a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.622+0000 7f390d1e3640 1 --2- 172.21.15.59:0/3665537631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3908102dc0 0x7f3908199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.622+0000 7f390d1e3640 1 -- 172.21.15.59:0/3665537631 >> 172.21.15.59:0/3665537631 conn(0x7f39080fe830 msgr2=0x7f3908100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.622+0000 7f390d1e3640 1 -- 172.21.15.59:0/3665537631 shutdown_connections 2024-09-10T21:13:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:07.622+0000 7f390d1e3640 1 -- 172.21.15.59:0/3665537631 wait complete. 2024-09-10T21:13:08.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:07 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:08.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:07 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:08.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:07 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:08.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:07 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:13:08.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:07 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:13:08.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:07 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:13:08.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:07 smithi154 ceph-mon[35041]: Deploying daemon mds.b on smithi154 2024-09-10T21:13:08.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:07 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.59:6840/1675735841,v1:172.21.15.59:6841/1675735841] up:boot 2024-09-10T21:13:08.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:07 smithi154 ceph-mon[35041]: fsmap 11 up:standby 2024-09-10T21:13:08.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:07 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T21:13:08.184 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:07 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3665537631' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:13:08.204 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:07 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:08.204 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:07 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:08.204 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:07 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:08.204 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:07 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:13:08.204 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:07 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:13:08.204 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:07 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:13:08.204 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:07 smithi059 ceph-mon[30888]: Deploying daemon mds.b on smithi154 2024-09-10T21:13:08.204 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:07 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.59:6840/1675735841,v1:172.21.15.59:6841/1675735841] up:boot 2024-09-10T21:13:08.204 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:07 smithi059 ceph-mon[30888]: fsmap 11 up:standby 2024-09-10T21:13:08.205 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:07 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T21:13:08.205 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:07 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3665537631' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:13:08.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:07 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:08.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:07 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:08.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:07 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:08.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:07 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T21:13:08.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:07 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T21:13:08.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:07 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:13:08.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:07 smithi192 ceph-mon[35363]: Deploying daemon mds.b on smithi154 2024-09-10T21:13:08.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:07 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.59:6840/1675735841,v1:172.21.15.59:6841/1675735841] up:boot 2024-09-10T21:13:08.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:07 smithi192 ceph-mon[35363]: fsmap 11 up:standby 2024-09-10T21:13:08.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:07 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T21:13:08.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:07 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3665537631' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:13:09.116 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:08 smithi154 ceph-mon[35041]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:09.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:08 smithi192 ceph-mon[35363]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:09.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:08 smithi059 ceph-mon[30888]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:09.933 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 21:13:09 smithi154 systemd[1]: Started Ceph mds.b for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:13:10.234 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:13:10.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:10 smithi059 ceph-mon[30888]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:10.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:10.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:10.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:10.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:10.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:10.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:13:10.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:10 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] up:boot 2024-09-10T21:13:10.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:10 smithi059 ceph-mon[30888]: fsmap 12 up:standby 2024-09-10T21:13:10.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:10 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T21:13:10.915 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:10.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:10 smithi154 ceph-mon[35041]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:10.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:10.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:10.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:10.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:10.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:10.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:13:10.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:10 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] up:boot 2024-09-10T21:13:10.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:10 smithi154 ceph-mon[35041]: fsmap 12 up:standby 2024-09-10T21:13:10.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:10 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T21:13:11.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:10 smithi192 ceph-mon[35363]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:11.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:11.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:11.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:11.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:11.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:11.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:13:11.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:10 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] up:boot 2024-09-10T21:13:11.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:10 smithi192 ceph-mon[35363]: fsmap 12 up:standby 2024-09-10T21:13:11.079 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:10 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T21:13:11.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.354+0000 7f1b564a2640 1 -- 172.21.15.59:0/2468125329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b501076e0 msgr2=0x7f1b50107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:11.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.354+0000 7f1b564a2640 1 --2- 172.21.15.59:0/2468125329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b501076e0 0x7f1b50107b20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009900 tx=0x7f1b4402a410 comp rx=0 tx=0).stop 2024-09-10T21:13:11.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.355+0000 7f1b564a2640 1 -- 172.21.15.59:0/2468125329 shutdown_connections 2024-09-10T21:13:11.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.355+0000 7f1b564a2640 1 --2- 172.21.15.59:0/2468125329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b50108060 0x7f1b5010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:11.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.355+0000 7f1b564a2640 1 --2- 172.21.15.59:0/2468125329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b501076e0 0x7f1b50107b20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:11.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.355+0000 7f1b564a2640 1 --2- 172.21.15.59:0/2468125329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b50101cd0 0x7f1b501020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:11.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.355+0000 7f1b564a2640 1 -- 172.21.15.59:0/2468125329 >> 172.21.15.59:0/2468125329 conn(0x7f1b500fd700 msgr2=0x7f1b500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:11.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.355+0000 7f1b564a2640 1 -- 172.21.15.59:0/2468125329 shutdown_connections 2024-09-10T21:13:11.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.355+0000 7f1b564a2640 1 -- 172.21.15.59:0/2468125329 wait complete. 2024-09-10T21:13:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.355+0000 7f1b564a2640 1 Processor -- start 2024-09-10T21:13:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.355+0000 7f1b564a2640 1 -- start start 2024-09-10T21:13:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.356+0000 7f1b564a2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b50101cd0 0x7f1b5019b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.356+0000 7f1b564a2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b501076e0 0x7f1b5019ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.356+0000 7f1b564a2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b50108060 0x7f1b501a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.356+0000 7f1b564a2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1b50111d20 con 0x7f1b50108060 2024-09-10T21:13:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.356+0000 7f1b564a2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b50111ba0 con 0x7f1b501076e0 2024-09-10T21:13:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.356+0000 7f1b564a2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1b50111ea0 con 0x7f1b50101cd0 2024-09-10T21:13:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.356+0000 7f1b54a3f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b50108060 0x7f1b501a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.356+0000 7f1b54a3f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b50108060 0x7f1b501a0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43688/0 (socket says 172.21.15.59:43688) 2024-09-10T21:13:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.356+0000 7f1b54a3f640 1 -- 172.21.15.59:0/2368003499 learned_addr learned my addr 172.21.15.59:0/2368003499 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.356+0000 7f1b4f7fe640 1 --2- 172.21.15.59:0/2368003499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b501076e0 0x7f1b5019ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:11.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.356+0000 7f1b4ffff640 1 --2- 172.21.15.59:0/2368003499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b50101cd0 0x7f1b5019b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:11.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.356+0000 7f1b54a3f640 1 -- 172.21.15.59:0/2368003499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b50101cd0 msgr2=0x7f1b5019b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:11.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.356+0000 7f1b54a3f640 1 --2- 172.21.15.59:0/2368003499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b50101cd0 0x7f1b5019b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:11.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.356+0000 7f1b54a3f640 1 -- 172.21.15.59:0/2368003499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b501076e0 msgr2=0x7f1b5019ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:11.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.356+0000 7f1b54a3f640 1 --2- 172.21.15.59:0/2368003499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b501076e0 0x7f1b5019ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:11.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.356+0000 7f1b54a3f640 1 -- 172.21.15.59:0/2368003499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b501a15b0 con 0x7f1b50108060 2024-09-10T21:13:11.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.357+0000 7f1b54a3f640 1 --2- 172.21.15.59:0/2368003499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b50108060 0x7f1b501a0de0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009fd0 tx=0x7f1b4800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:11.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.357+0000 7f1b4d7fa640 1 -- 172.21.15.59:0/2368003499 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b48017070 con 0x7f1b50108060 2024-09-10T21:13:11.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.357+0000 7f1b4d7fa640 1 -- 172.21.15.59:0/2368003499 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b48003e20 con 0x7f1b50108060 2024-09-10T21:13:11.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.357+0000 7f1b564a2640 1 -- 172.21.15.59:0/2368003499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b501a18a0 con 0x7f1b50108060 2024-09-10T21:13:11.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.357+0000 7f1b4d7fa640 1 -- 172.21.15.59:0/2368003499 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b48010460 con 0x7f1b50108060 2024-09-10T21:13:11.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.357+0000 7f1b564a2640 1 -- 172.21.15.59:0/2368003499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b501a7f60 con 0x7f1b50108060 2024-09-10T21:13:11.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.358+0000 7f1b564a2640 1 -- 172.21.15.59:0/2368003499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b501020b0 con 0x7f1b50108060 2024-09-10T21:13:11.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.359+0000 7f1b4d7fa640 1 -- 172.21.15.59:0/2368003499 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f1b48003970 con 0x7f1b50108060 2024-09-10T21:13:11.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.360+0000 7f1b4d7fa640 1 --2- 172.21.15.59:0/2368003499 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1b380b5360 0x7f1b380b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:11.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.361+0000 7f1b4ffff640 1 --2- 172.21.15.59:0/2368003499 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1b380b5360 0x7f1b380b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:11.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.361+0000 7f1b4d7fa640 1 -- 172.21.15.59:0/2368003499 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7f1b480e53c0 con 0x7f1b50108060 2024-09-10T21:13:11.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.361+0000 7f1b4ffff640 1 --2- 172.21.15.59:0/2368003499 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1b380b5360 0x7f1b380b7820 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009b60 tx=0x7f1b40005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:11.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.364+0000 7f1b4d7fa640 1 -- 172.21.15.59:0/2368003499 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1b480ac7a0 con 0x7f1b50108060 2024-09-10T21:13:11.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.613+0000 7f1b564a2640 1 -- 172.21.15.59:0/2368003499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b501a8230 con 0x7f1b50108060 2024-09-10T21:13:11.619 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:11 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:11.619 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:11 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:11.619 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:11 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:11.619 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:11 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:11.619 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:11 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:11.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.614+0000 7f1b4d7fa640 1 -- 172.21.15.59:0/2368003499 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10524 (secure 0 0 0) 0x7f1b480ac0a0 con 0x7f1b50108060 2024-09-10T21:13:11.620 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:13:11.620 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":13,"btime":"2024-09-10T21:13:09:937073+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14703,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14709,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24499,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24503,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24524,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24529,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24538,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24542,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24550,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-10T21:13:11.620 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 13 2024-09-10T21:13:11.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.617+0000 7f1b564a2640 1 -- 172.21.15.59:0/2368003499 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1b380b5360 msgr2=0x7f1b380b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:11.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.617+0000 7f1b564a2640 1 --2- 172.21.15.59:0/2368003499 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1b380b5360 0x7f1b380b7820 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009b60 tx=0x7f1b40005f90 comp rx=0 tx=0).stop 2024-09-10T21:13:11.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.617+0000 7f1b564a2640 1 -- 172.21.15.59:0/2368003499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b50108060 msgr2=0x7f1b501a0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:11.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.617+0000 7f1b564a2640 1 --2- 172.21.15.59:0/2368003499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b50108060 0x7f1b501a0de0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009fd0 tx=0x7f1b4800b260 comp rx=0 tx=0).stop 2024-09-10T21:13:11.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.617+0000 7f1b564a2640 1 -- 172.21.15.59:0/2368003499 shutdown_connections 2024-09-10T21:13:11.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.617+0000 7f1b564a2640 1 --2- 172.21.15.59:0/2368003499 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1b380b5360 0x7f1b380b7820 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:11.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.617+0000 7f1b564a2640 1 --2- 172.21.15.59:0/2368003499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b50108060 0x7f1b501a0de0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:11.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.617+0000 7f1b564a2640 1 --2- 172.21.15.59:0/2368003499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b501076e0 0x7f1b5019ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:11.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.617+0000 7f1b564a2640 1 --2- 172.21.15.59:0/2368003499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b50101cd0 0x7f1b5019b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:11.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.617+0000 7f1b564a2640 1 -- 172.21.15.59:0/2368003499 >> 172.21.15.59:0/2368003499 conn(0x7f1b500fd700 msgr2=0x7f1b5006bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:11.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.617+0000 7f1b564a2640 1 -- 172.21.15.59:0/2368003499 shutdown_connections 2024-09-10T21:13:11.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:11.617+0000 7f1b564a2640 1 -- 172.21.15.59:0/2368003499 wait complete. 2024-09-10T21:13:11.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:11 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:11.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:11 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:11.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:11 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:11.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:11 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:11.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:11 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:12.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:11 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:12.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:11 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:12.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:11 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:12.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:11 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:12.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:11 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:12.337 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-10T21:13:12.609 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:12 smithi059 ceph-mon[30888]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:12.609 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:12 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2368003499' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:13:12.610 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:12 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:12.610 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:12 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:12.630 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:12.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:12 smithi154 ceph-mon[35041]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:12.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:12 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2368003499' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:13:12.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:12 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:12.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:12 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:13.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:12 smithi192 ceph-mon[35363]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:13.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:12 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2368003499' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:13:13.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:12 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:13.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:12 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:13.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.123+0000 7fb326100640 1 -- 172.21.15.59:0/3803088700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3201076a0 msgr2=0x7fb320107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:13.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.123+0000 7fb326100640 1 --2- 172.21.15.59:0/3803088700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3201076a0 0x7fb320107ae0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb314009900 tx=0x7fb31402a410 comp rx=0 tx=0).stop 2024-09-10T21:13:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.123+0000 7fb326100640 1 -- 172.21.15.59:0/3803088700 shutdown_connections 2024-09-10T21:13:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.123+0000 7fb326100640 1 --2- 172.21.15.59:0/3803088700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb320108020 0x7fb32010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.123+0000 7fb326100640 1 --2- 172.21.15.59:0/3803088700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3201076a0 0x7fb320107ae0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.123+0000 7fb326100640 1 --2- 172.21.15.59:0/3803088700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb320101c90 0x7fb320102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.123+0000 7fb326100640 1 -- 172.21.15.59:0/3803088700 >> 172.21.15.59:0/3803088700 conn(0x7fb3200fd700 msgr2=0x7fb3200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.123+0000 7fb326100640 1 -- 172.21.15.59:0/3803088700 shutdown_connections 2024-09-10T21:13:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.123+0000 7fb326100640 1 -- 172.21.15.59:0/3803088700 wait complete. 2024-09-10T21:13:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.124+0000 7fb326100640 1 Processor -- start 2024-09-10T21:13:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.124+0000 7fb326100640 1 -- start start 2024-09-10T21:13:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.124+0000 7fb326100640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb320101c90 0x7fb320199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.124+0000 7fb326100640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3201076a0 0x7fb320199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.124+0000 7fb326100640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb320108020 0x7fb32019eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:13.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.124+0000 7fb326100640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb320111ca0 con 0x7fb3201076a0 2024-09-10T21:13:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.124+0000 7fb326100640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb320111b20 con 0x7fb320108020 2024-09-10T21:13:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.124+0000 7fb326100640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb320111e20 con 0x7fb320101c90 2024-09-10T21:13:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.124+0000 7fb31effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3201076a0 0x7fb320199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.124+0000 7fb31effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3201076a0 0x7fb320199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43708/0 (socket says 172.21.15.59:43708) 2024-09-10T21:13:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.124+0000 7fb31effd640 1 -- 172.21.15.59:0/500308063 learned_addr learned my addr 172.21.15.59:0/500308063 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.124+0000 7fb31f7fe640 1 --2- 172.21.15.59:0/500308063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb320101c90 0x7fb320199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.125+0000 7fb31effd640 1 -- 172.21.15.59:0/500308063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb320101c90 msgr2=0x7fb320199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.125+0000 7fb31ffff640 1 --2- 172.21.15.59:0/500308063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb320108020 0x7fb32019eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.125+0000 7fb31effd640 1 --2- 172.21.15.59:0/500308063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb320101c90 0x7fb320199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.125+0000 7fb31effd640 1 -- 172.21.15.59:0/500308063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb320108020 msgr2=0x7fb32019eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.125+0000 7fb31effd640 1 --2- 172.21.15.59:0/500308063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb320108020 0x7fb32019eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:13.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.125+0000 7fb31effd640 1 -- 172.21.15.59:0/500308063 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32019f300 con 0x7fb3201076a0 2024-09-10T21:13:13.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.125+0000 7fb31effd640 1 --2- 172.21.15.59:0/500308063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3201076a0 0x7fb320199790 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb314005940 tx=0x7fb3140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:13.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.125+0000 7fb31cff9640 1 -- 172.21.15.59:0/500308063 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31403f030 con 0x7fb3201076a0 2024-09-10T21:13:13.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.125+0000 7fb326100640 1 -- 172.21.15.59:0/500308063 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb32019f590 con 0x7fb3201076a0 2024-09-10T21:13:13.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.125+0000 7fb31cff9640 1 -- 172.21.15.59:0/500308063 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb314003cb0 con 0x7fb3201076a0 2024-09-10T21:13:13.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.125+0000 7fb31cff9640 1 -- 172.21.15.59:0/500308063 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314035070 con 0x7fb3201076a0 2024-09-10T21:13:13.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.125+0000 7fb326100640 1 -- 172.21.15.59:0/500308063 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3201a5cb0 con 0x7fb3201076a0 2024-09-10T21:13:13.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.126+0000 7fb326100640 1 -- 172.21.15.59:0/500308063 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb320102070 con 0x7fb3201076a0 2024-09-10T21:13:13.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.127+0000 7fb31cff9640 1 -- 172.21.15.59:0/500308063 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fb314003800 con 0x7fb3201076a0 2024-09-10T21:13:13.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.128+0000 7fb31cff9640 1 --2- 172.21.15.59:0/500308063 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb3080b52e0 0x7fb3080b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:13.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.128+0000 7fb31f7fe640 1 --2- 172.21.15.59:0/500308063 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb3080b52e0 0x7fb3080b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:13.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.128+0000 7fb31cff9640 1 -- 172.21.15.59:0/500308063 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7fb314106540 con 0x7fb3201076a0 2024-09-10T21:13:13.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.129+0000 7fb31f7fe640 1 --2- 172.21.15.59:0/500308063 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb3080b52e0 0x7fb3080b77a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb31000abe0 tx=0x7fb31000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:13.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.131+0000 7fb31cff9640 1 -- 172.21.15.59:0/500308063 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb3140cd8a0 con 0x7fb3201076a0 2024-09-10T21:13:13.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.323+0000 7fb326100640 1 -- 172.21.15.59:0/500308063 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb3201a5f40 con 0x7fb3201076a0 2024-09-10T21:13:13.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.324+0000 7fb31cff9640 1 -- 172.21.15.59:0/500308063 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) ==== 84+0+65 (secure 0 0 0) 0x7fb3140cd1a0 con 0x7fb3201076a0 2024-09-10T21:13:13.329 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:13:13.329 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-09-10T21:13:13.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:13:13.329 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-09-10T21:13:13.329 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-09-10T21:13:13.329 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:13:13.329 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-09-10T21:13:13.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.326+0000 7fb326100640 1 -- 172.21.15.59:0/500308063 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb3080b52e0 msgr2=0x7fb3080b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:13.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.326+0000 7fb326100640 1 --2- 172.21.15.59:0/500308063 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb3080b52e0 0x7fb3080b77a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb31000abe0 tx=0x7fb31000a2d0 comp rx=0 tx=0).stop 2024-09-10T21:13:13.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.326+0000 7fb326100640 1 -- 172.21.15.59:0/500308063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3201076a0 msgr2=0x7fb320199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:13.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.326+0000 7fb326100640 1 --2- 172.21.15.59:0/500308063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3201076a0 0x7fb320199790 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb314005940 tx=0x7fb3140042f0 comp rx=0 tx=0).stop 2024-09-10T21:13:13.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.326+0000 7fb326100640 1 -- 172.21.15.59:0/500308063 shutdown_connections 2024-09-10T21:13:13.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.326+0000 7fb326100640 1 --2- 172.21.15.59:0/500308063 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb3080b52e0 0x7fb3080b77a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:13.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.326+0000 7fb326100640 1 --2- 172.21.15.59:0/500308063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb320108020 0x7fb32019eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:13.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.326+0000 7fb326100640 1 --2- 172.21.15.59:0/500308063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3201076a0 0x7fb320199790 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:13.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.326+0000 7fb326100640 1 --2- 172.21.15.59:0/500308063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb320101c90 0x7fb320199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:13.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.326+0000 7fb326100640 1 -- 172.21.15.59:0/500308063 >> 172.21.15.59:0/500308063 conn(0x7fb3200fd700 msgr2=0x7fb320100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:13.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.326+0000 7fb326100640 1 -- 172.21.15.59:0/500308063 shutdown_connections 2024-09-10T21:13:13.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:13.326+0000 7fb326100640 1 -- 172.21.15.59:0/500308063 wait complete. 2024-09-10T21:13:13.881 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:13 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:13:13.882 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:13 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:13:13.882 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:13 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:13.882 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:13 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:13:13.882 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:13 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/500308063' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T21:13:13.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:13 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:13:13.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:13 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:13:13.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:13 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:13.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:13 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:13:13.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:13 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/500308063' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T21:13:13.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:13 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:13:13.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:13 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:13:13.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:13 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:13.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:13 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:13:13.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:13 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/500308063' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T21:13:13.965 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T21:13:13.965 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T21:13:14.875 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:14.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:14 smithi059 ceph-mon[30888]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:14.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:14 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:14.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:14 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:14.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:14 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:14.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:14 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:14.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:14 smithi154 ceph-mon[35041]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:14.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:14 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:14.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:14 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:14.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:14 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:14.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:14 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:15.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:14 smithi192 ceph-mon[35363]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:15.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:14 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:15.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:14 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:15.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:14 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:15.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:14 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:15.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.344+0000 7ffbda9c7640 1 -- 172.21.15.59:0/1272631334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbd410d160 msgr2=0x7ffbd410f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:15.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.344+0000 7ffbda9c7640 1 --2- 172.21.15.59:0/1272631334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbd410d160 0x7ffbd410f590 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009ca0 tx=0x7ffbcc02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:13:15.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.344+0000 7ffbda9c7640 1 -- 172.21.15.59:0/1272631334 shutdown_connections 2024-09-10T21:13:15.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.344+0000 7ffbda9c7640 1 --2- 172.21.15.59:0/1272631334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbd410d160 0x7ffbd410f590 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:15.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.344+0000 7ffbda9c7640 1 --2- 172.21.15.59:0/1272631334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbd41045b0 0x7ffbd410cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:15.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.344+0000 7ffbda9c7640 1 --2- 172.21.15.59:0/1272631334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbd4103bb0 0x7ffbd4103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:15.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.344+0000 7ffbda9c7640 1 -- 172.21.15.59:0/1272631334 >> 172.21.15.59:0/1272631334 conn(0x7ffbd40fd700 msgr2=0x7ffbd40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:15.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.344+0000 7ffbda9c7640 1 -- 172.21.15.59:0/1272631334 shutdown_connections 2024-09-10T21:13:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.344+0000 7ffbda9c7640 1 -- 172.21.15.59:0/1272631334 wait complete. 2024-09-10T21:13:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.345+0000 7ffbda9c7640 1 Processor -- start 2024-09-10T21:13:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.345+0000 7ffbda9c7640 1 -- start start 2024-09-10T21:13:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.345+0000 7ffbda9c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbd4103bb0 0x7ffbd4101a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.345+0000 7ffbda9c7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbd41045b0 0x7ffbd4101f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.345+0000 7ffbda9c7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbd410d160 0x7ffbd41024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.345+0000 7ffbda9c7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd4112da0 con 0x7ffbd410d160 2024-09-10T21:13:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.345+0000 7ffbda9c7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd4112c20 con 0x7ffbd4103bb0 2024-09-10T21:13:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.345+0000 7ffbda9c7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd4112f20 con 0x7ffbd41045b0 2024-09-10T21:13:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.345+0000 7ffbd8f64640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbd410d160 0x7ffbd41024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.345+0000 7ffbd8f64640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbd410d160 0x7ffbd41024b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43718/0 (socket says 172.21.15.59:43718) 2024-09-10T21:13:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.345+0000 7ffbd8f64640 1 -- 172.21.15.59:0/1827307581 learned_addr learned my addr 172.21.15.59:0/1827307581 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.345+0000 7ffbd3fff640 1 --2- 172.21.15.59:0/1827307581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbd4103bb0 0x7ffbd4101a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.345+0000 7ffbcbfff640 1 --2- 172.21.15.59:0/1827307581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbd41045b0 0x7ffbd4101f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.346+0000 7ffbd8f64640 1 -- 172.21.15.59:0/1827307581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbd41045b0 msgr2=0x7ffbd4101f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.346+0000 7ffbd8f64640 1 --2- 172.21.15.59:0/1827307581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbd41045b0 0x7ffbd4101f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.346+0000 7ffbd8f64640 1 -- 172.21.15.59:0/1827307581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbd4103bb0 msgr2=0x7ffbd4101a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.346+0000 7ffbd8f64640 1 --2- 172.21.15.59:0/1827307581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbd4103bb0 0x7ffbd4101a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.346+0000 7ffbd8f64640 1 -- 172.21.15.59:0/1827307581 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd41a7590 con 0x7ffbd410d160 2024-09-10T21:13:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.346+0000 7ffbcbfff640 1 --2- 172.21.15.59:0/1827307581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbd41045b0 0x7ffbd4101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:13:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.346+0000 7ffbd8f64640 1 --2- 172.21.15.59:0/1827307581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbd410d160 0x7ffbd41024b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc005cc0 tx=0x7ffbcc02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.346+0000 7ffbd1ffb640 1 -- 172.21.15.59:0/1827307581 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc003bf0 con 0x7ffbd410d160 2024-09-10T21:13:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.346+0000 7ffbd1ffb640 1 -- 172.21.15.59:0/1827307581 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbcc003d90 con 0x7ffbd410d160 2024-09-10T21:13:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.346+0000 7ffbda9c7640 1 -- 172.21.15.59:0/1827307581 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbd41a7820 con 0x7ffbd410d160 2024-09-10T21:13:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.346+0000 7ffbd1ffb640 1 -- 172.21.15.59:0/1827307581 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc02fb20 con 0x7ffbd410d160 2024-09-10T21:13:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.346+0000 7ffbda9c7640 1 -- 172.21.15.59:0/1827307581 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbd41a7db0 con 0x7ffbd410d160 2024-09-10T21:13:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.347+0000 7ffbda9c7640 1 -- 172.21.15.59:0/1827307581 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbd4103f90 con 0x7ffbd410d160 2024-09-10T21:13:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.349+0000 7ffbd1ffb640 1 -- 172.21.15.59:0/1827307581 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7ffbcc004580 con 0x7ffbd410d160 2024-09-10T21:13:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.349+0000 7ffbd1ffb640 1 --2- 172.21.15.59:0/1827307581 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffbc00b5360 0x7ffbc00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.349+0000 7ffbd3fff640 1 --2- 172.21.15.59:0/1827307581 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffbc00b5360 0x7ffbc00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.349+0000 7ffbd1ffb640 1 -- 172.21.15.59:0/1827307581 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7127+0+0 (secure 0 0 0) 0x7ffbcc106b20 con 0x7ffbd410d160 2024-09-10T21:13:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.350+0000 7ffbd3fff640 1 --2- 172.21.15.59:0/1827307581 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffbc00b5360 0x7ffbc00b7820 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400abe0 tx=0x7ffbc400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.353+0000 7ffbd1ffb640 1 -- 172.21.15.59:0/1827307581 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffbcc0cdde0 con 0x7ffbd410d160 2024-09-10T21:13:15.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.556+0000 7ffbda9c7640 1 -- 172.21.15.59:0/1827307581 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ffbd41a80e0 con 0x7ffbd410d160 2024-09-10T21:13:15.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.613+0000 7ffbd1ffb640 1 -- 172.21.15.59:0/1827307581 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) ==== 138+0+0 (secure 0 0 0) 0x7ffbcc0098b0 con 0x7ffbd410d160 2024-09-10T21:13:15.619 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-09-10T21:13:15.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.616+0000 7ffbda9c7640 1 -- 172.21.15.59:0/1827307581 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffbc00b5360 msgr2=0x7ffbc00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:15.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.616+0000 7ffbda9c7640 1 --2- 172.21.15.59:0/1827307581 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffbc00b5360 0x7ffbc00b7820 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400abe0 tx=0x7ffbc400a2d0 comp rx=0 tx=0).stop 2024-09-10T21:13:15.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.616+0000 7ffbda9c7640 1 -- 172.21.15.59:0/1827307581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbd410d160 msgr2=0x7ffbd41024b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:15.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.616+0000 7ffbda9c7640 1 --2- 172.21.15.59:0/1827307581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbd410d160 0x7ffbd41024b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc005cc0 tx=0x7ffbcc02f380 comp rx=0 tx=0).stop 2024-09-10T21:13:15.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.616+0000 7ffbda9c7640 1 -- 172.21.15.59:0/1827307581 shutdown_connections 2024-09-10T21:13:15.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.616+0000 7ffbda9c7640 1 --2- 172.21.15.59:0/1827307581 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffbc00b5360 0x7ffbc00b7820 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:15.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.616+0000 7ffbda9c7640 1 --2- 172.21.15.59:0/1827307581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbd410d160 0x7ffbd41024b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:15.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.616+0000 7ffbda9c7640 1 --2- 172.21.15.59:0/1827307581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbd41045b0 0x7ffbd4101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:15.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.616+0000 7ffbda9c7640 1 --2- 172.21.15.59:0/1827307581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffbd4103bb0 0x7ffbd4101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:15.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.616+0000 7ffbda9c7640 1 -- 172.21.15.59:0/1827307581 >> 172.21.15.59:0/1827307581 conn(0x7ffbd40fd700 msgr2=0x7ffbd410f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:15.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.616+0000 7ffbda9c7640 1 -- 172.21.15.59:0/1827307581 shutdown_connections 2024-09-10T21:13:15.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:15.616+0000 7ffbda9c7640 1 -- 172.21.15.59:0/1827307581 wait complete. 2024-09-10T21:13:15.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:15 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1827307581' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T21:13:15.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:15 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:15.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:15 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:15.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:15 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:13:15.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:15 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:13:15.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:15 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:15.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:15 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1827307581' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T21:13:15.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:15 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:15.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:15 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:15.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:15 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:13:15.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:15 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:13:15.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:15 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:16.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:15 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1827307581' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T21:13:16.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:15 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:16.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:15 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:16.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:15 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:13:16.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:15 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:13:16.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:15 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:13:16.331 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T21:13:16.590 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:16.627 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:16 smithi059 ceph-mon[30888]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:16.628 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:16 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1827307581' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T21:13:16.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:16 smithi059 ceph-mon[30888]: osdmap e69: 12 total, 12 up, 12 in 2024-09-10T21:13:16.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:16 smithi154 ceph-mon[35041]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:16.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:16 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1827307581' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T21:13:16.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:16 smithi154 ceph-mon[35041]: osdmap e69: 12 total, 12 up, 12 in 2024-09-10T21:13:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.072+0000 7fba3657c640 1 -- 172.21.15.59:0/3066040497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba301087d0 msgr2=0x7fba30108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.072+0000 7fba3657c640 1 --2- 172.21.15.59:0/3066040497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba301087d0 0x7fba30108c10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fba24009900 tx=0x7fba2402a410 comp rx=0 tx=0).stop 2024-09-10T21:13:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.072+0000 7fba3657c640 1 -- 172.21.15.59:0/3066040497 shutdown_connections 2024-09-10T21:13:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.072+0000 7fba3657c640 1 --2- 172.21.15.59:0/3066040497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba30109150 0x7fba3010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.072+0000 7fba3657c640 1 --2- 172.21.15.59:0/3066040497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba301087d0 0x7fba30108c10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.072+0000 7fba3657c640 1 --2- 172.21.15.59:0/3066040497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba30102dc0 0x7fba301031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.072+0000 7fba3657c640 1 -- 172.21.15.59:0/3066040497 >> 172.21.15.59:0/3066040497 conn(0x7fba300fe830 msgr2=0x7fba30100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.072+0000 7fba3657c640 1 -- 172.21.15.59:0/3066040497 shutdown_connections 2024-09-10T21:13:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.072+0000 7fba3657c640 1 -- 172.21.15.59:0/3066040497 wait complete. 2024-09-10T21:13:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.073+0000 7fba3657c640 1 Processor -- start 2024-09-10T21:13:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.073+0000 7fba3657c640 1 -- start start 2024-09-10T21:13:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.073+0000 7fba3657c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba30102dc0 0x7fba301993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.073+0000 7fba3657c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba301087d0 0x7fba30199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.073+0000 7fba3657c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba30109150 0x7fba3019ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.073+0000 7fba3657c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fba30112e50 con 0x7fba30109150 2024-09-10T21:13:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.073+0000 7fba3657c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fba30112cd0 con 0x7fba301087d0 2024-09-10T21:13:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.073+0000 7fba3657c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fba30112fd0 con 0x7fba30102dc0 2024-09-10T21:13:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.073+0000 7fba34b19640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba30109150 0x7fba3019ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.073+0000 7fba34b19640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba30109150 0x7fba3019ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43736/0 (socket says 172.21.15.59:43736) 2024-09-10T21:13:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.073+0000 7fba34b19640 1 -- 172.21.15.59:0/91593586 learned_addr learned my addr 172.21.15.59:0/91593586 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:17.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.073+0000 7fba2f7fe640 1 --2- 172.21.15.59:0/91593586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba301087d0 0x7fba30199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:17.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.073+0000 7fba2ffff640 1 --2- 172.21.15.59:0/91593586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba30102dc0 0x7fba301993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:17.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.074+0000 7fba34b19640 1 -- 172.21.15.59:0/91593586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba30102dc0 msgr2=0x7fba301993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:17.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.074+0000 7fba34b19640 1 --2- 172.21.15.59:0/91593586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba30102dc0 0x7fba301993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:17.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.074+0000 7fba34b19640 1 -- 172.21.15.59:0/91593586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba301087d0 msgr2=0x7fba30199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:17.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.074+0000 7fba34b19640 1 --2- 172.21.15.59:0/91593586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba301087d0 0x7fba30199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:17.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.074+0000 7fba34b19640 1 -- 172.21.15.59:0/91593586 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3019f490 con 0x7fba30109150 2024-09-10T21:13:17.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.074+0000 7fba34b19640 1 --2- 172.21.15.59:0/91593586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba30109150 0x7fba3019ecc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fba2800b970 tx=0x7fba2800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:17.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.074+0000 7fba2d7fa640 1 -- 172.21.15.59:0/91593586 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba28019070 con 0x7fba30109150 2024-09-10T21:13:17.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.074+0000 7fba3657c640 1 -- 172.21.15.59:0/91593586 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba3019f780 con 0x7fba30109150 2024-09-10T21:13:17.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.074+0000 7fba2d7fa640 1 -- 172.21.15.59:0/91593586 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba28014440 con 0x7fba30109150 2024-09-10T21:13:17.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.074+0000 7fba2d7fa640 1 -- 172.21.15.59:0/91593586 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba280075d0 con 0x7fba30109150 2024-09-10T21:13:17.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.074+0000 7fba3657c640 1 -- 172.21.15.59:0/91593586 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba301a5ec0 con 0x7fba30109150 2024-09-10T21:13:17.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.075+0000 7fba3657c640 1 -- 172.21.15.59:0/91593586 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba30103220 con 0x7fba30109150 2024-09-10T21:13:17.085 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:16 smithi192 ceph-mon[35363]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:17.085 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:16 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1827307581' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T21:13:17.085 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:16 smithi192 ceph-mon[35363]: osdmap e69: 12 total, 12 up, 12 in 2024-09-10T21:13:17.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.077+0000 7fba2d7fa640 1 -- 172.21.15.59:0/91593586 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fba280145f0 con 0x7fba30109150 2024-09-10T21:13:17.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.078+0000 7fba2d7fa640 1 --2- 172.21.15.59:0/91593586 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fba180b52e0 0x7fba180b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:17.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.078+0000 7fba2ffff640 1 --2- 172.21.15.59:0/91593586 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fba180b52e0 0x7fba180b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:17.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.078+0000 7fba2d7fa640 1 -- 172.21.15.59:0/91593586 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7497+0+0 (secure 0 0 0) 0x7fba280e5520 con 0x7fba30109150 2024-09-10T21:13:17.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.078+0000 7fba2ffff640 1 --2- 172.21.15.59:0/91593586 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fba180b52e0 0x7fba180b77a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fba20009990 tx=0x7fba20009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:17.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.081+0000 7fba2d7fa640 1 -- 172.21.15.59:0/91593586 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fba280ac020 con 0x7fba30109150 2024-09-10T21:13:17.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.266+0000 7fba3657c640 1 -- 172.21.15.59:0/91593586 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fba3010af30 con 0x7fba30109150 2024-09-10T21:13:17.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.627+0000 7fba2d7fa640 1 -- 172.21.15.59:0/91593586 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v71) ==== 170+0+0 (secure 0 0 0) 0x7fba280b0a50 con 0x7fba30109150 2024-09-10T21:13:17.633 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-09-10T21:13:17.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.630+0000 7fba3657c640 1 -- 172.21.15.59:0/91593586 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fba180b52e0 msgr2=0x7fba180b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:17.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.630+0000 7fba3657c640 1 --2- 172.21.15.59:0/91593586 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fba180b52e0 0x7fba180b77a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fba20009990 tx=0x7fba20009110 comp rx=0 tx=0).stop 2024-09-10T21:13:17.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.630+0000 7fba3657c640 1 -- 172.21.15.59:0/91593586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba30109150 msgr2=0x7fba3019ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:17.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.630+0000 7fba3657c640 1 --2- 172.21.15.59:0/91593586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba30109150 0x7fba3019ecc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fba2800b970 tx=0x7fba2800bd70 comp rx=0 tx=0).stop 2024-09-10T21:13:17.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.631+0000 7fba3657c640 1 -- 172.21.15.59:0/91593586 shutdown_connections 2024-09-10T21:13:17.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.631+0000 7fba3657c640 1 --2- 172.21.15.59:0/91593586 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fba180b52e0 0x7fba180b77a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:17.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.631+0000 7fba3657c640 1 --2- 172.21.15.59:0/91593586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba30109150 0x7fba3019ecc0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:17.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.631+0000 7fba3657c640 1 --2- 172.21.15.59:0/91593586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba301087d0 0x7fba30199920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:17.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.631+0000 7fba3657c640 1 --2- 172.21.15.59:0/91593586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba30102dc0 0x7fba301993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:17.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.631+0000 7fba3657c640 1 -- 172.21.15.59:0/91593586 >> 172.21.15.59:0/91593586 conn(0x7fba300fe830 msgr2=0x7fba30100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:17.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.631+0000 7fba3657c640 1 -- 172.21.15.59:0/91593586 shutdown_connections 2024-09-10T21:13:17.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:17.631+0000 7fba3657c640 1 -- 172.21.15.59:0/91593586 wait complete. 2024-09-10T21:13:17.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:17 smithi059 ceph-mon[30888]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T21:13:17.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:17 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/91593586' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T21:13:17.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:17 smithi154 ceph-mon[35041]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T21:13:17.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:17 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/91593586' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T21:13:18.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:17 smithi192 ceph-mon[35363]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T21:13:18.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:17 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/91593586' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T21:13:18.321 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T21:13:18.581 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:18.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:18 smithi059 ceph-mon[30888]: pgmap v276: 33 pgs: 3 creating+peering, 16 unknown, 14 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:18.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:18 smithi059 ceph-mon[30888]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T21:13:18.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:18 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/91593586' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T21:13:18.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:18 smithi059 ceph-mon[30888]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T21:13:18.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:18 smithi154 ceph-mon[35041]: pgmap v276: 33 pgs: 3 creating+peering, 16 unknown, 14 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:18.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:18 smithi154 ceph-mon[35041]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T21:13:18.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:18 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/91593586' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T21:13:18.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:18 smithi154 ceph-mon[35041]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T21:13:18.979 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:18 smithi192 ceph-mon[35363]: pgmap v276: 33 pgs: 3 creating+peering, 16 unknown, 14 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:18.979 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:18 smithi192 ceph-mon[35363]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T21:13:18.979 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:18 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/91593586' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T21:13:18.979 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:18 smithi192 ceph-mon[35363]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T21:13:19.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.049+0000 7fa436ad7640 1 -- 172.21.15.59:0/4081970341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa430104570 msgr2=0x7fa43010cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:19.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.049+0000 7fa436ad7640 1 --2- 172.21.15.59:0/4081970341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa430104570 0x7fa43010cb50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa424009900 tx=0x7fa42402a410 comp rx=0 tx=0).stop 2024-09-10T21:13:19.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.049+0000 7fa436ad7640 1 -- 172.21.15.59:0/4081970341 shutdown_connections 2024-09-10T21:13:19.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.049+0000 7fa436ad7640 1 --2- 172.21.15.59:0/4081970341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa43010d120 0x7fa43010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:19.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.049+0000 7fa436ad7640 1 --2- 172.21.15.59:0/4081970341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa430104570 0x7fa43010cb50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:19.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.049+0000 7fa436ad7640 1 --2- 172.21.15.59:0/4081970341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa430103b70 0x7fa430103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:19.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.049+0000 7fa436ad7640 1 -- 172.21.15.59:0/4081970341 >> 172.21.15.59:0/4081970341 conn(0x7fa4300fd700 msgr2=0x7fa4300ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:19.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.049+0000 7fa436ad7640 1 -- 172.21.15.59:0/4081970341 shutdown_connections 2024-09-10T21:13:19.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.049+0000 7fa436ad7640 1 -- 172.21.15.59:0/4081970341 wait complete. 2024-09-10T21:13:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.049+0000 7fa436ad7640 1 Processor -- start 2024-09-10T21:13:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.049+0000 7fa436ad7640 1 -- start start 2024-09-10T21:13:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa436ad7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa430103b70 0x7fa430199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa436ad7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa430104570 0x7fa4301997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa436ad7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa43010d120 0x7fa43019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:19.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa436ad7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa430112d60 con 0x7fa430103b70 2024-09-10T21:13:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa436ad7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa430112be0 con 0x7fa43010d120 2024-09-10T21:13:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa436ad7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa430112ee0 con 0x7fa430104570 2024-09-10T21:13:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa434873640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa430103b70 0x7fa430199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa434873640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa430103b70 0x7fa430199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43748/0 (socket says 172.21.15.59:43748) 2024-09-10T21:13:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa434873640 1 -- 172.21.15.59:0/789833359 learned_addr learned my addr 172.21.15.59:0/789833359 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa42ffff640 1 --2- 172.21.15.59:0/789833359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa430104570 0x7fa4301997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa435074640 1 --2- 172.21.15.59:0/789833359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa43010d120 0x7fa43019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa434873640 1 -- 172.21.15.59:0/789833359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa430104570 msgr2=0x7fa4301997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa434873640 1 --2- 172.21.15.59:0/789833359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa430104570 0x7fa4301997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa434873640 1 -- 172.21.15.59:0/789833359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa43010d120 msgr2=0x7fa43019eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa434873640 1 --2- 172.21.15.59:0/789833359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa43010d120 0x7fa43019eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa434873640 1 -- 172.21.15.59:0/789833359 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43019f320 con 0x7fa430103b70 2024-09-10T21:13:19.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa434873640 1 --2- 172.21.15.59:0/789833359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa430103b70 0x7fa430199270 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa42000d950 tx=0x7fa42000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:19.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa42dffb640 1 -- 172.21.15.59:0/789833359 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420017070 con 0x7fa430103b70 2024-09-10T21:13:19.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa42dffb640 1 -- 172.21.15.59:0/789833359 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa420009c30 con 0x7fa430103b70 2024-09-10T21:13:19.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa42dffb640 1 -- 172.21.15.59:0/789833359 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42000f620 con 0x7fa430103b70 2024-09-10T21:13:19.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.050+0000 7fa436ad7640 1 -- 172.21.15.59:0/789833359 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa43019f610 con 0x7fa430103b70 2024-09-10T21:13:19.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.051+0000 7fa436ad7640 1 -- 172.21.15.59:0/789833359 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4301a5cd0 con 0x7fa430103b70 2024-09-10T21:13:19.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.052+0000 7fa436ad7640 1 -- 172.21.15.59:0/789833359 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa430103f50 con 0x7fa430103b70 2024-09-10T21:13:19.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.053+0000 7fa42dffb640 1 -- 172.21.15.59:0/789833359 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fa420005030 con 0x7fa430103b70 2024-09-10T21:13:19.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.054+0000 7fa42dffb640 1 --2- 172.21.15.59:0/789833359 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa4180b52e0 0x7fa4180b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:19.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.054+0000 7fa42ffff640 1 --2- 172.21.15.59:0/789833359 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa4180b52e0 0x7fa4180b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:19.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.054+0000 7fa42dffb640 1 -- 172.21.15.59:0/789833359 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7879+0+0 (secure 0 0 0) 0x7fa4200e55b0 con 0x7fa430103b70 2024-09-10T21:13:19.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.054+0000 7fa42ffff640 1 --2- 172.21.15.59:0/789833359 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa4180b52e0 0x7fa4180b77a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa424031440 tx=0x7fa424005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:19.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.058+0000 7fa42dffb640 1 -- 172.21.15.59:0/789833359 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa420009de0 con 0x7fa430103b70 2024-09-10T21:13:19.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.281+0000 7fa436ad7640 1 -- 172.21.15.59:0/789833359 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa43002e5c0 con 0x7fa430103b70 2024-09-10T21:13:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.643+0000 7fa42dffb640 1 -- 172.21.15.59:0/789833359 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fa4200abfb0 con 0x7fa430103b70 2024-09-10T21:13:19.647 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T21:13:19.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.646+0000 7fa436ad7640 1 -- 172.21.15.59:0/789833359 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa4180b52e0 msgr2=0x7fa4180b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:19.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.646+0000 7fa436ad7640 1 --2- 172.21.15.59:0/789833359 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa4180b52e0 0x7fa4180b77a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa424031440 tx=0x7fa424005b50 comp rx=0 tx=0).stop 2024-09-10T21:13:19.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.646+0000 7fa436ad7640 1 -- 172.21.15.59:0/789833359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa430103b70 msgr2=0x7fa430199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:19.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.646+0000 7fa436ad7640 1 --2- 172.21.15.59:0/789833359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa430103b70 0x7fa430199270 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa42000d950 tx=0x7fa42000de10 comp rx=0 tx=0).stop 2024-09-10T21:13:19.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.646+0000 7fa436ad7640 1 -- 172.21.15.59:0/789833359 shutdown_connections 2024-09-10T21:13:19.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.646+0000 7fa436ad7640 1 --2- 172.21.15.59:0/789833359 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa4180b52e0 0x7fa4180b77a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:19.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.646+0000 7fa436ad7640 1 --2- 172.21.15.59:0/789833359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa43010d120 0x7fa43019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:19.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.646+0000 7fa436ad7640 1 --2- 172.21.15.59:0/789833359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa430104570 0x7fa4301997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:19.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.646+0000 7fa436ad7640 1 --2- 172.21.15.59:0/789833359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa430103b70 0x7fa430199270 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:19.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.646+0000 7fa436ad7640 1 -- 172.21.15.59:0/789833359 >> 172.21.15.59:0/789833359 conn(0x7fa4300fd700 msgr2=0x7fa4300fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:19.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.646+0000 7fa436ad7640 1 -- 172.21.15.59:0/789833359 shutdown_connections 2024-09-10T21:13:19.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:19.646+0000 7fa436ad7640 1 -- 172.21.15.59:0/789833359 wait complete. 2024-09-10T21:13:19.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:19 smithi059 ceph-mon[30888]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T21:13:19.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:19 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/789833359' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T21:13:19.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:19 smithi059 ceph-mon[30888]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T21:13:19.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:19 smithi154 ceph-mon[35041]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T21:13:19.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:19 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/789833359' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T21:13:19.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:19 smithi154 ceph-mon[35041]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T21:13:20.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:19 smithi192 ceph-mon[35363]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T21:13:20.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:19 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/789833359' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T21:13:20.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:19 smithi192 ceph-mon[35363]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T21:13:20.325 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:13:20.591 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:20.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:20 smithi059 ceph-mon[30888]: pgmap v279: 97 pgs: 26 creating+peering, 41 unknown, 30 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:20.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:20 smithi059 ceph-mon[30888]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T21:13:20.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:20 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/789833359' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T21:13:20.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:20 smithi059 ceph-mon[30888]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T21:13:20.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:20 smithi059 ceph-mon[30888]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T21:13:20.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:20 smithi154 ceph-mon[35041]: pgmap v279: 97 pgs: 26 creating+peering, 41 unknown, 30 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:20.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:20 smithi154 ceph-mon[35041]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T21:13:20.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:20 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/789833359' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T21:13:20.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:20 smithi154 ceph-mon[35041]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T21:13:20.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:20 smithi154 ceph-mon[35041]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T21:13:21.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:20 smithi192 ceph-mon[35363]: pgmap v279: 97 pgs: 26 creating+peering, 41 unknown, 30 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:13:21.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:20 smithi192 ceph-mon[35363]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T21:13:21.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:20 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/789833359' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T21:13:21.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:20 smithi192 ceph-mon[35363]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T21:13:21.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:20 smithi192 ceph-mon[35363]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T21:13:21.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.079+0000 7ffaafe0c640 1 -- 172.21.15.59:0/610030356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaa8113b20 msgr2=0x7ffaa8115f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:21.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.079+0000 7ffaafe0c640 1 --2- 172.21.15.59:0/610030356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaa8113b20 0x7ffaa8115f10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009ca0 tx=0x7ffaa002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:13:21.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.079+0000 7ffaafe0c640 1 -- 172.21.15.59:0/610030356 shutdown_connections 2024-09-10T21:13:21.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.079+0000 7ffaafe0c640 1 --2- 172.21.15.59:0/610030356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaa8113b20 0x7ffaa8115f10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:21.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.079+0000 7ffaafe0c640 1 --2- 172.21.15.59:0/610030356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffaa8075e60 0x7ffaa81135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:21.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.079+0000 7ffaafe0c640 1 --2- 172.21.15.59:0/610030356 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaa8075540 0x7ffaa8075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:21.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.079+0000 7ffaafe0c640 1 -- 172.21.15.59:0/610030356 >> 172.21.15.59:0/610030356 conn(0x7ffaa80fe830 msgr2=0x7ffaa8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:21.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.079+0000 7ffaafe0c640 1 -- 172.21.15.59:0/610030356 shutdown_connections 2024-09-10T21:13:21.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.079+0000 7ffaafe0c640 1 -- 172.21.15.59:0/610030356 wait complete. 2024-09-10T21:13:21.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.080+0000 7ffaafe0c640 1 Processor -- start 2024-09-10T21:13:21.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.080+0000 7ffaafe0c640 1 -- start start 2024-09-10T21:13:21.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.080+0000 7ffaafe0c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaa8075540 0x7ffaa819f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:21.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.080+0000 7ffaafe0c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffaa8075e60 0x7ffaa819fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:21.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.080+0000 7ffaafe0c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaa8113b20 0x7ffaa81a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:21.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.080+0000 7ffaafe0c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa81193f0 con 0x7ffaa8075540 2024-09-10T21:13:21.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.080+0000 7ffaafe0c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa8119270 con 0x7ffaa8113b20 2024-09-10T21:13:21.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.080+0000 7ffaafe0c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa8119570 con 0x7ffaa8075e60 2024-09-10T21:13:21.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.080+0000 7ffaadba8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaa8075540 0x7ffaa819f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:21.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.080+0000 7ffaadba8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaa8075540 0x7ffaa819f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52724/0 (socket says 172.21.15.59:52724) 2024-09-10T21:13:21.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.080+0000 7ffaadba8640 1 -- 172.21.15.59:0/940914880 learned_addr learned my addr 172.21.15.59:0/940914880 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:21.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.080+0000 7ffaad3a7640 1 --2- 172.21.15.59:0/940914880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffaa8075e60 0x7ffaa819fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:21.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.081+0000 7ffaadba8640 1 -- 172.21.15.59:0/940914880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffaa8075e60 msgr2=0x7ffaa819fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:21.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.081+0000 7ffaadba8640 1 --2- 172.21.15.59:0/940914880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffaa8075e60 0x7ffaa819fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:21.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.081+0000 7ffaadba8640 1 -- 172.21.15.59:0/940914880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaa8113b20 msgr2=0x7ffaa81a51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:21.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.081+0000 7ffaadba8640 1 --2- 172.21.15.59:0/940914880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaa8113b20 0x7ffaa81a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:21.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.081+0000 7ffaadba8640 1 -- 172.21.15.59:0/940914880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa81a5990 con 0x7ffaa8075540 2024-09-10T21:13:21.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.081+0000 7ffaadba8640 1 --2- 172.21.15.59:0/940914880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaa8075540 0x7ffaa819f8e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400b4a0 tx=0x7ffaa400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:21.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.081+0000 7ffa9effd640 1 -- 172.21.15.59:0/940914880 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4014070 con 0x7ffaa8075540 2024-09-10T21:13:21.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.081+0000 7ffa9effd640 1 -- 172.21.15.59:0/940914880 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffaa4010ac0 con 0x7ffaa8075540 2024-09-10T21:13:21.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.081+0000 7ffaafe0c640 1 -- 172.21.15.59:0/940914880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa81a5c80 con 0x7ffaa8075540 2024-09-10T21:13:21.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.081+0000 7ffa9effd640 1 -- 172.21.15.59:0/940914880 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4017c30 con 0x7ffaa8075540 2024-09-10T21:13:21.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.081+0000 7ffaafe0c640 1 -- 172.21.15.59:0/940914880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa81ac510 con 0x7ffaa8075540 2024-09-10T21:13:21.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.082+0000 7ffaafe0c640 1 -- 172.21.15.59:0/940914880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa8075920 con 0x7ffaa8075540 2024-09-10T21:13:21.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.083+0000 7ffa9effd640 1 -- 172.21.15.59:0/940914880 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7ffaa4010610 con 0x7ffaa8075540 2024-09-10T21:13:21.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.084+0000 7ffa9effd640 1 --2- 172.21.15.59:0/940914880 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffa940b5360 0x7ffa940b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:21.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.084+0000 7ffaad3a7640 1 --2- 172.21.15.59:0/940914880 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffa940b5360 0x7ffa940b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:21.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.084+0000 7ffa9effd640 1 -- 172.21.15.59:0/940914880 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7ffaa40e52d0 con 0x7ffaa8075540 2024-09-10T21:13:21.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.085+0000 7ffaad3a7640 1 --2- 172.21.15.59:0/940914880 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffa940b5360 0x7ffa940b7820 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffaa81160e0 tx=0x7ffa9800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:21.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.087+0000 7ffa9effd640 1 -- 172.21.15.59:0/940914880 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffaa40ac2e0 con 0x7ffaa8075540 2024-09-10T21:13:21.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.274+0000 7ffaafe0c640 1 -- 172.21.15.59:0/940914880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffaa81a0a10 con 0x7ffaa8075540 2024-09-10T21:13:21.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.275+0000 7ffa9effd640 1 -- 172.21.15.59:0/940914880 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22304 (secure 0 0 0) 0x7ffaa81a0a10 con 0x7ffaa8075540 2024-09-10T21:13:21.280 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:13:21.280 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":73,"fsid":"3c26b952-6fb8-11ef-bcea-c7b262605968","created":"2024-09-10T21:05:18.196881+0000","modified":"2024-09-10T21:13:19.283891+0000","last_up_change":"2024-09-10T21:12:31.909004+0000","last_in_change":"2024-09-10T21:12:08.116727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:08:47.611285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:13:15.562661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:13:17.272280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e88abf3-8592-4b5f-8ba9-5969e01e12d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6803","nonce":1237328951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6805","nonce":1237328951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6809","nonce":1237328951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6807","nonce":1237328951}]},"public_addr":"172.21.15.59:6803/1237328951","cluster_addr":"172.21.15.59:6805/1237328951","heartbeat_back_addr":"172.21.15.59:6809/1237328951","heartbeat_front_addr":"172.21.15.59:6807/1237328951","state":["exists","up"]},{"osd":1,"uuid":"7908eefd-bbfa-4fe4-9db9-7a92d0e77acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6801","nonce":3376412264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6803","nonce":3376412264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6807","nonce":3376412264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6805","nonce":3376412264}]},"public_addr":"172.21.15.154:6801/3376412264","cluster_addr":"172.21.15.154:6803/3376412264","heartbeat_back_addr":"172.21.15.154:6807/3376412264","heartbeat_front_addr":"172.21.15.154:6805/3376412264","state":["exists","up"]},{"osd":2,"uuid":"2351b9f0-bca1-48b2-afb8-0e2b7856c52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6801","nonce":440750253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6803","nonce":440750253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6807","nonce":440750253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6805","nonce":440750253}]},"public_addr":"172.21.15.192:6801/440750253","cluster_addr":"172.21.15.192:6803/440750253","heartbeat_back_addr":"172.21.15.192:6807/440750253","heartbeat_front_addr":"172.21.15.192:6805/440750253","state":["exists","up"]},{"osd":3,"uuid":"f26969d1-7b48-4f20-9077-c55c59775ed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6811","nonce":1483798393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6813","nonce":1483798393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6817","nonce":1483798393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6815","nonce":1483798393}]},"public_addr":"172.21.15.59:6811/1483798393","cluster_addr":"172.21.15.59:6813/1483798393","heartbeat_back_addr":"172.21.15.59:6817/1483798393","heartbeat_front_addr":"172.21.15.59:6815/1483798393","state":["exists","up"]},{"osd":4,"uuid":"21e1a472-1ae1-454b-aee5-2ad92f6eff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6809","nonce":1817188525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6811","nonce":1817188525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6815","nonce":1817188525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6813","nonce":1817188525}]},"public_addr":"172.21.15.154:6809/1817188525","cluster_addr":"172.21.15.154:6811/1817188525","heartbeat_back_addr":"172.21.15.154:6815/1817188525","heartbeat_front_addr":"172.21.15.154:6813/1817188525","state":["exists","up"]},{"osd":5,"uuid":"6191b10a-5cbd-4225-b0ec-70d05023d5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6809","nonce":1221386274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6811","nonce":1221386274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6815","nonce":1221386274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6813","nonce":1221386274}]},"public_addr":"172.21.15.192:6809/1221386274","cluster_addr":"172.21.15.192:6811/1221386274","heartbeat_back_addr":"172.21.15.192:6815/1221386274","heartbeat_front_addr":"172.21.15.192:6813/1221386274","state":["exists","up"]},{"osd":6,"uuid":"609c11f7-ce82-4714-bf73-a4f16f4483ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6819","nonce":3006857566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6821","nonce":3006857566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6825","nonce":3006857566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6823","nonce":3006857566}]},"public_addr":"172.21.15.59:6819/3006857566","cluster_addr":"172.21.15.59:6821/3006857566","heartbeat_back_addr":"172.21.15.59:6825/3006857566","heartbeat_front_addr":"172.21.15.59:6823/3006857566","state":["exists","up"]},{"osd":7,"uuid":"bff3a29f-47cc-4e66-92e4-14e9b7faf498","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6817","nonce":175260385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6819","nonce":175260385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6823","nonce":175260385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6821","nonce":175260385}]},"public_addr":"172.21.15.154:6817/175260385","cluster_addr":"172.21.15.154:6819/175260385","heartbeat_back_addr":"172.21.15.154:6823/175260385","heartbeat_front_addr":"172.21.15.154:6821/175260385","state":["exists","up"]},{"osd":8,"uuid":"56dabafd-9bb9-409a-88cd-4b5b5ecf810a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6817","nonce":3138189462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6819","nonce":3138189462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6823","nonce":3138189462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6821","nonce":3138189462}]},"public_addr":"172.21.15.192:6817/3138189462","cluster_addr":"172.21.15.192:6819/3138189462","heartbeat_back_addr":"172.21.15.192:6823/3138189462","heartbeat_front_addr":"172.21.15.192:6821/3138189462","state":["exists","up"]},{"osd":9,"uuid":"044f934d-3df5-47aa-85f5-c3b63b267ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6827","nonce":2446500753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6829","nonce":2446500753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6833","nonce":2446500753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6831","nonce":2446500753}]},"public_addr":"172.21.15.59:6827/2446500753","cluster_addr":"172.21.15.59:6829/2446500753","heartbeat_back_addr":"172.21.15.59:6833/2446500753","heartbeat_front_addr":"172.21.15.59:6831/2446500753","state":["exists","up"]},{"osd":10,"uuid":"8d3b735b-e4fe-4a8e-8c75-a49313c6fabb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6825","nonce":1139781446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6827","nonce":1139781446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6831","nonce":1139781446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6829","nonce":1139781446}]},"public_addr":"172.21.15.154:6825/1139781446","cluster_addr":"172.21.15.154:6827/1139781446","heartbeat_back_addr":"172.21.15.154:6831/1139781446","heartbeat_front_addr":"172.21.15.154:6829/1139781446","state":["exists","up"]},{"osd":11,"uuid":"fd6a6d06-c6aa-42e3-aa38-fc583319f6bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6825","nonce":1041494458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6827","nonce":1041494458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6831","nonce":1041494458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6829","nonce":1041494458}]},"public_addr":"172.21.15.192:6825/1041494458","cluster_addr":"172.21.15.192:6827/1041494458","heartbeat_back_addr":"172.21.15.192:6831/1041494458","heartbeat_front_addr":"172.21.15.192:6829/1041494458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:07:53.974382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:19.552358+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:44.251670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:09.430992+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:34.043343+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:59.903679+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:25.733171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:49.795257+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:14.485648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:40.485165+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:04.655475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:29.308456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/212243638":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/3305207692":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6801/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/2965147556":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/1174570395":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/2934865748":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:6801/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/3377179776":"2024-09-11T21:05:40.304807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:13:21.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.277+0000 7ffaafe0c640 1 -- 172.21.15.59:0/940914880 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffa940b5360 msgr2=0x7ffa940b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:21.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.277+0000 7ffaafe0c640 1 --2- 172.21.15.59:0/940914880 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffa940b5360 0x7ffa940b7820 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffaa81160e0 tx=0x7ffa9800b390 comp rx=0 tx=0).stop 2024-09-10T21:13:21.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.278+0000 7ffaafe0c640 1 -- 172.21.15.59:0/940914880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaa8075540 msgr2=0x7ffaa819f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:21.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.278+0000 7ffaafe0c640 1 --2- 172.21.15.59:0/940914880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaa8075540 0x7ffaa819f8e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400b4a0 tx=0x7ffaa400b960 comp rx=0 tx=0).stop 2024-09-10T21:13:21.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.278+0000 7ffaafe0c640 1 -- 172.21.15.59:0/940914880 shutdown_connections 2024-09-10T21:13:21.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.278+0000 7ffaafe0c640 1 --2- 172.21.15.59:0/940914880 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffa940b5360 0x7ffa940b7820 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:21.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.278+0000 7ffaafe0c640 1 --2- 172.21.15.59:0/940914880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaa8113b20 0x7ffaa81a51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:21.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.278+0000 7ffaafe0c640 1 --2- 172.21.15.59:0/940914880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffaa8075e60 0x7ffaa819fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:21.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.278+0000 7ffaafe0c640 1 --2- 172.21.15.59:0/940914880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaa8075540 0x7ffaa819f8e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:21.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.278+0000 7ffaafe0c640 1 -- 172.21.15.59:0/940914880 >> 172.21.15.59:0/940914880 conn(0x7ffaa80fe830 msgr2=0x7ffaa80ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:21.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.278+0000 7ffaafe0c640 1 -- 172.21.15.59:0/940914880 shutdown_connections 2024-09-10T21:13:21.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:21.278+0000 7ffaafe0c640 1 -- 172.21.15.59:0/940914880 wait complete. 2024-09-10T21:13:21.854 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:21 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] up:active 2024-09-10T21:13:21.855 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:21 smithi059 ceph-mon[30888]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:13:21.855 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:21 smithi059 ceph-mon[30888]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:13:21.855 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:21 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/940914880' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:13:21.887 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:13:21.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:21 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] up:active 2024-09-10T21:13:21.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:21 smithi154 ceph-mon[35041]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:13:21.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:21 smithi154 ceph-mon[35041]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:13:21.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:21 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/940914880' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:13:22.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:21 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] up:active 2024-09-10T21:13:22.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:21 smithi192 ceph-mon[35363]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:13:22.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:21 smithi192 ceph-mon[35363]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:13:22.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:21 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/940914880' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:13:22.149 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:22.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.593+0000 7f1341930640 1 -- 172.21.15.59:0/1815190572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f133c102dc0 msgr2=0x7f133c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:22.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.593+0000 7f1341930640 1 --2- 172.21.15.59:0/1815190572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f133c102dc0 0x7f133c1031a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f132c009900 tx=0x7f132c02a410 comp rx=0 tx=0).stop 2024-09-10T21:13:22.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.593+0000 7f1341930640 1 -- 172.21.15.59:0/1815190572 shutdown_connections 2024-09-10T21:13:22.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.593+0000 7f1341930640 1 --2- 172.21.15.59:0/1815190572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f133c109150 0x7f133c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:22.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.593+0000 7f1341930640 1 --2- 172.21.15.59:0/1815190572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f133c1087d0 0x7f133c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:22.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.593+0000 7f1341930640 1 --2- 172.21.15.59:0/1815190572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f133c102dc0 0x7f133c1031a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:22.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.593+0000 7f1341930640 1 -- 172.21.15.59:0/1815190572 >> 172.21.15.59:0/1815190572 conn(0x7f133c0fe830 msgr2=0x7f133c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:22.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.593+0000 7f1341930640 1 -- 172.21.15.59:0/1815190572 shutdown_connections 2024-09-10T21:13:22.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.593+0000 7f1341930640 1 -- 172.21.15.59:0/1815190572 wait complete. 2024-09-10T21:13:22.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.594+0000 7f1341930640 1 Processor -- start 2024-09-10T21:13:22.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.594+0000 7f1341930640 1 -- start start 2024-09-10T21:13:22.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.594+0000 7f1341930640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f133c102dc0 0x7f133c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:22.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.594+0000 7f1341930640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f133c1087d0 0x7f133c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:22.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.594+0000 7f1341930640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f133c109150 0x7f133c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:22.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.594+0000 7f1341930640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f133c112e50 con 0x7f133c109150 2024-09-10T21:13:22.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.594+0000 7f1341930640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f133c112cd0 con 0x7f133c102dc0 2024-09-10T21:13:22.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.594+0000 7f1341930640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f133c112fd0 con 0x7f133c1087d0 2024-09-10T21:13:22.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.594+0000 7f133b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f133c109150 0x7f133c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:22.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.594+0000 7f133b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f133c109150 0x7f133c075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52738/0 (socket says 172.21.15.59:52738) 2024-09-10T21:13:22.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.594+0000 7f133b7fe640 1 -- 172.21.15.59:0/3103958773 learned_addr learned my addr 172.21.15.59:0/3103958773 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:22.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.594+0000 7f133affd640 1 --2- 172.21.15.59:0/3103958773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f133c102dc0 0x7f133c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:22.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.594+0000 7f1333fff640 1 --2- 172.21.15.59:0/3103958773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f133c1087d0 0x7f133c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:22.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.595+0000 7f133b7fe640 1 -- 172.21.15.59:0/3103958773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f133c1087d0 msgr2=0x7f133c0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:22.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.595+0000 7f133b7fe640 1 --2- 172.21.15.59:0/3103958773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f133c1087d0 0x7f133c0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:22.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.595+0000 7f133b7fe640 1 -- 172.21.15.59:0/3103958773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f133c102dc0 msgr2=0x7f133c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:22.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.595+0000 7f133b7fe640 1 --2- 172.21.15.59:0/3103958773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f133c102dc0 0x7f133c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:22.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.595+0000 7f133b7fe640 1 -- 172.21.15.59:0/3103958773 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f133c1a7860 con 0x7f133c109150 2024-09-10T21:13:22.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.595+0000 7f1333fff640 1 --2- 172.21.15.59:0/3103958773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f133c1087d0 0x7f133c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:13:22.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.595+0000 7f133affd640 1 --2- 172.21.15.59:0/3103958773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f133c102dc0 0x7f133c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:13:22.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.595+0000 7f133b7fe640 1 --2- 172.21.15.59:0/3103958773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f133c109150 0x7f133c075f20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f133400b970 tx=0x7f133400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:22.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.595+0000 7f134092e640 1 -- 172.21.15.59:0/3103958773 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1334019070 con 0x7f133c109150 2024-09-10T21:13:22.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.595+0000 7f1341930640 1 -- 172.21.15.59:0/3103958773 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f133c1a7b50 con 0x7f133c109150 2024-09-10T21:13:22.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.595+0000 7f134092e640 1 -- 172.21.15.59:0/3103958773 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1334014440 con 0x7f133c109150 2024-09-10T21:13:22.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.595+0000 7f134092e640 1 -- 172.21.15.59:0/3103958773 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13340075d0 con 0x7f133c109150 2024-09-10T21:13:22.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.595+0000 7f1341930640 1 -- 172.21.15.59:0/3103958773 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f133c1a8090 con 0x7f133c109150 2024-09-10T21:13:22.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.597+0000 7f1341930640 1 -- 172.21.15.59:0/3103958773 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f131c0052c0 con 0x7f133c109150 2024-09-10T21:13:22.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.598+0000 7f134092e640 1 -- 172.21.15.59:0/3103958773 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f1334014b60 con 0x7f133c109150 2024-09-10T21:13:22.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.599+0000 7f134092e640 1 --2- 172.21.15.59:0/3103958773 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f13280b5360 0x7f13280b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:22.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.599+0000 7f133affd640 1 --2- 172.21.15.59:0/3103958773 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f13280b5360 0x7f13280b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:22.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.599+0000 7f134092e640 1 -- 172.21.15.59:0/3103958773 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f13340e5090 con 0x7f133c109150 2024-09-10T21:13:22.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.600+0000 7f133affd640 1 --2- 172.21.15.59:0/3103958773 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f13280b5360 0x7f13280b7820 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f132c031440 tx=0x7f132c0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:22.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.603+0000 7f134092e640 1 -- 172.21.15.59:0/3103958773 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f13340ac0a0 con 0x7f133c109150 2024-09-10T21:13:22.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.793+0000 7f1341930640 1 -- 172.21.15.59:0/3103958773 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f131c005880 con 0x7f133c109150 2024-09-10T21:13:22.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.794+0000 7f134092e640 1 -- 172.21.15.59:0/3103958773 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22304 (secure 0 0 0) 0x7f13340ab9a0 con 0x7f133c109150 2024-09-10T21:13:22.799 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:13:22.799 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":73,"fsid":"3c26b952-6fb8-11ef-bcea-c7b262605968","created":"2024-09-10T21:05:18.196881+0000","modified":"2024-09-10T21:13:19.283891+0000","last_up_change":"2024-09-10T21:12:31.909004+0000","last_in_change":"2024-09-10T21:12:08.116727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:08:47.611285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:13:15.562661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:13:17.272280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e88abf3-8592-4b5f-8ba9-5969e01e12d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6803","nonce":1237328951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6805","nonce":1237328951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6809","nonce":1237328951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6807","nonce":1237328951}]},"public_addr":"172.21.15.59:6803/1237328951","cluster_addr":"172.21.15.59:6805/1237328951","heartbeat_back_addr":"172.21.15.59:6809/1237328951","heartbeat_front_addr":"172.21.15.59:6807/1237328951","state":["exists","up"]},{"osd":1,"uuid":"7908eefd-bbfa-4fe4-9db9-7a92d0e77acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6801","nonce":3376412264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6803","nonce":3376412264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6807","nonce":3376412264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6805","nonce":3376412264}]},"public_addr":"172.21.15.154:6801/3376412264","cluster_addr":"172.21.15.154:6803/3376412264","heartbeat_back_addr":"172.21.15.154:6807/3376412264","heartbeat_front_addr":"172.21.15.154:6805/3376412264","state":["exists","up"]},{"osd":2,"uuid":"2351b9f0-bca1-48b2-afb8-0e2b7856c52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6801","nonce":440750253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6803","nonce":440750253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6807","nonce":440750253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6805","nonce":440750253}]},"public_addr":"172.21.15.192:6801/440750253","cluster_addr":"172.21.15.192:6803/440750253","heartbeat_back_addr":"172.21.15.192:6807/440750253","heartbeat_front_addr":"172.21.15.192:6805/440750253","state":["exists","up"]},{"osd":3,"uuid":"f26969d1-7b48-4f20-9077-c55c59775ed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6811","nonce":1483798393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6813","nonce":1483798393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6817","nonce":1483798393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6815","nonce":1483798393}]},"public_addr":"172.21.15.59:6811/1483798393","cluster_addr":"172.21.15.59:6813/1483798393","heartbeat_back_addr":"172.21.15.59:6817/1483798393","heartbeat_front_addr":"172.21.15.59:6815/1483798393","state":["exists","up"]},{"osd":4,"uuid":"21e1a472-1ae1-454b-aee5-2ad92f6eff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6809","nonce":1817188525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6811","nonce":1817188525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6815","nonce":1817188525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6813","nonce":1817188525}]},"public_addr":"172.21.15.154:6809/1817188525","cluster_addr":"172.21.15.154:6811/1817188525","heartbeat_back_addr":"172.21.15.154:6815/1817188525","heartbeat_front_addr":"172.21.15.154:6813/1817188525","state":["exists","up"]},{"osd":5,"uuid":"6191b10a-5cbd-4225-b0ec-70d05023d5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6809","nonce":1221386274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6811","nonce":1221386274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6815","nonce":1221386274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6813","nonce":1221386274}]},"public_addr":"172.21.15.192:6809/1221386274","cluster_addr":"172.21.15.192:6811/1221386274","heartbeat_back_addr":"172.21.15.192:6815/1221386274","heartbeat_front_addr":"172.21.15.192:6813/1221386274","state":["exists","up"]},{"osd":6,"uuid":"609c11f7-ce82-4714-bf73-a4f16f4483ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6819","nonce":3006857566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6821","nonce":3006857566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6825","nonce":3006857566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6823","nonce":3006857566}]},"public_addr":"172.21.15.59:6819/3006857566","cluster_addr":"172.21.15.59:6821/3006857566","heartbeat_back_addr":"172.21.15.59:6825/3006857566","heartbeat_front_addr":"172.21.15.59:6823/3006857566","state":["exists","up"]},{"osd":7,"uuid":"bff3a29f-47cc-4e66-92e4-14e9b7faf498","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6817","nonce":175260385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6819","nonce":175260385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6823","nonce":175260385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6821","nonce":175260385}]},"public_addr":"172.21.15.154:6817/175260385","cluster_addr":"172.21.15.154:6819/175260385","heartbeat_back_addr":"172.21.15.154:6823/175260385","heartbeat_front_addr":"172.21.15.154:6821/175260385","state":["exists","up"]},{"osd":8,"uuid":"56dabafd-9bb9-409a-88cd-4b5b5ecf810a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6817","nonce":3138189462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6819","nonce":3138189462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6823","nonce":3138189462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6821","nonce":3138189462}]},"public_addr":"172.21.15.192:6817/3138189462","cluster_addr":"172.21.15.192:6819/3138189462","heartbeat_back_addr":"172.21.15.192:6823/3138189462","heartbeat_front_addr":"172.21.15.192:6821/3138189462","state":["exists","up"]},{"osd":9,"uuid":"044f934d-3df5-47aa-85f5-c3b63b267ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6827","nonce":2446500753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6829","nonce":2446500753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6833","nonce":2446500753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6831","nonce":2446500753}]},"public_addr":"172.21.15.59:6827/2446500753","cluster_addr":"172.21.15.59:6829/2446500753","heartbeat_back_addr":"172.21.15.59:6833/2446500753","heartbeat_front_addr":"172.21.15.59:6831/2446500753","state":["exists","up"]},{"osd":10,"uuid":"8d3b735b-e4fe-4a8e-8c75-a49313c6fabb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6825","nonce":1139781446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6827","nonce":1139781446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6831","nonce":1139781446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6829","nonce":1139781446}]},"public_addr":"172.21.15.154:6825/1139781446","cluster_addr":"172.21.15.154:6827/1139781446","heartbeat_back_addr":"172.21.15.154:6831/1139781446","heartbeat_front_addr":"172.21.15.154:6829/1139781446","state":["exists","up"]},{"osd":11,"uuid":"fd6a6d06-c6aa-42e3-aa38-fc583319f6bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6825","nonce":1041494458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6827","nonce":1041494458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6831","nonce":1041494458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6829","nonce":1041494458}]},"public_addr":"172.21.15.192:6825/1041494458","cluster_addr":"172.21.15.192:6827/1041494458","heartbeat_back_addr":"172.21.15.192:6831/1041494458","heartbeat_front_addr":"172.21.15.192:6829/1041494458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:07:53.974382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:19.552358+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:44.251670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:09.430992+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:34.043343+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:59.903679+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:25.733171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:49.795257+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:14.485648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:40.485165+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:04.655475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:29.308456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/212243638":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/3305207692":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6801/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/2965147556":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/1174570395":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/2934865748":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:6801/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/3377179776":"2024-09-11T21:05:40.304807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:13:22.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.797+0000 7f1341930640 1 -- 172.21.15.59:0/3103958773 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f13280b5360 msgr2=0x7f13280b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:22.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.797+0000 7f1341930640 1 --2- 172.21.15.59:0/3103958773 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f13280b5360 0x7f13280b7820 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f132c031440 tx=0x7f132c0095f0 comp rx=0 tx=0).stop 2024-09-10T21:13:22.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.797+0000 7f1341930640 1 -- 172.21.15.59:0/3103958773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f133c109150 msgr2=0x7f133c075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:22.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.797+0000 7f1341930640 1 --2- 172.21.15.59:0/3103958773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f133c109150 0x7f133c075f20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f133400b970 tx=0x7f133400be30 comp rx=0 tx=0).stop 2024-09-10T21:13:22.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.797+0000 7f1341930640 1 -- 172.21.15.59:0/3103958773 shutdown_connections 2024-09-10T21:13:22.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.797+0000 7f1341930640 1 --2- 172.21.15.59:0/3103958773 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f13280b5360 0x7f13280b7820 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:22.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.797+0000 7f1341930640 1 --2- 172.21.15.59:0/3103958773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f133c109150 0x7f133c075f20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:22.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.797+0000 7f1341930640 1 --2- 172.21.15.59:0/3103958773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f133c1087d0 0x7f133c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:22.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.797+0000 7f1341930640 1 --2- 172.21.15.59:0/3103958773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f133c102dc0 0x7f133c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:22.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.797+0000 7f1341930640 1 -- 172.21.15.59:0/3103958773 >> 172.21.15.59:0/3103958773 conn(0x7f133c0fe830 msgr2=0x7f133c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:22.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.797+0000 7f1341930640 1 -- 172.21.15.59:0/3103958773 shutdown_connections 2024-09-10T21:13:22.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:22.797+0000 7f1341930640 1 -- 172.21.15.59:0/3103958773 wait complete. 2024-09-10T21:13:22.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:22 smithi059 ceph-mon[30888]: pgmap v281: 97 pgs: 23 creating+peering, 37 unknown, 37 active+clean; 578 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 666 B/s wr, 1 op/s 2024-09-10T21:13:22.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:22 smithi059 ceph-mon[30888]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T21:13:22.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:22 smithi059 ceph-mon[30888]: Cluster is now healthy 2024-09-10T21:13:22.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:22 smithi154 ceph-mon[35041]: pgmap v281: 97 pgs: 23 creating+peering, 37 unknown, 37 active+clean; 578 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 666 B/s wr, 1 op/s 2024-09-10T21:13:22.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:22 smithi154 ceph-mon[35041]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T21:13:22.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:22 smithi154 ceph-mon[35041]: Cluster is now healthy 2024-09-10T21:13:23.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:22 smithi192 ceph-mon[35363]: pgmap v281: 97 pgs: 23 creating+peering, 37 unknown, 37 active+clean; 578 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 666 B/s wr, 1 op/s 2024-09-10T21:13:23.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:22 smithi192 ceph-mon[35363]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T21:13:23.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:22 smithi192 ceph-mon[35363]: Cluster is now healthy 2024-09-10T21:13:23.499 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-10T21:13:23.757 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:23.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:23 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3103958773' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:13:24.005 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:23 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3103958773' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:13:24.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:23 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3103958773' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:13:24.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.213+0000 7fdf817cf640 1 -- 172.21.15.59:0/2310804816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf7c109150 msgr2=0x7fdf7c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:24.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.213+0000 7fdf817cf640 1 --2- 172.21.15.59:0/2310804816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf7c109150 0x7fdf7c10f950 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdf74009ca0 tx=0x7fdf7402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:13:24.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.213+0000 7fdf817cf640 1 -- 172.21.15.59:0/2310804816 shutdown_connections 2024-09-10T21:13:24.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.213+0000 7fdf817cf640 1 --2- 172.21.15.59:0/2310804816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf7c109150 0x7fdf7c10f950 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:24.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.213+0000 7fdf817cf640 1 --2- 172.21.15.59:0/2310804816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf7c1087d0 0x7fdf7c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:24.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.213+0000 7fdf817cf640 1 --2- 172.21.15.59:0/2310804816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf7c102dc0 0x7fdf7c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:24.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.213+0000 7fdf817cf640 1 -- 172.21.15.59:0/2310804816 >> 172.21.15.59:0/2310804816 conn(0x7fdf7c0fe830 msgr2=0x7fdf7c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.213+0000 7fdf817cf640 1 -- 172.21.15.59:0/2310804816 shutdown_connections 2024-09-10T21:13:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.213+0000 7fdf817cf640 1 -- 172.21.15.59:0/2310804816 wait complete. 2024-09-10T21:13:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.214+0000 7fdf817cf640 1 Processor -- start 2024-09-10T21:13:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.214+0000 7fdf817cf640 1 -- start start 2024-09-10T21:13:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.214+0000 7fdf817cf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf7c102dc0 0x7fdf7c1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.214+0000 7fdf817cf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf7c1087d0 0x7fdf7c199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.214+0000 7fdf817cf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf7c109150 0x7fdf7c19eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.214+0000 7fdf817cf640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c112e50 con 0x7fdf7c1087d0 2024-09-10T21:13:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.214+0000 7fdf817cf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c112cd0 con 0x7fdf7c109150 2024-09-10T21:13:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.214+0000 7fdf817cf640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c112fd0 con 0x7fdf7c102dc0 2024-09-10T21:13:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.214+0000 7fdf73fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf7c1087d0 0x7fdf7c199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.214+0000 7fdf73fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf7c1087d0 0x7fdf7c199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52754/0 (socket says 172.21.15.59:52754) 2024-09-10T21:13:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.214+0000 7fdf73fff640 1 -- 172.21.15.59:0/2206641358 learned_addr learned my addr 172.21.15.59:0/2206641358 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.214+0000 7fdf7affd640 1 --2- 172.21.15.59:0/2206641358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf7c102dc0 0x7fdf7c1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.214+0000 7fdf7b7fe640 1 --2- 172.21.15.59:0/2206641358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf7c109150 0x7fdf7c19eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.214+0000 7fdf73fff640 1 -- 172.21.15.59:0/2206641358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf7c102dc0 msgr2=0x7fdf7c1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.214+0000 7fdf73fff640 1 --2- 172.21.15.59:0/2206641358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf7c102dc0 0x7fdf7c1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.214+0000 7fdf73fff640 1 -- 172.21.15.59:0/2206641358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf7c109150 msgr2=0x7fdf7c19eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.214+0000 7fdf73fff640 1 --2- 172.21.15.59:0/2206641358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf7c109150 0x7fdf7c19eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.214+0000 7fdf73fff640 1 -- 172.21.15.59:0/2206641358 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7c19f470 con 0x7fdf7c1087d0 2024-09-10T21:13:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.214+0000 7fdf7b7fe640 1 --2- 172.21.15.59:0/2206641358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf7c109150 0x7fdf7c19eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:13:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.215+0000 7fdf73fff640 1 --2- 172.21.15.59:0/2206641358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf7c1087d0 0x7fdf7c199900 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400b4a0 tx=0x7fdf6400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.215+0000 7fdf78ff9640 1 -- 172.21.15.59:0/2206641358 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf64015020 con 0x7fdf7c1087d0 2024-09-10T21:13:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.215+0000 7fdf78ff9640 1 -- 172.21.15.59:0/2206641358 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf64011ce0 con 0x7fdf7c1087d0 2024-09-10T21:13:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.215+0000 7fdf817cf640 1 -- 172.21.15.59:0/2206641358 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf7c19f760 con 0x7fdf7c1087d0 2024-09-10T21:13:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.215+0000 7fdf78ff9640 1 -- 172.21.15.59:0/2206641358 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf64010dc0 con 0x7fdf7c1087d0 2024-09-10T21:13:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.215+0000 7fdf817cf640 1 -- 172.21.15.59:0/2206641358 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf7c1a5ea0 con 0x7fdf7c1087d0 2024-09-10T21:13:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.216+0000 7fdf817cf640 1 -- 172.21.15.59:0/2206641358 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf7c103220 con 0x7fdf7c1087d0 2024-09-10T21:13:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.218+0000 7fdf78ff9640 1 -- 172.21.15.59:0/2206641358 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fdf64011830 con 0x7fdf7c1087d0 2024-09-10T21:13:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.219+0000 7fdf78ff9640 1 --2- 172.21.15.59:0/2206641358 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdf680b5360 0x7fdf680b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.219+0000 7fdf7affd640 1 --2- 172.21.15.59:0/2206641358 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdf680b5360 0x7fdf680b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.219+0000 7fdf78ff9640 1 -- 172.21.15.59:0/2206641358 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fdf640e5ae0 con 0x7fdf7c1087d0 2024-09-10T21:13:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.220+0000 7fdf7affd640 1 --2- 172.21.15.59:0/2206641358 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdf680b5360 0x7fdf680b7820 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009990 tx=0x7fdf6c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.222+0000 7fdf78ff9640 1 -- 172.21.15.59:0/2206641358 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdf6401f020 con 0x7fdf7c1087d0 2024-09-10T21:13:24.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.445+0000 7fdf817cf640 1 -- 172.21.15.59:0/2206641358 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fdf7c02e5c0 con 0x7fdf7c1087d0 2024-09-10T21:13:24.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.890+0000 7fdf78ff9640 1 -- 172.21.15.59:0/2206641358 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fdf640b5070 con 0x7fdf7c1087d0 2024-09-10T21:13:24.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.892+0000 7fdf817cf640 1 -- 172.21.15.59:0/2206641358 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdf680b5360 msgr2=0x7fdf680b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:24.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.892+0000 7fdf817cf640 1 --2- 172.21.15.59:0/2206641358 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdf680b5360 0x7fdf680b7820 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009990 tx=0x7fdf6c009110 comp rx=0 tx=0).stop 2024-09-10T21:13:24.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.892+0000 7fdf817cf640 1 -- 172.21.15.59:0/2206641358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf7c1087d0 msgr2=0x7fdf7c199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:24.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.892+0000 7fdf817cf640 1 --2- 172.21.15.59:0/2206641358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf7c1087d0 0x7fdf7c199900 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400b4a0 tx=0x7fdf6400b8a0 comp rx=0 tx=0).stop 2024-09-10T21:13:24.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.892+0000 7fdf817cf640 1 -- 172.21.15.59:0/2206641358 shutdown_connections 2024-09-10T21:13:24.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.892+0000 7fdf817cf640 1 --2- 172.21.15.59:0/2206641358 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdf680b5360 0x7fdf680b7820 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:24.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.892+0000 7fdf817cf640 1 --2- 172.21.15.59:0/2206641358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf7c109150 0x7fdf7c19eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:24.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.892+0000 7fdf817cf640 1 --2- 172.21.15.59:0/2206641358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf7c1087d0 0x7fdf7c199900 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:24.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.892+0000 7fdf817cf640 1 --2- 172.21.15.59:0/2206641358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf7c102dc0 0x7fdf7c1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:24.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.893+0000 7fdf817cf640 1 -- 172.21.15.59:0/2206641358 >> 172.21.15.59:0/2206641358 conn(0x7fdf7c0fe830 msgr2=0x7fdf7c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:24.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.893+0000 7fdf817cf640 1 -- 172.21.15.59:0/2206641358 shutdown_connections 2024-09-10T21:13:24.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:24.893+0000 7fdf817cf640 1 -- 172.21.15.59:0/2206641358 wait complete. 2024-09-10T21:13:25.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:24 smithi059 ceph-mon[30888]: pgmap v282: 97 pgs: 8 creating+peering, 89 active+clean; 578 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-10T21:13:25.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:24 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2206641358' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T21:13:25.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:24 smithi154 ceph-mon[35041]: pgmap v282: 97 pgs: 8 creating+peering, 89 active+clean; 578 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-10T21:13:25.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:24 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2206641358' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T21:13:25.183 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 21:13:24 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-b[64936]: 2024-09-10T21:13:24.947+0000 7ff67616d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T21:13:25.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:24 smithi192 ceph-mon[35363]: pgmap v282: 97 pgs: 8 creating+peering, 89 active+clean; 578 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-10T21:13:25.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:24 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2206641358' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T21:13:25.546 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-10T21:13:25.547 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-10T21:13:25.814 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:26.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:25 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2206641358' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T21:13:26.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:25 smithi059 ceph-mon[30888]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:13:26.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:25 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2206641358' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T21:13:26.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:25 smithi154 ceph-mon[35041]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:13:26.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.252+0000 7fafc5505640 1 -- 172.21.15.59:0/4253197097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafc0101c90 msgr2=0x7fafc0102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.252+0000 7fafc5505640 1 --2- 172.21.15.59:0/4253197097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafc0101c90 0x7fafc0102070 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009900 tx=0x7fafb002a410 comp rx=0 tx=0).stop 2024-09-10T21:13:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.252+0000 7fafc5505640 1 -- 172.21.15.59:0/4253197097 shutdown_connections 2024-09-10T21:13:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.252+0000 7fafc5505640 1 --2- 172.21.15.59:0/4253197097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafc0108020 0x7fafc010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.252+0000 7fafc5505640 1 --2- 172.21.15.59:0/4253197097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafc01076a0 0x7fafc0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.252+0000 7fafc5505640 1 --2- 172.21.15.59:0/4253197097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafc0101c90 0x7fafc0102070 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.252+0000 7fafc5505640 1 -- 172.21.15.59:0/4253197097 >> 172.21.15.59:0/4253197097 conn(0x7fafc00fd700 msgr2=0x7fafc00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.252+0000 7fafc5505640 1 -- 172.21.15.59:0/4253197097 shutdown_connections 2024-09-10T21:13:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.252+0000 7fafc5505640 1 -- 172.21.15.59:0/4253197097 wait complete. 2024-09-10T21:13:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.252+0000 7fafc5505640 1 Processor -- start 2024-09-10T21:13:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.253+0000 7fafc5505640 1 -- start start 2024-09-10T21:13:26.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.253+0000 7fafc5505640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafc0101c90 0x7fafc0199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.253+0000 7fafc5505640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafc01076a0 0x7fafc01997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.253+0000 7fafc5505640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafc0108020 0x7fafc019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.253+0000 7fafc5505640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fafc0111ce0 con 0x7fafc01076a0 2024-09-10T21:13:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.253+0000 7fafc5505640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fafc0111b60 con 0x7fafc0101c90 2024-09-10T21:13:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.253+0000 7fafc5505640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fafc0111e60 con 0x7fafc0108020 2024-09-10T21:13:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.253+0000 7fafbe7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafc01076a0 0x7fafc01997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.253+0000 7fafbe7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafc01076a0 0x7fafc01997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52774/0 (socket says 172.21.15.59:52774) 2024-09-10T21:13:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.253+0000 7fafbe7fc640 1 -- 172.21.15.59:0/1177739597 learned_addr learned my addr 172.21.15.59:0/1177739597 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.253+0000 7fafbeffd640 1 --2- 172.21.15.59:0/1177739597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafc0101c90 0x7fafc0199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.253+0000 7fafbf7fe640 1 --2- 172.21.15.59:0/1177739597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafc0108020 0x7fafc019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.253+0000 7fafbe7fc640 1 -- 172.21.15.59:0/1177739597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafc0108020 msgr2=0x7fafc019eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:26.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.253+0000 7fafbe7fc640 1 --2- 172.21.15.59:0/1177739597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafc0108020 0x7fafc019eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:26.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.253+0000 7fafbe7fc640 1 -- 172.21.15.59:0/1177739597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafc0101c90 msgr2=0x7fafc0199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:26.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.253+0000 7fafbe7fc640 1 --2- 172.21.15.59:0/1177739597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafc0101c90 0x7fafc0199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:26.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.253+0000 7fafbe7fc640 1 -- 172.21.15.59:0/1177739597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc019f320 con 0x7fafc01076a0 2024-09-10T21:13:26.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.253+0000 7fafbf7fe640 1 --2- 172.21.15.59:0/1177739597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafc0108020 0x7fafc019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:13:26.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.254+0000 7fafbe7fc640 1 --2- 172.21.15.59:0/1177739597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafc01076a0 0x7fafc01997b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fafb400c920 tx=0x7fafb400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:26.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.254+0000 7fafa7fff640 1 -- 172.21.15.59:0/1177739597 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb4007c70 con 0x7fafc01076a0 2024-09-10T21:13:26.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.254+0000 7fafc5505640 1 -- 172.21.15.59:0/1177739597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafc019f610 con 0x7fafc01076a0 2024-09-10T21:13:26.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.254+0000 7fafa7fff640 1 -- 172.21.15.59:0/1177739597 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafb4007e10 con 0x7fafc01076a0 2024-09-10T21:13:26.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.254+0000 7fafa7fff640 1 -- 172.21.15.59:0/1177739597 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb4018820 con 0x7fafc01076a0 2024-09-10T21:13:26.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.254+0000 7fafc5505640 1 -- 172.21.15.59:0/1177739597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafc01a5cd0 con 0x7fafc01076a0 2024-09-10T21:13:26.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.255+0000 7fafc5505640 1 -- 172.21.15.59:0/1177739597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafc0102070 con 0x7fafc01076a0 2024-09-10T21:13:26.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.256+0000 7fafa7fff640 1 -- 172.21.15.59:0/1177739597 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7fafb400f450 con 0x7fafc01076a0 2024-09-10T21:13:26.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.257+0000 7fafa7fff640 1 --2- 172.21.15.59:0/1177739597 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fafa80b52e0 0x7fafa80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:26.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.257+0000 7fafbeffd640 1 --2- 172.21.15.59:0/1177739597 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fafa80b52e0 0x7fafa80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:26.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.257+0000 7fafa7fff640 1 -- 172.21.15.59:0/1177739597 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fafb40e5f00 con 0x7fafc01076a0 2024-09-10T21:13:26.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.257+0000 7fafbeffd640 1 --2- 172.21.15.59:0/1177739597 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fafa80b52e0 0x7fafa80b77a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fafb0031440 tx=0x7fafb0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:26.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.260+0000 7fafa7fff640 1 -- 172.21.15.59:0/1177739597 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fafb4014030 con 0x7fafc01076a0 2024-09-10T21:13:26.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:25 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2206641358' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T21:13:26.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:25 smithi192 ceph-mon[35363]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:13:26.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.484+0000 7fafc5505640 1 -- 172.21.15.59:0/1177739597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fafc002e5c0 con 0x7fafc01076a0 2024-09-10T21:13:26.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.910+0000 7fafa7fff640 1 -- 172.21.15.59:0/1177739597 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fafb40acf00 con 0x7fafc01076a0 2024-09-10T21:13:26.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.912+0000 7fafc5505640 1 -- 172.21.15.59:0/1177739597 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fafa80b52e0 msgr2=0x7fafa80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:26.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.912+0000 7fafc5505640 1 --2- 172.21.15.59:0/1177739597 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fafa80b52e0 0x7fafa80b77a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fafb0031440 tx=0x7fafb0005b50 comp rx=0 tx=0).stop 2024-09-10T21:13:26.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.912+0000 7fafc5505640 1 -- 172.21.15.59:0/1177739597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafc01076a0 msgr2=0x7fafc01997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:26.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.912+0000 7fafc5505640 1 --2- 172.21.15.59:0/1177739597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafc01076a0 0x7fafc01997b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fafb400c920 tx=0x7fafb400cde0 comp rx=0 tx=0).stop 2024-09-10T21:13:26.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.913+0000 7fafc5505640 1 -- 172.21.15.59:0/1177739597 shutdown_connections 2024-09-10T21:13:26.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.913+0000 7fafc5505640 1 --2- 172.21.15.59:0/1177739597 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fafa80b52e0 0x7fafa80b77a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:26.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.913+0000 7fafc5505640 1 --2- 172.21.15.59:0/1177739597 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fafc0108020 0x7fafc019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:26.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.913+0000 7fafc5505640 1 --2- 172.21.15.59:0/1177739597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafc01076a0 0x7fafc01997b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:26.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.913+0000 7fafc5505640 1 --2- 172.21.15.59:0/1177739597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fafc0101c90 0x7fafc0199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:26.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.913+0000 7fafc5505640 1 -- 172.21.15.59:0/1177739597 >> 172.21.15.59:0/1177739597 conn(0x7fafc00fd700 msgr2=0x7fafc006ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:26.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.913+0000 7fafc5505640 1 -- 172.21.15.59:0/1177739597 shutdown_connections 2024-09-10T21:13:26.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:26.913+0000 7fafc5505640 1 -- 172.21.15.59:0/1177739597 wait complete. 2024-09-10T21:13:27.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:26 smithi059 ceph-mon[30888]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-10T21:13:27.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:26 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1177739597' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-10T21:13:27.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:26 smithi154 ceph-mon[35041]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-10T21:13:27.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:26 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1177739597' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-10T21:13:27.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:26 smithi192 ceph-mon[35363]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-10T21:13:27.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:26 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1177739597' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-10T21:13:27.620 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-10T21:13:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:28.165 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:27 smithi059 ceph-mon[30888]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T21:13:28.165 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:27 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1177739597' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-10T21:13:28.165 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:27 smithi059 ceph-mon[30888]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T21:13:28.165 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:27 smithi059 ceph-mon[30888]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:13:28.165 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:27 smithi059 ceph-mon[30888]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-10T21:13:28.166 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:27 smithi059 ceph-mon[30888]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-10T21:13:28.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:27 smithi154 ceph-mon[35041]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T21:13:28.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:27 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1177739597' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-10T21:13:28.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:27 smithi154 ceph-mon[35041]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T21:13:28.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:27 smithi154 ceph-mon[35041]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:13:28.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:27 smithi154 ceph-mon[35041]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-10T21:13:28.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:27 smithi154 ceph-mon[35041]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-10T21:13:28.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:27 smithi192 ceph-mon[35363]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T21:13:28.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:27 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1177739597' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-10T21:13:28.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:27 smithi192 ceph-mon[35363]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T21:13:28.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:27 smithi192 ceph-mon[35363]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T21:13:28.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:27 smithi192 ceph-mon[35363]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-10T21:13:28.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:27 smithi192 ceph-mon[35363]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-10T21:13:28.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.535+0000 7f2681940640 1 -- 172.21.15.59:0/1151612555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f267c103ce0 msgr2=0x7f267c1040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:28.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.535+0000 7f2681940640 1 --2- 172.21.15.59:0/1151612555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f267c103ce0 0x7f267c1040c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f266c009900 tx=0x7f266c02a410 comp rx=0 tx=0).stop 2024-09-10T21:13:28.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.536+0000 7f2681940640 1 -- 172.21.15.59:0/1151612555 shutdown_connections 2024-09-10T21:13:28.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.536+0000 7f2681940640 1 --2- 172.21.15.59:0/1151612555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f267c10d140 0x7f267c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:28.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.536+0000 7f2681940640 1 --2- 172.21.15.59:0/1151612555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f267c104600 0x7f267c10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:28.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.536+0000 7f2681940640 1 --2- 172.21.15.59:0/1151612555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f267c103ce0 0x7f267c1040c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:28.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.536+0000 7f2681940640 1 -- 172.21.15.59:0/1151612555 >> 172.21.15.59:0/1151612555 conn(0x7f267c0fd720 msgr2=0x7f267c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:28.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.536+0000 7f2681940640 1 -- 172.21.15.59:0/1151612555 shutdown_connections 2024-09-10T21:13:28.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.536+0000 7f2681940640 1 -- 172.21.15.59:0/1151612555 wait complete. 2024-09-10T21:13:28.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.536+0000 7f2681940640 1 Processor -- start 2024-09-10T21:13:28.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.536+0000 7f2681940640 1 -- start start 2024-09-10T21:13:28.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.536+0000 7f2681940640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f267c103ce0 0x7f267c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.536+0000 7f2681940640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f267c104600 0x7f267c199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.537+0000 7f2681940640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f267c10d140 0x7f267c19ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.537+0000 7f2681940640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f267c112df0 con 0x7f267c10d140 2024-09-10T21:13:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.537+0000 7f2681940640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f267c112c70 con 0x7f267c104600 2024-09-10T21:13:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.537+0000 7f2681940640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f267c112f70 con 0x7f267c103ce0 2024-09-10T21:13:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.537+0000 7f267b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f267c10d140 0x7f267c19ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.537+0000 7f267b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f267c10d140 0x7f267c19ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52790/0 (socket says 172.21.15.59:52790) 2024-09-10T21:13:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.537+0000 7f267b7fe640 1 -- 172.21.15.59:0/2905463514 learned_addr learned my addr 172.21.15.59:0/2905463514 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.537+0000 7f267affd640 1 --2- 172.21.15.59:0/2905463514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f267c103ce0 0x7f267c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.537+0000 7f2673fff640 1 --2- 172.21.15.59:0/2905463514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f267c104600 0x7f267c199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.537+0000 7f267b7fe640 1 -- 172.21.15.59:0/2905463514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f267c103ce0 msgr2=0x7f267c199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.537+0000 7f267b7fe640 1 --2- 172.21.15.59:0/2905463514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f267c103ce0 0x7f267c199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.537+0000 7f267b7fe640 1 -- 172.21.15.59:0/2905463514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f267c104600 msgr2=0x7f267c199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:28.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.537+0000 7f267b7fe640 1 --2- 172.21.15.59:0/2905463514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f267c104600 0x7f267c199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:28.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.537+0000 7f267b7fe640 1 -- 172.21.15.59:0/2905463514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267c19f3d0 con 0x7f267c10d140 2024-09-10T21:13:28.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.537+0000 7f267b7fe640 1 --2- 172.21.15.59:0/2905463514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f267c10d140 0x7f267c19ec00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f267400b970 tx=0x7f267400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:28.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.537+0000 7f268093e640 1 -- 172.21.15.59:0/2905463514 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674019070 con 0x7f267c10d140 2024-09-10T21:13:28.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.537+0000 7f268093e640 1 -- 172.21.15.59:0/2905463514 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2674014440 con 0x7f267c10d140 2024-09-10T21:13:28.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.537+0000 7f2681940640 1 -- 172.21.15.59:0/2905463514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f267c19f6c0 con 0x7f267c10d140 2024-09-10T21:13:28.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.538+0000 7f268093e640 1 -- 172.21.15.59:0/2905463514 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26740075d0 con 0x7f267c10d140 2024-09-10T21:13:28.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.538+0000 7f2681940640 1 -- 172.21.15.59:0/2905463514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f267c1a5e00 con 0x7f267c10d140 2024-09-10T21:13:28.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.539+0000 7f2681940640 1 -- 172.21.15.59:0/2905463514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f267c1040c0 con 0x7f267c10d140 2024-09-10T21:13:28.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.540+0000 7f268093e640 1 -- 172.21.15.59:0/2905463514 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f267400cb40 con 0x7f267c10d140 2024-09-10T21:13:28.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.541+0000 7f268093e640 1 --2- 172.21.15.59:0/2905463514 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f26680b5360 0x7f26680b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:28.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.541+0000 7f267affd640 1 --2- 172.21.15.59:0/2905463514 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f26680b5360 0x7f26680b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:28.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.541+0000 7f268093e640 1 -- 172.21.15.59:0/2905463514 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f26740e51c0 con 0x7f267c10d140 2024-09-10T21:13:28.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.541+0000 7f267affd640 1 --2- 172.21.15.59:0/2905463514 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f26680b5360 0x7f26680b7820 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f266c031440 tx=0x7f266c005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:28.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.545+0000 7f268093e640 1 -- 172.21.15.59:0/2905463514 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f26740abb80 con 0x7f267c10d140 2024-09-10T21:13:28.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.767+0000 7f2681940640 1 -- 172.21.15.59:0/2905463514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f267c107c20 con 0x7f267c10d140 2024-09-10T21:13:28.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.927+0000 7f268093e640 1 -- 172.21.15.59:0/2905463514 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f26740b05b0 con 0x7f267c10d140 2024-09-10T21:13:28.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.930+0000 7f2681940640 1 -- 172.21.15.59:0/2905463514 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f26680b5360 msgr2=0x7f26680b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:28.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.930+0000 7f2681940640 1 --2- 172.21.15.59:0/2905463514 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f26680b5360 0x7f26680b7820 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f266c031440 tx=0x7f266c005e80 comp rx=0 tx=0).stop 2024-09-10T21:13:28.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.930+0000 7f2681940640 1 -- 172.21.15.59:0/2905463514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f267c10d140 msgr2=0x7f267c19ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:28.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.930+0000 7f2681940640 1 --2- 172.21.15.59:0/2905463514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f267c10d140 0x7f267c19ec00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f267400b970 tx=0x7f267400be30 comp rx=0 tx=0).stop 2024-09-10T21:13:28.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.930+0000 7f2681940640 1 -- 172.21.15.59:0/2905463514 shutdown_connections 2024-09-10T21:13:28.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.930+0000 7f2681940640 1 --2- 172.21.15.59:0/2905463514 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f26680b5360 0x7f26680b7820 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:28.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.930+0000 7f2681940640 1 --2- 172.21.15.59:0/2905463514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f267c10d140 0x7f267c19ec00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:28.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.930+0000 7f2681940640 1 --2- 172.21.15.59:0/2905463514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f267c104600 0x7f267c199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:28.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.930+0000 7f2681940640 1 --2- 172.21.15.59:0/2905463514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f267c103ce0 0x7f267c199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:28.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.930+0000 7f2681940640 1 -- 172.21.15.59:0/2905463514 >> 172.21.15.59:0/2905463514 conn(0x7f267c0fd720 msgr2=0x7f267c0fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:28.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.930+0000 7f2681940640 1 -- 172.21.15.59:0/2905463514 shutdown_connections 2024-09-10T21:13:28.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:28.931+0000 7f2681940640 1 -- 172.21.15.59:0/2905463514 wait complete. 2024-09-10T21:13:29.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:28 smithi154 ceph-mon[35041]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-09-10T21:13:29.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:28 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] up:active 2024-09-10T21:13:29.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:28 smithi154 ceph-mon[35041]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T21:13:29.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:28 smithi154 ceph-mon[35041]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-10T21:13:29.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:28 smithi154 ceph-mon[35041]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-10T21:13:29.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:28 smithi154 ceph-mon[35041]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-10T21:13:29.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:28 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2905463514' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T21:13:29.228 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:28 smithi059 ceph-mon[30888]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-09-10T21:13:29.228 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:28 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] up:active 2024-09-10T21:13:29.228 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:28 smithi059 ceph-mon[30888]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T21:13:29.228 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:28 smithi059 ceph-mon[30888]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-10T21:13:29.228 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:28 smithi059 ceph-mon[30888]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-10T21:13:29.228 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:28 smithi059 ceph-mon[30888]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-10T21:13:29.228 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:28 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2905463514' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T21:13:29.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:28 smithi192 ceph-mon[35363]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 6 op/s 2024-09-10T21:13:29.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:28 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] up:active 2024-09-10T21:13:29.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:28 smithi192 ceph-mon[35363]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T21:13:29.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:28 smithi192 ceph-mon[35363]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-10T21:13:29.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:28 smithi192 ceph-mon[35363]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-10T21:13:29.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:28 smithi192 ceph-mon[35363]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-10T21:13:29.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:28 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2905463514' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T21:13:29.603 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-10T21:13:29.869 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:30.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:29 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2905463514' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T21:13:30.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:29 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] up:active 2024-09-10T21:13:30.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:29 smithi192 ceph-mon[35363]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-10T21:13:30.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:29 smithi192 ceph-mon[35363]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-10T21:13:30.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:29 smithi192 ceph-mon[35363]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-10T21:13:30.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:29 smithi192 ceph-mon[35363]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-10T21:13:30.237 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:29 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2905463514' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T21:13:30.237 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:29 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] up:active 2024-09-10T21:13:30.237 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:29 smithi059 ceph-mon[30888]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-10T21:13:30.237 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:29 smithi059 ceph-mon[30888]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-10T21:13:30.237 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:29 smithi059 ceph-mon[30888]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-10T21:13:30.237 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:29 smithi059 ceph-mon[30888]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-10T21:13:30.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.321+0000 7f1494dcb640 1 -- 172.21.15.59:0/39927293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14901087d0 msgr2=0x7f1490108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:30.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.321+0000 7f1494dcb640 1 --2- 172.21.15.59:0/39927293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14901087d0 0x7f1490108c10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1484009ca0 tx=0x7f148402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:13:30.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.321+0000 7f1494dcb640 1 -- 172.21.15.59:0/39927293 shutdown_connections 2024-09-10T21:13:30.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.321+0000 7f1494dcb640 1 --2- 172.21.15.59:0/39927293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1490109150 0x7f149010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:30.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.321+0000 7f1494dcb640 1 --2- 172.21.15.59:0/39927293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14901087d0 0x7f1490108c10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:30.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.321+0000 7f1494dcb640 1 --2- 172.21.15.59:0/39927293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1490102dc0 0x7f14901031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:30.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.321+0000 7f1494dcb640 1 -- 172.21.15.59:0/39927293 >> 172.21.15.59:0/39927293 conn(0x7f14900fe830 msgr2=0x7f1490100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:30.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.321+0000 7f1494dcb640 1 -- 172.21.15.59:0/39927293 shutdown_connections 2024-09-10T21:13:30.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.321+0000 7f1494dcb640 1 -- 172.21.15.59:0/39927293 wait complete. 2024-09-10T21:13:30.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.321+0000 7f1494dcb640 1 Processor -- start 2024-09-10T21:13:30.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.322+0000 7f1494dcb640 1 -- start start 2024-09-10T21:13:30.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.322+0000 7f1494dcb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1490102dc0 0x7f1490199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:30.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.322+0000 7f1494dcb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14901087d0 0x7f1490199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:30.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.322+0000 7f1494dcb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1490109150 0x7f149019ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:30.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.322+0000 7f1494dcb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1490112e10 con 0x7f1490102dc0 2024-09-10T21:13:30.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.322+0000 7f1494dcb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1490112c90 con 0x7f1490109150 2024-09-10T21:13:30.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.322+0000 7f1494dcb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1490112f90 con 0x7f14901087d0 2024-09-10T21:13:30.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.322+0000 7f148e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1490102dc0 0x7f1490199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:30.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.322+0000 7f148e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1490102dc0 0x7f1490199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36480/0 (socket says 172.21.15.59:36480) 2024-09-10T21:13:30.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.322+0000 7f148e59c640 1 -- 172.21.15.59:0/175189810 learned_addr learned my addr 172.21.15.59:0/175189810 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:30.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.322+0000 7f148dd9b640 1 --2- 172.21.15.59:0/175189810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14901087d0 0x7f1490199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:30.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.322+0000 7f148e59c640 1 -- 172.21.15.59:0/175189810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14901087d0 msgr2=0x7f1490199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:30.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.322+0000 7f148e59c640 1 --2- 172.21.15.59:0/175189810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14901087d0 0x7f1490199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:30.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.322+0000 7f148e59c640 1 -- 172.21.15.59:0/175189810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1490109150 msgr2=0x7f149019ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:30.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.322+0000 7f148e59c640 1 --2- 172.21.15.59:0/175189810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1490109150 0x7f149019ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:30.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.322+0000 7f148e59c640 1 -- 172.21.15.59:0/175189810 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f149019f3f0 con 0x7f1490102dc0 2024-09-10T21:13:30.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.322+0000 7f148dd9b640 1 --2- 172.21.15.59:0/175189810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14901087d0 0x7f1490199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:13:30.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.322+0000 7f148e59c640 1 --2- 172.21.15.59:0/175189810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1490102dc0 0x7f1490199340 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f148000d770 tx=0x7f148000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:30.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.322+0000 7f147f7fe640 1 -- 172.21.15.59:0/175189810 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1480017070 con 0x7f1490102dc0 2024-09-10T21:13:30.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.323+0000 7f147f7fe640 1 -- 172.21.15.59:0/175189810 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14800054d0 con 0x7f1490102dc0 2024-09-10T21:13:30.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.323+0000 7f1494dcb640 1 -- 172.21.15.59:0/175189810 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f149019f6e0 con 0x7f1490102dc0 2024-09-10T21:13:30.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.323+0000 7f147f7fe640 1 -- 172.21.15.59:0/175189810 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1480004c30 con 0x7f1490102dc0 2024-09-10T21:13:30.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.323+0000 7f1494dcb640 1 -- 172.21.15.59:0/175189810 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14901a5da0 con 0x7f1490102dc0 2024-09-10T21:13:30.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.324+0000 7f1494dcb640 1 -- 172.21.15.59:0/175189810 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14901031a0 con 0x7f1490102dc0 2024-09-10T21:13:30.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.325+0000 7f147f7fe640 1 -- 172.21.15.59:0/175189810 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f1480004dd0 con 0x7f1490102dc0 2024-09-10T21:13:30.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.326+0000 7f147f7fe640 1 --2- 172.21.15.59:0/175189810 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f14780b5360 0x7f14780b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:30.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.326+0000 7f147f7fe640 1 -- 172.21.15.59:0/175189810 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f14800e5990 con 0x7f1490102dc0 2024-09-10T21:13:30.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.326+0000 7f148dd9b640 1 --2- 172.21.15.59:0/175189810 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f14780b5360 0x7f14780b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:30.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.326+0000 7f148dd9b640 1 --2- 172.21.15.59:0/175189810 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f14780b5360 0x7f14780b7820 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1484000f80 tx=0x7f1484009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:30.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.329+0000 7f147f7fe640 1 -- 172.21.15.59:0/175189810 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f14800aca20 con 0x7f1490102dc0 2024-09-10T21:13:30.433 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 21:13:29 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-b[64936]: 2024-09-10T21:13:29.946+0000 7ff67616d640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-10T21:13:30.433 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 21:13:29 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-b[64936]: 2024-09-10T21:13:29.946+0000 7ff67616d640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-10T21:13:30.433 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 21:13:29 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-b[64936]: 2024-09-10T21:13:29.946+0000 7ff67616d640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-10T21:13:30.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:29 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2905463514' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T21:13:30.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:29 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] up:active 2024-09-10T21:13:30.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:29 smithi154 ceph-mon[35041]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-10T21:13:30.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:29 smithi154 ceph-mon[35041]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-10T21:13:30.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:29 smithi154 ceph-mon[35041]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-10T21:13:30.434 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:29 smithi154 ceph-mon[35041]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-10T21:13:30.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.553+0000 7f1494dcb640 1 -- 172.21.15.59:0/175189810 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f149002e5c0 con 0x7f1490102dc0 2024-09-10T21:13:30.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.942+0000 7f147f7fe640 1 -- 172.21.15.59:0/175189810 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f14800ac320 con 0x7f1490102dc0 2024-09-10T21:13:30.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.945+0000 7f1494dcb640 1 -- 172.21.15.59:0/175189810 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f14780b5360 msgr2=0x7f14780b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:30.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.945+0000 7f1494dcb640 1 --2- 172.21.15.59:0/175189810 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f14780b5360 0x7f14780b7820 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1484000f80 tx=0x7f1484009800 comp rx=0 tx=0).stop 2024-09-10T21:13:30.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.945+0000 7f1494dcb640 1 -- 172.21.15.59:0/175189810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1490102dc0 msgr2=0x7f1490199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:30.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.945+0000 7f1494dcb640 1 --2- 172.21.15.59:0/175189810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1490102dc0 0x7f1490199340 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f148000d770 tx=0x7f148000dc30 comp rx=0 tx=0).stop 2024-09-10T21:13:30.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.945+0000 7f1494dcb640 1 -- 172.21.15.59:0/175189810 shutdown_connections 2024-09-10T21:13:30.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.945+0000 7f1494dcb640 1 --2- 172.21.15.59:0/175189810 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f14780b5360 0x7f14780b7820 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:30.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.945+0000 7f1494dcb640 1 --2- 172.21.15.59:0/175189810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1490109150 0x7f149019ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:30.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.945+0000 7f1494dcb640 1 --2- 172.21.15.59:0/175189810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14901087d0 0x7f1490199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:30.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.945+0000 7f1494dcb640 1 --2- 172.21.15.59:0/175189810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1490102dc0 0x7f1490199340 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:30.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.945+0000 7f1494dcb640 1 -- 172.21.15.59:0/175189810 >> 172.21.15.59:0/175189810 conn(0x7f14900fe830 msgr2=0x7f1490100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:30.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.945+0000 7f1494dcb640 1 -- 172.21.15.59:0/175189810 shutdown_connections 2024-09-10T21:13:30.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:30.945+0000 7f1494dcb640 1 -- 172.21.15.59:0/175189810 wait complete. 2024-09-10T21:13:31.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:30 smithi059 ceph-mon[30888]: pgmap v285: 97 pgs: 97 active+clean; 580 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-10T21:13:31.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:30 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] up:active 2024-09-10T21:13:31.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:30 smithi059 ceph-mon[30888]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-10T21:13:31.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:30 smithi059 ceph-mon[30888]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T21:13:31.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:30 smithi059 ceph-mon[30888]: Cluster is now healthy 2024-09-10T21:13:31.274 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:30 smithi059 ceph-mon[30888]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-10T21:13:31.274 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:30 smithi059 ceph-mon[30888]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-10T21:13:31.274 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:30 smithi059 ceph-mon[30888]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-10T21:13:31.274 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:30 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/175189810' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T21:13:31.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:30 smithi192 ceph-mon[35363]: pgmap v285: 97 pgs: 97 active+clean; 580 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-10T21:13:31.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:30 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] up:active 2024-09-10T21:13:31.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:30 smithi192 ceph-mon[35363]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-10T21:13:31.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:30 smithi192 ceph-mon[35363]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T21:13:31.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:30 smithi192 ceph-mon[35363]: Cluster is now healthy 2024-09-10T21:13:31.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:30 smithi192 ceph-mon[35363]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-10T21:13:31.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:30 smithi192 ceph-mon[35363]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-10T21:13:31.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:30 smithi192 ceph-mon[35363]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-10T21:13:31.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:30 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/175189810' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T21:13:31.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:30 smithi154 ceph-mon[35041]: pgmap v285: 97 pgs: 97 active+clean; 580 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-10T21:13:31.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:30 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] up:active 2024-09-10T21:13:31.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:30 smithi154 ceph-mon[35041]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-10T21:13:31.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:30 smithi154 ceph-mon[35041]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T21:13:31.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:30 smithi154 ceph-mon[35041]: Cluster is now healthy 2024-09-10T21:13:31.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:30 smithi154 ceph-mon[35041]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-10T21:13:31.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:30 smithi154 ceph-mon[35041]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-10T21:13:31.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:30 smithi154 ceph-mon[35041]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-10T21:13:31.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:30 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/175189810' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T21:13:31.608 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-10T21:13:31.609 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-10T21:13:31.874 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:32.269 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:31 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/175189810' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T21:13:32.269 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:31 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] up:active 2024-09-10T21:13:32.269 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:31 smithi059 ceph-mon[30888]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-10T21:13:32.269 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:31 smithi059 ceph-mon[30888]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:13:32.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:31 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/175189810' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T21:13:32.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:31 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] up:active 2024-09-10T21:13:32.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:31 smithi192 ceph-mon[35363]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-10T21:13:32.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:31 smithi192 ceph-mon[35363]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:13:32.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.351+0000 7f624d7e1640 1 -- 172.21.15.59:0/3759397112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f624810d100 msgr2=0x7f624810f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:32.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.351+0000 7f624d7e1640 1 --2- 172.21.15.59:0/3759397112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f624810d100 0x7f624810f560 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6240009ca0 tx=0x7f624002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:13:32.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.351+0000 7f624d7e1640 1 -- 172.21.15.59:0/3759397112 shutdown_connections 2024-09-10T21:13:32.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.351+0000 7f624d7e1640 1 --2- 172.21.15.59:0/3759397112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f624810d100 0x7f624810f560 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:32.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.351+0000 7f624d7e1640 1 --2- 172.21.15.59:0/3759397112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62481045c0 0x7f624810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:32.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.351+0000 7f624d7e1640 1 --2- 172.21.15.59:0/3759397112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6248103ca0 0x7f6248104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:32.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.351+0000 7f624d7e1640 1 -- 172.21.15.59:0/3759397112 >> 172.21.15.59:0/3759397112 conn(0x7f62480fd700 msgr2=0x7f62480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:32.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.351+0000 7f624d7e1640 1 -- 172.21.15.59:0/3759397112 shutdown_connections 2024-09-10T21:13:32.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.351+0000 7f624d7e1640 1 -- 172.21.15.59:0/3759397112 wait complete. 2024-09-10T21:13:32.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.352+0000 7f624d7e1640 1 Processor -- start 2024-09-10T21:13:32.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.352+0000 7f624d7e1640 1 -- start start 2024-09-10T21:13:32.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.352+0000 7f624d7e1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6248103ca0 0x7f624819b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:32.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.352+0000 7f624d7e1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62481045c0 0x7f624819ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:32.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.352+0000 7f624d7e1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f624810d100 0x7f62481a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:32.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.352+0000 7f624d7e1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6248112db0 con 0x7f62481045c0 2024-09-10T21:13:32.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.352+0000 7f624d7e1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6248112c30 con 0x7f6248103ca0 2024-09-10T21:13:32.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.352+0000 7f624d7e1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6248112f30 con 0x7f624810d100 2024-09-10T21:13:32.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.352+0000 7f623ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62481045c0 0x7f624819ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:32.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.352+0000 7f623ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62481045c0 0x7f624819ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36510/0 (socket says 172.21.15.59:36510) 2024-09-10T21:13:32.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.352+0000 7f623ffff640 1 -- 172.21.15.59:0/106120329 learned_addr learned my addr 172.21.15.59:0/106120329 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:32.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.352+0000 7f6246ffd640 1 --2- 172.21.15.59:0/106120329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6248103ca0 0x7f624819b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:32.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.353+0000 7f62477fe640 1 --2- 172.21.15.59:0/106120329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f624810d100 0x7f62481a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:32.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.353+0000 7f623ffff640 1 -- 172.21.15.59:0/106120329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f624810d100 msgr2=0x7f62481a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:32.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.353+0000 7f623ffff640 1 --2- 172.21.15.59:0/106120329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f624810d100 0x7f62481a0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:32.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.353+0000 7f623ffff640 1 -- 172.21.15.59:0/106120329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6248103ca0 msgr2=0x7f624819b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:32.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.353+0000 7f623ffff640 1 --2- 172.21.15.59:0/106120329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6248103ca0 0x7f624819b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:32.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.353+0000 7f623ffff640 1 -- 172.21.15.59:0/106120329 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62481a15f0 con 0x7f62481045c0 2024-09-10T21:13:32.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.353+0000 7f623ffff640 1 --2- 172.21.15.59:0/106120329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62481045c0 0x7f624819ba80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f623000d750 tx=0x7f623000db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:32.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.353+0000 7f6244ff9640 1 -- 172.21.15.59:0/106120329 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6230017070 con 0x7f62481045c0 2024-09-10T21:13:32.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.353+0000 7f6244ff9640 1 -- 172.21.15.59:0/106120329 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6230009cd0 con 0x7f62481045c0 2024-09-10T21:13:32.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.353+0000 7f624d7e1640 1 -- 172.21.15.59:0/106120329 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62481a18e0 con 0x7f62481045c0 2024-09-10T21:13:32.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.353+0000 7f6244ff9640 1 -- 172.21.15.59:0/106120329 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6230003b50 con 0x7f62481045c0 2024-09-10T21:13:32.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.353+0000 7f624d7e1640 1 -- 172.21.15.59:0/106120329 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62481a7fa0 con 0x7f62481045c0 2024-09-10T21:13:32.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.354+0000 7f624d7e1640 1 -- 172.21.15.59:0/106120329 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6248104080 con 0x7f62481045c0 2024-09-10T21:13:32.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.356+0000 7f6244ff9640 1 -- 172.21.15.59:0/106120329 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f6230003cf0 con 0x7f62481045c0 2024-09-10T21:13:32.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.356+0000 7f6244ff9640 1 --2- 172.21.15.59:0/106120329 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f62340b52e0 0x7f62340b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:32.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.357+0000 7f6246ffd640 1 --2- 172.21.15.59:0/106120329 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f62340b52e0 0x7f62340b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:32.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.357+0000 7f6244ff9640 1 -- 172.21.15.59:0/106120329 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f62300e5890 con 0x7f62481045c0 2024-09-10T21:13:32.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.357+0000 7f6246ffd640 1 --2- 172.21.15.59:0/106120329 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f62340b52e0 0x7f62340b77a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6238009990 tx=0x7f6238009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:32.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.359+0000 7f6244ff9640 1 -- 172.21.15.59:0/106120329 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f62300ac800 con 0x7f62481045c0 2024-09-10T21:13:32.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:31 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/175189810' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T21:13:32.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:31 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] up:active 2024-09-10T21:13:32.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:31 smithi154 ceph-mon[35041]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-10T21:13:32.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:31 smithi154 ceph-mon[35041]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:13:32.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.571+0000 7f624d7e1640 1 -- 172.21.15.59:0/106120329 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6248103060 con 0x7f62340b52e0 2024-09-10T21:13:32.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.595+0000 7f6244ff9640 1 -- 172.21.15.59:0/106120329 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6248103060 con 0x7f62340b52e0 2024-09-10T21:13:32.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.597+0000 7f624d7e1640 1 -- 172.21.15.59:0/106120329 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f62340b52e0 msgr2=0x7f62340b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.597+0000 7f624d7e1640 1 --2- 172.21.15.59:0/106120329 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f62340b52e0 0x7f62340b77a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6238009990 tx=0x7f6238009110 comp rx=0 tx=0).stop 2024-09-10T21:13:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.597+0000 7f624d7e1640 1 -- 172.21.15.59:0/106120329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62481045c0 msgr2=0x7f624819ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.597+0000 7f624d7e1640 1 --2- 172.21.15.59:0/106120329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62481045c0 0x7f624819ba80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f623000d750 tx=0x7f623000db50 comp rx=0 tx=0).stop 2024-09-10T21:13:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.597+0000 7f624d7e1640 1 -- 172.21.15.59:0/106120329 shutdown_connections 2024-09-10T21:13:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.597+0000 7f624d7e1640 1 --2- 172.21.15.59:0/106120329 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f62340b52e0 0x7f62340b77a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.597+0000 7f624d7e1640 1 --2- 172.21.15.59:0/106120329 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f624810d100 0x7f62481a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.597+0000 7f624d7e1640 1 --2- 172.21.15.59:0/106120329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62481045c0 0x7f624819ba80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.597+0000 7f624d7e1640 1 --2- 172.21.15.59:0/106120329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6248103ca0 0x7f624819b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.597+0000 7f624d7e1640 1 -- 172.21.15.59:0/106120329 >> 172.21.15.59:0/106120329 conn(0x7f62480fd700 msgr2=0x7f624810f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.598+0000 7f624d7e1640 1 -- 172.21.15.59:0/106120329 shutdown_connections 2024-09-10T21:13:32.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:32.598+0000 7f624d7e1640 1 -- 172.21.15.59:0/106120329 wait complete. 2024-09-10T21:13:32.838 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:13:32 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: 2024-09-10T21:13:32.576+0000 7f411851e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T21:13:32.838 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:13:32 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: 2024-09-10T21:13:32.576+0000 7f411851e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T21:13:32.839 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:13:32 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: 2024-09-10T21:13:32.576+0000 7f411851e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T21:13:32.839 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:13:32 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: 2024-09-10T21:13:32.576+0000 7f411851e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T21:13:32.839 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:13:32 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: 2024-09-10T21:13:32.576+0000 7f411851e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T21:13:33.147 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:32 smithi059 ceph-mon[30888]: pgmap v286: 97 pgs: 97 active+clean; 580 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 9 op/s 2024-09-10T21:13:33.176 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-10T21:13:33.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:32 smithi192 ceph-mon[35363]: pgmap v286: 97 pgs: 97 active+clean; 580 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 9 op/s 2024-09-10T21:13:33.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:32 smithi154 ceph-mon[35041]: pgmap v286: 97 pgs: 97 active+clean; 580 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 9 op/s 2024-09-10T21:13:33.433 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:33.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.908+0000 7f59c4d0a640 1 -- 172.21.15.59:0/1569448573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59c0108060 msgr2=0x7f59c010e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:33.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.908+0000 7f59c4d0a640 1 --2- 172.21.15.59:0/1569448573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59c0108060 0x7f59c010e860 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009ca0 tx=0x7f59b802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:13:33.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.908+0000 7f59c4d0a640 1 -- 172.21.15.59:0/1569448573 shutdown_connections 2024-09-10T21:13:33.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.908+0000 7f59c4d0a640 1 --2- 172.21.15.59:0/1569448573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59c0108060 0x7f59c010e860 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:33.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.908+0000 7f59c4d0a640 1 --2- 172.21.15.59:0/1569448573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59c01076e0 0x7f59c0107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:33.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.908+0000 7f59c4d0a640 1 --2- 172.21.15.59:0/1569448573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59c0101cd0 0x7f59c01020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:33.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.908+0000 7f59c4d0a640 1 -- 172.21.15.59:0/1569448573 >> 172.21.15.59:0/1569448573 conn(0x7f59c00fd700 msgr2=0x7f59c00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:33.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.908+0000 7f59c4d0a640 1 -- 172.21.15.59:0/1569448573 shutdown_connections 2024-09-10T21:13:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.908+0000 7f59c4d0a640 1 -- 172.21.15.59:0/1569448573 wait complete. 2024-09-10T21:13:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.909+0000 7f59c4d0a640 1 Processor -- start 2024-09-10T21:13:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.909+0000 7f59c4d0a640 1 -- start start 2024-09-10T21:13:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.909+0000 7f59c4d0a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59c0101cd0 0x7f59c0198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.909+0000 7f59c4d0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59c01076e0 0x7f59c01987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.909+0000 7f59c4d0a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59c0108060 0x7f59c019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.909+0000 7f59c4d0a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f59c0111d60 con 0x7f59c0101cd0 2024-09-10T21:13:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.909+0000 7f59c4d0a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f59c0111be0 con 0x7f59c01076e0 2024-09-10T21:13:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.909+0000 7f59c4d0a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f59c0111ee0 con 0x7f59c0108060 2024-09-10T21:13:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.909+0000 7f59be59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59c0101cd0 0x7f59c0198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.909+0000 7f59be59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59c0101cd0 0x7f59c0198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36534/0 (socket says 172.21.15.59:36534) 2024-09-10T21:13:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.909+0000 7f59be59c640 1 -- 172.21.15.59:0/3075511679 learned_addr learned my addr 172.21.15.59:0/3075511679 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.909+0000 7f59be59c640 1 -- 172.21.15.59:0/3075511679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59c0108060 msgr2=0x7f59c019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:33.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.909+0000 7f59bed9d640 1 --2- 172.21.15.59:0/3075511679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59c0108060 0x7f59c019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.909+0000 7f59bdd9b640 1 --2- 172.21.15.59:0/3075511679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59c01076e0 0x7f59c01987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.909+0000 7f59be59c640 1 --2- 172.21.15.59:0/3075511679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59c0108060 0x7f59c019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.909+0000 7f59be59c640 1 -- 172.21.15.59:0/3075511679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59c01076e0 msgr2=0x7f59c01987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.909+0000 7f59be59c640 1 --2- 172.21.15.59:0/3075511679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59c01076e0 0x7f59c01987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.909+0000 7f59be59c640 1 -- 172.21.15.59:0/3075511679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c019e340 con 0x7f59c0101cd0 2024-09-10T21:13:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.910+0000 7f59be59c640 1 --2- 172.21.15.59:0/3075511679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59c0101cd0 0x7f59c0198290 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f59b000b4a0 tx=0x7f59b000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.910+0000 7f59af7fe640 1 -- 172.21.15.59:0/3075511679 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b0014070 con 0x7f59c0101cd0 2024-09-10T21:13:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.910+0000 7f59c4d0a640 1 -- 172.21.15.59:0/3075511679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c019e630 con 0x7f59c0101cd0 2024-09-10T21:13:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.910+0000 7f59af7fe640 1 -- 172.21.15.59:0/3075511679 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59b0010ac0 con 0x7f59c0101cd0 2024-09-10T21:13:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.910+0000 7f59af7fe640 1 -- 172.21.15.59:0/3075511679 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b0017c30 con 0x7f59c0101cd0 2024-09-10T21:13:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.910+0000 7f59c4d0a640 1 -- 172.21.15.59:0/3075511679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c01a4d70 con 0x7f59c0101cd0 2024-09-10T21:13:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.911+0000 7f59c4d0a640 1 -- 172.21.15.59:0/3075511679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59c0102130 con 0x7f59c0101cd0 2024-09-10T21:13:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.912+0000 7f59af7fe640 1 -- 172.21.15.59:0/3075511679 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 153250+0+0 (secure 0 0 0) 0x7f59b0010610 con 0x7f59c0101cd0 2024-09-10T21:13:33.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.913+0000 7f59af7fe640 1 --2- 172.21.15.59:0/3075511679 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f59a80b52e0 0x7f59a80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:33.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.913+0000 7f59bdd9b640 1 --2- 172.21.15.59:0/3075511679 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f59a80b52e0 0x7f59a80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:33.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.913+0000 7f59af7fe640 1 -- 172.21.15.59:0/3075511679 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f59b00e54a0 con 0x7f59c0101cd0 2024-09-10T21:13:33.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.913+0000 7f59bdd9b640 1 --2- 172.21.15.59:0/3075511679 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f59a80b52e0 0x7f59a80b77a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f59c0103d20 tx=0x7f59b4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:33.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.916+0000 7f59af7fe640 1 -- 172.21.15.59:0/3075511679 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f59b00ac410 con 0x7f59c0101cd0 2024-09-10T21:13:33.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:33.968+0000 7f59af7fe640 1 -- 172.21.15.59:0/3075511679 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f59b00a7f80 con 0x7f59c0101cd0 2024-09-10T21:13:34.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:34.134+0000 7f59c4d0a640 1 -- 172.21.15.59:0/3075511679 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f59c0063590 con 0x7f59a80b52e0 2024-09-10T21:13:34.138 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:33 smithi059 ceph-mon[30888]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:13:34.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:34.158+0000 7f59af7fe640 1 -- 172.21.15.59:0/3075511679 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f59c0063590 con 0x7f59a80b52e0 2024-09-10T21:13:34.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:34.160+0000 7f59c4d0a640 1 -- 172.21.15.59:0/3075511679 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f59a80b52e0 msgr2=0x7f59a80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:34.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:34.160+0000 7f59c4d0a640 1 --2- 172.21.15.59:0/3075511679 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f59a80b52e0 0x7f59a80b77a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f59c0103d20 tx=0x7f59b4008040 comp rx=0 tx=0).stop 2024-09-10T21:13:34.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:34.160+0000 7f59c4d0a640 1 -- 172.21.15.59:0/3075511679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59c0101cd0 msgr2=0x7f59c0198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:34.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:34.160+0000 7f59c4d0a640 1 --2- 172.21.15.59:0/3075511679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59c0101cd0 0x7f59c0198290 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f59b000b4a0 tx=0x7f59b000b960 comp rx=0 tx=0).stop 2024-09-10T21:13:34.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:34.160+0000 7f59c4d0a640 1 -- 172.21.15.59:0/3075511679 shutdown_connections 2024-09-10T21:13:34.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:34.160+0000 7f59c4d0a640 1 --2- 172.21.15.59:0/3075511679 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f59a80b52e0 0x7f59a80b77a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:34.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:34.160+0000 7f59c4d0a640 1 --2- 172.21.15.59:0/3075511679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59c0108060 0x7f59c019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:34.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:34.160+0000 7f59c4d0a640 1 --2- 172.21.15.59:0/3075511679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f59c01076e0 0x7f59c01987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:34.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:34.160+0000 7f59c4d0a640 1 --2- 172.21.15.59:0/3075511679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59c0101cd0 0x7f59c0198290 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:34.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:34.160+0000 7f59c4d0a640 1 -- 172.21.15.59:0/3075511679 >> 172.21.15.59:0/3075511679 conn(0x7f59c00fd700 msgr2=0x7f59c00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:34.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:34.160+0000 7f59c4d0a640 1 -- 172.21.15.59:0/3075511679 shutdown_connections 2024-09-10T21:13:34.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:34.160+0000 7f59c4d0a640 1 -- 172.21.15.59:0/3075511679 wait complete. 2024-09-10T21:13:34.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:33 smithi192 ceph-mon[35363]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:13:34.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:33 smithi154 ceph-mon[35041]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:13:34.829 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-10T21:13:35.092 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:35.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:34 smithi059 ceph-mon[30888]: pgmap v287: 97 pgs: 97 active+clean; 584 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4.2 KiB/s wr, 18 op/s 2024-09-10T21:13:35.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:34 smithi059 ceph-mon[30888]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T21:13:35.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:34 smithi192 ceph-mon[35363]: pgmap v287: 97 pgs: 97 active+clean; 584 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4.2 KiB/s wr, 18 op/s 2024-09-10T21:13:35.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:34 smithi192 ceph-mon[35363]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T21:13:35.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:34 smithi154 ceph-mon[35041]: pgmap v287: 97 pgs: 97 active+clean; 584 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4.2 KiB/s wr, 18 op/s 2024-09-10T21:13:35.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:34 smithi154 ceph-mon[35041]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T21:13:35.433 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 21:13:34 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-b[64936]: 2024-09-10T21:13:34.947+0000 7ff67616d640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-10T21:13:35.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.533+0000 7fa0a3417640 1 -- 172.21.15.59:0/1559998633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa09c1087d0 msgr2=0x7fa09c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:35.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.533+0000 7fa0a3417640 1 --2- 172.21.15.59:0/1559998633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa09c1087d0 0x7fa09c108c10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009900 tx=0x7fa08c02a410 comp rx=0 tx=0).stop 2024-09-10T21:13:35.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.533+0000 7fa0a3417640 1 -- 172.21.15.59:0/1559998633 shutdown_connections 2024-09-10T21:13:35.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.533+0000 7fa0a3417640 1 --2- 172.21.15.59:0/1559998633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa09c109150 0x7fa09c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:35.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.533+0000 7fa0a3417640 1 --2- 172.21.15.59:0/1559998633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa09c1087d0 0x7fa09c108c10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:35.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.533+0000 7fa0a3417640 1 --2- 172.21.15.59:0/1559998633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa09c102dc0 0x7fa09c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:35.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.533+0000 7fa0a3417640 1 -- 172.21.15.59:0/1559998633 >> 172.21.15.59:0/1559998633 conn(0x7fa09c0fe830 msgr2=0x7fa09c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:35.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.533+0000 7fa0a3417640 1 -- 172.21.15.59:0/1559998633 shutdown_connections 2024-09-10T21:13:35.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.534+0000 7fa0a3417640 1 -- 172.21.15.59:0/1559998633 wait complete. 2024-09-10T21:13:35.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.534+0000 7fa0a3417640 1 Processor -- start 2024-09-10T21:13:35.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.534+0000 7fa0a3417640 1 -- start start 2024-09-10T21:13:35.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.534+0000 7fa0a3417640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa09c102dc0 0x7fa09c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:35.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.534+0000 7fa0a3417640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa09c1087d0 0x7fa09c199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:35.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.534+0000 7fa0a3417640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa09c109150 0x7fa09c19eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:35.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0a3417640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c112e10 con 0x7fa09c102dc0 2024-09-10T21:13:35.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0a3417640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c112c90 con 0x7fa09c1087d0 2024-09-10T21:13:35.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0a3417640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c112f90 con 0x7fa09c109150 2024-09-10T21:13:35.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0a11b3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa09c102dc0 0x7fa09c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:35.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0a11b3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa09c102dc0 0x7fa09c1992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36554/0 (socket says 172.21.15.59:36554) 2024-09-10T21:13:35.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0a11b3640 1 -- 172.21.15.59:0/430711672 learned_addr learned my addr 172.21.15.59:0/430711672 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:35.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0a09b2640 1 --2- 172.21.15.59:0/430711672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa09c1087d0 0x7fa09c199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:35.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0a19b4640 1 --2- 172.21.15.59:0/430711672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa09c109150 0x7fa09c19eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:35.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0a11b3640 1 -- 172.21.15.59:0/430711672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa09c109150 msgr2=0x7fa09c19eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:35.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0a11b3640 1 --2- 172.21.15.59:0/430711672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa09c109150 0x7fa09c19eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:35.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0a11b3640 1 -- 172.21.15.59:0/430711672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa09c1087d0 msgr2=0x7fa09c199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:35.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0a11b3640 1 --2- 172.21.15.59:0/430711672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa09c1087d0 0x7fa09c199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:35.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0a11b3640 1 -- 172.21.15.59:0/430711672 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa09c19f370 con 0x7fa09c102dc0 2024-09-10T21:13:35.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0a09b2640 1 --2- 172.21.15.59:0/430711672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa09c1087d0 0x7fa09c199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:13:35.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0a11b3640 1 --2- 172.21.15.59:0/430711672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa09c102dc0 0x7fa09c1992c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa09800d950 tx=0x7fa09800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:35.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0927fc640 1 -- 172.21.15.59:0/430711672 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa098017030 con 0x7fa09c102dc0 2024-09-10T21:13:35.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0927fc640 1 -- 172.21.15.59:0/430711672 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa098004020 con 0x7fa09c102dc0 2024-09-10T21:13:35.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0927fc640 1 -- 172.21.15.59:0/430711672 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0980047a0 con 0x7fa09c102dc0 2024-09-10T21:13:35.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0a3417640 1 -- 172.21.15.59:0/430711672 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa09c19f660 con 0x7fa09c102dc0 2024-09-10T21:13:35.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.535+0000 7fa0a3417640 1 -- 172.21.15.59:0/430711672 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa09c1a5ef0 con 0x7fa09c102dc0 2024-09-10T21:13:35.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.536+0000 7fa0a3417640 1 -- 172.21.15.59:0/430711672 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa09c1031a0 con 0x7fa09c102dc0 2024-09-10T21:13:35.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.538+0000 7fa0927fc640 1 -- 172.21.15.59:0/430711672 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fa098009a30 con 0x7fa09c102dc0 2024-09-10T21:13:35.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.538+0000 7fa0927fc640 1 --2- 172.21.15.59:0/430711672 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa0880b53f0 0x7fa0880b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:35.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.539+0000 7fa0a09b2640 1 --2- 172.21.15.59:0/430711672 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa0880b53f0 0x7fa0880b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:35.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.539+0000 7fa0927fc640 1 -- 172.21.15.59:0/430711672 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fa0980e5ce0 con 0x7fa09c102dc0 2024-09-10T21:13:35.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.539+0000 7fa0a09b2640 1 --2- 172.21.15.59:0/430711672 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa0880b53f0 0x7fa0880b78b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa08c031440 tx=0x7fa08c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:35.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.541+0000 7fa0927fc640 1 -- 172.21.15.59:0/430711672 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa0980acc70 con 0x7fa09c102dc0 2024-09-10T21:13:35.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.755+0000 7fa0a3417640 1 -- 172.21.15.59:0/430711672 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fa09c063590 con 0x7fa0880b53f0 2024-09-10T21:13:35.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.761+0000 7fa0927fc640 1 -- 172.21.15.59:0/430711672 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fa09c063590 con 0x7fa0880b53f0 2024-09-10T21:13:35.765 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/qa/sv_0/28c3135c-0253-46f7-a55f-952aaf4874d1 2024-09-10T21:13:35.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.763+0000 7fa0a3417640 1 -- 172.21.15.59:0/430711672 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa0880b53f0 msgr2=0x7fa0880b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:35.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.763+0000 7fa0a3417640 1 --2- 172.21.15.59:0/430711672 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa0880b53f0 0x7fa0880b78b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa08c031440 tx=0x7fa08c005a20 comp rx=0 tx=0).stop 2024-09-10T21:13:35.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.763+0000 7fa0a3417640 1 -- 172.21.15.59:0/430711672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa09c102dc0 msgr2=0x7fa09c1992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:35.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.763+0000 7fa0a3417640 1 --2- 172.21.15.59:0/430711672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa09c102dc0 0x7fa09c1992c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa09800d950 tx=0x7fa09800de10 comp rx=0 tx=0).stop 2024-09-10T21:13:35.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.763+0000 7fa0a3417640 1 -- 172.21.15.59:0/430711672 shutdown_connections 2024-09-10T21:13:35.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.763+0000 7fa0a3417640 1 --2- 172.21.15.59:0/430711672 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa0880b53f0 0x7fa0880b78b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:35.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.763+0000 7fa0a3417640 1 --2- 172.21.15.59:0/430711672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa09c109150 0x7fa09c19eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:35.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.763+0000 7fa0a3417640 1 --2- 172.21.15.59:0/430711672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa09c1087d0 0x7fa09c199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:35.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.763+0000 7fa0a3417640 1 --2- 172.21.15.59:0/430711672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa09c102dc0 0x7fa09c1992c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:35.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.763+0000 7fa0a3417640 1 -- 172.21.15.59:0/430711672 >> 172.21.15.59:0/430711672 conn(0x7fa09c0fe830 msgr2=0x7fa09c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:35.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.763+0000 7fa0a3417640 1 -- 172.21.15.59:0/430711672 shutdown_connections 2024-09-10T21:13:35.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:35.763+0000 7fa0a3417640 1 -- 172.21.15.59:0/430711672 wait complete. 2024-09-10T21:13:36.319 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:35 smithi059 ceph-mon[30888]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:13:36.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:35 smithi192 ceph-mon[35363]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:13:36.347 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-10T21:13:36.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:35 smithi154 ceph-mon[35041]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:13:36.603 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:37.014 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:36 smithi059 ceph-mon[30888]: pgmap v288: 97 pgs: 97 active+clean; 584 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 4.2 KiB/s wr, 17 op/s 2024-09-10T21:13:37.015 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:36 smithi059 ceph-mon[30888]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:13:37.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.098+0000 7f70f2827640 1 -- 172.21.15.59:0/938060220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70ec103ce0 msgr2=0x7f70ec1040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:37.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.098+0000 7f70f2827640 1 --2- 172.21.15.59:0/938060220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70ec103ce0 0x7f70ec1040c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009900 tx=0x7f70dc02a410 comp rx=0 tx=0).stop 2024-09-10T21:13:37.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.098+0000 7f70f2827640 1 -- 172.21.15.59:0/938060220 shutdown_connections 2024-09-10T21:13:37.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.098+0000 7f70f2827640 1 --2- 172.21.15.59:0/938060220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70ec10d140 0x7f70ec10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:37.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.098+0000 7f70f2827640 1 --2- 172.21.15.59:0/938060220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70ec104600 0x7f70ec10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:37.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.098+0000 7f70f2827640 1 --2- 172.21.15.59:0/938060220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70ec103ce0 0x7f70ec1040c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:37.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.098+0000 7f70f2827640 1 -- 172.21.15.59:0/938060220 >> 172.21.15.59:0/938060220 conn(0x7f70ec0fd720 msgr2=0x7f70ec0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:37.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.098+0000 7f70f2827640 1 -- 172.21.15.59:0/938060220 shutdown_connections 2024-09-10T21:13:37.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.098+0000 7f70f2827640 1 -- 172.21.15.59:0/938060220 wait complete. 2024-09-10T21:13:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.098+0000 7f70f2827640 1 Processor -- start 2024-09-10T21:13:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.098+0000 7f70f2827640 1 -- start start 2024-09-10T21:13:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70f2827640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70ec103ce0 0x7f70ec199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70f2827640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70ec104600 0x7f70ec1998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70f2827640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70ec10d140 0x7f70ec19ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70f2827640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec112e10 con 0x7f70ec10d140 2024-09-10T21:13:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70f2827640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec112c90 con 0x7f70ec104600 2024-09-10T21:13:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70f2827640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec112f90 con 0x7f70ec103ce0 2024-09-10T21:13:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70f0dc4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70ec10d140 0x7f70ec19ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70f0dc4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70ec10d140 0x7f70ec19ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36570/0 (socket says 172.21.15.59:36570) 2024-09-10T21:13:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70f0dc4640 1 -- 172.21.15.59:0/1315494545 learned_addr learned my addr 172.21.15.59:0/1315494545 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70ebfff640 1 --2- 172.21.15.59:0/1315494545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70ec103ce0 0x7f70ec199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:37.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70eb7fe640 1 --2- 172.21.15.59:0/1315494545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70ec104600 0x7f70ec1998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:37.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70f0dc4640 1 -- 172.21.15.59:0/1315494545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70ec103ce0 msgr2=0x7f70ec199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:37.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70f0dc4640 1 --2- 172.21.15.59:0/1315494545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70ec103ce0 0x7f70ec199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:37.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70f0dc4640 1 -- 172.21.15.59:0/1315494545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70ec104600 msgr2=0x7f70ec1998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:37.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70f0dc4640 1 --2- 172.21.15.59:0/1315494545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70ec104600 0x7f70ec1998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:37.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70f0dc4640 1 -- 172.21.15.59:0/1315494545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ec19f410 con 0x7f70ec10d140 2024-09-10T21:13:37.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70f0dc4640 1 --2- 172.21.15.59:0/1315494545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70ec10d140 0x7f70ec19ec40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f70e400cce0 tx=0x7f70e400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:37.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70e97fa640 1 -- 172.21.15.59:0/1315494545 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e400f450 con 0x7f70ec10d140 2024-09-10T21:13:37.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70e97fa640 1 -- 172.21.15.59:0/1315494545 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70e400faa0 con 0x7f70ec10d140 2024-09-10T21:13:37.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.099+0000 7f70f2827640 1 -- 172.21.15.59:0/1315494545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ec19f700 con 0x7f70ec10d140 2024-09-10T21:13:37.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.100+0000 7f70e97fa640 1 -- 172.21.15.59:0/1315494545 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e4018b70 con 0x7f70ec10d140 2024-09-10T21:13:37.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.100+0000 7f70f2827640 1 -- 172.21.15.59:0/1315494545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ec1a5dc0 con 0x7f70ec10d140 2024-09-10T21:13:37.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.101+0000 7f70f2827640 1 -- 172.21.15.59:0/1315494545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70ec1040c0 con 0x7f70ec10d140 2024-09-10T21:13:37.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.102+0000 7f70e97fa640 1 -- 172.21.15.59:0/1315494545 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f70e400f5f0 con 0x7f70ec10d140 2024-09-10T21:13:37.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.103+0000 7f70e97fa640 1 --2- 172.21.15.59:0/1315494545 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f70d40b53f0 0x7f70d40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:37.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.103+0000 7f70ebfff640 1 --2- 172.21.15.59:0/1315494545 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f70d40b53f0 0x7f70d40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:37.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.103+0000 7f70e97fa640 1 -- 172.21.15.59:0/1315494545 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f70e40e63c0 con 0x7f70ec10d140 2024-09-10T21:13:37.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.103+0000 7f70ebfff640 1 --2- 172.21.15.59:0/1315494545 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f70d40b53f0 0x7f70d40b78b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f70dc031440 tx=0x7f70dc005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:37.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.107+0000 7f70e97fa640 1 -- 172.21.15.59:0/1315494545 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f70e4014030 con 0x7f70ec10d140 2024-09-10T21:13:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.319+0000 7f70f2827640 1 -- 172.21.15.59:0/1315494545 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f70ec1081d0 con 0x7f70d40b53f0 2024-09-10T21:13:37.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:36 smithi192 ceph-mon[35363]: pgmap v288: 97 pgs: 97 active+clean; 584 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 4.2 KiB/s wr, 17 op/s 2024-09-10T21:13:37.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:36 smithi192 ceph-mon[35363]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:13:37.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.345+0000 7f70e97fa640 1 -- 172.21.15.59:0/1315494545 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f70dc0314a0 con 0x7f70d40b53f0 2024-09-10T21:13:37.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.347+0000 7f70f2827640 1 -- 172.21.15.59:0/1315494545 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f70d40b53f0 msgr2=0x7f70d40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:37.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.347+0000 7f70f2827640 1 --2- 172.21.15.59:0/1315494545 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f70d40b53f0 0x7f70d40b78b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f70dc031440 tx=0x7f70dc005e80 comp rx=0 tx=0).stop 2024-09-10T21:13:37.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.347+0000 7f70f2827640 1 -- 172.21.15.59:0/1315494545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70ec10d140 msgr2=0x7f70ec19ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.347+0000 7f70f2827640 1 --2- 172.21.15.59:0/1315494545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70ec10d140 0x7f70ec19ec40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f70e400cce0 tx=0x7f70e400a620 comp rx=0 tx=0).stop 2024-09-10T21:13:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.347+0000 7f70f2827640 1 -- 172.21.15.59:0/1315494545 shutdown_connections 2024-09-10T21:13:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.347+0000 7f70f2827640 1 --2- 172.21.15.59:0/1315494545 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f70d40b53f0 0x7f70d40b78b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.347+0000 7f70f2827640 1 --2- 172.21.15.59:0/1315494545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70ec10d140 0x7f70ec19ec40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.347+0000 7f70f2827640 1 --2- 172.21.15.59:0/1315494545 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70ec104600 0x7f70ec1998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.347+0000 7f70f2827640 1 --2- 172.21.15.59:0/1315494545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70ec103ce0 0x7f70ec199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:37.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.347+0000 7f70f2827640 1 -- 172.21.15.59:0/1315494545 >> 172.21.15.59:0/1315494545 conn(0x7f70ec0fd720 msgr2=0x7f70ec0fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:37.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.347+0000 7f70f2827640 1 -- 172.21.15.59:0/1315494545 shutdown_connections 2024-09-10T21:13:37.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:37.347+0000 7f70f2827640 1 -- 172.21.15.59:0/1315494545 wait complete. 2024-09-10T21:13:37.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:36 smithi154 ceph-mon[35041]: pgmap v288: 97 pgs: 97 active+clean; 584 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 4.2 KiB/s wr, 17 op/s 2024-09-10T21:13:37.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:36 smithi154 ceph-mon[35041]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:13:38.011 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-10T21:13:38.269 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.684+0000 7fd2c30da640 1 -- 172.21.15.59:0/1993479264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc109150 msgr2=0x7fd2bc10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.684+0000 7fd2c30da640 1 --2- 172.21.15.59:0/1993479264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc109150 0x7fd2bc10f950 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4009ca0 tx=0x7fd2b402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:13:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.684+0000 7fd2c30da640 1 -- 172.21.15.59:0/1993479264 shutdown_connections 2024-09-10T21:13:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.684+0000 7fd2c30da640 1 --2- 172.21.15.59:0/1993479264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc109150 0x7fd2bc10f950 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.684+0000 7fd2c30da640 1 --2- 172.21.15.59:0/1993479264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2bc1087d0 0x7fd2bc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.684+0000 7fd2c30da640 1 --2- 172.21.15.59:0/1993479264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2bc102dc0 0x7fd2bc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:38.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.684+0000 7fd2c30da640 1 -- 172.21.15.59:0/1993479264 >> 172.21.15.59:0/1993479264 conn(0x7fd2bc0fe830 msgr2=0x7fd2bc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.684+0000 7fd2c30da640 1 -- 172.21.15.59:0/1993479264 shutdown_connections 2024-09-10T21:13:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.684+0000 7fd2c30da640 1 -- 172.21.15.59:0/1993479264 wait complete. 2024-09-10T21:13:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.685+0000 7fd2c30da640 1 Processor -- start 2024-09-10T21:13:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.685+0000 7fd2c30da640 1 -- start start 2024-09-10T21:13:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.685+0000 7fd2c30da640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2bc102dc0 0x7fd2bc0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.685+0000 7fd2c30da640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2bc1087d0 0x7fd2bc0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.685+0000 7fd2c30da640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc109150 0x7fd2bc075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.685+0000 7fd2c30da640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc112ea0 con 0x7fd2bc109150 2024-09-10T21:13:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.685+0000 7fd2c30da640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc112d20 con 0x7fd2bc102dc0 2024-09-10T21:13:38.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.685+0000 7fd2c30da640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc113020 con 0x7fd2bc1087d0 2024-09-10T21:13:38.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.685+0000 7fd2c1677640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc109150 0x7fd2bc075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.685+0000 7fd2c1677640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc109150 0x7fd2bc075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36582/0 (socket says 172.21.15.59:36582) 2024-09-10T21:13:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.685+0000 7fd2c1677640 1 -- 172.21.15.59:0/2212350044 learned_addr learned my addr 172.21.15.59:0/2212350044 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.686+0000 7fd2bbfff640 1 --2- 172.21.15.59:0/2212350044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2bc1087d0 0x7fd2bc0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.686+0000 7fd2c0e76640 1 --2- 172.21.15.59:0/2212350044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2bc102dc0 0x7fd2bc0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.686+0000 7fd2c1677640 1 -- 172.21.15.59:0/2212350044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2bc1087d0 msgr2=0x7fd2bc0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.686+0000 7fd2c1677640 1 --2- 172.21.15.59:0/2212350044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2bc1087d0 0x7fd2bc0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.686+0000 7fd2c1677640 1 -- 172.21.15.59:0/2212350044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2bc102dc0 msgr2=0x7fd2bc0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.686+0000 7fd2c1677640 1 --2- 172.21.15.59:0/2212350044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2bc102dc0 0x7fd2bc0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.686+0000 7fd2c1677640 1 -- 172.21.15.59:0/2212350044 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2bc1a7880 con 0x7fd2bc109150 2024-09-10T21:13:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.686+0000 7fd2c0e76640 1 --2- 172.21.15.59:0/2212350044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2bc102dc0 0x7fd2bc0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:13:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.686+0000 7fd2c1677640 1 --2- 172.21.15.59:0/2212350044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc109150 0x7fd2bc075f20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4031a20 tx=0x7fd2b4031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.686+0000 7fd2b9ffb640 1 -- 172.21.15.59:0/2212350044 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b4003d30 con 0x7fd2bc109150 2024-09-10T21:13:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.686+0000 7fd2b9ffb640 1 -- 172.21.15.59:0/2212350044 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2b40044f0 con 0x7fd2bc109150 2024-09-10T21:13:38.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.686+0000 7fd2c30da640 1 -- 172.21.15.59:0/2212350044 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2bc1a7b10 con 0x7fd2bc109150 2024-09-10T21:13:38.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.686+0000 7fd2b9ffb640 1 -- 172.21.15.59:0/2212350044 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b402fd90 con 0x7fd2bc109150 2024-09-10T21:13:38.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.686+0000 7fd2c30da640 1 -- 172.21.15.59:0/2212350044 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2bc1a80a0 con 0x7fd2bc109150 2024-09-10T21:13:38.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.687+0000 7fd2c30da640 1 -- 172.21.15.59:0/2212350044 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2bc103220 con 0x7fd2bc109150 2024-09-10T21:13:38.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.689+0000 7fd2b9ffb640 1 -- 172.21.15.59:0/2212350044 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fd2b4004040 con 0x7fd2bc109150 2024-09-10T21:13:38.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.689+0000 7fd2b9ffb640 1 --2- 172.21.15.59:0/2212350044 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2ac0b53f0 0x7fd2ac0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:38.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.690+0000 7fd2c0e76640 1 --2- 172.21.15.59:0/2212350044 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2ac0b53f0 0x7fd2ac0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:38.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.690+0000 7fd2b9ffb640 1 -- 172.21.15.59:0/2212350044 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fd2b4107010 con 0x7fd2bc109150 2024-09-10T21:13:38.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.690+0000 7fd2c0e76640 1 --2- 172.21.15.59:0/2212350044 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2ac0b53f0 0x7fd2ac0b78b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0006fd0 tx=0x7fd2b0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:38.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.694+0000 7fd2b9ffb640 1 -- 172.21.15.59:0/2212350044 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd2b40cdfb0 con 0x7fd2bc109150 2024-09-10T21:13:38.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.911+0000 7fd2c30da640 1 -- 172.21.15.59:0/2212350044 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fd2bc063590 con 0x7fd2ac0b53f0 2024-09-10T21:13:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.917+0000 7fd2b9ffb640 1 -- 172.21.15.59:0/2212350044 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fd2bc063590 con 0x7fd2ac0b53f0 2024-09-10T21:13:38.921 INFO:teuthology.orchestra.run.smithi059.stdout:/volumes/qa/sv_1/4283cf76-93d2-406f-aa44-8c41ee73380a 2024-09-10T21:13:38.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.919+0000 7fd2c30da640 1 -- 172.21.15.59:0/2212350044 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2ac0b53f0 msgr2=0x7fd2ac0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:38.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.919+0000 7fd2c30da640 1 --2- 172.21.15.59:0/2212350044 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2ac0b53f0 0x7fd2ac0b78b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0006fd0 tx=0x7fd2b0008040 comp rx=0 tx=0).stop 2024-09-10T21:13:38.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.919+0000 7fd2c30da640 1 -- 172.21.15.59:0/2212350044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc109150 msgr2=0x7fd2bc075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:38.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.919+0000 7fd2c30da640 1 --2- 172.21.15.59:0/2212350044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc109150 0x7fd2bc075f20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4031a20 tx=0x7fd2b4031a50 comp rx=0 tx=0).stop 2024-09-10T21:13:38.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.919+0000 7fd2c30da640 1 -- 172.21.15.59:0/2212350044 shutdown_connections 2024-09-10T21:13:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.919+0000 7fd2c30da640 1 --2- 172.21.15.59:0/2212350044 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2ac0b53f0 0x7fd2ac0b78b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.919+0000 7fd2c30da640 1 --2- 172.21.15.59:0/2212350044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2bc109150 0x7fd2bc075f20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.919+0000 7fd2c30da640 1 --2- 172.21.15.59:0/2212350044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2bc1087d0 0x7fd2bc0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.919+0000 7fd2c30da640 1 --2- 172.21.15.59:0/2212350044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2bc102dc0 0x7fd2bc0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.919+0000 7fd2c30da640 1 -- 172.21.15.59:0/2212350044 >> 172.21.15.59:0/2212350044 conn(0x7fd2bc0fe830 msgr2=0x7fd2bc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.919+0000 7fd2c30da640 1 -- 172.21.15.59:0/2212350044 shutdown_connections 2024-09-10T21:13:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:38.919+0000 7fd2c30da640 1 -- 172.21.15.59:0/2212350044 wait complete. 2024-09-10T21:13:39.238 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:38 smithi059 ceph-mon[30888]: pgmap v289: 97 pgs: 97 active+clean; 609 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.4 KiB/s wr, 20 op/s 2024-09-10T21:13:39.239 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:38 smithi059 ceph-mon[30888]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:13:39.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:38 smithi192 ceph-mon[35363]: pgmap v289: 97 pgs: 97 active+clean; 609 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.4 KiB/s wr, 20 op/s 2024-09-10T21:13:39.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:38 smithi192 ceph-mon[35363]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:13:39.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:38 smithi154 ceph-mon[35041]: pgmap v289: 97 pgs: 97 active+clean; 609 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 6.4 KiB/s wr, 20 op/s 2024-09-10T21:13:39.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:38 smithi154 ceph-mon[35041]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:13:39.606 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:13:39.868 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:40.251 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:39 smithi059 ceph-mon[30888]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:13:40.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:39 smithi192 ceph-mon[35363]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:13:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.328+0000 7fa056b9c640 1 -- 172.21.15.59:0/2283268692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0501087d0 msgr2=0x7fa050108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:40.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.328+0000 7fa056b9c640 1 --2- 172.21.15.59:0/2283268692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0501087d0 0x7fa050108c10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa044009900 tx=0x7fa04402a410 comp rx=0 tx=0).stop 2024-09-10T21:13:40.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.328+0000 7fa056b9c640 1 -- 172.21.15.59:0/2283268692 shutdown_connections 2024-09-10T21:13:40.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.328+0000 7fa056b9c640 1 --2- 172.21.15.59:0/2283268692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa050109150 0x7fa05010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:40.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.328+0000 7fa056b9c640 1 --2- 172.21.15.59:0/2283268692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0501087d0 0x7fa050108c10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:40.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.328+0000 7fa056b9c640 1 --2- 172.21.15.59:0/2283268692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa050102dc0 0x7fa0501031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:40.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.328+0000 7fa056b9c640 1 -- 172.21.15.59:0/2283268692 >> 172.21.15.59:0/2283268692 conn(0x7fa0500fe830 msgr2=0x7fa050100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:40.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.328+0000 7fa056b9c640 1 -- 172.21.15.59:0/2283268692 shutdown_connections 2024-09-10T21:13:40.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.328+0000 7fa056b9c640 1 -- 172.21.15.59:0/2283268692 wait complete. 2024-09-10T21:13:40.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.329+0000 7fa056b9c640 1 Processor -- start 2024-09-10T21:13:40.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.329+0000 7fa056b9c640 1 -- start start 2024-09-10T21:13:40.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.329+0000 7fa056b9c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa050102dc0 0x7fa050199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:40.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.329+0000 7fa056b9c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0501087d0 0x7fa050199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:40.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.329+0000 7fa056b9c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa050109150 0x7fa05019ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:40.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.329+0000 7fa056b9c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa050112e10 con 0x7fa050102dc0 2024-09-10T21:13:40.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.329+0000 7fa056b9c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa050112c90 con 0x7fa0501087d0 2024-09-10T21:13:40.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.329+0000 7fa056b9c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa050112f90 con 0x7fa050109150 2024-09-10T21:13:40.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.329+0000 7fa054938640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa050102dc0 0x7fa050199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:40.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.329+0000 7fa054938640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa050102dc0 0x7fa050199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36552/0 (socket says 172.21.15.59:36552) 2024-09-10T21:13:40.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.329+0000 7fa054938640 1 -- 172.21.15.59:0/831623425 learned_addr learned my addr 172.21.15.59:0/831623425 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:40.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.330+0000 7fa055139640 1 --2- 172.21.15.59:0/831623425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa050109150 0x7fa05019ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:40.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.330+0000 7fa054938640 1 -- 172.21.15.59:0/831623425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa050109150 msgr2=0x7fa05019ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:40.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.330+0000 7fa04ffff640 1 --2- 172.21.15.59:0/831623425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0501087d0 0x7fa050199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:40.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.330+0000 7fa054938640 1 --2- 172.21.15.59:0/831623425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa050109150 0x7fa05019ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:40.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.330+0000 7fa054938640 1 -- 172.21.15.59:0/831623425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0501087d0 msgr2=0x7fa050199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:40.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.330+0000 7fa054938640 1 --2- 172.21.15.59:0/831623425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0501087d0 0x7fa050199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:40.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.330+0000 7fa054938640 1 -- 172.21.15.59:0/831623425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05019f3d0 con 0x7fa050102dc0 2024-09-10T21:13:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.330+0000 7fa055139640 1 --2- 172.21.15.59:0/831623425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa050109150 0x7fa05019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:13:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.330+0000 7fa054938640 1 --2- 172.21.15.59:0/831623425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa050102dc0 0x7fa050199320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa04000c890 tx=0x7fa04000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.330+0000 7fa04dffb640 1 -- 172.21.15.59:0/831623425 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa040004220 con 0x7fa050102dc0 2024-09-10T21:13:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.330+0000 7fa056b9c640 1 -- 172.21.15.59:0/831623425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa05019f6c0 con 0x7fa050102dc0 2024-09-10T21:13:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.330+0000 7fa04dffb640 1 -- 172.21.15.59:0/831623425 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0400043c0 con 0x7fa050102dc0 2024-09-10T21:13:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.330+0000 7fa04dffb640 1 -- 172.21.15.59:0/831623425 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa040004a00 con 0x7fa050102dc0 2024-09-10T21:13:40.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.330+0000 7fa056b9c640 1 -- 172.21.15.59:0/831623425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0501a5e00 con 0x7fa050102dc0 2024-09-10T21:13:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.331+0000 7fa056b9c640 1 -- 172.21.15.59:0/831623425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0501031a0 con 0x7fa050102dc0 2024-09-10T21:13:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.333+0000 7fa04dffb640 1 -- 172.21.15.59:0/831623425 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fa0400079b0 con 0x7fa050102dc0 2024-09-10T21:13:40.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.333+0000 7fa04dffb640 1 --2- 172.21.15.59:0/831623425 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa0380b5370 0x7fa0380b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:40.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.333+0000 7fa04ffff640 1 --2- 172.21.15.59:0/831623425 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa0380b5370 0x7fa0380b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:40.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.333+0000 7fa04dffb640 1 -- 172.21.15.59:0/831623425 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fa0400e5dd0 con 0x7fa050102dc0 2024-09-10T21:13:40.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.334+0000 7fa04ffff640 1 --2- 172.21.15.59:0/831623425 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa0380b5370 0x7fa0380b7830 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa044006010 tx=0x7fa044000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:40.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.336+0000 7fa04dffb640 1 -- 172.21.15.59:0/831623425 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa040014030 con 0x7fa050102dc0 2024-09-10T21:13:40.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:39 smithi154 ceph-mon[35041]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:13:40.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.557+0000 7fa056b9c640 1 -- 172.21.15.59:0/831623425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa05002e5c0 con 0x7fa050102dc0 2024-09-10T21:13:40.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.558+0000 7fa04dffb640 1 -- 172.21.15.59:0/831623425 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7fa0400acce0 con 0x7fa050102dc0 2024-09-10T21:13:40.562 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:13:40.562 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":27,"btime":"2024-09-10T21:13:30:946868+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:13:30.946837+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24563,24550,24538,24542,24529]},"id":1}]} 2024-09-10T21:13:40.562 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 27 2024-09-10T21:13:40.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.560+0000 7fa056b9c640 1 -- 172.21.15.59:0/831623425 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa0380b5370 msgr2=0x7fa0380b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:40.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.560+0000 7fa056b9c640 1 --2- 172.21.15.59:0/831623425 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa0380b5370 0x7fa0380b7830 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa044006010 tx=0x7fa044000bc0 comp rx=0 tx=0).stop 2024-09-10T21:13:40.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.560+0000 7fa056b9c640 1 -- 172.21.15.59:0/831623425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa050102dc0 msgr2=0x7fa050199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:40.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.560+0000 7fa056b9c640 1 --2- 172.21.15.59:0/831623425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa050102dc0 0x7fa050199320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa04000c890 tx=0x7fa04000cd50 comp rx=0 tx=0).stop 2024-09-10T21:13:40.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.560+0000 7fa056b9c640 1 -- 172.21.15.59:0/831623425 shutdown_connections 2024-09-10T21:13:40.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.560+0000 7fa056b9c640 1 --2- 172.21.15.59:0/831623425 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa0380b5370 0x7fa0380b7830 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:40.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.560+0000 7fa056b9c640 1 --2- 172.21.15.59:0/831623425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa050109150 0x7fa05019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:40.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.560+0000 7fa056b9c640 1 --2- 172.21.15.59:0/831623425 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0501087d0 0x7fa050199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:40.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.560+0000 7fa056b9c640 1 --2- 172.21.15.59:0/831623425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa050102dc0 0x7fa050199320 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:40.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.560+0000 7fa056b9c640 1 -- 172.21.15.59:0/831623425 >> 172.21.15.59:0/831623425 conn(0x7fa0500fe830 msgr2=0x7fa050100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:40.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.560+0000 7fa056b9c640 1 -- 172.21.15.59:0/831623425 shutdown_connections 2024-09-10T21:13:40.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:40.561+0000 7fa056b9c640 1 -- 172.21.15.59:0/831623425 wait complete. 2024-09-10T21:13:41.290 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:40 smithi059 ceph-mon[30888]: pgmap v290: 97 pgs: 97 active+clean; 610 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.2 KiB/s wr, 21 op/s 2024-09-10T21:13:41.290 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:40 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/831623425' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:13:41.322 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:13:41.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:40 smithi192 ceph-mon[35363]: pgmap v290: 97 pgs: 97 active+clean; 610 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.2 KiB/s wr, 21 op/s 2024-09-10T21:13:41.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:40 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/831623425' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:13:41.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:40 smithi154 ceph-mon[35041]: pgmap v290: 97 pgs: 97 active+clean; 610 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.2 KiB/s wr, 21 op/s 2024-09-10T21:13:41.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:40 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/831623425' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:13:41.581 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:41.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.989+0000 7f4292215640 1 -- 172.21.15.59:0/3240315509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c1087d0 msgr2=0x7f428c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:41.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.989+0000 7f4292215640 1 --2- 172.21.15.59:0/3240315509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c1087d0 0x7f428c108c10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4280009900 tx=0x7f428002a410 comp rx=0 tx=0).stop 2024-09-10T21:13:41.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.989+0000 7f4292215640 1 -- 172.21.15.59:0/3240315509 shutdown_connections 2024-09-10T21:13:41.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.989+0000 7f4292215640 1 --2- 172.21.15.59:0/3240315509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f428c109150 0x7f428c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.989+0000 7f4292215640 1 --2- 172.21.15.59:0/3240315509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c1087d0 0x7f428c108c10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.989+0000 7f4292215640 1 --2- 172.21.15.59:0/3240315509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f428c102dc0 0x7f428c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.989+0000 7f4292215640 1 -- 172.21.15.59:0/3240315509 >> 172.21.15.59:0/3240315509 conn(0x7f428c0fe830 msgr2=0x7f428c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.989+0000 7f4292215640 1 -- 172.21.15.59:0/3240315509 shutdown_connections 2024-09-10T21:13:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.989+0000 7f4292215640 1 -- 172.21.15.59:0/3240315509 wait complete. 2024-09-10T21:13:41.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.990+0000 7f4292215640 1 Processor -- start 2024-09-10T21:13:41.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.990+0000 7f4292215640 1 -- start start 2024-09-10T21:13:41.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.990+0000 7f4292215640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c102dc0 0x7f428c199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:41.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.990+0000 7f4292215640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f428c1087d0 0x7f428c1997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:41.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.990+0000 7f4292215640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f428c109150 0x7f428c19eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:41.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.990+0000 7f4292215640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f428c112da0 con 0x7f428c102dc0 2024-09-10T21:13:41.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.990+0000 7f4292215640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f428c112c20 con 0x7f428c109150 2024-09-10T21:13:41.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.990+0000 7f4292215640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f428c112f20 con 0x7f428c1087d0 2024-09-10T21:13:41.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.990+0000 7f428b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c102dc0 0x7f428c199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.990+0000 7f428b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c102dc0 0x7f428c199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36572/0 (socket says 172.21.15.59:36572) 2024-09-10T21:13:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.990+0000 7f428b7fe640 1 -- 172.21.15.59:0/4085095518 learned_addr learned my addr 172.21.15.59:0/4085095518 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.990+0000 7f428bfff640 1 --2- 172.21.15.59:0/4085095518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f428c109150 0x7f428c19eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.991+0000 7f428affd640 1 --2- 172.21.15.59:0/4085095518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f428c1087d0 0x7f428c1997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.991+0000 7f428b7fe640 1 -- 172.21.15.59:0/4085095518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f428c1087d0 msgr2=0x7f428c1997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.991+0000 7f428b7fe640 1 --2- 172.21.15.59:0/4085095518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f428c1087d0 0x7f428c1997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.991+0000 7f428b7fe640 1 -- 172.21.15.59:0/4085095518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f428c109150 msgr2=0x7f428c19eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.991+0000 7f428b7fe640 1 --2- 172.21.15.59:0/4085095518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f428c109150 0x7f428c19eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.991+0000 7f428b7fe640 1 -- 172.21.15.59:0/4085095518 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428c19f320 con 0x7f428c102dc0 2024-09-10T21:13:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.991+0000 7f428b7fe640 1 --2- 172.21.15.59:0/4085095518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c102dc0 0x7f428c199270 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f427c00d950 tx=0x7f427c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.991+0000 7f4288ff9640 1 -- 172.21.15.59:0/4085095518 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c017070 con 0x7f428c102dc0 2024-09-10T21:13:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.991+0000 7f4288ff9640 1 -- 172.21.15.59:0/4085095518 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f427c009c30 con 0x7f428c102dc0 2024-09-10T21:13:41.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.991+0000 7f4292215640 1 -- 172.21.15.59:0/4085095518 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f428c19f610 con 0x7f428c102dc0 2024-09-10T21:13:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.991+0000 7f4288ff9640 1 -- 172.21.15.59:0/4085095518 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c00f620 con 0x7f428c102dc0 2024-09-10T21:13:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.991+0000 7f4292215640 1 -- 172.21.15.59:0/4085095518 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f428c1a5ea0 con 0x7f428c102dc0 2024-09-10T21:13:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.992+0000 7f4292215640 1 -- 172.21.15.59:0/4085095518 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f428c104070 con 0x7f428c102dc0 2024-09-10T21:13:41.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.993+0000 7f4288ff9640 1 -- 172.21.15.59:0/4085095518 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f427c005030 con 0x7f428c102dc0 2024-09-10T21:13:42.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.994+0000 7f4288ff9640 1 --2- 172.21.15.59:0/4085095518 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f42740b53f0 0x7f42740b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:42.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.994+0000 7f428affd640 1 --2- 172.21.15.59:0/4085095518 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f42740b53f0 0x7f42740b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:42.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.994+0000 7f4288ff9640 1 -- 172.21.15.59:0/4085095518 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f427c0e5800 con 0x7f428c102dc0 2024-09-10T21:13:42.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.995+0000 7f428affd640 1 --2- 172.21.15.59:0/4085095518 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f42740b53f0 0x7f42740b78b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4280031440 tx=0x7f42800095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:42.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:41.997+0000 7f4288ff9640 1 -- 172.21.15.59:0/4085095518 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f427c0ac790 con 0x7f428c102dc0 2024-09-10T21:13:42.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:42.183+0000 7f4292215640 1 -- 172.21.15.59:0/4085095518 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f428c10af30 con 0x7f428c102dc0 2024-09-10T21:13:42.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:42.184+0000 7f4288ff9640 1 -- 172.21.15.59:0/4085095518 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22304 (secure 0 0 0) 0x7f427c009de0 con 0x7f428c102dc0 2024-09-10T21:13:42.189 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:13:42.189 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":73,"fsid":"3c26b952-6fb8-11ef-bcea-c7b262605968","created":"2024-09-10T21:05:18.196881+0000","modified":"2024-09-10T21:13:19.283891+0000","last_up_change":"2024-09-10T21:12:31.909004+0000","last_in_change":"2024-09-10T21:12:08.116727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:08:47.611285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:13:15.562661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:13:17.272280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e88abf3-8592-4b5f-8ba9-5969e01e12d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6803","nonce":1237328951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6805","nonce":1237328951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6809","nonce":1237328951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6807","nonce":1237328951}]},"public_addr":"172.21.15.59:6803/1237328951","cluster_addr":"172.21.15.59:6805/1237328951","heartbeat_back_addr":"172.21.15.59:6809/1237328951","heartbeat_front_addr":"172.21.15.59:6807/1237328951","state":["exists","up"]},{"osd":1,"uuid":"7908eefd-bbfa-4fe4-9db9-7a92d0e77acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6801","nonce":3376412264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6803","nonce":3376412264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6807","nonce":3376412264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6805","nonce":3376412264}]},"public_addr":"172.21.15.154:6801/3376412264","cluster_addr":"172.21.15.154:6803/3376412264","heartbeat_back_addr":"172.21.15.154:6807/3376412264","heartbeat_front_addr":"172.21.15.154:6805/3376412264","state":["exists","up"]},{"osd":2,"uuid":"2351b9f0-bca1-48b2-afb8-0e2b7856c52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6801","nonce":440750253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6803","nonce":440750253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6807","nonce":440750253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6805","nonce":440750253}]},"public_addr":"172.21.15.192:6801/440750253","cluster_addr":"172.21.15.192:6803/440750253","heartbeat_back_addr":"172.21.15.192:6807/440750253","heartbeat_front_addr":"172.21.15.192:6805/440750253","state":["exists","up"]},{"osd":3,"uuid":"f26969d1-7b48-4f20-9077-c55c59775ed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6811","nonce":1483798393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6813","nonce":1483798393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6817","nonce":1483798393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6815","nonce":1483798393}]},"public_addr":"172.21.15.59:6811/1483798393","cluster_addr":"172.21.15.59:6813/1483798393","heartbeat_back_addr":"172.21.15.59:6817/1483798393","heartbeat_front_addr":"172.21.15.59:6815/1483798393","state":["exists","up"]},{"osd":4,"uuid":"21e1a472-1ae1-454b-aee5-2ad92f6eff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6809","nonce":1817188525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6811","nonce":1817188525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6815","nonce":1817188525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6813","nonce":1817188525}]},"public_addr":"172.21.15.154:6809/1817188525","cluster_addr":"172.21.15.154:6811/1817188525","heartbeat_back_addr":"172.21.15.154:6815/1817188525","heartbeat_front_addr":"172.21.15.154:6813/1817188525","state":["exists","up"]},{"osd":5,"uuid":"6191b10a-5cbd-4225-b0ec-70d05023d5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6809","nonce":1221386274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6811","nonce":1221386274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6815","nonce":1221386274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6813","nonce":1221386274}]},"public_addr":"172.21.15.192:6809/1221386274","cluster_addr":"172.21.15.192:6811/1221386274","heartbeat_back_addr":"172.21.15.192:6815/1221386274","heartbeat_front_addr":"172.21.15.192:6813/1221386274","state":["exists","up"]},{"osd":6,"uuid":"609c11f7-ce82-4714-bf73-a4f16f4483ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6819","nonce":3006857566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6821","nonce":3006857566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6825","nonce":3006857566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6823","nonce":3006857566}]},"public_addr":"172.21.15.59:6819/3006857566","cluster_addr":"172.21.15.59:6821/3006857566","heartbeat_back_addr":"172.21.15.59:6825/3006857566","heartbeat_front_addr":"172.21.15.59:6823/3006857566","state":["exists","up"]},{"osd":7,"uuid":"bff3a29f-47cc-4e66-92e4-14e9b7faf498","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6817","nonce":175260385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6819","nonce":175260385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6823","nonce":175260385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6821","nonce":175260385}]},"public_addr":"172.21.15.154:6817/175260385","cluster_addr":"172.21.15.154:6819/175260385","heartbeat_back_addr":"172.21.15.154:6823/175260385","heartbeat_front_addr":"172.21.15.154:6821/175260385","state":["exists","up"]},{"osd":8,"uuid":"56dabafd-9bb9-409a-88cd-4b5b5ecf810a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6817","nonce":3138189462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6819","nonce":3138189462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6823","nonce":3138189462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6821","nonce":3138189462}]},"public_addr":"172.21.15.192:6817/3138189462","cluster_addr":"172.21.15.192:6819/3138189462","heartbeat_back_addr":"172.21.15.192:6823/3138189462","heartbeat_front_addr":"172.21.15.192:6821/3138189462","state":["exists","up"]},{"osd":9,"uuid":"044f934d-3df5-47aa-85f5-c3b63b267ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6827","nonce":2446500753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6829","nonce":2446500753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6833","nonce":2446500753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6831","nonce":2446500753}]},"public_addr":"172.21.15.59:6827/2446500753","cluster_addr":"172.21.15.59:6829/2446500753","heartbeat_back_addr":"172.21.15.59:6833/2446500753","heartbeat_front_addr":"172.21.15.59:6831/2446500753","state":["exists","up"]},{"osd":10,"uuid":"8d3b735b-e4fe-4a8e-8c75-a49313c6fabb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6825","nonce":1139781446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6827","nonce":1139781446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6831","nonce":1139781446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6829","nonce":1139781446}]},"public_addr":"172.21.15.154:6825/1139781446","cluster_addr":"172.21.15.154:6827/1139781446","heartbeat_back_addr":"172.21.15.154:6831/1139781446","heartbeat_front_addr":"172.21.15.154:6829/1139781446","state":["exists","up"]},{"osd":11,"uuid":"fd6a6d06-c6aa-42e3-aa38-fc583319f6bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6825","nonce":1041494458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6827","nonce":1041494458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6831","nonce":1041494458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6829","nonce":1041494458}]},"public_addr":"172.21.15.192:6825/1041494458","cluster_addr":"172.21.15.192:6827/1041494458","heartbeat_back_addr":"172.21.15.192:6831/1041494458","heartbeat_front_addr":"172.21.15.192:6829/1041494458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:07:53.974382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:19.552358+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:44.251670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:09.430992+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:34.043343+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:59.903679+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:25.733171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:49.795257+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:14.485648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:40.485165+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:04.655475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:29.308456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/212243638":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/3305207692":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6801/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/2965147556":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/1174570395":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/2934865748":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:6801/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/3377179776":"2024-09-11T21:05:40.304807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:13:42.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:42.186+0000 7f4292215640 1 -- 172.21.15.59:0/4085095518 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f42740b53f0 msgr2=0x7f42740b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:42.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:42.186+0000 7f4292215640 1 --2- 172.21.15.59:0/4085095518 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f42740b53f0 0x7f42740b78b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4280031440 tx=0x7f42800095f0 comp rx=0 tx=0).stop 2024-09-10T21:13:42.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:42.186+0000 7f4292215640 1 -- 172.21.15.59:0/4085095518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c102dc0 msgr2=0x7f428c199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:42.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:42.186+0000 7f4292215640 1 --2- 172.21.15.59:0/4085095518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c102dc0 0x7f428c199270 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f427c00d950 tx=0x7f427c00de10 comp rx=0 tx=0).stop 2024-09-10T21:13:42.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:42.186+0000 7f4292215640 1 -- 172.21.15.59:0/4085095518 shutdown_connections 2024-09-10T21:13:42.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:42.186+0000 7f4292215640 1 --2- 172.21.15.59:0/4085095518 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f42740b53f0 0x7f42740b78b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:42.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:42.186+0000 7f4292215640 1 --2- 172.21.15.59:0/4085095518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f428c109150 0x7f428c19eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:42.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:42.186+0000 7f4292215640 1 --2- 172.21.15.59:0/4085095518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f428c1087d0 0x7f428c1997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:42.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:42.186+0000 7f4292215640 1 --2- 172.21.15.59:0/4085095518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f428c102dc0 0x7f428c199270 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:42.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:42.186+0000 7f4292215640 1 -- 172.21.15.59:0/4085095518 >> 172.21.15.59:0/4085095518 conn(0x7f428c0fe830 msgr2=0x7f428c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:42.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:42.187+0000 7f4292215640 1 -- 172.21.15.59:0/4085095518 shutdown_connections 2024-09-10T21:13:42.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:42.187+0000 7f4292215640 1 -- 172.21.15.59:0/4085095518 wait complete. 2024-09-10T21:13:42.995 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T21:13:42.995 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T21:13:43.260 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:43.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:42 smithi192 ceph-mon[35363]: pgmap v291: 97 pgs: 97 active+clean; 632 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 21 op/s 2024-09-10T21:13:43.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:42 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/4085095518' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:13:43.381 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:42 smithi059 ceph-mon[30888]: pgmap v291: 97 pgs: 97 active+clean; 632 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 21 op/s 2024-09-10T21:13:43.381 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:42 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/4085095518' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:13:43.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:42 smithi154 ceph-mon[35041]: pgmap v291: 97 pgs: 97 active+clean; 632 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 21 op/s 2024-09-10T21:13:43.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:42 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/4085095518' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:13:43.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.768+0000 7f6725342640 1 -- 172.21.15.59:0/3785328930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6720102dc0 msgr2=0x7f67201031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:43.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.768+0000 7f6725342640 1 --2- 172.21.15.59:0/3785328930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6720102dc0 0x7f67201031a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6710009900 tx=0x7f671002a410 comp rx=0 tx=0).stop 2024-09-10T21:13:43.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.768+0000 7f6725342640 1 -- 172.21.15.59:0/3785328930 shutdown_connections 2024-09-10T21:13:43.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.768+0000 7f6725342640 1 --2- 172.21.15.59:0/3785328930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6720109150 0x7f672010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:43.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.768+0000 7f6725342640 1 --2- 172.21.15.59:0/3785328930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f67201087d0 0x7f6720108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:43.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.768+0000 7f6725342640 1 --2- 172.21.15.59:0/3785328930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6720102dc0 0x7f67201031a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:43.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.768+0000 7f6725342640 1 -- 172.21.15.59:0/3785328930 >> 172.21.15.59:0/3785328930 conn(0x7f67200fe830 msgr2=0x7f6720100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:43.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.768+0000 7f6725342640 1 -- 172.21.15.59:0/3785328930 shutdown_connections 2024-09-10T21:13:43.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.768+0000 7f6725342640 1 -- 172.21.15.59:0/3785328930 wait complete. 2024-09-10T21:13:43.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.768+0000 7f6725342640 1 Processor -- start 2024-09-10T21:13:43.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.769+0000 7f6725342640 1 -- start start 2024-09-10T21:13:43.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.769+0000 7f6725342640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6720102dc0 0x7f67200754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:43.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.769+0000 7f6725342640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67201087d0 0x7f67200759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:43.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.769+0000 7f6725342640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6720109150 0x7f6720075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:43.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.769+0000 7f6725342640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6720112e60 con 0x7f6720109150 2024-09-10T21:13:43.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.769+0000 7f6725342640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6720112ce0 con 0x7f6720102dc0 2024-09-10T21:13:43.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.769+0000 7f6725342640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6720112fe0 con 0x7f67201087d0 2024-09-10T21:13:43.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.769+0000 7f671f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6720109150 0x7f6720075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:43.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.769+0000 7f671f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6720109150 0x7f6720075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36584/0 (socket says 172.21.15.59:36584) 2024-09-10T21:13:43.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.769+0000 7f671f7fe640 1 -- 172.21.15.59:0/1502307652 learned_addr learned my addr 172.21.15.59:0/1502307652 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:43.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.769+0000 7f671effd640 1 --2- 172.21.15.59:0/1502307652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6720102dc0 0x7f67200754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:43.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.769+0000 7f67167fc640 1 --2- 172.21.15.59:0/1502307652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67201087d0 0x7f67200759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:43.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.769+0000 7f671f7fe640 1 -- 172.21.15.59:0/1502307652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67201087d0 msgr2=0x7f67200759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:43.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.769+0000 7f671f7fe640 1 --2- 172.21.15.59:0/1502307652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67201087d0 0x7f67200759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:43.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.769+0000 7f671f7fe640 1 -- 172.21.15.59:0/1502307652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6720102dc0 msgr2=0x7f67200754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:43.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.769+0000 7f671f7fe640 1 --2- 172.21.15.59:0/1502307652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6720102dc0 0x7f67200754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:43.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.769+0000 7f671f7fe640 1 -- 172.21.15.59:0/1502307652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67201a7750 con 0x7f6720109150 2024-09-10T21:13:43.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.770+0000 7f671f7fe640 1 --2- 172.21.15.59:0/1502307652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6720109150 0x7f6720075f20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f671800cce0 tx=0x7f671800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:43.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.770+0000 7f671cff9640 1 -- 172.21.15.59:0/1502307652 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671800f450 con 0x7f6720109150 2024-09-10T21:13:43.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.770+0000 7f671cff9640 1 -- 172.21.15.59:0/1502307652 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f671800faa0 con 0x7f6720109150 2024-09-10T21:13:43.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.770+0000 7f6725342640 1 -- 172.21.15.59:0/1502307652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67201a7a40 con 0x7f6720109150 2024-09-10T21:13:43.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.770+0000 7f671cff9640 1 -- 172.21.15.59:0/1502307652 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6718018b70 con 0x7f6720109150 2024-09-10T21:13:43.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.770+0000 7f6725342640 1 -- 172.21.15.59:0/1502307652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67201a7f30 con 0x7f6720109150 2024-09-10T21:13:43.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.771+0000 7f6725342640 1 -- 172.21.15.59:0/1502307652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67201031a0 con 0x7f6720109150 2024-09-10T21:13:43.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.772+0000 7f671cff9640 1 -- 172.21.15.59:0/1502307652 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f671800f5f0 con 0x7f6720109150 2024-09-10T21:13:43.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.773+0000 7f671cff9640 1 --2- 172.21.15.59:0/1502307652 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f670c0b5370 0x7f670c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:43.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.773+0000 7f671effd640 1 --2- 172.21.15.59:0/1502307652 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f670c0b5370 0x7f670c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:43.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.774+0000 7f671cff9640 1 -- 172.21.15.59:0/1502307652 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f67180e63e0 con 0x7f6720109150 2024-09-10T21:13:43.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.774+0000 7f671effd640 1 --2- 172.21.15.59:0/1502307652 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f670c0b5370 0x7f670c0b7830 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6710005ab0 tx=0x7f6710005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:43.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.777+0000 7f671cff9640 1 -- 172.21.15.59:0/1502307652 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6718014030 con 0x7f6720109150 2024-09-10T21:13:43.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.958+0000 7f6725342640 1 -- 172.21.15.59:0/1502307652 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6720063590 con 0x7f670c0b5370 2024-09-10T21:13:43.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.962+0000 7f671cff9640 1 -- 172.21.15.59:0/1502307652 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258741 (secure 0 0 0) 0x7f6720063590 con 0x7f670c0b5370 2024-09-10T21:13:43.969 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:13:43.971 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-10T21:13:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.966+0000 7f6725342640 1 -- 172.21.15.59:0/1502307652 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f670c0b5370 msgr2=0x7f670c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.966+0000 7f6725342640 1 --2- 172.21.15.59:0/1502307652 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f670c0b5370 0x7f670c0b7830 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6710005ab0 tx=0x7f6710005a20 comp rx=0 tx=0).stop 2024-09-10T21:13:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.966+0000 7f6725342640 1 -- 172.21.15.59:0/1502307652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6720109150 msgr2=0x7f6720075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.966+0000 7f6725342640 1 --2- 172.21.15.59:0/1502307652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6720109150 0x7f6720075f20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f671800cce0 tx=0x7f671800a620 comp rx=0 tx=0).stop 2024-09-10T21:13:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.966+0000 7f6725342640 1 -- 172.21.15.59:0/1502307652 shutdown_connections 2024-09-10T21:13:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.966+0000 7f6725342640 1 --2- 172.21.15.59:0/1502307652 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f670c0b5370 0x7f670c0b7830 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.966+0000 7f6725342640 1 --2- 172.21.15.59:0/1502307652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6720109150 0x7f6720075f20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.966+0000 7f6725342640 1 --2- 172.21.15.59:0/1502307652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67201087d0 0x7f67200759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.966+0000 7f6725342640 1 --2- 172.21.15.59:0/1502307652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6720102dc0 0x7f67200754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.966+0000 7f6725342640 1 -- 172.21.15.59:0/1502307652 >> 172.21.15.59:0/1502307652 conn(0x7f67200fe830 msgr2=0x7f6720100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.966+0000 7f6725342640 1 -- 172.21.15.59:0/1502307652 shutdown_connections 2024-09-10T21:13:43.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:43.966+0000 7f6725342640 1 -- 172.21.15.59:0/1502307652 wait complete. 2024-09-10T21:13:44.706 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-10T21:13:43.230418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647525,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":215,"num_read_kb":192,"num_write":354,"num_write_kb":2271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":294,"ondisk_log_size":294,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364820,"kb_used_data":11412,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577004,"statfs":{"total":1151940427776,"available":1151566852096,"internally_reserved":0,"allocated":11685888,"data_stored":6450495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":53161,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":139,"num_read_kb":128,"num_write":124,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002940"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.654813+0000","last_change":"2024-09-10T21:13:18.656166+0000","last_active":"2024-09-10T21:13:19.654813+0000","last_peered":"2024-09-10T21:13:19.654813+0000","last_clean":"2024-09-10T21:13:19.654813+0000","last_became_active":"2024-09-10T21:13:18.655774+0000","last_became_peered":"2024-09-10T21:13:18.655774+0000","last_unstale":"2024-09-10T21:13:19.654813+0000","last_undegraded":"2024-09-10T21:13:19.654813+0000","last_fullsized":"2024-09-10T21:13:19.654813+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:57.775209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652510+0000","last_change":"2024-09-10T21:13:18.654232+0000","last_active":"2024-09-10T21:13:19.652510+0000","last_peered":"2024-09-10T21:13:19.652510+0000","last_clean":"2024-09-10T21:13:19.652510+0000","last_became_active":"2024-09-10T21:13:18.653928+0000","last_became_peered":"2024-09-10T21:13:18.653928+0000","last_unstale":"2024-09-10T21:13:19.652510+0000","last_undegraded":"2024-09-10T21:13:19.652510+0000","last_fullsized":"2024-09-10T21:13:19.652510+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:02.615686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653206+0000","last_change":"2024-09-10T21:13:18.662923+0000","last_active":"2024-09-10T21:13:19.653206+0000","last_peered":"2024-09-10T21:13:19.653206+0000","last_clean":"2024-09-10T21:13:19.653206+0000","last_became_active":"2024-09-10T21:13:18.662541+0000","last_became_peered":"2024-09-10T21:13:18.662541+0000","last_unstale":"2024-09-10T21:13:19.653206+0000","last_undegraded":"2024-09-10T21:13:19.653206+0000","last_fullsized":"2024-09-10T21:13:19.653206+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:33:11.140761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.639448+0000","last_change":"2024-09-10T21:13:18.654661+0000","last_active":"2024-09-10T21:13:19.639448+0000","last_peered":"2024-09-10T21:13:19.639448+0000","last_clean":"2024-09-10T21:13:19.639448+0000","last_became_active":"2024-09-10T21:13:18.651043+0000","last_became_peered":"2024-09-10T21:13:18.651043+0000","last_unstale":"2024-09-10T21:13:19.639448+0000","last_undegraded":"2024-09-10T21:13:19.639448+0000","last_fullsized":"2024-09-10T21:13:19.639448+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:14.743608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.651880+0000","last_change":"2024-09-10T21:13:18.650427+0000","last_active":"2024-09-10T21:13:19.651880+0000","last_peered":"2024-09-10T21:13:19.651880+0000","last_clean":"2024-09-10T21:13:19.651880+0000","last_became_active":"2024-09-10T21:13:18.650039+0000","last_became_peered":"2024-09-10T21:13:18.650039+0000","last_unstale":"2024-09-10T21:13:19.651880+0000","last_undegraded":"2024-09-10T21:13:19.651880+0000","last_fullsized":"2024-09-10T21:13:19.651880+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:11.363642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.651596+0000","last_change":"2024-09-10T21:13:18.654320+0000","last_active":"2024-09-10T21:13:19.651596+0000","last_peered":"2024-09-10T21:13:19.651596+0000","last_clean":"2024-09-10T21:13:19.651596+0000","last_became_active":"2024-09-10T21:13:18.653291+0000","last_became_peered":"2024-09-10T21:13:18.653291+0000","last_unstale":"2024-09-10T21:13:19.651596+0000","last_undegraded":"2024-09-10T21:13:19.651596+0000","last_fullsized":"2024-09-10T21:13:19.651596+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:08:28.176816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.651905+0000","last_change":"2024-09-10T21:13:18.659695+0000","last_active":"2024-09-10T21:13:19.651905+0000","last_peered":"2024-09-10T21:13:19.651905+0000","last_clean":"2024-09-10T21:13:19.651905+0000","last_became_active":"2024-09-10T21:13:18.659240+0000","last_became_peered":"2024-09-10T21:13:18.659240+0000","last_unstale":"2024-09-10T21:13:19.651905+0000","last_undegraded":"2024-09-10T21:13:19.651905+0000","last_fullsized":"2024-09-10T21:13:19.651905+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:58.951873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653892+0000","last_change":"2024-09-10T21:13:18.653832+0000","last_active":"2024-09-10T21:13:19.653892+0000","last_peered":"2024-09-10T21:13:19.653892+0000","last_clean":"2024-09-10T21:13:19.653892+0000","last_became_active":"2024-09-10T21:13:18.653539+0000","last_became_peered":"2024-09-10T21:13:18.653539+0000","last_unstale":"2024-09-10T21:13:19.653892+0000","last_undegraded":"2024-09-10T21:13:19.653892+0000","last_fullsized":"2024-09-10T21:13:19.653892+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:52.556202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.657038+0000","last_change":"2024-09-10T21:13:18.656252+0000","last_active":"2024-09-10T21:13:19.657038+0000","last_peered":"2024-09-10T21:13:19.657038+0000","last_clean":"2024-09-10T21:13:19.657038+0000","last_became_active":"2024-09-10T21:13:18.655879+0000","last_became_peered":"2024-09-10T21:13:18.655879+0000","last_unstale":"2024-09-10T21:13:19.657038+0000","last_undegraded":"2024-09-10T21:13:19.657038+0000","last_fullsized":"2024-09-10T21:13:19.657038+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:03.748183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.651565+0000","last_change":"2024-09-10T21:13:18.663370+0000","last_active":"2024-09-10T21:13:19.651565+0000","last_peered":"2024-09-10T21:13:19.651565+0000","last_clean":"2024-09-10T21:13:19.651565+0000","last_became_active":"2024-09-10T21:13:18.662863+0000","last_became_peered":"2024-09-10T21:13:18.662863+0000","last_unstale":"2024-09-10T21:13:19.651565+0000","last_undegraded":"2024-09-10T21:13:19.651565+0000","last_fullsized":"2024-09-10T21:13:19.651565+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:22.912596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652339+0000","last_change":"2024-09-10T21:13:18.663626+0000","last_active":"2024-09-10T21:13:19.652339+0000","last_peered":"2024-09-10T21:13:19.652339+0000","last_clean":"2024-09-10T21:13:19.652339+0000","last_became_active":"2024-09-10T21:13:18.663280+0000","last_became_peered":"2024-09-10T21:13:18.663280+0000","last_unstale":"2024-09-10T21:13:19.652339+0000","last_undegraded":"2024-09-10T21:13:19.652339+0000","last_fullsized":"2024-09-10T21:13:19.652339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:07.874387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.639490+0000","last_change":"2024-09-10T21:13:18.660791+0000","last_active":"2024-09-10T21:13:19.639490+0000","last_peered":"2024-09-10T21:13:19.639490+0000","last_clean":"2024-09-10T21:13:19.639490+0000","last_became_active":"2024-09-10T21:13:18.660386+0000","last_became_peered":"2024-09-10T21:13:18.660386+0000","last_unstale":"2024-09-10T21:13:19.639490+0000","last_undegraded":"2024-09-10T21:13:19.639490+0000","last_fullsized":"2024-09-10T21:13:19.639490+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:37.218822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.641404+0000","last_change":"2024-09-10T21:13:18.655893+0000","last_active":"2024-09-10T21:13:19.641404+0000","last_peered":"2024-09-10T21:13:19.641404+0000","last_clean":"2024-09-10T21:13:19.641404+0000","last_became_active":"2024-09-10T21:13:18.655524+0000","last_became_peered":"2024-09-10T21:13:18.655524+0000","last_unstale":"2024-09-10T21:13:19.641404+0000","last_undegraded":"2024-09-10T21:13:19.641404+0000","last_fullsized":"2024-09-10T21:13:19.641404+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:29.734783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652528+0000","last_change":"2024-09-10T21:13:18.654359+0000","last_active":"2024-09-10T21:13:19.652528+0000","last_peered":"2024-09-10T21:13:19.652528+0000","last_clean":"2024-09-10T21:13:19.652528+0000","last_became_active":"2024-09-10T21:13:18.653983+0000","last_became_peered":"2024-09-10T21:13:18.653983+0000","last_unstale":"2024-09-10T21:13:19.652528+0000","last_undegraded":"2024-09-10T21:13:19.652528+0000","last_fullsized":"2024-09-10T21:13:19.652528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:48.806836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652317+0000","last_change":"2024-09-10T21:13:18.650428+0000","last_active":"2024-09-10T21:13:19.652317+0000","last_peered":"2024-09-10T21:13:19.652317+0000","last_clean":"2024-09-10T21:13:19.652317+0000","last_became_active":"2024-09-10T21:13:18.650121+0000","last_became_peered":"2024-09-10T21:13:18.650121+0000","last_unstale":"2024-09-10T21:13:19.652317+0000","last_undegraded":"2024-09-10T21:13:19.652317+0000","last_fullsized":"2024-09-10T21:13:19.652317+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:15.121916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.656358+0000","last_change":"2024-09-10T21:13:18.662321+0000","last_active":"2024-09-10T21:13:19.656358+0000","last_peered":"2024-09-10T21:13:19.656358+0000","last_clean":"2024-09-10T21:13:19.656358+0000","last_became_active":"2024-09-10T21:13:18.662013+0000","last_became_peered":"2024-09-10T21:13:18.662013+0000","last_unstale":"2024-09-10T21:13:19.656358+0000","last_undegraded":"2024-09-10T21:13:19.656358+0000","last_fullsized":"2024-09-10T21:13:19.656358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:54.303375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.655033+0000","last_change":"2024-09-10T21:13:18.662549+0000","last_active":"2024-09-10T21:13:19.655033+0000","last_peered":"2024-09-10T21:13:19.655033+0000","last_clean":"2024-09-10T21:13:19.655033+0000","last_became_active":"2024-09-10T21:13:18.662230+0000","last_became_peered":"2024-09-10T21:13:18.662230+0000","last_unstale":"2024-09-10T21:13:19.655033+0000","last_undegraded":"2024-09-10T21:13:19.655033+0000","last_fullsized":"2024-09-10T21:13:19.655033+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:02.582355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652083+0000","last_change":"2024-09-10T21:13:18.654906+0000","last_active":"2024-09-10T21:13:19.652083+0000","last_peered":"2024-09-10T21:13:19.652083+0000","last_clean":"2024-09-10T21:13:19.652083+0000","last_became_active":"2024-09-10T21:13:18.654599+0000","last_became_peered":"2024-09-10T21:13:18.654599+0000","last_unstale":"2024-09-10T21:13:19.652083+0000","last_undegraded":"2024-09-10T21:13:19.652083+0000","last_fullsized":"2024-09-10T21:13:19.652083+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:34.987893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.654183+0000","last_change":"2024-09-10T21:13:18.643997+0000","last_active":"2024-09-10T21:13:19.654183+0000","last_peered":"2024-09-10T21:13:19.654183+0000","last_clean":"2024-09-10T21:13:19.654183+0000","last_became_active":"2024-09-10T21:13:18.643632+0000","last_became_peered":"2024-09-10T21:13:18.643632+0000","last_unstale":"2024-09-10T21:13:19.654183+0000","last_undegraded":"2024-09-10T21:13:19.654183+0000","last_fullsized":"2024-09-10T21:13:19.654183+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:31.234040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653513+0000","last_change":"2024-09-10T21:13:18.657079+0000","last_active":"2024-09-10T21:13:19.653513+0000","last_peered":"2024-09-10T21:13:19.653513+0000","last_clean":"2024-09-10T21:13:19.653513+0000","last_became_active":"2024-09-10T21:13:18.656741+0000","last_became_peered":"2024-09-10T21:13:18.656741+0000","last_unstale":"2024-09-10T21:13:19.653513+0000","last_undegraded":"2024-09-10T21:13:19.653513+0000","last_fullsized":"2024-09-10T21:13:19.653513+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:27.036783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.641422+0000","last_change":"2024-09-10T21:13:18.653076+0000","last_active":"2024-09-10T21:13:19.641422+0000","last_peered":"2024-09-10T21:13:19.641422+0000","last_clean":"2024-09-10T21:13:19.641422+0000","last_became_active":"2024-09-10T21:13:18.652722+0000","last_became_peered":"2024-09-10T21:13:18.652722+0000","last_unstale":"2024-09-10T21:13:19.641422+0000","last_undegraded":"2024-09-10T21:13:19.641422+0000","last_fullsized":"2024-09-10T21:13:19.641422+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:11.005632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.656914+0000","last_change":"2024-09-10T21:13:18.663340+0000","last_active":"2024-09-10T21:13:19.656914+0000","last_peered":"2024-09-10T21:13:19.656914+0000","last_clean":"2024-09-10T21:13:19.656914+0000","last_became_active":"2024-09-10T21:13:18.662981+0000","last_became_peered":"2024-09-10T21:13:18.662981+0000","last_unstale":"2024-09-10T21:13:19.656914+0000","last_undegraded":"2024-09-10T21:13:19.656914+0000","last_fullsized":"2024-09-10T21:13:19.656914+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:39.510625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652935+0000","last_change":"2024-09-10T21:13:18.651376+0000","last_active":"2024-09-10T21:13:19.652935+0000","last_peered":"2024-09-10T21:13:19.652935+0000","last_clean":"2024-09-10T21:13:19.652935+0000","last_became_active":"2024-09-10T21:13:18.650999+0000","last_became_peered":"2024-09-10T21:13:18.650999+0000","last_unstale":"2024-09-10T21:13:19.652935+0000","last_undegraded":"2024-09-10T21:13:19.652935+0000","last_fullsized":"2024-09-10T21:13:19.652935+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:12.268120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.641236+0000","last_change":"2024-09-10T21:13:18.648634+0000","last_active":"2024-09-10T21:13:19.641236+0000","last_peered":"2024-09-10T21:13:19.641236+0000","last_clean":"2024-09-10T21:13:19.641236+0000","last_became_active":"2024-09-10T21:13:18.648099+0000","last_became_peered":"2024-09-10T21:13:18.648099+0000","last_unstale":"2024-09-10T21:13:19.641236+0000","last_undegraded":"2024-09-10T21:13:19.641236+0000","last_fullsized":"2024-09-10T21:13:19.641236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:47.570132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652650+0000","last_change":"2024-09-10T21:13:18.660188+0000","last_active":"2024-09-10T21:13:19.652650+0000","last_peered":"2024-09-10T21:13:19.652650+0000","last_clean":"2024-09-10T21:13:19.652650+0000","last_became_active":"2024-09-10T21:13:18.659821+0000","last_became_peered":"2024-09-10T21:13:18.659821+0000","last_unstale":"2024-09-10T21:13:19.652650+0000","last_undegraded":"2024-09-10T21:13:19.652650+0000","last_fullsized":"2024-09-10T21:13:19.652650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:36.456852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.655677+0000","last_change":"2024-09-10T21:13:18.656727+0000","last_active":"2024-09-10T21:13:19.655677+0000","last_peered":"2024-09-10T21:13:19.655677+0000","last_clean":"2024-09-10T21:13:19.655677+0000","last_became_active":"2024-09-10T21:13:18.654627+0000","last_became_peered":"2024-09-10T21:13:18.654627+0000","last_unstale":"2024-09-10T21:13:19.655677+0000","last_undegraded":"2024-09-10T21:13:19.655677+0000","last_fullsized":"2024-09-10T21:13:19.655677+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:42.838893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.654359+0000","last_change":"2024-09-10T21:13:18.660113+0000","last_active":"2024-09-10T21:13:19.654359+0000","last_peered":"2024-09-10T21:13:19.654359+0000","last_clean":"2024-09-10T21:13:19.654359+0000","last_became_active":"2024-09-10T21:13:18.659668+0000","last_became_peered":"2024-09-10T21:13:18.659668+0000","last_unstale":"2024-09-10T21:13:19.654359+0000","last_undegraded":"2024-09-10T21:13:19.654359+0000","last_fullsized":"2024-09-10T21:13:19.654359+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:43.733431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.641500+0000","last_change":"2024-09-10T21:13:18.648015+0000","last_active":"2024-09-10T21:13:19.641500+0000","last_peered":"2024-09-10T21:13:19.641500+0000","last_clean":"2024-09-10T21:13:19.641500+0000","last_became_active":"2024-09-10T21:13:18.647661+0000","last_became_peered":"2024-09-10T21:13:18.647661+0000","last_unstale":"2024-09-10T21:13:19.641500+0000","last_undegraded":"2024-09-10T21:13:19.641500+0000","last_fullsized":"2024-09-10T21:13:19.641500+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:22.543217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653081+0000","last_change":"2024-09-10T21:13:18.657728+0000","last_active":"2024-09-10T21:13:19.653081+0000","last_peered":"2024-09-10T21:13:19.653081+0000","last_clean":"2024-09-10T21:13:19.653081+0000","last_became_active":"2024-09-10T21:13:18.657372+0000","last_became_peered":"2024-09-10T21:13:18.657372+0000","last_unstale":"2024-09-10T21:13:19.653081+0000","last_undegraded":"2024-09-10T21:13:19.653081+0000","last_fullsized":"2024-09-10T21:13:19.653081+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:43.621668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652122+0000","last_change":"2024-09-10T21:13:18.648380+0000","last_active":"2024-09-10T21:13:19.652122+0000","last_peered":"2024-09-10T21:13:19.652122+0000","last_clean":"2024-09-10T21:13:19.652122+0000","last_became_active":"2024-09-10T21:13:18.647871+0000","last_became_peered":"2024-09-10T21:13:18.647871+0000","last_unstale":"2024-09-10T21:13:19.652122+0000","last_undegraded":"2024-09-10T21:13:19.652122+0000","last_fullsized":"2024-09-10T21:13:19.652122+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:16.374911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.656706+0000","last_change":"2024-09-10T21:13:18.654843+0000","last_active":"2024-09-10T21:13:19.656706+0000","last_peered":"2024-09-10T21:13:19.656706+0000","last_clean":"2024-09-10T21:13:19.656706+0000","last_became_active":"2024-09-10T21:13:18.654211+0000","last_became_peered":"2024-09-10T21:13:18.654211+0000","last_unstale":"2024-09-10T21:13:19.656706+0000","last_undegraded":"2024-09-10T21:13:19.656706+0000","last_fullsized":"2024-09-10T21:13:19.656706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:28.490792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653012+0000","last_change":"2024-09-10T21:13:18.659603+0000","last_active":"2024-09-10T21:13:19.653012+0000","last_peered":"2024-09-10T21:13:19.653012+0000","last_clean":"2024-09-10T21:13:19.653012+0000","last_became_active":"2024-09-10T21:13:18.659257+0000","last_became_peered":"2024-09-10T21:13:18.659257+0000","last_unstale":"2024-09-10T21:13:19.653012+0000","last_undegraded":"2024-09-10T21:13:19.653012+0000","last_fullsized":"2024-09-10T21:13:19.653012+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:26.249109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.651984+0000","last_change":"2024-09-10T21:13:18.649354+0000","last_active":"2024-09-10T21:13:19.651984+0000","last_peered":"2024-09-10T21:13:19.651984+0000","last_clean":"2024-09-10T21:13:19.651984+0000","last_became_active":"2024-09-10T21:13:18.649029+0000","last_became_peered":"2024-09-10T21:13:18.649029+0000","last_unstale":"2024-09-10T21:13:19.651984+0000","last_undegraded":"2024-09-10T21:13:19.651984+0000","last_fullsized":"2024-09-10T21:13:19.651984+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:06.946983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'6","reported_seq":40,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:40.971513+0000","last_change":"2024-09-10T21:13:16.631197+0000","last_active":"2024-09-10T21:13:40.971513+0000","last_peered":"2024-09-10T21:13:40.971513+0000","last_clean":"2024-09-10T21:13:40.971513+0000","last_became_active":"2024-09-10T21:13:16.630877+0000","last_became_peered":"2024-09-10T21:13:16.630877+0000","last_unstale":"2024-09-10T21:13:40.971513+0000","last_undegraded":"2024-09-10T21:13:40.971513+0000","last_fullsized":"2024-09-10T21:13:40.971513+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:50.117425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.641122+0000","last_change":"2024-09-10T21:13:18.654124+0000","last_active":"2024-09-10T21:13:19.641122+0000","last_peered":"2024-09-10T21:13:19.641122+0000","last_clean":"2024-09-10T21:13:19.641122+0000","last_became_active":"2024-09-10T21:13:18.653757+0000","last_became_peered":"2024-09-10T21:13:18.653757+0000","last_unstale":"2024-09-10T21:13:19.641122+0000","last_undegraded":"2024-09-10T21:13:19.641122+0000","last_fullsized":"2024-09-10T21:13:19.641122+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:25.174272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:28.942830+0000","last_change":"2024-09-10T21:13:16.631526+0000","last_active":"2024-09-10T21:13:28.942830+0000","last_peered":"2024-09-10T21:13:28.942830+0000","last_clean":"2024-09-10T21:13:28.942830+0000","last_became_active":"2024-09-10T21:13:16.631194+0000","last_became_peered":"2024-09-10T21:13:16.631194+0000","last_unstale":"2024-09-10T21:13:28.942830+0000","last_undegraded":"2024-09-10T21:13:28.942830+0000","last_fullsized":"2024-09-10T21:13:28.942830+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:31:35.036874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:27.935570+0000","last_change":"2024-09-10T21:13:16.624906+0000","last_active":"2024-09-10T21:13:27.935570+0000","last_peered":"2024-09-10T21:13:27.935570+0000","last_clean":"2024-09-10T21:13:27.935570+0000","last_became_active":"2024-09-10T21:13:16.624376+0000","last_became_peered":"2024-09-10T21:13:16.624376+0000","last_unstale":"2024-09-10T21:13:27.935570+0000","last_undegraded":"2024-09-10T21:13:27.935570+0000","last_fullsized":"2024-09-10T21:13:27.935570+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:20.942651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.654925+0000","last_change":"2024-09-10T21:13:18.646987+0000","last_active":"2024-09-10T21:13:19.654925+0000","last_peered":"2024-09-10T21:13:19.654925+0000","last_clean":"2024-09-10T21:13:19.654925+0000","last_became_active":"2024-09-10T21:13:18.646690+0000","last_became_peered":"2024-09-10T21:13:18.646690+0000","last_unstale":"2024-09-10T21:13:19.654925+0000","last_undegraded":"2024-09-10T21:13:19.654925+0000","last_fullsized":"2024-09-10T21:13:19.654925+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:47:02.132164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.951203+0000","last_change":"2024-09-10T21:13:16.633082+0000","last_active":"2024-09-10T21:13:29.951203+0000","last_peered":"2024-09-10T21:13:29.951203+0000","last_clean":"2024-09-10T21:13:29.951203+0000","last_became_active":"2024-09-10T21:13:16.632707+0000","last_became_peered":"2024-09-10T21:13:16.632707+0000","last_unstale":"2024-09-10T21:13:29.951203+0000","last_undegraded":"2024-09-10T21:13:29.951203+0000","last_fullsized":"2024-09-10T21:13:29.951203+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:53:56.611072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.651623+0000","last_change":"2024-09-10T21:13:18.663309+0000","last_active":"2024-09-10T21:13:19.651623+0000","last_peered":"2024-09-10T21:13:19.651623+0000","last_clean":"2024-09-10T21:13:19.651623+0000","last_became_active":"2024-09-10T21:13:18.662990+0000","last_became_peered":"2024-09-10T21:13:18.662990+0000","last_unstale":"2024-09-10T21:13:19.651623+0000","last_undegraded":"2024-09-10T21:13:19.651623+0000","last_fullsized":"2024-09-10T21:13:19.651623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:18.014441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'4","reported_seq":43,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:39.969733+0000","last_change":"2024-09-10T21:13:16.633012+0000","last_active":"2024-09-10T21:13:39.969733+0000","last_peered":"2024-09-10T21:13:39.969733+0000","last_clean":"2024-09-10T21:13:39.969733+0000","last_became_active":"2024-09-10T21:13:16.632622+0000","last_became_peered":"2024-09-10T21:13:16.632622+0000","last_unstale":"2024-09-10T21:13:39.969733+0000","last_undegraded":"2024-09-10T21:13:39.969733+0000","last_fullsized":"2024-09-10T21:13:39.969733+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:16.859255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.656947+0000","last_change":"2024-09-10T21:13:18.658015+0000","last_active":"2024-09-10T21:13:19.656947+0000","last_peered":"2024-09-10T21:13:19.656947+0000","last_clean":"2024-09-10T21:13:19.656947+0000","last_became_active":"2024-09-10T21:13:18.656922+0000","last_became_peered":"2024-09-10T21:13:18.656922+0000","last_unstale":"2024-09-10T21:13:19.656947+0000","last_undegraded":"2024-09-10T21:13:19.656947+0000","last_fullsized":"2024-09-10T21:13:19.656947+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:24.038131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.950479+0000","last_change":"2024-09-10T21:13:16.631771+0000","last_active":"2024-09-10T21:13:29.950479+0000","last_peered":"2024-09-10T21:13:29.950479+0000","last_clean":"2024-09-10T21:13:29.950479+0000","last_became_active":"2024-09-10T21:13:16.631477+0000","last_became_peered":"2024-09-10T21:13:16.631477+0000","last_unstale":"2024-09-10T21:13:29.950479+0000","last_undegraded":"2024-09-10T21:13:29.950479+0000","last_fullsized":"2024-09-10T21:13:29.950479+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:16.644046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652931+0000","last_change":"2024-09-10T21:13:18.658119+0000","last_active":"2024-09-10T21:13:19.652931+0000","last_peered":"2024-09-10T21:13:19.652931+0000","last_clean":"2024-09-10T21:13:19.652931+0000","last_became_active":"2024-09-10T21:13:18.657339+0000","last_became_peered":"2024-09-10T21:13:18.657339+0000","last_unstale":"2024-09-10T21:13:19.652931+0000","last_undegraded":"2024-09-10T21:13:19.652931+0000","last_fullsized":"2024-09-10T21:13:19.652931+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:45.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:28.942415+0000","last_change":"2024-09-10T21:13:16.727019+0000","last_active":"2024-09-10T21:13:28.942415+0000","last_peered":"2024-09-10T21:13:28.942415+0000","last_clean":"2024-09-10T21:13:28.942415+0000","last_became_active":"2024-09-10T21:13:16.726667+0000","last_became_peered":"2024-09-10T21:13:16.726667+0000","last_unstale":"2024-09-10T21:13:28.942415+0000","last_undegraded":"2024-09-10T21:13:28.942415+0000","last_fullsized":"2024-09-10T21:13:28.942415+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:57.551149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.656538+0000","last_change":"2024-09-10T21:13:18.659422+0000","last_active":"2024-09-10T21:13:19.656538+0000","last_peered":"2024-09-10T21:13:19.656538+0000","last_clean":"2024-09-10T21:13:19.656538+0000","last_became_active":"2024-09-10T21:13:18.657163+0000","last_became_peered":"2024-09-10T21:13:18.657163+0000","last_unstale":"2024-09-10T21:13:19.656538+0000","last_undegraded":"2024-09-10T21:13:19.656538+0000","last_fullsized":"2024-09-10T21:13:19.656538+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:24:50.147061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'27","reported_seq":72,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:39.971429+0000","last_change":"2024-09-10T21:13:16.631820+0000","last_active":"2024-09-10T21:13:39.971429+0000","last_peered":"2024-09-10T21:13:39.971429+0000","last_clean":"2024-09-10T21:13:39.971429+0000","last_became_active":"2024-09-10T21:13:16.631432+0000","last_became_peered":"2024-09-10T21:13:16.631432+0000","last_unstale":"2024-09-10T21:13:39.971429+0000","last_undegraded":"2024-09-10T21:13:39.971429+0000","last_fullsized":"2024-09-10T21:13:39.971429+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:47.972871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":61,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653825+0000","last_change":"2024-09-10T21:13:18.653147+0000","last_active":"2024-09-10T21:13:19.653825+0000","last_peered":"2024-09-10T21:13:19.653825+0000","last_clean":"2024-09-10T21:13:19.653825+0000","last_became_active":"2024-09-10T21:13:18.652846+0000","last_became_peered":"2024-09-10T21:13:18.652846+0000","last_unstale":"2024-09-10T21:13:19.653825+0000","last_undegraded":"2024-09-10T21:13:19.653825+0000","last_fullsized":"2024-09-10T21:13:19.653825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:59.007192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:30.953655+0000","last_change":"2024-09-10T21:13:16.631994+0000","last_active":"2024-09-10T21:13:30.953655+0000","last_peered":"2024-09-10T21:13:30.953655+0000","last_clean":"2024-09-10T21:13:30.953655+0000","last_became_active":"2024-09-10T21:13:16.631665+0000","last_became_peered":"2024-09-10T21:13:16.631665+0000","last_unstale":"2024-09-10T21:13:30.953655+0000","last_undegraded":"2024-09-10T21:13:30.953655+0000","last_fullsized":"2024-09-10T21:13:30.953655+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:05.537172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.641174+0000","last_change":"2024-09-10T21:13:18.657463+0000","last_active":"2024-09-10T21:13:19.641174+0000","last_peered":"2024-09-10T21:13:19.641174+0000","last_clean":"2024-09-10T21:13:19.641174+0000","last_became_active":"2024-09-10T21:13:18.657146+0000","last_became_peered":"2024-09-10T21:13:18.657146+0000","last_unstale":"2024-09-10T21:13:19.641174+0000","last_undegraded":"2024-09-10T21:13:19.641174+0000","last_fullsized":"2024-09-10T21:13:19.641174+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:42.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.951225+0000","last_change":"2024-09-10T21:13:16.630419+0000","last_active":"2024-09-10T21:13:29.951225+0000","last_peered":"2024-09-10T21:13:29.951225+0000","last_clean":"2024-09-10T21:13:29.951225+0000","last_became_active":"2024-09-10T21:13:16.630053+0000","last_became_peered":"2024-09-10T21:13:16.630053+0000","last_unstale":"2024-09-10T21:13:29.951225+0000","last_undegraded":"2024-09-10T21:13:29.951225+0000","last_fullsized":"2024-09-10T21:13:29.951225+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:08.090931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652286+0000","last_change":"2024-09-10T21:13:18.657585+0000","last_active":"2024-09-10T21:13:19.652286+0000","last_peered":"2024-09-10T21:13:19.652286+0000","last_clean":"2024-09-10T21:13:19.652286+0000","last_became_active":"2024-09-10T21:13:18.657280+0000","last_became_peered":"2024-09-10T21:13:18.657280+0000","last_unstale":"2024-09-10T21:13:19.652286+0000","last_undegraded":"2024-09-10T21:13:19.652286+0000","last_fullsized":"2024-09-10T21:13:19.652286+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:46:34.252882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'5","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:39.969898+0000","last_change":"2024-09-10T21:13:16.629700+0000","last_active":"2024-09-10T21:13:39.969898+0000","last_peered":"2024-09-10T21:13:39.969898+0000","last_clean":"2024-09-10T21:13:39.969898+0000","last_became_active":"2024-09-10T21:13:16.629282+0000","last_became_peered":"2024-09-10T21:13:16.629282+0000","last_unstale":"2024-09-10T21:13:39.969898+0000","last_undegraded":"2024-09-10T21:13:39.969898+0000","last_fullsized":"2024-09-10T21:13:39.969898+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:42.572643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.651855+0000","last_change":"2024-09-10T21:13:18.664535+0000","last_active":"2024-09-10T21:13:19.651855+0000","last_peered":"2024-09-10T21:13:19.651855+0000","last_clean":"2024-09-10T21:13:19.651855+0000","last_became_active":"2024-09-10T21:13:18.663997+0000","last_became_peered":"2024-09-10T21:13:18.663997+0000","last_unstale":"2024-09-10T21:13:19.651855+0000","last_undegraded":"2024-09-10T21:13:19.651855+0000","last_fullsized":"2024-09-10T21:13:19.651855+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:30.365106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.948447+0000","last_change":"2024-09-10T21:13:16.727096+0000","last_active":"2024-09-10T21:13:29.948447+0000","last_peered":"2024-09-10T21:13:29.948447+0000","last_clean":"2024-09-10T21:13:29.948447+0000","last_became_active":"2024-09-10T21:13:16.726408+0000","last_became_peered":"2024-09-10T21:13:16.726408+0000","last_unstale":"2024-09-10T21:13:29.948447+0000","last_undegraded":"2024-09-10T21:13:29.948447+0000","last_fullsized":"2024-09-10T21:13:29.948447+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:30.581238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.640980+0000","last_change":"2024-09-10T21:13:18.657397+0000","last_active":"2024-09-10T21:13:19.640980+0000","last_peered":"2024-09-10T21:13:19.640980+0000","last_clean":"2024-09-10T21:13:19.640980+0000","last_became_active":"2024-09-10T21:13:18.657050+0000","last_became_peered":"2024-09-10T21:13:18.657050+0000","last_unstale":"2024-09-10T21:13:19.640980+0000","last_undegraded":"2024-09-10T21:13:19.640980+0000","last_fullsized":"2024-09-10T21:13:19.640980+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:09.739544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:28.931420+0000","last_change":"2024-09-10T21:13:16.633716+0000","last_active":"2024-09-10T21:13:28.931420+0000","last_peered":"2024-09-10T21:13:28.931420+0000","last_clean":"2024-09-10T21:13:28.931420+0000","last_became_active":"2024-09-10T21:13:16.633225+0000","last_became_peered":"2024-09-10T21:13:16.633225+0000","last_unstale":"2024-09-10T21:13:28.931420+0000","last_undegraded":"2024-09-10T21:13:28.931420+0000","last_fullsized":"2024-09-10T21:13:28.931420+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:48.807549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.654008+0000","last_change":"2024-09-10T21:13:18.663129+0000","last_active":"2024-09-10T21:13:19.654008+0000","last_peered":"2024-09-10T21:13:19.654008+0000","last_clean":"2024-09-10T21:13:19.654008+0000","last_became_active":"2024-09-10T21:13:18.662694+0000","last_became_peered":"2024-09-10T21:13:18.662694+0000","last_unstale":"2024-09-10T21:13:19.654008+0000","last_undegraded":"2024-09-10T21:13:19.654008+0000","last_fullsized":"2024-09-10T21:13:19.654008+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:24.633468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.948428+0000","last_change":"2024-09-10T21:13:16.628733+0000","last_active":"2024-09-10T21:13:29.948428+0000","last_peered":"2024-09-10T21:13:29.948428+0000","last_clean":"2024-09-10T21:13:29.948428+0000","last_became_active":"2024-09-10T21:13:16.628419+0000","last_became_peered":"2024-09-10T21:13:16.628419+0000","last_unstale":"2024-09-10T21:13:29.948428+0000","last_undegraded":"2024-09-10T21:13:29.948428+0000","last_fullsized":"2024-09-10T21:13:29.948428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:31.264739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653097+0000","last_change":"2024-09-10T21:13:18.656571+0000","last_active":"2024-09-10T21:13:19.653097+0000","last_peered":"2024-09-10T21:13:19.653097+0000","last_clean":"2024-09-10T21:13:19.653097+0000","last_became_active":"2024-09-10T21:13:18.656253+0000","last_became_peered":"2024-09-10T21:13:18.656253+0000","last_unstale":"2024-09-10T21:13:19.653097+0000","last_undegraded":"2024-09-10T21:13:19.653097+0000","last_fullsized":"2024-09-10T21:13:19.653097+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:57.848566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.950426+0000","last_change":"2024-09-10T21:13:16.631750+0000","last_active":"2024-09-10T21:13:29.950426+0000","last_peered":"2024-09-10T21:13:29.950426+0000","last_clean":"2024-09-10T21:13:29.950426+0000","last_became_active":"2024-09-10T21:13:16.631245+0000","last_became_peered":"2024-09-10T21:13:16.631245+0000","last_unstale":"2024-09-10T21:13:29.950426+0000","last_undegraded":"2024-09-10T21:13:29.950426+0000","last_fullsized":"2024-09-10T21:13:29.950426+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:28.787751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652245+0000","last_change":"2024-09-10T21:13:18.660834+0000","last_active":"2024-09-10T21:13:19.652245+0000","last_peered":"2024-09-10T21:13:19.652245+0000","last_clean":"2024-09-10T21:13:19.652245+0000","last_became_active":"2024-09-10T21:13:18.660461+0000","last_became_peered":"2024-09-10T21:13:18.660461+0000","last_unstale":"2024-09-10T21:13:19.652245+0000","last_undegraded":"2024-09-10T21:13:19.652245+0000","last_fullsized":"2024-09-10T21:13:19.652245+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:55.531199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'5","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:39.970359+0000","last_change":"2024-09-10T21:13:16.726824+0000","last_active":"2024-09-10T21:13:39.970359+0000","last_peered":"2024-09-10T21:13:39.970359+0000","last_clean":"2024-09-10T21:13:39.970359+0000","last_became_active":"2024-09-10T21:13:16.726436+0000","last_became_peered":"2024-09-10T21:13:16.726436+0000","last_unstale":"2024-09-10T21:13:39.970359+0000","last_undegraded":"2024-09-10T21:13:39.970359+0000","last_fullsized":"2024-09-10T21:13:39.970359+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:49.391388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653044+0000","last_change":"2024-09-10T21:13:18.663725+0000","last_active":"2024-09-10T21:13:19.653044+0000","last_peered":"2024-09-10T21:13:19.653044+0000","last_clean":"2024-09-10T21:13:19.653044+0000","last_became_active":"2024-09-10T21:13:18.663254+0000","last_became_peered":"2024-09-10T21:13:18.663254+0000","last_unstale":"2024-09-10T21:13:19.653044+0000","last_undegraded":"2024-09-10T21:13:19.653044+0000","last_fullsized":"2024-09-10T21:13:19.653044+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:19.672231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":92,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652031+0000","last_change":"2024-09-10T21:12:08.173849+0000","last_active":"2024-09-10T21:13:19.652031+0000","last_peered":"2024-09-10T21:13:19.652031+0000","last_clean":"2024-09-10T21:13:19.652031+0000","last_became_active":"2024-09-10T21:12:08.153630+0000","last_became_peered":"2024-09-10T21:12:08.153630+0000","last_unstale":"2024-09-10T21:13:19.652031+0000","last_undegraded":"2024-09-10T21:13:19.652031+0000","last_fullsized":"2024-09-10T21:13:19.652031+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:08:47.842259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:08:47.842259+0000","last_clean_scrub_stamp":"2024-09-10T21:08:47.842259+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:39.166390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:30.953368+0000","last_change":"2024-09-10T21:13:16.628607+0000","last_active":"2024-09-10T21:13:30.953368+0000","last_peered":"2024-09-10T21:13:30.953368+0000","last_clean":"2024-09-10T21:13:30.953368+0000","last_became_active":"2024-09-10T21:13:16.627736+0000","last_became_peered":"2024-09-10T21:13:16.627736+0000","last_unstale":"2024-09-10T21:13:30.953368+0000","last_undegraded":"2024-09-10T21:13:30.953368+0000","last_fullsized":"2024-09-10T21:13:30.953368+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:16.388832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.655361+0000","last_change":"2024-09-10T21:13:18.652634+0000","last_active":"2024-09-10T21:13:19.655361+0000","last_peered":"2024-09-10T21:13:19.655361+0000","last_clean":"2024-09-10T21:13:19.655361+0000","last_became_active":"2024-09-10T21:13:18.652325+0000","last_became_peered":"2024-09-10T21:13:18.652325+0000","last_unstale":"2024-09-10T21:13:19.655361+0000","last_undegraded":"2024-09-10T21:13:19.655361+0000","last_fullsized":"2024-09-10T21:13:19.655361+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:16.382355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:27.936067+0000","last_change":"2024-09-10T21:13:16.631442+0000","last_active":"2024-09-10T21:13:27.936067+0000","last_peered":"2024-09-10T21:13:27.936067+0000","last_clean":"2024-09-10T21:13:27.936067+0000","last_became_active":"2024-09-10T21:13:16.631117+0000","last_became_peered":"2024-09-10T21:13:16.631117+0000","last_unstale":"2024-09-10T21:13:27.936067+0000","last_undegraded":"2024-09-10T21:13:27.936067+0000","last_fullsized":"2024-09-10T21:13:27.936067+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:35.376888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.641087+0000","last_change":"2024-09-10T21:13:18.644246+0000","last_active":"2024-09-10T21:13:19.641087+0000","last_peered":"2024-09-10T21:13:19.641087+0000","last_clean":"2024-09-10T21:13:19.641087+0000","last_became_active":"2024-09-10T21:13:18.643944+0000","last_became_peered":"2024-09-10T21:13:18.643944+0000","last_unstale":"2024-09-10T21:13:19.641087+0000","last_undegraded":"2024-09-10T21:13:19.641087+0000","last_fullsized":"2024-09-10T21:13:19.641087+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:18.856149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":33,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:36.965100+0000","last_change":"2024-09-10T21:13:16.726716+0000","last_active":"2024-09-10T21:13:36.965100+0000","last_peered":"2024-09-10T21:13:36.965100+0000","last_clean":"2024-09-10T21:13:36.965100+0000","last_became_active":"2024-09-10T21:13:16.726400+0000","last_became_peered":"2024-09-10T21:13:16.726400+0000","last_unstale":"2024-09-10T21:13:36.965100+0000","last_undegraded":"2024-09-10T21:13:36.965100+0000","last_fullsized":"2024-09-10T21:13:36.965100+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:55.643495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.641253+0000","last_change":"2024-09-10T21:13:18.660350+0000","last_active":"2024-09-10T21:13:19.641253+0000","last_peered":"2024-09-10T21:13:19.641253+0000","last_clean":"2024-09-10T21:13:19.641253+0000","last_became_active":"2024-09-10T21:13:18.659581+0000","last_became_peered":"2024-09-10T21:13:18.659581+0000","last_unstale":"2024-09-10T21:13:19.641253+0000","last_undegraded":"2024-09-10T21:13:19.641253+0000","last_fullsized":"2024-09-10T21:13:19.641253+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:46.127656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'5","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:40.971565+0000","last_change":"2024-09-10T21:13:16.633126+0000","last_active":"2024-09-10T21:13:40.971565+0000","last_peered":"2024-09-10T21:13:40.971565+0000","last_clean":"2024-09-10T21:13:40.971565+0000","last_became_active":"2024-09-10T21:13:16.632808+0000","last_became_peered":"2024-09-10T21:13:16.632808+0000","last_unstale":"2024-09-10T21:13:40.971565+0000","last_undegraded":"2024-09-10T21:13:40.971565+0000","last_fullsized":"2024-09-10T21:13:40.971565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:01.026506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653017+0000","last_change":"2024-09-10T21:13:18.652631+0000","last_active":"2024-09-10T21:13:19.653017+0000","last_peered":"2024-09-10T21:13:19.653017+0000","last_clean":"2024-09-10T21:13:19.653017+0000","last_became_active":"2024-09-10T21:13:18.650580+0000","last_became_peered":"2024-09-10T21:13:18.650580+0000","last_unstale":"2024-09-10T21:13:19.653017+0000","last_undegraded":"2024-09-10T21:13:19.653017+0000","last_fullsized":"2024-09-10T21:13:19.653017+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:32.733169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652274+0000","last_change":"2024-09-10T21:13:16.728172+0000","last_active":"2024-09-10T21:13:19.652274+0000","last_peered":"2024-09-10T21:13:19.652274+0000","last_clean":"2024-09-10T21:13:19.652274+0000","last_became_active":"2024-09-10T21:13:16.727793+0000","last_became_peered":"2024-09-10T21:13:16.727793+0000","last_unstale":"2024-09-10T21:13:19.652274+0000","last_undegraded":"2024-09-10T21:13:19.652274+0000","last_fullsized":"2024-09-10T21:13:19.652274+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:58:04.301119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:20.848461+0000","last_change":"2024-09-10T21:13:18.655371+0000","last_active":"2024-09-10T21:13:20.848461+0000","last_peered":"2024-09-10T21:13:20.848461+0000","last_clean":"2024-09-10T21:13:20.848461+0000","last_became_active":"2024-09-10T21:13:18.653250+0000","last_became_peered":"2024-09-10T21:13:18.653250+0000","last_unstale":"2024-09-10T21:13:20.848461+0000","last_undegraded":"2024-09-10T21:13:20.848461+0000","last_fullsized":"2024-09-10T21:13:20.848461+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:25.650736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.950915+0000","last_change":"2024-09-10T21:13:16.726816+0000","last_active":"2024-09-10T21:13:29.950915+0000","last_peered":"2024-09-10T21:13:29.950915+0000","last_clean":"2024-09-10T21:13:29.950915+0000","last_became_active":"2024-09-10T21:13:16.726438+0000","last_became_peered":"2024-09-10T21:13:16.726438+0000","last_unstale":"2024-09-10T21:13:29.950915+0000","last_undegraded":"2024-09-10T21:13:29.950915+0000","last_fullsized":"2024-09-10T21:13:29.950915+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:46.384899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.641594+0000","last_change":"2024-09-10T21:13:18.643424+0000","last_active":"2024-09-10T21:13:19.641594+0000","last_peered":"2024-09-10T21:13:19.641594+0000","last_clean":"2024-09-10T21:13:19.641594+0000","last_became_active":"2024-09-10T21:13:18.643010+0000","last_became_peered":"2024-09-10T21:13:18.643010+0000","last_unstale":"2024-09-10T21:13:19.641594+0000","last_undegraded":"2024-09-10T21:13:19.641594+0000","last_fullsized":"2024-09-10T21:13:19.641594+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:47.358129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'10","reported_seq":29,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:34.650824+0000","last_change":"2024-09-10T21:13:16.628900+0000","last_active":"2024-09-10T21:13:34.650824+0000","last_peered":"2024-09-10T21:13:34.650824+0000","last_clean":"2024-09-10T21:13:34.650824+0000","last_became_active":"2024-09-10T21:13:16.628535+0000","last_became_peered":"2024-09-10T21:13:16.628535+0000","last_unstale":"2024-09-10T21:13:34.650824+0000","last_undegraded":"2024-09-10T21:13:34.650824+0000","last_fullsized":"2024-09-10T21:13:34.650824+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:32:48.399519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.655274+0000","last_change":"2024-09-10T21:13:18.652347+0000","last_active":"2024-09-10T21:13:19.655274+0000","last_peered":"2024-09-10T21:13:19.655274+0000","last_clean":"2024-09-10T21:13:19.655274+0000","last_became_active":"2024-09-10T21:13:18.651942+0000","last_became_peered":"2024-09-10T21:13:18.651942+0000","last_unstale":"2024-09-10T21:13:19.655274+0000","last_undegraded":"2024-09-10T21:13:19.655274+0000","last_fullsized":"2024-09-10T21:13:19.655274+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:11.356787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.949840+0000","last_change":"2024-09-10T21:13:16.621647+0000","last_active":"2024-09-10T21:13:29.949840+0000","last_peered":"2024-09-10T21:13:29.949840+0000","last_clean":"2024-09-10T21:13:29.949840+0000","last_became_active":"2024-09-10T21:13:16.621316+0000","last_became_peered":"2024-09-10T21:13:16.621316+0000","last_unstale":"2024-09-10T21:13:29.949840+0000","last_undegraded":"2024-09-10T21:13:29.949840+0000","last_fullsized":"2024-09-10T21:13:29.949840+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:10.264578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652749+0000","last_change":"2024-09-10T21:13:18.656617+0000","last_active":"2024-09-10T21:13:19.652749+0000","last_peered":"2024-09-10T21:13:19.652749+0000","last_clean":"2024-09-10T21:13:19.652749+0000","last_became_active":"2024-09-10T21:13:18.656331+0000","last_became_peered":"2024-09-10T21:13:18.656331+0000","last_unstale":"2024-09-10T21:13:19.652749+0000","last_undegraded":"2024-09-10T21:13:19.652749+0000","last_fullsized":"2024-09-10T21:13:19.652749+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:44.482797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:26.928217+0000","last_change":"2024-09-10T21:13:16.727736+0000","last_active":"2024-09-10T21:13:26.928217+0000","last_peered":"2024-09-10T21:13:26.928217+0000","last_clean":"2024-09-10T21:13:26.928217+0000","last_became_active":"2024-09-10T21:13:16.727413+0000","last_became_peered":"2024-09-10T21:13:16.727413+0000","last_unstale":"2024-09-10T21:13:26.928217+0000","last_undegraded":"2024-09-10T21:13:26.928217+0000","last_fullsized":"2024-09-10T21:13:26.928217+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:26.351729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652100+0000","last_change":"2024-09-10T21:13:18.660100+0000","last_active":"2024-09-10T21:13:19.652100+0000","last_peered":"2024-09-10T21:13:19.652100+0000","last_clean":"2024-09-10T21:13:19.652100+0000","last_became_active":"2024-09-10T21:13:18.659733+0000","last_became_peered":"2024-09-10T21:13:18.659733+0000","last_unstale":"2024-09-10T21:13:19.652100+0000","last_undegraded":"2024-09-10T21:13:19.652100+0000","last_fullsized":"2024-09-10T21:13:19.652100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:44.371627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.948231+0000","last_change":"2024-09-10T21:13:16.627194+0000","last_active":"2024-09-10T21:13:29.948231+0000","last_peered":"2024-09-10T21:13:29.948231+0000","last_clean":"2024-09-10T21:13:29.948231+0000","last_became_active":"2024-09-10T21:13:16.626805+0000","last_became_peered":"2024-09-10T21:13:16.626805+0000","last_unstale":"2024-09-10T21:13:29.948231+0000","last_undegraded":"2024-09-10T21:13:29.948231+0000","last_fullsized":"2024-09-10T21:13:29.948231+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:33.582084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653253+0000","last_change":"2024-09-10T21:13:18.663122+0000","last_active":"2024-09-10T21:13:19.653253+0000","last_peered":"2024-09-10T21:13:19.653253+0000","last_clean":"2024-09-10T21:13:19.653253+0000","last_became_active":"2024-09-10T21:13:18.662673+0000","last_became_peered":"2024-09-10T21:13:18.662673+0000","last_unstale":"2024-09-10T21:13:19.653253+0000","last_undegraded":"2024-09-10T21:13:19.653253+0000","last_fullsized":"2024-09-10T21:13:19.653253+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:15.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:28.943470+0000","last_change":"2024-09-10T21:13:16.635008+0000","last_active":"2024-09-10T21:13:28.943470+0000","last_peered":"2024-09-10T21:13:28.943470+0000","last_clean":"2024-09-10T21:13:28.943470+0000","last_became_active":"2024-09-10T21:13:16.631954+0000","last_became_peered":"2024-09-10T21:13:16.631954+0000","last_unstale":"2024-09-10T21:13:28.943470+0000","last_undegraded":"2024-09-10T21:13:28.943470+0000","last_fullsized":"2024-09-10T21:13:28.943470+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:21.587883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652488+0000","last_change":"2024-09-10T21:13:18.656400+0000","last_active":"2024-09-10T21:13:19.652488+0000","last_peered":"2024-09-10T21:13:19.652488+0000","last_clean":"2024-09-10T21:13:19.652488+0000","last_became_active":"2024-09-10T21:13:18.655802+0000","last_became_peered":"2024-09-10T21:13:18.655802+0000","last_unstale":"2024-09-10T21:13:19.652488+0000","last_undegraded":"2024-09-10T21:13:19.652488+0000","last_fullsized":"2024-09-10T21:13:19.652488+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:41.901404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:26.929295+0000","last_change":"2024-09-10T21:13:16.632620+0000","last_active":"2024-09-10T21:13:26.929295+0000","last_peered":"2024-09-10T21:13:26.929295+0000","last_clean":"2024-09-10T21:13:26.929295+0000","last_became_active":"2024-09-10T21:13:16.632263+0000","last_became_peered":"2024-09-10T21:13:16.632263+0000","last_unstale":"2024-09-10T21:13:26.929295+0000","last_undegraded":"2024-09-10T21:13:26.929295+0000","last_fullsized":"2024-09-10T21:13:26.929295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:14.840545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652263+0000","last_change":"2024-09-10T21:13:18.664331+0000","last_active":"2024-09-10T21:13:19.652263+0000","last_peered":"2024-09-10T21:13:19.652263+0000","last_clean":"2024-09-10T21:13:19.652263+0000","last_became_active":"2024-09-10T21:13:18.663823+0000","last_became_peered":"2024-09-10T21:13:18.663823+0000","last_unstale":"2024-09-10T21:13:19.652263+0000","last_undegraded":"2024-09-10T21:13:19.652263+0000","last_fullsized":"2024-09-10T21:13:19.652263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:37.626712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.640975+0000","last_change":"2024-09-10T21:13:18.659941+0000","last_active":"2024-09-10T21:13:19.640975+0000","last_peered":"2024-09-10T21:13:19.640975+0000","last_clean":"2024-09-10T21:13:19.640975+0000","last_became_active":"2024-09-10T21:13:18.659019+0000","last_became_peered":"2024-09-10T21:13:18.659019+0000","last_unstale":"2024-09-10T21:13:19.640975+0000","last_undegraded":"2024-09-10T21:13:19.640975+0000","last_fullsized":"2024-09-10T21:13:19.640975+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:41.037722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.950223+0000","last_change":"2024-09-10T21:13:16.633660+0000","last_active":"2024-09-10T21:13:29.950223+0000","last_peered":"2024-09-10T21:13:29.950223+0000","last_clean":"2024-09-10T21:13:29.950223+0000","last_became_active":"2024-09-10T21:13:16.633222+0000","last_became_peered":"2024-09-10T21:13:16.633222+0000","last_unstale":"2024-09-10T21:13:29.950223+0000","last_undegraded":"2024-09-10T21:13:29.950223+0000","last_fullsized":"2024-09-10T21:13:29.950223+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:56.364355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.656363+0000","last_change":"2024-09-10T21:13:18.666837+0000","last_active":"2024-09-10T21:13:19.656363+0000","last_peered":"2024-09-10T21:13:19.656363+0000","last_clean":"2024-09-10T21:13:19.656363+0000","last_became_active":"2024-09-10T21:13:18.666382+0000","last_became_peered":"2024-09-10T21:13:18.666382+0000","last_unstale":"2024-09-10T21:13:19.656363+0000","last_undegraded":"2024-09-10T21:13:19.656363+0000","last_fullsized":"2024-09-10T21:13:19.656363+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:32.225130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":32,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:30.946463+0000","last_change":"2024-09-10T21:13:16.631424+0000","last_active":"2024-09-10T21:13:30.946463+0000","last_peered":"2024-09-10T21:13:30.946463+0000","last_clean":"2024-09-10T21:13:30.946463+0000","last_became_active":"2024-09-10T21:13:16.631116+0000","last_became_peered":"2024-09-10T21:13:16.631116+0000","last_unstale":"2024-09-10T21:13:30.946463+0000","last_undegraded":"2024-09-10T21:13:30.946463+0000","last_fullsized":"2024-09-10T21:13:30.946463+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:15.506410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652721+0000","last_change":"2024-09-10T21:13:18.654978+0000","last_active":"2024-09-10T21:13:19.652721+0000","last_peered":"2024-09-10T21:13:19.652721+0000","last_clean":"2024-09-10T21:13:19.652721+0000","last_became_active":"2024-09-10T21:13:18.654581+0000","last_became_peered":"2024-09-10T21:13:18.654581+0000","last_unstale":"2024-09-10T21:13:19.652721+0000","last_undegraded":"2024-09-10T21:13:19.652721+0000","last_fullsized":"2024-09-10T21:13:19.652721+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:17.504626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.658026+0000","last_change":"2024-09-10T21:13:16.726727+0000","last_active":"2024-09-10T21:13:19.658026+0000","last_peered":"2024-09-10T21:13:19.658026+0000","last_clean":"2024-09-10T21:13:19.658026+0000","last_became_active":"2024-09-10T21:13:16.726373+0000","last_became_peered":"2024-09-10T21:13:16.726373+0000","last_unstale":"2024-09-10T21:13:19.658026+0000","last_undegraded":"2024-09-10T21:13:19.658026+0000","last_fullsized":"2024-09-10T21:13:19.658026+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:31.803631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.654113+0000","last_change":"2024-09-10T21:13:18.648384+0000","last_active":"2024-09-10T21:13:19.654113+0000","last_peered":"2024-09-10T21:13:19.654113+0000","last_clean":"2024-09-10T21:13:19.654113+0000","last_became_active":"2024-09-10T21:13:18.647911+0000","last_became_peered":"2024-09-10T21:13:18.647911+0000","last_unstale":"2024-09-10T21:13:19.654113+0000","last_undegraded":"2024-09-10T21:13:19.654113+0000","last_fullsized":"2024-09-10T21:13:19.654113+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:02.582548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":41,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:36.967191+0000","last_change":"2024-09-10T21:13:16.631501+0000","last_active":"2024-09-10T21:13:36.967191+0000","last_peered":"2024-09-10T21:13:36.967191+0000","last_clean":"2024-09-10T21:13:36.967191+0000","last_became_active":"2024-09-10T21:13:16.631246+0000","last_became_peered":"2024-09-10T21:13:16.631246+0000","last_unstale":"2024-09-10T21:13:36.967191+0000","last_undegraded":"2024-09-10T21:13:36.967191+0000","last_fullsized":"2024-09-10T21:13:36.967191+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:25.277370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56923,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":139,"num_read_kb":128,"num_write":229,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":170769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808849,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":790528,"data_stored":376852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005077,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28472,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716680,"statfs":{"total":95995035648,"available":95965880320,"internally_reserved":0,"allocated":1482752,"data_stored":1017991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135898,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":376782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332128,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36136,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709016,"statfs":{"total":95995035648,"available":95958032384,"internally_reserved":0,"allocated":811008,"data_stored":377160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528357,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28400,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716752,"statfs":{"total":95995035648,"available":95965954048,"internally_reserved":0,"allocated":1409024,"data_stored":969678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659177,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36124,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709028,"statfs":{"total":95995035648,"available":95958044672,"internally_reserved":0,"allocated":798720,"data_stored":376499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855407,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28412,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716740,"statfs":{"total":95995035648,"available":95965941760,"internally_reserved":0,"allocated":1421312,"data_stored":969356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018931,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717348,"statfs":{"total":95995035648,"available":95966564352,"internally_reserved":0,"allocated":798720,"data_stored":376360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":376324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":428133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":427522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36144,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709008,"statfs":{"total":95995035648,"available":95958024192,"internally_reserved":0,"allocated":819200,"data_stored":377838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":51862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":52473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":51846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:13:44.711 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T21:13:44.972 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:45.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:44 smithi192 ceph-mon[35363]: pgmap v292: 97 pgs: 97 active+clean; 632 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 21 op/s 2024-09-10T21:13:45.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:44 smithi192 ceph-mon[35363]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:13:45.336 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:44 smithi059 ceph-mon[30888]: pgmap v292: 97 pgs: 97 active+clean; 632 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 21 op/s 2024-09-10T21:13:45.336 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:44 smithi059 ceph-mon[30888]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:13:45.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.413+0000 7f48c6c2a640 1 -- 172.21.15.59:0/4255179777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48c0108020 msgr2=0x7f48c010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:45.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.413+0000 7f48c6c2a640 1 --2- 172.21.15.59:0/4255179777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48c0108020 0x7f48c010e820 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f48b8009ca0 tx=0x7f48b802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:13:45.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.413+0000 7f48c6c2a640 1 -- 172.21.15.59:0/4255179777 shutdown_connections 2024-09-10T21:13:45.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.413+0000 7f48c6c2a640 1 --2- 172.21.15.59:0/4255179777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48c0108020 0x7f48c010e820 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:45.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.413+0000 7f48c6c2a640 1 --2- 172.21.15.59:0/4255179777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48c01076a0 0x7f48c0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:45.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.413+0000 7f48c6c2a640 1 --2- 172.21.15.59:0/4255179777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c0101c90 0x7f48c0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:45.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.413+0000 7f48c6c2a640 1 -- 172.21.15.59:0/4255179777 >> 172.21.15.59:0/4255179777 conn(0x7f48c00fd700 msgr2=0x7f48c00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:45.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.413+0000 7f48c6c2a640 1 -- 172.21.15.59:0/4255179777 shutdown_connections 2024-09-10T21:13:45.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.413+0000 7f48c6c2a640 1 -- 172.21.15.59:0/4255179777 wait complete. 2024-09-10T21:13:45.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.414+0000 7f48c6c2a640 1 Processor -- start 2024-09-10T21:13:45.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.414+0000 7f48c6c2a640 1 -- start start 2024-09-10T21:13:45.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.414+0000 7f48c6c2a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48c0101c90 0x7f48c00fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:45.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.414+0000 7f48c6c2a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48c01076a0 0x7f48c00fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:45.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.414+0000 7f48c6c2a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c0108020 0x7f48c00fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:45.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.414+0000 7f48c6c2a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f48c0111d30 con 0x7f48c0101c90 2024-09-10T21:13:45.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.414+0000 7f48c6c2a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f48c0111bb0 con 0x7f48c0108020 2024-09-10T21:13:45.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.414+0000 7f48c6c2a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f48c0111eb0 con 0x7f48c01076a0 2024-09-10T21:13:45.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.414+0000 7f48c49c6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48c0101c90 0x7f48c00fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:45.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.414+0000 7f48c49c6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48c0101c90 0x7f48c00fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36608/0 (socket says 172.21.15.59:36608) 2024-09-10T21:13:45.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.414+0000 7f48c49c6640 1 -- 172.21.15.59:0/2905614226 learned_addr learned my addr 172.21.15.59:0/2905614226 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:45.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.414+0000 7f48c51c7640 1 --2- 172.21.15.59:0/2905614226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c0108020 0x7f48c00fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:45.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.414+0000 7f48c49c6640 1 -- 172.21.15.59:0/2905614226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48c01076a0 msgr2=0x7f48c00fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:45.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.414+0000 7f48c49c6640 1 --2- 172.21.15.59:0/2905614226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48c01076a0 0x7f48c00fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:45.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.414+0000 7f48c49c6640 1 -- 172.21.15.59:0/2905614226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c0108020 msgr2=0x7f48c00fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:45.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.414+0000 7f48c49c6640 1 --2- 172.21.15.59:0/2905614226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c0108020 0x7f48c00fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:45.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.414+0000 7f48c49c6640 1 -- 172.21.15.59:0/2905614226 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c01a7670 con 0x7f48c0101c90 2024-09-10T21:13:45.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.414+0000 7f48c51c7640 1 --2- 172.21.15.59:0/2905614226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c0108020 0x7f48c00fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:13:45.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.415+0000 7f48c49c6640 1 --2- 172.21.15.59:0/2905614226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48c0101c90 0x7f48c00fdc00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f48b000b4a0 tx=0x7f48b000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:45.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.415+0000 7f48bdffb640 1 -- 172.21.15.59:0/2905614226 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b0014070 con 0x7f48c0101c90 2024-09-10T21:13:45.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.415+0000 7f48bdffb640 1 -- 172.21.15.59:0/2905614226 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48b0010ac0 con 0x7f48c0101c90 2024-09-10T21:13:45.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.415+0000 7f48c6c2a640 1 -- 172.21.15.59:0/2905614226 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48c01a7960 con 0x7f48c0101c90 2024-09-10T21:13:45.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.415+0000 7f48bdffb640 1 -- 172.21.15.59:0/2905614226 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b0017c30 con 0x7f48c0101c90 2024-09-10T21:13:45.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.415+0000 7f48c6c2a640 1 -- 172.21.15.59:0/2905614226 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48c01a7f20 con 0x7f48c0101c90 2024-09-10T21:13:45.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.416+0000 7f48c6c2a640 1 -- 172.21.15.59:0/2905614226 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48c0102070 con 0x7f48c0101c90 2024-09-10T21:13:45.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.417+0000 7f48bdffb640 1 -- 172.21.15.59:0/2905614226 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f48b0010610 con 0x7f48c0101c90 2024-09-10T21:13:45.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.418+0000 7f48bdffb640 1 --2- 172.21.15.59:0/2905614226 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f48ac0b5370 0x7f48ac0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:45.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.418+0000 7f48bdffb640 1 -- 172.21.15.59:0/2905614226 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f48b00e54d0 con 0x7f48c0101c90 2024-09-10T21:13:45.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.418+0000 7f48bffff640 1 --2- 172.21.15.59:0/2905614226 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f48ac0b5370 0x7f48ac0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:45.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.418+0000 7f48bffff640 1 --2- 172.21.15.59:0/2905614226 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f48ac0b5370 0x7f48ac0b7830 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f48c00ff6f0 tx=0x7f48a8005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:45.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.421+0000 7f48bdffb640 1 -- 172.21.15.59:0/2905614226 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f48b00ac3e0 con 0x7f48c0101c90 2024-09-10T21:13:45.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:44 smithi154 ceph-mon[35041]: pgmap v292: 97 pgs: 97 active+clean; 632 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 21 op/s 2024-09-10T21:13:45.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:44 smithi154 ceph-mon[35041]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:13:45.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.603+0000 7f48c6c2a640 1 -- 172.21.15.59:0/2905614226 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f48c01002d0 con 0x7f48ac0b5370 2024-09-10T21:13:45.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.607+0000 7f48bdffb640 1 -- 172.21.15.59:0/2905614226 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258740 (secure 0 0 0) 0x7f48c01002d0 con 0x7f48ac0b5370 2024-09-10T21:13:45.613 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:13:45.614 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-10T21:13:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.611+0000 7f48c6c2a640 1 -- 172.21.15.59:0/2905614226 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f48ac0b5370 msgr2=0x7f48ac0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.611+0000 7f48c6c2a640 1 --2- 172.21.15.59:0/2905614226 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f48ac0b5370 0x7f48ac0b7830 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f48c00ff6f0 tx=0x7f48a8005c70 comp rx=0 tx=0).stop 2024-09-10T21:13:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.611+0000 7f48c6c2a640 1 -- 172.21.15.59:0/2905614226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48c0101c90 msgr2=0x7f48c00fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.611+0000 7f48c6c2a640 1 --2- 172.21.15.59:0/2905614226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48c0101c90 0x7f48c00fdc00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f48b000b4a0 tx=0x7f48b000b960 comp rx=0 tx=0).stop 2024-09-10T21:13:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.611+0000 7f48c6c2a640 1 -- 172.21.15.59:0/2905614226 shutdown_connections 2024-09-10T21:13:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.611+0000 7f48c6c2a640 1 --2- 172.21.15.59:0/2905614226 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f48ac0b5370 0x7f48ac0b7830 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.611+0000 7f48c6c2a640 1 --2- 172.21.15.59:0/2905614226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48c0108020 0x7f48c00fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.611+0000 7f48c6c2a640 1 --2- 172.21.15.59:0/2905614226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48c01076a0 0x7f48c00fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.611+0000 7f48c6c2a640 1 --2- 172.21.15.59:0/2905614226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48c0101c90 0x7f48c00fdc00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.611+0000 7f48c6c2a640 1 -- 172.21.15.59:0/2905614226 >> 172.21.15.59:0/2905614226 conn(0x7f48c00fd700 msgr2=0x7f48c006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.611+0000 7f48c6c2a640 1 -- 172.21.15.59:0/2905614226 shutdown_connections 2024-09-10T21:13:45.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:45.611+0000 7f48c6c2a640 1 -- 172.21.15.59:0/2905614226 wait complete. 2024-09-10T21:13:46.406 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-09-10T21:13:45.231131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647525,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":225,"num_read_kb":202,"num_write":361,"num_write_kb":2272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":297,"ondisk_log_size":297,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364820,"kb_used_data":11412,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577004,"statfs":{"total":1151940427776,"available":1151566852096,"internally_reserved":0,"allocated":11685888,"data_stored":6450495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49235,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":114,"num_read_kb":110,"num_write":49,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003218"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.654813+0000","last_change":"2024-09-10T21:13:18.656166+0000","last_active":"2024-09-10T21:13:19.654813+0000","last_peered":"2024-09-10T21:13:19.654813+0000","last_clean":"2024-09-10T21:13:19.654813+0000","last_became_active":"2024-09-10T21:13:18.655774+0000","last_became_peered":"2024-09-10T21:13:18.655774+0000","last_unstale":"2024-09-10T21:13:19.654813+0000","last_undegraded":"2024-09-10T21:13:19.654813+0000","last_fullsized":"2024-09-10T21:13:19.654813+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:57.775209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652510+0000","last_change":"2024-09-10T21:13:18.654232+0000","last_active":"2024-09-10T21:13:19.652510+0000","last_peered":"2024-09-10T21:13:19.652510+0000","last_clean":"2024-09-10T21:13:19.652510+0000","last_became_active":"2024-09-10T21:13:18.653928+0000","last_became_peered":"2024-09-10T21:13:18.653928+0000","last_unstale":"2024-09-10T21:13:19.652510+0000","last_undegraded":"2024-09-10T21:13:19.652510+0000","last_fullsized":"2024-09-10T21:13:19.652510+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:02.615686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653206+0000","last_change":"2024-09-10T21:13:18.662923+0000","last_active":"2024-09-10T21:13:19.653206+0000","last_peered":"2024-09-10T21:13:19.653206+0000","last_clean":"2024-09-10T21:13:19.653206+0000","last_became_active":"2024-09-10T21:13:18.662541+0000","last_became_peered":"2024-09-10T21:13:18.662541+0000","last_unstale":"2024-09-10T21:13:19.653206+0000","last_undegraded":"2024-09-10T21:13:19.653206+0000","last_fullsized":"2024-09-10T21:13:19.653206+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:33:11.140761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.639448+0000","last_change":"2024-09-10T21:13:18.654661+0000","last_active":"2024-09-10T21:13:19.639448+0000","last_peered":"2024-09-10T21:13:19.639448+0000","last_clean":"2024-09-10T21:13:19.639448+0000","last_became_active":"2024-09-10T21:13:18.651043+0000","last_became_peered":"2024-09-10T21:13:18.651043+0000","last_unstale":"2024-09-10T21:13:19.639448+0000","last_undegraded":"2024-09-10T21:13:19.639448+0000","last_fullsized":"2024-09-10T21:13:19.639448+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:14.743608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.651880+0000","last_change":"2024-09-10T21:13:18.650427+0000","last_active":"2024-09-10T21:13:19.651880+0000","last_peered":"2024-09-10T21:13:19.651880+0000","last_clean":"2024-09-10T21:13:19.651880+0000","last_became_active":"2024-09-10T21:13:18.650039+0000","last_became_peered":"2024-09-10T21:13:18.650039+0000","last_unstale":"2024-09-10T21:13:19.651880+0000","last_undegraded":"2024-09-10T21:13:19.651880+0000","last_fullsized":"2024-09-10T21:13:19.651880+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:11.363642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.651596+0000","last_change":"2024-09-10T21:13:18.654320+0000","last_active":"2024-09-10T21:13:19.651596+0000","last_peered":"2024-09-10T21:13:19.651596+0000","last_clean":"2024-09-10T21:13:19.651596+0000","last_became_active":"2024-09-10T21:13:18.653291+0000","last_became_peered":"2024-09-10T21:13:18.653291+0000","last_unstale":"2024-09-10T21:13:19.651596+0000","last_undegraded":"2024-09-10T21:13:19.651596+0000","last_fullsized":"2024-09-10T21:13:19.651596+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:08:28.176816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.651905+0000","last_change":"2024-09-10T21:13:18.659695+0000","last_active":"2024-09-10T21:13:19.651905+0000","last_peered":"2024-09-10T21:13:19.651905+0000","last_clean":"2024-09-10T21:13:19.651905+0000","last_became_active":"2024-09-10T21:13:18.659240+0000","last_became_peered":"2024-09-10T21:13:18.659240+0000","last_unstale":"2024-09-10T21:13:19.651905+0000","last_undegraded":"2024-09-10T21:13:19.651905+0000","last_fullsized":"2024-09-10T21:13:19.651905+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:58.951873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653892+0000","last_change":"2024-09-10T21:13:18.653832+0000","last_active":"2024-09-10T21:13:19.653892+0000","last_peered":"2024-09-10T21:13:19.653892+0000","last_clean":"2024-09-10T21:13:19.653892+0000","last_became_active":"2024-09-10T21:13:18.653539+0000","last_became_peered":"2024-09-10T21:13:18.653539+0000","last_unstale":"2024-09-10T21:13:19.653892+0000","last_undegraded":"2024-09-10T21:13:19.653892+0000","last_fullsized":"2024-09-10T21:13:19.653892+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:01:52.556202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.657038+0000","last_change":"2024-09-10T21:13:18.656252+0000","last_active":"2024-09-10T21:13:19.657038+0000","last_peered":"2024-09-10T21:13:19.657038+0000","last_clean":"2024-09-10T21:13:19.657038+0000","last_became_active":"2024-09-10T21:13:18.655879+0000","last_became_peered":"2024-09-10T21:13:18.655879+0000","last_unstale":"2024-09-10T21:13:19.657038+0000","last_undegraded":"2024-09-10T21:13:19.657038+0000","last_fullsized":"2024-09-10T21:13:19.657038+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:03.748183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.651565+0000","last_change":"2024-09-10T21:13:18.663370+0000","last_active":"2024-09-10T21:13:19.651565+0000","last_peered":"2024-09-10T21:13:19.651565+0000","last_clean":"2024-09-10T21:13:19.651565+0000","last_became_active":"2024-09-10T21:13:18.662863+0000","last_became_peered":"2024-09-10T21:13:18.662863+0000","last_unstale":"2024-09-10T21:13:19.651565+0000","last_undegraded":"2024-09-10T21:13:19.651565+0000","last_fullsized":"2024-09-10T21:13:19.651565+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:22.912596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652339+0000","last_change":"2024-09-10T21:13:18.663626+0000","last_active":"2024-09-10T21:13:19.652339+0000","last_peered":"2024-09-10T21:13:19.652339+0000","last_clean":"2024-09-10T21:13:19.652339+0000","last_became_active":"2024-09-10T21:13:18.663280+0000","last_became_peered":"2024-09-10T21:13:18.663280+0000","last_unstale":"2024-09-10T21:13:19.652339+0000","last_undegraded":"2024-09-10T21:13:19.652339+0000","last_fullsized":"2024-09-10T21:13:19.652339+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:07.874387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.639490+0000","last_change":"2024-09-10T21:13:18.660791+0000","last_active":"2024-09-10T21:13:19.639490+0000","last_peered":"2024-09-10T21:13:19.639490+0000","last_clean":"2024-09-10T21:13:19.639490+0000","last_became_active":"2024-09-10T21:13:18.660386+0000","last_became_peered":"2024-09-10T21:13:18.660386+0000","last_unstale":"2024-09-10T21:13:19.639490+0000","last_undegraded":"2024-09-10T21:13:19.639490+0000","last_fullsized":"2024-09-10T21:13:19.639490+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:37.218822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.641404+0000","last_change":"2024-09-10T21:13:18.655893+0000","last_active":"2024-09-10T21:13:19.641404+0000","last_peered":"2024-09-10T21:13:19.641404+0000","last_clean":"2024-09-10T21:13:19.641404+0000","last_became_active":"2024-09-10T21:13:18.655524+0000","last_became_peered":"2024-09-10T21:13:18.655524+0000","last_unstale":"2024-09-10T21:13:19.641404+0000","last_undegraded":"2024-09-10T21:13:19.641404+0000","last_fullsized":"2024-09-10T21:13:19.641404+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:29.734783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652528+0000","last_change":"2024-09-10T21:13:18.654359+0000","last_active":"2024-09-10T21:13:19.652528+0000","last_peered":"2024-09-10T21:13:19.652528+0000","last_clean":"2024-09-10T21:13:19.652528+0000","last_became_active":"2024-09-10T21:13:18.653983+0000","last_became_peered":"2024-09-10T21:13:18.653983+0000","last_unstale":"2024-09-10T21:13:19.652528+0000","last_undegraded":"2024-09-10T21:13:19.652528+0000","last_fullsized":"2024-09-10T21:13:19.652528+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:48.806836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652317+0000","last_change":"2024-09-10T21:13:18.650428+0000","last_active":"2024-09-10T21:13:19.652317+0000","last_peered":"2024-09-10T21:13:19.652317+0000","last_clean":"2024-09-10T21:13:19.652317+0000","last_became_active":"2024-09-10T21:13:18.650121+0000","last_became_peered":"2024-09-10T21:13:18.650121+0000","last_unstale":"2024-09-10T21:13:19.652317+0000","last_undegraded":"2024-09-10T21:13:19.652317+0000","last_fullsized":"2024-09-10T21:13:19.652317+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:15.121916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.656358+0000","last_change":"2024-09-10T21:13:18.662321+0000","last_active":"2024-09-10T21:13:19.656358+0000","last_peered":"2024-09-10T21:13:19.656358+0000","last_clean":"2024-09-10T21:13:19.656358+0000","last_became_active":"2024-09-10T21:13:18.662013+0000","last_became_peered":"2024-09-10T21:13:18.662013+0000","last_unstale":"2024-09-10T21:13:19.656358+0000","last_undegraded":"2024-09-10T21:13:19.656358+0000","last_fullsized":"2024-09-10T21:13:19.656358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:54.303375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.655033+0000","last_change":"2024-09-10T21:13:18.662549+0000","last_active":"2024-09-10T21:13:19.655033+0000","last_peered":"2024-09-10T21:13:19.655033+0000","last_clean":"2024-09-10T21:13:19.655033+0000","last_became_active":"2024-09-10T21:13:18.662230+0000","last_became_peered":"2024-09-10T21:13:18.662230+0000","last_unstale":"2024-09-10T21:13:19.655033+0000","last_undegraded":"2024-09-10T21:13:19.655033+0000","last_fullsized":"2024-09-10T21:13:19.655033+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:02.582355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652083+0000","last_change":"2024-09-10T21:13:18.654906+0000","last_active":"2024-09-10T21:13:19.652083+0000","last_peered":"2024-09-10T21:13:19.652083+0000","last_clean":"2024-09-10T21:13:19.652083+0000","last_became_active":"2024-09-10T21:13:18.654599+0000","last_became_peered":"2024-09-10T21:13:18.654599+0000","last_unstale":"2024-09-10T21:13:19.652083+0000","last_undegraded":"2024-09-10T21:13:19.652083+0000","last_fullsized":"2024-09-10T21:13:19.652083+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:34.987893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.654183+0000","last_change":"2024-09-10T21:13:18.643997+0000","last_active":"2024-09-10T21:13:19.654183+0000","last_peered":"2024-09-10T21:13:19.654183+0000","last_clean":"2024-09-10T21:13:19.654183+0000","last_became_active":"2024-09-10T21:13:18.643632+0000","last_became_peered":"2024-09-10T21:13:18.643632+0000","last_unstale":"2024-09-10T21:13:19.654183+0000","last_undegraded":"2024-09-10T21:13:19.654183+0000","last_fullsized":"2024-09-10T21:13:19.654183+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:31.234040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653513+0000","last_change":"2024-09-10T21:13:18.657079+0000","last_active":"2024-09-10T21:13:19.653513+0000","last_peered":"2024-09-10T21:13:19.653513+0000","last_clean":"2024-09-10T21:13:19.653513+0000","last_became_active":"2024-09-10T21:13:18.656741+0000","last_became_peered":"2024-09-10T21:13:18.656741+0000","last_unstale":"2024-09-10T21:13:19.653513+0000","last_undegraded":"2024-09-10T21:13:19.653513+0000","last_fullsized":"2024-09-10T21:13:19.653513+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:27.036783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.641422+0000","last_change":"2024-09-10T21:13:18.653076+0000","last_active":"2024-09-10T21:13:19.641422+0000","last_peered":"2024-09-10T21:13:19.641422+0000","last_clean":"2024-09-10T21:13:19.641422+0000","last_became_active":"2024-09-10T21:13:18.652722+0000","last_became_peered":"2024-09-10T21:13:18.652722+0000","last_unstale":"2024-09-10T21:13:19.641422+0000","last_undegraded":"2024-09-10T21:13:19.641422+0000","last_fullsized":"2024-09-10T21:13:19.641422+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:11.005632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.656914+0000","last_change":"2024-09-10T21:13:18.663340+0000","last_active":"2024-09-10T21:13:19.656914+0000","last_peered":"2024-09-10T21:13:19.656914+0000","last_clean":"2024-09-10T21:13:19.656914+0000","last_became_active":"2024-09-10T21:13:18.662981+0000","last_became_peered":"2024-09-10T21:13:18.662981+0000","last_unstale":"2024-09-10T21:13:19.656914+0000","last_undegraded":"2024-09-10T21:13:19.656914+0000","last_fullsized":"2024-09-10T21:13:19.656914+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:39.510625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652935+0000","last_change":"2024-09-10T21:13:18.651376+0000","last_active":"2024-09-10T21:13:19.652935+0000","last_peered":"2024-09-10T21:13:19.652935+0000","last_clean":"2024-09-10T21:13:19.652935+0000","last_became_active":"2024-09-10T21:13:18.650999+0000","last_became_peered":"2024-09-10T21:13:18.650999+0000","last_unstale":"2024-09-10T21:13:19.652935+0000","last_undegraded":"2024-09-10T21:13:19.652935+0000","last_fullsized":"2024-09-10T21:13:19.652935+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:12.268120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.641236+0000","last_change":"2024-09-10T21:13:18.648634+0000","last_active":"2024-09-10T21:13:19.641236+0000","last_peered":"2024-09-10T21:13:19.641236+0000","last_clean":"2024-09-10T21:13:19.641236+0000","last_became_active":"2024-09-10T21:13:18.648099+0000","last_became_peered":"2024-09-10T21:13:18.648099+0000","last_unstale":"2024-09-10T21:13:19.641236+0000","last_undegraded":"2024-09-10T21:13:19.641236+0000","last_fullsized":"2024-09-10T21:13:19.641236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:47.570132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652650+0000","last_change":"2024-09-10T21:13:18.660188+0000","last_active":"2024-09-10T21:13:19.652650+0000","last_peered":"2024-09-10T21:13:19.652650+0000","last_clean":"2024-09-10T21:13:19.652650+0000","last_became_active":"2024-09-10T21:13:18.659821+0000","last_became_peered":"2024-09-10T21:13:18.659821+0000","last_unstale":"2024-09-10T21:13:19.652650+0000","last_undegraded":"2024-09-10T21:13:19.652650+0000","last_fullsized":"2024-09-10T21:13:19.652650+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:36.456852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.655677+0000","last_change":"2024-09-10T21:13:18.656727+0000","last_active":"2024-09-10T21:13:19.655677+0000","last_peered":"2024-09-10T21:13:19.655677+0000","last_clean":"2024-09-10T21:13:19.655677+0000","last_became_active":"2024-09-10T21:13:18.654627+0000","last_became_peered":"2024-09-10T21:13:18.654627+0000","last_unstale":"2024-09-10T21:13:19.655677+0000","last_undegraded":"2024-09-10T21:13:19.655677+0000","last_fullsized":"2024-09-10T21:13:19.655677+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:42.838893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.654359+0000","last_change":"2024-09-10T21:13:18.660113+0000","last_active":"2024-09-10T21:13:19.654359+0000","last_peered":"2024-09-10T21:13:19.654359+0000","last_clean":"2024-09-10T21:13:19.654359+0000","last_became_active":"2024-09-10T21:13:18.659668+0000","last_became_peered":"2024-09-10T21:13:18.659668+0000","last_unstale":"2024-09-10T21:13:19.654359+0000","last_undegraded":"2024-09-10T21:13:19.654359+0000","last_fullsized":"2024-09-10T21:13:19.654359+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:43.733431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.641500+0000","last_change":"2024-09-10T21:13:18.648015+0000","last_active":"2024-09-10T21:13:19.641500+0000","last_peered":"2024-09-10T21:13:19.641500+0000","last_clean":"2024-09-10T21:13:19.641500+0000","last_became_active":"2024-09-10T21:13:18.647661+0000","last_became_peered":"2024-09-10T21:13:18.647661+0000","last_unstale":"2024-09-10T21:13:19.641500+0000","last_undegraded":"2024-09-10T21:13:19.641500+0000","last_fullsized":"2024-09-10T21:13:19.641500+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:22.543217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653081+0000","last_change":"2024-09-10T21:13:18.657728+0000","last_active":"2024-09-10T21:13:19.653081+0000","last_peered":"2024-09-10T21:13:19.653081+0000","last_clean":"2024-09-10T21:13:19.653081+0000","last_became_active":"2024-09-10T21:13:18.657372+0000","last_became_peered":"2024-09-10T21:13:18.657372+0000","last_unstale":"2024-09-10T21:13:19.653081+0000","last_undegraded":"2024-09-10T21:13:19.653081+0000","last_fullsized":"2024-09-10T21:13:19.653081+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:43.621668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652122+0000","last_change":"2024-09-10T21:13:18.648380+0000","last_active":"2024-09-10T21:13:19.652122+0000","last_peered":"2024-09-10T21:13:19.652122+0000","last_clean":"2024-09-10T21:13:19.652122+0000","last_became_active":"2024-09-10T21:13:18.647871+0000","last_became_peered":"2024-09-10T21:13:18.647871+0000","last_unstale":"2024-09-10T21:13:19.652122+0000","last_undegraded":"2024-09-10T21:13:19.652122+0000","last_fullsized":"2024-09-10T21:13:19.652122+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:16.374911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.656706+0000","last_change":"2024-09-10T21:13:18.654843+0000","last_active":"2024-09-10T21:13:19.656706+0000","last_peered":"2024-09-10T21:13:19.656706+0000","last_clean":"2024-09-10T21:13:19.656706+0000","last_became_active":"2024-09-10T21:13:18.654211+0000","last_became_peered":"2024-09-10T21:13:18.654211+0000","last_unstale":"2024-09-10T21:13:19.656706+0000","last_undegraded":"2024-09-10T21:13:19.656706+0000","last_fullsized":"2024-09-10T21:13:19.656706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:28.490792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653012+0000","last_change":"2024-09-10T21:13:18.659603+0000","last_active":"2024-09-10T21:13:19.653012+0000","last_peered":"2024-09-10T21:13:19.653012+0000","last_clean":"2024-09-10T21:13:19.653012+0000","last_became_active":"2024-09-10T21:13:18.659257+0000","last_became_peered":"2024-09-10T21:13:18.659257+0000","last_unstale":"2024-09-10T21:13:19.653012+0000","last_undegraded":"2024-09-10T21:13:19.653012+0000","last_fullsized":"2024-09-10T21:13:19.653012+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:26.249109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.651984+0000","last_change":"2024-09-10T21:13:18.649354+0000","last_active":"2024-09-10T21:13:19.651984+0000","last_peered":"2024-09-10T21:13:19.651984+0000","last_clean":"2024-09-10T21:13:19.651984+0000","last_became_active":"2024-09-10T21:13:18.649029+0000","last_became_peered":"2024-09-10T21:13:18.649029+0000","last_unstale":"2024-09-10T21:13:19.651984+0000","last_undegraded":"2024-09-10T21:13:19.651984+0000","last_fullsized":"2024-09-10T21:13:19.651984+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:06.946983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'6","reported_seq":40,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:40.971513+0000","last_change":"2024-09-10T21:13:16.631197+0000","last_active":"2024-09-10T21:13:40.971513+0000","last_peered":"2024-09-10T21:13:40.971513+0000","last_clean":"2024-09-10T21:13:40.971513+0000","last_became_active":"2024-09-10T21:13:16.630877+0000","last_became_peered":"2024-09-10T21:13:16.630877+0000","last_unstale":"2024-09-10T21:13:40.971513+0000","last_undegraded":"2024-09-10T21:13:40.971513+0000","last_fullsized":"2024-09-10T21:13:40.971513+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:50.117425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.641122+0000","last_change":"2024-09-10T21:13:18.654124+0000","last_active":"2024-09-10T21:13:19.641122+0000","last_peered":"2024-09-10T21:13:19.641122+0000","last_clean":"2024-09-10T21:13:19.641122+0000","last_became_active":"2024-09-10T21:13:18.653757+0000","last_became_peered":"2024-09-10T21:13:18.653757+0000","last_unstale":"2024-09-10T21:13:19.641122+0000","last_undegraded":"2024-09-10T21:13:19.641122+0000","last_fullsized":"2024-09-10T21:13:19.641122+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:25.174272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:28.942830+0000","last_change":"2024-09-10T21:13:16.631526+0000","last_active":"2024-09-10T21:13:28.942830+0000","last_peered":"2024-09-10T21:13:28.942830+0000","last_clean":"2024-09-10T21:13:28.942830+0000","last_became_active":"2024-09-10T21:13:16.631194+0000","last_became_peered":"2024-09-10T21:13:16.631194+0000","last_unstale":"2024-09-10T21:13:28.942830+0000","last_undegraded":"2024-09-10T21:13:28.942830+0000","last_fullsized":"2024-09-10T21:13:28.942830+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:31:35.036874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:27.935570+0000","last_change":"2024-09-10T21:13:16.624906+0000","last_active":"2024-09-10T21:13:27.935570+0000","last_peered":"2024-09-10T21:13:27.935570+0000","last_clean":"2024-09-10T21:13:27.935570+0000","last_became_active":"2024-09-10T21:13:16.624376+0000","last_became_peered":"2024-09-10T21:13:16.624376+0000","last_unstale":"2024-09-10T21:13:27.935570+0000","last_undegraded":"2024-09-10T21:13:27.935570+0000","last_fullsized":"2024-09-10T21:13:27.935570+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:20.942651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.654925+0000","last_change":"2024-09-10T21:13:18.646987+0000","last_active":"2024-09-10T21:13:19.654925+0000","last_peered":"2024-09-10T21:13:19.654925+0000","last_clean":"2024-09-10T21:13:19.654925+0000","last_became_active":"2024-09-10T21:13:18.646690+0000","last_became_peered":"2024-09-10T21:13:18.646690+0000","last_unstale":"2024-09-10T21:13:19.654925+0000","last_undegraded":"2024-09-10T21:13:19.654925+0000","last_fullsized":"2024-09-10T21:13:19.654925+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:47:02.132164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.951203+0000","last_change":"2024-09-10T21:13:16.633082+0000","last_active":"2024-09-10T21:13:29.951203+0000","last_peered":"2024-09-10T21:13:29.951203+0000","last_clean":"2024-09-10T21:13:29.951203+0000","last_became_active":"2024-09-10T21:13:16.632707+0000","last_became_peered":"2024-09-10T21:13:16.632707+0000","last_unstale":"2024-09-10T21:13:29.951203+0000","last_undegraded":"2024-09-10T21:13:29.951203+0000","last_fullsized":"2024-09-10T21:13:29.951203+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:53:56.611072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.651623+0000","last_change":"2024-09-10T21:13:18.663309+0000","last_active":"2024-09-10T21:13:19.651623+0000","last_peered":"2024-09-10T21:13:19.651623+0000","last_clean":"2024-09-10T21:13:19.651623+0000","last_became_active":"2024-09-10T21:13:18.662990+0000","last_became_peered":"2024-09-10T21:13:18.662990+0000","last_unstale":"2024-09-10T21:13:19.651623+0000","last_undegraded":"2024-09-10T21:13:19.651623+0000","last_fullsized":"2024-09-10T21:13:19.651623+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:18.014441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'4","reported_seq":43,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:39.969733+0000","last_change":"2024-09-10T21:13:16.633012+0000","last_active":"2024-09-10T21:13:39.969733+0000","last_peered":"2024-09-10T21:13:39.969733+0000","last_clean":"2024-09-10T21:13:39.969733+0000","last_became_active":"2024-09-10T21:13:16.632622+0000","last_became_peered":"2024-09-10T21:13:16.632622+0000","last_unstale":"2024-09-10T21:13:39.969733+0000","last_undegraded":"2024-09-10T21:13:39.969733+0000","last_fullsized":"2024-09-10T21:13:39.969733+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:16.859255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.656947+0000","last_change":"2024-09-10T21:13:18.658015+0000","last_active":"2024-09-10T21:13:19.656947+0000","last_peered":"2024-09-10T21:13:19.656947+0000","last_clean":"2024-09-10T21:13:19.656947+0000","last_became_active":"2024-09-10T21:13:18.656922+0000","last_became_peered":"2024-09-10T21:13:18.656922+0000","last_unstale":"2024-09-10T21:13:19.656947+0000","last_undegraded":"2024-09-10T21:13:19.656947+0000","last_fullsized":"2024-09-10T21:13:19.656947+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:24.038131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.950479+0000","last_change":"2024-09-10T21:13:16.631771+0000","last_active":"2024-09-10T21:13:29.950479+0000","last_peered":"2024-09-10T21:13:29.950479+0000","last_clean":"2024-09-10T21:13:29.950479+0000","last_became_active":"2024-09-10T21:13:16.631477+0000","last_became_peered":"2024-09-10T21:13:16.631477+0000","last_unstale":"2024-09-10T21:13:29.950479+0000","last_undegraded":"2024-09-10T21:13:29.950479+0000","last_fullsized":"2024-09-10T21:13:29.950479+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:16.644046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652931+0000","last_change":"2024-09-10T21:13:18.658119+0000","last_active":"2024-09-10T21:13:19.652931+0000","last_peered":"2024-09-10T21:13:19.652931+0000","last_clean":"2024-09-10T21:13:19.652931+0000","last_became_active":"2024-09-10T21:13:18.657339+0000","last_became_peered":"2024-09-10T21:13:18.657339+0000","last_unstale":"2024-09-10T21:13:19.652931+0000","last_undegraded":"2024-09-10T21:13:19.652931+0000","last_fullsized":"2024-09-10T21:13:19.652931+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:45.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:28.942415+0000","last_change":"2024-09-10T21:13:16.727019+0000","last_active":"2024-09-10T21:13:28.942415+0000","last_peered":"2024-09-10T21:13:28.942415+0000","last_clean":"2024-09-10T21:13:28.942415+0000","last_became_active":"2024-09-10T21:13:16.726667+0000","last_became_peered":"2024-09-10T21:13:16.726667+0000","last_unstale":"2024-09-10T21:13:28.942415+0000","last_undegraded":"2024-09-10T21:13:28.942415+0000","last_fullsized":"2024-09-10T21:13:28.942415+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:57.551149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.656538+0000","last_change":"2024-09-10T21:13:18.659422+0000","last_active":"2024-09-10T21:13:19.656538+0000","last_peered":"2024-09-10T21:13:19.656538+0000","last_clean":"2024-09-10T21:13:19.656538+0000","last_became_active":"2024-09-10T21:13:18.657163+0000","last_became_peered":"2024-09-10T21:13:18.657163+0000","last_unstale":"2024-09-10T21:13:19.656538+0000","last_undegraded":"2024-09-10T21:13:19.656538+0000","last_fullsized":"2024-09-10T21:13:19.656538+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:24:50.147061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'27","reported_seq":72,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:39.971429+0000","last_change":"2024-09-10T21:13:16.631820+0000","last_active":"2024-09-10T21:13:39.971429+0000","last_peered":"2024-09-10T21:13:39.971429+0000","last_clean":"2024-09-10T21:13:39.971429+0000","last_became_active":"2024-09-10T21:13:16.631432+0000","last_became_peered":"2024-09-10T21:13:16.631432+0000","last_unstale":"2024-09-10T21:13:39.971429+0000","last_undegraded":"2024-09-10T21:13:39.971429+0000","last_fullsized":"2024-09-10T21:13:39.971429+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:47.972871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":61,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653825+0000","last_change":"2024-09-10T21:13:18.653147+0000","last_active":"2024-09-10T21:13:19.653825+0000","last_peered":"2024-09-10T21:13:19.653825+0000","last_clean":"2024-09-10T21:13:19.653825+0000","last_became_active":"2024-09-10T21:13:18.652846+0000","last_became_peered":"2024-09-10T21:13:18.652846+0000","last_unstale":"2024-09-10T21:13:19.653825+0000","last_undegraded":"2024-09-10T21:13:19.653825+0000","last_fullsized":"2024-09-10T21:13:19.653825+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:59.007192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":30,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:30.953655+0000","last_change":"2024-09-10T21:13:16.631994+0000","last_active":"2024-09-10T21:13:30.953655+0000","last_peered":"2024-09-10T21:13:30.953655+0000","last_clean":"2024-09-10T21:13:30.953655+0000","last_became_active":"2024-09-10T21:13:16.631665+0000","last_became_peered":"2024-09-10T21:13:16.631665+0000","last_unstale":"2024-09-10T21:13:30.953655+0000","last_undegraded":"2024-09-10T21:13:30.953655+0000","last_fullsized":"2024-09-10T21:13:30.953655+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:05.537172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.641174+0000","last_change":"2024-09-10T21:13:18.657463+0000","last_active":"2024-09-10T21:13:19.641174+0000","last_peered":"2024-09-10T21:13:19.641174+0000","last_clean":"2024-09-10T21:13:19.641174+0000","last_became_active":"2024-09-10T21:13:18.657146+0000","last_became_peered":"2024-09-10T21:13:18.657146+0000","last_unstale":"2024-09-10T21:13:19.641174+0000","last_undegraded":"2024-09-10T21:13:19.641174+0000","last_fullsized":"2024-09-10T21:13:19.641174+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:42.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.951225+0000","last_change":"2024-09-10T21:13:16.630419+0000","last_active":"2024-09-10T21:13:29.951225+0000","last_peered":"2024-09-10T21:13:29.951225+0000","last_clean":"2024-09-10T21:13:29.951225+0000","last_became_active":"2024-09-10T21:13:16.630053+0000","last_became_peered":"2024-09-10T21:13:16.630053+0000","last_unstale":"2024-09-10T21:13:29.951225+0000","last_undegraded":"2024-09-10T21:13:29.951225+0000","last_fullsized":"2024-09-10T21:13:29.951225+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:08.090931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652286+0000","last_change":"2024-09-10T21:13:18.657585+0000","last_active":"2024-09-10T21:13:19.652286+0000","last_peered":"2024-09-10T21:13:19.652286+0000","last_clean":"2024-09-10T21:13:19.652286+0000","last_became_active":"2024-09-10T21:13:18.657280+0000","last_became_peered":"2024-09-10T21:13:18.657280+0000","last_unstale":"2024-09-10T21:13:19.652286+0000","last_undegraded":"2024-09-10T21:13:19.652286+0000","last_fullsized":"2024-09-10T21:13:19.652286+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:46:34.252882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'5","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:39.969898+0000","last_change":"2024-09-10T21:13:16.629700+0000","last_active":"2024-09-10T21:13:39.969898+0000","last_peered":"2024-09-10T21:13:39.969898+0000","last_clean":"2024-09-10T21:13:39.969898+0000","last_became_active":"2024-09-10T21:13:16.629282+0000","last_became_peered":"2024-09-10T21:13:16.629282+0000","last_unstale":"2024-09-10T21:13:39.969898+0000","last_undegraded":"2024-09-10T21:13:39.969898+0000","last_fullsized":"2024-09-10T21:13:39.969898+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:42.572643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.651855+0000","last_change":"2024-09-10T21:13:18.664535+0000","last_active":"2024-09-10T21:13:19.651855+0000","last_peered":"2024-09-10T21:13:19.651855+0000","last_clean":"2024-09-10T21:13:19.651855+0000","last_became_active":"2024-09-10T21:13:18.663997+0000","last_became_peered":"2024-09-10T21:13:18.663997+0000","last_unstale":"2024-09-10T21:13:19.651855+0000","last_undegraded":"2024-09-10T21:13:19.651855+0000","last_fullsized":"2024-09-10T21:13:19.651855+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:30.365106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.948447+0000","last_change":"2024-09-10T21:13:16.727096+0000","last_active":"2024-09-10T21:13:29.948447+0000","last_peered":"2024-09-10T21:13:29.948447+0000","last_clean":"2024-09-10T21:13:29.948447+0000","last_became_active":"2024-09-10T21:13:16.726408+0000","last_became_peered":"2024-09-10T21:13:16.726408+0000","last_unstale":"2024-09-10T21:13:29.948447+0000","last_undegraded":"2024-09-10T21:13:29.948447+0000","last_fullsized":"2024-09-10T21:13:29.948447+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:30.581238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.640980+0000","last_change":"2024-09-10T21:13:18.657397+0000","last_active":"2024-09-10T21:13:19.640980+0000","last_peered":"2024-09-10T21:13:19.640980+0000","last_clean":"2024-09-10T21:13:19.640980+0000","last_became_active":"2024-09-10T21:13:18.657050+0000","last_became_peered":"2024-09-10T21:13:18.657050+0000","last_unstale":"2024-09-10T21:13:19.640980+0000","last_undegraded":"2024-09-10T21:13:19.640980+0000","last_fullsized":"2024-09-10T21:13:19.640980+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:09.739544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:28.931420+0000","last_change":"2024-09-10T21:13:16.633716+0000","last_active":"2024-09-10T21:13:28.931420+0000","last_peered":"2024-09-10T21:13:28.931420+0000","last_clean":"2024-09-10T21:13:28.931420+0000","last_became_active":"2024-09-10T21:13:16.633225+0000","last_became_peered":"2024-09-10T21:13:16.633225+0000","last_unstale":"2024-09-10T21:13:28.931420+0000","last_undegraded":"2024-09-10T21:13:28.931420+0000","last_fullsized":"2024-09-10T21:13:28.931420+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:48.807549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.654008+0000","last_change":"2024-09-10T21:13:18.663129+0000","last_active":"2024-09-10T21:13:19.654008+0000","last_peered":"2024-09-10T21:13:19.654008+0000","last_clean":"2024-09-10T21:13:19.654008+0000","last_became_active":"2024-09-10T21:13:18.662694+0000","last_became_peered":"2024-09-10T21:13:18.662694+0000","last_unstale":"2024-09-10T21:13:19.654008+0000","last_undegraded":"2024-09-10T21:13:19.654008+0000","last_fullsized":"2024-09-10T21:13:19.654008+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:24.633468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.948428+0000","last_change":"2024-09-10T21:13:16.628733+0000","last_active":"2024-09-10T21:13:29.948428+0000","last_peered":"2024-09-10T21:13:29.948428+0000","last_clean":"2024-09-10T21:13:29.948428+0000","last_became_active":"2024-09-10T21:13:16.628419+0000","last_became_peered":"2024-09-10T21:13:16.628419+0000","last_unstale":"2024-09-10T21:13:29.948428+0000","last_undegraded":"2024-09-10T21:13:29.948428+0000","last_fullsized":"2024-09-10T21:13:29.948428+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:31.264739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653097+0000","last_change":"2024-09-10T21:13:18.656571+0000","last_active":"2024-09-10T21:13:19.653097+0000","last_peered":"2024-09-10T21:13:19.653097+0000","last_clean":"2024-09-10T21:13:19.653097+0000","last_became_active":"2024-09-10T21:13:18.656253+0000","last_became_peered":"2024-09-10T21:13:18.656253+0000","last_unstale":"2024-09-10T21:13:19.653097+0000","last_undegraded":"2024-09-10T21:13:19.653097+0000","last_fullsized":"2024-09-10T21:13:19.653097+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:57.848566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.950426+0000","last_change":"2024-09-10T21:13:16.631750+0000","last_active":"2024-09-10T21:13:29.950426+0000","last_peered":"2024-09-10T21:13:29.950426+0000","last_clean":"2024-09-10T21:13:29.950426+0000","last_became_active":"2024-09-10T21:13:16.631245+0000","last_became_peered":"2024-09-10T21:13:16.631245+0000","last_unstale":"2024-09-10T21:13:29.950426+0000","last_undegraded":"2024-09-10T21:13:29.950426+0000","last_fullsized":"2024-09-10T21:13:29.950426+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:28.787751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652245+0000","last_change":"2024-09-10T21:13:18.660834+0000","last_active":"2024-09-10T21:13:19.652245+0000","last_peered":"2024-09-10T21:13:19.652245+0000","last_clean":"2024-09-10T21:13:19.652245+0000","last_became_active":"2024-09-10T21:13:18.660461+0000","last_became_peered":"2024-09-10T21:13:18.660461+0000","last_unstale":"2024-09-10T21:13:19.652245+0000","last_undegraded":"2024-09-10T21:13:19.652245+0000","last_fullsized":"2024-09-10T21:13:19.652245+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:55.531199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'5","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:39.970359+0000","last_change":"2024-09-10T21:13:16.726824+0000","last_active":"2024-09-10T21:13:39.970359+0000","last_peered":"2024-09-10T21:13:39.970359+0000","last_clean":"2024-09-10T21:13:39.970359+0000","last_became_active":"2024-09-10T21:13:16.726436+0000","last_became_peered":"2024-09-10T21:13:16.726436+0000","last_unstale":"2024-09-10T21:13:39.970359+0000","last_undegraded":"2024-09-10T21:13:39.970359+0000","last_fullsized":"2024-09-10T21:13:39.970359+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:49.391388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653044+0000","last_change":"2024-09-10T21:13:18.663725+0000","last_active":"2024-09-10T21:13:19.653044+0000","last_peered":"2024-09-10T21:13:19.653044+0000","last_clean":"2024-09-10T21:13:19.653044+0000","last_became_active":"2024-09-10T21:13:18.663254+0000","last_became_peered":"2024-09-10T21:13:18.663254+0000","last_unstale":"2024-09-10T21:13:19.653044+0000","last_undegraded":"2024-09-10T21:13:19.653044+0000","last_fullsized":"2024-09-10T21:13:19.653044+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:19.672231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":92,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652031+0000","last_change":"2024-09-10T21:12:08.173849+0000","last_active":"2024-09-10T21:13:19.652031+0000","last_peered":"2024-09-10T21:13:19.652031+0000","last_clean":"2024-09-10T21:13:19.652031+0000","last_became_active":"2024-09-10T21:12:08.153630+0000","last_became_peered":"2024-09-10T21:12:08.153630+0000","last_unstale":"2024-09-10T21:13:19.652031+0000","last_undegraded":"2024-09-10T21:13:19.652031+0000","last_fullsized":"2024-09-10T21:13:19.652031+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:08:47.842259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:08:47.842259+0000","last_clean_scrub_stamp":"2024-09-10T21:08:47.842259+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:39.166390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":28,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:30.953368+0000","last_change":"2024-09-10T21:13:16.628607+0000","last_active":"2024-09-10T21:13:30.953368+0000","last_peered":"2024-09-10T21:13:30.953368+0000","last_clean":"2024-09-10T21:13:30.953368+0000","last_became_active":"2024-09-10T21:13:16.627736+0000","last_became_peered":"2024-09-10T21:13:16.627736+0000","last_unstale":"2024-09-10T21:13:30.953368+0000","last_undegraded":"2024-09-10T21:13:30.953368+0000","last_fullsized":"2024-09-10T21:13:30.953368+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:16.388832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.655361+0000","last_change":"2024-09-10T21:13:18.652634+0000","last_active":"2024-09-10T21:13:19.655361+0000","last_peered":"2024-09-10T21:13:19.655361+0000","last_clean":"2024-09-10T21:13:19.655361+0000","last_became_active":"2024-09-10T21:13:18.652325+0000","last_became_peered":"2024-09-10T21:13:18.652325+0000","last_unstale":"2024-09-10T21:13:19.655361+0000","last_undegraded":"2024-09-10T21:13:19.655361+0000","last_fullsized":"2024-09-10T21:13:19.655361+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:16.382355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:27.936067+0000","last_change":"2024-09-10T21:13:16.631442+0000","last_active":"2024-09-10T21:13:27.936067+0000","last_peered":"2024-09-10T21:13:27.936067+0000","last_clean":"2024-09-10T21:13:27.936067+0000","last_became_active":"2024-09-10T21:13:16.631117+0000","last_became_peered":"2024-09-10T21:13:16.631117+0000","last_unstale":"2024-09-10T21:13:27.936067+0000","last_undegraded":"2024-09-10T21:13:27.936067+0000","last_fullsized":"2024-09-10T21:13:27.936067+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:35.376888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.641087+0000","last_change":"2024-09-10T21:13:18.644246+0000","last_active":"2024-09-10T21:13:19.641087+0000","last_peered":"2024-09-10T21:13:19.641087+0000","last_clean":"2024-09-10T21:13:19.641087+0000","last_became_active":"2024-09-10T21:13:18.643944+0000","last_became_peered":"2024-09-10T21:13:18.643944+0000","last_unstale":"2024-09-10T21:13:19.641087+0000","last_undegraded":"2024-09-10T21:13:19.641087+0000","last_fullsized":"2024-09-10T21:13:19.641087+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:18.856149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":38,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:41.972448+0000","last_change":"2024-09-10T21:13:16.726716+0000","last_active":"2024-09-10T21:13:41.972448+0000","last_peered":"2024-09-10T21:13:41.972448+0000","last_clean":"2024-09-10T21:13:41.972448+0000","last_became_active":"2024-09-10T21:13:16.726400+0000","last_became_peered":"2024-09-10T21:13:16.726400+0000","last_unstale":"2024-09-10T21:13:41.972448+0000","last_undegraded":"2024-09-10T21:13:41.972448+0000","last_fullsized":"2024-09-10T21:13:41.972448+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:55.643495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.641253+0000","last_change":"2024-09-10T21:13:18.660350+0000","last_active":"2024-09-10T21:13:19.641253+0000","last_peered":"2024-09-10T21:13:19.641253+0000","last_clean":"2024-09-10T21:13:19.641253+0000","last_became_active":"2024-09-10T21:13:18.659581+0000","last_became_peered":"2024-09-10T21:13:18.659581+0000","last_unstale":"2024-09-10T21:13:19.641253+0000","last_undegraded":"2024-09-10T21:13:19.641253+0000","last_fullsized":"2024-09-10T21:13:19.641253+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:46.127656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"73'5","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:40.971565+0000","last_change":"2024-09-10T21:13:16.633126+0000","last_active":"2024-09-10T21:13:40.971565+0000","last_peered":"2024-09-10T21:13:40.971565+0000","last_clean":"2024-09-10T21:13:40.971565+0000","last_became_active":"2024-09-10T21:13:16.632808+0000","last_became_peered":"2024-09-10T21:13:16.632808+0000","last_unstale":"2024-09-10T21:13:40.971565+0000","last_undegraded":"2024-09-10T21:13:40.971565+0000","last_fullsized":"2024-09-10T21:13:40.971565+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:01.026506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653017+0000","last_change":"2024-09-10T21:13:18.652631+0000","last_active":"2024-09-10T21:13:19.653017+0000","last_peered":"2024-09-10T21:13:19.653017+0000","last_clean":"2024-09-10T21:13:19.653017+0000","last_became_active":"2024-09-10T21:13:18.650580+0000","last_became_peered":"2024-09-10T21:13:18.650580+0000","last_unstale":"2024-09-10T21:13:19.653017+0000","last_undegraded":"2024-09-10T21:13:19.653017+0000","last_fullsized":"2024-09-10T21:13:19.653017+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:32.733169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652274+0000","last_change":"2024-09-10T21:13:16.728172+0000","last_active":"2024-09-10T21:13:19.652274+0000","last_peered":"2024-09-10T21:13:19.652274+0000","last_clean":"2024-09-10T21:13:19.652274+0000","last_became_active":"2024-09-10T21:13:16.727793+0000","last_became_peered":"2024-09-10T21:13:16.727793+0000","last_unstale":"2024-09-10T21:13:19.652274+0000","last_undegraded":"2024-09-10T21:13:19.652274+0000","last_fullsized":"2024-09-10T21:13:19.652274+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:58:04.301119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:20.848461+0000","last_change":"2024-09-10T21:13:18.655371+0000","last_active":"2024-09-10T21:13:20.848461+0000","last_peered":"2024-09-10T21:13:20.848461+0000","last_clean":"2024-09-10T21:13:20.848461+0000","last_became_active":"2024-09-10T21:13:18.653250+0000","last_became_peered":"2024-09-10T21:13:18.653250+0000","last_unstale":"2024-09-10T21:13:20.848461+0000","last_undegraded":"2024-09-10T21:13:20.848461+0000","last_fullsized":"2024-09-10T21:13:20.848461+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:25.650736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.950915+0000","last_change":"2024-09-10T21:13:16.726816+0000","last_active":"2024-09-10T21:13:29.950915+0000","last_peered":"2024-09-10T21:13:29.950915+0000","last_clean":"2024-09-10T21:13:29.950915+0000","last_became_active":"2024-09-10T21:13:16.726438+0000","last_became_peered":"2024-09-10T21:13:16.726438+0000","last_unstale":"2024-09-10T21:13:29.950915+0000","last_undegraded":"2024-09-10T21:13:29.950915+0000","last_fullsized":"2024-09-10T21:13:29.950915+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:46.384899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.641594+0000","last_change":"2024-09-10T21:13:18.643424+0000","last_active":"2024-09-10T21:13:19.641594+0000","last_peered":"2024-09-10T21:13:19.641594+0000","last_clean":"2024-09-10T21:13:19.641594+0000","last_became_active":"2024-09-10T21:13:18.643010+0000","last_became_peered":"2024-09-10T21:13:18.643010+0000","last_unstale":"2024-09-10T21:13:19.641594+0000","last_undegraded":"2024-09-10T21:13:19.641594+0000","last_fullsized":"2024-09-10T21:13:19.641594+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:47.358129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'13","reported_seq":32,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:41.652937+0000","last_change":"2024-09-10T21:13:16.628900+0000","last_active":"2024-09-10T21:13:41.652937+0000","last_peered":"2024-09-10T21:13:41.652937+0000","last_clean":"2024-09-10T21:13:41.652937+0000","last_became_active":"2024-09-10T21:13:16.628535+0000","last_became_peered":"2024-09-10T21:13:16.628535+0000","last_unstale":"2024-09-10T21:13:41.652937+0000","last_undegraded":"2024-09-10T21:13:41.652937+0000","last_fullsized":"2024-09-10T21:13:41.652937+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:32:48.399519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.655274+0000","last_change":"2024-09-10T21:13:18.652347+0000","last_active":"2024-09-10T21:13:19.655274+0000","last_peered":"2024-09-10T21:13:19.655274+0000","last_clean":"2024-09-10T21:13:19.655274+0000","last_became_active":"2024-09-10T21:13:18.651942+0000","last_became_peered":"2024-09-10T21:13:18.651942+0000","last_unstale":"2024-09-10T21:13:19.655274+0000","last_undegraded":"2024-09-10T21:13:19.655274+0000","last_fullsized":"2024-09-10T21:13:19.655274+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:11.356787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.949840+0000","last_change":"2024-09-10T21:13:16.621647+0000","last_active":"2024-09-10T21:13:29.949840+0000","last_peered":"2024-09-10T21:13:29.949840+0000","last_clean":"2024-09-10T21:13:29.949840+0000","last_became_active":"2024-09-10T21:13:16.621316+0000","last_became_peered":"2024-09-10T21:13:16.621316+0000","last_unstale":"2024-09-10T21:13:29.949840+0000","last_undegraded":"2024-09-10T21:13:29.949840+0000","last_fullsized":"2024-09-10T21:13:29.949840+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:10.264578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652749+0000","last_change":"2024-09-10T21:13:18.656617+0000","last_active":"2024-09-10T21:13:19.652749+0000","last_peered":"2024-09-10T21:13:19.652749+0000","last_clean":"2024-09-10T21:13:19.652749+0000","last_became_active":"2024-09-10T21:13:18.656331+0000","last_became_peered":"2024-09-10T21:13:18.656331+0000","last_unstale":"2024-09-10T21:13:19.652749+0000","last_undegraded":"2024-09-10T21:13:19.652749+0000","last_fullsized":"2024-09-10T21:13:19.652749+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:44.482797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:26.928217+0000","last_change":"2024-09-10T21:13:16.727736+0000","last_active":"2024-09-10T21:13:26.928217+0000","last_peered":"2024-09-10T21:13:26.928217+0000","last_clean":"2024-09-10T21:13:26.928217+0000","last_became_active":"2024-09-10T21:13:16.727413+0000","last_became_peered":"2024-09-10T21:13:16.727413+0000","last_unstale":"2024-09-10T21:13:26.928217+0000","last_undegraded":"2024-09-10T21:13:26.928217+0000","last_fullsized":"2024-09-10T21:13:26.928217+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:26.351729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652100+0000","last_change":"2024-09-10T21:13:18.660100+0000","last_active":"2024-09-10T21:13:19.652100+0000","last_peered":"2024-09-10T21:13:19.652100+0000","last_clean":"2024-09-10T21:13:19.652100+0000","last_became_active":"2024-09-10T21:13:18.659733+0000","last_became_peered":"2024-09-10T21:13:18.659733+0000","last_unstale":"2024-09-10T21:13:19.652100+0000","last_undegraded":"2024-09-10T21:13:19.652100+0000","last_fullsized":"2024-09-10T21:13:19.652100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:44.371627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":26,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.948231+0000","last_change":"2024-09-10T21:13:16.627194+0000","last_active":"2024-09-10T21:13:29.948231+0000","last_peered":"2024-09-10T21:13:29.948231+0000","last_clean":"2024-09-10T21:13:29.948231+0000","last_became_active":"2024-09-10T21:13:16.626805+0000","last_became_peered":"2024-09-10T21:13:16.626805+0000","last_unstale":"2024-09-10T21:13:29.948231+0000","last_undegraded":"2024-09-10T21:13:29.948231+0000","last_fullsized":"2024-09-10T21:13:29.948231+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:33.582084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.653253+0000","last_change":"2024-09-10T21:13:18.663122+0000","last_active":"2024-09-10T21:13:19.653253+0000","last_peered":"2024-09-10T21:13:19.653253+0000","last_clean":"2024-09-10T21:13:19.653253+0000","last_became_active":"2024-09-10T21:13:18.662673+0000","last_became_peered":"2024-09-10T21:13:18.662673+0000","last_unstale":"2024-09-10T21:13:19.653253+0000","last_undegraded":"2024-09-10T21:13:19.653253+0000","last_fullsized":"2024-09-10T21:13:19.653253+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:15.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:28.943470+0000","last_change":"2024-09-10T21:13:16.635008+0000","last_active":"2024-09-10T21:13:28.943470+0000","last_peered":"2024-09-10T21:13:28.943470+0000","last_clean":"2024-09-10T21:13:28.943470+0000","last_became_active":"2024-09-10T21:13:16.631954+0000","last_became_peered":"2024-09-10T21:13:16.631954+0000","last_unstale":"2024-09-10T21:13:28.943470+0000","last_undegraded":"2024-09-10T21:13:28.943470+0000","last_fullsized":"2024-09-10T21:13:28.943470+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:22:21.587883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652488+0000","last_change":"2024-09-10T21:13:18.656400+0000","last_active":"2024-09-10T21:13:19.652488+0000","last_peered":"2024-09-10T21:13:19.652488+0000","last_clean":"2024-09-10T21:13:19.652488+0000","last_became_active":"2024-09-10T21:13:18.655802+0000","last_became_peered":"2024-09-10T21:13:18.655802+0000","last_unstale":"2024-09-10T21:13:19.652488+0000","last_undegraded":"2024-09-10T21:13:19.652488+0000","last_fullsized":"2024-09-10T21:13:19.652488+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:41.901404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:26.929295+0000","last_change":"2024-09-10T21:13:16.632620+0000","last_active":"2024-09-10T21:13:26.929295+0000","last_peered":"2024-09-10T21:13:26.929295+0000","last_clean":"2024-09-10T21:13:26.929295+0000","last_became_active":"2024-09-10T21:13:16.632263+0000","last_became_peered":"2024-09-10T21:13:16.632263+0000","last_unstale":"2024-09-10T21:13:26.929295+0000","last_undegraded":"2024-09-10T21:13:26.929295+0000","last_fullsized":"2024-09-10T21:13:26.929295+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:14.840545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652263+0000","last_change":"2024-09-10T21:13:18.664331+0000","last_active":"2024-09-10T21:13:19.652263+0000","last_peered":"2024-09-10T21:13:19.652263+0000","last_clean":"2024-09-10T21:13:19.652263+0000","last_became_active":"2024-09-10T21:13:18.663823+0000","last_became_peered":"2024-09-10T21:13:18.663823+0000","last_unstale":"2024-09-10T21:13:19.652263+0000","last_undegraded":"2024-09-10T21:13:19.652263+0000","last_fullsized":"2024-09-10T21:13:19.652263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:37.626712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.640975+0000","last_change":"2024-09-10T21:13:18.659941+0000","last_active":"2024-09-10T21:13:19.640975+0000","last_peered":"2024-09-10T21:13:19.640975+0000","last_clean":"2024-09-10T21:13:19.640975+0000","last_became_active":"2024-09-10T21:13:18.659019+0000","last_became_peered":"2024-09-10T21:13:18.659019+0000","last_unstale":"2024-09-10T21:13:19.640975+0000","last_undegraded":"2024-09-10T21:13:19.640975+0000","last_fullsized":"2024-09-10T21:13:19.640975+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:41.037722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:29.950223+0000","last_change":"2024-09-10T21:13:16.633660+0000","last_active":"2024-09-10T21:13:29.950223+0000","last_peered":"2024-09-10T21:13:29.950223+0000","last_clean":"2024-09-10T21:13:29.950223+0000","last_became_active":"2024-09-10T21:13:16.633222+0000","last_became_peered":"2024-09-10T21:13:16.633222+0000","last_unstale":"2024-09-10T21:13:29.950223+0000","last_undegraded":"2024-09-10T21:13:29.950223+0000","last_fullsized":"2024-09-10T21:13:29.950223+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:56.364355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.656363+0000","last_change":"2024-09-10T21:13:18.666837+0000","last_active":"2024-09-10T21:13:19.656363+0000","last_peered":"2024-09-10T21:13:19.656363+0000","last_clean":"2024-09-10T21:13:19.656363+0000","last_became_active":"2024-09-10T21:13:18.666382+0000","last_became_peered":"2024-09-10T21:13:18.666382+0000","last_unstale":"2024-09-10T21:13:19.656363+0000","last_undegraded":"2024-09-10T21:13:19.656363+0000","last_fullsized":"2024-09-10T21:13:19.656363+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:32.225130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":32,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:30.946463+0000","last_change":"2024-09-10T21:13:16.631424+0000","last_active":"2024-09-10T21:13:30.946463+0000","last_peered":"2024-09-10T21:13:30.946463+0000","last_clean":"2024-09-10T21:13:30.946463+0000","last_became_active":"2024-09-10T21:13:16.631116+0000","last_became_peered":"2024-09-10T21:13:16.631116+0000","last_unstale":"2024-09-10T21:13:30.946463+0000","last_undegraded":"2024-09-10T21:13:30.946463+0000","last_fullsized":"2024-09-10T21:13:30.946463+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:15.506410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.652721+0000","last_change":"2024-09-10T21:13:18.654978+0000","last_active":"2024-09-10T21:13:19.652721+0000","last_peered":"2024-09-10T21:13:19.652721+0000","last_clean":"2024-09-10T21:13:19.652721+0000","last_became_active":"2024-09-10T21:13:18.654581+0000","last_became_peered":"2024-09-10T21:13:18.654581+0000","last_unstale":"2024-09-10T21:13:19.652721+0000","last_undegraded":"2024-09-10T21:13:19.652721+0000","last_fullsized":"2024-09-10T21:13:19.652721+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:17.504626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":21,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.658026+0000","last_change":"2024-09-10T21:13:16.726727+0000","last_active":"2024-09-10T21:13:19.658026+0000","last_peered":"2024-09-10T21:13:19.658026+0000","last_clean":"2024-09-10T21:13:19.658026+0000","last_became_active":"2024-09-10T21:13:16.726373+0000","last_became_peered":"2024-09-10T21:13:16.726373+0000","last_unstale":"2024-09-10T21:13:19.658026+0000","last_undegraded":"2024-09-10T21:13:19.658026+0000","last_fullsized":"2024-09-10T21:13:19.658026+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:31.803631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:19.654113+0000","last_change":"2024-09-10T21:13:18.648384+0000","last_active":"2024-09-10T21:13:19.654113+0000","last_peered":"2024-09-10T21:13:19.654113+0000","last_clean":"2024-09-10T21:13:19.654113+0000","last_became_active":"2024-09-10T21:13:18.647911+0000","last_became_peered":"2024-09-10T21:13:18.647911+0000","last_unstale":"2024-09-10T21:13:19.654113+0000","last_undegraded":"2024-09-10T21:13:19.654113+0000","last_fullsized":"2024-09-10T21:13:19.654113+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:02.582548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":46,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-10T21:13:41.972224+0000","last_change":"2024-09-10T21:13:16.631501+0000","last_active":"2024-09-10T21:13:41.972224+0000","last_peered":"2024-09-10T21:13:41.972224+0000","last_clean":"2024-09-10T21:13:41.972224+0000","last_became_active":"2024-09-10T21:13:16.631246+0000","last_became_peered":"2024-09-10T21:13:16.631246+0000","last_unstale":"2024-09-10T21:13:41.972224+0000","last_undegraded":"2024-09-10T21:13:41.972224+0000","last_fullsized":"2024-09-10T21:13:41.972224+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:25.277370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56923,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":149,"num_read_kb":138,"num_write":236,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":170769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808849,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":790528,"data_stored":376852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005077,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28472,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716680,"statfs":{"total":95995035648,"available":95965880320,"internally_reserved":0,"allocated":1482752,"data_stored":1017991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135899,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":376782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332128,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36136,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709016,"statfs":{"total":95995035648,"available":95958032384,"internally_reserved":0,"allocated":811008,"data_stored":377160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528357,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28400,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716752,"statfs":{"total":95995035648,"available":95965954048,"internally_reserved":0,"allocated":1409024,"data_stored":969678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659178,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36124,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709028,"statfs":{"total":95995035648,"available":95958044672,"internally_reserved":0,"allocated":798720,"data_stored":376499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855407,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28412,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716740,"statfs":{"total":95995035648,"available":95965941760,"internally_reserved":0,"allocated":1421312,"data_stored":969356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018931,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717348,"statfs":{"total":95995035648,"available":95966564352,"internally_reserved":0,"allocated":798720,"data_stored":376360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":376324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":428133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":427522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36144,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709008,"statfs":{"total":95995035648,"available":95958024192,"internally_reserved":0,"allocated":819200,"data_stored":377838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":51862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":52473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":51846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:13:46.410 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T21:13:46.411 INFO:tasks.cephadm:Setting up client nodes... 2024-09-10T21:13:46.411 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T21:13:46.673 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:47.077 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:46 smithi059 ceph-mon[30888]: pgmap v293: 97 pgs: 97 active+clean; 632 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2024-09-10T21:13:47.077 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:46 smithi059 ceph-mon[30888]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:13:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.163+0000 7f4ec2c42640 1 -- 172.21.15.59:0/3191418367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ebc103b90 msgr2=0x7f4ebc104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.163+0000 7f4ec2c42640 1 --2- 172.21.15.59:0/3191418367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ebc103b90 0x7f4ebc104010 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009930 tx=0x7f4ea802a420 comp rx=0 tx=0).stop 2024-09-10T21:13:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.163+0000 7f4ec2c42640 1 -- 172.21.15.59:0/3191418367 shutdown_connections 2024-09-10T21:13:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.163+0000 7f4ec2c42640 1 --2- 172.21.15.59:0/3191418367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ebc104550 0x7f4ebc10aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.163+0000 7f4ec2c42640 1 --2- 172.21.15.59:0/3191418367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ebc103b90 0x7f4ebc104010 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.163+0000 7f4ec2c42640 1 --2- 172.21.15.59:0/3191418367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc102a30 0x7f4ebc102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.163+0000 7f4ec2c42640 1 -- 172.21.15.59:0/3191418367 >> 172.21.15.59:0/3191418367 conn(0x7f4ebc0fe320 msgr2=0x7f4ebc100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.163+0000 7f4ec2c42640 1 -- 172.21.15.59:0/3191418367 shutdown_connections 2024-09-10T21:13:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.163+0000 7f4ec2c42640 1 -- 172.21.15.59:0/3191418367 wait complete. 2024-09-10T21:13:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.164+0000 7f4ec2c42640 1 Processor -- start 2024-09-10T21:13:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.164+0000 7f4ec2c42640 1 -- start start 2024-09-10T21:13:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.164+0000 7f4ec2c42640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ebc102a30 0x7f4ebc198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.164+0000 7f4ec2c42640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ebc103b90 0x7f4ebc199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.164+0000 7f4ec2c42640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc104550 0x7f4ebc19a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.164+0000 7f4ec2c42640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc10e7e0 con 0x7f4ebc102a30 2024-09-10T21:13:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.164+0000 7f4ec2c42640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc10e660 con 0x7f4ebc104550 2024-09-10T21:13:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.164+0000 7f4ec2c42640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc10e960 con 0x7f4ebc103b90 2024-09-10T21:13:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.164+0000 7f4ec09de640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ebc102a30 0x7f4ebc198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.164+0000 7f4ec09de640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ebc102a30 0x7f4ebc198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36628/0 (socket says 172.21.15.59:36628) 2024-09-10T21:13:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.164+0000 7f4ec09de640 1 -- 172.21.15.59:0/3078977252 learned_addr learned my addr 172.21.15.59:0/3078977252 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.164+0000 7f4ec11df640 1 --2- 172.21.15.59:0/3078977252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc104550 0x7f4ebc19a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.164+0000 7f4ec09de640 1 -- 172.21.15.59:0/3078977252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ebc103b90 msgr2=0x7f4ebc199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.164+0000 7f4ebbfff640 1 --2- 172.21.15.59:0/3078977252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ebc103b90 0x7f4ebc199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.164+0000 7f4ec09de640 1 --2- 172.21.15.59:0/3078977252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ebc103b90 0x7f4ebc199520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.164+0000 7f4ec09de640 1 -- 172.21.15.59:0/3078977252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc104550 msgr2=0x7f4ebc19a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.164+0000 7f4ec09de640 1 --2- 172.21.15.59:0/3078977252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc104550 0x7f4ebc19a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.164+0000 7f4ec09de640 1 -- 172.21.15.59:0/3078977252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ebc19aa00 con 0x7f4ebc102a30 2024-09-10T21:13:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.165+0000 7f4ec11df640 1 --2- 172.21.15.59:0/3078977252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc104550 0x7f4ebc19a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:13:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.165+0000 7f4ec09de640 1 --2- 172.21.15.59:0/3078977252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ebc102a30 0x7f4ebc198ed0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4eb000b4a0 tx=0x7f4eb000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.165+0000 7f4eb9ffb640 1 -- 172.21.15.59:0/3078977252 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0014070 con 0x7f4ebc102a30 2024-09-10T21:13:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.165+0000 7f4eb9ffb640 1 -- 172.21.15.59:0/3078977252 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4eb0010ac0 con 0x7f4ebc102a30 2024-09-10T21:13:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.165+0000 7f4ec2c42640 1 -- 172.21.15.59:0/3078977252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ebc19acf0 con 0x7f4ebc102a30 2024-09-10T21:13:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.165+0000 7f4eb9ffb640 1 -- 172.21.15.59:0/3078977252 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0017c30 con 0x7f4ebc102a30 2024-09-10T21:13:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.165+0000 7f4ec2c42640 1 -- 172.21.15.59:0/3078977252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ebc1a13d0 con 0x7f4ebc102a30 2024-09-10T21:13:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.166+0000 7f4ec2c42640 1 -- 172.21.15.59:0/3078977252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ebc109d50 con 0x7f4ebc102a30 2024-09-10T21:13:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.167+0000 7f4eb9ffb640 1 -- 172.21.15.59:0/3078977252 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f4eb0010610 con 0x7f4ebc102a30 2024-09-10T21:13:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.168+0000 7f4eb9ffb640 1 --2- 172.21.15.59:0/3078977252 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4eac0b53f0 0x7f4eac0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.168+0000 7f4ebbfff640 1 --2- 172.21.15.59:0/3078977252 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4eac0b53f0 0x7f4eac0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.169+0000 7f4eb9ffb640 1 -- 172.21.15.59:0/3078977252 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f4eb00e5490 con 0x7f4ebc102a30 2024-09-10T21:13:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.169+0000 7f4ebbfff640 1 --2- 172.21.15.59:0/3078977252 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4eac0b53f0 0x7f4eac0b78b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80096c0 tx=0x7f4ea8005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.173+0000 7f4eb9ffb640 1 -- 172.21.15.59:0/3078977252 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4eb00ac3a0 con 0x7f4ebc102a30 2024-09-10T21:13:47.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:46 smithi192 ceph-mon[35363]: pgmap v293: 97 pgs: 97 active+clean; 632 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2024-09-10T21:13:47.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:46 smithi192 ceph-mon[35363]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:13:47.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:46 smithi154 ceph-mon[35041]: pgmap v293: 97 pgs: 97 active+clean; 632 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2024-09-10T21:13:47.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:46 smithi154 ceph-mon[35041]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:13:47.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.448+0000 7f4ec2c42640 1 -- 172.21.15.59:0/3078977252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f4ebc02e5c0 con 0x7f4ebc102a30 2024-09-10T21:13:47.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.451+0000 7f4eb9ffb640 1 -- 172.21.15.59:0/3078977252 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f4eb00abca0 con 0x7f4ebc102a30 2024-09-10T21:13:47.455 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-09-10T21:13:47.455 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCLtuBmnRfYGhAACvYXTPXEQzbq4a6x2VbY2Q== 2024-09-10T21:13:47.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.453+0000 7f4ec2c42640 1 -- 172.21.15.59:0/3078977252 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4eac0b53f0 msgr2=0x7f4eac0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.453+0000 7f4ec2c42640 1 --2- 172.21.15.59:0/3078977252 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4eac0b53f0 0x7f4eac0b78b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80096c0 tx=0x7f4ea8005fd0 comp rx=0 tx=0).stop 2024-09-10T21:13:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.453+0000 7f4ec2c42640 1 -- 172.21.15.59:0/3078977252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ebc102a30 msgr2=0x7f4ebc198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.453+0000 7f4ec2c42640 1 --2- 172.21.15.59:0/3078977252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ebc102a30 0x7f4ebc198ed0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4eb000b4a0 tx=0x7f4eb000b960 comp rx=0 tx=0).stop 2024-09-10T21:13:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.453+0000 7f4ec2c42640 1 -- 172.21.15.59:0/3078977252 shutdown_connections 2024-09-10T21:13:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.453+0000 7f4ec2c42640 1 --2- 172.21.15.59:0/3078977252 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4eac0b53f0 0x7f4eac0b78b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.453+0000 7f4ec2c42640 1 --2- 172.21.15.59:0/3078977252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ebc104550 0x7f4ebc19a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.453+0000 7f4ec2c42640 1 --2- 172.21.15.59:0/3078977252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ebc103b90 0x7f4ebc199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.453+0000 7f4ec2c42640 1 --2- 172.21.15.59:0/3078977252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ebc102a30 0x7f4ebc198ed0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.453+0000 7f4ec2c42640 1 -- 172.21.15.59:0/3078977252 >> 172.21.15.59:0/3078977252 conn(0x7f4ebc0fe320 msgr2=0x7f4ebc106f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.454+0000 7f4ec2c42640 1 -- 172.21.15.59:0/3078977252 shutdown_connections 2024-09-10T21:13:47.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:47.454+0000 7f4ec2c42640 1 -- 172.21.15.59:0/3078977252 wait complete. 2024-09-10T21:13:48.091 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:47 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3078977252' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T21:13:48.091 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:47 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3078977252' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T21:13:48.121 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T21:13:48.121 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-10T21:13:48.121 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T21:13:48.162 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph config log 1 --format=json 2024-09-10T21:13:48.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:47 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3078977252' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T21:13:48.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:47 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3078977252' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T21:13:48.334 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:47 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3078977252' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T21:13:48.334 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:47 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3078977252' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T21:13:48.459 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:48.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.932+0000 7f5ddb3bb640 1 -- 172.21.15.59:0/44098349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dd4109150 msgr2=0x7f5dd410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:48.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.932+0000 7f5ddb3bb640 1 --2- 172.21.15.59:0/44098349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dd4109150 0x7f5dd410f950 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009ca0 tx=0x7f5dcc02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:13:48.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.932+0000 7f5ddb3bb640 1 -- 172.21.15.59:0/44098349 shutdown_connections 2024-09-10T21:13:48.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.932+0000 7f5ddb3bb640 1 --2- 172.21.15.59:0/44098349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dd4109150 0x7f5dd410f950 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:48.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.932+0000 7f5ddb3bb640 1 --2- 172.21.15.59:0/44098349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dd41087d0 0x7f5dd4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.932+0000 7f5ddb3bb640 1 --2- 172.21.15.59:0/44098349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd4102dc0 0x7f5dd41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.932+0000 7f5ddb3bb640 1 -- 172.21.15.59:0/44098349 >> 172.21.15.59:0/44098349 conn(0x7f5dd40fe830 msgr2=0x7f5dd4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.932+0000 7f5ddb3bb640 1 -- 172.21.15.59:0/44098349 shutdown_connections 2024-09-10T21:13:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.932+0000 7f5ddb3bb640 1 -- 172.21.15.59:0/44098349 wait complete. 2024-09-10T21:13:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.933+0000 7f5ddb3bb640 1 Processor -- start 2024-09-10T21:13:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.933+0000 7f5ddb3bb640 1 -- start start 2024-09-10T21:13:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.933+0000 7f5ddb3bb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd4102dc0 0x7f5dd41992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.933+0000 7f5ddb3bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dd41087d0 0x7f5dd41997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.933+0000 7f5ddb3bb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dd4109150 0x7f5dd419eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.933+0000 7f5ddb3bb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd4112e10 con 0x7f5dd4109150 2024-09-10T21:13:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.933+0000 7f5ddb3bb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd4112c90 con 0x7f5dd41087d0 2024-09-10T21:13:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.933+0000 7f5ddb3bb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd4112f90 con 0x7f5dd4102dc0 2024-09-10T21:13:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.933+0000 7f5dd9958640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dd4109150 0x7f5dd419eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:48.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.933+0000 7f5dd9958640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dd4109150 0x7f5dd419eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36632/0 (socket says 172.21.15.59:36632) 2024-09-10T21:13:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.933+0000 7f5dd9958640 1 -- 172.21.15.59:0/3014994302 learned_addr learned my addr 172.21.15.59:0/3014994302 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.933+0000 7f5dd9157640 1 --2- 172.21.15.59:0/3014994302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd4102dc0 0x7f5dd41992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.933+0000 7f5dd9958640 1 -- 172.21.15.59:0/3014994302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd4102dc0 msgr2=0x7f5dd41992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.933+0000 7f5dd9958640 1 --2- 172.21.15.59:0/3014994302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd4102dc0 0x7f5dd41992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.934+0000 7f5dd8956640 1 --2- 172.21.15.59:0/3014994302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dd41087d0 0x7f5dd41997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.934+0000 7f5dd9958640 1 -- 172.21.15.59:0/3014994302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dd41087d0 msgr2=0x7f5dd41997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.934+0000 7f5dd9958640 1 --2- 172.21.15.59:0/3014994302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dd41087d0 0x7f5dd41997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.934+0000 7f5dd9958640 1 -- 172.21.15.59:0/3014994302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd419f350 con 0x7f5dd4109150 2024-09-10T21:13:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.934+0000 7f5dd9958640 1 --2- 172.21.15.59:0/3014994302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dd4109150 0x7f5dd419eb80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc005cc0 tx=0x7f5dcc02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.934+0000 7f5dca7fc640 1 -- 172.21.15.59:0/3014994302 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc003bf0 con 0x7f5dd4109150 2024-09-10T21:13:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.934+0000 7f5dca7fc640 1 -- 172.21.15.59:0/3014994302 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dcc003d90 con 0x7f5dd4109150 2024-09-10T21:13:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.934+0000 7f5ddb3bb640 1 -- 172.21.15.59:0/3014994302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd419f5e0 con 0x7f5dd4109150 2024-09-10T21:13:48.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.934+0000 7f5dca7fc640 1 -- 172.21.15.59:0/3014994302 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc02fbc0 con 0x7f5dd4109150 2024-09-10T21:13:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.934+0000 7f5ddb3bb640 1 -- 172.21.15.59:0/3014994302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd41a5d00 con 0x7f5dd4109150 2024-09-10T21:13:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.935+0000 7f5ddb3bb640 1 -- 172.21.15.59:0/3014994302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd41031a0 con 0x7f5dd4109150 2024-09-10T21:13:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.936+0000 7f5dca7fc640 1 -- 172.21.15.59:0/3014994302 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f5dcc004610 con 0x7f5dd4109150 2024-09-10T21:13:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.937+0000 7f5dca7fc640 1 --2- 172.21.15.59:0/3014994302 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5dc00b5370 0x7f5dc00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.937+0000 7f5dd9157640 1 --2- 172.21.15.59:0/3014994302 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5dc00b5370 0x7f5dc00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.937+0000 7f5dca7fc640 1 -- 172.21.15.59:0/3014994302 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f5dcc107320 con 0x7f5dd4109150 2024-09-10T21:13:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.938+0000 7f5dd9157640 1 --2- 172.21.15.59:0/3014994302 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5dc00b5370 0x7f5dc00b7830 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000bbe0 tx=0x7f5dd000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:48.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:48.940+0000 7f5dca7fc640 1 -- 172.21.15.59:0/3014994302 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5dcc0ce130 con 0x7f5dd4109150 2024-09-10T21:13:49.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:49.131+0000 7f5ddb3bb640 1 -- 172.21.15.59:0/3014994302 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f5dd419a3d0 con 0x7f5dd4109150 2024-09-10T21:13:49.136 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:48 smithi059 ceph-mon[30888]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2024-09-10T21:13:49.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:49.132+0000 7f5dca7fc640 1 -- 172.21.15.59:0/3014994302 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v48) ==== 86+0+133 (secure 0 0 0) 0x7f5dcc0cda30 con 0x7f5dd4109150 2024-09-10T21:13:49.136 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:13:49.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:49.135+0000 7f5ddb3bb640 1 -- 172.21.15.59:0/3014994302 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5dc00b5370 msgr2=0x7f5dc00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:49.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:49.135+0000 7f5ddb3bb640 1 --2- 172.21.15.59:0/3014994302 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5dc00b5370 0x7f5dc00b7830 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000bbe0 tx=0x7f5dd000b390 comp rx=0 tx=0).stop 2024-09-10T21:13:49.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:49.135+0000 7f5ddb3bb640 1 -- 172.21.15.59:0/3014994302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dd4109150 msgr2=0x7f5dd419eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:49.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:49.135+0000 7f5ddb3bb640 1 --2- 172.21.15.59:0/3014994302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dd4109150 0x7f5dd419eb80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc005cc0 tx=0x7f5dcc02f380 comp rx=0 tx=0).stop 2024-09-10T21:13:49.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:49.135+0000 7f5ddb3bb640 1 -- 172.21.15.59:0/3014994302 shutdown_connections 2024-09-10T21:13:49.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:49.135+0000 7f5ddb3bb640 1 --2- 172.21.15.59:0/3014994302 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5dc00b5370 0x7f5dc00b7830 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:49.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:49.135+0000 7f5ddb3bb640 1 --2- 172.21.15.59:0/3014994302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dd4109150 0x7f5dd419eb80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:49.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:49.135+0000 7f5ddb3bb640 1 --2- 172.21.15.59:0/3014994302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5dd41087d0 0x7f5dd41997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:49.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:49.135+0000 7f5ddb3bb640 1 --2- 172.21.15.59:0/3014994302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd4102dc0 0x7f5dd41992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:49.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:49.135+0000 7f5ddb3bb640 1 -- 172.21.15.59:0/3014994302 >> 172.21.15.59:0/3014994302 conn(0x7f5dd40fe830 msgr2=0x7f5dd4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:49.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:49.135+0000 7f5ddb3bb640 1 -- 172.21.15.59:0/3014994302 shutdown_connections 2024-09-10T21:13:49.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:49.135+0000 7f5ddb3bb640 1 -- 172.21.15.59:0/3014994302 wait complete. 2024-09-10T21:13:49.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:48 smithi192 ceph-mon[35363]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2024-09-10T21:13:49.350 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:48 smithi154 ceph-mon[35041]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.3 KiB/s wr, 14 op/s 2024-09-10T21:13:49.812 INFO:teuthology.orchestra.run.smithi059.stdout:[{"version":48,"timestamp":"2024-09-10T21:13:09.609397+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-10T21:13:49.812 INFO:tasks.ceph_manager:config epoch is 48 2024-09-10T21:13:49.812 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T21:13:49.812 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-10T21:13:49.813 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-10T21:13:50.073 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:50.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:50 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3014994302' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T21:13:50.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:50 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3014994302' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T21:13:50.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:50 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3014994302' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T21:13:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.480+0000 7f9798497640 1 -- 172.21.15.59:0/2159219091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97901076e0 msgr2=0x7f9790107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.480+0000 7f9798497640 1 --2- 172.21.15.59:0/2159219091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97901076e0 0x7f9790107b20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9780009900 tx=0x7f978002a410 comp rx=0 tx=0).stop 2024-09-10T21:13:50.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.481+0000 7f9798497640 1 -- 172.21.15.59:0/2159219091 shutdown_connections 2024-09-10T21:13:50.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.481+0000 7f9798497640 1 --2- 172.21.15.59:0/2159219091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9790108060 0x7f979010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:50.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.481+0000 7f9798497640 1 --2- 172.21.15.59:0/2159219091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97901076e0 0x7f9790107b20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:50.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.481+0000 7f9798497640 1 --2- 172.21.15.59:0/2159219091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9790101cd0 0x7f97901020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:50.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.481+0000 7f9798497640 1 -- 172.21.15.59:0/2159219091 >> 172.21.15.59:0/2159219091 conn(0x7f97900fd700 msgr2=0x7f97900ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:50.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.481+0000 7f9798497640 1 -- 172.21.15.59:0/2159219091 shutdown_connections 2024-09-10T21:13:50.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.481+0000 7f9798497640 1 -- 172.21.15.59:0/2159219091 wait complete. 2024-09-10T21:13:50.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.481+0000 7f9798497640 1 Processor -- start 2024-09-10T21:13:50.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.481+0000 7f9798497640 1 -- start start 2024-09-10T21:13:50.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f9798497640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9790101cd0 0x7f97901992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:50.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f9798497640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97901076e0 0x7f9790199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:50.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f9798497640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9790108060 0x7f979019ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:50.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f9798497640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9790112e20 con 0x7f9790108060 2024-09-10T21:13:50.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f9798497640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9790112ca0 con 0x7f97901076e0 2024-09-10T21:13:50.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f9798497640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9790112fa0 con 0x7f9790101cd0 2024-09-10T21:13:50.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f9796a34640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9790108060 0x7f979019ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:50.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f9796a34640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9790108060 0x7f979019ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52828/0 (socket says 172.21.15.59:52828) 2024-09-10T21:13:50.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f9796a34640 1 -- 172.21.15.59:0/882808714 learned_addr learned my addr 172.21.15.59:0/882808714 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:50.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f9795a32640 1 --2- 172.21.15.59:0/882808714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97901076e0 0x7f9790199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:50.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f9796233640 1 --2- 172.21.15.59:0/882808714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9790101cd0 0x7f97901992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:50.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f9796a34640 1 -- 172.21.15.59:0/882808714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9790101cd0 msgr2=0x7f97901992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:50.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f9796a34640 1 --2- 172.21.15.59:0/882808714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9790101cd0 0x7f97901992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:50.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f9796a34640 1 -- 172.21.15.59:0/882808714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97901076e0 msgr2=0x7f9790199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:50.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f9796a34640 1 --2- 172.21.15.59:0/882808714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97901076e0 0x7f9790199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:50.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f9796a34640 1 -- 172.21.15.59:0/882808714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979019f380 con 0x7f9790108060 2024-09-10T21:13:50.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f9796a34640 1 --2- 172.21.15.59:0/882808714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9790108060 0x7f979019ebb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f978800cad0 tx=0x7f978800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:50.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f97877fe640 1 -- 172.21.15.59:0/882808714 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978800ae20 con 0x7f9790108060 2024-09-10T21:13:50.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f97877fe640 1 -- 172.21.15.59:0/882808714 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9788005020 con 0x7f9790108060 2024-09-10T21:13:50.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f9798497640 1 -- 172.21.15.59:0/882808714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f979019f670 con 0x7f9790108060 2024-09-10T21:13:50.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.482+0000 7f97877fe640 1 -- 172.21.15.59:0/882808714 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978800f6b0 con 0x7f9790108060 2024-09-10T21:13:50.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.483+0000 7f9798497640 1 -- 172.21.15.59:0/882808714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f979019fa00 con 0x7f9790108060 2024-09-10T21:13:50.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.483+0000 7f9798497640 1 -- 172.21.15.59:0/882808714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97901020b0 con 0x7f9790108060 2024-09-10T21:13:50.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.485+0000 7f97877fe640 1 -- 172.21.15.59:0/882808714 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f97880054f0 con 0x7f9790108060 2024-09-10T21:13:50.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.486+0000 7f97877fe640 1 --2- 172.21.15.59:0/882808714 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f977c0b53f0 0x7f977c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:50.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.486+0000 7f9796233640 1 --2- 172.21.15.59:0/882808714 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f977c0b53f0 0x7f977c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:50.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.486+0000 7f97877fe640 1 -- 172.21.15.59:0/882808714 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f97880e5ea0 con 0x7f9790108060 2024-09-10T21:13:50.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.486+0000 7f9796233640 1 --2- 172.21.15.59:0/882808714 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f977c0b53f0 0x7f977c0b78b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f978c0095f0 tx=0x7f978c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:50.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.489+0000 7f97877fe640 1 -- 172.21.15.59:0/882808714 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f979019fa00 con 0x7f9790108060 2024-09-10T21:13:50.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.726+0000 7f9798497640 1 -- 172.21.15.59:0/882808714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f979002e5c0 con 0x7f9790108060 2024-09-10T21:13:50.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.730+0000 7f97877fe640 1 -- 172.21.15.59:0/882808714 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+294211 (secure 0 0 0) 0x7f9788014030 con 0x7f9790108060 2024-09-10T21:13:50.738 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:13:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.734+0000 7f9798497640 1 -- 172.21.15.59:0/882808714 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f977c0b53f0 msgr2=0x7f977c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.734+0000 7f9798497640 1 --2- 172.21.15.59:0/882808714 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f977c0b53f0 0x7f977c0b78b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f978c0095f0 tx=0x7f978c005f90 comp rx=0 tx=0).stop 2024-09-10T21:13:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.734+0000 7f9798497640 1 -- 172.21.15.59:0/882808714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9790108060 msgr2=0x7f979019ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.734+0000 7f9798497640 1 --2- 172.21.15.59:0/882808714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9790108060 0x7f979019ebb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f978800cad0 tx=0x7f978800cf90 comp rx=0 tx=0).stop 2024-09-10T21:13:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.734+0000 7f9798497640 1 -- 172.21.15.59:0/882808714 shutdown_connections 2024-09-10T21:13:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.734+0000 7f9798497640 1 --2- 172.21.15.59:0/882808714 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f977c0b53f0 0x7f977c0b78b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.734+0000 7f9798497640 1 --2- 172.21.15.59:0/882808714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9790108060 0x7f979019ebb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.734+0000 7f9798497640 1 --2- 172.21.15.59:0/882808714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97901076e0 0x7f9790199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.734+0000 7f9798497640 1 --2- 172.21.15.59:0/882808714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9790101cd0 0x7f97901992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.734+0000 7f9798497640 1 -- 172.21.15.59:0/882808714 >> 172.21.15.59:0/882808714 conn(0x7f97900fd700 msgr2=0x7f97900ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.734+0000 7f9798497640 1 -- 172.21.15.59:0/882808714 shutdown_connections 2024-09-10T21:13:50.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:50.734+0000 7f9798497640 1 -- 172.21.15.59:0/882808714 wait complete. 2024-09-10T21:13:51.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:51 smithi192 ceph-mon[35363]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-10T21:13:51.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:51 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/882808714' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T21:13:51.366 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:51 smithi059 ceph-mon[30888]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-10T21:13:51.366 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:51 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/882808714' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T21:13:51.394 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":123832859},{"type":"v1","addr":"172.21.15.59:6801","nonce":123832859}]},"active_addr":"172.21.15.59:6801/123832859","active_change":"2024-09-10T21:06:05.141052+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24127,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24128,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.59:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":3251423687}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":872522677}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":2779156397}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":174460377}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":4215472907}]}]} 2024-09-10T21:13:51.400 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-10T21:13:51.400 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-10T21:13:51.401 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:13:51.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:51 smithi154 ceph-mon[35041]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-09-10T21:13:51.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:51 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/882808714' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T21:13:51.657 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:52.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.112+0000 7fa842b60640 1 -- 172.21.15.59:0/2593664154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa83c102dc0 msgr2=0x7fa83c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:52.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.112+0000 7fa842b60640 1 --2- 172.21.15.59:0/2593664154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa83c102dc0 0x7fa83c1031a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa830009900 tx=0x7fa83002a410 comp rx=0 tx=0).stop 2024-09-10T21:13:52.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.112+0000 7fa842b60640 1 -- 172.21.15.59:0/2593664154 shutdown_connections 2024-09-10T21:13:52.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.112+0000 7fa842b60640 1 --2- 172.21.15.59:0/2593664154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa83c109150 0x7fa83c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:52.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.112+0000 7fa842b60640 1 --2- 172.21.15.59:0/2593664154 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa83c1087d0 0x7fa83c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:52.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.112+0000 7fa842b60640 1 --2- 172.21.15.59:0/2593664154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa83c102dc0 0x7fa83c1031a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:52.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.112+0000 7fa842b60640 1 -- 172.21.15.59:0/2593664154 >> 172.21.15.59:0/2593664154 conn(0x7fa83c0fe830 msgr2=0x7fa83c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:52.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.112+0000 7fa842b60640 1 -- 172.21.15.59:0/2593664154 shutdown_connections 2024-09-10T21:13:52.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.112+0000 7fa842b60640 1 -- 172.21.15.59:0/2593664154 wait complete. 2024-09-10T21:13:52.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.113+0000 7fa842b60640 1 Processor -- start 2024-09-10T21:13:52.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.113+0000 7fa842b60640 1 -- start start 2024-09-10T21:13:52.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.113+0000 7fa842b60640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa83c102dc0 0x7fa83c199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:52.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.113+0000 7fa842b60640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa83c1087d0 0x7fa83c1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:52.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.113+0000 7fa842b60640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa83c109150 0x7fa83c19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:52.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.113+0000 7fa842b60640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c112e10 con 0x7fa83c1087d0 2024-09-10T21:13:52.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.113+0000 7fa842b60640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c112c90 con 0x7fa83c102dc0 2024-09-10T21:13:52.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.113+0000 7fa842b60640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c112f90 con 0x7fa83c109150 2024-09-10T21:13:52.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.113+0000 7fa83bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa83c1087d0 0x7fa83c1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:52.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.113+0000 7fa83bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa83c1087d0 0x7fa83c1997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52844/0 (socket says 172.21.15.59:52844) 2024-09-10T21:13:52.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.113+0000 7fa83bfff640 1 -- 172.21.15.59:0/987071586 learned_addr learned my addr 172.21.15.59:0/987071586 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:52.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.113+0000 7fa8410fd640 1 --2- 172.21.15.59:0/987071586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa83c109150 0x7fa83c19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:52.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.114+0000 7fa8408fc640 1 --2- 172.21.15.59:0/987071586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa83c102dc0 0x7fa83c199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:52.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.114+0000 7fa83bfff640 1 -- 172.21.15.59:0/987071586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa83c109150 msgr2=0x7fa83c19eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:52.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.114+0000 7fa83bfff640 1 --2- 172.21.15.59:0/987071586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa83c109150 0x7fa83c19eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:52.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.114+0000 7fa83bfff640 1 -- 172.21.15.59:0/987071586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa83c102dc0 msgr2=0x7fa83c199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:52.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.114+0000 7fa83bfff640 1 --2- 172.21.15.59:0/987071586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa83c102dc0 0x7fa83c199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:52.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.114+0000 7fa83bfff640 1 -- 172.21.15.59:0/987071586 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83c19f330 con 0x7fa83c1087d0 2024-09-10T21:13:52.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.114+0000 7fa8408fc640 1 --2- 172.21.15.59:0/987071586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa83c102dc0 0x7fa83c199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:13:52.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.114+0000 7fa83bfff640 1 --2- 172.21.15.59:0/987071586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa83c1087d0 0x7fa83c1997c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa82800b4a0 tx=0x7fa82800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:52.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.114+0000 7fa839ffb640 1 -- 172.21.15.59:0/987071586 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828014070 con 0x7fa83c1087d0 2024-09-10T21:13:52.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.114+0000 7fa839ffb640 1 -- 172.21.15.59:0/987071586 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa828010ac0 con 0x7fa83c1087d0 2024-09-10T21:13:52.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.114+0000 7fa842b60640 1 -- 172.21.15.59:0/987071586 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83c19f620 con 0x7fa83c1087d0 2024-09-10T21:13:52.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.114+0000 7fa839ffb640 1 -- 172.21.15.59:0/987071586 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828017c30 con 0x7fa83c1087d0 2024-09-10T21:13:52.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.114+0000 7fa842b60640 1 -- 172.21.15.59:0/987071586 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa83c1a5eb0 con 0x7fa83c1087d0 2024-09-10T21:13:52.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.115+0000 7fa842b60640 1 -- 172.21.15.59:0/987071586 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa83c1031a0 con 0x7fa83c1087d0 2024-09-10T21:13:52.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.116+0000 7fa839ffb640 1 -- 172.21.15.59:0/987071586 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fa828010610 con 0x7fa83c1087d0 2024-09-10T21:13:52.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.117+0000 7fa839ffb640 1 --2- 172.21.15.59:0/987071586 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa82c0b53f0 0x7fa82c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:52.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.117+0000 7fa8408fc640 1 --2- 172.21.15.59:0/987071586 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa82c0b53f0 0x7fa82c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:52.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.117+0000 7fa839ffb640 1 -- 172.21.15.59:0/987071586 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fa8280e55c0 con 0x7fa83c1087d0 2024-09-10T21:13:52.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.118+0000 7fa8408fc640 1 --2- 172.21.15.59:0/987071586 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa82c0b53f0 0x7fa82c0b78b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa830000c00 tx=0x7fa830031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:52.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.121+0000 7fa839ffb640 1 -- 172.21.15.59:0/987071586 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa8280ac3d0 con 0x7fa83c1087d0 2024-09-10T21:13:52.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.308+0000 7fa842b60640 1 -- 172.21.15.59:0/987071586 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa83c10a9a0 con 0x7fa83c1087d0 2024-09-10T21:13:52.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.309+0000 7fa839ffb640 1 -- 172.21.15.59:0/987071586 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22304 (secure 0 0 0) 0x7fa8280abcd0 con 0x7fa83c1087d0 2024-09-10T21:13:52.313 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:13:52.314 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":73,"fsid":"3c26b952-6fb8-11ef-bcea-c7b262605968","created":"2024-09-10T21:05:18.196881+0000","modified":"2024-09-10T21:13:19.283891+0000","last_up_change":"2024-09-10T21:12:31.909004+0000","last_in_change":"2024-09-10T21:12:08.116727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:08:47.611285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:13:15.562661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:13:17.272280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e88abf3-8592-4b5f-8ba9-5969e01e12d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6803","nonce":1237328951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6805","nonce":1237328951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6809","nonce":1237328951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6807","nonce":1237328951}]},"public_addr":"172.21.15.59:6803/1237328951","cluster_addr":"172.21.15.59:6805/1237328951","heartbeat_back_addr":"172.21.15.59:6809/1237328951","heartbeat_front_addr":"172.21.15.59:6807/1237328951","state":["exists","up"]},{"osd":1,"uuid":"7908eefd-bbfa-4fe4-9db9-7a92d0e77acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6801","nonce":3376412264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6803","nonce":3376412264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6807","nonce":3376412264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6805","nonce":3376412264}]},"public_addr":"172.21.15.154:6801/3376412264","cluster_addr":"172.21.15.154:6803/3376412264","heartbeat_back_addr":"172.21.15.154:6807/3376412264","heartbeat_front_addr":"172.21.15.154:6805/3376412264","state":["exists","up"]},{"osd":2,"uuid":"2351b9f0-bca1-48b2-afb8-0e2b7856c52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6801","nonce":440750253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6803","nonce":440750253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6807","nonce":440750253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6805","nonce":440750253}]},"public_addr":"172.21.15.192:6801/440750253","cluster_addr":"172.21.15.192:6803/440750253","heartbeat_back_addr":"172.21.15.192:6807/440750253","heartbeat_front_addr":"172.21.15.192:6805/440750253","state":["exists","up"]},{"osd":3,"uuid":"f26969d1-7b48-4f20-9077-c55c59775ed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6811","nonce":1483798393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6813","nonce":1483798393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6817","nonce":1483798393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6815","nonce":1483798393}]},"public_addr":"172.21.15.59:6811/1483798393","cluster_addr":"172.21.15.59:6813/1483798393","heartbeat_back_addr":"172.21.15.59:6817/1483798393","heartbeat_front_addr":"172.21.15.59:6815/1483798393","state":["exists","up"]},{"osd":4,"uuid":"21e1a472-1ae1-454b-aee5-2ad92f6eff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6809","nonce":1817188525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6811","nonce":1817188525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6815","nonce":1817188525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6813","nonce":1817188525}]},"public_addr":"172.21.15.154:6809/1817188525","cluster_addr":"172.21.15.154:6811/1817188525","heartbeat_back_addr":"172.21.15.154:6815/1817188525","heartbeat_front_addr":"172.21.15.154:6813/1817188525","state":["exists","up"]},{"osd":5,"uuid":"6191b10a-5cbd-4225-b0ec-70d05023d5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6809","nonce":1221386274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6811","nonce":1221386274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6815","nonce":1221386274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6813","nonce":1221386274}]},"public_addr":"172.21.15.192:6809/1221386274","cluster_addr":"172.21.15.192:6811/1221386274","heartbeat_back_addr":"172.21.15.192:6815/1221386274","heartbeat_front_addr":"172.21.15.192:6813/1221386274","state":["exists","up"]},{"osd":6,"uuid":"609c11f7-ce82-4714-bf73-a4f16f4483ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6819","nonce":3006857566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6821","nonce":3006857566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6825","nonce":3006857566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6823","nonce":3006857566}]},"public_addr":"172.21.15.59:6819/3006857566","cluster_addr":"172.21.15.59:6821/3006857566","heartbeat_back_addr":"172.21.15.59:6825/3006857566","heartbeat_front_addr":"172.21.15.59:6823/3006857566","state":["exists","up"]},{"osd":7,"uuid":"bff3a29f-47cc-4e66-92e4-14e9b7faf498","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6817","nonce":175260385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6819","nonce":175260385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6823","nonce":175260385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6821","nonce":175260385}]},"public_addr":"172.21.15.154:6817/175260385","cluster_addr":"172.21.15.154:6819/175260385","heartbeat_back_addr":"172.21.15.154:6823/175260385","heartbeat_front_addr":"172.21.15.154:6821/175260385","state":["exists","up"]},{"osd":8,"uuid":"56dabafd-9bb9-409a-88cd-4b5b5ecf810a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6817","nonce":3138189462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6819","nonce":3138189462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6823","nonce":3138189462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6821","nonce":3138189462}]},"public_addr":"172.21.15.192:6817/3138189462","cluster_addr":"172.21.15.192:6819/3138189462","heartbeat_back_addr":"172.21.15.192:6823/3138189462","heartbeat_front_addr":"172.21.15.192:6821/3138189462","state":["exists","up"]},{"osd":9,"uuid":"044f934d-3df5-47aa-85f5-c3b63b267ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6827","nonce":2446500753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6829","nonce":2446500753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6833","nonce":2446500753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6831","nonce":2446500753}]},"public_addr":"172.21.15.59:6827/2446500753","cluster_addr":"172.21.15.59:6829/2446500753","heartbeat_back_addr":"172.21.15.59:6833/2446500753","heartbeat_front_addr":"172.21.15.59:6831/2446500753","state":["exists","up"]},{"osd":10,"uuid":"8d3b735b-e4fe-4a8e-8c75-a49313c6fabb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6825","nonce":1139781446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6827","nonce":1139781446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6831","nonce":1139781446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6829","nonce":1139781446}]},"public_addr":"172.21.15.154:6825/1139781446","cluster_addr":"172.21.15.154:6827/1139781446","heartbeat_back_addr":"172.21.15.154:6831/1139781446","heartbeat_front_addr":"172.21.15.154:6829/1139781446","state":["exists","up"]},{"osd":11,"uuid":"fd6a6d06-c6aa-42e3-aa38-fc583319f6bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6825","nonce":1041494458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6827","nonce":1041494458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6831","nonce":1041494458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6829","nonce":1041494458}]},"public_addr":"172.21.15.192:6825/1041494458","cluster_addr":"172.21.15.192:6827/1041494458","heartbeat_back_addr":"172.21.15.192:6831/1041494458","heartbeat_front_addr":"172.21.15.192:6829/1041494458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:07:53.974382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:19.552358+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:44.251670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:09.430992+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:34.043343+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:59.903679+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:25.733171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:49.795257+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:14.485648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:40.485165+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:04.655475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:29.308456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/212243638":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/3305207692":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6801/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/2965147556":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/1174570395":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/2934865748":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:6801/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/3377179776":"2024-09-11T21:05:40.304807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:13:52.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.312+0000 7fa842b60640 1 -- 172.21.15.59:0/987071586 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa82c0b53f0 msgr2=0x7fa82c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:52.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.312+0000 7fa842b60640 1 --2- 172.21.15.59:0/987071586 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa82c0b53f0 0x7fa82c0b78b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa830000c00 tx=0x7fa830031400 comp rx=0 tx=0).stop 2024-09-10T21:13:52.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.312+0000 7fa842b60640 1 -- 172.21.15.59:0/987071586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa83c1087d0 msgr2=0x7fa83c1997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:52.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.312+0000 7fa842b60640 1 --2- 172.21.15.59:0/987071586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa83c1087d0 0x7fa83c1997c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa82800b4a0 tx=0x7fa82800b960 comp rx=0 tx=0).stop 2024-09-10T21:13:52.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.312+0000 7fa842b60640 1 -- 172.21.15.59:0/987071586 shutdown_connections 2024-09-10T21:13:52.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.312+0000 7fa842b60640 1 --2- 172.21.15.59:0/987071586 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa82c0b53f0 0x7fa82c0b78b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:52.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.312+0000 7fa842b60640 1 --2- 172.21.15.59:0/987071586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa83c109150 0x7fa83c19eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:52.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.312+0000 7fa842b60640 1 --2- 172.21.15.59:0/987071586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa83c1087d0 0x7fa83c1997c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:52.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.312+0000 7fa842b60640 1 --2- 172.21.15.59:0/987071586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa83c102dc0 0x7fa83c199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:52.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.312+0000 7fa842b60640 1 -- 172.21.15.59:0/987071586 >> 172.21.15.59:0/987071586 conn(0x7fa83c0fe830 msgr2=0x7fa83c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:52.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.312+0000 7fa842b60640 1 -- 172.21.15.59:0/987071586 shutdown_connections 2024-09-10T21:13:52.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:52.312+0000 7fa842b60640 1 -- 172.21.15.59:0/987071586 wait complete. 2024-09-10T21:13:53.006 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-10T21:13:53.007 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:13:53.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:53 smithi059 ceph-mon[30888]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-09-10T21:13:53.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:53 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/987071586' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:13:53.269 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:53.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:53 smithi192 ceph-mon[35363]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-09-10T21:13:53.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:53 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/987071586' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:13:53.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:53 smithi154 ceph-mon[35041]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-09-10T21:13:53.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:53 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/987071586' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:13:53.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.756+0000 7f857c772640 1 -- 172.21.15.59:0/272120161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8574101c90 msgr2=0x7f8574102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:53.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.756+0000 7f857c772640 1 --2- 172.21.15.59:0/272120161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8574101c90 0x7f8574102070 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8564009ca0 tx=0x7f856402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:13:53.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.756+0000 7f857c772640 1 -- 172.21.15.59:0/272120161 shutdown_connections 2024-09-10T21:13:53.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.756+0000 7f857c772640 1 --2- 172.21.15.59:0/272120161 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8574108020 0x7f857410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:53.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.756+0000 7f857c772640 1 --2- 172.21.15.59:0/272120161 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85741076a0 0x7f8574107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:53.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.756+0000 7f857c772640 1 --2- 172.21.15.59:0/272120161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8574101c90 0x7f8574102070 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:53.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.756+0000 7f857c772640 1 -- 172.21.15.59:0/272120161 >> 172.21.15.59:0/272120161 conn(0x7f85740fd700 msgr2=0x7f85740ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:53.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.756+0000 7f857c772640 1 -- 172.21.15.59:0/272120161 shutdown_connections 2024-09-10T21:13:53.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.756+0000 7f857c772640 1 -- 172.21.15.59:0/272120161 wait complete. 2024-09-10T21:13:53.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.756+0000 7f857c772640 1 Processor -- start 2024-09-10T21:13:53.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.756+0000 7f857c772640 1 -- start start 2024-09-10T21:13:53.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.757+0000 7f857c772640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8574101c90 0x7f8574199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:53.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.757+0000 7f857c772640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85741076a0 0x7f8574199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:53.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.757+0000 7f857c772640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8574108020 0x7f857419ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:53.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.757+0000 7f857c772640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8574111ce0 con 0x7f8574108020 2024-09-10T21:13:53.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.757+0000 7f857c772640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8574111b60 con 0x7f8574101c90 2024-09-10T21:13:53.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.757+0000 7f857c772640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8574111e60 con 0x7f85741076a0 2024-09-10T21:13:53.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.757+0000 7f857ad0f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8574108020 0x7f857419ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:53.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.757+0000 7f857ad0f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8574108020 0x7f857419ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52862/0 (socket says 172.21.15.59:52862) 2024-09-10T21:13:53.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.757+0000 7f857ad0f640 1 -- 172.21.15.59:0/370578363 learned_addr learned my addr 172.21.15.59:0/370578363 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:53.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.757+0000 7f857a50e640 1 --2- 172.21.15.59:0/370578363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8574101c90 0x7f8574199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:53.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.757+0000 7f8579d0d640 1 --2- 172.21.15.59:0/370578363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85741076a0 0x7f8574199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:53.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.757+0000 7f857ad0f640 1 -- 172.21.15.59:0/370578363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85741076a0 msgr2=0x7f8574199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:53.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.757+0000 7f857ad0f640 1 --2- 172.21.15.59:0/370578363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85741076a0 0x7f8574199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:53.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.757+0000 7f857ad0f640 1 -- 172.21.15.59:0/370578363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8574101c90 msgr2=0x7f8574199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:53.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.757+0000 7f857ad0f640 1 --2- 172.21.15.59:0/370578363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8574101c90 0x7f8574199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:53.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.757+0000 7f857ad0f640 1 -- 172.21.15.59:0/370578363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f857419f3c0 con 0x7f8574108020 2024-09-10T21:13:53.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.758+0000 7f857ad0f640 1 --2- 172.21.15.59:0/370578363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8574108020 0x7f857419ebf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f856c009fd0 tx=0x7f856c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:53.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.758+0000 7f85737fe640 1 -- 172.21.15.59:0/370578363 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c011830 con 0x7f8574108020 2024-09-10T21:13:53.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.758+0000 7f85737fe640 1 -- 172.21.15.59:0/370578363 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f856c016070 con 0x7f8574108020 2024-09-10T21:13:53.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.758+0000 7f85737fe640 1 -- 172.21.15.59:0/370578363 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c010de0 con 0x7f8574108020 2024-09-10T21:13:53.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.758+0000 7f857c772640 1 -- 172.21.15.59:0/370578363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f857419f6b0 con 0x7f8574108020 2024-09-10T21:13:53.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.758+0000 7f857c772640 1 -- 172.21.15.59:0/370578363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85741a5df0 con 0x7f8574108020 2024-09-10T21:13:53.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.759+0000 7f857c772640 1 -- 172.21.15.59:0/370578363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8574102070 con 0x7f8574108020 2024-09-10T21:13:53.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.760+0000 7f85737fe640 1 -- 172.21.15.59:0/370578363 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f856c0119d0 con 0x7f8574108020 2024-09-10T21:13:53.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.761+0000 7f85737fe640 1 --2- 172.21.15.59:0/370578363 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f855c0b5370 0x7f855c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:53.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.762+0000 7f857a50e640 1 --2- 172.21.15.59:0/370578363 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f855c0b5370 0x7f855c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:53.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.762+0000 7f85737fe640 1 -- 172.21.15.59:0/370578363 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f856c0e57f0 con 0x7f8574108020 2024-09-10T21:13:53.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.762+0000 7f857a50e640 1 --2- 172.21.15.59:0/370578363 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f855c0b5370 0x7f855c0b7830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8564009430 tx=0x7f8564009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:53.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.765+0000 7f85737fe640 1 -- 172.21.15.59:0/370578363 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f856c0ac680 con 0x7f8574108020 2024-09-10T21:13:53.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.949+0000 7f857c772640 1 -- 172.21.15.59:0/370578363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f857419a440 con 0x7f8574108020 2024-09-10T21:13:53.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.951+0000 7f85737fe640 1 -- 172.21.15.59:0/370578363 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+22304 (secure 0 0 0) 0x7f856c0abf80 con 0x7f8574108020 2024-09-10T21:13:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:13:53.955 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":73,"fsid":"3c26b952-6fb8-11ef-bcea-c7b262605968","created":"2024-09-10T21:05:18.196881+0000","modified":"2024-09-10T21:13:19.283891+0000","last_up_change":"2024-09-10T21:12:31.909004+0000","last_in_change":"2024-09-10T21:12:08.116727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:08:47.611285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:13:15.562661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:13:17.272280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e88abf3-8592-4b5f-8ba9-5969e01e12d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6803","nonce":1237328951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6805","nonce":1237328951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6809","nonce":1237328951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6807","nonce":1237328951}]},"public_addr":"172.21.15.59:6803/1237328951","cluster_addr":"172.21.15.59:6805/1237328951","heartbeat_back_addr":"172.21.15.59:6809/1237328951","heartbeat_front_addr":"172.21.15.59:6807/1237328951","state":["exists","up"]},{"osd":1,"uuid":"7908eefd-bbfa-4fe4-9db9-7a92d0e77acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6801","nonce":3376412264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6803","nonce":3376412264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6807","nonce":3376412264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6805","nonce":3376412264}]},"public_addr":"172.21.15.154:6801/3376412264","cluster_addr":"172.21.15.154:6803/3376412264","heartbeat_back_addr":"172.21.15.154:6807/3376412264","heartbeat_front_addr":"172.21.15.154:6805/3376412264","state":["exists","up"]},{"osd":2,"uuid":"2351b9f0-bca1-48b2-afb8-0e2b7856c52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6801","nonce":440750253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6803","nonce":440750253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6807","nonce":440750253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6805","nonce":440750253}]},"public_addr":"172.21.15.192:6801/440750253","cluster_addr":"172.21.15.192:6803/440750253","heartbeat_back_addr":"172.21.15.192:6807/440750253","heartbeat_front_addr":"172.21.15.192:6805/440750253","state":["exists","up"]},{"osd":3,"uuid":"f26969d1-7b48-4f20-9077-c55c59775ed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6811","nonce":1483798393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6813","nonce":1483798393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6817","nonce":1483798393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6815","nonce":1483798393}]},"public_addr":"172.21.15.59:6811/1483798393","cluster_addr":"172.21.15.59:6813/1483798393","heartbeat_back_addr":"172.21.15.59:6817/1483798393","heartbeat_front_addr":"172.21.15.59:6815/1483798393","state":["exists","up"]},{"osd":4,"uuid":"21e1a472-1ae1-454b-aee5-2ad92f6eff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6809","nonce":1817188525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6811","nonce":1817188525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6815","nonce":1817188525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6813","nonce":1817188525}]},"public_addr":"172.21.15.154:6809/1817188525","cluster_addr":"172.21.15.154:6811/1817188525","heartbeat_back_addr":"172.21.15.154:6815/1817188525","heartbeat_front_addr":"172.21.15.154:6813/1817188525","state":["exists","up"]},{"osd":5,"uuid":"6191b10a-5cbd-4225-b0ec-70d05023d5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6809","nonce":1221386274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6811","nonce":1221386274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6815","nonce":1221386274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6813","nonce":1221386274}]},"public_addr":"172.21.15.192:6809/1221386274","cluster_addr":"172.21.15.192:6811/1221386274","heartbeat_back_addr":"172.21.15.192:6815/1221386274","heartbeat_front_addr":"172.21.15.192:6813/1221386274","state":["exists","up"]},{"osd":6,"uuid":"609c11f7-ce82-4714-bf73-a4f16f4483ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6819","nonce":3006857566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6821","nonce":3006857566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6825","nonce":3006857566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6823","nonce":3006857566}]},"public_addr":"172.21.15.59:6819/3006857566","cluster_addr":"172.21.15.59:6821/3006857566","heartbeat_back_addr":"172.21.15.59:6825/3006857566","heartbeat_front_addr":"172.21.15.59:6823/3006857566","state":["exists","up"]},{"osd":7,"uuid":"bff3a29f-47cc-4e66-92e4-14e9b7faf498","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6817","nonce":175260385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6819","nonce":175260385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6823","nonce":175260385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6821","nonce":175260385}]},"public_addr":"172.21.15.154:6817/175260385","cluster_addr":"172.21.15.154:6819/175260385","heartbeat_back_addr":"172.21.15.154:6823/175260385","heartbeat_front_addr":"172.21.15.154:6821/175260385","state":["exists","up"]},{"osd":8,"uuid":"56dabafd-9bb9-409a-88cd-4b5b5ecf810a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6817","nonce":3138189462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6819","nonce":3138189462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6823","nonce":3138189462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6821","nonce":3138189462}]},"public_addr":"172.21.15.192:6817/3138189462","cluster_addr":"172.21.15.192:6819/3138189462","heartbeat_back_addr":"172.21.15.192:6823/3138189462","heartbeat_front_addr":"172.21.15.192:6821/3138189462","state":["exists","up"]},{"osd":9,"uuid":"044f934d-3df5-47aa-85f5-c3b63b267ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6827","nonce":2446500753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6829","nonce":2446500753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6833","nonce":2446500753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6831","nonce":2446500753}]},"public_addr":"172.21.15.59:6827/2446500753","cluster_addr":"172.21.15.59:6829/2446500753","heartbeat_back_addr":"172.21.15.59:6833/2446500753","heartbeat_front_addr":"172.21.15.59:6831/2446500753","state":["exists","up"]},{"osd":10,"uuid":"8d3b735b-e4fe-4a8e-8c75-a49313c6fabb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6825","nonce":1139781446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6827","nonce":1139781446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6831","nonce":1139781446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6829","nonce":1139781446}]},"public_addr":"172.21.15.154:6825/1139781446","cluster_addr":"172.21.15.154:6827/1139781446","heartbeat_back_addr":"172.21.15.154:6831/1139781446","heartbeat_front_addr":"172.21.15.154:6829/1139781446","state":["exists","up"]},{"osd":11,"uuid":"fd6a6d06-c6aa-42e3-aa38-fc583319f6bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6825","nonce":1041494458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6827","nonce":1041494458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6831","nonce":1041494458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6829","nonce":1041494458}]},"public_addr":"172.21.15.192:6825/1041494458","cluster_addr":"172.21.15.192:6827/1041494458","heartbeat_back_addr":"172.21.15.192:6831/1041494458","heartbeat_front_addr":"172.21.15.192:6829/1041494458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:07:53.974382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:19.552358+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:44.251670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:09.430992+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:34.043343+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:59.903679+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:25.733171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:49.795257+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:14.485648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:40.485165+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:04.655475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:29.308456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/212243638":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/3305207692":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6801/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/2965147556":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/1174570395":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/2934865748":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:6801/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/3377179776":"2024-09-11T21:05:40.304807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:13:53.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.953+0000 7f857c772640 1 -- 172.21.15.59:0/370578363 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f855c0b5370 msgr2=0x7f855c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:53.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.953+0000 7f857c772640 1 --2- 172.21.15.59:0/370578363 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f855c0b5370 0x7f855c0b7830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8564009430 tx=0x7f8564009360 comp rx=0 tx=0).stop 2024-09-10T21:13:53.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.953+0000 7f857c772640 1 -- 172.21.15.59:0/370578363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8574108020 msgr2=0x7f857419ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:53.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.953+0000 7f857c772640 1 --2- 172.21.15.59:0/370578363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8574108020 0x7f857419ebf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f856c009fd0 tx=0x7f856c00b8e0 comp rx=0 tx=0).stop 2024-09-10T21:13:53.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.953+0000 7f857c772640 1 -- 172.21.15.59:0/370578363 shutdown_connections 2024-09-10T21:13:53.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.953+0000 7f857c772640 1 --2- 172.21.15.59:0/370578363 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f855c0b5370 0x7f855c0b7830 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:53.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.953+0000 7f857c772640 1 --2- 172.21.15.59:0/370578363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8574108020 0x7f857419ebf0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:53.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.953+0000 7f857c772640 1 --2- 172.21.15.59:0/370578363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85741076a0 0x7f8574199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:53.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.953+0000 7f857c772640 1 --2- 172.21.15.59:0/370578363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8574101c90 0x7f8574199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:53.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.954+0000 7f857c772640 1 -- 172.21.15.59:0/370578363 >> 172.21.15.59:0/370578363 conn(0x7f85740fd700 msgr2=0x7f857406adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:53.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.954+0000 7f857c772640 1 -- 172.21.15.59:0/370578363 shutdown_connections 2024-09-10T21:13:53.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:53.954+0000 7f857c772640 1 -- 172.21.15.59:0/370578363 wait complete. 2024-09-10T21:13:54.247 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:54 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/370578363' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:13:54.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:54 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/370578363' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:13:54.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:54 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/370578363' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:13:54.647 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-10T21:13:54.648 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-10T21:13:54.648 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-10T21:13:54.649 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-10T21:13:54.649 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-10T21:13:54.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-10T21:13:54.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-10T21:13:54.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-10T21:13:54.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-10T21:13:54.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-10T21:13:54.652 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-10T21:13:54.652 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-10T21:13:55.319 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:55.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:55 smithi192 ceph-mon[35363]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-10T21:13:55.336 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:55.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:55 smithi059 ceph-mon[30888]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-10T21:13:55.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:55 smithi154 ceph-mon[35041]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-10T21:13:55.621 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:55.625 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:55.631 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:55.633 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:56.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.170+0000 7f4a7c856640 1 -- 172.21.15.59:0/1992031464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a78102dc0 msgr2=0x7f4a781031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:56.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.170+0000 7f4a7c856640 1 --2- 172.21.15.59:0/1992031464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a78102dc0 0x7f4a781031a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009900 tx=0x7f4a6802a410 comp rx=0 tx=0).stop 2024-09-10T21:13:56.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.170+0000 7f4a7c856640 1 -- 172.21.15.59:0/1992031464 shutdown_connections 2024-09-10T21:13:56.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.170+0000 7f4a7c856640 1 --2- 172.21.15.59:0/1992031464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a78109150 0x7f4a7810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:56.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.170+0000 7f4a7c856640 1 --2- 172.21.15.59:0/1992031464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a781087d0 0x7f4a78108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:56.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.170+0000 7f4a7c856640 1 --2- 172.21.15.59:0/1992031464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a78102dc0 0x7f4a781031a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:56.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.170+0000 7f4a7c856640 1 -- 172.21.15.59:0/1992031464 >> 172.21.15.59:0/1992031464 conn(0x7f4a780fe830 msgr2=0x7f4a78100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:56.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.170+0000 7f4a7c856640 1 -- 172.21.15.59:0/1992031464 shutdown_connections 2024-09-10T21:13:56.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.170+0000 7f4a7c856640 1 -- 172.21.15.59:0/1992031464 wait complete. 2024-09-10T21:13:56.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.171+0000 7f4a7c856640 1 Processor -- start 2024-09-10T21:13:56.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.171+0000 7f4a7c856640 1 -- start start 2024-09-10T21:13:56.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.171+0000 7f4a7c856640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a78102dc0 0x7f4a78199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:56.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.171+0000 7f4a7c856640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a781087d0 0x7f4a78199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:56.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.171+0000 7f4a7c856640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a78109150 0x7f4a7819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:56.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.171+0000 7f4a7c856640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4a78112e10 con 0x7f4a781087d0 2024-09-10T21:13:56.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.171+0000 7f4a7c856640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4a78112c90 con 0x7f4a78109150 2024-09-10T21:13:56.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.171+0000 7f4a7c856640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4a78112f90 con 0x7f4a78102dc0 2024-09-10T21:13:56.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.171+0000 7f4a75d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a781087d0 0x7f4a78199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:56.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.171+0000 7f4a75d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a781087d0 0x7f4a78199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52884/0 (socket says 172.21.15.59:52884) 2024-09-10T21:13:56.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.171+0000 7f4a75d9b640 1 -- 172.21.15.59:0/3686790482 learned_addr learned my addr 172.21.15.59:0/3686790482 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:56.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.171+0000 7f4a7659c640 1 --2- 172.21.15.59:0/3686790482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a78102dc0 0x7f4a78199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:56.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.171+0000 7f4a75d9b640 1 -- 172.21.15.59:0/3686790482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a78102dc0 msgr2=0x7f4a78199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:56.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.171+0000 7f4a75d9b640 1 --2- 172.21.15.59:0/3686790482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a78102dc0 0x7f4a78199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:56.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.171+0000 7f4a75d9b640 1 -- 172.21.15.59:0/3686790482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a78109150 msgr2=0x7f4a7819ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:56.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.171+0000 7f4a75d9b640 1 --2- 172.21.15.59:0/3686790482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a78109150 0x7f4a7819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:56.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.171+0000 7f4a75d9b640 1 -- 172.21.15.59:0/3686790482 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7819f3b0 con 0x7f4a781087d0 2024-09-10T21:13:56.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.171+0000 7f4a7659c640 1 --2- 172.21.15.59:0/3686790482 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a78102dc0 0x7f4a78199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:13:56.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.171+0000 7f4a75d9b640 1 --2- 172.21.15.59:0/3686790482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a781087d0 0x7f4a78199840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00c890 tx=0x7f4a6c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:56.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.172+0000 7f4a677fe640 1 -- 172.21.15.59:0/3686790482 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c004220 con 0x7f4a781087d0 2024-09-10T21:13:56.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.172+0000 7f4a677fe640 1 -- 172.21.15.59:0/3686790482 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a6c0043c0 con 0x7f4a781087d0 2024-09-10T21:13:56.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.172+0000 7f4a7c856640 1 -- 172.21.15.59:0/3686790482 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7819f6a0 con 0x7f4a781087d0 2024-09-10T21:13:56.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.172+0000 7f4a677fe640 1 -- 172.21.15.59:0/3686790482 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c004a00 con 0x7f4a781087d0 2024-09-10T21:13:56.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.172+0000 7f4a7c856640 1 -- 172.21.15.59:0/3686790482 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a781a5f30 con 0x7f4a781087d0 2024-09-10T21:13:56.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.173+0000 7f4a7c856640 1 -- 172.21.15.59:0/3686790482 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4a780638e0 con 0x7f4a781087d0 2024-09-10T21:13:56.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.174+0000 7f4a677fe640 1 -- 172.21.15.59:0/3686790482 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f4a6c0079b0 con 0x7f4a781087d0 2024-09-10T21:13:56.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.175+0000 7f4a677fe640 1 --2- 172.21.15.59:0/3686790482 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4a600b53f0 0x7f4a600b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:56.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.175+0000 7f4a7659c640 1 --2- 172.21.15.59:0/3686790482 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4a600b53f0 0x7f4a600b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:56.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.175+0000 7f4a677fe640 1 -- 172.21.15.59:0/3686790482 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f4a6c0e5d20 con 0x7f4a781087d0 2024-09-10T21:13:56.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.175+0000 7f4a677fe640 1 --2- 172.21.15.59:0/3686790482 >> [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393] conn(0x7f4a600beb30 0x7f4a600c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:56.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.175+0000 7f4a677fe640 1 -- 172.21.15.59:0/3686790482 --> [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a600c1600 con 0x7f4a600beb30 2024-09-10T21:13:56.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.175+0000 7f4a677fe640 1 -- 172.21.15.59:0/3686790482 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f4a6c0e6200 con 0x7f4a781087d0 2024-09-10T21:13:56.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.175+0000 7f4a76d9d640 1 --2- 172.21.15.59:0/3686790482 >> [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393] conn(0x7f4a600beb30 0x7f4a600c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:56.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.175+0000 7f4a7659c640 1 --2- 172.21.15.59:0/3686790482 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4a600b53f0 0x7f4a600b78b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4a68031440 tx=0x7f4a68005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:56.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.176+0000 7f4a76d9d640 1 --2- 172.21.15.59:0/3686790482 >> [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393] conn(0x7f4a600beb30 0x7f4a600c0f50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:56.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.176+0000 7f4a677fe640 1 -- 172.21.15.59:0/3686790482 <== osd.3 v2:172.21.15.59:6810/1483798393 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4a600c1600 con 0x7f4a600beb30 2024-09-10T21:13:56.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.190+0000 7f4a7c856640 1 -- 172.21.15.59:0/3686790482 --> [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4a78063ce0 con 0x7f4a600beb30 2024-09-10T21:13:56.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.191+0000 7f4a677fe640 1 -- 172.21.15.59:0/3686790482 <== osd.3 v2:172.21.15.59:6810/1483798393 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4a78063ce0 con 0x7f4a600beb30 2024-09-10T21:13:56.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.191+0000 7f4a7c856640 1 -- 172.21.15.59:0/3686790482 >> [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393] conn(0x7f4a600beb30 msgr2=0x7f4a600c0f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:56.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.191+0000 7f4a7c856640 1 --2- 172.21.15.59:0/3686790482 >> [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393] conn(0x7f4a600beb30 0x7f4a600c0f50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:56.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.191+0000 7f4a7c856640 1 -- 172.21.15.59:0/3686790482 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4a600b53f0 msgr2=0x7f4a600b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:56.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.191+0000 7f4a7c856640 1 --2- 172.21.15.59:0/3686790482 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4a600b53f0 0x7f4a600b78b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4a68031440 tx=0x7f4a68005a20 comp rx=0 tx=0).stop 2024-09-10T21:13:56.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.191+0000 7f4a7c856640 1 -- 172.21.15.59:0/3686790482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a781087d0 msgr2=0x7f4a78199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:56.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.191+0000 7f4a7c856640 1 --2- 172.21.15.59:0/3686790482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a781087d0 0x7f4a78199840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00c890 tx=0x7f4a6c00cd50 comp rx=0 tx=0).stop 2024-09-10T21:13:56.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.191+0000 7f4a76d9d640 1 -- 172.21.15.59:0/3686790482 reap_dead start 2024-09-10T21:13:56.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.191+0000 7f4a7c856640 1 -- 172.21.15.59:0/3686790482 shutdown_connections 2024-09-10T21:13:56.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.191+0000 7f4a7c856640 1 -- 172.21.15.59:0/3686790482 >> 172.21.15.59:0/3686790482 conn(0x7f4a780fe830 msgr2=0x7f4a78100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:56.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.191+0000 7f4a7c856640 1 -- 172.21.15.59:0/3686790482 shutdown_connections 2024-09-10T21:13:56.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.191+0000 7f4a7c856640 1 -- 172.21.15.59:0/3686790482 wait complete. 2024-09-10T21:13:56.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.591+0000 7f5026ecc640 1 -- 172.21.15.59:0/2842543662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50201076a0 msgr2=0x7f5020107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:56.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.591+0000 7f5026ecc640 1 --2- 172.21.15.59:0/2842543662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50201076a0 0x7f5020107ae0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f500c009900 tx=0x7f500c02a3f0 comp rx=0 tx=0).stop 2024-09-10T21:13:56.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.591+0000 7f5026ecc640 1 -- 172.21.15.59:0/2842543662 shutdown_connections 2024-09-10T21:13:56.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.591+0000 7f5026ecc640 1 --2- 172.21.15.59:0/2842543662 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5020108020 0x7f502010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:56.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.591+0000 7f5026ecc640 1 --2- 172.21.15.59:0/2842543662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50201076a0 0x7f5020107ae0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:56.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.591+0000 7f5026ecc640 1 --2- 172.21.15.59:0/2842543662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5020101c90 0x7f5020102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:56.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.591+0000 7f5026ecc640 1 -- 172.21.15.59:0/2842543662 >> 172.21.15.59:0/2842543662 conn(0x7f50200fd700 msgr2=0x7f50200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:56.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.591+0000 7f5026ecc640 1 -- 172.21.15.59:0/2842543662 shutdown_connections 2024-09-10T21:13:56.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.591+0000 7f5026ecc640 1 -- 172.21.15.59:0/2842543662 wait complete. 2024-09-10T21:13:56.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.592+0000 7f5026ecc640 1 Processor -- start 2024-09-10T21:13:56.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.592+0000 7f5026ecc640 1 -- start start 2024-09-10T21:13:56.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.592+0000 7f5026ecc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5020101c90 0x7f50201992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:56.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.592+0000 7f5026ecc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50201076a0 0x7f5020199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:56.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.592+0000 7f5026ecc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5020108020 0x7f502019eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:56.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.592+0000 7f5026ecc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5020111ce0 con 0x7f50201076a0 2024-09-10T21:13:56.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.592+0000 7f5026ecc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5020111b60 con 0x7f5020108020 2024-09-10T21:13:56.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.592+0000 7f5026ecc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5020111e60 con 0x7f5020101c90 2024-09-10T21:13:56.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.592+0000 7f501ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50201076a0 0x7f5020199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:56.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.592+0000 7f501ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50201076a0 0x7f5020199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52910/0 (socket says 172.21.15.59:52910) 2024-09-10T21:13:56.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.592+0000 7f501ffff640 1 -- 172.21.15.59:0/145489847 learned_addr learned my addr 172.21.15.59:0/145489847 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:56.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.592+0000 7f5024c68640 1 --2- 172.21.15.59:0/145489847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5020101c90 0x7f50201992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:56.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.592+0000 7f501ffff640 1 -- 172.21.15.59:0/145489847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5020101c90 msgr2=0x7f50201992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:56.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.592+0000 7f501ffff640 1 --2- 172.21.15.59:0/145489847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5020101c90 0x7f50201992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:56.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.592+0000 7f501ffff640 1 -- 172.21.15.59:0/145489847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5020108020 msgr2=0x7f502019eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:56.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.592+0000 7f501ffff640 1 --2- 172.21.15.59:0/145489847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5020108020 0x7f502019eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:56.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.592+0000 7f501ffff640 1 -- 172.21.15.59:0/145489847 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502019f370 con 0x7f50201076a0 2024-09-10T21:13:56.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.592+0000 7f5024c68640 1 --2- 172.21.15.59:0/145489847 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5020101c90 0x7f50201992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:13:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.593+0000 7f501ffff640 1 --2- 172.21.15.59:0/145489847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50201076a0 0x7f5020199800 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f500c006010 tx=0x7f500c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.593+0000 7f501dffb640 1 -- 172.21.15.59:0/145489847 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c03f030 con 0x7f50201076a0 2024-09-10T21:13:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.593+0000 7f501dffb640 1 -- 172.21.15.59:0/145489847 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f500c003800 con 0x7f50201076a0 2024-09-10T21:13:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.593+0000 7f5026ecc640 1 -- 172.21.15.59:0/145489847 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f502019f600 con 0x7f50201076a0 2024-09-10T21:13:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.593+0000 7f501dffb640 1 -- 172.21.15.59:0/145489847 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c035070 con 0x7f50201076a0 2024-09-10T21:13:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.593+0000 7f5026ecc640 1 -- 172.21.15.59:0/145489847 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50201a5d20 con 0x7f50201076a0 2024-09-10T21:13:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.594+0000 7f500b7fe640 1 -- 172.21.15.59:0/145489847 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f50200638e0 con 0x7f50201076a0 2024-09-10T21:13:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.596+0000 7f501dffb640 1 -- 172.21.15.59:0/145489847 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f500c031b10 con 0x7f50201076a0 2024-09-10T21:13:56.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.597+0000 7f501dffb640 1 --2- 172.21.15.59:0/145489847 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f50100b53f0 0x7f50100b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:56.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.597+0000 7f5024c68640 1 --2- 172.21.15.59:0/145489847 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f50100b53f0 0x7f50100b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:56.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.597+0000 7f501dffb640 1 -- 172.21.15.59:0/145489847 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f500c106dd0 con 0x7f50201076a0 2024-09-10T21:13:56.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.597+0000 7f501dffb640 1 --2- 172.21.15.59:0/145489847 >> [v2:172.21.15.154:6800/3376412264,v1:172.21.15.154:6801/3376412264] conn(0x7f50100beb20 0x7f50100c0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:56.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.597+0000 7f501dffb640 1 -- 172.21.15.59:0/145489847 --> [v2:172.21.15.154:6800/3376412264,v1:172.21.15.154:6801/3376412264] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f500c03dec0 con 0x7f50100beb20 2024-09-10T21:13:56.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.597+0000 7f501dffb640 1 -- 172.21.15.59:0/145489847 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f500c107180 con 0x7f50201076a0 2024-09-10T21:13:56.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.597+0000 7f5024c68640 1 --2- 172.21.15.59:0/145489847 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f50100b53f0 0x7f50100b78b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f501400abe0 tx=0x7f501400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:56.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.598+0000 7f5025469640 1 --2- 172.21.15.59:0/145489847 >> [v2:172.21.15.154:6800/3376412264,v1:172.21.15.154:6801/3376412264] conn(0x7f50100beb20 0x7f50100c0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:56.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.598+0000 7f5025469640 1 --2- 172.21.15.59:0/145489847 >> [v2:172.21.15.154:6800/3376412264,v1:172.21.15.154:6801/3376412264] conn(0x7f50100beb20 0x7f50100c0f40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:56.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.599+0000 7f501dffb640 1 -- 172.21.15.59:0/145489847 <== osd.1 v2:172.21.15.154:6800/3376412264 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f500c03dec0 con 0x7f50100beb20 2024-09-10T21:13:56.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.613+0000 7f500b7fe640 1 -- 172.21.15.59:0/145489847 --> [v2:172.21.15.154:6800/3376412264,v1:172.21.15.154:6801/3376412264] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5020063ce0 con 0x7f50100beb20 2024-09-10T21:13:56.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.613+0000 7f501dffb640 1 -- 172.21.15.59:0/145489847 <== osd.1 v2:172.21.15.154:6800/3376412264 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5020063ce0 con 0x7f50100beb20 2024-09-10T21:13:56.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.613+0000 7f500b7fe640 1 -- 172.21.15.59:0/145489847 >> [v2:172.21.15.154:6800/3376412264,v1:172.21.15.154:6801/3376412264] conn(0x7f50100beb20 msgr2=0x7f50100c0f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:56.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.613+0000 7f500b7fe640 1 --2- 172.21.15.59:0/145489847 >> [v2:172.21.15.154:6800/3376412264,v1:172.21.15.154:6801/3376412264] conn(0x7f50100beb20 0x7f50100c0f40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:56.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.614+0000 7f500b7fe640 1 -- 172.21.15.59:0/145489847 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f50100b53f0 msgr2=0x7f50100b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:56.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.614+0000 7f500b7fe640 1 --2- 172.21.15.59:0/145489847 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f50100b53f0 0x7f50100b78b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f501400abe0 tx=0x7f501400a5c0 comp rx=0 tx=0).stop 2024-09-10T21:13:56.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.614+0000 7f500b7fe640 1 -- 172.21.15.59:0/145489847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50201076a0 msgr2=0x7f5020199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:56.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.614+0000 7f500b7fe640 1 --2- 172.21.15.59:0/145489847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50201076a0 0x7f5020199800 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f500c006010 tx=0x7f500c0042f0 comp rx=0 tx=0).stop 2024-09-10T21:13:56.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.614+0000 7f5025469640 1 -- 172.21.15.59:0/145489847 reap_dead start 2024-09-10T21:13:56.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.614+0000 7f500b7fe640 1 -- 172.21.15.59:0/145489847 shutdown_connections 2024-09-10T21:13:56.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.614+0000 7f500b7fe640 1 -- 172.21.15.59:0/145489847 >> 172.21.15.59:0/145489847 conn(0x7f50200fd700 msgr2=0x7f5020100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:56.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.614+0000 7f500b7fe640 1 -- 172.21.15.59:0/145489847 shutdown_connections 2024-09-10T21:13:56.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:56.614+0000 7f500b7fe640 1 -- 172.21.15.59:0/145489847 wait complete. 2024-09-10T21:13:57.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:57 smithi192 ceph-mon[35363]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-10T21:13:57.332 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:57 smithi059 ceph-mon[30888]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-10T21:13:57.366 INFO:teuthology.orchestra.run.smithi059.stdout:55834574918 2024-09-10T21:13:57.366 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-10T21:13:57.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:57 smithi154 ceph-mon[35041]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-10T21:13:57.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.767+0000 7f0349c09640 1 -- 172.21.15.59:0/4204690890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0344104600 msgr2=0x7f034410caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:57.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.767+0000 7f0349c09640 1 --2- 172.21.15.59:0/4204690890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0344104600 0x7f034410caf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0338009900 tx=0x7f033802a3f0 comp rx=0 tx=0).stop 2024-09-10T21:13:57.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.767+0000 7f0349c09640 1 -- 172.21.15.59:0/4204690890 shutdown_connections 2024-09-10T21:13:57.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.767+0000 7f0349c09640 1 --2- 172.21.15.59:0/4204690890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f034410d140 0x7f034410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:57.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.767+0000 7f0349c09640 1 --2- 172.21.15.59:0/4204690890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0344104600 0x7f034410caf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:57.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.767+0000 7f0349c09640 1 --2- 172.21.15.59:0/4204690890 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0344103ce0 0x7f03441040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:57.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.767+0000 7f0349c09640 1 -- 172.21.15.59:0/4204690890 >> 172.21.15.59:0/4204690890 conn(0x7f03440fd700 msgr2=0x7f03440ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:57.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.767+0000 7f0349c09640 1 -- 172.21.15.59:0/4204690890 shutdown_connections 2024-09-10T21:13:57.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.767+0000 7f0349c09640 1 -- 172.21.15.59:0/4204690890 wait complete. 2024-09-10T21:13:57.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.768+0000 7f0349c09640 1 Processor -- start 2024-09-10T21:13:57.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.768+0000 7f0349c09640 1 -- start start 2024-09-10T21:13:57.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.769+0000 7f0349c09640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0344103ce0 0x7f0344199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:57.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.769+0000 7f0349c09640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0344104600 0x7f03441997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:57.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.769+0000 7f0349c09640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f034410d140 0x7f034419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:57.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.769+0000 7f0349c09640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0344112db0 con 0x7f0344104600 2024-09-10T21:13:57.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.769+0000 7f0349c09640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0344112c30 con 0x7f0344103ce0 2024-09-10T21:13:57.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.769+0000 7f0349c09640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0344112f30 con 0x7f034410d140 2024-09-10T21:13:57.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.769+0000 7f0342ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0344104600 0x7f03441997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:57.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.769+0000 7f0342ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0344104600 0x7f03441997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52924/0 (socket says 172.21.15.59:52924) 2024-09-10T21:13:57.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.769+0000 7f0342ffd640 1 -- 172.21.15.59:0/2962955689 learned_addr learned my addr 172.21.15.59:0/2962955689 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:57.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.769+0000 7f03437fe640 1 --2- 172.21.15.59:0/2962955689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0344103ce0 0x7f0344199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:57.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.769+0000 7f0343fff640 1 --2- 172.21.15.59:0/2962955689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f034410d140 0x7f034419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:57.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.769+0000 7f0342ffd640 1 -- 172.21.15.59:0/2962955689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f034410d140 msgr2=0x7f034419eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:57.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.769+0000 7f0342ffd640 1 --2- 172.21.15.59:0/2962955689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f034410d140 0x7f034419eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:57.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.769+0000 7f0342ffd640 1 -- 172.21.15.59:0/2962955689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0344103ce0 msgr2=0x7f0344199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:57.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.769+0000 7f0342ffd640 1 --2- 172.21.15.59:0/2962955689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0344103ce0 0x7f0344199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:57.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.769+0000 7f0342ffd640 1 -- 172.21.15.59:0/2962955689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034419f330 con 0x7f0344104600 2024-09-10T21:13:57.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.769+0000 7f0343fff640 1 --2- 172.21.15.59:0/2962955689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f034410d140 0x7f034419eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:13:57.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.769+0000 7f03437fe640 1 --2- 172.21.15.59:0/2962955689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0344103ce0 0x7f0344199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:13:57.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.769+0000 7f0342ffd640 1 --2- 172.21.15.59:0/2962955689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0344104600 0x7f03441997c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0338006010 tx=0x7f0338004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:57.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.770+0000 7f0340ff9640 1 -- 172.21.15.59:0/2962955689 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033803f030 con 0x7f0344104600 2024-09-10T21:13:57.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.770+0000 7f0340ff9640 1 -- 172.21.15.59:0/2962955689 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0338003aa0 con 0x7f0344104600 2024-09-10T21:13:57.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.770+0000 7f0349c09640 1 -- 172.21.15.59:0/2962955689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f034419f5c0 con 0x7f0344104600 2024-09-10T21:13:57.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.770+0000 7f0340ff9640 1 -- 172.21.15.59:0/2962955689 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0338035070 con 0x7f0344104600 2024-09-10T21:13:57.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.770+0000 7f0349c09640 1 -- 172.21.15.59:0/2962955689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03441a5ce0 con 0x7f0344104600 2024-09-10T21:13:57.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.770+0000 7f0349c09640 1 -- 172.21.15.59:0/2962955689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f03440638e0 con 0x7f0344104600 2024-09-10T21:13:57.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.772+0000 7f0340ff9640 1 -- 172.21.15.59:0/2962955689 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f03380035f0 con 0x7f0344104600 2024-09-10T21:13:57.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.773+0000 7f0340ff9640 1 --2- 172.21.15.59:0/2962955689 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f032c0b53f0 0x7f032c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:57.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.773+0000 7f03437fe640 1 --2- 172.21.15.59:0/2962955689 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f032c0b53f0 0x7f032c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:57.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.773+0000 7f0340ff9640 1 -- 172.21.15.59:0/2962955689 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f03381067b0 con 0x7f0344104600 2024-09-10T21:13:57.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.773+0000 7f0340ff9640 1 --2- 172.21.15.59:0/2962955689 >> [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951] conn(0x7f032c0beb30 0x7f032c0c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:57.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.773+0000 7f0340ff9640 1 -- 172.21.15.59:0/2962955689 --> [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f032c0c1600 con 0x7f032c0beb30 2024-09-10T21:13:57.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.773+0000 7f0340ff9640 1 -- 172.21.15.59:0/2962955689 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f0338106c90 con 0x7f0344104600 2024-09-10T21:13:57.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.773+0000 7f0343fff640 1 --2- 172.21.15.59:0/2962955689 >> [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951] conn(0x7f032c0beb30 0x7f032c0c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:57.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.774+0000 7f03437fe640 1 --2- 172.21.15.59:0/2962955689 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f032c0b53f0 0x7f032c0b78b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f033400abe0 tx=0x7f033400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:57.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.774+0000 7f0343fff640 1 --2- 172.21.15.59:0/2962955689 >> [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951] conn(0x7f032c0beb30 0x7f032c0c0f50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:57.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.774+0000 7f0340ff9640 1 -- 172.21.15.59:0/2962955689 <== osd.0 v2:172.21.15.59:6802/1237328951 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f032c0c1600 con 0x7f032c0beb30 2024-09-10T21:13:57.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.789+0000 7f0349c09640 1 -- 172.21.15.59:0/2962955689 --> [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0344063ce0 con 0x7f032c0beb30 2024-09-10T21:13:57.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.789+0000 7f0340ff9640 1 -- 172.21.15.59:0/2962955689 <== osd.0 v2:172.21.15.59:6802/1237328951 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0344063ce0 con 0x7f032c0beb30 2024-09-10T21:13:57.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.790+0000 7f0349c09640 1 -- 172.21.15.59:0/2962955689 >> [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951] conn(0x7f032c0beb30 msgr2=0x7f032c0c0f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:57.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.790+0000 7f0349c09640 1 --2- 172.21.15.59:0/2962955689 >> [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951] conn(0x7f032c0beb30 0x7f032c0c0f50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:57.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.790+0000 7f0349c09640 1 -- 172.21.15.59:0/2962955689 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f032c0b53f0 msgr2=0x7f032c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:57.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.790+0000 7f0349c09640 1 --2- 172.21.15.59:0/2962955689 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f032c0b53f0 0x7f032c0b78b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f033400abe0 tx=0x7f033400a5c0 comp rx=0 tx=0).stop 2024-09-10T21:13:57.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.790+0000 7f0349c09640 1 -- 172.21.15.59:0/2962955689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0344104600 msgr2=0x7f03441997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:57.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.790+0000 7f0349c09640 1 --2- 172.21.15.59:0/2962955689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0344104600 0x7f03441997c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0338006010 tx=0x7f0338004060 comp rx=0 tx=0).stop 2024-09-10T21:13:57.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.790+0000 7f0343fff640 1 -- 172.21.15.59:0/2962955689 reap_dead start 2024-09-10T21:13:57.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.790+0000 7f0349c09640 1 -- 172.21.15.59:0/2962955689 shutdown_connections 2024-09-10T21:13:57.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.790+0000 7f0349c09640 1 -- 172.21.15.59:0/2962955689 >> 172.21.15.59:0/2962955689 conn(0x7f03440fd700 msgr2=0x7f03440fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:57.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.791+0000 7f0349c09640 1 -- 172.21.15.59:0/2962955689 shutdown_connections 2024-09-10T21:13:57.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:57.791+0000 7f0349c09640 1 -- 172.21.15.59:0/2962955689 wait complete. 2024-09-10T21:13:57.800 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:57.801 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:57.805 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:57.805 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:57.807 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:13:58.318 INFO:teuthology.orchestra.run.smithi059.stdout:107374182459 2024-09-10T21:13:58.319 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-10T21:13:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.799+0000 7f773eeea640 1 -- 172.21.15.59:0/2437041312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77381076e0 msgr2=0x7f7738107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.799+0000 7f773eeea640 1 --2- 172.21.15.59:0/2437041312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77381076e0 0x7f7738107b20 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f772c009900 tx=0x7f772c02a410 comp rx=0 tx=0).stop 2024-09-10T21:13:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.800+0000 7f773eeea640 1 -- 172.21.15.59:0/2437041312 shutdown_connections 2024-09-10T21:13:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.800+0000 7f773eeea640 1 --2- 172.21.15.59:0/2437041312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7738108060 0x7f773810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.800+0000 7f773eeea640 1 --2- 172.21.15.59:0/2437041312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77381076e0 0x7f7738107b20 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.800+0000 7f773eeea640 1 --2- 172.21.15.59:0/2437041312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7738101cd0 0x7f77381020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:58.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.800+0000 7f773eeea640 1 -- 172.21.15.59:0/2437041312 >> 172.21.15.59:0/2437041312 conn(0x7f77380fd700 msgr2=0x7f77380ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:58.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.800+0000 7f773eeea640 1 -- 172.21.15.59:0/2437041312 shutdown_connections 2024-09-10T21:13:58.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.800+0000 7f773eeea640 1 -- 172.21.15.59:0/2437041312 wait complete. 2024-09-10T21:13:58.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.800+0000 7f773eeea640 1 Processor -- start 2024-09-10T21:13:58.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.800+0000 7f773eeea640 1 -- start start 2024-09-10T21:13:58.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.800+0000 7f773eeea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7738101cd0 0x7f773819a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:58.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.800+0000 7f773eeea640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77381076e0 0x7f773819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:58.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.800+0000 7f773eeea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7738108060 0x7f773819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:58.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.801+0000 7f773eeea640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7738111cb0 con 0x7f7738108060 2024-09-10T21:13:58.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.801+0000 7f773eeea640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7738111b30 con 0x7f7738101cd0 2024-09-10T21:13:58.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.801+0000 7f773eeea640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7738111e30 con 0x7f77381076e0 2024-09-10T21:13:58.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.801+0000 7f773d487640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7738108060 0x7f773819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:58.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.801+0000 7f7737fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77381076e0 0x7f773819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:58.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.801+0000 7f773d487640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7738108060 0x7f773819aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52954/0 (socket says 172.21.15.59:52954) 2024-09-10T21:13:58.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.801+0000 7f773d487640 1 -- 172.21.15.59:0/3102486707 learned_addr learned my addr 172.21.15.59:0/3102486707 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:13:58.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.801+0000 7f773cc86640 1 --2- 172.21.15.59:0/3102486707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7738101cd0 0x7f773819a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:58.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.801+0000 7f773d487640 1 -- 172.21.15.59:0/3102486707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77381076e0 msgr2=0x7f773819a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:58.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.801+0000 7f773d487640 1 --2- 172.21.15.59:0/3102486707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77381076e0 0x7f773819a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:58.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.801+0000 7f773d487640 1 -- 172.21.15.59:0/3102486707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7738101cd0 msgr2=0x7f773819a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:58.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.801+0000 7f773d487640 1 --2- 172.21.15.59:0/3102486707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7738101cd0 0x7f773819a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:58.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.801+0000 7f773d487640 1 -- 172.21.15.59:0/3102486707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77381a53e0 con 0x7f7738108060 2024-09-10T21:13:58.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.801+0000 7f773d487640 1 --2- 172.21.15.59:0/3102486707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7738108060 0x7f773819aaa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f773000eaa0 tx=0x7f773000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.801+0000 7f7735ffb640 1 -- 172.21.15.59:0/3102486707 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7730004d20 con 0x7f7738108060 2024-09-10T21:13:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.802+0000 7f7735ffb640 1 -- 172.21.15.59:0/3102486707 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7730005020 con 0x7f7738108060 2024-09-10T21:13:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.802+0000 7f773eeea640 1 -- 172.21.15.59:0/3102486707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7738197e50 con 0x7f7738108060 2024-09-10T21:13:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.802+0000 7f7735ffb640 1 -- 172.21.15.59:0/3102486707 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77300116b0 con 0x7f7738108060 2024-09-10T21:13:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.802+0000 7f773eeea640 1 -- 172.21.15.59:0/3102486707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7738198360 con 0x7f7738108060 2024-09-10T21:13:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.803+0000 7f773eeea640 1 -- 172.21.15.59:0/3102486707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7738105010 con 0x7f7738108060 2024-09-10T21:13:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.804+0000 7f7735ffb640 1 -- 172.21.15.59:0/3102486707 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f773000f040 con 0x7f7738108060 2024-09-10T21:13:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.805+0000 7f7735ffb640 1 --2- 172.21.15.59:0/3102486707 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f77200b53f0 0x7f77200b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.805+0000 7f773cc86640 1 --2- 172.21.15.59:0/3102486707 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f77200b53f0 0x7f77200b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.805+0000 7f7735ffb640 1 -- 172.21.15.59:0/3102486707 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f77300e5e80 con 0x7f7738108060 2024-09-10T21:13:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.805+0000 7f7735ffb640 1 --2- 172.21.15.59:0/3102486707 >> [v2:172.21.15.192:6824/1041494458,v1:172.21.15.192:6825/1041494458] conn(0x7f77200beb30 0x7f77200c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:13:58.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.805+0000 7f7735ffb640 1 -- 172.21.15.59:0/3102486707 --> [v2:172.21.15.192:6824/1041494458,v1:172.21.15.192:6825/1041494458] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7730014ec0 con 0x7f77200beb30 2024-09-10T21:13:58.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.805+0000 7f7735ffb640 1 -- 172.21.15.59:0/3102486707 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f77300e6230 con 0x7f7738108060 2024-09-10T21:13:58.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.805+0000 7f773cc86640 1 --2- 172.21.15.59:0/3102486707 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f77200b53f0 0x7f77200b78b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f772800abe0 tx=0x7f772800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:58.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.805+0000 7f7737fff640 1 --2- 172.21.15.59:0/3102486707 >> [v2:172.21.15.192:6824/1041494458,v1:172.21.15.192:6825/1041494458] conn(0x7f77200beb30 0x7f77200c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:13:58.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.806+0000 7f7737fff640 1 --2- 172.21.15.59:0/3102486707 >> [v2:172.21.15.192:6824/1041494458,v1:172.21.15.192:6825/1041494458] conn(0x7f77200beb30 0x7f77200c0f50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:13:58.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.807+0000 7f7735ffb640 1 -- 172.21.15.59:0/3102486707 <== osd.11 v2:172.21.15.192:6824/1041494458 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7730014ec0 con 0x7f77200beb30 2024-09-10T21:13:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.820+0000 7f773eeea640 1 -- 172.21.15.59:0/3102486707 --> [v2:172.21.15.192:6824/1041494458,v1:172.21.15.192:6825/1041494458] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7738102f80 con 0x7f77200beb30 2024-09-10T21:13:58.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.821+0000 7f7735ffb640 1 -- 172.21.15.59:0/3102486707 <== osd.11 v2:172.21.15.192:6824/1041494458 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7738102f80 con 0x7f77200beb30 2024-09-10T21:13:58.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.822+0000 7f773eeea640 1 -- 172.21.15.59:0/3102486707 >> [v2:172.21.15.192:6824/1041494458,v1:172.21.15.192:6825/1041494458] conn(0x7f77200beb30 msgr2=0x7f77200c0f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.822+0000 7f773eeea640 1 --2- 172.21.15.59:0/3102486707 >> [v2:172.21.15.192:6824/1041494458,v1:172.21.15.192:6825/1041494458] conn(0x7f77200beb30 0x7f77200c0f50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:13:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.822+0000 7f773eeea640 1 -- 172.21.15.59:0/3102486707 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f77200b53f0 msgr2=0x7f77200b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.822+0000 7f773eeea640 1 --2- 172.21.15.59:0/3102486707 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f77200b53f0 0x7f77200b78b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f772800abe0 tx=0x7f772800a2d0 comp rx=0 tx=0).stop 2024-09-10T21:13:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.822+0000 7f773eeea640 1 -- 172.21.15.59:0/3102486707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7738108060 msgr2=0x7f773819aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:13:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.822+0000 7f773eeea640 1 --2- 172.21.15.59:0/3102486707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7738108060 0x7f773819aaa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f773000eaa0 tx=0x7f773000eea0 comp rx=0 tx=0).stop 2024-09-10T21:13:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.822+0000 7f773d487640 1 -- 172.21.15.59:0/3102486707 reap_dead start 2024-09-10T21:13:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.822+0000 7f773eeea640 1 -- 172.21.15.59:0/3102486707 shutdown_connections 2024-09-10T21:13:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.822+0000 7f773eeea640 1 -- 172.21.15.59:0/3102486707 >> 172.21.15.59:0/3102486707 conn(0x7f77380fd700 msgr2=0x7f77380ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:13:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.822+0000 7f773eeea640 1 -- 172.21.15.59:0/3102486707 shutdown_connections 2024-09-10T21:13:58.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:13:58.822+0000 7f773eeea640 1 -- 172.21.15.59:0/3102486707 wait complete. 2024-09-10T21:13:59.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:13:59 smithi059 ceph-mon[30888]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-10T21:13:59.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:13:59 smithi192 ceph-mon[35363]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-10T21:13:59.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:13:59 smithi154 ceph-mon[35041]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-10T21:13:59.555 INFO:teuthology.orchestra.run.smithi059.stdout:287762808853 2024-09-10T21:13:59.555 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-10T21:14:00.359 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:00 smithi059 ceph-mon[30888]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T21:14:00.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.354+0000 7f4701cb9640 1 -- 172.21.15.59:0/597623996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46fc108020 msgr2=0x7f46fc10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:00.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.354+0000 7f4701cb9640 1 --2- 172.21.15.59:0/597623996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46fc108020 0x7f46fc10e820 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009ca0 tx=0x7f46f402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:14:00.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.354+0000 7f4701cb9640 1 -- 172.21.15.59:0/597623996 shutdown_connections 2024-09-10T21:14:00.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.354+0000 7f4701cb9640 1 --2- 172.21.15.59:0/597623996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46fc108020 0x7f46fc10e820 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:00.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.354+0000 7f4701cb9640 1 --2- 172.21.15.59:0/597623996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46fc1076a0 0x7f46fc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:00.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.354+0000 7f4701cb9640 1 --2- 172.21.15.59:0/597623996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46fc101c90 0x7f46fc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:00.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.354+0000 7f4701cb9640 1 -- 172.21.15.59:0/597623996 >> 172.21.15.59:0/597623996 conn(0x7f46fc0fd700 msgr2=0x7f46fc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:00.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.355+0000 7f4701cb9640 1 -- 172.21.15.59:0/597623996 shutdown_connections 2024-09-10T21:14:00.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.355+0000 7f4701cb9640 1 -- 172.21.15.59:0/597623996 wait complete. 2024-09-10T21:14:00.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.355+0000 7f4701cb9640 1 Processor -- start 2024-09-10T21:14:00.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.356+0000 7f4701cb9640 1 -- start start 2024-09-10T21:14:00.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.356+0000 7f4701cb9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46fc101c90 0x7f46fc19b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:00.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.356+0000 7f4701cb9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46fc1076a0 0x7f46fc19b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:00.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.356+0000 7f4701cb9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46fc108020 0x7f46fc1a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:00.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.356+0000 7f4701cb9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc111ce0 con 0x7f46fc101c90 2024-09-10T21:14:00.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.356+0000 7f4701cb9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc111b60 con 0x7f46fc108020 2024-09-10T21:14:00.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.356+0000 7f4701cb9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc111e60 con 0x7f46fc1076a0 2024-09-10T21:14:00.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.356+0000 7f46fb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46fc101c90 0x7f46fc19b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:00.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.356+0000 7f46fb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46fc101c90 0x7f46fc19b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51098/0 (socket says 172.21.15.59:51098) 2024-09-10T21:14:00.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.356+0000 7f46fb7fe640 1 -- 172.21.15.59:0/3079850585 learned_addr learned my addr 172.21.15.59:0/3079850585 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:00.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.356+0000 7f46faffd640 1 --2- 172.21.15.59:0/3079850585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46fc1076a0 0x7f46fc19b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:00.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.356+0000 7f46fbfff640 1 --2- 172.21.15.59:0/3079850585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46fc108020 0x7f46fc1a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:00.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.356+0000 7f46fb7fe640 1 -- 172.21.15.59:0/3079850585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46fc1076a0 msgr2=0x7f46fc19b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:00.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.356+0000 7f46fb7fe640 1 --2- 172.21.15.59:0/3079850585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46fc1076a0 0x7f46fc19b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:00.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.356+0000 7f46fb7fe640 1 -- 172.21.15.59:0/3079850585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46fc108020 msgr2=0x7f46fc1a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:00.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.356+0000 7f46fb7fe640 1 --2- 172.21.15.59:0/3079850585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46fc108020 0x7f46fc1a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:00.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.356+0000 7f46fb7fe640 1 -- 172.21.15.59:0/3079850585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46fc1a14f0 con 0x7f46fc101c90 2024-09-10T21:14:00.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.356+0000 7f46faffd640 1 --2- 172.21.15.59:0/3079850585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46fc1076a0 0x7f46fc19b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:00.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.357+0000 7f46fb7fe640 1 --2- 172.21.15.59:0/3079850585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46fc101c90 0x7f46fc19b440 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f46e400e9f0 tx=0x7f46e400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:00.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.357+0000 7f46f8ff9640 1 -- 172.21.15.59:0/3079850585 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e400cd80 con 0x7f46fc101c90 2024-09-10T21:14:00.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.357+0000 7f46f8ff9640 1 -- 172.21.15.59:0/3079850585 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46e40054d0 con 0x7f46fc101c90 2024-09-10T21:14:00.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.357+0000 7f4701cb9640 1 -- 172.21.15.59:0/3079850585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46fc1a17e0 con 0x7f46fc101c90 2024-09-10T21:14:00.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.357+0000 7f46f8ff9640 1 -- 172.21.15.59:0/3079850585 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e4010690 con 0x7f46fc101c90 2024-09-10T21:14:00.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.357+0000 7f4701cb9640 1 -- 172.21.15.59:0/3079850585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46fc1a7ea0 con 0x7f46fc101c90 2024-09-10T21:14:00.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.358+0000 7f4701cb9640 1 -- 172.21.15.59:0/3079850585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f46fc10de60 con 0x7f46fc101c90 2024-09-10T21:14:00.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.359+0000 7f46f8ff9640 1 -- 172.21.15.59:0/3079850585 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f46e4004e30 con 0x7f46fc101c90 2024-09-10T21:14:00.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.360+0000 7f46f8ff9640 1 --2- 172.21.15.59:0/3079850585 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f46e80b53f0 0x7f46e80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:00.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.360+0000 7f46faffd640 1 --2- 172.21.15.59:0/3079850585 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f46e80b53f0 0x7f46e80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:00.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.360+0000 7f46f8ff9640 1 -- 172.21.15.59:0/3079850585 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f46e40e64a0 con 0x7f46fc101c90 2024-09-10T21:14:00.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.360+0000 7f46f8ff9640 1 --2- 172.21.15.59:0/3079850585 >> [v2:172.21.15.192:6816/3138189462,v1:172.21.15.192:6817/3138189462] conn(0x7f46e80beb20 0x7f46e80c0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:00.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.360+0000 7f46f8ff9640 1 -- 172.21.15.59:0/3079850585 --> [v2:172.21.15.192:6816/3138189462,v1:172.21.15.192:6817/3138189462] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46e400ae50 con 0x7f46e80beb20 2024-09-10T21:14:00.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.360+0000 7f46f8ff9640 1 -- 172.21.15.59:0/3079850585 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f46e40e6980 con 0x7f46fc101c90 2024-09-10T21:14:00.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.361+0000 7f46faffd640 1 --2- 172.21.15.59:0/3079850585 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f46e80b53f0 0x7f46e80b78b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f46fc106f20 tx=0x7f46ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:00.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.361+0000 7f46fbfff640 1 --2- 172.21.15.59:0/3079850585 >> [v2:172.21.15.192:6816/3138189462,v1:172.21.15.192:6817/3138189462] conn(0x7f46e80beb20 0x7f46e80c0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:00.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.361+0000 7f46fbfff640 1 --2- 172.21.15.59:0/3079850585 >> [v2:172.21.15.192:6816/3138189462,v1:172.21.15.192:6817/3138189462] conn(0x7f46e80beb20 0x7f46e80c0f40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:00.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.362+0000 7f46f8ff9640 1 -- 172.21.15.59:0/3079850585 <== osd.8 v2:172.21.15.192:6816/3138189462 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f46e400ae50 con 0x7f46e80beb20 2024-09-10T21:14:00.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.389+0000 7f4701cb9640 1 -- 172.21.15.59:0/3079850585 --> [v2:172.21.15.192:6816/3138189462,v1:172.21.15.192:6817/3138189462] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f46fc102f40 con 0x7f46e80beb20 2024-09-10T21:14:00.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.390+0000 7f46f8ff9640 1 -- 172.21.15.59:0/3079850585 <== osd.8 v2:172.21.15.192:6816/3138189462 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f46fc102f40 con 0x7f46e80beb20 2024-09-10T21:14:00.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.391+0000 7f4701cb9640 1 -- 172.21.15.59:0/3079850585 >> [v2:172.21.15.192:6816/3138189462,v1:172.21.15.192:6817/3138189462] conn(0x7f46e80beb20 msgr2=0x7f46e80c0f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:00.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.391+0000 7f4701cb9640 1 --2- 172.21.15.59:0/3079850585 >> [v2:172.21.15.192:6816/3138189462,v1:172.21.15.192:6817/3138189462] conn(0x7f46e80beb20 0x7f46e80c0f40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:00.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.391+0000 7f4701cb9640 1 -- 172.21.15.59:0/3079850585 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f46e80b53f0 msgr2=0x7f46e80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:00.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.391+0000 7f4701cb9640 1 --2- 172.21.15.59:0/3079850585 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f46e80b53f0 0x7f46e80b78b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f46fc106f20 tx=0x7f46ec005f90 comp rx=0 tx=0).stop 2024-09-10T21:14:00.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.391+0000 7f4701cb9640 1 -- 172.21.15.59:0/3079850585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46fc101c90 msgr2=0x7f46fc19b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:00.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.391+0000 7f4701cb9640 1 --2- 172.21.15.59:0/3079850585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46fc101c90 0x7f46fc19b440 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f46e400e9f0 tx=0x7f46e400edf0 comp rx=0 tx=0).stop 2024-09-10T21:14:00.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.391+0000 7f46fbfff640 1 -- 172.21.15.59:0/3079850585 reap_dead start 2024-09-10T21:14:00.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.391+0000 7f4701cb9640 1 -- 172.21.15.59:0/3079850585 shutdown_connections 2024-09-10T21:14:00.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.391+0000 7f4701cb9640 1 -- 172.21.15.59:0/3079850585 >> 172.21.15.59:0/3079850585 conn(0x7f46fc0fd700 msgr2=0x7f46fc06b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:00.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.391+0000 7f4701cb9640 1 -- 172.21.15.59:0/3079850585 shutdown_connections 2024-09-10T21:14:00.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.391+0000 7f4701cb9640 1 -- 172.21.15.59:0/3079850585 wait complete. 2024-09-10T21:14:00.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:00 smithi154 ceph-mon[35041]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T21:14:00.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:00 smithi192 ceph-mon[35363]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T21:14:01.221 INFO:teuthology.orchestra.run.smithi059.stdout:219043332132 2024-09-10T21:14:01.222 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-10T21:14:01.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.259+0000 7feb8a757640 1 -- 172.21.15.59:0/2784713585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb84108020 msgr2=0x7feb8410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:01.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.259+0000 7feb8a757640 1 --2- 172.21.15.59:0/2784713585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb84108020 0x7feb8410e820 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009ca0 tx=0x7feb7c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:14:01.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.259+0000 7feb8a757640 1 -- 172.21.15.59:0/2784713585 shutdown_connections 2024-09-10T21:14:01.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.259+0000 7feb8a757640 1 --2- 172.21.15.59:0/2784713585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb84108020 0x7feb8410e820 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:01.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.259+0000 7feb8a757640 1 --2- 172.21.15.59:0/2784713585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb841076a0 0x7feb84107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:01.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.259+0000 7feb8a757640 1 --2- 172.21.15.59:0/2784713585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb84101c90 0x7feb84102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:01.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.259+0000 7feb8a757640 1 -- 172.21.15.59:0/2784713585 >> 172.21.15.59:0/2784713585 conn(0x7feb840fd700 msgr2=0x7feb840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:01.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.260+0000 7feb8a757640 1 -- 172.21.15.59:0/2784713585 shutdown_connections 2024-09-10T21:14:01.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.260+0000 7feb8a757640 1 -- 172.21.15.59:0/2784713585 wait complete. 2024-09-10T21:14:01.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.260+0000 7feb8a757640 1 Processor -- start 2024-09-10T21:14:01.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.260+0000 7feb8a757640 1 -- start start 2024-09-10T21:14:01.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.261+0000 7feb8a757640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb84101c90 0x7feb84199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:01.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.261+0000 7feb8a757640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb841076a0 0x7feb84199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:01.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.261+0000 7feb8a757640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb84108020 0x7feb8419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:01.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.261+0000 7feb8a757640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feb84111ce0 con 0x7feb841076a0 2024-09-10T21:14:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.261+0000 7feb8a757640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feb84111b60 con 0x7feb84108020 2024-09-10T21:14:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.261+0000 7feb8a757640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feb84111e60 con 0x7feb84101c90 2024-09-10T21:14:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.261+0000 7feb837fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb841076a0 0x7feb84199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.261+0000 7feb837fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb841076a0 0x7feb84199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51084/0 (socket says 172.21.15.59:51084) 2024-09-10T21:14:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.261+0000 7feb837fe640 1 -- 172.21.15.59:0/2975212180 learned_addr learned my addr 172.21.15.59:0/2975212180 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.261+0000 7feb83fff640 1 --2- 172.21.15.59:0/2975212180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb84101c90 0x7feb84199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.261+0000 7feb88cf4640 1 --2- 172.21.15.59:0/2975212180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb84108020 0x7feb8419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.261+0000 7feb837fe640 1 -- 172.21.15.59:0/2975212180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb84101c90 msgr2=0x7feb84199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.261+0000 7feb837fe640 1 --2- 172.21.15.59:0/2975212180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb84101c90 0x7feb84199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.261+0000 7feb837fe640 1 -- 172.21.15.59:0/2975212180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb84108020 msgr2=0x7feb8419eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.261+0000 7feb837fe640 1 --2- 172.21.15.59:0/2975212180 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb84108020 0x7feb8419eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.261+0000 7feb837fe640 1 -- 172.21.15.59:0/2975212180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8419f2b0 con 0x7feb841076a0 2024-09-10T21:14:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.262+0000 7feb837fe640 1 --2- 172.21.15.59:0/2975212180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb841076a0 0x7feb84199740 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7feb7800c890 tx=0x7feb7800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.262+0000 7feb817fa640 1 -- 172.21.15.59:0/2975212180 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb78004220 con 0x7feb841076a0 2024-09-10T21:14:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.262+0000 7feb8a757640 1 -- 172.21.15.59:0/2975212180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8419f5a0 con 0x7feb841076a0 2024-09-10T21:14:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.262+0000 7feb817fa640 1 -- 172.21.15.59:0/2975212180 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb780043c0 con 0x7feb841076a0 2024-09-10T21:14:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.262+0000 7feb817fa640 1 -- 172.21.15.59:0/2975212180 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb78004a00 con 0x7feb841076a0 2024-09-10T21:14:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.262+0000 7feb8a757640 1 -- 172.21.15.59:0/2975212180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb841a5c60 con 0x7feb841076a0 2024-09-10T21:14:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.263+0000 7feb8a757640 1 -- 172.21.15.59:0/2975212180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb840638e0 con 0x7feb841076a0 2024-09-10T21:14:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.264+0000 7feb817fa640 1 -- 172.21.15.59:0/2975212180 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7feb780079b0 con 0x7feb841076a0 2024-09-10T21:14:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.265+0000 7feb817fa640 1 --2- 172.21.15.59:0/2975212180 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7feb6c0b5370 0x7feb6c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.265+0000 7feb83fff640 1 --2- 172.21.15.59:0/2975212180 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7feb6c0b5370 0x7feb6c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.265+0000 7feb817fa640 1 -- 172.21.15.59:0/2975212180 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7feb780e5d70 con 0x7feb841076a0 2024-09-10T21:14:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.265+0000 7feb817fa640 1 --2- 172.21.15.59:0/2975212180 >> [v2:172.21.15.192:6808/1221386274,v1:172.21.15.192:6809/1221386274] conn(0x7feb6c0beab0 0x7feb6c0c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.265+0000 7feb817fa640 1 -- 172.21.15.59:0/2975212180 --> [v2:172.21.15.192:6808/1221386274,v1:172.21.15.192:6809/1221386274] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb6c0c1580 con 0x7feb6c0beab0 2024-09-10T21:14:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.265+0000 7feb817fa640 1 -- 172.21.15.59:0/2975212180 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7feb780e6120 con 0x7feb841076a0 2024-09-10T21:14:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.266+0000 7feb83fff640 1 --2- 172.21.15.59:0/2975212180 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7feb6c0b5370 0x7feb6c0b7830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feb740058c0 tx=0x7feb7400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.266+0000 7feb88cf4640 1 --2- 172.21.15.59:0/2975212180 >> [v2:172.21.15.192:6808/1221386274,v1:172.21.15.192:6809/1221386274] conn(0x7feb6c0beab0 0x7feb6c0c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.266+0000 7feb88cf4640 1 --2- 172.21.15.59:0/2975212180 >> [v2:172.21.15.192:6808/1221386274,v1:172.21.15.192:6809/1221386274] conn(0x7feb6c0beab0 0x7feb6c0c0ed0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.267+0000 7feb817fa640 1 -- 172.21.15.59:0/2975212180 <== osd.5 v2:172.21.15.192:6808/1221386274 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb6c0c1580 con 0x7feb6c0beab0 2024-09-10T21:14:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.282+0000 7feb8a757640 1 -- 172.21.15.59:0/2975212180 --> [v2:172.21.15.192:6808/1221386274,v1:172.21.15.192:6809/1221386274] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feb84063ce0 con 0x7feb6c0beab0 2024-09-10T21:14:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.283+0000 7feb817fa640 1 -- 172.21.15.59:0/2975212180 <== osd.5 v2:172.21.15.192:6808/1221386274 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7feb84063ce0 con 0x7feb6c0beab0 2024-09-10T21:14:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.283+0000 7feb8a757640 1 -- 172.21.15.59:0/2975212180 >> [v2:172.21.15.192:6808/1221386274,v1:172.21.15.192:6809/1221386274] conn(0x7feb6c0beab0 msgr2=0x7feb6c0c0ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.283+0000 7feb8a757640 1 --2- 172.21.15.59:0/2975212180 >> [v2:172.21.15.192:6808/1221386274,v1:172.21.15.192:6809/1221386274] conn(0x7feb6c0beab0 0x7feb6c0c0ed0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.283+0000 7feb8a757640 1 -- 172.21.15.59:0/2975212180 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7feb6c0b5370 msgr2=0x7feb6c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.283+0000 7feb8a757640 1 --2- 172.21.15.59:0/2975212180 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7feb6c0b5370 0x7feb6c0b7830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feb740058c0 tx=0x7feb7400a2d0 comp rx=0 tx=0).stop 2024-09-10T21:14:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.283+0000 7feb8a757640 1 -- 172.21.15.59:0/2975212180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb841076a0 msgr2=0x7feb84199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.283+0000 7feb8a757640 1 --2- 172.21.15.59:0/2975212180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb841076a0 0x7feb84199740 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7feb7800c890 tx=0x7feb7800cd50 comp rx=0 tx=0).stop 2024-09-10T21:14:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.283+0000 7feb88cf4640 1 -- 172.21.15.59:0/2975212180 reap_dead start 2024-09-10T21:14:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.283+0000 7feb8a757640 1 -- 172.21.15.59:0/2975212180 shutdown_connections 2024-09-10T21:14:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.283+0000 7feb8a757640 1 -- 172.21.15.59:0/2975212180 >> 172.21.15.59:0/2975212180 conn(0x7feb840fd700 msgr2=0x7feb8406acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.283+0000 7feb8a757640 1 -- 172.21.15.59:0/2975212180 shutdown_connections 2024-09-10T21:14:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:00.283+0000 7feb8a757640 1 -- 172.21.15.59:0/2975212180 wait complete. 2024-09-10T21:14:01.925 INFO:teuthology.orchestra.run.smithi059.stdout:150323855411 2024-09-10T21:14:01.926 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-10T21:14:02.386 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:02 smithi059 ceph-mon[30888]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T21:14:02.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:02 smithi192 ceph-mon[35363]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T21:14:02.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:02 smithi154 ceph-mon[35041]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T21:14:02.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.740+0000 7f6e80fe4640 1 -- 172.21.15.59:0/2030267754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e7c1045c0 msgr2=0x7f6e7c10cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:02.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.740+0000 7f6e80fe4640 1 --2- 172.21.15.59:0/2030267754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e7c1045c0 0x7f6e7c10cab0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6e64009900 tx=0x7f6e6402a410 comp rx=0 tx=0).stop 2024-09-10T21:14:02.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.741+0000 7f6e80fe4640 1 -- 172.21.15.59:0/2030267754 shutdown_connections 2024-09-10T21:14:02.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.741+0000 7f6e80fe4640 1 --2- 172.21.15.59:0/2030267754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e7c10d100 0x7f6e7c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:02.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.741+0000 7f6e80fe4640 1 --2- 172.21.15.59:0/2030267754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e7c1045c0 0x7f6e7c10cab0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:02.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.741+0000 7f6e80fe4640 1 --2- 172.21.15.59:0/2030267754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e7c103ca0 0x7f6e7c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:02.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.741+0000 7f6e80fe4640 1 -- 172.21.15.59:0/2030267754 >> 172.21.15.59:0/2030267754 conn(0x7f6e7c0fd700 msgr2=0x7f6e7c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.741+0000 7f6e80fe4640 1 -- 172.21.15.59:0/2030267754 shutdown_connections 2024-09-10T21:14:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.741+0000 7f6e80fe4640 1 -- 172.21.15.59:0/2030267754 wait complete. 2024-09-10T21:14:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.741+0000 7f6e80fe4640 1 Processor -- start 2024-09-10T21:14:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.741+0000 7f6e80fe4640 1 -- start start 2024-09-10T21:14:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e80fe4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e7c103ca0 0x7f6e7c1993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e80fe4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e7c1045c0 0x7f6e7c199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e80fe4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e7c10d100 0x7f6e7c19ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e80fe4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c112e30 con 0x7f6e7c10d100 2024-09-10T21:14:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e80fe4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c112cb0 con 0x7f6e7c1045c0 2024-09-10T21:14:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e80fe4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c112fb0 con 0x7f6e7c103ca0 2024-09-10T21:14:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e7ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e7c10d100 0x7f6e7c19ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e7ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e7c10d100 0x7f6e7c19ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51120/0 (socket says 172.21.15.59:51120) 2024-09-10T21:14:02.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e7ad9d640 1 -- 172.21.15.59:0/2344403432 learned_addr learned my addr 172.21.15.59:0/2344403432 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e79d9b640 1 --2- 172.21.15.59:0/2344403432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e7c1045c0 0x7f6e7c199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e7a59c640 1 --2- 172.21.15.59:0/2344403432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e7c103ca0 0x7f6e7c1993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e7ad9d640 1 -- 172.21.15.59:0/2344403432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e7c103ca0 msgr2=0x7f6e7c1993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e7ad9d640 1 --2- 172.21.15.59:0/2344403432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e7c103ca0 0x7f6e7c1993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e7ad9d640 1 -- 172.21.15.59:0/2344403432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e7c1045c0 msgr2=0x7f6e7c199920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e7ad9d640 1 --2- 172.21.15.59:0/2344403432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6e7c1045c0 0x7f6e7c199920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e7ad9d640 1 -- 172.21.15.59:0/2344403432 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e7c19f490 con 0x7f6e7c10d100 2024-09-10T21:14:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e7ad9d640 1 --2- 172.21.15.59:0/2344403432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e7c10d100 0x7f6e7c19ecc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009fd0 tx=0x7f6e7400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e737fe640 1 -- 172.21.15.59:0/2344403432 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e74011830 con 0x7f6e7c10d100 2024-09-10T21:14:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e737fe640 1 -- 172.21.15.59:0/2344403432 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e74016070 con 0x7f6e7c10d100 2024-09-10T21:14:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e80fe4640 1 -- 172.21.15.59:0/2344403432 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e7c19f780 con 0x7f6e7c10d100 2024-09-10T21:14:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.742+0000 7f6e737fe640 1 -- 172.21.15.59:0/2344403432 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e74010de0 con 0x7f6e7c10d100 2024-09-10T21:14:02.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.743+0000 7f6e80fe4640 1 -- 172.21.15.59:0/2344403432 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e7c1a5ec0 con 0x7f6e7c10d100 2024-09-10T21:14:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.743+0000 7f6e80fe4640 1 -- 172.21.15.59:0/2344403432 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6e7c0638e0 con 0x7f6e7c10d100 2024-09-10T21:14:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.745+0000 7f6e737fe640 1 -- 172.21.15.59:0/2344403432 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f6e740119d0 con 0x7f6e7c10d100 2024-09-10T21:14:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.746+0000 7f6e737fe640 1 --2- 172.21.15.59:0/2344403432 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6e680b53f0 0x7f6e680b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.746+0000 7f6e7a59c640 1 --2- 172.21.15.59:0/2344403432 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6e680b53f0 0x7f6e680b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.746+0000 7f6e737fe640 1 -- 172.21.15.59:0/2344403432 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f6e740e5c30 con 0x7f6e7c10d100 2024-09-10T21:14:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.746+0000 7f6e737fe640 1 --2- 172.21.15.59:0/2344403432 >> [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753] conn(0x7f6e680beb30 0x7f6e680c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.746+0000 7f6e737fe640 1 -- 172.21.15.59:0/2344403432 --> [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6e74022e50 con 0x7f6e680beb30 2024-09-10T21:14:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.746+0000 7f6e737fe640 1 -- 172.21.15.59:0/2344403432 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f6e740e5fe0 con 0x7f6e7c10d100 2024-09-10T21:14:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.746+0000 7f6e79d9b640 1 --2- 172.21.15.59:0/2344403432 >> [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753] conn(0x7f6e680beb30 0x7f6e680c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.746+0000 7f6e7a59c640 1 --2- 172.21.15.59:0/2344403432 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6e680b53f0 0x7f6e680b78b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00a400 tx=0x7f6e6c00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.747+0000 7f6e79d9b640 1 --2- 172.21.15.59:0/2344403432 >> [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753] conn(0x7f6e680beb30 0x7f6e680c0f50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:02.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.747+0000 7f6e737fe640 1 -- 172.21.15.59:0/2344403432 <== osd.9 v2:172.21.15.59:6826/2446500753 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6e74022e50 con 0x7f6e680beb30 2024-09-10T21:14:02.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.761+0000 7f6e80fe4640 1 -- 172.21.15.59:0/2344403432 --> [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6e7c063d60 con 0x7f6e680beb30 2024-09-10T21:14:02.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.761+0000 7f6e737fe640 1 -- 172.21.15.59:0/2344403432 <== osd.9 v2:172.21.15.59:6826/2446500753 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6e7c063d60 con 0x7f6e680beb30 2024-09-10T21:14:02.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.762+0000 7f6e80fe4640 1 -- 172.21.15.59:0/2344403432 >> [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753] conn(0x7f6e680beb30 msgr2=0x7f6e680c0f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:02.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.762+0000 7f6e80fe4640 1 --2- 172.21.15.59:0/2344403432 >> [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753] conn(0x7f6e680beb30 0x7f6e680c0f50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:02.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.762+0000 7f6e80fe4640 1 -- 172.21.15.59:0/2344403432 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6e680b53f0 msgr2=0x7f6e680b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:02.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.762+0000 7f6e80fe4640 1 --2- 172.21.15.59:0/2344403432 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6e680b53f0 0x7f6e680b78b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00a400 tx=0x7f6e6c00d040 comp rx=0 tx=0).stop 2024-09-10T21:14:02.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.762+0000 7f6e80fe4640 1 -- 172.21.15.59:0/2344403432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e7c10d100 msgr2=0x7f6e7c19ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:02.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.762+0000 7f6e80fe4640 1 --2- 172.21.15.59:0/2344403432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e7c10d100 0x7f6e7c19ecc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009fd0 tx=0x7f6e7400b8e0 comp rx=0 tx=0).stop 2024-09-10T21:14:02.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.762+0000 7f6e7ad9d640 1 -- 172.21.15.59:0/2344403432 reap_dead start 2024-09-10T21:14:02.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.762+0000 7f6e80fe4640 1 -- 172.21.15.59:0/2344403432 shutdown_connections 2024-09-10T21:14:02.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.762+0000 7f6e80fe4640 1 -- 172.21.15.59:0/2344403432 >> 172.21.15.59:0/2344403432 conn(0x7f6e7c0fd700 msgr2=0x7f6e7c0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:02.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.762+0000 7f6e80fe4640 1 -- 172.21.15.59:0/2344403432 shutdown_connections 2024-09-10T21:14:02.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.762+0000 7f6e80fe4640 1 -- 172.21.15.59:0/2344403432 wait complete. 2024-09-10T21:14:03.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.541+0000 7f70fdce1640 1 -- 172.21.15.59:0/3807733837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70f810d140 msgr2=0x7f70f810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:03.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.541+0000 7f70fdce1640 1 --2- 172.21.15.59:0/3807733837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70f810d140 0x7f70f810f5a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009ca0 tx=0x7f70f002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:14:03.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.541+0000 7f70fdce1640 1 -- 172.21.15.59:0/3807733837 shutdown_connections 2024-09-10T21:14:03.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.541+0000 7f70fdce1640 1 --2- 172.21.15.59:0/3807733837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70f810d140 0x7f70f810f5a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:03.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.541+0000 7f70fdce1640 1 --2- 172.21.15.59:0/3807733837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70f8104600 0x7f70f810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:03.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.541+0000 7f70fdce1640 1 --2- 172.21.15.59:0/3807733837 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70f8103ce0 0x7f70f81040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:03.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.541+0000 7f70fdce1640 1 -- 172.21.15.59:0/3807733837 >> 172.21.15.59:0/3807733837 conn(0x7f70f80fd700 msgr2=0x7f70f80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:03.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.541+0000 7f70fdce1640 1 -- 172.21.15.59:0/3807733837 shutdown_connections 2024-09-10T21:14:03.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.541+0000 7f70fdce1640 1 -- 172.21.15.59:0/3807733837 wait complete. 2024-09-10T21:14:03.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.542+0000 7f70fdce1640 1 Processor -- start 2024-09-10T21:14:03.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.542+0000 7f70fdce1640 1 -- start start 2024-09-10T21:14:03.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.542+0000 7f70fdce1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70f8103ce0 0x7f70f81991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:03.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.542+0000 7f70fdce1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70f8104600 0x7f70f8199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:03.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.542+0000 7f70fdce1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70f810d140 0x7f70f819eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:03.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.542+0000 7f70fdce1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f70f8112db0 con 0x7f70f810d140 2024-09-10T21:14:03.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.542+0000 7f70fdce1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70f8112c30 con 0x7f70f8103ce0 2024-09-10T21:14:03.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.542+0000 7f70fdce1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f70f8112f30 con 0x7f70f8104600 2024-09-10T21:14:03.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.543+0000 7f70f7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70f810d140 0x7f70f819eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:03.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.543+0000 7f70f7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70f810d140 0x7f70f819eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51154/0 (socket says 172.21.15.59:51154) 2024-09-10T21:14:03.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.543+0000 7f70f7fff640 1 -- 172.21.15.59:0/3017719830 learned_addr learned my addr 172.21.15.59:0/3017719830 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:03.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.543+0000 7f70f77fe640 1 --2- 172.21.15.59:0/3017719830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70f8103ce0 0x7f70f81991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:03.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.543+0000 7f70f6ffd640 1 --2- 172.21.15.59:0/3017719830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70f8104600 0x7f70f8199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:03.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.543+0000 7f70f7fff640 1 -- 172.21.15.59:0/3017719830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70f8104600 msgr2=0x7f70f8199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:03.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.543+0000 7f70f7fff640 1 --2- 172.21.15.59:0/3017719830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70f8104600 0x7f70f8199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:03.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.543+0000 7f70f7fff640 1 -- 172.21.15.59:0/3017719830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70f8103ce0 msgr2=0x7f70f81991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:03.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.543+0000 7f70f7fff640 1 --2- 172.21.15.59:0/3017719830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70f8103ce0 0x7f70f81991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:03.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.543+0000 7f70f7fff640 1 -- 172.21.15.59:0/3017719830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f819f270 con 0x7f70f810d140 2024-09-10T21:14:03.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.543+0000 7f70f77fe640 1 --2- 172.21.15.59:0/3017719830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70f8103ce0 0x7f70f81991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:03.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.543+0000 7f70f6ffd640 1 --2- 172.21.15.59:0/3017719830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70f8104600 0x7f70f8199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:14:03.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.543+0000 7f70f7fff640 1 --2- 172.21.15.59:0/3017719830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70f810d140 0x7f70f819eaa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f70f0005cc0 tx=0x7f70f002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:03.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.543+0000 7f70f4ff9640 1 -- 172.21.15.59:0/3017719830 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f0003bf0 con 0x7f70f810d140 2024-09-10T21:14:03.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.543+0000 7f70f4ff9640 1 -- 172.21.15.59:0/3017719830 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70f0003d90 con 0x7f70f810d140 2024-09-10T21:14:03.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.543+0000 7f70fdce1640 1 -- 172.21.15.59:0/3017719830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f819f500 con 0x7f70f810d140 2024-09-10T21:14:03.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.543+0000 7f70f4ff9640 1 -- 172.21.15.59:0/3017719830 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f002fbc0 con 0x7f70f810d140 2024-09-10T21:14:03.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.544+0000 7f70fdce1640 1 -- 172.21.15.59:0/3017719830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f81a5c20 con 0x7f70f810d140 2024-09-10T21:14:03.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.544+0000 7f70fdce1640 1 -- 172.21.15.59:0/3017719830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f70f80ff620 con 0x7f70f810d140 2024-09-10T21:14:03.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.546+0000 7f70f4ff9640 1 -- 172.21.15.59:0/3017719830 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f70f0004610 con 0x7f70f810d140 2024-09-10T21:14:03.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.547+0000 7f70f4ff9640 1 --2- 172.21.15.59:0/3017719830 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f70e00b5370 0x7f70e00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:03.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.547+0000 7f70f77fe640 1 --2- 172.21.15.59:0/3017719830 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f70e00b5370 0x7f70e00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:03.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.547+0000 7f70f4ff9640 1 -- 172.21.15.59:0/3017719830 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f70f01073c0 con 0x7f70f810d140 2024-09-10T21:14:03.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.547+0000 7f70f4ff9640 1 --2- 172.21.15.59:0/3017719830 >> [v2:172.21.15.192:6800/440750253,v1:172.21.15.192:6801/440750253] conn(0x7f70e00beab0 0x7f70e00c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:03.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.547+0000 7f70f4ff9640 1 -- 172.21.15.59:0/3017719830 --> [v2:172.21.15.192:6800/440750253,v1:172.21.15.192:6801/440750253] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70e00c1580 con 0x7f70e00beab0 2024-09-10T21:14:03.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.547+0000 7f70f4ff9640 1 -- 172.21.15.59:0/3017719830 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f70f0107820 con 0x7f70f810d140 2024-09-10T21:14:03.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.547+0000 7f70f77fe640 1 --2- 172.21.15.59:0/3017719830 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f70e00b5370 0x7f70e00b7830 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70e800abe0 tx=0x7f70e800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:03.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.547+0000 7f70f6ffd640 1 --2- 172.21.15.59:0/3017719830 >> [v2:172.21.15.192:6800/440750253,v1:172.21.15.192:6801/440750253] conn(0x7f70e00beab0 0x7f70e00c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:03.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.548+0000 7f70f6ffd640 1 --2- 172.21.15.59:0/3017719830 >> [v2:172.21.15.192:6800/440750253,v1:172.21.15.192:6801/440750253] conn(0x7f70e00beab0 0x7f70e00c0ed0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:03.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.549+0000 7f70f4ff9640 1 -- 172.21.15.59:0/3017719830 <== osd.2 v2:172.21.15.192:6800/440750253 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f70e00c1580 con 0x7f70e00beab0 2024-09-10T21:14:03.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.563+0000 7f70fdce1640 1 -- 172.21.15.59:0/3017719830 --> [v2:172.21.15.192:6800/440750253,v1:172.21.15.192:6801/440750253] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f70f806bb90 con 0x7f70e00beab0 2024-09-10T21:14:03.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.563+0000 7f70f4ff9640 1 -- 172.21.15.59:0/3017719830 <== osd.2 v2:172.21.15.192:6800/440750253 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f70f806bb90 con 0x7f70e00beab0 2024-09-10T21:14:03.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.563+0000 7f70fdce1640 1 -- 172.21.15.59:0/3017719830 >> [v2:172.21.15.192:6800/440750253,v1:172.21.15.192:6801/440750253] conn(0x7f70e00beab0 msgr2=0x7f70e00c0ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:03.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.563+0000 7f70fdce1640 1 --2- 172.21.15.59:0/3017719830 >> [v2:172.21.15.192:6800/440750253,v1:172.21.15.192:6801/440750253] conn(0x7f70e00beab0 0x7f70e00c0ed0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:03.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.563+0000 7f70fdce1640 1 -- 172.21.15.59:0/3017719830 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f70e00b5370 msgr2=0x7f70e00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:03.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.563+0000 7f70fdce1640 1 --2- 172.21.15.59:0/3017719830 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f70e00b5370 0x7f70e00b7830 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70e800abe0 tx=0x7f70e800a5c0 comp rx=0 tx=0).stop 2024-09-10T21:14:03.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.563+0000 7f70fdce1640 1 -- 172.21.15.59:0/3017719830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70f810d140 msgr2=0x7f70f819eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:03.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.563+0000 7f70fdce1640 1 --2- 172.21.15.59:0/3017719830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70f810d140 0x7f70f819eaa0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f70f0005cc0 tx=0x7f70f002f380 comp rx=0 tx=0).stop 2024-09-10T21:14:03.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.563+0000 7f70f7fff640 1 -- 172.21.15.59:0/3017719830 reap_dead start 2024-09-10T21:14:03.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.563+0000 7f70fdce1640 1 -- 172.21.15.59:0/3017719830 shutdown_connections 2024-09-10T21:14:03.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.563+0000 7f70fdce1640 1 -- 172.21.15.59:0/3017719830 >> 172.21.15.59:0/3017719830 conn(0x7f70f80fd700 msgr2=0x7f70f810f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:03.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.564+0000 7f70fdce1640 1 -- 172.21.15.59:0/3017719830 shutdown_connections 2024-09-10T21:14:03.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.564+0000 7f70fdce1640 1 -- 172.21.15.59:0/3017719830 wait complete. 2024-09-10T21:14:03.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.749+0000 7fac1a5bf640 1 -- 172.21.15.59:0/182021909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1410d140 msgr2=0x7fac1410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:03.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.749+0000 7fac1a5bf640 1 --2- 172.21.15.59:0/182021909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1410d140 0x7fac1410f5a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fac0c009ca0 tx=0x7fac0c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:14:03.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.749+0000 7fac1a5bf640 1 -- 172.21.15.59:0/182021909 shutdown_connections 2024-09-10T21:14:03.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.749+0000 7fac1a5bf640 1 --2- 172.21.15.59:0/182021909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1410d140 0x7fac1410f5a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:03.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.749+0000 7fac1a5bf640 1 --2- 172.21.15.59:0/182021909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac14104600 0x7fac1410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:03.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.749+0000 7fac1a5bf640 1 --2- 172.21.15.59:0/182021909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac14103ce0 0x7fac141040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:03.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.749+0000 7fac1a5bf640 1 -- 172.21.15.59:0/182021909 >> 172.21.15.59:0/182021909 conn(0x7fac140fd700 msgr2=0x7fac140ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:03.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.749+0000 7fac1a5bf640 1 -- 172.21.15.59:0/182021909 shutdown_connections 2024-09-10T21:14:03.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.749+0000 7fac1a5bf640 1 -- 172.21.15.59:0/182021909 wait complete. 2024-09-10T21:14:03.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.750+0000 7fac1a5bf640 1 Processor -- start 2024-09-10T21:14:03.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.750+0000 7fac1a5bf640 1 -- start start 2024-09-10T21:14:03.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.750+0000 7fac1a5bf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac14103ce0 0x7fac14199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:03.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.750+0000 7fac1a5bf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac14104600 0x7fac141997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:03.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.750+0000 7fac1a5bf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac1410d140 0x7fac1419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:03.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.750+0000 7fac1a5bf640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fac14112db0 con 0x7fac14103ce0 2024-09-10T21:14:03.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.750+0000 7fac1a5bf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fac14112c30 con 0x7fac1410d140 2024-09-10T21:14:03.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.750+0000 7fac1a5bf640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fac14112f30 con 0x7fac14104600 2024-09-10T21:14:03.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.750+0000 7fac13fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac14103ce0 0x7fac14199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:03.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.750+0000 7fac13fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac14103ce0 0x7fac14199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51178/0 (socket says 172.21.15.59:51178) 2024-09-10T21:14:03.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.750+0000 7fac13fff640 1 -- 172.21.15.59:0/898664804 learned_addr learned my addr 172.21.15.59:0/898664804 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:03.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.750+0000 7fac137fe640 1 --2- 172.21.15.59:0/898664804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac14104600 0x7fac141997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:03.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.751+0000 7fac18b5c640 1 --2- 172.21.15.59:0/898664804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac1410d140 0x7fac1419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:03.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.751+0000 7fac13fff640 1 -- 172.21.15.59:0/898664804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac14104600 msgr2=0x7fac141997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:03.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.751+0000 7fac13fff640 1 --2- 172.21.15.59:0/898664804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac14104600 0x7fac141997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:03.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.751+0000 7fac13fff640 1 -- 172.21.15.59:0/898664804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac1410d140 msgr2=0x7fac1419eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:03.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.751+0000 7fac13fff640 1 --2- 172.21.15.59:0/898664804 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac1410d140 0x7fac1419eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:03.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.751+0000 7fac13fff640 1 -- 172.21.15.59:0/898664804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1419f330 con 0x7fac14103ce0 2024-09-10T21:14:03.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.751+0000 7fac137fe640 1 --2- 172.21.15.59:0/898664804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac14104600 0x7fac141997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:03.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.751+0000 7fac13fff640 1 --2- 172.21.15.59:0/898664804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac14103ce0 0x7fac14199280 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fac0400c890 tx=0x7fac0400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:03.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.751+0000 7fac117fa640 1 -- 172.21.15.59:0/898664804 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac04004220 con 0x7fac14103ce0 2024-09-10T21:14:03.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.751+0000 7fac117fa640 1 -- 172.21.15.59:0/898664804 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac040043c0 con 0x7fac14103ce0 2024-09-10T21:14:03.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.751+0000 7fac117fa640 1 -- 172.21.15.59:0/898664804 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac04004a00 con 0x7fac14103ce0 2024-09-10T21:14:03.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.751+0000 7fac1a5bf640 1 -- 172.21.15.59:0/898664804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac1419f620 con 0x7fac14103ce0 2024-09-10T21:14:03.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.751+0000 7fac1a5bf640 1 -- 172.21.15.59:0/898664804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac141a5eb0 con 0x7fac14103ce0 2024-09-10T21:14:03.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.752+0000 7fac1a5bf640 1 -- 172.21.15.59:0/898664804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac140ffd70 con 0x7fac14103ce0 2024-09-10T21:14:03.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.753+0000 7fac117fa640 1 -- 172.21.15.59:0/898664804 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fac040079b0 con 0x7fac14103ce0 2024-09-10T21:14:03.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.754+0000 7fac117fa640 1 --2- 172.21.15.59:0/898664804 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fabfc0b53f0 0x7fabfc0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:03.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.754+0000 7fac137fe640 1 --2- 172.21.15.59:0/898664804 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fabfc0b53f0 0x7fabfc0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:03.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.754+0000 7fac117fa640 1 -- 172.21.15.59:0/898664804 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7fac040e5d20 con 0x7fac14103ce0 2024-09-10T21:14:03.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.755+0000 7fac117fa640 1 --2- 172.21.15.59:0/898664804 >> [v2:172.21.15.154:6824/1139781446,v1:172.21.15.154:6825/1139781446] conn(0x7fabfc0beb30 0x7fabfc0c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:03.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.755+0000 7fac117fa640 1 -- 172.21.15.59:0/898664804 --> [v2:172.21.15.154:6824/1139781446,v1:172.21.15.154:6825/1139781446] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fabfc0c1600 con 0x7fabfc0beb30 2024-09-10T21:14:03.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.755+0000 7fac117fa640 1 -- 172.21.15.59:0/898664804 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7fac040e6200 con 0x7fac14103ce0 2024-09-10T21:14:03.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.755+0000 7fac137fe640 1 --2- 172.21.15.59:0/898664804 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fabfc0b53f0 0x7fabfc0b78b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fac080058c0 tx=0x7fac08005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:03.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.755+0000 7fac18b5c640 1 --2- 172.21.15.59:0/898664804 >> [v2:172.21.15.154:6824/1139781446,v1:172.21.15.154:6825/1139781446] conn(0x7fabfc0beb30 0x7fabfc0c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:03.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.755+0000 7fac18b5c640 1 --2- 172.21.15.59:0/898664804 >> [v2:172.21.15.154:6824/1139781446,v1:172.21.15.154:6825/1139781446] conn(0x7fabfc0beb30 0x7fabfc0c0f50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:03.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.756+0000 7fac117fa640 1 -- 172.21.15.59:0/898664804 <== osd.10 v2:172.21.15.154:6824/1139781446 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fabfc0c1600 con 0x7fabfc0beb30 2024-09-10T21:14:03.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.770+0000 7fac1a5bf640 1 -- 172.21.15.59:0/898664804 --> [v2:172.21.15.154:6824/1139781446,v1:172.21.15.154:6825/1139781446] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fac1406bb90 con 0x7fabfc0beb30 2024-09-10T21:14:03.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.771+0000 7fac117fa640 1 -- 172.21.15.59:0/898664804 <== osd.10 v2:172.21.15.154:6824/1139781446 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fac1406bb90 con 0x7fabfc0beb30 2024-09-10T21:14:03.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.771+0000 7fac1a5bf640 1 -- 172.21.15.59:0/898664804 >> [v2:172.21.15.154:6824/1139781446,v1:172.21.15.154:6825/1139781446] conn(0x7fabfc0beb30 msgr2=0x7fabfc0c0f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:03.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.771+0000 7fac1a5bf640 1 --2- 172.21.15.59:0/898664804 >> [v2:172.21.15.154:6824/1139781446,v1:172.21.15.154:6825/1139781446] conn(0x7fabfc0beb30 0x7fabfc0c0f50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:03.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.771+0000 7fac1a5bf640 1 -- 172.21.15.59:0/898664804 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fabfc0b53f0 msgr2=0x7fabfc0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:03.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.771+0000 7fac1a5bf640 1 --2- 172.21.15.59:0/898664804 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fabfc0b53f0 0x7fabfc0b78b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fac080058c0 tx=0x7fac08005850 comp rx=0 tx=0).stop 2024-09-10T21:14:03.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.771+0000 7fac1a5bf640 1 -- 172.21.15.59:0/898664804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac14103ce0 msgr2=0x7fac14199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:03.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.771+0000 7fac1a5bf640 1 --2- 172.21.15.59:0/898664804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac14103ce0 0x7fac14199280 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fac0400c890 tx=0x7fac0400cd50 comp rx=0 tx=0).stop 2024-09-10T21:14:03.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.771+0000 7fac18b5c640 1 -- 172.21.15.59:0/898664804 reap_dead start 2024-09-10T21:14:03.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.771+0000 7fac1a5bf640 1 -- 172.21.15.59:0/898664804 shutdown_connections 2024-09-10T21:14:03.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.771+0000 7fac1a5bf640 1 -- 172.21.15.59:0/898664804 >> 172.21.15.59:0/898664804 conn(0x7fac140fd700 msgr2=0x7fac140fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:03.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.771+0000 7fac1a5bf640 1 -- 172.21.15.59:0/898664804 shutdown_connections 2024-09-10T21:14:03.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:03.772+0000 7fac1a5bf640 1 -- 172.21.15.59:0/898664804 wait complete. 2024-09-10T21:14:04.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.846+0000 7f25bfb6a640 1 -- 172.21.15.59:0/1195323863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b8103ce0 msgr2=0x7f25b81040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:04.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.846+0000 7f25bfb6a640 1 --2- 172.21.15.59:0/1195323863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b8103ce0 0x7f25b81040c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009900 tx=0x7f25b402a410 comp rx=0 tx=0).stop 2024-09-10T21:14:04.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.846+0000 7f25bfb6a640 1 -- 172.21.15.59:0/1195323863 shutdown_connections 2024-09-10T21:14:04.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.846+0000 7f25bfb6a640 1 --2- 172.21.15.59:0/1195323863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25b810d140 0x7f25b810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:04.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.846+0000 7f25bfb6a640 1 --2- 172.21.15.59:0/1195323863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b8104600 0x7f25b810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:04.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.846+0000 7f25bfb6a640 1 --2- 172.21.15.59:0/1195323863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b8103ce0 0x7f25b81040c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:04.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.846+0000 7f25bfb6a640 1 -- 172.21.15.59:0/1195323863 >> 172.21.15.59:0/1195323863 conn(0x7f25b80fd720 msgr2=0x7f25b80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:04.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.846+0000 7f25bfb6a640 1 -- 172.21.15.59:0/1195323863 shutdown_connections 2024-09-10T21:14:04.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.846+0000 7f25bfb6a640 1 -- 172.21.15.59:0/1195323863 wait complete. 2024-09-10T21:14:04.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25bfb6a640 1 Processor -- start 2024-09-10T21:14:04.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25bfb6a640 1 -- start start 2024-09-10T21:14:04.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25bfb6a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b8103ce0 0x7f25b81994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:04.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25bfb6a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b8104600 0x7f25b81999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:04.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25bfb6a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25b810d140 0x7f25b819ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:04.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25bfb6a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f25b8112e90 con 0x7f25b8103ce0 2024-09-10T21:14:04.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25bfb6a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f25b8112d10 con 0x7f25b8104600 2024-09-10T21:14:04.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25bfb6a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f25b8113010 con 0x7f25b810d140 2024-09-10T21:14:04.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25bd906640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b8103ce0 0x7f25b81994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:04.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25bd906640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b8103ce0 0x7f25b81994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51132/0 (socket says 172.21.15.59:51132) 2024-09-10T21:14:04.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25bd906640 1 -- 172.21.15.59:0/2376724981 learned_addr learned my addr 172.21.15.59:0/2376724981 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:04.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25bd105640 1 --2- 172.21.15.59:0/2376724981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b8104600 0x7f25b81999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:04.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25be107640 1 --2- 172.21.15.59:0/2376724981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25b810d140 0x7f25b819ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:04.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25bd906640 1 -- 172.21.15.59:0/2376724981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25b810d140 msgr2=0x7f25b819ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:04.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25bd906640 1 --2- 172.21.15.59:0/2376724981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25b810d140 0x7f25b819ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:04.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25bd906640 1 -- 172.21.15.59:0/2376724981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b8104600 msgr2=0x7f25b81999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:04.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25bd906640 1 --2- 172.21.15.59:0/2376724981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b8104600 0x7f25b81999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:04.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25bd906640 1 -- 172.21.15.59:0/2376724981 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b819f550 con 0x7f25b8103ce0 2024-09-10T21:14:04.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25bd105640 1 --2- 172.21.15.59:0/2376724981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25b8104600 0x7f25b81999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:04.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25be107640 1 --2- 172.21.15.59:0/2376724981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25b810d140 0x7f25b819ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:04.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.847+0000 7f25bd906640 1 --2- 172.21.15.59:0/2376724981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b8103ce0 0x7f25b81994a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f25b4006010 tx=0x7f25b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:04.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.848+0000 7f25aeffd640 1 -- 172.21.15.59:0/2376724981 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b403f030 con 0x7f25b8103ce0 2024-09-10T21:14:04.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.848+0000 7f25aeffd640 1 -- 172.21.15.59:0/2376724981 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25b4003800 con 0x7f25b8103ce0 2024-09-10T21:14:04.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.848+0000 7f25bfb6a640 1 -- 172.21.15.59:0/2376724981 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25b819f7e0 con 0x7f25b8103ce0 2024-09-10T21:14:04.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.848+0000 7f25aeffd640 1 -- 172.21.15.59:0/2376724981 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b4035070 con 0x7f25b8103ce0 2024-09-10T21:14:04.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.848+0000 7f25bfb6a640 1 -- 172.21.15.59:0/2376724981 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25b81a5f00 con 0x7f25b8103ce0 2024-09-10T21:14:04.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.849+0000 7f25bfb6a640 1 -- 172.21.15.59:0/2376724981 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f25b80638a0 con 0x7f25b8103ce0 2024-09-10T21:14:04.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.850+0000 7f25aeffd640 1 -- 172.21.15.59:0/2376724981 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f25b4031b10 con 0x7f25b8103ce0 2024-09-10T21:14:04.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.851+0000 7f25aeffd640 1 --2- 172.21.15.59:0/2376724981 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f25a40b53f0 0x7f25a40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:04.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.851+0000 7f25bd105640 1 --2- 172.21.15.59:0/2376724981 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f25a40b53f0 0x7f25a40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:04.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.851+0000 7f25aeffd640 1 -- 172.21.15.59:0/2376724981 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7979+0+0 (secure 0 0 0) 0x7f25b4106d10 con 0x7f25b8103ce0 2024-09-10T21:14:04.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.851+0000 7f25aeffd640 1 --2- 172.21.15.59:0/2376724981 >> [v2:172.21.15.154:6808/1817188525,v1:172.21.15.154:6809/1817188525] conn(0x7f25a40beb30 0x7f25a40c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:04.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.851+0000 7f25aeffd640 1 -- 172.21.15.59:0/2376724981 --> [v2:172.21.15.154:6808/1817188525,v1:172.21.15.154:6809/1817188525] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25a40c1600 con 0x7f25a40beb30 2024-09-10T21:14:04.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.851+0000 7f25aeffd640 1 -- 172.21.15.59:0/2376724981 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7f25b41070c0 con 0x7f25b8103ce0 2024-09-10T21:14:04.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.851+0000 7f25bd105640 1 --2- 172.21.15.59:0/2376724981 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f25a40b53f0 0x7f25a40b78b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f25b810f890 tx=0x7f25a8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:04.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.852+0000 7f25be107640 1 --2- 172.21.15.59:0/2376724981 >> [v2:172.21.15.154:6808/1817188525,v1:172.21.15.154:6809/1817188525] conn(0x7f25a40beb30 0x7f25a40c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:04.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.852+0000 7f25be107640 1 --2- 172.21.15.59:0/2376724981 >> [v2:172.21.15.154:6808/1817188525,v1:172.21.15.154:6809/1817188525] conn(0x7f25a40beb30 0x7f25a40c0f50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:04.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.853+0000 7f25aeffd640 1 -- 172.21.15.59:0/2376724981 <== osd.4 v2:172.21.15.154:6808/1817188525 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f25a40c1600 con 0x7f25a40beb30 2024-09-10T21:14:04.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.867+0000 7f25bfb6a640 1 -- 172.21.15.59:0/2376724981 --> [v2:172.21.15.154:6808/1817188525,v1:172.21.15.154:6809/1817188525] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f25b8063ca0 con 0x7f25a40beb30 2024-09-10T21:14:04.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.868+0000 7f25aeffd640 1 -- 172.21.15.59:0/2376724981 <== osd.4 v2:172.21.15.154:6808/1817188525 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f25b8063ca0 con 0x7f25a40beb30 2024-09-10T21:14:04.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.868+0000 7f25bfb6a640 1 -- 172.21.15.59:0/2376724981 >> [v2:172.21.15.154:6808/1817188525,v1:172.21.15.154:6809/1817188525] conn(0x7f25a40beb30 msgr2=0x7f25a40c0f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:04.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.868+0000 7f25bfb6a640 1 --2- 172.21.15.59:0/2376724981 >> [v2:172.21.15.154:6808/1817188525,v1:172.21.15.154:6809/1817188525] conn(0x7f25a40beb30 0x7f25a40c0f50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:04.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.868+0000 7f25bfb6a640 1 -- 172.21.15.59:0/2376724981 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f25a40b53f0 msgr2=0x7f25a40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:04.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.868+0000 7f25bfb6a640 1 --2- 172.21.15.59:0/2376724981 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f25a40b53f0 0x7f25a40b78b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f25b810f890 tx=0x7f25a8008040 comp rx=0 tx=0).stop 2024-09-10T21:14:04.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.868+0000 7f25bfb6a640 1 -- 172.21.15.59:0/2376724981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b8103ce0 msgr2=0x7f25b81994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:04.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.868+0000 7f25bfb6a640 1 --2- 172.21.15.59:0/2376724981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b8103ce0 0x7f25b81994a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f25b4006010 tx=0x7f25b40042f0 comp rx=0 tx=0).stop 2024-09-10T21:14:04.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.868+0000 7f25be107640 1 -- 172.21.15.59:0/2376724981 reap_dead start 2024-09-10T21:14:04.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.868+0000 7f25bfb6a640 1 -- 172.21.15.59:0/2376724981 shutdown_connections 2024-09-10T21:14:04.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.868+0000 7f25bfb6a640 1 -- 172.21.15.59:0/2376724981 >> 172.21.15.59:0/2376724981 conn(0x7f25b80fd720 msgr2=0x7f25b80fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:04.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.868+0000 7f25bfb6a640 1 -- 172.21.15.59:0/2376724981 shutdown_connections 2024-09-10T21:14:04.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:02.868+0000 7f25bfb6a640 1 -- 172.21.15.59:0/2376724981 wait complete. 2024-09-10T21:14:04.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:04 smithi059 ceph-mon[30888]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-10T21:14:04.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:04 smithi192 ceph-mon[35363]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-10T21:14:04.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:04 smithi154 ceph-mon[35041]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-10T21:14:04.830 INFO:teuthology.orchestra.run.smithi059.stdout:261993005082 2024-09-10T21:14:04.830 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-10T21:14:05.195 INFO:teuthology.orchestra.run.smithi059.stdout:34359738444 2024-09-10T21:14:05.196 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-10T21:14:05.408 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:05.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-09-10T21:14:05.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-10T21:14:05.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]} : dispatch 2024-09-10T21:14:05.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]} : dispatch 2024-09-10T21:14:05.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-10T21:14:05.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-09-10T21:14:05.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:05 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]} : dispatch 2024-09-10T21:14:05.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-09-10T21:14:05.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-10T21:14:05.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]} : dispatch 2024-09-10T21:14:05.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]} : dispatch 2024-09-10T21:14:05.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-10T21:14:05.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-09-10T21:14:05.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:05 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]} : dispatch 2024-09-10T21:14:05.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-09-10T21:14:05.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]} : dispatch 2024-09-10T21:14:05.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]} : dispatch 2024-09-10T21:14:05.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]} : dispatch 2024-09-10T21:14:05.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-10T21:14:05.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2024-09-10T21:14:05.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:05 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]} : dispatch 2024-09-10T21:14:05.975 INFO:teuthology.orchestra.run.smithi059.stdout:77309411395 2024-09-10T21:14:05.975 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-10T21:14:06.313 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:06 smithi059 ceph-mon[30888]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-10T21:14:06.313 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-10T21:14:06.313 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-10T21:14:06.313 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-10T21:14:06.313 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-10T21:14:06.313 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-10T21:14:06.314 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-10T21:14:06.314 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:06 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-10T21:14:06.314 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:06 smithi059 ceph-mon[30888]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T21:14:06.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:06 smithi192 ceph-mon[35363]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-10T21:14:06.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-10T21:14:06.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-10T21:14:06.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-10T21:14:06.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-10T21:14:06.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-10T21:14:06.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-10T21:14:06.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:06 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-10T21:14:06.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:06 smithi192 ceph-mon[35363]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T21:14:06.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:06 smithi154 ceph-mon[35041]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-10T21:14:06.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-10T21:14:06.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-10T21:14:06.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-10T21:14:06.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-10T21:14:06.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-10T21:14:06.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-10T21:14:06.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:06 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-10T21:14:06.684 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:06 smithi154 ceph-mon[35041]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T21:14:06.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.697+0000 7f05110a6640 1 -- 172.21.15.59:0/2906833033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f050c1077c0 msgr2=0x7f050c10dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:06.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.697+0000 7f05110a6640 1 --2- 172.21.15.59:0/2906833033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f050c1077c0 0x7f050c10dfc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f050400adb0 tx=0x7f050402b7a0 comp rx=0 tx=0).stop 2024-09-10T21:14:06.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.698+0000 7f05110a6640 1 -- 172.21.15.59:0/2906833033 shutdown_connections 2024-09-10T21:14:06.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.698+0000 7f05110a6640 1 --2- 172.21.15.59:0/2906833033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f050c1077c0 0x7f050c10dfc0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:06.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.698+0000 7f05110a6640 1 --2- 172.21.15.59:0/2906833033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f050c106e40 0x7f050c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:06.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.698+0000 7f05110a6640 1 --2- 172.21.15.59:0/2906833033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f050c101810 0x7f050c101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:06.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.698+0000 7f05110a6640 1 -- 172.21.15.59:0/2906833033 >> 172.21.15.59:0/2906833033 conn(0x7f050c076f50 msgr2=0x7f050c077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:06.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.698+0000 7f05110a6640 1 -- 172.21.15.59:0/2906833033 shutdown_connections 2024-09-10T21:14:06.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.698+0000 7f05110a6640 1 -- 172.21.15.59:0/2906833033 wait complete. 2024-09-10T21:14:06.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.698+0000 7f05110a6640 1 Processor -- start 2024-09-10T21:14:06.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.699+0000 7f05110a6640 1 -- start start 2024-09-10T21:14:06.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.699+0000 7f05110a6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f050c101810 0x7f050c199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:06.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.699+0000 7f05110a6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f050c106e40 0x7f050c1997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:06.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.699+0000 7f05110a6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f050c1077c0 0x7f050c19eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:06.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.699+0000 7f05110a6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f050c110c20 con 0x7f050c1077c0 2024-09-10T21:14:06.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.699+0000 7f05110a6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f050c110aa0 con 0x7f050c106e40 2024-09-10T21:14:06.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.699+0000 7f05110a6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f050c110da0 con 0x7f050c101810 2024-09-10T21:14:06.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.699+0000 7f050b59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f050c1077c0 0x7f050c19eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:06.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.699+0000 7f050b59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f050c1077c0 0x7f050c19eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51200/0 (socket says 172.21.15.59:51200) 2024-09-10T21:14:06.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.699+0000 7f050b59e640 1 -- 172.21.15.59:0/2433208114 learned_addr learned my addr 172.21.15.59:0/2433208114 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:06.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.699+0000 7f050ad9d640 1 --2- 172.21.15.59:0/2433208114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f050c101810 0x7f050c199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:06.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.699+0000 7f050a59c640 1 --2- 172.21.15.59:0/2433208114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f050c106e40 0x7f050c1997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:06.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.699+0000 7f050b59e640 1 -- 172.21.15.59:0/2433208114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f050c101810 msgr2=0x7f050c199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:06.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.699+0000 7f050b59e640 1 --2- 172.21.15.59:0/2433208114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f050c101810 0x7f050c199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:06.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.699+0000 7f050b59e640 1 -- 172.21.15.59:0/2433208114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f050c106e40 msgr2=0x7f050c1997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:06.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.699+0000 7f050b59e640 1 --2- 172.21.15.59:0/2433208114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f050c106e40 0x7f050c1997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:06.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.699+0000 7f050b59e640 1 -- 172.21.15.59:0/2433208114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050c19f320 con 0x7f050c1077c0 2024-09-10T21:14:06.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.699+0000 7f050ad9d640 1 --2- 172.21.15.59:0/2433208114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f050c101810 0x7f050c199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:14:06.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.699+0000 7f050a59c640 1 --2- 172.21.15.59:0/2433208114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f050c106e40 0x7f050c1997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:14:06.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.700+0000 7f050b59e640 1 --2- 172.21.15.59:0/2433208114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f050c1077c0 0x7f050c19eb50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0504030f50 tx=0x7f0504032400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:06.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.700+0000 7f0503fff640 1 -- 172.21.15.59:0/2433208114 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504040070 con 0x7f050c1077c0 2024-09-10T21:14:06.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.700+0000 7f05110a6640 1 -- 172.21.15.59:0/2433208114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050c19f5b0 con 0x7f050c1077c0 2024-09-10T21:14:06.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.700+0000 7f0503fff640 1 -- 172.21.15.59:0/2433208114 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05040309c0 con 0x7f050c1077c0 2024-09-10T21:14:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.700+0000 7f0503fff640 1 -- 172.21.15.59:0/2433208114 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504004810 con 0x7f050c1077c0 2024-09-10T21:14:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.700+0000 7f05110a6640 1 -- 172.21.15.59:0/2433208114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f050c1a5cd0 con 0x7f050c1077c0 2024-09-10T21:14:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.701+0000 7f05110a6640 1 -- 172.21.15.59:0/2433208114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f050c0638a0 con 0x7f050c1077c0 2024-09-10T21:14:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.702+0000 7f0503fff640 1 -- 172.21.15.59:0/2433208114 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f0504030510 con 0x7f050c1077c0 2024-09-10T21:14:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.703+0000 7f0503fff640 1 --2- 172.21.15.59:0/2433208114 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f04f80b5370 0x7f04f80b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.703+0000 7f050ad9d640 1 --2- 172.21.15.59:0/2433208114 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f04f80b5370 0x7f04f80b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.703+0000 7f0503fff640 1 -- 172.21.15.59:0/2433208114 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f05041074b0 con 0x7f050c1077c0 2024-09-10T21:14:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.703+0000 7f0503fff640 1 --2- 172.21.15.59:0/2433208114 >> [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566] conn(0x7f04f80bed90 0x7f04f80c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.703+0000 7f0503fff640 1 -- 172.21.15.59:0/2433208114 --> [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04f80c1900 con 0x7f04f80bed90 2024-09-10T21:14:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.703+0000 7f0503fff640 1 -- 172.21.15.59:0/2433208114 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f0504107900 con 0x7f050c1077c0 2024-09-10T21:14:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.704+0000 7f050ad9d640 1 --2- 172.21.15.59:0/2433208114 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f04f80b5370 0x7f04f80b7830 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00baa0 tx=0x7f04fc005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:06.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.704+0000 7f050a59c640 1 --2- 172.21.15.59:0/2433208114 >> [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566] conn(0x7f04f80bed90 0x7f04f80c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.704+0000 7f050a59c640 1 --2- 172.21.15.59:0/2433208114 >> [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566] conn(0x7f04f80bed90 0x7f04f80c1230 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.705+0000 7f0503fff640 1 -- 172.21.15.59:0/2433208114 <== osd.6 v2:172.21.15.59:6818/3006857566 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f04f80c1900 con 0x7f04f80bed90 2024-09-10T21:14:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.718+0000 7f05110a6640 1 -- 172.21.15.59:0/2433208114 --> [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f050c063ca0 con 0x7f04f80bed90 2024-09-10T21:14:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.719+0000 7f0503fff640 1 -- 172.21.15.59:0/2433208114 <== osd.6 v2:172.21.15.59:6818/3006857566 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f050c063ca0 con 0x7f04f80bed90 2024-09-10T21:14:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.719+0000 7f05110a6640 1 -- 172.21.15.59:0/2433208114 >> [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566] conn(0x7f04f80bed90 msgr2=0x7f04f80c1230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.719+0000 7f05110a6640 1 --2- 172.21.15.59:0/2433208114 >> [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566] conn(0x7f04f80bed90 0x7f04f80c1230 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.719+0000 7f05110a6640 1 -- 172.21.15.59:0/2433208114 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f04f80b5370 msgr2=0x7f04f80b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.719+0000 7f05110a6640 1 --2- 172.21.15.59:0/2433208114 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f04f80b5370 0x7f04f80b7830 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00baa0 tx=0x7f04fc005d90 comp rx=0 tx=0).stop 2024-09-10T21:14:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.719+0000 7f05110a6640 1 -- 172.21.15.59:0/2433208114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f050c1077c0 msgr2=0x7f050c19eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.719+0000 7f05110a6640 1 --2- 172.21.15.59:0/2433208114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f050c1077c0 0x7f050c19eb50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0504030f50 tx=0x7f0504032400 comp rx=0 tx=0).stop 2024-09-10T21:14:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.719+0000 7f050b59e640 1 -- 172.21.15.59:0/2433208114 reap_dead start 2024-09-10T21:14:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.719+0000 7f05110a6640 1 -- 172.21.15.59:0/2433208114 shutdown_connections 2024-09-10T21:14:06.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.719+0000 7f05110a6640 1 -- 172.21.15.59:0/2433208114 >> 172.21.15.59:0/2433208114 conn(0x7f050c076f50 msgr2=0x7f050c0ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:06.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.719+0000 7f05110a6640 1 -- 172.21.15.59:0/2433208114 shutdown_connections 2024-09-10T21:14:06.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:06.719+0000 7f05110a6640 1 -- 172.21.15.59:0/2433208114 wait complete. 2024-09-10T21:14:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.183+0000 7f3ff4cc7640 1 -- 172.21.15.59:0/3725250558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff0103b90 msgr2=0x7f3ff0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.183+0000 7f3ff4cc7640 1 --2- 172.21.15.59:0/3725250558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff0103b90 0x7f3ff0103f70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009ca0 tx=0x7f3fe002a8b0 comp rx=0 tx=0).stop 2024-09-10T21:14:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.183+0000 7f3ff4cc7640 1 -- 172.21.15.59:0/3725250558 shutdown_connections 2024-09-10T21:14:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.183+0000 7f3ff4cc7640 1 --2- 172.21.15.59:0/3725250558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff010d140 0x7f3ff010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:07.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.183+0000 7f3ff4cc7640 1 --2- 172.21.15.59:0/3725250558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ff0104590 0x7f3ff010cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.183+0000 7f3ff4cc7640 1 --2- 172.21.15.59:0/3725250558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff0103b90 0x7f3ff0103f70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.183+0000 7f3ff4cc7640 1 -- 172.21.15.59:0/3725250558 >> 172.21.15.59:0/3725250558 conn(0x7f3ff00fd700 msgr2=0x7f3ff00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.183+0000 7f3ff4cc7640 1 -- 172.21.15.59:0/3725250558 shutdown_connections 2024-09-10T21:14:07.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.183+0000 7f3ff4cc7640 1 -- 172.21.15.59:0/3725250558 wait complete. 2024-09-10T21:14:07.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.184+0000 7f3ff4cc7640 1 Processor -- start 2024-09-10T21:14:07.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.184+0000 7f3ff4cc7640 1 -- start start 2024-09-10T21:14:07.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3ff4cc7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ff0103b90 0x7f3ff01992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:07.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3ff4cc7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff0104590 0x7f3ff01997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:07.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3ff4cc7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff010d140 0x7f3ff019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:07.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3ff4cc7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff0112db0 con 0x7f3ff010d140 2024-09-10T21:14:07.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3ff4cc7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff0112c30 con 0x7f3ff0103b90 2024-09-10T21:14:07.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3ff4cc7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff0112f30 con 0x7f3ff0104590 2024-09-10T21:14:07.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3feed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff010d140 0x7f3ff019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:07.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3feed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff010d140 0x7f3ff019eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51220/0 (socket says 172.21.15.59:51220) 2024-09-10T21:14:07.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3feed9d640 1 -- 172.21.15.59:0/145069926 learned_addr learned my addr 172.21.15.59:0/145069926 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:07.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3fedd9b640 1 --2- 172.21.15.59:0/145069926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff0104590 0x7f3ff01997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:07.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3fee59c640 1 --2- 172.21.15.59:0/145069926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ff0103b90 0x7f3ff01992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:07.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3feed9d640 1 -- 172.21.15.59:0/145069926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff0104590 msgr2=0x7f3ff01997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:07.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3feed9d640 1 --2- 172.21.15.59:0/145069926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff0104590 0x7f3ff01997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:07.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3feed9d640 1 -- 172.21.15.59:0/145069926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ff0103b90 msgr2=0x7f3ff01992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:07.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3feed9d640 1 --2- 172.21.15.59:0/145069926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ff0103b90 0x7f3ff01992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:07.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3feed9d640 1 -- 172.21.15.59:0/145069926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff019f350 con 0x7f3ff010d140 2024-09-10T21:14:07.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3fedd9b640 1 --2- 172.21.15.59:0/145069926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff0104590 0x7f3ff01997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:07.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3feed9d640 1 --2- 172.21.15.59:0/145069926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff010d140 0x7f3ff019eb80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800d950 tx=0x7f3fe800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:07.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3fdf7fe640 1 -- 172.21.15.59:0/145069926 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8017070 con 0x7f3ff010d140 2024-09-10T21:14:07.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3fdf7fe640 1 -- 172.21.15.59:0/145069926 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fe8009c30 con 0x7f3ff010d140 2024-09-10T21:14:07.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3fdf7fe640 1 -- 172.21.15.59:0/145069926 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8003c10 con 0x7f3ff010d140 2024-09-10T21:14:07.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.185+0000 7f3ff4cc7640 1 -- 172.21.15.59:0/145069926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff019f640 con 0x7f3ff010d140 2024-09-10T21:14:07.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.186+0000 7f3ff4cc7640 1 -- 172.21.15.59:0/145069926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff01a5d00 con 0x7f3ff010d140 2024-09-10T21:14:07.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.187+0000 7f3ff4cc7640 1 -- 172.21.15.59:0/145069926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3ff00638e0 con 0x7f3ff010d140 2024-09-10T21:14:07.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.188+0000 7f3fdf7fe640 1 -- 172.21.15.59:0/145069926 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3fe8003db0 con 0x7f3ff010d140 2024-09-10T21:14:07.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.189+0000 7f3fdf7fe640 1 --2- 172.21.15.59:0/145069926 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3fd80b53f0 0x7f3fd80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:07.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.189+0000 7f3fee59c640 1 --2- 172.21.15.59:0/145069926 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3fd80b53f0 0x7f3fd80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:07.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.189+0000 7f3fdf7fe640 1 -- 172.21.15.59:0/145069926 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3fe80e5ac0 con 0x7f3ff010d140 2024-09-10T21:14:07.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.189+0000 7f3fdf7fe640 1 --2- 172.21.15.59:0/145069926 >> [v2:172.21.15.154:6816/175260385,v1:172.21.15.154:6817/175260385] conn(0x7f3fd80bee10 0x7f3fd80c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:07.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.189+0000 7f3fdf7fe640 1 -- 172.21.15.59:0/145069926 --> [v2:172.21.15.154:6816/175260385,v1:172.21.15.154:6817/175260385] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3fd80c1980 con 0x7f3fd80bee10 2024-09-10T21:14:07.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.189+0000 7f3fdf7fe640 1 -- 172.21.15.59:0/145069926 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f3fe80e5f10 con 0x7f3ff010d140 2024-09-10T21:14:07.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.189+0000 7f3fee59c640 1 --2- 172.21.15.59:0/145069926 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3fd80b53f0 0x7f3fd80b78b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0005fe0 tx=0x7f3fe0009960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:07.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.189+0000 7f3fedd9b640 1 --2- 172.21.15.59:0/145069926 >> [v2:172.21.15.154:6816/175260385,v1:172.21.15.154:6817/175260385] conn(0x7f3fd80bee10 0x7f3fd80c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:07.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.190+0000 7f3fedd9b640 1 --2- 172.21.15.59:0/145069926 >> [v2:172.21.15.154:6816/175260385,v1:172.21.15.154:6817/175260385] conn(0x7f3fd80bee10 0x7f3fd80c12b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:07.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.191+0000 7f3fdf7fe640 1 -- 172.21.15.59:0/145069926 <== osd.7 v2:172.21.15.154:6816/175260385 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3fd80c1980 con 0x7f3fd80bee10 2024-09-10T21:14:07.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.204+0000 7f3ff4cc7640 1 -- 172.21.15.59:0/145069926 --> [v2:172.21.15.154:6816/175260385,v1:172.21.15.154:6817/175260385] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3ff0063d60 con 0x7f3fd80bee10 2024-09-10T21:14:07.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.205+0000 7f3fdf7fe640 1 -- 172.21.15.59:0/145069926 <== osd.7 v2:172.21.15.154:6816/175260385 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3ff0063d60 con 0x7f3fd80bee10 2024-09-10T21:14:07.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.205+0000 7f3ff4cc7640 1 -- 172.21.15.59:0/145069926 >> [v2:172.21.15.154:6816/175260385,v1:172.21.15.154:6817/175260385] conn(0x7f3fd80bee10 msgr2=0x7f3fd80c12b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:07.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.205+0000 7f3ff4cc7640 1 --2- 172.21.15.59:0/145069926 >> [v2:172.21.15.154:6816/175260385,v1:172.21.15.154:6817/175260385] conn(0x7f3fd80bee10 0x7f3fd80c12b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:07.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.205+0000 7f3ff4cc7640 1 -- 172.21.15.59:0/145069926 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3fd80b53f0 msgr2=0x7f3fd80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:07.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.205+0000 7f3ff4cc7640 1 --2- 172.21.15.59:0/145069926 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3fd80b53f0 0x7f3fd80b78b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0005fe0 tx=0x7f3fe0009960 comp rx=0 tx=0).stop 2024-09-10T21:14:07.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.205+0000 7f3ff4cc7640 1 -- 172.21.15.59:0/145069926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff010d140 msgr2=0x7f3ff019eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:07.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.205+0000 7f3ff4cc7640 1 --2- 172.21.15.59:0/145069926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff010d140 0x7f3ff019eb80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800d950 tx=0x7f3fe800de10 comp rx=0 tx=0).stop 2024-09-10T21:14:07.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.205+0000 7f3feed9d640 1 -- 172.21.15.59:0/145069926 reap_dead start 2024-09-10T21:14:07.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.206+0000 7f3ff4cc7640 1 -- 172.21.15.59:0/145069926 shutdown_connections 2024-09-10T21:14:07.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.206+0000 7f3ff4cc7640 1 -- 172.21.15.59:0/145069926 >> 172.21.15.59:0/145069926 conn(0x7f3ff00fd700 msgr2=0x7f3ff00fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:07.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.206+0000 7f3ff4cc7640 1 -- 172.21.15.59:0/145069926 shutdown_connections 2024-09-10T21:14:07.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:07.206+0000 7f3ff4cc7640 1 -- 172.21.15.59:0/145069926 wait complete. 2024-09-10T21:14:07.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:07 smithi059 ceph-mon[30888]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T21:14:07.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:07 smithi192 ceph-mon[35363]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T21:14:07.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:07 smithi154 ceph-mon[35041]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T21:14:07.887 INFO:teuthology.orchestra.run.smithi059.stdout:193273528362 2024-09-10T21:14:07.888 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-10T21:14:08.321 INFO:teuthology.orchestra.run.smithi059.stdout:244813135903 2024-09-10T21:14:08.321 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-10T21:14:08.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:08 smithi192 ceph-mon[35363]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T21:14:08.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:08 smithi059 ceph-mon[30888]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T21:14:08.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:08 smithi154 ceph-mon[35041]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T21:14:08.816 INFO:teuthology.orchestra.run.smithi059.stdout:176093659183 2024-09-10T21:14:08.816 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-10T21:14:08.832 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:08.836 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:08.836 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:09.254 INFO:teuthology.orchestra.run.smithi059.stdout:128849018936 2024-09-10T21:14:09.254 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-10T21:14:09.329 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:09.329 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:09.329 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:09.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.949+0000 7fa82d21b640 1 -- 172.21.15.59:0/2230579853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa828103cc0 msgr2=0x7fa8281040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:09.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.949+0000 7fa82d21b640 1 --2- 172.21.15.59:0/2230579853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa828103cc0 0x7fa8281040a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa818009ca0 tx=0x7fa81802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:14:09.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.949+0000 7fa82d21b640 1 -- 172.21.15.59:0/2230579853 shutdown_connections 2024-09-10T21:14:09.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.949+0000 7fa82d21b640 1 --2- 172.21.15.59:0/2230579853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa82810d120 0x7fa82810f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:09.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.949+0000 7fa82d21b640 1 --2- 172.21.15.59:0/2230579853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa8281045e0 0x7fa82810cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:09.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.949+0000 7fa82d21b640 1 --2- 172.21.15.59:0/2230579853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa828103cc0 0x7fa8281040a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:09.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.949+0000 7fa82d21b640 1 -- 172.21.15.59:0/2230579853 >> 172.21.15.59:0/2230579853 conn(0x7fa8280fd700 msgr2=0x7fa8280ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:09.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.950+0000 7fa82d21b640 1 -- 172.21.15.59:0/2230579853 shutdown_connections 2024-09-10T21:14:09.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.950+0000 7fa82d21b640 1 -- 172.21.15.59:0/2230579853 wait complete. 2024-09-10T21:14:09.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.950+0000 7fa82d21b640 1 Processor -- start 2024-09-10T21:14:09.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.950+0000 7fa82d21b640 1 -- start start 2024-09-10T21:14:09.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.951+0000 7fa82d21b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa828103cc0 0x7fa828199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:09.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.951+0000 7fa82d21b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8281045e0 0x7fa828199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:09.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.951+0000 7fa82d21b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa82810d120 0x7fa82819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:09.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.951+0000 7fa82d21b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa828112e70 con 0x7fa8281045e0 2024-09-10T21:14:09.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.951+0000 7fa82d21b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa828112cf0 con 0x7fa828103cc0 2024-09-10T21:14:09.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.951+0000 7fa82d21b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa828112ff0 con 0x7fa82810d120 2024-09-10T21:14:09.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.951+0000 7fa82659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8281045e0 0x7fa828199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:09.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.951+0000 7fa826d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa828103cc0 0x7fa828199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:09.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.951+0000 7fa82659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8281045e0 0x7fa828199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40446/0 (socket says 172.21.15.59:40446) 2024-09-10T21:14:09.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.951+0000 7fa82659c640 1 -- 172.21.15.59:0/2568726127 learned_addr learned my addr 172.21.15.59:0/2568726127 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:09.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.951+0000 7fa82759e640 1 --2- 172.21.15.59:0/2568726127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa82810d120 0x7fa82819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:09.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.951+0000 7fa82659c640 1 -- 172.21.15.59:0/2568726127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa82810d120 msgr2=0x7fa82819ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:09.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.951+0000 7fa82659c640 1 --2- 172.21.15.59:0/2568726127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa82810d120 0x7fa82819ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:09.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.951+0000 7fa82659c640 1 -- 172.21.15.59:0/2568726127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa828103cc0 msgr2=0x7fa828199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:09.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.951+0000 7fa82659c640 1 --2- 172.21.15.59:0/2568726127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa828103cc0 0x7fa828199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:09.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.951+0000 7fa82659c640 1 -- 172.21.15.59:0/2568726127 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82819f4f0 con 0x7fa8281045e0 2024-09-10T21:14:09.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.951+0000 7fa82759e640 1 --2- 172.21.15.59:0/2568726127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa82810d120 0x7fa82819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:09.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.951+0000 7fa82659c640 1 --2- 172.21.15.59:0/2568726127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8281045e0 0x7fa828199980 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00b3c0 tx=0x7fa81c00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:09.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.952+0000 7fa80ffff640 1 -- 172.21.15.59:0/2568726127 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c011830 con 0x7fa8281045e0 2024-09-10T21:14:09.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.952+0000 7fa80ffff640 1 -- 172.21.15.59:0/2568726127 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa81c016070 con 0x7fa8281045e0 2024-09-10T21:14:09.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.952+0000 7fa82d21b640 1 -- 172.21.15.59:0/2568726127 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa82819f7e0 con 0x7fa8281045e0 2024-09-10T21:14:09.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.952+0000 7fa80ffff640 1 -- 172.21.15.59:0/2568726127 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c010de0 con 0x7fa8281045e0 2024-09-10T21:14:09.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.952+0000 7fa82d21b640 1 -- 172.21.15.59:0/2568726127 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8281a5ea0 con 0x7fa8281045e0 2024-09-10T21:14:09.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.953+0000 7fa82d21b640 1 -- 172.21.15.59:0/2568726127 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa828104120 con 0x7fa8281045e0 2024-09-10T21:14:09.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.955+0000 7fa80ffff640 1 -- 172.21.15.59:0/2568726127 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fa81c0119d0 con 0x7fa8281045e0 2024-09-10T21:14:09.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.956+0000 7fa80ffff640 1 --2- 172.21.15.59:0/2568726127 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa8100b53f0 0x7fa8100b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:09.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.956+0000 7fa826d9d640 1 --2- 172.21.15.59:0/2568726127 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa8100b53f0 0x7fa8100b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:09.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.956+0000 7fa80ffff640 1 -- 172.21.15.59:0/2568726127 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa81c0e58b0 con 0x7fa8281045e0 2024-09-10T21:14:09.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.957+0000 7fa826d9d640 1 --2- 172.21.15.59:0/2568726127 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa8100b53f0 0x7fa8100b78b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa8180098d0 tx=0x7fa818009900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:09.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:09.959+0000 7fa80ffff640 1 -- 172.21.15.59:0/2568726127 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa81c0ac640 con 0x7fa8281045e0 2024-09-10T21:14:10.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.134+0000 7f8d403b8640 1 -- 172.21.15.59:0/3952779226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d38104660 msgr2=0x7f8d3810cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:10.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.134+0000 7f8d403b8640 1 --2- 172.21.15.59:0/3952779226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d38104660 0x7f8d3810cb50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8d28009900 tx=0x7f8d2802a410 comp rx=0 tx=0).stop 2024-09-10T21:14:10.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.135+0000 7f8d403b8640 1 -- 172.21.15.59:0/3952779226 shutdown_connections 2024-09-10T21:14:10.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.135+0000 7f8d403b8640 1 --2- 172.21.15.59:0/3952779226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d3810d1a0 0x7f8d3810f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:10.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.135+0000 7f8d403b8640 1 --2- 172.21.15.59:0/3952779226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d38104660 0x7f8d3810cb50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:10.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.135+0000 7f8d403b8640 1 --2- 172.21.15.59:0/3952779226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d38103d40 0x7f8d38104120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:10.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.135+0000 7f8d403b8640 1 -- 172.21.15.59:0/3952779226 >> 172.21.15.59:0/3952779226 conn(0x7f8d380fd7e0 msgr2=0x7f8d380ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:10.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.135+0000 7f8d403b8640 1 -- 172.21.15.59:0/3952779226 shutdown_connections 2024-09-10T21:14:10.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.135+0000 7f8d403b8640 1 -- 172.21.15.59:0/3952779226 wait complete. 2024-09-10T21:14:10.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.136+0000 7f8d403b8640 1 Processor -- start 2024-09-10T21:14:10.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.136+0000 7f8d403b8640 1 -- start start 2024-09-10T21:14:10.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.136+0000 7f8d403b8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d38103d40 0x7f8d381019f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:10.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.136+0000 7f8d403b8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d38104660 0x7f8d38101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:10.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.136+0000 7f8d403b8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d3810d1a0 0x7f8d38102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:10.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.136+0000 7f8d403b8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8d38112e60 con 0x7f8d3810d1a0 2024-09-10T21:14:10.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.136+0000 7f8d403b8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8d38112ce0 con 0x7f8d38103d40 2024-09-10T21:14:10.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.136+0000 7f8d403b8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8d38112fe0 con 0x7f8d38104660 2024-09-10T21:14:10.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.136+0000 7f8d3e955640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d3810d1a0 0x7f8d38102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:10.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.136+0000 7f8d3e955640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d3810d1a0 0x7f8d38102470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40458/0 (socket says 172.21.15.59:40458) 2024-09-10T21:14:10.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.136+0000 7f8d3e955640 1 -- 172.21.15.59:0/3447017869 learned_addr learned my addr 172.21.15.59:0/3447017869 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:10.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.136+0000 7f8d3d953640 1 --2- 172.21.15.59:0/3447017869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d38104660 0x7f8d38101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:10.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.136+0000 7f8d3e154640 1 --2- 172.21.15.59:0/3447017869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d38103d40 0x7f8d381019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:10.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.137+0000 7f8d3e955640 1 -- 172.21.15.59:0/3447017869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d38104660 msgr2=0x7f8d38101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:10.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.137+0000 7f8d3e955640 1 --2- 172.21.15.59:0/3447017869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d38104660 0x7f8d38101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:10.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.137+0000 7f8d3e955640 1 -- 172.21.15.59:0/3447017869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d38103d40 msgr2=0x7f8d381019f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:10.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.137+0000 7f8d3e955640 1 --2- 172.21.15.59:0/3447017869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d38103d40 0x7f8d381019f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:10.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.137+0000 7f8d3e955640 1 -- 172.21.15.59:0/3447017869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d381a7790 con 0x7f8d3810d1a0 2024-09-10T21:14:10.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.137+0000 7f8d3e955640 1 --2- 172.21.15.59:0/3447017869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d3810d1a0 0x7f8d38102470 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000eaa0 tx=0x7f8d3000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:10.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.137+0000 7f8d2f7fe640 1 -- 172.21.15.59:0/3447017869 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3000cdb0 con 0x7f8d3810d1a0 2024-09-10T21:14:10.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.137+0000 7f8d2f7fe640 1 -- 172.21.15.59:0/3447017869 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d30005020 con 0x7f8d3810d1a0 2024-09-10T21:14:10.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.138+0000 7f8d2f7fe640 1 -- 172.21.15.59:0/3447017869 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d300116d0 con 0x7f8d3810d1a0 2024-09-10T21:14:10.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.138+0000 7f8d403b8640 1 -- 172.21.15.59:0/3447017869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d381a7a80 con 0x7f8d3810d1a0 2024-09-10T21:14:10.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.138+0000 7f8d403b8640 1 -- 172.21.15.59:0/3447017869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d381a7f40 con 0x7f8d3810d1a0 2024-09-10T21:14:10.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.139+0000 7f8d403b8640 1 -- 172.21.15.59:0/3447017869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d3806b9d0 con 0x7f8d3810d1a0 2024-09-10T21:14:10.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.142+0000 7f8d2f7fe640 1 -- 172.21.15.59:0/3447017869 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f8d3000f040 con 0x7f8d3810d1a0 2024-09-10T21:14:10.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.143+0000 7f8d2f7fe640 1 --2- 172.21.15.59:0/3447017869 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8d240b52c0 0x7f8d240b7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:10.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.143+0000 7f8d3e154640 1 --2- 172.21.15.59:0/3447017869 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8d240b52c0 0x7f8d240b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:10.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.143+0000 7f8d2f7fe640 1 -- 172.21.15.59:0/3447017869 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8d300e6360 con 0x7f8d3810d1a0 2024-09-10T21:14:10.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.144+0000 7f8d3e154640 1 --2- 172.21.15.59:0/3447017869 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8d240b52c0 0x7f8d240b7780 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8d34005fd0 tx=0x7f8d34005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:10.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.146+0000 7f8d2f7fe640 1 -- 172.21.15.59:0/3447017869 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8d3001f020 con 0x7f8d3810d1a0 2024-09-10T21:14:10.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.157+0000 7fa82d21b640 1 -- 172.21.15.59:0/2568726127 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa82819a570 con 0x7fa8281045e0 2024-09-10T21:14:10.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.158+0000 7fa80ffff640 1 -- 172.21.15.59:0/2568726127 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa82819a570 con 0x7fa8281045e0 2024-09-10T21:14:10.162 INFO:teuthology.orchestra.run.smithi059.stdout:107374182462 2024-09-10T21:14:10.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.160+0000 7fa82d21b640 1 -- 172.21.15.59:0/2568726127 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa8100b53f0 msgr2=0x7fa8100b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:10.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.160+0000 7fa82d21b640 1 --2- 172.21.15.59:0/2568726127 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa8100b53f0 0x7fa8100b78b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa8180098d0 tx=0x7fa818009900 comp rx=0 tx=0).stop 2024-09-10T21:14:10.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.160+0000 7fa82d21b640 1 -- 172.21.15.59:0/2568726127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8281045e0 msgr2=0x7fa828199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:10.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.160+0000 7fa82d21b640 1 --2- 172.21.15.59:0/2568726127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8281045e0 0x7fa828199980 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00b3c0 tx=0x7fa81c00b880 comp rx=0 tx=0).stop 2024-09-10T21:14:10.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.160+0000 7fa82d21b640 1 -- 172.21.15.59:0/2568726127 shutdown_connections 2024-09-10T21:14:10.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.160+0000 7fa82d21b640 1 --2- 172.21.15.59:0/2568726127 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa8100b53f0 0x7fa8100b78b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.160+0000 7fa82d21b640 1 --2- 172.21.15.59:0/2568726127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa82810d120 0x7fa82819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.160+0000 7fa82d21b640 1 --2- 172.21.15.59:0/2568726127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8281045e0 0x7fa828199980 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.160+0000 7fa82d21b640 1 --2- 172.21.15.59:0/2568726127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa828103cc0 0x7fa828199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.160+0000 7fa82d21b640 1 -- 172.21.15.59:0/2568726127 >> 172.21.15.59:0/2568726127 conn(0x7fa8280fd700 msgr2=0x7fa8280fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.160+0000 7fa82d21b640 1 -- 172.21.15.59:0/2568726127 shutdown_connections 2024-09-10T21:14:10.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.160+0000 7fa82d21b640 1 -- 172.21.15.59:0/2568726127 wait complete. 2024-09-10T21:14:10.175 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:10.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.342+0000 7f8d403b8640 1 -- 172.21.15.59:0/3447017869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8d38108210 con 0x7f8d3810d1a0 2024-09-10T21:14:10.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.342+0000 7f8d2f7fe640 1 -- 172.21.15.59:0/3447017869 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8d30016030 con 0x7f8d3810d1a0 2024-09-10T21:14:10.347 INFO:teuthology.orchestra.run.smithi059.stdout:34359738446 2024-09-10T21:14:10.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.345+0000 7f8d403b8640 1 -- 172.21.15.59:0/3447017869 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8d240b52c0 msgr2=0x7f8d240b7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:10.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.345+0000 7f8d403b8640 1 --2- 172.21.15.59:0/3447017869 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8d240b52c0 0x7f8d240b7780 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8d34005fd0 tx=0x7f8d34005850 comp rx=0 tx=0).stop 2024-09-10T21:14:10.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.345+0000 7f8d403b8640 1 -- 172.21.15.59:0/3447017869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d3810d1a0 msgr2=0x7f8d38102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:10.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.345+0000 7f8d403b8640 1 --2- 172.21.15.59:0/3447017869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d3810d1a0 0x7f8d38102470 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000eaa0 tx=0x7f8d3000ef60 comp rx=0 tx=0).stop 2024-09-10T21:14:10.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.345+0000 7f8d403b8640 1 -- 172.21.15.59:0/3447017869 shutdown_connections 2024-09-10T21:14:10.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.345+0000 7f8d403b8640 1 --2- 172.21.15.59:0/3447017869 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8d240b52c0 0x7f8d240b7780 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:10.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.345+0000 7f8d403b8640 1 --2- 172.21.15.59:0/3447017869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d3810d1a0 0x7f8d38102470 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:10.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.345+0000 7f8d403b8640 1 --2- 172.21.15.59:0/3447017869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d38104660 0x7f8d38101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:10.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.345+0000 7f8d403b8640 1 --2- 172.21.15.59:0/3447017869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d38103d40 0x7f8d381019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:10.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.345+0000 7f8d403b8640 1 -- 172.21.15.59:0/3447017869 >> 172.21.15.59:0/3447017869 conn(0x7f8d380fd7e0 msgr2=0x7f8d380fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:10.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.345+0000 7f8d403b8640 1 -- 172.21.15.59:0/3447017869 shutdown_connections 2024-09-10T21:14:10.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:10.345+0000 7f8d403b8640 1 -- 172.21.15.59:0/3447017869 wait complete. 2024-09-10T21:14:10.392 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:10 smithi059 ceph-mon[30888]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:14:10.392 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:10 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2568726127' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T21:14:10.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:10 smithi192 ceph-mon[35363]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:14:10.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:10 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2568726127' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T21:14:10.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:10 smithi154 ceph-mon[35041]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:14:10.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:10 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2568726127' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T21:14:11.414 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738444 got 34359738446 for osd.0 2024-09-10T21:14:11.414 DEBUG:teuthology.parallel:result is None 2024-09-10T21:14:11.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:11 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3447017869' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T21:14:11.626 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:11 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3447017869' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T21:14:11.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:11 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3447017869' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T21:14:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.244+0000 7f60e2bc9640 1 -- 172.21.15.59:0/3655956335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60dc109150 msgr2=0x7f60dc10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.244+0000 7f60e2bc9640 1 --2- 172.21.15.59:0/3655956335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60dc109150 0x7f60dc10f950 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009ca0 tx=0x7f60d402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.244+0000 7f60e2bc9640 1 -- 172.21.15.59:0/3655956335 shutdown_connections 2024-09-10T21:14:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.244+0000 7f60e2bc9640 1 --2- 172.21.15.59:0/3655956335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60dc109150 0x7f60dc10f950 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.244+0000 7f60e2bc9640 1 --2- 172.21.15.59:0/3655956335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60dc1087d0 0x7f60dc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.244+0000 7f60e2bc9640 1 --2- 172.21.15.59:0/3655956335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60dc102dc0 0x7f60dc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.244+0000 7f60e2bc9640 1 -- 172.21.15.59:0/3655956335 >> 172.21.15.59:0/3655956335 conn(0x7f60dc0fe830 msgr2=0x7f60dc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.244+0000 7f60e2bc9640 1 -- 172.21.15.59:0/3655956335 shutdown_connections 2024-09-10T21:14:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.244+0000 7f60e2bc9640 1 -- 172.21.15.59:0/3655956335 wait complete. 2024-09-10T21:14:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.245+0000 7f60e2bc9640 1 Processor -- start 2024-09-10T21:14:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.245+0000 7f60e2bc9640 1 -- start start 2024-09-10T21:14:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.245+0000 7f60e2bc9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60dc102dc0 0x7f60dc1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.245+0000 7f60e2bc9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60dc1087d0 0x7f60dc199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.245+0000 7f60e2bc9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60dc109150 0x7f60dc19eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.245+0000 7f60e2bc9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f60dc112e10 con 0x7f60dc109150 2024-09-10T21:14:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.245+0000 7f60e2bc9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60dc112c90 con 0x7f60dc1087d0 2024-09-10T21:14:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.245+0000 7f60e2bc9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f60dc112f90 con 0x7f60dc102dc0 2024-09-10T21:14:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.246+0000 7f60e1166640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60dc109150 0x7f60dc19eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.246+0000 7f60e1166640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60dc109150 0x7f60dc19eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40472/0 (socket says 172.21.15.59:40472) 2024-09-10T21:14:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.246+0000 7f60e1166640 1 -- 172.21.15.59:0/934866579 learned_addr learned my addr 172.21.15.59:0/934866579 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.246+0000 7f60dbfff640 1 --2- 172.21.15.59:0/934866579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60dc1087d0 0x7f60dc199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.246+0000 7f60e0965640 1 --2- 172.21.15.59:0/934866579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60dc102dc0 0x7f60dc1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.246+0000 7f60e1166640 1 -- 172.21.15.59:0/934866579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60dc102dc0 msgr2=0x7f60dc1992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.246+0000 7f60e1166640 1 --2- 172.21.15.59:0/934866579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60dc102dc0 0x7f60dc1992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.246+0000 7f60e1166640 1 -- 172.21.15.59:0/934866579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60dc1087d0 msgr2=0x7f60dc199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.246+0000 7f60e1166640 1 --2- 172.21.15.59:0/934866579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60dc1087d0 0x7f60dc199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.246+0000 7f60e1166640 1 -- 172.21.15.59:0/934866579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60dc19f370 con 0x7f60dc109150 2024-09-10T21:14:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.246+0000 7f60e1166640 1 --2- 172.21.15.59:0/934866579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60dc109150 0x7f60dc19eba0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f60d4005cc0 tx=0x7f60d402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.246+0000 7f60d9ffb640 1 -- 172.21.15.59:0/934866579 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d4003bf0 con 0x7f60dc109150 2024-09-10T21:14:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.246+0000 7f60d9ffb640 1 -- 172.21.15.59:0/934866579 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60d4003d90 con 0x7f60dc109150 2024-09-10T21:14:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.246+0000 7f60e2bc9640 1 -- 172.21.15.59:0/934866579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60dc19f600 con 0x7f60dc109150 2024-09-10T21:14:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.246+0000 7f60d9ffb640 1 -- 172.21.15.59:0/934866579 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d402fb20 con 0x7f60dc109150 2024-09-10T21:14:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.247+0000 7f60e2bc9640 1 -- 172.21.15.59:0/934866579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60dc1a5da0 con 0x7f60dc109150 2024-09-10T21:14:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.248+0000 7f60e2bc9640 1 -- 172.21.15.59:0/934866579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60dc1031a0 con 0x7f60dc109150 2024-09-10T21:14:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.250+0000 7f60d9ffb640 1 -- 172.21.15.59:0/934866579 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f60d4004580 con 0x7f60dc109150 2024-09-10T21:14:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.251+0000 7f60d9ffb640 1 --2- 172.21.15.59:0/934866579 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f60cc0b53f0 0x7f60cc0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.251+0000 7f60e0965640 1 --2- 172.21.15.59:0/934866579 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f60cc0b53f0 0x7f60cc0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.251+0000 7f60d9ffb640 1 -- 172.21.15.59:0/934866579 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f60d4107180 con 0x7f60dc109150 2024-09-10T21:14:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.251+0000 7f60e0965640 1 --2- 172.21.15.59:0/934866579 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f60cc0b53f0 0x7f60cc0b78b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f60d000bbe0 tx=0x7f60d000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:12.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.254+0000 7f60d9ffb640 1 -- 172.21.15.59:0/934866579 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f60d40cdeb0 con 0x7f60dc109150 2024-09-10T21:14:12.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.427+0000 7fbce66fa640 1 -- 172.21.15.59:0/1284418378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbce0108020 msgr2=0x7fbce010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:12.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.427+0000 7fbce66fa640 1 --2- 172.21.15.59:0/1284418378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbce0108020 0x7fbce010e820 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8009ca0 tx=0x7fbcd802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.427+0000 7fbce66fa640 1 -- 172.21.15.59:0/1284418378 shutdown_connections 2024-09-10T21:14:12.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.427+0000 7fbce66fa640 1 --2- 172.21.15.59:0/1284418378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbce0108020 0x7fbce010e820 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.427+0000 7fbce66fa640 1 --2- 172.21.15.59:0/1284418378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbce01076a0 0x7fbce0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.427+0000 7fbce66fa640 1 --2- 172.21.15.59:0/1284418378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce0101c90 0x7fbce0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.427+0000 7fbce66fa640 1 -- 172.21.15.59:0/1284418378 >> 172.21.15.59:0/1284418378 conn(0x7fbce00fd700 msgr2=0x7fbce00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:12.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.427+0000 7fbce66fa640 1 -- 172.21.15.59:0/1284418378 shutdown_connections 2024-09-10T21:14:12.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.427+0000 7fbce66fa640 1 -- 172.21.15.59:0/1284418378 wait complete. 2024-09-10T21:14:12.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.428+0000 7fbce66fa640 1 Processor -- start 2024-09-10T21:14:12.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.428+0000 7fbce66fa640 1 -- start start 2024-09-10T21:14:12.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.428+0000 7fbce66fa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbce0101c90 0x7fbce019b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.428+0000 7fbce66fa640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce01076a0 0x7fbce019b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.428+0000 7fbce66fa640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbce0108020 0x7fbce01a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.428+0000 7fbce66fa640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbce0111ce0 con 0x7fbce0108020 2024-09-10T21:14:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.428+0000 7fbce66fa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbce0111b60 con 0x7fbce0101c90 2024-09-10T21:14:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.428+0000 7fbce66fa640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbce0111e60 con 0x7fbce01076a0 2024-09-10T21:14:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.428+0000 7fbce4c97640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbce0108020 0x7fbce01a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.429+0000 7fbce4c97640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbce0108020 0x7fbce01a0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40496/0 (socket says 172.21.15.59:40496) 2024-09-10T21:14:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.429+0000 7fbce4c97640 1 -- 172.21.15.59:0/3354694685 learned_addr learned my addr 172.21.15.59:0/3354694685 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.429+0000 7fbcdffff640 1 --2- 172.21.15.59:0/3354694685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbce0101c90 0x7fbce019b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.429+0000 7fbcdf7fe640 1 --2- 172.21.15.59:0/3354694685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce01076a0 0x7fbce019b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.429+0000 7fbcdffff640 1 -- 172.21.15.59:0/3354694685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce01076a0 msgr2=0x7fbce019b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.429+0000 7fbcdffff640 1 --2- 172.21.15.59:0/3354694685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce01076a0 0x7fbce019b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.429+0000 7fbcdffff640 1 -- 172.21.15.59:0/3354694685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbce0108020 msgr2=0x7fbce01a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.429+0000 7fbcdffff640 1 --2- 172.21.15.59:0/3354694685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbce0108020 0x7fbce01a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.429+0000 7fbcdffff640 1 -- 172.21.15.59:0/3354694685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce01a14f0 con 0x7fbce0101c90 2024-09-10T21:14:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.429+0000 7fbce4c97640 1 --2- 172.21.15.59:0/3354694685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbce0108020 0x7fbce01a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:14:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.429+0000 7fbcdffff640 1 --2- 172.21.15.59:0/3354694685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbce0101c90 0x7fbce019b440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbcd000d720 tx=0x7fbcd000dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.429+0000 7fbcdd7fa640 1 -- 172.21.15.59:0/3354694685 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0017070 con 0x7fbce0101c90 2024-09-10T21:14:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.429+0000 7fbce66fa640 1 -- 172.21.15.59:0/3354694685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce01a17e0 con 0x7fbce0101c90 2024-09-10T21:14:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.429+0000 7fbcdd7fa640 1 -- 172.21.15.59:0/3354694685 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcd000de30 con 0x7fbce0101c90 2024-09-10T21:14:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.429+0000 7fbcdd7fa640 1 -- 172.21.15.59:0/3354694685 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd00047a0 con 0x7fbce0101c90 2024-09-10T21:14:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.430+0000 7fbce66fa640 1 -- 172.21.15.59:0/3354694685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce01a7ea0 con 0x7fbce0101c90 2024-09-10T21:14:12.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.430+0000 7fbce66fa640 1 -- 172.21.15.59:0/3354694685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce0102070 con 0x7fbce0101c90 2024-09-10T21:14:12.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.432+0000 7fbcdd7fa640 1 -- 172.21.15.59:0/3354694685 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fbcd00099d0 con 0x7fbce0101c90 2024-09-10T21:14:12.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.433+0000 7fbcdd7fa640 1 --2- 172.21.15.59:0/3354694685 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbcc80b5370 0x7fbcc80b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:12.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.433+0000 7fbcdf7fe640 1 --2- 172.21.15.59:0/3354694685 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbcc80b5370 0x7fbcc80b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:12.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.433+0000 7fbcdd7fa640 1 -- 172.21.15.59:0/3354694685 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbcd00e5d20 con 0x7fbce0101c90 2024-09-10T21:14:12.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.434+0000 7fbcdf7fe640 1 --2- 172.21.15.59:0/3354694685 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbcc80b5370 0x7fbcc80b7830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbce0106f20 tx=0x7fbcd400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.436+0000 7fbcdd7fa640 1 -- 172.21.15.59:0/3354694685 <== mon.2 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbcd0020020 con 0x7fbce0101c90 2024-09-10T21:14:12.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.445+0000 7f60e2bc9640 1 -- 172.21.15.59:0/934866579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f60dc02e5c0 con 0x7f60dc109150 2024-09-10T21:14:12.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.446+0000 7f60d9ffb640 1 -- 172.21.15.59:0/934866579 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f60d40cd7b0 con 0x7f60dc109150 2024-09-10T21:14:12.450 INFO:teuthology.orchestra.run.smithi059.stdout:176093659184 2024-09-10T21:14:12.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.448+0000 7f60e2bc9640 1 -- 172.21.15.59:0/934866579 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f60cc0b53f0 msgr2=0x7f60cc0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:12.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.448+0000 7f60e2bc9640 1 --2- 172.21.15.59:0/934866579 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f60cc0b53f0 0x7f60cc0b78b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f60d000bbe0 tx=0x7f60d000b390 comp rx=0 tx=0).stop 2024-09-10T21:14:12.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.448+0000 7f60e2bc9640 1 -- 172.21.15.59:0/934866579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60dc109150 msgr2=0x7f60dc19eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:12.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.448+0000 7f60e2bc9640 1 --2- 172.21.15.59:0/934866579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60dc109150 0x7f60dc19eba0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f60d4005cc0 tx=0x7f60d402f380 comp rx=0 tx=0).stop 2024-09-10T21:14:12.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.448+0000 7f60e2bc9640 1 -- 172.21.15.59:0/934866579 shutdown_connections 2024-09-10T21:14:12.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.448+0000 7f60e2bc9640 1 --2- 172.21.15.59:0/934866579 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f60cc0b53f0 0x7f60cc0b78b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.448+0000 7f60e2bc9640 1 --2- 172.21.15.59:0/934866579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60dc109150 0x7f60dc19eba0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.448+0000 7f60e2bc9640 1 --2- 172.21.15.59:0/934866579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60dc1087d0 0x7f60dc199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.448+0000 7f60e2bc9640 1 --2- 172.21.15.59:0/934866579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60dc102dc0 0x7f60dc1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.448+0000 7f60e2bc9640 1 -- 172.21.15.59:0/934866579 >> 172.21.15.59:0/934866579 conn(0x7f60dc0fe830 msgr2=0x7f60dc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:12.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.448+0000 7f60e2bc9640 1 -- 172.21.15.59:0/934866579 shutdown_connections 2024-09-10T21:14:12.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.448+0000 7f60e2bc9640 1 -- 172.21.15.59:0/934866579 wait complete. 2024-09-10T21:14:12.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:12 smithi192 ceph-mon[35363]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:14:12.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.628+0000 7fbce66fa640 1 -- 172.21.15.59:0/3354694685 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fbce019c570 con 0x7fbce0101c90 2024-09-10T21:14:12.632 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:12 smithi059 ceph-mon[30888]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:14:12.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.628+0000 7fbcdd7fa640 1 -- 172.21.15.59:0/3354694685 <== mon.2 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbcd00b5030 con 0x7fbce0101c90 2024-09-10T21:14:12.633 INFO:teuthology.orchestra.run.smithi059.stdout:244813135905 2024-09-10T21:14:12.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.630+0000 7fbce66fa640 1 -- 172.21.15.59:0/3354694685 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbcc80b5370 msgr2=0x7fbcc80b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:12.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.630+0000 7fbce66fa640 1 --2- 172.21.15.59:0/3354694685 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbcc80b5370 0x7fbcc80b7830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbce0106f20 tx=0x7fbcd400b410 comp rx=0 tx=0).stop 2024-09-10T21:14:12.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.630+0000 7fbce66fa640 1 -- 172.21.15.59:0/3354694685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbce0101c90 msgr2=0x7fbce019b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.630+0000 7fbce66fa640 1 --2- 172.21.15.59:0/3354694685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbce0101c90 0x7fbce019b440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbcd000d720 tx=0x7fbcd000dbe0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.630+0000 7fbce66fa640 1 -- 172.21.15.59:0/3354694685 shutdown_connections 2024-09-10T21:14:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.630+0000 7fbce66fa640 1 --2- 172.21.15.59:0/3354694685 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbcc80b5370 0x7fbcc80b7830 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.630+0000 7fbce66fa640 1 --2- 172.21.15.59:0/3354694685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbce0108020 0x7fbce01a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.630+0000 7fbce66fa640 1 --2- 172.21.15.59:0/3354694685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce01076a0 0x7fbce019b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.630+0000 7fbce66fa640 1 --2- 172.21.15.59:0/3354694685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbce0101c90 0x7fbce019b440 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.630+0000 7fbce66fa640 1 -- 172.21.15.59:0/3354694685 >> 172.21.15.59:0/3354694685 conn(0x7fbce00fd700 msgr2=0x7fbce006b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.630+0000 7fbce66fa640 1 -- 172.21.15.59:0/3354694685 shutdown_connections 2024-09-10T21:14:12.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:12.630+0000 7fbce66fa640 1 -- 172.21.15.59:0/3354694685 wait complete. 2024-09-10T21:14:12.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:12 smithi154 ceph-mon[35041]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:14:12.872 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182459 got 107374182462 for osd.3 2024-09-10T21:14:12.873 DEBUG:teuthology.parallel:result is None 2024-09-10T21:14:13.591 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:13 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/934866579' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T21:14:13.591 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:13 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3354694685' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T21:14:13.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:13 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/934866579' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T21:14:13.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:13 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3354694685' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T21:14:13.814 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:13.814 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:13.814 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:13.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:13 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/934866579' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T21:14:13.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:13 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3354694685' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T21:14:14.263 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659183 got 176093659184 for osd.6 2024-09-10T21:14:14.263 DEBUG:teuthology.parallel:result is None 2024-09-10T21:14:14.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.423+0000 7f9bcc18e640 1 -- 172.21.15.59:0/3749686383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc4101c90 msgr2=0x7f9bc4102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:14.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.423+0000 7f9bcc18e640 1 --2- 172.21.15.59:0/3749686383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc4101c90 0x7f9bc4102070 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009ca0 tx=0x7f9bc002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:14:14.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.423+0000 7f9bcc18e640 1 -- 172.21.15.59:0/3749686383 shutdown_connections 2024-09-10T21:14:14.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.423+0000 7f9bcc18e640 1 --2- 172.21.15.59:0/3749686383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bc4108020 0x7f9bc410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:14.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.423+0000 7f9bcc18e640 1 --2- 172.21.15.59:0/3749686383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc41076a0 0x7f9bc4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:14.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.423+0000 7f9bcc18e640 1 --2- 172.21.15.59:0/3749686383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc4101c90 0x7f9bc4102070 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.423+0000 7f9bcc18e640 1 -- 172.21.15.59:0/3749686383 >> 172.21.15.59:0/3749686383 conn(0x7f9bc40fd700 msgr2=0x7f9bc40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.423+0000 7f9bcc18e640 1 -- 172.21.15.59:0/3749686383 shutdown_connections 2024-09-10T21:14:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.423+0000 7f9bcc18e640 1 -- 172.21.15.59:0/3749686383 wait complete. 2024-09-10T21:14:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.423+0000 7f9bcc18e640 1 Processor -- start 2024-09-10T21:14:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.424+0000 7f9bcc18e640 1 -- start start 2024-09-10T21:14:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.424+0000 7f9bcc18e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bc4101c90 0x7f9bc410f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.424+0000 7f9bcc18e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc41076a0 0x7f9bc410f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.424+0000 7f9bcc18e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc4108020 0x7f9bc410fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.424+0000 7f9bcc18e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc4112e00 con 0x7f9bc4108020 2024-09-10T21:14:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.424+0000 7f9bcc18e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc4112c80 con 0x7f9bc41076a0 2024-09-10T21:14:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.424+0000 7f9bcc18e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc4112f80 con 0x7f9bc4101c90 2024-09-10T21:14:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.424+0000 7f9bca72b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc4108020 0x7f9bc410fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:14.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.424+0000 7f9bca72b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc4108020 0x7f9bc410fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40520/0 (socket says 172.21.15.59:40520) 2024-09-10T21:14:14.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.424+0000 7f9bca72b640 1 -- 172.21.15.59:0/1051794332 learned_addr learned my addr 172.21.15.59:0/1051794332 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:14.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.424+0000 7f9bc9729640 1 --2- 172.21.15.59:0/1051794332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc41076a0 0x7f9bc410f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:14.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.424+0000 7f9bc9f2a640 1 --2- 172.21.15.59:0/1051794332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bc4101c90 0x7f9bc410f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:14.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.424+0000 7f9bca72b640 1 -- 172.21.15.59:0/1051794332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bc4101c90 msgr2=0x7f9bc410f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:14.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.424+0000 7f9bca72b640 1 --2- 172.21.15.59:0/1051794332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bc4101c90 0x7f9bc410f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:14.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.424+0000 7f9bca72b640 1 -- 172.21.15.59:0/1051794332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc41076a0 msgr2=0x7f9bc410f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:14.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.424+0000 7f9bca72b640 1 --2- 172.21.15.59:0/1051794332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc41076a0 0x7f9bc410f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:14.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.424+0000 7f9bca72b640 1 -- 172.21.15.59:0/1051794332 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc41a76d0 con 0x7f9bc4108020 2024-09-10T21:14:14.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.425+0000 7f9bca72b640 1 --2- 172.21.15.59:0/1051794332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc4108020 0x7f9bc410fdb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00d950 tx=0x7f9bbc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:14.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.425+0000 7f9bb6ffd640 1 -- 172.21.15.59:0/1051794332 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc017030 con 0x7f9bc4108020 2024-09-10T21:14:14.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.425+0000 7f9bb6ffd640 1 -- 172.21.15.59:0/1051794332 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bbc004020 con 0x7f9bc4108020 2024-09-10T21:14:14.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.425+0000 7f9bcc18e640 1 -- 172.21.15.59:0/1051794332 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc41a79c0 con 0x7f9bc4108020 2024-09-10T21:14:14.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.425+0000 7f9bb6ffd640 1 -- 172.21.15.59:0/1051794332 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc003b50 con 0x7f9bc4108020 2024-09-10T21:14:14.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.425+0000 7f9bcc18e640 1 -- 172.21.15.59:0/1051794332 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc41a7eb0 con 0x7f9bc4108020 2024-09-10T21:14:14.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.426+0000 7f9bcc18e640 1 -- 172.21.15.59:0/1051794332 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bc4102070 con 0x7f9bc4108020 2024-09-10T21:14:14.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.427+0000 7f9bb6ffd640 1 -- 172.21.15.59:0/1051794332 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f9bbc003cf0 con 0x7f9bc4108020 2024-09-10T21:14:14.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.428+0000 7f9bb6ffd640 1 --2- 172.21.15.59:0/1051794332 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9bb00b5370 0x7f9bb00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:14.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.428+0000 7f9bc9f2a640 1 --2- 172.21.15.59:0/1051794332 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9bb00b5370 0x7f9bb00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:14.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.428+0000 7f9bb6ffd640 1 -- 172.21.15.59:0/1051794332 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9bbc0e5b30 con 0x7f9bc4108020 2024-09-10T21:14:14.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.429+0000 7f9bc9f2a640 1 --2- 172.21.15.59:0/1051794332 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9bb00b5370 0x7f9bb00b7830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0000f80 tx=0x7f9bc0005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:14.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.431+0000 7f9bb6ffd640 1 -- 172.21.15.59:0/1051794332 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9bbc021070 con 0x7f9bc4108020 2024-09-10T21:14:14.574 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:14 smithi059 ceph-mon[30888]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:14:14.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.624+0000 7f9bcc18e640 1 -- 172.21.15.59:0/1051794332 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f9bc402e5c0 con 0x7f9bc4108020 2024-09-10T21:14:14.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.624+0000 7f9bb6ffd640 1 -- 172.21.15.59:0/1051794332 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9bbc0ac8c0 con 0x7f9bc4108020 2024-09-10T21:14:14.628 INFO:teuthology.orchestra.run.smithi059.stdout:128849018938 2024-09-10T21:14:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.626+0000 7f9bcc18e640 1 -- 172.21.15.59:0/1051794332 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9bb00b5370 msgr2=0x7f9bb00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.626+0000 7f9bcc18e640 1 --2- 172.21.15.59:0/1051794332 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9bb00b5370 0x7f9bb00b7830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0000f80 tx=0x7f9bc0005ef0 comp rx=0 tx=0).stop 2024-09-10T21:14:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.626+0000 7f9bcc18e640 1 -- 172.21.15.59:0/1051794332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc4108020 msgr2=0x7f9bc410fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.626+0000 7f9bcc18e640 1 --2- 172.21.15.59:0/1051794332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc4108020 0x7f9bc410fdb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00d950 tx=0x7f9bbc00de10 comp rx=0 tx=0).stop 2024-09-10T21:14:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.626+0000 7f9bcc18e640 1 -- 172.21.15.59:0/1051794332 shutdown_connections 2024-09-10T21:14:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.626+0000 7f9bcc18e640 1 --2- 172.21.15.59:0/1051794332 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9bb00b5370 0x7f9bb00b7830 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.626+0000 7f9bcc18e640 1 --2- 172.21.15.59:0/1051794332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bc4108020 0x7f9bc410fdb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.626+0000 7f9bcc18e640 1 --2- 172.21.15.59:0/1051794332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9bc41076a0 0x7f9bc410f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.626+0000 7f9bcc18e640 1 --2- 172.21.15.59:0/1051794332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bc4101c90 0x7f9bc410f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.626+0000 7f9bcc18e640 1 -- 172.21.15.59:0/1051794332 >> 172.21.15.59:0/1051794332 conn(0x7f9bc40fd700 msgr2=0x7f9bc40fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.626+0000 7f9bcc18e640 1 -- 172.21.15.59:0/1051794332 shutdown_connections 2024-09-10T21:14:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.626+0000 7f9bcc18e640 1 -- 172.21.15.59:0/1051794332 wait complete. 2024-09-10T21:14:14.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:14 smithi154 ceph-mon[35041]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:14:14.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:14 smithi192 ceph-mon[35363]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:14:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.024+0000 7fdee852c640 1 -- 172.21.15.59:0/1051392077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdee0101250 msgr2=0x7fdee0101630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.024+0000 7fdee852c640 1 --2- 172.21.15.59:0/1051392077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdee0101250 0x7fdee0101630 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009900 tx=0x7fdedc02a410 comp rx=0 tx=0).stop 2024-09-10T21:14:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.024+0000 7fdee852c640 1 -- 172.21.15.59:0/1051392077 shutdown_connections 2024-09-10T21:14:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.024+0000 7fdee852c640 1 --2- 172.21.15.59:0/1051392077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee0105f40 0x7fdee010f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.024+0000 7fdee852c640 1 --2- 172.21.15.59:0/1051392077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdee01055a0 0x7fdee0105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.024+0000 7fdee852c640 1 --2- 172.21.15.59:0/1051392077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdee0101250 0x7fdee0101630 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.024+0000 7fdee852c640 1 -- 172.21.15.59:0/1051392077 >> 172.21.15.59:0/1051392077 conn(0x7fdee0078140 msgr2=0x7fdee00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.025+0000 7fdee852c640 1 -- 172.21.15.59:0/1051392077 shutdown_connections 2024-09-10T21:14:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.025+0000 7fdee852c640 1 -- 172.21.15.59:0/1051392077 wait complete. 2024-09-10T21:14:15.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.025+0000 7fdee852c640 1 Processor -- start 2024-09-10T21:14:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.025+0000 7fdee852c640 1 -- start start 2024-09-10T21:14:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.026+0000 7fdee852c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee0101250 0x7fdee010ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.026+0000 7fdee852c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdee01055a0 0x7fdee010f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.026+0000 7fdee852c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdee0105f40 0x7fdee01a2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.026+0000 7fdee852c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdee0112e20 con 0x7fdee01055a0 2024-09-10T21:14:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.026+0000 7fdee852c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdee0112ca0 con 0x7fdee0101250 2024-09-10T21:14:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.026+0000 7fdee852c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdee0112fa0 con 0x7fdee0105f40 2024-09-10T21:14:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.026+0000 7fdee5ac7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdee01055a0 0x7fdee010f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.026+0000 7fdee5ac7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdee01055a0 0x7fdee010f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40556/0 (socket says 172.21.15.59:40556) 2024-09-10T21:14:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.026+0000 7fdee5ac7640 1 -- 172.21.15.59:0/3352776573 learned_addr learned my addr 172.21.15.59:0/3352776573 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.026+0000 7fdee62c8640 1 --2- 172.21.15.59:0/3352776573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee0101250 0x7fdee010ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.026+0000 7fdee6ac9640 1 --2- 172.21.15.59:0/3352776573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdee0105f40 0x7fdee01a2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:15.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.026+0000 7fdee5ac7640 1 -- 172.21.15.59:0/3352776573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdee0105f40 msgr2=0x7fdee01a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.026+0000 7fdee5ac7640 1 --2- 172.21.15.59:0/3352776573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdee0105f40 0x7fdee01a2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.026+0000 7fdee5ac7640 1 -- 172.21.15.59:0/3352776573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee0101250 msgr2=0x7fdee010ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.026+0000 7fdee5ac7640 1 --2- 172.21.15.59:0/3352776573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee0101250 0x7fdee010ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.026+0000 7fdee5ac7640 1 -- 172.21.15.59:0/3352776573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee01a27d0 con 0x7fdee01055a0 2024-09-10T21:14:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.026+0000 7fdee6ac9640 1 --2- 172.21.15.59:0/3352776573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdee0105f40 0x7fdee01a2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:14:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.026+0000 7fdee5ac7640 1 --2- 172.21.15.59:0/3352776573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdee01055a0 0x7fdee010f260 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fded000d950 tx=0x7fded000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.027+0000 7fded77fe640 1 -- 172.21.15.59:0/3352776573 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded0017030 con 0x7fdee01055a0 2024-09-10T21:14:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.027+0000 7fdee852c640 1 -- 172.21.15.59:0/3352776573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee01a2ac0 con 0x7fdee01055a0 2024-09-10T21:14:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.027+0000 7fded77fe640 1 -- 172.21.15.59:0/3352776573 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fded0004020 con 0x7fdee01055a0 2024-09-10T21:14:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.027+0000 7fded77fe640 1 -- 172.21.15.59:0/3352776573 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded00047a0 con 0x7fdee01055a0 2024-09-10T21:14:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.027+0000 7fdee852c640 1 -- 172.21.15.59:0/3352776573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee01ac410 con 0x7fdee01055a0 2024-09-10T21:14:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.028+0000 7fdee852c640 1 -- 172.21.15.59:0/3352776573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee0101630 con 0x7fdee01055a0 2024-09-10T21:14:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.029+0000 7fded77fe640 1 -- 172.21.15.59:0/3352776573 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fded0009a30 con 0x7fdee01055a0 2024-09-10T21:14:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.030+0000 7fded77fe640 1 --2- 172.21.15.59:0/3352776573 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdecc0b5370 0x7fdecc0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.030+0000 7fdee62c8640 1 --2- 172.21.15.59:0/3352776573 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdecc0b5370 0x7fdecc0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.030+0000 7fded77fe640 1 -- 172.21.15.59:0/3352776573 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fded00e5e50 con 0x7fdee01055a0 2024-09-10T21:14:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.031+0000 7fdee62c8640 1 --2- 172.21.15.59:0/3352776573 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdecc0b5370 0x7fdecc0b7830 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdedc005ab0 tx=0x7fdedc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:15.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.033+0000 7fded77fe640 1 -- 172.21.15.59:0/3352776573 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fded00acb80 con 0x7fdee01055a0 2024-09-10T21:14:15.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.229+0000 7fdee852c640 1 -- 172.21.15.59:0/3352776573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fdee01a0b00 con 0x7fdee01055a0 2024-09-10T21:14:15.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.229+0000 7fded77fe640 1 -- 172.21.15.59:0/3352776573 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdee01a0b00 con 0x7fdee01055a0 2024-09-10T21:14:15.234 INFO:teuthology.orchestra.run.smithi059.stdout:55834574922 2024-09-10T21:14:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.231+0000 7fdee852c640 1 -- 172.21.15.59:0/3352776573 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdecc0b5370 msgr2=0x7fdecc0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.231+0000 7fdee852c640 1 --2- 172.21.15.59:0/3352776573 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdecc0b5370 0x7fdecc0b7830 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdedc005ab0 tx=0x7fdedc005a20 comp rx=0 tx=0).stop 2024-09-10T21:14:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.231+0000 7fdee852c640 1 -- 172.21.15.59:0/3352776573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdee01055a0 msgr2=0x7fdee010f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.231+0000 7fdee852c640 1 --2- 172.21.15.59:0/3352776573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdee01055a0 0x7fdee010f260 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fded000d950 tx=0x7fded000de10 comp rx=0 tx=0).stop 2024-09-10T21:14:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.232+0000 7fdee852c640 1 -- 172.21.15.59:0/3352776573 shutdown_connections 2024-09-10T21:14:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.232+0000 7fdee852c640 1 --2- 172.21.15.59:0/3352776573 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdecc0b5370 0x7fdecc0b7830 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.232+0000 7fdee852c640 1 --2- 172.21.15.59:0/3352776573 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdee0105f40 0x7fdee01a2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.232+0000 7fdee852c640 1 --2- 172.21.15.59:0/3352776573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdee01055a0 0x7fdee010f260 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.232+0000 7fdee852c640 1 --2- 172.21.15.59:0/3352776573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee0101250 0x7fdee010ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.232+0000 7fdee852c640 1 -- 172.21.15.59:0/3352776573 >> 172.21.15.59:0/3352776573 conn(0x7fdee0078140 msgr2=0x7fdee0108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:15.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.232+0000 7fdee852c640 1 -- 172.21.15.59:0/3352776573 shutdown_connections 2024-09-10T21:14:15.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.232+0000 7fdee852c640 1 -- 172.21.15.59:0/3352776573 wait complete. 2024-09-10T21:14:15.366 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135903 got 244813135905 for osd.9 2024-09-10T21:14:15.366 DEBUG:teuthology.parallel:result is None 2024-09-10T21:14:15.484 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:15 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1051794332' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T21:14:15.484 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:15 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/611187686' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T21:14:15.484 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:15 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3352776573' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T21:14:15.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:15 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1051794332' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T21:14:15.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:15 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/611187686' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T21:14:15.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:15 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3352776573' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T21:14:15.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:15 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1051794332' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T21:14:15.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:15 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/611187686' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T21:14:15.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:15 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3352776573' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T21:14:16.226 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018936 got 128849018938 for osd.4 2024-09-10T21:14:16.226 DEBUG:teuthology.parallel:result is None 2024-09-10T21:14:16.599 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:16 smithi059 ceph-mon[30888]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:14:16.600 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:16 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:14:16.600 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:16 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/919902951' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T21:14:16.662 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:16 smithi192 ceph-mon[35363]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:14:16.662 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:16 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:14:16.662 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:16 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/919902951' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T21:14:16.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.678+0000 7f436dec6640 1 -- 172.21.15.59:0/2329392076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4368102dc0 msgr2=0x7f43681031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:16.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.678+0000 7f436dec6640 1 --2- 172.21.15.59:0/2329392076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4368102dc0 0x7f43681031a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4358009900 tx=0x7f435802a410 comp rx=0 tx=0).stop 2024-09-10T21:14:16.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.678+0000 7f436dec6640 1 -- 172.21.15.59:0/2329392076 shutdown_connections 2024-09-10T21:14:16.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.678+0000 7f436dec6640 1 --2- 172.21.15.59:0/2329392076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4368109150 0x7f436810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.678+0000 7f436dec6640 1 --2- 172.21.15.59:0/2329392076 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43681087d0 0x7f4368108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.678+0000 7f436dec6640 1 --2- 172.21.15.59:0/2329392076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4368102dc0 0x7f43681031a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.678+0000 7f436dec6640 1 -- 172.21.15.59:0/2329392076 >> 172.21.15.59:0/2329392076 conn(0x7f43680fe830 msgr2=0x7f4368100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:16.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.678+0000 7f436dec6640 1 -- 172.21.15.59:0/2329392076 shutdown_connections 2024-09-10T21:14:16.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.678+0000 7f436dec6640 1 -- 172.21.15.59:0/2329392076 wait complete. 2024-09-10T21:14:16.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:16 smithi154 ceph-mon[35041]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:14:16.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:16 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:14:16.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:16 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/919902951' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T21:14:16.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.679+0000 7f436dec6640 1 Processor -- start 2024-09-10T21:14:16.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.679+0000 7f436dec6640 1 -- start start 2024-09-10T21:14:16.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.679+0000 7f436dec6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4368102dc0 0x7f4368199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:16.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.679+0000 7f436dec6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43681087d0 0x7f43681997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:16.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.679+0000 7f436dec6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4368109150 0x7f436819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:16.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.679+0000 7f436dec6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4368112e10 con 0x7f43681087d0 2024-09-10T21:14:16.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.679+0000 7f436dec6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4368112c90 con 0x7f4368109150 2024-09-10T21:14:16.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.679+0000 7f436dec6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4368112f90 con 0x7f4368102dc0 2024-09-10T21:14:16.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.679+0000 7f43677fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4368102dc0 0x7f4368199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:16.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.679+0000 7f4366ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43681087d0 0x7f43681997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:16.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.679+0000 7f43677fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4368102dc0 0x7f4368199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:58882/0 (socket says 172.21.15.59:58882) 2024-09-10T21:14:16.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.680+0000 7f43677fe640 1 -- 172.21.15.59:0/1750843572 learned_addr learned my addr 172.21.15.59:0/1750843572 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:16.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.680+0000 7f4367fff640 1 --2- 172.21.15.59:0/1750843572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4368109150 0x7f436819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:16.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.680+0000 7f4366ffd640 1 -- 172.21.15.59:0/1750843572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4368102dc0 msgr2=0x7f4368199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:16.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.680+0000 7f4366ffd640 1 --2- 172.21.15.59:0/1750843572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4368102dc0 0x7f4368199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.680+0000 7f4366ffd640 1 -- 172.21.15.59:0/1750843572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4368109150 msgr2=0x7f436819eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:16.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.680+0000 7f4366ffd640 1 --2- 172.21.15.59:0/1750843572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4368109150 0x7f436819eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.680+0000 7f4366ffd640 1 -- 172.21.15.59:0/1750843572 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f436819f330 con 0x7f43681087d0 2024-09-10T21:14:16.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.680+0000 7f4366ffd640 1 --2- 172.21.15.59:0/1750843572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43681087d0 0x7f43681997c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f435c00c970 tx=0x7f435c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:16.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.680+0000 7f4364ff9640 1 -- 172.21.15.59:0/1750843572 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c007bb0 con 0x7f43681087d0 2024-09-10T21:14:16.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.680+0000 7f4364ff9640 1 -- 172.21.15.59:0/1750843572 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f435c007d50 con 0x7f43681087d0 2024-09-10T21:14:16.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.680+0000 7f436dec6640 1 -- 172.21.15.59:0/1750843572 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f436819f620 con 0x7f43681087d0 2024-09-10T21:14:16.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.680+0000 7f4364ff9640 1 -- 172.21.15.59:0/1750843572 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c004df0 con 0x7f43681087d0 2024-09-10T21:14:16.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.680+0000 7f436dec6640 1 -- 172.21.15.59:0/1750843572 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43681a5eb0 con 0x7f43681087d0 2024-09-10T21:14:16.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.681+0000 7f436dec6640 1 -- 172.21.15.59:0/1750843572 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43681031a0 con 0x7f43681087d0 2024-09-10T21:14:16.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.683+0000 7f4364ff9640 1 -- 172.21.15.59:0/1750843572 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f435c005000 con 0x7f43681087d0 2024-09-10T21:14:16.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.683+0000 7f4364ff9640 1 --2- 172.21.15.59:0/1750843572 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43500b53f0 0x7f43500b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:16.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.683+0000 7f43677fe640 1 --2- 172.21.15.59:0/1750843572 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43500b53f0 0x7f43500b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:16.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.684+0000 7f4364ff9640 1 -- 172.21.15.59:0/1750843572 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f435c0e5da0 con 0x7f43681087d0 2024-09-10T21:14:16.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.684+0000 7f43677fe640 1 --2- 172.21.15.59:0/1750843572 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43500b53f0 0x7f43500b78b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4358005ec0 tx=0x7f43580058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:16.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.686+0000 7f4364ff9640 1 -- 172.21.15.59:0/1750843572 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f435c014030 con 0x7f43681087d0 2024-09-10T21:14:16.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.877+0000 7f436dec6640 1 -- 172.21.15.59:0/1750843572 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f436819a3b0 con 0x7f43681087d0 2024-09-10T21:14:16.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.878+0000 7f4364ff9640 1 -- 172.21.15.59:0/1750843572 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f435c0acbb0 con 0x7f43681087d0 2024-09-10T21:14:16.882 INFO:teuthology.orchestra.run.smithi059.stdout:261993005084 2024-09-10T21:14:16.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.880+0000 7f436dec6640 1 -- 172.21.15.59:0/1750843572 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43500b53f0 msgr2=0x7f43500b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:16.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.880+0000 7f436dec6640 1 --2- 172.21.15.59:0/1750843572 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43500b53f0 0x7f43500b78b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4358005ec0 tx=0x7f43580058d0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.880+0000 7f436dec6640 1 -- 172.21.15.59:0/1750843572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43681087d0 msgr2=0x7f43681997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:16.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.880+0000 7f436dec6640 1 --2- 172.21.15.59:0/1750843572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43681087d0 0x7f43681997c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f435c00c970 tx=0x7f435c00ce30 comp rx=0 tx=0).stop 2024-09-10T21:14:16.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.880+0000 7f436dec6640 1 -- 172.21.15.59:0/1750843572 shutdown_connections 2024-09-10T21:14:16.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.880+0000 7f436dec6640 1 --2- 172.21.15.59:0/1750843572 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43500b53f0 0x7f43500b78b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.880+0000 7f436dec6640 1 --2- 172.21.15.59:0/1750843572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4368109150 0x7f436819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.880+0000 7f436dec6640 1 --2- 172.21.15.59:0/1750843572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43681087d0 0x7f43681997c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.880+0000 7f436dec6640 1 --2- 172.21.15.59:0/1750843572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4368102dc0 0x7f4368199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.880+0000 7f436dec6640 1 -- 172.21.15.59:0/1750843572 >> 172.21.15.59:0/1750843572 conn(0x7f43680fe830 msgr2=0x7f43681000f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:16.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.880+0000 7f436dec6640 1 -- 172.21.15.59:0/1750843572 shutdown_connections 2024-09-10T21:14:16.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.880+0000 7f436dec6640 1 -- 172.21.15.59:0/1750843572 wait complete. 2024-09-10T21:14:16.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.883+0000 7fb41fcff640 1 -- 172.21.15.59:0/1153109497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb418101870 msgr2=0x7fb418101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:16.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.883+0000 7fb41fcff640 1 --2- 172.21.15.59:0/1153109497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb418101870 0x7fb418101c50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb414009900 tx=0x7fb41402a410 comp rx=0 tx=0).stop 2024-09-10T21:14:16.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.883+0000 7fb41fcff640 1 -- 172.21.15.59:0/1153109497 shutdown_connections 2024-09-10T21:14:16.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.883+0000 7fb41fcff640 1 --2- 172.21.15.59:0/1153109497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb41810f420 0x7fb418111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.883+0000 7fb41fcff640 1 --2- 172.21.15.59:0/1153109497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb418102190 0x7fb41810eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.883+0000 7fb41fcff640 1 --2- 172.21.15.59:0/1153109497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb418101870 0x7fb418101c50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.883+0000 7fb41fcff640 1 -- 172.21.15.59:0/1153109497 >> 172.21.15.59:0/1153109497 conn(0x7fb4180fd700 msgr2=0x7fb4180ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:16.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.883+0000 7fb41fcff640 1 -- 172.21.15.59:0/1153109497 shutdown_connections 2024-09-10T21:14:16.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.883+0000 7fb41fcff640 1 -- 172.21.15.59:0/1153109497 wait complete. 2024-09-10T21:14:16.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.884+0000 7fb41fcff640 1 Processor -- start 2024-09-10T21:14:16.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.884+0000 7fb41fcff640 1 -- start start 2024-09-10T21:14:16.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.884+0000 7fb41fcff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb418101870 0x7fb41819b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:16.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.884+0000 7fb41fcff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb418102190 0x7fb41819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:16.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.884+0000 7fb41fcff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41810f420 0x7fb4181a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:16.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.884+0000 7fb41fcff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb418114f90 con 0x7fb41810f420 2024-09-10T21:14:16.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.884+0000 7fb41fcff640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb418114e10 con 0x7fb418101870 2024-09-10T21:14:16.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.884+0000 7fb41fcff640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb418115110 con 0x7fb418102190 2024-09-10T21:14:16.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.884+0000 7fb41e29c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41810f420 0x7fb4181a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:16.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.884+0000 7fb41e29c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41810f420 0x7fb4181a0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40562/0 (socket says 172.21.15.59:40562) 2024-09-10T21:14:16.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.884+0000 7fb41e29c640 1 -- 172.21.15.59:0/919902951 learned_addr learned my addr 172.21.15.59:0/919902951 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:16.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.884+0000 7fb41d29a640 1 --2- 172.21.15.59:0/919902951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb418102190 0x7fb41819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:16.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.884+0000 7fb41da9b640 1 --2- 172.21.15.59:0/919902951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb418101870 0x7fb41819b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:16.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.885+0000 7fb41e29c640 1 -- 172.21.15.59:0/919902951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb418102190 msgr2=0x7fb41819b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:16.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.885+0000 7fb41e29c640 1 --2- 172.21.15.59:0/919902951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb418102190 0x7fb41819b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.885+0000 7fb41e29c640 1 -- 172.21.15.59:0/919902951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb418101870 msgr2=0x7fb41819b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:16.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.885+0000 7fb41e29c640 1 --2- 172.21.15.59:0/919902951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb418101870 0x7fb41819b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.885+0000 7fb41e29c640 1 -- 172.21.15.59:0/919902951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4181a1540 con 0x7fb41810f420 2024-09-10T21:14:16.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.885+0000 7fb41da9b640 1 --2- 172.21.15.59:0/919902951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb418101870 0x7fb41819b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:14:16.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.885+0000 7fb41d29a640 1 --2- 172.21.15.59:0/919902951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb418102190 0x7fb41819b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:14:16.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.885+0000 7fb41e29c640 1 --2- 172.21.15.59:0/919902951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41810f420 0x7fb4181a0d70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb41000eb40 tx=0x7fb41000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:16.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.885+0000 7fb40affd640 1 -- 172.21.15.59:0/919902951 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410004b20 con 0x7fb41810f420 2024-09-10T21:14:16.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.885+0000 7fb40affd640 1 -- 172.21.15.59:0/919902951 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb410004cc0 con 0x7fb41810f420 2024-09-10T21:14:16.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.885+0000 7fb41fcff640 1 -- 172.21.15.59:0/919902951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4181a1830 con 0x7fb41810f420 2024-09-10T21:14:16.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.885+0000 7fb40affd640 1 -- 172.21.15.59:0/919902951 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410010720 con 0x7fb41810f420 2024-09-10T21:14:16.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.885+0000 7fb41fcff640 1 -- 172.21.15.59:0/919902951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4181a7ef0 con 0x7fb41810f420 2024-09-10T21:14:16.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.886+0000 7fb41fcff640 1 -- 172.21.15.59:0/919902951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb418101c50 con 0x7fb41810f420 2024-09-10T21:14:16.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.888+0000 7fb40affd640 1 -- 172.21.15.59:0/919902951 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fb410005560 con 0x7fb41810f420 2024-09-10T21:14:16.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.889+0000 7fb40affd640 1 --2- 172.21.15.59:0/919902951 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb4040b53f0 0x7fb4040b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:16.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.889+0000 7fb41da9b640 1 --2- 172.21.15.59:0/919902951 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb4040b53f0 0x7fb4040b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:16.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.889+0000 7fb40affd640 1 -- 172.21.15.59:0/919902951 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fb4100e64e0 con 0x7fb41810f420 2024-09-10T21:14:16.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.889+0000 7fb41da9b640 1 --2- 172.21.15.59:0/919902951 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb4040b53f0 0x7fb4040b78b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb414031440 tx=0x7fb414005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:16.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:15.893+0000 7fb40affd640 1 -- 172.21.15.59:0/919902951 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb4100ad210 con 0x7fb41810f420 2024-09-10T21:14:16.955 INFO:teuthology.orchestra.run.smithi059.stdout:219043332135 2024-09-10T21:14:16.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.082+0000 7fb41fcff640 1 -- 172.21.15.59:0/919902951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fb41810a020 con 0x7fb41810f420 2024-09-10T21:14:16.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.082+0000 7fb40affd640 1 -- 172.21.15.59:0/919902951 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb4100acb10 con 0x7fb41810f420 2024-09-10T21:14:16.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.084+0000 7fb41fcff640 1 -- 172.21.15.59:0/919902951 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb4040b53f0 msgr2=0x7fb4040b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:16.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.084+0000 7fb41fcff640 1 --2- 172.21.15.59:0/919902951 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb4040b53f0 0x7fb4040b78b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb414031440 tx=0x7fb414005b50 comp rx=0 tx=0).stop 2024-09-10T21:14:16.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.084+0000 7fb41fcff640 1 -- 172.21.15.59:0/919902951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41810f420 msgr2=0x7fb4181a0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:16.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.084+0000 7fb41fcff640 1 --2- 172.21.15.59:0/919902951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41810f420 0x7fb4181a0d70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb41000eb40 tx=0x7fb41000c2d0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.085+0000 7fb41fcff640 1 -- 172.21.15.59:0/919902951 shutdown_connections 2024-09-10T21:14:16.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.085+0000 7fb41fcff640 1 --2- 172.21.15.59:0/919902951 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb4040b53f0 0x7fb4040b78b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.085+0000 7fb41fcff640 1 --2- 172.21.15.59:0/919902951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41810f420 0x7fb4181a0d70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.085+0000 7fb41fcff640 1 --2- 172.21.15.59:0/919902951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb418102190 0x7fb41819b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.085+0000 7fb41fcff640 1 --2- 172.21.15.59:0/919902951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb418101870 0x7fb41819b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:16.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.085+0000 7fb41fcff640 1 -- 172.21.15.59:0/919902951 >> 172.21.15.59:0/919902951 conn(0x7fb4180fd700 msgr2=0x7fb4180ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:16.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.085+0000 7fb41fcff640 1 -- 172.21.15.59:0/919902951 shutdown_connections 2024-09-10T21:14:16.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:16.085+0000 7fb41fcff640 1 -- 172.21.15.59:0/919902951 wait complete. 2024-09-10T21:14:17.522 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:17 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1750843572' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T21:14:17.523 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:17 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:17.523 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:17 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:17.523 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:17 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:17.523 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:17 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:17.550 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332132 got 219043332135 for osd.8 2024-09-10T21:14:17.551 DEBUG:teuthology.parallel:result is None 2024-09-10T21:14:17.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:17 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1750843572' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T21:14:17.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:17 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:17.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:17 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:17.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:17 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:17.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:17 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:17.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:17 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1750843572' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T21:14:17.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:17 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:17.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:17 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:17.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:17 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:17.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:17 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:18.003 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574918 got 55834574922 for osd.1 2024-09-10T21:14:18.003 DEBUG:teuthology.parallel:result is None 2024-09-10T21:14:18.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.200+0000 7f0d8f871640 1 -- 172.21.15.59:0/2203048638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d88102190 msgr2=0x7f0d8810eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:18.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.200+0000 7f0d8f871640 1 --2- 172.21.15.59:0/2203048638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d88102190 0x7f0d8810eee0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009900 tx=0x7f0d7802a410 comp rx=0 tx=0).stop 2024-09-10T21:14:18.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.200+0000 7f0d8f871640 1 -- 172.21.15.59:0/2203048638 shutdown_connections 2024-09-10T21:14:18.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.200+0000 7f0d8f871640 1 --2- 172.21.15.59:0/2203048638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d8810f420 0x7f0d88111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:18.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.200+0000 7f0d8f871640 1 --2- 172.21.15.59:0/2203048638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d88102190 0x7f0d8810eee0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:18.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.200+0000 7f0d8f871640 1 --2- 172.21.15.59:0/2203048638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d88101870 0x7f0d88101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:18.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.200+0000 7f0d8f871640 1 -- 172.21.15.59:0/2203048638 >> 172.21.15.59:0/2203048638 conn(0x7f0d880fd700 msgr2=0x7f0d880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:18.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.200+0000 7f0d8f871640 1 -- 172.21.15.59:0/2203048638 shutdown_connections 2024-09-10T21:14:18.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.200+0000 7f0d8f871640 1 -- 172.21.15.59:0/2203048638 wait complete. 2024-09-10T21:14:18.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.201+0000 7f0d8f871640 1 Processor -- start 2024-09-10T21:14:18.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.201+0000 7f0d8f871640 1 -- start start 2024-09-10T21:14:18.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.201+0000 7f0d8f871640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d88101870 0x7f0d8819b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:18.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.201+0000 7f0d8f871640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d88102190 0x7f0d8819ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:18.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.201+0000 7f0d8f871640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d8810f420 0x7f0d881a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:18.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.201+0000 7f0d8f871640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0d88114ff0 con 0x7f0d88101870 2024-09-10T21:14:18.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.201+0000 7f0d8f871640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0d88114e70 con 0x7f0d8810f420 2024-09-10T21:14:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.201+0000 7f0d8f871640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0d88115170 con 0x7f0d88102190 2024-09-10T21:14:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.201+0000 7f0d8d60d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d88101870 0x7f0d8819b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.201+0000 7f0d8d60d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d88101870 0x7f0d8819b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40590/0 (socket says 172.21.15.59:40590) 2024-09-10T21:14:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.201+0000 7f0d8d60d640 1 -- 172.21.15.59:0/1418419730 learned_addr learned my addr 172.21.15.59:0/1418419730 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.202+0000 7f0d8de0e640 1 --2- 172.21.15.59:0/1418419730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d8810f420 0x7f0d881a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.202+0000 7f0d8ce0c640 1 --2- 172.21.15.59:0/1418419730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d88102190 0x7f0d8819ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.202+0000 7f0d8d60d640 1 -- 172.21.15.59:0/1418419730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d88102190 msgr2=0x7f0d8819ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.202+0000 7f0d8d60d640 1 --2- 172.21.15.59:0/1418419730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d88102190 0x7f0d8819ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.202+0000 7f0d8d60d640 1 -- 172.21.15.59:0/1418419730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d8810f420 msgr2=0x7f0d881a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.202+0000 7f0d8d60d640 1 --2- 172.21.15.59:0/1418419730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d8810f420 0x7f0d881a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.202+0000 7f0d8d60d640 1 -- 172.21.15.59:0/1418419730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d881a1570 con 0x7f0d88101870 2024-09-10T21:14:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.202+0000 7f0d8ce0c640 1 --2- 172.21.15.59:0/1418419730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d88102190 0x7f0d8819ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:14:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.202+0000 7f0d8d60d640 1 --2- 172.21.15.59:0/1418419730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d88101870 0x7f0d8819b4c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0d8400b4a0 tx=0x7f0d8400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.202+0000 7f0d7e7fc640 1 -- 172.21.15.59:0/1418419730 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d84014070 con 0x7f0d88101870 2024-09-10T21:14:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.202+0000 7f0d7e7fc640 1 -- 172.21.15.59:0/1418419730 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d84010ac0 con 0x7f0d88101870 2024-09-10T21:14:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.202+0000 7f0d8f871640 1 -- 172.21.15.59:0/1418419730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d881a1860 con 0x7f0d88101870 2024-09-10T21:14:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.202+0000 7f0d7e7fc640 1 -- 172.21.15.59:0/1418419730 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d84017c30 con 0x7f0d88101870 2024-09-10T21:14:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.202+0000 7f0d8f871640 1 -- 172.21.15.59:0/1418419730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d881a7fa0 con 0x7f0d88101870 2024-09-10T21:14:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.203+0000 7f0d8f871640 1 -- 172.21.15.59:0/1418419730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d88101c50 con 0x7f0d88101870 2024-09-10T21:14:18.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.205+0000 7f0d7e7fc640 1 -- 172.21.15.59:0/1418419730 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f0d84010610 con 0x7f0d88101870 2024-09-10T21:14:18.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.205+0000 7f0d7e7fc640 1 --2- 172.21.15.59:0/1418419730 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0d740b5370 0x7f0d740b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:18.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.205+0000 7f0d8ce0c640 1 --2- 172.21.15.59:0/1418419730 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0d740b5370 0x7f0d740b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:18.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.206+0000 7f0d7e7fc640 1 -- 172.21.15.59:0/1418419730 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0d840e5850 con 0x7f0d88101870 2024-09-10T21:14:18.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.206+0000 7f0d8ce0c640 1 --2- 172.21.15.59:0/1418419730 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0d740b5370 0x7f0d740b7830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0d78000c00 tx=0x7f0d78031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:18.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.208+0000 7f0d7e7fc640 1 -- 172.21.15.59:0/1418419730 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0d840ac5e0 con 0x7f0d88101870 2024-09-10T21:14:18.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.398+0000 7f0d8f871640 1 -- 172.21.15.59:0/1418419730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0d8819c5f0 con 0x7f0d88101870 2024-09-10T21:14:18.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.398+0000 7f0d7e7fc640 1 -- 172.21.15.59:0/1418419730 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0d840abee0 con 0x7f0d88101870 2024-09-10T21:14:18.402 INFO:teuthology.orchestra.run.smithi059.stdout:150323855414 2024-09-10T21:14:18.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.400+0000 7f0d8f871640 1 -- 172.21.15.59:0/1418419730 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0d740b5370 msgr2=0x7f0d740b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:18.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.400+0000 7f0d8f871640 1 --2- 172.21.15.59:0/1418419730 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0d740b5370 0x7f0d740b7830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0d78000c00 tx=0x7f0d78031400 comp rx=0 tx=0).stop 2024-09-10T21:14:18.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.400+0000 7f0d8f871640 1 -- 172.21.15.59:0/1418419730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d88101870 msgr2=0x7f0d8819b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:18.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.400+0000 7f0d8f871640 1 --2- 172.21.15.59:0/1418419730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d88101870 0x7f0d8819b4c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0d8400b4a0 tx=0x7f0d8400b960 comp rx=0 tx=0).stop 2024-09-10T21:14:18.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.400+0000 7f0d8f871640 1 -- 172.21.15.59:0/1418419730 shutdown_connections 2024-09-10T21:14:18.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.400+0000 7f0d8f871640 1 --2- 172.21.15.59:0/1418419730 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0d740b5370 0x7f0d740b7830 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:18.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.400+0000 7f0d8f871640 1 --2- 172.21.15.59:0/1418419730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d8810f420 0x7f0d881a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:18.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.400+0000 7f0d8f871640 1 --2- 172.21.15.59:0/1418419730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d88102190 0x7f0d8819ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:18.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.400+0000 7f0d8f871640 1 --2- 172.21.15.59:0/1418419730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d88101870 0x7f0d8819b4c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:18.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.400+0000 7f0d8f871640 1 -- 172.21.15.59:0/1418419730 >> 172.21.15.59:0/1418419730 conn(0x7f0d880fd700 msgr2=0x7f0d88111610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:18.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.400+0000 7f0d8f871640 1 -- 172.21.15.59:0/1418419730 shutdown_connections 2024-09-10T21:14:18.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:18.401+0000 7f0d8f871640 1 -- 172.21.15.59:0/1418419730 wait complete. 2024-09-10T21:14:18.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:18 smithi059 ceph-mon[30888]: pgmap v311: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:14:18.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:18 smithi154 ceph-mon[35041]: pgmap v311: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:14:18.729 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:18 smithi192 ceph-mon[35363]: pgmap v311: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:14:18.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.795+0000 7f204cb20640 1 -- 172.21.15.59:0/3415536058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204810d120 msgr2=0x7f204810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.795+0000 7f204cb20640 1 --2- 172.21.15.59:0/3415536058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204810d120 0x7f204810f550 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2040009900 tx=0x7f204002a410 comp rx=0 tx=0).stop 2024-09-10T21:14:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.795+0000 7f204cb20640 1 -- 172.21.15.59:0/3415536058 shutdown_connections 2024-09-10T21:14:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.795+0000 7f204cb20640 1 --2- 172.21.15.59:0/3415536058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204810d120 0x7f204810f550 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.795+0000 7f204cb20640 1 --2- 172.21.15.59:0/3415536058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2048104570 0x7f204810cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.795+0000 7f204cb20640 1 --2- 172.21.15.59:0/3415536058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2048103b70 0x7f2048103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.795+0000 7f204cb20640 1 -- 172.21.15.59:0/3415536058 >> 172.21.15.59:0/3415536058 conn(0x7f20480fd700 msgr2=0x7f20480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.795+0000 7f204cb20640 1 -- 172.21.15.59:0/3415536058 shutdown_connections 2024-09-10T21:14:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.795+0000 7f204cb20640 1 -- 172.21.15.59:0/3415536058 wait complete. 2024-09-10T21:14:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.795+0000 7f204cb20640 1 Processor -- start 2024-09-10T21:14:18.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.796+0000 7f204cb20640 1 -- start start 2024-09-10T21:14:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.796+0000 7f204cb20640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2048103b70 0x7f2048199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.796+0000 7f204cb20640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2048104570 0x7f2048199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.796+0000 7f204cb20640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f204810d120 0x7f204819ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.796+0000 7f204cb20640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2048112db0 con 0x7f2048104570 2024-09-10T21:14:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.796+0000 7f204cb20640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2048112c30 con 0x7f2048103b70 2024-09-10T21:14:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.796+0000 7f204cb20640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2048112f30 con 0x7f204810d120 2024-09-10T21:14:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.796+0000 7f2045d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2048104570 0x7f2048199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.796+0000 7f2045d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2048104570 0x7f2048199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40538/0 (socket says 172.21.15.59:40538) 2024-09-10T21:14:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.796+0000 7f2045d9b640 1 -- 172.21.15.59:0/611187686 learned_addr learned my addr 172.21.15.59:0/611187686 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:18.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.796+0000 7f204659c640 1 --2- 172.21.15.59:0/611187686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2048103b70 0x7f2048199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:18.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.796+0000 7f2045d9b640 1 -- 172.21.15.59:0/611187686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f204810d120 msgr2=0x7f204819ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:18.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.796+0000 7f2045d9b640 1 --2- 172.21.15.59:0/611187686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f204810d120 0x7f204819ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:18.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.796+0000 7f2045d9b640 1 -- 172.21.15.59:0/611187686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2048103b70 msgr2=0x7f2048199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:18.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.796+0000 7f2045d9b640 1 --2- 172.21.15.59:0/611187686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2048103b70 0x7f2048199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:18.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.796+0000 7f2045d9b640 1 -- 172.21.15.59:0/611187686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f204819f3d0 con 0x7f2048104570 2024-09-10T21:14:18.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.796+0000 7f2045d9b640 1 --2- 172.21.15.59:0/611187686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2048104570 0x7f2048199860 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f203000c970 tx=0x7f203000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:18.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.796+0000 7f203f7fe640 1 -- 172.21.15.59:0/611187686 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2030007bb0 con 0x7f2048104570 2024-09-10T21:14:18.757 INFO:teuthology.orchestra.run.smithi059.stdout:287762808856 2024-09-10T21:14:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.797+0000 7f204cb20640 1 -- 172.21.15.59:0/611187686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f204819f6c0 con 0x7f2048104570 2024-09-10T21:14:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.797+0000 7f203f7fe640 1 -- 172.21.15.59:0/611187686 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2030007d50 con 0x7f2048104570 2024-09-10T21:14:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.797+0000 7f203f7fe640 1 -- 172.21.15.59:0/611187686 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f203000f450 con 0x7f2048104570 2024-09-10T21:14:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.797+0000 7f204cb20640 1 -- 172.21.15.59:0/611187686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20481a5d80 con 0x7f2048104570 2024-09-10T21:14:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.798+0000 7f204cb20640 1 -- 172.21.15.59:0/611187686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2048103f50 con 0x7f2048104570 2024-09-10T21:14:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.799+0000 7f203f7fe640 1 -- 172.21.15.59:0/611187686 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f2030004f20 con 0x7f2048104570 2024-09-10T21:14:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.800+0000 7f203f7fe640 1 --2- 172.21.15.59:0/611187686 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f20340b5370 0x7f20340b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.800+0000 7f204659c640 1 --2- 172.21.15.59:0/611187686 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f20340b5370 0x7f20340b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.800+0000 7f203f7fe640 1 -- 172.21.15.59:0/611187686 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f20300e5a90 con 0x7f2048104570 2024-09-10T21:14:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.801+0000 7f204659c640 1 --2- 172.21.15.59:0/611187686 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f20340b5370 0x7f20340b7830 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2038005c40 tx=0x7f2038005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.804+0000 7f203f7fe640 1 -- 172.21.15.59:0/611187686 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2030014030 con 0x7f2048104570 2024-09-10T21:14:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.995+0000 7f204cb20640 1 -- 172.21.15.59:0/611187686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f2048107c00 con 0x7f2048104570 2024-09-10T21:14:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.995+0000 7f203f7fe640 1 -- 172.21.15.59:0/611187686 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f20300ac820 con 0x7f2048104570 2024-09-10T21:14:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.997+0000 7f204cb20640 1 -- 172.21.15.59:0/611187686 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f20340b5370 msgr2=0x7f20340b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.997+0000 7f204cb20640 1 --2- 172.21.15.59:0/611187686 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f20340b5370 0x7f20340b7830 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2038005c40 tx=0x7f2038005bd0 comp rx=0 tx=0).stop 2024-09-10T21:14:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.997+0000 7f204cb20640 1 -- 172.21.15.59:0/611187686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2048104570 msgr2=0x7f2048199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.997+0000 7f204cb20640 1 --2- 172.21.15.59:0/611187686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2048104570 0x7f2048199860 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f203000c970 tx=0x7f203000ce30 comp rx=0 tx=0).stop 2024-09-10T21:14:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.997+0000 7f204cb20640 1 -- 172.21.15.59:0/611187686 shutdown_connections 2024-09-10T21:14:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.997+0000 7f204cb20640 1 --2- 172.21.15.59:0/611187686 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f20340b5370 0x7f20340b7830 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.997+0000 7f204cb20640 1 --2- 172.21.15.59:0/611187686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f204810d120 0x7f204819ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.997+0000 7f204cb20640 1 --2- 172.21.15.59:0/611187686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2048104570 0x7f2048199860 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.997+0000 7f204cb20640 1 --2- 172.21.15.59:0/611187686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2048103b70 0x7f2048199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.997+0000 7f204cb20640 1 -- 172.21.15.59:0/611187686 >> 172.21.15.59:0/611187686 conn(0x7f20480fd700 msgr2=0x7f20480fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.997+0000 7f204cb20640 1 -- 172.21.15.59:0/611187686 shutdown_connections 2024-09-10T21:14:18.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:14.997+0000 7f204cb20640 1 -- 172.21.15.59:0/611187686 wait complete. 2024-09-10T21:14:18.947 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:18.947 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:19.434 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808853 got 287762808856 for osd.11 2024-09-10T21:14:19.434 DEBUG:teuthology.parallel:result is None 2024-09-10T21:14:19.643 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:19 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1418419730' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T21:14:19.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:19 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1418419730' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T21:14:19.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:19 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1418419730' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T21:14:20.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.096+0000 7f611fad3640 1 -- 172.21.15.59:0/4239987073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f611810d110 msgr2=0x7f611810f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:20.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.096+0000 7f611fad3640 1 --2- 172.21.15.59:0/4239987073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f611810d110 0x7f611810f570 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6110009900 tx=0x7f611002a410 comp rx=0 tx=0).stop 2024-09-10T21:14:20.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.096+0000 7f611fad3640 1 -- 172.21.15.59:0/4239987073 shutdown_connections 2024-09-10T21:14:20.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.096+0000 7f611fad3640 1 --2- 172.21.15.59:0/4239987073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f611810d110 0x7f611810f570 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:20.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.096+0000 7f611fad3640 1 --2- 172.21.15.59:0/4239987073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61181045d0 0x7f611810cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:20.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.096+0000 7f611fad3640 1 --2- 172.21.15.59:0/4239987073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6118103cb0 0x7f6118104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:20.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.096+0000 7f611fad3640 1 -- 172.21.15.59:0/4239987073 >> 172.21.15.59:0/4239987073 conn(0x7f61180fd730 msgr2=0x7f61180ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:20.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.096+0000 7f611fad3640 1 -- 172.21.15.59:0/4239987073 shutdown_connections 2024-09-10T21:14:20.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.096+0000 7f611fad3640 1 -- 172.21.15.59:0/4239987073 wait complete. 2024-09-10T21:14:20.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.096+0000 7f611fad3640 1 Processor -- start 2024-09-10T21:14:20.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.096+0000 7f611fad3640 1 -- start start 2024-09-10T21:14:20.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611fad3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6118103cb0 0x7f611819b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:20.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611fad3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61181045d0 0x7f611819baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:20.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611fad3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f611810d110 0x7f61181a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611fad3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6118112e60 con 0x7f6118103cb0 2024-09-10T21:14:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611fad3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6118112ce0 con 0x7f611810d110 2024-09-10T21:14:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611fad3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6118112fe0 con 0x7f61181045d0 2024-09-10T21:14:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611d86f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6118103cb0 0x7f611819b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611d86f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6118103cb0 0x7f611819b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57952/0 (socket says 172.21.15.59:57952) 2024-09-10T21:14:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611d86f640 1 -- 172.21.15.59:0/2903608971 learned_addr learned my addr 172.21.15.59:0/2903608971 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611e070640 1 --2- 172.21.15.59:0/2903608971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f611810d110 0x7f61181a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611d06e640 1 --2- 172.21.15.59:0/2903608971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61181045d0 0x7f611819baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611d86f640 1 -- 172.21.15.59:0/2903608971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61181045d0 msgr2=0x7f611819baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611d86f640 1 --2- 172.21.15.59:0/2903608971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61181045d0 0x7f611819baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611d86f640 1 -- 172.21.15.59:0/2903608971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f611810d110 msgr2=0x7f61181a0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611d86f640 1 --2- 172.21.15.59:0/2903608971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f611810d110 0x7f61181a0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611d86f640 1 -- 172.21.15.59:0/2903608971 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61181a1660 con 0x7f6118103cb0 2024-09-10T21:14:20.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611e070640 1 --2- 172.21.15.59:0/2903608971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f611810d110 0x7f61181a0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:20.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611d86f640 1 --2- 172.21.15.59:0/2903608971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6118103cb0 0x7f611819b5b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f610800ba50 tx=0x7f610800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:20.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f6116ffd640 1 -- 172.21.15.59:0/2903608971 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108019070 con 0x7f6118103cb0 2024-09-10T21:14:20.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f6116ffd640 1 -- 172.21.15.59:0/2903608971 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f610800cbe0 con 0x7f6118103cb0 2024-09-10T21:14:20.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611fad3640 1 -- 172.21.15.59:0/2903608971 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61181a1950 con 0x7f6118103cb0 2024-09-10T21:14:20.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f6116ffd640 1 -- 172.21.15.59:0/2903608971 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61080075d0 con 0x7f6118103cb0 2024-09-10T21:14:20.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.097+0000 7f611fad3640 1 -- 172.21.15.59:0/2903608971 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61181a81e0 con 0x7f6118103cb0 2024-09-10T21:14:20.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.098+0000 7f611fad3640 1 -- 172.21.15.59:0/2903608971 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6118104110 con 0x7f6118103cb0 2024-09-10T21:14:20.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.100+0000 7f6116ffd640 1 -- 172.21.15.59:0/2903608971 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f6108007830 con 0x7f6118103cb0 2024-09-10T21:14:20.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.100+0000 7f6116ffd640 1 --2- 172.21.15.59:0/2903608971 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f61000b53f0 0x7f61000b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:20.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.101+0000 7f611d06e640 1 --2- 172.21.15.59:0/2903608971 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f61000b53f0 0x7f61000b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:20.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.101+0000 7f6116ffd640 1 -- 172.21.15.59:0/2903608971 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f61080e59e0 con 0x7f6118103cb0 2024-09-10T21:14:20.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.101+0000 7f611d06e640 1 --2- 172.21.15.59:0/2903608971 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f61000b53f0 0x7f61000b78b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f611810e790 tx=0x7f610c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:20.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.103+0000 7f6116ffd640 1 -- 172.21.15.59:0/2903608971 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f61080ac770 con 0x7f6118103cb0 2024-09-10T21:14:20.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.294+0000 7f611fad3640 1 -- 172.21.15.59:0/2903608971 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f61181a8440 con 0x7f6118103cb0 2024-09-10T21:14:20.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.294+0000 7f6116ffd640 1 -- 172.21.15.59:0/2903608971 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f61080ac070 con 0x7f6118103cb0 2024-09-10T21:14:20.299 INFO:teuthology.orchestra.run.smithi059.stdout:193273528365 2024-09-10T21:14:20.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.297+0000 7f611fad3640 1 -- 172.21.15.59:0/2903608971 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f61000b53f0 msgr2=0x7f61000b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:20.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.297+0000 7f611fad3640 1 --2- 172.21.15.59:0/2903608971 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f61000b53f0 0x7f61000b78b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f611810e790 tx=0x7f610c008040 comp rx=0 tx=0).stop 2024-09-10T21:14:20.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.297+0000 7f611fad3640 1 -- 172.21.15.59:0/2903608971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6118103cb0 msgr2=0x7f611819b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:20.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.297+0000 7f611fad3640 1 --2- 172.21.15.59:0/2903608971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6118103cb0 0x7f611819b5b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f610800ba50 tx=0x7f610800bf10 comp rx=0 tx=0).stop 2024-09-10T21:14:20.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.297+0000 7f611fad3640 1 -- 172.21.15.59:0/2903608971 shutdown_connections 2024-09-10T21:14:20.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.297+0000 7f611fad3640 1 --2- 172.21.15.59:0/2903608971 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f61000b53f0 0x7f61000b78b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:20.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.297+0000 7f611fad3640 1 --2- 172.21.15.59:0/2903608971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f611810d110 0x7f61181a0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:20.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.297+0000 7f611fad3640 1 --2- 172.21.15.59:0/2903608971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61181045d0 0x7f611819baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:20.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.297+0000 7f611fad3640 1 --2- 172.21.15.59:0/2903608971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6118103cb0 0x7f611819b5b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:20.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.297+0000 7f611fad3640 1 -- 172.21.15.59:0/2903608971 >> 172.21.15.59:0/2903608971 conn(0x7f61180fd730 msgr2=0x7f61180ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:20.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.297+0000 7f611fad3640 1 -- 172.21.15.59:0/2903608971 shutdown_connections 2024-09-10T21:14:20.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:20.297+0000 7f611fad3640 1 -- 172.21.15.59:0/2903608971 wait complete. 2024-09-10T21:14:20.532 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005082 got 261993005084 for osd.10 2024-09-10T21:14:20.533 DEBUG:teuthology.parallel:result is None 2024-09-10T21:14:20.555 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:20 smithi059 ceph-mon[30888]: pgmap v312: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:14:20.555 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:20 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2903608971' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T21:14:20.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:20 smithi154 ceph-mon[35041]: pgmap v312: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:14:20.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:20 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2903608971' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T21:14:20.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:20 smithi192 ceph-mon[35363]: pgmap v312: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-10T21:14:20.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:20 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2903608971' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T21:14:21.203 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528362 got 193273528365 for osd.7 2024-09-10T21:14:21.203 DEBUG:teuthology.parallel:result is None 2024-09-10T21:14:21.687 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855411 got 150323855414 for osd.5 2024-09-10T21:14:21.687 DEBUG:teuthology.parallel:result is None 2024-09-10T21:14:21.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.823+0000 7f91b5bf0640 1 -- 172.21.15.59:0/4119164303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b0107780 msgr2=0x7f91b0107be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:21.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.823+0000 7f91b5bf0640 1 --2- 172.21.15.59:0/4119164303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b0107780 0x7f91b0107be0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009900 tx=0x7f91a402a410 comp rx=0 tx=0).stop 2024-09-10T21:14:21.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.823+0000 7f91b5bf0640 1 -- 172.21.15.59:0/4119164303 shutdown_connections 2024-09-10T21:14:21.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.823+0000 7f91b5bf0640 1 --2- 172.21.15.59:0/4119164303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91b0108120 0x7f91b010e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:21.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.823+0000 7f91b5bf0640 1 --2- 172.21.15.59:0/4119164303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b0107780 0x7f91b0107be0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:21.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.823+0000 7f91b5bf0640 1 --2- 172.21.15.59:0/4119164303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91b0102920 0x7f91b0102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:21.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.823+0000 7f91b5bf0640 1 -- 172.21.15.59:0/4119164303 >> 172.21.15.59:0/4119164303 conn(0x7f91b0076f50 msgr2=0x7f91b0077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:21.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.823+0000 7f91b5bf0640 1 -- 172.21.15.59:0/4119164303 shutdown_connections 2024-09-10T21:14:21.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.823+0000 7f91b5bf0640 1 -- 172.21.15.59:0/4119164303 wait complete. 2024-09-10T21:14:21.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.824+0000 7f91b5bf0640 1 Processor -- start 2024-09-10T21:14:21.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.824+0000 7f91b5bf0640 1 -- start start 2024-09-10T21:14:21.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.825+0000 7f91b5bf0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b0102920 0x7f91b019a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:21.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.825+0000 7f91b5bf0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91b0107780 0x7f91b019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.825+0000 7f91b5bf0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91b0108120 0x7f91b019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.825+0000 7f91b5bf0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f91b0111ca0 con 0x7f91b0102920 2024-09-10T21:14:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.825+0000 7f91b5bf0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f91b0111b20 con 0x7f91b0108120 2024-09-10T21:14:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.825+0000 7f91b5bf0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f91b0111e20 con 0x7f91b0107780 2024-09-10T21:14:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.825+0000 7f91af7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b0102920 0x7f91b019a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.825+0000 7f91af7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b0102920 0x7f91b019a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57966/0 (socket says 172.21.15.59:57966) 2024-09-10T21:14:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.825+0000 7f91af7fe640 1 -- 172.21.15.59:0/916466339 learned_addr learned my addr 172.21.15.59:0/916466339 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.825+0000 7f91affff640 1 --2- 172.21.15.59:0/916466339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91b0108120 0x7f91b019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.825+0000 7f91aeffd640 1 --2- 172.21.15.59:0/916466339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91b0107780 0x7f91b019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.825+0000 7f91af7fe640 1 -- 172.21.15.59:0/916466339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91b0107780 msgr2=0x7f91b019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.825+0000 7f91af7fe640 1 --2- 172.21.15.59:0/916466339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91b0107780 0x7f91b019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.825+0000 7f91af7fe640 1 -- 172.21.15.59:0/916466339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91b0108120 msgr2=0x7f91b019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.825+0000 7f91af7fe640 1 --2- 172.21.15.59:0/916466339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91b0108120 0x7f91b019ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:21.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.825+0000 7f91af7fe640 1 -- 172.21.15.59:0/916466339 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b01a5450 con 0x7f91b0102920 2024-09-10T21:14:21.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.825+0000 7f91af7fe640 1 --2- 172.21.15.59:0/916466339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b0102920 0x7f91b019a070 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f91a000eab0 tx=0x7f91a000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:21.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.826+0000 7f91acff9640 1 -- 172.21.15.59:0/916466339 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a000ce40 con 0x7f91b0102920 2024-09-10T21:14:21.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.826+0000 7f91acff9640 1 -- 172.21.15.59:0/916466339 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91a0011920 con 0x7f91b0102920 2024-09-10T21:14:21.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.826+0000 7f91b5bf0640 1 -- 172.21.15.59:0/916466339 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b01a5740 con 0x7f91b0102920 2024-09-10T21:14:21.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.826+0000 7f91acff9640 1 -- 172.21.15.59:0/916466339 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0010a30 con 0x7f91b0102920 2024-09-10T21:14:21.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.826+0000 7f91b5bf0640 1 -- 172.21.15.59:0/916466339 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b01a5ca0 con 0x7f91b0102920 2024-09-10T21:14:21.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.827+0000 7f91b5bf0640 1 -- 172.21.15.59:0/916466339 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b0102d00 con 0x7f91b0102920 2024-09-10T21:14:21.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.828+0000 7f91acff9640 1 -- 172.21.15.59:0/916466339 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f91a000f040 con 0x7f91b0102920 2024-09-10T21:14:21.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.829+0000 7f91acff9640 1 --2- 172.21.15.59:0/916466339 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f91980b53f0 0x7f91980b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:21.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.829+0000 7f91aeffd640 1 --2- 172.21.15.59:0/916466339 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f91980b53f0 0x7f91980b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:21.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.829+0000 7f91acff9640 1 -- 172.21.15.59:0/916466339 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f91a00e5f40 con 0x7f91b0102920 2024-09-10T21:14:21.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.830+0000 7f91aeffd640 1 --2- 172.21.15.59:0/916466339 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f91980b53f0 0x7f91980b78b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f91a4031440 tx=0x7f91a4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:21.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:21.832+0000 7f91acff9640 1 -- 172.21.15.59:0/916466339 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f91a0016030 con 0x7f91b0102920 2024-09-10T21:14:22.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:22.043+0000 7f91b5bf0640 1 -- 172.21.15.59:0/916466339 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f91b002e5c0 con 0x7f91b0102920 2024-09-10T21:14:22.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:22.043+0000 7f91acff9640 1 -- 172.21.15.59:0/916466339 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f91a00accf0 con 0x7f91b0102920 2024-09-10T21:14:22.048 INFO:teuthology.orchestra.run.smithi059.stdout:77309411398 2024-09-10T21:14:22.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:22.045+0000 7f91b5bf0640 1 -- 172.21.15.59:0/916466339 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f91980b53f0 msgr2=0x7f91980b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:22.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:22.045+0000 7f91b5bf0640 1 --2- 172.21.15.59:0/916466339 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f91980b53f0 0x7f91980b78b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f91a4031440 tx=0x7f91a4005b50 comp rx=0 tx=0).stop 2024-09-10T21:14:22.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:22.045+0000 7f91b5bf0640 1 -- 172.21.15.59:0/916466339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b0102920 msgr2=0x7f91b019a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:22.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:22.045+0000 7f91b5bf0640 1 --2- 172.21.15.59:0/916466339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b0102920 0x7f91b019a070 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f91a000eab0 tx=0x7f91a000ef70 comp rx=0 tx=0).stop 2024-09-10T21:14:22.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:22.045+0000 7f91b5bf0640 1 -- 172.21.15.59:0/916466339 shutdown_connections 2024-09-10T21:14:22.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:22.045+0000 7f91b5bf0640 1 --2- 172.21.15.59:0/916466339 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f91980b53f0 0x7f91980b78b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:22.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:22.045+0000 7f91b5bf0640 1 --2- 172.21.15.59:0/916466339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f91b0108120 0x7f91b019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:22.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:22.046+0000 7f91b5bf0640 1 --2- 172.21.15.59:0/916466339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91b0107780 0x7f91b019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:22.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:22.046+0000 7f91b5bf0640 1 --2- 172.21.15.59:0/916466339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91b0102920 0x7f91b019a070 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:22.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:22.046+0000 7f91b5bf0640 1 -- 172.21.15.59:0/916466339 >> 172.21.15.59:0/916466339 conn(0x7f91b0076f50 msgr2=0x7f91b01004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:22.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:22.046+0000 7f91b5bf0640 1 -- 172.21.15.59:0/916466339 shutdown_connections 2024-09-10T21:14:22.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:22.046+0000 7f91b5bf0640 1 -- 172.21.15.59:0/916466339 wait complete. 2024-09-10T21:14:22.510 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:22 smithi059 ceph-mon[30888]: pgmap v313: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:14:22.510 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:22 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/916466339' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T21:14:22.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:22 smithi154 ceph-mon[35041]: pgmap v313: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:14:22.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:22 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/916466339' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T21:14:22.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:22 smithi192 ceph-mon[35363]: pgmap v313: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:14:22.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:22 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/916466339' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T21:14:23.232 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411395 got 77309411398 for osd.2 2024-09-10T21:14:23.232 DEBUG:teuthology.parallel:result is None 2024-09-10T21:14:23.232 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T21:14:23.232 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T21:14:23.509 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:24.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.017+0000 7ffad3f07640 1 -- 172.21.15.59:0/1741145899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffacc101c90 msgr2=0x7ffacc102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:24.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.017+0000 7ffad3f07640 1 --2- 172.21.15.59:0/1741145899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffacc101c90 0x7ffacc102070 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ffac8009900 tx=0x7ffac802a410 comp rx=0 tx=0).stop 2024-09-10T21:14:24.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.017+0000 7ffad3f07640 1 -- 172.21.15.59:0/1741145899 shutdown_connections 2024-09-10T21:14:24.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.017+0000 7ffad3f07640 1 --2- 172.21.15.59:0/1741145899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc108020 0x7ffacc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:24.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.017+0000 7ffad3f07640 1 --2- 172.21.15.59:0/1741145899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffacc1076a0 0x7ffacc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:24.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.017+0000 7ffad3f07640 1 --2- 172.21.15.59:0/1741145899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffacc101c90 0x7ffacc102070 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:24.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.017+0000 7ffad3f07640 1 -- 172.21.15.59:0/1741145899 >> 172.21.15.59:0/1741145899 conn(0x7ffacc0fd700 msgr2=0x7ffacc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:24.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.017+0000 7ffad3f07640 1 -- 172.21.15.59:0/1741145899 shutdown_connections 2024-09-10T21:14:24.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.017+0000 7ffad3f07640 1 -- 172.21.15.59:0/1741145899 wait complete. 2024-09-10T21:14:24.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad3f07640 1 Processor -- start 2024-09-10T21:14:24.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad3f07640 1 -- start start 2024-09-10T21:14:24.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad3f07640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc101c90 0x7ffacc0fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:24.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad3f07640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffacc1076a0 0x7ffacc0fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:24.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad3f07640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffacc108020 0x7ffacc0fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:24.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad3f07640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc111d30 con 0x7ffacc1076a0 2024-09-10T21:14:24.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad3f07640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc111bb0 con 0x7ffacc101c90 2024-09-10T21:14:24.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad3f07640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ffacc111eb0 con 0x7ffacc108020 2024-09-10T21:14:24.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad14a2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffacc1076a0 0x7ffacc0fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:24.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad14a2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffacc1076a0 0x7ffacc0fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57980/0 (socket says 172.21.15.59:57980) 2024-09-10T21:14:24.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad14a2640 1 -- 172.21.15.59:0/4050609818 learned_addr learned my addr 172.21.15.59:0/4050609818 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:24.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad1ca3640 1 --2- 172.21.15.59:0/4050609818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc101c90 0x7ffacc0fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:24.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad24a4640 1 --2- 172.21.15.59:0/4050609818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffacc108020 0x7ffacc0fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:24.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad14a2640 1 -- 172.21.15.59:0/4050609818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffacc108020 msgr2=0x7ffacc0fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:24.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad14a2640 1 --2- 172.21.15.59:0/4050609818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffacc108020 0x7ffacc0fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:24.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad14a2640 1 -- 172.21.15.59:0/4050609818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc101c90 msgr2=0x7ffacc0fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:24.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad14a2640 1 --2- 172.21.15.59:0/4050609818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc101c90 0x7ffacc0fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:24.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad14a2640 1 -- 172.21.15.59:0/4050609818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffacc1a76e0 con 0x7ffacc1076a0 2024-09-10T21:14:24.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad1ca3640 1 --2- 172.21.15.59:0/4050609818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc101c90 0x7ffacc0fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:24.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.018+0000 7ffad14a2640 1 --2- 172.21.15.59:0/4050609818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffacc1076a0 0x7ffacc0fe140 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00b4a0 tx=0x7ffabc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:24.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.019+0000 7ffac2ffd640 1 -- 172.21.15.59:0/4050609818 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc014070 con 0x7ffacc1076a0 2024-09-10T21:14:24.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.019+0000 7ffac2ffd640 1 -- 172.21.15.59:0/4050609818 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffabc010ac0 con 0x7ffacc1076a0 2024-09-10T21:14:24.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.019+0000 7ffad3f07640 1 -- 172.21.15.59:0/4050609818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffacc1a79d0 con 0x7ffacc1076a0 2024-09-10T21:14:24.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.019+0000 7ffac2ffd640 1 -- 172.21.15.59:0/4050609818 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc017c30 con 0x7ffacc1076a0 2024-09-10T21:14:24.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.019+0000 7ffad3f07640 1 -- 172.21.15.59:0/4050609818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffacc1a7fe0 con 0x7ffacc1076a0 2024-09-10T21:14:24.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.020+0000 7ffad3f07640 1 -- 172.21.15.59:0/4050609818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffacc102070 con 0x7ffacc1076a0 2024-09-10T21:14:24.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.022+0000 7ffac2ffd640 1 -- 172.21.15.59:0/4050609818 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7ffabc010610 con 0x7ffacc1076a0 2024-09-10T21:14:24.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.023+0000 7ffac2ffd640 1 --2- 172.21.15.59:0/4050609818 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffab80b53f0 0x7ffab80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:24.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.023+0000 7ffad1ca3640 1 --2- 172.21.15.59:0/4050609818 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffab80b53f0 0x7ffab80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:24.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.023+0000 7ffac2ffd640 1 -- 172.21.15.59:0/4050609818 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ffabc0e5690 con 0x7ffacc1076a0 2024-09-10T21:14:24.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.023+0000 7ffad1ca3640 1 --2- 172.21.15.59:0/4050609818 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffab80b53f0 0x7ffab80b78b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffac8000c00 tx=0x7ffac8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:24.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.026+0000 7ffac2ffd640 1 -- 172.21.15.59:0/4050609818 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffabc0ac3c0 con 0x7ffacc1076a0 2024-09-10T21:14:24.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.226+0000 7ffad3f07640 1 -- 172.21.15.59:0/4050609818 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffacc063590 con 0x7ffab80b53f0 2024-09-10T21:14:24.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.231+0000 7ffac2ffd640 1 -- 172.21.15.59:0/4050609818 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258744 (secure 0 0 0) 0x7ffacc063590 con 0x7ffab80b53f0 2024-09-10T21:14:24.272 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:14:24.273 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-10T21:14:24.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.234+0000 7ffad3f07640 1 -- 172.21.15.59:0/4050609818 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffab80b53f0 msgr2=0x7ffab80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:24.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.234+0000 7ffad3f07640 1 --2- 172.21.15.59:0/4050609818 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffab80b53f0 0x7ffab80b78b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffac8000c00 tx=0x7ffac8031400 comp rx=0 tx=0).stop 2024-09-10T21:14:24.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.234+0000 7ffad3f07640 1 -- 172.21.15.59:0/4050609818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffacc1076a0 msgr2=0x7ffacc0fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:24.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.234+0000 7ffad3f07640 1 --2- 172.21.15.59:0/4050609818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffacc1076a0 0x7ffacc0fe140 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00b4a0 tx=0x7ffabc00b960 comp rx=0 tx=0).stop 2024-09-10T21:14:24.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.234+0000 7ffad3f07640 1 -- 172.21.15.59:0/4050609818 shutdown_connections 2024-09-10T21:14:24.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.234+0000 7ffad3f07640 1 --2- 172.21.15.59:0/4050609818 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffab80b53f0 0x7ffab80b78b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:24.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.234+0000 7ffad3f07640 1 --2- 172.21.15.59:0/4050609818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffacc108020 0x7ffacc0fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:24.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.234+0000 7ffad3f07640 1 --2- 172.21.15.59:0/4050609818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffacc1076a0 0x7ffacc0fe140 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:24.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.234+0000 7ffad3f07640 1 --2- 172.21.15.59:0/4050609818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc101c90 0x7ffacc0fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:24.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.234+0000 7ffad3f07640 1 -- 172.21.15.59:0/4050609818 >> 172.21.15.59:0/4050609818 conn(0x7ffacc0fd700 msgr2=0x7ffacc06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:24.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.234+0000 7ffad3f07640 1 -- 172.21.15.59:0/4050609818 shutdown_connections 2024-09-10T21:14:24.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:24.234+0000 7ffad3f07640 1 -- 172.21.15.59:0/4050609818 wait complete. 2024-09-10T21:14:24.587 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:24 smithi059 ceph-mon[30888]: pgmap v314: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:14:24.587 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:24 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:24.587 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:24 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:24.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:24 smithi154 ceph-mon[35041]: pgmap v314: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:14:24.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:24 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:24.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:24 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:24.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:24 smithi192 ceph-mon[35363]: pgmap v314: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:14:24.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:24 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:24.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:24 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:24.907 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-09-10T21:14:23.241221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657177,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":617,"num_read_kb":403,"num_write":366,"num_write_kb":2284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2951840,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301,"ondisk_log_size":301,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365212,"kb_used_data":11724,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576612,"statfs":{"total":1151940427776,"available":1151566450688,"internally_reserved":0,"allocated":12005376,"data_stored":6683439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003407"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306392+0000","last_change":"2024-09-10T21:13:18.656166+0000","last_active":"2024-09-10T21:14:06.306392+0000","last_peered":"2024-09-10T21:14:06.306392+0000","last_clean":"2024-09-10T21:14:06.306392+0000","last_became_active":"2024-09-10T21:13:18.655774+0000","last_became_peered":"2024-09-10T21:13:18.655774+0000","last_unstale":"2024-09-10T21:14:06.306392+0000","last_undegraded":"2024-09-10T21:14:06.306392+0000","last_fullsized":"2024-09-10T21:14:06.306392+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:57.775209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433147+0000","last_change":"2024-09-10T21:13:18.654232+0000","last_active":"2024-09-10T21:14:06.433147+0000","last_peered":"2024-09-10T21:14:06.433147+0000","last_clean":"2024-09-10T21:14:06.433147+0000","last_became_active":"2024-09-10T21:13:18.653928+0000","last_became_peered":"2024-09-10T21:13:18.653928+0000","last_unstale":"2024-09-10T21:14:06.433147+0000","last_undegraded":"2024-09-10T21:14:06.433147+0000","last_fullsized":"2024-09-10T21:14:06.433147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:02.615686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433201+0000","last_change":"2024-09-10T21:13:18.662923+0000","last_active":"2024-09-10T21:14:06.433201+0000","last_peered":"2024-09-10T21:14:06.433201+0000","last_clean":"2024-09-10T21:14:06.433201+0000","last_became_active":"2024-09-10T21:13:18.662541+0000","last_became_peered":"2024-09-10T21:13:18.662541+0000","last_unstale":"2024-09-10T21:14:06.433201+0000","last_undegraded":"2024-09-10T21:14:06.433201+0000","last_fullsized":"2024-09-10T21:14:06.433201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:33:11.140761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.311665+0000","last_change":"2024-09-10T21:14:06.311161+0000","last_active":"2024-09-10T21:14:06.311665+0000","last_peered":"2024-09-10T21:14:06.311665+0000","last_clean":"2024-09-10T21:14:06.311665+0000","last_became_active":"2024-09-10T21:14:06.310829+0000","last_became_peered":"2024-09-10T21:14:06.310829+0000","last_unstale":"2024-09-10T21:14:06.311665+0000","last_undegraded":"2024-09-10T21:14:06.311665+0000","last_fullsized":"2024-09-10T21:14:06.311665+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:17.318129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308330+0000","last_change":"2024-09-10T21:13:18.650427+0000","last_active":"2024-09-10T21:14:06.308330+0000","last_peered":"2024-09-10T21:14:06.308330+0000","last_clean":"2024-09-10T21:14:06.308330+0000","last_became_active":"2024-09-10T21:13:18.650039+0000","last_became_peered":"2024-09-10T21:13:18.650039+0000","last_unstale":"2024-09-10T21:14:06.308330+0000","last_undegraded":"2024-09-10T21:14:06.308330+0000","last_fullsized":"2024-09-10T21:14:06.308330+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:11.363642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306730+0000","last_change":"2024-09-10T21:13:18.654320+0000","last_active":"2024-09-10T21:14:06.306730+0000","last_peered":"2024-09-10T21:14:06.306730+0000","last_clean":"2024-09-10T21:14:06.306730+0000","last_became_active":"2024-09-10T21:13:18.653291+0000","last_became_peered":"2024-09-10T21:13:18.653291+0000","last_unstale":"2024-09-10T21:14:06.306730+0000","last_undegraded":"2024-09-10T21:14:06.306730+0000","last_fullsized":"2024-09-10T21:14:06.306730+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:08:28.176816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312600+0000","last_change":"2024-09-10T21:13:18.659695+0000","last_active":"2024-09-10T21:14:06.312600+0000","last_peered":"2024-09-10T21:14:06.312600+0000","last_clean":"2024-09-10T21:14:06.312600+0000","last_became_active":"2024-09-10T21:13:18.659240+0000","last_became_peered":"2024-09-10T21:13:18.659240+0000","last_unstale":"2024-09-10T21:14:06.312600+0000","last_undegraded":"2024-09-10T21:14:06.312600+0000","last_fullsized":"2024-09-10T21:14:06.312600+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:58.951873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.435593+0000","last_change":"2024-09-10T21:14:06.435134+0000","last_active":"2024-09-10T21:14:06.435593+0000","last_peered":"2024-09-10T21:14:06.435593+0000","last_clean":"2024-09-10T21:14:06.435593+0000","last_became_active":"2024-09-10T21:14:06.434801+0000","last_became_peered":"2024-09-10T21:14:06.434801+0000","last_unstale":"2024-09-10T21:14:06.435593+0000","last_undegraded":"2024-09-10T21:14:06.435593+0000","last_fullsized":"2024-09-10T21:14:06.435593+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:01.473083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.310042+0000","last_change":"2024-09-10T21:13:18.656252+0000","last_active":"2024-09-10T21:14:06.310042+0000","last_peered":"2024-09-10T21:14:06.310042+0000","last_clean":"2024-09-10T21:14:06.310042+0000","last_became_active":"2024-09-10T21:13:18.655879+0000","last_became_peered":"2024-09-10T21:13:18.655879+0000","last_unstale":"2024-09-10T21:14:06.310042+0000","last_undegraded":"2024-09-10T21:14:06.310042+0000","last_fullsized":"2024-09-10T21:14:06.310042+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:03.748183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.307406+0000","last_change":"2024-09-10T21:13:18.663370+0000","last_active":"2024-09-10T21:14:06.307406+0000","last_peered":"2024-09-10T21:14:06.307406+0000","last_clean":"2024-09-10T21:14:06.307406+0000","last_became_active":"2024-09-10T21:13:18.662863+0000","last_became_peered":"2024-09-10T21:13:18.662863+0000","last_unstale":"2024-09-10T21:14:06.307406+0000","last_undegraded":"2024-09-10T21:14:06.307406+0000","last_fullsized":"2024-09-10T21:14:06.307406+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:22.912596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.313000+0000","last_change":"2024-09-10T21:13:18.663626+0000","last_active":"2024-09-10T21:14:06.313000+0000","last_peered":"2024-09-10T21:14:06.313000+0000","last_clean":"2024-09-10T21:14:06.313000+0000","last_became_active":"2024-09-10T21:13:18.663280+0000","last_became_peered":"2024-09-10T21:13:18.663280+0000","last_unstale":"2024-09-10T21:14:06.313000+0000","last_undegraded":"2024-09-10T21:14:06.313000+0000","last_fullsized":"2024-09-10T21:14:06.313000+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:07.874387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433273+0000","last_change":"2024-09-10T21:13:18.660791+0000","last_active":"2024-09-10T21:14:06.433273+0000","last_peered":"2024-09-10T21:14:06.433273+0000","last_clean":"2024-09-10T21:14:06.433273+0000","last_became_active":"2024-09-10T21:13:18.660386+0000","last_became_peered":"2024-09-10T21:13:18.660386+0000","last_unstale":"2024-09-10T21:14:06.433273+0000","last_undegraded":"2024-09-10T21:14:06.433273+0000","last_fullsized":"2024-09-10T21:14:06.433273+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:37.218822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.434094+0000","last_change":"2024-09-10T21:13:18.655893+0000","last_active":"2024-09-10T21:14:06.434094+0000","last_peered":"2024-09-10T21:14:06.434094+0000","last_clean":"2024-09-10T21:14:06.434094+0000","last_became_active":"2024-09-10T21:13:18.655524+0000","last_became_peered":"2024-09-10T21:13:18.655524+0000","last_unstale":"2024-09-10T21:14:06.434094+0000","last_undegraded":"2024-09-10T21:14:06.434094+0000","last_fullsized":"2024-09-10T21:14:06.434094+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:29.734783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.432842+0000","last_change":"2024-09-10T21:13:18.654359+0000","last_active":"2024-09-10T21:14:06.432842+0000","last_peered":"2024-09-10T21:14:06.432842+0000","last_clean":"2024-09-10T21:14:06.432842+0000","last_became_active":"2024-09-10T21:13:18.653983+0000","last_became_peered":"2024-09-10T21:13:18.653983+0000","last_unstale":"2024-09-10T21:14:06.432842+0000","last_undegraded":"2024-09-10T21:14:06.432842+0000","last_fullsized":"2024-09-10T21:14:06.432842+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:48.806836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.432735+0000","last_change":"2024-09-10T21:13:18.650428+0000","last_active":"2024-09-10T21:14:06.432735+0000","last_peered":"2024-09-10T21:14:06.432735+0000","last_clean":"2024-09-10T21:14:06.432735+0000","last_became_active":"2024-09-10T21:13:18.650121+0000","last_became_peered":"2024-09-10T21:13:18.650121+0000","last_unstale":"2024-09-10T21:14:06.432735+0000","last_undegraded":"2024-09-10T21:14:06.432735+0000","last_fullsized":"2024-09-10T21:14:06.432735+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:15.121916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309536+0000","last_change":"2024-09-10T21:13:18.662321+0000","last_active":"2024-09-10T21:14:06.309536+0000","last_peered":"2024-09-10T21:14:06.309536+0000","last_clean":"2024-09-10T21:14:06.309536+0000","last_became_active":"2024-09-10T21:13:18.662013+0000","last_became_peered":"2024-09-10T21:13:18.662013+0000","last_unstale":"2024-09-10T21:14:06.309536+0000","last_undegraded":"2024-09-10T21:14:06.309536+0000","last_fullsized":"2024-09-10T21:14:06.309536+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:54.303375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306309+0000","last_change":"2024-09-10T21:13:18.662549+0000","last_active":"2024-09-10T21:14:06.306309+0000","last_peered":"2024-09-10T21:14:06.306309+0000","last_clean":"2024-09-10T21:14:06.306309+0000","last_became_active":"2024-09-10T21:13:18.662230+0000","last_became_peered":"2024-09-10T21:13:18.662230+0000","last_unstale":"2024-09-10T21:14:06.306309+0000","last_undegraded":"2024-09-10T21:14:06.306309+0000","last_fullsized":"2024-09-10T21:14:06.306309+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:02.582355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306018+0000","last_change":"2024-09-10T21:13:18.654906+0000","last_active":"2024-09-10T21:14:06.306018+0000","last_peered":"2024-09-10T21:14:06.306018+0000","last_clean":"2024-09-10T21:14:06.306018+0000","last_became_active":"2024-09-10T21:13:18.654599+0000","last_became_peered":"2024-09-10T21:13:18.654599+0000","last_unstale":"2024-09-10T21:14:06.306018+0000","last_undegraded":"2024-09-10T21:14:06.306018+0000","last_fullsized":"2024-09-10T21:14:06.306018+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:34.987893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.310293+0000","last_change":"2024-09-10T21:13:18.643997+0000","last_active":"2024-09-10T21:14:06.310293+0000","last_peered":"2024-09-10T21:14:06.310293+0000","last_clean":"2024-09-10T21:14:06.310293+0000","last_became_active":"2024-09-10T21:13:18.643632+0000","last_became_peered":"2024-09-10T21:13:18.643632+0000","last_unstale":"2024-09-10T21:14:06.310293+0000","last_undegraded":"2024-09-10T21:14:06.310293+0000","last_fullsized":"2024-09-10T21:14:06.310293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:31.234040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.305975+0000","last_change":"2024-09-10T21:13:18.657079+0000","last_active":"2024-09-10T21:14:06.305975+0000","last_peered":"2024-09-10T21:14:06.305975+0000","last_clean":"2024-09-10T21:14:06.305975+0000","last_became_active":"2024-09-10T21:13:18.656741+0000","last_became_peered":"2024-09-10T21:13:18.656741+0000","last_unstale":"2024-09-10T21:14:06.305975+0000","last_undegraded":"2024-09-10T21:14:06.305975+0000","last_fullsized":"2024-09-10T21:14:06.305975+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:27.036783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.434190+0000","last_change":"2024-09-10T21:13:18.653076+0000","last_active":"2024-09-10T21:14:06.434190+0000","last_peered":"2024-09-10T21:14:06.434190+0000","last_clean":"2024-09-10T21:14:06.434190+0000","last_became_active":"2024-09-10T21:13:18.652722+0000","last_became_peered":"2024-09-10T21:13:18.652722+0000","last_unstale":"2024-09-10T21:14:06.434190+0000","last_undegraded":"2024-09-10T21:14:06.434190+0000","last_fullsized":"2024-09-10T21:14:06.434190+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:11.005632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309660+0000","last_change":"2024-09-10T21:13:18.663340+0000","last_active":"2024-09-10T21:14:06.309660+0000","last_peered":"2024-09-10T21:14:06.309660+0000","last_clean":"2024-09-10T21:14:06.309660+0000","last_became_active":"2024-09-10T21:13:18.662981+0000","last_became_peered":"2024-09-10T21:13:18.662981+0000","last_unstale":"2024-09-10T21:14:06.309660+0000","last_undegraded":"2024-09-10T21:14:06.309660+0000","last_fullsized":"2024-09-10T21:14:06.309660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:39.510625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.307979+0000","last_change":"2024-09-10T21:13:18.651376+0000","last_active":"2024-09-10T21:14:06.307979+0000","last_peered":"2024-09-10T21:14:06.307979+0000","last_clean":"2024-09-10T21:14:06.307979+0000","last_became_active":"2024-09-10T21:13:18.650999+0000","last_became_peered":"2024-09-10T21:13:18.650999+0000","last_unstale":"2024-09-10T21:14:06.307979+0000","last_undegraded":"2024-09-10T21:14:06.307979+0000","last_fullsized":"2024-09-10T21:14:06.307979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:12.268120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433378+0000","last_change":"2024-09-10T21:13:18.648634+0000","last_active":"2024-09-10T21:14:06.433378+0000","last_peered":"2024-09-10T21:14:06.433378+0000","last_clean":"2024-09-10T21:14:06.433378+0000","last_became_active":"2024-09-10T21:13:18.648099+0000","last_became_peered":"2024-09-10T21:13:18.648099+0000","last_unstale":"2024-09-10T21:14:06.433378+0000","last_undegraded":"2024-09-10T21:14:06.433378+0000","last_fullsized":"2024-09-10T21:14:06.433378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:47.570132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308404+0000","last_change":"2024-09-10T21:13:18.660188+0000","last_active":"2024-09-10T21:14:06.308404+0000","last_peered":"2024-09-10T21:14:06.308404+0000","last_clean":"2024-09-10T21:14:06.308404+0000","last_became_active":"2024-09-10T21:13:18.659821+0000","last_became_peered":"2024-09-10T21:13:18.659821+0000","last_unstale":"2024-09-10T21:14:06.308404+0000","last_undegraded":"2024-09-10T21:14:06.308404+0000","last_fullsized":"2024-09-10T21:14:06.308404+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:36.456852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.310055+0000","last_change":"2024-09-10T21:13:18.656727+0000","last_active":"2024-09-10T21:14:06.310055+0000","last_peered":"2024-09-10T21:14:06.310055+0000","last_clean":"2024-09-10T21:14:06.310055+0000","last_became_active":"2024-09-10T21:13:18.654627+0000","last_became_peered":"2024-09-10T21:13:18.654627+0000","last_unstale":"2024-09-10T21:14:06.310055+0000","last_undegraded":"2024-09-10T21:14:06.310055+0000","last_fullsized":"2024-09-10T21:14:06.310055+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:42.838893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306319+0000","last_change":"2024-09-10T21:13:18.660113+0000","last_active":"2024-09-10T21:14:06.306319+0000","last_peered":"2024-09-10T21:14:06.306319+0000","last_clean":"2024-09-10T21:14:06.306319+0000","last_became_active":"2024-09-10T21:13:18.659668+0000","last_became_peered":"2024-09-10T21:13:18.659668+0000","last_unstale":"2024-09-10T21:14:06.306319+0000","last_undegraded":"2024-09-10T21:14:06.306319+0000","last_fullsized":"2024-09-10T21:14:06.306319+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:43.733431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433883+0000","last_change":"2024-09-10T21:13:18.648015+0000","last_active":"2024-09-10T21:14:06.433883+0000","last_peered":"2024-09-10T21:14:06.433883+0000","last_clean":"2024-09-10T21:14:06.433883+0000","last_became_active":"2024-09-10T21:13:18.647661+0000","last_became_peered":"2024-09-10T21:13:18.647661+0000","last_unstale":"2024-09-10T21:14:06.433883+0000","last_undegraded":"2024-09-10T21:14:06.433883+0000","last_fullsized":"2024-09-10T21:14:06.433883+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:22.543217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433670+0000","last_change":"2024-09-10T21:13:18.657728+0000","last_active":"2024-09-10T21:14:06.433670+0000","last_peered":"2024-09-10T21:14:06.433670+0000","last_clean":"2024-09-10T21:14:06.433670+0000","last_became_active":"2024-09-10T21:13:18.657372+0000","last_became_peered":"2024-09-10T21:13:18.657372+0000","last_unstale":"2024-09-10T21:14:06.433670+0000","last_undegraded":"2024-09-10T21:14:06.433670+0000","last_fullsized":"2024-09-10T21:14:06.433670+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:43.621668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.310054+0000","last_change":"2024-09-10T21:13:18.648380+0000","last_active":"2024-09-10T21:14:06.310054+0000","last_peered":"2024-09-10T21:14:06.310054+0000","last_clean":"2024-09-10T21:14:06.310054+0000","last_became_active":"2024-09-10T21:13:18.647871+0000","last_became_peered":"2024-09-10T21:13:18.647871+0000","last_unstale":"2024-09-10T21:14:06.310054+0000","last_undegraded":"2024-09-10T21:14:06.310054+0000","last_fullsized":"2024-09-10T21:14:06.310054+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:16.374911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309443+0000","last_change":"2024-09-10T21:13:18.654843+0000","last_active":"2024-09-10T21:14:06.309443+0000","last_peered":"2024-09-10T21:14:06.309443+0000","last_clean":"2024-09-10T21:14:06.309443+0000","last_became_active":"2024-09-10T21:13:18.654211+0000","last_became_peered":"2024-09-10T21:13:18.654211+0000","last_unstale":"2024-09-10T21:14:06.309443+0000","last_undegraded":"2024-09-10T21:14:06.309443+0000","last_fullsized":"2024-09-10T21:14:06.309443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:28.490792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.305911+0000","last_change":"2024-09-10T21:13:18.659603+0000","last_active":"2024-09-10T21:14:06.305911+0000","last_peered":"2024-09-10T21:14:06.305911+0000","last_clean":"2024-09-10T21:14:06.305911+0000","last_became_active":"2024-09-10T21:13:18.659257+0000","last_became_peered":"2024-09-10T21:13:18.659257+0000","last_unstale":"2024-09-10T21:14:06.305911+0000","last_undegraded":"2024-09-10T21:14:06.305911+0000","last_fullsized":"2024-09-10T21:14:06.305911+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:26.249109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308571+0000","last_change":"2024-09-10T21:13:18.649354+0000","last_active":"2024-09-10T21:14:06.308571+0000","last_peered":"2024-09-10T21:14:06.308571+0000","last_clean":"2024-09-10T21:14:06.308571+0000","last_became_active":"2024-09-10T21:13:18.649029+0000","last_became_peered":"2024-09-10T21:13:18.649029+0000","last_unstale":"2024-09-10T21:14:06.308571+0000","last_undegraded":"2024-09-10T21:14:06.308571+0000","last_fullsized":"2024-09-10T21:14:06.308571+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:06.946983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'6","reported_seq":84,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:21.026493+0000","last_change":"2024-09-10T21:13:16.631197+0000","last_active":"2024-09-10T21:14:21.026493+0000","last_peered":"2024-09-10T21:14:21.026493+0000","last_clean":"2024-09-10T21:14:21.026493+0000","last_became_active":"2024-09-10T21:13:16.630877+0000","last_became_peered":"2024-09-10T21:13:16.630877+0000","last_unstale":"2024-09-10T21:14:21.026493+0000","last_undegraded":"2024-09-10T21:14:21.026493+0000","last_fullsized":"2024-09-10T21:14:21.026493+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:50.117425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433434+0000","last_change":"2024-09-10T21:13:18.654124+0000","last_active":"2024-09-10T21:14:06.433434+0000","last_peered":"2024-09-10T21:14:06.433434+0000","last_clean":"2024-09-10T21:14:06.433434+0000","last_became_active":"2024-09-10T21:13:18.653757+0000","last_became_peered":"2024-09-10T21:13:18.653757+0000","last_unstale":"2024-09-10T21:14:06.433434+0000","last_undegraded":"2024-09-10T21:14:06.433434+0000","last_fullsized":"2024-09-10T21:14:06.433434+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:25.174272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306892+0000","last_change":"2024-09-10T21:13:16.631526+0000","last_active":"2024-09-10T21:14:06.306892+0000","last_peered":"2024-09-10T21:14:06.306892+0000","last_clean":"2024-09-10T21:14:06.306892+0000","last_became_active":"2024-09-10T21:13:16.631194+0000","last_became_peered":"2024-09-10T21:13:16.631194+0000","last_unstale":"2024-09-10T21:14:06.306892+0000","last_undegraded":"2024-09-10T21:14:06.306892+0000","last_fullsized":"2024-09-10T21:14:06.306892+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:31:35.036874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433190+0000","last_change":"2024-09-10T21:13:16.624906+0000","last_active":"2024-09-10T21:14:06.433190+0000","last_peered":"2024-09-10T21:14:06.433190+0000","last_clean":"2024-09-10T21:14:06.433190+0000","last_became_active":"2024-09-10T21:13:16.624376+0000","last_became_peered":"2024-09-10T21:13:16.624376+0000","last_unstale":"2024-09-10T21:14:06.433190+0000","last_undegraded":"2024-09-10T21:14:06.433190+0000","last_fullsized":"2024-09-10T21:14:06.433190+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:20.942651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.307943+0000","last_change":"2024-09-10T21:13:18.646987+0000","last_active":"2024-09-10T21:14:06.307943+0000","last_peered":"2024-09-10T21:14:06.307943+0000","last_clean":"2024-09-10T21:14:06.307943+0000","last_became_active":"2024-09-10T21:13:18.646690+0000","last_became_peered":"2024-09-10T21:13:18.646690+0000","last_unstale":"2024-09-10T21:14:06.307943+0000","last_undegraded":"2024-09-10T21:14:06.307943+0000","last_fullsized":"2024-09-10T21:14:06.307943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:47:02.132164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433699+0000","last_change":"2024-09-10T21:13:16.633082+0000","last_active":"2024-09-10T21:14:06.433699+0000","last_peered":"2024-09-10T21:14:06.433699+0000","last_clean":"2024-09-10T21:14:06.433699+0000","last_became_active":"2024-09-10T21:13:16.632707+0000","last_became_peered":"2024-09-10T21:13:16.632707+0000","last_unstale":"2024-09-10T21:14:06.433699+0000","last_undegraded":"2024-09-10T21:14:06.433699+0000","last_fullsized":"2024-09-10T21:14:06.433699+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:53:56.611072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.305527+0000","last_change":"2024-09-10T21:13:18.663309+0000","last_active":"2024-09-10T21:14:06.305527+0000","last_peered":"2024-09-10T21:14:06.305527+0000","last_clean":"2024-09-10T21:14:06.305527+0000","last_became_active":"2024-09-10T21:13:18.662990+0000","last_became_peered":"2024-09-10T21:13:18.662990+0000","last_unstale":"2024-09-10T21:14:06.305527+0000","last_undegraded":"2024-09-10T21:14:06.305527+0000","last_fullsized":"2024-09-10T21:14:06.305527+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:18.014441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'4","reported_seq":127,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:20.024230+0000","last_change":"2024-09-10T21:13:16.633012+0000","last_active":"2024-09-10T21:14:20.024230+0000","last_peered":"2024-09-10T21:14:20.024230+0000","last_clean":"2024-09-10T21:14:20.024230+0000","last_became_active":"2024-09-10T21:13:16.632622+0000","last_became_peered":"2024-09-10T21:13:16.632622+0000","last_unstale":"2024-09-10T21:14:20.024230+0000","last_undegraded":"2024-09-10T21:14:20.024230+0000","last_fullsized":"2024-09-10T21:14:20.024230+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:16.859255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309944+0000","last_change":"2024-09-10T21:13:18.658015+0000","last_active":"2024-09-10T21:14:06.309944+0000","last_peered":"2024-09-10T21:14:06.309944+0000","last_clean":"2024-09-10T21:14:06.309944+0000","last_became_active":"2024-09-10T21:13:18.656922+0000","last_became_peered":"2024-09-10T21:13:18.656922+0000","last_unstale":"2024-09-10T21:14:06.309944+0000","last_undegraded":"2024-09-10T21:14:06.309944+0000","last_fullsized":"2024-09-10T21:14:06.309944+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:24.038131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.313021+0000","last_change":"2024-09-10T21:13:16.631771+0000","last_active":"2024-09-10T21:14:06.313021+0000","last_peered":"2024-09-10T21:14:06.313021+0000","last_clean":"2024-09-10T21:14:06.313021+0000","last_became_active":"2024-09-10T21:13:16.631477+0000","last_became_peered":"2024-09-10T21:13:16.631477+0000","last_unstale":"2024-09-10T21:14:06.313021+0000","last_undegraded":"2024-09-10T21:14:06.313021+0000","last_fullsized":"2024-09-10T21:14:06.313021+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:16.644046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433593+0000","last_change":"2024-09-10T21:13:18.658119+0000","last_active":"2024-09-10T21:14:06.433593+0000","last_peered":"2024-09-10T21:14:06.433593+0000","last_clean":"2024-09-10T21:14:06.433593+0000","last_became_active":"2024-09-10T21:13:18.657339+0000","last_became_peered":"2024-09-10T21:13:18.657339+0000","last_unstale":"2024-09-10T21:14:06.433593+0000","last_undegraded":"2024-09-10T21:14:06.433593+0000","last_fullsized":"2024-09-10T21:14:06.433593+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:45.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433347+0000","last_change":"2024-09-10T21:13:16.727019+0000","last_active":"2024-09-10T21:14:06.433347+0000","last_peered":"2024-09-10T21:14:06.433347+0000","last_clean":"2024-09-10T21:14:06.433347+0000","last_became_active":"2024-09-10T21:13:16.726667+0000","last_became_peered":"2024-09-10T21:13:16.726667+0000","last_unstale":"2024-09-10T21:14:06.433347+0000","last_undegraded":"2024-09-10T21:14:06.433347+0000","last_fullsized":"2024-09-10T21:14:06.433347+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:57.551149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.434300+0000","last_change":"2024-09-10T21:14:06.434206+0000","last_active":"2024-09-10T21:14:06.434300+0000","last_peered":"2024-09-10T21:14:06.434300+0000","last_clean":"2024-09-10T21:14:06.434300+0000","last_became_active":"2024-09-10T21:14:06.433779+0000","last_became_peered":"2024-09-10T21:14:06.433779+0000","last_unstale":"2024-09-10T21:14:06.434300+0000","last_undegraded":"2024-09-10T21:14:06.434300+0000","last_fullsized":"2024-09-10T21:14:06.434300+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:24.590286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'30","reported_seq":161,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:20.024229+0000","last_change":"2024-09-10T21:13:16.631820+0000","last_active":"2024-09-10T21:14:20.024229+0000","last_peered":"2024-09-10T21:14:20.024229+0000","last_clean":"2024-09-10T21:14:20.024229+0000","last_became_active":"2024-09-10T21:13:16.631432+0000","last_became_peered":"2024-09-10T21:13:16.631432+0000","last_unstale":"2024-09-10T21:14:20.024229+0000","last_undegraded":"2024-09-10T21:14:20.024229+0000","last_fullsized":"2024-09-10T21:14:20.024229+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:47.972871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59762,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":108,"num_read_kb":112,"num_write":32,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309219+0000","last_change":"2024-09-10T21:13:18.653147+0000","last_active":"2024-09-10T21:14:06.309219+0000","last_peered":"2024-09-10T21:14:06.309219+0000","last_clean":"2024-09-10T21:14:06.309219+0000","last_became_active":"2024-09-10T21:13:18.652846+0000","last_became_peered":"2024-09-10T21:13:18.652846+0000","last_unstale":"2024-09-10T21:14:06.309219+0000","last_undegraded":"2024-09-10T21:14:06.309219+0000","last_fullsized":"2024-09-10T21:14:06.309219+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:59.007192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309628+0000","last_change":"2024-09-10T21:13:16.631994+0000","last_active":"2024-09-10T21:14:06.309628+0000","last_peered":"2024-09-10T21:14:06.309628+0000","last_clean":"2024-09-10T21:14:06.309628+0000","last_became_active":"2024-09-10T21:13:16.631665+0000","last_became_peered":"2024-09-10T21:13:16.631665+0000","last_unstale":"2024-09-10T21:14:06.309628+0000","last_undegraded":"2024-09-10T21:14:06.309628+0000","last_fullsized":"2024-09-10T21:14:06.309628+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:05.537172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433331+0000","last_change":"2024-09-10T21:13:18.657463+0000","last_active":"2024-09-10T21:14:06.433331+0000","last_peered":"2024-09-10T21:14:06.433331+0000","last_clean":"2024-09-10T21:14:06.433331+0000","last_became_active":"2024-09-10T21:13:18.657146+0000","last_became_peered":"2024-09-10T21:13:18.657146+0000","last_unstale":"2024-09-10T21:14:06.433331+0000","last_undegraded":"2024-09-10T21:14:06.433331+0000","last_fullsized":"2024-09-10T21:14:06.433331+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:42.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433206+0000","last_change":"2024-09-10T21:13:16.630419+0000","last_active":"2024-09-10T21:14:06.433206+0000","last_peered":"2024-09-10T21:14:06.433206+0000","last_clean":"2024-09-10T21:14:06.433206+0000","last_became_active":"2024-09-10T21:13:16.630053+0000","last_became_peered":"2024-09-10T21:13:16.630053+0000","last_unstale":"2024-09-10T21:14:06.433206+0000","last_undegraded":"2024-09-10T21:14:06.433206+0000","last_fullsized":"2024-09-10T21:14:06.433206+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:08.090931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312872+0000","last_change":"2024-09-10T21:13:18.657585+0000","last_active":"2024-09-10T21:14:06.312872+0000","last_peered":"2024-09-10T21:14:06.312872+0000","last_clean":"2024-09-10T21:14:06.312872+0000","last_became_active":"2024-09-10T21:13:18.657280+0000","last_became_peered":"2024-09-10T21:13:18.657280+0000","last_unstale":"2024-09-10T21:14:06.312872+0000","last_undegraded":"2024-09-10T21:14:06.312872+0000","last_fullsized":"2024-09-10T21:14:06.312872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:46:34.252882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'5","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:20.024602+0000","last_change":"2024-09-10T21:13:16.629700+0000","last_active":"2024-09-10T21:14:20.024602+0000","last_peered":"2024-09-10T21:14:20.024602+0000","last_clean":"2024-09-10T21:14:20.024602+0000","last_became_active":"2024-09-10T21:13:16.629282+0000","last_became_peered":"2024-09-10T21:13:16.629282+0000","last_unstale":"2024-09-10T21:14:20.024602+0000","last_undegraded":"2024-09-10T21:14:20.024602+0000","last_fullsized":"2024-09-10T21:14:20.024602+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:42.572643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312516+0000","last_change":"2024-09-10T21:13:18.664535+0000","last_active":"2024-09-10T21:14:06.312516+0000","last_peered":"2024-09-10T21:14:06.312516+0000","last_clean":"2024-09-10T21:14:06.312516+0000","last_became_active":"2024-09-10T21:13:18.663997+0000","last_became_peered":"2024-09-10T21:13:18.663997+0000","last_unstale":"2024-09-10T21:14:06.312516+0000","last_undegraded":"2024-09-10T21:14:06.312516+0000","last_fullsized":"2024-09-10T21:14:06.312516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:30.365106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308443+0000","last_change":"2024-09-10T21:13:16.727096+0000","last_active":"2024-09-10T21:14:06.308443+0000","last_peered":"2024-09-10T21:14:06.308443+0000","last_clean":"2024-09-10T21:14:06.308443+0000","last_became_active":"2024-09-10T21:13:16.726408+0000","last_became_peered":"2024-09-10T21:13:16.726408+0000","last_unstale":"2024-09-10T21:14:06.308443+0000","last_undegraded":"2024-09-10T21:14:06.308443+0000","last_fullsized":"2024-09-10T21:14:06.308443+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:30.581238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433159+0000","last_change":"2024-09-10T21:13:18.657397+0000","last_active":"2024-09-10T21:14:06.433159+0000","last_peered":"2024-09-10T21:14:06.433159+0000","last_clean":"2024-09-10T21:14:06.433159+0000","last_became_active":"2024-09-10T21:13:18.657050+0000","last_became_peered":"2024-09-10T21:13:18.657050+0000","last_unstale":"2024-09-10T21:14:06.433159+0000","last_undegraded":"2024-09-10T21:14:06.433159+0000","last_fullsized":"2024-09-10T21:14:06.433159+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:09.739544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.310361+0000","last_change":"2024-09-10T21:13:16.633716+0000","last_active":"2024-09-10T21:14:06.310361+0000","last_peered":"2024-09-10T21:14:06.310361+0000","last_clean":"2024-09-10T21:14:06.310361+0000","last_became_active":"2024-09-10T21:13:16.633225+0000","last_became_peered":"2024-09-10T21:13:16.633225+0000","last_unstale":"2024-09-10T21:14:06.310361+0000","last_undegraded":"2024-09-10T21:14:06.310361+0000","last_fullsized":"2024-09-10T21:14:06.310361+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:48.807549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306189+0000","last_change":"2024-09-10T21:13:18.663129+0000","last_active":"2024-09-10T21:14:06.306189+0000","last_peered":"2024-09-10T21:14:06.306189+0000","last_clean":"2024-09-10T21:14:06.306189+0000","last_became_active":"2024-09-10T21:13:18.662694+0000","last_became_peered":"2024-09-10T21:13:18.662694+0000","last_unstale":"2024-09-10T21:14:06.306189+0000","last_undegraded":"2024-09-10T21:14:06.306189+0000","last_fullsized":"2024-09-10T21:14:06.306189+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:24.633468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433973+0000","last_change":"2024-09-10T21:13:16.628733+0000","last_active":"2024-09-10T21:14:06.433973+0000","last_peered":"2024-09-10T21:14:06.433973+0000","last_clean":"2024-09-10T21:14:06.433973+0000","last_became_active":"2024-09-10T21:13:16.628419+0000","last_became_peered":"2024-09-10T21:13:16.628419+0000","last_unstale":"2024-09-10T21:14:06.433973+0000","last_undegraded":"2024-09-10T21:14:06.433973+0000","last_fullsized":"2024-09-10T21:14:06.433973+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:31.264739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.313051+0000","last_change":"2024-09-10T21:13:18.656571+0000","last_active":"2024-09-10T21:14:06.313051+0000","last_peered":"2024-09-10T21:14:06.313051+0000","last_clean":"2024-09-10T21:14:06.313051+0000","last_became_active":"2024-09-10T21:13:18.656253+0000","last_became_peered":"2024-09-10T21:13:18.656253+0000","last_unstale":"2024-09-10T21:14:06.313051+0000","last_undegraded":"2024-09-10T21:14:06.313051+0000","last_fullsized":"2024-09-10T21:14:06.313051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:57.848566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433543+0000","last_change":"2024-09-10T21:13:16.631750+0000","last_active":"2024-09-10T21:14:06.433543+0000","last_peered":"2024-09-10T21:14:06.433543+0000","last_clean":"2024-09-10T21:14:06.433543+0000","last_became_active":"2024-09-10T21:13:16.631245+0000","last_became_peered":"2024-09-10T21:13:16.631245+0000","last_unstale":"2024-09-10T21:14:06.433543+0000","last_undegraded":"2024-09-10T21:14:06.433543+0000","last_fullsized":"2024-09-10T21:14:06.433543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:28.787751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312936+0000","last_change":"2024-09-10T21:13:18.660834+0000","last_active":"2024-09-10T21:14:06.312936+0000","last_peered":"2024-09-10T21:14:06.312936+0000","last_clean":"2024-09-10T21:14:06.312936+0000","last_became_active":"2024-09-10T21:13:18.660461+0000","last_became_peered":"2024-09-10T21:13:18.660461+0000","last_unstale":"2024-09-10T21:14:06.312936+0000","last_undegraded":"2024-09-10T21:14:06.312936+0000","last_fullsized":"2024-09-10T21:14:06.312936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:55.531199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'5","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:20.024802+0000","last_change":"2024-09-10T21:13:16.726824+0000","last_active":"2024-09-10T21:14:20.024802+0000","last_peered":"2024-09-10T21:14:20.024802+0000","last_clean":"2024-09-10T21:14:20.024802+0000","last_became_active":"2024-09-10T21:13:16.726436+0000","last_became_peered":"2024-09-10T21:13:16.726436+0000","last_unstale":"2024-09-10T21:14:20.024802+0000","last_undegraded":"2024-09-10T21:14:20.024802+0000","last_fullsized":"2024-09-10T21:14:20.024802+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:49.391388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.313093+0000","last_change":"2024-09-10T21:13:18.663725+0000","last_active":"2024-09-10T21:14:06.313093+0000","last_peered":"2024-09-10T21:14:06.313093+0000","last_clean":"2024-09-10T21:14:06.313093+0000","last_became_active":"2024-09-10T21:13:18.663254+0000","last_became_peered":"2024-09-10T21:13:18.663254+0000","last_unstale":"2024-09-10T21:14:06.313093+0000","last_undegraded":"2024-09-10T21:14:06.313093+0000","last_fullsized":"2024-09-10T21:14:06.313093+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:19.672231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312700+0000","last_change":"2024-09-10T21:12:08.173849+0000","last_active":"2024-09-10T21:14:06.312700+0000","last_peered":"2024-09-10T21:14:06.312700+0000","last_clean":"2024-09-10T21:14:06.312700+0000","last_became_active":"2024-09-10T21:12:08.153630+0000","last_became_peered":"2024-09-10T21:12:08.153630+0000","last_unstale":"2024-09-10T21:14:06.312700+0000","last_undegraded":"2024-09-10T21:14:06.312700+0000","last_fullsized":"2024-09-10T21:14:06.312700+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:08:47.842259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:08:47.842259+0000","last_clean_scrub_stamp":"2024-09-10T21:08:47.842259+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:39.166390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433413+0000","last_change":"2024-09-10T21:13:16.628607+0000","last_active":"2024-09-10T21:14:06.433413+0000","last_peered":"2024-09-10T21:14:06.433413+0000","last_clean":"2024-09-10T21:14:06.433413+0000","last_became_active":"2024-09-10T21:13:16.627736+0000","last_became_peered":"2024-09-10T21:13:16.627736+0000","last_unstale":"2024-09-10T21:14:06.433413+0000","last_undegraded":"2024-09-10T21:14:06.433413+0000","last_fullsized":"2024-09-10T21:14:06.433413+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:16.388832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308245+0000","last_change":"2024-09-10T21:13:18.652634+0000","last_active":"2024-09-10T21:14:06.308245+0000","last_peered":"2024-09-10T21:14:06.308245+0000","last_clean":"2024-09-10T21:14:06.308245+0000","last_became_active":"2024-09-10T21:13:18.652325+0000","last_became_peered":"2024-09-10T21:13:18.652325+0000","last_unstale":"2024-09-10T21:14:06.308245+0000","last_undegraded":"2024-09-10T21:14:06.308245+0000","last_fullsized":"2024-09-10T21:14:06.308245+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:16.382355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312642+0000","last_change":"2024-09-10T21:13:16.631442+0000","last_active":"2024-09-10T21:14:06.312642+0000","last_peered":"2024-09-10T21:14:06.312642+0000","last_clean":"2024-09-10T21:14:06.312642+0000","last_became_active":"2024-09-10T21:13:16.631117+0000","last_became_peered":"2024-09-10T21:13:16.631117+0000","last_unstale":"2024-09-10T21:14:06.312642+0000","last_undegraded":"2024-09-10T21:14:06.312642+0000","last_fullsized":"2024-09-10T21:14:06.312642+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:35.376888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433132+0000","last_change":"2024-09-10T21:13:18.644246+0000","last_active":"2024-09-10T21:14:06.433132+0000","last_peered":"2024-09-10T21:14:06.433132+0000","last_clean":"2024-09-10T21:14:06.433132+0000","last_became_active":"2024-09-10T21:13:18.643944+0000","last_became_peered":"2024-09-10T21:13:18.643944+0000","last_unstale":"2024-09-10T21:14:06.433132+0000","last_undegraded":"2024-09-10T21:14:06.433132+0000","last_fullsized":"2024-09-10T21:14:06.433132+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:18.856149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":77,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:17.020053+0000","last_change":"2024-09-10T21:13:16.726716+0000","last_active":"2024-09-10T21:14:17.020053+0000","last_peered":"2024-09-10T21:14:17.020053+0000","last_clean":"2024-09-10T21:14:17.020053+0000","last_became_active":"2024-09-10T21:13:16.726400+0000","last_became_peered":"2024-09-10T21:13:16.726400+0000","last_unstale":"2024-09-10T21:14:17.020053+0000","last_undegraded":"2024-09-10T21:14:17.020053+0000","last_fullsized":"2024-09-10T21:14:17.020053+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:55.643495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.435386+0000","last_change":"2024-09-10T21:14:06.433990+0000","last_active":"2024-09-10T21:14:06.435386+0000","last_peered":"2024-09-10T21:14:06.435386+0000","last_clean":"2024-09-10T21:14:06.435386+0000","last_became_active":"2024-09-10T21:14:06.433489+0000","last_became_peered":"2024-09-10T21:14:06.433489+0000","last_unstale":"2024-09-10T21:14:06.435386+0000","last_undegraded":"2024-09-10T21:14:06.435386+0000","last_fullsized":"2024-09-10T21:14:06.435386+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:28.001658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"73'5","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:21.025679+0000","last_change":"2024-09-10T21:13:16.633126+0000","last_active":"2024-09-10T21:14:21.025679+0000","last_peered":"2024-09-10T21:14:21.025679+0000","last_clean":"2024-09-10T21:14:21.025679+0000","last_became_active":"2024-09-10T21:13:16.632808+0000","last_became_peered":"2024-09-10T21:13:16.632808+0000","last_unstale":"2024-09-10T21:14:21.025679+0000","last_undegraded":"2024-09-10T21:14:21.025679+0000","last_fullsized":"2024-09-10T21:14:21.025679+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:01.026506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306894+0000","last_change":"2024-09-10T21:13:18.652631+0000","last_active":"2024-09-10T21:14:06.306894+0000","last_peered":"2024-09-10T21:14:06.306894+0000","last_clean":"2024-09-10T21:14:06.306894+0000","last_became_active":"2024-09-10T21:13:18.650580+0000","last_became_peered":"2024-09-10T21:13:18.650580+0000","last_unstale":"2024-09-10T21:14:06.306894+0000","last_undegraded":"2024-09-10T21:14:06.306894+0000","last_fullsized":"2024-09-10T21:14:06.306894+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:32.733169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.305817+0000","last_change":"2024-09-10T21:13:16.728172+0000","last_active":"2024-09-10T21:14:06.305817+0000","last_peered":"2024-09-10T21:14:06.305817+0000","last_clean":"2024-09-10T21:14:06.305817+0000","last_became_active":"2024-09-10T21:13:16.727793+0000","last_became_peered":"2024-09-10T21:13:16.727793+0000","last_unstale":"2024-09-10T21:14:06.305817+0000","last_undegraded":"2024-09-10T21:14:06.305817+0000","last_fullsized":"2024-09-10T21:14:06.305817+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:58:04.301119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.307027+0000","last_change":"2024-09-10T21:13:18.655371+0000","last_active":"2024-09-10T21:14:06.307027+0000","last_peered":"2024-09-10T21:14:06.307027+0000","last_clean":"2024-09-10T21:14:06.307027+0000","last_became_active":"2024-09-10T21:13:18.653250+0000","last_became_peered":"2024-09-10T21:13:18.653250+0000","last_unstale":"2024-09-10T21:14:06.307027+0000","last_undegraded":"2024-09-10T21:14:06.307027+0000","last_fullsized":"2024-09-10T21:14:06.307027+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:25.650736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309415+0000","last_change":"2024-09-10T21:13:16.726816+0000","last_active":"2024-09-10T21:14:06.309415+0000","last_peered":"2024-09-10T21:14:06.309415+0000","last_clean":"2024-09-10T21:14:06.309415+0000","last_became_active":"2024-09-10T21:13:16.726438+0000","last_became_peered":"2024-09-10T21:13:16.726438+0000","last_unstale":"2024-09-10T21:14:06.309415+0000","last_undegraded":"2024-09-10T21:14:06.309415+0000","last_fullsized":"2024-09-10T21:14:06.309415+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:46.384899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433915+0000","last_change":"2024-09-10T21:13:18.643424+0000","last_active":"2024-09-10T21:14:06.433915+0000","last_peered":"2024-09-10T21:14:06.433915+0000","last_clean":"2024-09-10T21:14:06.433915+0000","last_became_active":"2024-09-10T21:13:18.643010+0000","last_became_peered":"2024-09-10T21:13:18.643010+0000","last_unstale":"2024-09-10T21:14:06.433915+0000","last_undegraded":"2024-09-10T21:14:06.433915+0000","last_fullsized":"2024-09-10T21:14:06.433915+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:47.358129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'14","reported_seq":54,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.316429+0000","last_change":"2024-09-10T21:14:06.316327+0000","last_active":"2024-09-10T21:14:06.316429+0000","last_peered":"2024-09-10T21:14:06.316429+0000","last_clean":"2024-09-10T21:14:06.316429+0000","last_became_active":"2024-09-10T21:14:06.309000+0000","last_became_peered":"2024-09-10T21:14:06.309000+0000","last_unstale":"2024-09-10T21:14:06.316429+0000","last_undegraded":"2024-09-10T21:14:06.316429+0000","last_fullsized":"2024-09-10T21:14:06.316429+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:13.582411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308498+0000","last_change":"2024-09-10T21:13:18.652347+0000","last_active":"2024-09-10T21:14:06.308498+0000","last_peered":"2024-09-10T21:14:06.308498+0000","last_clean":"2024-09-10T21:14:06.308498+0000","last_became_active":"2024-09-10T21:13:18.651942+0000","last_became_peered":"2024-09-10T21:13:18.651942+0000","last_unstale":"2024-09-10T21:14:06.308498+0000","last_undegraded":"2024-09-10T21:14:06.308498+0000","last_fullsized":"2024-09-10T21:14:06.308498+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:11.356787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433490+0000","last_change":"2024-09-10T21:13:16.621647+0000","last_active":"2024-09-10T21:14:06.433490+0000","last_peered":"2024-09-10T21:14:06.433490+0000","last_clean":"2024-09-10T21:14:06.433490+0000","last_became_active":"2024-09-10T21:13:16.621316+0000","last_became_peered":"2024-09-10T21:13:16.621316+0000","last_unstale":"2024-09-10T21:14:06.433490+0000","last_undegraded":"2024-09-10T21:14:06.433490+0000","last_fullsized":"2024-09-10T21:14:06.433490+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:10.264578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433433+0000","last_change":"2024-09-10T21:13:18.656617+0000","last_active":"2024-09-10T21:14:06.433433+0000","last_peered":"2024-09-10T21:14:06.433433+0000","last_clean":"2024-09-10T21:14:06.433433+0000","last_became_active":"2024-09-10T21:13:18.656331+0000","last_became_peered":"2024-09-10T21:13:18.656331+0000","last_unstale":"2024-09-10T21:14:06.433433+0000","last_undegraded":"2024-09-10T21:14:06.433433+0000","last_fullsized":"2024-09-10T21:14:06.433433+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:44.482797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309648+0000","last_change":"2024-09-10T21:13:16.727736+0000","last_active":"2024-09-10T21:14:06.309648+0000","last_peered":"2024-09-10T21:14:06.309648+0000","last_clean":"2024-09-10T21:14:06.309648+0000","last_became_active":"2024-09-10T21:13:16.727413+0000","last_became_peered":"2024-09-10T21:13:16.727413+0000","last_unstale":"2024-09-10T21:14:06.309648+0000","last_undegraded":"2024-09-10T21:14:06.309648+0000","last_fullsized":"2024-09-10T21:14:06.309648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:26.351729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308390+0000","last_change":"2024-09-10T21:13:18.660100+0000","last_active":"2024-09-10T21:14:06.308390+0000","last_peered":"2024-09-10T21:14:06.308390+0000","last_clean":"2024-09-10T21:14:06.308390+0000","last_became_active":"2024-09-10T21:13:18.659733+0000","last_became_peered":"2024-09-10T21:13:18.659733+0000","last_unstale":"2024-09-10T21:14:06.308390+0000","last_undegraded":"2024-09-10T21:14:06.308390+0000","last_fullsized":"2024-09-10T21:14:06.308390+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:44.371627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308097+0000","last_change":"2024-09-10T21:13:16.627194+0000","last_active":"2024-09-10T21:14:06.308097+0000","last_peered":"2024-09-10T21:14:06.308097+0000","last_clean":"2024-09-10T21:14:06.308097+0000","last_became_active":"2024-09-10T21:13:16.626805+0000","last_became_peered":"2024-09-10T21:13:16.626805+0000","last_unstale":"2024-09-10T21:14:06.308097+0000","last_undegraded":"2024-09-10T21:14:06.308097+0000","last_fullsized":"2024-09-10T21:14:06.308097+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:33.582084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306066+0000","last_change":"2024-09-10T21:13:18.663122+0000","last_active":"2024-09-10T21:14:06.306066+0000","last_peered":"2024-09-10T21:14:06.306066+0000","last_clean":"2024-09-10T21:14:06.306066+0000","last_became_active":"2024-09-10T21:13:18.662673+0000","last_became_peered":"2024-09-10T21:13:18.662673+0000","last_unstale":"2024-09-10T21:14:06.306066+0000","last_undegraded":"2024-09-10T21:14:06.306066+0000","last_fullsized":"2024-09-10T21:14:06.306066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:15.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.320090+0000","last_change":"2024-09-10T21:14:06.319645+0000","last_active":"2024-09-10T21:14:06.320090+0000","last_peered":"2024-09-10T21:14:06.320090+0000","last_clean":"2024-09-10T21:14:06.320090+0000","last_became_active":"2024-09-10T21:14:06.311394+0000","last_became_peered":"2024-09-10T21:14:06.311394+0000","last_unstale":"2024-09-10T21:14:06.320090+0000","last_undegraded":"2024-09-10T21:14:06.320090+0000","last_fullsized":"2024-09-10T21:14:06.320090+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:26:20.925331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308195+0000","last_change":"2024-09-10T21:13:18.656400+0000","last_active":"2024-09-10T21:14:06.308195+0000","last_peered":"2024-09-10T21:14:06.308195+0000","last_clean":"2024-09-10T21:14:06.308195+0000","last_became_active":"2024-09-10T21:13:18.655802+0000","last_became_peered":"2024-09-10T21:13:18.655802+0000","last_unstale":"2024-09-10T21:14:06.308195+0000","last_undegraded":"2024-09-10T21:14:06.308195+0000","last_fullsized":"2024-09-10T21:14:06.308195+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:41.901404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.438924+0000","last_change":"2024-09-10T21:14:06.438851+0000","last_active":"2024-09-10T21:14:06.438924+0000","last_peered":"2024-09-10T21:14:06.438924+0000","last_clean":"2024-09-10T21:14:06.438924+0000","last_became_active":"2024-09-10T21:14:06.434291+0000","last_became_peered":"2024-09-10T21:14:06.434291+0000","last_unstale":"2024-09-10T21:14:06.438924+0000","last_undegraded":"2024-09-10T21:14:06.438924+0000","last_fullsized":"2024-09-10T21:14:06.438924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:43.895028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312707+0000","last_change":"2024-09-10T21:13:18.664331+0000","last_active":"2024-09-10T21:14:06.312707+0000","last_peered":"2024-09-10T21:14:06.312707+0000","last_clean":"2024-09-10T21:14:06.312707+0000","last_became_active":"2024-09-10T21:13:18.663823+0000","last_became_peered":"2024-09-10T21:13:18.663823+0000","last_unstale":"2024-09-10T21:14:06.312707+0000","last_undegraded":"2024-09-10T21:14:06.312707+0000","last_fullsized":"2024-09-10T21:14:06.312707+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:37.626712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433509+0000","last_change":"2024-09-10T21:13:18.659941+0000","last_active":"2024-09-10T21:14:06.433509+0000","last_peered":"2024-09-10T21:14:06.433509+0000","last_clean":"2024-09-10T21:14:06.433509+0000","last_became_active":"2024-09-10T21:13:18.659019+0000","last_became_peered":"2024-09-10T21:13:18.659019+0000","last_unstale":"2024-09-10T21:14:06.433509+0000","last_undegraded":"2024-09-10T21:14:06.433509+0000","last_fullsized":"2024-09-10T21:14:06.433509+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:41.037722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309893+0000","last_change":"2024-09-10T21:13:16.633660+0000","last_active":"2024-09-10T21:14:06.309893+0000","last_peered":"2024-09-10T21:14:06.309893+0000","last_clean":"2024-09-10T21:14:06.309893+0000","last_became_active":"2024-09-10T21:13:16.633222+0000","last_became_peered":"2024-09-10T21:13:16.633222+0000","last_unstale":"2024-09-10T21:14:06.309893+0000","last_undegraded":"2024-09-10T21:14:06.309893+0000","last_fullsized":"2024-09-10T21:14:06.309893+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:56.364355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309639+0000","last_change":"2024-09-10T21:13:18.666837+0000","last_active":"2024-09-10T21:14:06.309639+0000","last_peered":"2024-09-10T21:14:06.309639+0000","last_clean":"2024-09-10T21:14:06.309639+0000","last_became_active":"2024-09-10T21:13:18.666382+0000","last_became_peered":"2024-09-10T21:13:18.666382+0000","last_unstale":"2024-09-10T21:14:06.309639+0000","last_undegraded":"2024-09-10T21:14:06.309639+0000","last_fullsized":"2024-09-10T21:14:06.309639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:32.225130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309304+0000","last_change":"2024-09-10T21:13:16.631424+0000","last_active":"2024-09-10T21:14:06.309304+0000","last_peered":"2024-09-10T21:14:06.309304+0000","last_clean":"2024-09-10T21:14:06.309304+0000","last_became_active":"2024-09-10T21:13:16.631116+0000","last_became_peered":"2024-09-10T21:13:16.631116+0000","last_unstale":"2024-09-10T21:14:06.309304+0000","last_undegraded":"2024-09-10T21:14:06.309304+0000","last_fullsized":"2024-09-10T21:14:06.309304+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:15.506410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433552+0000","last_change":"2024-09-10T21:13:18.654978+0000","last_active":"2024-09-10T21:14:06.433552+0000","last_peered":"2024-09-10T21:14:06.433552+0000","last_clean":"2024-09-10T21:14:06.433552+0000","last_became_active":"2024-09-10T21:13:18.654581+0000","last_became_peered":"2024-09-10T21:13:18.654581+0000","last_unstale":"2024-09-10T21:14:06.433552+0000","last_undegraded":"2024-09-10T21:14:06.433552+0000","last_fullsized":"2024-09-10T21:14:06.433552+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:17.504626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308544+0000","last_change":"2024-09-10T21:13:16.726727+0000","last_active":"2024-09-10T21:14:06.308544+0000","last_peered":"2024-09-10T21:14:06.308544+0000","last_clean":"2024-09-10T21:14:06.308544+0000","last_became_active":"2024-09-10T21:13:16.726373+0000","last_became_peered":"2024-09-10T21:13:16.726373+0000","last_unstale":"2024-09-10T21:14:06.308544+0000","last_undegraded":"2024-09-10T21:14:06.308544+0000","last_fullsized":"2024-09-10T21:14:06.308544+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:31.803631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308420+0000","last_change":"2024-09-10T21:13:18.648384+0000","last_active":"2024-09-10T21:14:06.308420+0000","last_peered":"2024-09-10T21:14:06.308420+0000","last_clean":"2024-09-10T21:14:06.308420+0000","last_became_active":"2024-09-10T21:13:18.647911+0000","last_became_peered":"2024-09-10T21:13:18.647911+0000","last_unstale":"2024-09-10T21:14:06.308420+0000","last_undegraded":"2024-09-10T21:14:06.308420+0000","last_fullsized":"2024-09-10T21:14:06.308420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:02.582548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:17.019568+0000","last_change":"2024-09-10T21:13:16.631501+0000","last_active":"2024-09-10T21:14:17.019568+0000","last_peered":"2024-09-10T21:14:17.019568+0000","last_clean":"2024-09-10T21:14:17.019568+0000","last_became_active":"2024-09-10T21:13:16.631246+0000","last_became_peered":"2024-09-10T21:13:16.631246+0000","last_unstale":"2024-09-10T21:14:17.019568+0000","last_undegraded":"2024-09-10T21:14:17.019568+0000","last_fullsized":"2024-09-10T21:14:17.019568+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:25.277370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66575,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":541,"num_read_kb":339,"num_write":241,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":199725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808858,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":815104,"data_stored":393851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005086,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1515520,"data_stored":1044642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135907,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":839680,"data_stored":393781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332137,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":835584,"data_stored":394159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528366,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28432,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716720,"statfs":{"total":95995035648,"available":95965921280,"internally_reserved":0,"allocated":1433600,"data_stored":986677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659186,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":823296,"data_stored":393498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855416,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28440,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716712,"statfs":{"total":95995035648,"available":95965913088,"internally_reserved":0,"allocated":1445888,"data_stored":986355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018940,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":393359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":393323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":905216,"data_stored":454784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":884736,"data_stored":454173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":843776,"data_stored":394837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:14:24.912 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T21:14:25.167 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:25.566 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:25 smithi059 ceph-mon[30888]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:14:25.567 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:25 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:14:25.567 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:25 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:14:25.567 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:25 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:25.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.644+0000 7fcfb3281640 1 -- 172.21.15.59:0/2244297980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfac108060 msgr2=0x7fcfac10e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:25.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.644+0000 7fcfb3281640 1 --2- 172.21.15.59:0/2244297980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfac108060 0x7fcfac10e860 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009ca0 tx=0x7fcfa402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:14:25.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.644+0000 7fcfb3281640 1 -- 172.21.15.59:0/2244297980 shutdown_connections 2024-09-10T21:14:25.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.644+0000 7fcfb3281640 1 --2- 172.21.15.59:0/2244297980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfac108060 0x7fcfac10e860 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:25.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.644+0000 7fcfb3281640 1 --2- 172.21.15.59:0/2244297980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfac1076e0 0x7fcfac107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:25.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.644+0000 7fcfb3281640 1 --2- 172.21.15.59:0/2244297980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfac101cd0 0x7fcfac1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:25.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.644+0000 7fcfb3281640 1 -- 172.21.15.59:0/2244297980 >> 172.21.15.59:0/2244297980 conn(0x7fcfac0fd700 msgr2=0x7fcfac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:25.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.644+0000 7fcfb3281640 1 -- 172.21.15.59:0/2244297980 shutdown_connections 2024-09-10T21:14:25.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.644+0000 7fcfb3281640 1 -- 172.21.15.59:0/2244297980 wait complete. 2024-09-10T21:14:25.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.645+0000 7fcfb3281640 1 Processor -- start 2024-09-10T21:14:25.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.645+0000 7fcfb3281640 1 -- start start 2024-09-10T21:14:25.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.645+0000 7fcfb3281640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfac101cd0 0x7fcfac199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:25.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.645+0000 7fcfb3281640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfac1076e0 0x7fcfac1998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:25.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.645+0000 7fcfb3281640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfac108060 0x7fcfac19ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:25.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.645+0000 7fcfb3281640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcfac111ce0 con 0x7fcfac108060 2024-09-10T21:14:25.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.645+0000 7fcfb3281640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcfac111b60 con 0x7fcfac1076e0 2024-09-10T21:14:25.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.645+0000 7fcfb3281640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcfac111e60 con 0x7fcfac101cd0 2024-09-10T21:14:25.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.645+0000 7fcfb181e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfac108060 0x7fcfac19ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:25.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.645+0000 7fcfb181e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfac108060 0x7fcfac19ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58004/0 (socket says 172.21.15.59:58004) 2024-09-10T21:14:25.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.645+0000 7fcfb181e640 1 -- 172.21.15.59:0/1436188392 learned_addr learned my addr 172.21.15.59:0/1436188392 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:25.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.645+0000 7fcfb081c640 1 --2- 172.21.15.59:0/1436188392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfac1076e0 0x7fcfac1998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:25.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.645+0000 7fcfb101d640 1 --2- 172.21.15.59:0/1436188392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfac101cd0 0x7fcfac199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:25.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.645+0000 7fcfb181e640 1 -- 172.21.15.59:0/1436188392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfac101cd0 msgr2=0x7fcfac199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:25.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.645+0000 7fcfb181e640 1 --2- 172.21.15.59:0/1436188392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfac101cd0 0x7fcfac199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:25.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.645+0000 7fcfb181e640 1 -- 172.21.15.59:0/1436188392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfac1076e0 msgr2=0x7fcfac1998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:25.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.645+0000 7fcfb181e640 1 --2- 172.21.15.59:0/1436188392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfac1076e0 0x7fcfac1998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:25.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.645+0000 7fcfb181e640 1 -- 172.21.15.59:0/1436188392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfac19f410 con 0x7fcfac108060 2024-09-10T21:14:25.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.645+0000 7fcfb181e640 1 --2- 172.21.15.59:0/1436188392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfac108060 0x7fcfac19ec40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4005cc0 tx=0x7fcfa402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:25.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.646+0000 7fcfa27fc640 1 -- 172.21.15.59:0/1436188392 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4003bf0 con 0x7fcfac108060 2024-09-10T21:14:25.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.646+0000 7fcfa27fc640 1 -- 172.21.15.59:0/1436188392 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfa4003d90 con 0x7fcfac108060 2024-09-10T21:14:25.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.646+0000 7fcfb3281640 1 -- 172.21.15.59:0/1436188392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfac19f6a0 con 0x7fcfac108060 2024-09-10T21:14:25.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.646+0000 7fcfa27fc640 1 -- 172.21.15.59:0/1436188392 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa402fbc0 con 0x7fcfac108060 2024-09-10T21:14:25.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.646+0000 7fcfb3281640 1 -- 172.21.15.59:0/1436188392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfac1a5dc0 con 0x7fcfac108060 2024-09-10T21:14:25.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.647+0000 7fcfb3281640 1 -- 172.21.15.59:0/1436188392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfac1020b0 con 0x7fcfac108060 2024-09-10T21:14:25.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.648+0000 7fcfa27fc640 1 -- 172.21.15.59:0/1436188392 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fcfa4004610 con 0x7fcfac108060 2024-09-10T21:14:25.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.649+0000 7fcfa27fc640 1 --2- 172.21.15.59:0/1436188392 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcf980b53f0 0x7fcf980b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:25.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.649+0000 7fcfb101d640 1 --2- 172.21.15.59:0/1436188392 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcf980b53f0 0x7fcf980b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:25.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.649+0000 7fcfa27fc640 1 -- 172.21.15.59:0/1436188392 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcfa4107460 con 0x7fcfac108060 2024-09-10T21:14:25.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.649+0000 7fcfb101d640 1 --2- 172.21.15.59:0/1436188392 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcf980b53f0 0x7fcf980b78b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80058c0 tx=0x7fcfa800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:25.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.652+0000 7fcfa27fc640 1 -- 172.21.15.59:0/1436188392 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcfa40ce190 con 0x7fcfac108060 2024-09-10T21:14:25.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:25 smithi154 ceph-mon[35041]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:14:25.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:25 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:14:25.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:25 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:14:25.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:25 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:25.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:25 smithi192 ceph-mon[35363]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:14:25.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:25 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:14:25.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:25 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:14:25.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:25 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:14:25.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.836+0000 7fcfb3281640 1 -- 172.21.15.59:0/1436188392 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcfac10aeb0 con 0x7fcf980b53f0 2024-09-10T21:14:25.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.840+0000 7fcfa27fc640 1 -- 172.21.15.59:0/1436188392 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258744 (secure 0 0 0) 0x7fcfac10aeb0 con 0x7fcf980b53f0 2024-09-10T21:14:25.847 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:14:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-10T21:14:25.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.843+0000 7fcfb3281640 1 -- 172.21.15.59:0/1436188392 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcf980b53f0 msgr2=0x7fcf980b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:25.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.843+0000 7fcfb3281640 1 --2- 172.21.15.59:0/1436188392 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcf980b53f0 0x7fcf980b78b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80058c0 tx=0x7fcfa800a4c0 comp rx=0 tx=0).stop 2024-09-10T21:14:25.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.843+0000 7fcfb3281640 1 -- 172.21.15.59:0/1436188392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfac108060 msgr2=0x7fcfac19ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:25.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.843+0000 7fcfb3281640 1 --2- 172.21.15.59:0/1436188392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfac108060 0x7fcfac19ec40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4005cc0 tx=0x7fcfa402f380 comp rx=0 tx=0).stop 2024-09-10T21:14:25.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.843+0000 7fcfb3281640 1 -- 172.21.15.59:0/1436188392 shutdown_connections 2024-09-10T21:14:25.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.843+0000 7fcfb3281640 1 --2- 172.21.15.59:0/1436188392 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcf980b53f0 0x7fcf980b78b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:25.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.843+0000 7fcfb3281640 1 --2- 172.21.15.59:0/1436188392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfac108060 0x7fcfac19ec40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:25.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.843+0000 7fcfb3281640 1 --2- 172.21.15.59:0/1436188392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfac1076e0 0x7fcfac1998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:25.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.843+0000 7fcfb3281640 1 --2- 172.21.15.59:0/1436188392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfac101cd0 0x7fcfac199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:25.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.843+0000 7fcfb3281640 1 -- 172.21.15.59:0/1436188392 >> 172.21.15.59:0/1436188392 conn(0x7fcfac0fd700 msgr2=0x7fcfac06b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:25.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.843+0000 7fcfb3281640 1 -- 172.21.15.59:0/1436188392 shutdown_connections 2024-09-10T21:14:25.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:25.843+0000 7fcfb3281640 1 -- 172.21.15.59:0/1436188392 wait complete. 2024-09-10T21:14:26.517 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2024-09-10T21:14:25.241797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657177,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":627,"num_read_kb":413,"num_write":366,"num_write_kb":2284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2951840,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301,"ondisk_log_size":301,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365212,"kb_used_data":11724,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576612,"statfs":{"total":1151940427776,"available":1151566450688,"internally_reserved":0,"allocated":12005376,"data_stored":6683439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":361674042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":60,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003581"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306392+0000","last_change":"2024-09-10T21:13:18.656166+0000","last_active":"2024-09-10T21:14:06.306392+0000","last_peered":"2024-09-10T21:14:06.306392+0000","last_clean":"2024-09-10T21:14:06.306392+0000","last_became_active":"2024-09-10T21:13:18.655774+0000","last_became_peered":"2024-09-10T21:13:18.655774+0000","last_unstale":"2024-09-10T21:14:06.306392+0000","last_undegraded":"2024-09-10T21:14:06.306392+0000","last_fullsized":"2024-09-10T21:14:06.306392+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:57.775209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433147+0000","last_change":"2024-09-10T21:13:18.654232+0000","last_active":"2024-09-10T21:14:06.433147+0000","last_peered":"2024-09-10T21:14:06.433147+0000","last_clean":"2024-09-10T21:14:06.433147+0000","last_became_active":"2024-09-10T21:13:18.653928+0000","last_became_peered":"2024-09-10T21:13:18.653928+0000","last_unstale":"2024-09-10T21:14:06.433147+0000","last_undegraded":"2024-09-10T21:14:06.433147+0000","last_fullsized":"2024-09-10T21:14:06.433147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:02.615686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433201+0000","last_change":"2024-09-10T21:13:18.662923+0000","last_active":"2024-09-10T21:14:06.433201+0000","last_peered":"2024-09-10T21:14:06.433201+0000","last_clean":"2024-09-10T21:14:06.433201+0000","last_became_active":"2024-09-10T21:13:18.662541+0000","last_became_peered":"2024-09-10T21:13:18.662541+0000","last_unstale":"2024-09-10T21:14:06.433201+0000","last_undegraded":"2024-09-10T21:14:06.433201+0000","last_fullsized":"2024-09-10T21:14:06.433201+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:33:11.140761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.311665+0000","last_change":"2024-09-10T21:14:06.311161+0000","last_active":"2024-09-10T21:14:06.311665+0000","last_peered":"2024-09-10T21:14:06.311665+0000","last_clean":"2024-09-10T21:14:06.311665+0000","last_became_active":"2024-09-10T21:14:06.310829+0000","last_became_peered":"2024-09-10T21:14:06.310829+0000","last_unstale":"2024-09-10T21:14:06.311665+0000","last_undegraded":"2024-09-10T21:14:06.311665+0000","last_fullsized":"2024-09-10T21:14:06.311665+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:17.318129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308330+0000","last_change":"2024-09-10T21:13:18.650427+0000","last_active":"2024-09-10T21:14:06.308330+0000","last_peered":"2024-09-10T21:14:06.308330+0000","last_clean":"2024-09-10T21:14:06.308330+0000","last_became_active":"2024-09-10T21:13:18.650039+0000","last_became_peered":"2024-09-10T21:13:18.650039+0000","last_unstale":"2024-09-10T21:14:06.308330+0000","last_undegraded":"2024-09-10T21:14:06.308330+0000","last_fullsized":"2024-09-10T21:14:06.308330+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:11.363642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306730+0000","last_change":"2024-09-10T21:13:18.654320+0000","last_active":"2024-09-10T21:14:06.306730+0000","last_peered":"2024-09-10T21:14:06.306730+0000","last_clean":"2024-09-10T21:14:06.306730+0000","last_became_active":"2024-09-10T21:13:18.653291+0000","last_became_peered":"2024-09-10T21:13:18.653291+0000","last_unstale":"2024-09-10T21:14:06.306730+0000","last_undegraded":"2024-09-10T21:14:06.306730+0000","last_fullsized":"2024-09-10T21:14:06.306730+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:08:28.176816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312600+0000","last_change":"2024-09-10T21:13:18.659695+0000","last_active":"2024-09-10T21:14:06.312600+0000","last_peered":"2024-09-10T21:14:06.312600+0000","last_clean":"2024-09-10T21:14:06.312600+0000","last_became_active":"2024-09-10T21:13:18.659240+0000","last_became_peered":"2024-09-10T21:13:18.659240+0000","last_unstale":"2024-09-10T21:14:06.312600+0000","last_undegraded":"2024-09-10T21:14:06.312600+0000","last_fullsized":"2024-09-10T21:14:06.312600+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:58.951873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.435593+0000","last_change":"2024-09-10T21:14:06.435134+0000","last_active":"2024-09-10T21:14:06.435593+0000","last_peered":"2024-09-10T21:14:06.435593+0000","last_clean":"2024-09-10T21:14:06.435593+0000","last_became_active":"2024-09-10T21:14:06.434801+0000","last_became_peered":"2024-09-10T21:14:06.434801+0000","last_unstale":"2024-09-10T21:14:06.435593+0000","last_undegraded":"2024-09-10T21:14:06.435593+0000","last_fullsized":"2024-09-10T21:14:06.435593+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:01.473083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.310042+0000","last_change":"2024-09-10T21:13:18.656252+0000","last_active":"2024-09-10T21:14:06.310042+0000","last_peered":"2024-09-10T21:14:06.310042+0000","last_clean":"2024-09-10T21:14:06.310042+0000","last_became_active":"2024-09-10T21:13:18.655879+0000","last_became_peered":"2024-09-10T21:13:18.655879+0000","last_unstale":"2024-09-10T21:14:06.310042+0000","last_undegraded":"2024-09-10T21:14:06.310042+0000","last_fullsized":"2024-09-10T21:14:06.310042+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:03.748183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.307406+0000","last_change":"2024-09-10T21:13:18.663370+0000","last_active":"2024-09-10T21:14:06.307406+0000","last_peered":"2024-09-10T21:14:06.307406+0000","last_clean":"2024-09-10T21:14:06.307406+0000","last_became_active":"2024-09-10T21:13:18.662863+0000","last_became_peered":"2024-09-10T21:13:18.662863+0000","last_unstale":"2024-09-10T21:14:06.307406+0000","last_undegraded":"2024-09-10T21:14:06.307406+0000","last_fullsized":"2024-09-10T21:14:06.307406+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:22.912596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.313000+0000","last_change":"2024-09-10T21:13:18.663626+0000","last_active":"2024-09-10T21:14:06.313000+0000","last_peered":"2024-09-10T21:14:06.313000+0000","last_clean":"2024-09-10T21:14:06.313000+0000","last_became_active":"2024-09-10T21:13:18.663280+0000","last_became_peered":"2024-09-10T21:13:18.663280+0000","last_unstale":"2024-09-10T21:14:06.313000+0000","last_undegraded":"2024-09-10T21:14:06.313000+0000","last_fullsized":"2024-09-10T21:14:06.313000+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:07.874387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433273+0000","last_change":"2024-09-10T21:13:18.660791+0000","last_active":"2024-09-10T21:14:06.433273+0000","last_peered":"2024-09-10T21:14:06.433273+0000","last_clean":"2024-09-10T21:14:06.433273+0000","last_became_active":"2024-09-10T21:13:18.660386+0000","last_became_peered":"2024-09-10T21:13:18.660386+0000","last_unstale":"2024-09-10T21:14:06.433273+0000","last_undegraded":"2024-09-10T21:14:06.433273+0000","last_fullsized":"2024-09-10T21:14:06.433273+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:37.218822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.434094+0000","last_change":"2024-09-10T21:13:18.655893+0000","last_active":"2024-09-10T21:14:06.434094+0000","last_peered":"2024-09-10T21:14:06.434094+0000","last_clean":"2024-09-10T21:14:06.434094+0000","last_became_active":"2024-09-10T21:13:18.655524+0000","last_became_peered":"2024-09-10T21:13:18.655524+0000","last_unstale":"2024-09-10T21:14:06.434094+0000","last_undegraded":"2024-09-10T21:14:06.434094+0000","last_fullsized":"2024-09-10T21:14:06.434094+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:29.734783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.432842+0000","last_change":"2024-09-10T21:13:18.654359+0000","last_active":"2024-09-10T21:14:06.432842+0000","last_peered":"2024-09-10T21:14:06.432842+0000","last_clean":"2024-09-10T21:14:06.432842+0000","last_became_active":"2024-09-10T21:13:18.653983+0000","last_became_peered":"2024-09-10T21:13:18.653983+0000","last_unstale":"2024-09-10T21:14:06.432842+0000","last_undegraded":"2024-09-10T21:14:06.432842+0000","last_fullsized":"2024-09-10T21:14:06.432842+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:48.806836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.432735+0000","last_change":"2024-09-10T21:13:18.650428+0000","last_active":"2024-09-10T21:14:06.432735+0000","last_peered":"2024-09-10T21:14:06.432735+0000","last_clean":"2024-09-10T21:14:06.432735+0000","last_became_active":"2024-09-10T21:13:18.650121+0000","last_became_peered":"2024-09-10T21:13:18.650121+0000","last_unstale":"2024-09-10T21:14:06.432735+0000","last_undegraded":"2024-09-10T21:14:06.432735+0000","last_fullsized":"2024-09-10T21:14:06.432735+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:15.121916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309536+0000","last_change":"2024-09-10T21:13:18.662321+0000","last_active":"2024-09-10T21:14:06.309536+0000","last_peered":"2024-09-10T21:14:06.309536+0000","last_clean":"2024-09-10T21:14:06.309536+0000","last_became_active":"2024-09-10T21:13:18.662013+0000","last_became_peered":"2024-09-10T21:13:18.662013+0000","last_unstale":"2024-09-10T21:14:06.309536+0000","last_undegraded":"2024-09-10T21:14:06.309536+0000","last_fullsized":"2024-09-10T21:14:06.309536+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:54.303375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306309+0000","last_change":"2024-09-10T21:13:18.662549+0000","last_active":"2024-09-10T21:14:06.306309+0000","last_peered":"2024-09-10T21:14:06.306309+0000","last_clean":"2024-09-10T21:14:06.306309+0000","last_became_active":"2024-09-10T21:13:18.662230+0000","last_became_peered":"2024-09-10T21:13:18.662230+0000","last_unstale":"2024-09-10T21:14:06.306309+0000","last_undegraded":"2024-09-10T21:14:06.306309+0000","last_fullsized":"2024-09-10T21:14:06.306309+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:02.582355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306018+0000","last_change":"2024-09-10T21:13:18.654906+0000","last_active":"2024-09-10T21:14:06.306018+0000","last_peered":"2024-09-10T21:14:06.306018+0000","last_clean":"2024-09-10T21:14:06.306018+0000","last_became_active":"2024-09-10T21:13:18.654599+0000","last_became_peered":"2024-09-10T21:13:18.654599+0000","last_unstale":"2024-09-10T21:14:06.306018+0000","last_undegraded":"2024-09-10T21:14:06.306018+0000","last_fullsized":"2024-09-10T21:14:06.306018+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:34.987893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.310293+0000","last_change":"2024-09-10T21:13:18.643997+0000","last_active":"2024-09-10T21:14:06.310293+0000","last_peered":"2024-09-10T21:14:06.310293+0000","last_clean":"2024-09-10T21:14:06.310293+0000","last_became_active":"2024-09-10T21:13:18.643632+0000","last_became_peered":"2024-09-10T21:13:18.643632+0000","last_unstale":"2024-09-10T21:14:06.310293+0000","last_undegraded":"2024-09-10T21:14:06.310293+0000","last_fullsized":"2024-09-10T21:14:06.310293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:31.234040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.305975+0000","last_change":"2024-09-10T21:13:18.657079+0000","last_active":"2024-09-10T21:14:06.305975+0000","last_peered":"2024-09-10T21:14:06.305975+0000","last_clean":"2024-09-10T21:14:06.305975+0000","last_became_active":"2024-09-10T21:13:18.656741+0000","last_became_peered":"2024-09-10T21:13:18.656741+0000","last_unstale":"2024-09-10T21:14:06.305975+0000","last_undegraded":"2024-09-10T21:14:06.305975+0000","last_fullsized":"2024-09-10T21:14:06.305975+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:27.036783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.434190+0000","last_change":"2024-09-10T21:13:18.653076+0000","last_active":"2024-09-10T21:14:06.434190+0000","last_peered":"2024-09-10T21:14:06.434190+0000","last_clean":"2024-09-10T21:14:06.434190+0000","last_became_active":"2024-09-10T21:13:18.652722+0000","last_became_peered":"2024-09-10T21:13:18.652722+0000","last_unstale":"2024-09-10T21:14:06.434190+0000","last_undegraded":"2024-09-10T21:14:06.434190+0000","last_fullsized":"2024-09-10T21:14:06.434190+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:11.005632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309660+0000","last_change":"2024-09-10T21:13:18.663340+0000","last_active":"2024-09-10T21:14:06.309660+0000","last_peered":"2024-09-10T21:14:06.309660+0000","last_clean":"2024-09-10T21:14:06.309660+0000","last_became_active":"2024-09-10T21:13:18.662981+0000","last_became_peered":"2024-09-10T21:13:18.662981+0000","last_unstale":"2024-09-10T21:14:06.309660+0000","last_undegraded":"2024-09-10T21:14:06.309660+0000","last_fullsized":"2024-09-10T21:14:06.309660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:39.510625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.307979+0000","last_change":"2024-09-10T21:13:18.651376+0000","last_active":"2024-09-10T21:14:06.307979+0000","last_peered":"2024-09-10T21:14:06.307979+0000","last_clean":"2024-09-10T21:14:06.307979+0000","last_became_active":"2024-09-10T21:13:18.650999+0000","last_became_peered":"2024-09-10T21:13:18.650999+0000","last_unstale":"2024-09-10T21:14:06.307979+0000","last_undegraded":"2024-09-10T21:14:06.307979+0000","last_fullsized":"2024-09-10T21:14:06.307979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:12.268120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433378+0000","last_change":"2024-09-10T21:13:18.648634+0000","last_active":"2024-09-10T21:14:06.433378+0000","last_peered":"2024-09-10T21:14:06.433378+0000","last_clean":"2024-09-10T21:14:06.433378+0000","last_became_active":"2024-09-10T21:13:18.648099+0000","last_became_peered":"2024-09-10T21:13:18.648099+0000","last_unstale":"2024-09-10T21:14:06.433378+0000","last_undegraded":"2024-09-10T21:14:06.433378+0000","last_fullsized":"2024-09-10T21:14:06.433378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:47.570132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308404+0000","last_change":"2024-09-10T21:13:18.660188+0000","last_active":"2024-09-10T21:14:06.308404+0000","last_peered":"2024-09-10T21:14:06.308404+0000","last_clean":"2024-09-10T21:14:06.308404+0000","last_became_active":"2024-09-10T21:13:18.659821+0000","last_became_peered":"2024-09-10T21:13:18.659821+0000","last_unstale":"2024-09-10T21:14:06.308404+0000","last_undegraded":"2024-09-10T21:14:06.308404+0000","last_fullsized":"2024-09-10T21:14:06.308404+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:36.456852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.310055+0000","last_change":"2024-09-10T21:13:18.656727+0000","last_active":"2024-09-10T21:14:06.310055+0000","last_peered":"2024-09-10T21:14:06.310055+0000","last_clean":"2024-09-10T21:14:06.310055+0000","last_became_active":"2024-09-10T21:13:18.654627+0000","last_became_peered":"2024-09-10T21:13:18.654627+0000","last_unstale":"2024-09-10T21:14:06.310055+0000","last_undegraded":"2024-09-10T21:14:06.310055+0000","last_fullsized":"2024-09-10T21:14:06.310055+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:42.838893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306319+0000","last_change":"2024-09-10T21:13:18.660113+0000","last_active":"2024-09-10T21:14:06.306319+0000","last_peered":"2024-09-10T21:14:06.306319+0000","last_clean":"2024-09-10T21:14:06.306319+0000","last_became_active":"2024-09-10T21:13:18.659668+0000","last_became_peered":"2024-09-10T21:13:18.659668+0000","last_unstale":"2024-09-10T21:14:06.306319+0000","last_undegraded":"2024-09-10T21:14:06.306319+0000","last_fullsized":"2024-09-10T21:14:06.306319+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:43.733431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433883+0000","last_change":"2024-09-10T21:13:18.648015+0000","last_active":"2024-09-10T21:14:06.433883+0000","last_peered":"2024-09-10T21:14:06.433883+0000","last_clean":"2024-09-10T21:14:06.433883+0000","last_became_active":"2024-09-10T21:13:18.647661+0000","last_became_peered":"2024-09-10T21:13:18.647661+0000","last_unstale":"2024-09-10T21:14:06.433883+0000","last_undegraded":"2024-09-10T21:14:06.433883+0000","last_fullsized":"2024-09-10T21:14:06.433883+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:22.543217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433670+0000","last_change":"2024-09-10T21:13:18.657728+0000","last_active":"2024-09-10T21:14:06.433670+0000","last_peered":"2024-09-10T21:14:06.433670+0000","last_clean":"2024-09-10T21:14:06.433670+0000","last_became_active":"2024-09-10T21:13:18.657372+0000","last_became_peered":"2024-09-10T21:13:18.657372+0000","last_unstale":"2024-09-10T21:14:06.433670+0000","last_undegraded":"2024-09-10T21:14:06.433670+0000","last_fullsized":"2024-09-10T21:14:06.433670+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:43.621668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.310054+0000","last_change":"2024-09-10T21:13:18.648380+0000","last_active":"2024-09-10T21:14:06.310054+0000","last_peered":"2024-09-10T21:14:06.310054+0000","last_clean":"2024-09-10T21:14:06.310054+0000","last_became_active":"2024-09-10T21:13:18.647871+0000","last_became_peered":"2024-09-10T21:13:18.647871+0000","last_unstale":"2024-09-10T21:14:06.310054+0000","last_undegraded":"2024-09-10T21:14:06.310054+0000","last_fullsized":"2024-09-10T21:14:06.310054+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:16.374911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309443+0000","last_change":"2024-09-10T21:13:18.654843+0000","last_active":"2024-09-10T21:14:06.309443+0000","last_peered":"2024-09-10T21:14:06.309443+0000","last_clean":"2024-09-10T21:14:06.309443+0000","last_became_active":"2024-09-10T21:13:18.654211+0000","last_became_peered":"2024-09-10T21:13:18.654211+0000","last_unstale":"2024-09-10T21:14:06.309443+0000","last_undegraded":"2024-09-10T21:14:06.309443+0000","last_fullsized":"2024-09-10T21:14:06.309443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:28.490792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.305911+0000","last_change":"2024-09-10T21:13:18.659603+0000","last_active":"2024-09-10T21:14:06.305911+0000","last_peered":"2024-09-10T21:14:06.305911+0000","last_clean":"2024-09-10T21:14:06.305911+0000","last_became_active":"2024-09-10T21:13:18.659257+0000","last_became_peered":"2024-09-10T21:13:18.659257+0000","last_unstale":"2024-09-10T21:14:06.305911+0000","last_undegraded":"2024-09-10T21:14:06.305911+0000","last_fullsized":"2024-09-10T21:14:06.305911+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:26.249109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308571+0000","last_change":"2024-09-10T21:13:18.649354+0000","last_active":"2024-09-10T21:14:06.308571+0000","last_peered":"2024-09-10T21:14:06.308571+0000","last_clean":"2024-09-10T21:14:06.308571+0000","last_became_active":"2024-09-10T21:13:18.649029+0000","last_became_peered":"2024-09-10T21:13:18.649029+0000","last_unstale":"2024-09-10T21:14:06.308571+0000","last_undegraded":"2024-09-10T21:14:06.308571+0000","last_fullsized":"2024-09-10T21:14:06.308571+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:06.946983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"73'6","reported_seq":84,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:21.026493+0000","last_change":"2024-09-10T21:13:16.631197+0000","last_active":"2024-09-10T21:14:21.026493+0000","last_peered":"2024-09-10T21:14:21.026493+0000","last_clean":"2024-09-10T21:14:21.026493+0000","last_became_active":"2024-09-10T21:13:16.630877+0000","last_became_peered":"2024-09-10T21:13:16.630877+0000","last_unstale":"2024-09-10T21:14:21.026493+0000","last_undegraded":"2024-09-10T21:14:21.026493+0000","last_fullsized":"2024-09-10T21:14:21.026493+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:50.117425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433434+0000","last_change":"2024-09-10T21:13:18.654124+0000","last_active":"2024-09-10T21:14:06.433434+0000","last_peered":"2024-09-10T21:14:06.433434+0000","last_clean":"2024-09-10T21:14:06.433434+0000","last_became_active":"2024-09-10T21:13:18.653757+0000","last_became_peered":"2024-09-10T21:13:18.653757+0000","last_unstale":"2024-09-10T21:14:06.433434+0000","last_undegraded":"2024-09-10T21:14:06.433434+0000","last_fullsized":"2024-09-10T21:14:06.433434+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:25.174272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306892+0000","last_change":"2024-09-10T21:13:16.631526+0000","last_active":"2024-09-10T21:14:06.306892+0000","last_peered":"2024-09-10T21:14:06.306892+0000","last_clean":"2024-09-10T21:14:06.306892+0000","last_became_active":"2024-09-10T21:13:16.631194+0000","last_became_peered":"2024-09-10T21:13:16.631194+0000","last_unstale":"2024-09-10T21:14:06.306892+0000","last_undegraded":"2024-09-10T21:14:06.306892+0000","last_fullsized":"2024-09-10T21:14:06.306892+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:31:35.036874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433190+0000","last_change":"2024-09-10T21:13:16.624906+0000","last_active":"2024-09-10T21:14:06.433190+0000","last_peered":"2024-09-10T21:14:06.433190+0000","last_clean":"2024-09-10T21:14:06.433190+0000","last_became_active":"2024-09-10T21:13:16.624376+0000","last_became_peered":"2024-09-10T21:13:16.624376+0000","last_unstale":"2024-09-10T21:14:06.433190+0000","last_undegraded":"2024-09-10T21:14:06.433190+0000","last_fullsized":"2024-09-10T21:14:06.433190+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:20.942651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.307943+0000","last_change":"2024-09-10T21:13:18.646987+0000","last_active":"2024-09-10T21:14:06.307943+0000","last_peered":"2024-09-10T21:14:06.307943+0000","last_clean":"2024-09-10T21:14:06.307943+0000","last_became_active":"2024-09-10T21:13:18.646690+0000","last_became_peered":"2024-09-10T21:13:18.646690+0000","last_unstale":"2024-09-10T21:14:06.307943+0000","last_undegraded":"2024-09-10T21:14:06.307943+0000","last_fullsized":"2024-09-10T21:14:06.307943+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:47:02.132164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433699+0000","last_change":"2024-09-10T21:13:16.633082+0000","last_active":"2024-09-10T21:14:06.433699+0000","last_peered":"2024-09-10T21:14:06.433699+0000","last_clean":"2024-09-10T21:14:06.433699+0000","last_became_active":"2024-09-10T21:13:16.632707+0000","last_became_peered":"2024-09-10T21:13:16.632707+0000","last_unstale":"2024-09-10T21:14:06.433699+0000","last_undegraded":"2024-09-10T21:14:06.433699+0000","last_fullsized":"2024-09-10T21:14:06.433699+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:53:56.611072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.305527+0000","last_change":"2024-09-10T21:13:18.663309+0000","last_active":"2024-09-10T21:14:06.305527+0000","last_peered":"2024-09-10T21:14:06.305527+0000","last_clean":"2024-09-10T21:14:06.305527+0000","last_became_active":"2024-09-10T21:13:18.662990+0000","last_became_peered":"2024-09-10T21:13:18.662990+0000","last_unstale":"2024-09-10T21:14:06.305527+0000","last_undegraded":"2024-09-10T21:14:06.305527+0000","last_fullsized":"2024-09-10T21:14:06.305527+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:18.014441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"73'4","reported_seq":127,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:20.024230+0000","last_change":"2024-09-10T21:13:16.633012+0000","last_active":"2024-09-10T21:14:20.024230+0000","last_peered":"2024-09-10T21:14:20.024230+0000","last_clean":"2024-09-10T21:14:20.024230+0000","last_became_active":"2024-09-10T21:13:16.632622+0000","last_became_peered":"2024-09-10T21:13:16.632622+0000","last_unstale":"2024-09-10T21:14:20.024230+0000","last_undegraded":"2024-09-10T21:14:20.024230+0000","last_fullsized":"2024-09-10T21:14:20.024230+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:16.859255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309944+0000","last_change":"2024-09-10T21:13:18.658015+0000","last_active":"2024-09-10T21:14:06.309944+0000","last_peered":"2024-09-10T21:14:06.309944+0000","last_clean":"2024-09-10T21:14:06.309944+0000","last_became_active":"2024-09-10T21:13:18.656922+0000","last_became_peered":"2024-09-10T21:13:18.656922+0000","last_unstale":"2024-09-10T21:14:06.309944+0000","last_undegraded":"2024-09-10T21:14:06.309944+0000","last_fullsized":"2024-09-10T21:14:06.309944+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:24.038131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.313021+0000","last_change":"2024-09-10T21:13:16.631771+0000","last_active":"2024-09-10T21:14:06.313021+0000","last_peered":"2024-09-10T21:14:06.313021+0000","last_clean":"2024-09-10T21:14:06.313021+0000","last_became_active":"2024-09-10T21:13:16.631477+0000","last_became_peered":"2024-09-10T21:13:16.631477+0000","last_unstale":"2024-09-10T21:14:06.313021+0000","last_undegraded":"2024-09-10T21:14:06.313021+0000","last_fullsized":"2024-09-10T21:14:06.313021+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:16.644046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433593+0000","last_change":"2024-09-10T21:13:18.658119+0000","last_active":"2024-09-10T21:14:06.433593+0000","last_peered":"2024-09-10T21:14:06.433593+0000","last_clean":"2024-09-10T21:14:06.433593+0000","last_became_active":"2024-09-10T21:13:18.657339+0000","last_became_peered":"2024-09-10T21:13:18.657339+0000","last_unstale":"2024-09-10T21:14:06.433593+0000","last_undegraded":"2024-09-10T21:14:06.433593+0000","last_fullsized":"2024-09-10T21:14:06.433593+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:45.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433347+0000","last_change":"2024-09-10T21:13:16.727019+0000","last_active":"2024-09-10T21:14:06.433347+0000","last_peered":"2024-09-10T21:14:06.433347+0000","last_clean":"2024-09-10T21:14:06.433347+0000","last_became_active":"2024-09-10T21:13:16.726667+0000","last_became_peered":"2024-09-10T21:13:16.726667+0000","last_unstale":"2024-09-10T21:14:06.433347+0000","last_undegraded":"2024-09-10T21:14:06.433347+0000","last_fullsized":"2024-09-10T21:14:06.433347+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:57.551149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.434300+0000","last_change":"2024-09-10T21:14:06.434206+0000","last_active":"2024-09-10T21:14:06.434300+0000","last_peered":"2024-09-10T21:14:06.434300+0000","last_clean":"2024-09-10T21:14:06.434300+0000","last_became_active":"2024-09-10T21:14:06.433779+0000","last_became_peered":"2024-09-10T21:14:06.433779+0000","last_unstale":"2024-09-10T21:14:06.434300+0000","last_undegraded":"2024-09-10T21:14:06.434300+0000","last_fullsized":"2024-09-10T21:14:06.434300+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:24.590286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"73'30","reported_seq":161,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:20.024229+0000","last_change":"2024-09-10T21:13:16.631820+0000","last_active":"2024-09-10T21:14:20.024229+0000","last_peered":"2024-09-10T21:14:20.024229+0000","last_clean":"2024-09-10T21:14:20.024229+0000","last_became_active":"2024-09-10T21:13:16.631432+0000","last_became_peered":"2024-09-10T21:13:16.631432+0000","last_unstale":"2024-09-10T21:14:20.024229+0000","last_undegraded":"2024-09-10T21:14:20.024229+0000","last_fullsized":"2024-09-10T21:14:20.024229+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:47.972871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59762,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":108,"num_read_kb":112,"num_write":32,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309219+0000","last_change":"2024-09-10T21:13:18.653147+0000","last_active":"2024-09-10T21:14:06.309219+0000","last_peered":"2024-09-10T21:14:06.309219+0000","last_clean":"2024-09-10T21:14:06.309219+0000","last_became_active":"2024-09-10T21:13:18.652846+0000","last_became_peered":"2024-09-10T21:13:18.652846+0000","last_unstale":"2024-09-10T21:14:06.309219+0000","last_undegraded":"2024-09-10T21:14:06.309219+0000","last_fullsized":"2024-09-10T21:14:06.309219+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:59.007192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309628+0000","last_change":"2024-09-10T21:13:16.631994+0000","last_active":"2024-09-10T21:14:06.309628+0000","last_peered":"2024-09-10T21:14:06.309628+0000","last_clean":"2024-09-10T21:14:06.309628+0000","last_became_active":"2024-09-10T21:13:16.631665+0000","last_became_peered":"2024-09-10T21:13:16.631665+0000","last_unstale":"2024-09-10T21:14:06.309628+0000","last_undegraded":"2024-09-10T21:14:06.309628+0000","last_fullsized":"2024-09-10T21:14:06.309628+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:05.537172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433331+0000","last_change":"2024-09-10T21:13:18.657463+0000","last_active":"2024-09-10T21:14:06.433331+0000","last_peered":"2024-09-10T21:14:06.433331+0000","last_clean":"2024-09-10T21:14:06.433331+0000","last_became_active":"2024-09-10T21:13:18.657146+0000","last_became_peered":"2024-09-10T21:13:18.657146+0000","last_unstale":"2024-09-10T21:14:06.433331+0000","last_undegraded":"2024-09-10T21:14:06.433331+0000","last_fullsized":"2024-09-10T21:14:06.433331+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:42.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433206+0000","last_change":"2024-09-10T21:13:16.630419+0000","last_active":"2024-09-10T21:14:06.433206+0000","last_peered":"2024-09-10T21:14:06.433206+0000","last_clean":"2024-09-10T21:14:06.433206+0000","last_became_active":"2024-09-10T21:13:16.630053+0000","last_became_peered":"2024-09-10T21:13:16.630053+0000","last_unstale":"2024-09-10T21:14:06.433206+0000","last_undegraded":"2024-09-10T21:14:06.433206+0000","last_fullsized":"2024-09-10T21:14:06.433206+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:08.090931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312872+0000","last_change":"2024-09-10T21:13:18.657585+0000","last_active":"2024-09-10T21:14:06.312872+0000","last_peered":"2024-09-10T21:14:06.312872+0000","last_clean":"2024-09-10T21:14:06.312872+0000","last_became_active":"2024-09-10T21:13:18.657280+0000","last_became_peered":"2024-09-10T21:13:18.657280+0000","last_unstale":"2024-09-10T21:14:06.312872+0000","last_undegraded":"2024-09-10T21:14:06.312872+0000","last_fullsized":"2024-09-10T21:14:06.312872+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:46:34.252882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'5","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:20.024602+0000","last_change":"2024-09-10T21:13:16.629700+0000","last_active":"2024-09-10T21:14:20.024602+0000","last_peered":"2024-09-10T21:14:20.024602+0000","last_clean":"2024-09-10T21:14:20.024602+0000","last_became_active":"2024-09-10T21:13:16.629282+0000","last_became_peered":"2024-09-10T21:13:16.629282+0000","last_unstale":"2024-09-10T21:14:20.024602+0000","last_undegraded":"2024-09-10T21:14:20.024602+0000","last_fullsized":"2024-09-10T21:14:20.024602+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:42.572643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312516+0000","last_change":"2024-09-10T21:13:18.664535+0000","last_active":"2024-09-10T21:14:06.312516+0000","last_peered":"2024-09-10T21:14:06.312516+0000","last_clean":"2024-09-10T21:14:06.312516+0000","last_became_active":"2024-09-10T21:13:18.663997+0000","last_became_peered":"2024-09-10T21:13:18.663997+0000","last_unstale":"2024-09-10T21:14:06.312516+0000","last_undegraded":"2024-09-10T21:14:06.312516+0000","last_fullsized":"2024-09-10T21:14:06.312516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:30.365106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308443+0000","last_change":"2024-09-10T21:13:16.727096+0000","last_active":"2024-09-10T21:14:06.308443+0000","last_peered":"2024-09-10T21:14:06.308443+0000","last_clean":"2024-09-10T21:14:06.308443+0000","last_became_active":"2024-09-10T21:13:16.726408+0000","last_became_peered":"2024-09-10T21:13:16.726408+0000","last_unstale":"2024-09-10T21:14:06.308443+0000","last_undegraded":"2024-09-10T21:14:06.308443+0000","last_fullsized":"2024-09-10T21:14:06.308443+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:30.581238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433159+0000","last_change":"2024-09-10T21:13:18.657397+0000","last_active":"2024-09-10T21:14:06.433159+0000","last_peered":"2024-09-10T21:14:06.433159+0000","last_clean":"2024-09-10T21:14:06.433159+0000","last_became_active":"2024-09-10T21:13:18.657050+0000","last_became_peered":"2024-09-10T21:13:18.657050+0000","last_unstale":"2024-09-10T21:14:06.433159+0000","last_undegraded":"2024-09-10T21:14:06.433159+0000","last_fullsized":"2024-09-10T21:14:06.433159+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:09.739544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.310361+0000","last_change":"2024-09-10T21:13:16.633716+0000","last_active":"2024-09-10T21:14:06.310361+0000","last_peered":"2024-09-10T21:14:06.310361+0000","last_clean":"2024-09-10T21:14:06.310361+0000","last_became_active":"2024-09-10T21:13:16.633225+0000","last_became_peered":"2024-09-10T21:13:16.633225+0000","last_unstale":"2024-09-10T21:14:06.310361+0000","last_undegraded":"2024-09-10T21:14:06.310361+0000","last_fullsized":"2024-09-10T21:14:06.310361+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:48.807549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306189+0000","last_change":"2024-09-10T21:13:18.663129+0000","last_active":"2024-09-10T21:14:06.306189+0000","last_peered":"2024-09-10T21:14:06.306189+0000","last_clean":"2024-09-10T21:14:06.306189+0000","last_became_active":"2024-09-10T21:13:18.662694+0000","last_became_peered":"2024-09-10T21:13:18.662694+0000","last_unstale":"2024-09-10T21:14:06.306189+0000","last_undegraded":"2024-09-10T21:14:06.306189+0000","last_fullsized":"2024-09-10T21:14:06.306189+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:24.633468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433973+0000","last_change":"2024-09-10T21:13:16.628733+0000","last_active":"2024-09-10T21:14:06.433973+0000","last_peered":"2024-09-10T21:14:06.433973+0000","last_clean":"2024-09-10T21:14:06.433973+0000","last_became_active":"2024-09-10T21:13:16.628419+0000","last_became_peered":"2024-09-10T21:13:16.628419+0000","last_unstale":"2024-09-10T21:14:06.433973+0000","last_undegraded":"2024-09-10T21:14:06.433973+0000","last_fullsized":"2024-09-10T21:14:06.433973+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:31.264739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.313051+0000","last_change":"2024-09-10T21:13:18.656571+0000","last_active":"2024-09-10T21:14:06.313051+0000","last_peered":"2024-09-10T21:14:06.313051+0000","last_clean":"2024-09-10T21:14:06.313051+0000","last_became_active":"2024-09-10T21:13:18.656253+0000","last_became_peered":"2024-09-10T21:13:18.656253+0000","last_unstale":"2024-09-10T21:14:06.313051+0000","last_undegraded":"2024-09-10T21:14:06.313051+0000","last_fullsized":"2024-09-10T21:14:06.313051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:57.848566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433543+0000","last_change":"2024-09-10T21:13:16.631750+0000","last_active":"2024-09-10T21:14:06.433543+0000","last_peered":"2024-09-10T21:14:06.433543+0000","last_clean":"2024-09-10T21:14:06.433543+0000","last_became_active":"2024-09-10T21:13:16.631245+0000","last_became_peered":"2024-09-10T21:13:16.631245+0000","last_unstale":"2024-09-10T21:14:06.433543+0000","last_undegraded":"2024-09-10T21:14:06.433543+0000","last_fullsized":"2024-09-10T21:14:06.433543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:28.787751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312936+0000","last_change":"2024-09-10T21:13:18.660834+0000","last_active":"2024-09-10T21:14:06.312936+0000","last_peered":"2024-09-10T21:14:06.312936+0000","last_clean":"2024-09-10T21:14:06.312936+0000","last_became_active":"2024-09-10T21:13:18.660461+0000","last_became_peered":"2024-09-10T21:13:18.660461+0000","last_unstale":"2024-09-10T21:14:06.312936+0000","last_undegraded":"2024-09-10T21:14:06.312936+0000","last_fullsized":"2024-09-10T21:14:06.312936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:55.531199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'5","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:20.024802+0000","last_change":"2024-09-10T21:13:16.726824+0000","last_active":"2024-09-10T21:14:20.024802+0000","last_peered":"2024-09-10T21:14:20.024802+0000","last_clean":"2024-09-10T21:14:20.024802+0000","last_became_active":"2024-09-10T21:13:16.726436+0000","last_became_peered":"2024-09-10T21:13:16.726436+0000","last_unstale":"2024-09-10T21:14:20.024802+0000","last_undegraded":"2024-09-10T21:14:20.024802+0000","last_fullsized":"2024-09-10T21:14:20.024802+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:49.391388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.313093+0000","last_change":"2024-09-10T21:13:18.663725+0000","last_active":"2024-09-10T21:14:06.313093+0000","last_peered":"2024-09-10T21:14:06.313093+0000","last_clean":"2024-09-10T21:14:06.313093+0000","last_became_active":"2024-09-10T21:13:18.663254+0000","last_became_peered":"2024-09-10T21:13:18.663254+0000","last_unstale":"2024-09-10T21:14:06.313093+0000","last_undegraded":"2024-09-10T21:14:06.313093+0000","last_fullsized":"2024-09-10T21:14:06.313093+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:19.672231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":96,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312700+0000","last_change":"2024-09-10T21:12:08.173849+0000","last_active":"2024-09-10T21:14:06.312700+0000","last_peered":"2024-09-10T21:14:06.312700+0000","last_clean":"2024-09-10T21:14:06.312700+0000","last_became_active":"2024-09-10T21:12:08.153630+0000","last_became_peered":"2024-09-10T21:12:08.153630+0000","last_unstale":"2024-09-10T21:14:06.312700+0000","last_undegraded":"2024-09-10T21:14:06.312700+0000","last_fullsized":"2024-09-10T21:14:06.312700+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:08:47.842259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:08:47.842259+0000","last_clean_scrub_stamp":"2024-09-10T21:08:47.842259+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:39.166390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433413+0000","last_change":"2024-09-10T21:13:16.628607+0000","last_active":"2024-09-10T21:14:06.433413+0000","last_peered":"2024-09-10T21:14:06.433413+0000","last_clean":"2024-09-10T21:14:06.433413+0000","last_became_active":"2024-09-10T21:13:16.627736+0000","last_became_peered":"2024-09-10T21:13:16.627736+0000","last_unstale":"2024-09-10T21:14:06.433413+0000","last_undegraded":"2024-09-10T21:14:06.433413+0000","last_fullsized":"2024-09-10T21:14:06.433413+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:16.388832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308245+0000","last_change":"2024-09-10T21:13:18.652634+0000","last_active":"2024-09-10T21:14:06.308245+0000","last_peered":"2024-09-10T21:14:06.308245+0000","last_clean":"2024-09-10T21:14:06.308245+0000","last_became_active":"2024-09-10T21:13:18.652325+0000","last_became_peered":"2024-09-10T21:13:18.652325+0000","last_unstale":"2024-09-10T21:14:06.308245+0000","last_undegraded":"2024-09-10T21:14:06.308245+0000","last_fullsized":"2024-09-10T21:14:06.308245+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:16.382355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312642+0000","last_change":"2024-09-10T21:13:16.631442+0000","last_active":"2024-09-10T21:14:06.312642+0000","last_peered":"2024-09-10T21:14:06.312642+0000","last_clean":"2024-09-10T21:14:06.312642+0000","last_became_active":"2024-09-10T21:13:16.631117+0000","last_became_peered":"2024-09-10T21:13:16.631117+0000","last_unstale":"2024-09-10T21:14:06.312642+0000","last_undegraded":"2024-09-10T21:14:06.312642+0000","last_fullsized":"2024-09-10T21:14:06.312642+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:35.376888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433132+0000","last_change":"2024-09-10T21:13:18.644246+0000","last_active":"2024-09-10T21:14:06.433132+0000","last_peered":"2024-09-10T21:14:06.433132+0000","last_clean":"2024-09-10T21:14:06.433132+0000","last_became_active":"2024-09-10T21:13:18.643944+0000","last_became_peered":"2024-09-10T21:13:18.643944+0000","last_unstale":"2024-09-10T21:14:06.433132+0000","last_undegraded":"2024-09-10T21:14:06.433132+0000","last_fullsized":"2024-09-10T21:14:06.433132+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:18.856149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:22.026835+0000","last_change":"2024-09-10T21:13:16.726716+0000","last_active":"2024-09-10T21:14:22.026835+0000","last_peered":"2024-09-10T21:14:22.026835+0000","last_clean":"2024-09-10T21:14:22.026835+0000","last_became_active":"2024-09-10T21:13:16.726400+0000","last_became_peered":"2024-09-10T21:13:16.726400+0000","last_unstale":"2024-09-10T21:14:22.026835+0000","last_undegraded":"2024-09-10T21:14:22.026835+0000","last_fullsized":"2024-09-10T21:14:22.026835+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:55.643495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.435386+0000","last_change":"2024-09-10T21:14:06.433990+0000","last_active":"2024-09-10T21:14:06.435386+0000","last_peered":"2024-09-10T21:14:06.435386+0000","last_clean":"2024-09-10T21:14:06.435386+0000","last_became_active":"2024-09-10T21:14:06.433489+0000","last_became_peered":"2024-09-10T21:14:06.433489+0000","last_unstale":"2024-09-10T21:14:06.435386+0000","last_undegraded":"2024-09-10T21:14:06.435386+0000","last_fullsized":"2024-09-10T21:14:06.435386+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:28.001658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"73'5","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:21.025679+0000","last_change":"2024-09-10T21:13:16.633126+0000","last_active":"2024-09-10T21:14:21.025679+0000","last_peered":"2024-09-10T21:14:21.025679+0000","last_clean":"2024-09-10T21:14:21.025679+0000","last_became_active":"2024-09-10T21:13:16.632808+0000","last_became_peered":"2024-09-10T21:13:16.632808+0000","last_unstale":"2024-09-10T21:14:21.025679+0000","last_undegraded":"2024-09-10T21:14:21.025679+0000","last_fullsized":"2024-09-10T21:14:21.025679+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:01.026506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306894+0000","last_change":"2024-09-10T21:13:18.652631+0000","last_active":"2024-09-10T21:14:06.306894+0000","last_peered":"2024-09-10T21:14:06.306894+0000","last_clean":"2024-09-10T21:14:06.306894+0000","last_became_active":"2024-09-10T21:13:18.650580+0000","last_became_peered":"2024-09-10T21:13:18.650580+0000","last_unstale":"2024-09-10T21:14:06.306894+0000","last_undegraded":"2024-09-10T21:14:06.306894+0000","last_fullsized":"2024-09-10T21:14:06.306894+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:32.733169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.305817+0000","last_change":"2024-09-10T21:13:16.728172+0000","last_active":"2024-09-10T21:14:06.305817+0000","last_peered":"2024-09-10T21:14:06.305817+0000","last_clean":"2024-09-10T21:14:06.305817+0000","last_became_active":"2024-09-10T21:13:16.727793+0000","last_became_peered":"2024-09-10T21:13:16.727793+0000","last_unstale":"2024-09-10T21:14:06.305817+0000","last_undegraded":"2024-09-10T21:14:06.305817+0000","last_fullsized":"2024-09-10T21:14:06.305817+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:58:04.301119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"73'1","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.307027+0000","last_change":"2024-09-10T21:13:18.655371+0000","last_active":"2024-09-10T21:14:06.307027+0000","last_peered":"2024-09-10T21:14:06.307027+0000","last_clean":"2024-09-10T21:14:06.307027+0000","last_became_active":"2024-09-10T21:13:18.653250+0000","last_became_peered":"2024-09-10T21:13:18.653250+0000","last_unstale":"2024-09-10T21:14:06.307027+0000","last_undegraded":"2024-09-10T21:14:06.307027+0000","last_fullsized":"2024-09-10T21:14:06.307027+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:25.650736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309415+0000","last_change":"2024-09-10T21:13:16.726816+0000","last_active":"2024-09-10T21:14:06.309415+0000","last_peered":"2024-09-10T21:14:06.309415+0000","last_clean":"2024-09-10T21:14:06.309415+0000","last_became_active":"2024-09-10T21:13:16.726438+0000","last_became_peered":"2024-09-10T21:13:16.726438+0000","last_unstale":"2024-09-10T21:14:06.309415+0000","last_undegraded":"2024-09-10T21:14:06.309415+0000","last_fullsized":"2024-09-10T21:14:06.309415+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:46.384899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433915+0000","last_change":"2024-09-10T21:13:18.643424+0000","last_active":"2024-09-10T21:14:06.433915+0000","last_peered":"2024-09-10T21:14:06.433915+0000","last_clean":"2024-09-10T21:14:06.433915+0000","last_became_active":"2024-09-10T21:13:18.643010+0000","last_became_peered":"2024-09-10T21:13:18.643010+0000","last_unstale":"2024-09-10T21:14:06.433915+0000","last_undegraded":"2024-09-10T21:14:06.433915+0000","last_fullsized":"2024-09-10T21:14:06.433915+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:47.358129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"73'14","reported_seq":54,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.316429+0000","last_change":"2024-09-10T21:14:06.316327+0000","last_active":"2024-09-10T21:14:06.316429+0000","last_peered":"2024-09-10T21:14:06.316429+0000","last_clean":"2024-09-10T21:14:06.316429+0000","last_became_active":"2024-09-10T21:14:06.309000+0000","last_became_peered":"2024-09-10T21:14:06.309000+0000","last_unstale":"2024-09-10T21:14:06.316429+0000","last_undegraded":"2024-09-10T21:14:06.316429+0000","last_fullsized":"2024-09-10T21:14:06.316429+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:13.582411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308498+0000","last_change":"2024-09-10T21:13:18.652347+0000","last_active":"2024-09-10T21:14:06.308498+0000","last_peered":"2024-09-10T21:14:06.308498+0000","last_clean":"2024-09-10T21:14:06.308498+0000","last_became_active":"2024-09-10T21:13:18.651942+0000","last_became_peered":"2024-09-10T21:13:18.651942+0000","last_unstale":"2024-09-10T21:14:06.308498+0000","last_undegraded":"2024-09-10T21:14:06.308498+0000","last_fullsized":"2024-09-10T21:14:06.308498+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:11.356787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433490+0000","last_change":"2024-09-10T21:13:16.621647+0000","last_active":"2024-09-10T21:14:06.433490+0000","last_peered":"2024-09-10T21:14:06.433490+0000","last_clean":"2024-09-10T21:14:06.433490+0000","last_became_active":"2024-09-10T21:13:16.621316+0000","last_became_peered":"2024-09-10T21:13:16.621316+0000","last_unstale":"2024-09-10T21:14:06.433490+0000","last_undegraded":"2024-09-10T21:14:06.433490+0000","last_fullsized":"2024-09-10T21:14:06.433490+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:10.264578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433433+0000","last_change":"2024-09-10T21:13:18.656617+0000","last_active":"2024-09-10T21:14:06.433433+0000","last_peered":"2024-09-10T21:14:06.433433+0000","last_clean":"2024-09-10T21:14:06.433433+0000","last_became_active":"2024-09-10T21:13:18.656331+0000","last_became_peered":"2024-09-10T21:13:18.656331+0000","last_unstale":"2024-09-10T21:14:06.433433+0000","last_undegraded":"2024-09-10T21:14:06.433433+0000","last_fullsized":"2024-09-10T21:14:06.433433+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:44.482797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309648+0000","last_change":"2024-09-10T21:13:16.727736+0000","last_active":"2024-09-10T21:14:06.309648+0000","last_peered":"2024-09-10T21:14:06.309648+0000","last_clean":"2024-09-10T21:14:06.309648+0000","last_became_active":"2024-09-10T21:13:16.727413+0000","last_became_peered":"2024-09-10T21:13:16.727413+0000","last_unstale":"2024-09-10T21:14:06.309648+0000","last_undegraded":"2024-09-10T21:14:06.309648+0000","last_fullsized":"2024-09-10T21:14:06.309648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:26.351729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308390+0000","last_change":"2024-09-10T21:13:18.660100+0000","last_active":"2024-09-10T21:14:06.308390+0000","last_peered":"2024-09-10T21:14:06.308390+0000","last_clean":"2024-09-10T21:14:06.308390+0000","last_became_active":"2024-09-10T21:13:18.659733+0000","last_became_peered":"2024-09-10T21:13:18.659733+0000","last_unstale":"2024-09-10T21:14:06.308390+0000","last_undegraded":"2024-09-10T21:14:06.308390+0000","last_fullsized":"2024-09-10T21:14:06.308390+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:44.371627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308097+0000","last_change":"2024-09-10T21:13:16.627194+0000","last_active":"2024-09-10T21:14:06.308097+0000","last_peered":"2024-09-10T21:14:06.308097+0000","last_clean":"2024-09-10T21:14:06.308097+0000","last_became_active":"2024-09-10T21:13:16.626805+0000","last_became_peered":"2024-09-10T21:13:16.626805+0000","last_unstale":"2024-09-10T21:14:06.308097+0000","last_undegraded":"2024-09-10T21:14:06.308097+0000","last_fullsized":"2024-09-10T21:14:06.308097+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:33.582084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306066+0000","last_change":"2024-09-10T21:13:18.663122+0000","last_active":"2024-09-10T21:14:06.306066+0000","last_peered":"2024-09-10T21:14:06.306066+0000","last_clean":"2024-09-10T21:14:06.306066+0000","last_became_active":"2024-09-10T21:13:18.662673+0000","last_became_peered":"2024-09-10T21:13:18.662673+0000","last_unstale":"2024-09-10T21:14:06.306066+0000","last_undegraded":"2024-09-10T21:14:06.306066+0000","last_fullsized":"2024-09-10T21:14:06.306066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:15.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.320090+0000","last_change":"2024-09-10T21:14:06.319645+0000","last_active":"2024-09-10T21:14:06.320090+0000","last_peered":"2024-09-10T21:14:06.320090+0000","last_clean":"2024-09-10T21:14:06.320090+0000","last_became_active":"2024-09-10T21:14:06.311394+0000","last_became_peered":"2024-09-10T21:14:06.311394+0000","last_unstale":"2024-09-10T21:14:06.320090+0000","last_undegraded":"2024-09-10T21:14:06.320090+0000","last_fullsized":"2024-09-10T21:14:06.320090+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:26:20.925331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308195+0000","last_change":"2024-09-10T21:13:18.656400+0000","last_active":"2024-09-10T21:14:06.308195+0000","last_peered":"2024-09-10T21:14:06.308195+0000","last_clean":"2024-09-10T21:14:06.308195+0000","last_became_active":"2024-09-10T21:13:18.655802+0000","last_became_peered":"2024-09-10T21:13:18.655802+0000","last_unstale":"2024-09-10T21:14:06.308195+0000","last_undegraded":"2024-09-10T21:14:06.308195+0000","last_fullsized":"2024-09-10T21:14:06.308195+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:41.901404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.438924+0000","last_change":"2024-09-10T21:14:06.438851+0000","last_active":"2024-09-10T21:14:06.438924+0000","last_peered":"2024-09-10T21:14:06.438924+0000","last_clean":"2024-09-10T21:14:06.438924+0000","last_became_active":"2024-09-10T21:14:06.434291+0000","last_became_peered":"2024-09-10T21:14:06.434291+0000","last_unstale":"2024-09-10T21:14:06.438924+0000","last_undegraded":"2024-09-10T21:14:06.438924+0000","last_fullsized":"2024-09-10T21:14:06.438924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:43.895028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312707+0000","last_change":"2024-09-10T21:13:18.664331+0000","last_active":"2024-09-10T21:14:06.312707+0000","last_peered":"2024-09-10T21:14:06.312707+0000","last_clean":"2024-09-10T21:14:06.312707+0000","last_became_active":"2024-09-10T21:13:18.663823+0000","last_became_peered":"2024-09-10T21:13:18.663823+0000","last_unstale":"2024-09-10T21:14:06.312707+0000","last_undegraded":"2024-09-10T21:14:06.312707+0000","last_fullsized":"2024-09-10T21:14:06.312707+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:37.626712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433509+0000","last_change":"2024-09-10T21:13:18.659941+0000","last_active":"2024-09-10T21:14:06.433509+0000","last_peered":"2024-09-10T21:14:06.433509+0000","last_clean":"2024-09-10T21:14:06.433509+0000","last_became_active":"2024-09-10T21:13:18.659019+0000","last_became_peered":"2024-09-10T21:13:18.659019+0000","last_unstale":"2024-09-10T21:14:06.433509+0000","last_undegraded":"2024-09-10T21:14:06.433509+0000","last_fullsized":"2024-09-10T21:14:06.433509+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:41.037722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309893+0000","last_change":"2024-09-10T21:13:16.633660+0000","last_active":"2024-09-10T21:14:06.309893+0000","last_peered":"2024-09-10T21:14:06.309893+0000","last_clean":"2024-09-10T21:14:06.309893+0000","last_became_active":"2024-09-10T21:13:16.633222+0000","last_became_peered":"2024-09-10T21:13:16.633222+0000","last_unstale":"2024-09-10T21:14:06.309893+0000","last_undegraded":"2024-09-10T21:14:06.309893+0000","last_fullsized":"2024-09-10T21:14:06.309893+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:56.364355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309639+0000","last_change":"2024-09-10T21:13:18.666837+0000","last_active":"2024-09-10T21:14:06.309639+0000","last_peered":"2024-09-10T21:14:06.309639+0000","last_clean":"2024-09-10T21:14:06.309639+0000","last_became_active":"2024-09-10T21:13:18.666382+0000","last_became_peered":"2024-09-10T21:13:18.666382+0000","last_unstale":"2024-09-10T21:14:06.309639+0000","last_undegraded":"2024-09-10T21:14:06.309639+0000","last_fullsized":"2024-09-10T21:14:06.309639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:32.225130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309304+0000","last_change":"2024-09-10T21:13:16.631424+0000","last_active":"2024-09-10T21:14:06.309304+0000","last_peered":"2024-09-10T21:14:06.309304+0000","last_clean":"2024-09-10T21:14:06.309304+0000","last_became_active":"2024-09-10T21:13:16.631116+0000","last_became_peered":"2024-09-10T21:13:16.631116+0000","last_unstale":"2024-09-10T21:14:06.309304+0000","last_undegraded":"2024-09-10T21:14:06.309304+0000","last_fullsized":"2024-09-10T21:14:06.309304+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:15.506410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433552+0000","last_change":"2024-09-10T21:13:18.654978+0000","last_active":"2024-09-10T21:14:06.433552+0000","last_peered":"2024-09-10T21:14:06.433552+0000","last_clean":"2024-09-10T21:14:06.433552+0000","last_became_active":"2024-09-10T21:13:18.654581+0000","last_became_peered":"2024-09-10T21:13:18.654581+0000","last_unstale":"2024-09-10T21:14:06.433552+0000","last_undegraded":"2024-09-10T21:14:06.433552+0000","last_fullsized":"2024-09-10T21:14:06.433552+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:17.504626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308544+0000","last_change":"2024-09-10T21:13:16.726727+0000","last_active":"2024-09-10T21:14:06.308544+0000","last_peered":"2024-09-10T21:14:06.308544+0000","last_clean":"2024-09-10T21:14:06.308544+0000","last_became_active":"2024-09-10T21:13:16.726373+0000","last_became_peered":"2024-09-10T21:13:16.726373+0000","last_unstale":"2024-09-10T21:14:06.308544+0000","last_undegraded":"2024-09-10T21:14:06.308544+0000","last_fullsized":"2024-09-10T21:14:06.308544+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:31.803631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308420+0000","last_change":"2024-09-10T21:13:18.648384+0000","last_active":"2024-09-10T21:14:06.308420+0000","last_peered":"2024-09-10T21:14:06.308420+0000","last_clean":"2024-09-10T21:14:06.308420+0000","last_became_active":"2024-09-10T21:13:18.647911+0000","last_became_peered":"2024-09-10T21:13:18.647911+0000","last_unstale":"2024-09-10T21:14:06.308420+0000","last_undegraded":"2024-09-10T21:14:06.308420+0000","last_fullsized":"2024-09-10T21:14:06.308420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:02.582548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"73'13","reported_seq":90,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:22.026496+0000","last_change":"2024-09-10T21:13:16.631501+0000","last_active":"2024-09-10T21:14:22.026496+0000","last_peered":"2024-09-10T21:14:22.026496+0000","last_clean":"2024-09-10T21:14:22.026496+0000","last_became_active":"2024-09-10T21:13:16.631246+0000","last_became_peered":"2024-09-10T21:13:16.631246+0000","last_unstale":"2024-09-10T21:14:22.026496+0000","last_undegraded":"2024-09-10T21:14:22.026496+0000","last_fullsized":"2024-09-10T21:14:22.026496+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:25.277370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66575,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":551,"num_read_kb":349,"num_write":241,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":199725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808858,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":815104,"data_stored":393851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005086,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28512,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716640,"statfs":{"total":95995035648,"available":95965839360,"internally_reserved":0,"allocated":1515520,"data_stored":1044642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135908,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":839680,"data_stored":393781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332137,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":835584,"data_stored":394159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528366,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28432,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716720,"statfs":{"total":95995035648,"available":95965921280,"internally_reserved":0,"allocated":1433600,"data_stored":986677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659187,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36152,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709000,"statfs":{"total":95995035648,"available":95958016000,"internally_reserved":0,"allocated":823296,"data_stored":393498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855416,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28440,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716712,"statfs":{"total":95995035648,"available":95965913088,"internally_reserved":0,"allocated":1445888,"data_stored":986355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018940,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":823296,"data_stored":393359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":393323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":905216,"data_stored":454784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":884736,"data_stored":454173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":843776,"data_stored":394837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:14:26.584 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T21:14:26.584 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T21:14:26.584 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-10T21:14:26.584 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-10T21:14:26.844 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:26.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:26 smithi059 ceph-mon[30888]: pgmap v315: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:26.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:26 smithi059 ceph-mon[30888]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:14:26.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:26 smithi154 ceph-mon[35041]: pgmap v315: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:26.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:26 smithi154 ceph-mon[35041]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:14:27.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:26 smithi192 ceph-mon[35363]: pgmap v315: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:27.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:26 smithi192 ceph-mon[35363]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:14:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.302+0000 7f39c55f4640 1 -- 172.21.15.59:0/1815982709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39c0109130 msgr2=0x7f39c010f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:27.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.302+0000 7f39c55f4640 1 --2- 172.21.15.59:0/1815982709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39c0109130 0x7f39c010f930 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f39b8009ca0 tx=0x7f39b802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:14:27.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.302+0000 7f39c55f4640 1 -- 172.21.15.59:0/1815982709 shutdown_connections 2024-09-10T21:14:27.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.302+0000 7f39c55f4640 1 --2- 172.21.15.59:0/1815982709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39c0109130 0x7f39c010f930 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:27.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.302+0000 7f39c55f4640 1 --2- 172.21.15.59:0/1815982709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c01087b0 0x7f39c0108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:27.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.302+0000 7f39c55f4640 1 --2- 172.21.15.59:0/1815982709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39c0102da0 0x7f39c0103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:27.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.302+0000 7f39c55f4640 1 -- 172.21.15.59:0/1815982709 >> 172.21.15.59:0/1815982709 conn(0x7f39c00fe810 msgr2=0x7f39c0100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:27.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.302+0000 7f39c55f4640 1 -- 172.21.15.59:0/1815982709 shutdown_connections 2024-09-10T21:14:27.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.302+0000 7f39c55f4640 1 -- 172.21.15.59:0/1815982709 wait complete. 2024-09-10T21:14:27.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.302+0000 7f39c55f4640 1 Processor -- start 2024-09-10T21:14:27.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.302+0000 7f39c55f4640 1 -- start start 2024-09-10T21:14:27.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39c55f4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c0102da0 0x7f39c00754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:27.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39c55f4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39c01087b0 0x7f39c00759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39c55f4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39c0109130 0x7f39c0075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39c55f4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f39c0112db0 con 0x7f39c0109130 2024-09-10T21:14:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39c55f4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f39c0112c30 con 0x7f39c01087b0 2024-09-10T21:14:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39c55f4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f39c0112f30 con 0x7f39c0102da0 2024-09-10T21:14:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39bf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39c0109130 0x7f39c0075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39bf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39c0109130 0x7f39c0075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58024/0 (socket says 172.21.15.59:58024) 2024-09-10T21:14:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39bf7fe640 1 -- 172.21.15.59:0/2912159114 learned_addr learned my addr 172.21.15.59:0/2912159114 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39beffd640 1 --2- 172.21.15.59:0/2912159114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c0102da0 0x7f39c00754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39b7fff640 1 --2- 172.21.15.59:0/2912159114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39c01087b0 0x7f39c00759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39bf7fe640 1 -- 172.21.15.59:0/2912159114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c0102da0 msgr2=0x7f39c00754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39bf7fe640 1 --2- 172.21.15.59:0/2912159114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c0102da0 0x7f39c00754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39bf7fe640 1 -- 172.21.15.59:0/2912159114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39c01087b0 msgr2=0x7f39c00759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:27.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39bf7fe640 1 --2- 172.21.15.59:0/2912159114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39c01087b0 0x7f39c00759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39bf7fe640 1 -- 172.21.15.59:0/2912159114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c01a7560 con 0x7f39c0109130 2024-09-10T21:14:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39beffd640 1 --2- 172.21.15.59:0/2912159114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c0102da0 0x7f39c00754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39bf7fe640 1 --2- 172.21.15.59:0/2912159114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39c0109130 0x7f39c0075f20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f39b8005cc0 tx=0x7f39b802f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39bcff9640 1 -- 172.21.15.59:0/2912159114 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8003cf0 con 0x7f39c0109130 2024-09-10T21:14:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39c55f4640 1 -- 172.21.15.59:0/2912159114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c01a77f0 con 0x7f39c0109130 2024-09-10T21:14:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39bcff9640 1 -- 172.21.15.59:0/2912159114 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39b80044f0 con 0x7f39c0109130 2024-09-10T21:14:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39bcff9640 1 -- 172.21.15.59:0/2912159114 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b802fd10 con 0x7f39c0109130 2024-09-10T21:14:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.303+0000 7f39c55f4640 1 -- 172.21.15.59:0/2912159114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c01a7d80 con 0x7f39c0109130 2024-09-10T21:14:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.304+0000 7f39c55f4640 1 -- 172.21.15.59:0/2912159114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c0103180 con 0x7f39c0109130 2024-09-10T21:14:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.306+0000 7f39bcff9640 1 -- 172.21.15.59:0/2912159114 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f39b8004040 con 0x7f39c0109130 2024-09-10T21:14:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.307+0000 7f39bcff9640 1 --2- 172.21.15.59:0/2912159114 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f39ac0b5370 0x7f39ac0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.307+0000 7f39beffd640 1 --2- 172.21.15.59:0/2912159114 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f39ac0b5370 0x7f39ac0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:27.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.307+0000 7f39bcff9640 1 -- 172.21.15.59:0/2912159114 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f39b81075b0 con 0x7f39c0109130 2024-09-10T21:14:27.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.307+0000 7f39beffd640 1 --2- 172.21.15.59:0/2912159114 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f39ac0b5370 0x7f39ac0b7830 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f39b000abe0 tx=0x7f39b000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:27.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.310+0000 7f39bcff9640 1 -- 172.21.15.59:0/2912159114 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f39b80ce340 con 0x7f39c0109130 2024-09-10T21:14:27.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.533+0000 7f39c55f4640 1 -- 172.21.15.59:0/2912159114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f39c00767a0 con 0x7f39c0109130 2024-09-10T21:14:27.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.533+0000 7f39bcff9640 1 -- 172.21.15.59:0/2912159114 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f39b80cdc40 con 0x7f39c0109130 2024-09-10T21:14:27.538 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:14:27.538 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T21:14:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.536+0000 7f39c55f4640 1 -- 172.21.15.59:0/2912159114 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f39ac0b5370 msgr2=0x7f39ac0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.536+0000 7f39c55f4640 1 --2- 172.21.15.59:0/2912159114 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f39ac0b5370 0x7f39ac0b7830 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f39b000abe0 tx=0x7f39b000a5c0 comp rx=0 tx=0).stop 2024-09-10T21:14:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.536+0000 7f39c55f4640 1 -- 172.21.15.59:0/2912159114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39c0109130 msgr2=0x7f39c0075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.536+0000 7f39c55f4640 1 --2- 172.21.15.59:0/2912159114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39c0109130 0x7f39c0075f20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f39b8005cc0 tx=0x7f39b802f470 comp rx=0 tx=0).stop 2024-09-10T21:14:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.536+0000 7f39c55f4640 1 -- 172.21.15.59:0/2912159114 shutdown_connections 2024-09-10T21:14:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.536+0000 7f39c55f4640 1 --2- 172.21.15.59:0/2912159114 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f39ac0b5370 0x7f39ac0b7830 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.536+0000 7f39c55f4640 1 --2- 172.21.15.59:0/2912159114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39c0109130 0x7f39c0075f20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.536+0000 7f39c55f4640 1 --2- 172.21.15.59:0/2912159114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39c01087b0 0x7f39c00759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.536+0000 7f39c55f4640 1 --2- 172.21.15.59:0/2912159114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c0102da0 0x7f39c00754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.536+0000 7f39c55f4640 1 -- 172.21.15.59:0/2912159114 >> 172.21.15.59:0/2912159114 conn(0x7f39c00fe810 msgr2=0x7f39c00fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:27.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.536+0000 7f39c55f4640 1 -- 172.21.15.59:0/2912159114 shutdown_connections 2024-09-10T21:14:27.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:27.536+0000 7f39c55f4640 1 -- 172.21.15.59:0/2912159114 wait complete. 2024-09-10T21:14:27.864 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:27 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2912159114' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T21:14:27.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:27 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2912159114' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T21:14:28.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:27 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2912159114' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T21:14:28.234 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-10T21:14:28.235 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:14:28.492 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:28.860 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:28 smithi059 ceph-mon[30888]: pgmap v316: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:14:28.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:28 smithi154 ceph-mon[35041]: pgmap v316: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:14:28.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.937+0000 7fe3684b5640 1 -- 172.21.15.59:0/2457877647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe360109150 msgr2=0x7fe36010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:28.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.937+0000 7fe3684b5640 1 --2- 172.21.15.59:0/2457877647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe360109150 0x7fe36010f950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe358009ca0 tx=0x7fe35802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:14:28.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.937+0000 7fe3684b5640 1 -- 172.21.15.59:0/2457877647 shutdown_connections 2024-09-10T21:14:28.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.937+0000 7fe3684b5640 1 --2- 172.21.15.59:0/2457877647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe360109150 0x7fe36010f950 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:28.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.937+0000 7fe3684b5640 1 --2- 172.21.15.59:0/2457877647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3601087d0 0x7fe360108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:28.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.937+0000 7fe3684b5640 1 --2- 172.21.15.59:0/2457877647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe360102dc0 0x7fe3601031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:28.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.937+0000 7fe3684b5640 1 -- 172.21.15.59:0/2457877647 >> 172.21.15.59:0/2457877647 conn(0x7fe3600fe830 msgr2=0x7fe360100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:28.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.937+0000 7fe3684b5640 1 -- 172.21.15.59:0/2457877647 shutdown_connections 2024-09-10T21:14:28.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.937+0000 7fe3684b5640 1 -- 172.21.15.59:0/2457877647 wait complete. 2024-09-10T21:14:28.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.937+0000 7fe3684b5640 1 Processor -- start 2024-09-10T21:14:28.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.937+0000 7fe3684b5640 1 -- start start 2024-09-10T21:14:28.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.937+0000 7fe3684b5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe360102dc0 0x7fe360199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:28.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.937+0000 7fe3684b5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3601087d0 0x7fe3601997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:28.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe3684b5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe360109150 0x7fe36019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:28.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe3684b5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe360112dd0 con 0x7fe3601087d0 2024-09-10T21:14:28.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe3684b5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe360112c50 con 0x7fe360109150 2024-09-10T21:14:28.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe3684b5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe360112f50 con 0x7fe360102dc0 2024-09-10T21:14:28.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe365a50640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3601087d0 0x7fe3601997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:28.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe365a50640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3601087d0 0x7fe3601997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58040/0 (socket says 172.21.15.59:58040) 2024-09-10T21:14:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe365a50640 1 -- 172.21.15.59:0/1769050598 learned_addr learned my addr 172.21.15.59:0/1769050598 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe366a52640 1 --2- 172.21.15.59:0/1769050598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe360109150 0x7fe36019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe366251640 1 --2- 172.21.15.59:0/1769050598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe360102dc0 0x7fe360199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe365a50640 1 -- 172.21.15.59:0/1769050598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe360102dc0 msgr2=0x7fe360199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe365a50640 1 --2- 172.21.15.59:0/1769050598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe360102dc0 0x7fe360199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe365a50640 1 -- 172.21.15.59:0/1769050598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe360109150 msgr2=0x7fe36019eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe365a50640 1 --2- 172.21.15.59:0/1769050598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe360109150 0x7fe36019eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe365a50640 1 -- 172.21.15.59:0/1769050598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe36019f310 con 0x7fe3601087d0 2024-09-10T21:14:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe366a52640 1 --2- 172.21.15.59:0/1769050598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe360109150 0x7fe36019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe365a50640 1 --2- 172.21.15.59:0/1769050598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3601087d0 0x7fe3601997a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe35000d950 tx=0x7fe35000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe3577fe640 1 -- 172.21.15.59:0/1769050598 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe350017070 con 0x7fe3601087d0 2024-09-10T21:14:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe3577fe640 1 -- 172.21.15.59:0/1769050598 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe350009c30 con 0x7fe3601087d0 2024-09-10T21:14:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe3684b5640 1 -- 172.21.15.59:0/1769050598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe36019f600 con 0x7fe3601087d0 2024-09-10T21:14:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe3577fe640 1 -- 172.21.15.59:0/1769050598 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35000f620 con 0x7fe3601087d0 2024-09-10T21:14:28.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.938+0000 7fe3684b5640 1 -- 172.21.15.59:0/1769050598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3601a5cc0 con 0x7fe3601087d0 2024-09-10T21:14:28.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.939+0000 7fe3684b5640 1 -- 172.21.15.59:0/1769050598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3601031a0 con 0x7fe3601087d0 2024-09-10T21:14:28.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.941+0000 7fe3577fe640 1 -- 172.21.15.59:0/1769050598 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fe350010460 con 0x7fe3601087d0 2024-09-10T21:14:28.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.942+0000 7fe3577fe640 1 --2- 172.21.15.59:0/1769050598 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe34c0b5370 0x7fe34c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:28.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.942+0000 7fe366251640 1 --2- 172.21.15.59:0/1769050598 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe34c0b5370 0x7fe34c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:28.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.942+0000 7fe3577fe640 1 -- 172.21.15.59:0/1769050598 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe3500e59a0 con 0x7fe3601087d0 2024-09-10T21:14:28.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.942+0000 7fe366251640 1 --2- 172.21.15.59:0/1769050598 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe34c0b5370 0x7fe34c0b7830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe35c005e10 tx=0x7fe35c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:28.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:28.944+0000 7fe3577fe640 1 -- 172.21.15.59:0/1769050598 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe3500ac730 con 0x7fe3601087d0 2024-09-10T21:14:29.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:28 smithi192 ceph-mon[35363]: pgmap v316: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:14:29.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:29.167+0000 7fe3684b5640 1 -- 172.21.15.59:0/1769050598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe36019a390 con 0x7fe3601087d0 2024-09-10T21:14:29.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:29.168+0000 7fe3577fe640 1 -- 172.21.15.59:0/1769050598 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7fe350009de0 con 0x7fe3601087d0 2024-09-10T21:14:29.173 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:14:29.173 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":27,"btime":"2024-09-10T21:13:30:946868+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:13:30.946837+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24563,24550,24538,24542,24529]},"id":1}]} 2024-09-10T21:14:29.174 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 27 2024-09-10T21:14:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:29.171+0000 7fe3684b5640 1 -- 172.21.15.59:0/1769050598 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe34c0b5370 msgr2=0x7fe34c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:29.171+0000 7fe3684b5640 1 --2- 172.21.15.59:0/1769050598 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe34c0b5370 0x7fe34c0b7830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe35c005e10 tx=0x7fe35c005da0 comp rx=0 tx=0).stop 2024-09-10T21:14:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:29.171+0000 7fe3684b5640 1 -- 172.21.15.59:0/1769050598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3601087d0 msgr2=0x7fe3601997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:29.171+0000 7fe3684b5640 1 --2- 172.21.15.59:0/1769050598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3601087d0 0x7fe3601997a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe35000d950 tx=0x7fe35000de10 comp rx=0 tx=0).stop 2024-09-10T21:14:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:29.171+0000 7fe3684b5640 1 -- 172.21.15.59:0/1769050598 shutdown_connections 2024-09-10T21:14:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:29.171+0000 7fe3684b5640 1 --2- 172.21.15.59:0/1769050598 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe34c0b5370 0x7fe34c0b7830 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:29.171+0000 7fe3684b5640 1 --2- 172.21.15.59:0/1769050598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe360109150 0x7fe36019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:29.171+0000 7fe3684b5640 1 --2- 172.21.15.59:0/1769050598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3601087d0 0x7fe3601997a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:29.171+0000 7fe3684b5640 1 --2- 172.21.15.59:0/1769050598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe360102dc0 0x7fe360199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:29.171+0000 7fe3684b5640 1 -- 172.21.15.59:0/1769050598 >> 172.21.15.59:0/1769050598 conn(0x7fe3600fe830 msgr2=0x7fe3600ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:29.171+0000 7fe3684b5640 1 -- 172.21.15.59:0/1769050598 shutdown_connections 2024-09-10T21:14:29.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:29.171+0000 7fe3684b5640 1 -- 172.21.15.59:0/1769050598 wait complete. 2024-09-10T21:14:29.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:29 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1769050598' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:14:29.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:29 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1769050598' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:14:30.036 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:14:30.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:29 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1769050598' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:14:30.303 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:30.686 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:30 smithi059 ceph-mon[30888]: pgmap v317: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:30.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.764+0000 7fc6529b7640 1 -- 172.21.15.59:0/290441769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc64c1087d0 msgr2=0x7fc64c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.764+0000 7fc6529b7640 1 --2- 172.21.15.59:0/290441769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc64c1087d0 0x7fc64c108c10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc640009900 tx=0x7fc64002a410 comp rx=0 tx=0).stop 2024-09-10T21:14:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.764+0000 7fc6529b7640 1 -- 172.21.15.59:0/290441769 shutdown_connections 2024-09-10T21:14:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.764+0000 7fc6529b7640 1 --2- 172.21.15.59:0/290441769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc64c109150 0x7fc64c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.764+0000 7fc6529b7640 1 --2- 172.21.15.59:0/290441769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc64c1087d0 0x7fc64c108c10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.764+0000 7fc6529b7640 1 --2- 172.21.15.59:0/290441769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64c102dc0 0x7fc64c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.764+0000 7fc6529b7640 1 -- 172.21.15.59:0/290441769 >> 172.21.15.59:0/290441769 conn(0x7fc64c0fe830 msgr2=0x7fc64c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.764+0000 7fc6529b7640 1 -- 172.21.15.59:0/290441769 shutdown_connections 2024-09-10T21:14:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.765+0000 7fc6529b7640 1 -- 172.21.15.59:0/290441769 wait complete. 2024-09-10T21:14:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.765+0000 7fc6529b7640 1 Processor -- start 2024-09-10T21:14:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.765+0000 7fc6529b7640 1 -- start start 2024-09-10T21:14:30.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.765+0000 7fc6529b7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc64c102dc0 0x7fc64c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:30.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc6529b7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc64c1087d0 0x7fc64c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:30.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc6529b7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64c109150 0x7fc64c19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:30.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc6529b7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c112e10 con 0x7fc64c102dc0 2024-09-10T21:14:30.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc6529b7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c112c90 con 0x7fc64c109150 2024-09-10T21:14:30.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc6529b7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c112f90 con 0x7fc64c1087d0 2024-09-10T21:14:30.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc64bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc64c102dc0 0x7fc64c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:30.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc64bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc64c102dc0 0x7fc64c1992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36000/0 (socket says 172.21.15.59:36000) 2024-09-10T21:14:30.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc64bfff640 1 -- 172.21.15.59:0/4102785730 learned_addr learned my addr 172.21.15.59:0/4102785730 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:30.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc64b7fe640 1 --2- 172.21.15.59:0/4102785730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc64c1087d0 0x7fc64c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:30.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc650f54640 1 --2- 172.21.15.59:0/4102785730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64c109150 0x7fc64c19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:30.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc64bfff640 1 -- 172.21.15.59:0/4102785730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc64c1087d0 msgr2=0x7fc64c199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:30.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc64bfff640 1 --2- 172.21.15.59:0/4102785730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc64c1087d0 0x7fc64c199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:30.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc64bfff640 1 -- 172.21.15.59:0/4102785730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64c109150 msgr2=0x7fc64c19ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:30.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc64bfff640 1 --2- 172.21.15.59:0/4102785730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64c109150 0x7fc64c19ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:30.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc64bfff640 1 -- 172.21.15.59:0/4102785730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64c19f390 con 0x7fc64c102dc0 2024-09-10T21:14:30.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc64b7fe640 1 --2- 172.21.15.59:0/4102785730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc64c1087d0 0x7fc64c199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:14:30.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc64bfff640 1 --2- 172.21.15.59:0/4102785730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc64c102dc0 0x7fc64c1992e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00b4a0 tx=0x7fc63c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:30.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc6497fa640 1 -- 172.21.15.59:0/4102785730 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c014070 con 0x7fc64c102dc0 2024-09-10T21:14:30.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc6529b7640 1 -- 172.21.15.59:0/4102785730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc64c19f680 con 0x7fc64c102dc0 2024-09-10T21:14:30.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc6497fa640 1 -- 172.21.15.59:0/4102785730 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc63c010ac0 con 0x7fc64c102dc0 2024-09-10T21:14:30.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc6497fa640 1 -- 172.21.15.59:0/4102785730 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c017c30 con 0x7fc64c102dc0 2024-09-10T21:14:30.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.766+0000 7fc6529b7640 1 -- 172.21.15.59:0/4102785730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc64c1a5dc0 con 0x7fc64c102dc0 2024-09-10T21:14:30.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.767+0000 7fc6529b7640 1 -- 172.21.15.59:0/4102785730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc64c1031a0 con 0x7fc64c102dc0 2024-09-10T21:14:30.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.769+0000 7fc6497fa640 1 -- 172.21.15.59:0/4102785730 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fc63c010610 con 0x7fc64c102dc0 2024-09-10T21:14:30.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.770+0000 7fc6497fa640 1 --2- 172.21.15.59:0/4102785730 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc6340b5370 0x7fc6340b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:30.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.770+0000 7fc64b7fe640 1 --2- 172.21.15.59:0/4102785730 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc6340b5370 0x7fc6340b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:30.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.770+0000 7fc6497fa640 1 -- 172.21.15.59:0/4102785730 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc63c0e5710 con 0x7fc64c102dc0 2024-09-10T21:14:30.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.770+0000 7fc64b7fe640 1 --2- 172.21.15.59:0/4102785730 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc6340b5370 0x7fc6340b7830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc640000c00 tx=0x7fc640031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:30.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.773+0000 7fc6497fa640 1 -- 172.21.15.59:0/4102785730 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc63c0ac440 con 0x7fc64c102dc0 2024-09-10T21:14:30.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:30 smithi154 ceph-mon[35041]: pgmap v317: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:31.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.995+0000 7fc6529b7640 1 -- 172.21.15.59:0/4102785730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc64c02e5c0 con 0x7fc64c102dc0 2024-09-10T21:14:31.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.995+0000 7fc6497fa640 1 -- 172.21.15.59:0/4102785730 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7fc63c0abd40 con 0x7fc64c102dc0 2024-09-10T21:14:31.001 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:14:31.001 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":27,"btime":"2024-09-10T21:13:30:946868+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:13:30.946837+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24563,24550,24538,24542,24529]},"id":1}]} 2024-09-10T21:14:31.001 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 27 2024-09-10T21:14:31.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.998+0000 7fc6529b7640 1 -- 172.21.15.59:0/4102785730 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc6340b5370 msgr2=0x7fc6340b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:31.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.998+0000 7fc6529b7640 1 --2- 172.21.15.59:0/4102785730 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc6340b5370 0x7fc6340b7830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc640000c00 tx=0x7fc640031400 comp rx=0 tx=0).stop 2024-09-10T21:14:31.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.998+0000 7fc6529b7640 1 -- 172.21.15.59:0/4102785730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc64c102dc0 msgr2=0x7fc64c1992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:31.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.998+0000 7fc6529b7640 1 --2- 172.21.15.59:0/4102785730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc64c102dc0 0x7fc64c1992e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00b4a0 tx=0x7fc63c00b960 comp rx=0 tx=0).stop 2024-09-10T21:14:31.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.998+0000 7fc6529b7640 1 -- 172.21.15.59:0/4102785730 shutdown_connections 2024-09-10T21:14:31.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.998+0000 7fc6529b7640 1 --2- 172.21.15.59:0/4102785730 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc6340b5370 0x7fc6340b7830 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:31.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.998+0000 7fc6529b7640 1 --2- 172.21.15.59:0/4102785730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc64c109150 0x7fc64c19ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:31.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.998+0000 7fc6529b7640 1 --2- 172.21.15.59:0/4102785730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc64c1087d0 0x7fc64c199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:31.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.998+0000 7fc6529b7640 1 --2- 172.21.15.59:0/4102785730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc64c102dc0 0x7fc64c1992e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:31.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.998+0000 7fc6529b7640 1 -- 172.21.15.59:0/4102785730 >> 172.21.15.59:0/4102785730 conn(0x7fc64c0fe830 msgr2=0x7fc64c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:31.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.998+0000 7fc6529b7640 1 -- 172.21.15.59:0/4102785730 shutdown_connections 2024-09-10T21:14:31.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:30.998+0000 7fc6529b7640 1 -- 172.21.15.59:0/4102785730 wait complete. 2024-09-10T21:14:31.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:30 smithi192 ceph-mon[35363]: pgmap v317: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:31.665 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:14:31.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:31 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/4102785730' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:14:31.924 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:31.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:31 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/4102785730' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:14:32.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:31 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/4102785730' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:14:32.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.329+0000 7fa439023640 1 -- 172.21.15.59:0/103062974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4341076b0 msgr2=0x7fa434107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:32.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.329+0000 7fa439023640 1 --2- 172.21.15.59:0/103062974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4341076b0 0x7fa434107af0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa428009900 tx=0x7fa42802a410 comp rx=0 tx=0).stop 2024-09-10T21:14:32.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.329+0000 7fa439023640 1 -- 172.21.15.59:0/103062974 shutdown_connections 2024-09-10T21:14:32.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.329+0000 7fa439023640 1 --2- 172.21.15.59:0/103062974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa434108030 0x7fa43410e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:32.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.329+0000 7fa439023640 1 --2- 172.21.15.59:0/103062974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4341076b0 0x7fa434107af0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:32.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.329+0000 7fa439023640 1 --2- 172.21.15.59:0/103062974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa434101ca0 0x7fa434102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:32.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.329+0000 7fa439023640 1 -- 172.21.15.59:0/103062974 >> 172.21.15.59:0/103062974 conn(0x7fa4340fd730 msgr2=0x7fa4340ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:32.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.329+0000 7fa439023640 1 -- 172.21.15.59:0/103062974 shutdown_connections 2024-09-10T21:14:32.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.329+0000 7fa439023640 1 -- 172.21.15.59:0/103062974 wait complete. 2024-09-10T21:14:32.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.330+0000 7fa439023640 1 Processor -- start 2024-09-10T21:14:32.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.331+0000 7fa439023640 1 -- start start 2024-09-10T21:14:32.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.332+0000 7fa439023640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa434101ca0 0x7fa43419a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:32.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.332+0000 7fa439023640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4341076b0 0x7fa43419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:32.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.332+0000 7fa439023640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa434108030 0x7fa43419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:32.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.332+0000 7fa439023640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa434111cf0 con 0x7fa434108030 2024-09-10T21:14:32.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.332+0000 7fa439023640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa434111b70 con 0x7fa434101ca0 2024-09-10T21:14:32.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.332+0000 7fa439023640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa434111e70 con 0x7fa4341076b0 2024-09-10T21:14:32.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.332+0000 7fa43359e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa434108030 0x7fa43419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:32.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.332+0000 7fa432d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa434101ca0 0x7fa43419a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:32.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.332+0000 7fa43359e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa434108030 0x7fa43419ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36020/0 (socket says 172.21.15.59:36020) 2024-09-10T21:14:32.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.332+0000 7fa43359e640 1 -- 172.21.15.59:0/2452461549 learned_addr learned my addr 172.21.15.59:0/2452461549 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:32.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.332+0000 7fa43259c640 1 --2- 172.21.15.59:0/2452461549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4341076b0 0x7fa43419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:32.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.332+0000 7fa43359e640 1 -- 172.21.15.59:0/2452461549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4341076b0 msgr2=0x7fa43419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:32.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.332+0000 7fa43359e640 1 --2- 172.21.15.59:0/2452461549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4341076b0 0x7fa43419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:32.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.332+0000 7fa43359e640 1 -- 172.21.15.59:0/2452461549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa434101ca0 msgr2=0x7fa43419a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:32.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.332+0000 7fa43359e640 1 --2- 172.21.15.59:0/2452461549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa434101ca0 0x7fa43419a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:32.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.332+0000 7fa43359e640 1 -- 172.21.15.59:0/2452461549 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4341a5440 con 0x7fa434108030 2024-09-10T21:14:32.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.333+0000 7fa43359e640 1 --2- 172.21.15.59:0/2452461549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa434108030 0x7fa43419ab00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00b970 tx=0x7fa42c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:32.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.333+0000 7fa41bfff640 1 -- 172.21.15.59:0/2452461549 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42c019070 con 0x7fa434108030 2024-09-10T21:14:32.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.333+0000 7fa439023640 1 -- 172.21.15.59:0/2452461549 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4341a5730 con 0x7fa434108030 2024-09-10T21:14:32.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.333+0000 7fa41bfff640 1 -- 172.21.15.59:0/2452461549 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa42c014440 con 0x7fa434108030 2024-09-10T21:14:32.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.333+0000 7fa439023640 1 -- 172.21.15.59:0/2452461549 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4341a5cc0 con 0x7fa434108030 2024-09-10T21:14:32.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.333+0000 7fa41bfff640 1 -- 172.21.15.59:0/2452461549 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42c0075d0 con 0x7fa434108030 2024-09-10T21:14:32.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.334+0000 7fa439023640 1 -- 172.21.15.59:0/2452461549 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa434102f50 con 0x7fa434108030 2024-09-10T21:14:32.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.335+0000 7fa41bfff640 1 -- 172.21.15.59:0/2452461549 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fa42c0145f0 con 0x7fa434108030 2024-09-10T21:14:32.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.336+0000 7fa41bfff640 1 --2- 172.21.15.59:0/2452461549 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa41c0b5370 0x7fa41c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:32.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.336+0000 7fa432d9d640 1 --2- 172.21.15.59:0/2452461549 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa41c0b5370 0x7fa41c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:32.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.336+0000 7fa41bfff640 1 -- 172.21.15.59:0/2452461549 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa42c0e5910 con 0x7fa434108030 2024-09-10T21:14:32.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.336+0000 7fa432d9d640 1 --2- 172.21.15.59:0/2452461549 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa41c0b5370 0x7fa41c0b7830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa42400abe0 tx=0x7fa42400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:32.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.339+0000 7fa41bfff640 1 -- 172.21.15.59:0/2452461549 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa42c0ac050 con 0x7fa434108030 2024-09-10T21:14:32.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.525+0000 7fa439023640 1 -- 172.21.15.59:0/2452461549 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa43402e5c0 con 0x7fa434108030 2024-09-10T21:14:32.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.526+0000 7fa41bfff640 1 -- 172.21.15.59:0/2452461549 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22633 (secure 0 0 0) 0x7fa42c0b0a80 con 0x7fa434108030 2024-09-10T21:14:32.532 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:14:32.532 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":75,"fsid":"3c26b952-6fb8-11ef-bcea-c7b262605968","created":"2024-09-10T21:05:18.196881+0000","modified":"2024-09-10T21:14:06.297762+0000","last_up_change":"2024-09-10T21:12:31.909004+0000","last_in_change":"2024-09-10T21:12:08.116727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:08:47.611285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:13:15.562661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:13:17.272280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e88abf3-8592-4b5f-8ba9-5969e01e12d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6803","nonce":1237328951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6805","nonce":1237328951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6809","nonce":1237328951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6807","nonce":1237328951}]},"public_addr":"172.21.15.59:6803/1237328951","cluster_addr":"172.21.15.59:6805/1237328951","heartbeat_back_addr":"172.21.15.59:6809/1237328951","heartbeat_front_addr":"172.21.15.59:6807/1237328951","state":["exists","up"]},{"osd":1,"uuid":"7908eefd-bbfa-4fe4-9db9-7a92d0e77acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6801","nonce":3376412264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6803","nonce":3376412264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6807","nonce":3376412264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6805","nonce":3376412264}]},"public_addr":"172.21.15.154:6801/3376412264","cluster_addr":"172.21.15.154:6803/3376412264","heartbeat_back_addr":"172.21.15.154:6807/3376412264","heartbeat_front_addr":"172.21.15.154:6805/3376412264","state":["exists","up"]},{"osd":2,"uuid":"2351b9f0-bca1-48b2-afb8-0e2b7856c52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6801","nonce":440750253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6803","nonce":440750253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6807","nonce":440750253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6805","nonce":440750253}]},"public_addr":"172.21.15.192:6801/440750253","cluster_addr":"172.21.15.192:6803/440750253","heartbeat_back_addr":"172.21.15.192:6807/440750253","heartbeat_front_addr":"172.21.15.192:6805/440750253","state":["exists","up"]},{"osd":3,"uuid":"f26969d1-7b48-4f20-9077-c55c59775ed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6811","nonce":1483798393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6813","nonce":1483798393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6817","nonce":1483798393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6815","nonce":1483798393}]},"public_addr":"172.21.15.59:6811/1483798393","cluster_addr":"172.21.15.59:6813/1483798393","heartbeat_back_addr":"172.21.15.59:6817/1483798393","heartbeat_front_addr":"172.21.15.59:6815/1483798393","state":["exists","up"]},{"osd":4,"uuid":"21e1a472-1ae1-454b-aee5-2ad92f6eff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6809","nonce":1817188525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6811","nonce":1817188525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6815","nonce":1817188525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6813","nonce":1817188525}]},"public_addr":"172.21.15.154:6809/1817188525","cluster_addr":"172.21.15.154:6811/1817188525","heartbeat_back_addr":"172.21.15.154:6815/1817188525","heartbeat_front_addr":"172.21.15.154:6813/1817188525","state":["exists","up"]},{"osd":5,"uuid":"6191b10a-5cbd-4225-b0ec-70d05023d5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6809","nonce":1221386274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6811","nonce":1221386274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6815","nonce":1221386274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6813","nonce":1221386274}]},"public_addr":"172.21.15.192:6809/1221386274","cluster_addr":"172.21.15.192:6811/1221386274","heartbeat_back_addr":"172.21.15.192:6815/1221386274","heartbeat_front_addr":"172.21.15.192:6813/1221386274","state":["exists","up"]},{"osd":6,"uuid":"609c11f7-ce82-4714-bf73-a4f16f4483ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6819","nonce":3006857566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6821","nonce":3006857566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6825","nonce":3006857566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6823","nonce":3006857566}]},"public_addr":"172.21.15.59:6819/3006857566","cluster_addr":"172.21.15.59:6821/3006857566","heartbeat_back_addr":"172.21.15.59:6825/3006857566","heartbeat_front_addr":"172.21.15.59:6823/3006857566","state":["exists","up"]},{"osd":7,"uuid":"bff3a29f-47cc-4e66-92e4-14e9b7faf498","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6817","nonce":175260385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6819","nonce":175260385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6823","nonce":175260385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6821","nonce":175260385}]},"public_addr":"172.21.15.154:6817/175260385","cluster_addr":"172.21.15.154:6819/175260385","heartbeat_back_addr":"172.21.15.154:6823/175260385","heartbeat_front_addr":"172.21.15.154:6821/175260385","state":["exists","up"]},{"osd":8,"uuid":"56dabafd-9bb9-409a-88cd-4b5b5ecf810a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6817","nonce":3138189462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6819","nonce":3138189462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6823","nonce":3138189462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6821","nonce":3138189462}]},"public_addr":"172.21.15.192:6817/3138189462","cluster_addr":"172.21.15.192:6819/3138189462","heartbeat_back_addr":"172.21.15.192:6823/3138189462","heartbeat_front_addr":"172.21.15.192:6821/3138189462","state":["exists","up"]},{"osd":9,"uuid":"044f934d-3df5-47aa-85f5-c3b63b267ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6827","nonce":2446500753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6829","nonce":2446500753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6833","nonce":2446500753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6831","nonce":2446500753}]},"public_addr":"172.21.15.59:6827/2446500753","cluster_addr":"172.21.15.59:6829/2446500753","heartbeat_back_addr":"172.21.15.59:6833/2446500753","heartbeat_front_addr":"172.21.15.59:6831/2446500753","state":["exists","up"]},{"osd":10,"uuid":"8d3b735b-e4fe-4a8e-8c75-a49313c6fabb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6825","nonce":1139781446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6827","nonce":1139781446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6831","nonce":1139781446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6829","nonce":1139781446}]},"public_addr":"172.21.15.154:6825/1139781446","cluster_addr":"172.21.15.154:6827/1139781446","heartbeat_back_addr":"172.21.15.154:6831/1139781446","heartbeat_front_addr":"172.21.15.154:6829/1139781446","state":["exists","up"]},{"osd":11,"uuid":"fd6a6d06-c6aa-42e3-aa38-fc583319f6bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6825","nonce":1041494458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6827","nonce":1041494458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6831","nonce":1041494458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6829","nonce":1041494458}]},"public_addr":"172.21.15.192:6825/1041494458","cluster_addr":"172.21.15.192:6827/1041494458","heartbeat_back_addr":"172.21.15.192:6831/1041494458","heartbeat_front_addr":"172.21.15.192:6829/1041494458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:07:53.974382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:19.552358+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:44.251670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:09.430992+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:34.043343+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:59.903679+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:25.733171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:49.795257+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:14.485648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:40.485165+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:04.655475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:29.308456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/212243638":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/3305207692":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6801/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/2965147556":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/1174570395":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/2934865748":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:6801/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/3377179776":"2024-09-11T21:05:40.304807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:14:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.528+0000 7fa439023640 1 -- 172.21.15.59:0/2452461549 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa41c0b5370 msgr2=0x7fa41c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:32.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.528+0000 7fa439023640 1 --2- 172.21.15.59:0/2452461549 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa41c0b5370 0x7fa41c0b7830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa42400abe0 tx=0x7fa42400a2d0 comp rx=0 tx=0).stop 2024-09-10T21:14:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.528+0000 7fa439023640 1 -- 172.21.15.59:0/2452461549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa434108030 msgr2=0x7fa43419ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.528+0000 7fa439023640 1 --2- 172.21.15.59:0/2452461549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa434108030 0x7fa43419ab00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00b970 tx=0x7fa42c00bd70 comp rx=0 tx=0).stop 2024-09-10T21:14:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.528+0000 7fa439023640 1 -- 172.21.15.59:0/2452461549 shutdown_connections 2024-09-10T21:14:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.528+0000 7fa439023640 1 --2- 172.21.15.59:0/2452461549 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa41c0b5370 0x7fa41c0b7830 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.528+0000 7fa439023640 1 --2- 172.21.15.59:0/2452461549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa434108030 0x7fa43419ab00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.528+0000 7fa439023640 1 --2- 172.21.15.59:0/2452461549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4341076b0 0x7fa43419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.528+0000 7fa439023640 1 --2- 172.21.15.59:0/2452461549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa434101ca0 0x7fa43419a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.528+0000 7fa439023640 1 -- 172.21.15.59:0/2452461549 >> 172.21.15.59:0/2452461549 conn(0x7fa4340fd730 msgr2=0x7fa4340ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.528+0000 7fa439023640 1 -- 172.21.15.59:0/2452461549 shutdown_connections 2024-09-10T21:14:32.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:32.529+0000 7fa439023640 1 -- 172.21.15.59:0/2452461549 wait complete. 2024-09-10T21:14:32.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:32 smithi154 ceph-mon[35041]: pgmap v318: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:14:32.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:32 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2452461549' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:14:33.069 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:32 smithi059 ceph-mon[30888]: pgmap v318: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:14:33.069 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:32 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2452461549' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:14:33.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:32 smithi192 ceph-mon[35363]: pgmap v318: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:14:33.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:32 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2452461549' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:14:33.240 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:14:33.500 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.924+0000 7f3e0ba23640 1 -- 172.21.15.59:0/2932609884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e0410a920 msgr2=0x7f3e0410cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.924+0000 7f3e0ba23640 1 --2- 172.21.15.59:0/2932609884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e0410a920 0x7f3e0410cd10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009900 tx=0x7f3df402a410 comp rx=0 tx=0).stop 2024-09-10T21:14:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.924+0000 7f3e0ba23640 1 -- 172.21.15.59:0/2932609884 shutdown_connections 2024-09-10T21:14:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.924+0000 7f3e0ba23640 1 --2- 172.21.15.59:0/2932609884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e0410d250 0x7f3e0410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.924+0000 7f3e0ba23640 1 --2- 172.21.15.59:0/2932609884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e0410a920 0x7f3e0410cd10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.924+0000 7f3e0ba23640 1 --2- 172.21.15.59:0/2932609884 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e04101810 0x7f3e04101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.924+0000 7f3e0ba23640 1 -- 172.21.15.59:0/2932609884 >> 172.21.15.59:0/2932609884 conn(0x7f3e04076f50 msgr2=0x7f3e04077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.924+0000 7f3e0ba23640 1 -- 172.21.15.59:0/2932609884 shutdown_connections 2024-09-10T21:14:33.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.924+0000 7f3e0ba23640 1 -- 172.21.15.59:0/2932609884 wait complete. 2024-09-10T21:14:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.924+0000 7f3e0ba23640 1 Processor -- start 2024-09-10T21:14:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.925+0000 7f3e0ba23640 1 -- start start 2024-09-10T21:14:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.925+0000 7f3e0ba23640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e04101810 0x7f3e04199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.925+0000 7f3e0ba23640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e0410a920 0x7f3e041997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.925+0000 7f3e0ba23640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e0410d250 0x7f3e0419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.925+0000 7f3e0ba23640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3e04112d50 con 0x7f3e04101810 2024-09-10T21:14:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.925+0000 7f3e0ba23640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3e04112bd0 con 0x7f3e0410d250 2024-09-10T21:14:33.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.925+0000 7f3e0ba23640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3e04112ed0 con 0x7f3e0410a920 2024-09-10T21:14:33.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.925+0000 7f3e097bf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e04101810 0x7f3e04199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:33.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.925+0000 7f3e097bf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e04101810 0x7f3e04199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36026/0 (socket says 172.21.15.59:36026) 2024-09-10T21:14:33.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.925+0000 7f3e097bf640 1 -- 172.21.15.59:0/2614176908 learned_addr learned my addr 172.21.15.59:0/2614176908 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:33.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.925+0000 7f3e09fc0640 1 --2- 172.21.15.59:0/2614176908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e0410d250 0x7f3e0419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:33.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.925+0000 7f3e08fbe640 1 --2- 172.21.15.59:0/2614176908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e0410a920 0x7f3e041997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:33.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.925+0000 7f3e097bf640 1 -- 172.21.15.59:0/2614176908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e0410a920 msgr2=0x7f3e041997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:33.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.925+0000 7f3e097bf640 1 --2- 172.21.15.59:0/2614176908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e0410a920 0x7f3e041997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:33.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.925+0000 7f3e097bf640 1 -- 172.21.15.59:0/2614176908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e0410d250 msgr2=0x7f3e0419eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:33.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.925+0000 7f3e097bf640 1 --2- 172.21.15.59:0/2614176908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e0410d250 0x7f3e0419eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:33.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.925+0000 7f3e097bf640 1 -- 172.21.15.59:0/2614176908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0419f310 con 0x7f3e04101810 2024-09-10T21:14:33.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.925+0000 7f3e097bf640 1 --2- 172.21.15.59:0/2614176908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e04101810 0x7f3e04199260 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000c920 tx=0x7f3e0000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:33.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.925+0000 7f3dfa7fc640 1 -- 172.21.15.59:0/2614176908 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00007c70 con 0x7f3e04101810 2024-09-10T21:14:33.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.926+0000 7f3dfa7fc640 1 -- 172.21.15.59:0/2614176908 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e00007e10 con 0x7f3e04101810 2024-09-10T21:14:33.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.926+0000 7f3e0ba23640 1 -- 172.21.15.59:0/2614176908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0419f600 con 0x7f3e04101810 2024-09-10T21:14:33.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.926+0000 7f3dfa7fc640 1 -- 172.21.15.59:0/2614176908 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00018820 con 0x7f3e04101810 2024-09-10T21:14:33.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.926+0000 7f3e0ba23640 1 -- 172.21.15.59:0/2614176908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e041a5e90 con 0x7f3e04101810 2024-09-10T21:14:33.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.926+0000 7f3e0ba23640 1 -- 172.21.15.59:0/2614176908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e04101bf0 con 0x7f3e04101810 2024-09-10T21:14:33.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.929+0000 7f3dfa7fc640 1 -- 172.21.15.59:0/2614176908 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3e0000f450 con 0x7f3e04101810 2024-09-10T21:14:33.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.929+0000 7f3dfa7fc640 1 --2- 172.21.15.59:0/2614176908 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3df00b53f0 0x7f3df00b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:33.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.930+0000 7f3e08fbe640 1 --2- 172.21.15.59:0/2614176908 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3df00b53f0 0x7f3df00b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:33.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.930+0000 7f3dfa7fc640 1 -- 172.21.15.59:0/2614176908 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3e000e6100 con 0x7f3e04101810 2024-09-10T21:14:33.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.930+0000 7f3e08fbe640 1 --2- 172.21.15.59:0/2614176908 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3df00b53f0 0x7f3df00b78b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3df4031440 tx=0x7f3df40095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:33.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:33.932+0000 7f3dfa7fc640 1 -- 172.21.15.59:0/2614176908 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3e00014030 con 0x7f3e04101810 2024-09-10T21:14:34.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:34.155+0000 7f3e0ba23640 1 -- 172.21.15.59:0/2614176908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e0419a390 con 0x7f3e04101810 2024-09-10T21:14:34.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:34.155+0000 7f3dfa7fc640 1 -- 172.21.15.59:0/2614176908 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7f3e0419a390 con 0x7f3e04101810 2024-09-10T21:14:34.160 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:14:34.161 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":27,"btime":"2024-09-10T21:13:30:946868+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:13:30.946837+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24563,24550,24538,24542,24529]},"id":1}]} 2024-09-10T21:14:34.161 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 27 2024-09-10T21:14:34.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:34.157+0000 7f3e0ba23640 1 -- 172.21.15.59:0/2614176908 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3df00b53f0 msgr2=0x7f3df00b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:34.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:34.157+0000 7f3e0ba23640 1 --2- 172.21.15.59:0/2614176908 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3df00b53f0 0x7f3df00b78b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3df4031440 tx=0x7f3df40095f0 comp rx=0 tx=0).stop 2024-09-10T21:14:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:34.157+0000 7f3e0ba23640 1 -- 172.21.15.59:0/2614176908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e04101810 msgr2=0x7f3e04199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:34.157+0000 7f3e0ba23640 1 --2- 172.21.15.59:0/2614176908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e04101810 0x7f3e04199260 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000c920 tx=0x7f3e0000cde0 comp rx=0 tx=0).stop 2024-09-10T21:14:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:34.157+0000 7f3e0ba23640 1 -- 172.21.15.59:0/2614176908 shutdown_connections 2024-09-10T21:14:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:34.157+0000 7f3e0ba23640 1 --2- 172.21.15.59:0/2614176908 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3df00b53f0 0x7f3df00b78b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:34.157+0000 7f3e0ba23640 1 --2- 172.21.15.59:0/2614176908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e0410d250 0x7f3e0419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:34.157+0000 7f3e0ba23640 1 --2- 172.21.15.59:0/2614176908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e0410a920 0x7f3e041997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:34.157+0000 7f3e0ba23640 1 --2- 172.21.15.59:0/2614176908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e04101810 0x7f3e04199260 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:34.157+0000 7f3e0ba23640 1 -- 172.21.15.59:0/2614176908 >> 172.21.15.59:0/2614176908 conn(0x7f3e04076f50 msgr2=0x7f3e041005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:34.157+0000 7f3e0ba23640 1 -- 172.21.15.59:0/2614176908 shutdown_connections 2024-09-10T21:14:34.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:34.158+0000 7f3e0ba23640 1 -- 172.21.15.59:0/2614176908 wait complete. 2024-09-10T21:14:34.838 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T21:13:19.283837+0000', 'modified': '2024-09-10T21:13:30.946837+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24563, 'mds_1': 24550, 'mds_2': 24542, 'mds_3': 24538, 'mds_4': 24529}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14703': {'gid': 14703, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.59:6839/4138885833', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6838', 'nonce': 4138885833}, {'type': 'v1', 'addr': '172.21.15.59:6839', 'nonce': 4138885833}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14709': {'gid': 14709, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.59:6841/1675735841', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6840', 'nonce': 1675735841}, {'type': 'v1', 'addr': '172.21.15.59:6841', 'nonce': 1675735841}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.192:6833/2513372486', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6832', 'nonce': 2513372486}, {'type': 'v1', 'addr': '172.21.15.192:6833', 'nonce': 2513372486}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24503': {'gid': 24503, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6833/2006948406', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 2006948406}, {'type': 'v1', 'addr': '172.21.15.154:6833', 'nonce': 2006948406}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24524': {'gid': 24524, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6835/294213384', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 294213384}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 294213384}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24529': {'gid': 24529, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.192:6835/3608050805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6834', 'nonce': 3608050805}, {'type': 'v1', 'addr': '172.21.15.192:6835', 'nonce': 3608050805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24538': {'gid': 24538, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.192:6837/266289113', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6836', 'nonce': 266289113}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 266289113}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24542': {'gid': 24542, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.154:6837/3954687054', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 3954687054}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 3954687054}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24550': {'gid': 24550, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.192:6839/677733026', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6838', 'nonce': 677733026}, {'type': 'v1', 'addr': '172.21.15.192:6839', 'nonce': 677733026}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24563': {'gid': 24563, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.154:6839/3664432388', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 3664432388}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 3664432388}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24563, 'qdb_cluster': [24563, 24550, 24538, 24542, 24529]} 2024-09-10T21:14:34.838 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-10T21:14:34.839 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-10T21:14:34.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:34 smithi154 ceph-mon[35041]: pgmap v319: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:14:34.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:34 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2614176908' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:14:35.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:34 smithi192 ceph-mon[35363]: pgmap v319: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:14:35.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:34 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2614176908' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:14:35.099 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:35.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:34 smithi059 ceph-mon[30888]: pgmap v319: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:14:35.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:34 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2614176908' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:14:35.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.599+0000 7f8750e61640 1 -- 172.21.15.59:0/3992735038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f874c103ca0 msgr2=0x7f874c104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:35.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.599+0000 7f8750e61640 1 --2- 172.21.15.59:0/3992735038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f874c103ca0 0x7f874c104080 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f873c009900 tx=0x7f873c02a410 comp rx=0 tx=0).stop 2024-09-10T21:14:35.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.599+0000 7f8750e61640 1 -- 172.21.15.59:0/3992735038 shutdown_connections 2024-09-10T21:14:35.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.599+0000 7f8750e61640 1 --2- 172.21.15.59:0/3992735038 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f874c10d100 0x7f874c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.599+0000 7f8750e61640 1 --2- 172.21.15.59:0/3992735038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874c1045c0 0x7f874c10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.599+0000 7f8750e61640 1 --2- 172.21.15.59:0/3992735038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f874c103ca0 0x7f874c104080 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.599+0000 7f8750e61640 1 -- 172.21.15.59:0/3992735038 >> 172.21.15.59:0/3992735038 conn(0x7f874c0fd700 msgr2=0x7f874c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:35.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.599+0000 7f8750e61640 1 -- 172.21.15.59:0/3992735038 shutdown_connections 2024-09-10T21:14:35.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.599+0000 7f8750e61640 1 -- 172.21.15.59:0/3992735038 wait complete. 2024-09-10T21:14:35.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.600+0000 7f8750e61640 1 Processor -- start 2024-09-10T21:14:35.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.600+0000 7f8750e61640 1 -- start start 2024-09-10T21:14:35.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.600+0000 7f8750e61640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f874c103ca0 0x7f874c10beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:35.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.600+0000 7f8750e61640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874c1045c0 0x7f874c10c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:35.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.600+0000 7f8750e61640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f874c10d100 0x7f874c1a5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:35.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.600+0000 7f8750e61640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f874c112e50 con 0x7f874c103ca0 2024-09-10T21:14:35.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.600+0000 7f8750e61640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f874c112cd0 con 0x7f874c1045c0 2024-09-10T21:14:35.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.600+0000 7f8750e61640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f874c112fd0 con 0x7f874c10d100 2024-09-10T21:14:35.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.600+0000 7f874a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f874c103ca0 0x7f874c10beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:35.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.600+0000 7f874a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f874c103ca0 0x7f874c10beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36044/0 (socket says 172.21.15.59:36044) 2024-09-10T21:14:35.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.600+0000 7f874a59c640 1 -- 172.21.15.59:0/1728653369 learned_addr learned my addr 172.21.15.59:0/1728653369 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:35.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.601+0000 7f8743fff640 1 --2- 172.21.15.59:0/1728653369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874c1045c0 0x7f874c10c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:35.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.601+0000 7f874ad9d640 1 --2- 172.21.15.59:0/1728653369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f874c10d100 0x7f874c1a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:35.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.601+0000 7f874a59c640 1 -- 172.21.15.59:0/1728653369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f874c10d100 msgr2=0x7f874c1a5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:35.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.601+0000 7f874a59c640 1 --2- 172.21.15.59:0/1728653369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f874c10d100 0x7f874c1a5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.601+0000 7f874a59c640 1 -- 172.21.15.59:0/1728653369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874c1045c0 msgr2=0x7f874c10c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:35.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.601+0000 7f874a59c640 1 --2- 172.21.15.59:0/1728653369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874c1045c0 0x7f874c10c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.601+0000 7f874a59c640 1 -- 172.21.15.59:0/1728653369 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874c1a5aa0 con 0x7f874c103ca0 2024-09-10T21:14:35.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.601+0000 7f8743fff640 1 --2- 172.21.15.59:0/1728653369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874c1045c0 0x7f874c10c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:35.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.601+0000 7f874a59c640 1 --2- 172.21.15.59:0/1728653369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f874c103ca0 0x7f874c10beb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f873c006010 tx=0x7f873c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:35.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.601+0000 7f87437fe640 1 -- 172.21.15.59:0/1728653369 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c03f030 con 0x7f874c103ca0 2024-09-10T21:14:35.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.601+0000 7f87437fe640 1 -- 172.21.15.59:0/1728653369 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f873c003800 con 0x7f874c103ca0 2024-09-10T21:14:35.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.601+0000 7f8750e61640 1 -- 172.21.15.59:0/1728653369 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f874c1a5d30 con 0x7f874c103ca0 2024-09-10T21:14:35.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.601+0000 7f87437fe640 1 -- 172.21.15.59:0/1728653369 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c035070 con 0x7f874c103ca0 2024-09-10T21:14:35.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.601+0000 7f8750e61640 1 -- 172.21.15.59:0/1728653369 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f874c1ac4a0 con 0x7f874c103ca0 2024-09-10T21:14:35.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.604+0000 7f8753236740 1 Processor -- start 2024-09-10T21:14:35.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.604+0000 7f87437fe640 1 -- 172.21.15.59:0/1728653369 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f873c031b10 con 0x7f874c103ca0 2024-09-10T21:14:35.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.604+0000 7f8753236740 1 -- start start 2024-09-10T21:14:35.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.604+0000 7f8753236740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23add30 0x55aad23ae110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:35.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.604+0000 7f8753236740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aad23ae650 0x55aad23ba0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:35.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.604+0000 7f8753236740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23ba5e0 0x55aad23bc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:35.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.604+0000 7f8753236740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55aad2325c10 con 0x55aad23add30 2024-09-10T21:14:35.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.604+0000 7f8753236740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55aad2315040 con 0x55aad23ba5e0 2024-09-10T21:14:35.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.604+0000 7f8753236740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55aad2318e50 con 0x55aad23ae650 2024-09-10T21:14:35.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.604+0000 7f874ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23add30 0x55aad23ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.604+0000 7f874ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23add30 0x55aad23ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36054/0 (socket says 172.21.15.59:36054) 2024-09-10T21:14:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.604+0000 7f874ad9d640 1 -- 172.21.15.59:0/1324258740 learned_addr learned my addr 172.21.15.59:0/1324258740 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.604+0000 7f8743fff640 1 --2- 172.21.15.59:0/1324258740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23ba5e0 0x55aad23bc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.604+0000 7f874a59c640 1 --2- 172.21.15.59:0/1324258740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aad23ae650 0x55aad23ba0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.605+0000 7f874ad9d640 1 -- 172.21.15.59:0/1324258740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aad23ae650 msgr2=0x55aad23ba0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.605+0000 7f874ad9d640 1 --2- 172.21.15.59:0/1324258740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aad23ae650 0x55aad23ba0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.605+0000 7f874ad9d640 1 -- 172.21.15.59:0/1324258740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23ba5e0 msgr2=0x55aad23bc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.605+0000 7f874ad9d640 1 --2- 172.21.15.59:0/1324258740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23ba5e0 0x55aad23bc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.605+0000 7f874ad9d640 1 -- 172.21.15.59:0/1324258740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aad2073540 con 0x55aad23add30 2024-09-10T21:14:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.605+0000 7f87437fe640 1 --2- 172.21.15.59:0/1728653369 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f87380b5370 0x7f87380b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.605+0000 7f874a59c640 1 --2- 172.21.15.59:0/1728653369 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f87380b5370 0x7f87380b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.605+0000 7f874ad9d640 1 --2- 172.21.15.59:0/1324258740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23add30 0x55aad23ae110 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8744009f50 tx=0x7f874400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583189c6d7d40996 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.605+0000 7f87437fe640 1 -- 172.21.15.59:0/1728653369 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f873c106770 con 0x7f874c103ca0 2024-09-10T21:14:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.605+0000 7f8740ff9640 1 -- 172.21.15.59:0/1324258740 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874401a070 con 0x55aad23add30 2024-09-10T21:14:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.605+0000 7f8740ff9640 1 -- 172.21.15.59:0/1324258740 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87440158c0 con 0x55aad23add30 2024-09-10T21:14:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.605+0000 7f8740ff9640 1 -- 172.21.15.59:0/1324258740 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874400a860 con 0x55aad23add30 2024-09-10T21:14:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.606+0000 7f8753236740 1 -- 172.21.15.59:0/1324258740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23add30 msgr2=0x55aad23ae110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.606+0000 7f874a59c640 1 --2- 172.21.15.59:0/1728653369 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f87380b5370 0x7f87380b7830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55aad23b0eb0 tx=0x7f873c10c530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.606+0000 7f8753236740 1 --2- 172.21.15.59:0/1324258740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23add30 0x55aad23ae110 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8744009f50 tx=0x7f874400c8b0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.606+0000 7f8753236740 1 -- 172.21.15.59:0/1324258740 shutdown_connections 2024-09-10T21:14:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.606+0000 7f8753236740 1 --2- 172.21.15.59:0/1324258740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23ba5e0 0x55aad23bc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.606+0000 7f8753236740 1 --2- 172.21.15.59:0/1324258740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aad23ae650 0x55aad23ba0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.606+0000 7f8753236740 1 --2- 172.21.15.59:0/1324258740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23add30 0x55aad23ae110 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.606+0000 7f8753236740 1 -- 172.21.15.59:0/1324258740 >> 172.21.15.59:0/1324258740 conn(0x55aad23abb60 msgr2=0x55aad23acd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.606+0000 7f8753236740 1 -- 172.21.15.59:0/1324258740 shutdown_connections 2024-09-10T21:14:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.606+0000 7f8753236740 1 -- 172.21.15.59:0/1324258740 wait complete. 2024-09-10T21:14:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.606+0000 7f8753236740 1 -- start start 2024-09-10T21:14:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.606+0000 7f8753236740 1 Processor -- start 2024-09-10T21:14:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.607+0000 7f8753236740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aad23add30 0x55aad23b75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.607+0000 7f8753236740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23ae650 0x55aad23b7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.607+0000 7f8753236740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ba5e0 0x55aad23b8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:35.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.607+0000 7f8753236740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55aad21765f0 con 0x55aad23ba5e0 2024-09-10T21:14:35.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.607+0000 7f8753236740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55aad22b0010 con 0x55aad23ae650 2024-09-10T21:14:35.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.607+0000 7f8753236740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55aad23bd290 con 0x55aad23add30 2024-09-10T21:14:35.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.607+0000 7f8753236740 10 client.0 _ll_register_callbacks cb 0x55aad230f340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:14:35.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.607+0000 7f874ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ba5e0 0x55aad23b8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:35.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.607+0000 7f874ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ba5e0 0x55aad23b8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36070/0 (socket says 172.21.15.59:36070) 2024-09-10T21:14:35.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.607+0000 7f874ad9d640 1 -- 172.21.15.59:0/150278233 learned_addr learned my addr 172.21.15.59:0/150278233 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:35.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.607+0000 7f8743fff640 1 --2- 172.21.15.59:0/150278233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23ae650 0x55aad23b7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:35.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.607+0000 7f874ad9d640 1 --2- 172.21.15.59:0/150278233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aad23add30 0x55aad23b75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:35.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.607+0000 7f874ad9d640 1 -- 172.21.15.59:0/150278233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aad23add30 msgr2=0x55aad23b75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:35.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.607+0000 7f874ad9d640 1 --2- 172.21.15.59:0/150278233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aad23add30 0x55aad23b75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.607+0000 7f874ad9d640 1 -- 172.21.15.59:0/150278233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23ae650 msgr2=0x55aad23b7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.607+0000 7f874ad9d640 1 --2- 172.21.15.59:0/150278233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23ae650 0x55aad23b7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.607+0000 7f874ad9d640 1 -- 172.21.15.59:0/150278233 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aad22dda00 con 0x55aad23ba5e0 2024-09-10T21:14:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.607+0000 7f8743fff640 1 --2- 172.21.15.59:0/150278233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23ae650 0x55aad23b7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:14:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.608+0000 7f874ad9d640 1 --2- 172.21.15.59:0/150278233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ba5e0 0x55aad23b8050 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f874400a9b0 tx=0x7f874400a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f6cdc8c2a614d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.608+0000 7f8731ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:14:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.608+0000 7f8731ffb640 1 -- 172.21.15.59:0/150278233 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744029060 con 0x55aad23ba5e0 2024-09-10T21:14:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.608+0000 7f8731ffb640 1 -- 172.21.15.59:0/150278233 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8744015c80 con 0x55aad23ba5e0 2024-09-10T21:14:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.608+0000 7f8753236740 1 -- 172.21.15.59:0/150278233 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87440158c0 con 0x55aad23ba5e0 2024-09-10T21:14:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.608+0000 7f8731ffb640 1 -- 172.21.15.59:0/150278233 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f874401a030 con 0x55aad23ba5e0 2024-09-10T21:14:35.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.608+0000 7f8753236740 10 client.15072 fetch_fsmap learned FSMap version 27 2024-09-10T21:14:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.608+0000 7f8753236740 1 -- 172.21.15.59:0/150278233 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55aad23c8ea0 con 0x55aad23ba5e0 2024-09-10T21:14:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.608+0000 7f8731ffb640 1 -- 172.21.15.59:0/150278233 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87440158c0 con 0x55aad23ba5e0 2024-09-10T21:14:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.608+0000 7f8731ffb640 1 -- 172.21.15.59:0/150278233 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f874402f9b0 con 0x55aad23ba5e0 2024-09-10T21:14:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.608+0000 7f8753236740 10 client.15072 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:14:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.608+0000 7f8753236740 10 client.15072 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T21:14:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.608+0000 7f8753236740 20 client.15072 populate_metadata read hostname 'smithi059' 2024-09-10T21:14:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.608+0000 7f8753236740 1 --2- 172.21.15.59:0/150278233 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55aad23ca2b0 0x55aad23cc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.608+0000 7f8753236740 4 client.15072 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:14:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.608+0000 7f8753236740 1 -- 172.21.15.59:0/150278233 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aad2327b60 con 0x55aad23ca2b0 2024-09-10T21:14:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.609+0000 7f8743fff640 1 --2- 172.21.15.59:0/150278233 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55aad23ca2b0 0x55aad23cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:35.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.609+0000 7f8743fff640 1 --2- 172.21.15.59:0/150278233 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55aad23ca2b0 0x55aad23cc490 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6b3dd131a1ec830e server_cookie=20c6cc38b3f896c0 in_seq=0 out_seq=0 2024-09-10T21:14:35.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.609+0000 7f8731ffb640 10 client.15072 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:14:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.610+0000 7f8731ffb640 1 -- 172.21.15.59:0/150278233 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aad2327b60 con 0x55aad23ca2b0 2024-09-10T21:14:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.610+0000 7f8731ffb640 10 client.15072 handle_command_reply: tid=0 2024-09-10T21:14:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.610+0000 7f8753236740 1 client.15072 shutdown 2024-09-10T21:14:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.610+0000 7f8753236740 1 -- 172.21.15.59:0/150278233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ba5e0 msgr2=0x55aad23b8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.610+0000 7f8753236740 1 --2- 172.21.15.59:0/150278233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ba5e0 0x55aad23b8050 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f874400a9b0 tx=0x7f874400a400 comp rx=0 tx=0).stop 2024-09-10T21:14:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.610+0000 7f8753236740 1 -- 172.21.15.59:0/150278233 shutdown_connections 2024-09-10T21:14:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.610+0000 7f8753236740 1 --2- 172.21.15.59:0/150278233 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55aad23ca2b0 0x55aad23cc490 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.610+0000 7f8753236740 1 --2- 172.21.15.59:0/150278233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ba5e0 0x55aad23b8050 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.610+0000 7f8753236740 1 --2- 172.21.15.59:0/150278233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23ae650 0x55aad23b7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.610+0000 7f8731ffb640 0 client.15072 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:14:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.610+0000 7f8753236740 1 --2- 172.21.15.59:0/150278233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aad23add30 0x55aad23b75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.610+0000 7f8753236740 1 -- 172.21.15.59:0/150278233 >> 172.21.15.59:0/150278233 conn(0x55aad23abb60 msgr2=0x55aad23b1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.611+0000 7f8753236740 1 -- 172.21.15.59:0/150278233 shutdown_connections 2024-09-10T21:14:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.611+0000 7f8753236740 1 -- 172.21.15.59:0/150278233 wait complete. 2024-09-10T21:14:35.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.611+0000 7f8753236740 20 client.15072 trim_cache size 0 max 16384 2024-09-10T21:14:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.629+0000 7f8753236740 1 Processor -- start 2024-09-10T21:14:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.629+0000 7f8753236740 1 -- start start 2024-09-10T21:14:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.629+0000 7f8753236740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aad23add30 0x55aad23cc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.629+0000 7f8753236740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ae650 0x55aad23a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.629+0000 7f8753236740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23ba5e0 0x55aad23b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.629+0000 7f8753236740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55aad23ca7d0 con 0x55aad23ae650 2024-09-10T21:14:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.629+0000 7f8753236740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55aad23caea0 con 0x55aad23ba5e0 2024-09-10T21:14:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.629+0000 7f8753236740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55aad23cb570 con 0x55aad23add30 2024-09-10T21:14:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.629+0000 7f8743fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ae650 0x55aad23a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.629+0000 7f8743fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ae650 0x55aad23a6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36072/0 (socket says 172.21.15.59:36072) 2024-09-10T21:14:35.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.629+0000 7f8743fff640 1 -- 172.21.15.59:0/296892831 learned_addr learned my addr 172.21.15.59:0/296892831 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:35.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.629+0000 7f8743fff640 1 -- 172.21.15.59:0/296892831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aad23add30 msgr2=0x55aad23cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:35.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.629+0000 7f8743fff640 1 --2- 172.21.15.59:0/296892831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aad23add30 0x55aad23cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.629+0000 7f8743fff640 1 -- 172.21.15.59:0/296892831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23ba5e0 msgr2=0x55aad23b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:35.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.629+0000 7f8743fff640 1 --2- 172.21.15.59:0/296892831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23ba5e0 0x55aad23b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.629+0000 7f8743fff640 1 -- 172.21.15.59:0/296892831 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aad23ac5e0 con 0x55aad23ae650 2024-09-10T21:14:35.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.630+0000 7f8743fff640 1 --2- 172.21.15.59:0/296892831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ae650 0x55aad23a6c00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55aad23adce0 tx=0x7f87340047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7801d31b9f8fdbca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:35.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.630+0000 7f8733fff640 1 -- 172.21.15.59:0/296892831 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8734016d70 con 0x55aad23ae650 2024-09-10T21:14:35.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.630+0000 7f8733fff640 1 -- 172.21.15.59:0/296892831 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8734020030 con 0x55aad23ae650 2024-09-10T21:14:35.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.630+0000 7f8733fff640 1 -- 172.21.15.59:0/296892831 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87340143b0 con 0x55aad23ae650 2024-09-10T21:14:35.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.630+0000 7f8753236740 1 -- 172.21.15.59:0/296892831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ae650 msgr2=0x55aad23a6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:35.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.630+0000 7f8753236740 1 --2- 172.21.15.59:0/296892831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ae650 0x55aad23a6c00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55aad23adce0 tx=0x7f87340047d0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.630+0000 7f8753236740 1 -- 172.21.15.59:0/296892831 shutdown_connections 2024-09-10T21:14:35.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.630+0000 7f8753236740 1 --2- 172.21.15.59:0/296892831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23ba5e0 0x55aad23b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.630+0000 7f8753236740 1 --2- 172.21.15.59:0/296892831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ae650 0x55aad23a6c00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.630+0000 7f8753236740 1 --2- 172.21.15.59:0/296892831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aad23add30 0x55aad23cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.630+0000 7f8753236740 1 -- 172.21.15.59:0/296892831 >> 172.21.15.59:0/296892831 conn(0x55aad23abb60 msgr2=0x55aad23b5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:35.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.631+0000 7f8753236740 1 -- 172.21.15.59:0/296892831 shutdown_connections 2024-09-10T21:14:35.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.631+0000 7f8753236740 1 -- 172.21.15.59:0/296892831 wait complete. 2024-09-10T21:14:35.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.631+0000 7f8753236740 1 -- start start 2024-09-10T21:14:35.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.631+0000 7f8753236740 1 Processor -- start 2024-09-10T21:14:35.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.631+0000 7f8753236740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23add30 0x55aad23c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:35.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.631+0000 7f8753236740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ae650 0x55aad23d4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:35.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.631+0000 7f8753236740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aad23ba5e0 0x55aad23d4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:35.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.631+0000 7f8753236740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55aad23cc310 con 0x55aad23ae650 2024-09-10T21:14:35.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.631+0000 7f8753236740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55aad23cbc40 con 0x55aad23add30 2024-09-10T21:14:35.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.631+0000 7f8753236740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55aad23cc9e0 con 0x55aad23ba5e0 2024-09-10T21:14:35.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.631+0000 7f8753236740 10 client.0 _ll_register_callbacks cb 0x7f8744018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:14:35.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.631+0000 7f8743fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ae650 0x55aad23d4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:35.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.631+0000 7f874ad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23add30 0x55aad23c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:35.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.631+0000 7f8743fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ae650 0x55aad23d4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36074/0 (socket says 172.21.15.59:36074) 2024-09-10T21:14:35.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.631+0000 7f8743fff640 1 -- 172.21.15.59:0/3680657920 learned_addr learned my addr 172.21.15.59:0/3680657920 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:35.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.631+0000 7f874ad9d640 1 --2- 172.21.15.59:0/3680657920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aad23ba5e0 0x55aad23d4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:35.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.632+0000 7f8743fff640 1 -- 172.21.15.59:0/3680657920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aad23ba5e0 msgr2=0x55aad23d4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:35.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.632+0000 7f8743fff640 1 --2- 172.21.15.59:0/3680657920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aad23ba5e0 0x55aad23d4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.632+0000 7f8743fff640 1 -- 172.21.15.59:0/3680657920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23add30 msgr2=0x55aad23c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:35.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.632+0000 7f8743fff640 1 --2- 172.21.15.59:0/3680657920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23add30 0x55aad23c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.632+0000 7f8743fff640 1 -- 172.21.15.59:0/3680657920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aad23aa4e0 con 0x55aad23ae650 2024-09-10T21:14:35.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.632+0000 7f8743fff640 1 --2- 172.21.15.59:0/3680657920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ae650 0x55aad23d4810 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8734004700 tx=0x7f87340243d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42f4ece2b02e726 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:35.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.632+0000 7f8731ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:14:35.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.632+0000 7f8731ffb640 1 -- 172.21.15.59:0/3680657920 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8734029020 con 0x55aad23ae650 2024-09-10T21:14:35.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.632+0000 7f8731ffb640 1 -- 172.21.15.59:0/3680657920 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8734024950 con 0x55aad23ae650 2024-09-10T21:14:35.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.632+0000 7f8753236740 1 -- 172.21.15.59:0/3680657920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8734020030 con 0x55aad23ae650 2024-09-10T21:14:35.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.632+0000 7f8731ffb640 1 -- 172.21.15.59:0/3680657920 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8734024bb0 con 0x55aad23ae650 2024-09-10T21:14:35.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.632+0000 7f8753236740 10 client.15078 fetch_fsmap learned FSMap version 27 2024-09-10T21:14:35.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.632+0000 7f8753236740 1 -- 172.21.15.59:0/3680657920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55aad2437c80 con 0x55aad23ae650 2024-09-10T21:14:35.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.632+0000 7f8731ffb640 1 -- 172.21.15.59:0/3680657920 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8734020030 con 0x55aad23ae650 2024-09-10T21:14:35.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.632+0000 7f8731ffb640 1 -- 172.21.15.59:0/3680657920 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f873402d510 con 0x55aad23ae650 2024-09-10T21:14:35.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.633+0000 7f8753236740 10 client.15078 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:14:35.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.633+0000 7f8753236740 10 client.15078 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T21:14:35.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.633+0000 7f8753236740 20 client.15078 populate_metadata read hostname 'smithi059' 2024-09-10T21:14:35.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.633+0000 7f8753236740 1 --2- 172.21.15.59:0/3680657920 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55aad243c480 0x55aad243b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:35.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.633+0000 7f8753236740 4 client.15078 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:14:35.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.633+0000 7f8753236740 1 -- 172.21.15.59:0/3680657920 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "status"}) -- 0x55aad2323610 con 0x55aad243c480 2024-09-10T21:14:35.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.633+0000 7f874ad9d640 1 --2- 172.21.15.59:0/3680657920 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55aad243c480 0x55aad243b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:35.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.633+0000 7f874ad9d640 1 --2- 172.21.15.59:0/3680657920 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55aad243c480 0x55aad243b190 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6e197f325f775547 server_cookie=ef68a74241dae6c9 in_seq=0 out_seq=0 2024-09-10T21:14:35.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.633+0000 7f8731ffb640 10 client.15078 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:14:35.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.633+0000 7f8731ffb640 1 -- 172.21.15.59:0/3680657920 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55aad2323610 con 0x55aad243c480 2024-09-10T21:14:35.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.633+0000 7f8731ffb640 10 client.15078 handle_command_reply: tid=0 2024-09-10T21:14:35.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.633+0000 7f8753236740 1 client.15078 shutdown 2024-09-10T21:14:35.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8753236740 1 -- 172.21.15.59:0/3680657920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ae650 msgr2=0x55aad23d4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:35.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8753236740 1 --2- 172.21.15.59:0/3680657920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ae650 0x55aad23d4810 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8734004700 tx=0x7f87340243d0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8753236740 1 -- 172.21.15.59:0/3680657920 shutdown_connections 2024-09-10T21:14:35.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8753236740 1 --2- 172.21.15.59:0/3680657920 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55aad243c480 0x55aad243b190 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8753236740 1 --2- 172.21.15.59:0/3680657920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aad23ba5e0 0x55aad23d4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8753236740 1 --2- 172.21.15.59:0/3680657920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aad23ae650 0x55aad23d4810 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8753236740 1 --2- 172.21.15.59:0/3680657920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aad23add30 0x55aad23c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8753236740 1 -- 172.21.15.59:0/3680657920 >> 172.21.15.59:0/3680657920 conn(0x55aad23abb60 msgr2=0x55aad23ac940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:35.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8731ffb640 0 client.15078 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:14:35.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8753236740 1 -- 172.21.15.59:0/3680657920 shutdown_connections 2024-09-10T21:14:35.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8753236740 1 -- 172.21.15.59:0/3680657920 wait complete. 2024-09-10T21:14:35.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8753236740 20 client.15078 trim_cache size 0 max 16384 2024-09-10T21:14:35.647 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:14:35.647 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "3c26b952-6fb8-11ef-bcea-c7b262605968", 2024-09-10T21:14:35.647 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 4, 2024-09-10T21:14:35.647 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 24529, 2024-09-10T21:14:35.647 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-09-10T21:14:35.648 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-09-10T21:14:35.648 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-09-10T21:14:35.648 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 65.694060692999997, 2024-09-10T21:14:35.648 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 27, 2024-09-10T21:14:35.648 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 75, 2024-09-10T21:14:35.648 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T21:14:35.648 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 101.848532252 2024-09-10T21:14:35.648 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:14:35.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8750e61640 1 -- 172.21.15.59:0/1728653369 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f87380b5370 msgr2=0x7f87380b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:35.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8750e61640 1 --2- 172.21.15.59:0/1728653369 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f87380b5370 0x7f87380b7830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55aad23b0eb0 tx=0x7f873c10c530 comp rx=0 tx=0).stop 2024-09-10T21:14:35.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8750e61640 1 -- 172.21.15.59:0/1728653369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f874c103ca0 msgr2=0x7f874c10beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:35.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8750e61640 1 --2- 172.21.15.59:0/1728653369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f874c103ca0 0x7f874c10beb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f873c006010 tx=0x7f873c0042f0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8750e61640 1 -- 172.21.15.59:0/1728653369 shutdown_connections 2024-09-10T21:14:35.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8750e61640 1 --2- 172.21.15.59:0/1728653369 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f87380b5370 0x7f87380b7830 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8750e61640 1 --2- 172.21.15.59:0/1728653369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f874c10d100 0x7f874c1a5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8750e61640 1 --2- 172.21.15.59:0/1728653369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f874c1045c0 0x7f874c10c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8750e61640 1 --2- 172.21.15.59:0/1728653369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f874c103ca0 0x7f874c10beb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:35.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.634+0000 7f8750e61640 1 -- 172.21.15.59:0/1728653369 >> 172.21.15.59:0/1728653369 conn(0x7f874c0fd700 msgr2=0x7f874c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:35.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.635+0000 7f8750e61640 1 -- 172.21.15.59:0/1728653369 shutdown_connections 2024-09-10T21:14:35.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:35.635+0000 7f8750e61640 1 -- 172.21.15.59:0/1728653369 wait complete. 2024-09-10T21:14:36.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-10T21:14:36.664 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:36.924 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:36 smithi059 ceph-mon[30888]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:36.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:36 smithi154 ceph-mon[35041]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:37.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:36 smithi192 ceph-mon[35363]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:37.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.118+0000 7f4111762640 1 -- 172.21.15.59:0/3707050954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f410c103ce0 msgr2=0x7f410c1040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:37.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.118+0000 7f4111762640 1 --2- 172.21.15.59:0/3707050954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f410c103ce0 0x7f410c1040c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4104009900 tx=0x7f410402a410 comp rx=0 tx=0).stop 2024-09-10T21:14:37.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.118+0000 7f4111762640 1 -- 172.21.15.59:0/3707050954 shutdown_connections 2024-09-10T21:14:37.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.118+0000 7f4111762640 1 --2- 172.21.15.59:0/3707050954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f410c10d140 0x7f410c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.118+0000 7f4111762640 1 --2- 172.21.15.59:0/3707050954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f410c104600 0x7f410c10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.118+0000 7f4111762640 1 --2- 172.21.15.59:0/3707050954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f410c103ce0 0x7f410c1040c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.118+0000 7f4111762640 1 -- 172.21.15.59:0/3707050954 >> 172.21.15.59:0/3707050954 conn(0x7f410c0fd700 msgr2=0x7f410c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:37.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.118+0000 7f4111762640 1 -- 172.21.15.59:0/3707050954 shutdown_connections 2024-09-10T21:14:37.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.118+0000 7f4111762640 1 -- 172.21.15.59:0/3707050954 wait complete. 2024-09-10T21:14:37.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.118+0000 7f4111762640 1 Processor -- start 2024-09-10T21:14:37.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.118+0000 7f4111762640 1 -- start start 2024-09-10T21:14:37.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.119+0000 7f4111762640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f410c103ce0 0x7f410c199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:37.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.119+0000 7f4111762640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f410c104600 0x7f410c199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:37.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.119+0000 7f4111762640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f410c10d140 0x7f410c19ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:37.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.119+0000 7f4111762640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f410c112e10 con 0x7f410c103ce0 2024-09-10T21:14:37.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.119+0000 7f4111762640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f410c112c90 con 0x7f410c10d140 2024-09-10T21:14:37.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.119+0000 7f4111762640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f410c112f90 con 0x7f410c104600 2024-09-10T21:14:37.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.119+0000 7f410affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f410c103ce0 0x7f410c199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:37.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.119+0000 7f410affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f410c103ce0 0x7f410c199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36104/0 (socket says 172.21.15.59:36104) 2024-09-10T21:14:37.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.119+0000 7f410affd640 1 -- 172.21.15.59:0/2628003160 learned_addr learned my addr 172.21.15.59:0/2628003160 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:37.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.119+0000 7f410b7fe640 1 --2- 172.21.15.59:0/2628003160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f410c10d140 0x7f410c19ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:37.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.119+0000 7f410a7fc640 1 --2- 172.21.15.59:0/2628003160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f410c104600 0x7f410c199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:37.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.119+0000 7f410affd640 1 -- 172.21.15.59:0/2628003160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f410c104600 msgr2=0x7f410c199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:37.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.119+0000 7f410affd640 1 --2- 172.21.15.59:0/2628003160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f410c104600 0x7f410c199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.119+0000 7f410affd640 1 -- 172.21.15.59:0/2628003160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f410c10d140 msgr2=0x7f410c19ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:37.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.119+0000 7f410affd640 1 --2- 172.21.15.59:0/2628003160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f410c10d140 0x7f410c19ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.119+0000 7f410affd640 1 -- 172.21.15.59:0/2628003160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410c19f3f0 con 0x7f410c103ce0 2024-09-10T21:14:37.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.119+0000 7f410affd640 1 --2- 172.21.15.59:0/2628003160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f410c103ce0 0x7f410c199340 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4104006010 tx=0x7f41040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:37.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.120+0000 7f4103fff640 1 -- 172.21.15.59:0/2628003160 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410403f030 con 0x7f410c103ce0 2024-09-10T21:14:37.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.120+0000 7f4103fff640 1 -- 172.21.15.59:0/2628003160 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4104003800 con 0x7f410c103ce0 2024-09-10T21:14:37.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.120+0000 7f4111762640 1 -- 172.21.15.59:0/2628003160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f410c19f680 con 0x7f410c103ce0 2024-09-10T21:14:37.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.120+0000 7f4103fff640 1 -- 172.21.15.59:0/2628003160 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4104035070 con 0x7f410c103ce0 2024-09-10T21:14:37.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.120+0000 7f4111762640 1 -- 172.21.15.59:0/2628003160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f410c1a5da0 con 0x7f410c103ce0 2024-09-10T21:14:37.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.122+0000 7f4113b37740 1 Processor -- start 2024-09-10T21:14:37.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.122+0000 7f4113b37740 1 -- start start 2024-09-10T21:14:37.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.122+0000 7f4113b37740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbdd30 0x558edecbe110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:37.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.122+0000 7f4113b37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecbe650 0x558edecca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:37.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.122+0000 7f4113b37740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecca5e0 0x558edeccc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:37.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.123+0000 7f4113b37740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558edec35c10 con 0x558edecca5e0 2024-09-10T21:14:37.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.123+0000 7f4113b37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558edec25040 con 0x558edecbe650 2024-09-10T21:14:37.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.123+0000 7f4113b37740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558edec28e50 con 0x558edecbdd30 2024-09-10T21:14:37.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.123+0000 7f410a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecca5e0 0x558edeccc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:37.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.123+0000 7f4103fff640 1 -- 172.21.15.59:0/2628003160 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f4104031b10 con 0x7f410c103ce0 2024-09-10T21:14:37.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.123+0000 7f410a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecca5e0 0x558edeccc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36118/0 (socket says 172.21.15.59:36118) 2024-09-10T21:14:37.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.123+0000 7f410a7fc640 1 -- 172.21.15.59:0/2302303439 learned_addr learned my addr 172.21.15.59:0/2302303439 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:37.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.123+0000 7f410b7fe640 1 --2- 172.21.15.59:0/2302303439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbdd30 0x558edecbe110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:37.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.123+0000 7f410affd640 1 --2- 172.21.15.59:0/2302303439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecbe650 0x558edecca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:37.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.123+0000 7f410a7fc640 1 -- 172.21.15.59:0/2302303439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbdd30 msgr2=0x558edecbe110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:37.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.123+0000 7f410a7fc640 1 --2- 172.21.15.59:0/2302303439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbdd30 0x558edecbe110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.123+0000 7f410a7fc640 1 -- 172.21.15.59:0/2302303439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecbe650 msgr2=0x558edecca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:37.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.123+0000 7f410a7fc640 1 --2- 172.21.15.59:0/2302303439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecbe650 0x558edecca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.123+0000 7f410a7fc640 1 -- 172.21.15.59:0/2302303439 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ede983540 con 0x558edecca5e0 2024-09-10T21:14:37.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.123+0000 7f410affd640 1 --2- 172.21.15.59:0/2302303439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecbe650 0x558edecca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:14:37.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.123+0000 7f410a7fc640 1 --2- 172.21.15.59:0/2302303439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecca5e0 0x558edeccc9d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009a10 tx=0x7f40f4009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f18b1359fd343c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:37.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.123+0000 7f41017fa640 1 -- 172.21.15.59:0/2302303439 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f4017070 con 0x558edecca5e0 2024-09-10T21:14:37.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.124+0000 7f41017fa640 1 -- 172.21.15.59:0/2302303439 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40f4013470 con 0x558edecca5e0 2024-09-10T21:14:37.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.124+0000 7f41017fa640 1 -- 172.21.15.59:0/2302303439 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f4012630 con 0x558edecca5e0 2024-09-10T21:14:37.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.124+0000 7f4103fff640 1 --2- 172.21.15.59:0/2628003160 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f40f80b53f0 0x7f40f80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:37.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.124+0000 7f410b7fe640 1 --2- 172.21.15.59:0/2628003160 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f40f80b53f0 0x7f40f80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:37.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.124+0000 7f4103fff640 1 -- 172.21.15.59:0/2628003160 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4104106540 con 0x7f410c103ce0 2024-09-10T21:14:37.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.124+0000 7f4113b37740 1 -- 172.21.15.59:0/2302303439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecca5e0 msgr2=0x558edeccc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:37.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.124+0000 7f410b7fe640 1 --2- 172.21.15.59:0/2628003160 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f40f80b53f0 0x7f40f80b78b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f40fc007f80 tx=0x7f40fc007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:37.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.124+0000 7f4113b37740 1 --2- 172.21.15.59:0/2302303439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecca5e0 0x558edeccc9d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009a10 tx=0x7f40f4009ed0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.124+0000 7f4113b37740 1 -- 172.21.15.59:0/2302303439 shutdown_connections 2024-09-10T21:14:37.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.124+0000 7f4113b37740 1 --2- 172.21.15.59:0/2302303439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecca5e0 0x558edeccc9d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.124+0000 7f4113b37740 1 --2- 172.21.15.59:0/2302303439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecbe650 0x558edecca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.124+0000 7f4113b37740 1 --2- 172.21.15.59:0/2302303439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbdd30 0x558edecbe110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.124+0000 7f4113b37740 1 -- 172.21.15.59:0/2302303439 >> 172.21.15.59:0/2302303439 conn(0x558edecbbb60 msgr2=0x558edecbcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:37.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.125+0000 7f4113b37740 1 -- 172.21.15.59:0/2302303439 shutdown_connections 2024-09-10T21:14:37.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.125+0000 7f4113b37740 1 -- 172.21.15.59:0/2302303439 wait complete. 2024-09-10T21:14:37.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.125+0000 7f4113b37740 1 -- start start 2024-09-10T21:14:37.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.125+0000 7f4113b37740 1 Processor -- start 2024-09-10T21:14:37.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.125+0000 7f4113b37740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbdd30 0x558edecc7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:37.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.125+0000 7f4113b37740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecbe650 0x558edecc7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:37.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.125+0000 7f4113b37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecca5e0 0x558edecc7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:37.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.125+0000 7f4113b37740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558edea865f0 con 0x558edecbe650 2024-09-10T21:14:37.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.125+0000 7f4113b37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558edebc0010 con 0x558edecca5e0 2024-09-10T21:14:37.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.125+0000 7f4113b37740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558edeccd290 con 0x558edecbdd30 2024-09-10T21:14:37.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.125+0000 7f4113b37740 10 client.0 _ll_register_callbacks cb 0x558edec1f340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:14:37.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.125+0000 7f410a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecbe650 0x558edecc7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:37.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.125+0000 7f410a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecbe650 0x558edecc7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36132/0 (socket says 172.21.15.59:36132) 2024-09-10T21:14:37.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.125+0000 7f410a7fc640 1 -- 172.21.15.59:0/3334815081 learned_addr learned my addr 172.21.15.59:0/3334815081 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:37.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.125+0000 7f410affd640 1 --2- 172.21.15.59:0/3334815081 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbdd30 0x558edecc7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:37.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.126+0000 7f410a7fc640 1 -- 172.21.15.59:0/3334815081 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbdd30 msgr2=0x558edecc7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:37.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.126+0000 7f410a7fc640 1 --2- 172.21.15.59:0/3334815081 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbdd30 0x558edecc7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.126+0000 7f410a7fc640 1 -- 172.21.15.59:0/3334815081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecca5e0 msgr2=0x558edecc7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:37.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.126+0000 7f410a7fc640 1 --2- 172.21.15.59:0/3334815081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecca5e0 0x558edecc7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.126+0000 7f410a7fc640 1 -- 172.21.15.59:0/3334815081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558edebeda00 con 0x558edecbe650 2024-09-10T21:14:37.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.126+0000 7f410a7fc640 1 --2- 172.21.15.59:0/3334815081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecbe650 0x558edecc7a60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009250 tx=0x7f40f4013b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee56a2303a0d387c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:37.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.126+0000 7f40f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:14:37.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.126+0000 7f40f27fc640 1 -- 172.21.15.59:0/3334815081 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f4017050 con 0x558edecbe650 2024-09-10T21:14:37.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.126+0000 7f40f27fc640 1 -- 172.21.15.59:0/3334815081 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f40f401c450 con 0x558edecbe650 2024-09-10T21:14:37.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.126+0000 7f4113b37740 1 -- 172.21.15.59:0/3334815081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40f4013470 con 0x558edecbe650 2024-09-10T21:14:37.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.126+0000 7f40f27fc640 1 -- 172.21.15.59:0/3334815081 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f40f402d070 con 0x558edecbe650 2024-09-10T21:14:37.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.126+0000 7f4113b37740 10 client.15090 fetch_fsmap learned FSMap version 27 2024-09-10T21:14:37.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.126+0000 7f4113b37740 1 -- 172.21.15.59:0/3334815081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558edecd8d70 con 0x558edecbe650 2024-09-10T21:14:37.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.126+0000 7f40f27fc640 1 -- 172.21.15.59:0/3334815081 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40f4013470 con 0x558edecbe650 2024-09-10T21:14:37.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.127+0000 7f40f27fc640 1 -- 172.21.15.59:0/3334815081 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f40f40266e0 con 0x558edecbe650 2024-09-10T21:14:37.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.127+0000 7f4113b37740 10 client.15090 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:14:37.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.127+0000 7f4113b37740 10 client.15090 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T21:14:37.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.127+0000 7f4113b37740 20 client.15090 populate_metadata read hostname 'smithi059' 2024-09-10T21:14:37.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.127+0000 7f4113b37740 1 --2- 172.21.15.59:0/3334815081 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x558edecdb030 0x558edecdc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:37.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.127+0000 7f4113b37740 4 client.15090 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:14:37.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.127+0000 7f4113b37740 1 -- 172.21.15.59:0/3334815081 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558edec37b60 con 0x558edecdb030 2024-09-10T21:14:37.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.127+0000 7f410affd640 1 --2- 172.21.15.59:0/3334815081 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x558edecdb030 0x558edecdc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:37.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.127+0000 7f410affd640 1 --2- 172.21.15.59:0/3334815081 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x558edecdb030 0x558edecdc4a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=224f511f81713819 server_cookie=8f2abe66c1cbdb86 in_seq=0 out_seq=0 2024-09-10T21:14:37.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.127+0000 7f40f27fc640 10 client.15090 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:14:37.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.128+0000 7f40f27fc640 1 -- 172.21.15.59:0/3334815081 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558edec37b60 con 0x558edecdb030 2024-09-10T21:14:37.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.128+0000 7f40f27fc640 10 client.15090 handle_command_reply: tid=0 2024-09-10T21:14:37.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.128+0000 7f4113b37740 1 client.15090 shutdown 2024-09-10T21:14:37.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.128+0000 7f4113b37740 1 -- 172.21.15.59:0/3334815081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecbe650 msgr2=0x558edecc7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:37.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.128+0000 7f4113b37740 1 --2- 172.21.15.59:0/3334815081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecbe650 0x558edecc7a60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009250 tx=0x7f40f4013b90 comp rx=0 tx=0).stop 2024-09-10T21:14:37.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.128+0000 7f4113b37740 1 -- 172.21.15.59:0/3334815081 shutdown_connections 2024-09-10T21:14:37.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.128+0000 7f4113b37740 1 --2- 172.21.15.59:0/3334815081 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x558edecdb030 0x558edecdc4a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.128+0000 7f4113b37740 1 --2- 172.21.15.59:0/3334815081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecca5e0 0x558edecc7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.128+0000 7f4113b37740 1 --2- 172.21.15.59:0/3334815081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecbe650 0x558edecc7a60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.128+0000 7f4113b37740 1 --2- 172.21.15.59:0/3334815081 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbdd30 0x558edecc7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.128+0000 7f40f27fc640 0 client.15090 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:14:37.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.128+0000 7f4113b37740 1 -- 172.21.15.59:0/3334815081 >> 172.21.15.59:0/3334815081 conn(0x558edecbbb60 msgr2=0x558edecc1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:37.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.129+0000 7f4113b37740 1 -- 172.21.15.59:0/3334815081 shutdown_connections 2024-09-10T21:14:37.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.129+0000 7f4113b37740 1 -- 172.21.15.59:0/3334815081 wait complete. 2024-09-10T21:14:37.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.129+0000 7f4113b37740 20 client.15090 trim_cache size 0 max 16384 2024-09-10T21:14:37.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.147+0000 7f4113b37740 1 Processor -- start 2024-09-10T21:14:37.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.147+0000 7f4113b37740 1 -- start start 2024-09-10T21:14:37.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.147+0000 7f4113b37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecbdd30 0x558edecda960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:37.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.147+0000 7f4113b37740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbe650 0x558edecc6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:37.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.147+0000 7f4113b37740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecca5e0 0x558edece4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:37.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.147+0000 7f4113b37740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558edecda7e0 con 0x558edecca5e0 2024-09-10T21:14:37.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.147+0000 7f4113b37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558edecdaeb0 con 0x558edecbdd30 2024-09-10T21:14:37.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.147+0000 7f4113b37740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558edecdb580 con 0x558edecbe650 2024-09-10T21:14:37.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.148+0000 7f410b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecca5e0 0x558edece4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:37.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.148+0000 7f410b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecca5e0 0x558edece4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36142/0 (socket says 172.21.15.59:36142) 2024-09-10T21:14:37.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.148+0000 7f410b7fe640 1 -- 172.21.15.59:0/1015856114 learned_addr learned my addr 172.21.15.59:0/1015856114 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:37.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.148+0000 7f410a7fc640 1 --2- 172.21.15.59:0/1015856114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbe650 0x558edecc6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:37.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.148+0000 7f410affd640 1 --2- 172.21.15.59:0/1015856114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecbdd30 0x558edecda960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:37.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.148+0000 7f410b7fe640 1 -- 172.21.15.59:0/1015856114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbe650 msgr2=0x558edecc6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:37.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.148+0000 7f410b7fe640 1 --2- 172.21.15.59:0/1015856114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbe650 0x558edecc6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.148+0000 7f410b7fe640 1 -- 172.21.15.59:0/1015856114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecbdd30 msgr2=0x558edecda960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:37.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.148+0000 7f410b7fe640 1 --2- 172.21.15.59:0/1015856114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecbdd30 0x558edecda960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.148+0000 7f410b7fe640 1 -- 172.21.15.59:0/1015856114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558edecbe480 con 0x558edecca5e0 2024-09-10T21:14:37.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.148+0000 7f410b7fe640 1 --2- 172.21.15.59:0/1015856114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecca5e0 0x558edece4b70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f40fc005cc0 tx=0x7f40fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2160091e4a6da234 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:37.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.148+0000 7f4100ff9640 1 -- 172.21.15.59:0/1015856114 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40fc01e110 con 0x558edecca5e0 2024-09-10T21:14:37.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.148+0000 7f4100ff9640 1 -- 172.21.15.59:0/1015856114 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40fc01e2b0 con 0x558edecca5e0 2024-09-10T21:14:37.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.148+0000 7f4100ff9640 1 -- 172.21.15.59:0/1015856114 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40fc005280 con 0x558edecca5e0 2024-09-10T21:14:37.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.149+0000 7f4113b37740 1 -- 172.21.15.59:0/1015856114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecca5e0 msgr2=0x558edece4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:37.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.149+0000 7f4113b37740 1 --2- 172.21.15.59:0/1015856114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecca5e0 0x558edece4b70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f40fc005cc0 tx=0x7f40fc004a40 comp rx=0 tx=0).stop 2024-09-10T21:14:37.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.149+0000 7f4113b37740 1 -- 172.21.15.59:0/1015856114 shutdown_connections 2024-09-10T21:14:37.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.149+0000 7f4113b37740 1 --2- 172.21.15.59:0/1015856114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecca5e0 0x558edece4b70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.149+0000 7f4113b37740 1 --2- 172.21.15.59:0/1015856114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbe650 0x558edecc6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.149+0000 7f4113b37740 1 --2- 172.21.15.59:0/1015856114 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecbdd30 0x558edecda960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.149+0000 7f4113b37740 1 -- 172.21.15.59:0/1015856114 >> 172.21.15.59:0/1015856114 conn(0x558edecbbb60 msgr2=0x558edecc5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.149+0000 7f4113b37740 1 -- 172.21.15.59:0/1015856114 shutdown_connections 2024-09-10T21:14:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.149+0000 7f4113b37740 1 -- 172.21.15.59:0/1015856114 wait complete. 2024-09-10T21:14:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.149+0000 7f4113b37740 1 -- start start 2024-09-10T21:14:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.149+0000 7f4113b37740 1 Processor -- start 2024-09-10T21:14:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f4113b37740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbdd30 0x558edece4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f4113b37740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecbe650 0x558edece50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f4113b37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecca5e0 0x558edece1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f4113b37740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558edecdc320 con 0x558edecbe650 2024-09-10T21:14:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f4113b37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558edecdbc50 con 0x558edecca5e0 2024-09-10T21:14:37.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f4113b37740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558edecdc9f0 con 0x558edecbdd30 2024-09-10T21:14:37.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f4113b37740 10 client.0 _ll_register_callbacks cb 0x7f40fc007940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:14:37.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f410a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecbe650 0x558edece50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:37.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f410a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecbe650 0x558edece50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36158/0 (socket says 172.21.15.59:36158) 2024-09-10T21:14:37.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f410a7fc640 1 -- 172.21.15.59:0/71999013 learned_addr learned my addr 172.21.15.59:0/71999013 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:37.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f410affd640 1 --2- 172.21.15.59:0/71999013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbdd30 0x558edece4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:37.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f410b7fe640 1 --2- 172.21.15.59:0/71999013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecca5e0 0x558edece1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:37.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f410a7fc640 1 -- 172.21.15.59:0/71999013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbdd30 msgr2=0x558edece4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:37.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f410a7fc640 1 --2- 172.21.15.59:0/71999013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbdd30 0x558edece4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f410a7fc640 1 -- 172.21.15.59:0/71999013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecca5e0 msgr2=0x558edece1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:37.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f410a7fc640 1 --2- 172.21.15.59:0/71999013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecca5e0 0x558edece1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f410a7fc640 1 -- 172.21.15.59:0/71999013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558edece2450 con 0x558edecbe650 2024-09-10T21:14:37.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f410b7fe640 1 --2- 172.21.15.59:0/71999013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecca5e0 0x558edece1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:37.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f410a7fc640 1 --2- 172.21.15.59:0/71999013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecbe650 0x558edece50c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f40f400e620 tx=0x7f40f4013470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4050db1dfb87dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.150+0000 7f40f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:14:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.151+0000 7f40f27fc640 1 -- 172.21.15.59:0/71999013 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f4036020 con 0x558edecbe650 2024-09-10T21:14:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.151+0000 7f40f27fc640 1 -- 172.21.15.59:0/71999013 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f40f40265e0 con 0x558edecbe650 2024-09-10T21:14:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.151+0000 7f4113b37740 1 -- 172.21.15.59:0/71999013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40fc01e2b0 con 0x558edecbe650 2024-09-10T21:14:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.151+0000 7f40f27fc640 1 -- 172.21.15.59:0/71999013 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f40f4017040 con 0x558edecbe650 2024-09-10T21:14:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.151+0000 7f4113b37740 10 client.15096 fetch_fsmap learned FSMap version 27 2024-09-10T21:14:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.151+0000 7f4113b37740 1 -- 172.21.15.59:0/71999013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558eded4c560 con 0x558edecbe650 2024-09-10T21:14:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.151+0000 7f40f27fc640 1 -- 172.21.15.59:0/71999013 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40fc01e2b0 con 0x558edecbe650 2024-09-10T21:14:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.151+0000 7f40f27fc640 1 -- 172.21.15.59:0/71999013 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f40f4032ca0 con 0x558edecbe650 2024-09-10T21:14:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.151+0000 7f4113b37740 10 client.15096 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:14:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.151+0000 7f4113b37740 10 client.15096 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T21:14:37.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.151+0000 7f4113b37740 20 client.15096 populate_metadata read hostname 'smithi059' 2024-09-10T21:14:37.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.151+0000 7f4113b37740 1 --2- 172.21.15.59:0/71999013 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x558eded51130 0x558eded4fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:37.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.151+0000 7f4113b37740 4 client.15096 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:14:37.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.151+0000 7f4113b37740 1 -- 172.21.15.59:0/71999013 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "status"}) -- 0x558edec33610 con 0x558eded51130 2024-09-10T21:14:37.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.152+0000 7f410affd640 1 --2- 172.21.15.59:0/71999013 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x558eded51130 0x558eded4fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:37.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.152+0000 7f40f27fc640 10 client.15096 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:14:37.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.152+0000 7f410affd640 1 --2- 172.21.15.59:0/71999013 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x558eded51130 0x558eded4fe40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=95533e7ac30b6545 server_cookie=5d1e1f17d49fab0d in_seq=0 out_seq=0 2024-09-10T21:14:37.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.152+0000 7f40f27fc640 1 -- 172.21.15.59:0/71999013 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x558edec33610 con 0x558eded51130 2024-09-10T21:14:37.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.152+0000 7f40f27fc640 10 client.15096 handle_command_reply: tid=0 2024-09-10T21:14:37.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.152+0000 7f4113b37740 1 client.15096 shutdown 2024-09-10T21:14:37.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.152+0000 7f4113b37740 1 -- 172.21.15.59:0/71999013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecbe650 msgr2=0x558edece50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:37.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.152+0000 7f4113b37740 1 --2- 172.21.15.59:0/71999013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecbe650 0x558edece50c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f40f400e620 tx=0x7f40f4013470 comp rx=0 tx=0).stop 2024-09-10T21:14:37.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.152+0000 7f4113b37740 1 -- 172.21.15.59:0/71999013 shutdown_connections 2024-09-10T21:14:37.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.152+0000 7f4113b37740 1 --2- 172.21.15.59:0/71999013 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x558eded51130 0x558eded4fe40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.152+0000 7f4113b37740 1 --2- 172.21.15.59:0/71999013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558edecca5e0 0x558edece1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.152+0000 7f4113b37740 1 --2- 172.21.15.59:0/71999013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558edecbe650 0x558edece50c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.152+0000 7f4113b37740 1 --2- 172.21.15.59:0/71999013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558edecbdd30 0x558edece4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.152+0000 7f40f27fc640 0 client.15096 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:14:37.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.152+0000 7f4113b37740 1 -- 172.21.15.59:0/71999013 >> 172.21.15.59:0/71999013 conn(0x558edecbbb60 msgr2=0x558edecbcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:37.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.153+0000 7f4113b37740 1 -- 172.21.15.59:0/71999013 shutdown_connections 2024-09-10T21:14:37.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.153+0000 7f4113b37740 1 -- 172.21.15.59:0/71999013 wait complete. 2024-09-10T21:14:37.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.153+0000 7f4113b37740 20 client.15096 trim_cache size 0 max 16384 2024-09-10T21:14:37.162 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:14:37.162 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "3c26b952-6fb8-11ef-bcea-c7b262605968", 2024-09-10T21:14:37.162 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 3, 2024-09-10T21:14:37.163 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 24538, 2024-09-10T21:14:37.163 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-09-10T21:14:37.163 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-09-10T21:14:37.163 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-09-10T21:14:37.163 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 68.219111099000003, 2024-09-10T21:14:37.163 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 27, 2024-09-10T21:14:37.163 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 75, 2024-09-10T21:14:37.163 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T21:14:37.163 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 100.96228698100001 2024-09-10T21:14:37.163 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:14:37.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.153+0000 7f4111762640 1 -- 172.21.15.59:0/2628003160 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f40f80b53f0 msgr2=0x7f40f80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:37.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.153+0000 7f4111762640 1 --2- 172.21.15.59:0/2628003160 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f40f80b53f0 0x7f40f80b78b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f40fc007f80 tx=0x7f40fc007520 comp rx=0 tx=0).stop 2024-09-10T21:14:37.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.153+0000 7f4111762640 1 -- 172.21.15.59:0/2628003160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f410c103ce0 msgr2=0x7f410c199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:37.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.153+0000 7f4111762640 1 --2- 172.21.15.59:0/2628003160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f410c103ce0 0x7f410c199340 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4104006010 tx=0x7f41040042f0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.153+0000 7f4111762640 1 -- 172.21.15.59:0/2628003160 shutdown_connections 2024-09-10T21:14:37.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.153+0000 7f4111762640 1 --2- 172.21.15.59:0/2628003160 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f40f80b53f0 0x7f40f80b78b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.153+0000 7f4111762640 1 --2- 172.21.15.59:0/2628003160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f410c10d140 0x7f410c19ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.153+0000 7f4111762640 1 --2- 172.21.15.59:0/2628003160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f410c104600 0x7f410c199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.153+0000 7f4111762640 1 --2- 172.21.15.59:0/2628003160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f410c103ce0 0x7f410c199340 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:37.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.153+0000 7f4111762640 1 -- 172.21.15.59:0/2628003160 >> 172.21.15.59:0/2628003160 conn(0x7f410c0fd700 msgr2=0x7f410c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:37.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.153+0000 7f4111762640 1 -- 172.21.15.59:0/2628003160 shutdown_connections 2024-09-10T21:14:37.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:37.153+0000 7f4111762640 1 -- 172.21.15.59:0/2628003160 wait complete. 2024-09-10T21:14:37.893 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T21:14:38.157 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:38.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.633+0000 7fac5d6de640 1 -- 172.21.15.59:0/3976367039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac581076a0 msgr2=0x7fac58107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:38.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.633+0000 7fac5d6de640 1 --2- 172.21.15.59:0/3976367039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac581076a0 0x7fac58107ae0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fac4c009900 tx=0x7fac4c02a410 comp rx=0 tx=0).stop 2024-09-10T21:14:38.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.633+0000 7fac5d6de640 1 -- 172.21.15.59:0/3976367039 shutdown_connections 2024-09-10T21:14:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.633+0000 7fac5d6de640 1 --2- 172.21.15.59:0/3976367039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac58108020 0x7fac5810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.633+0000 7fac5d6de640 1 --2- 172.21.15.59:0/3976367039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac581076a0 0x7fac58107ae0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.633+0000 7fac5d6de640 1 --2- 172.21.15.59:0/3976367039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac58101c90 0x7fac58102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.633+0000 7fac5d6de640 1 -- 172.21.15.59:0/3976367039 >> 172.21.15.59:0/3976367039 conn(0x7fac580fd700 msgr2=0x7fac580ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.634+0000 7fac5d6de640 1 -- 172.21.15.59:0/3976367039 shutdown_connections 2024-09-10T21:14:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.634+0000 7fac5d6de640 1 -- 172.21.15.59:0/3976367039 wait complete. 2024-09-10T21:14:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.634+0000 7fac5d6de640 1 Processor -- start 2024-09-10T21:14:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.634+0000 7fac5d6de640 1 -- start start 2024-09-10T21:14:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.634+0000 7fac5d6de640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac58101c90 0x7fac581982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.634+0000 7fac5d6de640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac581076a0 0x7fac58198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.634+0000 7fac5d6de640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac58108020 0x7fac5819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.634+0000 7fac5d6de640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fac58111d20 con 0x7fac58101c90 2024-09-10T21:14:38.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.635+0000 7fac5d6de640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fac58111ba0 con 0x7fac581076a0 2024-09-10T21:14:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.635+0000 7fac5d6de640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fac58111ea0 con 0x7fac58108020 2024-09-10T21:14:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.635+0000 7fac56ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac58101c90 0x7fac581982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.635+0000 7fac56ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac58101c90 0x7fac581982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36168/0 (socket says 172.21.15.59:36168) 2024-09-10T21:14:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.635+0000 7fac56ffd640 1 -- 172.21.15.59:0/864339168 learned_addr learned my addr 172.21.15.59:0/864339168 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.635+0000 7fac577fe640 1 --2- 172.21.15.59:0/864339168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac58108020 0x7fac5819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.635+0000 7fac567fc640 1 --2- 172.21.15.59:0/864339168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac581076a0 0x7fac58198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.635+0000 7fac56ffd640 1 -- 172.21.15.59:0/864339168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac58108020 msgr2=0x7fac5819dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.635+0000 7fac56ffd640 1 --2- 172.21.15.59:0/864339168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac58108020 0x7fac5819dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.635+0000 7fac56ffd640 1 -- 172.21.15.59:0/864339168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac581076a0 msgr2=0x7fac58198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.635+0000 7fac56ffd640 1 --2- 172.21.15.59:0/864339168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac581076a0 0x7fac58198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.635+0000 7fac56ffd640 1 -- 172.21.15.59:0/864339168 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5819e380 con 0x7fac58101c90 2024-09-10T21:14:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.635+0000 7fac577fe640 1 --2- 172.21.15.59:0/864339168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac58108020 0x7fac5819dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:38.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.635+0000 7fac56ffd640 1 --2- 172.21.15.59:0/864339168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac58101c90 0x7fac581982d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fac4800df40 tx=0x7fac4800df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.635+0000 7fac3ffff640 1 -- 172.21.15.59:0/864339168 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4800ea60 con 0x7fac58101c90 2024-09-10T21:14:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.635+0000 7fac5d6de640 1 -- 172.21.15.59:0/864339168 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5819e610 con 0x7fac58101c90 2024-09-10T21:14:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.635+0000 7fac3ffff640 1 -- 172.21.15.59:0/864339168 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac4800ec00 con 0x7fac58101c90 2024-09-10T21:14:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.635+0000 7fac3ffff640 1 -- 172.21.15.59:0/864339168 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac48016630 con 0x7fac58101c90 2024-09-10T21:14:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.635+0000 7fac5d6de640 1 -- 172.21.15.59:0/864339168 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac5806ab30 con 0x7fac58101c90 2024-09-10T21:14:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.638+0000 7fac5fab3740 1 Processor -- start 2024-09-10T21:14:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.638+0000 7fac5fab3740 1 -- start start 2024-09-10T21:14:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.638+0000 7fac3ffff640 1 -- 172.21.15.59:0/864339168 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fac48009580 con 0x7fac58101c90 2024-09-10T21:14:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.638+0000 7fac5fab3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd2d30 0x5557f9bd3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.638+0000 7fac5fab3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bd3650 0x5557f9bdf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.638+0000 7fac5fab3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 0x5557f9be19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.638+0000 7fac5fab3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5557f9b4ac10 con 0x5557f9bdf5e0 2024-09-10T21:14:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.638+0000 7fac5fab3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5557f9b3a040 con 0x5557f9bd2d30 2024-09-10T21:14:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.638+0000 7fac5fab3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5557f9b3de50 con 0x5557f9bd3650 2024-09-10T21:14:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.638+0000 7fac567fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 0x5557f9be19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.638+0000 7fac567fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 0x5557f9be19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36178/0 (socket says 172.21.15.59:36178) 2024-09-10T21:14:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.639+0000 7fac567fc640 1 -- 172.21.15.59:0/1935150120 learned_addr learned my addr 172.21.15.59:0/1935150120 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.639+0000 7fac56ffd640 1 --2- 172.21.15.59:0/1935150120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bd3650 0x5557f9bdf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.639+0000 7fac577fe640 1 --2- 172.21.15.59:0/1935150120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd2d30 0x5557f9bd3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.639+0000 7fac567fc640 1 -- 172.21.15.59:0/1935150120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bd3650 msgr2=0x5557f9bdf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.639+0000 7fac567fc640 1 --2- 172.21.15.59:0/1935150120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bd3650 0x5557f9bdf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.639+0000 7fac567fc640 1 -- 172.21.15.59:0/1935150120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd2d30 msgr2=0x5557f9bd3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.639+0000 7fac567fc640 1 --2- 172.21.15.59:0/1935150120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd2d30 0x5557f9bd3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.639+0000 7fac567fc640 1 -- 172.21.15.59:0/1935150120 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557f9898540 con 0x5557f9bdf5e0 2024-09-10T21:14:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.639+0000 7fac3ffff640 1 --2- 172.21.15.59:0/864339168 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fac400b5370 0x7fac400b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.639+0000 7fac567fc640 1 --2- 172.21.15.59:0/1935150120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 0x5557f9be19d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fac4c033000 tx=0x7fac4c031de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d32f995a6745760 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.639+0000 7fac577fe640 1 --2- 172.21.15.59:0/864339168 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fac400b5370 0x7fac400b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.639+0000 7fac3ffff640 1 -- 172.21.15.59:0/864339168 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fac480e7330 con 0x7fac58101c90 2024-09-10T21:14:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.639+0000 7fac3d7fa640 1 -- 172.21.15.59:0/1935150120 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c040070 con 0x5557f9bdf5e0 2024-09-10T21:14:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.639+0000 7fac3d7fa640 1 -- 172.21.15.59:0/1935150120 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac4c0316a0 con 0x5557f9bdf5e0 2024-09-10T21:14:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.639+0000 7fac3d7fa640 1 -- 172.21.15.59:0/1935150120 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c035040 con 0x5557f9bdf5e0 2024-09-10T21:14:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.640+0000 7fac5fab3740 1 -- 172.21.15.59:0/1935150120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 msgr2=0x5557f9be19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.640+0000 7fac577fe640 1 --2- 172.21.15.59:0/864339168 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fac400b5370 0x7fac400b7830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fac5000ba90 tx=0x7fac50008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.640+0000 7fac5fab3740 1 --2- 172.21.15.59:0/1935150120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 0x5557f9be19d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fac4c033000 tx=0x7fac4c031de0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.640+0000 7fac5fab3740 1 -- 172.21.15.59:0/1935150120 shutdown_connections 2024-09-10T21:14:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.640+0000 7fac5fab3740 1 --2- 172.21.15.59:0/1935150120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 0x5557f9be19d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.640+0000 7fac5fab3740 1 --2- 172.21.15.59:0/1935150120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bd3650 0x5557f9bdf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.640+0000 7fac5fab3740 1 --2- 172.21.15.59:0/1935150120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd2d30 0x5557f9bd3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.640+0000 7fac5fab3740 1 -- 172.21.15.59:0/1935150120 >> 172.21.15.59:0/1935150120 conn(0x5557f9bd0b60 msgr2=0x5557f9bd1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.640+0000 7fac5fab3740 1 -- 172.21.15.59:0/1935150120 shutdown_connections 2024-09-10T21:14:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.640+0000 7fac5fab3740 1 -- 172.21.15.59:0/1935150120 wait complete. 2024-09-10T21:14:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.640+0000 7fac5fab3740 1 -- start start 2024-09-10T21:14:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.640+0000 7fac5fab3740 1 Processor -- start 2024-09-10T21:14:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac5fab3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd2d30 0x5557f9bdc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac5fab3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bd3650 0x5557f9bdcb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac5fab3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 0x5557f9bdd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac5fab3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5557f999b5f0 con 0x5557f9bdf5e0 2024-09-10T21:14:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac5fab3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5557f9ad5010 con 0x5557f9bd2d30 2024-09-10T21:14:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac5fab3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5557f9be2230 con 0x5557f9bd3650 2024-09-10T21:14:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac5fab3740 10 client.0 _ll_register_callbacks cb 0x5557f9b34340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:14:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac577fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 0x5557f9bdd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac577fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 0x5557f9bdd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36194/0 (socket says 172.21.15.59:36194) 2024-09-10T21:14:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac577fe640 1 -- 172.21.15.59:0/458754774 learned_addr learned my addr 172.21.15.59:0/458754774 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac56ffd640 1 --2- 172.21.15.59:0/458754774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd2d30 0x5557f9bdc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac567fc640 1 --2- 172.21.15.59:0/458754774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bd3650 0x5557f9bdcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac577fe640 1 -- 172.21.15.59:0/458754774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bd3650 msgr2=0x5557f9bdcb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac577fe640 1 --2- 172.21.15.59:0/458754774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bd3650 0x5557f9bdcb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac577fe640 1 -- 172.21.15.59:0/458754774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd2d30 msgr2=0x5557f9bdc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac577fe640 1 --2- 172.21.15.59:0/458754774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd2d30 0x5557f9bdc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac577fe640 1 -- 172.21.15.59:0/458754774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557f9b02a00 con 0x5557f9bdf5e0 2024-09-10T21:14:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac567fc640 1 --2- 172.21.15.59:0/458754774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bd3650 0x5557f9bdcb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac577fe640 1 --2- 172.21.15.59:0/458754774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 0x5557f9bdd070 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fac500146e0 tx=0x7fac500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fba3c70f8c3addc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac3aff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:14:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.641+0000 7fac3aff5640 1 -- 172.21.15.59:0/458754774 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5001b050 con 0x5557f9bdf5e0 2024-09-10T21:14:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.642+0000 7fac3aff5640 1 -- 172.21.15.59:0/458754774 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fac50015820 con 0x5557f9bdf5e0 2024-09-10T21:14:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.642+0000 7fac5fab3740 1 -- 172.21.15.59:0/458754774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac4c0316a0 con 0x5557f9bdf5e0 2024-09-10T21:14:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.642+0000 7fac3aff5640 1 -- 172.21.15.59:0/458754774 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fac50015a20 con 0x5557f9bdf5e0 2024-09-10T21:14:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.642+0000 7fac5fab3740 10 client.15108 fetch_fsmap learned FSMap version 27 2024-09-10T21:14:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.642+0000 7fac5fab3740 1 -- 172.21.15.59:0/458754774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5557f9bf22b0 con 0x5557f9bdf5e0 2024-09-10T21:14:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.642+0000 7fac3aff5640 1 -- 172.21.15.59:0/458754774 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac4c0316a0 con 0x5557f9bdf5e0 2024-09-10T21:14:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.642+0000 7fac3aff5640 1 -- 172.21.15.59:0/458754774 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fac50029400 con 0x5557f9bdf5e0 2024-09-10T21:14:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.642+0000 7fac5fab3740 10 client.15108 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:14:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.642+0000 7fac5fab3740 10 client.15108 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T21:14:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.642+0000 7fac5fab3740 20 client.15108 populate_metadata read hostname 'smithi059' 2024-09-10T21:14:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.642+0000 7fac5fab3740 1 --2- 172.21.15.59:0/458754774 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5557f9bf49b0 0x5557f9bf5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.642+0000 7fac5fab3740 4 client.15108 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:14:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.642+0000 7fac5fab3740 1 -- 172.21.15.59:0/458754774 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557f9b4cb60 con 0x5557f9bf49b0 2024-09-10T21:14:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.643+0000 7fac56ffd640 1 --2- 172.21.15.59:0/458754774 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5557f9bf49b0 0x5557f9bf5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.644+0000 7fac56ffd640 1 --2- 172.21.15.59:0/458754774 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5557f9bf49b0 0x5557f9bf5e20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fb7cc2790997f613 server_cookie=231f828ac6e942dc in_seq=0 out_seq=0 2024-09-10T21:14:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.644+0000 7fac3aff5640 10 client.15108 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:14:38.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.644+0000 7fac3aff5640 1 -- 172.21.15.59:0/458754774 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5557f9b4cb60 con 0x5557f9bf49b0 2024-09-10T21:14:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.644+0000 7fac3aff5640 10 client.15108 handle_command_reply: tid=0 2024-09-10T21:14:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.644+0000 7fac5fab3740 1 client.15108 shutdown 2024-09-10T21:14:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.645+0000 7fac5fab3740 1 -- 172.21.15.59:0/458754774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 msgr2=0x5557f9bdd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.645+0000 7fac5fab3740 1 --2- 172.21.15.59:0/458754774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 0x5557f9bdd070 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fac500146e0 tx=0x7fac500046c0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.645+0000 7fac5fab3740 1 -- 172.21.15.59:0/458754774 shutdown_connections 2024-09-10T21:14:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.645+0000 7fac5fab3740 1 --2- 172.21.15.59:0/458754774 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5557f9bf49b0 0x5557f9bf5e20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.645+0000 7fac5fab3740 1 --2- 172.21.15.59:0/458754774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 0x5557f9bdd070 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.645+0000 7fac5fab3740 1 --2- 172.21.15.59:0/458754774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bd3650 0x5557f9bdcb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.645+0000 7fac5fab3740 1 --2- 172.21.15.59:0/458754774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd2d30 0x5557f9bdc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.645+0000 7fac5fab3740 1 -- 172.21.15.59:0/458754774 >> 172.21.15.59:0/458754774 conn(0x5557f9bd0b60 msgr2=0x5557f9bd6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.645+0000 7fac3aff5640 0 client.15108 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:14:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.645+0000 7fac5fab3740 1 -- 172.21.15.59:0/458754774 shutdown_connections 2024-09-10T21:14:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.645+0000 7fac5fab3740 1 -- 172.21.15.59:0/458754774 wait complete. 2024-09-10T21:14:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.645+0000 7fac5fab3740 20 client.15108 trim_cache size 0 max 16384 2024-09-10T21:14:38.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.665+0000 7fac5fab3740 1 Processor -- start 2024-09-10T21:14:38.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.665+0000 7fac5fab3740 1 -- start start 2024-09-10T21:14:38.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.666+0000 7fac5fab3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bd2d30 0x5557f9bd6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:38.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.666+0000 7fac5fab3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd3650 0x5557f9bdae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:38.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.666+0000 7fac5fab3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 0x5557f9bdb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:38.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.666+0000 7fac5fab3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5557f9bf4160 con 0x5557f9bdf5e0 2024-09-10T21:14:38.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.666+0000 7fac5fab3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5557f9bf4830 con 0x5557f9bd3650 2024-09-10T21:14:38.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.666+0000 7fac5fab3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5557f9bf4f00 con 0x5557f9bd2d30 2024-09-10T21:14:38.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.666+0000 7fac577fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 0x5557f9bdb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:38.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.666+0000 7fac577fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 0x5557f9bdb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36204/0 (socket says 172.21.15.59:36204) 2024-09-10T21:14:38.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.666+0000 7fac567fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd3650 0x5557f9bdae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:38.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.666+0000 7fac577fe640 1 -- 172.21.15.59:0/511756399 learned_addr learned my addr 172.21.15.59:0/511756399 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:38.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.666+0000 7fac56ffd640 1 --2- 172.21.15.59:0/511756399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bd2d30 0x5557f9bd6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:38.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.666+0000 7fac577fe640 1 -- 172.21.15.59:0/511756399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bd2d30 msgr2=0x5557f9bd6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:38.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.666+0000 7fac577fe640 1 --2- 172.21.15.59:0/511756399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bd2d30 0x5557f9bd6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.666+0000 7fac577fe640 1 -- 172.21.15.59:0/511756399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd3650 msgr2=0x5557f9bdae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:38.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.666+0000 7fac577fe640 1 --2- 172.21.15.59:0/511756399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd3650 0x5557f9bdae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.666+0000 7fac577fe640 1 -- 172.21.15.59:0/511756399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557f9bf3f90 con 0x5557f9bdf5e0 2024-09-10T21:14:38.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.666+0000 7fac567fc640 1 --2- 172.21.15.59:0/511756399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd3650 0x5557f9bdae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:14:38.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.666+0000 7fac577fe640 1 --2- 172.21.15.59:0/511756399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 0x5557f9bdb3b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fac50014f30 tx=0x7fac50014f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c934fd8e471e129 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:38.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.666+0000 7fac3cff9640 1 -- 172.21.15.59:0/511756399 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5001b040 con 0x5557f9bdf5e0 2024-09-10T21:14:38.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.667+0000 7fac3cff9640 1 -- 172.21.15.59:0/511756399 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac50025070 con 0x5557f9bdf5e0 2024-09-10T21:14:38.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.667+0000 7fac3cff9640 1 -- 172.21.15.59:0/511756399 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac50015880 con 0x5557f9bdf5e0 2024-09-10T21:14:38.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.667+0000 7fac5fab3740 1 -- 172.21.15.59:0/511756399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 msgr2=0x5557f9bdb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:38.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.667+0000 7fac5fab3740 1 --2- 172.21.15.59:0/511756399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 0x5557f9bdb3b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fac50014f30 tx=0x7fac50014f60 comp rx=0 tx=0).stop 2024-09-10T21:14:38.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.667+0000 7fac5fab3740 1 -- 172.21.15.59:0/511756399 shutdown_connections 2024-09-10T21:14:38.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.667+0000 7fac5fab3740 1 --2- 172.21.15.59:0/511756399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bdf5e0 0x5557f9bdb3b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.667+0000 7fac5fab3740 1 --2- 172.21.15.59:0/511756399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd3650 0x5557f9bdae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.667+0000 7fac5fab3740 1 --2- 172.21.15.59:0/511756399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bd2d30 0x5557f9bd6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.667+0000 7fac5fab3740 1 -- 172.21.15.59:0/511756399 >> 172.21.15.59:0/511756399 conn(0x5557f9bd0b60 msgr2=0x5557f9bd7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:38.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.668+0000 7fac5fab3740 1 -- 172.21.15.59:0/511756399 shutdown_connections 2024-09-10T21:14:38.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.668+0000 7fac5fab3740 1 -- 172.21.15.59:0/511756399 wait complete. 2024-09-10T21:14:38.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.668+0000 7fac5fab3740 1 -- start start 2024-09-10T21:14:38.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.668+0000 7fac5fab3740 1 Processor -- start 2024-09-10T21:14:38.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.668+0000 7fac5fab3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd2d30 0x5557f9bfe950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:38.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.668+0000 7fac5fab3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bd3650 0x5557f9bf7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:38.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.668+0000 7fac5fab3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bdf5e0 0x5557f9bf84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:38.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.668+0000 7fac5fab3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5557f9bf5ca0 con 0x5557f9bd3650 2024-09-10T21:14:38.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.668+0000 7fac5fab3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5557f9bf55d0 con 0x5557f9bd2d30 2024-09-10T21:14:38.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.668+0000 7fac5fab3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5557f9bf6370 con 0x5557f9bdf5e0 2024-09-10T21:14:38.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.668+0000 7fac5fab3740 10 client.0 _ll_register_callbacks cb 0x7fac5000b280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:14:38.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.669+0000 7fac567fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bd3650 0x5557f9bf7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:38.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.669+0000 7fac56ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd2d30 0x5557f9bfe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:38.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.669+0000 7fac567fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bd3650 0x5557f9bf7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36208/0 (socket says 172.21.15.59:36208) 2024-09-10T21:14:38.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.669+0000 7fac567fc640 1 -- 172.21.15.59:0/4238570882 learned_addr learned my addr 172.21.15.59:0/4238570882 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:38.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.669+0000 7fac577fe640 1 --2- 172.21.15.59:0/4238570882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bdf5e0 0x5557f9bf84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:38.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.669+0000 7fac56ffd640 1 -- 172.21.15.59:0/4238570882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bdf5e0 msgr2=0x5557f9bf84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:38.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.669+0000 7fac56ffd640 1 --2- 172.21.15.59:0/4238570882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bdf5e0 0x5557f9bf84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.669+0000 7fac56ffd640 1 -- 172.21.15.59:0/4238570882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bd3650 msgr2=0x5557f9bf7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:38.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.669+0000 7fac56ffd640 1 --2- 172.21.15.59:0/4238570882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bd3650 0x5557f9bf7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.669+0000 7fac56ffd640 1 -- 172.21.15.59:0/4238570882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557f9bfd5b0 con 0x5557f9bd2d30 2024-09-10T21:14:38.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.669+0000 7fac56ffd640 1 --2- 172.21.15.59:0/4238570882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd2d30 0x5557f9bfe950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac480e4d10 tx=0x7fac4800bb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67d5f052fdd3a3bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:38.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.669+0000 7fac3aff5640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-10T21:14:38.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.671+0000 7fac3aff5640 1 -- 172.21.15.59:0/4238570882 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac480ad560 con 0x5557f9bd2d30 2024-09-10T21:14:38.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.671+0000 7fac3aff5640 1 -- 172.21.15.59:0/4238570882 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fac480e4f60 con 0x5557f9bd2d30 2024-09-10T21:14:38.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.671+0000 7fac5fab3740 1 -- 172.21.15.59:0/4238570882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac50025070 con 0x5557f9bd2d30 2024-09-10T21:14:38.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.671+0000 7fac3aff5640 1 -- 172.21.15.59:0/4238570882 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fac480ae150 con 0x5557f9bd2d30 2024-09-10T21:14:38.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.671+0000 7fac5fab3740 10 client.24791 fetch_fsmap learned FSMap version 27 2024-09-10T21:14:38.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.671+0000 7fac5fab3740 1 -- 172.21.15.59:0/4238570882 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5557f9c614a0 con 0x5557f9bd2d30 2024-09-10T21:14:38.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.671+0000 7fac3aff5640 1 -- 172.21.15.59:0/4238570882 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac50025070 con 0x5557f9bd2d30 2024-09-10T21:14:38.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.672+0000 7fac3aff5640 1 -- 172.21.15.59:0/4238570882 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fac480eacd0 con 0x5557f9bd2d30 2024-09-10T21:14:38.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.672+0000 7fac5fab3740 10 client.24791 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:14:38.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.672+0000 7fac5fab3740 10 client.24791 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T21:14:38.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.672+0000 7fac5fab3740 20 client.24791 populate_metadata read hostname 'smithi059' 2024-09-10T21:14:38.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.672+0000 7fac5fab3740 1 --2- 172.21.15.59:0/4238570882 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5557f9c66010 0x5557f9c64d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:38.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.672+0000 7fac5fab3740 4 client.24791 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:14:38.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.672+0000 7fac5fab3740 1 -- 172.21.15.59:0/4238570882 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "status"}) -- 0x5557f9b48610 con 0x5557f9c66010 2024-09-10T21:14:38.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.672+0000 7fac567fc640 1 --2- 172.21.15.59:0/4238570882 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5557f9c66010 0x5557f9c64d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:38.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.673+0000 7fac3aff5640 10 client.24791 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:14:38.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.673+0000 7fac567fc640 1 --2- 172.21.15.59:0/4238570882 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5557f9c66010 0x5557f9c64d20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed3a0b85c6b06a8f server_cookie=6dadea9fb357295a in_seq=0 out_seq=0 2024-09-10T21:14:38.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.673+0000 7fac3aff5640 1 -- 172.21.15.59:0/4238570882 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5557f9b48610 con 0x5557f9c66010 2024-09-10T21:14:38.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.673+0000 7fac3aff5640 10 client.24791 handle_command_reply: tid=0 2024-09-10T21:14:38.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.673+0000 7fac5fab3740 1 client.24791 shutdown 2024-09-10T21:14:38.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.673+0000 7fac5fab3740 1 -- 172.21.15.59:0/4238570882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd2d30 msgr2=0x5557f9bfe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:38.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.673+0000 7fac5fab3740 1 --2- 172.21.15.59:0/4238570882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd2d30 0x5557f9bfe950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac480e4d10 tx=0x7fac4800bb40 comp rx=0 tx=0).stop 2024-09-10T21:14:38.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.673+0000 7fac5fab3740 1 -- 172.21.15.59:0/4238570882 shutdown_connections 2024-09-10T21:14:38.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.673+0000 7fac5fab3740 1 --2- 172.21.15.59:0/4238570882 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5557f9c66010 0x5557f9c64d20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.673+0000 7fac5fab3740 1 --2- 172.21.15.59:0/4238570882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557f9bdf5e0 0x5557f9bf84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.673+0000 7fac5fab3740 1 --2- 172.21.15.59:0/4238570882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557f9bd3650 0x5557f9bf7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.673+0000 7fac3aff5640 0 client.24791 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:14:38.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.673+0000 7fac5fab3740 1 --2- 172.21.15.59:0/4238570882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557f9bd2d30 0x5557f9bfe950 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.673+0000 7fac5fab3740 1 -- 172.21.15.59:0/4238570882 >> 172.21.15.59:0/4238570882 conn(0x5557f9bd0b60 msgr2=0x5557f9bd1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:38.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.673+0000 7fac5fab3740 1 -- 172.21.15.59:0/4238570882 shutdown_connections 2024-09-10T21:14:38.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.673+0000 7fac5fab3740 1 -- 172.21.15.59:0/4238570882 wait complete. 2024-09-10T21:14:38.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.673+0000 7fac5fab3740 20 client.24791 trim_cache size 0 max 16384 2024-09-10T21:14:38.681 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:14:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "3c26b952-6fb8-11ef-bcea-c7b262605968", 2024-09-10T21:14:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 2, 2024-09-10T21:14:38.681 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 24542, 2024-09-10T21:14:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-09-10T21:14:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-09-10T21:14:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-09-10T21:14:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 70.747059270999998, 2024-09-10T21:14:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 27, 2024-09-10T21:14:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 75, 2024-09-10T21:14:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T21:14:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 99.976949778000005 2024-09-10T21:14:38.682 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:14:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.674+0000 7fac5d6de640 1 -- 172.21.15.59:0/864339168 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fac400b5370 msgr2=0x7fac400b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.674+0000 7fac5d6de640 1 --2- 172.21.15.59:0/864339168 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fac400b5370 0x7fac400b7830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fac5000ba90 tx=0x7fac50008040 comp rx=0 tx=0).stop 2024-09-10T21:14:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.674+0000 7fac5d6de640 1 -- 172.21.15.59:0/864339168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac58101c90 msgr2=0x7fac581982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.674+0000 7fac5d6de640 1 --2- 172.21.15.59:0/864339168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac58101c90 0x7fac581982d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fac4800df40 tx=0x7fac4800df70 comp rx=0 tx=0).stop 2024-09-10T21:14:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.674+0000 7fac5d6de640 1 -- 172.21.15.59:0/864339168 shutdown_connections 2024-09-10T21:14:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.674+0000 7fac5d6de640 1 --2- 172.21.15.59:0/864339168 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fac400b5370 0x7fac400b7830 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.674+0000 7fac5d6de640 1 --2- 172.21.15.59:0/864339168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac58108020 0x7fac5819dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.674+0000 7fac5d6de640 1 --2- 172.21.15.59:0/864339168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac581076a0 0x7fac58198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.674+0000 7fac5d6de640 1 --2- 172.21.15.59:0/864339168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac58101c90 0x7fac581982d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.674+0000 7fac5d6de640 1 -- 172.21.15.59:0/864339168 >> 172.21.15.59:0/864339168 conn(0x7fac580fd700 msgr2=0x7fac580ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.674+0000 7fac5d6de640 1 -- 172.21.15.59:0/864339168 shutdown_connections 2024-09-10T21:14:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:38.674+0000 7fac5d6de640 1 -- 172.21.15.59:0/864339168 wait complete. 2024-09-10T21:14:38.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:38 smithi059 ceph-mon[30888]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:14:38.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:38 smithi154 ceph-mon[35041]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:14:39.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:38 smithi192 ceph-mon[35363]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:14:39.380 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T21:14:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.150+0000 7fd6fb95f640 1 -- 172.21.15.59:0/1513898371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f410f420 msgr2=0x7fd6f4111810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.150+0000 7fd6fb95f640 1 --2- 172.21.15.59:0/1513898371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f410f420 0x7fd6f4111810 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009900 tx=0x7fd6ec02a480 comp rx=0 tx=0).stop 2024-09-10T21:14:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.150+0000 7fd6fb95f640 1 -- 172.21.15.59:0/1513898371 shutdown_connections 2024-09-10T21:14:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.150+0000 7fd6fb95f640 1 --2- 172.21.15.59:0/1513898371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f410f420 0x7fd6f4111810 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.150+0000 7fd6fb95f640 1 --2- 172.21.15.59:0/1513898371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6f4102190 0x7fd6f410eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.150+0000 7fd6fb95f640 1 --2- 172.21.15.59:0/1513898371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6f4101870 0x7fd6f4101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.150+0000 7fd6fb95f640 1 -- 172.21.15.59:0/1513898371 >> 172.21.15.59:0/1513898371 conn(0x7fd6f40fd720 msgr2=0x7fd6f40ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.150+0000 7fd6fb95f640 1 -- 172.21.15.59:0/1513898371 shutdown_connections 2024-09-10T21:14:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.150+0000 7fd6fb95f640 1 -- 172.21.15.59:0/1513898371 wait complete. 2024-09-10T21:14:40.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.150+0000 7fd6fb95f640 1 Processor -- start 2024-09-10T21:14:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.150+0000 7fd6fb95f640 1 -- start start 2024-09-10T21:14:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6fb95f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6f4101870 0x7fd6f419b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6fb95f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f4102190 0x7fd6f419ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6fb95f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6f410f420 0x7fd6f41a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6fb95f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f4114fe0 con 0x7fd6f4102190 2024-09-10T21:14:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6fb95f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f4114e60 con 0x7fd6f410f420 2024-09-10T21:14:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6fb95f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f4115160 con 0x7fd6f4101870 2024-09-10T21:14:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6f8efa640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f4102190 0x7fd6f419ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6f8efa640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f4102190 0x7fd6f419ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59844/0 (socket says 172.21.15.59:59844) 2024-09-10T21:14:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6f8efa640 1 -- 172.21.15.59:0/3938351281 learned_addr learned my addr 172.21.15.59:0/3938351281 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6f9efc640 1 --2- 172.21.15.59:0/3938351281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6f410f420 0x7fd6f41a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6f96fb640 1 --2- 172.21.15.59:0/3938351281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6f4101870 0x7fd6f419b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:40.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6f8efa640 1 -- 172.21.15.59:0/3938351281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6f4101870 msgr2=0x7fd6f419b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6f8efa640 1 --2- 172.21.15.59:0/3938351281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6f4101870 0x7fd6f419b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6f8efa640 1 -- 172.21.15.59:0/3938351281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6f410f420 msgr2=0x7fd6f41a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6f8efa640 1 --2- 172.21.15.59:0/3938351281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6f410f420 0x7fd6f41a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6f8efa640 1 -- 172.21.15.59:0/3938351281 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f41a1590 con 0x7fd6f4102190 2024-09-10T21:14:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6f8efa640 1 --2- 172.21.15.59:0/3938351281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f4102190 0x7fd6f419ba20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400b4a0 tx=0x7fd6e400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6ea7fc640 1 -- 172.21.15.59:0/3938351281 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4014070 con 0x7fd6f4102190 2024-09-10T21:14:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6ea7fc640 1 -- 172.21.15.59:0/3938351281 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6e4010ac0 con 0x7fd6f4102190 2024-09-10T21:14:40.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6fb95f640 1 -- 172.21.15.59:0/3938351281 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f41a1880 con 0x7fd6f4102190 2024-09-10T21:14:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6ea7fc640 1 -- 172.21.15.59:0/3938351281 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4017c30 con 0x7fd6f4102190 2024-09-10T21:14:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.151+0000 7fd6fb95f640 1 -- 172.21.15.59:0/3938351281 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f41a7fc0 con 0x7fd6f4102190 2024-09-10T21:14:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6fdd34740 1 Processor -- start 2024-09-10T21:14:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6fdd34740 1 -- start start 2024-09-10T21:14:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6ea7fc640 1 -- 172.21.15.59:0/3938351281 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fd6e4010610 con 0x7fd6f4102190 2024-09-10T21:14:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6fdd34740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525a9d30 0x5648525aa110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6fdd34740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525aa650 0x5648525b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6fdd34740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 0x5648525b89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6fdd34740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564852521c10 con 0x5648525aa650 2024-09-10T21:14:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6fdd34740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564852511040 con 0x5648525a9d30 2024-09-10T21:14:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6fdd34740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564852514e50 con 0x5648525b65e0 2024-09-10T21:14:40.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6f96fb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525aa650 0x5648525b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6f96fb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525aa650 0x5648525b60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59858/0 (socket says 172.21.15.59:59858) 2024-09-10T21:14:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6f96fb640 1 -- 172.21.15.59:0/3264706868 learned_addr learned my addr 172.21.15.59:0/3264706868 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6f9efc640 1 --2- 172.21.15.59:0/3264706868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525a9d30 0x5648525aa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6f8efa640 1 --2- 172.21.15.59:0/3264706868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 0x5648525b89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6f96fb640 1 -- 172.21.15.59:0/3264706868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 msgr2=0x5648525b89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6f96fb640 1 --2- 172.21.15.59:0/3264706868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 0x5648525b89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6f96fb640 1 -- 172.21.15.59:0/3264706868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525a9d30 msgr2=0x5648525aa110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6f96fb640 1 --2- 172.21.15.59:0/3264706868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525a9d30 0x5648525aa110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6f96fb640 1 -- 172.21.15.59:0/3264706868 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56485226f540 con 0x5648525aa650 2024-09-10T21:14:40.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.155+0000 7fd6f9efc640 1 --2- 172.21.15.59:0/3264706868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525a9d30 0x5648525aa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:14:40.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.156+0000 7fd6f96fb640 1 --2- 172.21.15.59:0/3264706868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525aa650 0x5648525b60a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0003a20 tx=0x7fd6f0003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363e1b4875eab765 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:40.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.156+0000 7fd6df7fe640 1 -- 172.21.15.59:0/3264706868 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0004b20 con 0x5648525aa650 2024-09-10T21:14:40.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.156+0000 7fd6ea7fc640 1 --2- 172.21.15.59:0/3938351281 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd6e00b5370 0x7fd6e00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:40.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.156+0000 7fd6df7fe640 1 -- 172.21.15.59:0/3264706868 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6f0004cc0 con 0x5648525aa650 2024-09-10T21:14:40.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.156+0000 7fd6df7fe640 1 -- 172.21.15.59:0/3264706868 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0012690 con 0x5648525aa650 2024-09-10T21:14:40.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.156+0000 7fd6f9efc640 1 --2- 172.21.15.59:0/3938351281 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd6e00b5370 0x7fd6e00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:40.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.156+0000 7fd6ea7fc640 1 -- 172.21.15.59:0/3938351281 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd6e40e5570 con 0x7fd6f4102190 2024-09-10T21:14:40.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.157+0000 7fd6fdd34740 1 -- 172.21.15.59:0/3264706868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525aa650 msgr2=0x5648525b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:40.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.157+0000 7fd6f9efc640 1 --2- 172.21.15.59:0/3938351281 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd6e00b5370 0x7fd6e00b7830 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec006010 tx=0x7fd6ec0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:40.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.157+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/3264706868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525aa650 0x5648525b60a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0003a20 tx=0x7fd6f0003ee0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.157+0000 7fd6fdd34740 1 -- 172.21.15.59:0/3264706868 shutdown_connections 2024-09-10T21:14:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.157+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/3264706868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 0x5648525b89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.157+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/3264706868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525aa650 0x5648525b60a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.157+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/3264706868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525a9d30 0x5648525aa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.157+0000 7fd6fdd34740 1 -- 172.21.15.59:0/3264706868 >> 172.21.15.59:0/3264706868 conn(0x5648525a7b60 msgr2=0x5648525a8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.157+0000 7fd6fdd34740 1 -- 172.21.15.59:0/3264706868 shutdown_connections 2024-09-10T21:14:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.157+0000 7fd6fdd34740 1 -- 172.21.15.59:0/3264706868 wait complete. 2024-09-10T21:14:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.157+0000 7fd6fdd34740 1 -- start start 2024-09-10T21:14:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.157+0000 7fd6fdd34740 1 Processor -- start 2024-09-10T21:14:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6fdd34740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525a9d30 0x5648525b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6fdd34740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525aa650 0x5648525b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6fdd34740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 0x5648525b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6fdd34740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5648523725f0 con 0x5648525a9d30 2024-09-10T21:14:40.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6fdd34740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5648524ac010 con 0x5648525aa650 2024-09-10T21:14:40.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6fdd34740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5648525b9290 con 0x5648525b65e0 2024-09-10T21:14:40.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6fdd34740 10 client.0 _ll_register_callbacks cb 0x56485250b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:14:40.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6f96fb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525a9d30 0x5648525b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:40.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6f96fb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525a9d30 0x5648525b35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59872/0 (socket says 172.21.15.59:59872) 2024-09-10T21:14:40.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6f96fb640 1 -- 172.21.15.59:0/3389245798 learned_addr learned my addr 172.21.15.59:0/3389245798 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:40.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6f8efa640 1 --2- 172.21.15.59:0/3389245798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525aa650 0x5648525b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:40.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6f9efc640 1 --2- 172.21.15.59:0/3389245798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 0x5648525b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:40.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6f96fb640 1 -- 172.21.15.59:0/3389245798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 msgr2=0x5648525b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:40.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6f96fb640 1 --2- 172.21.15.59:0/3389245798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 0x5648525b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6f96fb640 1 -- 172.21.15.59:0/3389245798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525aa650 msgr2=0x5648525b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:40.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6f96fb640 1 --2- 172.21.15.59:0/3389245798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525aa650 0x5648525b3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6f96fb640 1 -- 172.21.15.59:0/3389245798 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648524d9a00 con 0x5648525a9d30 2024-09-10T21:14:40.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6f9efc640 1 --2- 172.21.15.59:0/3389245798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 0x5648525b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:40.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6f96fb640 1 --2- 172.21.15.59:0/3389245798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525a9d30 0x5648525b35c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00049d0 tx=0x7fd6f0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5b6600819f8679 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:40.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:14:40.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6dcff9640 1 -- 172.21.15.59:0/3389245798 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0005280 con 0x5648525a9d30 2024-09-10T21:14:40.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6dcff9640 1 -- 172.21.15.59:0/3389245798 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd6f0005420 con 0x5648525a9d30 2024-09-10T21:14:40.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.158+0000 7fd6fdd34740 1 -- 172.21.15.59:0/3389245798 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6f0004cc0 con 0x5648525a9d30 2024-09-10T21:14:40.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.159+0000 7fd6dcff9640 1 -- 172.21.15.59:0/3389245798 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd6f0005620 con 0x5648525a9d30 2024-09-10T21:14:40.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.159+0000 7fd6fdd34740 10 client.15126 fetch_fsmap learned FSMap version 27 2024-09-10T21:14:40.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.159+0000 7fd6fdd34740 1 -- 172.21.15.59:0/3389245798 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5648525c4e10 con 0x5648525a9d30 2024-09-10T21:14:40.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.159+0000 7fd6dcff9640 1 -- 172.21.15.59:0/3389245798 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6f0004cc0 con 0x5648525a9d30 2024-09-10T21:14:40.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.159+0000 7fd6dcff9640 1 -- 172.21.15.59:0/3389245798 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd6f000f040 con 0x5648525a9d30 2024-09-10T21:14:40.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.159+0000 7fd6fdd34740 10 client.15126 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:14:40.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.159+0000 7fd6fdd34740 10 client.15126 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T21:14:40.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.159+0000 7fd6fdd34740 20 client.15126 populate_metadata read hostname 'smithi059' 2024-09-10T21:14:40.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.159+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/3389245798 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5648525c71f0 0x5648525c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:40.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.159+0000 7fd6fdd34740 4 client.15126 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:14:40.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.159+0000 7fd6fdd34740 1 -- 172.21.15.59:0/3389245798 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564852523b60 con 0x5648525c71f0 2024-09-10T21:14:40.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.159+0000 7fd6f8efa640 1 --2- 172.21.15.59:0/3389245798 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5648525c71f0 0x5648525c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:40.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.160+0000 7fd6f8efa640 1 --2- 172.21.15.59:0/3389245798 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5648525c71f0 0x5648525c8660 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5d4f3997036050f5 server_cookie=1893874098db7501 in_seq=0 out_seq=0 2024-09-10T21:14:40.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.160+0000 7fd6dcff9640 10 client.15126 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:14:40.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.161+0000 7fd6dcff9640 1 -- 172.21.15.59:0/3389245798 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564852523b60 con 0x5648525c71f0 2024-09-10T21:14:40.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.161+0000 7fd6dcff9640 10 client.15126 handle_command_reply: tid=0 2024-09-10T21:14:40.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.161+0000 7fd6fdd34740 1 client.15126 shutdown 2024-09-10T21:14:40.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.161+0000 7fd6fdd34740 1 -- 172.21.15.59:0/3389245798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525a9d30 msgr2=0x5648525b35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:40.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.161+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/3389245798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525a9d30 0x5648525b35c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00049d0 tx=0x7fd6f0009c30 comp rx=0 tx=0).stop 2024-09-10T21:14:40.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.161+0000 7fd6fdd34740 1 -- 172.21.15.59:0/3389245798 shutdown_connections 2024-09-10T21:14:40.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.161+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/3389245798 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5648525c71f0 0x5648525c8660 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.161+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/3389245798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 0x5648525b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.161+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/3389245798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525aa650 0x5648525b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.161+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/3389245798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525a9d30 0x5648525b35c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.161+0000 7fd6fdd34740 1 -- 172.21.15.59:0/3389245798 >> 172.21.15.59:0/3389245798 conn(0x5648525a7b60 msgr2=0x5648525ad700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:40.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.161+0000 7fd6dcff9640 0 client.15126 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:14:40.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.161+0000 7fd6fdd34740 1 -- 172.21.15.59:0/3389245798 shutdown_connections 2024-09-10T21:14:40.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.161+0000 7fd6fdd34740 1 -- 172.21.15.59:0/3389245798 wait complete. 2024-09-10T21:14:40.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.161+0000 7fd6fdd34740 20 client.15126 trim_cache size 0 max 16384 2024-09-10T21:14:40.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.179+0000 7fd6fdd34740 1 Processor -- start 2024-09-10T21:14:40.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.179+0000 7fd6fdd34740 1 -- start start 2024-09-10T21:14:40.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.179+0000 7fd6fdd34740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525a9d30 0x5648525a9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:40.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.179+0000 7fd6fdd34740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525aa650 0x5648525aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.179+0000 7fd6fdd34740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 0x5648525adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.179+0000 7fd6fdd34740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5648525c69a0 con 0x5648525a9d30 2024-09-10T21:14:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.179+0000 7fd6fdd34740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5648525c7070 con 0x5648525aa650 2024-09-10T21:14:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.179+0000 7fd6fdd34740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5648525c7740 con 0x5648525b65e0 2024-09-10T21:14:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.179+0000 7fd6f96fb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525a9d30 0x5648525a9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.179+0000 7fd6f96fb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525a9d30 0x5648525a9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59876/0 (socket says 172.21.15.59:59876) 2024-09-10T21:14:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.179+0000 7fd6f96fb640 1 -- 172.21.15.59:0/1899006816 learned_addr learned my addr 172.21.15.59:0/1899006816 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.180+0000 7fd6f8efa640 1 --2- 172.21.15.59:0/1899006816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525aa650 0x5648525aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.180+0000 7fd6f96fb640 1 -- 172.21.15.59:0/1899006816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 msgr2=0x5648525adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.180+0000 7fd6f96fb640 1 --2- 172.21.15.59:0/1899006816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 0x5648525adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.180+0000 7fd6f96fb640 1 -- 172.21.15.59:0/1899006816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525aa650 msgr2=0x5648525aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.180+0000 7fd6f96fb640 1 --2- 172.21.15.59:0/1899006816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525aa650 0x5648525aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.180+0000 7fd6f96fb640 1 -- 172.21.15.59:0/1899006816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648525a85e0 con 0x5648525a9d30 2024-09-10T21:14:40.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.180+0000 7fd6f8efa640 1 --2- 172.21.15.59:0/1899006816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525aa650 0x5648525aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:14:40.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.180+0000 7fd6f96fb640 1 --2- 172.21.15.59:0/1899006816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525a9d30 0x5648525a9070 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0006010 tx=0x7fd6f0005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0e09cec9157cff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:40.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.180+0000 7fd6deffd640 1 -- 172.21.15.59:0/1899006816 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f00099c0 con 0x5648525a9d30 2024-09-10T21:14:40.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.180+0000 7fd6deffd640 1 -- 172.21.15.59:0/1899006816 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6f0035020 con 0x5648525a9d30 2024-09-10T21:14:40.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.180+0000 7fd6deffd640 1 -- 172.21.15.59:0/1899006816 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0031ba0 con 0x5648525a9d30 2024-09-10T21:14:40.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.181+0000 7fd6fdd34740 1 -- 172.21.15.59:0/1899006816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525a9d30 msgr2=0x5648525a9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:40.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.181+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/1899006816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525a9d30 0x5648525a9070 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0006010 tx=0x7fd6f0005c50 comp rx=0 tx=0).stop 2024-09-10T21:14:40.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.181+0000 7fd6fdd34740 1 -- 172.21.15.59:0/1899006816 shutdown_connections 2024-09-10T21:14:40.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.181+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/1899006816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 0x5648525adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.181+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/1899006816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525aa650 0x5648525aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.181+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/1899006816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525a9d30 0x5648525a9070 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.181+0000 7fd6fdd34740 1 -- 172.21.15.59:0/1899006816 >> 172.21.15.59:0/1899006816 conn(0x5648525a7b60 msgr2=0x5648525c1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:40.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.181+0000 7fd6fdd34740 1 -- 172.21.15.59:0/1899006816 shutdown_connections 2024-09-10T21:14:40.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.181+0000 7fd6fdd34740 1 -- 172.21.15.59:0/1899006816 wait complete. 2024-09-10T21:14:40.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.181+0000 7fd6fdd34740 1 -- start start 2024-09-10T21:14:40.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.181+0000 7fd6fdd34740 1 Processor -- start 2024-09-10T21:14:40.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6fdd34740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525a9d30 0x5648525d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:40.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6fdd34740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525aa650 0x5648525cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:40.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6fdd34740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 0x5648525cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:40.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6fdd34740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5648525c84e0 con 0x5648525aa650 2024-09-10T21:14:40.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6fdd34740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5648525c7e10 con 0x5648525a9d30 2024-09-10T21:14:40.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6fdd34740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5648525c8bb0 con 0x5648525b65e0 2024-09-10T21:14:40.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6fdd34740 10 client.0 _ll_register_callbacks cb 0x7fd6f0009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:14:40.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6f8efa640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525aa650 0x5648525cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:40.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6f8efa640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525aa650 0x5648525cb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59882/0 (socket says 172.21.15.59:59882) 2024-09-10T21:14:40.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6f8efa640 1 -- 172.21.15.59:0/1690989222 learned_addr learned my addr 172.21.15.59:0/1690989222 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:40.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6f96fb640 1 --2- 172.21.15.59:0/1690989222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525a9d30 0x5648525d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:40.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6f9efc640 1 --2- 172.21.15.59:0/1690989222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 0x5648525cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:40.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6f8efa640 1 -- 172.21.15.59:0/1690989222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 msgr2=0x5648525cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:40.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6f8efa640 1 --2- 172.21.15.59:0/1690989222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 0x5648525cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6f8efa640 1 -- 172.21.15.59:0/1690989222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525a9d30 msgr2=0x5648525d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:40.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6f8efa640 1 --2- 172.21.15.59:0/1690989222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525a9d30 0x5648525d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6f8efa640 1 -- 172.21.15.59:0/1690989222 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648525b8d40 con 0x5648525aa650 2024-09-10T21:14:40.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6f8efa640 1 --2- 172.21.15.59:0/1690989222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525aa650 0x5648525cb3a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4000c00 tx=0x7fd6e4010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f59d50b28200bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:40.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:14:40.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6dcff9640 1 -- 172.21.15.59:0/1690989222 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e401e040 con 0x5648525aa650 2024-09-10T21:14:40.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.182+0000 7fd6dcff9640 1 -- 172.21.15.59:0/1690989222 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd6e4010c70 con 0x5648525aa650 2024-09-10T21:14:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.183+0000 7fd6fdd34740 1 -- 172.21.15.59:0/1690989222 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6f0035020 con 0x5648525aa650 2024-09-10T21:14:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.183+0000 7fd6dcff9640 1 -- 172.21.15.59:0/1690989222 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd6e4017360 con 0x5648525aa650 2024-09-10T21:14:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.183+0000 7fd6fdd34740 10 client.15132 fetch_fsmap learned FSMap version 27 2024-09-10T21:14:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.183+0000 7fd6fdd34740 1 -- 172.21.15.59:0/1690989222 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5648526347a0 con 0x5648525aa650 2024-09-10T21:14:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.183+0000 7fd6dcff9640 1 -- 172.21.15.59:0/1690989222 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6f0035020 con 0x5648525aa650 2024-09-10T21:14:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.183+0000 7fd6dcff9640 1 -- 172.21.15.59:0/1690989222 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd6e40a7f20 con 0x5648525aa650 2024-09-10T21:14:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.183+0000 7fd6fdd34740 10 client.15132 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:14:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.183+0000 7fd6fdd34740 10 client.15132 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T21:14:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.183+0000 7fd6fdd34740 20 client.15132 populate_metadata read hostname 'smithi059' 2024-09-10T21:14:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.183+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/1690989222 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5648526392d0 0x564852637fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.183+0000 7fd6fdd34740 4 client.15132 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:14:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.183+0000 7fd6fdd34740 1 -- 172.21.15.59:0/1690989222 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "status"}) -- 0x56485251f610 con 0x5648526392d0 2024-09-10T21:14:40.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.184+0000 7fd6f96fb640 1 --2- 172.21.15.59:0/1690989222 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5648526392d0 0x564852637fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:40.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.184+0000 7fd6dcff9640 10 client.15132 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:14:40.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.184+0000 7fd6f96fb640 1 --2- 172.21.15.59:0/1690989222 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5648526392d0 0x564852637fe0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f48e174466fe944a server_cookie=d5f63b9e59b2c347 in_seq=0 out_seq=0 2024-09-10T21:14:40.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.184+0000 7fd6dcff9640 1 -- 172.21.15.59:0/1690989222 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56485251f610 con 0x5648526392d0 2024-09-10T21:14:40.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.184+0000 7fd6dcff9640 10 client.15132 handle_command_reply: tid=0 2024-09-10T21:14:40.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.184+0000 7fd6fdd34740 1 client.15132 shutdown 2024-09-10T21:14:40.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.184+0000 7fd6fdd34740 1 -- 172.21.15.59:0/1690989222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525aa650 msgr2=0x5648525cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:40.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.184+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/1690989222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525aa650 0x5648525cb3a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4000c00 tx=0x7fd6e4010f90 comp rx=0 tx=0).stop 2024-09-10T21:14:40.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.184+0000 7fd6fdd34740 1 -- 172.21.15.59:0/1690989222 shutdown_connections 2024-09-10T21:14:40.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.184+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/1690989222 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5648526392d0 0x564852637fe0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.185+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/1690989222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5648525b65e0 0x5648525cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.185+0000 7fd6dcff9640 0 client.15132 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:14:40.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.185+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/1690989222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648525aa650 0x5648525cb3a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.185+0000 7fd6fdd34740 1 --2- 172.21.15.59:0/1690989222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5648525a9d30 0x5648525d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.185+0000 7fd6fdd34740 1 -- 172.21.15.59:0/1690989222 >> 172.21.15.59:0/1690989222 conn(0x5648525a7b60 msgr2=0x5648525c1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:40.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.185+0000 7fd6fdd34740 1 -- 172.21.15.59:0/1690989222 shutdown_connections 2024-09-10T21:14:40.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.185+0000 7fd6fdd34740 1 -- 172.21.15.59:0/1690989222 wait complete. 2024-09-10T21:14:40.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.185+0000 7fd6fdd34740 20 client.15132 trim_cache size 0 max 16384 2024-09-10T21:14:40.200 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:14:40.200 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "3c26b952-6fb8-11ef-bcea-c7b262605968", 2024-09-10T21:14:40.201 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 1, 2024-09-10T21:14:40.201 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 24550, 2024-09-10T21:14:40.201 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-09-10T21:14:40.201 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-09-10T21:14:40.202 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-09-10T21:14:40.202 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 73.265962978999994, 2024-09-10T21:14:40.202 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 27, 2024-09-10T21:14:40.203 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 75, 2024-09-10T21:14:40.203 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T21:14:40.203 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 99.124118283000001 2024-09-10T21:14:40.203 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:14:40.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.185+0000 7fd6fb95f640 1 -- 172.21.15.59:0/3938351281 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd6e00b5370 msgr2=0x7fd6e00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:40.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.185+0000 7fd6fb95f640 1 --2- 172.21.15.59:0/3938351281 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd6e00b5370 0x7fd6e00b7830 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec006010 tx=0x7fd6ec0058d0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.185+0000 7fd6fb95f640 1 -- 172.21.15.59:0/3938351281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f4102190 msgr2=0x7fd6f419ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:40.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.185+0000 7fd6fb95f640 1 --2- 172.21.15.59:0/3938351281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f4102190 0x7fd6f419ba20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400b4a0 tx=0x7fd6e400b960 comp rx=0 tx=0).stop 2024-09-10T21:14:40.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.185+0000 7fd6fb95f640 1 -- 172.21.15.59:0/3938351281 shutdown_connections 2024-09-10T21:14:40.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.185+0000 7fd6fb95f640 1 --2- 172.21.15.59:0/3938351281 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd6e00b5370 0x7fd6e00b7830 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.185+0000 7fd6fb95f640 1 --2- 172.21.15.59:0/3938351281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6f410f420 0x7fd6f41a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.185+0000 7fd6fb95f640 1 --2- 172.21.15.59:0/3938351281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6f4102190 0x7fd6f419ba20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.185+0000 7fd6fb95f640 1 --2- 172.21.15.59:0/3938351281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6f4101870 0x7fd6f419b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:40.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.185+0000 7fd6fb95f640 1 -- 172.21.15.59:0/3938351281 >> 172.21.15.59:0/3938351281 conn(0x7fd6f40fd720 msgr2=0x7fd6f4110710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:40.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.186+0000 7fd6fb95f640 1 -- 172.21.15.59:0/3938351281 shutdown_connections 2024-09-10T21:14:40.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:40.186+0000 7fd6fb95f640 1 -- 172.21.15.59:0/3938351281 wait complete. 2024-09-10T21:14:40.818 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:40 smithi059 ceph-mon[30888]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:40.850 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T21:14:40.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:40 smithi154 ceph-mon[35041]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:41.081 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:40 smithi192 ceph-mon[35363]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:41.110 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:41.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.610+0000 7ff267c14640 1 -- 172.21.15.59:0/3290803591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2601087d0 msgr2=0x7ff260108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:41.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.610+0000 7ff267c14640 1 --2- 172.21.15.59:0/3290803591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2601087d0 0x7ff260108c10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009900 tx=0x7ff25c02a410 comp rx=0 tx=0).stop 2024-09-10T21:14:41.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.610+0000 7ff267c14640 1 -- 172.21.15.59:0/3290803591 shutdown_connections 2024-09-10T21:14:41.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.610+0000 7ff267c14640 1 --2- 172.21.15.59:0/3290803591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff260109150 0x7ff26010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.610+0000 7ff267c14640 1 --2- 172.21.15.59:0/3290803591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2601087d0 0x7ff260108c10 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.610+0000 7ff267c14640 1 --2- 172.21.15.59:0/3290803591 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff260102dc0 0x7ff2601031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.610+0000 7ff267c14640 1 -- 172.21.15.59:0/3290803591 >> 172.21.15.59:0/3290803591 conn(0x7ff2600fe830 msgr2=0x7ff260100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.610+0000 7ff267c14640 1 -- 172.21.15.59:0/3290803591 shutdown_connections 2024-09-10T21:14:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.610+0000 7ff267c14640 1 -- 172.21.15.59:0/3290803591 wait complete. 2024-09-10T21:14:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.611+0000 7ff267c14640 1 Processor -- start 2024-09-10T21:14:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.611+0000 7ff267c14640 1 -- start start 2024-09-10T21:14:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.611+0000 7ff267c14640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff260102dc0 0x7ff2601992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.611+0000 7ff267c14640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2601087d0 0x7ff2601997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.611+0000 7ff267c14640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff260109150 0x7ff26019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.611+0000 7ff267c14640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff260112e10 con 0x7ff2601087d0 2024-09-10T21:14:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.611+0000 7ff267c14640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff260112c90 con 0x7ff260109150 2024-09-10T21:14:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.611+0000 7ff267c14640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff260112f90 con 0x7ff260102dc0 2024-09-10T21:14:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.611+0000 7ff2651af640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2601087d0 0x7ff2601997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.611+0000 7ff2651af640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2601087d0 0x7ff2601997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59914/0 (socket says 172.21.15.59:59914) 2024-09-10T21:14:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.611+0000 7ff2651af640 1 -- 172.21.15.59:0/2366686170 learned_addr learned my addr 172.21.15.59:0/2366686170 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.612+0000 7ff2659b0640 1 --2- 172.21.15.59:0/2366686170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff260102dc0 0x7ff2601992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.612+0000 7ff2661b1640 1 --2- 172.21.15.59:0/2366686170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff260109150 0x7ff26019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.612+0000 7ff2651af640 1 -- 172.21.15.59:0/2366686170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff260102dc0 msgr2=0x7ff2601992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.612+0000 7ff2651af640 1 --2- 172.21.15.59:0/2366686170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff260102dc0 0x7ff2601992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.612+0000 7ff2651af640 1 -- 172.21.15.59:0/2366686170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff260109150 msgr2=0x7ff26019eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.612+0000 7ff2651af640 1 --2- 172.21.15.59:0/2366686170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff260109150 0x7ff26019eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.612+0000 7ff2651af640 1 -- 172.21.15.59:0/2366686170 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26019f350 con 0x7ff2601087d0 2024-09-10T21:14:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.612+0000 7ff2661b1640 1 --2- 172.21.15.59:0/2366686170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff260109150 0x7ff26019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:14:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.612+0000 7ff2651af640 1 --2- 172.21.15.59:0/2366686170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2601087d0 0x7ff2601997e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff25c006010 tx=0x7ff25c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.612+0000 7ff252ffd640 1 -- 172.21.15.59:0/2366686170 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c03f030 con 0x7ff2601087d0 2024-09-10T21:14:41.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.612+0000 7ff252ffd640 1 -- 172.21.15.59:0/2366686170 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff25c003800 con 0x7ff2601087d0 2024-09-10T21:14:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.612+0000 7ff252ffd640 1 -- 172.21.15.59:0/2366686170 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c035070 con 0x7ff2601087d0 2024-09-10T21:14:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.612+0000 7ff267c14640 1 -- 172.21.15.59:0/2366686170 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff26019f5e0 con 0x7ff2601087d0 2024-09-10T21:14:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.612+0000 7ff267c14640 1 -- 172.21.15.59:0/2366686170 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2601a5d00 con 0x7ff2601087d0 2024-09-10T21:14:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.615+0000 7ff269fe9740 1 Processor -- start 2024-09-10T21:14:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.615+0000 7ff252ffd640 1 -- 172.21.15.59:0/2366686170 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7ff25c031b10 con 0x7ff2601087d0 2024-09-10T21:14:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.615+0000 7ff269fe9740 1 -- start start 2024-09-10T21:14:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.615+0000 7ff269fe9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d549218d30 0x55d549219110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.615+0000 7ff269fe9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d549219650 0x55d5492250a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.615+0000 7ff269fe9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5492255e0 0x55d5492279d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.615+0000 7ff269fe9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d549190c10 con 0x55d5492255e0 2024-09-10T21:14:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.615+0000 7ff269fe9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d549180040 con 0x55d549218d30 2024-09-10T21:14:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.615+0000 7ff269fe9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d549183e50 con 0x55d549219650 2024-09-10T21:14:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.616+0000 7ff2651af640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5492255e0 0x55d5492279d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.616+0000 7ff2659b0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d549219650 0x55d5492250a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.616+0000 7ff2659b0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d549219650 0x55d5492250a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:41726/0 (socket says 172.21.15.59:41726) 2024-09-10T21:14:41.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.616+0000 7ff2659b0640 1 -- 172.21.15.59:0/1821858904 learned_addr learned my addr 172.21.15.59:0/1821858904 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:41.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.616+0000 7ff2661b1640 1 --2- 172.21.15.59:0/1821858904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d549218d30 0x55d549219110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:41.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.616+0000 7ff2651af640 1 -- 172.21.15.59:0/1821858904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d549219650 msgr2=0x55d5492250a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:41.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.616+0000 7ff2651af640 1 --2- 172.21.15.59:0/1821858904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d549219650 0x55d5492250a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.616+0000 7ff2651af640 1 -- 172.21.15.59:0/1821858904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d549218d30 msgr2=0x55d549219110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:41.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.616+0000 7ff2651af640 1 --2- 172.21.15.59:0/1821858904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d549218d30 0x55d549219110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.616+0000 7ff2651af640 1 -- 172.21.15.59:0/1821858904 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d548ede540 con 0x55d5492255e0 2024-09-10T21:14:41.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.616+0000 7ff252ffd640 1 --2- 172.21.15.59:0/2366686170 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff24c0b53f0 0x7ff24c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:41.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.616+0000 7ff2661b1640 1 --2- 172.21.15.59:0/2366686170 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff24c0b53f0 0x7ff24c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:41.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.616+0000 7ff2651af640 1 --2- 172.21.15.59:0/1821858904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5492255e0 0x55d5492279d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff25c104050 tx=0x7ff25c10ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c70b29283f546bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:41.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.616+0000 7ff252ffd640 1 -- 172.21.15.59:0/2366686170 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff25c1066a0 con 0x7ff2601087d0 2024-09-10T21:14:41.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.617+0000 7ff24bfff640 1 -- 172.21.15.59:0/1821858904 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0c9380 con 0x55d5492255e0 2024-09-10T21:14:41.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.617+0000 7ff24bfff640 1 -- 172.21.15.59:0/1821858904 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff25c0cc840 con 0x55d5492255e0 2024-09-10T21:14:41.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.617+0000 7ff24bfff640 1 -- 172.21.15.59:0/1821858904 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0cc4a0 con 0x55d5492255e0 2024-09-10T21:14:41.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.617+0000 7ff269fe9740 1 -- 172.21.15.59:0/1821858904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5492255e0 msgr2=0x55d5492279d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:41.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.617+0000 7ff269fe9740 1 --2- 172.21.15.59:0/1821858904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5492255e0 0x55d5492279d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff25c104050 tx=0x7ff25c10ccb0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.617+0000 7ff2661b1640 1 --2- 172.21.15.59:0/2366686170 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff24c0b53f0 0x7ff24c0b78b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff258005fd0 tx=0x7ff2580086a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.617+0000 7ff269fe9740 1 -- 172.21.15.59:0/1821858904 shutdown_connections 2024-09-10T21:14:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.617+0000 7ff269fe9740 1 --2- 172.21.15.59:0/1821858904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5492255e0 0x55d5492279d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.617+0000 7ff269fe9740 1 --2- 172.21.15.59:0/1821858904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d549219650 0x55d5492250a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.617+0000 7ff269fe9740 1 --2- 172.21.15.59:0/1821858904 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d549218d30 0x55d549219110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.617+0000 7ff269fe9740 1 -- 172.21.15.59:0/1821858904 >> 172.21.15.59:0/1821858904 conn(0x55d549216b60 msgr2=0x55d549217d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.617+0000 7ff269fe9740 1 -- 172.21.15.59:0/1821858904 shutdown_connections 2024-09-10T21:14:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.617+0000 7ff269fe9740 1 -- 172.21.15.59:0/1821858904 wait complete. 2024-09-10T21:14:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.618+0000 7ff269fe9740 1 -- start start 2024-09-10T21:14:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.618+0000 7ff269fe9740 1 Processor -- start 2024-09-10T21:14:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.618+0000 7ff269fe9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d549218d30 0x55d5492225d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.618+0000 7ff269fe9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d549219650 0x55d549222b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.618+0000 7ff269fe9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5492255e0 0x55d549223050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.618+0000 7ff269fe9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d548fe15f0 con 0x55d5492255e0 2024-09-10T21:14:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.618+0000 7ff269fe9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d54911b010 con 0x55d549219650 2024-09-10T21:14:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.618+0000 7ff269fe9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d549228050 con 0x55d549218d30 2024-09-10T21:14:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.618+0000 7ff269fe9740 10 client.0 _ll_register_callbacks cb 0x55d54917a340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:14:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.618+0000 7ff2661b1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5492255e0 0x55d549223050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.619+0000 7ff2661b1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5492255e0 0x55d549223050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59930/0 (socket says 172.21.15.59:59930) 2024-09-10T21:14:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.619+0000 7ff2661b1640 1 -- 172.21.15.59:0/3376564990 learned_addr learned my addr 172.21.15.59:0/3376564990 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.619+0000 7ff2651af640 1 --2- 172.21.15.59:0/3376564990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d549219650 0x55d549222b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.619+0000 7ff2659b0640 1 --2- 172.21.15.59:0/3376564990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d549218d30 0x55d5492225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.619+0000 7ff2661b1640 1 -- 172.21.15.59:0/3376564990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d549218d30 msgr2=0x55d5492225d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.619+0000 7ff2661b1640 1 --2- 172.21.15.59:0/3376564990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d549218d30 0x55d5492225d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.619+0000 7ff2661b1640 1 -- 172.21.15.59:0/3376564990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d549219650 msgr2=0x55d549222b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.619+0000 7ff2661b1640 1 --2- 172.21.15.59:0/3376564990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d549219650 0x55d549222b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.619+0000 7ff2661b1640 1 -- 172.21.15.59:0/3376564990 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d549148a00 con 0x55d5492255e0 2024-09-10T21:14:41.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.619+0000 7ff2661b1640 1 --2- 172.21.15.59:0/3376564990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5492255e0 0x55d549223050 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff25801cda0 tx=0x7ff258004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91d9ab0a8bb1bd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:41.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.619+0000 7ff2497fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:14:41.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.619+0000 7ff2497fa640 1 -- 172.21.15.59:0/3376564990 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25801d620 con 0x55d5492255e0 2024-09-10T21:14:41.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.619+0000 7ff2497fa640 1 -- 172.21.15.59:0/3376564990 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff25801d7c0 con 0x55d5492255e0 2024-09-10T21:14:41.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.619+0000 7ff269fe9740 1 -- 172.21.15.59:0/3376564990 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff25c0cc840 con 0x55d5492255e0 2024-09-10T21:14:41.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.619+0000 7ff2497fa640 1 -- 172.21.15.59:0/3376564990 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff258004b20 con 0x55d5492255e0 2024-09-10T21:14:41.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.619+0000 7ff269fe9740 10 client.15144 fetch_fsmap learned FSMap version 27 2024-09-10T21:14:41.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.619+0000 7ff269fe9740 1 -- 172.21.15.59:0/3376564990 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d549233bd0 con 0x55d5492255e0 2024-09-10T21:14:41.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.620+0000 7ff2497fa640 1 -- 172.21.15.59:0/3376564990 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff25c0cc840 con 0x55d5492255e0 2024-09-10T21:14:41.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.620+0000 7ff2497fa640 1 -- 172.21.15.59:0/3376564990 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ff2580052a0 con 0x55d5492255e0 2024-09-10T21:14:41.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.620+0000 7ff269fe9740 10 client.15144 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:14:41.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.620+0000 7ff269fe9740 10 client.15144 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T21:14:41.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.620+0000 7ff269fe9740 20 client.15144 populate_metadata read hostname 'smithi059' 2024-09-10T21:14:41.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.620+0000 7ff269fe9740 1 --2- 172.21.15.59:0/3376564990 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d549236210 0x55d549237680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:41.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.620+0000 7ff269fe9740 4 client.15144 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:14:41.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.620+0000 7ff269fe9740 1 -- 172.21.15.59:0/3376564990 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d549192b60 con 0x55d549236210 2024-09-10T21:14:41.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.620+0000 7ff2659b0640 1 --2- 172.21.15.59:0/3376564990 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d549236210 0x55d549237680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:41.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.621+0000 7ff2659b0640 1 --2- 172.21.15.59:0/3376564990 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d549236210 0x55d549237680 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=869070d34f7eeb90 server_cookie=e147f69671ffc293 in_seq=0 out_seq=0 2024-09-10T21:14:41.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.621+0000 7ff2497fa640 10 client.15144 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:14:41.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.621+0000 7ff2497fa640 1 -- 172.21.15.59:0/3376564990 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d549192b60 con 0x55d549236210 2024-09-10T21:14:41.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.621+0000 7ff2497fa640 10 client.15144 handle_command_reply: tid=0 2024-09-10T21:14:41.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.621+0000 7ff269fe9740 1 client.15144 shutdown 2024-09-10T21:14:41.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.622+0000 7ff269fe9740 1 -- 172.21.15.59:0/3376564990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5492255e0 msgr2=0x55d549223050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:41.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.622+0000 7ff269fe9740 1 --2- 172.21.15.59:0/3376564990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5492255e0 0x55d549223050 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff25801cda0 tx=0x7ff258004a40 comp rx=0 tx=0).stop 2024-09-10T21:14:41.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.622+0000 7ff269fe9740 1 -- 172.21.15.59:0/3376564990 shutdown_connections 2024-09-10T21:14:41.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.622+0000 7ff269fe9740 1 --2- 172.21.15.59:0/3376564990 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d549236210 0x55d549237680 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.622+0000 7ff269fe9740 1 --2- 172.21.15.59:0/3376564990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d5492255e0 0x55d549223050 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.622+0000 7ff269fe9740 1 --2- 172.21.15.59:0/3376564990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d549219650 0x55d549222b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.622+0000 7ff2497fa640 0 client.15144 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:14:41.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.622+0000 7ff269fe9740 1 --2- 172.21.15.59:0/3376564990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d549218d30 0x55d5492225d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.622+0000 7ff269fe9740 1 -- 172.21.15.59:0/3376564990 >> 172.21.15.59:0/3376564990 conn(0x55d549216b60 msgr2=0x55d54921c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:41.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.622+0000 7ff269fe9740 1 -- 172.21.15.59:0/3376564990 shutdown_connections 2024-09-10T21:14:41.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.622+0000 7ff269fe9740 1 -- 172.21.15.59:0/3376564990 wait complete. 2024-09-10T21:14:41.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.622+0000 7ff269fe9740 20 client.15144 trim_cache size 0 max 16384 2024-09-10T21:14:41.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.640+0000 7ff269fe9740 1 Processor -- start 2024-09-10T21:14:41.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.640+0000 7ff269fe9740 1 -- start start 2024-09-10T21:14:41.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.640+0000 7ff269fe9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d549218d30 0x55d54921cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:41.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.640+0000 7ff269fe9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d549219650 0x55d54923fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:41.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.640+0000 7ff269fe9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d5492255e0 0x55d549240290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:41.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.640+0000 7ff269fe9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d5492359c0 con 0x55d549218d30 2024-09-10T21:14:41.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.640+0000 7ff269fe9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d549236090 con 0x55d549219650 2024-09-10T21:14:41.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.640+0000 7ff269fe9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d549236760 con 0x55d5492255e0 2024-09-10T21:14:41.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.640+0000 7ff2659b0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d549218d30 0x55d54921cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:41.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.640+0000 7ff2659b0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d549218d30 0x55d54921cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59936/0 (socket says 172.21.15.59:59936) 2024-09-10T21:14:41.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.640+0000 7ff2659b0640 1 -- 172.21.15.59:0/341445310 learned_addr learned my addr 172.21.15.59:0/341445310 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:41.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.641+0000 7ff2661b1640 1 --2- 172.21.15.59:0/341445310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d5492255e0 0x55d549240290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:41.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.641+0000 7ff2659b0640 1 -- 172.21.15.59:0/341445310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d5492255e0 msgr2=0x55d549240290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:41.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.641+0000 7ff2659b0640 1 --2- 172.21.15.59:0/341445310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d5492255e0 0x55d549240290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.641+0000 7ff2651af640 1 --2- 172.21.15.59:0/341445310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d549219650 0x55d54923fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:41.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.641+0000 7ff2659b0640 1 -- 172.21.15.59:0/341445310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d549219650 msgr2=0x55d54923fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:41.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.641+0000 7ff2659b0640 1 --2- 172.21.15.59:0/341445310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d549219650 0x55d54923fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.641+0000 7ff2659b0640 1 -- 172.21.15.59:0/341445310 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d549216990 con 0x55d549218d30 2024-09-10T21:14:41.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.641+0000 7ff2651af640 1 --2- 172.21.15.59:0/341445310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d549219650 0x55d54923fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:14:41.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.641+0000 7ff2659b0640 1 --2- 172.21.15.59:0/341445310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d549218d30 0x55d54921cef0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff25400b810 tx=0x7ff254008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e601015b00cb92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:41.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.641+0000 7ff24b7fe640 1 -- 172.21.15.59:0/341445310 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff254016ac0 con 0x55d549218d30 2024-09-10T21:14:41.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.641+0000 7ff24b7fe640 1 -- 172.21.15.59:0/341445310 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff254020030 con 0x55d549218d30 2024-09-10T21:14:41.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.641+0000 7ff24b7fe640 1 -- 172.21.15.59:0/341445310 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff254024e10 con 0x55d549218d30 2024-09-10T21:14:41.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.642+0000 7ff269fe9740 1 -- 172.21.15.59:0/341445310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d549218d30 msgr2=0x55d54921cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:41.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.642+0000 7ff269fe9740 1 --2- 172.21.15.59:0/341445310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d549218d30 0x55d54921cef0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff25400b810 tx=0x7ff254008040 comp rx=0 tx=0).stop 2024-09-10T21:14:41.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.642+0000 7ff269fe9740 1 -- 172.21.15.59:0/341445310 shutdown_connections 2024-09-10T21:14:41.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.642+0000 7ff269fe9740 1 --2- 172.21.15.59:0/341445310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d5492255e0 0x55d549240290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.642+0000 7ff269fe9740 1 --2- 172.21.15.59:0/341445310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d549219650 0x55d54923fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.642+0000 7ff269fe9740 1 --2- 172.21.15.59:0/341445310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d549218d30 0x55d54921cef0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.642+0000 7ff269fe9740 1 -- 172.21.15.59:0/341445310 >> 172.21.15.59:0/341445310 conn(0x55d549216b60 msgr2=0x55d549235040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.642+0000 7ff269fe9740 1 -- 172.21.15.59:0/341445310 shutdown_connections 2024-09-10T21:14:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.642+0000 7ff269fe9740 1 -- 172.21.15.59:0/341445310 wait complete. 2024-09-10T21:14:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.642+0000 7ff269fe9740 1 -- start start 2024-09-10T21:14:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.642+0000 7ff269fe9740 1 Processor -- start 2024-09-10T21:14:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff269fe9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d549218d30 0x55d549238b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff269fe9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d549219650 0x55d5492390a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff269fe9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5492255e0 0x55d5492395e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff269fe9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d549237500 con 0x55d549219650 2024-09-10T21:14:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff269fe9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d549236e30 con 0x55d5492255e0 2024-09-10T21:14:41.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff269fe9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d549237bd0 con 0x55d549218d30 2024-09-10T21:14:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff269fe9740 10 client.0 _ll_register_callbacks cb 0x7ff258008be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:14:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff2651af640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d549219650 0x55d5492390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff2659b0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d549218d30 0x55d549238b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff2659b0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d549218d30 0x55d549238b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:41758/0 (socket says 172.21.15.59:41758) 2024-09-10T21:14:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff2659b0640 1 -- 172.21.15.59:0/1972420308 learned_addr learned my addr 172.21.15.59:0/1972420308 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff2661b1640 1 --2- 172.21.15.59:0/1972420308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5492255e0 0x55d5492395e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff2651af640 1 -- 172.21.15.59:0/1972420308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d549218d30 msgr2=0x55d549238b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff2651af640 1 --2- 172.21.15.59:0/1972420308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d549218d30 0x55d549238b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff2651af640 1 -- 172.21.15.59:0/1972420308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5492255e0 msgr2=0x55d5492395e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff2651af640 1 --2- 172.21.15.59:0/1972420308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5492255e0 0x55d5492395e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff2651af640 1 -- 172.21.15.59:0/1972420308 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5492175e0 con 0x55d549219650 2024-09-10T21:14:41.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff2659b0640 1 --2- 172.21.15.59:0/1972420308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d549218d30 0x55d549238b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:14:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff2651af640 1 --2- 172.21.15.59:0/1972420308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d549219650 0x55d5492390a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff25c108000 tx=0x7ff25c0044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3229984848f3d536 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff2497fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:14:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff2497fa640 1 -- 172.21.15.59:0/1972420308 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c049040 con 0x55d549219650 2024-09-10T21:14:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff2497fa640 1 -- 172.21.15.59:0/1972420308 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff25c0b40d0 con 0x55d549219650 2024-09-10T21:14:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.643+0000 7ff269fe9740 1 -- 172.21.15.59:0/1972420308 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff254020030 con 0x55d549219650 2024-09-10T21:14:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.644+0000 7ff2497fa640 1 -- 172.21.15.59:0/1972420308 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff25c0cc680 con 0x55d549219650 2024-09-10T21:14:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.644+0000 7ff269fe9740 10 client.15150 fetch_fsmap learned FSMap version 27 2024-09-10T21:14:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.644+0000 7ff269fe9740 1 -- 172.21.15.59:0/1972420308 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d5492a7d30 con 0x55d549219650 2024-09-10T21:14:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.644+0000 7ff2497fa640 1 -- 172.21.15.59:0/1972420308 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff254020030 con 0x55d549219650 2024-09-10T21:14:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.644+0000 7ff2497fa640 1 -- 172.21.15.59:0/1972420308 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ff25c0ccf90 con 0x55d549219650 2024-09-10T21:14:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.644+0000 7ff269fe9740 10 client.15150 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:14:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.644+0000 7ff269fe9740 10 client.15150 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T21:14:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.644+0000 7ff269fe9740 20 client.15150 populate_metadata read hostname 'smithi059' 2024-09-10T21:14:41.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.644+0000 7ff269fe9740 1 --2- 172.21.15.59:0/1972420308 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d5492ac610 0x55d5492ab320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.644+0000 7ff269fe9740 4 client.15150 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:14:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.644+0000 7ff269fe9740 1 -- 172.21.15.59:0/1972420308 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "status"}) -- 0x55d549235810 con 0x55d5492ac610 2024-09-10T21:14:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.644+0000 7ff2659b0640 1 --2- 172.21.15.59:0/1972420308 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d5492ac610 0x55d5492ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.645+0000 7ff2659b0640 1 --2- 172.21.15.59:0/1972420308 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d5492ac610 0x55d5492ab320 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20d9397ea736ff0f server_cookie=931241d9dafbf96b in_seq=0 out_seq=0 2024-09-10T21:14:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.645+0000 7ff2497fa640 10 client.15150 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:14:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.645+0000 7ff2497fa640 1 -- 172.21.15.59:0/1972420308 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d549235810 con 0x55d5492ac610 2024-09-10T21:14:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.645+0000 7ff2497fa640 10 client.15150 handle_command_reply: tid=0 2024-09-10T21:14:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.645+0000 7ff269fe9740 1 client.15150 shutdown 2024-09-10T21:14:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.645+0000 7ff269fe9740 1 -- 172.21.15.59:0/1972420308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d549219650 msgr2=0x55d5492390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.645+0000 7ff269fe9740 1 --2- 172.21.15.59:0/1972420308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d549219650 0x55d5492390a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff25c108000 tx=0x7ff25c0044e0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.645+0000 7ff269fe9740 1 -- 172.21.15.59:0/1972420308 shutdown_connections 2024-09-10T21:14:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.645+0000 7ff269fe9740 1 --2- 172.21.15.59:0/1972420308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5492255e0 0x55d5492395e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.645+0000 7ff269fe9740 1 --2- 172.21.15.59:0/1972420308 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d5492ac610 0x55d5492ab320 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.645+0000 7ff269fe9740 1 --2- 172.21.15.59:0/1972420308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d549219650 0x55d5492390a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.645+0000 7ff269fe9740 1 --2- 172.21.15.59:0/1972420308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d549218d30 0x55d549238b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.645+0000 7ff2497fa640 0 client.15150 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:14:41.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.645+0000 7ff269fe9740 1 -- 172.21.15.59:0/1972420308 >> 172.21.15.59:0/1972420308 conn(0x55d549216b60 msgr2=0x55d5492302a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:41.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.645+0000 7ff269fe9740 1 -- 172.21.15.59:0/1972420308 shutdown_connections 2024-09-10T21:14:41.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.645+0000 7ff269fe9740 1 -- 172.21.15.59:0/1972420308 wait complete. 2024-09-10T21:14:41.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.645+0000 7ff269fe9740 20 client.15150 trim_cache size 0 max 16384 2024-09-10T21:14:41.655 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:14:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "3c26b952-6fb8-11ef-bcea-c7b262605968", 2024-09-10T21:14:41.655 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-09-10T21:14:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 24563, 2024-09-10T21:14:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-09-10T21:14:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-09-10T21:14:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-09-10T21:14:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 82.000770001000006, 2024-09-10T21:14:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 27, 2024-09-10T21:14:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 75, 2024-09-10T21:14:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T21:14:41.656 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 92.163008102000006 2024-09-10T21:14:41.656 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:14:41.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.646+0000 7ff267c14640 1 -- 172.21.15.59:0/2366686170 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff24c0b53f0 msgr2=0x7ff24c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:41.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.646+0000 7ff267c14640 1 --2- 172.21.15.59:0/2366686170 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff24c0b53f0 0x7ff24c0b78b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff258005fd0 tx=0x7ff2580086a0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.646+0000 7ff267c14640 1 -- 172.21.15.59:0/2366686170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2601087d0 msgr2=0x7ff2601997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:41.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.646+0000 7ff267c14640 1 --2- 172.21.15.59:0/2366686170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2601087d0 0x7ff2601997e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff25c006010 tx=0x7ff25c0042f0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.646+0000 7ff267c14640 1 -- 172.21.15.59:0/2366686170 shutdown_connections 2024-09-10T21:14:41.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.646+0000 7ff267c14640 1 --2- 172.21.15.59:0/2366686170 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff24c0b53f0 0x7ff24c0b78b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.646+0000 7ff267c14640 1 --2- 172.21.15.59:0/2366686170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff260109150 0x7ff26019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.646+0000 7ff267c14640 1 --2- 172.21.15.59:0/2366686170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2601087d0 0x7ff2601997e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.646+0000 7ff267c14640 1 --2- 172.21.15.59:0/2366686170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff260102dc0 0x7ff2601992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:41.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.646+0000 7ff267c14640 1 -- 172.21.15.59:0/2366686170 >> 172.21.15.59:0/2366686170 conn(0x7ff2600fe830 msgr2=0x7ff260100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:41.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.646+0000 7ff267c14640 1 -- 172.21.15.59:0/2366686170 shutdown_connections 2024-09-10T21:14:41.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:41.646+0000 7ff267c14640 1 -- 172.21.15.59:0/2366686170 wait complete. 2024-09-10T21:14:42.455 INFO:tasks.cephadm:Setup complete, yielding 2024-09-10T21:14:42.455 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T21:14:42.465 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi059.front.sepia.ceph.com 2024-09-10T21:14:42.465 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-10T21:14:42.732 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:42.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:42 smithi154 ceph-mon[35041]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:14:42.980 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:42 smithi059 ceph-mon[30888]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:14:43.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:42 smithi192 ceph-mon[35363]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:14:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.218+0000 7fbbf2979640 1 -- 172.21.15.59:0/926807933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbec102a40 msgr2=0x7fbbec102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.218+0000 7fbbf2979640 1 --2- 172.21.15.59:0/926807933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbec102a40 0x7fbbec102e40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009930 tx=0x7fbbdc02a420 comp rx=0 tx=0).stop 2024-09-10T21:14:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.218+0000 7fbbf2979640 1 -- 172.21.15.59:0/926807933 shutdown_connections 2024-09-10T21:14:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.218+0000 7fbbf2979640 1 --2- 172.21.15.59:0/926807933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbec104560 0x7fbbec10aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.218+0000 7fbbf2979640 1 --2- 172.21.15.59:0/926807933 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbec103ba0 0x7fbbec104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.218+0000 7fbbf2979640 1 --2- 172.21.15.59:0/926807933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbec102a40 0x7fbbec102e40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.218+0000 7fbbf2979640 1 -- 172.21.15.59:0/926807933 >> 172.21.15.59:0/926807933 conn(0x7fbbec0fe2f0 msgr2=0x7fbbec100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.218+0000 7fbbf2979640 1 -- 172.21.15.59:0/926807933 shutdown_connections 2024-09-10T21:14:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.218+0000 7fbbf2979640 1 -- 172.21.15.59:0/926807933 wait complete. 2024-09-10T21:14:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.219+0000 7fbbf2979640 1 Processor -- start 2024-09-10T21:14:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.219+0000 7fbbf2979640 1 -- start start 2024-09-10T21:14:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.219+0000 7fbbf2979640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbec102a40 0x7fbbec19b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.219+0000 7fbbf2979640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbec103ba0 0x7fbbec19b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.219+0000 7fbbf2979640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbec104560 0x7fbbec19c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.219+0000 7fbbf2979640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec10e6a0 con 0x7fbbec103ba0 2024-09-10T21:14:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.219+0000 7fbbf2979640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec10e520 con 0x7fbbec104560 2024-09-10T21:14:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.219+0000 7fbbf2979640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec10e820 con 0x7fbbec102a40 2024-09-10T21:14:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.219+0000 7fbbeb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbec103ba0 0x7fbbec19b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.219+0000 7fbbeb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbec103ba0 0x7fbbec19b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59954/0 (socket says 172.21.15.59:59954) 2024-09-10T21:14:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.219+0000 7fbbeb7fe640 1 -- 172.21.15.59:0/1607220680 learned_addr learned my addr 172.21.15.59:0/1607220680 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:43.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.219+0000 7fbbebfff640 1 --2- 172.21.15.59:0/1607220680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbec102a40 0x7fbbec19b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:43.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.219+0000 7fbbf0f16640 1 --2- 172.21.15.59:0/1607220680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbec104560 0x7fbbec19c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:43.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.219+0000 7fbbeb7fe640 1 -- 172.21.15.59:0/1607220680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbec102a40 msgr2=0x7fbbec19b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:43.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.219+0000 7fbbeb7fe640 1 --2- 172.21.15.59:0/1607220680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbec102a40 0x7fbbec19b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:43.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.219+0000 7fbbeb7fe640 1 -- 172.21.15.59:0/1607220680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbec104560 msgr2=0x7fbbec19c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:43.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.219+0000 7fbbeb7fe640 1 --2- 172.21.15.59:0/1607220680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbec104560 0x7fbbec19c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:43.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.219+0000 7fbbeb7fe640 1 -- 172.21.15.59:0/1607220680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbec19cb60 con 0x7fbbec103ba0 2024-09-10T21:14:43.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.220+0000 7fbbeb7fe640 1 --2- 172.21.15.59:0/1607220680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbec103ba0 0x7fbbec19b680 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000d950 tx=0x7fbbe000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:43.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.220+0000 7fbbe97fa640 1 -- 172.21.15.59:0/1607220680 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0017070 con 0x7fbbec103ba0 2024-09-10T21:14:43.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.220+0000 7fbbe97fa640 1 -- 172.21.15.59:0/1607220680 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbe0009c30 con 0x7fbbec103ba0 2024-09-10T21:14:43.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.220+0000 7fbbf2979640 1 -- 172.21.15.59:0/1607220680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbec19ce50 con 0x7fbbec103ba0 2024-09-10T21:14:43.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.220+0000 7fbbe97fa640 1 -- 172.21.15.59:0/1607220680 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe000f620 con 0x7fbbec103ba0 2024-09-10T21:14:43.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.220+0000 7fbbf2979640 1 -- 172.21.15.59:0/1607220680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbec1a3530 con 0x7fbbec103ba0 2024-09-10T21:14:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.221+0000 7fbbf2979640 1 -- 172.21.15.59:0/1607220680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbec1a3700 con 0x7fbbec103ba0 2024-09-10T21:14:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.222+0000 7fbbe97fa640 1 -- 172.21.15.59:0/1607220680 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fbbe0010460 con 0x7fbbec103ba0 2024-09-10T21:14:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.223+0000 7fbbe97fa640 1 --2- 172.21.15.59:0/1607220680 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbbd40b53f0 0x7fbbd40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:43.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.224+0000 7fbbebfff640 1 --2- 172.21.15.59:0/1607220680 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbbd40b53f0 0x7fbbd40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:43.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.224+0000 7fbbe97fa640 1 -- 172.21.15.59:0/1607220680 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbbe00e5900 con 0x7fbbec103ba0 2024-09-10T21:14:43.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.224+0000 7fbbebfff640 1 --2- 172.21.15.59:0/1607220680 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbbd40b53f0 0x7fbbd40b78b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009900 tx=0x7fbbdc031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:43.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.228+0000 7fbbe97fa640 1 -- 172.21.15.59:0/1607220680 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbbe0009de0 con 0x7fbbec103ba0 2024-09-10T21:14:43.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.432+0000 7fbbf2979640 1 -- 172.21.15.59:0/1607220680 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fbbec109a40 con 0x7fbbd40b53f0 2024-09-10T21:14:43.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.433+0000 7fbbe97fa640 1 -- 172.21.15.59:0/1607220680 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fbbec109a40 con 0x7fbbd40b53f0 2024-09-10T21:14:43.437 INFO:teuthology.orchestra.run.smithi059.stdout:Backend: cephadm 2024-09-10T21:14:43.437 INFO:teuthology.orchestra.run.smithi059.stdout:Available: Yes 2024-09-10T21:14:43.437 INFO:teuthology.orchestra.run.smithi059.stdout:Paused: No 2024-09-10T21:14:43.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.436+0000 7fbbf2979640 1 -- 172.21.15.59:0/1607220680 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbbd40b53f0 msgr2=0x7fbbd40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:43.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.436+0000 7fbbf2979640 1 --2- 172.21.15.59:0/1607220680 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbbd40b53f0 0x7fbbd40b78b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009900 tx=0x7fbbdc031430 comp rx=0 tx=0).stop 2024-09-10T21:14:43.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.436+0000 7fbbf2979640 1 -- 172.21.15.59:0/1607220680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbec103ba0 msgr2=0x7fbbec19b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:43.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.436+0000 7fbbf2979640 1 --2- 172.21.15.59:0/1607220680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbec103ba0 0x7fbbec19b680 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000d950 tx=0x7fbbe000de10 comp rx=0 tx=0).stop 2024-09-10T21:14:43.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.436+0000 7fbbf2979640 1 -- 172.21.15.59:0/1607220680 shutdown_connections 2024-09-10T21:14:43.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.436+0000 7fbbf2979640 1 --2- 172.21.15.59:0/1607220680 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbbd40b53f0 0x7fbbd40b78b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:43.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.436+0000 7fbbf2979640 1 --2- 172.21.15.59:0/1607220680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbbec104560 0x7fbbec19c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:43.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.436+0000 7fbbf2979640 1 --2- 172.21.15.59:0/1607220680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbec103ba0 0x7fbbec19b680 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:43.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.436+0000 7fbbf2979640 1 --2- 172.21.15.59:0/1607220680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbec102a40 0x7fbbec19b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:43.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.436+0000 7fbbf2979640 1 -- 172.21.15.59:0/1607220680 >> 172.21.15.59:0/1607220680 conn(0x7fbbec0fe2f0 msgr2=0x7fbbec109330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:43.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.436+0000 7fbbf2979640 1 -- 172.21.15.59:0/1607220680 shutdown_connections 2024-09-10T21:14:43.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:43.436+0000 7fbbf2979640 1 -- 172.21.15.59:0/1607220680 wait complete. 2024-09-10T21:14:44.099 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-10T21:14:44.362 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:44.804 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:44 smithi059 ceph-mon[30888]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:14:44.804 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:44 smithi059 ceph-mon[30888]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:14:44.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.799+0000 7f823223e640 1 -- 172.21.15.59:0/1377459294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f822c104550 msgr2=0x7f822c10aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:44.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.799+0000 7f823223e640 1 --2- 172.21.15.59:0/1377459294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f822c104550 0x7f822c10aed0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8224009cd0 tx=0x7f822402a8e0 comp rx=0 tx=0).stop 2024-09-10T21:14:44.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.800+0000 7f823223e640 1 -- 172.21.15.59:0/1377459294 shutdown_connections 2024-09-10T21:14:44.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.800+0000 7f823223e640 1 --2- 172.21.15.59:0/1377459294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f822c104550 0x7f822c10aed0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:44.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.800+0000 7f823223e640 1 --2- 172.21.15.59:0/1377459294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f822c103b90 0x7f822c104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:44.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.800+0000 7f823223e640 1 --2- 172.21.15.59:0/1377459294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f822c102a30 0x7f822c102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:44.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.800+0000 7f823223e640 1 -- 172.21.15.59:0/1377459294 >> 172.21.15.59:0/1377459294 conn(0x7f822c0fe320 msgr2=0x7f822c100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:44.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.800+0000 7f823223e640 1 -- 172.21.15.59:0/1377459294 shutdown_connections 2024-09-10T21:14:44.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.800+0000 7f823223e640 1 -- 172.21.15.59:0/1377459294 wait complete. 2024-09-10T21:14:44.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.801+0000 7f823223e640 1 Processor -- start 2024-09-10T21:14:44.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.801+0000 7f823223e640 1 -- start start 2024-09-10T21:14:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.801+0000 7f823223e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f822c102a30 0x7f822c198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.801+0000 7f823223e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f822c103b90 0x7f822c1994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.801+0000 7f823223e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f822c104550 0x7f822c19a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.801+0000 7f823223e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f822c10e710 con 0x7f822c102a30 2024-09-10T21:14:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.801+0000 7f823223e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f822c10e590 con 0x7f822c103b90 2024-09-10T21:14:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.801+0000 7f823223e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f822c10e890 con 0x7f822c104550 2024-09-10T21:14:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.801+0000 7f822b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f822c102a30 0x7f822c198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.801+0000 7f822b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f822c102a30 0x7f822c198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59976/0 (socket says 172.21.15.59:59976) 2024-09-10T21:14:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.801+0000 7f822b7fe640 1 -- 172.21.15.59:0/257227887 learned_addr learned my addr 172.21.15.59:0/257227887 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.801+0000 7f822affd640 1 --2- 172.21.15.59:0/257227887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f822c103b90 0x7f822c1994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.802+0000 7f822bfff640 1 --2- 172.21.15.59:0/257227887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f822c104550 0x7f822c19a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.802+0000 7f822b7fe640 1 -- 172.21.15.59:0/257227887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f822c104550 msgr2=0x7f822c19a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:44.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.802+0000 7f822b7fe640 1 --2- 172.21.15.59:0/257227887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f822c104550 0x7f822c19a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.802+0000 7f822b7fe640 1 -- 172.21.15.59:0/257227887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f822c103b90 msgr2=0x7f822c1994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.802+0000 7f822b7fe640 1 --2- 172.21.15.59:0/257227887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f822c103b90 0x7f822c1994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.802+0000 7f822b7fe640 1 -- 172.21.15.59:0/257227887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822c19a9b0 con 0x7f822c102a30 2024-09-10T21:14:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.802+0000 7f822affd640 1 --2- 172.21.15.59:0/257227887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f822c103b90 0x7f822c1994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.802+0000 7f822b7fe640 1 --2- 172.21.15.59:0/257227887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f822c102a30 0x7f822c198e80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f821c00d950 tx=0x7f821c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.802+0000 7f8228ff9640 1 -- 172.21.15.59:0/257227887 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c017070 con 0x7f822c102a30 2024-09-10T21:14:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.802+0000 7f8228ff9640 1 -- 172.21.15.59:0/257227887 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f821c009c30 con 0x7f822c102a30 2024-09-10T21:14:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.802+0000 7f823223e640 1 -- 172.21.15.59:0/257227887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f822c19aca0 con 0x7f822c102a30 2024-09-10T21:14:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.802+0000 7f8228ff9640 1 -- 172.21.15.59:0/257227887 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c00f620 con 0x7f822c102a30 2024-09-10T21:14:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.802+0000 7f823223e640 1 -- 172.21.15.59:0/257227887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f822c1a1380 con 0x7f822c102a30 2024-09-10T21:14:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.803+0000 7f823223e640 1 -- 172.21.15.59:0/257227887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f822c109d50 con 0x7f822c102a30 2024-09-10T21:14:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.805+0000 7f8228ff9640 1 -- 172.21.15.59:0/257227887 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f821c005030 con 0x7f822c102a30 2024-09-10T21:14:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.805+0000 7f8228ff9640 1 --2- 172.21.15.59:0/257227887 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f82140b53f0 0x7f82140b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.805+0000 7f822affd640 1 --2- 172.21.15.59:0/257227887 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f82140b53f0 0x7f82140b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.805+0000 7f8228ff9640 1 -- 172.21.15.59:0/257227887 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f821c0e5980 con 0x7f822c102a30 2024-09-10T21:14:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.806+0000 7f822affd640 1 --2- 172.21.15.59:0/257227887 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f82140b53f0 0x7f82140b78b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8220009930 tx=0x7f8220008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:44.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:44.808+0000 7f8228ff9640 1 -- 172.21.15.59:0/257227887 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f821c0ac790 con 0x7f822c102a30 2024-09-10T21:14:44.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:44 smithi154 ceph-mon[35041]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:14:44.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:44 smithi154 ceph-mon[35041]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:14:45.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:45.004+0000 7f823223e640 1 -- 172.21.15.59:0/257227887 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f822c063590 con 0x7f82140b53f0 2024-09-10T21:14:45.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:45.016+0000 7f8228ff9640 1 -- 172.21.15.59:0/257227887 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f822c063590 con 0x7f82140b53f0 2024-09-10T21:14:45.020 INFO:teuthology.orchestra.run.smithi059.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T21:14:45.020 INFO:teuthology.orchestra.run.smithi059.stdout:mds.a smithi059 running (98s) 20s ago 98s 19.6M - 19.3.0-4854-g8f219c47 589dd18248e4 a31d4854eded 2024-09-10T21:14:45.020 INFO:teuthology.orchestra.run.smithi059.stdout:mds.b smithi154 running (95s) 27s ago 95s 29.0M - 19.3.0-4854-g8f219c47 589dd18248e4 d24ac9fe33d6 2024-09-10T21:14:45.020 INFO:teuthology.orchestra.run.smithi059.stdout:mds.c smithi192 running (109s) 27s ago 108s 18.4M - 19.3.0-4854-g8f219c47 589dd18248e4 f6a5aacb6973 2024-09-10T21:14:45.021 INFO:teuthology.orchestra.run.smithi059.stdout:mds.d smithi059 running (117s) 20s ago 116s 17.0M - 19.3.0-4854-g8f219c47 589dd18248e4 d195de98ee05 2024-09-10T21:14:45.021 INFO:teuthology.orchestra.run.smithi059.stdout:mds.e smithi154 running (113s) 27s ago 113s 17.4M - 19.3.0-4854-g8f219c47 589dd18248e4 0611dfb906c6 2024-09-10T21:14:45.021 INFO:teuthology.orchestra.run.smithi059.stdout:mds.f smithi192 running (111s) 27s ago 111s 18.2M - 19.3.0-4854-g8f219c47 589dd18248e4 107fe9555a11 2024-09-10T21:14:45.021 INFO:teuthology.orchestra.run.smithi059.stdout:mds.g smithi059 running (101s) 20s ago 100s 17.5M - 19.3.0-4854-g8f219c47 589dd18248e4 0eb009049ea7 2024-09-10T21:14:45.021 INFO:teuthology.orchestra.run.smithi059.stdout:mds.h smithi154 running (106s) 27s ago 106s 20.8M - 19.3.0-4854-g8f219c47 589dd18248e4 d9b31ea9966a 2024-09-10T21:14:45.021 INFO:teuthology.orchestra.run.smithi059.stdout:mds.i smithi192 running (104s) 27s ago 103s 18.6M - 19.3.0-4854-g8f219c47 589dd18248e4 eeea3014e75f 2024-09-10T21:14:45.021 INFO:teuthology.orchestra.run.smithi059.stdout:mds.j smithi059 running (119s) 20s ago 119s 15.1M - 19.3.0-4854-g8f219c47 589dd18248e4 5956a89a0aeb 2024-09-10T21:14:45.021 INFO:teuthology.orchestra.run.smithi059.stdout:mds.k smithi154 running (2m) 27s ago 2m 17.3M - 19.3.0-4854-g8f219c47 589dd18248e4 c0f664d5812a 2024-09-10T21:14:45.022 INFO:teuthology.orchestra.run.smithi059.stdout:mds.l smithi192 running (2m) 27s ago 2m 17.4M - 19.3.0-4854-g8f219c47 589dd18248e4 28fd56854895 2024-09-10T21:14:45.022 INFO:teuthology.orchestra.run.smithi059.stdout:mgr.x smithi059 *:9283,8765 running (9m) 20s ago 9m 525M - 19.3.0-4854-g8f219c47 589dd18248e4 c1d7dced6f3a 2024-09-10T21:14:45.022 INFO:teuthology.orchestra.run.smithi059.stdout:mgr.y smithi154 *:8443,8765 running (7m) 27s ago 7m 457M - 19.3.0-4854-g8f219c47 589dd18248e4 8868cafc2947 2024-09-10T21:14:45.022 INFO:teuthology.orchestra.run.smithi059.stdout:mgr.z smithi192 *:8443,8765 running (7m) 27s ago 7m 456M - 19.3.0-4854-g8f219c47 589dd18248e4 71c1ee07190e 2024-09-10T21:14:45.022 INFO:teuthology.orchestra.run.smithi059.stdout:mon.a smithi059 running (9m) 20s ago 9m 52.1M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 6c68aa69a917 2024-09-10T21:14:45.022 INFO:teuthology.orchestra.run.smithi059.stdout:mon.b smithi154 running (7m) 27s ago 7m 41.0M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 e3a53235f860 2024-09-10T21:14:45.022 INFO:teuthology.orchestra.run.smithi059.stdout:mon.c smithi192 running (8m) 27s ago 8m 39.8M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 6e6bf3764cea 2024-09-10T21:14:45.022 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0 smithi059 running (6m) 20s ago 6m 55.0M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 2426eaffeec7 2024-09-10T21:14:45.022 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1 smithi154 running (6m) 27s ago 6m 48.5M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 a93ff1f9b99a 2024-09-10T21:14:45.022 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2 smithi192 running (6m) 27s ago 6m 49.4M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 da58a1406bd0 2024-09-10T21:14:45.023 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3 smithi059 running (5m) 20s ago 5m 46.8M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 9714147b549a 2024-09-10T21:14:45.023 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4 smithi154 running (5m) 27s ago 5m 45.9M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 c0b8270af282 2024-09-10T21:14:45.023 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5 smithi192 running (4m) 27s ago 4m 46.4M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 772273d8208d 2024-09-10T21:14:45.023 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6 smithi059 running (4m) 20s ago 4m 50.9M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 260974bda5ad 2024-09-10T21:14:45.023 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7 smithi154 running (4m) 27s ago 4m 45.4M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 62a10b15d775 2024-09-10T21:14:45.023 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8 smithi192 running (3m) 27s ago 3m 54.0M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 dc3badf41d42 2024-09-10T21:14:45.023 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9 smithi059 running (3m) 20s ago 3m 47.3M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 bd18f32b2159 2024-09-10T21:14:45.023 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10 smithi154 running (2m) 27s ago 2m 45.5M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 8cd66e8d7bf6 2024-09-10T21:14:45.023 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11 smithi192 running (2m) 27s ago 2m 51.9M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 462d0851d2a5 2024-09-10T21:14:45.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:45.018+0000 7f823223e640 1 -- 172.21.15.59:0/257227887 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f82140b53f0 msgr2=0x7f82140b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:45.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:45.018+0000 7f823223e640 1 --2- 172.21.15.59:0/257227887 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f82140b53f0 0x7f82140b78b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8220009930 tx=0x7f8220008040 comp rx=0 tx=0).stop 2024-09-10T21:14:45.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:45.018+0000 7f823223e640 1 -- 172.21.15.59:0/257227887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f822c102a30 msgr2=0x7f822c198e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:45.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:45.018+0000 7f823223e640 1 --2- 172.21.15.59:0/257227887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f822c102a30 0x7f822c198e80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f821c00d950 tx=0x7f821c00de10 comp rx=0 tx=0).stop 2024-09-10T21:14:45.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:45.018+0000 7f823223e640 1 -- 172.21.15.59:0/257227887 shutdown_connections 2024-09-10T21:14:45.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:45.018+0000 7f823223e640 1 --2- 172.21.15.59:0/257227887 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f82140b53f0 0x7f82140b78b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:45.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:45.018+0000 7f823223e640 1 --2- 172.21.15.59:0/257227887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f822c104550 0x7f822c19a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:45.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:45.018+0000 7f823223e640 1 --2- 172.21.15.59:0/257227887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f822c103b90 0x7f822c1994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:45.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:45.018+0000 7f823223e640 1 --2- 172.21.15.59:0/257227887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f822c102a30 0x7f822c198e80 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:45.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:45.018+0000 7f823223e640 1 -- 172.21.15.59:0/257227887 >> 172.21.15.59:0/257227887 conn(0x7f822c0fe320 msgr2=0x7f822c106f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:45.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:45.018+0000 7f823223e640 1 -- 172.21.15.59:0/257227887 shutdown_connections 2024-09-10T21:14:45.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:45.018+0000 7f823223e640 1 -- 172.21.15.59:0/257227887 wait complete. 2024-09-10T21:14:45.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:44 smithi192 ceph-mon[35363]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:14:45.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:44 smithi192 ceph-mon[35363]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:14:45.672 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-10T21:14:45.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:45 smithi059 ceph-mon[30888]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:14:45.930 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:46.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:45 smithi192 ceph-mon[35363]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:14:46.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:45 smithi154 ceph-mon[35041]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:14:46.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.415+0000 7f0a3d590640 1 -- 172.21.15.59:0/919300178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a38103ba0 msgr2=0x7f0a38104020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:46.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.415+0000 7f0a3d590640 1 --2- 172.21.15.59:0/919300178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a38103ba0 0x7f0a38104020 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c009930 tx=0x7f0a2c02a420 comp rx=0 tx=0).stop 2024-09-10T21:14:46.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.415+0000 7f0a3d590640 1 -- 172.21.15.59:0/919300178 shutdown_connections 2024-09-10T21:14:46.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.415+0000 7f0a3d590640 1 --2- 172.21.15.59:0/919300178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a38104560 0x7f0a3810aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:46.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.415+0000 7f0a3d590640 1 --2- 172.21.15.59:0/919300178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a38103ba0 0x7f0a38104020 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:46.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.415+0000 7f0a3d590640 1 --2- 172.21.15.59:0/919300178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a38102a40 0x7f0a38102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:46.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.415+0000 7f0a3d590640 1 -- 172.21.15.59:0/919300178 >> 172.21.15.59:0/919300178 conn(0x7f0a380fe2f0 msgr2=0x7f0a38100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:46.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.415+0000 7f0a3d590640 1 -- 172.21.15.59:0/919300178 shutdown_connections 2024-09-10T21:14:46.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.415+0000 7f0a3d590640 1 -- 172.21.15.59:0/919300178 wait complete. 2024-09-10T21:14:46.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.415+0000 7f0a3d590640 1 Processor -- start 2024-09-10T21:14:46.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.416+0000 7f0a3d590640 1 -- start start 2024-09-10T21:14:46.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.416+0000 7f0a3d590640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a38102a40 0x7f0a38076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:46.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.416+0000 7f0a3d590640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a38103ba0 0x7f0a38075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:46.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.416+0000 7f0a3d590640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a38104560 0x7f0a38075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:46.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.416+0000 7f0a3d590640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3810e6c0 con 0x7f0a38103ba0 2024-09-10T21:14:46.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.416+0000 7f0a3d590640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3810e540 con 0x7f0a38102a40 2024-09-10T21:14:46.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.416+0000 7f0a3d590640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3810e840 con 0x7f0a38104560 2024-09-10T21:14:46.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.416+0000 7f0a367fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a38103ba0 0x7f0a38075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:46.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.416+0000 7f0a367fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a38103ba0 0x7f0a38075540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59992/0 (socket says 172.21.15.59:59992) 2024-09-10T21:14:46.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.416+0000 7f0a367fc640 1 -- 172.21.15.59:0/3035714643 learned_addr learned my addr 172.21.15.59:0/3035714643 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:46.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.416+0000 7f0a36ffd640 1 --2- 172.21.15.59:0/3035714643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a38102a40 0x7f0a38076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:46.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.416+0000 7f0a377fe640 1 --2- 172.21.15.59:0/3035714643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a38104560 0x7f0a38075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:46.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.416+0000 7f0a367fc640 1 -- 172.21.15.59:0/3035714643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a38104560 msgr2=0x7f0a38075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:46.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.416+0000 7f0a367fc640 1 --2- 172.21.15.59:0/3035714643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a38104560 0x7f0a38075a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:46.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.416+0000 7f0a367fc640 1 -- 172.21.15.59:0/3035714643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a38102a40 msgr2=0x7f0a38076cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:46.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.416+0000 7f0a367fc640 1 --2- 172.21.15.59:0/3035714643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a38102a40 0x7f0a38076cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:46.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.416+0000 7f0a367fc640 1 -- 172.21.15.59:0/3035714643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a38076340 con 0x7f0a38103ba0 2024-09-10T21:14:46.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.416+0000 7f0a367fc640 1 --2- 172.21.15.59:0/3035714643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a38103ba0 0x7f0a38075540 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c005ec0 tx=0x7f0a2c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:46.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.417+0000 7f0a1ffff640 1 -- 172.21.15.59:0/3035714643 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c03f030 con 0x7f0a38103ba0 2024-09-10T21:14:46.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.417+0000 7f0a1ffff640 1 -- 172.21.15.59:0/3035714643 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a2c003cb0 con 0x7f0a38103ba0 2024-09-10T21:14:46.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.417+0000 7f0a3d590640 1 -- 172.21.15.59:0/3035714643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a381a2e50 con 0x7f0a38103ba0 2024-09-10T21:14:46.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.417+0000 7f0a1ffff640 1 -- 172.21.15.59:0/3035714643 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c035070 con 0x7f0a38103ba0 2024-09-10T21:14:46.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.417+0000 7f0a3d590640 1 -- 172.21.15.59:0/3035714643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a381a32a0 con 0x7f0a38103ba0 2024-09-10T21:14:46.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.418+0000 7f0a3d590640 1 -- 172.21.15.59:0/3035714643 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a38109d40 con 0x7f0a38103ba0 2024-09-10T21:14:46.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.419+0000 7f0a1ffff640 1 -- 172.21.15.59:0/3035714643 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f0a2c03b460 con 0x7f0a38103ba0 2024-09-10T21:14:46.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.420+0000 7f0a1ffff640 1 --2- 172.21.15.59:0/3035714643 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0a200b5370 0x7f0a200b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:46.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.420+0000 7f0a36ffd640 1 --2- 172.21.15.59:0/3035714643 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0a200b5370 0x7f0a200b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:46.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.420+0000 7f0a1ffff640 1 -- 172.21.15.59:0/3035714643 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0a2c106700 con 0x7f0a38103ba0 2024-09-10T21:14:46.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.420+0000 7f0a36ffd640 1 --2- 172.21.15.59:0/3035714643 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0a200b5370 0x7f0a200b7830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a280058c0 tx=0x7f0a2800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:46.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.424+0000 7f0a1ffff640 1 -- 172.21.15.59:0/3035714643 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0a2c0ccde0 con 0x7f0a38103ba0 2024-09-10T21:14:46.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.618+0000 7f0a3d590640 1 -- 172.21.15.59:0/3035714643 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f0a38063590 con 0x7f0a200b5370 2024-09-10T21:14:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.624+0000 7f0a1ffff640 1 -- 172.21.15.59:0/3035714643 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f0a38063590 con 0x7f0a200b5370 2024-09-10T21:14:46.628 INFO:teuthology.orchestra.run.smithi059.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-10T21:14:46.628 INFO:teuthology.orchestra.run.smithi059.stdout:mds.all 12/12 29s ago 2m smithi059=a;smithi059=d;smithi059=g;smithi059=j;smithi154=b;smithi154=e;smithi154=h;smithi154=k;smithi192=c;smithi192=f;smithi192=i;smithi192=l;count:12 2024-09-10T21:14:46.628 INFO:teuthology.orchestra.run.smithi059.stdout:mgr 3/3 29s ago 7m smithi059=x;smithi154=y;smithi192=z;count:3 2024-09-10T21:14:46.628 INFO:teuthology.orchestra.run.smithi059.stdout:mon 3/3 29s ago 8m smithi059:172.21.15.59=a;smithi154:172.21.15.154=b;smithi192:172.21.15.192=c;count:3 2024-09-10T21:14:46.628 INFO:teuthology.orchestra.run.smithi059.stdout:osd 12 29s ago - 2024-09-10T21:14:46.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.626+0000 7f0a3d590640 1 -- 172.21.15.59:0/3035714643 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0a200b5370 msgr2=0x7f0a200b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:46.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.626+0000 7f0a3d590640 1 --2- 172.21.15.59:0/3035714643 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0a200b5370 0x7f0a200b7830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a280058c0 tx=0x7f0a2800a250 comp rx=0 tx=0).stop 2024-09-10T21:14:46.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.626+0000 7f0a3d590640 1 -- 172.21.15.59:0/3035714643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a38103ba0 msgr2=0x7f0a38075540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:46.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.626+0000 7f0a3d590640 1 --2- 172.21.15.59:0/3035714643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a38103ba0 0x7f0a38075540 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c005ec0 tx=0x7f0a2c004360 comp rx=0 tx=0).stop 2024-09-10T21:14:46.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.626+0000 7f0a3d590640 1 -- 172.21.15.59:0/3035714643 shutdown_connections 2024-09-10T21:14:46.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.626+0000 7f0a3d590640 1 --2- 172.21.15.59:0/3035714643 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0a200b5370 0x7f0a200b7830 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:46.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.626+0000 7f0a3d590640 1 --2- 172.21.15.59:0/3035714643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a38104560 0x7f0a38075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:46.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.626+0000 7f0a3d590640 1 --2- 172.21.15.59:0/3035714643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a38103ba0 0x7f0a38075540 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:46.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.626+0000 7f0a3d590640 1 --2- 172.21.15.59:0/3035714643 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0a38102a40 0x7f0a38076cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:46.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.626+0000 7f0a3d590640 1 -- 172.21.15.59:0/3035714643 >> 172.21.15.59:0/3035714643 conn(0x7f0a380fe2f0 msgr2=0x7f0a38106f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:46.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.626+0000 7f0a3d590640 1 -- 172.21.15.59:0/3035714643 shutdown_connections 2024-09-10T21:14:46.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:46.626+0000 7f0a3d590640 1 -- 172.21.15.59:0/3035714643 wait complete. 2024-09-10T21:14:46.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:46 smithi059 ceph-mon[30888]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:47.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:46 smithi192 ceph-mon[35363]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:47.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:46 smithi154 ceph-mon[35041]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:47.311 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-10T21:14:47.568 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:47.953 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:47 smithi059 ceph-mon[30888]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:14:48.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.033+0000 7f28972a4640 1 -- 172.21.15.59:0/668986007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2890105bf0 msgr2=0x7f2890107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:48.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.033+0000 7f28972a4640 1 --2- 172.21.15.59:0/668986007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2890105bf0 0x7f2890107fe0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2884009900 tx=0x7f288402a410 comp rx=0 tx=0).stop 2024-09-10T21:14:48.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.033+0000 7f28972a4640 1 -- 172.21.15.59:0/668986007 shutdown_connections 2024-09-10T21:14:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.033+0000 7f28972a4640 1 --2- 172.21.15.59:0/668986007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2890108720 0x7f289010abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.033+0000 7f28972a4640 1 --2- 172.21.15.59:0/668986007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2890105bf0 0x7f2890107fe0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.033+0000 7f28972a4640 1 --2- 172.21.15.59:0/668986007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f289006b620 0x7f28901056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.033+0000 7f28972a4640 1 -- 172.21.15.59:0/668986007 >> 172.21.15.59:0/668986007 conn(0x7f28900fd1e0 msgr2=0x7f28900ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.034+0000 7f28972a4640 1 -- 172.21.15.59:0/668986007 shutdown_connections 2024-09-10T21:14:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.034+0000 7f28972a4640 1 -- 172.21.15.59:0/668986007 wait complete. 2024-09-10T21:14:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.034+0000 7f28972a4640 1 Processor -- start 2024-09-10T21:14:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.034+0000 7f28972a4640 1 -- start start 2024-09-10T21:14:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.034+0000 7f28972a4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f289006b620 0x7f2890102de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.034+0000 7f28972a4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2890105bf0 0x7f2890101650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.034+0000 7f28972a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2890108720 0x7f2890101b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:48.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.034+0000 7f28972a4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f289010e750 con 0x7f2890105bf0 2024-09-10T21:14:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.034+0000 7f28972a4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f289010e5d0 con 0x7f2890108720 2024-09-10T21:14:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.034+0000 7f28972a4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f289010e8d0 con 0x7f289006b620 2024-09-10T21:14:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.035+0000 7f289483f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2890105bf0 0x7f2890101650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.035+0000 7f289483f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2890105bf0 0x7f2890101650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60006/0 (socket says 172.21.15.59:60006) 2024-09-10T21:14:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.035+0000 7f289483f640 1 -- 172.21.15.59:0/3452291359 learned_addr learned my addr 172.21.15.59:0/3452291359 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.035+0000 7f2895040640 1 --2- 172.21.15.59:0/3452291359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f289006b620 0x7f2890102de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.035+0000 7f2895841640 1 --2- 172.21.15.59:0/3452291359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2890108720 0x7f2890101b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.035+0000 7f289483f640 1 -- 172.21.15.59:0/3452291359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f289006b620 msgr2=0x7f2890102de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.035+0000 7f289483f640 1 --2- 172.21.15.59:0/3452291359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f289006b620 0x7f2890102de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:48.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.035+0000 7f289483f640 1 -- 172.21.15.59:0/3452291359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2890108720 msgr2=0x7f2890101b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.035+0000 7f289483f640 1 --2- 172.21.15.59:0/3452291359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2890108720 0x7f2890101b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.035+0000 7f289483f640 1 -- 172.21.15.59:0/3452291359 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2890102450 con 0x7f2890105bf0 2024-09-10T21:14:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.035+0000 7f2895040640 1 --2- 172.21.15.59:0/3452291359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f289006b620 0x7f2890102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.035+0000 7f289483f640 1 --2- 172.21.15.59:0/3452291359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2890105bf0 0x7f2890101650 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2884031500 tx=0x7f28840043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.035+0000 7f288e7fc640 1 -- 172.21.15.59:0/3452291359 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288403f030 con 0x7f2890105bf0 2024-09-10T21:14:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.035+0000 7f288e7fc640 1 -- 172.21.15.59:0/3452291359 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2884003800 con 0x7f2890105bf0 2024-09-10T21:14:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.035+0000 7f28972a4640 1 -- 172.21.15.59:0/3452291359 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28901a2fd0 con 0x7f2890105bf0 2024-09-10T21:14:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.035+0000 7f288e7fc640 1 -- 172.21.15.59:0/3452291359 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2884035070 con 0x7f2890105bf0 2024-09-10T21:14:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.035+0000 7f28972a4640 1 -- 172.21.15.59:0/3452291359 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28901a34a0 con 0x7f2890105bf0 2024-09-10T21:14:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.036+0000 7f28972a4640 1 -- 172.21.15.59:0/3452291359 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28900fecd0 con 0x7f2890105bf0 2024-09-10T21:14:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.038+0000 7f288e7fc640 1 -- 172.21.15.59:0/3452291359 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f2884003cd0 con 0x7f2890105bf0 2024-09-10T21:14:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.038+0000 7f288e7fc640 1 --2- 172.21.15.59:0/3452291359 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f28780b5370 0x7f28780b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.039+0000 7f2895040640 1 --2- 172.21.15.59:0/3452291359 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f28780b5370 0x7f28780b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:48.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.039+0000 7f288e7fc640 1 -- 172.21.15.59:0/3452291359 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2884106dc0 con 0x7f2890105bf0 2024-09-10T21:14:48.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.039+0000 7f2895040640 1 --2- 172.21.15.59:0/3452291359 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f28780b5370 0x7f28780b7830 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2888009930 tx=0x7f2888008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:48.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.041+0000 7f288e7fc640 1 -- 172.21.15.59:0/3452291359 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f28840cdb50 con 0x7f2890105bf0 2024-09-10T21:14:48.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:47 smithi192 ceph-mon[35363]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:14:48.084 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:47 smithi154 ceph-mon[35041]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:14:48.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.235+0000 7f28972a4640 1 -- 172.21.15.59:0/3452291359 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f2890063590 con 0x7f28780b5370 2024-09-10T21:14:48.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.236+0000 7f288e7fc640 1 -- 172.21.15.59:0/3452291359 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f2890063590 con 0x7f28780b5370 2024-09-10T21:14:48.240 INFO:teuthology.orchestra.run.smithi059.stdout:HOST ADDR LABELS STATUS 2024-09-10T21:14:48.240 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059 172.21.15.59 2024-09-10T21:14:48.240 INFO:teuthology.orchestra.run.smithi059.stdout:smithi154 172.21.15.154 2024-09-10T21:14:48.241 INFO:teuthology.orchestra.run.smithi059.stdout:smithi192 172.21.15.192 2024-09-10T21:14:48.241 INFO:teuthology.orchestra.run.smithi059.stdout:3 hosts in cluster 2024-09-10T21:14:48.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.238+0000 7f28972a4640 1 -- 172.21.15.59:0/3452291359 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f28780b5370 msgr2=0x7f28780b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:48.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.238+0000 7f28972a4640 1 --2- 172.21.15.59:0/3452291359 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f28780b5370 0x7f28780b7830 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2888009930 tx=0x7f2888008040 comp rx=0 tx=0).stop 2024-09-10T21:14:48.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.238+0000 7f28972a4640 1 -- 172.21.15.59:0/3452291359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2890105bf0 msgr2=0x7f2890101650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:48.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.238+0000 7f28972a4640 1 --2- 172.21.15.59:0/3452291359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2890105bf0 0x7f2890101650 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2884031500 tx=0x7f28840043c0 comp rx=0 tx=0).stop 2024-09-10T21:14:48.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.239+0000 7f28972a4640 1 -- 172.21.15.59:0/3452291359 shutdown_connections 2024-09-10T21:14:48.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.239+0000 7f28972a4640 1 --2- 172.21.15.59:0/3452291359 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f28780b5370 0x7f28780b7830 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:48.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.239+0000 7f28972a4640 1 --2- 172.21.15.59:0/3452291359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2890108720 0x7f2890101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:48.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.239+0000 7f28972a4640 1 --2- 172.21.15.59:0/3452291359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2890105bf0 0x7f2890101650 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:48.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.239+0000 7f28972a4640 1 --2- 172.21.15.59:0/3452291359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f289006b620 0x7f2890102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:48.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.239+0000 7f28972a4640 1 -- 172.21.15.59:0/3452291359 >> 172.21.15.59:0/3452291359 conn(0x7f28900fd1e0 msgr2=0x7f2890103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:48.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.239+0000 7f28972a4640 1 -- 172.21.15.59:0/3452291359 shutdown_connections 2024-09-10T21:14:48.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:48.239+0000 7f28972a4640 1 -- 172.21.15.59:0/3452291359 wait complete. 2024-09-10T21:14:48.883 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:48 smithi059 ceph-mon[30888]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:14:48.917 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-10T21:14:48.978 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:48 smithi192 ceph-mon[35363]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:14:49.181 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:49.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:48 smithi154 ceph-mon[35041]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:14:49.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.633+0000 7ff157f34640 1 -- 172.21.15.59:0/3105749801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff150104560 msgr2=0x7ff15010aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:49.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.633+0000 7ff157f34640 1 --2- 172.21.15.59:0/3105749801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff150104560 0x7ff15010aee0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff148009cd0 tx=0x7ff14802a8e0 comp rx=0 tx=0).stop 2024-09-10T21:14:49.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.633+0000 7ff157f34640 1 -- 172.21.15.59:0/3105749801 shutdown_connections 2024-09-10T21:14:49.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.633+0000 7ff157f34640 1 --2- 172.21.15.59:0/3105749801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff150104560 0x7ff15010aee0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:49.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.633+0000 7ff157f34640 1 --2- 172.21.15.59:0/3105749801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff150103ba0 0x7ff150104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:49.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.633+0000 7ff157f34640 1 --2- 172.21.15.59:0/3105749801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff150102a40 0x7ff150102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:49.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.633+0000 7ff157f34640 1 -- 172.21.15.59:0/3105749801 >> 172.21.15.59:0/3105749801 conn(0x7ff1500fe2f0 msgr2=0x7ff150100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:49.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.633+0000 7ff157f34640 1 -- 172.21.15.59:0/3105749801 shutdown_connections 2024-09-10T21:14:49.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.633+0000 7ff157f34640 1 -- 172.21.15.59:0/3105749801 wait complete. 2024-09-10T21:14:49.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.634+0000 7ff157f34640 1 Processor -- start 2024-09-10T21:14:49.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.634+0000 7ff157f34640 1 -- start start 2024-09-10T21:14:49.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.634+0000 7ff157f34640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff150102a40 0x7ff150198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:49.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.634+0000 7ff157f34640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff150103ba0 0x7ff150199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:49.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.634+0000 7ff157f34640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff150104560 0x7ff15019a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:49.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.634+0000 7ff157f34640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff15010e7f0 con 0x7ff150104560 2024-09-10T21:14:49.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.634+0000 7ff157f34640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff15010e670 con 0x7ff150103ba0 2024-09-10T21:14:49.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.634+0000 7ff157f34640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff15010e970 con 0x7ff150102a40 2024-09-10T21:14:49.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.634+0000 7ff1564d1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff150104560 0x7ff15019a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:49.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.634+0000 7ff1564d1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff150104560 0x7ff15019a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55346/0 (socket says 172.21.15.59:55346) 2024-09-10T21:14:49.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.634+0000 7ff1564d1640 1 -- 172.21.15.59:0/2672526088 learned_addr learned my addr 172.21.15.59:0/2672526088 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:49.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.634+0000 7ff155cd0640 1 --2- 172.21.15.59:0/2672526088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff150102a40 0x7ff150198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:49.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.634+0000 7ff1564d1640 1 -- 172.21.15.59:0/2672526088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff150102a40 msgr2=0x7ff150198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:49.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.634+0000 7ff1564d1640 1 --2- 172.21.15.59:0/2672526088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff150102a40 0x7ff150198f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:49.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.634+0000 7ff1554cf640 1 --2- 172.21.15.59:0/2672526088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff150103ba0 0x7ff150199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:49.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.634+0000 7ff1564d1640 1 -- 172.21.15.59:0/2672526088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff150103ba0 msgr2=0x7ff150199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:49.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.634+0000 7ff1564d1640 1 --2- 172.21.15.59:0/2672526088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff150103ba0 0x7ff150199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:49.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.634+0000 7ff1564d1640 1 -- 172.21.15.59:0/2672526088 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff15019aa50 con 0x7ff150104560 2024-09-10T21:14:49.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.634+0000 7ff1564d1640 1 --2- 172.21.15.59:0/2672526088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff150104560 0x7ff15019a1b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff148033040 tx=0x7ff148003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:49.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.635+0000 7ff146ffd640 1 -- 172.21.15.59:0/2672526088 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff148004450 con 0x7ff150104560 2024-09-10T21:14:49.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.635+0000 7ff157f34640 1 -- 172.21.15.59:0/2672526088 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff15019ace0 con 0x7ff150104560 2024-09-10T21:14:49.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.635+0000 7ff146ffd640 1 -- 172.21.15.59:0/2672526088 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1480045f0 con 0x7ff150104560 2024-09-10T21:14:49.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.635+0000 7ff146ffd640 1 -- 172.21.15.59:0/2672526088 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1480466e0 con 0x7ff150104560 2024-09-10T21:14:49.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.635+0000 7ff157f34640 1 -- 172.21.15.59:0/2672526088 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1501a1420 con 0x7ff150104560 2024-09-10T21:14:49.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.636+0000 7ff157f34640 1 -- 172.21.15.59:0/2672526088 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff150109d60 con 0x7ff150104560 2024-09-10T21:14:49.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.637+0000 7ff146ffd640 1 -- 172.21.15.59:0/2672526088 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7ff14804e070 con 0x7ff150104560 2024-09-10T21:14:49.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.638+0000 7ff146ffd640 1 --2- 172.21.15.59:0/2672526088 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff13c0b5370 0x7ff13c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:49.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.638+0000 7ff155cd0640 1 --2- 172.21.15.59:0/2672526088 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff13c0b5370 0x7ff13c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:49.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.638+0000 7ff146ffd640 1 -- 172.21.15.59:0/2672526088 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff14802e030 con 0x7ff150104560 2024-09-10T21:14:49.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.638+0000 7ff155cd0640 1 --2- 172.21.15.59:0/2672526088 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff13c0b5370 0x7ff13c0b7830 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009890 tx=0x7ff14c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:49.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.641+0000 7ff146ffd640 1 -- 172.21.15.59:0/2672526088 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff14804b060 con 0x7ff150104560 2024-09-10T21:14:49.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.836+0000 7ff157f34640 1 -- 172.21.15.59:0/2672526088 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7ff150063590 con 0x7ff13c0b5370 2024-09-10T21:14:49.840 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:49 smithi059 ceph-mon[30888]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:14:49.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.838+0000 7ff146ffd640 1 -- 172.21.15.59:0/2672526088 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7ff150063590 con 0x7ff13c0b5370 2024-09-10T21:14:49.842 INFO:teuthology.orchestra.run.smithi059.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-10T21:14:49.842 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330009L400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-10T21:14:49.842 INFO:teuthology.orchestra.run.smithi059.stdout:smithi154 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233003B400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T21:14:49.843 INFO:teuthology.orchestra.run.smithi059.stdout:smithi192 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500NN400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T21:14:49.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.840+0000 7ff157f34640 1 -- 172.21.15.59:0/2672526088 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff13c0b5370 msgr2=0x7ff13c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:49.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.840+0000 7ff157f34640 1 --2- 172.21.15.59:0/2672526088 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff13c0b5370 0x7ff13c0b7830 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009890 tx=0x7ff14c008040 comp rx=0 tx=0).stop 2024-09-10T21:14:49.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.840+0000 7ff157f34640 1 -- 172.21.15.59:0/2672526088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff150104560 msgr2=0x7ff15019a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:49.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.840+0000 7ff157f34640 1 --2- 172.21.15.59:0/2672526088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff150104560 0x7ff15019a1b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff148033040 tx=0x7ff148003d00 comp rx=0 tx=0).stop 2024-09-10T21:14:49.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.840+0000 7ff157f34640 1 -- 172.21.15.59:0/2672526088 shutdown_connections 2024-09-10T21:14:49.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.840+0000 7ff157f34640 1 --2- 172.21.15.59:0/2672526088 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff13c0b5370 0x7ff13c0b7830 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:49.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.840+0000 7ff157f34640 1 --2- 172.21.15.59:0/2672526088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff150104560 0x7ff15019a1b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:49.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.840+0000 7ff157f34640 1 --2- 172.21.15.59:0/2672526088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff150103ba0 0x7ff150199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:49.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.840+0000 7ff157f34640 1 --2- 172.21.15.59:0/2672526088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff150102a40 0x7ff150198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:49.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.840+0000 7ff157f34640 1 -- 172.21.15.59:0/2672526088 >> 172.21.15.59:0/2672526088 conn(0x7ff1500fe2f0 msgr2=0x7ff150106f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:49.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.841+0000 7ff157f34640 1 -- 172.21.15.59:0/2672526088 shutdown_connections 2024-09-10T21:14:49.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:49.841+0000 7ff157f34640 1 -- 172.21.15.59:0/2672526088 wait complete. 2024-09-10T21:14:50.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:49 smithi192 ceph-mon[35363]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:14:50.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:49 smithi154 ceph-mon[35041]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:14:50.522 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T21:14:50.533 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi059.front.sepia.ceph.com 2024-09-10T21:14:50.533 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T21:14:50.796 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:50.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:50 smithi059 ceph-mon[30888]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:50.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:50 smithi059 ceph-mon[30888]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:14:51.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:50 smithi192 ceph-mon[35363]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:51.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:50 smithi192 ceph-mon[35363]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:14:51.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:50 smithi154 ceph-mon[35041]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:51.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:50 smithi154 ceph-mon[35041]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T21:14:51.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.289+0000 7f3ec9fa6640 1 -- 172.21.15.59:0/4169386225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4104560 msgr2=0x7f3ec410aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.289+0000 7f3ec9fa6640 1 --2- 172.21.15.59:0/4169386225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4104560 0x7f3ec410aee0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009cd0 tx=0x7f3ebc02a8e0 comp rx=0 tx=0).stop 2024-09-10T21:14:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.289+0000 7f3ec9fa6640 1 -- 172.21.15.59:0/4169386225 shutdown_connections 2024-09-10T21:14:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.289+0000 7f3ec9fa6640 1 --2- 172.21.15.59:0/4169386225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4104560 0x7f3ec410aee0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.289+0000 7f3ec9fa6640 1 --2- 172.21.15.59:0/4169386225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ec4103ba0 0x7f3ec4104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.289+0000 7f3ec9fa6640 1 --2- 172.21.15.59:0/4169386225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec4102a40 0x7f3ec4102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.289+0000 7f3ec9fa6640 1 -- 172.21.15.59:0/4169386225 >> 172.21.15.59:0/4169386225 conn(0x7f3ec40fe2f0 msgr2=0x7f3ec4100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.289+0000 7f3ec9fa6640 1 -- 172.21.15.59:0/4169386225 shutdown_connections 2024-09-10T21:14:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.289+0000 7f3ec9fa6640 1 -- 172.21.15.59:0/4169386225 wait complete. 2024-09-10T21:14:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.290+0000 7f3ec9fa6640 1 Processor -- start 2024-09-10T21:14:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.290+0000 7f3ec9fa6640 1 -- start start 2024-09-10T21:14:51.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.290+0000 7f3ec9fa6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4102a40 0x7f3ec4198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.290+0000 7f3ec9fa6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec4103ba0 0x7f3ec41994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.290+0000 7f3ec9fa6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ec4104560 0x7f3ec419a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.290+0000 7f3ec9fa6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec410e720 con 0x7f3ec4102a40 2024-09-10T21:14:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.290+0000 7f3ec9fa6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec410e5a0 con 0x7f3ec4103ba0 2024-09-10T21:14:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.290+0000 7f3ec9fa6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec410e8a0 con 0x7f3ec4104560 2024-09-10T21:14:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.290+0000 7f3ec37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4102a40 0x7f3ec4198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.290+0000 7f3ec37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4102a40 0x7f3ec4198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55356/0 (socket says 172.21.15.59:55356) 2024-09-10T21:14:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.290+0000 7f3ec37fe640 1 -- 172.21.15.59:0/1304426776 learned_addr learned my addr 172.21.15.59:0/1304426776 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.290+0000 7f3ec3fff640 1 --2- 172.21.15.59:0/1304426776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ec4104560 0x7f3ec419a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.290+0000 7f3ec2ffd640 1 --2- 172.21.15.59:0/1304426776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec4103ba0 0x7f3ec41994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.291+0000 7f3ec37fe640 1 -- 172.21.15.59:0/1304426776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ec4104560 msgr2=0x7f3ec419a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.291+0000 7f3ec37fe640 1 --2- 172.21.15.59:0/1304426776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ec4104560 0x7f3ec419a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:51.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.291+0000 7f3ec37fe640 1 -- 172.21.15.59:0/1304426776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec4103ba0 msgr2=0x7f3ec41994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:51.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.291+0000 7f3ec37fe640 1 --2- 172.21.15.59:0/1304426776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec4103ba0 0x7f3ec41994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:51.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.291+0000 7f3ec37fe640 1 -- 172.21.15.59:0/1304426776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec419a990 con 0x7f3ec4102a40 2024-09-10T21:14:51.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.291+0000 7f3ec2ffd640 1 --2- 172.21.15.59:0/1304426776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec4103ba0 0x7f3ec41994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:14:51.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.291+0000 7f3ec37fe640 1 --2- 172.21.15.59:0/1304426776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4102a40 0x7f3ec4198e60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3eb400c890 tx=0x7f3eb400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:51.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.291+0000 7f3ec0ff9640 1 -- 172.21.15.59:0/1304426776 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4004220 con 0x7f3ec4102a40 2024-09-10T21:14:51.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.291+0000 7f3ec9fa6640 1 -- 172.21.15.59:0/1304426776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec419ac80 con 0x7f3ec4102a40 2024-09-10T21:14:51.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.291+0000 7f3ec0ff9640 1 -- 172.21.15.59:0/1304426776 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3eb40043c0 con 0x7f3ec4102a40 2024-09-10T21:14:51.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.291+0000 7f3ec0ff9640 1 -- 172.21.15.59:0/1304426776 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4004a00 con 0x7f3ec4102a40 2024-09-10T21:14:51.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.291+0000 7f3ec9fa6640 1 -- 172.21.15.59:0/1304426776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec41a1360 con 0x7f3ec4102a40 2024-09-10T21:14:51.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.292+0000 7f3ec9fa6640 1 -- 172.21.15.59:0/1304426776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec4109d60 con 0x7f3ec4102a40 2024-09-10T21:14:51.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.293+0000 7f3ec0ff9640 1 -- 172.21.15.59:0/1304426776 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f3eb40079b0 con 0x7f3ec4102a40 2024-09-10T21:14:51.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.294+0000 7f3ec0ff9640 1 --2- 172.21.15.59:0/1304426776 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3eac0b53f0 0x7f3eac0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:51.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.294+0000 7f3ec2ffd640 1 --2- 172.21.15.59:0/1304426776 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3eac0b53f0 0x7f3eac0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:51.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.294+0000 7f3ec0ff9640 1 -- 172.21.15.59:0/1304426776 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3eb40e5b30 con 0x7f3ec4102a40 2024-09-10T21:14:51.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.295+0000 7f3ec2ffd640 1 --2- 172.21.15.59:0/1304426776 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3eac0b53f0 0x7f3eac0b78b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8006fd0 tx=0x7f3eb8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:51.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.298+0000 7f3ec0ff9640 1 -- 172.21.15.59:0/1304426776 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3eb4014030 con 0x7f3ec4102a40 2024-09-10T21:14:51.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.523+0000 7f3ec9fa6640 1 -- 172.21.15.59:0/1304426776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3ec402e5c0 con 0x7f3ec4102a40 2024-09-10T21:14:51.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.524+0000 7f3ec0ff9640 1 -- 172.21.15.59:0/1304426776 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3128 (secure 0 0 0) 0x7f3eb40ac860 con 0x7f3ec4102a40 2024-09-10T21:14:51.530 INFO:teuthology.orchestra.run.smithi059.stdout:e27 2024-09-10T21:14:51.530 INFO:teuthology.orchestra.run.smithi059.stdout:btime 2024-09-10T21:13:30:946868+0000 2024-09-10T21:14:51.530 INFO:teuthology.orchestra.run.smithi059.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T21:14:51.530 INFO:teuthology.orchestra.run.smithi059.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T21:14:51.530 INFO:teuthology.orchestra.run.smithi059.stdout:legacy client fscid: 1 2024-09-10T21:14:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:14:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:Filesystem 'cephfs' (1) 2024-09-10T21:14:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:fs_name cephfs 2024-09-10T21:14:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:epoch 27 2024-09-10T21:14:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T21:14:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:created 2024-09-10T21:13:19.283837+0000 2024-09-10T21:14:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:modified 2024-09-10T21:13:30.946837+0000 2024-09-10T21:14:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:tableserver 0 2024-09-10T21:14:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:root 0 2024-09-10T21:14:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:session_timeout 300 2024-09-10T21:14:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:session_autoclose 300 2024-09-10T21:14:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:max_file_size 1099511627776 2024-09-10T21:14:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:max_xattr_size 65536 2024-09-10T21:14:51.531 INFO:teuthology.orchestra.run.smithi059.stdout:required_client_features {} 2024-09-10T21:14:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:last_failure 0 2024-09-10T21:14:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:last_failure_osd_epoch 0 2024-09-10T21:14:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T21:14:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:max_mds 5 2024-09-10T21:14:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:in 0,1,2,3,4 2024-09-10T21:14:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:up {0=24563,1=24550,2=24542,3=24538,4=24529} 2024-09-10T21:14:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:failed 2024-09-10T21:14:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:damaged 2024-09-10T21:14:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:stopped 2024-09-10T21:14:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:data_pools [3] 2024-09-10T21:14:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:metadata_pool 2 2024-09-10T21:14:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:inline_data disabled 2024-09-10T21:14:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:balancer 2024-09-10T21:14:51.532 INFO:teuthology.orchestra.run.smithi059.stdout:bal_rank_mask -1 2024-09-10T21:14:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:standby_count_wanted 0 2024-09-10T21:14:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:qdb_cluster leader: 24563 members: 24563,24550,24538,24542,24529 2024-09-10T21:14:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b{0:24563} state up:active seq 4 addr [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:14:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.e{0:24524} state up:standby-replay seq 1 addr [v2:172.21.15.154:6834/294213384,v1:172.21.15.154:6835/294213384] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:14:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.i{1:24550} state up:active seq 8 addr [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:14:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.k{1:24503} state up:standby-replay seq 1 addr [v2:172.21.15.154:6832/2006948406,v1:172.21.15.154:6833/2006948406] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:14:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.h{2:24542} state up:active seq 9 addr [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:14:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.l{2:24499} state up:standby-replay seq 1 addr [v2:172.21.15.192:6832/2513372486,v1:172.21.15.192:6833/2513372486] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:14:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c{3:24538} state up:active seq 10 addr [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:14:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a{3:14709} state up:standby-replay seq 1 addr [v2:172.21.15.59:6840/1675735841,v1:172.21.15.59:6841/1675735841] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:14:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.f{4:24529} state up:active seq 11 addr [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:14:51.533 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.g{4:14703} state up:standby-replay seq 1 addr [v2:172.21.15.59:6838/4138885833,v1:172.21.15.59:6839/4138885833] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:14:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:14:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:14:51.534 INFO:teuthology.orchestra.run.smithi059.stdout:Standby daemons: 2024-09-10T21:14:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:14:51.534 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.j{-1:14640} state up:standby seq 1 addr [v2:172.21.15.59:6834/1242047500,v1:172.21.15.59:6835/1242047500] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:14:51.534 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.d{-1:14652} state up:standby seq 1 addr [v2:172.21.15.59:6836/90543201,v1:172.21.15.59:6837/90543201] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T21:14:51.534 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 27 2024-09-10T21:14:51.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.526+0000 7f3ec9fa6640 1 -- 172.21.15.59:0/1304426776 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3eac0b53f0 msgr2=0x7f3eac0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:51.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.526+0000 7f3ec9fa6640 1 --2- 172.21.15.59:0/1304426776 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3eac0b53f0 0x7f3eac0b78b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8006fd0 tx=0x7f3eb8008040 comp rx=0 tx=0).stop 2024-09-10T21:14:51.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.526+0000 7f3ec9fa6640 1 -- 172.21.15.59:0/1304426776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4102a40 msgr2=0x7f3ec4198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:51.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.526+0000 7f3ec9fa6640 1 --2- 172.21.15.59:0/1304426776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4102a40 0x7f3ec4198e60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3eb400c890 tx=0x7f3eb400cd50 comp rx=0 tx=0).stop 2024-09-10T21:14:51.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.526+0000 7f3ec9fa6640 1 -- 172.21.15.59:0/1304426776 shutdown_connections 2024-09-10T21:14:51.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.526+0000 7f3ec9fa6640 1 --2- 172.21.15.59:0/1304426776 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3eac0b53f0 0x7f3eac0b78b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:51.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.526+0000 7f3ec9fa6640 1 --2- 172.21.15.59:0/1304426776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ec4104560 0x7f3ec419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:51.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.526+0000 7f3ec9fa6640 1 --2- 172.21.15.59:0/1304426776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ec4103ba0 0x7f3ec41994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:51.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.526+0000 7f3ec9fa6640 1 --2- 172.21.15.59:0/1304426776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec4102a40 0x7f3ec4198e60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:51.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.526+0000 7f3ec9fa6640 1 -- 172.21.15.59:0/1304426776 >> 172.21.15.59:0/1304426776 conn(0x7f3ec40fe2f0 msgr2=0x7f3ec4106f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:51.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.526+0000 7f3ec9fa6640 1 -- 172.21.15.59:0/1304426776 shutdown_connections 2024-09-10T21:14:51.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:51.526+0000 7f3ec9fa6640 1 -- 172.21.15.59:0/1304426776 wait complete. 2024-09-10T21:14:51.897 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:51 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1304426776' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T21:14:52.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:51 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1304426776' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T21:14:52.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:51 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1304426776' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T21:14:52.247 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-10T21:14:52.507 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:52.880 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:52 smithi059 ceph-mon[30888]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:14:52.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.955+0000 7f114e3cf640 1 -- 172.21.15.59:0/718774151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1148102a70 msgr2=0x7f1148102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:52.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.955+0000 7f114e3cf640 1 --2- 172.21.15.59:0/718774151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1148102a70 0x7f1148102ef0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f113c009930 tx=0x7f113c02a420 comp rx=0 tx=0).stop 2024-09-10T21:14:52.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.955+0000 7f114e3cf640 1 -- 172.21.15.59:0/718774151 shutdown_connections 2024-09-10T21:14:52.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.955+0000 7f114e3cf640 1 --2- 172.21.15.59:0/718774151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1148103430 0x7f1148109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:52.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.956+0000 7f114e3cf640 1 --2- 172.21.15.59:0/718774151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1148102a70 0x7f1148102ef0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:52.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.956+0000 7f114e3cf640 1 --2- 172.21.15.59:0/718774151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1148101910 0x7f1148101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:52.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.956+0000 7f114e3cf640 1 -- 172.21.15.59:0/718774151 >> 172.21.15.59:0/718774151 conn(0x7f11480fd1e0 msgr2=0x7f11480ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:52.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.956+0000 7f114e3cf640 1 -- 172.21.15.59:0/718774151 shutdown_connections 2024-09-10T21:14:52.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.956+0000 7f114e3cf640 1 -- 172.21.15.59:0/718774151 wait complete. 2024-09-10T21:14:52.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.956+0000 7f114e3cf640 1 Processor -- start 2024-09-10T21:14:52.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.956+0000 7f114e3cf640 1 -- start start 2024-09-10T21:14:52.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.956+0000 7f114e3cf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1148101910 0x7f11481056d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:52.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.956+0000 7f114e3cf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1148102a70 0x7f1148103f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:52.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.956+0000 7f114e3cf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1148103430 0x7f1148104480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:52.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f114e3cf640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f114810d5f0 con 0x7f1148101910 2024-09-10T21:14:52.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f114e3cf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f114810d470 con 0x7f1148102a70 2024-09-10T21:14:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f114e3cf640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f114810d770 con 0x7f1148103430 2024-09-10T21:14:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f1147fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1148101910 0x7f11481056d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f1147fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1148101910 0x7f11481056d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55362/0 (socket says 172.21.15.59:55362) 2024-09-10T21:14:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f1147fff640 1 -- 172.21.15.59:0/3045528100 learned_addr learned my addr 172.21.15.59:0/3045528100 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f114c96c640 1 --2- 172.21.15.59:0/3045528100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1148103430 0x7f1148104480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f11477fe640 1 --2- 172.21.15.59:0/3045528100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1148102a70 0x7f1148103f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f1147fff640 1 -- 172.21.15.59:0/3045528100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1148103430 msgr2=0x7f1148104480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f1147fff640 1 --2- 172.21.15.59:0/3045528100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1148103430 0x7f1148104480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f1147fff640 1 -- 172.21.15.59:0/3045528100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1148102a70 msgr2=0x7f1148103f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f1147fff640 1 --2- 172.21.15.59:0/3045528100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1148102a70 0x7f1148103f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f1147fff640 1 -- 172.21.15.59:0/3045528100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1148104d40 con 0x7f1148101910 2024-09-10T21:14:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f11477fe640 1 --2- 172.21.15.59:0/3045528100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1148102a70 0x7f1148103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:14:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f1147fff640 1 --2- 172.21.15.59:0/3045528100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1148101910 0x7f11481056d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f113800d950 tx=0x7f113800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f11457fa640 1 -- 172.21.15.59:0/3045528100 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1138017070 con 0x7f1148101910 2024-09-10T21:14:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f11457fa640 1 -- 172.21.15.59:0/3045528100 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1138009c30 con 0x7f1148101910 2024-09-10T21:14:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f114e3cf640 1 -- 172.21.15.59:0/3045528100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11481a2f20 con 0x7f1148101910 2024-09-10T21:14:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f11457fa640 1 -- 172.21.15.59:0/3045528100 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113800f620 con 0x7f1148101910 2024-09-10T21:14:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.957+0000 7f114e3cf640 1 -- 172.21.15.59:0/3045528100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11481a3380 con 0x7f1148101910 2024-09-10T21:14:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.958+0000 7f114e3cf640 1 -- 172.21.15.59:0/3045528100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11481a35b0 con 0x7f1148101910 2024-09-10T21:14:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.960+0000 7f11457fa640 1 -- 172.21.15.59:0/3045528100 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f1138005030 con 0x7f1148101910 2024-09-10T21:14:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.961+0000 7f11457fa640 1 --2- 172.21.15.59:0/3045528100 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f11300b53f0 0x7f11300b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.962+0000 7f11477fe640 1 --2- 172.21.15.59:0/3045528100 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f11300b53f0 0x7f11300b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.962+0000 7f11457fa640 1 -- 172.21.15.59:0/3045528100 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f11380e58e0 con 0x7f1148101910 2024-09-10T21:14:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.962+0000 7f11477fe640 1 --2- 172.21.15.59:0/3045528100 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f11300b53f0 0x7f11300b78b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f113c0096c0 tx=0x7f113c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:52.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:52.965+0000 7f11457fa640 1 -- 172.21.15.59:0/3045528100 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f11380ac690 con 0x7f1148101910 2024-09-10T21:14:53.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:52 smithi192 ceph-mon[35363]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:14:53.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:53.153+0000 7f114e3cf640 1 -- 172.21.15.59:0/3045528100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f11481a3940 con 0x7f1148101910 2024-09-10T21:14:53.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:53.154+0000 7f11457fa640 1 -- 172.21.15.59:0/3045528100 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v75) ==== 56+0+5261 (secure 0 0 0) 0x7f1138009de0 con 0x7f1148101910 2024-09-10T21:14:53.158 INFO:teuthology.orchestra.run.smithi059.stdout:epoch 75 2024-09-10T21:14:53.158 INFO:teuthology.orchestra.run.smithi059.stdout:fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:14:53.158 INFO:teuthology.orchestra.run.smithi059.stdout:created 2024-09-10T21:05:18.196881+0000 2024-09-10T21:14:53.158 INFO:teuthology.orchestra.run.smithi059.stdout:modified 2024-09-10T21:14:06.297762+0000 2024-09-10T21:14:53.158 INFO:teuthology.orchestra.run.smithi059.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-10T21:14:53.158 INFO:teuthology.orchestra.run.smithi059.stdout:crush_version 26 2024-09-10T21:14:53.158 INFO:teuthology.orchestra.run.smithi059.stdout:full_ratio 0.95 2024-09-10T21:14:53.159 INFO:teuthology.orchestra.run.smithi059.stdout:backfillfull_ratio 0.9 2024-09-10T21:14:53.159 INFO:teuthology.orchestra.run.smithi059.stdout:nearfull_ratio 0.85 2024-09-10T21:14:53.159 INFO:teuthology.orchestra.run.smithi059.stdout:require_min_compat_client luminous 2024-09-10T21:14:53.159 INFO:teuthology.orchestra.run.smithi059.stdout:min_compat_client luminous 2024-09-10T21:14:53.159 INFO:teuthology.orchestra.run.smithi059.stdout:require_osd_release squid 2024-09-10T21:14:53.159 INFO:teuthology.orchestra.run.smithi059.stdout:stretch_mode_enabled false 2024-09-10T21:14:53.159 INFO:teuthology.orchestra.run.smithi059.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-10T21:14:53.159 INFO:teuthology.orchestra.run.smithi059.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 73 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-10T21:14:53.159 INFO:teuthology.orchestra.run.smithi059.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 73 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-10T21:14:53.159 INFO:teuthology.orchestra.run.smithi059.stdout:max_osd 12 2024-09-10T21:14:53.160 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0 up in weight 1 up_from 8 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6802/1237328951,v1:172.21.15.59:6803/1237328951] [v2:172.21.15.59:6804/1237328951,v1:172.21.15.59:6805/1237328951] exists,up 4e88abf3-8592-4b5f-8ba9-5969e01e12d6 2024-09-10T21:14:53.160 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1 up in weight 1 up_from 13 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/3376412264,v1:172.21.15.154:6801/3376412264] [v2:172.21.15.154:6802/3376412264,v1:172.21.15.154:6803/3376412264] exists,up 7908eefd-bbfa-4fe4-9db9-7a92d0e77acb 2024-09-10T21:14:53.160 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2 up in weight 1 up_from 18 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6800/440750253,v1:172.21.15.192:6801/440750253] [v2:172.21.15.192:6802/440750253,v1:172.21.15.192:6803/440750253] exists,up 2351b9f0-bca1-48b2-afb8-0e2b7856c52e 2024-09-10T21:14:53.160 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3 up in weight 1 up_from 25 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6810/1483798393,v1:172.21.15.59:6811/1483798393] [v2:172.21.15.59:6812/1483798393,v1:172.21.15.59:6813/1483798393] exists,up f26969d1-7b48-4f20-9077-c55c59775ed7 2024-09-10T21:14:53.160 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4 up in weight 1 up_from 30 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6808/1817188525,v1:172.21.15.154:6809/1817188525] [v2:172.21.15.154:6810/1817188525,v1:172.21.15.154:6811/1817188525] exists,up 21e1a472-1ae1-454b-aee5-2ad92f6eff17 2024-09-10T21:14:53.160 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5 up in weight 1 up_from 35 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6808/1221386274,v1:172.21.15.192:6809/1221386274] [v2:172.21.15.192:6810/1221386274,v1:172.21.15.192:6811/1221386274] exists,up 6191b10a-5cbd-4225-b0ec-70d05023d5d6 2024-09-10T21:14:53.160 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6 up in weight 1 up_from 41 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6818/3006857566,v1:172.21.15.59:6819/3006857566] [v2:172.21.15.59:6820/3006857566,v1:172.21.15.59:6821/3006857566] exists,up 609c11f7-ce82-4714-bf73-a4f16f4483ad 2024-09-10T21:14:53.160 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7 up in weight 1 up_from 45 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6816/175260385,v1:172.21.15.154:6817/175260385] [v2:172.21.15.154:6818/175260385,v1:172.21.15.154:6819/175260385] exists,up bff3a29f-47cc-4e66-92e4-14e9b7faf498 2024-09-10T21:14:53.160 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8 up in weight 1 up_from 51 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6816/3138189462,v1:172.21.15.192:6817/3138189462] [v2:172.21.15.192:6818/3138189462,v1:172.21.15.192:6819/3138189462] exists,up 56dabafd-9bb9-409a-88cd-4b5b5ecf810a 2024-09-10T21:14:53.160 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9 up in weight 1 up_from 57 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6826/2446500753,v1:172.21.15.59:6827/2446500753] [v2:172.21.15.59:6828/2446500753,v1:172.21.15.59:6829/2446500753] exists,up 044f934d-3df5-47aa-85f5-c3b63b267ecd 2024-09-10T21:14:53.161 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10 up in weight 1 up_from 61 up_thru 71 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6824/1139781446,v1:172.21.15.154:6825/1139781446] [v2:172.21.15.154:6826/1139781446,v1:172.21.15.154:6827/1139781446] exists,up 8d3b735b-e4fe-4a8e-8c75-a49313c6fabb 2024-09-10T21:14:53.161 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11 up in weight 1 up_from 67 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.192:6824/1041494458,v1:172.21.15.192:6825/1041494458] [v2:172.21.15.192:6826/1041494458,v1:172.21.15.192:6827/1041494458] exists,up fd6a6d06-c6aa-42e3-aa38-fc583319f6bb 2024-09-10T21:14:53.165 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 2.6 [8,11] 2024-09-10T21:14:53.165 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 2.a [2,11] 2024-09-10T21:14:53.165 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 2.b [2,4] 2024-09-10T21:14:53.165 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 3.0 [5,9] 2024-09-10T21:14:53.165 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 3.14 [4,6] 2024-09-10T21:14:53.165 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 3.38 [3,9] 2024-09-10T21:14:53.165 INFO:teuthology.orchestra.run.smithi059.stdout:pg_upmap_items 3.3c [4,9] 2024-09-10T21:14:53.165 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/212243638 expires 2024-09-11T21:06:05.140902+0000 2024-09-10T21:14:53.165 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/3305207692 expires 2024-09-11T21:06:05.140902+0000 2024-09-10T21:14:53.165 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:6801/1576322369 expires 2024-09-11T21:06:05.140902+0000 2024-09-10T21:14:53.165 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:6800/1576322369 expires 2024-09-11T21:06:05.140902+0000 2024-09-10T21:14:53.165 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/2965147556 expires 2024-09-11T21:05:40.304807+0000 2024-09-10T21:14:53.166 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/1174570395 expires 2024-09-11T21:05:40.304807+0000 2024-09-10T21:14:53.166 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/2934865748 expires 2024-09-11T21:06:05.140902+0000 2024-09-10T21:14:53.166 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:6800/3633609115 expires 2024-09-11T21:05:40.304807+0000 2024-09-10T21:14:53.166 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:6801/3633609115 expires 2024-09-11T21:05:40.304807+0000 2024-09-10T21:14:53.166 INFO:teuthology.orchestra.run.smithi059.stdout:blocklist 172.21.15.59:0/3377179776 expires 2024-09-11T21:05:40.304807+0000 2024-09-10T21:14:53.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:53.156+0000 7f114e3cf640 1 -- 172.21.15.59:0/3045528100 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f11300b53f0 msgr2=0x7f11300b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:53.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:53.156+0000 7f114e3cf640 1 --2- 172.21.15.59:0/3045528100 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f11300b53f0 0x7f11300b78b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f113c0096c0 tx=0x7f113c000bc0 comp rx=0 tx=0).stop 2024-09-10T21:14:53.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:53.156+0000 7f114e3cf640 1 -- 172.21.15.59:0/3045528100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1148101910 msgr2=0x7f11481056d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:53.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:53.156+0000 7f114e3cf640 1 --2- 172.21.15.59:0/3045528100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1148101910 0x7f11481056d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f113800d950 tx=0x7f113800de10 comp rx=0 tx=0).stop 2024-09-10T21:14:53.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:53.156+0000 7f114e3cf640 1 -- 172.21.15.59:0/3045528100 shutdown_connections 2024-09-10T21:14:53.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:53.156+0000 7f114e3cf640 1 --2- 172.21.15.59:0/3045528100 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f11300b53f0 0x7f11300b78b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:53.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:53.156+0000 7f114e3cf640 1 --2- 172.21.15.59:0/3045528100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1148103430 0x7f1148104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:53.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:53.156+0000 7f114e3cf640 1 --2- 172.21.15.59:0/3045528100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1148102a70 0x7f1148103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:53.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:53.156+0000 7f114e3cf640 1 --2- 172.21.15.59:0/3045528100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1148101910 0x7f11481056d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:53.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:53.156+0000 7f114e3cf640 1 -- 172.21.15.59:0/3045528100 >> 172.21.15.59:0/3045528100 conn(0x7f11480fd1e0 msgr2=0x7f11480fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:53.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:53.156+0000 7f114e3cf640 1 -- 172.21.15.59:0/3045528100 shutdown_connections 2024-09-10T21:14:53.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:53.157+0000 7f114e3cf640 1 -- 172.21.15.59:0/3045528100 wait complete. 2024-09-10T21:14:53.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:52 smithi154 ceph-mon[35041]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:14:53.882 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-10T21:14:53.894 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:14:53.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:53 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3045528100' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T21:14:54.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:53 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3045528100' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T21:14:54.156 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:54.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:53 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3045528100' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T21:14:54.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.673+0000 7f648d01e640 1 -- 172.21.15.59:0/2946440450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6488103ce0 msgr2=0x7f64881040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.673+0000 7f648d01e640 1 --2- 172.21.15.59:0/2946440450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6488103ce0 0x7f64881040c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6478009900 tx=0x7f647802a410 comp rx=0 tx=0).stop 2024-09-10T21:14:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.673+0000 7f648d01e640 1 -- 172.21.15.59:0/2946440450 shutdown_connections 2024-09-10T21:14:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.673+0000 7f648d01e640 1 --2- 172.21.15.59:0/2946440450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f648810d140 0x7f648810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.673+0000 7f648d01e640 1 --2- 172.21.15.59:0/2946440450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6488104600 0x7f648810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.673+0000 7f648d01e640 1 --2- 172.21.15.59:0/2946440450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6488103ce0 0x7f64881040c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:54.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.673+0000 7f648d01e640 1 -- 172.21.15.59:0/2946440450 >> 172.21.15.59:0/2946440450 conn(0x7f64880fd700 msgr2=0x7f64880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:54.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.673+0000 7f648d01e640 1 -- 172.21.15.59:0/2946440450 shutdown_connections 2024-09-10T21:14:54.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.673+0000 7f648d01e640 1 -- 172.21.15.59:0/2946440450 wait complete. 2024-09-10T21:14:54.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.674+0000 7f648d01e640 1 Processor -- start 2024-09-10T21:14:54.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.674+0000 7f648d01e640 1 -- start start 2024-09-10T21:14:54.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.674+0000 7f648d01e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6488103ce0 0x7f648819b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.674+0000 7f648d01e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6488104600 0x7f648819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.674+0000 7f648d01e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f648810d140 0x7f64881a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.674+0000 7f648d01e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6488112db0 con 0x7f6488103ce0 2024-09-10T21:14:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.674+0000 7f648d01e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6488112c30 con 0x7f648810d140 2024-09-10T21:14:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.674+0000 7f648d01e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6488112f30 con 0x7f6488104600 2024-09-10T21:14:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.674+0000 7f6486d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6488103ce0 0x7f648819b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.674+0000 7f6486d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6488103ce0 0x7f648819b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55374/0 (socket says 172.21.15.59:55374) 2024-09-10T21:14:54.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.675+0000 7f6486d9d640 1 -- 172.21.15.59:0/2757181585 learned_addr learned my addr 172.21.15.59:0/2757181585 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:54.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.675+0000 7f648659c640 1 --2- 172.21.15.59:0/2757181585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6488104600 0x7f648819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:54.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.675+0000 7f648759e640 1 --2- 172.21.15.59:0/2757181585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f648810d140 0x7f64881a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:54.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.675+0000 7f6486d9d640 1 -- 172.21.15.59:0/2757181585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6488104600 msgr2=0x7f648819b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:54.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.675+0000 7f6486d9d640 1 --2- 172.21.15.59:0/2757181585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6488104600 0x7f648819b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:54.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.675+0000 7f6486d9d640 1 -- 172.21.15.59:0/2757181585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f648810d140 msgr2=0x7f64881a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:54.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.675+0000 7f6486d9d640 1 --2- 172.21.15.59:0/2757181585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f648810d140 0x7f64881a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:54.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.675+0000 7f6486d9d640 1 -- 172.21.15.59:0/2757181585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64881a1520 con 0x7f6488103ce0 2024-09-10T21:14:54.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.675+0000 7f648759e640 1 --2- 172.21.15.59:0/2757181585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f648810d140 0x7f64881a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:54.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.675+0000 7f6486d9d640 1 --2- 172.21.15.59:0/2757181585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6488103ce0 0x7f648819b470 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6478005940 tx=0x7f6478004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:54.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.675+0000 7f646ffff640 1 -- 172.21.15.59:0/2757181585 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647803f030 con 0x7f6488103ce0 2024-09-10T21:14:54.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.675+0000 7f648d01e640 1 -- 172.21.15.59:0/2757181585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64881a17b0 con 0x7f6488103ce0 2024-09-10T21:14:54.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.675+0000 7f646ffff640 1 -- 172.21.15.59:0/2757181585 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6478003aa0 con 0x7f6488103ce0 2024-09-10T21:14:54.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.675+0000 7f646ffff640 1 -- 172.21.15.59:0/2757181585 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6478035070 con 0x7f6488103ce0 2024-09-10T21:14:54.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.675+0000 7f648d01e640 1 -- 172.21.15.59:0/2757181585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64881a7ed0 con 0x7f6488103ce0 2024-09-10T21:14:54.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.676+0000 7f648d01e640 1 -- 172.21.15.59:0/2757181585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64881040c0 con 0x7f6488103ce0 2024-09-10T21:14:54.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.678+0000 7f646ffff640 1 -- 172.21.15.59:0/2757181585 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f647803bcc0 con 0x7f6488103ce0 2024-09-10T21:14:54.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.678+0000 7f646ffff640 1 --2- 172.21.15.59:0/2757181585 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f64700b5370 0x7f64700b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:54.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.679+0000 7f648659c640 1 --2- 172.21.15.59:0/2757181585 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f64700b5370 0x7f64700b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:54.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.679+0000 7f646ffff640 1 -- 172.21.15.59:0/2757181585 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6478106990 con 0x7f6488103ce0 2024-09-10T21:14:54.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.679+0000 7f648659c640 1 --2- 172.21.15.59:0/2757181585 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f64700b5370 0x7f64700b7830 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f648810e640 tx=0x7f647c00b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:54.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.681+0000 7f646ffff640 1 -- 172.21.15.59:0/2757181585 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f64780cd720 con 0x7f6488103ce0 2024-09-10T21:14:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.906+0000 7f648d01e640 1 -- 172.21.15.59:0/2757181585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f648819c5a0 con 0x7f6488103ce0 2024-09-10T21:14:54.963 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:54 smithi059 ceph-mon[30888]: pgmap v329: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:14:54.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.907+0000 7f646ffff640 1 -- 172.21.15.59:0/2757181585 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7f64780cd020 con 0x7f6488103ce0 2024-09-10T21:14:54.964 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:14:54.964 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":27,"btime":"2024-09-10T21:13:30:946868+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:13:30.946837+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24563,24550,24538,24542,24529]},"id":1}]} 2024-09-10T21:14:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 27 2024-09-10T21:14:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.909+0000 7f648d01e640 1 -- 172.21.15.59:0/2757181585 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f64700b5370 msgr2=0x7f64700b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.909+0000 7f648d01e640 1 --2- 172.21.15.59:0/2757181585 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f64700b5370 0x7f64700b7830 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f648810e640 tx=0x7f647c00b2e0 comp rx=0 tx=0).stop 2024-09-10T21:14:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.909+0000 7f648d01e640 1 -- 172.21.15.59:0/2757181585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6488103ce0 msgr2=0x7f648819b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.909+0000 7f648d01e640 1 --2- 172.21.15.59:0/2757181585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6488103ce0 0x7f648819b470 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6478005940 tx=0x7f6478004270 comp rx=0 tx=0).stop 2024-09-10T21:14:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.909+0000 7f648d01e640 1 -- 172.21.15.59:0/2757181585 shutdown_connections 2024-09-10T21:14:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.909+0000 7f648d01e640 1 --2- 172.21.15.59:0/2757181585 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f64700b5370 0x7f64700b7830 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.909+0000 7f648d01e640 1 --2- 172.21.15.59:0/2757181585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f648810d140 0x7f64881a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.909+0000 7f648d01e640 1 --2- 172.21.15.59:0/2757181585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6488104600 0x7f648819b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.909+0000 7f648d01e640 1 --2- 172.21.15.59:0/2757181585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6488103ce0 0x7f648819b470 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.909+0000 7f648d01e640 1 -- 172.21.15.59:0/2757181585 >> 172.21.15.59:0/2757181585 conn(0x7f64880fd700 msgr2=0x7f64880ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.909+0000 7f648d01e640 1 -- 172.21.15.59:0/2757181585 shutdown_connections 2024-09-10T21:14:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:54.909+0000 7f648d01e640 1 -- 172.21.15.59:0/2757181585 wait complete. 2024-09-10T21:14:55.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:54 smithi192 ceph-mon[35363]: pgmap v329: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:14:55.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:54 smithi154 ceph-mon[35041]: pgmap v329: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:14:55.615 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:14:55.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:55 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2757181585' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:14:55.924 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:56.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:55 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2757181585' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:14:56.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:55 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2757181585' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:14:56.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.361+0000 7f8126d66640 1 -- 172.21.15.59:0/3397259068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f812010d140 msgr2=0x7f812010f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:56.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.361+0000 7f8126d66640 1 --2- 172.21.15.59:0/3397259068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f812010d140 0x7f812010f5a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8118009900 tx=0x7f811802a410 comp rx=0 tx=0).stop 2024-09-10T21:14:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.361+0000 7f8126d66640 1 -- 172.21.15.59:0/3397259068 shutdown_connections 2024-09-10T21:14:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.361+0000 7f8126d66640 1 --2- 172.21.15.59:0/3397259068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f812010d140 0x7f812010f5a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.361+0000 7f8126d66640 1 --2- 172.21.15.59:0/3397259068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8120104600 0x7f812010caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.361+0000 7f8126d66640 1 --2- 172.21.15.59:0/3397259068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8120103ce0 0x7f81201040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.361+0000 7f8126d66640 1 -- 172.21.15.59:0/3397259068 >> 172.21.15.59:0/3397259068 conn(0x7f81200fd720 msgr2=0x7f81200ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.361+0000 7f8126d66640 1 -- 172.21.15.59:0/3397259068 shutdown_connections 2024-09-10T21:14:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.361+0000 7f8126d66640 1 -- 172.21.15.59:0/3397259068 wait complete. 2024-09-10T21:14:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.362+0000 7f8126d66640 1 Processor -- start 2024-09-10T21:14:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.362+0000 7f8126d66640 1 -- start start 2024-09-10T21:14:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.362+0000 7f8126d66640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8120103ce0 0x7f8120101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.362+0000 7f8126d66640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8120104600 0x7f8120101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.362+0000 7f8126d66640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f812010d140 0x7f8120102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:56.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.362+0000 7f8126d66640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8120112db0 con 0x7f8120104600 2024-09-10T21:14:56.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.362+0000 7f8126d66640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8120112c30 con 0x7f8120103ce0 2024-09-10T21:14:56.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.362+0000 7f8126d66640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8120112f30 con 0x7f812010d140 2024-09-10T21:14:56.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.362+0000 7f811ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8120104600 0x7f8120101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:56.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.362+0000 7f811ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8120104600 0x7f8120101ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55384/0 (socket says 172.21.15.59:55384) 2024-09-10T21:14:56.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.362+0000 7f811ffff640 1 -- 172.21.15.59:0/945520264 learned_addr learned my addr 172.21.15.59:0/945520264 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:56.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.363+0000 7f811ffff640 1 -- 172.21.15.59:0/945520264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f812010d140 msgr2=0x7f8120102410 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T21:14:56.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.363+0000 7f811ffff640 1 --2- 172.21.15.59:0/945520264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f812010d140 0x7f8120102410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:56.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.363+0000 7f811ffff640 1 -- 172.21.15.59:0/945520264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8120103ce0 msgr2=0x7f8120101990 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T21:14:56.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.363+0000 7f811ffff640 1 --2- 172.21.15.59:0/945520264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8120103ce0 0x7f8120101990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:56.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.363+0000 7f811ffff640 1 -- 172.21.15.59:0/945520264 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81201a76a0 con 0x7f8120104600 2024-09-10T21:14:56.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.363+0000 7f811ffff640 1 --2- 172.21.15.59:0/945520264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8120104600 0x7f8120101ed0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f811400c970 tx=0x7f811400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:56.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.363+0000 7f811dffb640 1 -- 172.21.15.59:0/945520264 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8114004220 con 0x7f8120104600 2024-09-10T21:14:56.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.363+0000 7f811dffb640 1 -- 172.21.15.59:0/945520264 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81140043c0 con 0x7f8120104600 2024-09-10T21:14:56.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.363+0000 7f8126d66640 1 -- 172.21.15.59:0/945520264 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81201a7990 con 0x7f8120104600 2024-09-10T21:14:56.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.363+0000 7f811dffb640 1 -- 172.21.15.59:0/945520264 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81140047c0 con 0x7f8120104600 2024-09-10T21:14:56.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.363+0000 7f8126d66640 1 -- 172.21.15.59:0/945520264 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81201a7e80 con 0x7f8120104600 2024-09-10T21:14:56.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.364+0000 7f8126d66640 1 -- 172.21.15.59:0/945520264 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81201040c0 con 0x7f8120104600 2024-09-10T21:14:56.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.366+0000 7f811dffb640 1 -- 172.21.15.59:0/945520264 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f81140079b0 con 0x7f8120104600 2024-09-10T21:14:56.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.366+0000 7f811dffb640 1 --2- 172.21.15.59:0/945520264 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f81080b5370 0x7f81080b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:56.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.366+0000 7f811dffb640 1 -- 172.21.15.59:0/945520264 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f81140e5ed0 con 0x7f8120104600 2024-09-10T21:14:56.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.366+0000 7f8124b02640 1 --2- 172.21.15.59:0/945520264 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f81080b5370 0x7f81080b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:56.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.367+0000 7f8124b02640 1 --2- 172.21.15.59:0/945520264 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f81080b5370 0x7f81080b7830 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8110005c40 tx=0x7f8110005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:56.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.369+0000 7f811dffb640 1 -- 172.21.15.59:0/945520264 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8114014030 con 0x7f8120104600 2024-09-10T21:14:56.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.592+0000 7f8126d66640 1 -- 172.21.15.59:0/945520264 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f812002e5c0 con 0x7f8120104600 2024-09-10T21:14:56.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.593+0000 7f811dffb640 1 -- 172.21.15.59:0/945520264 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11973 (secure 0 0 0) 0x7f81140acc60 con 0x7f8120104600 2024-09-10T21:14:56.597 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:14:56.597 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":27,"btime":"2024-09-10T21:13:30:946868+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:13:30.946837+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24563,24550,24538,24542,24529]},"id":1}]} 2024-09-10T21:14:56.598 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 27 2024-09-10T21:14:56.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.595+0000 7f8126d66640 1 -- 172.21.15.59:0/945520264 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f81080b5370 msgr2=0x7f81080b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:56.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.595+0000 7f8126d66640 1 --2- 172.21.15.59:0/945520264 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f81080b5370 0x7f81080b7830 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8110005c40 tx=0x7f8110005bd0 comp rx=0 tx=0).stop 2024-09-10T21:14:56.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.595+0000 7f8126d66640 1 -- 172.21.15.59:0/945520264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8120104600 msgr2=0x7f8120101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:56.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.595+0000 7f8126d66640 1 --2- 172.21.15.59:0/945520264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8120104600 0x7f8120101ed0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f811400c970 tx=0x7f811400ce30 comp rx=0 tx=0).stop 2024-09-10T21:14:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.595+0000 7f8126d66640 1 -- 172.21.15.59:0/945520264 shutdown_connections 2024-09-10T21:14:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.595+0000 7f8126d66640 1 --2- 172.21.15.59:0/945520264 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f81080b5370 0x7f81080b7830 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.595+0000 7f8126d66640 1 --2- 172.21.15.59:0/945520264 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f812010d140 0x7f8120102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.595+0000 7f8126d66640 1 --2- 172.21.15.59:0/945520264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8120104600 0x7f8120101ed0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.595+0000 7f8126d66640 1 --2- 172.21.15.59:0/945520264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8120103ce0 0x7f8120101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.595+0000 7f8126d66640 1 -- 172.21.15.59:0/945520264 >> 172.21.15.59:0/945520264 conn(0x7f81200fd720 msgr2=0x7f81200fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.595+0000 7f8126d66640 1 -- 172.21.15.59:0/945520264 shutdown_connections 2024-09-10T21:14:56.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:56.595+0000 7f8126d66640 1 -- 172.21.15.59:0/945520264 wait complete. 2024-09-10T21:14:56.988 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:56 smithi059 ceph-mon[30888]: pgmap v330: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:56.989 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:56 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/945520264' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:14:57.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:56 smithi192 ceph-mon[35363]: pgmap v330: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:57.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:56 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/945520264' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:14:57.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:56 smithi154 ceph-mon[35041]: pgmap v330: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:14:57.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:56 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/945520264' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:14:57.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:14:57.669 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:58.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.137+0000 7fc6b3f4d640 1 -- 172.21.15.59:0/1116551817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6ac075f40 msgr2=0x7fc6ac10ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:58.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.137+0000 7fc6b3f4d640 1 --2- 172.21.15.59:0/1116551817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6ac075f40 0x7fc6ac10ee10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc69c009900 tx=0x7fc69c02a410 comp rx=0 tx=0).stop 2024-09-10T21:14:58.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.137+0000 7fc6b3f4d640 1 -- 172.21.15.59:0/1116551817 shutdown_connections 2024-09-10T21:14:58.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.137+0000 7fc6b3f4d640 1 --2- 172.21.15.59:0/1116551817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6ac10f3e0 0x7fc6ac1117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:58.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.137+0000 7fc6b3f4d640 1 --2- 172.21.15.59:0/1116551817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6ac075f40 0x7fc6ac10ee10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:58.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.137+0000 7fc6b3f4d640 1 --2- 172.21.15.59:0/1116551817 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6ac075540 0x7fc6ac075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:58.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.137+0000 7fc6b3f4d640 1 -- 172.21.15.59:0/1116551817 >> 172.21.15.59:0/1116551817 conn(0x7fc6ac0fe830 msgr2=0x7fc6ac100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:58.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.137+0000 7fc6b3f4d640 1 -- 172.21.15.59:0/1116551817 shutdown_connections 2024-09-10T21:14:58.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.137+0000 7fc6b3f4d640 1 -- 172.21.15.59:0/1116551817 wait complete. 2024-09-10T21:14:58.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.137+0000 7fc6b3f4d640 1 Processor -- start 2024-09-10T21:14:58.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.137+0000 7fc6b3f4d640 1 -- start start 2024-09-10T21:14:58.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.138+0000 7fc6b3f4d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6ac075540 0x7fc6ac19b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:58.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.138+0000 7fc6b3f4d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6ac075f40 0x7fc6ac19baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:58.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.138+0000 7fc6b3f4d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6ac10f3e0 0x7fc6ac1a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:58.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.138+0000 7fc6b3f4d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac114f80 con 0x7fc6ac10f3e0 2024-09-10T21:14:58.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.138+0000 7fc6b3f4d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac114e00 con 0x7fc6ac075540 2024-09-10T21:14:58.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.138+0000 7fc6b3f4d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac115100 con 0x7fc6ac075f40 2024-09-10T21:14:58.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.138+0000 7fc6b24ea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6ac10f3e0 0x7fc6ac1a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:58.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.138+0000 7fc6b24ea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6ac10f3e0 0x7fc6ac1a0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55398/0 (socket says 172.21.15.59:55398) 2024-09-10T21:14:58.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.138+0000 7fc6b24ea640 1 -- 172.21.15.59:0/1832362484 learned_addr learned my addr 172.21.15.59:0/1832362484 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:58.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.138+0000 7fc6b1ce9640 1 --2- 172.21.15.59:0/1832362484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6ac075540 0x7fc6ac19b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:58.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.138+0000 7fc6b14e8640 1 --2- 172.21.15.59:0/1832362484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6ac075f40 0x7fc6ac19baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:58.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.138+0000 7fc6b24ea640 1 -- 172.21.15.59:0/1832362484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6ac075f40 msgr2=0x7fc6ac19baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:58.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.138+0000 7fc6b24ea640 1 --2- 172.21.15.59:0/1832362484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6ac075f40 0x7fc6ac19baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:58.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.138+0000 7fc6b24ea640 1 -- 172.21.15.59:0/1832362484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6ac075540 msgr2=0x7fc6ac19b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:58.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.138+0000 7fc6b24ea640 1 --2- 172.21.15.59:0/1832362484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6ac075540 0x7fc6ac19b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:58.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.138+0000 7fc6b24ea640 1 -- 172.21.15.59:0/1832362484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ac1a1660 con 0x7fc6ac10f3e0 2024-09-10T21:14:58.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.138+0000 7fc6b24ea640 1 --2- 172.21.15.59:0/1832362484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6ac10f3e0 0x7fc6ac1a0e90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400e9d0 tx=0x7fc6a400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:58.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.138+0000 7fc6a2ffd640 1 -- 172.21.15.59:0/1832362484 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a400cd80 con 0x7fc6ac10f3e0 2024-09-10T21:14:58.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.139+0000 7fc6b3f4d640 1 -- 172.21.15.59:0/1832362484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ac1a1950 con 0x7fc6ac10f3e0 2024-09-10T21:14:58.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.139+0000 7fc6a2ffd640 1 -- 172.21.15.59:0/1832362484 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6a4005020 con 0x7fc6ac10f3e0 2024-09-10T21:14:58.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.139+0000 7fc6a2ffd640 1 -- 172.21.15.59:0/1832362484 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40116d0 con 0x7fc6ac10f3e0 2024-09-10T21:14:58.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.139+0000 7fc6b3f4d640 1 -- 172.21.15.59:0/1832362484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6ac1a8010 con 0x7fc6ac10f3e0 2024-09-10T21:14:58.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.140+0000 7fc6b3f4d640 1 -- 172.21.15.59:0/1832362484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6ac075920 con 0x7fc6ac10f3e0 2024-09-10T21:14:58.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.141+0000 7fc6a2ffd640 1 -- 172.21.15.59:0/1832362484 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fc6a400f040 con 0x7fc6ac10f3e0 2024-09-10T21:14:58.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.142+0000 7fc6a2ffd640 1 --2- 172.21.15.59:0/1832362484 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc6980b5370 0x7fc6980b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:58.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.142+0000 7fc6b1ce9640 1 --2- 172.21.15.59:0/1832362484 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc6980b5370 0x7fc6980b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:58.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.142+0000 7fc6a2ffd640 1 -- 172.21.15.59:0/1832362484 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc6a40e5f60 con 0x7fc6ac10f3e0 2024-09-10T21:14:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.142+0000 7fc6b1ce9640 1 --2- 172.21.15.59:0/1832362484 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc6980b5370 0x7fc6980b7830 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8005d00 tx=0x7fc6a800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.145+0000 7fc6a2ffd640 1 -- 172.21.15.59:0/1832362484 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc6a4016030 con 0x7fc6ac10f3e0 2024-09-10T21:14:58.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.332+0000 7fc6b3f4d640 1 -- 172.21.15.59:0/1832362484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc6ac1a8270 con 0x7fc6ac10f3e0 2024-09-10T21:14:58.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.333+0000 7fc6a2ffd640 1 -- 172.21.15.59:0/1832362484 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22633 (secure 0 0 0) 0x7fc6a40ac640 con 0x7fc6ac10f3e0 2024-09-10T21:14:58.337 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:14:58.337 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":75,"fsid":"3c26b952-6fb8-11ef-bcea-c7b262605968","created":"2024-09-10T21:05:18.196881+0000","modified":"2024-09-10T21:14:06.297762+0000","last_up_change":"2024-09-10T21:12:31.909004+0000","last_in_change":"2024-09-10T21:12:08.116727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:08:47.611285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:13:15.562661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:13:17.272280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e88abf3-8592-4b5f-8ba9-5969e01e12d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6803","nonce":1237328951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6805","nonce":1237328951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6809","nonce":1237328951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6807","nonce":1237328951}]},"public_addr":"172.21.15.59:6803/1237328951","cluster_addr":"172.21.15.59:6805/1237328951","heartbeat_back_addr":"172.21.15.59:6809/1237328951","heartbeat_front_addr":"172.21.15.59:6807/1237328951","state":["exists","up"]},{"osd":1,"uuid":"7908eefd-bbfa-4fe4-9db9-7a92d0e77acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6801","nonce":3376412264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6803","nonce":3376412264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6807","nonce":3376412264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6805","nonce":3376412264}]},"public_addr":"172.21.15.154:6801/3376412264","cluster_addr":"172.21.15.154:6803/3376412264","heartbeat_back_addr":"172.21.15.154:6807/3376412264","heartbeat_front_addr":"172.21.15.154:6805/3376412264","state":["exists","up"]},{"osd":2,"uuid":"2351b9f0-bca1-48b2-afb8-0e2b7856c52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6801","nonce":440750253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6803","nonce":440750253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6807","nonce":440750253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6805","nonce":440750253}]},"public_addr":"172.21.15.192:6801/440750253","cluster_addr":"172.21.15.192:6803/440750253","heartbeat_back_addr":"172.21.15.192:6807/440750253","heartbeat_front_addr":"172.21.15.192:6805/440750253","state":["exists","up"]},{"osd":3,"uuid":"f26969d1-7b48-4f20-9077-c55c59775ed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6811","nonce":1483798393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6813","nonce":1483798393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6817","nonce":1483798393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6815","nonce":1483798393}]},"public_addr":"172.21.15.59:6811/1483798393","cluster_addr":"172.21.15.59:6813/1483798393","heartbeat_back_addr":"172.21.15.59:6817/1483798393","heartbeat_front_addr":"172.21.15.59:6815/1483798393","state":["exists","up"]},{"osd":4,"uuid":"21e1a472-1ae1-454b-aee5-2ad92f6eff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6809","nonce":1817188525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6811","nonce":1817188525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6815","nonce":1817188525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6813","nonce":1817188525}]},"public_addr":"172.21.15.154:6809/1817188525","cluster_addr":"172.21.15.154:6811/1817188525","heartbeat_back_addr":"172.21.15.154:6815/1817188525","heartbeat_front_addr":"172.21.15.154:6813/1817188525","state":["exists","up"]},{"osd":5,"uuid":"6191b10a-5cbd-4225-b0ec-70d05023d5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6809","nonce":1221386274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6811","nonce":1221386274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6815","nonce":1221386274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6813","nonce":1221386274}]},"public_addr":"172.21.15.192:6809/1221386274","cluster_addr":"172.21.15.192:6811/1221386274","heartbeat_back_addr":"172.21.15.192:6815/1221386274","heartbeat_front_addr":"172.21.15.192:6813/1221386274","state":["exists","up"]},{"osd":6,"uuid":"609c11f7-ce82-4714-bf73-a4f16f4483ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6819","nonce":3006857566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6821","nonce":3006857566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6825","nonce":3006857566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6823","nonce":3006857566}]},"public_addr":"172.21.15.59:6819/3006857566","cluster_addr":"172.21.15.59:6821/3006857566","heartbeat_back_addr":"172.21.15.59:6825/3006857566","heartbeat_front_addr":"172.21.15.59:6823/3006857566","state":["exists","up"]},{"osd":7,"uuid":"bff3a29f-47cc-4e66-92e4-14e9b7faf498","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6817","nonce":175260385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6819","nonce":175260385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6823","nonce":175260385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6821","nonce":175260385}]},"public_addr":"172.21.15.154:6817/175260385","cluster_addr":"172.21.15.154:6819/175260385","heartbeat_back_addr":"172.21.15.154:6823/175260385","heartbeat_front_addr":"172.21.15.154:6821/175260385","state":["exists","up"]},{"osd":8,"uuid":"56dabafd-9bb9-409a-88cd-4b5b5ecf810a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6817","nonce":3138189462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6819","nonce":3138189462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6823","nonce":3138189462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6821","nonce":3138189462}]},"public_addr":"172.21.15.192:6817/3138189462","cluster_addr":"172.21.15.192:6819/3138189462","heartbeat_back_addr":"172.21.15.192:6823/3138189462","heartbeat_front_addr":"172.21.15.192:6821/3138189462","state":["exists","up"]},{"osd":9,"uuid":"044f934d-3df5-47aa-85f5-c3b63b267ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6827","nonce":2446500753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6829","nonce":2446500753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6833","nonce":2446500753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6831","nonce":2446500753}]},"public_addr":"172.21.15.59:6827/2446500753","cluster_addr":"172.21.15.59:6829/2446500753","heartbeat_back_addr":"172.21.15.59:6833/2446500753","heartbeat_front_addr":"172.21.15.59:6831/2446500753","state":["exists","up"]},{"osd":10,"uuid":"8d3b735b-e4fe-4a8e-8c75-a49313c6fabb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6825","nonce":1139781446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6827","nonce":1139781446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6831","nonce":1139781446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6829","nonce":1139781446}]},"public_addr":"172.21.15.154:6825/1139781446","cluster_addr":"172.21.15.154:6827/1139781446","heartbeat_back_addr":"172.21.15.154:6831/1139781446","heartbeat_front_addr":"172.21.15.154:6829/1139781446","state":["exists","up"]},{"osd":11,"uuid":"fd6a6d06-c6aa-42e3-aa38-fc583319f6bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6825","nonce":1041494458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6827","nonce":1041494458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6831","nonce":1041494458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6829","nonce":1041494458}]},"public_addr":"172.21.15.192:6825/1041494458","cluster_addr":"172.21.15.192:6827/1041494458","heartbeat_back_addr":"172.21.15.192:6831/1041494458","heartbeat_front_addr":"172.21.15.192:6829/1041494458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:07:53.974382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:19.552358+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:44.251670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:09.430992+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:34.043343+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:59.903679+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:25.733171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:49.795257+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:14.485648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:40.485165+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:04.655475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:29.308456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/212243638":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/3305207692":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6801/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/2965147556":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/1174570395":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/2934865748":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:6801/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/3377179776":"2024-09-11T21:05:40.304807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:14:58.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.335+0000 7fc6b3f4d640 1 -- 172.21.15.59:0/1832362484 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc6980b5370 msgr2=0x7fc6980b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:58.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.335+0000 7fc6b3f4d640 1 --2- 172.21.15.59:0/1832362484 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc6980b5370 0x7fc6980b7830 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8005d00 tx=0x7fc6a800b410 comp rx=0 tx=0).stop 2024-09-10T21:14:58.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.335+0000 7fc6b3f4d640 1 -- 172.21.15.59:0/1832362484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6ac10f3e0 msgr2=0x7fc6ac1a0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:58.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.335+0000 7fc6b3f4d640 1 --2- 172.21.15.59:0/1832362484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6ac10f3e0 0x7fc6ac1a0e90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400e9d0 tx=0x7fc6a400ee90 comp rx=0 tx=0).stop 2024-09-10T21:14:58.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.335+0000 7fc6b3f4d640 1 -- 172.21.15.59:0/1832362484 shutdown_connections 2024-09-10T21:14:58.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.335+0000 7fc6b3f4d640 1 --2- 172.21.15.59:0/1832362484 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc6980b5370 0x7fc6980b7830 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:58.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.335+0000 7fc6b3f4d640 1 --2- 172.21.15.59:0/1832362484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6ac10f3e0 0x7fc6ac1a0e90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:58.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.335+0000 7fc6b3f4d640 1 --2- 172.21.15.59:0/1832362484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6ac075f40 0x7fc6ac19baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:58.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.335+0000 7fc6b3f4d640 1 --2- 172.21.15.59:0/1832362484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6ac075540 0x7fc6ac19b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:58.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.335+0000 7fc6b3f4d640 1 -- 172.21.15.59:0/1832362484 >> 172.21.15.59:0/1832362484 conn(0x7fc6ac0fe830 msgr2=0x7fc6ac111600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:58.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.335+0000 7fc6b3f4d640 1 -- 172.21.15.59:0/1832362484 shutdown_connections 2024-09-10T21:14:58.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:58.335+0000 7fc6b3f4d640 1 -- 172.21.15.59:0/1832362484 wait complete. 2024-09-10T21:14:58.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:58 smithi059 ceph-mon[30888]: pgmap v331: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:14:58.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:14:58 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1832362484' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:14:59.061 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T21:13:19.283837+0000', 'modified': '2024-09-10T21:13:30.946837+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24563, 'mds_1': 24550, 'mds_2': 24542, 'mds_3': 24538, 'mds_4': 24529}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14703': {'gid': 14703, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.59:6839/4138885833', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6838', 'nonce': 4138885833}, {'type': 'v1', 'addr': '172.21.15.59:6839', 'nonce': 4138885833}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14709': {'gid': 14709, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.59:6841/1675735841', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6840', 'nonce': 1675735841}, {'type': 'v1', 'addr': '172.21.15.59:6841', 'nonce': 1675735841}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24499': {'gid': 24499, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.192:6833/2513372486', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6832', 'nonce': 2513372486}, {'type': 'v1', 'addr': '172.21.15.192:6833', 'nonce': 2513372486}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24503': {'gid': 24503, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6833/2006948406', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 2006948406}, {'type': 'v1', 'addr': '172.21.15.154:6833', 'nonce': 2006948406}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24524': {'gid': 24524, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6835/294213384', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 294213384}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 294213384}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24529': {'gid': 24529, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.192:6835/3608050805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6834', 'nonce': 3608050805}, {'type': 'v1', 'addr': '172.21.15.192:6835', 'nonce': 3608050805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24538': {'gid': 24538, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.192:6837/266289113', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6836', 'nonce': 266289113}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 266289113}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24542': {'gid': 24542, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.154:6837/3954687054', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 3954687054}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 3954687054}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24550': {'gid': 24550, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.192:6839/677733026', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6838', 'nonce': 677733026}, {'type': 'v1', 'addr': '172.21.15.192:6839', 'nonce': 677733026}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24563': {'gid': 24563, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.154:6839/3664432388', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 3664432388}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 3664432388}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24563, 'qdb_cluster': [24563, 24550, 24538, 24542, 24529]} 2024-09-10T21:14:59.061 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-10T21:14:59.061 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.f status 2024-09-10T21:14:59.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:58 smithi192 ceph-mon[35363]: pgmap v331: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:14:59.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:14:58 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1832362484' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:14:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:58 smithi154 ceph-mon[35041]: pgmap v331: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:14:59.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:14:58 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1832362484' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:14:59.322 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:14:59.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.814+0000 7f61cb83b640 1 -- 172.21.15.59:0/2887963575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61c41023b0 msgr2=0x7f61c4106880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:59.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.814+0000 7f61cb83b640 1 --2- 172.21.15.59:0/2887963575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61c41023b0 0x7f61c4106880 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f61b8009900 tx=0x7f61b802a410 comp rx=0 tx=0).stop 2024-09-10T21:14:59.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.814+0000 7f61cb83b640 1 -- 172.21.15.59:0/2887963575 shutdown_connections 2024-09-10T21:14:59.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.814+0000 7f61cb83b640 1 --2- 172.21.15.59:0/2887963575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61c4106ed0 0x7f61c4107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.814+0000 7f61cb83b640 1 --2- 172.21.15.59:0/2887963575 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61c41023b0 0x7f61c4106880 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.814+0000 7f61cb83b640 1 --2- 172.21.15.59:0/2887963575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61c4101a90 0x7f61c4101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.814+0000 7f61cb83b640 1 -- 172.21.15.59:0/2887963575 >> 172.21.15.59:0/2887963575 conn(0x7f61c40fd700 msgr2=0x7f61c40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:59.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.814+0000 7f61cb83b640 1 -- 172.21.15.59:0/2887963575 shutdown_connections 2024-09-10T21:14:59.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.814+0000 7f61cb83b640 1 -- 172.21.15.59:0/2887963575 wait complete. 2024-09-10T21:14:59.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.814+0000 7f61cb83b640 1 Processor -- start 2024-09-10T21:14:59.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.814+0000 7f61cb83b640 1 -- start start 2024-09-10T21:14:59.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61cb83b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61c4101a90 0x7f61c419fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:59.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61cb83b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61c41023b0 0x7f61c419ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:59.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61cb83b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61c4106ed0 0x7f61c41a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:59.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61cb83b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f61c4119430 con 0x7f61c4101a90 2024-09-10T21:14:59.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61cb83b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f61c41192b0 con 0x7f61c41023b0 2024-09-10T21:14:59.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61cb83b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f61c41195b0 con 0x7f61c4106ed0 2024-09-10T21:14:59.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61c95d7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61c4101a90 0x7f61c419fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:59.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61c95d7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61c4101a90 0x7f61c419fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56034/0 (socket says 172.21.15.59:56034) 2024-09-10T21:14:59.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61c95d7640 1 -- 172.21.15.59:0/662668443 learned_addr learned my addr 172.21.15.59:0/662668443 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:59.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61c8dd6640 1 --2- 172.21.15.59:0/662668443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61c41023b0 0x7f61c419ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61c9dd8640 1 --2- 172.21.15.59:0/662668443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61c4106ed0 0x7f61c41a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61c95d7640 1 -- 172.21.15.59:0/662668443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61c4106ed0 msgr2=0x7f61c41a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61c95d7640 1 --2- 172.21.15.59:0/662668443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61c4106ed0 0x7f61c41a5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61c95d7640 1 -- 172.21.15.59:0/662668443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61c41023b0 msgr2=0x7f61c419ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61c95d7640 1 --2- 172.21.15.59:0/662668443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61c41023b0 0x7f61c419ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61c95d7640 1 -- 172.21.15.59:0/662668443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c41a5b30 con 0x7f61c4101a90 2024-09-10T21:14:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61c8dd6640 1 --2- 172.21.15.59:0/662668443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61c41023b0 0x7f61c419ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61c9dd8640 1 --2- 172.21.15.59:0/662668443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61c4106ed0 0x7f61c41a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:14:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61c95d7640 1 --2- 172.21.15.59:0/662668443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61c4101a90 0x7f61c419fa80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f61b400ba50 tx=0x7f61b400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61c27fc640 1 -- 172.21.15.59:0/662668443 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b4019070 con 0x7f61c4101a90 2024-09-10T21:14:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61cb83b640 1 -- 172.21.15.59:0/662668443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c41a5e20 con 0x7f61c4101a90 2024-09-10T21:14:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.815+0000 7f61c27fc640 1 -- 172.21.15.59:0/662668443 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61b400cbe0 con 0x7f61c4101a90 2024-09-10T21:14:59.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.816+0000 7f61c27fc640 1 -- 172.21.15.59:0/662668443 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b40075d0 con 0x7f61c4101a90 2024-09-10T21:14:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.816+0000 7f61cb83b640 1 -- 172.21.15.59:0/662668443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c41ac6b0 con 0x7f61c4101a90 2024-09-10T21:14:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.818+0000 7f61c27fc640 1 -- 172.21.15.59:0/662668443 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f61b4007830 con 0x7f61c4101a90 2024-09-10T21:14:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.818+0000 7f61cdc10740 1 Processor -- start 2024-09-10T21:14:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.818+0000 7f61cdc10740 1 -- start start 2024-09-10T21:14:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61cdc10740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e5d30 0x56381b6e6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61cdc10740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6e6650 0x56381b6f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61cdc10740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6f25e0 0x56381b6f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61cdc10740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56381b65dc10 con 0x56381b6f25e0 2024-09-10T21:14:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61cdc10740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56381b64d040 con 0x56381b6e6650 2024-09-10T21:14:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61cdc10740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56381b650e50 con 0x56381b6e5d30 2024-09-10T21:14:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61c8dd6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6f25e0 0x56381b6f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61c9dd8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e5d30 0x56381b6e6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61c8dd6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6f25e0 0x56381b6f49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56048/0 (socket says 172.21.15.59:56048) 2024-09-10T21:14:59.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61c8dd6640 1 -- 172.21.15.59:0/4147885430 learned_addr learned my addr 172.21.15.59:0/4147885430 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61c95d7640 1 --2- 172.21.15.59:0/4147885430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6e6650 0x56381b6f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61c27fc640 1 --2- 172.21.15.59:0/662668443 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f61ac0b5370 0x7f61ac0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61c8dd6640 1 -- 172.21.15.59:0/4147885430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e5d30 msgr2=0x56381b6e6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61c8dd6640 1 --2- 172.21.15.59:0/4147885430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e5d30 0x56381b6e6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61c8dd6640 1 -- 172.21.15.59:0/4147885430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6e6650 msgr2=0x56381b6f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61c8dd6640 1 --2- 172.21.15.59:0/4147885430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6e6650 0x56381b6f20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61c8dd6640 1 -- 172.21.15.59:0/4147885430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56381b3ab540 con 0x56381b6f25e0 2024-09-10T21:14:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61c9dd8640 1 --2- 172.21.15.59:0/662668443 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f61ac0b5370 0x7f61ac0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61c27fc640 1 -- 172.21.15.59:0/662668443 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f61b40e55c0 con 0x7f61c4101a90 2024-09-10T21:14:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.819+0000 7f61c8dd6640 1 --2- 172.21.15.59:0/4147885430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6f25e0 0x56381b6f49d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f61b8033000 tx=0x7f61b8031db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96eb9ac2308714c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.820+0000 7f61ab7fe640 1 -- 172.21.15.59:0/4147885430 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b803f070 con 0x56381b6f25e0 2024-09-10T21:14:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.820+0000 7f61ab7fe640 1 -- 172.21.15.59:0/4147885430 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61b80316a0 con 0x56381b6f25e0 2024-09-10T21:14:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.820+0000 7f61ab7fe640 1 -- 172.21.15.59:0/4147885430 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b8035070 con 0x56381b6f25e0 2024-09-10T21:14:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.820+0000 7f61cdc10740 1 -- 172.21.15.59:0/4147885430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6f25e0 msgr2=0x56381b6f49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.820+0000 7f61c9dd8640 1 --2- 172.21.15.59:0/662668443 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f61ac0b5370 0x7f61ac0b7830 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00aa40 tx=0x7f61bc0047d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.820+0000 7f61cdc10740 1 --2- 172.21.15.59:0/4147885430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6f25e0 0x56381b6f49d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f61b8033000 tx=0x7f61b8031db0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.820+0000 7f61cdc10740 1 -- 172.21.15.59:0/4147885430 shutdown_connections 2024-09-10T21:14:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.820+0000 7f61cdc10740 1 --2- 172.21.15.59:0/4147885430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6f25e0 0x56381b6f49d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.820+0000 7f61cdc10740 1 --2- 172.21.15.59:0/4147885430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6e6650 0x56381b6f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.820+0000 7f61cdc10740 1 --2- 172.21.15.59:0/4147885430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e5d30 0x56381b6e6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.820+0000 7f61cdc10740 1 -- 172.21.15.59:0/4147885430 >> 172.21.15.59:0/4147885430 conn(0x56381b6e3b60 msgr2=0x56381b6e4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.820+0000 7f61cdc10740 1 -- 172.21.15.59:0/4147885430 shutdown_connections 2024-09-10T21:14:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.820+0000 7f61cdc10740 1 -- 172.21.15.59:0/4147885430 wait complete. 2024-09-10T21:14:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.821+0000 7f61cdc10740 1 -- start start 2024-09-10T21:14:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.821+0000 7f61cdc10740 1 Processor -- start 2024-09-10T21:14:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.821+0000 7f61cdc10740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e5d30 0x56381b6ef5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.821+0000 7f61cdc10740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6e6650 0x56381b6efb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.821+0000 7f61cdc10740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6f25e0 0x56381b6f0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.821+0000 7f61cdc10740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56381b4ae5f0 con 0x56381b6f25e0 2024-09-10T21:14:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.821+0000 7f61cdc10740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56381b5e8010 con 0x56381b6e6650 2024-09-10T21:14:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.821+0000 7f61cdc10740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56381b6f5230 con 0x56381b6e5d30 2024-09-10T21:14:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.821+0000 7f61cdc10740 10 client.0 _ll_register_callbacks cb 0x56381b647340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:14:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.821+0000 7f61c9dd8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6f25e0 0x56381b6f0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.821+0000 7f61c9dd8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6f25e0 0x56381b6f0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56060/0 (socket says 172.21.15.59:56060) 2024-09-10T21:14:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.821+0000 7f61c9dd8640 1 -- 172.21.15.59:0/969750796 learned_addr learned my addr 172.21.15.59:0/969750796 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.822+0000 7f61c95d7640 1 --2- 172.21.15.59:0/969750796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e5d30 0x56381b6ef5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.822+0000 7f61c8dd6640 1 --2- 172.21.15.59:0/969750796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6e6650 0x56381b6efb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.822+0000 7f61c9dd8640 1 -- 172.21.15.59:0/969750796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e5d30 msgr2=0x56381b6ef5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.822+0000 7f61c9dd8640 1 --2- 172.21.15.59:0/969750796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e5d30 0x56381b6ef5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.822+0000 7f61c9dd8640 1 -- 172.21.15.59:0/969750796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6e6650 msgr2=0x56381b6efb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.822+0000 7f61c9dd8640 1 --2- 172.21.15.59:0/969750796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6e6650 0x56381b6efb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.822+0000 7f61c9dd8640 1 -- 172.21.15.59:0/969750796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56381b615a00 con 0x56381b6f25e0 2024-09-10T21:14:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.822+0000 7f61c95d7640 1 --2- 172.21.15.59:0/969750796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e5d30 0x56381b6ef5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:14:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.822+0000 7f61c9dd8640 1 --2- 172.21.15.59:0/969750796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6f25e0 0x56381b6f0050 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f61bc014670 tx=0x7f61bc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca30ff4584d6b43 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.822+0000 7f61a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:14:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.822+0000 7f61a8ff9640 1 -- 172.21.15.59:0/969750796 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc024020 con 0x56381b6f25e0 2024-09-10T21:14:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.822+0000 7f61a8ff9640 1 -- 172.21.15.59:0/969750796 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f61bc013940 con 0x56381b6f25e0 2024-09-10T21:14:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.822+0000 7f61cdc10740 1 -- 172.21.15.59:0/969750796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61b80316a0 con 0x56381b6f25e0 2024-09-10T21:14:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.822+0000 7f61a8ff9640 1 -- 172.21.15.59:0/969750796 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f61bc013b40 con 0x56381b6f25e0 2024-09-10T21:14:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.822+0000 7f61cdc10740 10 client.15222 fetch_fsmap learned FSMap version 27 2024-09-10T21:14:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.822+0000 7f61cdc10740 1 -- 172.21.15.59:0/969750796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56381b700e70 con 0x56381b6f25e0 2024-09-10T21:14:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.823+0000 7f61a8ff9640 1 -- 172.21.15.59:0/969750796 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61b80316a0 con 0x56381b6f25e0 2024-09-10T21:14:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.823+0000 7f61a8ff9640 1 -- 172.21.15.59:0/969750796 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f61bc02b400 con 0x56381b6f25e0 2024-09-10T21:14:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.823+0000 7f61cdc10740 10 client.15222 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:14:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.823+0000 7f61cdc10740 10 client.15222 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T21:14:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.823+0000 7f61cdc10740 20 client.15222 populate_metadata read hostname 'smithi059' 2024-09-10T21:14:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.823+0000 7f61cdc10740 1 --2- 172.21.15.59:0/969750796 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56381b703590 0x56381b704a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.823+0000 7f61cdc10740 4 client.15222 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:14:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.823+0000 7f61cdc10740 1 -- 172.21.15.59:0/969750796 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56381b65fb60 con 0x56381b703590 2024-09-10T21:14:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.823+0000 7f61c95d7640 1 --2- 172.21.15.59:0/969750796 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56381b703590 0x56381b704a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.823+0000 7f61a8ff9640 10 client.15222 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:14:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.823+0000 7f61c95d7640 1 --2- 172.21.15.59:0/969750796 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56381b703590 0x56381b704a00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6477c01f51ef1542 server_cookie=191c5dfb464b389c in_seq=0 out_seq=0 2024-09-10T21:14:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.824+0000 7f61a8ff9640 1 -- 172.21.15.59:0/969750796 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56381b65fb60 con 0x56381b703590 2024-09-10T21:14:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.824+0000 7f61a8ff9640 10 client.15222 handle_command_reply: tid=0 2024-09-10T21:14:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.824+0000 7f61cdc10740 1 client.15222 shutdown 2024-09-10T21:14:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.824+0000 7f61cdc10740 1 -- 172.21.15.59:0/969750796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6f25e0 msgr2=0x56381b6f0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.824+0000 7f61cdc10740 1 --2- 172.21.15.59:0/969750796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6f25e0 0x56381b6f0050 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f61bc014670 tx=0x7f61bc008040 comp rx=0 tx=0).stop 2024-09-10T21:14:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.825+0000 7f61cdc10740 1 -- 172.21.15.59:0/969750796 shutdown_connections 2024-09-10T21:14:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.825+0000 7f61cdc10740 1 --2- 172.21.15.59:0/969750796 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56381b703590 0x56381b704a00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.825+0000 7f61a8ff9640 0 client.15222 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:14:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.825+0000 7f61cdc10740 1 --2- 172.21.15.59:0/969750796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6f25e0 0x56381b6f0050 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.825+0000 7f61cdc10740 1 --2- 172.21.15.59:0/969750796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6e6650 0x56381b6efb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.825+0000 7f61cdc10740 1 --2- 172.21.15.59:0/969750796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e5d30 0x56381b6ef5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.825+0000 7f61cdc10740 1 -- 172.21.15.59:0/969750796 >> 172.21.15.59:0/969750796 conn(0x56381b6e3b60 msgr2=0x56381b6e96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.825+0000 7f61cdc10740 1 -- 172.21.15.59:0/969750796 shutdown_connections 2024-09-10T21:14:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.825+0000 7f61cdc10740 1 -- 172.21.15.59:0/969750796 wait complete. 2024-09-10T21:14:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.825+0000 7f61cdc10740 20 client.15222 trim_cache size 0 max 16384 2024-09-10T21:14:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.844+0000 7f61cdc10740 1 Processor -- start 2024-09-10T21:14:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.844+0000 7f61cdc10740 1 -- start start 2024-09-10T21:14:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.844+0000 7f61cdc10740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6e5d30 0x56381b704330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.844+0000 7f61cdc10740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e6650 0x56381b6ede70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.844+0000 7f61cdc10740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6f25e0 0x56381b6ee3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.844+0000 7f61cdc10740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56381b702d40 con 0x56381b6e5d30 2024-09-10T21:14:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.844+0000 7f61cdc10740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56381b703410 con 0x56381b6f25e0 2024-09-10T21:14:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.844+0000 7f61cdc10740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56381b703ae0 con 0x56381b6e6650 2024-09-10T21:14:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.844+0000 7f61c95d7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6e5d30 0x56381b704330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.844+0000 7f61c95d7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6e5d30 0x56381b704330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56074/0 (socket says 172.21.15.59:56074) 2024-09-10T21:14:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.844+0000 7f61c95d7640 1 -- 172.21.15.59:0/700917422 learned_addr learned my addr 172.21.15.59:0/700917422 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.844+0000 7f61c9dd8640 1 --2- 172.21.15.59:0/700917422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6f25e0 0x56381b6ee3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.844+0000 7f61c8dd6640 1 --2- 172.21.15.59:0/700917422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e6650 0x56381b6ede70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.844+0000 7f61c95d7640 1 -- 172.21.15.59:0/700917422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e6650 msgr2=0x56381b6ede70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.844+0000 7f61c95d7640 1 --2- 172.21.15.59:0/700917422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e6650 0x56381b6ede70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.844+0000 7f61c95d7640 1 -- 172.21.15.59:0/700917422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6f25e0 msgr2=0x56381b6ee3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.844+0000 7f61c95d7640 1 --2- 172.21.15.59:0/700917422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6f25e0 0x56381b6ee3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.844+0000 7f61c95d7640 1 -- 172.21.15.59:0/700917422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56381b6e3990 con 0x56381b6e5d30 2024-09-10T21:14:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.844+0000 7f61c9dd8640 1 --2- 172.21.15.59:0/700917422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6f25e0 0x56381b6ee3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:14:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.845+0000 7f61c95d7640 1 --2- 172.21.15.59:0/700917422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6e5d30 0x56381b704330 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f61b40e3520 tx=0x7f61b40e7ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5433e78b667eadcb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.845+0000 7f61aaffd640 1 -- 172.21.15.59:0/700917422 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b40ac350 con 0x56381b6e5d30 2024-09-10T21:14:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.845+0000 7f61aaffd640 1 -- 172.21.15.59:0/700917422 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61b40abc50 con 0x56381b6e5d30 2024-09-10T21:14:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.845+0000 7f61aaffd640 1 -- 172.21.15.59:0/700917422 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b40b4d50 con 0x56381b6e5d30 2024-09-10T21:14:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.845+0000 7f61cdc10740 1 -- 172.21.15.59:0/700917422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6e5d30 msgr2=0x56381b704330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.845+0000 7f61cdc10740 1 --2- 172.21.15.59:0/700917422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6e5d30 0x56381b704330 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f61b40e3520 tx=0x7f61b40e7ab0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.846+0000 7f61cdc10740 1 -- 172.21.15.59:0/700917422 shutdown_connections 2024-09-10T21:14:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.846+0000 7f61cdc10740 1 --2- 172.21.15.59:0/700917422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6f25e0 0x56381b6ee3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.846+0000 7f61cdc10740 1 --2- 172.21.15.59:0/700917422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e6650 0x56381b6ede70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.846+0000 7f61cdc10740 1 --2- 172.21.15.59:0/700917422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6e5d30 0x56381b704330 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.846+0000 7f61cdc10740 1 -- 172.21.15.59:0/700917422 >> 172.21.15.59:0/700917422 conn(0x56381b6e3b60 msgr2=0x56381b6ea8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.846+0000 7f61cdc10740 1 -- 172.21.15.59:0/700917422 shutdown_connections 2024-09-10T21:14:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.846+0000 7f61cdc10740 1 -- 172.21.15.59:0/700917422 wait complete. 2024-09-10T21:14:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.846+0000 7f61cdc10740 1 -- start start 2024-09-10T21:14:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.846+0000 7f61cdc10740 1 Processor -- start 2024-09-10T21:14:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.846+0000 7f61cdc10740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6e5d30 0x56381b70d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.846+0000 7f61cdc10740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e6650 0x56381b70d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.846+0000 7f61cdc10740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6f25e0 0x56381b707d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.846+0000 7f61cdc10740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56381b704880 con 0x56381b6e5d30 2024-09-10T21:14:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.846+0000 7f61cdc10740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56381b7041b0 con 0x56381b6f25e0 2024-09-10T21:14:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.846+0000 7f61cdc10740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56381b704f50 con 0x56381b6e6650 2024-09-10T21:14:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61cdc10740 10 client.0 _ll_register_callbacks cb 0x7f61bc010cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:14:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61c95d7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6e5d30 0x56381b70d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61c95d7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6e5d30 0x56381b70d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56090/0 (socket says 172.21.15.59:56090) 2024-09-10T21:14:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61c95d7640 1 -- 172.21.15.59:0/4184994959 learned_addr learned my addr 172.21.15.59:0/4184994959 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:14:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61c9dd8640 1 --2- 172.21.15.59:0/4184994959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6f25e0 0x56381b707d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61c8dd6640 1 --2- 172.21.15.59:0/4184994959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e6650 0x56381b70d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61c95d7640 1 -- 172.21.15.59:0/4184994959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e6650 msgr2=0x56381b70d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61c95d7640 1 --2- 172.21.15.59:0/4184994959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e6650 0x56381b70d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61c95d7640 1 -- 172.21.15.59:0/4184994959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6f25e0 msgr2=0x56381b707d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:14:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61c95d7640 1 --2- 172.21.15.59:0/4184994959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6f25e0 0x56381b707d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61c95d7640 1 -- 172.21.15.59:0/4184994959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56381b6e45e0 con 0x56381b6e5d30 2024-09-10T21:14:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61c9dd8640 1 --2- 172.21.15.59:0/4184994959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6f25e0 0x56381b707d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:14:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61c8dd6640 1 --2- 172.21.15.59:0/4184994959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e6650 0x56381b70d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:14:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61c95d7640 1 --2- 172.21.15.59:0/4184994959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6e5d30 0x56381b70d010 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f61b400ba20 tx=0x7f61b40b52a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c260c2e133b4cfe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:14:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:14:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61a8ff9640 1 -- 172.21.15.59:0/4184994959 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b40b0730 con 0x56381b6e5d30 2024-09-10T21:14:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61a8ff9640 1 -- 172.21.15.59:0/4184994959 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f61b40e31f0 con 0x56381b6e5d30 2024-09-10T21:14:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61cdc10740 1 -- 172.21.15.59:0/4184994959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61b40abc50 con 0x56381b6e5d30 2024-09-10T21:14:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61a8ff9640 1 -- 172.21.15.59:0/4184994959 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f61b40a7ec0 con 0x56381b6e5d30 2024-09-10T21:14:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61cdc10740 10 client.15228 fetch_fsmap learned FSMap version 27 2024-09-10T21:14:59.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.847+0000 7f61cdc10740 1 -- 172.21.15.59:0/4184994959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56381b770930 con 0x56381b6e5d30 2024-09-10T21:14:59.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.848+0000 7f61a8ff9640 1 -- 172.21.15.59:0/4184994959 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61b40abc50 con 0x56381b6e5d30 2024-09-10T21:14:59.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.848+0000 7f61a8ff9640 1 -- 172.21.15.59:0/4184994959 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f61b40e7b20 con 0x56381b6e5d30 2024-09-10T21:14:59.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.848+0000 7f61cdc10740 10 client.15228 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:14:59.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.848+0000 7f61cdc10740 10 client.15228 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-10T21:14:59.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.848+0000 7f61cdc10740 20 client.15228 populate_metadata read hostname 'smithi059' 2024-09-10T21:14:59.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.848+0000 7f61cdc10740 1 --2- 172.21.15.59:0/4184994959 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56381b703590 0x56381b773c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:14:59.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.848+0000 7f61cdc10740 4 client.15228 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:14:59.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.848+0000 7f61cdc10740 1 -- 172.21.15.59:0/4184994959 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "status"}) -- 0x56381b65b610 con 0x56381b703590 2024-09-10T21:14:59.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.848+0000 7f61c8dd6640 1 --2- 172.21.15.59:0/4184994959 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56381b703590 0x56381b773c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:14:59.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.849+0000 7f61a8ff9640 10 client.15228 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:14:59.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.849+0000 7f61c8dd6640 1 --2- 172.21.15.59:0/4184994959 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56381b703590 0x56381b773c50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1e32c41cb509305 server_cookie=9a4e498b2a460ea6 in_seq=0 out_seq=0 2024-09-10T21:14:59.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.849+0000 7f61a8ff9640 1 -- 172.21.15.59:0/4184994959 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56381b65b610 con 0x56381b703590 2024-09-10T21:14:59.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.849+0000 7f61a8ff9640 10 client.15228 handle_command_reply: tid=0 2024-09-10T21:14:59.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.849+0000 7f61cdc10740 1 client.15228 shutdown 2024-09-10T21:14:59.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.849+0000 7f61cdc10740 1 -- 172.21.15.59:0/4184994959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6e5d30 msgr2=0x56381b70d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:59.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.849+0000 7f61cdc10740 1 --2- 172.21.15.59:0/4184994959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6e5d30 0x56381b70d010 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f61b400ba20 tx=0x7f61b40b52a0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.849+0000 7f61cdc10740 1 -- 172.21.15.59:0/4184994959 shutdown_connections 2024-09-10T21:14:59.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.849+0000 7f61cdc10740 1 --2- 172.21.15.59:0/4184994959 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56381b703590 0x56381b773c50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.849+0000 7f61cdc10740 1 --2- 172.21.15.59:0/4184994959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56381b6f25e0 0x56381b707d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.849+0000 7f61cdc10740 1 --2- 172.21.15.59:0/4184994959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56381b6e6650 0x56381b70d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.849+0000 7f61cdc10740 1 --2- 172.21.15.59:0/4184994959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56381b6e5d30 0x56381b70d010 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.849+0000 7f61cdc10740 1 -- 172.21.15.59:0/4184994959 >> 172.21.15.59:0/4184994959 conn(0x56381b6e3b60 msgr2=0x56381b6f0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:59.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.849+0000 7f61a8ff9640 0 client.15228 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:14:59.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.849+0000 7f61cdc10740 1 -- 172.21.15.59:0/4184994959 shutdown_connections 2024-09-10T21:14:59.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.849+0000 7f61cdc10740 1 -- 172.21.15.59:0/4184994959 wait complete. 2024-09-10T21:14:59.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.849+0000 7f61cdc10740 20 client.15228 trim_cache size 0 max 16384 2024-09-10T21:14:59.863 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:14:59.863 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "3c26b952-6fb8-11ef-bcea-c7b262605968", 2024-09-10T21:14:59.863 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 4, 2024-09-10T21:14:59.863 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 24529, 2024-09-10T21:14:59.863 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-09-10T21:14:59.863 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-09-10T21:14:59.863 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-09-10T21:14:59.863 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 89.908474763000001, 2024-09-10T21:14:59.863 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 27, 2024-09-10T21:14:59.863 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 75, 2024-09-10T21:14:59.863 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T21:14:59.864 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 126.062944844 2024-09-10T21:14:59.864 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:14:59.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.850+0000 7f61cb83b640 1 -- 172.21.15.59:0/662668443 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f61ac0b5370 msgr2=0x7f61ac0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:59.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.850+0000 7f61cb83b640 1 --2- 172.21.15.59:0/662668443 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f61ac0b5370 0x7f61ac0b7830 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00aa40 tx=0x7f61bc0047d0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.850+0000 7f61cb83b640 1 -- 172.21.15.59:0/662668443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61c4101a90 msgr2=0x7f61c419fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:14:59.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.850+0000 7f61cb83b640 1 --2- 172.21.15.59:0/662668443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61c4101a90 0x7f61c419fa80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f61b400ba50 tx=0x7f61b400bf10 comp rx=0 tx=0).stop 2024-09-10T21:14:59.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.850+0000 7f61cb83b640 1 -- 172.21.15.59:0/662668443 shutdown_connections 2024-09-10T21:14:59.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.850+0000 7f61cb83b640 1 --2- 172.21.15.59:0/662668443 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f61ac0b5370 0x7f61ac0b7830 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.850+0000 7f61cb83b640 1 --2- 172.21.15.59:0/662668443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61c4106ed0 0x7f61c41a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.850+0000 7f61cb83b640 1 --2- 172.21.15.59:0/662668443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61c41023b0 0x7f61c419ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.850+0000 7f61cb83b640 1 --2- 172.21.15.59:0/662668443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61c4101a90 0x7f61c419fa80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:14:59.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.850+0000 7f61cb83b640 1 -- 172.21.15.59:0/662668443 >> 172.21.15.59:0/662668443 conn(0x7f61c40fd700 msgr2=0x7f61c4104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:14:59.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.850+0000 7f61cb83b640 1 -- 172.21.15.59:0/662668443 shutdown_connections 2024-09-10T21:14:59.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:14:59.850+0000 7f61cb83b640 1 -- 172.21.15.59:0/662668443 wait complete. 2024-09-10T21:15:00.817 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.c status 2024-09-10T21:15:01.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:00 smithi192 ceph-mon[35363]: pgmap v332: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:15:01.086 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:15:01.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:00 smithi059 ceph-mon[30888]: pgmap v332: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:15:01.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:00 smithi154 ceph-mon[35041]: pgmap v332: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:15:01.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.604+0000 7fd81a741640 1 -- 172.21.15.59:0/1409349202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8141076a0 msgr2=0x7fd814107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:01.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.604+0000 7fd81a741640 1 --2- 172.21.15.59:0/1409349202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8141076a0 0x7fd814107ae0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd808009900 tx=0x7fd80802a410 comp rx=0 tx=0).stop 2024-09-10T21:15:01.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.604+0000 7fd81a741640 1 -- 172.21.15.59:0/1409349202 shutdown_connections 2024-09-10T21:15:01.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.604+0000 7fd81a741640 1 --2- 172.21.15.59:0/1409349202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd814108020 0x7fd81410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.604+0000 7fd81a741640 1 --2- 172.21.15.59:0/1409349202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8141076a0 0x7fd814107ae0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.604+0000 7fd81a741640 1 --2- 172.21.15.59:0/1409349202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd814101c90 0x7fd814102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.604+0000 7fd81a741640 1 -- 172.21.15.59:0/1409349202 >> 172.21.15.59:0/1409349202 conn(0x7fd8140fd700 msgr2=0x7fd8140ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:01.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.604+0000 7fd81a741640 1 -- 172.21.15.59:0/1409349202 shutdown_connections 2024-09-10T21:15:01.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.604+0000 7fd81a741640 1 -- 172.21.15.59:0/1409349202 wait complete. 2024-09-10T21:15:01.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.605+0000 7fd81a741640 1 Processor -- start 2024-09-10T21:15:01.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.605+0000 7fd81a741640 1 -- start start 2024-09-10T21:15:01.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.605+0000 7fd81a741640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd814101c90 0x7fd8140fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:01.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.605+0000 7fd81a741640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8141076a0 0x7fd8140fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:01.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.605+0000 7fd81a741640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd814108020 0x7fd8140fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:01.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.605+0000 7fd81a741640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd814111d20 con 0x7fd814108020 2024-09-10T21:15:01.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.605+0000 7fd81a741640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd814111ba0 con 0x7fd8141076a0 2024-09-10T21:15:01.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.605+0000 7fd81a741640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd814111ea0 con 0x7fd814101c90 2024-09-10T21:15:01.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.606+0000 7fd818cde640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd814108020 0x7fd8140fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:01.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.606+0000 7fd818cde640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd814108020 0x7fd8140fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56100/0 (socket says 172.21.15.59:56100) 2024-09-10T21:15:01.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.606+0000 7fd818cde640 1 -- 172.21.15.59:0/1182972342 learned_addr learned my addr 172.21.15.59:0/1182972342 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:01.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.606+0000 7fd8137fe640 1 --2- 172.21.15.59:0/1182972342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8141076a0 0x7fd8140fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:01.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.606+0000 7fd813fff640 1 --2- 172.21.15.59:0/1182972342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd814101c90 0x7fd8140fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:01.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.606+0000 7fd818cde640 1 -- 172.21.15.59:0/1182972342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd814101c90 msgr2=0x7fd8140fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:01.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.606+0000 7fd818cde640 1 --2- 172.21.15.59:0/1182972342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd814101c90 0x7fd8140fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.606+0000 7fd818cde640 1 -- 172.21.15.59:0/1182972342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8141076a0 msgr2=0x7fd8140fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:01.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.606+0000 7fd818cde640 1 --2- 172.21.15.59:0/1182972342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8141076a0 0x7fd8140fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.606+0000 7fd818cde640 1 -- 172.21.15.59:0/1182972342 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8141a7840 con 0x7fd814108020 2024-09-10T21:15:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.606+0000 7fd8137fe640 1 --2- 172.21.15.59:0/1182972342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8141076a0 0x7fd8140fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:15:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.606+0000 7fd818cde640 1 --2- 172.21.15.59:0/1182972342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd814108020 0x7fd8140fe680 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00b970 tx=0x7fd80c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.606+0000 7fd8117fa640 1 -- 172.21.15.59:0/1182972342 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c019070 con 0x7fd814108020 2024-09-10T21:15:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.606+0000 7fd81a741640 1 -- 172.21.15.59:0/1182972342 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8141a7b30 con 0x7fd814108020 2024-09-10T21:15:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.606+0000 7fd8117fa640 1 -- 172.21.15.59:0/1182972342 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd80c014440 con 0x7fd814108020 2024-09-10T21:15:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.606+0000 7fd8117fa640 1 -- 172.21.15.59:0/1182972342 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c0075d0 con 0x7fd814108020 2024-09-10T21:15:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.606+0000 7fd81a741640 1 -- 172.21.15.59:0/1182972342 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8141a8040 con 0x7fd814108020 2024-09-10T21:15:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.609+0000 7fd8117fa640 1 -- 172.21.15.59:0/1182972342 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fd80c00cb40 con 0x7fd814108020 2024-09-10T21:15:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.609+0000 7fd81cb16740 1 Processor -- start 2024-09-10T21:15:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.609+0000 7fd81cb16740 1 -- start start 2024-09-10T21:15:01.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.609+0000 7fd81cb16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea882d30 0x55b5ea883110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:01.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.609+0000 7fd81cb16740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5ea883650 0x55b5ea88f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:01.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.609+0000 7fd81cb16740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea88f5e0 0x55b5ea8919d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:01.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.609+0000 7fd81cb16740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b5ea7fac10 con 0x55b5ea88f5e0 2024-09-10T21:15:01.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.609+0000 7fd81cb16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b5ea7ea040 con 0x55b5ea882d30 2024-09-10T21:15:01.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.609+0000 7fd81cb16740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b5ea7ede50 con 0x55b5ea883650 2024-09-10T21:15:01.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.610+0000 7fd8117fa640 1 --2- 172.21.15.59:0/1182972342 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd7fc0b5370 0x7fd7fc0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:01.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.610+0000 7fd8137fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea88f5e0 0x55b5ea8919d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:01.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.610+0000 7fd8137fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea88f5e0 0x55b5ea8919d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56102/0 (socket says 172.21.15.59:56102) 2024-09-10T21:15:01.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.610+0000 7fd8137fe640 1 -- 172.21.15.59:0/4010129363 learned_addr learned my addr 172.21.15.59:0/4010129363 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:01.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.610+0000 7fd8137fe640 1 --2- 172.21.15.59:0/4010129363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea882d30 0x55b5ea883110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:01.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.610+0000 7fd818cde640 1 --2- 172.21.15.59:0/1182972342 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd7fc0b5370 0x7fd7fc0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:01.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.610+0000 7fd813fff640 1 --2- 172.21.15.59:0/4010129363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5ea883650 0x55b5ea88f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:01.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.610+0000 7fd8117fa640 1 -- 172.21.15.59:0/1182972342 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd80c0e5560 con 0x7fd814108020 2024-09-10T21:15:01.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.610+0000 7fd8137fe640 1 -- 172.21.15.59:0/4010129363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5ea883650 msgr2=0x55b5ea88f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:01.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.610+0000 7fd8137fe640 1 --2- 172.21.15.59:0/4010129363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5ea883650 0x55b5ea88f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.610+0000 7fd8137fe640 1 -- 172.21.15.59:0/4010129363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea882d30 msgr2=0x55b5ea883110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:01.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.610+0000 7fd8137fe640 1 --2- 172.21.15.59:0/4010129363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea882d30 0x55b5ea883110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.610+0000 7fd8137fe640 1 -- 172.21.15.59:0/4010129363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5ea548540 con 0x55b5ea88f5e0 2024-09-10T21:15:01.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.610+0000 7fd818cde640 1 --2- 172.21.15.59:0/1182972342 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd7fc0b5370 0x7fd7fc0b7830 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0a81c0 tx=0x7fd80c0a61b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:01.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.610+0000 7fd8137fe640 1 --2- 172.21.15.59:0/4010129363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea88f5e0 0x55b5ea8919d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd80802a930 tx=0x7fd8080058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870ad26992cf250f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:01.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.610+0000 7fd7fa7fc640 1 -- 172.21.15.59:0/4010129363 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd808035040 con 0x55b5ea88f5e0 2024-09-10T21:15:01.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.610+0000 7fd7fa7fc640 1 -- 172.21.15.59:0/4010129363 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8080054d0 con 0x55b5ea88f5e0 2024-09-10T21:15:01.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.610+0000 7fd7fa7fc640 1 -- 172.21.15.59:0/4010129363 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8080049e0 con 0x55b5ea88f5e0 2024-09-10T21:15:01.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.611+0000 7fd81cb16740 1 -- 172.21.15.59:0/4010129363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea88f5e0 msgr2=0x55b5ea8919d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:01.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.611+0000 7fd81cb16740 1 --2- 172.21.15.59:0/4010129363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea88f5e0 0x55b5ea8919d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd80802a930 tx=0x7fd8080058d0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.611+0000 7fd81cb16740 1 -- 172.21.15.59:0/4010129363 shutdown_connections 2024-09-10T21:15:01.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.611+0000 7fd81cb16740 1 --2- 172.21.15.59:0/4010129363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea88f5e0 0x55b5ea8919d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.611+0000 7fd81cb16740 1 --2- 172.21.15.59:0/4010129363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5ea883650 0x55b5ea88f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.611+0000 7fd81cb16740 1 --2- 172.21.15.59:0/4010129363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea882d30 0x55b5ea883110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.611+0000 7fd81cb16740 1 -- 172.21.15.59:0/4010129363 >> 172.21.15.59:0/4010129363 conn(0x55b5ea880b60 msgr2=0x55b5ea881d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:01.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.611+0000 7fd81cb16740 1 -- 172.21.15.59:0/4010129363 shutdown_connections 2024-09-10T21:15:01.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.611+0000 7fd81cb16740 1 -- 172.21.15.59:0/4010129363 wait complete. 2024-09-10T21:15:01.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.612+0000 7fd81cb16740 1 -- start start 2024-09-10T21:15:01.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.612+0000 7fd81cb16740 1 Processor -- start 2024-09-10T21:15:01.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.612+0000 7fd81cb16740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5ea882d30 0x55b5ea88c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:01.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.612+0000 7fd81cb16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea883650 0x55b5ea88cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:01.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.612+0000 7fd81cb16740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea88f5e0 0x55b5ea88d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:01.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.612+0000 7fd81cb16740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b5ea64b5f0 con 0x55b5ea88f5e0 2024-09-10T21:15:01.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.612+0000 7fd81cb16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b5ea785010 con 0x55b5ea883650 2024-09-10T21:15:01.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.612+0000 7fd81cb16740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b5ea892230 con 0x55b5ea882d30 2024-09-10T21:15:01.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.612+0000 7fd81cb16740 10 client.0 _ll_register_callbacks cb 0x55b5ea7e4340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:15:01.659 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:15:01.659 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "3c26b952-6fb8-11ef-bcea-c7b262605968", 2024-09-10T21:15:01.659 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 3, 2024-09-10T21:15:01.659 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 24538, 2024-09-10T21:15:01.659 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-09-10T21:15:01.659 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-09-10T21:15:01.659 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-09-10T21:15:01.659 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 92.705247736999993, 2024-09-10T21:15:01.659 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 27, 2024-09-10T21:15:01.660 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 75, 2024-09-10T21:15:01.660 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T21:15:01.660 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 125.44842365700001 2024-09-10T21:15:01.660 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:15:01.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.612+0000 7fd8137fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea88f5e0 0x55b5ea88d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:01.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.612+0000 7fd8137fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea88f5e0 0x55b5ea88d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56104/0 (socket says 172.21.15.59:56104) 2024-09-10T21:15:01.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.612+0000 7fd8137fe640 1 -- 172.21.15.59:0/228841004 learned_addr learned my addr 172.21.15.59:0/228841004 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:01.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.612+0000 7fd813fff640 1 --2- 172.21.15.59:0/228841004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea883650 0x55b5ea88cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:01.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.613+0000 7fd8137fe640 1 -- 172.21.15.59:0/228841004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5ea882d30 msgr2=0x55b5ea88c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:01.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.613+0000 7fd8137fe640 1 --2- 172.21.15.59:0/228841004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5ea882d30 0x55b5ea88c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.613+0000 7fd8137fe640 1 -- 172.21.15.59:0/228841004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea883650 msgr2=0x55b5ea88cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:01.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.613+0000 7fd8137fe640 1 --2- 172.21.15.59:0/228841004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea883650 0x55b5ea88cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.613+0000 7fd8137fe640 1 -- 172.21.15.59:0/228841004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5ea7b2a00 con 0x55b5ea88f5e0 2024-09-10T21:15:01.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.613+0000 7fd8137fe640 1 --2- 172.21.15.59:0/228841004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea88f5e0 0x55b5ea88d020 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd80802a450 tx=0x7fd808032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc4d08005977fe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:01.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.613+0000 7fd7f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:15:01.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.613+0000 7fd7f37fe640 1 -- 172.21.15.59:0/228841004 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd808050020 con 0x55b5ea88f5e0 2024-09-10T21:15:01.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.613+0000 7fd7f37fe640 1 -- 172.21.15.59:0/228841004 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd808005680 con 0x55b5ea88f5e0 2024-09-10T21:15:01.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.613+0000 7fd81cb16740 1 -- 172.21.15.59:0/228841004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8080054d0 con 0x55b5ea88f5e0 2024-09-10T21:15:01.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.613+0000 7fd7f37fe640 1 -- 172.21.15.59:0/228841004 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd808035070 con 0x55b5ea88f5e0 2024-09-10T21:15:01.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.613+0000 7fd81cb16740 10 client.15240 fetch_fsmap learned FSMap version 27 2024-09-10T21:15:01.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.613+0000 7fd81cb16740 1 -- 172.21.15.59:0/228841004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b5ea89de20 con 0x55b5ea88f5e0 2024-09-10T21:15:01.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.613+0000 7fd7f37fe640 1 -- 172.21.15.59:0/228841004 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8080054d0 con 0x55b5ea88f5e0 2024-09-10T21:15:01.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.613+0000 7fd7f37fe640 1 -- 172.21.15.59:0/228841004 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd80803a040 con 0x55b5ea88f5e0 2024-09-10T21:15:01.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.613+0000 7fd81cb16740 10 client.15240 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:15:01.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.614+0000 7fd81cb16740 10 client.15240 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T21:15:01.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.614+0000 7fd81cb16740 20 client.15240 populate_metadata read hostname 'smithi059' 2024-09-10T21:15:01.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.614+0000 7fd81cb16740 1 --2- 172.21.15.59:0/228841004 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55b5ea89ff40 0x55b5ea8a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:01.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.614+0000 7fd81cb16740 4 client.15240 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:15:01.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.614+0000 7fd81cb16740 1 -- 172.21.15.59:0/228841004 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5ea7fcb60 con 0x55b5ea89ff40 2024-09-10T21:15:01.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.614+0000 7fd813fff640 1 --2- 172.21.15.59:0/228841004 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55b5ea89ff40 0x55b5ea8a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:01.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.614+0000 7fd813fff640 1 --2- 172.21.15.59:0/228841004 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55b5ea89ff40 0x55b5ea8a13b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a5b1bcb458f35f2e server_cookie=ed600b25c37b2ef6 in_seq=0 out_seq=0 2024-09-10T21:15:01.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.614+0000 7fd7f37fe640 10 client.15240 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:15:01.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.615+0000 7fd7f37fe640 1 -- 172.21.15.59:0/228841004 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b5ea7fcb60 con 0x55b5ea89ff40 2024-09-10T21:15:01.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.615+0000 7fd7f37fe640 10 client.15240 handle_command_reply: tid=0 2024-09-10T21:15:01.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.615+0000 7fd81cb16740 1 client.15240 shutdown 2024-09-10T21:15:01.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.615+0000 7fd81cb16740 1 -- 172.21.15.59:0/228841004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea88f5e0 msgr2=0x55b5ea88d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:01.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.615+0000 7fd81cb16740 1 --2- 172.21.15.59:0/228841004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea88f5e0 0x55b5ea88d020 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd80802a450 tx=0x7fd808032d30 comp rx=0 tx=0).stop 2024-09-10T21:15:01.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.615+0000 7fd81cb16740 1 -- 172.21.15.59:0/228841004 shutdown_connections 2024-09-10T21:15:01.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.615+0000 7fd81cb16740 1 --2- 172.21.15.59:0/228841004 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55b5ea89ff40 0x55b5ea8a13b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.615+0000 7fd81cb16740 1 --2- 172.21.15.59:0/228841004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea88f5e0 0x55b5ea88d020 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.615+0000 7fd81cb16740 1 --2- 172.21.15.59:0/228841004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea883650 0x55b5ea88cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.615+0000 7fd7f37fe640 0 client.15240 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:15:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.615+0000 7fd81cb16740 1 --2- 172.21.15.59:0/228841004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5ea882d30 0x55b5ea88c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.615+0000 7fd81cb16740 1 -- 172.21.15.59:0/228841004 >> 172.21.15.59:0/228841004 conn(0x55b5ea880b60 msgr2=0x55b5ea886700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.615+0000 7fd81cb16740 1 -- 172.21.15.59:0/228841004 shutdown_connections 2024-09-10T21:15:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.615+0000 7fd81cb16740 1 -- 172.21.15.59:0/228841004 wait complete. 2024-09-10T21:15:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.615+0000 7fd81cb16740 20 client.15240 trim_cache size 0 max 16384 2024-09-10T21:15:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.633+0000 7fd81cb16740 1 Processor -- start 2024-09-10T21:15:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.633+0000 7fd81cb16740 1 -- start start 2024-09-10T21:15:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd81cb16740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea882d30 0x55b5ea8a0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:01.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd81cb16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea883650 0x55b5ea886ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:01.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd81cb16740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5ea88f5e0 0x55b5ea8822c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:01.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd81cb16740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b5ea89f6f0 con 0x55b5ea882d30 2024-09-10T21:15:01.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd81cb16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b5ea89fdc0 con 0x55b5ea883650 2024-09-10T21:15:01.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd81cb16740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b5ea8a0490 con 0x55b5ea88f5e0 2024-09-10T21:15:01.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd8137fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea882d30 0x55b5ea8a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:01.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd8137fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea882d30 0x55b5ea8a0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56120/0 (socket says 172.21.15.59:56120) 2024-09-10T21:15:01.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd8137fe640 1 -- 172.21.15.59:0/1249262287 learned_addr learned my addr 172.21.15.59:0/1249262287 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:01.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd813fff640 1 --2- 172.21.15.59:0/1249262287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea883650 0x55b5ea886ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:01.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd8137fe640 1 -- 172.21.15.59:0/1249262287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5ea88f5e0 msgr2=0x55b5ea8822c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:01.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd8137fe640 1 --2- 172.21.15.59:0/1249262287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5ea88f5e0 0x55b5ea8822c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd8137fe640 1 -- 172.21.15.59:0/1249262287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea883650 msgr2=0x55b5ea886ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:01.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd8137fe640 1 --2- 172.21.15.59:0/1249262287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea883650 0x55b5ea886ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd8137fe640 1 -- 172.21.15.59:0/1249262287 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5ea8815e0 con 0x55b5ea882d30 2024-09-10T21:15:01.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd813fff640 1 --2- 172.21.15.59:0/1249262287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea883650 0x55b5ea886ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:15:01.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd8137fe640 1 --2- 172.21.15.59:0/1249262287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea882d30 0x55b5ea8a0610 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd808059040 tx=0x7fd808031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cda10d30da5874c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:01.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd7f9ffb640 1 -- 172.21.15.59:0/1249262287 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd808050070 con 0x55b5ea882d30 2024-09-10T21:15:01.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd7f9ffb640 1 -- 172.21.15.59:0/1249262287 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8080049b0 con 0x55b5ea882d30 2024-09-10T21:15:01.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.634+0000 7fd7f9ffb640 1 -- 172.21.15.59:0/1249262287 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80803d6e0 con 0x55b5ea882d30 2024-09-10T21:15:01.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.635+0000 7fd81cb16740 1 -- 172.21.15.59:0/1249262287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea882d30 msgr2=0x55b5ea8a0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:01.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.635+0000 7fd81cb16740 1 --2- 172.21.15.59:0/1249262287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea882d30 0x55b5ea8a0610 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd808059040 tx=0x7fd808031400 comp rx=0 tx=0).stop 2024-09-10T21:15:01.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.635+0000 7fd81cb16740 1 -- 172.21.15.59:0/1249262287 shutdown_connections 2024-09-10T21:15:01.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.635+0000 7fd81cb16740 1 --2- 172.21.15.59:0/1249262287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5ea88f5e0 0x55b5ea8822c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.635+0000 7fd81cb16740 1 --2- 172.21.15.59:0/1249262287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea883650 0x55b5ea886ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.635+0000 7fd81cb16740 1 --2- 172.21.15.59:0/1249262287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea882d30 0x55b5ea8a0610 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.635+0000 7fd81cb16740 1 -- 172.21.15.59:0/1249262287 >> 172.21.15.59:0/1249262287 conn(0x55b5ea880b60 msgr2=0x55b5ea881bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:01.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.635+0000 7fd81cb16740 1 -- 172.21.15.59:0/1249262287 shutdown_connections 2024-09-10T21:15:01.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.635+0000 7fd81cb16740 1 -- 172.21.15.59:0/1249262287 wait complete. 2024-09-10T21:15:01.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.635+0000 7fd81cb16740 1 -- start start 2024-09-10T21:15:01.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.636+0000 7fd81cb16740 1 Processor -- start 2024-09-10T21:15:01.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.636+0000 7fd81cb16740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea882d30 0x55b5ea8a3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:01.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.636+0000 7fd81cb16740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5ea883650 0x55b5ea8a3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:01.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.636+0000 7fd81cb16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea88f5e0 0x55b5ea8a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:01.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.636+0000 7fd81cb16740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b5ea8a1230 con 0x55b5ea882d30 2024-09-10T21:15:01.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.636+0000 7fd81cb16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b5ea8a0b60 con 0x55b5ea88f5e0 2024-09-10T21:15:01.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.636+0000 7fd81cb16740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b5ea8a1900 con 0x55b5ea883650 2024-09-10T21:15:01.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.636+0000 7fd81cb16740 10 client.0 _ll_register_callbacks cb 0x7fd808032f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:15:01.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.636+0000 7fd8137fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea882d30 0x55b5ea8a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:01.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.636+0000 7fd8137fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea882d30 0x55b5ea8a3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56122/0 (socket says 172.21.15.59:56122) 2024-09-10T21:15:01.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.636+0000 7fd8137fe640 1 -- 172.21.15.59:0/1262202576 learned_addr learned my addr 172.21.15.59:0/1262202576 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:01.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.636+0000 7fd813fff640 1 --2- 172.21.15.59:0/1262202576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5ea883650 0x55b5ea8a3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:01.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.636+0000 7fd8137fe640 1 -- 172.21.15.59:0/1262202576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5ea883650 msgr2=0x55b5ea8a3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:01.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.636+0000 7fd8137fe640 1 --2- 172.21.15.59:0/1262202576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5ea883650 0x55b5ea8a3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.636+0000 7fd8137fe640 1 -- 172.21.15.59:0/1262202576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea88f5e0 msgr2=0x55b5ea8a90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:01.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.636+0000 7fd8137fe640 1 --2- 172.21.15.59:0/1262202576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea88f5e0 0x55b5ea8a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.636+0000 7fd8137fe640 1 -- 172.21.15.59:0/1262202576 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5ea8a9610 con 0x55b5ea882d30 2024-09-10T21:15:01.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.636+0000 7fd8137fe640 1 --2- 172.21.15.59:0/1262202576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea882d30 0x55b5ea8a3940 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd80803dd40 tx=0x7fd808032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0aeb446f8e6d92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:01.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.636+0000 7fd7f37fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:15:01.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.637+0000 7fd7f37fe640 1 -- 172.21.15.59:0/1262202576 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd808050040 con 0x55b5ea882d30 2024-09-10T21:15:01.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.637+0000 7fd7f37fe640 1 -- 172.21.15.59:0/1262202576 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd80803d480 con 0x55b5ea882d30 2024-09-10T21:15:01.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.637+0000 7fd81cb16740 1 -- 172.21.15.59:0/1262202576 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8080049b0 con 0x55b5ea882d30 2024-09-10T21:15:01.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.637+0000 7fd7f37fe640 1 -- 172.21.15.59:0/1262202576 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd80803d680 con 0x55b5ea882d30 2024-09-10T21:15:01.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.637+0000 7fd81cb16740 10 client.15246 fetch_fsmap learned FSMap version 27 2024-09-10T21:15:01.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.637+0000 7fd81cb16740 1 -- 172.21.15.59:0/1262202576 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b5ea8a9610 con 0x55b5ea882d30 2024-09-10T21:15:01.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.637+0000 7fd7f37fe640 1 -- 172.21.15.59:0/1262202576 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8080049b0 con 0x55b5ea882d30 2024-09-10T21:15:01.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.637+0000 7fd7f37fe640 1 -- 172.21.15.59:0/1262202576 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd80806d030 con 0x55b5ea882d30 2024-09-10T21:15:01.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.637+0000 7fd81cb16740 10 client.15246 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:15:01.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.637+0000 7fd81cb16740 10 client.15246 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T21:15:01.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.637+0000 7fd81cb16740 20 client.15246 populate_metadata read hostname 'smithi059' 2024-09-10T21:15:01.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.637+0000 7fd81cb16740 1 --2- 172.21.15.59:0/1262202576 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55b5ea911260 0x55b5ea90ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:01.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.637+0000 7fd81cb16740 4 client.15246 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:15:01.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.637+0000 7fd81cb16740 1 -- 172.21.15.59:0/1262202576 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "status"}) -- 0x55b5ea7f8610 con 0x55b5ea911260 2024-09-10T21:15:01.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.638+0000 7fd813fff640 1 --2- 172.21.15.59:0/1262202576 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55b5ea911260 0x55b5ea90ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:01.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.638+0000 7fd813fff640 1 --2- 172.21.15.59:0/1262202576 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55b5ea911260 0x55b5ea90ff70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=432fa95c4f72541b server_cookie=8d0403ab510c2e44 in_seq=0 out_seq=0 2024-09-10T21:15:01.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.638+0000 7fd7f37fe640 10 client.15246 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:15:01.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.638+0000 7fd7f37fe640 1 -- 172.21.15.59:0/1262202576 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b5ea7f8610 con 0x55b5ea911260 2024-09-10T21:15:01.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.638+0000 7fd7f37fe640 10 client.15246 handle_command_reply: tid=0 2024-09-10T21:15:01.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.638+0000 7fd81cb16740 1 client.15246 shutdown 2024-09-10T21:15:01.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.638+0000 7fd81cb16740 1 -- 172.21.15.59:0/1262202576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea882d30 msgr2=0x55b5ea8a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:01.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.638+0000 7fd81cb16740 1 --2- 172.21.15.59:0/1262202576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea882d30 0x55b5ea8a3940 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd80803dd40 tx=0x7fd808032d00 comp rx=0 tx=0).stop 2024-09-10T21:15:01.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.639+0000 7fd81cb16740 1 -- 172.21.15.59:0/1262202576 shutdown_connections 2024-09-10T21:15:01.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.639+0000 7fd81cb16740 1 --2- 172.21.15.59:0/1262202576 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55b5ea911260 0x55b5ea90ff70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.639+0000 7fd81cb16740 1 --2- 172.21.15.59:0/1262202576 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b5ea88f5e0 0x55b5ea8a90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.639+0000 7fd81cb16740 1 --2- 172.21.15.59:0/1262202576 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b5ea883650 0x55b5ea8a3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.639+0000 7fd81cb16740 1 --2- 172.21.15.59:0/1262202576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5ea882d30 0x55b5ea8a3940 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.639+0000 7fd7f37fe640 0 client.15246 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:15:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.639+0000 7fd81cb16740 1 -- 172.21.15.59:0/1262202576 >> 172.21.15.59:0/1262202576 conn(0x55b5ea880b60 msgr2=0x55b5ea88dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.639+0000 7fd81cb16740 1 -- 172.21.15.59:0/1262202576 shutdown_connections 2024-09-10T21:15:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.639+0000 7fd81cb16740 1 -- 172.21.15.59:0/1262202576 wait complete. 2024-09-10T21:15:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.639+0000 7fd81cb16740 20 client.15246 trim_cache size 0 max 16384 2024-09-10T21:15:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.639+0000 7fd81a741640 1 -- 172.21.15.59:0/1182972342 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd7fc0b5370 msgr2=0x7fd7fc0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.639+0000 7fd81a741640 1 --2- 172.21.15.59:0/1182972342 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd7fc0b5370 0x7fd7fc0b7830 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0a81c0 tx=0x7fd80c0a61b0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.639+0000 7fd81a741640 1 -- 172.21.15.59:0/1182972342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd814108020 msgr2=0x7fd8140fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.639+0000 7fd81a741640 1 --2- 172.21.15.59:0/1182972342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd814108020 0x7fd8140fe680 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd80c00b970 tx=0x7fd80c00be30 comp rx=0 tx=0).stop 2024-09-10T21:15:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.639+0000 7fd81a741640 1 -- 172.21.15.59:0/1182972342 shutdown_connections 2024-09-10T21:15:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.639+0000 7fd81a741640 1 --2- 172.21.15.59:0/1182972342 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd7fc0b5370 0x7fd7fc0b7830 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.639+0000 7fd81a741640 1 --2- 172.21.15.59:0/1182972342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd814108020 0x7fd8140fe680 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.639+0000 7fd81a741640 1 --2- 172.21.15.59:0/1182972342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8141076a0 0x7fd8140fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.639+0000 7fd81a741640 1 --2- 172.21.15.59:0/1182972342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd814101c90 0x7fd8140fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:01.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.640+0000 7fd81a741640 1 -- 172.21.15.59:0/1182972342 >> 172.21.15.59:0/1182972342 conn(0x7fd8140fd700 msgr2=0x7fd81406ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:01.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.640+0000 7fd81a741640 1 -- 172.21.15.59:0/1182972342 shutdown_connections 2024-09-10T21:15:01.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:01.640+0000 7fd81a741640 1 -- 172.21.15.59:0/1182972342 wait complete. 2024-09-10T21:15:02.452 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T21:15:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:15:02.985 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:02 smithi059 ceph-mon[30888]: pgmap v333: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:15:03.078 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:02 smithi192 ceph-mon[35363]: pgmap v333: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:15:03.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:02 smithi154 ceph-mon[35041]: pgmap v333: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:15:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.181+0000 7f0c4be0a640 1 -- 172.21.15.59:0/302476584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c44075540 msgr2=0x7f0c44075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.181+0000 7f0c4be0a640 1 --2- 172.21.15.59:0/302476584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c44075540 0x7f0c44075920 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0c40009900 tx=0x7f0c4002a410 comp rx=0 tx=0).stop 2024-09-10T21:15:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.181+0000 7f0c4be0a640 1 -- 172.21.15.59:0/302476584 shutdown_connections 2024-09-10T21:15:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.181+0000 7f0c4be0a640 1 --2- 172.21.15.59:0/302476584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c44113b20 0x7f0c44115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.181+0000 7f0c4be0a640 1 --2- 172.21.15.59:0/302476584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c44075e60 0x7f0c441135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.181+0000 7f0c4be0a640 1 --2- 172.21.15.59:0/302476584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c44075540 0x7f0c44075920 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.181+0000 7f0c4be0a640 1 -- 172.21.15.59:0/302476584 >> 172.21.15.59:0/302476584 conn(0x7f0c440fe830 msgr2=0x7f0c44100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.181+0000 7f0c4be0a640 1 -- 172.21.15.59:0/302476584 shutdown_connections 2024-09-10T21:15:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.181+0000 7f0c4be0a640 1 -- 172.21.15.59:0/302476584 wait complete. 2024-09-10T21:15:03.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.182+0000 7f0c4be0a640 1 Processor -- start 2024-09-10T21:15:03.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.182+0000 7f0c4be0a640 1 -- start start 2024-09-10T21:15:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.182+0000 7f0c4be0a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c44075540 0x7f0c4419f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.182+0000 7f0c4be0a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c44075e60 0x7f0c4419fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.182+0000 7f0c4be0a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c44113b20 0x7f0c441a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.182+0000 7f0c4be0a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0c441193a0 con 0x7f0c44075e60 2024-09-10T21:15:03.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.182+0000 7f0c4be0a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0c44119220 con 0x7f0c44075540 2024-09-10T21:15:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.182+0000 7f0c4be0a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0c44119520 con 0x7f0c44113b20 2024-09-10T21:15:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.182+0000 7f0c493a5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c44075e60 0x7f0c4419fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.182+0000 7f0c493a5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c44075e60 0x7f0c4419fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56146/0 (socket says 172.21.15.59:56146) 2024-09-10T21:15:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.182+0000 7f0c493a5640 1 -- 172.21.15.59:0/2672854385 learned_addr learned my addr 172.21.15.59:0/2672854385 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.183+0000 7f0c49ba6640 1 --2- 172.21.15.59:0/2672854385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c44075540 0x7f0c4419f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.183+0000 7f0c4a3a7640 1 --2- 172.21.15.59:0/2672854385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c44113b20 0x7f0c441a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.183+0000 7f0c493a5640 1 -- 172.21.15.59:0/2672854385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c44113b20 msgr2=0x7f0c441a51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.183+0000 7f0c493a5640 1 --2- 172.21.15.59:0/2672854385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c44113b20 0x7f0c441a51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.183+0000 7f0c493a5640 1 -- 172.21.15.59:0/2672854385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c44075540 msgr2=0x7f0c4419f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.183+0000 7f0c493a5640 1 --2- 172.21.15.59:0/2672854385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c44075540 0x7f0c4419f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.183+0000 7f0c493a5640 1 -- 172.21.15.59:0/2672854385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c441a59a0 con 0x7f0c44075e60 2024-09-10T21:15:03.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.183+0000 7f0c4a3a7640 1 --2- 172.21.15.59:0/2672854385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c44113b20 0x7f0c441a51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:15:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.183+0000 7f0c493a5640 1 --2- 172.21.15.59:0/2672854385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c44075e60 0x7f0c4419fe30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400c890 tx=0x7f0c3400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.183+0000 7f0c3affd640 1 -- 172.21.15.59:0/2672854385 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c34004220 con 0x7f0c44075e60 2024-09-10T21:15:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.183+0000 7f0c4be0a640 1 -- 172.21.15.59:0/2672854385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c441a5c90 con 0x7f0c44075e60 2024-09-10T21:15:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.183+0000 7f0c3affd640 1 -- 172.21.15.59:0/2672854385 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c340043c0 con 0x7f0c44075e60 2024-09-10T21:15:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.183+0000 7f0c3affd640 1 -- 172.21.15.59:0/2672854385 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c34004a00 con 0x7f0c44075e60 2024-09-10T21:15:03.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.183+0000 7f0c4be0a640 1 -- 172.21.15.59:0/2672854385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c441ac350 con 0x7f0c44075e60 2024-09-10T21:15:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.186+0000 7f0c4e1df740 1 Processor -- start 2024-09-10T21:15:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.186+0000 7f0c4e1df740 1 -- start start 2024-09-10T21:15:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.186+0000 7f0c3affd640 1 -- 172.21.15.59:0/2672854385 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f0c340079b0 con 0x7f0c44075e60 2024-09-10T21:15:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.186+0000 7f0c4e1df740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a31d30 0x55abc0a32110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.186+0000 7f0c4e1df740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a32650 0x55abc0a3e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.186+0000 7f0c4e1df740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55abc0a3e5e0 0x55abc0a409d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.186+0000 7f0c4e1df740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55abc09a9c10 con 0x55abc0a32650 2024-09-10T21:15:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.186+0000 7f0c4e1df740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55abc0999040 con 0x55abc0a3e5e0 2024-09-10T21:15:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.186+0000 7f0c4e1df740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55abc099ce50 con 0x55abc0a31d30 2024-09-10T21:15:03.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.186+0000 7f0c49ba6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a32650 0x55abc0a3e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.186+0000 7f0c49ba6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a32650 0x55abc0a3e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56150/0 (socket says 172.21.15.59:56150) 2024-09-10T21:15:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.186+0000 7f0c49ba6640 1 -- 172.21.15.59:0/2593042574 learned_addr learned my addr 172.21.15.59:0/2593042574 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.186+0000 7f0c4a3a7640 1 --2- 172.21.15.59:0/2593042574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a31d30 0x55abc0a32110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.187+0000 7f0c493a5640 1 --2- 172.21.15.59:0/2593042574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55abc0a3e5e0 0x55abc0a409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.187+0000 7f0c49ba6640 1 -- 172.21.15.59:0/2593042574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a31d30 msgr2=0x55abc0a32110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.187+0000 7f0c49ba6640 1 --2- 172.21.15.59:0/2593042574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a31d30 0x55abc0a32110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.187+0000 7f0c49ba6640 1 -- 172.21.15.59:0/2593042574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55abc0a3e5e0 msgr2=0x55abc0a409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.187+0000 7f0c49ba6640 1 --2- 172.21.15.59:0/2593042574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55abc0a3e5e0 0x55abc0a409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.187+0000 7f0c49ba6640 1 -- 172.21.15.59:0/2593042574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abc06f7540 con 0x55abc0a32650 2024-09-10T21:15:03.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.187+0000 7f0c49ba6640 1 --2- 172.21.15.59:0/2593042574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a32650 0x55abc0a3e0a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0c40033000 tx=0x7f0c40032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a744fa64261445ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:03.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.187+0000 7f0c2ffff640 1 -- 172.21.15.59:0/2593042574 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c40035040 con 0x55abc0a32650 2024-09-10T21:15:03.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.187+0000 7f0c2ffff640 1 -- 172.21.15.59:0/2593042574 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c400316a0 con 0x55abc0a32650 2024-09-10T21:15:03.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.187+0000 7f0c2ffff640 1 -- 172.21.15.59:0/2593042574 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c40004750 con 0x55abc0a32650 2024-09-10T21:15:03.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.187+0000 7f0c3affd640 1 --2- 172.21.15.59:0/2672854385 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0c300b5370 0x7f0c300b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:03.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.188+0000 7f0c4a3a7640 1 --2- 172.21.15.59:0/2672854385 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0c300b5370 0x7f0c300b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:03.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.188+0000 7f0c3affd640 1 -- 172.21.15.59:0/2672854385 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0c340e5ad0 con 0x7f0c44075e60 2024-09-10T21:15:03.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.188+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2593042574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a32650 msgr2=0x55abc0a3e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:03.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.188+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/2593042574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a32650 0x55abc0a3e0a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0c40033000 tx=0x7f0c40032e60 comp rx=0 tx=0).stop 2024-09-10T21:15:03.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.188+0000 7f0c4a3a7640 1 --2- 172.21.15.59:0/2672854385 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0c300b5370 0x7f0c300b7830 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0c4406c510 tx=0x7f0c3c009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.188+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2593042574 shutdown_connections 2024-09-10T21:15:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.188+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/2593042574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55abc0a3e5e0 0x55abc0a409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.188+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/2593042574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a32650 0x55abc0a3e0a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.188+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/2593042574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a31d30 0x55abc0a32110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.188+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2593042574 >> 172.21.15.59:0/2593042574 conn(0x55abc0a2fb60 msgr2=0x55abc0a30d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.188+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2593042574 shutdown_connections 2024-09-10T21:15:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.188+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2593042574 wait complete. 2024-09-10T21:15:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.188+0000 7f0c4e1df740 1 -- start start 2024-09-10T21:15:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.189+0000 7f0c4e1df740 1 Processor -- start 2024-09-10T21:15:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.189+0000 7f0c4e1df740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a31d30 0x55abc0a3b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.189+0000 7f0c4e1df740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a32650 0x55abc0a3bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.189+0000 7f0c4e1df740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55abc0a3e5e0 0x55abc0a3c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:03.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.189+0000 7f0c4e1df740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55abc07fa5f0 con 0x55abc0a32650 2024-09-10T21:15:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.189+0000 7f0c4e1df740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55abc0934010 con 0x55abc0a3e5e0 2024-09-10T21:15:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.189+0000 7f0c4e1df740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55abc0a41230 con 0x55abc0a31d30 2024-09-10T21:15:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.189+0000 7f0c4e1df740 10 client.0 _ll_register_callbacks cb 0x55abc0993340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:15:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.189+0000 7f0c493a5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a32650 0x55abc0a3bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.189+0000 7f0c493a5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a32650 0x55abc0a3bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56158/0 (socket says 172.21.15.59:56158) 2024-09-10T21:15:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.189+0000 7f0c493a5640 1 -- 172.21.15.59:0/2322498522 learned_addr learned my addr 172.21.15.59:0/2322498522 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.189+0000 7f0c4a3a7640 1 --2- 172.21.15.59:0/2322498522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55abc0a3e5e0 0x55abc0a3c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.189+0000 7f0c49ba6640 1 --2- 172.21.15.59:0/2322498522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a31d30 0x55abc0a3b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.189+0000 7f0c493a5640 1 -- 172.21.15.59:0/2322498522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a31d30 msgr2=0x55abc0a3b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.189+0000 7f0c493a5640 1 --2- 172.21.15.59:0/2322498522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a31d30 0x55abc0a3b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.189+0000 7f0c493a5640 1 -- 172.21.15.59:0/2322498522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55abc0a3e5e0 msgr2=0x55abc0a3c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.189+0000 7f0c493a5640 1 --2- 172.21.15.59:0/2322498522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55abc0a3e5e0 0x55abc0a3c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.189+0000 7f0c493a5640 1 -- 172.21.15.59:0/2322498522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abc0961a00 con 0x55abc0a32650 2024-09-10T21:15:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.189+0000 7f0c4a3a7640 1 --2- 172.21.15.59:0/2322498522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55abc0a3e5e0 0x55abc0a3c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:15:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.190+0000 7f0c493a5640 1 --2- 172.21.15.59:0/2322498522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a32650 0x55abc0a3bac0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0c34005fd0 tx=0x7f0c340a88a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967881afa934f2c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.190+0000 7f0c2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:15:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.190+0000 7f0c2d7fa640 1 -- 172.21.15.59:0/2322498522 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3401d040 con 0x55abc0a32650 2024-09-10T21:15:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.190+0000 7f0c2d7fa640 1 -- 172.21.15.59:0/2322498522 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0c340cf0d0 con 0x55abc0a32650 2024-09-10T21:15:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.190+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2322498522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c400316a0 con 0x55abc0a32650 2024-09-10T21:15:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.190+0000 7f0c2d7fa640 1 -- 172.21.15.59:0/2322498522 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0c340ab8d0 con 0x55abc0a32650 2024-09-10T21:15:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.190+0000 7f0c4e1df740 10 client.15258 fetch_fsmap learned FSMap version 27 2024-09-10T21:15:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.190+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2322498522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55abc0a4ce20 con 0x55abc0a32650 2024-09-10T21:15:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.190+0000 7f0c2d7fa640 1 -- 172.21.15.59:0/2322498522 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c400316a0 con 0x55abc0a32650 2024-09-10T21:15:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.190+0000 7f0c2d7fa640 1 -- 172.21.15.59:0/2322498522 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0c340ab3c0 con 0x55abc0a32650 2024-09-10T21:15:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.190+0000 7f0c4e1df740 10 client.15258 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:15:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.190+0000 7f0c4e1df740 10 client.15258 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T21:15:03.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.190+0000 7f0c4e1df740 20 client.15258 populate_metadata read hostname 'smithi059' 2024-09-10T21:15:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.191+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/2322498522 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55abc0a4f430 0x55abc0a508a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.191+0000 7f0c4e1df740 4 client.15258 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:15:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.191+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2322498522 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abc09abb60 con 0x55abc0a4f430 2024-09-10T21:15:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.191+0000 7f0c49ba6640 1 --2- 172.21.15.59:0/2322498522 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55abc0a4f430 0x55abc0a508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.191+0000 7f0c49ba6640 1 --2- 172.21.15.59:0/2322498522 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55abc0a4f430 0x55abc0a508a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2071e47428d40a1c server_cookie=f07bf2b4f10a9022 in_seq=0 out_seq=0 2024-09-10T21:15:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.191+0000 7f0c2d7fa640 10 client.15258 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:15:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.192+0000 7f0c2d7fa640 1 -- 172.21.15.59:0/2322498522 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55abc09abb60 con 0x55abc0a4f430 2024-09-10T21:15:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.192+0000 7f0c2d7fa640 10 client.15258 handle_command_reply: tid=0 2024-09-10T21:15:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.192+0000 7f0c4e1df740 1 client.15258 shutdown 2024-09-10T21:15:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.192+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2322498522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a32650 msgr2=0x55abc0a3bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.192+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/2322498522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a32650 0x55abc0a3bac0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0c34005fd0 tx=0x7f0c340a88a0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.192+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2322498522 shutdown_connections 2024-09-10T21:15:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.192+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/2322498522 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55abc0a4f430 0x55abc0a508a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.192+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/2322498522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55abc0a3e5e0 0x55abc0a3c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.192+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/2322498522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a32650 0x55abc0a3bac0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.192+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/2322498522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a31d30 0x55abc0a3b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.192+0000 7f0c2d7fa640 0 client.15258 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:15:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.192+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2322498522 >> 172.21.15.59:0/2322498522 conn(0x55abc0a2fb60 msgr2=0x55abc0a35700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.192+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2322498522 shutdown_connections 2024-09-10T21:15:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.192+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2322498522 wait complete. 2024-09-10T21:15:03.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.192+0000 7f0c4e1df740 20 client.15258 trim_cache size 0 max 16384 2024-09-10T21:15:03.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.210+0000 7f0c4e1df740 1 Processor -- start 2024-09-10T21:15:03.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.211+0000 7f0c4e1df740 1 -- start start 2024-09-10T21:15:03.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.211+0000 7f0c4e1df740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55abc0a31d30 0x55abc0a35ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:03.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.211+0000 7f0c4e1df740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a32650 0x55abc0a3aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:03.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.211+0000 7f0c4e1df740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a3e5e0 0x55abc0a367e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:03.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.211+0000 7f0c4e1df740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55abc0a4ebe0 con 0x55abc0a3e5e0 2024-09-10T21:15:03.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.211+0000 7f0c4e1df740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55abc0a4f2b0 con 0x55abc0a31d30 2024-09-10T21:15:03.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.211+0000 7f0c4e1df740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55abc0a4f980 con 0x55abc0a32650 2024-09-10T21:15:03.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.211+0000 7f0c4a3a7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a3e5e0 0x55abc0a367e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:03.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.211+0000 7f0c4a3a7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a3e5e0 0x55abc0a367e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56170/0 (socket says 172.21.15.59:56170) 2024-09-10T21:15:03.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.211+0000 7f0c4a3a7640 1 -- 172.21.15.59:0/1458610920 learned_addr learned my addr 172.21.15.59:0/1458610920 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:03.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.211+0000 7f0c4a3a7640 1 -- 172.21.15.59:0/1458610920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a32650 msgr2=0x55abc0a3aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:03.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.211+0000 7f0c4a3a7640 1 --2- 172.21.15.59:0/1458610920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a32650 0x55abc0a3aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.211+0000 7f0c4a3a7640 1 -- 172.21.15.59:0/1458610920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55abc0a31d30 msgr2=0x55abc0a35ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:03.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.211+0000 7f0c4a3a7640 1 --2- 172.21.15.59:0/1458610920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55abc0a31d30 0x55abc0a35ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.211+0000 7f0c4a3a7640 1 -- 172.21.15.59:0/1458610920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abc0a2b4f0 con 0x55abc0a3e5e0 2024-09-10T21:15:03.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.211+0000 7f0c4a3a7640 1 --2- 172.21.15.59:0/1458610920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a3e5e0 0x55abc0a367e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c0116b0 tx=0x7f0c3c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa72d62608d3506 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:03.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.211+0000 7f0c2f7fe640 1 -- 172.21.15.59:0/1458610920 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c0217d0 con 0x55abc0a3e5e0 2024-09-10T21:15:03.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.212+0000 7f0c2f7fe640 1 -- 172.21.15.59:0/1458610920 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c3c021e20 con 0x55abc0a3e5e0 2024-09-10T21:15:03.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.212+0000 7f0c2f7fe640 1 -- 172.21.15.59:0/1458610920 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c0293e0 con 0x55abc0a3e5e0 2024-09-10T21:15:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.212+0000 7f0c4e1df740 1 -- 172.21.15.59:0/1458610920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a3e5e0 msgr2=0x55abc0a367e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.212+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/1458610920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a3e5e0 0x55abc0a367e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c0116b0 tx=0x7f0c3c016000 comp rx=0 tx=0).stop 2024-09-10T21:15:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.212+0000 7f0c4e1df740 1 -- 172.21.15.59:0/1458610920 shutdown_connections 2024-09-10T21:15:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.212+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/1458610920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a3e5e0 0x55abc0a367e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.212+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/1458610920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a32650 0x55abc0a3aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.212+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/1458610920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55abc0a31d30 0x55abc0a35ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.212+0000 7f0c4e1df740 1 -- 172.21.15.59:0/1458610920 >> 172.21.15.59:0/1458610920 conn(0x55abc0a2fb60 msgr2=0x55abc0a30a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.212+0000 7f0c4e1df740 1 -- 172.21.15.59:0/1458610920 shutdown_connections 2024-09-10T21:15:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.212+0000 7f0c4e1df740 1 -- 172.21.15.59:0/1458610920 wait complete. 2024-09-10T21:15:03.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.212+0000 7f0c4e1df740 1 -- start start 2024-09-10T21:15:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.213+0000 7f0c4e1df740 1 Processor -- start 2024-09-10T21:15:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.213+0000 7f0c4e1df740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a31d30 0x55abc0a59540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.213+0000 7f0c4e1df740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55abc0a32650 0x55abc0a52ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.213+0000 7f0c4e1df740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a3e5e0 0x55abc0a53260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.213+0000 7f0c4e1df740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55abc0a50720 con 0x55abc0a31d30 2024-09-10T21:15:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.213+0000 7f0c4e1df740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55abc0a50050 con 0x55abc0a32650 2024-09-10T21:15:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.213+0000 7f0c4e1df740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55abc0a50df0 con 0x55abc0a3e5e0 2024-09-10T21:15:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.213+0000 7f0c4e1df740 10 client.0 _ll_register_callbacks cb 0x7f0c34004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:15:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.213+0000 7f0c49ba6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a31d30 0x55abc0a59540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.213+0000 7f0c49ba6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a31d30 0x55abc0a59540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56172/0 (socket says 172.21.15.59:56172) 2024-09-10T21:15:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.213+0000 7f0c49ba6640 1 -- 172.21.15.59:0/2879613756 learned_addr learned my addr 172.21.15.59:0/2879613756 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.213+0000 7f0c4a3a7640 1 --2- 172.21.15.59:0/2879613756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a3e5e0 0x55abc0a53260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.213+0000 7f0c49ba6640 1 -- 172.21.15.59:0/2879613756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a3e5e0 msgr2=0x55abc0a53260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:03.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.213+0000 7f0c49ba6640 1 --2- 172.21.15.59:0/2879613756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a3e5e0 0x55abc0a53260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.213+0000 7f0c49ba6640 1 -- 172.21.15.59:0/2879613756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55abc0a32650 msgr2=0x55abc0a52ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.213+0000 7f0c49ba6640 1 --2- 172.21.15.59:0/2879613756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55abc0a32650 0x55abc0a52ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.213+0000 7f0c49ba6640 1 -- 172.21.15.59:0/2879613756 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abc0a581a0 con 0x55abc0a31d30 2024-09-10T21:15:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.213+0000 7f0c4a3a7640 1 --2- 172.21.15.59:0/2879613756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a3e5e0 0x55abc0a53260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:15:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.214+0000 7f0c49ba6640 1 --2- 172.21.15.59:0/2879613756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a31d30 0x55abc0a59540 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0c40005390 tx=0x7f0c40005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ec42c77c7bf79 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.214+0000 7f0c2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:15:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.214+0000 7f0c2d7fa640 1 -- 172.21.15.59:0/2879613756 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c40035040 con 0x55abc0a31d30 2024-09-10T21:15:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.214+0000 7f0c2d7fa640 1 -- 172.21.15.59:0/2879613756 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0c40005430 con 0x55abc0a31d30 2024-09-10T21:15:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.214+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2879613756 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c3c021e20 con 0x55abc0a31d30 2024-09-10T21:15:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.214+0000 7f0c2d7fa640 1 -- 172.21.15.59:0/2879613756 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0c40005630 con 0x55abc0a31d30 2024-09-10T21:15:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.214+0000 7f0c4e1df740 10 client.15264 fetch_fsmap learned FSMap version 27 2024-09-10T21:15:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.214+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2879613756 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55abc0abc030 con 0x55abc0a31d30 2024-09-10T21:15:03.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.214+0000 7f0c2d7fa640 1 -- 172.21.15.59:0/2879613756 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c3c021e20 con 0x55abc0a31d30 2024-09-10T21:15:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.214+0000 7f0c2d7fa640 1 -- 172.21.15.59:0/2879613756 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f0c4003c8c0 con 0x55abc0a31d30 2024-09-10T21:15:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.214+0000 7f0c4e1df740 10 client.15264 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:15:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.214+0000 7f0c4e1df740 10 client.15264 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T21:15:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.214+0000 7f0c4e1df740 20 client.15264 populate_metadata read hostname 'smithi059' 2024-09-10T21:15:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.214+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/2879613756 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55abc0ac07d0 0x55abc0abf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.214+0000 7f0c4e1df740 4 client.15264 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:15:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.214+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2879613756 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "status"}) -- 0x55abc09a7610 con 0x55abc0ac07d0 2024-09-10T21:15:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.215+0000 7f0c493a5640 1 --2- 172.21.15.59:0/2879613756 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55abc0ac07d0 0x55abc0abf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.215+0000 7f0c493a5640 1 --2- 172.21.15.59:0/2879613756 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55abc0ac07d0 0x55abc0abf4e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fc4d57e20257e243 server_cookie=c92d9a107d08591e in_seq=0 out_seq=0 2024-09-10T21:15:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.215+0000 7f0c2d7fa640 10 client.15264 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:15:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.215+0000 7f0c2d7fa640 1 -- 172.21.15.59:0/2879613756 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55abc09a7610 con 0x55abc0ac07d0 2024-09-10T21:15:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.215+0000 7f0c2d7fa640 10 client.15264 handle_command_reply: tid=0 2024-09-10T21:15:03.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.215+0000 7f0c4e1df740 1 client.15264 shutdown 2024-09-10T21:15:03.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2879613756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a31d30 msgr2=0x55abc0a59540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:03.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/2879613756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a31d30 0x55abc0a59540 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0c40005390 tx=0x7f0c40005a20 comp rx=0 tx=0).stop 2024-09-10T21:15:03.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2879613756 shutdown_connections 2024-09-10T21:15:03.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/2879613756 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55abc0ac07d0 0x55abc0abf4e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/2879613756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55abc0a3e5e0 0x55abc0a53260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/2879613756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55abc0a32650 0x55abc0a52ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c2d7fa640 0 client.15264 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:15:03.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4e1df740 1 --2- 172.21.15.59:0/2879613756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55abc0a31d30 0x55abc0a59540 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2879613756 >> 172.21.15.59:0/2879613756 conn(0x55abc0a2fb60 msgr2=0x55abc0a367e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:03.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2879613756 shutdown_connections 2024-09-10T21:15:03.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4e1df740 1 -- 172.21.15.59:0/2879613756 wait complete. 2024-09-10T21:15:03.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4e1df740 20 client.15264 trim_cache size 0 max 16384 2024-09-10T21:15:03.226 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:15:03.226 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "3c26b952-6fb8-11ef-bcea-c7b262605968", 2024-09-10T21:15:03.226 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 2, 2024-09-10T21:15:03.226 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 24542, 2024-09-10T21:15:03.226 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-09-10T21:15:03.226 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-09-10T21:15:03.226 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-09-10T21:15:03.226 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 95.289670024000003, 2024-09-10T21:15:03.226 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 27, 2024-09-10T21:15:03.226 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 75, 2024-09-10T21:15:03.226 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T21:15:03.226 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 124.519558581 2024-09-10T21:15:03.227 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:15:03.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4be0a640 1 -- 172.21.15.59:0/2672854385 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0c300b5370 msgr2=0x7f0c300b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:03.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4be0a640 1 --2- 172.21.15.59:0/2672854385 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0c300b5370 0x7f0c300b7830 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0c4406c510 tx=0x7f0c3c009800 comp rx=0 tx=0).stop 2024-09-10T21:15:03.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4be0a640 1 -- 172.21.15.59:0/2672854385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c44075e60 msgr2=0x7f0c4419fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:03.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4be0a640 1 --2- 172.21.15.59:0/2672854385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c44075e60 0x7f0c4419fe30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400c890 tx=0x7f0c3400cd50 comp rx=0 tx=0).stop 2024-09-10T21:15:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4be0a640 1 -- 172.21.15.59:0/2672854385 shutdown_connections 2024-09-10T21:15:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4be0a640 1 --2- 172.21.15.59:0/2672854385 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0c300b5370 0x7f0c300b7830 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4be0a640 1 --2- 172.21.15.59:0/2672854385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c44113b20 0x7f0c441a51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4be0a640 1 --2- 172.21.15.59:0/2672854385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c44075e60 0x7f0c4419fe30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4be0a640 1 --2- 172.21.15.59:0/2672854385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0c44075540 0x7f0c4419f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4be0a640 1 -- 172.21.15.59:0/2672854385 >> 172.21.15.59:0/2672854385 conn(0x7f0c440fe830 msgr2=0x7f0c440ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.216+0000 7f0c4be0a640 1 -- 172.21.15.59:0/2672854385 shutdown_connections 2024-09-10T21:15:03.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:03.217+0000 7f0c4be0a640 1 -- 172.21.15.59:0/2672854385 wait complete. 2024-09-10T21:15:03.913 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T21:15:04.176 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:15:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.577+0000 7f29b73bb640 1 -- 172.21.15.59:0/846020584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b010d250 msgr2=0x7f29b010f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.577+0000 7f29b73bb640 1 --2- 172.21.15.59:0/846020584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b010d250 0x7f29b010f640 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009ca0 tx=0x7f29a802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.577+0000 7f29b73bb640 1 -- 172.21.15.59:0/846020584 shutdown_connections 2024-09-10T21:15:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.577+0000 7f29b73bb640 1 --2- 172.21.15.59:0/846020584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b010d250 0x7f29b010f640 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.577+0000 7f29b73bb640 1 --2- 172.21.15.59:0/846020584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29b010a920 0x7f29b010cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.577+0000 7f29b73bb640 1 --2- 172.21.15.59:0/846020584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29b0101810 0x7f29b0101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.577+0000 7f29b73bb640 1 -- 172.21.15.59:0/846020584 >> 172.21.15.59:0/846020584 conn(0x7f29b0076f50 msgr2=0x7f29b0077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.577+0000 7f29b73bb640 1 -- 172.21.15.59:0/846020584 shutdown_connections 2024-09-10T21:15:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.578+0000 7f29b73bb640 1 -- 172.21.15.59:0/846020584 wait complete. 2024-09-10T21:15:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.579+0000 7f29b73bb640 1 Processor -- start 2024-09-10T21:15:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.579+0000 7f29b73bb640 1 -- start start 2024-09-10T21:15:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.579+0000 7f29b73bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29b0101810 0x7f29b0199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.579+0000 7f29b73bb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b010a920 0x7f29b0199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.579+0000 7f29b73bb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29b010d250 0x7f29b019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.579+0000 7f29b73bb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0112d90 con 0x7f29b010a920 2024-09-10T21:15:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.579+0000 7f29b73bb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0112c10 con 0x7f29b0101810 2024-09-10T21:15:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.579+0000 7f29b73bb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0112f10 con 0x7f29b010d250 2024-09-10T21:15:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.579+0000 7f29b4956640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b010a920 0x7f29b0199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.579+0000 7f29b4956640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b010a920 0x7f29b0199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56196/0 (socket says 172.21.15.59:56196) 2024-09-10T21:15:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.579+0000 7f29b4956640 1 -- 172.21.15.59:0/3104701997 learned_addr learned my addr 172.21.15.59:0/3104701997 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.580+0000 7f29b5157640 1 --2- 172.21.15.59:0/3104701997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29b0101810 0x7f29b0199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.580+0000 7f29b5958640 1 --2- 172.21.15.59:0/3104701997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29b010d250 0x7f29b019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.580+0000 7f29b4956640 1 -- 172.21.15.59:0/3104701997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29b010d250 msgr2=0x7f29b019eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.580+0000 7f29b4956640 1 --2- 172.21.15.59:0/3104701997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29b010d250 0x7f29b019eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.580+0000 7f29b4956640 1 -- 172.21.15.59:0/3104701997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29b0101810 msgr2=0x7f29b0199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.580+0000 7f29b4956640 1 --2- 172.21.15.59:0/3104701997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29b0101810 0x7f29b0199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.580+0000 7f29b4956640 1 -- 172.21.15.59:0/3104701997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b019f2b0 con 0x7f29b010a920 2024-09-10T21:15:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.580+0000 7f29b5157640 1 --2- 172.21.15.59:0/3104701997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29b0101810 0x7f29b0199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:15:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.580+0000 7f29b4956640 1 --2- 172.21.15.59:0/3104701997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b010a920 0x7f29b0199740 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f29a000d770 tx=0x7f29a000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.580+0000 7f29a67fc640 1 -- 172.21.15.59:0/3104701997 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a0017070 con 0x7f29b010a920 2024-09-10T21:15:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.580+0000 7f29a67fc640 1 -- 172.21.15.59:0/3104701997 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29a00054d0 con 0x7f29b010a920 2024-09-10T21:15:04.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.580+0000 7f29b73bb640 1 -- 172.21.15.59:0/3104701997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b019f5a0 con 0x7f29b010a920 2024-09-10T21:15:04.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.580+0000 7f29a67fc640 1 -- 172.21.15.59:0/3104701997 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a0004c30 con 0x7f29b010a920 2024-09-10T21:15:04.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.580+0000 7f29b73bb640 1 -- 172.21.15.59:0/3104701997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b01a5c60 con 0x7f29b010a920 2024-09-10T21:15:04.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.583+0000 7f29a67fc640 1 -- 172.21.15.59:0/3104701997 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7f29a0004e10 con 0x7f29b010a920 2024-09-10T21:15:04.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.583+0000 7f29b9790740 1 Processor -- start 2024-09-10T21:15:04.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.583+0000 7f29b9790740 1 -- start start 2024-09-10T21:15:04.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.583+0000 7f29b9790740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5670d30 0x55d1f5671110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:04.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.583+0000 7f29b9790740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f5671650 0x55d1f567d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:04.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.583+0000 7f29b9790740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f567d5e0 0x55d1f567f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:04.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.584+0000 7f29b9790740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d1f55e8c10 con 0x55d1f5671650 2024-09-10T21:15:04.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.584+0000 7f29b9790740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d1f55d8040 con 0x55d1f5670d30 2024-09-10T21:15:04.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.584+0000 7f29b9790740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d1f55dbe50 con 0x55d1f567d5e0 2024-09-10T21:15:04.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.584+0000 7f29b5157640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f5671650 0x55d1f567d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:04.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.584+0000 7f29b5157640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f5671650 0x55d1f567d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56204/0 (socket says 172.21.15.59:56204) 2024-09-10T21:15:04.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.584+0000 7f29b5157640 1 -- 172.21.15.59:0/1331458763 learned_addr learned my addr 172.21.15.59:0/1331458763 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:04.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.584+0000 7f29b5958640 1 --2- 172.21.15.59:0/1331458763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5670d30 0x55d1f5671110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:04.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.584+0000 7f29b4956640 1 --2- 172.21.15.59:0/1331458763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f567d5e0 0x55d1f567f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:04.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.584+0000 7f29b5157640 1 -- 172.21.15.59:0/1331458763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f567d5e0 msgr2=0x55d1f567f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:04.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.584+0000 7f29b5157640 1 --2- 172.21.15.59:0/1331458763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f567d5e0 0x55d1f567f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.584+0000 7f29b5157640 1 -- 172.21.15.59:0/1331458763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5670d30 msgr2=0x55d1f5671110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:04.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.584+0000 7f29b5157640 1 --2- 172.21.15.59:0/1331458763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5670d30 0x55d1f5671110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.584+0000 7f29b5157640 1 -- 172.21.15.59:0/1331458763 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1f5336540 con 0x55d1f5671650 2024-09-10T21:15:04.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.584+0000 7f29b4956640 1 --2- 172.21.15.59:0/1331458763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f567d5e0 0x55d1f567f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:15:04.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.584+0000 7f29a67fc640 1 --2- 172.21.15.59:0/3104701997 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f299c0b53f0 0x7f299c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:04.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.584+0000 7f29b5157640 1 --2- 172.21.15.59:0/1331458763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f5671650 0x55d1f567d0a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00ccd0 tx=0x7f29ac00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beeaec8c66f71723 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:04.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.584+0000 7f29b5958640 1 --2- 172.21.15.59:0/3104701997 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f299c0b53f0 0x7f299c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:04.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.584+0000 7f29a67fc640 1 -- 172.21.15.59:0/3104701997 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f29a00e58c0 con 0x7f29b010a920 2024-09-10T21:15:04.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.585+0000 7f299b7fe640 1 -- 172.21.15.59:0/1331458763 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac005220 con 0x55d1f5671650 2024-09-10T21:15:04.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.585+0000 7f299b7fe640 1 -- 172.21.15.59:0/1331458763 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29ac004c50 con 0x55d1f5671650 2024-09-10T21:15:04.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.585+0000 7f299b7fe640 1 -- 172.21.15.59:0/1331458763 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac0107e0 con 0x55d1f5671650 2024-09-10T21:15:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.585+0000 7f29b5958640 1 --2- 172.21.15.59:0/3104701997 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f299c0b53f0 0x7f299c0b78b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009430 tx=0x7f29a8005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.585+0000 7f29b9790740 1 -- 172.21.15.59:0/1331458763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f5671650 msgr2=0x55d1f567d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.585+0000 7f29b9790740 1 --2- 172.21.15.59:0/1331458763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f5671650 0x55d1f567d0a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00ccd0 tx=0x7f29ac00e720 comp rx=0 tx=0).stop 2024-09-10T21:15:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.585+0000 7f29b9790740 1 -- 172.21.15.59:0/1331458763 shutdown_connections 2024-09-10T21:15:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.585+0000 7f29b9790740 1 --2- 172.21.15.59:0/1331458763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f567d5e0 0x55d1f567f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.585+0000 7f29b9790740 1 --2- 172.21.15.59:0/1331458763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f5671650 0x55d1f567d0a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.585+0000 7f29b9790740 1 --2- 172.21.15.59:0/1331458763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5670d30 0x55d1f5671110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.585+0000 7f29b9790740 1 -- 172.21.15.59:0/1331458763 >> 172.21.15.59:0/1331458763 conn(0x55d1f566eb60 msgr2=0x55d1f566fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.585+0000 7f29b9790740 1 -- 172.21.15.59:0/1331458763 shutdown_connections 2024-09-10T21:15:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.585+0000 7f29b9790740 1 -- 172.21.15.59:0/1331458763 wait complete. 2024-09-10T21:15:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.586+0000 7f29b9790740 1 -- start start 2024-09-10T21:15:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.586+0000 7f29b9790740 1 Processor -- start 2024-09-10T21:15:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.586+0000 7f29b9790740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f5670d30 0x55d1f567a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.586+0000 7f29b9790740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5671650 0x55d1f567aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.586+0000 7f29b9790740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 0x55d1f567b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.586+0000 7f29b9790740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d1f54395f0 con 0x55d1f567d5e0 2024-09-10T21:15:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.586+0000 7f29b9790740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d1f5573010 con 0x55d1f5671650 2024-09-10T21:15:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.586+0000 7f29b9790740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d1f5680290 con 0x55d1f5670d30 2024-09-10T21:15:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.586+0000 7f29b9790740 10 client.0 _ll_register_callbacks cb 0x55d1f55d2340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:15:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.586+0000 7f29b5958640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 0x55d1f567b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.587+0000 7f29b5958640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 0x55d1f567b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56210/0 (socket says 172.21.15.59:56210) 2024-09-10T21:15:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.587+0000 7f29b5958640 1 -- 172.21.15.59:0/2214688162 learned_addr learned my addr 172.21.15.59:0/2214688162 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.587+0000 7f29b5157640 1 --2- 172.21.15.59:0/2214688162 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f5670d30 0x55d1f567a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.587+0000 7f29b4956640 1 --2- 172.21.15.59:0/2214688162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5671650 0x55d1f567aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.587+0000 7f29b5958640 1 -- 172.21.15.59:0/2214688162 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f5670d30 msgr2=0x55d1f567a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.587+0000 7f29b5958640 1 --2- 172.21.15.59:0/2214688162 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f5670d30 0x55d1f567a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.587+0000 7f29b5958640 1 -- 172.21.15.59:0/2214688162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5671650 msgr2=0x55d1f567aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.587+0000 7f29b5958640 1 --2- 172.21.15.59:0/2214688162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5671650 0x55d1f567aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.587+0000 7f29b5958640 1 -- 172.21.15.59:0/2214688162 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1f55a0a00 con 0x55d1f567d5e0 2024-09-10T21:15:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.587+0000 7f29b5958640 1 --2- 172.21.15.59:0/2214688162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 0x55d1f567b010 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f29a8031450 tx=0x7f29a802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338529c408dfa0c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.587+0000 7f2998ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:15:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.587+0000 7f2998ff9640 1 -- 172.21.15.59:0/2214688162 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8003d00 con 0x55d1f567d5e0 2024-09-10T21:15:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.587+0000 7f2998ff9640 1 -- 172.21.15.59:0/2214688162 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f29a8004040 con 0x55d1f567d5e0 2024-09-10T21:15:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.587+0000 7f29b9790740 1 -- 172.21.15.59:0/2214688162 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29ac004c50 con 0x55d1f567d5e0 2024-09-10T21:15:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.587+0000 7f2998ff9640 1 -- 172.21.15.59:0/2214688162 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f29a8004240 con 0x55d1f567d5e0 2024-09-10T21:15:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.587+0000 7f29b9790740 10 client.15276 fetch_fsmap learned FSMap version 27 2024-09-10T21:15:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.587+0000 7f29b9790740 1 -- 172.21.15.59:0/2214688162 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d1f568bda0 con 0x55d1f567d5e0 2024-09-10T21:15:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.588+0000 7f2998ff9640 1 -- 172.21.15.59:0/2214688162 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29ac004c50 con 0x55d1f567d5e0 2024-09-10T21:15:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.588+0000 7f2998ff9640 1 -- 172.21.15.59:0/2214688162 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f29a8051070 con 0x55d1f567d5e0 2024-09-10T21:15:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.588+0000 7f29b9790740 10 client.15276 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:15:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.588+0000 7f29b9790740 10 client.15276 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T21:15:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.588+0000 7f29b9790740 20 client.15276 populate_metadata read hostname 'smithi059' 2024-09-10T21:15:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.588+0000 7f29b9790740 1 --2- 172.21.15.59:0/2214688162 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55d1f568e460 0x55d1f568f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.588+0000 7f29b9790740 4 client.15276 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:15:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.588+0000 7f29b9790740 1 -- 172.21.15.59:0/2214688162 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1f55eab60 con 0x55d1f568e460 2024-09-10T21:15:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.588+0000 7f29b5157640 1 --2- 172.21.15.59:0/2214688162 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55d1f568e460 0x55d1f568f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.589+0000 7f29b5157640 1 --2- 172.21.15.59:0/2214688162 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55d1f568e460 0x55d1f568f8d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f82c7af1ffc930a7 server_cookie=a1569b45747fe3a0 in_seq=0 out_seq=0 2024-09-10T21:15:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.589+0000 7f2998ff9640 10 client.15276 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:15:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.589+0000 7f2998ff9640 1 -- 172.21.15.59:0/2214688162 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d1f55eab60 con 0x55d1f568e460 2024-09-10T21:15:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.589+0000 7f2998ff9640 10 client.15276 handle_command_reply: tid=0 2024-09-10T21:15:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.589+0000 7f29b9790740 1 client.15276 shutdown 2024-09-10T21:15:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.590+0000 7f29b9790740 1 -- 172.21.15.59:0/2214688162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 msgr2=0x55d1f567b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.590+0000 7f29b9790740 1 --2- 172.21.15.59:0/2214688162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 0x55d1f567b010 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f29a8031450 tx=0x7f29a802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.590+0000 7f29b9790740 1 -- 172.21.15.59:0/2214688162 shutdown_connections 2024-09-10T21:15:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.590+0000 7f29b9790740 1 --2- 172.21.15.59:0/2214688162 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55d1f568e460 0x55d1f568f8d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.590+0000 7f29b9790740 1 --2- 172.21.15.59:0/2214688162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 0x55d1f567b010 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.590+0000 7f29b9790740 1 --2- 172.21.15.59:0/2214688162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5671650 0x55d1f567aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.590+0000 7f29b9790740 1 --2- 172.21.15.59:0/2214688162 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f5670d30 0x55d1f567a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.590+0000 7f29b9790740 1 -- 172.21.15.59:0/2214688162 >> 172.21.15.59:0/2214688162 conn(0x55d1f566eb60 msgr2=0x55d1f5674700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.590+0000 7f2998ff9640 0 client.15276 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:15:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.590+0000 7f29b9790740 1 -- 172.21.15.59:0/2214688162 shutdown_connections 2024-09-10T21:15:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.590+0000 7f29b9790740 1 -- 172.21.15.59:0/2214688162 wait complete. 2024-09-10T21:15:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.590+0000 7f29b9790740 20 client.15276 trim_cache size 0 max 16384 2024-09-10T21:15:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.608+0000 7f29b9790740 1 Processor -- start 2024-09-10T21:15:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.608+0000 7f29b9790740 1 -- start start 2024-09-10T21:15:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.608+0000 7f29b9790740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5670d30 0x55d1f5689e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.608+0000 7f29b9790740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f5671650 0x55d1f5675820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.608+0000 7f29b9790740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 0x55d1f5675d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.608+0000 7f29b9790740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d1f568dc10 con 0x55d1f567d5e0 2024-09-10T21:15:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.608+0000 7f29b9790740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d1f568e2e0 con 0x55d1f5670d30 2024-09-10T21:15:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.608+0000 7f29b9790740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d1f568e9b0 con 0x55d1f5671650 2024-09-10T21:15:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.608+0000 7f29b5958640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 0x55d1f5675d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.608+0000 7f29b5958640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 0x55d1f5675d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56218/0 (socket says 172.21.15.59:56218) 2024-09-10T21:15:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.608+0000 7f29b5958640 1 -- 172.21.15.59:0/3647125819 learned_addr learned my addr 172.21.15.59:0/3647125819 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.609+0000 7f29b4956640 1 --2- 172.21.15.59:0/3647125819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f5671650 0x55d1f5675820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.609+0000 7f29b5157640 1 --2- 172.21.15.59:0/3647125819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5670d30 0x55d1f5689e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.609+0000 7f29b5958640 1 -- 172.21.15.59:0/3647125819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f5671650 msgr2=0x55d1f5675820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.609+0000 7f29b5958640 1 --2- 172.21.15.59:0/3647125819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f5671650 0x55d1f5675820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.609+0000 7f29b5958640 1 -- 172.21.15.59:0/3647125819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5670d30 msgr2=0x55d1f5689e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.609+0000 7f29b5958640 1 --2- 172.21.15.59:0/3647125819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5670d30 0x55d1f5689e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.609+0000 7f29b5958640 1 -- 172.21.15.59:0/3647125819 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1f566f5e0 con 0x55d1f567d5e0 2024-09-10T21:15:04.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.609+0000 7f29b5157640 1 --2- 172.21.15.59:0/3647125819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5670d30 0x55d1f5689e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:15:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.609+0000 7f29b5958640 1 --2- 172.21.15.59:0/3647125819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 0x55d1f5675d60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f29a802fd80 tx=0x7f29a80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b94d7ad8365f82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.609+0000 7f299affd640 1 -- 172.21.15.59:0/3647125819 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8031910 con 0x55d1f567d5e0 2024-09-10T21:15:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.609+0000 7f299affd640 1 -- 172.21.15.59:0/3647125819 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29a8036040 con 0x55d1f567d5e0 2024-09-10T21:15:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.609+0000 7f299affd640 1 -- 172.21.15.59:0/3647125819 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8004640 con 0x55d1f567d5e0 2024-09-10T21:15:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.610+0000 7f29b9790740 1 -- 172.21.15.59:0/3647125819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 msgr2=0x55d1f5675d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.610+0000 7f29b9790740 1 --2- 172.21.15.59:0/3647125819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 0x55d1f5675d60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f29a802fd80 tx=0x7f29a80095c0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.610+0000 7f29b9790740 1 -- 172.21.15.59:0/3647125819 shutdown_connections 2024-09-10T21:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.610+0000 7f29b9790740 1 --2- 172.21.15.59:0/3647125819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 0x55d1f5675d60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.610+0000 7f29b9790740 1 --2- 172.21.15.59:0/3647125819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f5671650 0x55d1f5675820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.610+0000 7f29b9790740 1 --2- 172.21.15.59:0/3647125819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5670d30 0x55d1f5689e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.610+0000 7f29b9790740 1 -- 172.21.15.59:0/3647125819 >> 172.21.15.59:0/3647125819 conn(0x55d1f566eb60 msgr2=0x55d1f568d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.610+0000 7f29b9790740 1 -- 172.21.15.59:0/3647125819 shutdown_connections 2024-09-10T21:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.610+0000 7f29b9790740 1 -- 172.21.15.59:0/3647125819 wait complete. 2024-09-10T21:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.610+0000 7f29b9790740 1 -- start start 2024-09-10T21:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.610+0000 7f29b9790740 1 Processor -- start 2024-09-10T21:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f29b9790740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5670d30 0x55d1f56769b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f29b9790740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f5671650 0x55d1f5676f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:04.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f29b9790740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 0x55d1f56776e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f29b9790740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d1f568f750 con 0x55d1f567d5e0 2024-09-10T21:15:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f29b9790740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d1f568f080 con 0x55d1f5670d30 2024-09-10T21:15:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f29b9790740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d1f568fe20 con 0x55d1f5671650 2024-09-10T21:15:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f29b9790740 10 client.0 _ll_register_callbacks cb 0x7f29a802f330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:15:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f29b5958640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 0x55d1f56776e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f29b5958640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 0x55d1f56776e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56228/0 (socket says 172.21.15.59:56228) 2024-09-10T21:15:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f29b5958640 1 -- 172.21.15.59:0/1039501432 learned_addr learned my addr 172.21.15.59:0/1039501432 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f29b5157640 1 --2- 172.21.15.59:0/1039501432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5670d30 0x55d1f56769b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f29b4956640 1 --2- 172.21.15.59:0/1039501432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f5671650 0x55d1f5676f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f29b5958640 1 -- 172.21.15.59:0/1039501432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f5671650 msgr2=0x55d1f5676f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:04.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f29b5958640 1 --2- 172.21.15.59:0/1039501432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f5671650 0x55d1f5676f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f29b5958640 1 -- 172.21.15.59:0/1039501432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5670d30 msgr2=0x55d1f56769b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f29b5958640 1 --2- 172.21.15.59:0/1039501432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5670d30 0x55d1f56769b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f29b5958640 1 -- 172.21.15.59:0/1039501432 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1f566fa50 con 0x55d1f567d5e0 2024-09-10T21:15:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f29b5157640 1 --2- 172.21.15.59:0/1039501432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5670d30 0x55d1f56769b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:15:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f29b5958640 1 --2- 172.21.15.59:0/1039501432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 0x55d1f56776e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f29a8006010 tx=0x7f29a8004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38a469c881e3a46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.611+0000 7f2998ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:15:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.612+0000 7f2998ff9640 1 -- 172.21.15.59:0/1039501432 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8031910 con 0x55d1f567d5e0 2024-09-10T21:15:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.612+0000 7f2998ff9640 1 -- 172.21.15.59:0/1039501432 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f29a802f660 con 0x55d1f567d5e0 2024-09-10T21:15:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.612+0000 7f29b9790740 1 -- 172.21.15.59:0/1039501432 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29a8036040 con 0x55d1f567d5e0 2024-09-10T21:15:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.612+0000 7f2998ff9640 1 -- 172.21.15.59:0/1039501432 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f29a8003d00 con 0x55d1f567d5e0 2024-09-10T21:15:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.612+0000 7f29b9790740 10 client.15282 fetch_fsmap learned FSMap version 27 2024-09-10T21:15:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.612+0000 7f29b9790740 1 -- 172.21.15.59:0/1039501432 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d1f56ff5d0 con 0x55d1f567d5e0 2024-09-10T21:15:04.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.612+0000 7f2998ff9640 1 -- 172.21.15.59:0/1039501432 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29a8036040 con 0x55d1f567d5e0 2024-09-10T21:15:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.612+0000 7f2998ff9640 1 -- 172.21.15.59:0/1039501432 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f29a8051070 con 0x55d1f567d5e0 2024-09-10T21:15:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.612+0000 7f29b9790740 10 client.15282 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:15:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.612+0000 7f29b9790740 10 client.15282 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T21:15:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.612+0000 7f29b9790740 20 client.15282 populate_metadata read hostname 'smithi059' 2024-09-10T21:15:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.612+0000 7f29b9790740 1 --2- 172.21.15.59:0/1039501432 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55d1f5703d70 0x55d1f5702a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.612+0000 7f29b9790740 4 client.15282 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:15:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.612+0000 7f29b9790740 1 -- 172.21.15.59:0/1039501432 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "status"}) -- 0x55d1f55e6610 con 0x55d1f5703d70 2024-09-10T21:15:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.613+0000 7f29b5157640 1 --2- 172.21.15.59:0/1039501432 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55d1f5703d70 0x55d1f5702a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.613+0000 7f29b5157640 1 --2- 172.21.15.59:0/1039501432 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55d1f5703d70 0x55d1f5702a80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ad9ad9826c13667d server_cookie=89e9b701f6374596 in_seq=0 out_seq=0 2024-09-10T21:15:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.613+0000 7f2998ff9640 10 client.15282 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:15:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.613+0000 7f2998ff9640 1 -- 172.21.15.59:0/1039501432 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d1f55e6610 con 0x55d1f5703d70 2024-09-10T21:15:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.613+0000 7f2998ff9640 10 client.15282 handle_command_reply: tid=0 2024-09-10T21:15:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.613+0000 7f29b9790740 1 client.15282 shutdown 2024-09-10T21:15:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.613+0000 7f29b9790740 1 -- 172.21.15.59:0/1039501432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 msgr2=0x55d1f56776e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.613+0000 7f29b9790740 1 --2- 172.21.15.59:0/1039501432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 0x55d1f56776e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f29a8006010 tx=0x7f29a8004610 comp rx=0 tx=0).stop 2024-09-10T21:15:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.613+0000 7f29b9790740 1 -- 172.21.15.59:0/1039501432 shutdown_connections 2024-09-10T21:15:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.613+0000 7f29b9790740 1 --2- 172.21.15.59:0/1039501432 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55d1f5703d70 0x55d1f5702a80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.613+0000 7f29b9790740 1 --2- 172.21.15.59:0/1039501432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1f567d5e0 0x55d1f56776e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.613+0000 7f29b9790740 1 --2- 172.21.15.59:0/1039501432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d1f5671650 0x55d1f5676f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.613+0000 7f2998ff9640 0 client.15282 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:15:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.613+0000 7f29b9790740 1 --2- 172.21.15.59:0/1039501432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d1f5670d30 0x55d1f56769b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.613+0000 7f29b9790740 1 -- 172.21.15.59:0/1039501432 >> 172.21.15.59:0/1039501432 conn(0x55d1f566eb60 msgr2=0x55d1f568d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.613+0000 7f29b9790740 1 -- 172.21.15.59:0/1039501432 shutdown_connections 2024-09-10T21:15:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.613+0000 7f29b9790740 1 -- 172.21.15.59:0/1039501432 wait complete. 2024-09-10T21:15:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.614+0000 7f29b9790740 20 client.15282 trim_cache size 0 max 16384 2024-09-10T21:15:04.624 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:15:04.624 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "3c26b952-6fb8-11ef-bcea-c7b262605968", 2024-09-10T21:15:04.624 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 1, 2024-09-10T21:15:04.625 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 24550, 2024-09-10T21:15:04.625 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-09-10T21:15:04.625 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-09-10T21:15:04.625 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-09-10T21:15:04.625 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 97.694913083000003, 2024-09-10T21:15:04.625 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 27, 2024-09-10T21:15:04.625 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 75, 2024-09-10T21:15:04.625 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T21:15:04.625 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 123.55306952700001 2024-09-10T21:15:04.625 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:15:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.614+0000 7f29b73bb640 1 -- 172.21.15.59:0/3104701997 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f299c0b53f0 msgr2=0x7f299c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.614+0000 7f29b73bb640 1 --2- 172.21.15.59:0/3104701997 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f299c0b53f0 0x7f299c0b78b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009430 tx=0x7f29a8005c30 comp rx=0 tx=0).stop 2024-09-10T21:15:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.614+0000 7f29b73bb640 1 -- 172.21.15.59:0/3104701997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b010a920 msgr2=0x7f29b0199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.614+0000 7f29b73bb640 1 --2- 172.21.15.59:0/3104701997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b010a920 0x7f29b0199740 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f29a000d770 tx=0x7f29a000dc30 comp rx=0 tx=0).stop 2024-09-10T21:15:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.614+0000 7f29b73bb640 1 -- 172.21.15.59:0/3104701997 shutdown_connections 2024-09-10T21:15:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.614+0000 7f29b73bb640 1 --2- 172.21.15.59:0/3104701997 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f299c0b53f0 0x7f299c0b78b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.614+0000 7f29b73bb640 1 --2- 172.21.15.59:0/3104701997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29b010d250 0x7f29b019eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.614+0000 7f29b73bb640 1 --2- 172.21.15.59:0/3104701997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b010a920 0x7f29b0199740 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.614+0000 7f29b73bb640 1 --2- 172.21.15.59:0/3104701997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29b0101810 0x7f29b0199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.614+0000 7f29b73bb640 1 -- 172.21.15.59:0/3104701997 >> 172.21.15.59:0/3104701997 conn(0x7f29b0076f50 msgr2=0x7f29b01005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.614+0000 7f29b73bb640 1 -- 172.21.15.59:0/3104701997 shutdown_connections 2024-09-10T21:15:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:04.614+0000 7f29b73bb640 1 -- 172.21.15.59:0/3104701997 wait complete. 2024-09-10T21:15:05.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:04 smithi154 ceph-mon[35041]: pgmap v334: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:15:05.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:04 smithi192 ceph-mon[35363]: pgmap v334: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:15:05.388 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:04 smithi059 ceph-mon[30888]: pgmap v334: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:15:05.419 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T21:15:05.710 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:15:06.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.179+0000 7fee2f4f2640 1 -- 172.21.15.59:0/3221327196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee281045b0 msgr2=0x7fee2810cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:06.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.179+0000 7fee2f4f2640 1 --2- 172.21.15.59:0/3221327196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee281045b0 0x7fee2810cb90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fee18009900 tx=0x7fee1802a410 comp rx=0 tx=0).stop 2024-09-10T21:15:06.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.179+0000 7fee2f4f2640 1 -- 172.21.15.59:0/3221327196 shutdown_connections 2024-09-10T21:15:06.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.179+0000 7fee2f4f2640 1 --2- 172.21.15.59:0/3221327196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee2810d160 0x7fee2810f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.179+0000 7fee2f4f2640 1 --2- 172.21.15.59:0/3221327196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee281045b0 0x7fee2810cb90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.179+0000 7fee2f4f2640 1 --2- 172.21.15.59:0/3221327196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee28103bb0 0x7fee28103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.179+0000 7fee2f4f2640 1 -- 172.21.15.59:0/3221327196 >> 172.21.15.59:0/3221327196 conn(0x7fee280fd700 msgr2=0x7fee280ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:06.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.179+0000 7fee2f4f2640 1 -- 172.21.15.59:0/3221327196 shutdown_connections 2024-09-10T21:15:06.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.179+0000 7fee2f4f2640 1 -- 172.21.15.59:0/3221327196 wait complete. 2024-09-10T21:15:06.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.180+0000 7fee2f4f2640 1 Processor -- start 2024-09-10T21:15:06.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.180+0000 7fee2f4f2640 1 -- start start 2024-09-10T21:15:06.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.180+0000 7fee2f4f2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee28103bb0 0x7fee28199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:06.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.180+0000 7fee2f4f2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee281045b0 0x7fee281997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:06.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.180+0000 7fee2f4f2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee2810d160 0x7fee2819eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:06.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.180+0000 7fee2f4f2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fee28112da0 con 0x7fee2810d160 2024-09-10T21:15:06.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.180+0000 7fee2f4f2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee28112c20 con 0x7fee28103bb0 2024-09-10T21:15:06.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.180+0000 7fee2f4f2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fee28112f20 con 0x7fee281045b0 2024-09-10T21:15:06.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.180+0000 7fee2da8f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee2810d160 0x7fee2819eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:06.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.180+0000 7fee2da8f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee2810d160 0x7fee2819eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56248/0 (socket says 172.21.15.59:56248) 2024-09-10T21:15:06.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.180+0000 7fee2da8f640 1 -- 172.21.15.59:0/682883280 learned_addr learned my addr 172.21.15.59:0/682883280 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:06.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.180+0000 7fee2d28e640 1 --2- 172.21.15.59:0/682883280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee28103bb0 0x7fee28199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:06.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.181+0000 7fee2ca8d640 1 --2- 172.21.15.59:0/682883280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee281045b0 0x7fee281997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:06.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.181+0000 7fee2da8f640 1 -- 172.21.15.59:0/682883280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee281045b0 msgr2=0x7fee281997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:06.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.181+0000 7fee2da8f640 1 --2- 172.21.15.59:0/682883280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee281045b0 0x7fee281997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.181+0000 7fee2da8f640 1 -- 172.21.15.59:0/682883280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee28103bb0 msgr2=0x7fee28199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:06.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.181+0000 7fee2da8f640 1 --2- 172.21.15.59:0/682883280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee28103bb0 0x7fee28199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.181+0000 7fee2da8f640 1 -- 172.21.15.59:0/682883280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2819f340 con 0x7fee2810d160 2024-09-10T21:15:06.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.181+0000 7fee2ca8d640 1 --2- 172.21.15.59:0/682883280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee281045b0 0x7fee281997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:15:06.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.181+0000 7fee2da8f640 1 --2- 172.21.15.59:0/682883280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee2810d160 0x7fee2819eb70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fee2000eaa0 tx=0x7fee2000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:06.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.181+0000 7fee1e7fc640 1 -- 172.21.15.59:0/682883280 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2000cdb0 con 0x7fee2810d160 2024-09-10T21:15:06.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.181+0000 7fee2f4f2640 1 -- 172.21.15.59:0/682883280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee2819f630 con 0x7fee2810d160 2024-09-10T21:15:06.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.181+0000 7fee1e7fc640 1 -- 172.21.15.59:0/682883280 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee20005020 con 0x7fee2810d160 2024-09-10T21:15:06.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.181+0000 7fee1e7fc640 1 -- 172.21.15.59:0/682883280 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee200116d0 con 0x7fee2810d160 2024-09-10T21:15:06.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.181+0000 7fee2f4f2640 1 -- 172.21.15.59:0/682883280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee281a5cf0 con 0x7fee2810d160 2024-09-10T21:15:06.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.184+0000 7fee1e7fc640 1 -- 172.21.15.59:0/682883280 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 153301+0+0 (secure 0 0 0) 0x7fee2000f040 con 0x7fee2810d160 2024-09-10T21:15:06.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.185+0000 7fee1e7fc640 1 --2- 172.21.15.59:0/682883280 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fee140b5370 0x7fee140b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:06.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.185+0000 7fee318c7740 1 Processor -- start 2024-09-10T21:15:06.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.185+0000 7fee318c7740 1 -- start start 2024-09-10T21:15:06.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.185+0000 7fee2d28e640 1 --2- 172.21.15.59:0/682883280 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fee140b5370 0x7fee140b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:06.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.185+0000 7fee1e7fc640 1 -- 172.21.15.59:0/682883280 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fee200e5be0 con 0x7fee2810d160 2024-09-10T21:15:06.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.185+0000 7fee318c7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d358d8d30 0x560d358d9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:06.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.185+0000 7fee318c7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358d9650 0x560d358e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:06.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.185+0000 7fee318c7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 0x560d358e79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:06.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.185+0000 7fee318c7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560d35850c10 con 0x560d358e55e0 2024-09-10T21:15:06.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.185+0000 7fee318c7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560d35840040 con 0x560d358d9650 2024-09-10T21:15:06.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.185+0000 7fee318c7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x560d35843e50 con 0x560d358d8d30 2024-09-10T21:15:06.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.186+0000 7fee2da8f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 0x560d358e79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:06.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.186+0000 7fee2da8f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 0x560d358e79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56256/0 (socket says 172.21.15.59:56256) 2024-09-10T21:15:06.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.186+0000 7fee2da8f640 1 -- 172.21.15.59:0/3657579598 learned_addr learned my addr 172.21.15.59:0/3657579598 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:06.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.186+0000 7fee2d28e640 1 --2- 172.21.15.59:0/682883280 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fee140b5370 0x7fee140b7830 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fee240058c0 tx=0x7fee2400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:06.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.186+0000 7fee2d28e640 1 --2- 172.21.15.59:0/3657579598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d358d8d30 0x560d358d9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:06.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.186+0000 7fee2ca8d640 1 --2- 172.21.15.59:0/3657579598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358d9650 0x560d358e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:06.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.186+0000 7fee2da8f640 1 -- 172.21.15.59:0/3657579598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d358d8d30 msgr2=0x560d358d9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:06.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.186+0000 7fee2da8f640 1 --2- 172.21.15.59:0/3657579598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d358d8d30 0x560d358d9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.186+0000 7fee2da8f640 1 -- 172.21.15.59:0/3657579598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358d9650 msgr2=0x560d358e50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:06.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.186+0000 7fee2da8f640 1 --2- 172.21.15.59:0/3657579598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358d9650 0x560d358e50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.186+0000 7fee2da8f640 1 -- 172.21.15.59:0/3657579598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d3559e540 con 0x560d358e55e0 2024-09-10T21:15:06.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.186+0000 7fee2ca8d640 1 --2- 172.21.15.59:0/3657579598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358d9650 0x560d358e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:15:06.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.186+0000 7fee2da8f640 1 --2- 172.21.15.59:0/3657579598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 0x560d358e79d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fee2000efd0 tx=0x7fee200abe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc19a95a0116d026 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:06.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.186+0000 7fee137fe640 1 -- 172.21.15.59:0/3657579598 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2001f040 con 0x560d358e55e0 2024-09-10T21:15:06.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.186+0000 7fee137fe640 1 -- 172.21.15.59:0/3657579598 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee200b0d50 con 0x560d358e55e0 2024-09-10T21:15:06.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.186+0000 7fee137fe640 1 -- 172.21.15.59:0/3657579598 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee200cf110 con 0x560d358e55e0 2024-09-10T21:15:06.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.187+0000 7fee318c7740 1 -- 172.21.15.59:0/3657579598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 msgr2=0x560d358e79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:06.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.187+0000 7fee318c7740 1 --2- 172.21.15.59:0/3657579598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 0x560d358e79d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fee2000efd0 tx=0x7fee200abe20 comp rx=0 tx=0).stop 2024-09-10T21:15:06.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.187+0000 7fee318c7740 1 -- 172.21.15.59:0/3657579598 shutdown_connections 2024-09-10T21:15:06.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.187+0000 7fee318c7740 1 --2- 172.21.15.59:0/3657579598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 0x560d358e79d0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.187+0000 7fee318c7740 1 --2- 172.21.15.59:0/3657579598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358d9650 0x560d358e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.187+0000 7fee318c7740 1 --2- 172.21.15.59:0/3657579598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d358d8d30 0x560d358d9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.187+0000 7fee318c7740 1 -- 172.21.15.59:0/3657579598 >> 172.21.15.59:0/3657579598 conn(0x560d358d6b60 msgr2=0x560d358d7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:06.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.187+0000 7fee318c7740 1 -- 172.21.15.59:0/3657579598 shutdown_connections 2024-09-10T21:15:06.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.187+0000 7fee318c7740 1 -- 172.21.15.59:0/3657579598 wait complete. 2024-09-10T21:15:06.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.188+0000 7fee318c7740 1 -- start start 2024-09-10T21:15:06.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.188+0000 7fee318c7740 1 Processor -- start 2024-09-10T21:15:06.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.188+0000 7fee318c7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358d8d30 0x560d358e25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:06.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.188+0000 7fee318c7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d358d9650 0x560d358e2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:06.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.188+0000 7fee318c7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 0x560d358e3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:06.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.188+0000 7fee318c7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560d356a15f0 con 0x560d358e55e0 2024-09-10T21:15:06.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.188+0000 7fee318c7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560d357db010 con 0x560d358d8d30 2024-09-10T21:15:06.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.188+0000 7fee318c7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x560d358ec5e0 con 0x560d358d9650 2024-09-10T21:15:06.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.188+0000 7fee318c7740 10 client.0 _ll_register_callbacks cb 0x560d3583a340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:15:06.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.188+0000 7fee2da8f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 0x560d358e3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:06.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.188+0000 7fee2d28e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358d8d30 0x560d358e25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:06.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.189+0000 7fee2d28e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358d8d30 0x560d358e25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:33292/0 (socket says 172.21.15.59:33292) 2024-09-10T21:15:06.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.189+0000 7fee2d28e640 1 -- 172.21.15.59:0/192327494 learned_addr learned my addr 172.21.15.59:0/192327494 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:06.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.189+0000 7fee2ca8d640 1 --2- 172.21.15.59:0/192327494 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d358d9650 0x560d358e2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:06.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.189+0000 7fee2da8f640 1 -- 172.21.15.59:0/192327494 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d358d9650 msgr2=0x560d358e2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:06.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.189+0000 7fee2da8f640 1 --2- 172.21.15.59:0/192327494 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d358d9650 0x560d358e2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.189+0000 7fee2da8f640 1 -- 172.21.15.59:0/192327494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358d8d30 msgr2=0x560d358e25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:06.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.189+0000 7fee2da8f640 1 --2- 172.21.15.59:0/192327494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358d8d30 0x560d358e25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.189+0000 7fee2da8f640 1 -- 172.21.15.59:0/192327494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d35808a00 con 0x560d358e55e0 2024-09-10T21:15:06.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.189+0000 7fee2d28e640 1 --2- 172.21.15.59:0/192327494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358d8d30 0x560d358e25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:15:06.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.189+0000 7fee2da8f640 1 --2- 172.21.15.59:0/192327494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 0x560d358e3060 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fee2000efd0 tx=0x7fee20005400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7aa0d2d1be89f97 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:06.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.189+0000 7fee10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:15:06.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.189+0000 7fee10ff9640 1 -- 172.21.15.59:0/192327494 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2001f070 con 0x560d358e55e0 2024-09-10T21:15:06.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.189+0000 7fee318c7740 1 -- 172.21.15.59:0/192327494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee200b0d50 con 0x560d358e55e0 2024-09-10T21:15:06.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.189+0000 7fee10ff9640 1 -- 172.21.15.59:0/192327494 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fee200e3dd0 con 0x560d358e55e0 2024-09-10T21:15:06.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.189+0000 7fee10ff9640 1 -- 172.21.15.59:0/192327494 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fee200b5800 con 0x560d358e55e0 2024-09-10T21:15:06.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.189+0000 7fee318c7740 10 client.15294 fetch_fsmap learned FSMap version 27 2024-09-10T21:15:06.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.189+0000 7fee318c7740 1 -- 172.21.15.59:0/192327494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560d358f81d0 con 0x560d358e55e0 2024-09-10T21:15:06.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.189+0000 7fee10ff9640 1 -- 172.21.15.59:0/192327494 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee200b0d50 con 0x560d358e55e0 2024-09-10T21:15:06.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.190+0000 7fee10ff9640 1 -- 172.21.15.59:0/192327494 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fee200a7dc0 con 0x560d358e55e0 2024-09-10T21:15:06.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.190+0000 7fee318c7740 10 client.15294 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:15:06.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.190+0000 7fee318c7740 10 client.15294 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T21:15:06.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.190+0000 7fee318c7740 20 client.15294 populate_metadata read hostname 'smithi059' 2024-09-10T21:15:06.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.190+0000 7fee318c7740 1 --2- 172.21.15.59:0/192327494 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x560d358fa380 0x560d358fb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:06.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.190+0000 7fee318c7740 4 client.15294 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:15:06.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.190+0000 7fee318c7740 1 -- 172.21.15.59:0/192327494 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d35852b60 con 0x560d358fa380 2024-09-10T21:15:06.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.190+0000 7fee2d28e640 1 --2- 172.21.15.59:0/192327494 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x560d358fa380 0x560d358fb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:06.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.191+0000 7fee10ff9640 10 client.15294 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:15:06.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.191+0000 7fee2d28e640 1 --2- 172.21.15.59:0/192327494 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x560d358fa380 0x560d358fb7f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7aa6a4f2baeb33 server_cookie=f44dc6b86b2fa790 in_seq=0 out_seq=0 2024-09-10T21:15:06.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.191+0000 7fee10ff9640 1 -- 172.21.15.59:0/192327494 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d35852b60 con 0x560d358fa380 2024-09-10T21:15:06.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.191+0000 7fee10ff9640 10 client.15294 handle_command_reply: tid=0 2024-09-10T21:15:06.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.191+0000 7fee318c7740 1 client.15294 shutdown 2024-09-10T21:15:06.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.192+0000 7fee318c7740 1 -- 172.21.15.59:0/192327494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 msgr2=0x560d358e3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:06.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.192+0000 7fee318c7740 1 --2- 172.21.15.59:0/192327494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 0x560d358e3060 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fee2000efd0 tx=0x7fee20005400 comp rx=0 tx=0).stop 2024-09-10T21:15:06.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.192+0000 7fee318c7740 1 -- 172.21.15.59:0/192327494 shutdown_connections 2024-09-10T21:15:06.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.192+0000 7fee318c7740 1 --2- 172.21.15.59:0/192327494 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x560d358fa380 0x560d358fb7f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.192+0000 7fee318c7740 1 --2- 172.21.15.59:0/192327494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 0x560d358e3060 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.192+0000 7fee10ff9640 0 client.15294 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:15:06.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.192+0000 7fee318c7740 1 --2- 172.21.15.59:0/192327494 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d358d9650 0x560d358e2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.192+0000 7fee318c7740 1 --2- 172.21.15.59:0/192327494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358d8d30 0x560d358e25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.192+0000 7fee318c7740 1 -- 172.21.15.59:0/192327494 >> 172.21.15.59:0/192327494 conn(0x560d358d6b60 msgr2=0x560d358dc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:06.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.192+0000 7fee318c7740 1 -- 172.21.15.59:0/192327494 shutdown_connections 2024-09-10T21:15:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.192+0000 7fee318c7740 1 -- 172.21.15.59:0/192327494 wait complete. 2024-09-10T21:15:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.192+0000 7fee318c7740 20 client.15294 trim_cache size 0 max 16384 2024-09-10T21:15:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.210+0000 7fee318c7740 1 Processor -- start 2024-09-10T21:15:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.210+0000 7fee318c7740 1 -- start start 2024-09-10T21:15:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.210+0000 7fee318c7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358d8d30 0x560d358df810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.210+0000 7fee318c7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d358d9650 0x560d358dfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.210+0000 7fee318c7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358e55e0 0x560d358e2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.210+0000 7fee318c7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560d358f9b30 con 0x560d358d8d30 2024-09-10T21:15:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.210+0000 7fee318c7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560d358fa200 con 0x560d358e55e0 2024-09-10T21:15:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.210+0000 7fee318c7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x560d358fa8d0 con 0x560d358d9650 2024-09-10T21:15:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.210+0000 7fee2d28e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358d8d30 0x560d358df810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.210+0000 7fee2d28e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358d8d30 0x560d358df810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56276/0 (socket says 172.21.15.59:56276) 2024-09-10T21:15:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.211+0000 7fee2d28e640 1 -- 172.21.15.59:0/2728131929 learned_addr learned my addr 172.21.15.59:0/2728131929 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:06.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.211+0000 7fee2d28e640 1 -- 172.21.15.59:0/2728131929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d358d9650 msgr2=0x560d358dfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.211+0000 7fee2d28e640 1 --2- 172.21.15.59:0/2728131929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d358d9650 0x560d358dfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.211+0000 7fee2d28e640 1 -- 172.21.15.59:0/2728131929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358e55e0 msgr2=0x560d358e2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.211+0000 7fee2d28e640 1 --2- 172.21.15.59:0/2728131929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358e55e0 0x560d358e2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.211+0000 7fee2d28e640 1 -- 172.21.15.59:0/2728131929 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d358d6990 con 0x560d358d8d30 2024-09-10T21:15:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.211+0000 7fee2d28e640 1 --2- 172.21.15.59:0/2728131929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358d8d30 0x560d358df810 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fee2400f790 tx=0x7fee24012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c7bb392a8da5dd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.211+0000 7fee12ffd640 1 -- 172.21.15.59:0/2728131929 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2402c070 con 0x560d358d8d30 2024-09-10T21:15:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.211+0000 7fee12ffd640 1 -- 172.21.15.59:0/2728131929 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee24010c60 con 0x560d358d8d30 2024-09-10T21:15:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.211+0000 7fee12ffd640 1 -- 172.21.15.59:0/2728131929 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee24016070 con 0x560d358d8d30 2024-09-10T21:15:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.212+0000 7fee318c7740 1 -- 172.21.15.59:0/2728131929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358d8d30 msgr2=0x560d358df810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.212+0000 7fee318c7740 1 --2- 172.21.15.59:0/2728131929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358d8d30 0x560d358df810 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fee2400f790 tx=0x7fee24012000 comp rx=0 tx=0).stop 2024-09-10T21:15:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.212+0000 7fee318c7740 1 -- 172.21.15.59:0/2728131929 shutdown_connections 2024-09-10T21:15:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.212+0000 7fee318c7740 1 --2- 172.21.15.59:0/2728131929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358e55e0 0x560d358e2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.212+0000 7fee318c7740 1 --2- 172.21.15.59:0/2728131929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d358d9650 0x560d358dfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.212+0000 7fee318c7740 1 --2- 172.21.15.59:0/2728131929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358d8d30 0x560d358df810 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.212+0000 7fee318c7740 1 -- 172.21.15.59:0/2728131929 >> 172.21.15.59:0/2728131929 conn(0x560d358d6b60 msgr2=0x560d358dd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:06.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.212+0000 7fee318c7740 1 -- 172.21.15.59:0/2728131929 shutdown_connections 2024-09-10T21:15:06.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.212+0000 7fee318c7740 1 -- 172.21.15.59:0/2728131929 wait complete. 2024-09-10T21:15:06.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.212+0000 7fee318c7740 1 -- start start 2024-09-10T21:15:06.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.212+0000 7fee318c7740 1 Processor -- start 2024-09-10T21:15:06.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee318c7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358d8d30 0x560d35903fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:06.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee318c7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d358d9650 0x560d358fe910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:06.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee318c7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 0x560d358fee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:06.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee318c7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560d358fb670 con 0x560d358e55e0 2024-09-10T21:15:06.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee318c7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560d358fafa0 con 0x560d358d8d30 2024-09-10T21:15:06.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee318c7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x560d358fbd40 con 0x560d358d9650 2024-09-10T21:15:06.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee318c7740 10 client.0 _ll_register_callbacks cb 0x7fee2400a7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:15:06.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee2da8f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 0x560d358fee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:06.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee2da8f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 0x560d358fee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56284/0 (socket says 172.21.15.59:56284) 2024-09-10T21:15:06.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee2da8f640 1 -- 172.21.15.59:0/3487788327 learned_addr learned my addr 172.21.15.59:0/3487788327 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:06.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee2d28e640 1 --2- 172.21.15.59:0/3487788327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358d8d30 0x560d35903fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:06.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee2ca8d640 1 --2- 172.21.15.59:0/3487788327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d358d9650 0x560d358fe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:06.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee2da8f640 1 -- 172.21.15.59:0/3487788327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d358d9650 msgr2=0x560d358fe910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:06.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee2da8f640 1 --2- 172.21.15.59:0/3487788327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d358d9650 0x560d358fe910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee2da8f640 1 -- 172.21.15.59:0/3487788327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358d8d30 msgr2=0x560d35903fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:06.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee2da8f640 1 --2- 172.21.15.59:0/3487788327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358d8d30 0x560d35903fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee2da8f640 1 -- 172.21.15.59:0/3487788327 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d358d75e0 con 0x560d358e55e0 2024-09-10T21:15:06.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee2da8f640 1 --2- 172.21.15.59:0/3487788327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 0x560d358fee50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fee20009270 tx=0x7fee200e3e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f73110f78fe3ee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:06.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:15:06.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee10ff9640 1 -- 172.21.15.59:0/3487788327 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2001f040 con 0x560d358e55e0 2024-09-10T21:15:06.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee10ff9640 1 -- 172.21.15.59:0/3487788327 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fee200d3170 con 0x560d358e55e0 2024-09-10T21:15:06.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.213+0000 7fee318c7740 1 -- 172.21.15.59:0/3487788327 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee24010c60 con 0x560d358e55e0 2024-09-10T21:15:06.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.214+0000 7fee10ff9640 1 -- 172.21.15.59:0/3487788327 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fee200a84e0 con 0x560d358e55e0 2024-09-10T21:15:06.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.214+0000 7fee318c7740 10 client.15300 fetch_fsmap learned FSMap version 27 2024-09-10T21:15:06.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.214+0000 7fee318c7740 1 -- 172.21.15.59:0/3487788327 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560d359678a0 con 0x560d358e55e0 2024-09-10T21:15:06.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.214+0000 7fee10ff9640 1 -- 172.21.15.59:0/3487788327 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee24010c60 con 0x560d358e55e0 2024-09-10T21:15:06.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.214+0000 7fee10ff9640 1 -- 172.21.15.59:0/3487788327 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fee200a7bc0 con 0x560d358e55e0 2024-09-10T21:15:06.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.214+0000 7fee318c7740 10 client.15300 fetch_fsmap finished waiting for FSMap version 27 2024-09-10T21:15:06.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.214+0000 7fee318c7740 10 client.15300 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T21:15:06.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.214+0000 7fee318c7740 20 client.15300 populate_metadata read hostname 'smithi059' 2024-09-10T21:15:06.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.214+0000 7fee318c7740 1 --2- 172.21.15.59:0/3487788327 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x560d3596c1e0 0x560d3596aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:06.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.214+0000 7fee318c7740 4 client.15300 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T21:15:06.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.214+0000 7fee318c7740 1 -- 172.21.15.59:0/3487788327 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "status"}) -- 0x560d3584e610 con 0x560d3596c1e0 2024-09-10T21:15:06.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.214+0000 7fee2d28e640 1 --2- 172.21.15.59:0/3487788327 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x560d3596c1e0 0x560d3596aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:06.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.215+0000 7fee2d28e640 1 --2- 172.21.15.59:0/3487788327 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x560d3596c1e0 0x560d3596aef0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8776a7dee07136c server_cookie=98264d1a1488ff20 in_seq=0 out_seq=0 2024-09-10T21:15:06.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.215+0000 7fee10ff9640 10 client.15300 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:15:06.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.215+0000 7fee10ff9640 1 -- 172.21.15.59:0/3487788327 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x560d3584e610 con 0x560d3596c1e0 2024-09-10T21:15:06.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.215+0000 7fee10ff9640 10 client.15300 handle_command_reply: tid=0 2024-09-10T21:15:06.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.215+0000 7fee318c7740 1 client.15300 shutdown 2024-09-10T21:15:06.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.215+0000 7fee318c7740 1 -- 172.21.15.59:0/3487788327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 msgr2=0x560d358fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:06.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.215+0000 7fee318c7740 1 --2- 172.21.15.59:0/3487788327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 0x560d358fee50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fee20009270 tx=0x7fee200e3e00 comp rx=0 tx=0).stop 2024-09-10T21:15:06.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.215+0000 7fee318c7740 1 -- 172.21.15.59:0/3487788327 shutdown_connections 2024-09-10T21:15:06.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.215+0000 7fee318c7740 1 --2- 172.21.15.59:0/3487788327 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x560d3596c1e0 0x560d3596aef0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.251 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:15:06.252 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "3c26b952-6fb8-11ef-bcea-c7b262605968", 2024-09-10T21:15:06.252 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-09-10T21:15:06.252 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 24563, 2024-09-10T21:15:06.252 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-09-10T21:15:06.252 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-09-10T21:15:06.252 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-09-10T21:15:06.252 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 106.570778288, 2024-09-10T21:15:06.252 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 27, 2024-09-10T21:15:06.252 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 75, 2024-09-10T21:15:06.252 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 73, 2024-09-10T21:15:06.252 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 116.733016818 2024-09-10T21:15:06.252 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:15:06.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.215+0000 7fee318c7740 1 --2- 172.21.15.59:0/3487788327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d358e55e0 0x560d358fee50 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.215+0000 7fee318c7740 1 --2- 172.21.15.59:0/3487788327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560d358d9650 0x560d358fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.215+0000 7fee318c7740 1 --2- 172.21.15.59:0/3487788327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560d358d8d30 0x560d35903fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.215+0000 7fee318c7740 1 -- 172.21.15.59:0/3487788327 >> 172.21.15.59:0/3487788327 conn(0x560d358d6b60 msgr2=0x560d358e3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:06.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.215+0000 7fee10ff9640 0 client.15300 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:15:06.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.215+0000 7fee318c7740 1 -- 172.21.15.59:0/3487788327 shutdown_connections 2024-09-10T21:15:06.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.215+0000 7fee318c7740 1 -- 172.21.15.59:0/3487788327 wait complete. 2024-09-10T21:15:06.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.215+0000 7fee318c7740 20 client.15300 trim_cache size 0 max 16384 2024-09-10T21:15:06.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.216+0000 7fee2f4f2640 1 -- 172.21.15.59:0/682883280 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fee140b5370 msgr2=0x7fee140b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.216+0000 7fee2f4f2640 1 --2- 172.21.15.59:0/682883280 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fee140b5370 0x7fee140b7830 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fee240058c0 tx=0x7fee2400a250 comp rx=0 tx=0).stop 2024-09-10T21:15:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.216+0000 7fee2f4f2640 1 -- 172.21.15.59:0/682883280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee2810d160 msgr2=0x7fee2819eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.216+0000 7fee2f4f2640 1 --2- 172.21.15.59:0/682883280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee2810d160 0x7fee2819eb70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fee2000eaa0 tx=0x7fee2000ef60 comp rx=0 tx=0).stop 2024-09-10T21:15:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.216+0000 7fee2f4f2640 1 -- 172.21.15.59:0/682883280 shutdown_connections 2024-09-10T21:15:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.216+0000 7fee2f4f2640 1 --2- 172.21.15.59:0/682883280 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fee140b5370 0x7fee140b7830 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.216+0000 7fee2f4f2640 1 --2- 172.21.15.59:0/682883280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee2810d160 0x7fee2819eb70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.216+0000 7fee2f4f2640 1 --2- 172.21.15.59:0/682883280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee281045b0 0x7fee281997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.216+0000 7fee2f4f2640 1 --2- 172.21.15.59:0/682883280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee28103bb0 0x7fee28199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.216+0000 7fee2f4f2640 1 -- 172.21.15.59:0/682883280 >> 172.21.15.59:0/682883280 conn(0x7fee280fd700 msgr2=0x7fee280fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.216+0000 7fee2f4f2640 1 -- 172.21.15.59:0/682883280 shutdown_connections 2024-09-10T21:15:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:06.216+0000 7fee2f4f2640 1 -- 172.21.15.59:0/682883280 wait complete. 2024-09-10T21:15:06.902 INFO:teuthology.run_tasks:Running task kclient... 2024-09-10T21:15:06.930 INFO:tasks.kclient:Mounting kernel clients... 2024-09-10T21:15:06.930 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-10T21:15:06.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:15:06.930 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-09-10T21:15:06.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:15:06.949 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2024-09-10T21:15:07.019 INFO:teuthology.orchestra.run.smithi059.stderr:Cannot find device "ceph-brx" 2024-09-10T21:15:07.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:15:07.021 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-10T21:15:07.021 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T21:15:07.021 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T21:15:07.022 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T21:15:07.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:06 smithi059 ceph-mon[30888]: pgmap v335: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:15:07.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:06 smithi154 ceph-mon[35041]: pgmap v335: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:15:07.320 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:15:07.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:06 smithi192 ceph-mon[35363]: pgmap v335: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:15:07.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.952+0000 7f2527b43640 1 -- 172.21.15.59:0/652687087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2520101cd0 msgr2=0x7f25201020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.952+0000 7f2527b43640 1 --2- 172.21.15.59:0/652687087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2520101cd0 0x7f25201020b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f251c009900 tx=0x7f251c02a410 comp rx=0 tx=0).stop 2024-09-10T21:15:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.952+0000 7f2527b43640 1 -- 172.21.15.59:0/652687087 shutdown_connections 2024-09-10T21:15:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.952+0000 7f2527b43640 1 --2- 172.21.15.59:0/652687087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2520108060 0x7f252010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.952+0000 7f2527b43640 1 --2- 172.21.15.59:0/652687087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25201076e0 0x7f2520107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.952+0000 7f2527b43640 1 --2- 172.21.15.59:0/652687087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2520101cd0 0x7f25201020b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.952+0000 7f2527b43640 1 -- 172.21.15.59:0/652687087 >> 172.21.15.59:0/652687087 conn(0x7f25200fd700 msgr2=0x7f25200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.952+0000 7f2527b43640 1 -- 172.21.15.59:0/652687087 shutdown_connections 2024-09-10T21:15:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.952+0000 7f2527b43640 1 -- 172.21.15.59:0/652687087 wait complete. 2024-09-10T21:15:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.953+0000 7f2527b43640 1 Processor -- start 2024-09-10T21:15:07.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.953+0000 7f2527b43640 1 -- start start 2024-09-10T21:15:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.953+0000 7f2527b43640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2520101cd0 0x7f25200fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.953+0000 7f2527b43640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25201076e0 0x7f25200fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.953+0000 7f2527b43640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2520108060 0x7f25200fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.953+0000 7f2527b43640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2520111db0 con 0x7f2520108060 2024-09-10T21:15:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.953+0000 7f2527b43640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2520111c30 con 0x7f25201076e0 2024-09-10T21:15:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.953+0000 7f2527b43640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2520111f30 con 0x7f2520101cd0 2024-09-10T21:15:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.953+0000 7f25260e0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2520108060 0x7f25200fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:07.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.953+0000 7f25260e0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2520108060 0x7f25200fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56290/0 (socket says 172.21.15.59:56290) 2024-09-10T21:15:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.953+0000 7f25260e0640 1 -- 172.21.15.59:0/1808832995 learned_addr learned my addr 172.21.15.59:0/1808832995 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.953+0000 7f25250de640 1 --2- 172.21.15.59:0/1808832995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25201076e0 0x7f25200fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.953+0000 7f25258df640 1 --2- 172.21.15.59:0/1808832995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2520101cd0 0x7f25200fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.953+0000 7f25260e0640 1 -- 172.21.15.59:0/1808832995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2520101cd0 msgr2=0x7f25200fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.953+0000 7f25260e0640 1 --2- 172.21.15.59:0/1808832995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2520101cd0 0x7f25200fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.953+0000 7f25260e0640 1 -- 172.21.15.59:0/1808832995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25201076e0 msgr2=0x7f25200fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.953+0000 7f25260e0640 1 --2- 172.21.15.59:0/1808832995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25201076e0 0x7f25200fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.953+0000 7f25260e0640 1 -- 172.21.15.59:0/1808832995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25201a7890 con 0x7f2520108060 2024-09-10T21:15:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.954+0000 7f25260e0640 1 --2- 172.21.15.59:0/1808832995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2520108060 0x7f25200fe680 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f251800b970 tx=0x7f251800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.954+0000 7f2516ffd640 1 -- 172.21.15.59:0/1808832995 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2518019070 con 0x7f2520108060 2024-09-10T21:15:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.954+0000 7f2527b43640 1 -- 172.21.15.59:0/1808832995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25201a7b80 con 0x7f2520108060 2024-09-10T21:15:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.954+0000 7f2516ffd640 1 -- 172.21.15.59:0/1808832995 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2518014440 con 0x7f2520108060 2024-09-10T21:15:07.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.954+0000 7f2516ffd640 1 -- 172.21.15.59:0/1808832995 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25180075d0 con 0x7f2520108060 2024-09-10T21:15:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.954+0000 7f2527b43640 1 -- 172.21.15.59:0/1808832995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25201a8070 con 0x7f2520108060 2024-09-10T21:15:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.955+0000 7f2527b43640 1 -- 172.21.15.59:0/1808832995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2520102130 con 0x7f2520108060 2024-09-10T21:15:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.956+0000 7f2516ffd640 1 -- 172.21.15.59:0/1808832995 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f25180145f0 con 0x7f2520108060 2024-09-10T21:15:07.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.957+0000 7f2516ffd640 1 --2- 172.21.15.59:0/1808832995 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f250c0b52e0 0x7f250c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.957+0000 7f25258df640 1 --2- 172.21.15.59:0/1808832995 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f250c0b52e0 0x7f250c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.957+0000 7f2516ffd640 1 -- 172.21.15.59:0/1808832995 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f25180e5390 con 0x7f2520108060 2024-09-10T21:15:07.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.958+0000 7f25258df640 1 --2- 172.21.15.59:0/1808832995 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f250c0b52e0 0x7f250c0b77a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f251c02a930 tx=0x7f251c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:07.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:07.962+0000 7f2516ffd640 1 -- 172.21.15.59:0/1808832995 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f25180ac220 con 0x7f2520108060 2024-09-10T21:15:08.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:08.189+0000 7f2527b43640 1 -- 172.21.15.59:0/1808832995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f252010ae50 con 0x7f2520108060 2024-09-10T21:15:08.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:08.190+0000 7f2516ffd640 1 -- 172.21.15.59:0/1808832995 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f25180abb20 con 0x7f2520108060 2024-09-10T21:15:08.194 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T21:15:08.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:08.192+0000 7f2527b43640 1 -- 172.21.15.59:0/1808832995 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f250c0b52e0 msgr2=0x7f250c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:08.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:08.192+0000 7f2527b43640 1 --2- 172.21.15.59:0/1808832995 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f250c0b52e0 0x7f250c0b77a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f251c02a930 tx=0x7f251c005fd0 comp rx=0 tx=0).stop 2024-09-10T21:15:08.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:08.192+0000 7f2527b43640 1 -- 172.21.15.59:0/1808832995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2520108060 msgr2=0x7f25200fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:08.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:08.192+0000 7f2527b43640 1 --2- 172.21.15.59:0/1808832995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2520108060 0x7f25200fe680 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f251800b970 tx=0x7f251800bd70 comp rx=0 tx=0).stop 2024-09-10T21:15:08.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:08.192+0000 7f2527b43640 1 -- 172.21.15.59:0/1808832995 shutdown_connections 2024-09-10T21:15:08.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:08.192+0000 7f2527b43640 1 --2- 172.21.15.59:0/1808832995 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f250c0b52e0 0x7f250c0b77a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:08.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:08.192+0000 7f2527b43640 1 --2- 172.21.15.59:0/1808832995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2520108060 0x7f25200fe680 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:08.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:08.192+0000 7f2527b43640 1 --2- 172.21.15.59:0/1808832995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25201076e0 0x7f25200fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:08.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:08.192+0000 7f2527b43640 1 --2- 172.21.15.59:0/1808832995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2520101cd0 0x7f25200fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:08.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:08.192+0000 7f2527b43640 1 -- 172.21.15.59:0/1808832995 >> 172.21.15.59:0/1808832995 conn(0x7f25200fd700 msgr2=0x7f252006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:08.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:08.192+0000 7f2527b43640 1 -- 172.21.15.59:0/1808832995 shutdown_connections 2024-09-10T21:15:08.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:08.192+0000 7f2527b43640 1 -- 172.21.15.59:0/1808832995 wait complete. 2024-09-10T21:15:08.879 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T21:15:08.879 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T21:15:08.879 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-09-10T21:15:08.879 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T21:15:08.879 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T21:15:08.879 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T21:15:08.879 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T21:15:08.880 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T21:15:08.880 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T21:15:08.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:15:08.880 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-09-10T21:15:08.899 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T21:15:08.899 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T21:15:08.899 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T21:15:08.899 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:15:08.900 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-09-10T21:15:08.900 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:15:08.900 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:15:08.900 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-09-10T21:15:08.900 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-09-10T21:15:08.900 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:15:08.901 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-09-10T21:15:08.901 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-09-10T21:15:08.901 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T21:15:08.901 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-09-10T21:15:08.901 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-09-10T21:15:08.901 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T21:15:08.902 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42169sec preferred_lft 42169sec 2024-09-10T21:15:08.902 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-09-10T21:15:08.902 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-09-10T21:15:08.902 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T21:15:08.902 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-09-10T21:15:08.902 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-09-10T21:15:08.903 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T21:15:08.903 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:15:08.903 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-09-10T21:15:08.904 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add name ceph-brx type bridge 2024-09-10T21:15:08.904 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr flush dev ceph-brx 2024-09-10T21:15:08.904 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set ceph-brx up 2024-09-10T21:15:08.904 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T21:15:08.904 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-09-10T21:15:08.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:15:09.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:08 smithi059 ceph-mon[30888]: pgmap v336: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-10T21:15:09.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:08 smithi059 ceph-mon[30888]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-10T21:15:09.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:08 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1808832995' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T21:15:09.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:08 smithi154 ceph-mon[35041]: pgmap v336: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-10T21:15:09.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:08 smithi154 ceph-mon[35041]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-10T21:15:09.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:08 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1808832995' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T21:15:09.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:15:09.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:15:09.224 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T21:15:09.251 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-09-10T21:15:09.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:15:09.253 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-09-10T21:15:09.323 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-09-10T21:15:09.323 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T21:15:09.323 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T21:15:09.323 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T21:15:09.323 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T21:15:09.324 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:15:09.324 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-09-10T21:15:09.324 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T21:15:09.324 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T21:15:09.324 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T21:15:09.324 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-09-10T21:15:09.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:08 smithi192 ceph-mon[35363]: pgmap v336: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-10T21:15:09.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:08 smithi192 ceph-mon[35363]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-10T21:15:09.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:08 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1808832995' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T21:15:09.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:15:09.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:15:09.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:15:09.787 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-09-10T21:15:09.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:15:09.804 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list-id 2024-09-10T21:15:09.860 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:15:09.861 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-09-10T21:15:09.861 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:15:09.861 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T21:15:09.861 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-09-10T21:15:09.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:15:09.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:15:09.981 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T21:15:09.982 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:15:09.982 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-09-10T21:15:09.982 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T21:15:09.982 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T21:15:09.982 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T21:15:09.982 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T21:15:09.982 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T21:15:09.982 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-09-10T21:15:10.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:15:10.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:15:10.230 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T21:15:10.230 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-09-10T21:15:10.230 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-09-10T21:15:10.231 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T21:15:10.231 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-09-10T21:15:10.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:15:10.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:15:10.310 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T21:15:10.310 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T21:15:10.325 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T21:15:10.326 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T21:15:10.326 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T21:15:10.381 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-10T21:15:10.381 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-10T21:15:10.381 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/4283cf76-93d2-406f-aa44-8c41ee73380a 2024-09-10T21:15:10.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:15:10.381 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/4283cf76-93d2-406f-aa44-8c41ee73380a /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-10T21:15:10.504 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-10T21:15:10.505 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-10T21:15:10.505 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-09-10T21:15:10.667 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-10T21:15:10.667 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-10T21:15:10.667 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-09-10T21:15:10.667 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.154:3300,172.21.15.192:3300" 2024-09-10T21:15:10.667 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:3300,172.21.15.154:3300,172.21.15.192:3300:/volumes/qa/sv_1/4283cf76-93d2-406f-aa44-8c41ee73380a 2024-09-10T21:15:10.668 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=3c26b952-6fb8-11ef-bcea-c7b262605968" will pass to kernel 2024-09-10T21:15:10.668 INFO:teuthology.orchestra.run.smithi059.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T21:15:10.668 INFO:teuthology.orchestra.run.smithi059.stdout: You just mounted a file system that supports labels which does not 2024-09-10T21:15:10.669 INFO:teuthology.orchestra.run.smithi059.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T21:15:10.669 INFO:teuthology.orchestra.run.smithi059.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T21:15:10.669 INFO:teuthology.orchestra.run.smithi059.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T21:15:10.670 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T21:15:10.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:15:10.670 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T21:15:10.698 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T21:15:10.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T21:15:10.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:15:10.796 INFO:teuthology.orchestra.run.smithi059.stdout:client24916 2024-09-10T21:15:10.797 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T21:15:10.797 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:15:10.814 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T21:15:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T21:15:10.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:15:10.912 INFO:teuthology.orchestra.run.smithi059.stdout:client24916 2024-09-10T21:15:10.913 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T21:15:10.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T21:15:10.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:15:10.972 INFO:teuthology.orchestra.run.smithi059.stdout:client24916 2024-09-10T21:15:10.972 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968.client24916/status') 2024-09-10T21:15:11.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T21:15:11.032 INFO:teuthology.orchestra.run.smithi059.stdout:instance: client.24916 (3)172.21.15.59:0/311033238 2024-09-10T21:15:11.032 INFO:teuthology.orchestra.run.smithi059.stdout:blocklisted: false 2024-09-10T21:15:11.032 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2024-09-10T21:15:11.032 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2024-09-10T21:15:11.032 INFO:teuthology.orchestra.run.smithi059.stderr:70 bytes copied, 2.5867e-05 s, 2.7 MB/s 2024-09-10T21:15:11.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T21:15:11.040 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T21:15:11.050 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T21:15:11.050 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi059.front.sepia.ceph.com 2024-09-10T21:15:11.050 DEBUG:teuthology.orchestra.run.smithi059:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-10T21:15:11.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.151+0000 7f2143564640 1 -- 172.21.15.59:0/905922539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213c06bfb0 msgr2=0x7f213c105580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:11.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.151+0000 7f2143564640 1 --2- 172.21.15.59:0/905922539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213c06bfb0 0x7f213c105580 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2138009ca0 tx=0x7f213802a8e0 comp rx=0 tx=0).stop 2024-09-10T21:15:11.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.151+0000 7f2143564640 1 -- 172.21.15.59:0/905922539 shutdown_connections 2024-09-10T21:15:11.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.151+0000 7f2143564640 1 --2- 172.21.15.59:0/905922539 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f213c1086c0 0x7f213c10ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:11.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.151+0000 7f2143564640 1 --2- 172.21.15.59:0/905922539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f213c105b10 0x7f213c107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:11.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.151+0000 7f2143564640 1 --2- 172.21.15.59:0/905922539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213c06bfb0 0x7f213c105580 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:11.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.151+0000 7f2143564640 1 -- 172.21.15.59:0/905922539 >> 172.21.15.59:0/905922539 conn(0x7f213c0fd150 msgr2=0x7f213c0ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:11.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.151+0000 7f2143564640 1 -- 172.21.15.59:0/905922539 shutdown_connections 2024-09-10T21:15:11.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.151+0000 7f2143564640 1 -- 172.21.15.59:0/905922539 wait complete. 2024-09-10T21:15:11.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.152+0000 7f2143564640 1 Processor -- start 2024-09-10T21:15:11.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.152+0000 7f2143564640 1 -- start start 2024-09-10T21:15:11.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.152+0000 7f2143564640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f213c06bfb0 0x7f213c102cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:11.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.152+0000 7f2143564640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f213c105b10 0x7f213c101520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:11.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.152+0000 7f2143564640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213c1086c0 0x7f213c101a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:11.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.152+0000 7f2143564640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f213c10e690 con 0x7f213c1086c0 2024-09-10T21:15:11.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.152+0000 7f2143564640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f213c10e510 con 0x7f213c105b10 2024-09-10T21:15:11.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.152+0000 7f2143564640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f213c10e810 con 0x7f213c06bfb0 2024-09-10T21:15:11.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.153+0000 7f2141b01640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213c1086c0 0x7f213c101a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:11.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.153+0000 7f2141b01640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213c1086c0 0x7f213c101a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59294/0 (socket says 172.21.15.59:59294) 2024-09-10T21:15:11.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.153+0000 7f2141b01640 1 -- 172.21.15.59:0/2329538199 learned_addr learned my addr 172.21.15.59:0/2329538199 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:11.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.153+0000 7f2140aff640 1 --2- 172.21.15.59:0/2329538199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f213c105b10 0x7f213c101520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:11.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.153+0000 7f2141300640 1 --2- 172.21.15.59:0/2329538199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f213c06bfb0 0x7f213c102cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:11.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.153+0000 7f2141b01640 1 -- 172.21.15.59:0/2329538199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f213c06bfb0 msgr2=0x7f213c102cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:11.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.153+0000 7f2141b01640 1 --2- 172.21.15.59:0/2329538199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f213c06bfb0 0x7f213c102cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:11.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.153+0000 7f2141b01640 1 -- 172.21.15.59:0/2329538199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f213c105b10 msgr2=0x7f213c101520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:11.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.153+0000 7f2141b01640 1 --2- 172.21.15.59:0/2329538199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f213c105b10 0x7f213c101520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:11.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.153+0000 7f2141b01640 1 -- 172.21.15.59:0/2329538199 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f213c1022d0 con 0x7f213c1086c0 2024-09-10T21:15:11.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.153+0000 7f2141b01640 1 --2- 172.21.15.59:0/2329538199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213c1086c0 0x7f213c101a60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f213400c970 tx=0x7f213400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:11.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.153+0000 7f21327fc640 1 -- 172.21.15.59:0/2329538199 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2134007bb0 con 0x7f213c1086c0 2024-09-10T21:15:11.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.153+0000 7f21327fc640 1 -- 172.21.15.59:0/2329538199 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2134007d50 con 0x7f213c1086c0 2024-09-10T21:15:11.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.153+0000 7f2143564640 1 -- 172.21.15.59:0/2329538199 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f213c1a2fb0 con 0x7f213c1086c0 2024-09-10T21:15:11.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.153+0000 7f21327fc640 1 -- 172.21.15.59:0/2329538199 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2134004e60 con 0x7f213c1086c0 2024-09-10T21:15:11.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.153+0000 7f2143564640 1 -- 172.21.15.59:0/2329538199 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f213c1a34a0 con 0x7f213c1086c0 2024-09-10T21:15:11.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.154+0000 7f2143564640 1 -- 172.21.15.59:0/2329538199 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f213c0fec40 con 0x7f213c1086c0 2024-09-10T21:15:11.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.156+0000 7f21327fc640 1 -- 172.21.15.59:0/2329538199 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f2134005020 con 0x7f213c1086c0 2024-09-10T21:15:11.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.156+0000 7f21327fc640 1 --2- 172.21.15.59:0/2329538199 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f21280b52e0 0x7f21280b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:11.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.156+0000 7f2141300640 1 --2- 172.21.15.59:0/2329538199 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f21280b52e0 0x7f21280b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:11.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.157+0000 7f21327fc640 1 -- 172.21.15.59:0/2329538199 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f21340e5900 con 0x7f213c1086c0 2024-09-10T21:15:11.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.157+0000 7f2141300640 1 --2- 172.21.15.59:0/2329538199 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f21280b52e0 0x7f21280b77a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2138031930 tx=0x7f21380093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:11.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.160+0000 7f21327fc640 1 -- 172.21.15.59:0/2329538199 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2134014030 con 0x7f213c1086c0 2024-09-10T21:15:11.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:10 smithi154 ceph-mon[35041]: pgmap v337: 97 pgs: 97 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T21:15:11.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:10 smithi192 ceph-mon[35363]: pgmap v337: 97 pgs: 97 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T21:15:11.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.385+0000 7f2143564640 1 -- 172.21.15.59:0/2329538199 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f213c063d50 con 0x7f213c1086c0 2024-09-10T21:15:11.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:10 smithi059 ceph-mon[30888]: pgmap v337: 97 pgs: 97 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T21:15:11.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.933+0000 7f21327fc640 1 -- 172.21.15.59:0/2329538199 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7f21340ac7f0 con 0x7f213c1086c0 2024-09-10T21:15:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.937+0000 7f2143564640 1 -- 172.21.15.59:0/2329538199 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f21280b52e0 msgr2=0x7f21280b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.937+0000 7f2143564640 1 --2- 172.21.15.59:0/2329538199 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f21280b52e0 0x7f21280b77a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2138031930 tx=0x7f21380093f0 comp rx=0 tx=0).stop 2024-09-10T21:15:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.937+0000 7f2143564640 1 -- 172.21.15.59:0/2329538199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213c1086c0 msgr2=0x7f213c101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.937+0000 7f2143564640 1 --2- 172.21.15.59:0/2329538199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213c1086c0 0x7f213c101a60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f213400c970 tx=0x7f213400ce30 comp rx=0 tx=0).stop 2024-09-10T21:15:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.937+0000 7f2143564640 1 -- 172.21.15.59:0/2329538199 shutdown_connections 2024-09-10T21:15:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.937+0000 7f2143564640 1 --2- 172.21.15.59:0/2329538199 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f21280b52e0 0x7f21280b77a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.937+0000 7f2143564640 1 --2- 172.21.15.59:0/2329538199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f213c1086c0 0x7f213c101a60 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.937+0000 7f2143564640 1 --2- 172.21.15.59:0/2329538199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f213c105b10 0x7f213c101520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.937+0000 7f2143564640 1 --2- 172.21.15.59:0/2329538199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f213c06bfb0 0x7f213c102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.937+0000 7f2143564640 1 -- 172.21.15.59:0/2329538199 >> 172.21.15.59:0/2329538199 conn(0x7f213c0fd150 msgr2=0x7f213c103e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.937+0000 7f2143564640 1 -- 172.21.15.59:0/2329538199 shutdown_connections 2024-09-10T21:15:11.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:11.937+0000 7f2143564640 1 -- 172.21.15.59:0/2329538199 wait complete. 2024-09-10T21:15:11.954 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-10T21:15:11.967 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-10T21:15:12.006 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:15:12.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.114+0000 7f06aaba0640 1 -- 172.21.15.59:0/409161141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a41018b0 msgr2=0x7f06a4101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:12.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.114+0000 7f06aaba0640 1 --2- 172.21.15.59:0/409161141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a41018b0 0x7f06a4101cb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0698009930 tx=0x7f069802a420 comp rx=0 tx=0).stop 2024-09-10T21:15:12.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.114+0000 7f06aaba0640 1 -- 172.21.15.59:0/409161141 shutdown_connections 2024-09-10T21:15:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.114+0000 7f06aaba0640 1 --2- 172.21.15.59:0/409161141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06a41033c0 0x7f06a4109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.114+0000 7f06aaba0640 1 --2- 172.21.15.59:0/409161141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06a4102a00 0x7f06a4102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.114+0000 7f06aaba0640 1 --2- 172.21.15.59:0/409161141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a41018b0 0x7f06a4101cb0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.114+0000 7f06aaba0640 1 -- 172.21.15.59:0/409161141 >> 172.21.15.59:0/409161141 conn(0x7f06a40fd190 msgr2=0x7f06a40ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.114+0000 7f06aaba0640 1 -- 172.21.15.59:0/409161141 shutdown_connections 2024-09-10T21:15:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.114+0000 7f06aaba0640 1 -- 172.21.15.59:0/409161141 wait complete. 2024-09-10T21:15:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.115+0000 7f06aaba0640 1 Processor -- start 2024-09-10T21:15:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.115+0000 7f06aaba0640 1 -- start start 2024-09-10T21:15:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.115+0000 7f06aaba0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06a41018b0 0x7f06a4198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.115+0000 7f06aaba0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06a4102a00 0x7f06a4199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.115+0000 7f06aaba0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a41033c0 0x7f06a419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.115+0000 7f06aaba0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f06a410e610 con 0x7f06a41033c0 2024-09-10T21:15:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.115+0000 7f06aaba0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f06a410e490 con 0x7f06a41018b0 2024-09-10T21:15:12.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.115+0000 7f06aaba0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f06a410e790 con 0x7f06a4102a00 2024-09-10T21:15:12.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.115+0000 7f06a913d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a41033c0 0x7f06a419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:12.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.115+0000 7f06a913d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a41033c0 0x7f06a419a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59318/0 (socket says 172.21.15.59:59318) 2024-09-10T21:15:12.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.115+0000 7f06a913d640 1 -- 172.21.15.59:0/41633489 learned_addr learned my addr 172.21.15.59:0/41633489 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:12.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.116+0000 7f06a893c640 1 --2- 172.21.15.59:0/41633489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06a41018b0 0x7f06a4198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:12.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.116+0000 7f06a3fff640 1 --2- 172.21.15.59:0/41633489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06a4102a00 0x7f06a4199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:12.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.116+0000 7f06a913d640 1 -- 172.21.15.59:0/41633489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06a4102a00 msgr2=0x7f06a4199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:12.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.116+0000 7f06a913d640 1 --2- 172.21.15.59:0/41633489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06a4102a00 0x7f06a4199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.116+0000 7f06a913d640 1 -- 172.21.15.59:0/41633489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06a41018b0 msgr2=0x7f06a4198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:12.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.116+0000 7f06a913d640 1 --2- 172.21.15.59:0/41633489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06a41018b0 0x7f06a4198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.116+0000 7f06a913d640 1 -- 172.21.15.59:0/41633489 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a419a940 con 0x7f06a41033c0 2024-09-10T21:15:12.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.116+0000 7f06a913d640 1 --2- 172.21.15.59:0/41633489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a41033c0 0x7f06a419a080 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f069c00eaa0 tx=0x7f069c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:12.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.116+0000 7f06a1ffb640 1 -- 172.21.15.59:0/41633489 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c00cdb0 con 0x7f06a41033c0 2024-09-10T21:15:12.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.116+0000 7f06a1ffb640 1 -- 172.21.15.59:0/41633489 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f069c005020 con 0x7f06a41033c0 2024-09-10T21:15:12.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.116+0000 7f06aaba0640 1 -- 172.21.15.59:0/41633489 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a419ac30 con 0x7f06a41033c0 2024-09-10T21:15:12.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.116+0000 7f06a1ffb640 1 -- 172.21.15.59:0/41633489 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c0116d0 con 0x7f06a41033c0 2024-09-10T21:15:12.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.116+0000 7f06aaba0640 1 -- 172.21.15.59:0/41633489 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a41a1300 con 0x7f06a41033c0 2024-09-10T21:15:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.117+0000 7f06aaba0640 1 -- 172.21.15.59:0/41633489 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06a4108c20 con 0x7f06a41033c0 2024-09-10T21:15:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.119+0000 7f06a1ffb640 1 -- 172.21.15.59:0/41633489 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f069c00f040 con 0x7f06a41033c0 2024-09-10T21:15:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.119+0000 7f06a1ffb640 1 --2- 172.21.15.59:0/41633489 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f06940b5360 0x7f06940b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.119+0000 7f06a893c640 1 --2- 172.21.15.59:0/41633489 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f06940b5360 0x7f06940b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.119+0000 7f06a1ffb640 1 -- 172.21.15.59:0/41633489 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f069c0e59f0 con 0x7f06a41033c0 2024-09-10T21:15:12.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.120+0000 7f06a893c640 1 --2- 172.21.15.59:0/41633489 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f06940b5360 0x7f06940b7820 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0698000c00 tx=0x7f06980314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:12.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.124+0000 7f06a1ffb640 1 -- 172.21.15.59:0/41633489 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f069c016030 con 0x7f06a41033c0 2024-09-10T21:15:12.183 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:11 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2329538199' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-10T21:15:12.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.309+0000 7f06aaba0640 1 -- 172.21.15.59:0/41633489 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06a4063d50 con 0x7f06a41033c0 2024-09-10T21:15:12.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.310+0000 7f06a1ffb640 1 -- 172.21.15.59:0/41633489 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22633 (secure 0 0 0) 0x7f069c0ac8e0 con 0x7f06a41033c0 2024-09-10T21:15:12.314 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:15:12.314 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":75,"fsid":"3c26b952-6fb8-11ef-bcea-c7b262605968","created":"2024-09-10T21:05:18.196881+0000","modified":"2024-09-10T21:14:06.297762+0000","last_up_change":"2024-09-10T21:12:31.909004+0000","last_in_change":"2024-09-10T21:12:08.116727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:08:47.611285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:13:15.562661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:13:17.272280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e88abf3-8592-4b5f-8ba9-5969e01e12d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6803","nonce":1237328951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6805","nonce":1237328951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6809","nonce":1237328951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6807","nonce":1237328951}]},"public_addr":"172.21.15.59:6803/1237328951","cluster_addr":"172.21.15.59:6805/1237328951","heartbeat_back_addr":"172.21.15.59:6809/1237328951","heartbeat_front_addr":"172.21.15.59:6807/1237328951","state":["exists","up"]},{"osd":1,"uuid":"7908eefd-bbfa-4fe4-9db9-7a92d0e77acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6801","nonce":3376412264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6803","nonce":3376412264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6807","nonce":3376412264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6805","nonce":3376412264}]},"public_addr":"172.21.15.154:6801/3376412264","cluster_addr":"172.21.15.154:6803/3376412264","heartbeat_back_addr":"172.21.15.154:6807/3376412264","heartbeat_front_addr":"172.21.15.154:6805/3376412264","state":["exists","up"]},{"osd":2,"uuid":"2351b9f0-bca1-48b2-afb8-0e2b7856c52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6801","nonce":440750253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6803","nonce":440750253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6807","nonce":440750253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6805","nonce":440750253}]},"public_addr":"172.21.15.192:6801/440750253","cluster_addr":"172.21.15.192:6803/440750253","heartbeat_back_addr":"172.21.15.192:6807/440750253","heartbeat_front_addr":"172.21.15.192:6805/440750253","state":["exists","up"]},{"osd":3,"uuid":"f26969d1-7b48-4f20-9077-c55c59775ed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6811","nonce":1483798393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6813","nonce":1483798393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6817","nonce":1483798393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6815","nonce":1483798393}]},"public_addr":"172.21.15.59:6811/1483798393","cluster_addr":"172.21.15.59:6813/1483798393","heartbeat_back_addr":"172.21.15.59:6817/1483798393","heartbeat_front_addr":"172.21.15.59:6815/1483798393","state":["exists","up"]},{"osd":4,"uuid":"21e1a472-1ae1-454b-aee5-2ad92f6eff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6809","nonce":1817188525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6811","nonce":1817188525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6815","nonce":1817188525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6813","nonce":1817188525}]},"public_addr":"172.21.15.154:6809/1817188525","cluster_addr":"172.21.15.154:6811/1817188525","heartbeat_back_addr":"172.21.15.154:6815/1817188525","heartbeat_front_addr":"172.21.15.154:6813/1817188525","state":["exists","up"]},{"osd":5,"uuid":"6191b10a-5cbd-4225-b0ec-70d05023d5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6809","nonce":1221386274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6811","nonce":1221386274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6815","nonce":1221386274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6813","nonce":1221386274}]},"public_addr":"172.21.15.192:6809/1221386274","cluster_addr":"172.21.15.192:6811/1221386274","heartbeat_back_addr":"172.21.15.192:6815/1221386274","heartbeat_front_addr":"172.21.15.192:6813/1221386274","state":["exists","up"]},{"osd":6,"uuid":"609c11f7-ce82-4714-bf73-a4f16f4483ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6819","nonce":3006857566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6821","nonce":3006857566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6825","nonce":3006857566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6823","nonce":3006857566}]},"public_addr":"172.21.15.59:6819/3006857566","cluster_addr":"172.21.15.59:6821/3006857566","heartbeat_back_addr":"172.21.15.59:6825/3006857566","heartbeat_front_addr":"172.21.15.59:6823/3006857566","state":["exists","up"]},{"osd":7,"uuid":"bff3a29f-47cc-4e66-92e4-14e9b7faf498","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6817","nonce":175260385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6819","nonce":175260385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6823","nonce":175260385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6821","nonce":175260385}]},"public_addr":"172.21.15.154:6817/175260385","cluster_addr":"172.21.15.154:6819/175260385","heartbeat_back_addr":"172.21.15.154:6823/175260385","heartbeat_front_addr":"172.21.15.154:6821/175260385","state":["exists","up"]},{"osd":8,"uuid":"56dabafd-9bb9-409a-88cd-4b5b5ecf810a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6817","nonce":3138189462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6819","nonce":3138189462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6823","nonce":3138189462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6821","nonce":3138189462}]},"public_addr":"172.21.15.192:6817/3138189462","cluster_addr":"172.21.15.192:6819/3138189462","heartbeat_back_addr":"172.21.15.192:6823/3138189462","heartbeat_front_addr":"172.21.15.192:6821/3138189462","state":["exists","up"]},{"osd":9,"uuid":"044f934d-3df5-47aa-85f5-c3b63b267ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6827","nonce":2446500753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6829","nonce":2446500753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6833","nonce":2446500753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6831","nonce":2446500753}]},"public_addr":"172.21.15.59:6827/2446500753","cluster_addr":"172.21.15.59:6829/2446500753","heartbeat_back_addr":"172.21.15.59:6833/2446500753","heartbeat_front_addr":"172.21.15.59:6831/2446500753","state":["exists","up"]},{"osd":10,"uuid":"8d3b735b-e4fe-4a8e-8c75-a49313c6fabb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6825","nonce":1139781446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6827","nonce":1139781446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6831","nonce":1139781446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6829","nonce":1139781446}]},"public_addr":"172.21.15.154:6825/1139781446","cluster_addr":"172.21.15.154:6827/1139781446","heartbeat_back_addr":"172.21.15.154:6831/1139781446","heartbeat_front_addr":"172.21.15.154:6829/1139781446","state":["exists","up"]},{"osd":11,"uuid":"fd6a6d06-c6aa-42e3-aa38-fc583319f6bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6825","nonce":1041494458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6827","nonce":1041494458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6831","nonce":1041494458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6829","nonce":1041494458}]},"public_addr":"172.21.15.192:6825/1041494458","cluster_addr":"172.21.15.192:6827/1041494458","heartbeat_back_addr":"172.21.15.192:6831/1041494458","heartbeat_front_addr":"172.21.15.192:6829/1041494458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:07:53.974382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:19.552358+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:44.251670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:09.430992+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:34.043343+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:59.903679+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:25.733171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:49.795257+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:14.485648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:40.485165+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:04.655475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:29.308456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/212243638":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/3305207692":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6801/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/2965147556":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/1174570395":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/2934865748":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:6801/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/3377179776":"2024-09-11T21:05:40.304807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:15:12.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.312+0000 7f06aaba0640 1 -- 172.21.15.59:0/41633489 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f06940b5360 msgr2=0x7f06940b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:12.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.312+0000 7f06aaba0640 1 --2- 172.21.15.59:0/41633489 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f06940b5360 0x7f06940b7820 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0698000c00 tx=0x7f06980314a0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.312+0000 7f06aaba0640 1 -- 172.21.15.59:0/41633489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a41033c0 msgr2=0x7f06a419a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:12.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.312+0000 7f06aaba0640 1 --2- 172.21.15.59:0/41633489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a41033c0 0x7f06a419a080 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f069c00eaa0 tx=0x7f069c00ef60 comp rx=0 tx=0).stop 2024-09-10T21:15:12.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.312+0000 7f06aaba0640 1 -- 172.21.15.59:0/41633489 shutdown_connections 2024-09-10T21:15:12.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.312+0000 7f06aaba0640 1 --2- 172.21.15.59:0/41633489 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f06940b5360 0x7f06940b7820 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.312+0000 7f06aaba0640 1 --2- 172.21.15.59:0/41633489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a41033c0 0x7f06a419a080 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.312+0000 7f06aaba0640 1 --2- 172.21.15.59:0/41633489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06a4102a00 0x7f06a4199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.312+0000 7f06aaba0640 1 --2- 172.21.15.59:0/41633489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06a41018b0 0x7f06a4198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.312+0000 7f06aaba0640 1 -- 172.21.15.59:0/41633489 >> 172.21.15.59:0/41633489 conn(0x7f06a40fd190 msgr2=0x7f06a4105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:12.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.312+0000 7f06aaba0640 1 -- 172.21.15.59:0/41633489 shutdown_connections 2024-09-10T21:15:12.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.313+0000 7f06aaba0640 1 -- 172.21.15.59:0/41633489 wait complete. 2024-09-10T21:15:12.326 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:11 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2329538199' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-10T21:15:12.328 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T21:08:47.611285+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T21:13:15.562661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T21:13:17.272280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T21:15:12.328 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T21:15:12.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:11 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2329538199' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-10T21:15:12.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.431+0000 7f2b6d7ad640 1 -- 172.21.15.59:0/395478174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b6806be40 msgr2=0x7f2b681055c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:12.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.431+0000 7f2b6d7ad640 1 --2- 172.21.15.59:0/395478174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b6806be40 0x7f2b681055c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2b60009ca0 tx=0x7f2b6002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.431+0000 7f2b6d7ad640 1 -- 172.21.15.59:0/395478174 shutdown_connections 2024-09-10T21:15:12.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.431+0000 7f2b6d7ad640 1 --2- 172.21.15.59:0/395478174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b681086b0 0x7f2b6810ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.431+0000 7f2b6d7ad640 1 --2- 172.21.15.59:0/395478174 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b68105b00 0x7f2b68107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.431+0000 7f2b6d7ad640 1 --2- 172.21.15.59:0/395478174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b6806be40 0x7f2b681055c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.431+0000 7f2b6d7ad640 1 -- 172.21.15.59:0/395478174 >> 172.21.15.59:0/395478174 conn(0x7f2b680fd150 msgr2=0x7f2b680ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:12.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.431+0000 7f2b6d7ad640 1 -- 172.21.15.59:0/395478174 shutdown_connections 2024-09-10T21:15:12.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.431+0000 7f2b6d7ad640 1 -- 172.21.15.59:0/395478174 wait complete. 2024-09-10T21:15:12.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.432+0000 7f2b6d7ad640 1 Processor -- start 2024-09-10T21:15:12.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.432+0000 7f2b6d7ad640 1 -- start start 2024-09-10T21:15:12.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.432+0000 7f2b6d7ad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b6806be40 0x7f2b68198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:12.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.432+0000 7f2b6d7ad640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b68105b00 0x7f2b68199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:12.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.432+0000 7f2b6d7ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b681086b0 0x7f2b6819a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:12.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.432+0000 7f2b6d7ad640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6810e630 con 0x7f2b681086b0 2024-09-10T21:15:12.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.432+0000 7f2b6d7ad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6810e4b0 con 0x7f2b6806be40 2024-09-10T21:15:12.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.432+0000 7f2b6d7ad640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6810e7b0 con 0x7f2b68105b00 2024-09-10T21:15:12.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.432+0000 7f2b677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b681086b0 0x7f2b6819a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:12.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.432+0000 7f2b677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b681086b0 0x7f2b6819a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59328/0 (socket says 172.21.15.59:59328) 2024-09-10T21:15:12.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.432+0000 7f2b677fe640 1 -- 172.21.15.59:0/662169716 learned_addr learned my addr 172.21.15.59:0/662169716 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:12.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.432+0000 7f2b66ffd640 1 --2- 172.21.15.59:0/662169716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b6806be40 0x7f2b68198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:12.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.432+0000 7f2b667fc640 1 --2- 172.21.15.59:0/662169716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b68105b00 0x7f2b68199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:12.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.432+0000 7f2b677fe640 1 -- 172.21.15.59:0/662169716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b68105b00 msgr2=0x7f2b68199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:12.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.432+0000 7f2b677fe640 1 --2- 172.21.15.59:0/662169716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b68105b00 0x7f2b68199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.432+0000 7f2b677fe640 1 -- 172.21.15.59:0/662169716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b6806be40 msgr2=0x7f2b68198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.432+0000 7f2b677fe640 1 --2- 172.21.15.59:0/662169716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b6806be40 0x7f2b68198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.432+0000 7f2b677fe640 1 -- 172.21.15.59:0/662169716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6819a980 con 0x7f2b681086b0 2024-09-10T21:15:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.432+0000 7f2b66ffd640 1 --2- 172.21.15.59:0/662169716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b6806be40 0x7f2b68198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:15:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.433+0000 7f2b677fe640 1 --2- 172.21.15.59:0/662169716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b681086b0 0x7f2b6819a0c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800c970 tx=0x7f2b5800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.433+0000 7f2b5ffff640 1 -- 172.21.15.59:0/662169716 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b58007bb0 con 0x7f2b681086b0 2024-09-10T21:15:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.433+0000 7f2b6d7ad640 1 -- 172.21.15.59:0/662169716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b6819ac70 con 0x7f2b681086b0 2024-09-10T21:15:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.433+0000 7f2b5ffff640 1 -- 172.21.15.59:0/662169716 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b58007d50 con 0x7f2b681086b0 2024-09-10T21:15:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.433+0000 7f2b5ffff640 1 -- 172.21.15.59:0/662169716 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b58004e60 con 0x7f2b681086b0 2024-09-10T21:15:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.433+0000 7f2b6d7ad640 1 -- 172.21.15.59:0/662169716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b681a1340 con 0x7f2b681086b0 2024-09-10T21:15:12.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.434+0000 7f2b6d7ad640 1 -- 172.21.15.59:0/662169716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b680fec40 con 0x7f2b681086b0 2024-09-10T21:15:12.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.435+0000 7f2b5ffff640 1 -- 172.21.15.59:0/662169716 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f2b58005000 con 0x7f2b681086b0 2024-09-10T21:15:12.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.436+0000 7f2b5ffff640 1 --2- 172.21.15.59:0/662169716 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2b540b52e0 0x7f2b540b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:12.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.436+0000 7f2b66ffd640 1 --2- 172.21.15.59:0/662169716 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2b540b52e0 0x7f2b540b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:12.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.436+0000 7f2b5ffff640 1 -- 172.21.15.59:0/662169716 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2b580e5d40 con 0x7f2b681086b0 2024-09-10T21:15:12.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.437+0000 7f2b66ffd640 1 --2- 172.21.15.59:0/662169716 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2b540b52e0 0x7f2b540b77a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2b60031b50 tx=0x7f2b60005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:12.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.439+0000 7f2b5ffff640 1 -- 172.21.15.59:0/662169716 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2b58014030 con 0x7f2b681086b0 2024-09-10T21:15:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.625+0000 7f2b6d7ad640 1 -- 172.21.15.59:0/662169716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2b6802e7c0 con 0x7f2b681086b0 2024-09-10T21:15:12.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.625+0000 7f2b5ffff640 1 -- 172.21.15.59:0/662169716 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f2b580acbd0 con 0x7f2b681086b0 2024-09-10T21:15:12.631 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-09-10T21:15:12.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.627+0000 7f2b6d7ad640 1 -- 172.21.15.59:0/662169716 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2b540b52e0 msgr2=0x7f2b540b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:12.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.627+0000 7f2b6d7ad640 1 --2- 172.21.15.59:0/662169716 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2b540b52e0 0x7f2b540b77a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2b60031b50 tx=0x7f2b60005ef0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.627+0000 7f2b6d7ad640 1 -- 172.21.15.59:0/662169716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b681086b0 msgr2=0x7f2b6819a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:12.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.627+0000 7f2b6d7ad640 1 --2- 172.21.15.59:0/662169716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b681086b0 0x7f2b6819a0c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800c970 tx=0x7f2b5800ce30 comp rx=0 tx=0).stop 2024-09-10T21:15:12.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.627+0000 7f2b6d7ad640 1 -- 172.21.15.59:0/662169716 shutdown_connections 2024-09-10T21:15:12.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.627+0000 7f2b6d7ad640 1 --2- 172.21.15.59:0/662169716 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2b540b52e0 0x7f2b540b77a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.627+0000 7f2b6d7ad640 1 --2- 172.21.15.59:0/662169716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b681086b0 0x7f2b6819a0c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.627+0000 7f2b6d7ad640 1 --2- 172.21.15.59:0/662169716 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b68105b00 0x7f2b68199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.627+0000 7f2b6d7ad640 1 --2- 172.21.15.59:0/662169716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b6806be40 0x7f2b68198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.627+0000 7f2b6d7ad640 1 -- 172.21.15.59:0/662169716 >> 172.21.15.59:0/662169716 conn(0x7f2b680fd150 msgr2=0x7f2b68103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:12.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.628+0000 7f2b6d7ad640 1 -- 172.21.15.59:0/662169716 shutdown_connections 2024-09-10T21:15:12.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.628+0000 7f2b6d7ad640 1 -- 172.21.15.59:0/662169716 wait complete. 2024-09-10T21:15:12.642 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T21:15:12.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.745+0000 7ffaf0462640 1 -- 172.21.15.59:0/1801945151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffae810eea0 msgr2=0x7ffae8115800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:12.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.745+0000 7ffaf0462640 1 --2- 172.21.15.59:0/1801945151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffae810eea0 0x7ffae8115800 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009cd0 tx=0x7ffae002a8e0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.745+0000 7ffaf0462640 1 -- 172.21.15.59:0/1801945151 shutdown_connections 2024-09-10T21:15:12.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.745+0000 7ffaf0462640 1 --2- 172.21.15.59:0/1801945151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffae810eea0 0x7ffae8115800 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.745+0000 7ffaf0462640 1 --2- 172.21.15.59:0/1801945151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffae810e4e0 0x7ffae810e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.745+0000 7ffaf0462640 1 --2- 172.21.15.59:0/1801945151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae810d420 0x7ffae810d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.745+0000 7ffaf0462640 1 -- 172.21.15.59:0/1801945151 >> 172.21.15.59:0/1801945151 conn(0x7ffae806d1f0 msgr2=0x7ffae806d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:12.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.745+0000 7ffaf0462640 1 -- 172.21.15.59:0/1801945151 shutdown_connections 2024-09-10T21:15:12.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.745+0000 7ffaf0462640 1 -- 172.21.15.59:0/1801945151 wait complete. 2024-09-10T21:15:12.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.746+0000 7ffaf0462640 1 Processor -- start 2024-09-10T21:15:12.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.746+0000 7ffaf0462640 1 -- start start 2024-09-10T21:15:12.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.746+0000 7ffaf0462640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffae810d420 0x7ffae81a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:12.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.746+0000 7ffaf0462640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffae810e4e0 0x7ffae81a3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:12.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.746+0000 7ffaf0462640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae810eea0 0x7ffae81a49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:12.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.746+0000 7ffaf0462640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffae8118fc0 con 0x7ffae810d420 2024-09-10T21:15:12.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.746+0000 7ffaf0462640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffae8118e40 con 0x7ffae810eea0 2024-09-10T21:15:12.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.746+0000 7ffaf0462640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ffae8119140 con 0x7ffae810e4e0 2024-09-10T21:15:12.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.746+0000 7ffaee1fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffae810d420 0x7ffae81a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:12.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.746+0000 7ffaee1fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffae810d420 0x7ffae81a3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59342/0 (socket says 172.21.15.59:59342) 2024-09-10T21:15:12.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.746+0000 7ffaee1fe640 1 -- 172.21.15.59:0/724031537 learned_addr learned my addr 172.21.15.59:0/724031537 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:12.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.746+0000 7ffaee9ff640 1 --2- 172.21.15.59:0/724031537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae810eea0 0x7ffae81a49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:12.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.746+0000 7ffaed9fd640 1 --2- 172.21.15.59:0/724031537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffae810e4e0 0x7ffae81a3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:12.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.746+0000 7ffaee1fe640 1 -- 172.21.15.59:0/724031537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffae810e4e0 msgr2=0x7ffae81a3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:12.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.746+0000 7ffaee1fe640 1 --2- 172.21.15.59:0/724031537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffae810e4e0 0x7ffae81a3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.746+0000 7ffaee1fe640 1 -- 172.21.15.59:0/724031537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae810eea0 msgr2=0x7ffae81a49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:12.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.746+0000 7ffaee1fe640 1 --2- 172.21.15.59:0/724031537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae810eea0 0x7ffae81a49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.746+0000 7ffaee1fe640 1 -- 172.21.15.59:0/724031537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae81a5280 con 0x7ffae810d420 2024-09-10T21:15:12.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.747+0000 7ffaee1fe640 1 --2- 172.21.15.59:0/724031537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffae810d420 0x7ffae81a3740 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ffae400c920 tx=0x7ffae400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:12.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.747+0000 7ffadf7fe640 1 -- 172.21.15.59:0/724031537 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae4007c70 con 0x7ffae810d420 2024-09-10T21:15:12.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.747+0000 7ffadf7fe640 1 -- 172.21.15.59:0/724031537 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffae4007e10 con 0x7ffae810d420 2024-09-10T21:15:12.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.747+0000 7ffaf0462640 1 -- 172.21.15.59:0/724031537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffae81a5570 con 0x7ffae810d420 2024-09-10T21:15:12.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.747+0000 7ffadf7fe640 1 -- 172.21.15.59:0/724031537 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae4018820 con 0x7ffae810d420 2024-09-10T21:15:12.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.747+0000 7ffaf0462640 1 -- 172.21.15.59:0/724031537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffae81abc40 con 0x7ffae810d420 2024-09-10T21:15:12.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.748+0000 7ffaf0462640 1 -- 172.21.15.59:0/724031537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffae8114680 con 0x7ffae810d420 2024-09-10T21:15:12.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.749+0000 7ffadf7fe640 1 -- 172.21.15.59:0/724031537 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7ffae400f450 con 0x7ffae810d420 2024-09-10T21:15:12.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.750+0000 7ffadf7fe640 1 --2- 172.21.15.59:0/724031537 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffad40b5360 0x7ffad40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:12.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.750+0000 7ffaed9fd640 1 --2- 172.21.15.59:0/724031537 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffad40b5360 0x7ffad40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:12.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.750+0000 7ffadf7fe640 1 -- 172.21.15.59:0/724031537 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ffae40e5ff0 con 0x7ffae810d420 2024-09-10T21:15:12.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.750+0000 7ffaed9fd640 1 --2- 172.21.15.59:0/724031537 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffad40b5360 0x7ffad40b7820 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ffad8009aa0 tx=0x7ffad8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:12.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.753+0000 7ffadf7fe640 1 -- 172.21.15.59:0/724031537 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffae4014030 con 0x7ffae810d420 2024-09-10T21:15:12.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.939+0000 7ffaf0462640 1 -- 172.21.15.59:0/724031537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ffae8063d80 con 0x7ffae810d420 2024-09-10T21:15:12.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.939+0000 7ffadf7fe640 1 -- 172.21.15.59:0/724031537 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) ==== 104+0+11 (secure 0 0 0) 0x7ffae40acf90 con 0x7ffae810d420 2024-09-10T21:15:12.943 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-09-10T21:15:12.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.941+0000 7ffaf0462640 1 -- 172.21.15.59:0/724031537 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffad40b5360 msgr2=0x7ffad40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:12.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.941+0000 7ffaf0462640 1 --2- 172.21.15.59:0/724031537 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffad40b5360 0x7ffad40b7820 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ffad8009aa0 tx=0x7ffad8005f90 comp rx=0 tx=0).stop 2024-09-10T21:15:12.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.941+0000 7ffaf0462640 1 -- 172.21.15.59:0/724031537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffae810d420 msgr2=0x7ffae81a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:12.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.941+0000 7ffaf0462640 1 --2- 172.21.15.59:0/724031537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffae810d420 0x7ffae81a3740 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ffae400c920 tx=0x7ffae400cde0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.941+0000 7ffaf0462640 1 -- 172.21.15.59:0/724031537 shutdown_connections 2024-09-10T21:15:12.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.941+0000 7ffaf0462640 1 --2- 172.21.15.59:0/724031537 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffad40b5360 0x7ffad40b7820 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.941+0000 7ffaf0462640 1 --2- 172.21.15.59:0/724031537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffae810eea0 0x7ffae81a49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.941+0000 7ffaf0462640 1 --2- 172.21.15.59:0/724031537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffae810e4e0 0x7ffae81a3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.941+0000 7ffaf0462640 1 --2- 172.21.15.59:0/724031537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffae810d420 0x7ffae81a3740 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:12.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.941+0000 7ffaf0462640 1 -- 172.21.15.59:0/724031537 >> 172.21.15.59:0/724031537 conn(0x7ffae806d1f0 msgr2=0x7ffae8111850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:12.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.941+0000 7ffaf0462640 1 -- 172.21.15.59:0/724031537 shutdown_connections 2024-09-10T21:15:12.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:12.941+0000 7ffaf0462640 1 -- 172.21.15.59:0/724031537 wait complete. 2024-09-10T21:15:12.956 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T21:15:13.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.060+0000 7f2257260640 1 -- 172.21.15.59:0/2615571137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2250104470 msgr2=0x7f225010adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:13.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.060+0000 7f2257260640 1 --2- 172.21.15.59:0/2615571137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2250104470 0x7f225010adf0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2248009cd0 tx=0x7f224802a8e0 comp rx=0 tx=0).stop 2024-09-10T21:15:13.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.060+0000 7f2257260640 1 -- 172.21.15.59:0/2615571137 shutdown_connections 2024-09-10T21:15:13.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.060+0000 7f2257260640 1 --2- 172.21.15.59:0/2615571137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2250104470 0x7f225010adf0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:13.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.060+0000 7f2257260640 1 --2- 172.21.15.59:0/2615571137 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2250103ab0 0x7f2250103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:13.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.060+0000 7f2257260640 1 --2- 172.21.15.59:0/2615571137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2250102960 0x7f2250102d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:13.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.060+0000 7f2257260640 1 -- 172.21.15.59:0/2615571137 >> 172.21.15.59:0/2615571137 conn(0x7f22500fe220 msgr2=0x7f2250100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:13.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.060+0000 7f2257260640 1 -- 172.21.15.59:0/2615571137 shutdown_connections 2024-09-10T21:15:13.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.060+0000 7f2257260640 1 -- 172.21.15.59:0/2615571137 wait complete. 2024-09-10T21:15:13.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.060+0000 7f2257260640 1 Processor -- start 2024-09-10T21:15:13.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.060+0000 7f2257260640 1 -- start start 2024-09-10T21:15:13.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f2257260640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2250102960 0x7f2250076ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:13.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f2257260640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2250103ab0 0x7f2250075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:13.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f2257260640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2250104470 0x7f2250075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:13.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f2257260640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f225010e5d0 con 0x7f2250103ab0 2024-09-10T21:15:13.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f2257260640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f225010e450 con 0x7f2250102960 2024-09-10T21:15:13.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f2257260640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f225010e750 con 0x7f2250104470 2024-09-10T21:15:13.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f224ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2250103ab0 0x7f2250075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f224ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2250103ab0 0x7f2250075540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59358/0 (socket says 172.21.15.59:59358) 2024-09-10T21:15:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f224ffff640 1 -- 172.21.15.59:0/2401831362 learned_addr learned my addr 172.21.15.59:0/2401831362 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f2254ffc640 1 --2- 172.21.15.59:0/2401831362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2250102960 0x7f2250076ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f22557fd640 1 --2- 172.21.15.59:0/2401831362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2250104470 0x7f2250075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f224ffff640 1 -- 172.21.15.59:0/2401831362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2250104470 msgr2=0x7f2250075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f224ffff640 1 --2- 172.21.15.59:0/2401831362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2250104470 0x7f2250075a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f224ffff640 1 -- 172.21.15.59:0/2401831362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2250102960 msgr2=0x7f2250076ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f224ffff640 1 --2- 172.21.15.59:0/2401831362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2250102960 0x7f2250076ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f224ffff640 1 -- 172.21.15.59:0/2401831362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22500762f0 con 0x7f2250103ab0 2024-09-10T21:15:13.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f224ffff640 1 --2- 172.21.15.59:0/2401831362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2250103ab0 0x7f2250075540 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f224400e9f0 tx=0x7f224400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:13.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f224dffb640 1 -- 172.21.15.59:0/2401831362 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224400cd80 con 0x7f2250103ab0 2024-09-10T21:15:13.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f224dffb640 1 -- 172.21.15.59:0/2401831362 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22440054d0 con 0x7f2250103ab0 2024-09-10T21:15:13.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f2257260640 1 -- 172.21.15.59:0/2401831362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22501a2e00 con 0x7f2250103ab0 2024-09-10T21:15:13.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.061+0000 7f224dffb640 1 -- 172.21.15.59:0/2401831362 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2244010690 con 0x7f2250103ab0 2024-09-10T21:15:13.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.062+0000 7f2257260640 1 -- 172.21.15.59:0/2401831362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22501a3270 con 0x7f2250103ab0 2024-09-10T21:15:13.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.063+0000 7f2257260640 1 -- 172.21.15.59:0/2401831362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2250109cd0 con 0x7f2250103ab0 2024-09-10T21:15:13.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.064+0000 7f224dffb640 1 -- 172.21.15.59:0/2401831362 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f2244004e90 con 0x7f2250103ab0 2024-09-10T21:15:13.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.065+0000 7f224dffb640 1 --2- 172.21.15.59:0/2401831362 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f22380b52e0 0x7f22380b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:13.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.065+0000 7f2254ffc640 1 --2- 172.21.15.59:0/2401831362 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f22380b52e0 0x7f22380b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:13.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.065+0000 7f224dffb640 1 -- 172.21.15.59:0/2401831362 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f22440e6090 con 0x7f2250103ab0 2024-09-10T21:15:13.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.065+0000 7f2254ffc640 1 --2- 172.21.15.59:0/2401831362 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f22380b52e0 0x7f22380b77a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2240009bd0 tx=0x7f2240005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:13.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.069+0000 7f224dffb640 1 -- 172.21.15.59:0/2401831362 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f22440acf20 con 0x7f2250103ab0 2024-09-10T21:15:13.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.256+0000 7f2257260640 1 -- 172.21.15.59:0/2401831362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2250063d80 con 0x7f2250103ab0 2024-09-10T21:15:13.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.256+0000 7f224dffb640 1 -- 172.21.15.59:0/2401831362 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) ==== 100+0+11 (secure 0 0 0) 0x7f22440ac820 con 0x7f2250103ab0 2024-09-10T21:15:13.260 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-09-10T21:15:13.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.259+0000 7f2257260640 1 -- 172.21.15.59:0/2401831362 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f22380b52e0 msgr2=0x7f22380b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:13.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.259+0000 7f2257260640 1 --2- 172.21.15.59:0/2401831362 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f22380b52e0 0x7f22380b77a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2240009bd0 tx=0x7f2240005f90 comp rx=0 tx=0).stop 2024-09-10T21:15:13.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.259+0000 7f2257260640 1 -- 172.21.15.59:0/2401831362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2250103ab0 msgr2=0x7f2250075540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:13.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.259+0000 7f2257260640 1 --2- 172.21.15.59:0/2401831362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2250103ab0 0x7f2250075540 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f224400e9f0 tx=0x7f224400edf0 comp rx=0 tx=0).stop 2024-09-10T21:15:13.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.259+0000 7f2257260640 1 -- 172.21.15.59:0/2401831362 shutdown_connections 2024-09-10T21:15:13.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.259+0000 7f2257260640 1 --2- 172.21.15.59:0/2401831362 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f22380b52e0 0x7f22380b77a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:13.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.259+0000 7f2257260640 1 --2- 172.21.15.59:0/2401831362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2250104470 0x7f2250075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:13.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.259+0000 7f2257260640 1 --2- 172.21.15.59:0/2401831362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2250103ab0 0x7f2250075540 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:13.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.259+0000 7f2257260640 1 --2- 172.21.15.59:0/2401831362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2250102960 0x7f2250076ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:13.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.259+0000 7f2257260640 1 -- 172.21.15.59:0/2401831362 >> 172.21.15.59:0/2401831362 conn(0x7f22500fe220 msgr2=0x7f2250106ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:13.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.259+0000 7f2257260640 1 -- 172.21.15.59:0/2401831362 shutdown_connections 2024-09-10T21:15:13.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:13.259+0000 7f2257260640 1 -- 172.21.15.59:0/2401831362 wait complete. 2024-09-10T21:15:13.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:12 smithi059 ceph-mon[30888]: pgmap v338: 97 pgs: 97 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-10T21:15:13.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:12 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2329538199' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T21:15:13.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:12 smithi059 ceph-mon[30888]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:15:13.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:12 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/41633489' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:15:13.273 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:12 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/662169716' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T21:15:13.274 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-10T21:15:13.274 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:15:13.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:12 smithi192 ceph-mon[35363]: pgmap v338: 97 pgs: 97 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-10T21:15:13.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:12 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2329538199' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T21:15:13.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:12 smithi192 ceph-mon[35363]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:15:13.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:12 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/41633489' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:15:13.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:12 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/662169716' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T21:15:13.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:12 smithi154 ceph-mon[35041]: pgmap v338: 97 pgs: 97 active+clean; 642 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-10T21:15:13.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:12 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2329538199' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T21:15:13.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:12 smithi154 ceph-mon[35041]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T21:15:13.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:12 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/41633489' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:15:13.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:12 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/662169716' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T21:15:13.533 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:15:14.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.008+0000 7fa81e4a4640 1 -- 172.21.15.59:0/2664095836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa818075540 msgr2=0x7fa818075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:14.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.008+0000 7fa81e4a4640 1 --2- 172.21.15.59:0/2664095836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa818075540 0x7fa818075920 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa808009900 tx=0x7fa80802a3f0 comp rx=0 tx=0).stop 2024-09-10T21:15:14.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.008+0000 7fa81e4a4640 1 -- 172.21.15.59:0/2664095836 shutdown_connections 2024-09-10T21:15:14.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.008+0000 7fa81e4a4640 1 --2- 172.21.15.59:0/2664095836 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa81810f3e0 0x7fa8181117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:14.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.008+0000 7fa81e4a4640 1 --2- 172.21.15.59:0/2664095836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa818075f40 0x7fa81810ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:14.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.008+0000 7fa81e4a4640 1 --2- 172.21.15.59:0/2664095836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa818075540 0x7fa818075920 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:14.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.008+0000 7fa81e4a4640 1 -- 172.21.15.59:0/2664095836 >> 172.21.15.59:0/2664095836 conn(0x7fa8180fe830 msgr2=0x7fa818100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:14.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.008+0000 7fa81e4a4640 1 -- 172.21.15.59:0/2664095836 shutdown_connections 2024-09-10T21:15:14.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.008+0000 7fa81e4a4640 1 -- 172.21.15.59:0/2664095836 wait complete. 2024-09-10T21:15:14.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.009+0000 7fa81e4a4640 1 Processor -- start 2024-09-10T21:15:14.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.009+0000 7fa81e4a4640 1 -- start start 2024-09-10T21:15:14.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.009+0000 7fa81e4a4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa818075540 0x7fa81819b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:14.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.009+0000 7fa81e4a4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa818075f40 0x7fa81819bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:14.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.009+0000 7fa81e4a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa81810f3e0 0x7fa8181a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:14.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.009+0000 7fa81e4a4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa818115070 con 0x7fa818075f40 2024-09-10T21:15:14.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.009+0000 7fa81e4a4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa818114ef0 con 0x7fa81810f3e0 2024-09-10T21:15:14.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.009+0000 7fa81e4a4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa8181151f0 con 0x7fa818075540 2024-09-10T21:15:14.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.009+0000 7fa8177fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa818075f40 0x7fa81819bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:14.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.009+0000 7fa8177fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa818075f40 0x7fa81819bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59368/0 (socket says 172.21.15.59:59368) 2024-09-10T21:15:14.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.009+0000 7fa8177fe640 1 -- 172.21.15.59:0/493897938 learned_addr learned my addr 172.21.15.59:0/493897938 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:14.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.010+0000 7fa81ca41640 1 --2- 172.21.15.59:0/493897938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa81810f3e0 0x7fa8181a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:14.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.010+0000 7fa817fff640 1 --2- 172.21.15.59:0/493897938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa818075540 0x7fa81819b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:14.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.010+0000 7fa8177fe640 1 -- 172.21.15.59:0/493897938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa818075540 msgr2=0x7fa81819b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:14.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.010+0000 7fa8177fe640 1 --2- 172.21.15.59:0/493897938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa818075540 0x7fa81819b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:14.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.010+0000 7fa8177fe640 1 -- 172.21.15.59:0/493897938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa81810f3e0 msgr2=0x7fa8181a0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:14.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.010+0000 7fa8177fe640 1 --2- 172.21.15.59:0/493897938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa81810f3e0 0x7fa8181a0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:14.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.010+0000 7fa8177fe640 1 -- 172.21.15.59:0/493897938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8181a16d0 con 0x7fa818075f40 2024-09-10T21:15:14.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.010+0000 7fa8177fe640 1 --2- 172.21.15.59:0/493897938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa818075f40 0x7fa81819bb60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00b4a0 tx=0x7fa80c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:14.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.010+0000 7fa8157fa640 1 -- 172.21.15.59:0/493897938 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c014070 con 0x7fa818075f40 2024-09-10T21:15:14.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.010+0000 7fa8157fa640 1 -- 172.21.15.59:0/493897938 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa80c010ac0 con 0x7fa818075f40 2024-09-10T21:15:14.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.010+0000 7fa81e4a4640 1 -- 172.21.15.59:0/493897938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8181a19c0 con 0x7fa818075f40 2024-09-10T21:15:14.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.010+0000 7fa8157fa640 1 -- 172.21.15.59:0/493897938 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c017c30 con 0x7fa818075f40 2024-09-10T21:15:14.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.010+0000 7fa81e4a4640 1 -- 172.21.15.59:0/493897938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8181a8250 con 0x7fa818075f40 2024-09-10T21:15:14.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.011+0000 7fa81e4a4640 1 -- 172.21.15.59:0/493897938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8180759a0 con 0x7fa818075f40 2024-09-10T21:15:14.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.013+0000 7fa8157fa640 1 -- 172.21.15.59:0/493897938 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fa80c010610 con 0x7fa818075f40 2024-09-10T21:15:14.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.014+0000 7fa8157fa640 1 --2- 172.21.15.59:0/493897938 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa8000b5360 0x7fa8000b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:14.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.014+0000 7fa817fff640 1 --2- 172.21.15.59:0/493897938 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa8000b5360 0x7fa8000b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:14.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.014+0000 7fa8157fa640 1 -- 172.21.15.59:0/493897938 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa80c0e53f0 con 0x7fa818075f40 2024-09-10T21:15:14.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.014+0000 7fa817fff640 1 --2- 172.21.15.59:0/493897938 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa8000b5360 0x7fa8000b7820 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa808031440 tx=0x7fa8080095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:14.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.017+0000 7fa8157fa640 1 -- 172.21.15.59:0/493897938 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa80c0ac2e0 con 0x7fa818075f40 2024-09-10T21:15:14.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.242+0000 7fa81e4a4640 1 -- 172.21.15.59:0/493897938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa81819c750 con 0x7fa818075f40 2024-09-10T21:15:14.247 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:13 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/724031537' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T21:15:14.247 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:13 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2401831362' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T21:15:14.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.243+0000 7fa8157fa640 1 -- 172.21.15.59:0/493897938 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7fa80c0abbe0 con 0x7fa818075f40 2024-09-10T21:15:14.247 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:15:14.248 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:15:14.248 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:15:14.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.246+0000 7fa81e4a4640 1 -- 172.21.15.59:0/493897938 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa8000b5360 msgr2=0x7fa8000b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:14.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.246+0000 7fa81e4a4640 1 --2- 172.21.15.59:0/493897938 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa8000b5360 0x7fa8000b7820 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa808031440 tx=0x7fa8080095f0 comp rx=0 tx=0).stop 2024-09-10T21:15:14.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.246+0000 7fa81e4a4640 1 -- 172.21.15.59:0/493897938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa818075f40 msgr2=0x7fa81819bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:14.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.246+0000 7fa81e4a4640 1 --2- 172.21.15.59:0/493897938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa818075f40 0x7fa81819bb60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00b4a0 tx=0x7fa80c00b960 comp rx=0 tx=0).stop 2024-09-10T21:15:14.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.246+0000 7fa81e4a4640 1 -- 172.21.15.59:0/493897938 shutdown_connections 2024-09-10T21:15:14.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.246+0000 7fa81e4a4640 1 --2- 172.21.15.59:0/493897938 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa8000b5360 0x7fa8000b7820 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:14.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.246+0000 7fa81e4a4640 1 --2- 172.21.15.59:0/493897938 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa81810f3e0 0x7fa8181a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:14.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.246+0000 7fa81e4a4640 1 --2- 172.21.15.59:0/493897938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa818075f40 0x7fa81819bb60 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:14.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.246+0000 7fa81e4a4640 1 --2- 172.21.15.59:0/493897938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa818075540 0x7fa81819b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:14.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.246+0000 7fa81e4a4640 1 -- 172.21.15.59:0/493897938 >> 172.21.15.59:0/493897938 conn(0x7fa8180fe830 msgr2=0x7fa8180ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:14.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.246+0000 7fa81e4a4640 1 -- 172.21.15.59:0/493897938 shutdown_connections 2024-09-10T21:15:14.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:14.246+0000 7fa81e4a4640 1 -- 172.21.15.59:0/493897938 wait complete. 2024-09-10T21:15:14.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:13 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/724031537' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T21:15:14.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:13 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2401831362' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T21:15:14.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:13 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/724031537' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T21:15:14.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:13 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2401831362' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T21:15:15.009 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-10T21:15:15.010 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-10T21:15:15.010 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:15:15.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.120+0000 7f746d964640 1 -- 172.21.15.59:0/2948176833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74681086c0 msgr2=0x7f746810ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:15.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.120+0000 7f746d964640 1 --2- 172.21.15.59:0/2948176833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74681086c0 0x7f746810ab80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7460009900 tx=0x7f746002a410 comp rx=0 tx=0).stop 2024-09-10T21:15:15.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.120+0000 7f746d964640 1 -- 172.21.15.59:0/2948176833 shutdown_connections 2024-09-10T21:15:15.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.120+0000 7f746d964640 1 --2- 172.21.15.59:0/2948176833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74681086c0 0x7f746810ab80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.120+0000 7f746d964640 1 --2- 172.21.15.59:0/2948176833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7468105b30 0x7f7468107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.120+0000 7f746d964640 1 --2- 172.21.15.59:0/2948176833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f746806af40 0x7f74681055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.120+0000 7f746d964640 1 -- 172.21.15.59:0/2948176833 >> 172.21.15.59:0/2948176833 conn(0x7f74680fd180 msgr2=0x7f74680ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:15.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.120+0000 7f746d964640 1 -- 172.21.15.59:0/2948176833 shutdown_connections 2024-09-10T21:15:15.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.120+0000 7f746d964640 1 -- 172.21.15.59:0/2948176833 wait complete. 2024-09-10T21:15:15.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.120+0000 7f746d964640 1 Processor -- start 2024-09-10T21:15:15.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.121+0000 7f746d964640 1 -- start start 2024-09-10T21:15:15.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.121+0000 7f746d964640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746806af40 0x7f7468198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:15.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.121+0000 7f746d964640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7468105b30 0x7f7468199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:15.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.121+0000 7f746d964640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74681086c0 0x7f7468199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:15.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.121+0000 7f746d964640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f746810e640 con 0x7f74681086c0 2024-09-10T21:15:15.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.121+0000 7f746d964640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f746810e4c0 con 0x7f746806af40 2024-09-10T21:15:15.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.121+0000 7f746d964640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f746810e7c0 con 0x7f7468105b30 2024-09-10T21:15:15.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.121+0000 7f74677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74681086c0 0x7f7468199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:15.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.121+0000 7f74677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74681086c0 0x7f7468199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59378/0 (socket says 172.21.15.59:59378) 2024-09-10T21:15:15.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.121+0000 7f74677fe640 1 -- 172.21.15.59:0/2691367683 learned_addr learned my addr 172.21.15.59:0/2691367683 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:15.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.121+0000 7f74667fc640 1 --2- 172.21.15.59:0/2691367683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7468105b30 0x7f7468199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:15.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.121+0000 7f7466ffd640 1 --2- 172.21.15.59:0/2691367683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746806af40 0x7f7468198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:15.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.121+0000 7f74677fe640 1 -- 172.21.15.59:0/2691367683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7468105b30 msgr2=0x7f7468199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:15.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.121+0000 7f74677fe640 1 --2- 172.21.15.59:0/2691367683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7468105b30 0x7f7468199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.121+0000 7f74677fe640 1 -- 172.21.15.59:0/2691367683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746806af40 msgr2=0x7f7468198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:15.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.121+0000 7f74677fe640 1 --2- 172.21.15.59:0/2691367683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746806af40 0x7f7468198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.121+0000 7f74677fe640 1 -- 172.21.15.59:0/2691367683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746819a850 con 0x7f74681086c0 2024-09-10T21:15:15.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.121+0000 7f7466ffd640 1 --2- 172.21.15.59:0/2691367683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746806af40 0x7f7468198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:15:15.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.121+0000 7f74677fe640 1 --2- 172.21.15.59:0/2691367683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74681086c0 0x7f7468199f90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7460031500 tx=0x7f74600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:15.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.122+0000 7f746c962640 1 -- 172.21.15.59:0/2691367683 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746003f030 con 0x7f74681086c0 2024-09-10T21:15:15.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.122+0000 7f746c962640 1 -- 172.21.15.59:0/2691367683 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7460003cb0 con 0x7f74681086c0 2024-09-10T21:15:15.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.122+0000 7f746d964640 1 -- 172.21.15.59:0/2691367683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746819aae0 con 0x7f74681086c0 2024-09-10T21:15:15.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.122+0000 7f746c962640 1 -- 172.21.15.59:0/2691367683 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7460035070 con 0x7f74681086c0 2024-09-10T21:15:15.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.122+0000 7f746d964640 1 -- 172.21.15.59:0/2691367683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74681a1210 con 0x7f74681086c0 2024-09-10T21:15:15.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.123+0000 7f746d964640 1 -- 172.21.15.59:0/2691367683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7468105f70 con 0x7f74681086c0 2024-09-10T21:15:15.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.124+0000 7f746c962640 1 -- 172.21.15.59:0/2691367683 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f7460003800 con 0x7f74681086c0 2024-09-10T21:15:15.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.125+0000 7f746c962640 1 --2- 172.21.15.59:0/2691367683 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f74500b52e0 0x7f74500b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:15.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.125+0000 7f7466ffd640 1 --2- 172.21.15.59:0/2691367683 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f74500b52e0 0x7f74500b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:15.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.125+0000 7f746c962640 1 -- 172.21.15.59:0/2691367683 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7460106ad0 con 0x7f74681086c0 2024-09-10T21:15:15.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.126+0000 7f7466ffd640 1 --2- 172.21.15.59:0/2691367683 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f74500b52e0 0x7f74500b77a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7458005fd0 tx=0x7f7458009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:15.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.128+0000 7f746c962640 1 -- 172.21.15.59:0/2691367683 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f74600cd960 con 0x7f74681086c0 2024-09-10T21:15:15.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.311+0000 7f746d964640 1 -- 172.21.15.59:0/2691367683 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7468063590 con 0x7f74500b52e0 2024-09-10T21:15:15.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.316+0000 7f746c962640 1 -- 172.21.15.59:0/2691367683 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258870 (secure 0 0 0) 0x7f7468063590 con 0x7f74500b52e0 2024-09-10T21:15:15.322 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:15:15.324 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-10T21:15:15.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.319+0000 7f746d964640 1 -- 172.21.15.59:0/2691367683 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f74500b52e0 msgr2=0x7f74500b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:15.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.319+0000 7f746d964640 1 --2- 172.21.15.59:0/2691367683 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f74500b52e0 0x7f74500b77a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7458005fd0 tx=0x7f7458009500 comp rx=0 tx=0).stop 2024-09-10T21:15:15.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.319+0000 7f746d964640 1 -- 172.21.15.59:0/2691367683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74681086c0 msgr2=0x7f7468199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:15.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.319+0000 7f746d964640 1 --2- 172.21.15.59:0/2691367683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74681086c0 0x7f7468199f90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7460031500 tx=0x7f74600042f0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.319+0000 7f746d964640 1 -- 172.21.15.59:0/2691367683 shutdown_connections 2024-09-10T21:15:15.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.319+0000 7f746d964640 1 --2- 172.21.15.59:0/2691367683 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f74500b52e0 0x7f74500b77a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.319+0000 7f746d964640 1 --2- 172.21.15.59:0/2691367683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74681086c0 0x7f7468199f90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.319+0000 7f746d964640 1 --2- 172.21.15.59:0/2691367683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7468105b30 0x7f7468199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.319+0000 7f746d964640 1 --2- 172.21.15.59:0/2691367683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f746806af40 0x7f7468198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.319+0000 7f746d964640 1 -- 172.21.15.59:0/2691367683 >> 172.21.15.59:0/2691367683 conn(0x7f74680fd180 msgr2=0x7f7468103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:15.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.319+0000 7f746d964640 1 -- 172.21.15.59:0/2691367683 shutdown_connections 2024-09-10T21:15:15.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.319+0000 7f746d964640 1 -- 172.21.15.59:0/2691367683 wait complete. 2024-09-10T21:15:15.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:14 smithi192 ceph-mon[35363]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T21:15:15.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:14 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/493897938' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:15:15.333 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:14 smithi059 ceph-mon[30888]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T21:15:15.333 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:14 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/493897938' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:15:15.334 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-09-10T21:15:15.254276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658183,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1130,"num_read_kb":666,"num_write":378,"num_write_kb":2293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2951840,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":811,"ondisk_log_size":811,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369292,"kb_used_data":11724,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572532,"statfs":{"total":1151940427776,"available":1151562272768,"internally_reserved":0,"allocated":12005376,"data_stored":6686149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1006,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":63,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002825"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.631039+0000","last_change":"2024-09-10T21:13:18.656166+0000","last_active":"2024-09-10T21:15:05.631039+0000","last_peered":"2024-09-10T21:15:05.631039+0000","last_clean":"2024-09-10T21:15:05.631039+0000","last_became_active":"2024-09-10T21:13:18.655774+0000","last_became_peered":"2024-09-10T21:13:18.655774+0000","last_unstale":"2024-09-10T21:15:05.631039+0000","last_undegraded":"2024-09-10T21:15:05.631039+0000","last_fullsized":"2024-09-10T21:15:05.631039+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:57.775209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636830+0000","last_change":"2024-09-10T21:13:18.654232+0000","last_active":"2024-09-10T21:15:05.636830+0000","last_peered":"2024-09-10T21:15:05.636830+0000","last_clean":"2024-09-10T21:15:05.636830+0000","last_became_active":"2024-09-10T21:13:18.653928+0000","last_became_peered":"2024-09-10T21:13:18.653928+0000","last_unstale":"2024-09-10T21:15:05.636830+0000","last_undegraded":"2024-09-10T21:15:05.636830+0000","last_fullsized":"2024-09-10T21:15:05.636830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:02.615686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.639156+0000","last_change":"2024-09-10T21:13:18.662923+0000","last_active":"2024-09-10T21:15:05.639156+0000","last_peered":"2024-09-10T21:15:05.639156+0000","last_clean":"2024-09-10T21:15:05.639156+0000","last_became_active":"2024-09-10T21:13:18.662541+0000","last_became_peered":"2024-09-10T21:13:18.662541+0000","last_unstale":"2024-09-10T21:15:05.639156+0000","last_undegraded":"2024-09-10T21:15:05.639156+0000","last_fullsized":"2024-09-10T21:15:05.639156+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:33:11.140761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.632974+0000","last_change":"2024-09-10T21:14:06.311161+0000","last_active":"2024-09-10T21:15:05.632974+0000","last_peered":"2024-09-10T21:15:05.632974+0000","last_clean":"2024-09-10T21:15:05.632974+0000","last_became_active":"2024-09-10T21:14:06.310829+0000","last_became_peered":"2024-09-10T21:14:06.310829+0000","last_unstale":"2024-09-10T21:15:05.632974+0000","last_undegraded":"2024-09-10T21:15:05.632974+0000","last_fullsized":"2024-09-10T21:15:05.632974+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:17.318129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.622564+0000","last_change":"2024-09-10T21:13:18.650427+0000","last_active":"2024-09-10T21:15:05.622564+0000","last_peered":"2024-09-10T21:15:05.622564+0000","last_clean":"2024-09-10T21:15:05.622564+0000","last_became_active":"2024-09-10T21:13:18.650039+0000","last_became_peered":"2024-09-10T21:13:18.650039+0000","last_unstale":"2024-09-10T21:15:05.622564+0000","last_undegraded":"2024-09-10T21:15:05.622564+0000","last_fullsized":"2024-09-10T21:15:05.622564+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:11.363642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.633901+0000","last_change":"2024-09-10T21:13:18.654320+0000","last_active":"2024-09-10T21:15:05.633901+0000","last_peered":"2024-09-10T21:15:05.633901+0000","last_clean":"2024-09-10T21:15:05.633901+0000","last_became_active":"2024-09-10T21:13:18.653291+0000","last_became_peered":"2024-09-10T21:13:18.653291+0000","last_unstale":"2024-09-10T21:15:05.633901+0000","last_undegraded":"2024-09-10T21:15:05.633901+0000","last_fullsized":"2024-09-10T21:15:05.633901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:08:28.176816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.637595+0000","last_change":"2024-09-10T21:13:18.659695+0000","last_active":"2024-09-10T21:15:05.637595+0000","last_peered":"2024-09-10T21:15:05.637595+0000","last_clean":"2024-09-10T21:15:05.637595+0000","last_became_active":"2024-09-10T21:13:18.659240+0000","last_became_peered":"2024-09-10T21:13:18.659240+0000","last_unstale":"2024-09-10T21:15:05.637595+0000","last_undegraded":"2024-09-10T21:15:05.637595+0000","last_fullsized":"2024-09-10T21:15:05.637595+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:58.951873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.631859+0000","last_change":"2024-09-10T21:14:06.435134+0000","last_active":"2024-09-10T21:15:05.631859+0000","last_peered":"2024-09-10T21:15:05.631859+0000","last_clean":"2024-09-10T21:15:05.631859+0000","last_became_active":"2024-09-10T21:14:06.434801+0000","last_became_peered":"2024-09-10T21:14:06.434801+0000","last_unstale":"2024-09-10T21:15:05.631859+0000","last_undegraded":"2024-09-10T21:15:05.631859+0000","last_fullsized":"2024-09-10T21:15:05.631859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:01.473083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.633884+0000","last_change":"2024-09-10T21:13:18.656252+0000","last_active":"2024-09-10T21:15:05.633884+0000","last_peered":"2024-09-10T21:15:05.633884+0000","last_clean":"2024-09-10T21:15:05.633884+0000","last_became_active":"2024-09-10T21:13:18.655879+0000","last_became_peered":"2024-09-10T21:13:18.655879+0000","last_unstale":"2024-09-10T21:15:05.633884+0000","last_undegraded":"2024-09-10T21:15:05.633884+0000","last_fullsized":"2024-09-10T21:15:05.633884+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:03.748183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.637233+0000","last_change":"2024-09-10T21:13:18.663370+0000","last_active":"2024-09-10T21:15:05.637233+0000","last_peered":"2024-09-10T21:15:05.637233+0000","last_clean":"2024-09-10T21:15:05.637233+0000","last_became_active":"2024-09-10T21:13:18.662863+0000","last_became_peered":"2024-09-10T21:13:18.662863+0000","last_unstale":"2024-09-10T21:15:05.637233+0000","last_undegraded":"2024-09-10T21:15:05.637233+0000","last_fullsized":"2024-09-10T21:15:05.637233+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:22.912596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638616+0000","last_change":"2024-09-10T21:13:18.663626+0000","last_active":"2024-09-10T21:15:05.638616+0000","last_peered":"2024-09-10T21:15:05.638616+0000","last_clean":"2024-09-10T21:15:05.638616+0000","last_became_active":"2024-09-10T21:13:18.663280+0000","last_became_peered":"2024-09-10T21:13:18.663280+0000","last_unstale":"2024-09-10T21:15:05.638616+0000","last_undegraded":"2024-09-10T21:15:05.638616+0000","last_fullsized":"2024-09-10T21:15:05.638616+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:07.874387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.609442+0000","last_change":"2024-09-10T21:13:18.660791+0000","last_active":"2024-09-10T21:15:05.609442+0000","last_peered":"2024-09-10T21:15:05.609442+0000","last_clean":"2024-09-10T21:15:05.609442+0000","last_became_active":"2024-09-10T21:13:18.660386+0000","last_became_peered":"2024-09-10T21:13:18.660386+0000","last_unstale":"2024-09-10T21:15:05.609442+0000","last_undegraded":"2024-09-10T21:15:05.609442+0000","last_fullsized":"2024-09-10T21:15:05.609442+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:37.218822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636304+0000","last_change":"2024-09-10T21:13:18.655893+0000","last_active":"2024-09-10T21:15:05.636304+0000","last_peered":"2024-09-10T21:15:05.636304+0000","last_clean":"2024-09-10T21:15:05.636304+0000","last_became_active":"2024-09-10T21:13:18.655524+0000","last_became_peered":"2024-09-10T21:13:18.655524+0000","last_unstale":"2024-09-10T21:15:05.636304+0000","last_undegraded":"2024-09-10T21:15:05.636304+0000","last_fullsized":"2024-09-10T21:15:05.636304+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:29.734783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638144+0000","last_change":"2024-09-10T21:13:18.654359+0000","last_active":"2024-09-10T21:15:05.638144+0000","last_peered":"2024-09-10T21:15:05.638144+0000","last_clean":"2024-09-10T21:15:05.638144+0000","last_became_active":"2024-09-10T21:13:18.653983+0000","last_became_peered":"2024-09-10T21:13:18.653983+0000","last_unstale":"2024-09-10T21:15:05.638144+0000","last_undegraded":"2024-09-10T21:15:05.638144+0000","last_fullsized":"2024-09-10T21:15:05.638144+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:48.806836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.637562+0000","last_change":"2024-09-10T21:13:18.650428+0000","last_active":"2024-09-10T21:15:05.637562+0000","last_peered":"2024-09-10T21:15:05.637562+0000","last_clean":"2024-09-10T21:15:05.637562+0000","last_became_active":"2024-09-10T21:13:18.650121+0000","last_became_peered":"2024-09-10T21:13:18.650121+0000","last_unstale":"2024-09-10T21:15:05.637562+0000","last_undegraded":"2024-09-10T21:15:05.637562+0000","last_fullsized":"2024-09-10T21:15:05.637562+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:15.121916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.639726+0000","last_change":"2024-09-10T21:13:18.662321+0000","last_active":"2024-09-10T21:15:05.639726+0000","last_peered":"2024-09-10T21:15:05.639726+0000","last_clean":"2024-09-10T21:15:05.639726+0000","last_became_active":"2024-09-10T21:13:18.662013+0000","last_became_peered":"2024-09-10T21:13:18.662013+0000","last_unstale":"2024-09-10T21:15:05.639726+0000","last_undegraded":"2024-09-10T21:15:05.639726+0000","last_fullsized":"2024-09-10T21:15:05.639726+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:54.303375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.631470+0000","last_change":"2024-09-10T21:13:18.662549+0000","last_active":"2024-09-10T21:15:05.631470+0000","last_peered":"2024-09-10T21:15:05.631470+0000","last_clean":"2024-09-10T21:15:05.631470+0000","last_became_active":"2024-09-10T21:13:18.662230+0000","last_became_peered":"2024-09-10T21:13:18.662230+0000","last_unstale":"2024-09-10T21:15:05.631470+0000","last_undegraded":"2024-09-10T21:15:05.631470+0000","last_fullsized":"2024-09-10T21:15:05.631470+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:02.582355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.634231+0000","last_change":"2024-09-10T21:13:18.654906+0000","last_active":"2024-09-10T21:15:05.634231+0000","last_peered":"2024-09-10T21:15:05.634231+0000","last_clean":"2024-09-10T21:15:05.634231+0000","last_became_active":"2024-09-10T21:13:18.654599+0000","last_became_peered":"2024-09-10T21:13:18.654599+0000","last_unstale":"2024-09-10T21:15:05.634231+0000","last_undegraded":"2024-09-10T21:15:05.634231+0000","last_fullsized":"2024-09-10T21:15:05.634231+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:34.987893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.632146+0000","last_change":"2024-09-10T21:13:18.643997+0000","last_active":"2024-09-10T21:15:05.632146+0000","last_peered":"2024-09-10T21:15:05.632146+0000","last_clean":"2024-09-10T21:15:05.632146+0000","last_became_active":"2024-09-10T21:13:18.643632+0000","last_became_peered":"2024-09-10T21:13:18.643632+0000","last_unstale":"2024-09-10T21:15:05.632146+0000","last_undegraded":"2024-09-10T21:15:05.632146+0000","last_fullsized":"2024-09-10T21:15:05.632146+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:31.234040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.617895+0000","last_change":"2024-09-10T21:13:18.657079+0000","last_active":"2024-09-10T21:15:05.617895+0000","last_peered":"2024-09-10T21:15:05.617895+0000","last_clean":"2024-09-10T21:15:05.617895+0000","last_became_active":"2024-09-10T21:13:18.656741+0000","last_became_peered":"2024-09-10T21:13:18.656741+0000","last_unstale":"2024-09-10T21:15:05.617895+0000","last_undegraded":"2024-09-10T21:15:05.617895+0000","last_fullsized":"2024-09-10T21:15:05.617895+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:27.036783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638632+0000","last_change":"2024-09-10T21:13:18.653076+0000","last_active":"2024-09-10T21:15:05.638632+0000","last_peered":"2024-09-10T21:15:05.638632+0000","last_clean":"2024-09-10T21:15:05.638632+0000","last_became_active":"2024-09-10T21:13:18.652722+0000","last_became_peered":"2024-09-10T21:13:18.652722+0000","last_unstale":"2024-09-10T21:15:05.638632+0000","last_undegraded":"2024-09-10T21:15:05.638632+0000","last_fullsized":"2024-09-10T21:15:05.638632+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:11.005632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.639992+0000","last_change":"2024-09-10T21:13:18.663340+0000","last_active":"2024-09-10T21:15:05.639992+0000","last_peered":"2024-09-10T21:15:05.639992+0000","last_clean":"2024-09-10T21:15:05.639992+0000","last_became_active":"2024-09-10T21:13:18.662981+0000","last_became_peered":"2024-09-10T21:13:18.662981+0000","last_unstale":"2024-09-10T21:15:05.639992+0000","last_undegraded":"2024-09-10T21:15:05.639992+0000","last_fullsized":"2024-09-10T21:15:05.639992+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:39.510625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.629760+0000","last_change":"2024-09-10T21:13:18.651376+0000","last_active":"2024-09-10T21:15:05.629760+0000","last_peered":"2024-09-10T21:15:05.629760+0000","last_clean":"2024-09-10T21:15:05.629760+0000","last_became_active":"2024-09-10T21:13:18.650999+0000","last_became_peered":"2024-09-10T21:13:18.650999+0000","last_unstale":"2024-09-10T21:15:05.629760+0000","last_undegraded":"2024-09-10T21:15:05.629760+0000","last_fullsized":"2024-09-10T21:15:05.629760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:12.268120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.628971+0000","last_change":"2024-09-10T21:13:18.648634+0000","last_active":"2024-09-10T21:15:05.628971+0000","last_peered":"2024-09-10T21:15:05.628971+0000","last_clean":"2024-09-10T21:15:05.628971+0000","last_became_active":"2024-09-10T21:13:18.648099+0000","last_became_peered":"2024-09-10T21:13:18.648099+0000","last_unstale":"2024-09-10T21:15:05.628971+0000","last_undegraded":"2024-09-10T21:15:05.628971+0000","last_fullsized":"2024-09-10T21:15:05.628971+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:47.570132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.627349+0000","last_change":"2024-09-10T21:13:18.660188+0000","last_active":"2024-09-10T21:15:05.627349+0000","last_peered":"2024-09-10T21:15:05.627349+0000","last_clean":"2024-09-10T21:15:05.627349+0000","last_became_active":"2024-09-10T21:13:18.659821+0000","last_became_peered":"2024-09-10T21:13:18.659821+0000","last_unstale":"2024-09-10T21:15:05.627349+0000","last_undegraded":"2024-09-10T21:15:05.627349+0000","last_fullsized":"2024-09-10T21:15:05.627349+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:36.456852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.632319+0000","last_change":"2024-09-10T21:13:18.656727+0000","last_active":"2024-09-10T21:15:05.632319+0000","last_peered":"2024-09-10T21:15:05.632319+0000","last_clean":"2024-09-10T21:15:05.632319+0000","last_became_active":"2024-09-10T21:13:18.654627+0000","last_became_peered":"2024-09-10T21:13:18.654627+0000","last_unstale":"2024-09-10T21:15:05.632319+0000","last_undegraded":"2024-09-10T21:15:05.632319+0000","last_fullsized":"2024-09-10T21:15:05.632319+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:42.838893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.629978+0000","last_change":"2024-09-10T21:13:18.660113+0000","last_active":"2024-09-10T21:15:05.629978+0000","last_peered":"2024-09-10T21:15:05.629978+0000","last_clean":"2024-09-10T21:15:05.629978+0000","last_became_active":"2024-09-10T21:13:18.659668+0000","last_became_peered":"2024-09-10T21:13:18.659668+0000","last_unstale":"2024-09-10T21:15:05.629978+0000","last_undegraded":"2024-09-10T21:15:05.629978+0000","last_fullsized":"2024-09-10T21:15:05.629978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:43.733431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.637642+0000","last_change":"2024-09-10T21:13:18.648015+0000","last_active":"2024-09-10T21:15:05.637642+0000","last_peered":"2024-09-10T21:15:05.637642+0000","last_clean":"2024-09-10T21:15:05.637642+0000","last_became_active":"2024-09-10T21:13:18.647661+0000","last_became_peered":"2024-09-10T21:13:18.647661+0000","last_unstale":"2024-09-10T21:15:05.637642+0000","last_undegraded":"2024-09-10T21:15:05.637642+0000","last_fullsized":"2024-09-10T21:15:05.637642+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:22.543217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638146+0000","last_change":"2024-09-10T21:13:18.657728+0000","last_active":"2024-09-10T21:15:05.638146+0000","last_peered":"2024-09-10T21:15:05.638146+0000","last_clean":"2024-09-10T21:15:05.638146+0000","last_became_active":"2024-09-10T21:13:18.657372+0000","last_became_peered":"2024-09-10T21:13:18.657372+0000","last_unstale":"2024-09-10T21:15:05.638146+0000","last_undegraded":"2024-09-10T21:15:05.638146+0000","last_fullsized":"2024-09-10T21:15:05.638146+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:43.621668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.626804+0000","last_change":"2024-09-10T21:13:18.648380+0000","last_active":"2024-09-10T21:15:05.626804+0000","last_peered":"2024-09-10T21:15:05.626804+0000","last_clean":"2024-09-10T21:15:05.626804+0000","last_became_active":"2024-09-10T21:13:18.647871+0000","last_became_peered":"2024-09-10T21:13:18.647871+0000","last_unstale":"2024-09-10T21:15:05.626804+0000","last_undegraded":"2024-09-10T21:15:05.626804+0000","last_fullsized":"2024-09-10T21:15:05.626804+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:16.374911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636553+0000","last_change":"2024-09-10T21:13:18.654843+0000","last_active":"2024-09-10T21:15:05.636553+0000","last_peered":"2024-09-10T21:15:05.636553+0000","last_clean":"2024-09-10T21:15:05.636553+0000","last_became_active":"2024-09-10T21:13:18.654211+0000","last_became_peered":"2024-09-10T21:13:18.654211+0000","last_unstale":"2024-09-10T21:15:05.636553+0000","last_undegraded":"2024-09-10T21:15:05.636553+0000","last_fullsized":"2024-09-10T21:15:05.636553+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:28.490792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.628477+0000","last_change":"2024-09-10T21:13:18.659603+0000","last_active":"2024-09-10T21:15:05.628477+0000","last_peered":"2024-09-10T21:15:05.628477+0000","last_clean":"2024-09-10T21:15:05.628477+0000","last_became_active":"2024-09-10T21:13:18.659257+0000","last_became_peered":"2024-09-10T21:13:18.659257+0000","last_unstale":"2024-09-10T21:15:05.628477+0000","last_undegraded":"2024-09-10T21:15:05.628477+0000","last_fullsized":"2024-09-10T21:15:05.628477+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:26.249109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.626761+0000","last_change":"2024-09-10T21:13:18.649354+0000","last_active":"2024-09-10T21:15:05.626761+0000","last_peered":"2024-09-10T21:15:05.626761+0000","last_clean":"2024-09-10T21:15:05.626761+0000","last_became_active":"2024-09-10T21:13:18.649029+0000","last_became_peered":"2024-09-10T21:13:18.649029+0000","last_unstale":"2024-09-10T21:15:05.626761+0000","last_undegraded":"2024-09-10T21:15:05.626761+0000","last_fullsized":"2024-09-10T21:15:05.626761+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:06.946983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'7","reported_seq":136,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:11.094790+0000","last_change":"2024-09-10T21:13:16.631197+0000","last_active":"2024-09-10T21:15:11.094790+0000","last_peered":"2024-09-10T21:15:11.094790+0000","last_clean":"2024-09-10T21:15:11.094790+0000","last_became_active":"2024-09-10T21:13:16.630877+0000","last_became_peered":"2024-09-10T21:13:16.630877+0000","last_unstale":"2024-09-10T21:15:11.094790+0000","last_undegraded":"2024-09-10T21:15:11.094790+0000","last_fullsized":"2024-09-10T21:15:11.094790+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:50.117425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.629100+0000","last_change":"2024-09-10T21:13:18.654124+0000","last_active":"2024-09-10T21:15:05.629100+0000","last_peered":"2024-09-10T21:15:05.629100+0000","last_clean":"2024-09-10T21:15:05.629100+0000","last_became_active":"2024-09-10T21:13:18.653757+0000","last_became_peered":"2024-09-10T21:13:18.653757+0000","last_unstale":"2024-09-10T21:15:05.629100+0000","last_undegraded":"2024-09-10T21:15:05.629100+0000","last_fullsized":"2024-09-10T21:15:05.629100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:25.174272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306892+0000","last_change":"2024-09-10T21:13:16.631526+0000","last_active":"2024-09-10T21:14:06.306892+0000","last_peered":"2024-09-10T21:14:06.306892+0000","last_clean":"2024-09-10T21:14:06.306892+0000","last_became_active":"2024-09-10T21:13:16.631194+0000","last_became_peered":"2024-09-10T21:13:16.631194+0000","last_unstale":"2024-09-10T21:14:06.306892+0000","last_undegraded":"2024-09-10T21:14:06.306892+0000","last_fullsized":"2024-09-10T21:14:06.306892+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:31:35.036874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433190+0000","last_change":"2024-09-10T21:13:16.624906+0000","last_active":"2024-09-10T21:14:06.433190+0000","last_peered":"2024-09-10T21:14:06.433190+0000","last_clean":"2024-09-10T21:14:06.433190+0000","last_became_active":"2024-09-10T21:13:16.624376+0000","last_became_peered":"2024-09-10T21:13:16.624376+0000","last_unstale":"2024-09-10T21:14:06.433190+0000","last_undegraded":"2024-09-10T21:14:06.433190+0000","last_fullsized":"2024-09-10T21:14:06.433190+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:20.942651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.628480+0000","last_change":"2024-09-10T21:13:18.646987+0000","last_active":"2024-09-10T21:15:05.628480+0000","last_peered":"2024-09-10T21:15:05.628480+0000","last_clean":"2024-09-10T21:15:05.628480+0000","last_became_active":"2024-09-10T21:13:18.646690+0000","last_became_peered":"2024-09-10T21:13:18.646690+0000","last_unstale":"2024-09-10T21:15:05.628480+0000","last_undegraded":"2024-09-10T21:15:05.628480+0000","last_fullsized":"2024-09-10T21:15:05.628480+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:47:02.132164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433699+0000","last_change":"2024-09-10T21:13:16.633082+0000","last_active":"2024-09-10T21:14:06.433699+0000","last_peered":"2024-09-10T21:14:06.433699+0000","last_clean":"2024-09-10T21:14:06.433699+0000","last_became_active":"2024-09-10T21:13:16.632707+0000","last_became_peered":"2024-09-10T21:13:16.632707+0000","last_unstale":"2024-09-10T21:14:06.433699+0000","last_undegraded":"2024-09-10T21:14:06.433699+0000","last_fullsized":"2024-09-10T21:14:06.433699+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:53:56.611072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.632300+0000","last_change":"2024-09-10T21:13:18.663309+0000","last_active":"2024-09-10T21:15:05.632300+0000","last_peered":"2024-09-10T21:15:05.632300+0000","last_clean":"2024-09-10T21:15:05.632300+0000","last_became_active":"2024-09-10T21:13:18.662990+0000","last_became_peered":"2024-09-10T21:13:18.662990+0000","last_unstale":"2024-09-10T21:15:05.632300+0000","last_undegraded":"2024-09-10T21:15:05.632300+0000","last_fullsized":"2024-09-10T21:15:05.632300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:18.014441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'5","reported_seq":228,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:10.092588+0000","last_change":"2024-09-10T21:13:16.633012+0000","last_active":"2024-09-10T21:15:10.092588+0000","last_peered":"2024-09-10T21:15:10.092588+0000","last_clean":"2024-09-10T21:15:10.092588+0000","last_became_active":"2024-09-10T21:13:16.632622+0000","last_became_peered":"2024-09-10T21:13:16.632622+0000","last_unstale":"2024-09-10T21:15:10.092588+0000","last_undegraded":"2024-09-10T21:15:10.092588+0000","last_fullsized":"2024-09-10T21:15:10.092588+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:16.859255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":200,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638770+0000","last_change":"2024-09-10T21:13:18.658015+0000","last_active":"2024-09-10T21:15:05.638770+0000","last_peered":"2024-09-10T21:15:05.638770+0000","last_clean":"2024-09-10T21:15:05.638770+0000","last_became_active":"2024-09-10T21:13:18.656922+0000","last_became_peered":"2024-09-10T21:13:18.656922+0000","last_unstale":"2024-09-10T21:15:05.638770+0000","last_undegraded":"2024-09-10T21:15:05.638770+0000","last_fullsized":"2024-09-10T21:15:05.638770+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:24.038131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.313021+0000","last_change":"2024-09-10T21:13:16.631771+0000","last_active":"2024-09-10T21:14:06.313021+0000","last_peered":"2024-09-10T21:14:06.313021+0000","last_clean":"2024-09-10T21:14:06.313021+0000","last_became_active":"2024-09-10T21:13:16.631477+0000","last_became_peered":"2024-09-10T21:13:16.631477+0000","last_unstale":"2024-09-10T21:14:06.313021+0000","last_undegraded":"2024-09-10T21:14:06.313021+0000","last_fullsized":"2024-09-10T21:14:06.313021+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:16.644046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638312+0000","last_change":"2024-09-10T21:13:18.658119+0000","last_active":"2024-09-10T21:15:05.638312+0000","last_peered":"2024-09-10T21:15:05.638312+0000","last_clean":"2024-09-10T21:15:05.638312+0000","last_became_active":"2024-09-10T21:13:18.657339+0000","last_became_peered":"2024-09-10T21:13:18.657339+0000","last_unstale":"2024-09-10T21:15:05.638312+0000","last_undegraded":"2024-09-10T21:15:05.638312+0000","last_fullsized":"2024-09-10T21:15:05.638312+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:45.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433347+0000","last_change":"2024-09-10T21:13:16.727019+0000","last_active":"2024-09-10T21:14:06.433347+0000","last_peered":"2024-09-10T21:14:06.433347+0000","last_clean":"2024-09-10T21:14:06.433347+0000","last_became_active":"2024-09-10T21:13:16.726667+0000","last_became_peered":"2024-09-10T21:13:16.726667+0000","last_unstale":"2024-09-10T21:14:06.433347+0000","last_undegraded":"2024-09-10T21:14:06.433347+0000","last_fullsized":"2024-09-10T21:14:06.433347+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:57.551149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636868+0000","last_change":"2024-09-10T21:14:06.434206+0000","last_active":"2024-09-10T21:15:05.636868+0000","last_peered":"2024-09-10T21:15:05.636868+0000","last_clean":"2024-09-10T21:15:05.636868+0000","last_became_active":"2024-09-10T21:14:06.433779+0000","last_became_peered":"2024-09-10T21:14:06.433779+0000","last_unstale":"2024-09-10T21:15:05.636868+0000","last_undegraded":"2024-09-10T21:15:05.636868+0000","last_fullsized":"2024-09-10T21:15:05.636868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:24.590286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'34","reported_seq":266,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:10.093069+0000","last_change":"2024-09-10T21:13:16.631820+0000","last_active":"2024-09-10T21:15:10.093069+0000","last_peered":"2024-09-10T21:15:10.093069+0000","last_clean":"2024-09-10T21:15:10.093069+0000","last_became_active":"2024-09-10T21:13:16.631432+0000","last_became_peered":"2024-09-10T21:13:16.631432+0000","last_unstale":"2024-09-10T21:15:10.093069+0000","last_undegraded":"2024-09-10T21:15:10.093069+0000","last_fullsized":"2024-09-10T21:15:10.093069+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:47.972871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60319,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":209,"num_read_kb":163,"num_write":36,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.630791+0000","last_change":"2024-09-10T21:13:18.653147+0000","last_active":"2024-09-10T21:15:05.630791+0000","last_peered":"2024-09-10T21:15:05.630791+0000","last_clean":"2024-09-10T21:15:05.630791+0000","last_became_active":"2024-09-10T21:13:18.652846+0000","last_became_peered":"2024-09-10T21:13:18.652846+0000","last_unstale":"2024-09-10T21:15:05.630791+0000","last_undegraded":"2024-09-10T21:15:05.630791+0000","last_fullsized":"2024-09-10T21:15:05.630791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:59.007192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309628+0000","last_change":"2024-09-10T21:13:16.631994+0000","last_active":"2024-09-10T21:14:06.309628+0000","last_peered":"2024-09-10T21:14:06.309628+0000","last_clean":"2024-09-10T21:14:06.309628+0000","last_became_active":"2024-09-10T21:13:16.631665+0000","last_became_peered":"2024-09-10T21:13:16.631665+0000","last_unstale":"2024-09-10T21:14:06.309628+0000","last_undegraded":"2024-09-10T21:14:06.309628+0000","last_fullsized":"2024-09-10T21:14:06.309628+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:05.537172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638781+0000","last_change":"2024-09-10T21:13:18.657463+0000","last_active":"2024-09-10T21:15:05.638781+0000","last_peered":"2024-09-10T21:15:05.638781+0000","last_clean":"2024-09-10T21:15:05.638781+0000","last_became_active":"2024-09-10T21:13:18.657146+0000","last_became_peered":"2024-09-10T21:13:18.657146+0000","last_unstale":"2024-09-10T21:15:05.638781+0000","last_undegraded":"2024-09-10T21:15:05.638781+0000","last_fullsized":"2024-09-10T21:15:05.638781+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:42.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433206+0000","last_change":"2024-09-10T21:13:16.630419+0000","last_active":"2024-09-10T21:14:06.433206+0000","last_peered":"2024-09-10T21:14:06.433206+0000","last_clean":"2024-09-10T21:14:06.433206+0000","last_became_active":"2024-09-10T21:13:16.630053+0000","last_became_peered":"2024-09-10T21:13:16.630053+0000","last_unstale":"2024-09-10T21:14:06.433206+0000","last_undegraded":"2024-09-10T21:14:06.433206+0000","last_fullsized":"2024-09-10T21:14:06.433206+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:08.090931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.640928+0000","last_change":"2024-09-10T21:13:18.657585+0000","last_active":"2024-09-10T21:15:05.640928+0000","last_peered":"2024-09-10T21:15:05.640928+0000","last_clean":"2024-09-10T21:15:05.640928+0000","last_became_active":"2024-09-10T21:13:18.657280+0000","last_became_peered":"2024-09-10T21:13:18.657280+0000","last_unstale":"2024-09-10T21:15:05.640928+0000","last_undegraded":"2024-09-10T21:15:05.640928+0000","last_fullsized":"2024-09-10T21:15:05.640928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:46:34.252882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'5","reported_seq":131,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:10.093287+0000","last_change":"2024-09-10T21:13:16.629700+0000","last_active":"2024-09-10T21:15:10.093287+0000","last_peered":"2024-09-10T21:15:10.093287+0000","last_clean":"2024-09-10T21:15:10.093287+0000","last_became_active":"2024-09-10T21:13:16.629282+0000","last_became_peered":"2024-09-10T21:13:16.629282+0000","last_unstale":"2024-09-10T21:15:10.093287+0000","last_undegraded":"2024-09-10T21:15:10.093287+0000","last_fullsized":"2024-09-10T21:15:10.093287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:42.572643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.635679+0000","last_change":"2024-09-10T21:13:18.664535+0000","last_active":"2024-09-10T21:15:05.635679+0000","last_peered":"2024-09-10T21:15:05.635679+0000","last_clean":"2024-09-10T21:15:05.635679+0000","last_became_active":"2024-09-10T21:13:18.663997+0000","last_became_peered":"2024-09-10T21:13:18.663997+0000","last_unstale":"2024-09-10T21:15:05.635679+0000","last_undegraded":"2024-09-10T21:15:05.635679+0000","last_fullsized":"2024-09-10T21:15:05.635679+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:30.365106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308443+0000","last_change":"2024-09-10T21:13:16.727096+0000","last_active":"2024-09-10T21:14:06.308443+0000","last_peered":"2024-09-10T21:14:06.308443+0000","last_clean":"2024-09-10T21:14:06.308443+0000","last_became_active":"2024-09-10T21:13:16.726408+0000","last_became_peered":"2024-09-10T21:13:16.726408+0000","last_unstale":"2024-09-10T21:14:06.308443+0000","last_undegraded":"2024-09-10T21:14:06.308443+0000","last_fullsized":"2024-09-10T21:14:06.308443+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:30.581238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.628607+0000","last_change":"2024-09-10T21:13:18.657397+0000","last_active":"2024-09-10T21:15:05.628607+0000","last_peered":"2024-09-10T21:15:05.628607+0000","last_clean":"2024-09-10T21:15:05.628607+0000","last_became_active":"2024-09-10T21:13:18.657050+0000","last_became_peered":"2024-09-10T21:13:18.657050+0000","last_unstale":"2024-09-10T21:15:05.628607+0000","last_undegraded":"2024-09-10T21:15:05.628607+0000","last_fullsized":"2024-09-10T21:15:05.628607+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:09.739544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.310361+0000","last_change":"2024-09-10T21:13:16.633716+0000","last_active":"2024-09-10T21:14:06.310361+0000","last_peered":"2024-09-10T21:14:06.310361+0000","last_clean":"2024-09-10T21:14:06.310361+0000","last_became_active":"2024-09-10T21:13:16.633225+0000","last_became_peered":"2024-09-10T21:13:16.633225+0000","last_unstale":"2024-09-10T21:14:06.310361+0000","last_undegraded":"2024-09-10T21:14:06.310361+0000","last_fullsized":"2024-09-10T21:14:06.310361+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:48.807549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.627900+0000","last_change":"2024-09-10T21:13:18.663129+0000","last_active":"2024-09-10T21:15:05.627900+0000","last_peered":"2024-09-10T21:15:05.627900+0000","last_clean":"2024-09-10T21:15:05.627900+0000","last_became_active":"2024-09-10T21:13:18.662694+0000","last_became_peered":"2024-09-10T21:13:18.662694+0000","last_unstale":"2024-09-10T21:15:05.627900+0000","last_undegraded":"2024-09-10T21:15:05.627900+0000","last_fullsized":"2024-09-10T21:15:05.627900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:24.633468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433973+0000","last_change":"2024-09-10T21:13:16.628733+0000","last_active":"2024-09-10T21:14:06.433973+0000","last_peered":"2024-09-10T21:14:06.433973+0000","last_clean":"2024-09-10T21:14:06.433973+0000","last_became_active":"2024-09-10T21:13:16.628419+0000","last_became_peered":"2024-09-10T21:13:16.628419+0000","last_unstale":"2024-09-10T21:14:06.433973+0000","last_undegraded":"2024-09-10T21:14:06.433973+0000","last_fullsized":"2024-09-10T21:14:06.433973+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:31.264739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636488+0000","last_change":"2024-09-10T21:13:18.656571+0000","last_active":"2024-09-10T21:15:05.636488+0000","last_peered":"2024-09-10T21:15:05.636488+0000","last_clean":"2024-09-10T21:15:05.636488+0000","last_became_active":"2024-09-10T21:13:18.656253+0000","last_became_peered":"2024-09-10T21:13:18.656253+0000","last_unstale":"2024-09-10T21:15:05.636488+0000","last_undegraded":"2024-09-10T21:15:05.636488+0000","last_fullsized":"2024-09-10T21:15:05.636488+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:57.848566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433543+0000","last_change":"2024-09-10T21:13:16.631750+0000","last_active":"2024-09-10T21:14:06.433543+0000","last_peered":"2024-09-10T21:14:06.433543+0000","last_clean":"2024-09-10T21:14:06.433543+0000","last_became_active":"2024-09-10T21:13:16.631245+0000","last_became_peered":"2024-09-10T21:13:16.631245+0000","last_unstale":"2024-09-10T21:14:06.433543+0000","last_undegraded":"2024-09-10T21:14:06.433543+0000","last_fullsized":"2024-09-10T21:14:06.433543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:28.787751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.635634+0000","last_change":"2024-09-10T21:13:18.660834+0000","last_active":"2024-09-10T21:15:05.635634+0000","last_peered":"2024-09-10T21:15:05.635634+0000","last_clean":"2024-09-10T21:15:05.635634+0000","last_became_active":"2024-09-10T21:13:18.660461+0000","last_became_peered":"2024-09-10T21:13:18.660461+0000","last_unstale":"2024-09-10T21:15:05.635634+0000","last_undegraded":"2024-09-10T21:15:05.635634+0000","last_fullsized":"2024-09-10T21:15:05.635634+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:55.531199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'5","reported_seq":131,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:10.093142+0000","last_change":"2024-09-10T21:13:16.726824+0000","last_active":"2024-09-10T21:15:10.093142+0000","last_peered":"2024-09-10T21:15:10.093142+0000","last_clean":"2024-09-10T21:15:10.093142+0000","last_became_active":"2024-09-10T21:13:16.726436+0000","last_became_peered":"2024-09-10T21:13:16.726436+0000","last_unstale":"2024-09-10T21:15:10.093142+0000","last_undegraded":"2024-09-10T21:15:10.093142+0000","last_fullsized":"2024-09-10T21:15:10.093142+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:49.391388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638751+0000","last_change":"2024-09-10T21:13:18.663725+0000","last_active":"2024-09-10T21:15:05.638751+0000","last_peered":"2024-09-10T21:15:05.638751+0000","last_clean":"2024-09-10T21:15:05.638751+0000","last_became_active":"2024-09-10T21:13:18.663254+0000","last_became_peered":"2024-09-10T21:13:18.663254+0000","last_unstale":"2024-09-10T21:15:05.638751+0000","last_undegraded":"2024-09-10T21:15:05.638751+0000","last_fullsized":"2024-09-10T21:15:05.638751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:19.672231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312748+0000","last_change":"2024-09-10T21:12:08.173849+0000","last_active":"2024-09-10T21:14:06.312748+0000","last_peered":"2024-09-10T21:14:06.312748+0000","last_clean":"2024-09-10T21:14:06.312748+0000","last_became_active":"2024-09-10T21:12:08.153630+0000","last_became_peered":"2024-09-10T21:12:08.153630+0000","last_unstale":"2024-09-10T21:14:06.312748+0000","last_undegraded":"2024-09-10T21:14:06.312748+0000","last_fullsized":"2024-09-10T21:14:06.312748+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:08:47.842259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:08:47.842259+0000","last_clean_scrub_stamp":"2024-09-10T21:08:47.842259+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:39.166390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433413+0000","last_change":"2024-09-10T21:13:16.628607+0000","last_active":"2024-09-10T21:14:06.433413+0000","last_peered":"2024-09-10T21:14:06.433413+0000","last_clean":"2024-09-10T21:14:06.433413+0000","last_became_active":"2024-09-10T21:13:16.627736+0000","last_became_peered":"2024-09-10T21:13:16.627736+0000","last_unstale":"2024-09-10T21:14:06.433413+0000","last_undegraded":"2024-09-10T21:14:06.433413+0000","last_fullsized":"2024-09-10T21:14:06.433413+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:16.388832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636188+0000","last_change":"2024-09-10T21:13:18.652634+0000","last_active":"2024-09-10T21:15:05.636188+0000","last_peered":"2024-09-10T21:15:05.636188+0000","last_clean":"2024-09-10T21:15:05.636188+0000","last_became_active":"2024-09-10T21:13:18.652325+0000","last_became_peered":"2024-09-10T21:13:18.652325+0000","last_unstale":"2024-09-10T21:15:05.636188+0000","last_undegraded":"2024-09-10T21:15:05.636188+0000","last_fullsized":"2024-09-10T21:15:05.636188+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:16.382355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312642+0000","last_change":"2024-09-10T21:13:16.631442+0000","last_active":"2024-09-10T21:14:06.312642+0000","last_peered":"2024-09-10T21:14:06.312642+0000","last_clean":"2024-09-10T21:14:06.312642+0000","last_became_active":"2024-09-10T21:13:16.631117+0000","last_became_peered":"2024-09-10T21:13:16.631117+0000","last_unstale":"2024-09-10T21:14:06.312642+0000","last_undegraded":"2024-09-10T21:14:06.312642+0000","last_fullsized":"2024-09-10T21:14:06.312642+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:35.376888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.635164+0000","last_change":"2024-09-10T21:13:18.644246+0000","last_active":"2024-09-10T21:15:05.635164+0000","last_peered":"2024-09-10T21:15:05.635164+0000","last_clean":"2024-09-10T21:15:05.635164+0000","last_became_active":"2024-09-10T21:13:18.643944+0000","last_became_peered":"2024-09-10T21:13:18.643944+0000","last_unstale":"2024-09-10T21:15:05.635164+0000","last_undegraded":"2024-09-10T21:15:05.635164+0000","last_fullsized":"2024-09-10T21:15:05.635164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:18.856149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":132,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:12.095387+0000","last_change":"2024-09-10T21:13:16.726716+0000","last_active":"2024-09-10T21:15:12.095387+0000","last_peered":"2024-09-10T21:15:12.095387+0000","last_clean":"2024-09-10T21:15:12.095387+0000","last_became_active":"2024-09-10T21:13:16.726400+0000","last_became_peered":"2024-09-10T21:13:16.726400+0000","last_unstale":"2024-09-10T21:15:12.095387+0000","last_undegraded":"2024-09-10T21:15:12.095387+0000","last_fullsized":"2024-09-10T21:15:12.095387+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:55.643495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.624187+0000","last_change":"2024-09-10T21:14:06.433990+0000","last_active":"2024-09-10T21:15:05.624187+0000","last_peered":"2024-09-10T21:15:05.624187+0000","last_clean":"2024-09-10T21:15:05.624187+0000","last_became_active":"2024-09-10T21:14:06.433489+0000","last_became_peered":"2024-09-10T21:14:06.433489+0000","last_unstale":"2024-09-10T21:15:05.624187+0000","last_undegraded":"2024-09-10T21:15:05.624187+0000","last_fullsized":"2024-09-10T21:15:05.624187+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:28.001658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"75'6","reported_seq":133,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:11.094570+0000","last_change":"2024-09-10T21:13:16.633126+0000","last_active":"2024-09-10T21:15:11.094570+0000","last_peered":"2024-09-10T21:15:11.094570+0000","last_clean":"2024-09-10T21:15:11.094570+0000","last_became_active":"2024-09-10T21:13:16.632808+0000","last_became_peered":"2024-09-10T21:13:16.632808+0000","last_unstale":"2024-09-10T21:15:11.094570+0000","last_undegraded":"2024-09-10T21:15:11.094570+0000","last_fullsized":"2024-09-10T21:15:11.094570+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:01.026506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.633724+0000","last_change":"2024-09-10T21:13:18.652631+0000","last_active":"2024-09-10T21:15:05.633724+0000","last_peered":"2024-09-10T21:15:05.633724+0000","last_clean":"2024-09-10T21:15:05.633724+0000","last_became_active":"2024-09-10T21:13:18.650580+0000","last_became_peered":"2024-09-10T21:13:18.650580+0000","last_unstale":"2024-09-10T21:15:05.633724+0000","last_undegraded":"2024-09-10T21:15:05.633724+0000","last_fullsized":"2024-09-10T21:15:05.633724+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:32.733169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.305817+0000","last_change":"2024-09-10T21:13:16.728172+0000","last_active":"2024-09-10T21:14:06.305817+0000","last_peered":"2024-09-10T21:14:06.305817+0000","last_clean":"2024-09-10T21:14:06.305817+0000","last_became_active":"2024-09-10T21:13:16.727793+0000","last_became_peered":"2024-09-10T21:13:16.727793+0000","last_unstale":"2024-09-10T21:14:06.305817+0000","last_undegraded":"2024-09-10T21:14:06.305817+0000","last_fullsized":"2024-09-10T21:14:06.305817+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:58:04.301119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.629258+0000","last_change":"2024-09-10T21:13:18.655371+0000","last_active":"2024-09-10T21:15:05.629258+0000","last_peered":"2024-09-10T21:15:05.629258+0000","last_clean":"2024-09-10T21:15:05.629258+0000","last_became_active":"2024-09-10T21:13:18.653250+0000","last_became_peered":"2024-09-10T21:13:18.653250+0000","last_unstale":"2024-09-10T21:15:05.629258+0000","last_undegraded":"2024-09-10T21:15:05.629258+0000","last_fullsized":"2024-09-10T21:15:05.629258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:25.650736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309415+0000","last_change":"2024-09-10T21:13:16.726816+0000","last_active":"2024-09-10T21:14:06.309415+0000","last_peered":"2024-09-10T21:14:06.309415+0000","last_clean":"2024-09-10T21:14:06.309415+0000","last_became_active":"2024-09-10T21:13:16.726438+0000","last_became_peered":"2024-09-10T21:13:16.726438+0000","last_unstale":"2024-09-10T21:14:06.309415+0000","last_undegraded":"2024-09-10T21:14:06.309415+0000","last_fullsized":"2024-09-10T21:14:06.309415+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:46.384899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.635531+0000","last_change":"2024-09-10T21:13:18.643424+0000","last_active":"2024-09-10T21:15:05.635531+0000","last_peered":"2024-09-10T21:15:05.635531+0000","last_clean":"2024-09-10T21:15:05.635531+0000","last_became_active":"2024-09-10T21:13:18.643010+0000","last_became_peered":"2024-09-10T21:13:18.643010+0000","last_unstale":"2024-09-10T21:15:05.635531+0000","last_undegraded":"2024-09-10T21:15:05.635531+0000","last_fullsized":"2024-09-10T21:15:05.635531+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:47.358129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'16","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.663709+0000","last_change":"2024-09-10T21:14:06.316327+0000","last_active":"2024-09-10T21:15:05.663709+0000","last_peered":"2024-09-10T21:15:05.663709+0000","last_clean":"2024-09-10T21:15:05.663709+0000","last_became_active":"2024-09-10T21:14:06.309000+0000","last_became_peered":"2024-09-10T21:14:06.309000+0000","last_unstale":"2024-09-10T21:15:05.663709+0000","last_undegraded":"2024-09-10T21:15:05.663709+0000","last_fullsized":"2024-09-10T21:15:05.663709+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:13.582411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.633119+0000","last_change":"2024-09-10T21:13:18.652347+0000","last_active":"2024-09-10T21:15:05.633119+0000","last_peered":"2024-09-10T21:15:05.633119+0000","last_clean":"2024-09-10T21:15:05.633119+0000","last_became_active":"2024-09-10T21:13:18.651942+0000","last_became_peered":"2024-09-10T21:13:18.651942+0000","last_unstale":"2024-09-10T21:15:05.633119+0000","last_undegraded":"2024-09-10T21:15:05.633119+0000","last_fullsized":"2024-09-10T21:15:05.633119+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:11.356787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433490+0000","last_change":"2024-09-10T21:13:16.621647+0000","last_active":"2024-09-10T21:14:06.433490+0000","last_peered":"2024-09-10T21:14:06.433490+0000","last_clean":"2024-09-10T21:14:06.433490+0000","last_became_active":"2024-09-10T21:13:16.621316+0000","last_became_peered":"2024-09-10T21:13:16.621316+0000","last_unstale":"2024-09-10T21:14:06.433490+0000","last_undegraded":"2024-09-10T21:14:06.433490+0000","last_fullsized":"2024-09-10T21:14:06.433490+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:10.264578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.637297+0000","last_change":"2024-09-10T21:13:18.656617+0000","last_active":"2024-09-10T21:15:05.637297+0000","last_peered":"2024-09-10T21:15:05.637297+0000","last_clean":"2024-09-10T21:15:05.637297+0000","last_became_active":"2024-09-10T21:13:18.656331+0000","last_became_peered":"2024-09-10T21:13:18.656331+0000","last_unstale":"2024-09-10T21:15:05.637297+0000","last_undegraded":"2024-09-10T21:15:05.637297+0000","last_fullsized":"2024-09-10T21:15:05.637297+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:44.482797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309648+0000","last_change":"2024-09-10T21:13:16.727736+0000","last_active":"2024-09-10T21:14:06.309648+0000","last_peered":"2024-09-10T21:14:06.309648+0000","last_clean":"2024-09-10T21:14:06.309648+0000","last_became_active":"2024-09-10T21:13:16.727413+0000","last_became_peered":"2024-09-10T21:13:16.727413+0000","last_unstale":"2024-09-10T21:14:06.309648+0000","last_undegraded":"2024-09-10T21:14:06.309648+0000","last_fullsized":"2024-09-10T21:14:06.309648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:26.351729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.592112+0000","last_change":"2024-09-10T21:13:18.660100+0000","last_active":"2024-09-10T21:15:05.592112+0000","last_peered":"2024-09-10T21:15:05.592112+0000","last_clean":"2024-09-10T21:15:05.592112+0000","last_became_active":"2024-09-10T21:13:18.659733+0000","last_became_peered":"2024-09-10T21:13:18.659733+0000","last_unstale":"2024-09-10T21:15:05.592112+0000","last_undegraded":"2024-09-10T21:15:05.592112+0000","last_fullsized":"2024-09-10T21:15:05.592112+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:44.371627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308097+0000","last_change":"2024-09-10T21:13:16.627194+0000","last_active":"2024-09-10T21:14:06.308097+0000","last_peered":"2024-09-10T21:14:06.308097+0000","last_clean":"2024-09-10T21:14:06.308097+0000","last_became_active":"2024-09-10T21:13:16.626805+0000","last_became_peered":"2024-09-10T21:13:16.626805+0000","last_unstale":"2024-09-10T21:14:06.308097+0000","last_undegraded":"2024-09-10T21:14:06.308097+0000","last_fullsized":"2024-09-10T21:14:06.308097+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:33.582084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.623962+0000","last_change":"2024-09-10T21:13:18.663122+0000","last_active":"2024-09-10T21:15:05.623962+0000","last_peered":"2024-09-10T21:15:05.623962+0000","last_clean":"2024-09-10T21:15:05.623962+0000","last_became_active":"2024-09-10T21:13:18.662673+0000","last_became_peered":"2024-09-10T21:13:18.662673+0000","last_unstale":"2024-09-10T21:15:05.623962+0000","last_undegraded":"2024-09-10T21:15:05.623962+0000","last_fullsized":"2024-09-10T21:15:05.623962+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:15.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.320090+0000","last_change":"2024-09-10T21:14:06.319645+0000","last_active":"2024-09-10T21:14:06.320090+0000","last_peered":"2024-09-10T21:14:06.320090+0000","last_clean":"2024-09-10T21:14:06.320090+0000","last_became_active":"2024-09-10T21:14:06.311394+0000","last_became_peered":"2024-09-10T21:14:06.311394+0000","last_unstale":"2024-09-10T21:14:06.320090+0000","last_undegraded":"2024-09-10T21:14:06.320090+0000","last_fullsized":"2024-09-10T21:14:06.320090+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:26:20.925331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.631611+0000","last_change":"2024-09-10T21:13:18.656400+0000","last_active":"2024-09-10T21:15:05.631611+0000","last_peered":"2024-09-10T21:15:05.631611+0000","last_clean":"2024-09-10T21:15:05.631611+0000","last_became_active":"2024-09-10T21:13:18.655802+0000","last_became_peered":"2024-09-10T21:13:18.655802+0000","last_unstale":"2024-09-10T21:15:05.631611+0000","last_undegraded":"2024-09-10T21:15:05.631611+0000","last_fullsized":"2024-09-10T21:15:05.631611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:41.901404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.438924+0000","last_change":"2024-09-10T21:14:06.438851+0000","last_active":"2024-09-10T21:14:06.438924+0000","last_peered":"2024-09-10T21:14:06.438924+0000","last_clean":"2024-09-10T21:14:06.438924+0000","last_became_active":"2024-09-10T21:14:06.434291+0000","last_became_peered":"2024-09-10T21:14:06.434291+0000","last_unstale":"2024-09-10T21:14:06.438924+0000","last_undegraded":"2024-09-10T21:14:06.438924+0000","last_fullsized":"2024-09-10T21:14:06.438924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:43.895028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.639513+0000","last_change":"2024-09-10T21:13:18.664331+0000","last_active":"2024-09-10T21:15:05.639513+0000","last_peered":"2024-09-10T21:15:05.639513+0000","last_clean":"2024-09-10T21:15:05.639513+0000","last_became_active":"2024-09-10T21:13:18.663823+0000","last_became_peered":"2024-09-10T21:13:18.663823+0000","last_unstale":"2024-09-10T21:15:05.639513+0000","last_undegraded":"2024-09-10T21:15:05.639513+0000","last_fullsized":"2024-09-10T21:15:05.639513+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:37.626712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.633093+0000","last_change":"2024-09-10T21:13:18.659941+0000","last_active":"2024-09-10T21:15:05.633093+0000","last_peered":"2024-09-10T21:15:05.633093+0000","last_clean":"2024-09-10T21:15:05.633093+0000","last_became_active":"2024-09-10T21:13:18.659019+0000","last_became_peered":"2024-09-10T21:13:18.659019+0000","last_unstale":"2024-09-10T21:15:05.633093+0000","last_undegraded":"2024-09-10T21:15:05.633093+0000","last_fullsized":"2024-09-10T21:15:05.633093+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:41.037722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309893+0000","last_change":"2024-09-10T21:13:16.633660+0000","last_active":"2024-09-10T21:14:06.309893+0000","last_peered":"2024-09-10T21:14:06.309893+0000","last_clean":"2024-09-10T21:14:06.309893+0000","last_became_active":"2024-09-10T21:13:16.633222+0000","last_became_peered":"2024-09-10T21:13:16.633222+0000","last_unstale":"2024-09-10T21:14:06.309893+0000","last_undegraded":"2024-09-10T21:14:06.309893+0000","last_fullsized":"2024-09-10T21:14:06.309893+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:56.364355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636617+0000","last_change":"2024-09-10T21:13:18.666837+0000","last_active":"2024-09-10T21:15:05.636617+0000","last_peered":"2024-09-10T21:15:05.636617+0000","last_clean":"2024-09-10T21:15:05.636617+0000","last_became_active":"2024-09-10T21:13:18.666382+0000","last_became_peered":"2024-09-10T21:13:18.666382+0000","last_unstale":"2024-09-10T21:15:05.636617+0000","last_undegraded":"2024-09-10T21:15:05.636617+0000","last_fullsized":"2024-09-10T21:15:05.636617+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:32.225130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309304+0000","last_change":"2024-09-10T21:13:16.631424+0000","last_active":"2024-09-10T21:14:06.309304+0000","last_peered":"2024-09-10T21:14:06.309304+0000","last_clean":"2024-09-10T21:14:06.309304+0000","last_became_active":"2024-09-10T21:13:16.631116+0000","last_became_peered":"2024-09-10T21:13:16.631116+0000","last_unstale":"2024-09-10T21:14:06.309304+0000","last_undegraded":"2024-09-10T21:14:06.309304+0000","last_fullsized":"2024-09-10T21:14:06.309304+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:15.506410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.639550+0000","last_change":"2024-09-10T21:13:18.654978+0000","last_active":"2024-09-10T21:15:05.639550+0000","last_peered":"2024-09-10T21:15:05.639550+0000","last_clean":"2024-09-10T21:15:05.639550+0000","last_became_active":"2024-09-10T21:13:18.654581+0000","last_became_peered":"2024-09-10T21:13:18.654581+0000","last_unstale":"2024-09-10T21:15:05.639550+0000","last_undegraded":"2024-09-10T21:15:05.639550+0000","last_fullsized":"2024-09-10T21:15:05.639550+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:17.504626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308544+0000","last_change":"2024-09-10T21:13:16.726727+0000","last_active":"2024-09-10T21:14:06.308544+0000","last_peered":"2024-09-10T21:14:06.308544+0000","last_clean":"2024-09-10T21:14:06.308544+0000","last_became_active":"2024-09-10T21:13:16.726373+0000","last_became_peered":"2024-09-10T21:13:16.726373+0000","last_unstale":"2024-09-10T21:14:06.308544+0000","last_undegraded":"2024-09-10T21:14:06.308544+0000","last_fullsized":"2024-09-10T21:14:06.308544+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:31.803631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.630259+0000","last_change":"2024-09-10T21:13:18.648384+0000","last_active":"2024-09-10T21:15:05.630259+0000","last_peered":"2024-09-10T21:15:05.630259+0000","last_clean":"2024-09-10T21:15:05.630259+0000","last_became_active":"2024-09-10T21:13:18.647911+0000","last_became_peered":"2024-09-10T21:13:18.647911+0000","last_unstale":"2024-09-10T21:15:05.630259+0000","last_undegraded":"2024-09-10T21:15:05.630259+0000","last_fullsized":"2024-09-10T21:15:05.630259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:02.582548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'14","reported_seq":141,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:12.095279+0000","last_change":"2024-09-10T21:13:16.631501+0000","last_active":"2024-09-10T21:15:12.095279+0000","last_peered":"2024-09-10T21:15:12.095279+0000","last_clean":"2024-09-10T21:15:12.095279+0000","last_became_active":"2024-09-10T21:13:16.631246+0000","last_became_peered":"2024-09-10T21:13:16.631246+0000","last_unstale":"2024-09-10T21:15:12.095279+0000","last_undegraded":"2024-09-10T21:15:12.095279+0000","last_fullsized":"2024-09-10T21:15:12.095279+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:25.277370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67581,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1054,"num_read_kb":602,"num_write":253,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":202743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36140,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709012,"statfs":{"total":95995035648,"available":95958028288,"internally_reserved":0,"allocated":815104,"data_stored":393851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005096,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1044891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135918,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":393781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332147,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":394159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528376,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28424,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716728,"statfs":{"total":95995035648,"available":95965929472,"internally_reserved":0,"allocated":1433600,"data_stored":987126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659197,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36148,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709004,"statfs":{"total":95995035648,"available":95958020096,"internally_reserved":0,"allocated":823296,"data_stored":393806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855426,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28436,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716716,"statfs":{"total":95995035648,"available":95965917184,"internally_reserved":0,"allocated":1445888,"data_stored":986496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":393359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":393323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":455482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":455038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":843776,"data_stored":394837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:15:15.339 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:15:15.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:14 smithi154 ceph-mon[35041]: pgmap v339: 97 pgs: 97 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T21:15:15.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:14 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/493897938' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:15:15.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.473+0000 7f8480b2b640 1 -- 172.21.15.59:0/1108676057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c105cf0 msgr2=0x7f847c106170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:15.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.473+0000 7f8480b2b640 1 --2- 172.21.15.59:0/1108676057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c105cf0 0x7f847c106170 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8464009930 tx=0x7f846402a420 comp rx=0 tx=0).stop 2024-09-10T21:15:15.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.473+0000 7f8480b2b640 1 -- 172.21.15.59:0/1108676057 shutdown_connections 2024-09-10T21:15:15.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.473+0000 7f8480b2b640 1 --2- 172.21.15.59:0/1108676057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f847c1066b0 0x7f847c10d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.473+0000 7f8480b2b640 1 --2- 172.21.15.59:0/1108676057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c105cf0 0x7f847c106170 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.473+0000 7f8480b2b640 1 --2- 172.21.15.59:0/1108676057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f847c104ba0 0x7f847c104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.473+0000 7f8480b2b640 1 -- 172.21.15.59:0/1108676057 >> 172.21.15.59:0/1108676057 conn(0x7f847c100440 msgr2=0x7f847c102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:15.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.474+0000 7f8480b2b640 1 -- 172.21.15.59:0/1108676057 shutdown_connections 2024-09-10T21:15:15.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.474+0000 7f8480b2b640 1 -- 172.21.15.59:0/1108676057 wait complete. 2024-09-10T21:15:15.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.474+0000 7f8480b2b640 1 Processor -- start 2024-09-10T21:15:15.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.474+0000 7f8480b2b640 1 -- start start 2024-09-10T21:15:15.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.474+0000 7f8480b2b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f847c104ba0 0x7f847c19afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:15.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.474+0000 7f8480b2b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c105cf0 0x7f847c19b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:15.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.474+0000 7f8480b2b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f847c1066b0 0x7f847c19c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:15.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.474+0000 7f8480b2b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f847c1107f0 con 0x7f847c105cf0 2024-09-10T21:15:15.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.474+0000 7f8480b2b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f847c110670 con 0x7f847c1066b0 2024-09-10T21:15:15.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.474+0000 7f8480b2b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f847c110970 con 0x7f847c104ba0 2024-09-10T21:15:15.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.475+0000 7f8479d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c105cf0 0x7f847c19b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:15.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.475+0000 7f8479d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c105cf0 0x7f847c19b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59406/0 (socket says 172.21.15.59:59406) 2024-09-10T21:15:15.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.475+0000 7f8479d9b640 1 -- 172.21.15.59:0/937451421 learned_addr learned my addr 172.21.15.59:0/937451421 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:15.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.475+0000 7f847ad9d640 1 --2- 172.21.15.59:0/937451421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f847c1066b0 0x7f847c19c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:15.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.475+0000 7f847a59c640 1 --2- 172.21.15.59:0/937451421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f847c104ba0 0x7f847c19afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:15.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.475+0000 7f8479d9b640 1 -- 172.21.15.59:0/937451421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f847c104ba0 msgr2=0x7f847c19afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:15.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.475+0000 7f8479d9b640 1 --2- 172.21.15.59:0/937451421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f847c104ba0 0x7f847c19afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.475+0000 7f8479d9b640 1 -- 172.21.15.59:0/937451421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f847c1066b0 msgr2=0x7f847c19c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:15.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.475+0000 7f8479d9b640 1 --2- 172.21.15.59:0/937451421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f847c1066b0 0x7f847c19c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.475+0000 7f8479d9b640 1 -- 172.21.15.59:0/937451421 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847c19cb10 con 0x7f847c105cf0 2024-09-10T21:15:15.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.475+0000 7f8479d9b640 1 --2- 172.21.15.59:0/937451421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c105cf0 0x7f847c19b620 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8464009230 tx=0x7f8464031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:15.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.475+0000 7f84737fe640 1 -- 172.21.15.59:0/937451421 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846403f030 con 0x7f847c105cf0 2024-09-10T21:15:15.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.475+0000 7f84737fe640 1 -- 172.21.15.59:0/937451421 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8464003aa0 con 0x7f847c105cf0 2024-09-10T21:15:15.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.475+0000 7f8480b2b640 1 -- 172.21.15.59:0/937451421 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f847c19cda0 con 0x7f847c105cf0 2024-09-10T21:15:15.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.475+0000 7f84737fe640 1 -- 172.21.15.59:0/937451421 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8464035070 con 0x7f847c105cf0 2024-09-10T21:15:15.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.475+0000 7f8480b2b640 1 -- 172.21.15.59:0/937451421 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f847c1a34d0 con 0x7f847c105cf0 2024-09-10T21:15:15.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.476+0000 7f8480b2b640 1 -- 172.21.15.59:0/937451421 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f847c104fa0 con 0x7f847c105cf0 2024-09-10T21:15:15.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.478+0000 7f84737fe640 1 -- 172.21.15.59:0/937451421 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f8464003c50 con 0x7f847c105cf0 2024-09-10T21:15:15.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.479+0000 7f84737fe640 1 --2- 172.21.15.59:0/937451421 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f84680b52e0 0x7f84680b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:15.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.479+0000 7f847a59c640 1 --2- 172.21.15.59:0/937451421 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f84680b52e0 0x7f84680b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:15.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.479+0000 7f84737fe640 1 -- 172.21.15.59:0/937451421 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8464106910 con 0x7f847c105cf0 2024-09-10T21:15:15.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.479+0000 7f847a59c640 1 --2- 172.21.15.59:0/937451421 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f84680b52e0 0x7f84680b77a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8474005fd0 tx=0x7f8474009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:15.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.482+0000 7f84737fe640 1 -- 172.21.15.59:0/937451421 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f84640cd800 con 0x7f847c105cf0 2024-09-10T21:15:15.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.665+0000 7f8480b2b640 1 -- 172.21.15.59:0/937451421 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f847c063590 con 0x7f84680b52e0 2024-09-10T21:15:15.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.669+0000 7f84737fe640 1 -- 172.21.15.59:0/937451421 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258870 (secure 0 0 0) 0x7f847c063590 con 0x7f84680b52e0 2024-09-10T21:15:15.676 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:15:15.677 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-10T21:15:15.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.673+0000 7f8480b2b640 1 -- 172.21.15.59:0/937451421 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f84680b52e0 msgr2=0x7f84680b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:15.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.673+0000 7f8480b2b640 1 --2- 172.21.15.59:0/937451421 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f84680b52e0 0x7f84680b77a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8474005fd0 tx=0x7f8474009870 comp rx=0 tx=0).stop 2024-09-10T21:15:15.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.673+0000 7f8480b2b640 1 -- 172.21.15.59:0/937451421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c105cf0 msgr2=0x7f847c19b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:15.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.673+0000 7f8480b2b640 1 --2- 172.21.15.59:0/937451421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c105cf0 0x7f847c19b620 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8464009230 tx=0x7f8464031a50 comp rx=0 tx=0).stop 2024-09-10T21:15:15.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.673+0000 7f8480b2b640 1 -- 172.21.15.59:0/937451421 shutdown_connections 2024-09-10T21:15:15.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.673+0000 7f8480b2b640 1 --2- 172.21.15.59:0/937451421 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f84680b52e0 0x7f84680b77a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.673+0000 7f8480b2b640 1 --2- 172.21.15.59:0/937451421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f847c1066b0 0x7f847c19c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.673+0000 7f8480b2b640 1 --2- 172.21.15.59:0/937451421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c105cf0 0x7f847c19b620 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.673+0000 7f8480b2b640 1 --2- 172.21.15.59:0/937451421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f847c104ba0 0x7f847c19afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.673+0000 7f8480b2b640 1 -- 172.21.15.59:0/937451421 >> 172.21.15.59:0/937451421 conn(0x7f847c100440 msgr2=0x7f847c109080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:15.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.673+0000 7f8480b2b640 1 -- 172.21.15.59:0/937451421 shutdown_connections 2024-09-10T21:15:15.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.673+0000 7f8480b2b640 1 -- 172.21.15.59:0/937451421 wait complete. 2024-09-10T21:15:15.688 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-09-10T21:15:15.254276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658183,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1130,"num_read_kb":666,"num_write":378,"num_write_kb":2293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2951840,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":811,"ondisk_log_size":811,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369292,"kb_used_data":11724,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572532,"statfs":{"total":1151940427776,"available":1151562272768,"internally_reserved":0,"allocated":12005376,"data_stored":6686149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1006,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":63,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002825"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.631039+0000","last_change":"2024-09-10T21:13:18.656166+0000","last_active":"2024-09-10T21:15:05.631039+0000","last_peered":"2024-09-10T21:15:05.631039+0000","last_clean":"2024-09-10T21:15:05.631039+0000","last_became_active":"2024-09-10T21:13:18.655774+0000","last_became_peered":"2024-09-10T21:13:18.655774+0000","last_unstale":"2024-09-10T21:15:05.631039+0000","last_undegraded":"2024-09-10T21:15:05.631039+0000","last_fullsized":"2024-09-10T21:15:05.631039+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:57.775209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636830+0000","last_change":"2024-09-10T21:13:18.654232+0000","last_active":"2024-09-10T21:15:05.636830+0000","last_peered":"2024-09-10T21:15:05.636830+0000","last_clean":"2024-09-10T21:15:05.636830+0000","last_became_active":"2024-09-10T21:13:18.653928+0000","last_became_peered":"2024-09-10T21:13:18.653928+0000","last_unstale":"2024-09-10T21:15:05.636830+0000","last_undegraded":"2024-09-10T21:15:05.636830+0000","last_fullsized":"2024-09-10T21:15:05.636830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:02.615686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.639156+0000","last_change":"2024-09-10T21:13:18.662923+0000","last_active":"2024-09-10T21:15:05.639156+0000","last_peered":"2024-09-10T21:15:05.639156+0000","last_clean":"2024-09-10T21:15:05.639156+0000","last_became_active":"2024-09-10T21:13:18.662541+0000","last_became_peered":"2024-09-10T21:13:18.662541+0000","last_unstale":"2024-09-10T21:15:05.639156+0000","last_undegraded":"2024-09-10T21:15:05.639156+0000","last_fullsized":"2024-09-10T21:15:05.639156+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:33:11.140761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.632974+0000","last_change":"2024-09-10T21:14:06.311161+0000","last_active":"2024-09-10T21:15:05.632974+0000","last_peered":"2024-09-10T21:15:05.632974+0000","last_clean":"2024-09-10T21:15:05.632974+0000","last_became_active":"2024-09-10T21:14:06.310829+0000","last_became_peered":"2024-09-10T21:14:06.310829+0000","last_unstale":"2024-09-10T21:15:05.632974+0000","last_undegraded":"2024-09-10T21:15:05.632974+0000","last_fullsized":"2024-09-10T21:15:05.632974+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:17.318129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.622564+0000","last_change":"2024-09-10T21:13:18.650427+0000","last_active":"2024-09-10T21:15:05.622564+0000","last_peered":"2024-09-10T21:15:05.622564+0000","last_clean":"2024-09-10T21:15:05.622564+0000","last_became_active":"2024-09-10T21:13:18.650039+0000","last_became_peered":"2024-09-10T21:13:18.650039+0000","last_unstale":"2024-09-10T21:15:05.622564+0000","last_undegraded":"2024-09-10T21:15:05.622564+0000","last_fullsized":"2024-09-10T21:15:05.622564+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:11.363642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.633901+0000","last_change":"2024-09-10T21:13:18.654320+0000","last_active":"2024-09-10T21:15:05.633901+0000","last_peered":"2024-09-10T21:15:05.633901+0000","last_clean":"2024-09-10T21:15:05.633901+0000","last_became_active":"2024-09-10T21:13:18.653291+0000","last_became_peered":"2024-09-10T21:13:18.653291+0000","last_unstale":"2024-09-10T21:15:05.633901+0000","last_undegraded":"2024-09-10T21:15:05.633901+0000","last_fullsized":"2024-09-10T21:15:05.633901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:08:28.176816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.637595+0000","last_change":"2024-09-10T21:13:18.659695+0000","last_active":"2024-09-10T21:15:05.637595+0000","last_peered":"2024-09-10T21:15:05.637595+0000","last_clean":"2024-09-10T21:15:05.637595+0000","last_became_active":"2024-09-10T21:13:18.659240+0000","last_became_peered":"2024-09-10T21:13:18.659240+0000","last_unstale":"2024-09-10T21:15:05.637595+0000","last_undegraded":"2024-09-10T21:15:05.637595+0000","last_fullsized":"2024-09-10T21:15:05.637595+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:58.951873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.631859+0000","last_change":"2024-09-10T21:14:06.435134+0000","last_active":"2024-09-10T21:15:05.631859+0000","last_peered":"2024-09-10T21:15:05.631859+0000","last_clean":"2024-09-10T21:15:05.631859+0000","last_became_active":"2024-09-10T21:14:06.434801+0000","last_became_peered":"2024-09-10T21:14:06.434801+0000","last_unstale":"2024-09-10T21:15:05.631859+0000","last_undegraded":"2024-09-10T21:15:05.631859+0000","last_fullsized":"2024-09-10T21:15:05.631859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:01.473083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.633884+0000","last_change":"2024-09-10T21:13:18.656252+0000","last_active":"2024-09-10T21:15:05.633884+0000","last_peered":"2024-09-10T21:15:05.633884+0000","last_clean":"2024-09-10T21:15:05.633884+0000","last_became_active":"2024-09-10T21:13:18.655879+0000","last_became_peered":"2024-09-10T21:13:18.655879+0000","last_unstale":"2024-09-10T21:15:05.633884+0000","last_undegraded":"2024-09-10T21:15:05.633884+0000","last_fullsized":"2024-09-10T21:15:05.633884+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:03.748183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.637233+0000","last_change":"2024-09-10T21:13:18.663370+0000","last_active":"2024-09-10T21:15:05.637233+0000","last_peered":"2024-09-10T21:15:05.637233+0000","last_clean":"2024-09-10T21:15:05.637233+0000","last_became_active":"2024-09-10T21:13:18.662863+0000","last_became_peered":"2024-09-10T21:13:18.662863+0000","last_unstale":"2024-09-10T21:15:05.637233+0000","last_undegraded":"2024-09-10T21:15:05.637233+0000","last_fullsized":"2024-09-10T21:15:05.637233+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:22.912596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638616+0000","last_change":"2024-09-10T21:13:18.663626+0000","last_active":"2024-09-10T21:15:05.638616+0000","last_peered":"2024-09-10T21:15:05.638616+0000","last_clean":"2024-09-10T21:15:05.638616+0000","last_became_active":"2024-09-10T21:13:18.663280+0000","last_became_peered":"2024-09-10T21:13:18.663280+0000","last_unstale":"2024-09-10T21:15:05.638616+0000","last_undegraded":"2024-09-10T21:15:05.638616+0000","last_fullsized":"2024-09-10T21:15:05.638616+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:07.874387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.609442+0000","last_change":"2024-09-10T21:13:18.660791+0000","last_active":"2024-09-10T21:15:05.609442+0000","last_peered":"2024-09-10T21:15:05.609442+0000","last_clean":"2024-09-10T21:15:05.609442+0000","last_became_active":"2024-09-10T21:13:18.660386+0000","last_became_peered":"2024-09-10T21:13:18.660386+0000","last_unstale":"2024-09-10T21:15:05.609442+0000","last_undegraded":"2024-09-10T21:15:05.609442+0000","last_fullsized":"2024-09-10T21:15:05.609442+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:37.218822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636304+0000","last_change":"2024-09-10T21:13:18.655893+0000","last_active":"2024-09-10T21:15:05.636304+0000","last_peered":"2024-09-10T21:15:05.636304+0000","last_clean":"2024-09-10T21:15:05.636304+0000","last_became_active":"2024-09-10T21:13:18.655524+0000","last_became_peered":"2024-09-10T21:13:18.655524+0000","last_unstale":"2024-09-10T21:15:05.636304+0000","last_undegraded":"2024-09-10T21:15:05.636304+0000","last_fullsized":"2024-09-10T21:15:05.636304+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:29.734783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638144+0000","last_change":"2024-09-10T21:13:18.654359+0000","last_active":"2024-09-10T21:15:05.638144+0000","last_peered":"2024-09-10T21:15:05.638144+0000","last_clean":"2024-09-10T21:15:05.638144+0000","last_became_active":"2024-09-10T21:13:18.653983+0000","last_became_peered":"2024-09-10T21:13:18.653983+0000","last_unstale":"2024-09-10T21:15:05.638144+0000","last_undegraded":"2024-09-10T21:15:05.638144+0000","last_fullsized":"2024-09-10T21:15:05.638144+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:48.806836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.637562+0000","last_change":"2024-09-10T21:13:18.650428+0000","last_active":"2024-09-10T21:15:05.637562+0000","last_peered":"2024-09-10T21:15:05.637562+0000","last_clean":"2024-09-10T21:15:05.637562+0000","last_became_active":"2024-09-10T21:13:18.650121+0000","last_became_peered":"2024-09-10T21:13:18.650121+0000","last_unstale":"2024-09-10T21:15:05.637562+0000","last_undegraded":"2024-09-10T21:15:05.637562+0000","last_fullsized":"2024-09-10T21:15:05.637562+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:15.121916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.639726+0000","last_change":"2024-09-10T21:13:18.662321+0000","last_active":"2024-09-10T21:15:05.639726+0000","last_peered":"2024-09-10T21:15:05.639726+0000","last_clean":"2024-09-10T21:15:05.639726+0000","last_became_active":"2024-09-10T21:13:18.662013+0000","last_became_peered":"2024-09-10T21:13:18.662013+0000","last_unstale":"2024-09-10T21:15:05.639726+0000","last_undegraded":"2024-09-10T21:15:05.639726+0000","last_fullsized":"2024-09-10T21:15:05.639726+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:54.303375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.631470+0000","last_change":"2024-09-10T21:13:18.662549+0000","last_active":"2024-09-10T21:15:05.631470+0000","last_peered":"2024-09-10T21:15:05.631470+0000","last_clean":"2024-09-10T21:15:05.631470+0000","last_became_active":"2024-09-10T21:13:18.662230+0000","last_became_peered":"2024-09-10T21:13:18.662230+0000","last_unstale":"2024-09-10T21:15:05.631470+0000","last_undegraded":"2024-09-10T21:15:05.631470+0000","last_fullsized":"2024-09-10T21:15:05.631470+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:02.582355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.634231+0000","last_change":"2024-09-10T21:13:18.654906+0000","last_active":"2024-09-10T21:15:05.634231+0000","last_peered":"2024-09-10T21:15:05.634231+0000","last_clean":"2024-09-10T21:15:05.634231+0000","last_became_active":"2024-09-10T21:13:18.654599+0000","last_became_peered":"2024-09-10T21:13:18.654599+0000","last_unstale":"2024-09-10T21:15:05.634231+0000","last_undegraded":"2024-09-10T21:15:05.634231+0000","last_fullsized":"2024-09-10T21:15:05.634231+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:34.987893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.632146+0000","last_change":"2024-09-10T21:13:18.643997+0000","last_active":"2024-09-10T21:15:05.632146+0000","last_peered":"2024-09-10T21:15:05.632146+0000","last_clean":"2024-09-10T21:15:05.632146+0000","last_became_active":"2024-09-10T21:13:18.643632+0000","last_became_peered":"2024-09-10T21:13:18.643632+0000","last_unstale":"2024-09-10T21:15:05.632146+0000","last_undegraded":"2024-09-10T21:15:05.632146+0000","last_fullsized":"2024-09-10T21:15:05.632146+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:31.234040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.617895+0000","last_change":"2024-09-10T21:13:18.657079+0000","last_active":"2024-09-10T21:15:05.617895+0000","last_peered":"2024-09-10T21:15:05.617895+0000","last_clean":"2024-09-10T21:15:05.617895+0000","last_became_active":"2024-09-10T21:13:18.656741+0000","last_became_peered":"2024-09-10T21:13:18.656741+0000","last_unstale":"2024-09-10T21:15:05.617895+0000","last_undegraded":"2024-09-10T21:15:05.617895+0000","last_fullsized":"2024-09-10T21:15:05.617895+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:27.036783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638632+0000","last_change":"2024-09-10T21:13:18.653076+0000","last_active":"2024-09-10T21:15:05.638632+0000","last_peered":"2024-09-10T21:15:05.638632+0000","last_clean":"2024-09-10T21:15:05.638632+0000","last_became_active":"2024-09-10T21:13:18.652722+0000","last_became_peered":"2024-09-10T21:13:18.652722+0000","last_unstale":"2024-09-10T21:15:05.638632+0000","last_undegraded":"2024-09-10T21:15:05.638632+0000","last_fullsized":"2024-09-10T21:15:05.638632+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:11.005632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.639992+0000","last_change":"2024-09-10T21:13:18.663340+0000","last_active":"2024-09-10T21:15:05.639992+0000","last_peered":"2024-09-10T21:15:05.639992+0000","last_clean":"2024-09-10T21:15:05.639992+0000","last_became_active":"2024-09-10T21:13:18.662981+0000","last_became_peered":"2024-09-10T21:13:18.662981+0000","last_unstale":"2024-09-10T21:15:05.639992+0000","last_undegraded":"2024-09-10T21:15:05.639992+0000","last_fullsized":"2024-09-10T21:15:05.639992+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:39.510625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.629760+0000","last_change":"2024-09-10T21:13:18.651376+0000","last_active":"2024-09-10T21:15:05.629760+0000","last_peered":"2024-09-10T21:15:05.629760+0000","last_clean":"2024-09-10T21:15:05.629760+0000","last_became_active":"2024-09-10T21:13:18.650999+0000","last_became_peered":"2024-09-10T21:13:18.650999+0000","last_unstale":"2024-09-10T21:15:05.629760+0000","last_undegraded":"2024-09-10T21:15:05.629760+0000","last_fullsized":"2024-09-10T21:15:05.629760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:12.268120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.628971+0000","last_change":"2024-09-10T21:13:18.648634+0000","last_active":"2024-09-10T21:15:05.628971+0000","last_peered":"2024-09-10T21:15:05.628971+0000","last_clean":"2024-09-10T21:15:05.628971+0000","last_became_active":"2024-09-10T21:13:18.648099+0000","last_became_peered":"2024-09-10T21:13:18.648099+0000","last_unstale":"2024-09-10T21:15:05.628971+0000","last_undegraded":"2024-09-10T21:15:05.628971+0000","last_fullsized":"2024-09-10T21:15:05.628971+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:47.570132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.627349+0000","last_change":"2024-09-10T21:13:18.660188+0000","last_active":"2024-09-10T21:15:05.627349+0000","last_peered":"2024-09-10T21:15:05.627349+0000","last_clean":"2024-09-10T21:15:05.627349+0000","last_became_active":"2024-09-10T21:13:18.659821+0000","last_became_peered":"2024-09-10T21:13:18.659821+0000","last_unstale":"2024-09-10T21:15:05.627349+0000","last_undegraded":"2024-09-10T21:15:05.627349+0000","last_fullsized":"2024-09-10T21:15:05.627349+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:36.456852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.632319+0000","last_change":"2024-09-10T21:13:18.656727+0000","last_active":"2024-09-10T21:15:05.632319+0000","last_peered":"2024-09-10T21:15:05.632319+0000","last_clean":"2024-09-10T21:15:05.632319+0000","last_became_active":"2024-09-10T21:13:18.654627+0000","last_became_peered":"2024-09-10T21:13:18.654627+0000","last_unstale":"2024-09-10T21:15:05.632319+0000","last_undegraded":"2024-09-10T21:15:05.632319+0000","last_fullsized":"2024-09-10T21:15:05.632319+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:42.838893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.629978+0000","last_change":"2024-09-10T21:13:18.660113+0000","last_active":"2024-09-10T21:15:05.629978+0000","last_peered":"2024-09-10T21:15:05.629978+0000","last_clean":"2024-09-10T21:15:05.629978+0000","last_became_active":"2024-09-10T21:13:18.659668+0000","last_became_peered":"2024-09-10T21:13:18.659668+0000","last_unstale":"2024-09-10T21:15:05.629978+0000","last_undegraded":"2024-09-10T21:15:05.629978+0000","last_fullsized":"2024-09-10T21:15:05.629978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:43.733431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.637642+0000","last_change":"2024-09-10T21:13:18.648015+0000","last_active":"2024-09-10T21:15:05.637642+0000","last_peered":"2024-09-10T21:15:05.637642+0000","last_clean":"2024-09-10T21:15:05.637642+0000","last_became_active":"2024-09-10T21:13:18.647661+0000","last_became_peered":"2024-09-10T21:13:18.647661+0000","last_unstale":"2024-09-10T21:15:05.637642+0000","last_undegraded":"2024-09-10T21:15:05.637642+0000","last_fullsized":"2024-09-10T21:15:05.637642+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:22.543217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638146+0000","last_change":"2024-09-10T21:13:18.657728+0000","last_active":"2024-09-10T21:15:05.638146+0000","last_peered":"2024-09-10T21:15:05.638146+0000","last_clean":"2024-09-10T21:15:05.638146+0000","last_became_active":"2024-09-10T21:13:18.657372+0000","last_became_peered":"2024-09-10T21:13:18.657372+0000","last_unstale":"2024-09-10T21:15:05.638146+0000","last_undegraded":"2024-09-10T21:15:05.638146+0000","last_fullsized":"2024-09-10T21:15:05.638146+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:43.621668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.626804+0000","last_change":"2024-09-10T21:13:18.648380+0000","last_active":"2024-09-10T21:15:05.626804+0000","last_peered":"2024-09-10T21:15:05.626804+0000","last_clean":"2024-09-10T21:15:05.626804+0000","last_became_active":"2024-09-10T21:13:18.647871+0000","last_became_peered":"2024-09-10T21:13:18.647871+0000","last_unstale":"2024-09-10T21:15:05.626804+0000","last_undegraded":"2024-09-10T21:15:05.626804+0000","last_fullsized":"2024-09-10T21:15:05.626804+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:16.374911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636553+0000","last_change":"2024-09-10T21:13:18.654843+0000","last_active":"2024-09-10T21:15:05.636553+0000","last_peered":"2024-09-10T21:15:05.636553+0000","last_clean":"2024-09-10T21:15:05.636553+0000","last_became_active":"2024-09-10T21:13:18.654211+0000","last_became_peered":"2024-09-10T21:13:18.654211+0000","last_unstale":"2024-09-10T21:15:05.636553+0000","last_undegraded":"2024-09-10T21:15:05.636553+0000","last_fullsized":"2024-09-10T21:15:05.636553+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:28.490792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.628477+0000","last_change":"2024-09-10T21:13:18.659603+0000","last_active":"2024-09-10T21:15:05.628477+0000","last_peered":"2024-09-10T21:15:05.628477+0000","last_clean":"2024-09-10T21:15:05.628477+0000","last_became_active":"2024-09-10T21:13:18.659257+0000","last_became_peered":"2024-09-10T21:13:18.659257+0000","last_unstale":"2024-09-10T21:15:05.628477+0000","last_undegraded":"2024-09-10T21:15:05.628477+0000","last_fullsized":"2024-09-10T21:15:05.628477+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:26.249109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.626761+0000","last_change":"2024-09-10T21:13:18.649354+0000","last_active":"2024-09-10T21:15:05.626761+0000","last_peered":"2024-09-10T21:15:05.626761+0000","last_clean":"2024-09-10T21:15:05.626761+0000","last_became_active":"2024-09-10T21:13:18.649029+0000","last_became_peered":"2024-09-10T21:13:18.649029+0000","last_unstale":"2024-09-10T21:15:05.626761+0000","last_undegraded":"2024-09-10T21:15:05.626761+0000","last_fullsized":"2024-09-10T21:15:05.626761+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:06.946983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'7","reported_seq":136,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:11.094790+0000","last_change":"2024-09-10T21:13:16.631197+0000","last_active":"2024-09-10T21:15:11.094790+0000","last_peered":"2024-09-10T21:15:11.094790+0000","last_clean":"2024-09-10T21:15:11.094790+0000","last_became_active":"2024-09-10T21:13:16.630877+0000","last_became_peered":"2024-09-10T21:13:16.630877+0000","last_unstale":"2024-09-10T21:15:11.094790+0000","last_undegraded":"2024-09-10T21:15:11.094790+0000","last_fullsized":"2024-09-10T21:15:11.094790+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:50.117425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.629100+0000","last_change":"2024-09-10T21:13:18.654124+0000","last_active":"2024-09-10T21:15:05.629100+0000","last_peered":"2024-09-10T21:15:05.629100+0000","last_clean":"2024-09-10T21:15:05.629100+0000","last_became_active":"2024-09-10T21:13:18.653757+0000","last_became_peered":"2024-09-10T21:13:18.653757+0000","last_unstale":"2024-09-10T21:15:05.629100+0000","last_undegraded":"2024-09-10T21:15:05.629100+0000","last_fullsized":"2024-09-10T21:15:05.629100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:25.174272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306892+0000","last_change":"2024-09-10T21:13:16.631526+0000","last_active":"2024-09-10T21:14:06.306892+0000","last_peered":"2024-09-10T21:14:06.306892+0000","last_clean":"2024-09-10T21:14:06.306892+0000","last_became_active":"2024-09-10T21:13:16.631194+0000","last_became_peered":"2024-09-10T21:13:16.631194+0000","last_unstale":"2024-09-10T21:14:06.306892+0000","last_undegraded":"2024-09-10T21:14:06.306892+0000","last_fullsized":"2024-09-10T21:14:06.306892+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:31:35.036874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433190+0000","last_change":"2024-09-10T21:13:16.624906+0000","last_active":"2024-09-10T21:14:06.433190+0000","last_peered":"2024-09-10T21:14:06.433190+0000","last_clean":"2024-09-10T21:14:06.433190+0000","last_became_active":"2024-09-10T21:13:16.624376+0000","last_became_peered":"2024-09-10T21:13:16.624376+0000","last_unstale":"2024-09-10T21:14:06.433190+0000","last_undegraded":"2024-09-10T21:14:06.433190+0000","last_fullsized":"2024-09-10T21:14:06.433190+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:20.942651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.628480+0000","last_change":"2024-09-10T21:13:18.646987+0000","last_active":"2024-09-10T21:15:05.628480+0000","last_peered":"2024-09-10T21:15:05.628480+0000","last_clean":"2024-09-10T21:15:05.628480+0000","last_became_active":"2024-09-10T21:13:18.646690+0000","last_became_peered":"2024-09-10T21:13:18.646690+0000","last_unstale":"2024-09-10T21:15:05.628480+0000","last_undegraded":"2024-09-10T21:15:05.628480+0000","last_fullsized":"2024-09-10T21:15:05.628480+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:47:02.132164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433699+0000","last_change":"2024-09-10T21:13:16.633082+0000","last_active":"2024-09-10T21:14:06.433699+0000","last_peered":"2024-09-10T21:14:06.433699+0000","last_clean":"2024-09-10T21:14:06.433699+0000","last_became_active":"2024-09-10T21:13:16.632707+0000","last_became_peered":"2024-09-10T21:13:16.632707+0000","last_unstale":"2024-09-10T21:14:06.433699+0000","last_undegraded":"2024-09-10T21:14:06.433699+0000","last_fullsized":"2024-09-10T21:14:06.433699+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:53:56.611072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.632300+0000","last_change":"2024-09-10T21:13:18.663309+0000","last_active":"2024-09-10T21:15:05.632300+0000","last_peered":"2024-09-10T21:15:05.632300+0000","last_clean":"2024-09-10T21:15:05.632300+0000","last_became_active":"2024-09-10T21:13:18.662990+0000","last_became_peered":"2024-09-10T21:13:18.662990+0000","last_unstale":"2024-09-10T21:15:05.632300+0000","last_undegraded":"2024-09-10T21:15:05.632300+0000","last_fullsized":"2024-09-10T21:15:05.632300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:18.014441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'5","reported_seq":228,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:10.092588+0000","last_change":"2024-09-10T21:13:16.633012+0000","last_active":"2024-09-10T21:15:10.092588+0000","last_peered":"2024-09-10T21:15:10.092588+0000","last_clean":"2024-09-10T21:15:10.092588+0000","last_became_active":"2024-09-10T21:13:16.632622+0000","last_became_peered":"2024-09-10T21:13:16.632622+0000","last_unstale":"2024-09-10T21:15:10.092588+0000","last_undegraded":"2024-09-10T21:15:10.092588+0000","last_fullsized":"2024-09-10T21:15:10.092588+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:16.859255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":200,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638770+0000","last_change":"2024-09-10T21:13:18.658015+0000","last_active":"2024-09-10T21:15:05.638770+0000","last_peered":"2024-09-10T21:15:05.638770+0000","last_clean":"2024-09-10T21:15:05.638770+0000","last_became_active":"2024-09-10T21:13:18.656922+0000","last_became_peered":"2024-09-10T21:13:18.656922+0000","last_unstale":"2024-09-10T21:15:05.638770+0000","last_undegraded":"2024-09-10T21:15:05.638770+0000","last_fullsized":"2024-09-10T21:15:05.638770+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:24.038131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.313021+0000","last_change":"2024-09-10T21:13:16.631771+0000","last_active":"2024-09-10T21:14:06.313021+0000","last_peered":"2024-09-10T21:14:06.313021+0000","last_clean":"2024-09-10T21:14:06.313021+0000","last_became_active":"2024-09-10T21:13:16.631477+0000","last_became_peered":"2024-09-10T21:13:16.631477+0000","last_unstale":"2024-09-10T21:14:06.313021+0000","last_undegraded":"2024-09-10T21:14:06.313021+0000","last_fullsized":"2024-09-10T21:14:06.313021+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:16.644046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638312+0000","last_change":"2024-09-10T21:13:18.658119+0000","last_active":"2024-09-10T21:15:05.638312+0000","last_peered":"2024-09-10T21:15:05.638312+0000","last_clean":"2024-09-10T21:15:05.638312+0000","last_became_active":"2024-09-10T21:13:18.657339+0000","last_became_peered":"2024-09-10T21:13:18.657339+0000","last_unstale":"2024-09-10T21:15:05.638312+0000","last_undegraded":"2024-09-10T21:15:05.638312+0000","last_fullsized":"2024-09-10T21:15:05.638312+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:45.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433347+0000","last_change":"2024-09-10T21:13:16.727019+0000","last_active":"2024-09-10T21:14:06.433347+0000","last_peered":"2024-09-10T21:14:06.433347+0000","last_clean":"2024-09-10T21:14:06.433347+0000","last_became_active":"2024-09-10T21:13:16.726667+0000","last_became_peered":"2024-09-10T21:13:16.726667+0000","last_unstale":"2024-09-10T21:14:06.433347+0000","last_undegraded":"2024-09-10T21:14:06.433347+0000","last_fullsized":"2024-09-10T21:14:06.433347+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:57.551149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636868+0000","last_change":"2024-09-10T21:14:06.434206+0000","last_active":"2024-09-10T21:15:05.636868+0000","last_peered":"2024-09-10T21:15:05.636868+0000","last_clean":"2024-09-10T21:15:05.636868+0000","last_became_active":"2024-09-10T21:14:06.433779+0000","last_became_peered":"2024-09-10T21:14:06.433779+0000","last_unstale":"2024-09-10T21:15:05.636868+0000","last_undegraded":"2024-09-10T21:15:05.636868+0000","last_fullsized":"2024-09-10T21:15:05.636868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:24.590286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'34","reported_seq":266,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:10.093069+0000","last_change":"2024-09-10T21:13:16.631820+0000","last_active":"2024-09-10T21:15:10.093069+0000","last_peered":"2024-09-10T21:15:10.093069+0000","last_clean":"2024-09-10T21:15:10.093069+0000","last_became_active":"2024-09-10T21:13:16.631432+0000","last_became_peered":"2024-09-10T21:13:16.631432+0000","last_unstale":"2024-09-10T21:15:10.093069+0000","last_undegraded":"2024-09-10T21:15:10.093069+0000","last_fullsized":"2024-09-10T21:15:10.093069+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:47.972871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60319,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":209,"num_read_kb":163,"num_write":36,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.630791+0000","last_change":"2024-09-10T21:13:18.653147+0000","last_active":"2024-09-10T21:15:05.630791+0000","last_peered":"2024-09-10T21:15:05.630791+0000","last_clean":"2024-09-10T21:15:05.630791+0000","last_became_active":"2024-09-10T21:13:18.652846+0000","last_became_peered":"2024-09-10T21:13:18.652846+0000","last_unstale":"2024-09-10T21:15:05.630791+0000","last_undegraded":"2024-09-10T21:15:05.630791+0000","last_fullsized":"2024-09-10T21:15:05.630791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:59.007192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309628+0000","last_change":"2024-09-10T21:13:16.631994+0000","last_active":"2024-09-10T21:14:06.309628+0000","last_peered":"2024-09-10T21:14:06.309628+0000","last_clean":"2024-09-10T21:14:06.309628+0000","last_became_active":"2024-09-10T21:13:16.631665+0000","last_became_peered":"2024-09-10T21:13:16.631665+0000","last_unstale":"2024-09-10T21:14:06.309628+0000","last_undegraded":"2024-09-10T21:14:06.309628+0000","last_fullsized":"2024-09-10T21:14:06.309628+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:05.537172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638781+0000","last_change":"2024-09-10T21:13:18.657463+0000","last_active":"2024-09-10T21:15:05.638781+0000","last_peered":"2024-09-10T21:15:05.638781+0000","last_clean":"2024-09-10T21:15:05.638781+0000","last_became_active":"2024-09-10T21:13:18.657146+0000","last_became_peered":"2024-09-10T21:13:18.657146+0000","last_unstale":"2024-09-10T21:15:05.638781+0000","last_undegraded":"2024-09-10T21:15:05.638781+0000","last_fullsized":"2024-09-10T21:15:05.638781+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:42.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433206+0000","last_change":"2024-09-10T21:13:16.630419+0000","last_active":"2024-09-10T21:14:06.433206+0000","last_peered":"2024-09-10T21:14:06.433206+0000","last_clean":"2024-09-10T21:14:06.433206+0000","last_became_active":"2024-09-10T21:13:16.630053+0000","last_became_peered":"2024-09-10T21:13:16.630053+0000","last_unstale":"2024-09-10T21:14:06.433206+0000","last_undegraded":"2024-09-10T21:14:06.433206+0000","last_fullsized":"2024-09-10T21:14:06.433206+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:08.090931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.640928+0000","last_change":"2024-09-10T21:13:18.657585+0000","last_active":"2024-09-10T21:15:05.640928+0000","last_peered":"2024-09-10T21:15:05.640928+0000","last_clean":"2024-09-10T21:15:05.640928+0000","last_became_active":"2024-09-10T21:13:18.657280+0000","last_became_peered":"2024-09-10T21:13:18.657280+0000","last_unstale":"2024-09-10T21:15:05.640928+0000","last_undegraded":"2024-09-10T21:15:05.640928+0000","last_fullsized":"2024-09-10T21:15:05.640928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:46:34.252882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'5","reported_seq":131,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:10.093287+0000","last_change":"2024-09-10T21:13:16.629700+0000","last_active":"2024-09-10T21:15:10.093287+0000","last_peered":"2024-09-10T21:15:10.093287+0000","last_clean":"2024-09-10T21:15:10.093287+0000","last_became_active":"2024-09-10T21:13:16.629282+0000","last_became_peered":"2024-09-10T21:13:16.629282+0000","last_unstale":"2024-09-10T21:15:10.093287+0000","last_undegraded":"2024-09-10T21:15:10.093287+0000","last_fullsized":"2024-09-10T21:15:10.093287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:42.572643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.635679+0000","last_change":"2024-09-10T21:13:18.664535+0000","last_active":"2024-09-10T21:15:05.635679+0000","last_peered":"2024-09-10T21:15:05.635679+0000","last_clean":"2024-09-10T21:15:05.635679+0000","last_became_active":"2024-09-10T21:13:18.663997+0000","last_became_peered":"2024-09-10T21:13:18.663997+0000","last_unstale":"2024-09-10T21:15:05.635679+0000","last_undegraded":"2024-09-10T21:15:05.635679+0000","last_fullsized":"2024-09-10T21:15:05.635679+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:30.365106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308443+0000","last_change":"2024-09-10T21:13:16.727096+0000","last_active":"2024-09-10T21:14:06.308443+0000","last_peered":"2024-09-10T21:14:06.308443+0000","last_clean":"2024-09-10T21:14:06.308443+0000","last_became_active":"2024-09-10T21:13:16.726408+0000","last_became_peered":"2024-09-10T21:13:16.726408+0000","last_unstale":"2024-09-10T21:14:06.308443+0000","last_undegraded":"2024-09-10T21:14:06.308443+0000","last_fullsized":"2024-09-10T21:14:06.308443+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:30.581238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.628607+0000","last_change":"2024-09-10T21:13:18.657397+0000","last_active":"2024-09-10T21:15:05.628607+0000","last_peered":"2024-09-10T21:15:05.628607+0000","last_clean":"2024-09-10T21:15:05.628607+0000","last_became_active":"2024-09-10T21:13:18.657050+0000","last_became_peered":"2024-09-10T21:13:18.657050+0000","last_unstale":"2024-09-10T21:15:05.628607+0000","last_undegraded":"2024-09-10T21:15:05.628607+0000","last_fullsized":"2024-09-10T21:15:05.628607+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:09.739544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.310361+0000","last_change":"2024-09-10T21:13:16.633716+0000","last_active":"2024-09-10T21:14:06.310361+0000","last_peered":"2024-09-10T21:14:06.310361+0000","last_clean":"2024-09-10T21:14:06.310361+0000","last_became_active":"2024-09-10T21:13:16.633225+0000","last_became_peered":"2024-09-10T21:13:16.633225+0000","last_unstale":"2024-09-10T21:14:06.310361+0000","last_undegraded":"2024-09-10T21:14:06.310361+0000","last_fullsized":"2024-09-10T21:14:06.310361+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:48.807549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.627900+0000","last_change":"2024-09-10T21:13:18.663129+0000","last_active":"2024-09-10T21:15:05.627900+0000","last_peered":"2024-09-10T21:15:05.627900+0000","last_clean":"2024-09-10T21:15:05.627900+0000","last_became_active":"2024-09-10T21:13:18.662694+0000","last_became_peered":"2024-09-10T21:13:18.662694+0000","last_unstale":"2024-09-10T21:15:05.627900+0000","last_undegraded":"2024-09-10T21:15:05.627900+0000","last_fullsized":"2024-09-10T21:15:05.627900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:24.633468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433973+0000","last_change":"2024-09-10T21:13:16.628733+0000","last_active":"2024-09-10T21:14:06.433973+0000","last_peered":"2024-09-10T21:14:06.433973+0000","last_clean":"2024-09-10T21:14:06.433973+0000","last_became_active":"2024-09-10T21:13:16.628419+0000","last_became_peered":"2024-09-10T21:13:16.628419+0000","last_unstale":"2024-09-10T21:14:06.433973+0000","last_undegraded":"2024-09-10T21:14:06.433973+0000","last_fullsized":"2024-09-10T21:14:06.433973+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:31.264739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636488+0000","last_change":"2024-09-10T21:13:18.656571+0000","last_active":"2024-09-10T21:15:05.636488+0000","last_peered":"2024-09-10T21:15:05.636488+0000","last_clean":"2024-09-10T21:15:05.636488+0000","last_became_active":"2024-09-10T21:13:18.656253+0000","last_became_peered":"2024-09-10T21:13:18.656253+0000","last_unstale":"2024-09-10T21:15:05.636488+0000","last_undegraded":"2024-09-10T21:15:05.636488+0000","last_fullsized":"2024-09-10T21:15:05.636488+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:57.848566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433543+0000","last_change":"2024-09-10T21:13:16.631750+0000","last_active":"2024-09-10T21:14:06.433543+0000","last_peered":"2024-09-10T21:14:06.433543+0000","last_clean":"2024-09-10T21:14:06.433543+0000","last_became_active":"2024-09-10T21:13:16.631245+0000","last_became_peered":"2024-09-10T21:13:16.631245+0000","last_unstale":"2024-09-10T21:14:06.433543+0000","last_undegraded":"2024-09-10T21:14:06.433543+0000","last_fullsized":"2024-09-10T21:14:06.433543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:28.787751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.635634+0000","last_change":"2024-09-10T21:13:18.660834+0000","last_active":"2024-09-10T21:15:05.635634+0000","last_peered":"2024-09-10T21:15:05.635634+0000","last_clean":"2024-09-10T21:15:05.635634+0000","last_became_active":"2024-09-10T21:13:18.660461+0000","last_became_peered":"2024-09-10T21:13:18.660461+0000","last_unstale":"2024-09-10T21:15:05.635634+0000","last_undegraded":"2024-09-10T21:15:05.635634+0000","last_fullsized":"2024-09-10T21:15:05.635634+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:55.531199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'5","reported_seq":131,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:10.093142+0000","last_change":"2024-09-10T21:13:16.726824+0000","last_active":"2024-09-10T21:15:10.093142+0000","last_peered":"2024-09-10T21:15:10.093142+0000","last_clean":"2024-09-10T21:15:10.093142+0000","last_became_active":"2024-09-10T21:13:16.726436+0000","last_became_peered":"2024-09-10T21:13:16.726436+0000","last_unstale":"2024-09-10T21:15:10.093142+0000","last_undegraded":"2024-09-10T21:15:10.093142+0000","last_fullsized":"2024-09-10T21:15:10.093142+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:49.391388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638751+0000","last_change":"2024-09-10T21:13:18.663725+0000","last_active":"2024-09-10T21:15:05.638751+0000","last_peered":"2024-09-10T21:15:05.638751+0000","last_clean":"2024-09-10T21:15:05.638751+0000","last_became_active":"2024-09-10T21:13:18.663254+0000","last_became_peered":"2024-09-10T21:13:18.663254+0000","last_unstale":"2024-09-10T21:15:05.638751+0000","last_undegraded":"2024-09-10T21:15:05.638751+0000","last_fullsized":"2024-09-10T21:15:05.638751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:19.672231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312748+0000","last_change":"2024-09-10T21:12:08.173849+0000","last_active":"2024-09-10T21:14:06.312748+0000","last_peered":"2024-09-10T21:14:06.312748+0000","last_clean":"2024-09-10T21:14:06.312748+0000","last_became_active":"2024-09-10T21:12:08.153630+0000","last_became_peered":"2024-09-10T21:12:08.153630+0000","last_unstale":"2024-09-10T21:14:06.312748+0000","last_undegraded":"2024-09-10T21:14:06.312748+0000","last_fullsized":"2024-09-10T21:14:06.312748+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:08:47.842259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:08:47.842259+0000","last_clean_scrub_stamp":"2024-09-10T21:08:47.842259+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:39.166390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433413+0000","last_change":"2024-09-10T21:13:16.628607+0000","last_active":"2024-09-10T21:14:06.433413+0000","last_peered":"2024-09-10T21:14:06.433413+0000","last_clean":"2024-09-10T21:14:06.433413+0000","last_became_active":"2024-09-10T21:13:16.627736+0000","last_became_peered":"2024-09-10T21:13:16.627736+0000","last_unstale":"2024-09-10T21:14:06.433413+0000","last_undegraded":"2024-09-10T21:14:06.433413+0000","last_fullsized":"2024-09-10T21:14:06.433413+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:16.388832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636188+0000","last_change":"2024-09-10T21:13:18.652634+0000","last_active":"2024-09-10T21:15:05.636188+0000","last_peered":"2024-09-10T21:15:05.636188+0000","last_clean":"2024-09-10T21:15:05.636188+0000","last_became_active":"2024-09-10T21:13:18.652325+0000","last_became_peered":"2024-09-10T21:13:18.652325+0000","last_unstale":"2024-09-10T21:15:05.636188+0000","last_undegraded":"2024-09-10T21:15:05.636188+0000","last_fullsized":"2024-09-10T21:15:05.636188+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:16.382355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312642+0000","last_change":"2024-09-10T21:13:16.631442+0000","last_active":"2024-09-10T21:14:06.312642+0000","last_peered":"2024-09-10T21:14:06.312642+0000","last_clean":"2024-09-10T21:14:06.312642+0000","last_became_active":"2024-09-10T21:13:16.631117+0000","last_became_peered":"2024-09-10T21:13:16.631117+0000","last_unstale":"2024-09-10T21:14:06.312642+0000","last_undegraded":"2024-09-10T21:14:06.312642+0000","last_fullsized":"2024-09-10T21:14:06.312642+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:35.376888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.635164+0000","last_change":"2024-09-10T21:13:18.644246+0000","last_active":"2024-09-10T21:15:05.635164+0000","last_peered":"2024-09-10T21:15:05.635164+0000","last_clean":"2024-09-10T21:15:05.635164+0000","last_became_active":"2024-09-10T21:13:18.643944+0000","last_became_peered":"2024-09-10T21:13:18.643944+0000","last_unstale":"2024-09-10T21:15:05.635164+0000","last_undegraded":"2024-09-10T21:15:05.635164+0000","last_fullsized":"2024-09-10T21:15:05.635164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:18.856149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":132,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:12.095387+0000","last_change":"2024-09-10T21:13:16.726716+0000","last_active":"2024-09-10T21:15:12.095387+0000","last_peered":"2024-09-10T21:15:12.095387+0000","last_clean":"2024-09-10T21:15:12.095387+0000","last_became_active":"2024-09-10T21:13:16.726400+0000","last_became_peered":"2024-09-10T21:13:16.726400+0000","last_unstale":"2024-09-10T21:15:12.095387+0000","last_undegraded":"2024-09-10T21:15:12.095387+0000","last_fullsized":"2024-09-10T21:15:12.095387+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:55.643495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.624187+0000","last_change":"2024-09-10T21:14:06.433990+0000","last_active":"2024-09-10T21:15:05.624187+0000","last_peered":"2024-09-10T21:15:05.624187+0000","last_clean":"2024-09-10T21:15:05.624187+0000","last_became_active":"2024-09-10T21:14:06.433489+0000","last_became_peered":"2024-09-10T21:14:06.433489+0000","last_unstale":"2024-09-10T21:15:05.624187+0000","last_undegraded":"2024-09-10T21:15:05.624187+0000","last_fullsized":"2024-09-10T21:15:05.624187+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:28.001658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"75'6","reported_seq":133,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:11.094570+0000","last_change":"2024-09-10T21:13:16.633126+0000","last_active":"2024-09-10T21:15:11.094570+0000","last_peered":"2024-09-10T21:15:11.094570+0000","last_clean":"2024-09-10T21:15:11.094570+0000","last_became_active":"2024-09-10T21:13:16.632808+0000","last_became_peered":"2024-09-10T21:13:16.632808+0000","last_unstale":"2024-09-10T21:15:11.094570+0000","last_undegraded":"2024-09-10T21:15:11.094570+0000","last_fullsized":"2024-09-10T21:15:11.094570+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:01.026506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.633724+0000","last_change":"2024-09-10T21:13:18.652631+0000","last_active":"2024-09-10T21:15:05.633724+0000","last_peered":"2024-09-10T21:15:05.633724+0000","last_clean":"2024-09-10T21:15:05.633724+0000","last_became_active":"2024-09-10T21:13:18.650580+0000","last_became_peered":"2024-09-10T21:13:18.650580+0000","last_unstale":"2024-09-10T21:15:05.633724+0000","last_undegraded":"2024-09-10T21:15:05.633724+0000","last_fullsized":"2024-09-10T21:15:05.633724+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:32.733169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.305817+0000","last_change":"2024-09-10T21:13:16.728172+0000","last_active":"2024-09-10T21:14:06.305817+0000","last_peered":"2024-09-10T21:14:06.305817+0000","last_clean":"2024-09-10T21:14:06.305817+0000","last_became_active":"2024-09-10T21:13:16.727793+0000","last_became_peered":"2024-09-10T21:13:16.727793+0000","last_unstale":"2024-09-10T21:14:06.305817+0000","last_undegraded":"2024-09-10T21:14:06.305817+0000","last_fullsized":"2024-09-10T21:14:06.305817+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:58:04.301119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.629258+0000","last_change":"2024-09-10T21:13:18.655371+0000","last_active":"2024-09-10T21:15:05.629258+0000","last_peered":"2024-09-10T21:15:05.629258+0000","last_clean":"2024-09-10T21:15:05.629258+0000","last_became_active":"2024-09-10T21:13:18.653250+0000","last_became_peered":"2024-09-10T21:13:18.653250+0000","last_unstale":"2024-09-10T21:15:05.629258+0000","last_undegraded":"2024-09-10T21:15:05.629258+0000","last_fullsized":"2024-09-10T21:15:05.629258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:25.650736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309415+0000","last_change":"2024-09-10T21:13:16.726816+0000","last_active":"2024-09-10T21:14:06.309415+0000","last_peered":"2024-09-10T21:14:06.309415+0000","last_clean":"2024-09-10T21:14:06.309415+0000","last_became_active":"2024-09-10T21:13:16.726438+0000","last_became_peered":"2024-09-10T21:13:16.726438+0000","last_unstale":"2024-09-10T21:14:06.309415+0000","last_undegraded":"2024-09-10T21:14:06.309415+0000","last_fullsized":"2024-09-10T21:14:06.309415+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:46.384899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.635531+0000","last_change":"2024-09-10T21:13:18.643424+0000","last_active":"2024-09-10T21:15:05.635531+0000","last_peered":"2024-09-10T21:15:05.635531+0000","last_clean":"2024-09-10T21:15:05.635531+0000","last_became_active":"2024-09-10T21:13:18.643010+0000","last_became_peered":"2024-09-10T21:13:18.643010+0000","last_unstale":"2024-09-10T21:15:05.635531+0000","last_undegraded":"2024-09-10T21:15:05.635531+0000","last_fullsized":"2024-09-10T21:15:05.635531+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:47.358129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'16","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.663709+0000","last_change":"2024-09-10T21:14:06.316327+0000","last_active":"2024-09-10T21:15:05.663709+0000","last_peered":"2024-09-10T21:15:05.663709+0000","last_clean":"2024-09-10T21:15:05.663709+0000","last_became_active":"2024-09-10T21:14:06.309000+0000","last_became_peered":"2024-09-10T21:14:06.309000+0000","last_unstale":"2024-09-10T21:15:05.663709+0000","last_undegraded":"2024-09-10T21:15:05.663709+0000","last_fullsized":"2024-09-10T21:15:05.663709+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:13.582411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.633119+0000","last_change":"2024-09-10T21:13:18.652347+0000","last_active":"2024-09-10T21:15:05.633119+0000","last_peered":"2024-09-10T21:15:05.633119+0000","last_clean":"2024-09-10T21:15:05.633119+0000","last_became_active":"2024-09-10T21:13:18.651942+0000","last_became_peered":"2024-09-10T21:13:18.651942+0000","last_unstale":"2024-09-10T21:15:05.633119+0000","last_undegraded":"2024-09-10T21:15:05.633119+0000","last_fullsized":"2024-09-10T21:15:05.633119+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:11.356787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433490+0000","last_change":"2024-09-10T21:13:16.621647+0000","last_active":"2024-09-10T21:14:06.433490+0000","last_peered":"2024-09-10T21:14:06.433490+0000","last_clean":"2024-09-10T21:14:06.433490+0000","last_became_active":"2024-09-10T21:13:16.621316+0000","last_became_peered":"2024-09-10T21:13:16.621316+0000","last_unstale":"2024-09-10T21:14:06.433490+0000","last_undegraded":"2024-09-10T21:14:06.433490+0000","last_fullsized":"2024-09-10T21:14:06.433490+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:10.264578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.637297+0000","last_change":"2024-09-10T21:13:18.656617+0000","last_active":"2024-09-10T21:15:05.637297+0000","last_peered":"2024-09-10T21:15:05.637297+0000","last_clean":"2024-09-10T21:15:05.637297+0000","last_became_active":"2024-09-10T21:13:18.656331+0000","last_became_peered":"2024-09-10T21:13:18.656331+0000","last_unstale":"2024-09-10T21:15:05.637297+0000","last_undegraded":"2024-09-10T21:15:05.637297+0000","last_fullsized":"2024-09-10T21:15:05.637297+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:44.482797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309648+0000","last_change":"2024-09-10T21:13:16.727736+0000","last_active":"2024-09-10T21:14:06.309648+0000","last_peered":"2024-09-10T21:14:06.309648+0000","last_clean":"2024-09-10T21:14:06.309648+0000","last_became_active":"2024-09-10T21:13:16.727413+0000","last_became_peered":"2024-09-10T21:13:16.727413+0000","last_unstale":"2024-09-10T21:14:06.309648+0000","last_undegraded":"2024-09-10T21:14:06.309648+0000","last_fullsized":"2024-09-10T21:14:06.309648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:26.351729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.592112+0000","last_change":"2024-09-10T21:13:18.660100+0000","last_active":"2024-09-10T21:15:05.592112+0000","last_peered":"2024-09-10T21:15:05.592112+0000","last_clean":"2024-09-10T21:15:05.592112+0000","last_became_active":"2024-09-10T21:13:18.659733+0000","last_became_peered":"2024-09-10T21:13:18.659733+0000","last_unstale":"2024-09-10T21:15:05.592112+0000","last_undegraded":"2024-09-10T21:15:05.592112+0000","last_fullsized":"2024-09-10T21:15:05.592112+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:44.371627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308097+0000","last_change":"2024-09-10T21:13:16.627194+0000","last_active":"2024-09-10T21:14:06.308097+0000","last_peered":"2024-09-10T21:14:06.308097+0000","last_clean":"2024-09-10T21:14:06.308097+0000","last_became_active":"2024-09-10T21:13:16.626805+0000","last_became_peered":"2024-09-10T21:13:16.626805+0000","last_unstale":"2024-09-10T21:14:06.308097+0000","last_undegraded":"2024-09-10T21:14:06.308097+0000","last_fullsized":"2024-09-10T21:14:06.308097+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:33.582084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.623962+0000","last_change":"2024-09-10T21:13:18.663122+0000","last_active":"2024-09-10T21:15:05.623962+0000","last_peered":"2024-09-10T21:15:05.623962+0000","last_clean":"2024-09-10T21:15:05.623962+0000","last_became_active":"2024-09-10T21:13:18.662673+0000","last_became_peered":"2024-09-10T21:13:18.662673+0000","last_unstale":"2024-09-10T21:15:05.623962+0000","last_undegraded":"2024-09-10T21:15:05.623962+0000","last_fullsized":"2024-09-10T21:15:05.623962+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:15.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.320090+0000","last_change":"2024-09-10T21:14:06.319645+0000","last_active":"2024-09-10T21:14:06.320090+0000","last_peered":"2024-09-10T21:14:06.320090+0000","last_clean":"2024-09-10T21:14:06.320090+0000","last_became_active":"2024-09-10T21:14:06.311394+0000","last_became_peered":"2024-09-10T21:14:06.311394+0000","last_unstale":"2024-09-10T21:14:06.320090+0000","last_undegraded":"2024-09-10T21:14:06.320090+0000","last_fullsized":"2024-09-10T21:14:06.320090+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:26:20.925331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.631611+0000","last_change":"2024-09-10T21:13:18.656400+0000","last_active":"2024-09-10T21:15:05.631611+0000","last_peered":"2024-09-10T21:15:05.631611+0000","last_clean":"2024-09-10T21:15:05.631611+0000","last_became_active":"2024-09-10T21:13:18.655802+0000","last_became_peered":"2024-09-10T21:13:18.655802+0000","last_unstale":"2024-09-10T21:15:05.631611+0000","last_undegraded":"2024-09-10T21:15:05.631611+0000","last_fullsized":"2024-09-10T21:15:05.631611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:41.901404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.438924+0000","last_change":"2024-09-10T21:14:06.438851+0000","last_active":"2024-09-10T21:14:06.438924+0000","last_peered":"2024-09-10T21:14:06.438924+0000","last_clean":"2024-09-10T21:14:06.438924+0000","last_became_active":"2024-09-10T21:14:06.434291+0000","last_became_peered":"2024-09-10T21:14:06.434291+0000","last_unstale":"2024-09-10T21:14:06.438924+0000","last_undegraded":"2024-09-10T21:14:06.438924+0000","last_fullsized":"2024-09-10T21:14:06.438924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:43.895028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.639513+0000","last_change":"2024-09-10T21:13:18.664331+0000","last_active":"2024-09-10T21:15:05.639513+0000","last_peered":"2024-09-10T21:15:05.639513+0000","last_clean":"2024-09-10T21:15:05.639513+0000","last_became_active":"2024-09-10T21:13:18.663823+0000","last_became_peered":"2024-09-10T21:13:18.663823+0000","last_unstale":"2024-09-10T21:15:05.639513+0000","last_undegraded":"2024-09-10T21:15:05.639513+0000","last_fullsized":"2024-09-10T21:15:05.639513+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:37.626712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.633093+0000","last_change":"2024-09-10T21:13:18.659941+0000","last_active":"2024-09-10T21:15:05.633093+0000","last_peered":"2024-09-10T21:15:05.633093+0000","last_clean":"2024-09-10T21:15:05.633093+0000","last_became_active":"2024-09-10T21:13:18.659019+0000","last_became_peered":"2024-09-10T21:13:18.659019+0000","last_unstale":"2024-09-10T21:15:05.633093+0000","last_undegraded":"2024-09-10T21:15:05.633093+0000","last_fullsized":"2024-09-10T21:15:05.633093+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:41.037722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309893+0000","last_change":"2024-09-10T21:13:16.633660+0000","last_active":"2024-09-10T21:14:06.309893+0000","last_peered":"2024-09-10T21:14:06.309893+0000","last_clean":"2024-09-10T21:14:06.309893+0000","last_became_active":"2024-09-10T21:13:16.633222+0000","last_became_peered":"2024-09-10T21:13:16.633222+0000","last_unstale":"2024-09-10T21:14:06.309893+0000","last_undegraded":"2024-09-10T21:14:06.309893+0000","last_fullsized":"2024-09-10T21:14:06.309893+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:56.364355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636617+0000","last_change":"2024-09-10T21:13:18.666837+0000","last_active":"2024-09-10T21:15:05.636617+0000","last_peered":"2024-09-10T21:15:05.636617+0000","last_clean":"2024-09-10T21:15:05.636617+0000","last_became_active":"2024-09-10T21:13:18.666382+0000","last_became_peered":"2024-09-10T21:13:18.666382+0000","last_unstale":"2024-09-10T21:15:05.636617+0000","last_undegraded":"2024-09-10T21:15:05.636617+0000","last_fullsized":"2024-09-10T21:15:05.636617+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:32.225130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309304+0000","last_change":"2024-09-10T21:13:16.631424+0000","last_active":"2024-09-10T21:14:06.309304+0000","last_peered":"2024-09-10T21:14:06.309304+0000","last_clean":"2024-09-10T21:14:06.309304+0000","last_became_active":"2024-09-10T21:13:16.631116+0000","last_became_peered":"2024-09-10T21:13:16.631116+0000","last_unstale":"2024-09-10T21:14:06.309304+0000","last_undegraded":"2024-09-10T21:14:06.309304+0000","last_fullsized":"2024-09-10T21:14:06.309304+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:15.506410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.639550+0000","last_change":"2024-09-10T21:13:18.654978+0000","last_active":"2024-09-10T21:15:05.639550+0000","last_peered":"2024-09-10T21:15:05.639550+0000","last_clean":"2024-09-10T21:15:05.639550+0000","last_became_active":"2024-09-10T21:13:18.654581+0000","last_became_peered":"2024-09-10T21:13:18.654581+0000","last_unstale":"2024-09-10T21:15:05.639550+0000","last_undegraded":"2024-09-10T21:15:05.639550+0000","last_fullsized":"2024-09-10T21:15:05.639550+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:17.504626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308544+0000","last_change":"2024-09-10T21:13:16.726727+0000","last_active":"2024-09-10T21:14:06.308544+0000","last_peered":"2024-09-10T21:14:06.308544+0000","last_clean":"2024-09-10T21:14:06.308544+0000","last_became_active":"2024-09-10T21:13:16.726373+0000","last_became_peered":"2024-09-10T21:13:16.726373+0000","last_unstale":"2024-09-10T21:14:06.308544+0000","last_undegraded":"2024-09-10T21:14:06.308544+0000","last_fullsized":"2024-09-10T21:14:06.308544+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:31.803631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.630259+0000","last_change":"2024-09-10T21:13:18.648384+0000","last_active":"2024-09-10T21:15:05.630259+0000","last_peered":"2024-09-10T21:15:05.630259+0000","last_clean":"2024-09-10T21:15:05.630259+0000","last_became_active":"2024-09-10T21:13:18.647911+0000","last_became_peered":"2024-09-10T21:13:18.647911+0000","last_unstale":"2024-09-10T21:15:05.630259+0000","last_undegraded":"2024-09-10T21:15:05.630259+0000","last_fullsized":"2024-09-10T21:15:05.630259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:02.582548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'14","reported_seq":141,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:12.095279+0000","last_change":"2024-09-10T21:13:16.631501+0000","last_active":"2024-09-10T21:15:12.095279+0000","last_peered":"2024-09-10T21:15:12.095279+0000","last_clean":"2024-09-10T21:15:12.095279+0000","last_became_active":"2024-09-10T21:13:16.631246+0000","last_became_peered":"2024-09-10T21:13:16.631246+0000","last_unstale":"2024-09-10T21:15:12.095279+0000","last_undegraded":"2024-09-10T21:15:12.095279+0000","last_fullsized":"2024-09-10T21:15:12.095279+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:25.277370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67581,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1054,"num_read_kb":602,"num_write":253,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":202743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36140,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709012,"statfs":{"total":95995035648,"available":95958028288,"internally_reserved":0,"allocated":815104,"data_stored":393851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005096,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1044891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135918,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":393781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332147,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":394159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528376,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28424,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716728,"statfs":{"total":95995035648,"available":95965929472,"internally_reserved":0,"allocated":1433600,"data_stored":987126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659197,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36148,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709004,"statfs":{"total":95995035648,"available":95958020096,"internally_reserved":0,"allocated":823296,"data_stored":393806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855426,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28436,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716716,"statfs":{"total":95995035648,"available":95965917184,"internally_reserved":0,"allocated":1445888,"data_stored":986496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":393359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":393323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":455482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":455038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":843776,"data_stored":394837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:15:15.692 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-10T21:15:15.692 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T21:15:15.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.828+0000 7f3dcad52640 1 -- 172.21.15.59:0/1495057072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dc41018b0 msgr2=0x7f3dc4101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.828+0000 7f3dcad52640 1 --2- 172.21.15.59:0/1495057072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dc41018b0 0x7f3dc4101cb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3db8009930 tx=0x7f3db802a420 comp rx=0 tx=0).stop 2024-09-10T21:15:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.828+0000 7f3dcad52640 1 -- 172.21.15.59:0/1495057072 shutdown_connections 2024-09-10T21:15:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.828+0000 7f3dcad52640 1 --2- 172.21.15.59:0/1495057072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc41033c0 0x7f3dc4109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.828+0000 7f3dcad52640 1 --2- 172.21.15.59:0/1495057072 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dc4102a00 0x7f3dc4102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.828+0000 7f3dcad52640 1 --2- 172.21.15.59:0/1495057072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dc41018b0 0x7f3dc4101cb0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.828+0000 7f3dcad52640 1 -- 172.21.15.59:0/1495057072 >> 172.21.15.59:0/1495057072 conn(0x7f3dc40fd190 msgr2=0x7f3dc40ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.828+0000 7f3dcad52640 1 -- 172.21.15.59:0/1495057072 shutdown_connections 2024-09-10T21:15:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.828+0000 7f3dcad52640 1 -- 172.21.15.59:0/1495057072 wait complete. 2024-09-10T21:15:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.829+0000 7f3dcad52640 1 Processor -- start 2024-09-10T21:15:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.829+0000 7f3dcad52640 1 -- start start 2024-09-10T21:15:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.829+0000 7f3dcad52640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dc41018b0 0x7f3dc4198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:15.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.829+0000 7f3dcad52640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dc4102a00 0x7f3dc4199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:15.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.829+0000 7f3dcad52640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc41033c0 0x7f3dc419a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:15.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.829+0000 7f3dcad52640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc410d550 con 0x7f3dc41018b0 2024-09-10T21:15:15.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.829+0000 7f3dcad52640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc410d3d0 con 0x7f3dc41033c0 2024-09-10T21:15:15.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.829+0000 7f3dcad52640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc410d6d0 con 0x7f3dc4102a00 2024-09-10T21:15:15.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.829+0000 7f3dc8aee640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dc41018b0 0x7f3dc4198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:15.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.829+0000 7f3dc8aee640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dc41018b0 0x7f3dc4198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59430/0 (socket says 172.21.15.59:59430) 2024-09-10T21:15:15.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.829+0000 7f3dc8aee640 1 -- 172.21.15.59:0/2265361296 learned_addr learned my addr 172.21.15.59:0/2265361296 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:15.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.830+0000 7f3dc92ef640 1 --2- 172.21.15.59:0/2265361296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc41033c0 0x7f3dc419a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:15.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.830+0000 7f3dc3fff640 1 --2- 172.21.15.59:0/2265361296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dc4102a00 0x7f3dc4199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:15.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.830+0000 7f3dc8aee640 1 -- 172.21.15.59:0/2265361296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dc4102a00 msgr2=0x7f3dc4199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:15.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.830+0000 7f3dc8aee640 1 --2- 172.21.15.59:0/2265361296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dc4102a00 0x7f3dc4199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.830+0000 7f3dc8aee640 1 -- 172.21.15.59:0/2265361296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc41033c0 msgr2=0x7f3dc419a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:15.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.830+0000 7f3dc8aee640 1 --2- 172.21.15.59:0/2265361296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc41033c0 0x7f3dc419a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.830+0000 7f3dc8aee640 1 -- 172.21.15.59:0/2265361296 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc419a970 con 0x7f3dc41018b0 2024-09-10T21:15:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.830+0000 7f3dc3fff640 1 --2- 172.21.15.59:0/2265361296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dc4102a00 0x7f3dc4199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:15:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.830+0000 7f3dc8aee640 1 --2- 172.21.15.59:0/2265361296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dc41018b0 0x7f3dc4198e30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3db8031500 tx=0x7f3db8003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.830+0000 7f3dc1ffb640 1 -- 172.21.15.59:0/2265361296 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db803f070 con 0x7f3dc41018b0 2024-09-10T21:15:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.830+0000 7f3dc1ffb640 1 -- 172.21.15.59:0/2265361296 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3db803b460 con 0x7f3dc41018b0 2024-09-10T21:15:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.830+0000 7f3dcad52640 1 -- 172.21.15.59:0/2265361296 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dc419ac00 con 0x7f3dc41018b0 2024-09-10T21:15:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.830+0000 7f3dc1ffb640 1 -- 172.21.15.59:0/2265361296 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db8035030 con 0x7f3dc41018b0 2024-09-10T21:15:15.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.830+0000 7f3dcad52640 1 -- 172.21.15.59:0/2265361296 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dc41a1330 con 0x7f3dc41018b0 2024-09-10T21:15:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.831+0000 7f3dcad52640 1 -- 172.21.15.59:0/2265361296 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dc41a1500 con 0x7f3dc41018b0 2024-09-10T21:15:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.833+0000 7f3dc1ffb640 1 -- 172.21.15.59:0/2265361296 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f3db803b610 con 0x7f3dc41018b0 2024-09-10T21:15:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.833+0000 7f3dc1ffb640 1 --2- 172.21.15.59:0/2265361296 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3db40b5360 0x7f3db40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.834+0000 7f3dc3fff640 1 --2- 172.21.15.59:0/2265361296 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3db40b5360 0x7f3db40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.834+0000 7f3dc1ffb640 1 -- 172.21.15.59:0/2265361296 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3db8106bf0 con 0x7f3dc41018b0 2024-09-10T21:15:15.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.834+0000 7f3dc3fff640 1 --2- 172.21.15.59:0/2265361296 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3db40b5360 0x7f3db40b7820 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009b40 tx=0x7f3db0005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:15.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:15.836+0000 7f3dc1ffb640 1 -- 172.21.15.59:0/2265361296 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3db80cdae0 con 0x7f3dc41018b0 2024-09-10T21:15:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.020+0000 7f3dcad52640 1 -- 172.21.15.59:0/2265361296 --> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3dc406b990 con 0x7f3db40b5360 2024-09-10T21:15:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.024+0000 7f3dc1ffb640 1 -- 172.21.15.59:0/2265361296 <== mgr.14150 v2:172.21.15.59:6800/123832859 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258870 (secure 0 0 0) 0x7f3dc406b990 con 0x7f3db40b5360 2024-09-10T21:15:16.031 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:15:16.032 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-09-10T21:15:16.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.027+0000 7f3dcad52640 1 -- 172.21.15.59:0/2265361296 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3db40b5360 msgr2=0x7f3db40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:16.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.027+0000 7f3dcad52640 1 --2- 172.21.15.59:0/2265361296 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3db40b5360 0x7f3db40b7820 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009b40 tx=0x7f3db0005e50 comp rx=0 tx=0).stop 2024-09-10T21:15:16.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.027+0000 7f3dcad52640 1 -- 172.21.15.59:0/2265361296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dc41018b0 msgr2=0x7f3dc4198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:16.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.028+0000 7f3dcad52640 1 --2- 172.21.15.59:0/2265361296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dc41018b0 0x7f3dc4198e30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3db8031500 tx=0x7f3db8003c80 comp rx=0 tx=0).stop 2024-09-10T21:15:16.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.028+0000 7f3dcad52640 1 -- 172.21.15.59:0/2265361296 shutdown_connections 2024-09-10T21:15:16.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.028+0000 7f3dcad52640 1 --2- 172.21.15.59:0/2265361296 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3db40b5360 0x7f3db40b7820 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:16.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.028+0000 7f3dcad52640 1 --2- 172.21.15.59:0/2265361296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3dc41033c0 0x7f3dc419a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:16.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.028+0000 7f3dcad52640 1 --2- 172.21.15.59:0/2265361296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dc4102a00 0x7f3dc4199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:16.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.028+0000 7f3dcad52640 1 --2- 172.21.15.59:0/2265361296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dc41018b0 0x7f3dc4198e30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:16.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.028+0000 7f3dcad52640 1 -- 172.21.15.59:0/2265361296 >> 172.21.15.59:0/2265361296 conn(0x7f3dc40fd190 msgr2=0x7f3dc406b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:16.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.028+0000 7f3dcad52640 1 -- 172.21.15.59:0/2265361296 shutdown_connections 2024-09-10T21:15:16.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.028+0000 7f3dcad52640 1 -- 172.21.15.59:0/2265361296 wait complete. 2024-09-10T21:15:16.042 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-09-10T21:15:15.254276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658183,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1130,"num_read_kb":666,"num_write":378,"num_write_kb":2293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2951840,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":811,"ondisk_log_size":811,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369292,"kb_used_data":11724,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572532,"statfs":{"total":1151940427776,"available":1151562272768,"internally_reserved":0,"allocated":12005376,"data_stored":6686149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":365933882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1006,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":63,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002825"},"pg_stats":[{"pgid":"3.3f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.631039+0000","last_change":"2024-09-10T21:13:18.656166+0000","last_active":"2024-09-10T21:15:05.631039+0000","last_peered":"2024-09-10T21:15:05.631039+0000","last_clean":"2024-09-10T21:15:05.631039+0000","last_became_active":"2024-09-10T21:13:18.655774+0000","last_became_peered":"2024-09-10T21:13:18.655774+0000","last_unstale":"2024-09-10T21:15:05.631039+0000","last_undegraded":"2024-09-10T21:15:05.631039+0000","last_fullsized":"2024-09-10T21:15:05.631039+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:17:57.775209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636830+0000","last_change":"2024-09-10T21:13:18.654232+0000","last_active":"2024-09-10T21:15:05.636830+0000","last_peered":"2024-09-10T21:15:05.636830+0000","last_clean":"2024-09-10T21:15:05.636830+0000","last_became_active":"2024-09-10T21:13:18.653928+0000","last_became_peered":"2024-09-10T21:13:18.653928+0000","last_unstale":"2024-09-10T21:15:05.636830+0000","last_undegraded":"2024-09-10T21:15:05.636830+0000","last_fullsized":"2024-09-10T21:15:05.636830+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:02.615686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.639156+0000","last_change":"2024-09-10T21:13:18.662923+0000","last_active":"2024-09-10T21:15:05.639156+0000","last_peered":"2024-09-10T21:15:05.639156+0000","last_clean":"2024-09-10T21:15:05.639156+0000","last_became_active":"2024-09-10T21:13:18.662541+0000","last_became_peered":"2024-09-10T21:13:18.662541+0000","last_unstale":"2024-09-10T21:15:05.639156+0000","last_undegraded":"2024-09-10T21:15:05.639156+0000","last_fullsized":"2024-09-10T21:15:05.639156+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:33:11.140761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.632974+0000","last_change":"2024-09-10T21:14:06.311161+0000","last_active":"2024-09-10T21:15:05.632974+0000","last_peered":"2024-09-10T21:15:05.632974+0000","last_clean":"2024-09-10T21:15:05.632974+0000","last_became_active":"2024-09-10T21:14:06.310829+0000","last_became_peered":"2024-09-10T21:14:06.310829+0000","last_unstale":"2024-09-10T21:15:05.632974+0000","last_undegraded":"2024-09-10T21:15:05.632974+0000","last_fullsized":"2024-09-10T21:15:05.632974+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:17.318129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.622564+0000","last_change":"2024-09-10T21:13:18.650427+0000","last_active":"2024-09-10T21:15:05.622564+0000","last_peered":"2024-09-10T21:15:05.622564+0000","last_clean":"2024-09-10T21:15:05.622564+0000","last_became_active":"2024-09-10T21:13:18.650039+0000","last_became_peered":"2024-09-10T21:13:18.650039+0000","last_unstale":"2024-09-10T21:15:05.622564+0000","last_undegraded":"2024-09-10T21:15:05.622564+0000","last_fullsized":"2024-09-10T21:15:05.622564+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:11.363642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.633901+0000","last_change":"2024-09-10T21:13:18.654320+0000","last_active":"2024-09-10T21:15:05.633901+0000","last_peered":"2024-09-10T21:15:05.633901+0000","last_clean":"2024-09-10T21:15:05.633901+0000","last_became_active":"2024-09-10T21:13:18.653291+0000","last_became_peered":"2024-09-10T21:13:18.653291+0000","last_unstale":"2024-09-10T21:15:05.633901+0000","last_undegraded":"2024-09-10T21:15:05.633901+0000","last_fullsized":"2024-09-10T21:15:05.633901+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:08:28.176816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.637595+0000","last_change":"2024-09-10T21:13:18.659695+0000","last_active":"2024-09-10T21:15:05.637595+0000","last_peered":"2024-09-10T21:15:05.637595+0000","last_clean":"2024-09-10T21:15:05.637595+0000","last_became_active":"2024-09-10T21:13:18.659240+0000","last_became_peered":"2024-09-10T21:13:18.659240+0000","last_unstale":"2024-09-10T21:15:05.637595+0000","last_undegraded":"2024-09-10T21:15:05.637595+0000","last_fullsized":"2024-09-10T21:15:05.637595+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:58.951873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"75'9","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.631859+0000","last_change":"2024-09-10T21:14:06.435134+0000","last_active":"2024-09-10T21:15:05.631859+0000","last_peered":"2024-09-10T21:15:05.631859+0000","last_clean":"2024-09-10T21:15:05.631859+0000","last_became_active":"2024-09-10T21:14:06.434801+0000","last_became_peered":"2024-09-10T21:14:06.434801+0000","last_unstale":"2024-09-10T21:15:05.631859+0000","last_undegraded":"2024-09-10T21:15:05.631859+0000","last_fullsized":"2024-09-10T21:15:05.631859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:01.473083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.633884+0000","last_change":"2024-09-10T21:13:18.656252+0000","last_active":"2024-09-10T21:15:05.633884+0000","last_peered":"2024-09-10T21:15:05.633884+0000","last_clean":"2024-09-10T21:15:05.633884+0000","last_became_active":"2024-09-10T21:13:18.655879+0000","last_became_peered":"2024-09-10T21:13:18.655879+0000","last_unstale":"2024-09-10T21:15:05.633884+0000","last_undegraded":"2024-09-10T21:15:05.633884+0000","last_fullsized":"2024-09-10T21:15:05.633884+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:36:03.748183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"75'16","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.637233+0000","last_change":"2024-09-10T21:13:18.663370+0000","last_active":"2024-09-10T21:15:05.637233+0000","last_peered":"2024-09-10T21:15:05.637233+0000","last_clean":"2024-09-10T21:15:05.637233+0000","last_became_active":"2024-09-10T21:13:18.662863+0000","last_became_peered":"2024-09-10T21:13:18.662863+0000","last_unstale":"2024-09-10T21:15:05.637233+0000","last_undegraded":"2024-09-10T21:15:05.637233+0000","last_fullsized":"2024-09-10T21:15:05.637233+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:22.912596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638616+0000","last_change":"2024-09-10T21:13:18.663626+0000","last_active":"2024-09-10T21:15:05.638616+0000","last_peered":"2024-09-10T21:15:05.638616+0000","last_clean":"2024-09-10T21:15:05.638616+0000","last_became_active":"2024-09-10T21:13:18.663280+0000","last_became_peered":"2024-09-10T21:13:18.663280+0000","last_unstale":"2024-09-10T21:15:05.638616+0000","last_undegraded":"2024-09-10T21:15:05.638616+0000","last_fullsized":"2024-09-10T21:15:05.638616+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:07.874387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.609442+0000","last_change":"2024-09-10T21:13:18.660791+0000","last_active":"2024-09-10T21:15:05.609442+0000","last_peered":"2024-09-10T21:15:05.609442+0000","last_clean":"2024-09-10T21:15:05.609442+0000","last_became_active":"2024-09-10T21:13:18.660386+0000","last_became_peered":"2024-09-10T21:13:18.660386+0000","last_unstale":"2024-09-10T21:15:05.609442+0000","last_undegraded":"2024-09-10T21:15:05.609442+0000","last_fullsized":"2024-09-10T21:15:05.609442+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:57:37.218822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636304+0000","last_change":"2024-09-10T21:13:18.655893+0000","last_active":"2024-09-10T21:15:05.636304+0000","last_peered":"2024-09-10T21:15:05.636304+0000","last_clean":"2024-09-10T21:15:05.636304+0000","last_became_active":"2024-09-10T21:13:18.655524+0000","last_became_peered":"2024-09-10T21:13:18.655524+0000","last_unstale":"2024-09-10T21:15:05.636304+0000","last_undegraded":"2024-09-10T21:15:05.636304+0000","last_fullsized":"2024-09-10T21:15:05.636304+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:13:29.734783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638144+0000","last_change":"2024-09-10T21:13:18.654359+0000","last_active":"2024-09-10T21:15:05.638144+0000","last_peered":"2024-09-10T21:15:05.638144+0000","last_clean":"2024-09-10T21:15:05.638144+0000","last_became_active":"2024-09-10T21:13:18.653983+0000","last_became_peered":"2024-09-10T21:13:18.653983+0000","last_unstale":"2024-09-10T21:15:05.638144+0000","last_undegraded":"2024-09-10T21:15:05.638144+0000","last_fullsized":"2024-09-10T21:15:05.638144+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:00:48.806836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.637562+0000","last_change":"2024-09-10T21:13:18.650428+0000","last_active":"2024-09-10T21:15:05.637562+0000","last_peered":"2024-09-10T21:15:05.637562+0000","last_clean":"2024-09-10T21:15:05.637562+0000","last_became_active":"2024-09-10T21:13:18.650121+0000","last_became_peered":"2024-09-10T21:13:18.650121+0000","last_unstale":"2024-09-10T21:15:05.637562+0000","last_undegraded":"2024-09-10T21:15:05.637562+0000","last_fullsized":"2024-09-10T21:15:05.637562+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:12:15.121916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.639726+0000","last_change":"2024-09-10T21:13:18.662321+0000","last_active":"2024-09-10T21:15:05.639726+0000","last_peered":"2024-09-10T21:15:05.639726+0000","last_clean":"2024-09-10T21:15:05.639726+0000","last_became_active":"2024-09-10T21:13:18.662013+0000","last_became_peered":"2024-09-10T21:13:18.662013+0000","last_unstale":"2024-09-10T21:15:05.639726+0000","last_undegraded":"2024-09-10T21:15:05.639726+0000","last_fullsized":"2024-09-10T21:15:05.639726+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:04:54.303375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.631470+0000","last_change":"2024-09-10T21:13:18.662549+0000","last_active":"2024-09-10T21:15:05.631470+0000","last_peered":"2024-09-10T21:15:05.631470+0000","last_clean":"2024-09-10T21:15:05.631470+0000","last_became_active":"2024-09-10T21:13:18.662230+0000","last_became_peered":"2024-09-10T21:13:18.662230+0000","last_unstale":"2024-09-10T21:15:05.631470+0000","last_undegraded":"2024-09-10T21:15:05.631470+0000","last_fullsized":"2024-09-10T21:15:05.631470+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:02.582355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.634231+0000","last_change":"2024-09-10T21:13:18.654906+0000","last_active":"2024-09-10T21:15:05.634231+0000","last_peered":"2024-09-10T21:15:05.634231+0000","last_clean":"2024-09-10T21:15:05.634231+0000","last_became_active":"2024-09-10T21:13:18.654599+0000","last_became_peered":"2024-09-10T21:13:18.654599+0000","last_unstale":"2024-09-10T21:15:05.634231+0000","last_undegraded":"2024-09-10T21:15:05.634231+0000","last_fullsized":"2024-09-10T21:15:05.634231+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:34.987893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.632146+0000","last_change":"2024-09-10T21:13:18.643997+0000","last_active":"2024-09-10T21:15:05.632146+0000","last_peered":"2024-09-10T21:15:05.632146+0000","last_clean":"2024-09-10T21:15:05.632146+0000","last_became_active":"2024-09-10T21:13:18.643632+0000","last_became_peered":"2024-09-10T21:13:18.643632+0000","last_unstale":"2024-09-10T21:15:05.632146+0000","last_undegraded":"2024-09-10T21:15:05.632146+0000","last_fullsized":"2024-09-10T21:15:05.632146+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:54:31.234040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.617895+0000","last_change":"2024-09-10T21:13:18.657079+0000","last_active":"2024-09-10T21:15:05.617895+0000","last_peered":"2024-09-10T21:15:05.617895+0000","last_clean":"2024-09-10T21:15:05.617895+0000","last_became_active":"2024-09-10T21:13:18.656741+0000","last_became_peered":"2024-09-10T21:13:18.656741+0000","last_unstale":"2024-09-10T21:15:05.617895+0000","last_undegraded":"2024-09-10T21:15:05.617895+0000","last_fullsized":"2024-09-10T21:15:05.617895+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:27.036783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638632+0000","last_change":"2024-09-10T21:13:18.653076+0000","last_active":"2024-09-10T21:15:05.638632+0000","last_peered":"2024-09-10T21:15:05.638632+0000","last_clean":"2024-09-10T21:15:05.638632+0000","last_became_active":"2024-09-10T21:13:18.652722+0000","last_became_peered":"2024-09-10T21:13:18.652722+0000","last_unstale":"2024-09-10T21:15:05.638632+0000","last_undegraded":"2024-09-10T21:15:05.638632+0000","last_fullsized":"2024-09-10T21:15:05.638632+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:11.005632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.639992+0000","last_change":"2024-09-10T21:13:18.663340+0000","last_active":"2024-09-10T21:15:05.639992+0000","last_peered":"2024-09-10T21:15:05.639992+0000","last_clean":"2024-09-10T21:15:05.639992+0000","last_became_active":"2024-09-10T21:13:18.662981+0000","last_became_peered":"2024-09-10T21:13:18.662981+0000","last_unstale":"2024-09-10T21:15:05.639992+0000","last_undegraded":"2024-09-10T21:15:05.639992+0000","last_fullsized":"2024-09-10T21:15:05.639992+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:14:39.510625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.629760+0000","last_change":"2024-09-10T21:13:18.651376+0000","last_active":"2024-09-10T21:15:05.629760+0000","last_peered":"2024-09-10T21:15:05.629760+0000","last_clean":"2024-09-10T21:15:05.629760+0000","last_became_active":"2024-09-10T21:13:18.650999+0000","last_became_peered":"2024-09-10T21:13:18.650999+0000","last_unstale":"2024-09-10T21:15:05.629760+0000","last_undegraded":"2024-09-10T21:15:05.629760+0000","last_fullsized":"2024-09-10T21:15:05.629760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:12.268120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.628971+0000","last_change":"2024-09-10T21:13:18.648634+0000","last_active":"2024-09-10T21:15:05.628971+0000","last_peered":"2024-09-10T21:15:05.628971+0000","last_clean":"2024-09-10T21:15:05.628971+0000","last_became_active":"2024-09-10T21:13:18.648099+0000","last_became_peered":"2024-09-10T21:13:18.648099+0000","last_unstale":"2024-09-10T21:15:05.628971+0000","last_undegraded":"2024-09-10T21:15:05.628971+0000","last_fullsized":"2024-09-10T21:15:05.628971+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:38:47.570132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.627349+0000","last_change":"2024-09-10T21:13:18.660188+0000","last_active":"2024-09-10T21:15:05.627349+0000","last_peered":"2024-09-10T21:15:05.627349+0000","last_clean":"2024-09-10T21:15:05.627349+0000","last_became_active":"2024-09-10T21:13:18.659821+0000","last_became_peered":"2024-09-10T21:13:18.659821+0000","last_unstale":"2024-09-10T21:15:05.627349+0000","last_undegraded":"2024-09-10T21:15:05.627349+0000","last_fullsized":"2024-09-10T21:15:05.627349+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:36.456852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.632319+0000","last_change":"2024-09-10T21:13:18.656727+0000","last_active":"2024-09-10T21:15:05.632319+0000","last_peered":"2024-09-10T21:15:05.632319+0000","last_clean":"2024-09-10T21:15:05.632319+0000","last_became_active":"2024-09-10T21:13:18.654627+0000","last_became_peered":"2024-09-10T21:13:18.654627+0000","last_unstale":"2024-09-10T21:15:05.632319+0000","last_undegraded":"2024-09-10T21:15:05.632319+0000","last_fullsized":"2024-09-10T21:15:05.632319+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:42.838893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.629978+0000","last_change":"2024-09-10T21:13:18.660113+0000","last_active":"2024-09-10T21:15:05.629978+0000","last_peered":"2024-09-10T21:15:05.629978+0000","last_clean":"2024-09-10T21:15:05.629978+0000","last_became_active":"2024-09-10T21:13:18.659668+0000","last_became_peered":"2024-09-10T21:13:18.659668+0000","last_unstale":"2024-09-10T21:15:05.629978+0000","last_undegraded":"2024-09-10T21:15:05.629978+0000","last_fullsized":"2024-09-10T21:15:05.629978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:52:43.733431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"75'4","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.637642+0000","last_change":"2024-09-10T21:13:18.648015+0000","last_active":"2024-09-10T21:15:05.637642+0000","last_peered":"2024-09-10T21:15:05.637642+0000","last_clean":"2024-09-10T21:15:05.637642+0000","last_became_active":"2024-09-10T21:13:18.647661+0000","last_became_peered":"2024-09-10T21:13:18.647661+0000","last_unstale":"2024-09-10T21:15:05.637642+0000","last_undegraded":"2024-09-10T21:15:05.637642+0000","last_fullsized":"2024-09-10T21:15:05.637642+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:22.543217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638146+0000","last_change":"2024-09-10T21:13:18.657728+0000","last_active":"2024-09-10T21:15:05.638146+0000","last_peered":"2024-09-10T21:15:05.638146+0000","last_clean":"2024-09-10T21:15:05.638146+0000","last_became_active":"2024-09-10T21:13:18.657372+0000","last_became_peered":"2024-09-10T21:13:18.657372+0000","last_unstale":"2024-09-10T21:15:05.638146+0000","last_undegraded":"2024-09-10T21:15:05.638146+0000","last_fullsized":"2024-09-10T21:15:05.638146+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:00:43.621668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.626804+0000","last_change":"2024-09-10T21:13:18.648380+0000","last_active":"2024-09-10T21:15:05.626804+0000","last_peered":"2024-09-10T21:15:05.626804+0000","last_clean":"2024-09-10T21:15:05.626804+0000","last_became_active":"2024-09-10T21:13:18.647871+0000","last_became_peered":"2024-09-10T21:13:18.647871+0000","last_unstale":"2024-09-10T21:15:05.626804+0000","last_undegraded":"2024-09-10T21:15:05.626804+0000","last_fullsized":"2024-09-10T21:15:05.626804+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:15:16.374911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'12","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636553+0000","last_change":"2024-09-10T21:13:18.654843+0000","last_active":"2024-09-10T21:15:05.636553+0000","last_peered":"2024-09-10T21:15:05.636553+0000","last_clean":"2024-09-10T21:15:05.636553+0000","last_became_active":"2024-09-10T21:13:18.654211+0000","last_became_peered":"2024-09-10T21:13:18.654211+0000","last_unstale":"2024-09-10T21:15:05.636553+0000","last_undegraded":"2024-09-10T21:15:05.636553+0000","last_fullsized":"2024-09-10T21:15:05.636553+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:08:28.490792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.628477+0000","last_change":"2024-09-10T21:13:18.659603+0000","last_active":"2024-09-10T21:15:05.628477+0000","last_peered":"2024-09-10T21:15:05.628477+0000","last_clean":"2024-09-10T21:15:05.628477+0000","last_became_active":"2024-09-10T21:13:18.659257+0000","last_became_peered":"2024-09-10T21:13:18.659257+0000","last_unstale":"2024-09-10T21:15:05.628477+0000","last_undegraded":"2024-09-10T21:15:05.628477+0000","last_fullsized":"2024-09-10T21:15:05.628477+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:26.249109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.626761+0000","last_change":"2024-09-10T21:13:18.649354+0000","last_active":"2024-09-10T21:15:05.626761+0000","last_peered":"2024-09-10T21:15:05.626761+0000","last_clean":"2024-09-10T21:15:05.626761+0000","last_became_active":"2024-09-10T21:13:18.649029+0000","last_became_peered":"2024-09-10T21:13:18.649029+0000","last_unstale":"2024-09-10T21:15:05.626761+0000","last_undegraded":"2024-09-10T21:15:05.626761+0000","last_fullsized":"2024-09-10T21:15:05.626761+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:06.946983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'7","reported_seq":136,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:11.094790+0000","last_change":"2024-09-10T21:13:16.631197+0000","last_active":"2024-09-10T21:15:11.094790+0000","last_peered":"2024-09-10T21:15:11.094790+0000","last_clean":"2024-09-10T21:15:11.094790+0000","last_became_active":"2024-09-10T21:13:16.630877+0000","last_became_peered":"2024-09-10T21:13:16.630877+0000","last_unstale":"2024-09-10T21:15:11.094790+0000","last_undegraded":"2024-09-10T21:15:11.094790+0000","last_fullsized":"2024-09-10T21:15:11.094790+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:51:50.117425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.629100+0000","last_change":"2024-09-10T21:13:18.654124+0000","last_active":"2024-09-10T21:15:05.629100+0000","last_peered":"2024-09-10T21:15:05.629100+0000","last_clean":"2024-09-10T21:15:05.629100+0000","last_became_active":"2024-09-10T21:13:18.653757+0000","last_became_peered":"2024-09-10T21:13:18.653757+0000","last_unstale":"2024-09-10T21:15:05.629100+0000","last_undegraded":"2024-09-10T21:15:05.629100+0000","last_fullsized":"2024-09-10T21:15:05.629100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:37:25.174272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.306892+0000","last_change":"2024-09-10T21:13:16.631526+0000","last_active":"2024-09-10T21:14:06.306892+0000","last_peered":"2024-09-10T21:14:06.306892+0000","last_clean":"2024-09-10T21:14:06.306892+0000","last_became_active":"2024-09-10T21:13:16.631194+0000","last_became_peered":"2024-09-10T21:13:16.631194+0000","last_unstale":"2024-09-10T21:14:06.306892+0000","last_undegraded":"2024-09-10T21:14:06.306892+0000","last_fullsized":"2024-09-10T21:14:06.306892+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:31:35.036874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"73'3","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433190+0000","last_change":"2024-09-10T21:13:16.624906+0000","last_active":"2024-09-10T21:14:06.433190+0000","last_peered":"2024-09-10T21:14:06.433190+0000","last_clean":"2024-09-10T21:14:06.433190+0000","last_became_active":"2024-09-10T21:13:16.624376+0000","last_became_peered":"2024-09-10T21:13:16.624376+0000","last_unstale":"2024-09-10T21:14:06.433190+0000","last_undegraded":"2024-09-10T21:14:06.433190+0000","last_fullsized":"2024-09-10T21:14:06.433190+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:20.942651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.628480+0000","last_change":"2024-09-10T21:13:18.646987+0000","last_active":"2024-09-10T21:15:05.628480+0000","last_peered":"2024-09-10T21:15:05.628480+0000","last_clean":"2024-09-10T21:15:05.628480+0000","last_became_active":"2024-09-10T21:13:18.646690+0000","last_became_peered":"2024-09-10T21:13:18.646690+0000","last_unstale":"2024-09-10T21:15:05.628480+0000","last_undegraded":"2024-09-10T21:15:05.628480+0000","last_fullsized":"2024-09-10T21:15:05.628480+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:47:02.132164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433699+0000","last_change":"2024-09-10T21:13:16.633082+0000","last_active":"2024-09-10T21:14:06.433699+0000","last_peered":"2024-09-10T21:14:06.433699+0000","last_clean":"2024-09-10T21:14:06.433699+0000","last_became_active":"2024-09-10T21:13:16.632707+0000","last_became_peered":"2024-09-10T21:13:16.632707+0000","last_unstale":"2024-09-10T21:14:06.433699+0000","last_undegraded":"2024-09-10T21:14:06.433699+0000","last_fullsized":"2024-09-10T21:14:06.433699+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:53:56.611072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"75'11","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.632300+0000","last_change":"2024-09-10T21:13:18.663309+0000","last_active":"2024-09-10T21:15:05.632300+0000","last_peered":"2024-09-10T21:15:05.632300+0000","last_clean":"2024-09-10T21:15:05.632300+0000","last_became_active":"2024-09-10T21:13:18.662990+0000","last_became_peered":"2024-09-10T21:13:18.662990+0000","last_unstale":"2024-09-10T21:15:05.632300+0000","last_undegraded":"2024-09-10T21:15:05.632300+0000","last_fullsized":"2024-09-10T21:15:05.632300+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:17:18.014441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'5","reported_seq":228,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:10.092588+0000","last_change":"2024-09-10T21:13:16.633012+0000","last_active":"2024-09-10T21:15:10.092588+0000","last_peered":"2024-09-10T21:15:10.092588+0000","last_clean":"2024-09-10T21:15:10.092588+0000","last_became_active":"2024-09-10T21:13:16.632622+0000","last_became_peered":"2024-09-10T21:13:16.632622+0000","last_unstale":"2024-09-10T21:15:10.092588+0000","last_undegraded":"2024-09-10T21:15:10.092588+0000","last_fullsized":"2024-09-10T21:15:10.092588+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:59:16.859255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":200,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"75'10","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638770+0000","last_change":"2024-09-10T21:13:18.658015+0000","last_active":"2024-09-10T21:15:05.638770+0000","last_peered":"2024-09-10T21:15:05.638770+0000","last_clean":"2024-09-10T21:15:05.638770+0000","last_became_active":"2024-09-10T21:13:18.656922+0000","last_became_peered":"2024-09-10T21:13:18.656922+0000","last_unstale":"2024-09-10T21:15:05.638770+0000","last_undegraded":"2024-09-10T21:15:05.638770+0000","last_fullsized":"2024-09-10T21:15:05.638770+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:15:24.038131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.313021+0000","last_change":"2024-09-10T21:13:16.631771+0000","last_active":"2024-09-10T21:14:06.313021+0000","last_peered":"2024-09-10T21:14:06.313021+0000","last_clean":"2024-09-10T21:14:06.313021+0000","last_became_active":"2024-09-10T21:13:16.631477+0000","last_became_peered":"2024-09-10T21:13:16.631477+0000","last_unstale":"2024-09-10T21:14:06.313021+0000","last_undegraded":"2024-09-10T21:14:06.313021+0000","last_fullsized":"2024-09-10T21:14:06.313021+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:16.644046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638312+0000","last_change":"2024-09-10T21:13:18.658119+0000","last_active":"2024-09-10T21:15:05.638312+0000","last_peered":"2024-09-10T21:15:05.638312+0000","last_clean":"2024-09-10T21:15:05.638312+0000","last_became_active":"2024-09-10T21:13:18.657339+0000","last_became_peered":"2024-09-10T21:13:18.657339+0000","last_unstale":"2024-09-10T21:15:05.638312+0000","last_undegraded":"2024-09-10T21:15:05.638312+0000","last_fullsized":"2024-09-10T21:15:05.638312+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:45.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433347+0000","last_change":"2024-09-10T21:13:16.727019+0000","last_active":"2024-09-10T21:14:06.433347+0000","last_peered":"2024-09-10T21:14:06.433347+0000","last_clean":"2024-09-10T21:14:06.433347+0000","last_became_active":"2024-09-10T21:13:16.726667+0000","last_became_peered":"2024-09-10T21:13:16.726667+0000","last_unstale":"2024-09-10T21:14:06.433347+0000","last_undegraded":"2024-09-10T21:14:06.433347+0000","last_fullsized":"2024-09-10T21:14:06.433347+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:21:57.551149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"75'11","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636868+0000","last_change":"2024-09-10T21:14:06.434206+0000","last_active":"2024-09-10T21:15:05.636868+0000","last_peered":"2024-09-10T21:15:05.636868+0000","last_clean":"2024-09-10T21:15:05.636868+0000","last_became_active":"2024-09-10T21:14:06.433779+0000","last_became_peered":"2024-09-10T21:14:06.433779+0000","last_unstale":"2024-09-10T21:15:05.636868+0000","last_undegraded":"2024-09-10T21:15:05.636868+0000","last_fullsized":"2024-09-10T21:15:05.636868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:50:24.590286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'34","reported_seq":266,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:10.093069+0000","last_change":"2024-09-10T21:13:16.631820+0000","last_active":"2024-09-10T21:15:10.093069+0000","last_peered":"2024-09-10T21:15:10.093069+0000","last_clean":"2024-09-10T21:15:10.093069+0000","last_became_active":"2024-09-10T21:13:16.631432+0000","last_became_peered":"2024-09-10T21:13:16.631432+0000","last_unstale":"2024-09-10T21:15:10.093069+0000","last_undegraded":"2024-09-10T21:15:10.093069+0000","last_fullsized":"2024-09-10T21:15:10.093069+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:47.972871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60319,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":209,"num_read_kb":163,"num_write":36,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.630791+0000","last_change":"2024-09-10T21:13:18.653147+0000","last_active":"2024-09-10T21:15:05.630791+0000","last_peered":"2024-09-10T21:15:05.630791+0000","last_clean":"2024-09-10T21:15:05.630791+0000","last_became_active":"2024-09-10T21:13:18.652846+0000","last_became_peered":"2024-09-10T21:13:18.652846+0000","last_unstale":"2024-09-10T21:15:05.630791+0000","last_undegraded":"2024-09-10T21:15:05.630791+0000","last_fullsized":"2024-09-10T21:15:05.630791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:59.007192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"73'9","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309628+0000","last_change":"2024-09-10T21:13:16.631994+0000","last_active":"2024-09-10T21:14:06.309628+0000","last_peered":"2024-09-10T21:14:06.309628+0000","last_clean":"2024-09-10T21:14:06.309628+0000","last_became_active":"2024-09-10T21:13:16.631665+0000","last_became_peered":"2024-09-10T21:13:16.631665+0000","last_unstale":"2024-09-10T21:14:06.309628+0000","last_undegraded":"2024-09-10T21:14:06.309628+0000","last_fullsized":"2024-09-10T21:14:06.309628+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:14:05.537172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638781+0000","last_change":"2024-09-10T21:13:18.657463+0000","last_active":"2024-09-10T21:15:05.638781+0000","last_peered":"2024-09-10T21:15:05.638781+0000","last_clean":"2024-09-10T21:15:05.638781+0000","last_became_active":"2024-09-10T21:13:18.657146+0000","last_became_peered":"2024-09-10T21:13:18.657146+0000","last_unstale":"2024-09-10T21:15:05.638781+0000","last_undegraded":"2024-09-10T21:15:05.638781+0000","last_fullsized":"2024-09-10T21:15:05.638781+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:42.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433206+0000","last_change":"2024-09-10T21:13:16.630419+0000","last_active":"2024-09-10T21:14:06.433206+0000","last_peered":"2024-09-10T21:14:06.433206+0000","last_clean":"2024-09-10T21:14:06.433206+0000","last_became_active":"2024-09-10T21:13:16.630053+0000","last_became_peered":"2024-09-10T21:13:16.630053+0000","last_unstale":"2024-09-10T21:14:06.433206+0000","last_undegraded":"2024-09-10T21:14:06.433206+0000","last_fullsized":"2024-09-10T21:14:06.433206+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:08.090931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.640928+0000","last_change":"2024-09-10T21:13:18.657585+0000","last_active":"2024-09-10T21:15:05.640928+0000","last_peered":"2024-09-10T21:15:05.640928+0000","last_clean":"2024-09-10T21:15:05.640928+0000","last_became_active":"2024-09-10T21:13:18.657280+0000","last_became_peered":"2024-09-10T21:13:18.657280+0000","last_unstale":"2024-09-10T21:15:05.640928+0000","last_undegraded":"2024-09-10T21:15:05.640928+0000","last_fullsized":"2024-09-10T21:15:05.640928+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:46:34.252882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"73'5","reported_seq":131,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:10.093287+0000","last_change":"2024-09-10T21:13:16.629700+0000","last_active":"2024-09-10T21:15:10.093287+0000","last_peered":"2024-09-10T21:15:10.093287+0000","last_clean":"2024-09-10T21:15:10.093287+0000","last_became_active":"2024-09-10T21:13:16.629282+0000","last_became_peered":"2024-09-10T21:13:16.629282+0000","last_unstale":"2024-09-10T21:15:10.093287+0000","last_undegraded":"2024-09-10T21:15:10.093287+0000","last_fullsized":"2024-09-10T21:15:10.093287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:42.572643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.635679+0000","last_change":"2024-09-10T21:13:18.664535+0000","last_active":"2024-09-10T21:15:05.635679+0000","last_peered":"2024-09-10T21:15:05.635679+0000","last_clean":"2024-09-10T21:15:05.635679+0000","last_became_active":"2024-09-10T21:13:18.663997+0000","last_became_peered":"2024-09-10T21:13:18.663997+0000","last_unstale":"2024-09-10T21:15:05.635679+0000","last_undegraded":"2024-09-10T21:15:05.635679+0000","last_fullsized":"2024-09-10T21:15:05.635679+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:45:30.365106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"73'17","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308443+0000","last_change":"2024-09-10T21:13:16.727096+0000","last_active":"2024-09-10T21:14:06.308443+0000","last_peered":"2024-09-10T21:14:06.308443+0000","last_clean":"2024-09-10T21:14:06.308443+0000","last_became_active":"2024-09-10T21:13:16.726408+0000","last_became_peered":"2024-09-10T21:13:16.726408+0000","last_unstale":"2024-09-10T21:14:06.308443+0000","last_undegraded":"2024-09-10T21:14:06.308443+0000","last_fullsized":"2024-09-10T21:14:06.308443+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:47:30.581238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.628607+0000","last_change":"2024-09-10T21:13:18.657397+0000","last_active":"2024-09-10T21:15:05.628607+0000","last_peered":"2024-09-10T21:15:05.628607+0000","last_clean":"2024-09-10T21:15:05.628607+0000","last_became_active":"2024-09-10T21:13:18.657050+0000","last_became_peered":"2024-09-10T21:13:18.657050+0000","last_unstale":"2024-09-10T21:15:05.628607+0000","last_undegraded":"2024-09-10T21:15:05.628607+0000","last_fullsized":"2024-09-10T21:15:05.628607+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:44:09.739544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"73'2","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.310361+0000","last_change":"2024-09-10T21:13:16.633716+0000","last_active":"2024-09-10T21:14:06.310361+0000","last_peered":"2024-09-10T21:14:06.310361+0000","last_clean":"2024-09-10T21:14:06.310361+0000","last_became_active":"2024-09-10T21:13:16.633225+0000","last_became_peered":"2024-09-10T21:13:16.633225+0000","last_unstale":"2024-09-10T21:14:06.310361+0000","last_undegraded":"2024-09-10T21:14:06.310361+0000","last_fullsized":"2024-09-10T21:14:06.310361+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:00:48.807549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.627900+0000","last_change":"2024-09-10T21:13:18.663129+0000","last_active":"2024-09-10T21:15:05.627900+0000","last_peered":"2024-09-10T21:15:05.627900+0000","last_clean":"2024-09-10T21:15:05.627900+0000","last_became_active":"2024-09-10T21:13:18.662694+0000","last_became_peered":"2024-09-10T21:13:18.662694+0000","last_unstale":"2024-09-10T21:15:05.627900+0000","last_undegraded":"2024-09-10T21:15:05.627900+0000","last_fullsized":"2024-09-10T21:15:05.627900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:24.633468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"73'5","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433973+0000","last_change":"2024-09-10T21:13:16.628733+0000","last_active":"2024-09-10T21:14:06.433973+0000","last_peered":"2024-09-10T21:14:06.433973+0000","last_clean":"2024-09-10T21:14:06.433973+0000","last_became_active":"2024-09-10T21:13:16.628419+0000","last_became_peered":"2024-09-10T21:13:16.628419+0000","last_unstale":"2024-09-10T21:14:06.433973+0000","last_undegraded":"2024-09-10T21:14:06.433973+0000","last_fullsized":"2024-09-10T21:14:06.433973+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:34:31.264739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636488+0000","last_change":"2024-09-10T21:13:18.656571+0000","last_active":"2024-09-10T21:15:05.636488+0000","last_peered":"2024-09-10T21:15:05.636488+0000","last_clean":"2024-09-10T21:15:05.636488+0000","last_became_active":"2024-09-10T21:13:18.656253+0000","last_became_peered":"2024-09-10T21:13:18.656253+0000","last_unstale":"2024-09-10T21:15:05.636488+0000","last_undegraded":"2024-09-10T21:15:05.636488+0000","last_fullsized":"2024-09-10T21:15:05.636488+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:33:57.848566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"73'3","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433543+0000","last_change":"2024-09-10T21:13:16.631750+0000","last_active":"2024-09-10T21:14:06.433543+0000","last_peered":"2024-09-10T21:14:06.433543+0000","last_clean":"2024-09-10T21:14:06.433543+0000","last_became_active":"2024-09-10T21:13:16.631245+0000","last_became_peered":"2024-09-10T21:13:16.631245+0000","last_unstale":"2024-09-10T21:14:06.433543+0000","last_undegraded":"2024-09-10T21:14:06.433543+0000","last_fullsized":"2024-09-10T21:14:06.433543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:28.787751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.635634+0000","last_change":"2024-09-10T21:13:18.660834+0000","last_active":"2024-09-10T21:15:05.635634+0000","last_peered":"2024-09-10T21:15:05.635634+0000","last_clean":"2024-09-10T21:15:05.635634+0000","last_became_active":"2024-09-10T21:13:18.660461+0000","last_became_peered":"2024-09-10T21:13:18.660461+0000","last_unstale":"2024-09-10T21:15:05.635634+0000","last_undegraded":"2024-09-10T21:15:05.635634+0000","last_fullsized":"2024-09-10T21:15:05.635634+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:01:55.531199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"73'5","reported_seq":131,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:10.093142+0000","last_change":"2024-09-10T21:13:16.726824+0000","last_active":"2024-09-10T21:15:10.093142+0000","last_peered":"2024-09-10T21:15:10.093142+0000","last_clean":"2024-09-10T21:15:10.093142+0000","last_became_active":"2024-09-10T21:13:16.726436+0000","last_became_peered":"2024-09-10T21:13:16.726436+0000","last_unstale":"2024-09-10T21:15:10.093142+0000","last_undegraded":"2024-09-10T21:15:10.093142+0000","last_fullsized":"2024-09-10T21:15:10.093142+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:39:49.391388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":103,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.638751+0000","last_change":"2024-09-10T21:13:18.663725+0000","last_active":"2024-09-10T21:15:05.638751+0000","last_peered":"2024-09-10T21:15:05.638751+0000","last_clean":"2024-09-10T21:15:05.638751+0000","last_became_active":"2024-09-10T21:13:18.663254+0000","last_became_peered":"2024-09-10T21:13:18.663254+0000","last_unstale":"2024-09-10T21:15:05.638751+0000","last_undegraded":"2024-09-10T21:15:05.638751+0000","last_fullsized":"2024-09-10T21:15:05.638751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:19.672231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312748+0000","last_change":"2024-09-10T21:12:08.173849+0000","last_active":"2024-09-10T21:14:06.312748+0000","last_peered":"2024-09-10T21:14:06.312748+0000","last_clean":"2024-09-10T21:14:06.312748+0000","last_became_active":"2024-09-10T21:12:08.153630+0000","last_became_peered":"2024-09-10T21:12:08.153630+0000","last_unstale":"2024-09-10T21:14:06.312748+0000","last_undegraded":"2024-09-10T21:14:06.312748+0000","last_fullsized":"2024-09-10T21:14:06.312748+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:08:47.842259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:08:47.842259+0000","last_clean_scrub_stamp":"2024-09-10T21:08:47.842259+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:01:39.166390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"73'6","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433413+0000","last_change":"2024-09-10T21:13:16.628607+0000","last_active":"2024-09-10T21:14:06.433413+0000","last_peered":"2024-09-10T21:14:06.433413+0000","last_clean":"2024-09-10T21:14:06.433413+0000","last_became_active":"2024-09-10T21:13:16.627736+0000","last_became_peered":"2024-09-10T21:13:16.627736+0000","last_unstale":"2024-09-10T21:14:06.433413+0000","last_undegraded":"2024-09-10T21:14:06.433413+0000","last_fullsized":"2024-09-10T21:14:06.433413+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:03:16.388832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636188+0000","last_change":"2024-09-10T21:13:18.652634+0000","last_active":"2024-09-10T21:15:05.636188+0000","last_peered":"2024-09-10T21:15:05.636188+0000","last_clean":"2024-09-10T21:15:05.636188+0000","last_became_active":"2024-09-10T21:13:18.652325+0000","last_became_peered":"2024-09-10T21:13:18.652325+0000","last_unstale":"2024-09-10T21:15:05.636188+0000","last_undegraded":"2024-09-10T21:15:05.636188+0000","last_fullsized":"2024-09-10T21:15:05.636188+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:09:16.382355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"73'4","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.312642+0000","last_change":"2024-09-10T21:13:16.631442+0000","last_active":"2024-09-10T21:14:06.312642+0000","last_peered":"2024-09-10T21:14:06.312642+0000","last_clean":"2024-09-10T21:14:06.312642+0000","last_became_active":"2024-09-10T21:13:16.631117+0000","last_became_peered":"2024-09-10T21:13:16.631117+0000","last_unstale":"2024-09-10T21:14:06.312642+0000","last_undegraded":"2024-09-10T21:14:06.312642+0000","last_fullsized":"2024-09-10T21:14:06.312642+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:07:35.376888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.635164+0000","last_change":"2024-09-10T21:13:18.644246+0000","last_active":"2024-09-10T21:15:05.635164+0000","last_peered":"2024-09-10T21:15:05.635164+0000","last_clean":"2024-09-10T21:15:05.635164+0000","last_became_active":"2024-09-10T21:13:18.643944+0000","last_became_peered":"2024-09-10T21:13:18.643944+0000","last_unstale":"2024-09-10T21:15:05.635164+0000","last_undegraded":"2024-09-10T21:15:05.635164+0000","last_fullsized":"2024-09-10T21:15:05.635164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:18.856149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"73'5","reported_seq":132,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:12.095387+0000","last_change":"2024-09-10T21:13:16.726716+0000","last_active":"2024-09-10T21:15:12.095387+0000","last_peered":"2024-09-10T21:15:12.095387+0000","last_clean":"2024-09-10T21:15:12.095387+0000","last_became_active":"2024-09-10T21:13:16.726400+0000","last_became_peered":"2024-09-10T21:13:16.726400+0000","last_unstale":"2024-09-10T21:15:12.095387+0000","last_undegraded":"2024-09-10T21:15:12.095387+0000","last_fullsized":"2024-09-10T21:15:12.095387+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:50:55.643495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.624187+0000","last_change":"2024-09-10T21:14:06.433990+0000","last_active":"2024-09-10T21:15:05.624187+0000","last_peered":"2024-09-10T21:15:05.624187+0000","last_clean":"2024-09-10T21:15:05.624187+0000","last_became_active":"2024-09-10T21:14:06.433489+0000","last_became_peered":"2024-09-10T21:14:06.433489+0000","last_unstale":"2024-09-10T21:15:05.624187+0000","last_undegraded":"2024-09-10T21:15:05.624187+0000","last_fullsized":"2024-09-10T21:15:05.624187+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:28.001658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"75'6","reported_seq":133,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:11.094570+0000","last_change":"2024-09-10T21:13:16.633126+0000","last_active":"2024-09-10T21:15:11.094570+0000","last_peered":"2024-09-10T21:15:11.094570+0000","last_clean":"2024-09-10T21:15:11.094570+0000","last_became_active":"2024-09-10T21:13:16.632808+0000","last_became_peered":"2024-09-10T21:13:16.632808+0000","last_unstale":"2024-09-10T21:15:11.094570+0000","last_undegraded":"2024-09-10T21:15:11.094570+0000","last_fullsized":"2024-09-10T21:15:11.094570+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:49:01.026506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":896,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.633724+0000","last_change":"2024-09-10T21:13:18.652631+0000","last_active":"2024-09-10T21:15:05.633724+0000","last_peered":"2024-09-10T21:15:05.633724+0000","last_clean":"2024-09-10T21:15:05.633724+0000","last_became_active":"2024-09-10T21:13:18.650580+0000","last_became_peered":"2024-09-10T21:13:18.650580+0000","last_unstale":"2024-09-10T21:15:05.633724+0000","last_undegraded":"2024-09-10T21:15:05.633724+0000","last_fullsized":"2024-09-10T21:15:05.633724+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:32:32.733169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"73'1","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.305817+0000","last_change":"2024-09-10T21:13:16.728172+0000","last_active":"2024-09-10T21:14:06.305817+0000","last_peered":"2024-09-10T21:14:06.305817+0000","last_clean":"2024-09-10T21:14:06.305817+0000","last_became_active":"2024-09-10T21:13:16.727793+0000","last_became_peered":"2024-09-10T21:13:16.727793+0000","last_unstale":"2024-09-10T21:14:06.305817+0000","last_undegraded":"2024-09-10T21:14:06.305817+0000","last_fullsized":"2024-09-10T21:14:06.305817+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:58:04.301119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.629258+0000","last_change":"2024-09-10T21:13:18.655371+0000","last_active":"2024-09-10T21:15:05.629258+0000","last_peered":"2024-09-10T21:15:05.629258+0000","last_clean":"2024-09-10T21:15:05.629258+0000","last_became_active":"2024-09-10T21:13:18.653250+0000","last_became_peered":"2024-09-10T21:13:18.653250+0000","last_unstale":"2024-09-10T21:15:05.629258+0000","last_undegraded":"2024-09-10T21:15:05.629258+0000","last_fullsized":"2024-09-10T21:15:05.629258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:21:25.650736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"73'4","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309415+0000","last_change":"2024-09-10T21:13:16.726816+0000","last_active":"2024-09-10T21:14:06.309415+0000","last_peered":"2024-09-10T21:14:06.309415+0000","last_clean":"2024-09-10T21:14:06.309415+0000","last_became_active":"2024-09-10T21:13:16.726438+0000","last_became_peered":"2024-09-10T21:13:16.726438+0000","last_unstale":"2024-09-10T21:14:06.309415+0000","last_undegraded":"2024-09-10T21:14:06.309415+0000","last_fullsized":"2024-09-10T21:14:06.309415+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:46.384899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.635531+0000","last_change":"2024-09-10T21:13:18.643424+0000","last_active":"2024-09-10T21:15:05.635531+0000","last_peered":"2024-09-10T21:15:05.635531+0000","last_clean":"2024-09-10T21:15:05.635531+0000","last_became_active":"2024-09-10T21:13:18.643010+0000","last_became_peered":"2024-09-10T21:13:18.643010+0000","last_unstale":"2024-09-10T21:15:05.635531+0000","last_undegraded":"2024-09-10T21:15:05.635531+0000","last_fullsized":"2024-09-10T21:15:05.635531+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:38:47.358129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'16","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.663709+0000","last_change":"2024-09-10T21:14:06.316327+0000","last_active":"2024-09-10T21:15:05.663709+0000","last_peered":"2024-09-10T21:15:05.663709+0000","last_clean":"2024-09-10T21:15:05.663709+0000","last_became_active":"2024-09-10T21:14:06.309000+0000","last_became_peered":"2024-09-10T21:14:06.309000+0000","last_unstale":"2024-09-10T21:15:05.663709+0000","last_undegraded":"2024-09-10T21:15:05.663709+0000","last_fullsized":"2024-09-10T21:15:05.663709+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:58:13.582411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.633119+0000","last_change":"2024-09-10T21:13:18.652347+0000","last_active":"2024-09-10T21:15:05.633119+0000","last_peered":"2024-09-10T21:15:05.633119+0000","last_clean":"2024-09-10T21:15:05.633119+0000","last_became_active":"2024-09-10T21:13:18.651942+0000","last_became_peered":"2024-09-10T21:13:18.651942+0000","last_unstale":"2024-09-10T21:15:05.633119+0000","last_undegraded":"2024-09-10T21:15:05.633119+0000","last_fullsized":"2024-09-10T21:15:05.633119+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:27:11.356787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"73'7","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.433490+0000","last_change":"2024-09-10T21:13:16.621647+0000","last_active":"2024-09-10T21:14:06.433490+0000","last_peered":"2024-09-10T21:14:06.433490+0000","last_clean":"2024-09-10T21:14:06.433490+0000","last_became_active":"2024-09-10T21:13:16.621316+0000","last_became_peered":"2024-09-10T21:13:16.621316+0000","last_unstale":"2024-09-10T21:14:06.433490+0000","last_undegraded":"2024-09-10T21:14:06.433490+0000","last_fullsized":"2024-09-10T21:14:06.433490+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:35:10.264578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'7","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.637297+0000","last_change":"2024-09-10T21:13:18.656617+0000","last_active":"2024-09-10T21:15:05.637297+0000","last_peered":"2024-09-10T21:15:05.637297+0000","last_clean":"2024-09-10T21:15:05.637297+0000","last_became_active":"2024-09-10T21:13:18.656331+0000","last_became_peered":"2024-09-10T21:13:18.656331+0000","last_unstale":"2024-09-10T21:15:05.637297+0000","last_undegraded":"2024-09-10T21:15:05.637297+0000","last_fullsized":"2024-09-10T21:15:05.637297+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:44.482797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309648+0000","last_change":"2024-09-10T21:13:16.727736+0000","last_active":"2024-09-10T21:14:06.309648+0000","last_peered":"2024-09-10T21:14:06.309648+0000","last_clean":"2024-09-10T21:14:06.309648+0000","last_became_active":"2024-09-10T21:13:16.727413+0000","last_became_peered":"2024-09-10T21:13:16.727413+0000","last_unstale":"2024-09-10T21:14:06.309648+0000","last_undegraded":"2024-09-10T21:14:06.309648+0000","last_fullsized":"2024-09-10T21:14:06.309648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:26.351729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"75'2","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.592112+0000","last_change":"2024-09-10T21:13:18.660100+0000","last_active":"2024-09-10T21:15:05.592112+0000","last_peered":"2024-09-10T21:15:05.592112+0000","last_clean":"2024-09-10T21:15:05.592112+0000","last_became_active":"2024-09-10T21:13:18.659733+0000","last_became_peered":"2024-09-10T21:13:18.659733+0000","last_unstale":"2024-09-10T21:15:05.592112+0000","last_undegraded":"2024-09-10T21:15:05.592112+0000","last_fullsized":"2024-09-10T21:15:05.592112+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:44.371627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"73'7","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308097+0000","last_change":"2024-09-10T21:13:16.627194+0000","last_active":"2024-09-10T21:14:06.308097+0000","last_peered":"2024-09-10T21:14:06.308097+0000","last_clean":"2024-09-10T21:14:06.308097+0000","last_became_active":"2024-09-10T21:13:16.626805+0000","last_became_peered":"2024-09-10T21:13:16.626805+0000","last_unstale":"2024-09-10T21:14:06.308097+0000","last_undegraded":"2024-09-10T21:14:06.308097+0000","last_fullsized":"2024-09-10T21:14:06.308097+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:33.582084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.623962+0000","last_change":"2024-09-10T21:13:18.663122+0000","last_active":"2024-09-10T21:15:05.623962+0000","last_peered":"2024-09-10T21:15:05.623962+0000","last_clean":"2024-09-10T21:15:05.623962+0000","last_became_active":"2024-09-10T21:13:18.662673+0000","last_became_peered":"2024-09-10T21:13:18.662673+0000","last_unstale":"2024-09-10T21:15:05.623962+0000","last_undegraded":"2024-09-10T21:15:05.623962+0000","last_fullsized":"2024-09-10T21:15:05.623962+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:15.710246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"73'3","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.320090+0000","last_change":"2024-09-10T21:14:06.319645+0000","last_active":"2024-09-10T21:14:06.320090+0000","last_peered":"2024-09-10T21:14:06.320090+0000","last_clean":"2024-09-10T21:14:06.320090+0000","last_became_active":"2024-09-10T21:14:06.311394+0000","last_became_peered":"2024-09-10T21:14:06.311394+0000","last_unstale":"2024-09-10T21:14:06.320090+0000","last_undegraded":"2024-09-10T21:14:06.320090+0000","last_fullsized":"2024-09-10T21:14:06.320090+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:26:20.925331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"75'8","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.631611+0000","last_change":"2024-09-10T21:13:18.656400+0000","last_active":"2024-09-10T21:15:05.631611+0000","last_peered":"2024-09-10T21:15:05.631611+0000","last_clean":"2024-09-10T21:15:05.631611+0000","last_became_active":"2024-09-10T21:13:18.655802+0000","last_became_peered":"2024-09-10T21:13:18.655802+0000","last_unstale":"2024-09-10T21:15:05.631611+0000","last_undegraded":"2024-09-10T21:15:05.631611+0000","last_fullsized":"2024-09-10T21:15:05.631611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:50:41.901404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"73'4","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.438924+0000","last_change":"2024-09-10T21:14:06.438851+0000","last_active":"2024-09-10T21:14:06.438924+0000","last_peered":"2024-09-10T21:14:06.438924+0000","last_clean":"2024-09-10T21:14:06.438924+0000","last_became_active":"2024-09-10T21:14:06.434291+0000","last_became_peered":"2024-09-10T21:14:06.434291+0000","last_unstale":"2024-09-10T21:14:06.438924+0000","last_undegraded":"2024-09-10T21:14:06.438924+0000","last_fullsized":"2024-09-10T21:14:06.438924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:43.895028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.639513+0000","last_change":"2024-09-10T21:13:18.664331+0000","last_active":"2024-09-10T21:15:05.639513+0000","last_peered":"2024-09-10T21:15:05.639513+0000","last_clean":"2024-09-10T21:15:05.639513+0000","last_became_active":"2024-09-10T21:13:18.663823+0000","last_became_peered":"2024-09-10T21:13:18.663823+0000","last_unstale":"2024-09-10T21:15:05.639513+0000","last_undegraded":"2024-09-10T21:15:05.639513+0000","last_fullsized":"2024-09-10T21:15:05.639513+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:37.626712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"75'15","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.633093+0000","last_change":"2024-09-10T21:13:18.659941+0000","last_active":"2024-09-10T21:15:05.633093+0000","last_peered":"2024-09-10T21:15:05.633093+0000","last_clean":"2024-09-10T21:15:05.633093+0000","last_became_active":"2024-09-10T21:13:18.659019+0000","last_became_peered":"2024-09-10T21:13:18.659019+0000","last_unstale":"2024-09-10T21:15:05.633093+0000","last_undegraded":"2024-09-10T21:15:05.633093+0000","last_fullsized":"2024-09-10T21:15:05.633093+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:41:41.037722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"73'5","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309893+0000","last_change":"2024-09-10T21:13:16.633660+0000","last_active":"2024-09-10T21:14:06.309893+0000","last_peered":"2024-09-10T21:14:06.309893+0000","last_clean":"2024-09-10T21:14:06.309893+0000","last_became_active":"2024-09-10T21:13:16.633222+0000","last_became_peered":"2024-09-10T21:13:16.633222+0000","last_unstale":"2024-09-10T21:14:06.309893+0000","last_undegraded":"2024-09-10T21:14:06.309893+0000","last_fullsized":"2024-09-10T21:14:06.309893+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:56.364355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"75'9","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.636617+0000","last_change":"2024-09-10T21:13:18.666837+0000","last_active":"2024-09-10T21:15:05.636617+0000","last_peered":"2024-09-10T21:15:05.636617+0000","last_clean":"2024-09-10T21:15:05.636617+0000","last_became_active":"2024-09-10T21:13:18.666382+0000","last_became_peered":"2024-09-10T21:13:18.666382+0000","last_unstale":"2024-09-10T21:15:05.636617+0000","last_undegraded":"2024-09-10T21:15:05.636617+0000","last_fullsized":"2024-09-10T21:15:05.636617+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:32.225130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"73'12","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.309304+0000","last_change":"2024-09-10T21:13:16.631424+0000","last_active":"2024-09-10T21:14:06.309304+0000","last_peered":"2024-09-10T21:14:06.309304+0000","last_clean":"2024-09-10T21:14:06.309304+0000","last_became_active":"2024-09-10T21:13:16.631116+0000","last_became_peered":"2024-09-10T21:13:16.631116+0000","last_unstale":"2024-09-10T21:14:06.309304+0000","last_undegraded":"2024-09-10T21:14:06.309304+0000","last_fullsized":"2024-09-10T21:14:06.309304+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:38:15.506410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"75'6","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.639550+0000","last_change":"2024-09-10T21:13:18.654978+0000","last_active":"2024-09-10T21:15:05.639550+0000","last_peered":"2024-09-10T21:15:05.639550+0000","last_clean":"2024-09-10T21:15:05.639550+0000","last_became_active":"2024-09-10T21:13:18.654581+0000","last_became_peered":"2024-09-10T21:13:18.654581+0000","last_unstale":"2024-09-10T21:15:05.639550+0000","last_undegraded":"2024-09-10T21:15:05.639550+0000","last_fullsized":"2024-09-10T21:15:05.639550+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:22:17.504626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"73'2","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:14:06.308544+0000","last_change":"2024-09-10T21:13:16.726727+0000","last_active":"2024-09-10T21:14:06.308544+0000","last_peered":"2024-09-10T21:14:06.308544+0000","last_clean":"2024-09-10T21:14:06.308544+0000","last_became_active":"2024-09-10T21:13:16.726373+0000","last_became_peered":"2024-09-10T21:13:16.726373+0000","last_unstale":"2024-09-10T21:14:06.308544+0000","last_undegraded":"2024-09-10T21:14:06.308544+0000","last_fullsized":"2024-09-10T21:14:06.308544+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:10:31.803631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"75'5","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:05.630259+0000","last_change":"2024-09-10T21:13:18.648384+0000","last_active":"2024-09-10T21:15:05.630259+0000","last_peered":"2024-09-10T21:15:05.630259+0000","last_clean":"2024-09-10T21:15:05.630259+0000","last_became_active":"2024-09-10T21:13:18.647911+0000","last_became_peered":"2024-09-10T21:13:18.647911+0000","last_unstale":"2024-09-10T21:15:05.630259+0000","last_undegraded":"2024-09-10T21:15:05.630259+0000","last_fullsized":"2024-09-10T21:15:05.630259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:17.624294+0000","last_clean_scrub_stamp":"2024-09-10T21:13:17.624294+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:02.582548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'14","reported_seq":141,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-10T21:15:12.095279+0000","last_change":"2024-09-10T21:13:16.631501+0000","last_active":"2024-09-10T21:15:12.095279+0000","last_peered":"2024-09-10T21:15:12.095279+0000","last_clean":"2024-09-10T21:15:12.095279+0000","last_became_active":"2024-09-10T21:13:16.631246+0000","last_became_peered":"2024-09-10T21:13:16.631246+0000","last_unstale":"2024-09-10T21:15:12.095279+0000","last_undegraded":"2024-09-10T21:15:12.095279+0000","last_fullsized":"2024-09-10T21:15:12.095279+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T21:13:15.609135+0000","last_clean_scrub_stamp":"2024-09-10T21:13:15.609135+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:51:25.277370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67581,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1054,"num_read_kb":602,"num_write":253,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":202743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":67,"seq":287762808868,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36140,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709012,"statfs":{"total":95995035648,"available":95958028288,"internally_reserved":0,"allocated":815104,"data_stored":393851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":61,"seq":261993005096,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1044891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135918,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":393781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332147,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":394159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528376,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28424,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716728,"statfs":{"total":95995035648,"available":95965929472,"internally_reserved":0,"allocated":1433600,"data_stored":987126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659197,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36148,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709004,"statfs":{"total":95995035648,"available":95958020096,"internally_reserved":0,"allocated":823296,"data_stored":393806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855426,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28436,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716716,"statfs":{"total":95995035648,"available":95965917184,"internally_reserved":0,"allocated":1445888,"data_stored":986496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":393359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":393323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":455482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":455038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":843776,"data_stored":394837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T21:15:16.047 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:15:16.349 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:15:16.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.805+0000 7f2850de0640 1 -- 172.21.15.59:0/3454555494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c1076a0 msgr2=0x7f284c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:16.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.805+0000 7f2850de0640 1 --2- 172.21.15.59:0/3454555494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c1076a0 0x7f284c107ae0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2840009ca0 tx=0x7f284002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:15:16.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.806+0000 7f2850de0640 1 -- 172.21.15.59:0/3454555494 shutdown_connections 2024-09-10T21:15:16.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.806+0000 7f2850de0640 1 --2- 172.21.15.59:0/3454555494 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f284c108020 0x7f284c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:16.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.806+0000 7f2850de0640 1 --2- 172.21.15.59:0/3454555494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c1076a0 0x7f284c107ae0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:16.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.806+0000 7f2850de0640 1 --2- 172.21.15.59:0/3454555494 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f284c101c90 0x7f284c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:16.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.806+0000 7f2850de0640 1 -- 172.21.15.59:0/3454555494 >> 172.21.15.59:0/3454555494 conn(0x7f284c0fd700 msgr2=0x7f284c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:16.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.806+0000 7f2850de0640 1 -- 172.21.15.59:0/3454555494 shutdown_connections 2024-09-10T21:15:16.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.806+0000 7f2850de0640 1 -- 172.21.15.59:0/3454555494 wait complete. 2024-09-10T21:15:16.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.806+0000 7f2850de0640 1 Processor -- start 2024-09-10T21:15:16.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.806+0000 7f2850de0640 1 -- start start 2024-09-10T21:15:16.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.807+0000 7f2850de0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f284c101c90 0x7f284c199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:16.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.807+0000 7f2850de0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c1076a0 0x7f284c1998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:16.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.807+0000 7f2850de0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f284c108020 0x7f284c19ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:16.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.807+0000 7f2850de0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f284c111ce0 con 0x7f284c1076a0 2024-09-10T21:15:16.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.807+0000 7f2850de0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f284c111b60 con 0x7f284c108020 2024-09-10T21:15:16.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.807+0000 7f2850de0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f284c111e60 con 0x7f284c101c90 2024-09-10T21:15:16.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.807+0000 7f2849d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c1076a0 0x7f284c1998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:16.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.807+0000 7f2849d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c1076a0 0x7f284c1998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59450/0 (socket says 172.21.15.59:59450) 2024-09-10T21:15:16.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.807+0000 7f2849d9b640 1 -- 172.21.15.59:0/1611498238 learned_addr learned my addr 172.21.15.59:0/1611498238 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:16.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.807+0000 7f284a59c640 1 --2- 172.21.15.59:0/1611498238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f284c101c90 0x7f284c199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:16.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.807+0000 7f284ad9d640 1 --2- 172.21.15.59:0/1611498238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f284c108020 0x7f284c19ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:16.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.807+0000 7f2849d9b640 1 -- 172.21.15.59:0/1611498238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f284c101c90 msgr2=0x7f284c199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:16.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.807+0000 7f2849d9b640 1 --2- 172.21.15.59:0/1611498238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f284c101c90 0x7f284c199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:16.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.807+0000 7f2849d9b640 1 -- 172.21.15.59:0/1611498238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f284c108020 msgr2=0x7f284c19ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:16.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.807+0000 7f2849d9b640 1 --2- 172.21.15.59:0/1611498238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f284c108020 0x7f284c19ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:16.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.807+0000 7f2849d9b640 1 -- 172.21.15.59:0/1611498238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284c19f410 con 0x7f284c1076a0 2024-09-10T21:15:16.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.807+0000 7f2849d9b640 1 --2- 172.21.15.59:0/1611498238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c1076a0 0x7f284c1998a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2840006010 tx=0x7f28400319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:16.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.808+0000 7f283b7fe640 1 -- 172.21.15.59:0/1611498238 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2840003bf0 con 0x7f284c1076a0 2024-09-10T21:15:16.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.808+0000 7f2850de0640 1 -- 172.21.15.59:0/1611498238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f284c19f6a0 con 0x7f284c1076a0 2024-09-10T21:15:16.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.808+0000 7f283b7fe640 1 -- 172.21.15.59:0/1611498238 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2840003d90 con 0x7f284c1076a0 2024-09-10T21:15:16.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.808+0000 7f283b7fe640 1 -- 172.21.15.59:0/1611498238 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284002fc20 con 0x7f284c1076a0 2024-09-10T21:15:16.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.808+0000 7f2850de0640 1 -- 172.21.15.59:0/1611498238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f284c1a5e40 con 0x7f284c1076a0 2024-09-10T21:15:16.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.809+0000 7f2850de0640 1 -- 172.21.15.59:0/1611498238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f284c102070 con 0x7f284c1076a0 2024-09-10T21:15:16.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.810+0000 7f283b7fe640 1 -- 172.21.15.59:0/1611498238 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f28400046a0 con 0x7f284c1076a0 2024-09-10T21:15:16.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.811+0000 7f283b7fe640 1 --2- 172.21.15.59:0/1611498238 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f28340b52e0 0x7f28340b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:16.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.811+0000 7f284a59c640 1 --2- 172.21.15.59:0/1611498238 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f28340b52e0 0x7f28340b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:16.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.811+0000 7f283b7fe640 1 -- 172.21.15.59:0/1611498238 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2840106fa0 con 0x7f284c1076a0 2024-09-10T21:15:16.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.811+0000 7f284a59c640 1 --2- 172.21.15.59:0/1611498238 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f28340b52e0 0x7f28340b77a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f283c009990 tx=0x7f283c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:16.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:16.814+0000 7f283b7fe640 1 -- 172.21.15.59:0/1611498238 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f28400cdf30 con 0x7f284c1076a0 2024-09-10T21:15:17.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:17.039+0000 7f2850de0640 1 -- 172.21.15.59:0/1611498238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f284c1a6070 con 0x7f284c1076a0 2024-09-10T21:15:17.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:17.040+0000 7f283b7fe640 1 -- 172.21.15.59:0/1611498238 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f28400cd830 con 0x7f284c1076a0 2024-09-10T21:15:17.044 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:15:17.044 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:15:17.045 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:15:17.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:17.042+0000 7f2850de0640 1 -- 172.21.15.59:0/1611498238 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f28340b52e0 msgr2=0x7f28340b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:17.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:17.042+0000 7f2850de0640 1 --2- 172.21.15.59:0/1611498238 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f28340b52e0 0x7f28340b77a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f283c009990 tx=0x7f283c009110 comp rx=0 tx=0).stop 2024-09-10T21:15:17.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:17.042+0000 7f2850de0640 1 -- 172.21.15.59:0/1611498238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c1076a0 msgr2=0x7f284c1998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:17.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:17.042+0000 7f2850de0640 1 --2- 172.21.15.59:0/1611498238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c1076a0 0x7f284c1998a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2840006010 tx=0x7f28400319f0 comp rx=0 tx=0).stop 2024-09-10T21:15:17.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:17.042+0000 7f2850de0640 1 -- 172.21.15.59:0/1611498238 shutdown_connections 2024-09-10T21:15:17.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:17.042+0000 7f2850de0640 1 --2- 172.21.15.59:0/1611498238 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f28340b52e0 0x7f28340b77a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:17.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:17.042+0000 7f2850de0640 1 --2- 172.21.15.59:0/1611498238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f284c108020 0x7f284c19ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:17.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:17.042+0000 7f2850de0640 1 --2- 172.21.15.59:0/1611498238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c1076a0 0x7f284c1998a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:17.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:17.042+0000 7f2850de0640 1 --2- 172.21.15.59:0/1611498238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f284c101c90 0x7f284c199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:17.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:17.042+0000 7f2850de0640 1 -- 172.21.15.59:0/1611498238 >> 172.21.15.59:0/1611498238 conn(0x7f284c0fd700 msgr2=0x7f284c06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:17.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:17.043+0000 7f2850de0640 1 -- 172.21.15.59:0/1611498238 shutdown_connections 2024-09-10T21:15:17.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:17.043+0000 7f2850de0640 1 -- 172.21.15.59:0/1611498238 wait complete. 2024-09-10T21:15:17.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:16 smithi192 ceph-mon[35363]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-10T21:15:17.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:16 smithi192 ceph-mon[35363]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:15:17.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:16 smithi192 ceph-mon[35363]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:15:17.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:16 smithi192 ceph-mon[35363]: from='client.15360 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:15:17.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:16 smithi059 ceph-mon[30888]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-10T21:15:17.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:16 smithi059 ceph-mon[30888]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:15:17.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:16 smithi059 ceph-mon[30888]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:15:17.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:16 smithi059 ceph-mon[30888]: from='client.15360 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:15:17.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:16 smithi154 ceph-mon[35041]: pgmap v340: 97 pgs: 97 active+clean; 643 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-10T21:15:17.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:16 smithi154 ceph-mon[35041]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:15:17.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:16 smithi154 ceph-mon[35041]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:15:17.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:16 smithi154 ceph-mon[35041]: from='client.15360 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T21:15:17.834 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:15:18.103 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:15:18.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:17 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1611498238' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:15:18.229 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:17 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1611498238' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:15:18.336 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:17 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1611498238' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:15:18.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.571+0000 7f9739ecf640 1 -- 172.21.15.59:0/398857500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9734102dc0 msgr2=0x7f97341031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:18.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.571+0000 7f9739ecf640 1 --2- 172.21.15.59:0/398857500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9734102dc0 0x7f97341031a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9724009900 tx=0x7f972402a410 comp rx=0 tx=0).stop 2024-09-10T21:15:18.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.571+0000 7f9739ecf640 1 -- 172.21.15.59:0/398857500 shutdown_connections 2024-09-10T21:15:18.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.571+0000 7f9739ecf640 1 --2- 172.21.15.59:0/398857500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9734109150 0x7f973410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:18.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.571+0000 7f9739ecf640 1 --2- 172.21.15.59:0/398857500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97341087d0 0x7f9734108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:18.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.571+0000 7f9739ecf640 1 --2- 172.21.15.59:0/398857500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9734102dc0 0x7f97341031a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.571+0000 7f9739ecf640 1 -- 172.21.15.59:0/398857500 >> 172.21.15.59:0/398857500 conn(0x7f97340fe830 msgr2=0x7f9734100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.571+0000 7f9739ecf640 1 -- 172.21.15.59:0/398857500 shutdown_connections 2024-09-10T21:15:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.571+0000 7f9739ecf640 1 -- 172.21.15.59:0/398857500 wait complete. 2024-09-10T21:15:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.572+0000 7f9739ecf640 1 Processor -- start 2024-09-10T21:15:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.572+0000 7f9739ecf640 1 -- start start 2024-09-10T21:15:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.572+0000 7f9739ecf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9734102dc0 0x7f9734199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.572+0000 7f9739ecf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97341087d0 0x7f97341998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.572+0000 7f9739ecf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9734109150 0x7f973419ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.572+0000 7f9739ecf640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9734112e10 con 0x7f97341087d0 2024-09-10T21:15:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.572+0000 7f9739ecf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9734112c90 con 0x7f9734102dc0 2024-09-10T21:15:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.572+0000 7f9739ecf640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9734112f90 con 0x7f9734109150 2024-09-10T21:15:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.572+0000 7f9732ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97341087d0 0x7f97341998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:18.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.572+0000 7f9732ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97341087d0 0x7f97341998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59468/0 (socket says 172.21.15.59:59468) 2024-09-10T21:15:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.572+0000 7f9732ffd640 1 -- 172.21.15.59:0/2140950080 learned_addr learned my addr 172.21.15.59:0/2140950080 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.572+0000 7f9733fff640 1 --2- 172.21.15.59:0/2140950080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9734109150 0x7f973419ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.573+0000 7f97337fe640 1 --2- 172.21.15.59:0/2140950080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9734102dc0 0x7f9734199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.573+0000 7f9732ffd640 1 -- 172.21.15.59:0/2140950080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9734109150 msgr2=0x7f973419ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.573+0000 7f9732ffd640 1 --2- 172.21.15.59:0/2140950080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9734109150 0x7f973419ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.573+0000 7f9732ffd640 1 -- 172.21.15.59:0/2140950080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9734102dc0 msgr2=0x7f9734199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.573+0000 7f9732ffd640 1 --2- 172.21.15.59:0/2140950080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9734102dc0 0x7f9734199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.573+0000 7f9732ffd640 1 -- 172.21.15.59:0/2140950080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973419f410 con 0x7f97341087d0 2024-09-10T21:15:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.573+0000 7f9732ffd640 1 --2- 172.21.15.59:0/2140950080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97341087d0 0x7f97341998a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f972800e9f0 tx=0x7f972800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.573+0000 7f9730ff9640 1 -- 172.21.15.59:0/2140950080 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972800cd80 con 0x7f97341087d0 2024-09-10T21:15:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.573+0000 7f9730ff9640 1 -- 172.21.15.59:0/2140950080 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97280108e0 con 0x7f97341087d0 2024-09-10T21:15:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.573+0000 7f9739ecf640 1 -- 172.21.15.59:0/2140950080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f973419f700 con 0x7f97341087d0 2024-09-10T21:15:18.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.573+0000 7f9730ff9640 1 -- 172.21.15.59:0/2140950080 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9728018980 con 0x7f97341087d0 2024-09-10T21:15:18.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.573+0000 7f9739ecf640 1 -- 172.21.15.59:0/2140950080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97341a5dc0 con 0x7f97341087d0 2024-09-10T21:15:18.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.574+0000 7f9739ecf640 1 -- 172.21.15.59:0/2140950080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97341031a0 con 0x7f97341087d0 2024-09-10T21:15:18.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.575+0000 7f9730ff9640 1 -- 172.21.15.59:0/2140950080 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f9728010430 con 0x7f97341087d0 2024-09-10T21:15:18.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.576+0000 7f9730ff9640 1 --2- 172.21.15.59:0/2140950080 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f971c0b52e0 0x7f971c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:18.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.576+0000 7f97337fe640 1 --2- 172.21.15.59:0/2140950080 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f971c0b52e0 0x7f971c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:18.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.576+0000 7f9730ff9640 1 -- 172.21.15.59:0/2140950080 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f97280e6560 con 0x7f97341087d0 2024-09-10T21:15:18.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.577+0000 7f97337fe640 1 --2- 172.21.15.59:0/2140950080 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f971c0b52e0 0x7f971c0b77a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9724006010 tx=0x7f9724000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:18.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.579+0000 7f9730ff9640 1 -- 172.21.15.59:0/2140950080 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f97280ad3f0 con 0x7f97341087d0 2024-09-10T21:15:18.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.769+0000 7f9739ecf640 1 -- 172.21.15.59:0/2140950080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f973402e5c0 con 0x7f97341087d0 2024-09-10T21:15:18.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.770+0000 7f9730ff9640 1 -- 172.21.15.59:0/2140950080 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22633 (secure 0 0 0) 0x7f97280accf0 con 0x7f97341087d0 2024-09-10T21:15:18.776 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:15:18.776 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":75,"fsid":"3c26b952-6fb8-11ef-bcea-c7b262605968","created":"2024-09-10T21:05:18.196881+0000","modified":"2024-09-10T21:14:06.297762+0000","last_up_change":"2024-09-10T21:12:31.909004+0000","last_in_change":"2024-09-10T21:12:08.116727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:08:47.611285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:13:15.562661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:13:17.272280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e88abf3-8592-4b5f-8ba9-5969e01e12d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6803","nonce":1237328951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6805","nonce":1237328951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6809","nonce":1237328951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6807","nonce":1237328951}]},"public_addr":"172.21.15.59:6803/1237328951","cluster_addr":"172.21.15.59:6805/1237328951","heartbeat_back_addr":"172.21.15.59:6809/1237328951","heartbeat_front_addr":"172.21.15.59:6807/1237328951","state":["exists","up"]},{"osd":1,"uuid":"7908eefd-bbfa-4fe4-9db9-7a92d0e77acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6801","nonce":3376412264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6803","nonce":3376412264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6807","nonce":3376412264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6805","nonce":3376412264}]},"public_addr":"172.21.15.154:6801/3376412264","cluster_addr":"172.21.15.154:6803/3376412264","heartbeat_back_addr":"172.21.15.154:6807/3376412264","heartbeat_front_addr":"172.21.15.154:6805/3376412264","state":["exists","up"]},{"osd":2,"uuid":"2351b9f0-bca1-48b2-afb8-0e2b7856c52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6801","nonce":440750253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6803","nonce":440750253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6807","nonce":440750253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6805","nonce":440750253}]},"public_addr":"172.21.15.192:6801/440750253","cluster_addr":"172.21.15.192:6803/440750253","heartbeat_back_addr":"172.21.15.192:6807/440750253","heartbeat_front_addr":"172.21.15.192:6805/440750253","state":["exists","up"]},{"osd":3,"uuid":"f26969d1-7b48-4f20-9077-c55c59775ed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6811","nonce":1483798393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6813","nonce":1483798393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6817","nonce":1483798393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6815","nonce":1483798393}]},"public_addr":"172.21.15.59:6811/1483798393","cluster_addr":"172.21.15.59:6813/1483798393","heartbeat_back_addr":"172.21.15.59:6817/1483798393","heartbeat_front_addr":"172.21.15.59:6815/1483798393","state":["exists","up"]},{"osd":4,"uuid":"21e1a472-1ae1-454b-aee5-2ad92f6eff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6809","nonce":1817188525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6811","nonce":1817188525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6815","nonce":1817188525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6813","nonce":1817188525}]},"public_addr":"172.21.15.154:6809/1817188525","cluster_addr":"172.21.15.154:6811/1817188525","heartbeat_back_addr":"172.21.15.154:6815/1817188525","heartbeat_front_addr":"172.21.15.154:6813/1817188525","state":["exists","up"]},{"osd":5,"uuid":"6191b10a-5cbd-4225-b0ec-70d05023d5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6809","nonce":1221386274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6811","nonce":1221386274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6815","nonce":1221386274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6813","nonce":1221386274}]},"public_addr":"172.21.15.192:6809/1221386274","cluster_addr":"172.21.15.192:6811/1221386274","heartbeat_back_addr":"172.21.15.192:6815/1221386274","heartbeat_front_addr":"172.21.15.192:6813/1221386274","state":["exists","up"]},{"osd":6,"uuid":"609c11f7-ce82-4714-bf73-a4f16f4483ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6819","nonce":3006857566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6821","nonce":3006857566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6825","nonce":3006857566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6823","nonce":3006857566}]},"public_addr":"172.21.15.59:6819/3006857566","cluster_addr":"172.21.15.59:6821/3006857566","heartbeat_back_addr":"172.21.15.59:6825/3006857566","heartbeat_front_addr":"172.21.15.59:6823/3006857566","state":["exists","up"]},{"osd":7,"uuid":"bff3a29f-47cc-4e66-92e4-14e9b7faf498","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6817","nonce":175260385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6819","nonce":175260385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6823","nonce":175260385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6821","nonce":175260385}]},"public_addr":"172.21.15.154:6817/175260385","cluster_addr":"172.21.15.154:6819/175260385","heartbeat_back_addr":"172.21.15.154:6823/175260385","heartbeat_front_addr":"172.21.15.154:6821/175260385","state":["exists","up"]},{"osd":8,"uuid":"56dabafd-9bb9-409a-88cd-4b5b5ecf810a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6817","nonce":3138189462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6819","nonce":3138189462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6823","nonce":3138189462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6821","nonce":3138189462}]},"public_addr":"172.21.15.192:6817/3138189462","cluster_addr":"172.21.15.192:6819/3138189462","heartbeat_back_addr":"172.21.15.192:6823/3138189462","heartbeat_front_addr":"172.21.15.192:6821/3138189462","state":["exists","up"]},{"osd":9,"uuid":"044f934d-3df5-47aa-85f5-c3b63b267ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6827","nonce":2446500753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6829","nonce":2446500753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6833","nonce":2446500753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6831","nonce":2446500753}]},"public_addr":"172.21.15.59:6827/2446500753","cluster_addr":"172.21.15.59:6829/2446500753","heartbeat_back_addr":"172.21.15.59:6833/2446500753","heartbeat_front_addr":"172.21.15.59:6831/2446500753","state":["exists","up"]},{"osd":10,"uuid":"8d3b735b-e4fe-4a8e-8c75-a49313c6fabb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6825","nonce":1139781446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6827","nonce":1139781446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6831","nonce":1139781446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6829","nonce":1139781446}]},"public_addr":"172.21.15.154:6825/1139781446","cluster_addr":"172.21.15.154:6827/1139781446","heartbeat_back_addr":"172.21.15.154:6831/1139781446","heartbeat_front_addr":"172.21.15.154:6829/1139781446","state":["exists","up"]},{"osd":11,"uuid":"fd6a6d06-c6aa-42e3-aa38-fc583319f6bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6825","nonce":1041494458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6827","nonce":1041494458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6831","nonce":1041494458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6829","nonce":1041494458}]},"public_addr":"172.21.15.192:6825/1041494458","cluster_addr":"172.21.15.192:6827/1041494458","heartbeat_back_addr":"172.21.15.192:6831/1041494458","heartbeat_front_addr":"172.21.15.192:6829/1041494458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:07:53.974382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:19.552358+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:44.251670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:09.430992+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:34.043343+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:59.903679+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:25.733171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:49.795257+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:14.485648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:40.485165+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:04.655475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:29.308456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/212243638":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/3305207692":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6801/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/2965147556":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/1174570395":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/2934865748":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:6801/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/3377179776":"2024-09-11T21:05:40.304807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:15:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.773+0000 7f9739ecf640 1 -- 172.21.15.59:0/2140950080 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f971c0b52e0 msgr2=0x7f971c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.773+0000 7f9739ecf640 1 --2- 172.21.15.59:0/2140950080 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f971c0b52e0 0x7f971c0b77a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9724006010 tx=0x7f9724000bc0 comp rx=0 tx=0).stop 2024-09-10T21:15:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.773+0000 7f9739ecf640 1 -- 172.21.15.59:0/2140950080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97341087d0 msgr2=0x7f97341998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.773+0000 7f9739ecf640 1 --2- 172.21.15.59:0/2140950080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97341087d0 0x7f97341998a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f972800e9f0 tx=0x7f972800eeb0 comp rx=0 tx=0).stop 2024-09-10T21:15:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.773+0000 7f9739ecf640 1 -- 172.21.15.59:0/2140950080 shutdown_connections 2024-09-10T21:15:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.773+0000 7f9739ecf640 1 --2- 172.21.15.59:0/2140950080 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f971c0b52e0 0x7f971c0b77a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.773+0000 7f9739ecf640 1 --2- 172.21.15.59:0/2140950080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9734109150 0x7f973419ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.773+0000 7f9739ecf640 1 --2- 172.21.15.59:0/2140950080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97341087d0 0x7f97341998a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:18.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.773+0000 7f9739ecf640 1 --2- 172.21.15.59:0/2140950080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9734102dc0 0x7f9734199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:18.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.773+0000 7f9739ecf640 1 -- 172.21.15.59:0/2140950080 >> 172.21.15.59:0/2140950080 conn(0x7f97340fe830 msgr2=0x7f9734100140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:18.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.773+0000 7f9739ecf640 1 -- 172.21.15.59:0/2140950080 shutdown_connections 2024-09-10T21:15:18.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:18.773+0000 7f9739ecf640 1 -- 172.21.15.59:0/2140950080 wait complete. 2024-09-10T21:15:19.121 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:18 smithi059 ceph-mon[30888]: pgmap v341: 97 pgs: 97 active+clean; 648 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-10T21:15:19.122 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:18 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2140950080' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:15:19.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:18 smithi192 ceph-mon[35363]: pgmap v341: 97 pgs: 97 active+clean; 648 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-10T21:15:19.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:18 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2140950080' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:15:19.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:18 smithi154 ceph-mon[35041]: pgmap v341: 97 pgs: 97 active+clean; 648 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-10T21:15:19.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:18 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2140950080' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:15:19.524 DEBUG:tasks.fwd_scrub:Yielding 2024-09-10T21:15:19.524 INFO:teuthology.run_tasks:Running task workunit... 2024-09-10T21:15:19.538 INFO:tasks.workunit:Pulling workunits from ref 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:15:19.538 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T21:15:19.539 INFO:tasks.workunit:timeout=3h 2024-09-10T21:15:19.539 INFO:tasks.workunit:cleanup=True 2024-09-10T21:15:19.539 DEBUG:teuthology.orchestra.run.smithi059:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T21:15:19.539 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-10T21:15:19.539 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:15:19.540 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:15:19.558 INFO:teuthology.orchestra.run.smithi059.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-10T21:15:19.559 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-10T21:15:19.559 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-10T21:15:19.559 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T21:15:19.559 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-10T21:15:19.559 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-10 21:13:37.324901573 +0000 2024-09-10T21:15:19.559 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-10 21:13:37.324901573 +0000 2024-09-10T21:15:19.559 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-10 21:15:10.691407018 +0000 2024-09-10T21:15:19.559 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-09-10 21:13:37.324901573 +0000 2024-09-10T21:15:19.559 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-10T21:15:19.559 DEBUG:teuthology.orchestra.run.smithi059:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-10T21:15:19.634 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:15:19.691 INFO:tasks.workunit.client.0.smithi059.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T21:15:19.807 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:15:20.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.326+0000 7f0bbb544640 1 -- 172.21.15.59:0/1335585220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb4075540 msgr2=0x7f0bb4075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:20.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.326+0000 7f0bbb544640 1 --2- 172.21.15.59:0/1335585220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb4075540 0x7f0bb4075920 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009900 tx=0x7f0bb002a410 comp rx=0 tx=0).stop 2024-09-10T21:15:20.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.326+0000 7f0bbb544640 1 -- 172.21.15.59:0/1335585220 shutdown_connections 2024-09-10T21:15:20.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.326+0000 7f0bbb544640 1 --2- 172.21.15.59:0/1335585220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bb4113b20 0x7f0bb4115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.326+0000 7f0bbb544640 1 --2- 172.21.15.59:0/1335585220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bb4075e60 0x7f0bb41135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.326+0000 7f0bbb544640 1 --2- 172.21.15.59:0/1335585220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb4075540 0x7f0bb4075920 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.326+0000 7f0bbb544640 1 -- 172.21.15.59:0/1335585220 >> 172.21.15.59:0/1335585220 conn(0x7f0bb40fe830 msgr2=0x7f0bb4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:20.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.327+0000 7f0bbb544640 1 -- 172.21.15.59:0/1335585220 shutdown_connections 2024-09-10T21:15:20.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.327+0000 7f0bbb544640 1 -- 172.21.15.59:0/1335585220 wait complete. 2024-09-10T21:15:20.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.327+0000 7f0bbb544640 1 Processor -- start 2024-09-10T21:15:20.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.327+0000 7f0bbb544640 1 -- start start 2024-09-10T21:15:20.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.327+0000 7f0bbb544640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb4075540 0x7f0bb419f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:20.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.327+0000 7f0bbb544640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bb4075e60 0x7f0bb419fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:20.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.327+0000 7f0bbb544640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bb4113b20 0x7f0bb41a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:20.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.327+0000 7f0bbb544640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb4119390 con 0x7f0bb4075540 2024-09-10T21:15:20.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.327+0000 7f0bbb544640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb4119210 con 0x7f0bb4075e60 2024-09-10T21:15:20.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.327+0000 7f0bbb544640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb4119510 con 0x7f0bb4113b20 2024-09-10T21:15:20.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.328+0000 7f0bb92e0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb4075540 0x7f0bb419f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:20.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.328+0000 7f0bb92e0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb4075540 0x7f0bb419f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46660/0 (socket says 172.21.15.59:46660) 2024-09-10T21:15:20.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.328+0000 7f0bb92e0640 1 -- 172.21.15.59:0/2025919771 learned_addr learned my addr 172.21.15.59:0/2025919771 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:20.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.328+0000 7f0bb8adf640 1 --2- 172.21.15.59:0/2025919771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bb4075e60 0x7f0bb419fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:20.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.328+0000 7f0bb9ae1640 1 --2- 172.21.15.59:0/2025919771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bb4113b20 0x7f0bb41a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:20.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.328+0000 7f0bb92e0640 1 -- 172.21.15.59:0/2025919771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bb4113b20 msgr2=0x7f0bb41a51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:20.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.328+0000 7f0bb92e0640 1 --2- 172.21.15.59:0/2025919771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bb4113b20 0x7f0bb41a51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.328+0000 7f0bb92e0640 1 -- 172.21.15.59:0/2025919771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bb4075e60 msgr2=0x7f0bb419fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:20.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.328+0000 7f0bb92e0640 1 --2- 172.21.15.59:0/2025919771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bb4075e60 0x7f0bb419fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.328+0000 7f0bb92e0640 1 -- 172.21.15.59:0/2025919771 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb41a5990 con 0x7f0bb4075540 2024-09-10T21:15:20.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.328+0000 7f0bb92e0640 1 --2- 172.21.15.59:0/2025919771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb4075540 0x7f0bb419f8e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0005940 tx=0x7f0bb00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:20.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.328+0000 7f0baa7fc640 1 -- 172.21.15.59:0/2025919771 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb003f030 con 0x7f0bb4075540 2024-09-10T21:15:20.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.328+0000 7f0bbb544640 1 -- 172.21.15.59:0/2025919771 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb41a5c20 con 0x7f0bb4075540 2024-09-10T21:15:20.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.328+0000 7f0baa7fc640 1 -- 172.21.15.59:0/2025919771 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bb0003cb0 con 0x7f0bb4075540 2024-09-10T21:15:20.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.328+0000 7f0baa7fc640 1 -- 172.21.15.59:0/2025919771 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0035070 con 0x7f0bb4075540 2024-09-10T21:15:20.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.328+0000 7f0bbb544640 1 -- 172.21.15.59:0/2025919771 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb41ac340 con 0x7f0bb4075540 2024-09-10T21:15:20.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.331+0000 7f0bbd919740 1 Processor -- start 2024-09-10T21:15:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.331+0000 7f0baa7fc640 1 -- 172.21.15.59:0/2025919771 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f0bb003bbf0 con 0x7f0bb4075540 2024-09-10T21:15:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.331+0000 7f0bbd919740 1 -- start start 2024-09-10T21:15:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.331+0000 7f0bbd919740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a45ee0 0x55b1f7a462c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.331+0000 7f0bbd919740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a46800 0x55b1f7a52250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.331+0000 7f0bbd919740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a52790 0x55b1f7a54b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.331+0000 7f0bbd919740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b1f79bce60 con 0x55b1f7a45ee0 2024-09-10T21:15:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.331+0000 7f0bbd919740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b1f79ac290 con 0x55b1f7a52790 2024-09-10T21:15:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.331+0000 7f0bbd919740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b1f79b00a0 con 0x55b1f7a46800 2024-09-10T21:15:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.332+0000 7f0bb9ae1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a45ee0 0x55b1f7a462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.332+0000 7f0bb9ae1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a45ee0 0x55b1f7a462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46672/0 (socket says 172.21.15.59:46672) 2024-09-10T21:15:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.332+0000 7f0bb9ae1640 1 -- 172.21.15.59:0/4048037885 learned_addr learned my addr 172.21.15.59:0/4048037885 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:20.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.332+0000 7f0bb92e0640 1 --2- 172.21.15.59:0/4048037885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a46800 0x55b1f7a52250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:20.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.332+0000 7f0bb8adf640 1 --2- 172.21.15.59:0/4048037885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a52790 0x55b1f7a54b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:20.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.332+0000 7f0bb9ae1640 1 -- 172.21.15.59:0/4048037885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a46800 msgr2=0x55b1f7a52250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:20.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.332+0000 7f0bb9ae1640 1 --2- 172.21.15.59:0/4048037885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a46800 0x55b1f7a52250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.332+0000 7f0bb9ae1640 1 -- 172.21.15.59:0/4048037885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a52790 msgr2=0x55b1f7a54b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:20.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.332+0000 7f0bb9ae1640 1 --2- 172.21.15.59:0/4048037885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a52790 0x55b1f7a54b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.332+0000 7f0bb9ae1640 1 -- 172.21.15.59:0/4048037885 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1f770a930 con 0x55b1f7a45ee0 2024-09-10T21:15:20.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.332+0000 7f0baa7fc640 1 --2- 172.21.15.59:0/2025919771 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0ba00b52e0 0x7f0ba00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:20.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.332+0000 7f0bb9ae1640 1 --2- 172.21.15.59:0/4048037885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a45ee0 0x55b1f7a462c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0bac0103a0 tx=0x7f0bac010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc63251670b966f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:20.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.332+0000 7f0bb92e0640 1 --2- 172.21.15.59:0/2025919771 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0ba00b52e0 0x7f0ba00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:20.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.332+0000 7f0b9f7fe640 1 -- 172.21.15.59:0/4048037885 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac016070 con 0x55b1f7a45ee0 2024-09-10T21:15:20.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.333+0000 7f0baa7fc640 1 -- 172.21.15.59:0/2025919771 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0bb01066b0 con 0x7f0bb4075540 2024-09-10T21:15:20.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.333+0000 7f0b9f7fe640 1 -- 172.21.15.59:0/4048037885 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bac004d20 con 0x55b1f7a45ee0 2024-09-10T21:15:20.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.333+0000 7f0b9f7fe640 1 -- 172.21.15.59:0/4048037885 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac005420 con 0x55b1f7a45ee0 2024-09-10T21:15:20.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.333+0000 7f0bbd919740 1 -- 172.21.15.59:0/4048037885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a45ee0 msgr2=0x55b1f7a462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:20.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.333+0000 7f0bb92e0640 1 --2- 172.21.15.59:0/2025919771 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0ba00b52e0 0x7f0ba00b77a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0104550 tx=0x7f0bb00b4040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:20.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.333+0000 7f0bbd919740 1 --2- 172.21.15.59:0/4048037885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a45ee0 0x55b1f7a462c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0bac0103a0 tx=0x7f0bac010860 comp rx=0 tx=0).stop 2024-09-10T21:15:20.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.333+0000 7f0bbd919740 1 -- 172.21.15.59:0/4048037885 shutdown_connections 2024-09-10T21:15:20.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.333+0000 7f0bbd919740 1 --2- 172.21.15.59:0/4048037885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a52790 0x55b1f7a54b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.333+0000 7f0bbd919740 1 --2- 172.21.15.59:0/4048037885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a46800 0x55b1f7a52250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.333+0000 7f0bbd919740 1 --2- 172.21.15.59:0/4048037885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a45ee0 0x55b1f7a462c0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.333+0000 7f0bbd919740 1 -- 172.21.15.59:0/4048037885 >> 172.21.15.59:0/4048037885 conn(0x55b1f7a43d10 msgr2=0x55b1f7a44eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.333+0000 7f0bbd919740 1 -- 172.21.15.59:0/4048037885 shutdown_connections 2024-09-10T21:15:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.333+0000 7f0bbd919740 1 -- 172.21.15.59:0/4048037885 wait complete. 2024-09-10T21:15:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.334+0000 7f0bbd919740 1 -- start start 2024-09-10T21:15:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.334+0000 7f0bbd919740 1 Processor -- start 2024-09-10T21:15:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.334+0000 7f0bbd919740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a45ee0 0x55b1f7a4f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.334+0000 7f0bbd919740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a46800 0x55b1f7a4fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.334+0000 7f0bbd919740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a52790 0x55b1f7a50200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:20.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.334+0000 7f0bbd919740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b1f780d890 con 0x55b1f7a52790 2024-09-10T21:15:20.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.334+0000 7f0bbd919740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b1f7946d40 con 0x55b1f7a45ee0 2024-09-10T21:15:20.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.334+0000 7f0bbd919740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b1f7a55440 con 0x55b1f7a46800 2024-09-10T21:15:20.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.334+0000 7f0bbd919740 10 client.0 _ll_register_callbacks cb 0x55b1f79aac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:15:20.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.334+0000 7f0bb9ae1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a52790 0x55b1f7a50200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:20.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.334+0000 7f0bb9ae1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a52790 0x55b1f7a50200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46676/0 (socket says 172.21.15.59:46676) 2024-09-10T21:15:20.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.335+0000 7f0bb9ae1640 1 -- 172.21.15.59:0/2284683400 learned_addr learned my addr 172.21.15.59:0/2284683400 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:20.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.335+0000 7f0bb9ae1640 1 --2- 172.21.15.59:0/2284683400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a45ee0 0x55b1f7a4f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:20.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.335+0000 7f0bb8adf640 1 --2- 172.21.15.59:0/2284683400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a46800 0x55b1f7a4fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:20.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.335+0000 7f0bb9ae1640 1 -- 172.21.15.59:0/2284683400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a46800 msgr2=0x55b1f7a4fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:20.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.335+0000 7f0bb9ae1640 1 --2- 172.21.15.59:0/2284683400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a46800 0x55b1f7a4fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.335+0000 7f0bb9ae1640 1 -- 172.21.15.59:0/2284683400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a45ee0 msgr2=0x55b1f7a4f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:20.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.335+0000 7f0bb9ae1640 1 --2- 172.21.15.59:0/2284683400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a45ee0 0x55b1f7a4f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.335+0000 7f0bb9ae1640 1 -- 172.21.15.59:0/2284683400 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1f7a5e870 con 0x55b1f7a52790 2024-09-10T21:15:20.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.335+0000 7f0bb9ae1640 1 --2- 172.21.15.59:0/2284683400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a52790 0x55b1f7a50200 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0bac005560 tx=0x7f0bac013fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c533ed1f935d0460 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:20.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.335+0000 7f0b9cff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:15:20.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.335+0000 7f0b9cff9640 1 -- 172.21.15.59:0/2284683400 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac016070 con 0x55b1f7a52790 2024-09-10T21:15:20.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.335+0000 7f0bbd919740 1 -- 172.21.15.59:0/2284683400 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bac004d20 con 0x55b1f7a52790 2024-09-10T21:15:20.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.335+0000 7f0b9cff9640 1 -- 172.21.15.59:0/2284683400 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0bac0057c0 con 0x55b1f7a52790 2024-09-10T21:15:20.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.335+0000 7f0b9cff9640 1 -- 172.21.15.59:0/2284683400 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0bac023040 con 0x55b1f7a52790 2024-09-10T21:15:20.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.335+0000 7f0bbd919740 10 client.15384 fetch_fsmap learned FSMap version 28 2024-09-10T21:15:20.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.335+0000 7f0bbd919740 1 -- 172.21.15.59:0/2284683400 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b1f7a61220 con 0x55b1f7a52790 2024-09-10T21:15:20.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.336+0000 7f0b9cff9640 1 -- 172.21.15.59:0/2284683400 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bac004d20 con 0x55b1f7a52790 2024-09-10T21:15:20.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.336+0000 7f0b9cff9640 1 -- 172.21.15.59:0/2284683400 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0bac00f040 con 0x55b1f7a52790 2024-09-10T21:15:20.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.336+0000 7f0bbd919740 10 client.15384 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:15:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.336+0000 7f0bbd919740 10 client.15384 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:15:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.336+0000 7f0bbd919740 20 client.15384 populate_metadata read hostname 'smithi059' 2024-09-10T21:15:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.336+0000 7f0bbd919740 1 --2- 172.21.15.59:0/2284683400 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b1f7a62630 0x55b1f7a64a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.336+0000 7f0bbd919740 4 client.15384 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:15:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.336+0000 7f0bbd919740 1 -- 172.21.15.59:0/2284683400 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1f79bedb0 con 0x55b1f7a62630 2024-09-10T21:15:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.336+0000 7f0bb8adf640 1 --2- 172.21.15.59:0/2284683400 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b1f7a62630 0x55b1f7a64a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.337+0000 7f0b9cff9640 10 client.15384 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:15:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.337+0000 7f0bb8adf640 1 --2- 172.21.15.59:0/2284683400 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b1f7a62630 0x55b1f7a64a20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84415cb82d594864 server_cookie=6598e4c21b431689 in_seq=0 out_seq=0 2024-09-10T21:15:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.337+0000 7f0b9cff9640 1 -- 172.21.15.59:0/2284683400 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b1f79bedb0 con 0x55b1f7a62630 2024-09-10T21:15:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.337+0000 7f0b9cff9640 10 client.15384 handle_command_reply: tid=0 2024-09-10T21:15:20.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.337+0000 7f0bbd919740 1 client.15384 shutdown 2024-09-10T21:15:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.338+0000 7f0bbd919740 1 -- 172.21.15.59:0/2284683400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a52790 msgr2=0x55b1f7a50200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.338+0000 7f0bbd919740 1 --2- 172.21.15.59:0/2284683400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a52790 0x55b1f7a50200 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0bac005560 tx=0x7f0bac013fc0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.338+0000 7f0bbd919740 1 -- 172.21.15.59:0/2284683400 shutdown_connections 2024-09-10T21:15:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.338+0000 7f0bbd919740 1 --2- 172.21.15.59:0/2284683400 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b1f7a62630 0x55b1f7a64a20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.338+0000 7f0bbd919740 1 --2- 172.21.15.59:0/2284683400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a52790 0x55b1f7a50200 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.338+0000 7f0bbd919740 1 --2- 172.21.15.59:0/2284683400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a46800 0x55b1f7a4fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.338+0000 7f0bbd919740 1 --2- 172.21.15.59:0/2284683400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a45ee0 0x55b1f7a4f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.338+0000 7f0bbd919740 1 -- 172.21.15.59:0/2284683400 >> 172.21.15.59:0/2284683400 conn(0x55b1f7a43d10 msgr2=0x55b1f7a42f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.338+0000 7f0b9cff9640 0 client.15384 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:15:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.338+0000 7f0bbd919740 1 -- 172.21.15.59:0/2284683400 shutdown_connections 2024-09-10T21:15:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.338+0000 7f0bbd919740 1 -- 172.21.15.59:0/2284683400 wait complete. 2024-09-10T21:15:20.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.338+0000 7f0bbd919740 20 client.15384 trim_cache size 0 max 16384 2024-09-10T21:15:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.356+0000 7f0bbd919740 1 Processor -- start 2024-09-10T21:15:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.356+0000 7f0bbd919740 1 -- start start 2024-09-10T21:15:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.356+0000 7f0bbd919740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a45ee0 0x55b1f7a4a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.356+0000 7f0bbd919740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a46800 0x55b1f7a4fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.356+0000 7f0bbd919740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a52790 0x55b1f7a4c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.356+0000 7f0bbd919740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb41b4910 con 0x55b1f7a52790 2024-09-10T21:15:20.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.356+0000 7f0bbd919740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb41b6450 con 0x55b1f7a45ee0 2024-09-10T21:15:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.356+0000 7f0bbd919740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb41b4fe0 con 0x55b1f7a46800 2024-09-10T21:15:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.356+0000 7f0bb9ae1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a52790 0x55b1f7a4c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.356+0000 7f0bb9ae1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a52790 0x55b1f7a4c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46684/0 (socket says 172.21.15.59:46684) 2024-09-10T21:15:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.356+0000 7f0bb9ae1640 1 -- 172.21.15.59:0/1977189610 learned_addr learned my addr 172.21.15.59:0/1977189610 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.356+0000 7f0bb9ae1640 1 -- 172.21.15.59:0/1977189610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a46800 msgr2=0x55b1f7a4fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.356+0000 7f0bb8adf640 1 --2- 172.21.15.59:0/1977189610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a46800 0x55b1f7a4fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.356+0000 7f0bb9ae1640 1 --2- 172.21.15.59:0/1977189610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a46800 0x55b1f7a4fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.356+0000 7f0bb9ae1640 1 -- 172.21.15.59:0/1977189610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a45ee0 msgr2=0x55b1f7a4a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.356+0000 7f0bb9ae1640 1 --2- 172.21.15.59:0/1977189610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a45ee0 0x55b1f7a4a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.356+0000 7f0bb9ae1640 1 -- 172.21.15.59:0/1977189610 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1f7a43b40 con 0x55b1f7a52790 2024-09-10T21:15:20.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.356+0000 7f0bb8adf640 1 --2- 172.21.15.59:0/1977189610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a46800 0x55b1f7a4fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:15:20.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.357+0000 7f0bb9ae1640 1 --2- 172.21.15.59:0/1977189610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a52790 0x55b1f7a4c990 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009a80 tx=0x7f0bac010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b44e3ec829678 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:20.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.357+0000 7f0b9effd640 1 -- 172.21.15.59:0/1977189610 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac039020 con 0x55b1f7a52790 2024-09-10T21:15:20.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.357+0000 7f0b9effd640 1 -- 172.21.15.59:0/1977189610 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bac010d60 con 0x55b1f7a52790 2024-09-10T21:15:20.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.357+0000 7f0b9effd640 1 -- 172.21.15.59:0/1977189610 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac016040 con 0x55b1f7a52790 2024-09-10T21:15:20.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.357+0000 7f0bbd919740 1 -- 172.21.15.59:0/1977189610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a52790 msgr2=0x55b1f7a4c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:20.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.357+0000 7f0bbd919740 1 --2- 172.21.15.59:0/1977189610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a52790 0x55b1f7a4c990 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009a80 tx=0x7f0bac010860 comp rx=0 tx=0).stop 2024-09-10T21:15:20.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.357+0000 7f0bbd919740 1 -- 172.21.15.59:0/1977189610 shutdown_connections 2024-09-10T21:15:20.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.357+0000 7f0bbd919740 1 --2- 172.21.15.59:0/1977189610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a52790 0x55b1f7a4c990 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.357+0000 7f0bbd919740 1 --2- 172.21.15.59:0/1977189610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a46800 0x55b1f7a4fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.357+0000 7f0bbd919740 1 --2- 172.21.15.59:0/1977189610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a45ee0 0x55b1f7a4a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.357+0000 7f0bbd919740 1 -- 172.21.15.59:0/1977189610 >> 172.21.15.59:0/1977189610 conn(0x55b1f7a43d10 msgr2=0x55b1f7a4f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.357+0000 7f0bbd919740 1 -- 172.21.15.59:0/1977189610 shutdown_connections 2024-09-10T21:15:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.358+0000 7f0bbd919740 1 -- 172.21.15.59:0/1977189610 wait complete. 2024-09-10T21:15:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.358+0000 7f0bbd919740 1 -- start start 2024-09-10T21:15:20.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.358+0000 7f0bbd919740 1 Processor -- start 2024-09-10T21:15:20.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.358+0000 7f0bbd919740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a45ee0 0x55b1f7a5b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:20.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.358+0000 7f0bbd919740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a46800 0x55b1f7a56540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:20.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.358+0000 7f0bbd919740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a52790 0x55b1f7a56cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:20.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.358+0000 7f0bbd919740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb41b5d80 con 0x55b1f7a46800 2024-09-10T21:15:20.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.358+0000 7f0bbd919740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb41b56b0 con 0x55b1f7a45ee0 2024-09-10T21:15:20.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.358+0000 7f0bbd919740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb41b28f0 con 0x55b1f7a52790 2024-09-10T21:15:20.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.359+0000 7f0bbd919740 10 client.0 _ll_register_callbacks cb 0x7f0ba400b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:15:20.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.359+0000 7f0bb8adf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a46800 0x55b1f7a56540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:20.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.359+0000 7f0bb8adf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a46800 0x55b1f7a56540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46690/0 (socket says 172.21.15.59:46690) 2024-09-10T21:15:20.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.359+0000 7f0bb8adf640 1 -- 172.21.15.59:0/2084438385 learned_addr learned my addr 172.21.15.59:0/2084438385 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:20.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.359+0000 7f0bb9ae1640 1 --2- 172.21.15.59:0/2084438385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a52790 0x55b1f7a56cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:20.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.359+0000 7f0bb9ae1640 1 --2- 172.21.15.59:0/2084438385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a45ee0 0x55b1f7a5b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:20.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.359+0000 7f0bb8adf640 1 -- 172.21.15.59:0/2084438385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a52790 msgr2=0x55b1f7a56cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:20.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.359+0000 7f0bb8adf640 1 --2- 172.21.15.59:0/2084438385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a52790 0x55b1f7a56cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.359+0000 7f0bb8adf640 1 -- 172.21.15.59:0/2084438385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a45ee0 msgr2=0x55b1f7a5b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:20.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.359+0000 7f0bb8adf640 1 --2- 172.21.15.59:0/2084438385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a45ee0 0x55b1f7a5b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.359+0000 7f0bb8adf640 1 -- 172.21.15.59:0/2084438385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1f7ace3b0 con 0x55b1f7a46800 2024-09-10T21:15:20.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.359+0000 7f0bb9ae1640 1 --2- 172.21.15.59:0/2084438385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a45ee0 0x55b1f7a5b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:15:20.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.359+0000 7f0bb8adf640 1 --2- 172.21.15.59:0/2084438385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a46800 0x55b1f7a56540 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0ba400b740 tx=0x7f0ba400bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9eab18356c1534 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:20.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.359+0000 7f0b9cff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:15:20.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.359+0000 7f0b9cff9640 1 -- 172.21.15.59:0/2084438385 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4003d30 con 0x55b1f7a46800 2024-09-10T21:15:20.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.359+0000 7f0b9cff9640 1 -- 172.21.15.59:0/2084438385 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f0ba4005020 con 0x55b1f7a46800 2024-09-10T21:15:20.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.359+0000 7f0bbd919740 1 -- 172.21.15.59:0/2084438385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bac010d60 con 0x55b1f7a46800 2024-09-10T21:15:20.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.360+0000 7f0b9cff9640 1 -- 172.21.15.59:0/2084438385 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0ba4005220 con 0x55b1f7a46800 2024-09-10T21:15:20.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.360+0000 7f0bbd919740 10 client.15390 fetch_fsmap learned FSMap version 28 2024-09-10T21:15:20.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.360+0000 7f0bbd919740 1 -- 172.21.15.59:0/2084438385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b1f7acf610 con 0x55b1f7a46800 2024-09-10T21:15:20.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.360+0000 7f0b9cff9640 1 -- 172.21.15.59:0/2084438385 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bac010d60 con 0x55b1f7a46800 2024-09-10T21:15:20.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.360+0000 7f0b9cff9640 1 -- 172.21.15.59:0/2084438385 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0ba4024470 con 0x55b1f7a46800 2024-09-10T21:15:20.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.360+0000 7f0bbd919740 10 client.15390 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:15:20.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.360+0000 7f0bbd919740 10 client.15390 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:15:20.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.360+0000 7f0bbd919740 20 client.15390 populate_metadata read hostname 'smithi059' 2024-09-10T21:15:20.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.360+0000 7f0bbd919740 1 --2- 172.21.15.59:0/2084438385 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b1f7acfdc0 0x55b1f7ad21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:20.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.360+0000 7f0bbd919740 4 client.15390 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:15:20.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.360+0000 7f0bbd919740 1 -- 172.21.15.59:0/2084438385 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b1f79ba860 con 0x55b1f7acfdc0 2024-09-10T21:15:20.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.360+0000 7f0bb9ae1640 1 --2- 172.21.15.59:0/2084438385 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b1f7acfdc0 0x55b1f7ad21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:20.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.361+0000 7f0bb9ae1640 1 --2- 172.21.15.59:0/2084438385 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b1f7acfdc0 0x55b1f7ad21e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52ee78a480ac68b7 server_cookie=9d89e5e81a84dbd9 in_seq=0 out_seq=0 2024-09-10T21:15:20.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.361+0000 7f0b9cff9640 10 client.15390 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:15:20.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.363+0000 7f0b9cff9640 1 -- 172.21.15.59:0/2084438385 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b1f79ba860 con 0x55b1f7acfdc0 2024-09-10T21:15:20.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.363+0000 7f0b9cff9640 10 client.15390 handle_command_reply: tid=0 2024-09-10T21:15:20.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.363+0000 7f0bbd919740 1 client.15390 shutdown 2024-09-10T21:15:20.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.363+0000 7f0bbd919740 1 -- 172.21.15.59:0/2084438385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a46800 msgr2=0x55b1f7a56540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:20.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.363+0000 7f0bbd919740 1 --2- 172.21.15.59:0/2084438385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a46800 0x55b1f7a56540 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0ba400b740 tx=0x7f0ba400bcc0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.363+0000 7f0bbd919740 1 -- 172.21.15.59:0/2084438385 shutdown_connections 2024-09-10T21:15:20.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.363+0000 7f0bbd919740 1 --2- 172.21.15.59:0/2084438385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b1f7a52790 0x55b1f7a56cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.363+0000 7f0bbd919740 1 --2- 172.21.15.59:0/2084438385 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b1f7acfdc0 0x55b1f7ad21e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.363+0000 7f0bbd919740 1 --2- 172.21.15.59:0/2084438385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f7a46800 0x55b1f7a56540 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.363+0000 7f0b9cff9640 0 client.15390 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:15:20.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.363+0000 7f0bbd919740 1 --2- 172.21.15.59:0/2084438385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b1f7a45ee0 0x55b1f7a5b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.363+0000 7f0bbd919740 1 -- 172.21.15.59:0/2084438385 >> 172.21.15.59:0/2084438385 conn(0x55b1f7a43d10 msgr2=0x55b1f7a4ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:20.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.363+0000 7f0bbd919740 1 -- 172.21.15.59:0/2084438385 shutdown_connections 2024-09-10T21:15:20.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.363+0000 7f0bbd919740 1 -- 172.21.15.59:0/2084438385 wait complete. 2024-09-10T21:15:20.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.364+0000 7f0bbd919740 20 client.15390 trim_cache size 0 max 16384 2024-09-10T21:15:20.373 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:15:20.373 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:15:20.373 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "fd4fecc0-22d7-47c0-92e7-a9953c988c74", 2024-09-10T21:15:20.373 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:15:20.373 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:15:20.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.364+0000 7f0bbb544640 1 -- 172.21.15.59:0/2025919771 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0ba00b52e0 msgr2=0x7f0ba00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:20.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.364+0000 7f0bbb544640 1 --2- 172.21.15.59:0/2025919771 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0ba00b52e0 0x7f0ba00b77a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0104550 tx=0x7f0bb00b4040 comp rx=0 tx=0).stop 2024-09-10T21:15:20.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.364+0000 7f0bbb544640 1 -- 172.21.15.59:0/2025919771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb4075540 msgr2=0x7f0bb419f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:20.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.364+0000 7f0bbb544640 1 --2- 172.21.15.59:0/2025919771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb4075540 0x7f0bb419f8e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0005940 tx=0x7f0bb00042f0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.364+0000 7f0bbb544640 1 -- 172.21.15.59:0/2025919771 shutdown_connections 2024-09-10T21:15:20.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.364+0000 7f0bbb544640 1 --2- 172.21.15.59:0/2025919771 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f0ba00b52e0 0x7f0ba00b77a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.364+0000 7f0bbb544640 1 --2- 172.21.15.59:0/2025919771 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0bb4113b20 0x7f0bb41a51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.364+0000 7f0bbb544640 1 --2- 172.21.15.59:0/2025919771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bb4075e60 0x7f0bb419fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.364+0000 7f0bbb544640 1 --2- 172.21.15.59:0/2025919771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bb4075540 0x7f0bb419f8e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:20.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.364+0000 7f0bbb544640 1 -- 172.21.15.59:0/2025919771 >> 172.21.15.59:0/2025919771 conn(0x7f0bb40fe830 msgr2=0x7f0bb40ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:20.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.364+0000 7f0bbb544640 1 -- 172.21.15.59:0/2025919771 shutdown_connections 2024-09-10T21:15:20.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:20.364+0000 7f0bbb544640 1 -- 172.21.15.59:0/2025919771 wait complete. 2024-09-10T21:15:21.044 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:15:21.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:20 smithi192 ceph-mon[35363]: pgmap v342: 97 pgs: 97 active+clean; 648 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-10T21:15:21.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:20 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:15:21.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:20 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:15:21.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:20 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:15:21.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:20 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:15:21.346 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:15:21.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:20 smithi059 ceph-mon[30888]: pgmap v342: 97 pgs: 97 active+clean; 648 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-10T21:15:21.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:20 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:15:21.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:20 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:15:21.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:20 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:15:21.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:20 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:15:21.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:20 smithi154 ceph-mon[35041]: pgmap v342: 97 pgs: 97 active+clean; 648 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-10T21:15:21.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:20 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:15:21.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:20 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:15:21.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:20 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:15:21.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:20 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:15:21.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.839+0000 7fa7420a1640 1 -- 172.21.15.59:0/1636985190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c103ce0 msgr2=0x7fa73c1040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:21.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.839+0000 7fa7420a1640 1 --2- 172.21.15.59:0/1636985190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c103ce0 0x7fa73c1040c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa72c009900 tx=0x7fa72c02a410 comp rx=0 tx=0).stop 2024-09-10T21:15:21.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.839+0000 7fa7420a1640 1 -- 172.21.15.59:0/1636985190 shutdown_connections 2024-09-10T21:15:21.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.839+0000 7fa7420a1640 1 --2- 172.21.15.59:0/1636985190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa73c10d140 0x7fa73c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.839+0000 7fa7420a1640 1 --2- 172.21.15.59:0/1636985190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa73c104600 0x7fa73c10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.839+0000 7fa7420a1640 1 --2- 172.21.15.59:0/1636985190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c103ce0 0x7fa73c1040c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.839+0000 7fa7420a1640 1 -- 172.21.15.59:0/1636985190 >> 172.21.15.59:0/1636985190 conn(0x7fa73c0fd700 msgr2=0x7fa73c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:21.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.839+0000 7fa7420a1640 1 -- 172.21.15.59:0/1636985190 shutdown_connections 2024-09-10T21:15:21.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.839+0000 7fa7420a1640 1 -- 172.21.15.59:0/1636985190 wait complete. 2024-09-10T21:15:21.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.840+0000 7fa7420a1640 1 Processor -- start 2024-09-10T21:15:21.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.840+0000 7fa7420a1640 1 -- start start 2024-09-10T21:15:21.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.840+0000 7fa7420a1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c103ce0 0x7fa73c199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:21.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.840+0000 7fa7420a1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa73c104600 0x7fa73c199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:21.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.840+0000 7fa7420a1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa73c10d140 0x7fa73c19ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:21.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.840+0000 7fa7420a1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c112e90 con 0x7fa73c103ce0 2024-09-10T21:15:21.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.840+0000 7fa7420a1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c112d10 con 0x7fa73c10d140 2024-09-10T21:15:21.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.840+0000 7fa7420a1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c113010 con 0x7fa73c104600 2024-09-10T21:15:21.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.840+0000 7fa73b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c103ce0 0x7fa73c199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:21.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.840+0000 7fa73b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c103ce0 0x7fa73c199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46718/0 (socket says 172.21.15.59:46718) 2024-09-10T21:15:21.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.840+0000 7fa73b7fe640 1 -- 172.21.15.59:0/778236192 learned_addr learned my addr 172.21.15.59:0/778236192 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:21.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.841+0000 7fa73affd640 1 --2- 172.21.15.59:0/778236192 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa73c104600 0x7fa73c199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.841+0000 7fa73bfff640 1 --2- 172.21.15.59:0/778236192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa73c10d140 0x7fa73c19ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.841+0000 7fa73b7fe640 1 -- 172.21.15.59:0/778236192 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa73c104600 msgr2=0x7fa73c199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.841+0000 7fa73b7fe640 1 --2- 172.21.15.59:0/778236192 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa73c104600 0x7fa73c199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.841+0000 7fa73b7fe640 1 -- 172.21.15.59:0/778236192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa73c10d140 msgr2=0x7fa73c19ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.841+0000 7fa73b7fe640 1 --2- 172.21.15.59:0/778236192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa73c10d140 0x7fa73c19ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.841+0000 7fa73b7fe640 1 -- 172.21.15.59:0/778236192 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73c19f4b0 con 0x7fa73c103ce0 2024-09-10T21:15:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.841+0000 7fa73bfff640 1 --2- 172.21.15.59:0/778236192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa73c10d140 0x7fa73c19ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:15:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.841+0000 7fa73b7fe640 1 --2- 172.21.15.59:0/778236192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c103ce0 0x7fa73c199400 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa72c006010 tx=0x7fa72c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.841+0000 7fa738ff9640 1 -- 172.21.15.59:0/778236192 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c03f030 con 0x7fa73c103ce0 2024-09-10T21:15:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.841+0000 7fa738ff9640 1 -- 172.21.15.59:0/778236192 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa72c003800 con 0x7fa73c103ce0 2024-09-10T21:15:21.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.841+0000 7fa7420a1640 1 -- 172.21.15.59:0/778236192 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa73c19f740 con 0x7fa73c103ce0 2024-09-10T21:15:21.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.841+0000 7fa738ff9640 1 -- 172.21.15.59:0/778236192 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c035070 con 0x7fa73c103ce0 2024-09-10T21:15:21.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.841+0000 7fa7420a1640 1 -- 172.21.15.59:0/778236192 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa73c1a5e60 con 0x7fa73c103ce0 2024-09-10T21:15:21.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.844+0000 7fa738ff9640 1 -- 172.21.15.59:0/778236192 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fa72c031b10 con 0x7fa73c103ce0 2024-09-10T21:15:21.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.844+0000 7fa744476740 1 Processor -- start 2024-09-10T21:15:21.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.844+0000 7fa744476740 1 -- start start 2024-09-10T21:15:21.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.844+0000 7fa744476740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031471480 0x556031471860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:21.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.844+0000 7fa744476740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471da0 0x556031481c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:21.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.844+0000 7fa744476740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031482140 0x556031484530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:21.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.844+0000 7fa744476740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5560313e7e50 con 0x556031471da0 2024-09-10T21:15:21.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.844+0000 7fa744476740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5560313d7280 con 0x556031482140 2024-09-10T21:15:21.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.844+0000 7fa744476740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5560313db090 con 0x556031471480 2024-09-10T21:15:21.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.844+0000 7fa73b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471da0 0x556031481c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:21.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.844+0000 7fa73b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471da0 0x556031481c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46720/0 (socket says 172.21.15.59:46720) 2024-09-10T21:15:21.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.844+0000 7fa73b7fe640 1 -- 172.21.15.59:0/926278044 learned_addr learned my addr 172.21.15.59:0/926278044 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:21.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.844+0000 7fa73bfff640 1 --2- 172.21.15.59:0/926278044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031471480 0x556031471860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:21.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.845+0000 7fa73affd640 1 --2- 172.21.15.59:0/926278044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031482140 0x556031484530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:21.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.845+0000 7fa73b7fe640 1 -- 172.21.15.59:0/926278044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031471480 msgr2=0x556031471860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:21.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.845+0000 7fa73b7fe640 1 --2- 172.21.15.59:0/926278044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031471480 0x556031471860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.845+0000 7fa73b7fe640 1 -- 172.21.15.59:0/926278044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031482140 msgr2=0x556031484530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:21.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.845+0000 7fa73b7fe640 1 --2- 172.21.15.59:0/926278044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031482140 0x556031484530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.845+0000 7fa73b7fe640 1 -- 172.21.15.59:0/926278044 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556031135650 con 0x556031471da0 2024-09-10T21:15:21.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.845+0000 7fa738ff9640 1 --2- 172.21.15.59:0/778236192 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa7240b52e0 0x7fa7240b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:21.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.845+0000 7fa73bfff640 1 --2- 172.21.15.59:0/778236192 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa7240b52e0 0x7fa7240b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:21.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.845+0000 7fa73b7fe640 1 --2- 172.21.15.59:0/926278044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471da0 0x556031481c00 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa72c10c750 tx=0x7fa72c10c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7926d67de524f7e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:21.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.845+0000 7fa738ff9640 1 -- 172.21.15.59:0/778236192 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa72c1065e0 con 0x7fa73c103ce0 2024-09-10T21:15:21.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.845+0000 7fa721ffb640 1 -- 172.21.15.59:0/926278044 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c0c9420 con 0x556031471da0 2024-09-10T21:15:21.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.845+0000 7fa721ffb640 1 -- 172.21.15.59:0/926278044 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa72c0cc8e0 con 0x556031471da0 2024-09-10T21:15:21.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.845+0000 7fa721ffb640 1 -- 172.21.15.59:0/926278044 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c0cc540 con 0x556031471da0 2024-09-10T21:15:21.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.846+0000 7fa744476740 1 -- 172.21.15.59:0/926278044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471da0 msgr2=0x556031481c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:21.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.846+0000 7fa744476740 1 --2- 172.21.15.59:0/926278044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471da0 0x556031481c00 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa72c10c750 tx=0x7fa72c10c840 comp rx=0 tx=0).stop 2024-09-10T21:15:21.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.846+0000 7fa73bfff640 1 --2- 172.21.15.59:0/778236192 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa7240b52e0 0x7fa7240b77a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa73400f4c0 tx=0x7fa734007740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:21.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.846+0000 7fa744476740 1 -- 172.21.15.59:0/926278044 shutdown_connections 2024-09-10T21:15:21.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.846+0000 7fa744476740 1 --2- 172.21.15.59:0/926278044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031482140 0x556031484530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.846+0000 7fa744476740 1 --2- 172.21.15.59:0/926278044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471da0 0x556031481c00 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.846+0000 7fa744476740 1 --2- 172.21.15.59:0/926278044 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031471480 0x556031471860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.846+0000 7fa744476740 1 -- 172.21.15.59:0/926278044 >> 172.21.15.59:0/926278044 conn(0x55603146f2b0 msgr2=0x556031470450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:21.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.846+0000 7fa744476740 1 -- 172.21.15.59:0/926278044 shutdown_connections 2024-09-10T21:15:21.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.846+0000 7fa744476740 1 -- 172.21.15.59:0/926278044 wait complete. 2024-09-10T21:15:21.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.846+0000 7fa744476740 1 -- start start 2024-09-10T21:15:21.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.847+0000 7fa744476740 1 Processor -- start 2024-09-10T21:15:21.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.847+0000 7fa744476740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471480 0x556031481a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:21.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.847+0000 7fa744476740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031471da0 0x55603147ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:21.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.847+0000 7fa744476740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031482140 0x55603147f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:21.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.847+0000 7fa744476740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556031238700 con 0x556031471480 2024-09-10T21:15:21.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.847+0000 7fa744476740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556031372110 con 0x556031482140 2024-09-10T21:15:21.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.847+0000 7fa744476740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x556031484bb0 con 0x556031471da0 2024-09-10T21:15:21.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.847+0000 7fa744476740 10 client.0 _ll_register_callbacks cb 0x55603138b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:15:21.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.847+0000 7fa73b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471480 0x556031481a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:21.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.847+0000 7fa73b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471480 0x556031481a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46728/0 (socket says 172.21.15.59:46728) 2024-09-10T21:15:21.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.847+0000 7fa73b7fe640 1 -- 172.21.15.59:0/2102657112 learned_addr learned my addr 172.21.15.59:0/2102657112 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:21.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.847+0000 7fa73bfff640 1 --2- 172.21.15.59:0/2102657112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031482140 0x55603147f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:21.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.847+0000 7fa73affd640 1 --2- 172.21.15.59:0/2102657112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031471da0 0x55603147ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:21.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.847+0000 7fa73b7fe640 1 -- 172.21.15.59:0/2102657112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031471da0 msgr2=0x55603147ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:21.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.847+0000 7fa73b7fe640 1 --2- 172.21.15.59:0/2102657112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031471da0 0x55603147ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.847+0000 7fa73b7fe640 1 -- 172.21.15.59:0/2102657112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031482140 msgr2=0x55603147f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:21.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.847+0000 7fa73b7fe640 1 --2- 172.21.15.59:0/2102657112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031482140 0x55603147f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.847+0000 7fa73b7fe640 1 -- 172.21.15.59:0/2102657112 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55603139fc40 con 0x556031471480 2024-09-10T21:15:21.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.848+0000 7fa73b7fe640 1 --2- 172.21.15.59:0/2102657112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471480 0x556031481a40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa72c0ca040 tx=0x7fa72c004460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190d12b9ee5cf31d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:21.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.848+0000 7fa71affd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:15:21.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.848+0000 7fa71affd640 1 -- 172.21.15.59:0/2102657112 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c049040 con 0x556031471480 2024-09-10T21:15:21.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.848+0000 7fa744476740 1 -- 172.21.15.59:0/2102657112 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa72c0cc8e0 con 0x556031471480 2024-09-10T21:15:21.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.848+0000 7fa71affd640 1 -- 172.21.15.59:0/2102657112 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa72c003cb0 con 0x556031471480 2024-09-10T21:15:21.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.848+0000 7fa71affd640 1 -- 172.21.15.59:0/2102657112 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa72c0cc720 con 0x556031471480 2024-09-10T21:15:21.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.848+0000 7fa744476740 10 client.15402 fetch_fsmap learned FSMap version 28 2024-09-10T21:15:21.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.848+0000 7fa744476740 1 -- 172.21.15.59:0/2102657112 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556031490480 con 0x556031471480 2024-09-10T21:15:21.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.848+0000 7fa71affd640 1 -- 172.21.15.59:0/2102657112 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa72c0cc8e0 con 0x556031471480 2024-09-10T21:15:21.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.848+0000 7fa71affd640 1 -- 172.21.15.59:0/2102657112 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa72c10cca0 con 0x556031471480 2024-09-10T21:15:21.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.848+0000 7fa744476740 10 client.15402 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:15:21.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.848+0000 7fa744476740 10 client.15402 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:15:21.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.848+0000 7fa744476740 20 client.15402 populate_metadata read hostname 'smithi059' 2024-09-10T21:15:21.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.848+0000 7fa744476740 1 --2- 172.21.15.59:0/2102657112 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5560314917d0 0x556031493bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:21.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.848+0000 7fa744476740 4 client.15402 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:15:21.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.848+0000 7fa744476740 1 -- 172.21.15.59:0/2102657112 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560313e9da0 con 0x5560314917d0 2024-09-10T21:15:21.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.849+0000 7fa73affd640 1 --2- 172.21.15.59:0/2102657112 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5560314917d0 0x556031493bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:21.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.849+0000 7fa73affd640 1 --2- 172.21.15.59:0/2102657112 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5560314917d0 0x556031493bc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dfa77465570f4e0 server_cookie=431bf15eb2986c40 in_seq=0 out_seq=0 2024-09-10T21:15:21.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.849+0000 7fa71affd640 10 client.15402 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:15:21.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.850+0000 7fa71affd640 1 -- 172.21.15.59:0/2102657112 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5560313e9da0 con 0x5560314917d0 2024-09-10T21:15:21.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.850+0000 7fa71affd640 10 client.15402 handle_command_reply: tid=0 2024-09-10T21:15:21.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.850+0000 7fa744476740 1 client.15402 shutdown 2024-09-10T21:15:21.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.850+0000 7fa744476740 1 -- 172.21.15.59:0/2102657112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471480 msgr2=0x556031481a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:21.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.850+0000 7fa744476740 1 --2- 172.21.15.59:0/2102657112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471480 0x556031481a40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa72c0ca040 tx=0x7fa72c004460 comp rx=0 tx=0).stop 2024-09-10T21:15:21.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.850+0000 7fa744476740 1 -- 172.21.15.59:0/2102657112 shutdown_connections 2024-09-10T21:15:21.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.850+0000 7fa744476740 1 --2- 172.21.15.59:0/2102657112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031482140 0x55603147f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.850+0000 7fa744476740 1 --2- 172.21.15.59:0/2102657112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031471da0 0x55603147ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.850+0000 7fa744476740 1 --2- 172.21.15.59:0/2102657112 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5560314917d0 0x556031493bc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.850+0000 7fa744476740 1 --2- 172.21.15.59:0/2102657112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471480 0x556031481a40 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.850+0000 7fa744476740 1 -- 172.21.15.59:0/2102657112 >> 172.21.15.59:0/2102657112 conn(0x55603146f2b0 msgr2=0x556031474e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:21.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.850+0000 7fa71affd640 0 client.15402 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:15:21.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.851+0000 7fa744476740 1 -- 172.21.15.59:0/2102657112 shutdown_connections 2024-09-10T21:15:21.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.851+0000 7fa744476740 1 -- 172.21.15.59:0/2102657112 wait complete. 2024-09-10T21:15:21.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.851+0000 7fa744476740 20 client.15402 trim_cache size 0 max 16384 2024-09-10T21:15:21.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.868+0000 7fa744476740 1 Processor -- start 2024-09-10T21:15:21.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.868+0000 7fa744476740 1 -- start start 2024-09-10T21:15:21.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.868+0000 7fa744476740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031471480 0x55603148dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:21.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.868+0000 7fa744476740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031471da0 0x55603146ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:21.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.868+0000 7fa744476740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031482140 0x55603147e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:21.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.868+0000 7fa744476740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1ac260 con 0x556031482140 2024-09-10T21:15:21.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.868+0000 7fa744476740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1adda0 con 0x556031471da0 2024-09-10T21:15:21.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.868+0000 7fa744476740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1ac930 con 0x556031471480 2024-09-10T21:15:21.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.869+0000 7fa73bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031482140 0x55603147e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:21.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.869+0000 7fa73bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031482140 0x55603147e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46738/0 (socket says 172.21.15.59:46738) 2024-09-10T21:15:21.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.869+0000 7fa73bfff640 1 -- 172.21.15.59:0/2243704092 learned_addr learned my addr 172.21.15.59:0/2243704092 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:21.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.869+0000 7fa73affd640 1 --2- 172.21.15.59:0/2243704092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031471da0 0x55603146ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:21.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.869+0000 7fa73b7fe640 1 --2- 172.21.15.59:0/2243704092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031471480 0x55603148dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:21.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.869+0000 7fa73bfff640 1 -- 172.21.15.59:0/2243704092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031471480 msgr2=0x55603148dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:21.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.869+0000 7fa73bfff640 1 --2- 172.21.15.59:0/2243704092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031471480 0x55603148dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.869+0000 7fa73bfff640 1 -- 172.21.15.59:0/2243704092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031471da0 msgr2=0x55603146ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:21.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.869+0000 7fa73bfff640 1 --2- 172.21.15.59:0/2243704092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031471da0 0x55603146ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.869+0000 7fa73bfff640 1 -- 172.21.15.59:0/2243704092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55603147cde0 con 0x556031482140 2024-09-10T21:15:21.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.869+0000 7fa73affd640 1 --2- 172.21.15.59:0/2243704092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031471da0 0x55603146ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:15:21.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.869+0000 7fa73b7fe640 1 --2- 172.21.15.59:0/2243704092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031471480 0x55603148dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:15:21.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.869+0000 7fa73bfff640 1 --2- 172.21.15.59:0/2243704092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031482140 0x55603147e3a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa7340109d0 tx=0x7fa734012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164c3b0f74425981 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:21.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.869+0000 7fa7217fa640 1 -- 172.21.15.59:0/2243704092 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73401edc0 con 0x556031482140 2024-09-10T21:15:21.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.869+0000 7fa7217fa640 1 -- 172.21.15.59:0/2243704092 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa734026890 con 0x556031482140 2024-09-10T21:15:21.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.869+0000 7fa7217fa640 1 -- 172.21.15.59:0/2243704092 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa734019740 con 0x556031482140 2024-09-10T21:15:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.870+0000 7fa744476740 1 -- 172.21.15.59:0/2243704092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031482140 msgr2=0x55603147e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.870+0000 7fa744476740 1 --2- 172.21.15.59:0/2243704092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031482140 0x55603147e3a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa7340109d0 tx=0x7fa734012000 comp rx=0 tx=0).stop 2024-09-10T21:15:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.870+0000 7fa744476740 1 -- 172.21.15.59:0/2243704092 shutdown_connections 2024-09-10T21:15:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.870+0000 7fa744476740 1 --2- 172.21.15.59:0/2243704092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031482140 0x55603147e3a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.870+0000 7fa744476740 1 --2- 172.21.15.59:0/2243704092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031471da0 0x55603146ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.870+0000 7fa744476740 1 --2- 172.21.15.59:0/2243704092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031471480 0x55603148dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.870+0000 7fa744476740 1 -- 172.21.15.59:0/2243704092 >> 172.21.15.59:0/2243704092 conn(0x55603146f2b0 msgr2=0x5560314804c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.870+0000 7fa744476740 1 -- 172.21.15.59:0/2243704092 shutdown_connections 2024-09-10T21:15:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.870+0000 7fa744476740 1 -- 172.21.15.59:0/2243704092 wait complete. 2024-09-10T21:15:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.870+0000 7fa744476740 1 -- start start 2024-09-10T21:15:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.871+0000 7fa744476740 1 Processor -- start 2024-09-10T21:15:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.871+0000 7fa744476740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031471480 0x556031489e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.871+0000 7fa744476740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471da0 0x55603148a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.871+0000 7fa744476740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031482140 0x556031486dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.871+0000 7fa744476740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1ad6d0 con 0x556031471da0 2024-09-10T21:15:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.871+0000 7fa744476740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1ad000 con 0x556031471480 2024-09-10T21:15:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.871+0000 7fa744476740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1aa260 con 0x556031482140 2024-09-10T21:15:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.871+0000 7fa744476740 10 client.0 _ll_register_callbacks cb 0x7fa7340075e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:15:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.871+0000 7fa73affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471da0 0x55603148a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.871+0000 7fa73affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471da0 0x55603148a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46750/0 (socket says 172.21.15.59:46750) 2024-09-10T21:15:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.871+0000 7fa73affd640 1 -- 172.21.15.59:0/2009720239 learned_addr learned my addr 172.21.15.59:0/2009720239 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.871+0000 7fa73b7fe640 1 --2- 172.21.15.59:0/2009720239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031471480 0x556031489e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.871+0000 7fa73bfff640 1 --2- 172.21.15.59:0/2009720239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031482140 0x556031486dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.871+0000 7fa73affd640 1 -- 172.21.15.59:0/2009720239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031482140 msgr2=0x556031486dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.871+0000 7fa73affd640 1 --2- 172.21.15.59:0/2009720239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031482140 0x556031486dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.871+0000 7fa73affd640 1 -- 172.21.15.59:0/2009720239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031471480 msgr2=0x556031489e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:21.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.871+0000 7fa73affd640 1 --2- 172.21.15.59:0/2009720239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031471480 0x556031489e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.871+0000 7fa73affd640 1 -- 172.21.15.59:0/2009720239 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55603148ab70 con 0x556031471da0 2024-09-10T21:15:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.872+0000 7fa73affd640 1 --2- 172.21.15.59:0/2009720239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471da0 0x55603148a340 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa73c10f720 tx=0x7fa73000dfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4387c0187c8b5c73 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.872+0000 7fa71affd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:15:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.872+0000 7fa71affd640 1 -- 172.21.15.59:0/2009720239 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa730015cc0 con 0x556031471da0 2024-09-10T21:15:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.872+0000 7fa744476740 1 -- 172.21.15.59:0/2009720239 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa734026890 con 0x556031471da0 2024-09-10T21:15:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.872+0000 7fa71affd640 1 -- 172.21.15.59:0/2009720239 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa730022380 con 0x556031471da0 2024-09-10T21:15:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.872+0000 7fa71affd640 1 -- 172.21.15.59:0/2009720239 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa730015e60 con 0x556031471da0 2024-09-10T21:15:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.872+0000 7fa744476740 10 client.15408 fetch_fsmap learned FSMap version 28 2024-09-10T21:15:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.872+0000 7fa744476740 1 -- 172.21.15.59:0/2009720239 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5560314feae0 con 0x556031471da0 2024-09-10T21:15:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.872+0000 7fa71affd640 1 -- 172.21.15.59:0/2009720239 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa734026890 con 0x556031471da0 2024-09-10T21:15:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.872+0000 7fa71affd640 1 -- 172.21.15.59:0/2009720239 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa730024820 con 0x556031471da0 2024-09-10T21:15:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.872+0000 7fa744476740 10 client.15408 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:15:21.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.873+0000 7fa744476740 10 client.15408 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:15:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.873+0000 7fa744476740 20 client.15408 populate_metadata read hostname 'smithi059' 2024-09-10T21:15:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.873+0000 7fa744476740 1 --2- 172.21.15.59:0/2009720239 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5560314ff270 0x556031501690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.873+0000 7fa744476740 4 client.15408 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:15:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.873+0000 7fa744476740 1 -- 172.21.15.59:0/2009720239 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5560313e5850 con 0x5560314ff270 2024-09-10T21:15:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.873+0000 7fa73b7fe640 1 --2- 172.21.15.59:0/2009720239 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5560314ff270 0x556031501690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.873+0000 7fa73b7fe640 1 --2- 172.21.15.59:0/2009720239 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5560314ff270 0x556031501690 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89773f7441f30c14 server_cookie=578d32650f9ba099 in_seq=0 out_seq=0 2024-09-10T21:15:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.873+0000 7fa71affd640 10 client.15408 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:15:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.873+0000 7fa71affd640 1 -- 172.21.15.59:0/2009720239 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x5560313e5850 con 0x5560314ff270 2024-09-10T21:15:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.873+0000 7fa71affd640 10 client.15408 handle_command_reply: tid=0 2024-09-10T21:15:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.873+0000 7fa744476740 1 client.15408 shutdown 2024-09-10T21:15:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.874+0000 7fa744476740 1 -- 172.21.15.59:0/2009720239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471da0 msgr2=0x55603148a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.874+0000 7fa744476740 1 --2- 172.21.15.59:0/2009720239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471da0 0x55603148a340 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa73c10f720 tx=0x7fa73000dfc0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.874+0000 7fa744476740 1 -- 172.21.15.59:0/2009720239 shutdown_connections 2024-09-10T21:15:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.874+0000 7fa744476740 1 --2- 172.21.15.59:0/2009720239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556031482140 0x556031486dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.874+0000 7fa744476740 1 --2- 172.21.15.59:0/2009720239 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5560314ff270 0x556031501690 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.874+0000 7fa744476740 1 --2- 172.21.15.59:0/2009720239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556031471da0 0x55603148a340 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.874+0000 7fa71affd640 0 client.15408 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:15:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.874+0000 7fa744476740 1 --2- 172.21.15.59:0/2009720239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556031471480 0x556031489e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.874+0000 7fa744476740 1 -- 172.21.15.59:0/2009720239 >> 172.21.15.59:0/2009720239 conn(0x55603146f2b0 msgr2=0x556031480ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.874+0000 7fa744476740 1 -- 172.21.15.59:0/2009720239 shutdown_connections 2024-09-10T21:15:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.874+0000 7fa744476740 1 -- 172.21.15.59:0/2009720239 wait complete. 2024-09-10T21:15:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.874+0000 7fa744476740 20 client.15408 trim_cache size 0 max 16384 2024-09-10T21:15:21.883 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:15:21.883 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:15:21.883 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-09-10T21:15:21.883 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:15:21.883 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:15:21.884 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "fd4fecc0-22d7-47c0-92e7-a9953c988c74", 2024-09-10T21:15:21.884 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2024-09-10T21:15:21.884 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:15:21.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:15:21.884 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:15:21.884 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:15:21.884 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:15:21.884 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:15:21.884 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:15:21.884 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:15:21.884 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:15:21.884 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:15:21.884 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:15:21.885 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:15:21.885 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:15:21.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.874+0000 7fa7420a1640 1 -- 172.21.15.59:0/778236192 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa7240b52e0 msgr2=0x7fa7240b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:21.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.874+0000 7fa7420a1640 1 --2- 172.21.15.59:0/778236192 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa7240b52e0 0x7fa7240b77a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa73400f4c0 tx=0x7fa734007740 comp rx=0 tx=0).stop 2024-09-10T21:15:21.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.874+0000 7fa7420a1640 1 -- 172.21.15.59:0/778236192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c103ce0 msgr2=0x7fa73c199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:21.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.874+0000 7fa7420a1640 1 --2- 172.21.15.59:0/778236192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c103ce0 0x7fa73c199400 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa72c006010 tx=0x7fa72c0042f0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.875+0000 7fa7420a1640 1 -- 172.21.15.59:0/778236192 shutdown_connections 2024-09-10T21:15:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.875+0000 7fa7420a1640 1 --2- 172.21.15.59:0/778236192 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa7240b52e0 0x7fa7240b77a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.875+0000 7fa7420a1640 1 --2- 172.21.15.59:0/778236192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa73c10d140 0x7fa73c19ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.875+0000 7fa7420a1640 1 --2- 172.21.15.59:0/778236192 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa73c104600 0x7fa73c199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.875+0000 7fa7420a1640 1 --2- 172.21.15.59:0/778236192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c103ce0 0x7fa73c199400 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.875+0000 7fa7420a1640 1 -- 172.21.15.59:0/778236192 >> 172.21.15.59:0/778236192 conn(0x7fa73c0fd700 msgr2=0x7fa73c0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.875+0000 7fa7420a1640 1 -- 172.21.15.59:0/778236192 shutdown_connections 2024-09-10T21:15:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:21.875+0000 7fa7420a1640 1 -- 172.21.15.59:0/778236192 wait complete. 2024-09-10T21:15:22.694 INFO:tasks.cephfs.filesystem:scrub status for tag:fd4fecc0-22d7-47c0-92e7-a9953c988c74 - {'path': '/', 'tag': 'fd4fecc0-22d7-47c0-92e7-a9953c988c74', 'options': 'recursive,force'} 2024-09-10T21:15:23.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:22 smithi192 ceph-mon[35363]: pgmap v343: 97 pgs: 97 active+clean; 653 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-10T21:15:23.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:22 smithi059 ceph-mon[30888]: pgmap v343: 97 pgs: 97 active+clean; 653 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-10T21:15:23.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:22 smithi154 ceph-mon[35041]: pgmap v343: 97 pgs: 97 active+clean; 653 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-10T21:15:25.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:24 smithi192 ceph-mon[35363]: pgmap v344: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-10T21:15:25.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:24 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:15:25.376 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:24 smithi059 ceph-mon[30888]: pgmap v344: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-10T21:15:25.376 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:24 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:15:25.405 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:24 smithi154 ceph-mon[35041]: pgmap v344: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-10T21:15:25.405 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:24 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:15:27.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:26 smithi192 ceph-mon[35363]: pgmap v345: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T21:15:27.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:26 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:26 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:26 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:26 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:26 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:26 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:26 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:15:27.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:26 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:15:27.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:26 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:26 smithi059 ceph-mon[30888]: pgmap v345: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T21:15:27.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:26 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:26 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:26 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:26 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:26 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:26 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:26 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:15:27.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:26 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:15:27.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:26 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:26 smithi154 ceph-mon[35041]: pgmap v345: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T21:15:27.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:26 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:26 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:26 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:26 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:26 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:26 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:27.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:26 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:15:27.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:26 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:15:27.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:26 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:15:29.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:28 smithi192 ceph-mon[35363]: pgmap v346: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-10T21:15:29.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:28 smithi059 ceph-mon[30888]: pgmap v346: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-10T21:15:29.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:28 smithi154 ceph-mon[35041]: pgmap v346: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-09-10T21:15:31.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:30 smithi192 ceph-mon[35363]: pgmap v347: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-10T21:15:31.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:30 smithi059 ceph-mon[30888]: pgmap v347: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-10T21:15:31.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:30 smithi154 ceph-mon[35041]: pgmap v347: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-10T21:15:33.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:32 smithi192 ceph-mon[35363]: pgmap v348: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-10T21:15:33.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:32 smithi059 ceph-mon[30888]: pgmap v348: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-10T21:15:33.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:32 smithi154 ceph-mon[35041]: pgmap v348: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-10T21:15:35.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:34 smithi192 ceph-mon[35363]: pgmap v349: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T21:15:35.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:34 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:15:35.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:34 smithi059 ceph-mon[30888]: pgmap v349: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T21:15:35.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:34 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:15:35.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:34 smithi154 ceph-mon[35041]: pgmap v349: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T21:15:35.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:34 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:15:37.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:36 smithi192 ceph-mon[35363]: pgmap v350: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-10T21:15:37.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:36 smithi059 ceph-mon[30888]: pgmap v350: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-10T21:15:37.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:36 smithi154 ceph-mon[35041]: pgmap v350: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-10T21:15:39.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:38 smithi192 ceph-mon[35363]: pgmap v351: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:15:39.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:38 smithi059 ceph-mon[30888]: pgmap v351: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:15:39.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:38 smithi154 ceph-mon[35041]: pgmap v351: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:15:41.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:40 smithi192 ceph-mon[35363]: pgmap v352: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:15:41.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:40 smithi059 ceph-mon[30888]: pgmap v352: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:15:41.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:40 smithi154 ceph-mon[35041]: pgmap v352: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:15:43.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:42 smithi192 ceph-mon[35363]: pgmap v353: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:15:43.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:42 smithi059 ceph-mon[30888]: pgmap v353: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:15:43.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:42 smithi154 ceph-mon[35041]: pgmap v353: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:15:45.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:44 smithi192 ceph-mon[35363]: pgmap v354: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:15:45.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:44 smithi059 ceph-mon[30888]: pgmap v354: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:15:45.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:44 smithi154 ceph-mon[35041]: pgmap v354: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:15:47.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:46 smithi192 ceph-mon[35363]: pgmap v355: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:15:47.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:46 smithi059 ceph-mon[30888]: pgmap v355: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:15:47.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:46 smithi154 ceph-mon[35041]: pgmap v355: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:15:49.277 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:48 smithi059 ceph-mon[30888]: pgmap v356: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:15:49.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:48 smithi192 ceph-mon[35363]: pgmap v356: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:15:49.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:48 smithi154 ceph-mon[35041]: pgmap v356: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:15:51.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:50 smithi192 ceph-mon[35363]: pgmap v357: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:15:51.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:50 smithi059 ceph-mon[30888]: pgmap v357: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:15:51.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:50 smithi154 ceph-mon[35041]: pgmap v357: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:15:52.695 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:15:53.027 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:15:53.313 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:52 smithi059 ceph-mon[30888]: pgmap v358: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:15:53.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:52 smithi192 ceph-mon[35363]: pgmap v358: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:15:53.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:52 smithi154 ceph-mon[35041]: pgmap v358: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:15:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.533+0000 7f510d55e640 1 -- 172.21.15.59:0/659955271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f510810d100 msgr2=0x7f510810f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.533+0000 7f510d55e640 1 --2- 172.21.15.59:0/659955271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f510810d100 0x7f510810f560 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5100009ca0 tx=0x7f510002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.533+0000 7f510d55e640 1 -- 172.21.15.59:0/659955271 shutdown_connections 2024-09-10T21:15:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.533+0000 7f510d55e640 1 --2- 172.21.15.59:0/659955271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f510810d100 0x7f510810f560 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.533+0000 7f510d55e640 1 --2- 172.21.15.59:0/659955271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51081045c0 0x7f510810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.533+0000 7f510d55e640 1 --2- 172.21.15.59:0/659955271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5108103ca0 0x7f5108104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.533+0000 7f510d55e640 1 -- 172.21.15.59:0/659955271 >> 172.21.15.59:0/659955271 conn(0x7f51080fd700 msgr2=0x7f51080ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.533+0000 7f510d55e640 1 -- 172.21.15.59:0/659955271 shutdown_connections 2024-09-10T21:15:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.533+0000 7f510d55e640 1 -- 172.21.15.59:0/659955271 wait complete. 2024-09-10T21:15:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.534+0000 7f510d55e640 1 Processor -- start 2024-09-10T21:15:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.534+0000 7f510d55e640 1 -- start start 2024-09-10T21:15:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.534+0000 7f510d55e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5108103ca0 0x7f51081992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.534+0000 7f510d55e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51081045c0 0x7f5108199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.534+0000 7f510d55e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f510810d100 0x7f510819ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.534+0000 7f5106ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5108103ca0 0x7f51081992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.534+0000 7f510d55e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5108112dc0 con 0x7f5108103ca0 2024-09-10T21:15:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.534+0000 7f5106ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5108103ca0 0x7f51081992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33454/0 (socket says 172.21.15.59:33454) 2024-09-10T21:15:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.535+0000 7f5106ffd640 1 -- 172.21.15.59:0/3531823636 learned_addr learned my addr 172.21.15.59:0/3531823636 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.535+0000 7f510d55e640 1 -- 172.21.15.59:0/3531823636 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5108112c40 con 0x7f51081045c0 2024-09-10T21:15:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.535+0000 7f510d55e640 1 -- 172.21.15.59:0/3531823636 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5108112f40 con 0x7f510810d100 2024-09-10T21:15:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.535+0000 7f51077fe640 1 --2- 172.21.15.59:0/3531823636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f510810d100 0x7f510819ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.535+0000 7f5106ffd640 1 -- 172.21.15.59:0/3531823636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f510810d100 msgr2=0x7f510819ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.535+0000 7f5106ffd640 1 --2- 172.21.15.59:0/3531823636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f510810d100 0x7f510819ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.535+0000 7f51067fc640 1 --2- 172.21.15.59:0/3531823636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51081045c0 0x7f5108199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.535+0000 7f5106ffd640 1 -- 172.21.15.59:0/3531823636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51081045c0 msgr2=0x7f5108199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.535+0000 7f5106ffd640 1 --2- 172.21.15.59:0/3531823636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51081045c0 0x7f5108199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.535+0000 7f5106ffd640 1 -- 172.21.15.59:0/3531823636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510819f380 con 0x7f5108103ca0 2024-09-10T21:15:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.535+0000 7f51067fc640 1 --2- 172.21.15.59:0/3531823636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51081045c0 0x7f5108199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:15:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.536+0000 7f5106ffd640 1 --2- 172.21.15.59:0/3531823636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5108103ca0 0x7f51081992d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f50f800d770 tx=0x7f50f800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.536+0000 7f50effff640 1 -- 172.21.15.59:0/3531823636 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8017070 con 0x7f5108103ca0 2024-09-10T21:15:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.536+0000 7f510d55e640 1 -- 172.21.15.59:0/3531823636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f510819f670 con 0x7f5108103ca0 2024-09-10T21:15:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.536+0000 7f50effff640 1 -- 172.21.15.59:0/3531823636 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50f80054d0 con 0x7f5108103ca0 2024-09-10T21:15:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.536+0000 7f510d55e640 1 -- 172.21.15.59:0/3531823636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51081a5d30 con 0x7f5108103ca0 2024-09-10T21:15:53.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.537+0000 7f50effff640 1 -- 172.21.15.59:0/3531823636 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8005220 con 0x7f5108103ca0 2024-09-10T21:15:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.540+0000 7f510f933740 1 Processor -- start 2024-09-10T21:15:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.540+0000 7f510f933740 1 -- start start 2024-09-10T21:15:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.540+0000 7f510f933740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c2654a0a0 0x557c2654a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.540+0000 7f510f933740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c2654a9c0 0x557c26556410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.540+0000 7f510f933740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c26556950 0x557c26558d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.540+0000 7f510f933740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557c264c0e50 con 0x557c2654a9c0 2024-09-10T21:15:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.540+0000 7f510f933740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557c264b0280 con 0x557c2654a0a0 2024-09-10T21:15:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.540+0000 7f510f933740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557c264b4090 con 0x557c26556950 2024-09-10T21:15:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.541+0000 7f51067fc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c26556950 0x557c26558d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.541+0000 7f51067fc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c26556950 0x557c26558d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:43726/0 (socket says 172.21.15.59:43726) 2024-09-10T21:15:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.541+0000 7f51067fc640 1 -- 172.21.15.59:0/3927125419 learned_addr learned my addr 172.21.15.59:0/3927125419 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.541+0000 7f51077fe640 1 --2- 172.21.15.59:0/3927125419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c2654a0a0 0x557c2654a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.541+0000 7f51067fc640 1 -- 172.21.15.59:0/3927125419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c2654a0a0 msgr2=0x557c2654a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.541+0000 7f51067fc640 1 --2- 172.21.15.59:0/3927125419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c2654a0a0 0x557c2654a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.541+0000 7f51067fc640 1 -- 172.21.15.59:0/3927125419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c2654a9c0 msgr2=0x557c26556410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:15:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.541+0000 7f51067fc640 1 --2- 172.21.15.59:0/3927125419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c2654a9c0 0x557c26556410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.541+0000 7f51067fc640 1 -- 172.21.15.59:0/3927125419 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c2620e650 con 0x557c26556950 2024-09-10T21:15:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.541+0000 7f51067fc640 1 --2- 172.21.15.59:0/3927125419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c26556950 0x557c26558d40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009c00 tx=0x7f50fc00e6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4662afa4d8a586 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.541+0000 7f50effff640 1 -- 172.21.15.59:0/3531823636 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f50f80049d0 con 0x7f5108103ca0 2024-09-10T21:15:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.541+0000 7f50ed7fa640 1 -- 172.21.15.59:0/3927125419 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc016070 con 0x557c26556950 2024-09-10T21:15:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.541+0000 7f50ed7fa640 1 -- 172.21.15.59:0/3927125419 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50fc0054d0 con 0x557c26556950 2024-09-10T21:15:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.542+0000 7f50ed7fa640 1 -- 172.21.15.59:0/3927125419 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc011470 con 0x557c26556950 2024-09-10T21:15:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.542+0000 7f50effff640 1 --2- 172.21.15.59:0/3531823636 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f50f00b52e0 0x7f50f00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.542+0000 7f510f933740 1 -- 172.21.15.59:0/3927125419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c26556950 msgr2=0x557c26558d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.542+0000 7f510f933740 1 --2- 172.21.15.59:0/3927125419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c26556950 0x557c26558d40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009c00 tx=0x7f50fc00e6c0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.542+0000 7f510f933740 1 -- 172.21.15.59:0/3927125419 shutdown_connections 2024-09-10T21:15:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.542+0000 7f510f933740 1 --2- 172.21.15.59:0/3927125419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c26556950 0x557c26558d40 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009c00 tx=0x7f50fc00e6c0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.542+0000 7f510f933740 1 --2- 172.21.15.59:0/3927125419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c2654a9c0 0x557c26556410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.542+0000 7f510f933740 1 --2- 172.21.15.59:0/3927125419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c2654a0a0 0x557c2654a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.542+0000 7f510f933740 1 -- 172.21.15.59:0/3927125419 >> 172.21.15.59:0/3927125419 conn(0x557c26547ed0 msgr2=0x557c26549070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.542+0000 7f50effff640 1 -- 172.21.15.59:0/3531823636 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f50f80e59a0 con 0x7f5108103ca0 2024-09-10T21:15:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.542+0000 7f51077fe640 1 --2- 172.21.15.59:0/3531823636 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f50f00b52e0 0x7f50f00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.543+0000 7f510f933740 1 -- 172.21.15.59:0/3927125419 shutdown_connections 2024-09-10T21:15:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.543+0000 7f510f933740 1 -- 172.21.15.59:0/3927125419 wait complete. 2024-09-10T21:15:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.543+0000 7f51077fe640 1 --2- 172.21.15.59:0/3531823636 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f50f00b52e0 0x7f50f00b77a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5100006010 tx=0x7f5100005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.543+0000 7f510f933740 1 -- start start 2024-09-10T21:15:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.543+0000 7f510f933740 1 Processor -- start 2024-09-10T21:15:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.544+0000 7f510f933740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c2654a0a0 0x557c265539a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.544+0000 7f510f933740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c2654a9c0 0x557c26553ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.544+0000 7f510f933740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c26554420 0x557c26562930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.544+0000 7f510f933740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557c26311700 con 0x557c2654a9c0 2024-09-10T21:15:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.544+0000 7f510f933740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557c2644b110 con 0x557c26554420 2024-09-10T21:15:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.544+0000 7f510f933740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557c265595d0 con 0x557c2654a0a0 2024-09-10T21:15:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.544+0000 7f510f933740 10 client.0 _ll_register_callbacks cb 0x557c26464990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:15:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.544+0000 7f5106ffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c2654a0a0 0x557c265539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.544+0000 7f51067fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c2654a9c0 0x557c26553ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.544+0000 7f5106ffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c2654a0a0 0x557c265539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:43742/0 (socket says 172.21.15.59:43742) 2024-09-10T21:15:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.544+0000 7f5106ffd640 1 -- 172.21.15.59:0/1076702293 learned_addr learned my addr 172.21.15.59:0/1076702293 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.544+0000 7f51077fe640 1 --2- 172.21.15.59:0/1076702293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c26554420 0x557c26562930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.544+0000 7f5106ffd640 1 -- 172.21.15.59:0/1076702293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c26554420 msgr2=0x557c26562930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.544+0000 7f5106ffd640 1 --2- 172.21.15.59:0/1076702293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c26554420 0x557c26562930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.544+0000 7f5106ffd640 1 -- 172.21.15.59:0/1076702293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c2654a9c0 msgr2=0x557c26553ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.544+0000 7f5106ffd640 1 --2- 172.21.15.59:0/1076702293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c2654a9c0 0x557c26553ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.544+0000 7f5106ffd640 1 -- 172.21.15.59:0/1076702293 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c26478c40 con 0x557c2654a0a0 2024-09-10T21:15:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.544+0000 7f51067fc640 1 --2- 172.21.15.59:0/1076702293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c2654a9c0 0x557c26553ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:15:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.545+0000 7f5106ffd640 1 --2- 172.21.15.59:0/1076702293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c2654a0a0 0x557c265539a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f50f80a8760 tx=0x7f50f80abae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8de3c08c8f5feb33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.545+0000 7f50eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-10T21:15:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.545+0000 7f50eaff5640 1 -- 172.21.15.59:0/1076702293 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f80abca0 con 0x557c2654a0a0 2024-09-10T21:15:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.545+0000 7f510f933740 1 -- 172.21.15.59:0/1076702293 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50fc0054d0 con 0x557c2654a0a0 2024-09-10T21:15:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.545+0000 7f50eaff5640 1 -- 172.21.15.59:0/1076702293 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f50f80a8400 con 0x557c2654a0a0 2024-09-10T21:15:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.545+0000 7f50eaff5640 1 -- 172.21.15.59:0/1076702293 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f50f80ac890 con 0x557c2654a0a0 2024-09-10T21:15:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.545+0000 7f510f933740 10 client.25012 fetch_fsmap learned FSMap version 28 2024-09-10T21:15:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.545+0000 7f510f933740 1 -- 172.21.15.59:0/1076702293 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557c26565680 con 0x557c2654a0a0 2024-09-10T21:15:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.546+0000 7f50eaff5640 1 -- 172.21.15.59:0/1076702293 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50fc0054d0 con 0x557c2654a0a0 2024-09-10T21:15:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.546+0000 7f50eaff5640 1 -- 172.21.15.59:0/1076702293 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f50f80cdb70 con 0x557c2654a0a0 2024-09-10T21:15:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.546+0000 7f510f933740 10 client.25012 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:15:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.546+0000 7f510f933740 10 client.25012 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:15:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.546+0000 7f510f933740 20 client.25012 populate_metadata read hostname 'smithi059' 2024-09-10T21:15:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.546+0000 7f510f933740 1 --2- 172.21.15.59:0/1076702293 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557c26566a90 0x557c26568e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.546+0000 7f510f933740 4 client.25012 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:15:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.546+0000 7f510f933740 1 -- 172.21.15.59:0/1076702293 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c264c2da0 con 0x557c26566a90 2024-09-10T21:15:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.546+0000 7f51067fc640 1 --2- 172.21.15.59:0/1076702293 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557c26566a90 0x557c26568e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.547+0000 7f50eaff5640 10 client.25012 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:15:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.547+0000 7f51067fc640 1 --2- 172.21.15.59:0/1076702293 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557c26566a90 0x557c26568e80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=946eeff3acdd5aaf server_cookie=3e5575333fadfea0 in_seq=0 out_seq=0 2024-09-10T21:15:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.547+0000 7f50eaff5640 1 -- 172.21.15.59:0/1076702293 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c264c2da0 con 0x557c26566a90 2024-09-10T21:15:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.547+0000 7f50eaff5640 10 client.25012 handle_command_reply: tid=0 2024-09-10T21:15:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.548+0000 7f510f933740 1 client.25012 shutdown 2024-09-10T21:15:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.548+0000 7f510f933740 1 -- 172.21.15.59:0/1076702293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c2654a0a0 msgr2=0x557c265539a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.548+0000 7f510f933740 1 --2- 172.21.15.59:0/1076702293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c2654a0a0 0x557c265539a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f50f80a8760 tx=0x7f50f80abae0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.548+0000 7f510f933740 1 -- 172.21.15.59:0/1076702293 shutdown_connections 2024-09-10T21:15:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.548+0000 7f510f933740 1 --2- 172.21.15.59:0/1076702293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c26554420 0x557c26562930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.548+0000 7f510f933740 1 --2- 172.21.15.59:0/1076702293 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557c26566a90 0x557c26568e80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.548+0000 7f510f933740 1 --2- 172.21.15.59:0/1076702293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c2654a9c0 0x557c26553ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.548+0000 7f510f933740 1 --2- 172.21.15.59:0/1076702293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c2654a0a0 0x557c265539a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.548+0000 7f50eaff5640 0 client.25012 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:15:53.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.548+0000 7f510f933740 1 -- 172.21.15.59:0/1076702293 >> 172.21.15.59:0/1076702293 conn(0x557c26547ed0 msgr2=0x557c2654da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:53.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.548+0000 7f510f933740 1 -- 172.21.15.59:0/1076702293 shutdown_connections 2024-09-10T21:15:53.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.548+0000 7f510f933740 1 -- 172.21.15.59:0/1076702293 wait complete. 2024-09-10T21:15:53.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.548+0000 7f510f933740 20 client.25012 trim_cache size 0 max 16384 2024-09-10T21:15:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.583+0000 7f510f933740 1 Processor -- start 2024-09-10T21:15:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.583+0000 7f510f933740 1 -- start start 2024-09-10T21:15:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.584+0000 7f510f933740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c2654a9c0 0x557c26553e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.584+0000 7f510f933740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c26554420 0x557c2655ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.584+0000 7f510f933740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c26549670 0x557c2655f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.584+0000 7f510f933740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f51081ae320 con 0x557c26554420 2024-09-10T21:15:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.584+0000 7f510f933740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51081afe60 con 0x557c26549670 2024-09-10T21:15:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.584+0000 7f510f933740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f51081ae9f0 con 0x557c2654a9c0 2024-09-10T21:15:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.584+0000 7f51077fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c26549670 0x557c2655f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.584+0000 7f51077fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c26549670 0x557c2655f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:40246/0 (socket says 172.21.15.59:40246) 2024-09-10T21:15:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.584+0000 7f51077fe640 1 -- 172.21.15.59:0/1023843194 learned_addr learned my addr 172.21.15.59:0/1023843194 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.585+0000 7f5106ffd640 1 --2- 172.21.15.59:0/1023843194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c2654a9c0 0x557c26553e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.585+0000 7f51077fe640 1 -- 172.21.15.59:0/1023843194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c2654a9c0 msgr2=0x557c26553e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.585+0000 7f51077fe640 1 --2- 172.21.15.59:0/1023843194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c2654a9c0 0x557c26553e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.585+0000 7f51077fe640 1 -- 172.21.15.59:0/1023843194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c26554420 msgr2=0x557c2655ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.585+0000 7f51077fe640 1 --2- 172.21.15.59:0/1023843194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c26554420 0x557c2655ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.585+0000 7f51077fe640 1 -- 172.21.15.59:0/1023843194 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c26569460 con 0x557c26549670 2024-09-10T21:15:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.585+0000 7f51077fe640 1 --2- 172.21.15.59:0/1023843194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c26549670 0x557c2655f1b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5100009ca0 tx=0x7f5100041000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2704492678d3c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:53.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.586+0000 7f50ecff9640 1 -- 172.21.15.59:0/1023843194 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100003970 con 0x557c26549670 2024-09-10T21:15:53.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.586+0000 7f50ecff9640 1 -- 172.21.15.59:0/1023843194 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5100036050 con 0x557c26549670 2024-09-10T21:15:53.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.586+0000 7f50ecff9640 1 -- 172.21.15.59:0/1023843194 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510002f610 con 0x557c26549670 2024-09-10T21:15:53.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.587+0000 7f510f933740 1 -- 172.21.15.59:0/1023843194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c26549670 msgr2=0x557c2655f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:53.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.587+0000 7f510f933740 1 --2- 172.21.15.59:0/1023843194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c26549670 0x557c2655f1b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5100009ca0 tx=0x7f5100041000 comp rx=0 tx=0).stop 2024-09-10T21:15:53.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.587+0000 7f510f933740 1 -- 172.21.15.59:0/1023843194 shutdown_connections 2024-09-10T21:15:53.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.587+0000 7f510f933740 1 --2- 172.21.15.59:0/1023843194 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c26549670 0x557c2655f1b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.587+0000 7f510f933740 1 --2- 172.21.15.59:0/1023843194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c26554420 0x557c2655ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.587+0000 7f510f933740 1 --2- 172.21.15.59:0/1023843194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c2654a9c0 0x557c26553e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.587+0000 7f510f933740 1 -- 172.21.15.59:0/1023843194 >> 172.21.15.59:0/1023843194 conn(0x557c26547ed0 msgr2=0x557c26553750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.587+0000 7f510f933740 1 -- 172.21.15.59:0/1023843194 shutdown_connections 2024-09-10T21:15:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.587+0000 7f510f933740 1 -- 172.21.15.59:0/1023843194 wait complete. 2024-09-10T21:15:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.588+0000 7f510f933740 1 -- start start 2024-09-10T21:15:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.588+0000 7f510f933740 1 Processor -- start 2024-09-10T21:15:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.588+0000 7f510f933740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c26549670 0x557c2654fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.588+0000 7f510f933740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c2654a9c0 0x557c265502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.588+0000 7f510f933740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c26554420 0x557c2655c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.588+0000 7f5106ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c26549670 0x557c2654fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.588+0000 7f51067fc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c2654a9c0 0x557c265502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.588+0000 7f51067fc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c2654a9c0 0x557c265502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:43762/0 (socket says 172.21.15.59:43762) 2024-09-10T21:15:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.588+0000 7f5106ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c26549670 0x557c2654fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:40254/0 (socket says 172.21.15.59:40254) 2024-09-10T21:15:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.589+0000 7f51077fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c26554420 0x557c2655c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.589+0000 7f51077fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c26554420 0x557c2655c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33480/0 (socket says 172.21.15.59:33480) 2024-09-10T21:15:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.589+0000 7f510f933740 1 -- 172.21.15.59:0/1458386246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f51081af790 con 0x557c26554420 2024-09-10T21:15:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.589+0000 7f51067fc640 1 -- 172.21.15.59:0/1458386246 learned_addr learned my addr 172.21.15.59:0/1458386246 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.589+0000 7f510f933740 1 -- 172.21.15.59:0/1458386246 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f51081af0c0 con 0x557c26549670 2024-09-10T21:15:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.589+0000 7f510f933740 1 -- 172.21.15.59:0/1458386246 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f51081ac300 con 0x557c2654a9c0 2024-09-10T21:15:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.589+0000 7f510f933740 10 client.0 _ll_register_callbacks cb 0x7f50f800d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:15:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.589+0000 7f51067fc640 1 -- 172.21.15.59:0/1458386246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c26549670 msgr2=0x557c2654fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.589+0000 7f51067fc640 1 --2- 172.21.15.59:0/1458386246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c26549670 0x557c2654fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.589+0000 7f51067fc640 1 -- 172.21.15.59:0/1458386246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c26554420 msgr2=0x557c2655c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.589+0000 7f51067fc640 1 --2- 172.21.15.59:0/1458386246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c26554420 0x557c2655c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.589+0000 7f51067fc640 1 -- 172.21.15.59:0/1458386246 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c26548950 con 0x557c2654a9c0 2024-09-10T21:15:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.589+0000 7f51067fc640 1 --2- 172.21.15.59:0/1458386246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c2654a9c0 0x557c265502c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50fc001eb0 tx=0x7f50fc005fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3338e95aedddbd25 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.589+0000 7f50eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-10T21:15:53.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.590+0000 7f50eaff5640 1 -- 172.21.15.59:0/1458386246 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc016040 con 0x557c2654a9c0 2024-09-10T21:15:53.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.590+0000 7f50eaff5640 1 -- 172.21.15.59:0/1458386246 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f50fc011670 con 0x557c2654a9c0 2024-09-10T21:15:53.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.590+0000 7f510f933740 1 -- 172.21.15.59:0/1458386246 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5100036050 con 0x557c2654a9c0 2024-09-10T21:15:53.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.590+0000 7f50eaff5640 1 -- 172.21.15.59:0/1458386246 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f50fc011870 con 0x557c2654a9c0 2024-09-10T21:15:53.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.590+0000 7f510f933740 10 client.25018 fetch_fsmap learned FSMap version 28 2024-09-10T21:15:53.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.590+0000 7f510f933740 1 -- 172.21.15.59:0/1458386246 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557c265dc690 con 0x557c2654a9c0 2024-09-10T21:15:53.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.590+0000 7f50eaff5640 1 -- 172.21.15.59:0/1458386246 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50fc02e8c0 con 0x557c2654a9c0 2024-09-10T21:15:53.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.590+0000 7f50eaff5640 1 -- 172.21.15.59:0/1458386246 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f50fc036030 con 0x557c2654a9c0 2024-09-10T21:15:53.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.590+0000 7f510f933740 10 client.25018 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:15:53.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.590+0000 7f510f933740 10 client.25018 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:15:53.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.590+0000 7f510f933740 20 client.25018 populate_metadata read hostname 'smithi059' 2024-09-10T21:15:53.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.590+0000 7f510f933740 1 --2- 172.21.15.59:0/1458386246 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557c265dcbe0 0x557c265df000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:53.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.591+0000 7f510f933740 4 client.25018 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:15:53.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.591+0000 7f510f933740 1 -- 172.21.15.59:0/1458386246 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f5100036050 con 0x557c265dcbe0 2024-09-10T21:15:53.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.591+0000 7f5106ffd640 1 --2- 172.21.15.59:0/1458386246 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557c265dcbe0 0x557c265df000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:53.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.591+0000 7f5106ffd640 1 --2- 172.21.15.59:0/1458386246 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557c265dcbe0 0x557c265df000 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d33d69d17cf120c server_cookie=68d0a9bf132f81f8 in_seq=0 out_seq=0 2024-09-10T21:15:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.591+0000 7f50eaff5640 10 client.25018 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:15:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.592+0000 7f50eaff5640 1 -- 172.21.15.59:0/1458386246 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x7f5100036050 con 0x557c265dcbe0 2024-09-10T21:15:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.592+0000 7f50eaff5640 10 client.25018 handle_command_reply: tid=0 2024-09-10T21:15:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.592+0000 7f510f933740 1 client.25018 shutdown 2024-09-10T21:15:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.592+0000 7f510f933740 1 -- 172.21.15.59:0/1458386246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c2654a9c0 msgr2=0x557c265502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.592+0000 7f510f933740 1 --2- 172.21.15.59:0/1458386246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c2654a9c0 0x557c265502c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50fc001eb0 tx=0x7f50fc005fb0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.592+0000 7f510f933740 1 -- 172.21.15.59:0/1458386246 shutdown_connections 2024-09-10T21:15:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.592+0000 7f510f933740 1 --2- 172.21.15.59:0/1458386246 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557c265dcbe0 0x557c265df000 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.592+0000 7f510f933740 1 --2- 172.21.15.59:0/1458386246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c26554420 0x557c2655c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.592+0000 7f510f933740 1 --2- 172.21.15.59:0/1458386246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557c2654a9c0 0x557c265502c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.592+0000 7f50eaff5640 0 client.25018 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:15:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.592+0000 7f510f933740 1 --2- 172.21.15.59:0/1458386246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557c26549670 0x557c2654fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.592+0000 7f510f933740 1 -- 172.21.15.59:0/1458386246 >> 172.21.15.59:0/1458386246 conn(0x557c26547ed0 msgr2=0x557c26552220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.592+0000 7f510f933740 1 -- 172.21.15.59:0/1458386246 shutdown_connections 2024-09-10T21:15:53.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.592+0000 7f510f933740 1 -- 172.21.15.59:0/1458386246 wait complete. 2024-09-10T21:15:53.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.592+0000 7f510f933740 20 client.25018 trim_cache size 0 max 16384 2024-09-10T21:15:53.599 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:15:53.599 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:15:53.599 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:15:53.599 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:15:53.599 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:15:53.599 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:15:53.599 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:15:53.599 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:15:53.600 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:15:53.600 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:15:53.600 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:15:53.600 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:15:53.600 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:15:53.600 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:15:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.593+0000 7f510d55e640 1 -- 172.21.15.59:0/3531823636 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f50f00b52e0 msgr2=0x7f50f00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.593+0000 7f510d55e640 1 --2- 172.21.15.59:0/3531823636 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f50f00b52e0 0x7f50f00b77a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5100006010 tx=0x7f5100005d80 comp rx=0 tx=0).stop 2024-09-10T21:15:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.593+0000 7f510d55e640 1 -- 172.21.15.59:0/3531823636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5108103ca0 msgr2=0x7f51081992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.593+0000 7f510d55e640 1 --2- 172.21.15.59:0/3531823636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5108103ca0 0x7f51081992d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f50f800d770 tx=0x7f50f800dc30 comp rx=0 tx=0).stop 2024-09-10T21:15:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.593+0000 7f510d55e640 1 -- 172.21.15.59:0/3531823636 shutdown_connections 2024-09-10T21:15:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.593+0000 7f510d55e640 1 --2- 172.21.15.59:0/3531823636 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f50f00b52e0 0x7f50f00b77a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.593+0000 7f510d55e640 1 --2- 172.21.15.59:0/3531823636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f510810d100 0x7f510819ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.593+0000 7f510d55e640 1 --2- 172.21.15.59:0/3531823636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51081045c0 0x7f5108199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.593+0000 7f510d55e640 1 --2- 172.21.15.59:0/3531823636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5108103ca0 0x7f51081992d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.593+0000 7f510d55e640 1 -- 172.21.15.59:0/3531823636 >> 172.21.15.59:0/3531823636 conn(0x7f51080fd700 msgr2=0x7f51080fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.593+0000 7f510d55e640 1 -- 172.21.15.59:0/3531823636 shutdown_connections 2024-09-10T21:15:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:53.593+0000 7f510d55e640 1 -- 172.21.15.59:0/3531823636 wait complete. 2024-09-10T21:15:54.560 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:15:54.560 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:15:54.927 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:15:55.275 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:54 smithi059 ceph-mon[30888]: pgmap v359: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:15:55.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:54 smithi192 ceph-mon[35363]: pgmap v359: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:15:55.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:54 smithi154 ceph-mon[35041]: pgmap v359: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T21:15:55.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.454+0000 7fb3f14ea640 1 -- 172.21.15.59:0/916284612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3ec10d100 msgr2=0x7fb3ec10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:55.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.454+0000 7fb3f14ea640 1 --2- 172.21.15.59:0/916284612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3ec10d100 0x7fb3ec10f560 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4009ca0 tx=0x7fb3e402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:15:55.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.454+0000 7fb3f14ea640 1 -- 172.21.15.59:0/916284612 shutdown_connections 2024-09-10T21:15:55.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.454+0000 7fb3f14ea640 1 --2- 172.21.15.59:0/916284612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3ec10d100 0x7fb3ec10f560 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:55.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.454+0000 7fb3f14ea640 1 --2- 172.21.15.59:0/916284612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3ec1045c0 0x7fb3ec10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:55.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.454+0000 7fb3f14ea640 1 --2- 172.21.15.59:0/916284612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3ec103ca0 0x7fb3ec104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:55.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.454+0000 7fb3f14ea640 1 -- 172.21.15.59:0/916284612 >> 172.21.15.59:0/916284612 conn(0x7fb3ec0fd700 msgr2=0x7fb3ec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:55.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.455+0000 7fb3f14ea640 1 -- 172.21.15.59:0/916284612 shutdown_connections 2024-09-10T21:15:55.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.455+0000 7fb3f14ea640 1 -- 172.21.15.59:0/916284612 wait complete. 2024-09-10T21:15:55.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.455+0000 7fb3f14ea640 1 Processor -- start 2024-09-10T21:15:55.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.456+0000 7fb3f14ea640 1 -- start start 2024-09-10T21:15:55.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.456+0000 7fb3f14ea640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3ec103ca0 0x7fb3ec199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:55.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.456+0000 7fb3f14ea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3ec1045c0 0x7fb3ec199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:55.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.456+0000 7fb3f14ea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3ec10d100 0x7fb3ec19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:55.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.456+0000 7fb3f14ea640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ec112d70 con 0x7fb3ec10d100 2024-09-10T21:15:55.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.456+0000 7fb3f14ea640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ec112bf0 con 0x7fb3ec1045c0 2024-09-10T21:15:55.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.456+0000 7fb3eb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3ec10d100 0x7fb3ec19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:55.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.456+0000 7fb3eb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3ec10d100 0x7fb3ec19eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33508/0 (socket says 172.21.15.59:33508) 2024-09-10T21:15:55.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.456+0000 7fb3eb7fe640 1 -- 172.21.15.59:0/345642791 learned_addr learned my addr 172.21.15.59:0/345642791 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:55.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.456+0000 7fb3eaffd640 1 --2- 172.21.15.59:0/345642791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3ec103ca0 0x7fb3ec199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:55.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.456+0000 7fb3f14ea640 1 -- 172.21.15.59:0/345642791 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ec112ef0 con 0x7fb3ec103ca0 2024-09-10T21:15:55.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.456+0000 7fb3ea7fc640 1 --2- 172.21.15.59:0/345642791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3ec1045c0 0x7fb3ec199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:55.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.457+0000 7fb3eb7fe640 1 -- 172.21.15.59:0/345642791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3ec103ca0 msgr2=0x7fb3ec199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:55.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.457+0000 7fb3eb7fe640 1 --2- 172.21.15.59:0/345642791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3ec103ca0 0x7fb3ec199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:55.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.457+0000 7fb3eb7fe640 1 -- 172.21.15.59:0/345642791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3ec1045c0 msgr2=0x7fb3ec199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:55.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.457+0000 7fb3eb7fe640 1 --2- 172.21.15.59:0/345642791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3ec1045c0 0x7fb3ec199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:55.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.457+0000 7fb3eb7fe640 1 -- 172.21.15.59:0/345642791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ec19f2d0 con 0x7fb3ec10d100 2024-09-10T21:15:55.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.457+0000 7fb3eb7fe640 1 --2- 172.21.15.59:0/345642791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3ec10d100 0x7fb3ec19eb00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4005cc0 tx=0x7fb3e402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:55.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.457+0000 7fb3d3fff640 1 -- 172.21.15.59:0/345642791 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4003bf0 con 0x7fb3ec10d100 2024-09-10T21:15:55.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.457+0000 7fb3d3fff640 1 -- 172.21.15.59:0/345642791 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3e4003d90 con 0x7fb3ec10d100 2024-09-10T21:15:55.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.457+0000 7fb3d3fff640 1 -- 172.21.15.59:0/345642791 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e402fb90 con 0x7fb3ec10d100 2024-09-10T21:15:55.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.458+0000 7fb3f14ea640 1 -- 172.21.15.59:0/345642791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3ec19f560 con 0x7fb3ec10d100 2024-09-10T21:15:55.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.458+0000 7fb3f14ea640 1 -- 172.21.15.59:0/345642791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3ec1a5c80 con 0x7fb3ec10d100 2024-09-10T21:15:55.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.459+0000 7fb3f14ea640 1 -- 172.21.15.59:0/345642791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3ec104080 con 0x7fb3ec10d100 2024-09-10T21:15:55.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.461+0000 7fb3d3fff640 1 -- 172.21.15.59:0/345642791 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fb3e402fd30 con 0x7fb3ec10d100 2024-09-10T21:15:55.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.462+0000 7fb3d3fff640 1 --2- 172.21.15.59:0/345642791 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb3d40b5360 0x7fb3d40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:55.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.463+0000 7fb3d3fff640 1 -- 172.21.15.59:0/345642791 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fb3e4107140 con 0x7fb3ec10d100 2024-09-10T21:15:55.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.463+0000 7fb3eaffd640 1 --2- 172.21.15.59:0/345642791 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb3d40b5360 0x7fb3d40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:55.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.463+0000 7fb3eaffd640 1 --2- 172.21.15.59:0/345642791 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb3d40b5360 0x7fb3d40b7820 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc005d00 tx=0x7fb3dc005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:55.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.466+0000 7fb3d3fff640 1 -- 172.21.15.59:0/345642791 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb3e40ce030 con 0x7fb3ec10d100 2024-09-10T21:15:55.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.823+0000 7fb3f14ea640 1 -- 172.21.15.59:0/345642791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3ec1a6070 con 0x7fb3ec10d100 2024-09-10T21:15:55.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.824+0000 7fb3d3fff640 1 -- 172.21.15.59:0/345642791 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7fb3e40cd930 con 0x7fb3ec10d100 2024-09-10T21:15:55.829 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:15:55.829 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:15:55.829 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:15:55.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.826+0000 7fb3f14ea640 1 -- 172.21.15.59:0/345642791 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb3d40b5360 msgr2=0x7fb3d40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:55.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.827+0000 7fb3f14ea640 1 --2- 172.21.15.59:0/345642791 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb3d40b5360 0x7fb3d40b7820 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc005d00 tx=0x7fb3dc005c50 comp rx=0 tx=0).stop 2024-09-10T21:15:55.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.827+0000 7fb3f14ea640 1 -- 172.21.15.59:0/345642791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3ec10d100 msgr2=0x7fb3ec19eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:55.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.827+0000 7fb3f14ea640 1 --2- 172.21.15.59:0/345642791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3ec10d100 0x7fb3ec19eb00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4005cc0 tx=0x7fb3e402f380 comp rx=0 tx=0).stop 2024-09-10T21:15:55.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.827+0000 7fb3f14ea640 1 -- 172.21.15.59:0/345642791 shutdown_connections 2024-09-10T21:15:55.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.827+0000 7fb3f14ea640 1 --2- 172.21.15.59:0/345642791 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb3d40b5360 0x7fb3d40b7820 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:55.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.827+0000 7fb3f14ea640 1 --2- 172.21.15.59:0/345642791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3ec10d100 0x7fb3ec19eb00 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:55.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.827+0000 7fb3f14ea640 1 --2- 172.21.15.59:0/345642791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3ec1045c0 0x7fb3ec199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:55.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.827+0000 7fb3f14ea640 1 --2- 172.21.15.59:0/345642791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3ec103ca0 0x7fb3ec199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:55.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.827+0000 7fb3f14ea640 1 -- 172.21.15.59:0/345642791 >> 172.21.15.59:0/345642791 conn(0x7fb3ec0fd700 msgr2=0x7fb3ec0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:55.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.827+0000 7fb3f14ea640 1 -- 172.21.15.59:0/345642791 shutdown_connections 2024-09-10T21:15:55.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:55.827+0000 7fb3f14ea640 1 -- 172.21.15.59:0/345642791 wait complete. 2024-09-10T21:15:56.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:56 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/345642791' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:15:56.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:56 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/345642791' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:15:56.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:56 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/345642791' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:15:56.529 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:15:56.892 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:15:57.319 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:57 smithi059 ceph-mon[30888]: pgmap v360: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:15:57.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:57 smithi192 ceph-mon[35363]: pgmap v360: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:15:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.403+0000 7f7e0b696640 1 -- 172.21.15.59:0/3673494755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e04105f40 msgr2=0x7f7e0410f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.403+0000 7f7e0b696640 1 --2- 172.21.15.59:0/3673494755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e04105f40 0x7f7e0410f960 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc009ca0 tx=0x7f7dfc02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.403+0000 7f7e0b696640 1 -- 172.21.15.59:0/3673494755 shutdown_connections 2024-09-10T21:15:57.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.403+0000 7f7e0b696640 1 --2- 172.21.15.59:0/3673494755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e04105f40 0x7f7e0410f960 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.403+0000 7f7e0b696640 1 --2- 172.21.15.59:0/3673494755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e041055a0 0x7f7e04105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.403+0000 7f7e0b696640 1 --2- 172.21.15.59:0/3673494755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e04101250 0x7f7e04101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.403+0000 7f7e0b696640 1 -- 172.21.15.59:0/3673494755 >> 172.21.15.59:0/3673494755 conn(0x7f7e04078140 msgr2=0x7f7e040ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:57.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.404+0000 7f7e0b696640 1 -- 172.21.15.59:0/3673494755 shutdown_connections 2024-09-10T21:15:57.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.404+0000 7f7e0b696640 1 -- 172.21.15.59:0/3673494755 wait complete. 2024-09-10T21:15:57.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.404+0000 7f7e0b696640 1 Processor -- start 2024-09-10T21:15:57.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.404+0000 7f7e0b696640 1 -- start start 2024-09-10T21:15:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.405+0000 7f7e0b696640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e04101250 0x7f7e04199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.405+0000 7f7e0b696640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e041055a0 0x7f7e041997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.405+0000 7f7e0b696640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e04105f40 0x7f7e0419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.405+0000 7f7e0b696640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7e04112e00 con 0x7f7e041055a0 2024-09-10T21:15:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.405+0000 7f7e0b696640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e04112c80 con 0x7f7e04101250 2024-09-10T21:15:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.405+0000 7f7e0b696640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7e04112f80 con 0x7f7e04105f40 2024-09-10T21:15:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.405+0000 7f7e08c31640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e041055a0 0x7f7e041997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.405+0000 7f7e08c31640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e041055a0 0x7f7e041997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33526/0 (socket says 172.21.15.59:33526) 2024-09-10T21:15:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.405+0000 7f7e08c31640 1 -- 172.21.15.59:0/4055946075 learned_addr learned my addr 172.21.15.59:0/4055946075 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.405+0000 7f7e09432640 1 --2- 172.21.15.59:0/4055946075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e04101250 0x7f7e04199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.405+0000 7f7e09c33640 1 --2- 172.21.15.59:0/4055946075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e04105f40 0x7f7e0419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:57.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.406+0000 7f7e08c31640 1 -- 172.21.15.59:0/4055946075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e04105f40 msgr2=0x7f7e0419eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.406+0000 7f7e08c31640 1 --2- 172.21.15.59:0/4055946075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e04105f40 0x7f7e0419eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.406+0000 7f7e08c31640 1 -- 172.21.15.59:0/4055946075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e04101250 msgr2=0x7f7e04199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.406+0000 7f7e08c31640 1 --2- 172.21.15.59:0/4055946075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e04101250 0x7f7e04199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.406+0000 7f7e08c31640 1 -- 172.21.15.59:0/4055946075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e0419f320 con 0x7f7e041055a0 2024-09-10T21:15:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.406+0000 7f7e08c31640 1 --2- 172.21.15.59:0/4055946075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e041055a0 0x7f7e041997b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7df400e9f0 tx=0x7f7df400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.406+0000 7f7dfa7fc640 1 -- 172.21.15.59:0/4055946075 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df400cd80 con 0x7f7e041055a0 2024-09-10T21:15:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.406+0000 7f7dfa7fc640 1 -- 172.21.15.59:0/4055946075 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7df40054d0 con 0x7f7e041055a0 2024-09-10T21:15:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.406+0000 7f7dfa7fc640 1 -- 172.21.15.59:0/4055946075 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4010690 con 0x7f7e041055a0 2024-09-10T21:15:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.406+0000 7f7e0b696640 1 -- 172.21.15.59:0/4055946075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e0419f610 con 0x7f7e041055a0 2024-09-10T21:15:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.406+0000 7f7e0b696640 1 -- 172.21.15.59:0/4055946075 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e041a5cd0 con 0x7f7e041055a0 2024-09-10T21:15:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.410+0000 7f7e0da6b740 1 Processor -- start 2024-09-10T21:15:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.410+0000 7f7e0da6b740 1 -- start start 2024-09-10T21:15:57.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.410+0000 7f7e0da6b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db330f0 0x56028db334d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.410+0000 7f7e0da6b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db33a10 0x56028db3f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.410+0000 7f7e0da6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db3f9a0 0x56028db41d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.410+0000 7f7e0da6b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56028daa9ea0 con 0x56028db3f9a0 2024-09-10T21:15:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.410+0000 7f7e0da6b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56028da992d0 con 0x56028db330f0 2024-09-10T21:15:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.410+0000 7f7e0da6b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56028da9d0e0 con 0x56028db33a10 2024-09-10T21:15:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.411+0000 7f7e09432640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db33a10 0x56028db3f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.411+0000 7f7e09432640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db33a10 0x56028db3f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:43800/0 (socket says 172.21.15.59:43800) 2024-09-10T21:15:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.411+0000 7f7e09432640 1 -- 172.21.15.59:0/2655347931 learned_addr learned my addr 172.21.15.59:0/2655347931 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.411+0000 7f7dfa7fc640 1 -- 172.21.15.59:0/4055946075 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f7df4010830 con 0x7f7e041055a0 2024-09-10T21:15:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.411+0000 7f7e09c33640 1 --2- 172.21.15.59:0/2655347931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db330f0 0x56028db334d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.411+0000 7f7e09432640 1 -- 172.21.15.59:0/2655347931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db330f0 msgr2=0x56028db334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.411+0000 7f7e09432640 1 --2- 172.21.15.59:0/2655347931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db330f0 0x56028db334d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.411+0000 7f7e09432640 1 -- 172.21.15.59:0/2655347931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db3f9a0 msgr2=0x56028db41d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.411+0000 7f7e08c31640 1 --2- 172.21.15.59:0/2655347931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db3f9a0 0x56028db41d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.411+0000 7f7e09432640 1 --2- 172.21.15.59:0/2655347931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db3f9a0 0x56028db41d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.411+0000 7f7e09432640 1 -- 172.21.15.59:0/2655347931 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56028d7f7650 con 0x56028db33a10 2024-09-10T21:15:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.412+0000 7f7e08c31640 1 --2- 172.21.15.59:0/2655347931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db3f9a0 0x56028db41d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:15:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.412+0000 7f7e09432640 1 --2- 172.21.15.59:0/2655347931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db33a10 0x56028db3f460 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000bd10 tx=0x7f7e000107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7674b9c278cdfb79 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.412+0000 7f7def7fe640 1 -- 172.21.15.59:0/2655347931 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e00004030 con 0x56028db33a10 2024-09-10T21:15:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.412+0000 7f7dfa7fc640 1 --2- 172.21.15.59:0/4055946075 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7df00b53e0 0x7f7df00b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.413+0000 7f7e09c33640 1 --2- 172.21.15.59:0/4055946075 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7df00b53e0 0x7f7df00b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.413+0000 7f7dfa7fc640 1 -- 172.21.15.59:0/4055946075 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7df40e5fe0 con 0x7f7e041055a0 2024-09-10T21:15:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.413+0000 7f7def7fe640 1 -- 172.21.15.59:0/2655347931 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e000035f0 con 0x56028db33a10 2024-09-10T21:15:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.413+0000 7f7def7fe640 1 -- 172.21.15.59:0/2655347931 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e00011770 con 0x56028db33a10 2024-09-10T21:15:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.414+0000 7f7e0da6b740 1 -- 172.21.15.59:0/2655347931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db33a10 msgr2=0x56028db3f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:57.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.414+0000 7f7e09c33640 1 --2- 172.21.15.59:0/4055946075 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7df00b53e0 0x7f7df00b78a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc006010 tx=0x7f7dfc005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.414+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/2655347931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db33a10 0x56028db3f460 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000bd10 tx=0x7f7e000107a0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.414+0000 7f7e0da6b740 1 -- 172.21.15.59:0/2655347931 shutdown_connections 2024-09-10T21:15:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.414+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/2655347931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db3f9a0 0x56028db41d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.414+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/2655347931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db33a10 0x56028db3f460 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.414+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/2655347931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db330f0 0x56028db334d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.414+0000 7f7e0da6b740 1 -- 172.21.15.59:0/2655347931 >> 172.21.15.59:0/2655347931 conn(0x56028db30f20 msgr2=0x56028db320c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.415+0000 7f7e0da6b740 1 -- 172.21.15.59:0/2655347931 shutdown_connections 2024-09-10T21:15:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.415+0000 7f7e0da6b740 1 -- 172.21.15.59:0/2655347931 wait complete. 2024-09-10T21:15:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.415+0000 7f7e0da6b740 1 -- start start 2024-09-10T21:15:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.415+0000 7f7e0da6b740 1 Processor -- start 2024-09-10T21:15:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.416+0000 7f7e0da6b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db330f0 0x56028db3f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.416+0000 7f7e0da6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db33a10 0x56028db387d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.416+0000 7f7e0da6b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db3f9a0 0x56028db38f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:57.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.416+0000 7f7e09432640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db330f0 0x56028db3f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:57.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.416+0000 7f7e09432640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db330f0 0x56028db3f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:40306/0 (socket says 172.21.15.59:40306) 2024-09-10T21:15:57.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.416+0000 7f7e08c31640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db33a10 0x56028db387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:57.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.416+0000 7f7e08c31640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db33a10 0x56028db387d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33542/0 (socket says 172.21.15.59:33542) 2024-09-10T21:15:57.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.416+0000 7f7e09432640 1 -- 172.21.15.59:0/3664787637 learned_addr learned my addr 172.21.15.59:0/3664787637 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:57.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.416+0000 7f7e0da6b740 1 -- 172.21.15.59:0/3664787637 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56028d8fa700 con 0x56028db33a10 2024-09-10T21:15:57.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.416+0000 7f7e0da6b740 1 -- 172.21.15.59:0/3664787637 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56028da34160 con 0x56028db330f0 2024-09-10T21:15:57.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.416+0000 7f7e0da6b740 1 -- 172.21.15.59:0/3664787637 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56028db42510 con 0x56028db3f9a0 2024-09-10T21:15:57.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.417+0000 7f7e09c33640 1 --2- 172.21.15.59:0/3664787637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db3f9a0 0x56028db38f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:57.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.417+0000 7f7e09c33640 1 -- 172.21.15.59:0/3664787637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db330f0 msgr2=0x56028db3f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:57.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.417+0000 7f7e09c33640 1 --2- 172.21.15.59:0/3664787637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db330f0 0x56028db3f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.417+0000 7f7e09c33640 1 -- 172.21.15.59:0/3664787637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db33a10 msgr2=0x56028db387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:57.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.417+0000 7f7e09c33640 1 --2- 172.21.15.59:0/3664787637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db33a10 0x56028db387d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.417+0000 7f7e09c33640 1 -- 172.21.15.59:0/3664787637 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56028da61c90 con 0x56028db3f9a0 2024-09-10T21:15:57.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.417+0000 7f7e08c31640 1 --2- 172.21.15.59:0/3664787637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db33a10 0x56028db387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:15:57.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.418+0000 7f7e09c33640 1 --2- 172.21.15.59:0/3664787637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db3f9a0 0x56028db38f60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc005e30 tx=0x7f7dfc02a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=631d4728a1e1f91e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:57.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.418+0000 7f7decff9640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-10T21:15:57.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.418+0000 7f7e0da6b740 10 client.0 _ll_register_callbacks cb 0x56028da4d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:15:57.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.418+0000 7f7e0da6b740 1 -- 172.21.15.59:0/3664787637 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e000035f0 con 0x56028db3f9a0 2024-09-10T21:15:57.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.418+0000 7f7decff9640 1 -- 172.21.15.59:0/3664787637 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc02f610 con 0x56028db3f9a0 2024-09-10T21:15:57.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.418+0000 7f7decff9640 1 -- 172.21.15.59:0/3664787637 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7dfc02f7b0 con 0x56028db3f9a0 2024-09-10T21:15:57.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.418+0000 7f7decff9640 1 -- 172.21.15.59:0/3664787637 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7dfc02f9b0 con 0x56028db3f9a0 2024-09-10T21:15:57.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.418+0000 7f7e0da6b740 10 client.25036 fetch_fsmap learned FSMap version 28 2024-09-10T21:15:57.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.418+0000 7f7e0da6b740 1 -- 172.21.15.59:0/3664787637 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56028db3eda0 con 0x56028db3f9a0 2024-09-10T21:15:57.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.419+0000 7f7decff9640 1 -- 172.21.15.59:0/3664787637 <== mon.1 v2:172.21.15.192:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7dfc051070 con 0x56028db3f9a0 2024-09-10T21:15:57.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.419+0000 7f7e0da6b740 10 client.25036 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:15:57.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.419+0000 7f7e0da6b740 10 client.25036 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:15:57.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.419+0000 7f7e0da6b740 20 client.25036 populate_metadata read hostname 'smithi059' 2024-09-10T21:15:57.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.419+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/3664787637 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56028db57c30 0x56028db5a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:57.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.419+0000 7f7e0da6b740 4 client.25036 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:15:57.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.419+0000 7f7e0da6b740 1 -- 172.21.15.59:0/3664787637 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7e000035f0 con 0x56028db57c30 2024-09-10T21:15:57.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.419+0000 7f7e09432640 1 --2- 172.21.15.59:0/3664787637 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56028db57c30 0x56028db5a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:57.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.420+0000 7f7e09432640 1 --2- 172.21.15.59:0/3664787637 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56028db57c30 0x56028db5a020 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=37ef427e9a30b0bd server_cookie=d9eeb863275fa74c in_seq=0 out_seq=0 2024-09-10T21:15:57.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.420+0000 7f7decff9640 10 client.25036 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:15:57.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.421+0000 7f7decff9640 1 -- 172.21.15.59:0/3664787637 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f7e000035f0 con 0x56028db57c30 2024-09-10T21:15:57.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.421+0000 7f7decff9640 10 client.25036 handle_command_reply: tid=0 2024-09-10T21:15:57.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.421+0000 7f7e0da6b740 1 client.25036 shutdown 2024-09-10T21:15:57.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.421+0000 7f7e0da6b740 1 -- 172.21.15.59:0/3664787637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db3f9a0 msgr2=0x56028db38f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:57.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.421+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/3664787637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db3f9a0 0x56028db38f60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc005e30 tx=0x7f7dfc02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.422+0000 7f7e0da6b740 1 -- 172.21.15.59:0/3664787637 shutdown_connections 2024-09-10T21:15:57.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.422+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/3664787637 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56028db57c30 0x56028db5a020 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.422+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/3664787637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db3f9a0 0x56028db38f60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.422+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/3664787637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db33a10 0x56028db387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.422+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/3664787637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db330f0 0x56028db3f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.422+0000 7f7e0da6b740 1 -- 172.21.15.59:0/3664787637 >> 172.21.15.59:0/3664787637 conn(0x56028db30f20 msgr2=0x56028db36a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:57.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.422+0000 7f7decff9640 0 client.25036 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:15:57.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.422+0000 7f7e0da6b740 1 -- 172.21.15.59:0/3664787637 shutdown_connections 2024-09-10T21:15:57.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.422+0000 7f7e0da6b740 1 -- 172.21.15.59:0/3664787637 wait complete. 2024-09-10T21:15:57.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.422+0000 7f7e0da6b740 20 client.25036 trim_cache size 0 max 16384 2024-09-10T21:15:57.438 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:57 smithi154 ceph-mon[35041]: pgmap v360: 97 pgs: 97 active+clean; 654 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T21:15:57.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.436+0000 7f7e0da6b740 1 Processor -- start 2024-09-10T21:15:57.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.436+0000 7f7e0da6b740 1 -- start start 2024-09-10T21:15:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.436+0000 7f7e0da6b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db330f0 0x56028db42d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.436+0000 7f7e0da6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db33a10 0x56028db43290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.436+0000 7f7e0da6b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db3f9a0 0x56028db37190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.436+0000 7f7e0da6b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7e041ac040 con 0x56028db33a10 2024-09-10T21:15:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.436+0000 7f7e0da6b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e041adb80 con 0x56028db3f9a0 2024-09-10T21:15:57.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.436+0000 7f7e0da6b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7e041ac710 con 0x56028db330f0 2024-09-10T21:15:57.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.436+0000 7f7e08c31640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db33a10 0x56028db43290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:57.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.436+0000 7f7e08c31640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db33a10 0x56028db43290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33548/0 (socket says 172.21.15.59:33548) 2024-09-10T21:15:57.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.436+0000 7f7e08c31640 1 -- 172.21.15.59:0/1927752355 learned_addr learned my addr 172.21.15.59:0/1927752355 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:57.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.436+0000 7f7e09432640 1 --2- 172.21.15.59:0/1927752355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db330f0 0x56028db42d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:57.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.437+0000 7f7e08c31640 1 -- 172.21.15.59:0/1927752355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db330f0 msgr2=0x56028db42d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:57.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.437+0000 7f7e08c31640 1 --2- 172.21.15.59:0/1927752355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db330f0 0x56028db42d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.437+0000 7f7e08c31640 1 -- 172.21.15.59:0/1927752355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db3f9a0 msgr2=0x56028db37190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:57.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.437+0000 7f7e09c33640 1 --2- 172.21.15.59:0/1927752355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db3f9a0 0x56028db37190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:57.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.437+0000 7f7e08c31640 1 --2- 172.21.15.59:0/1927752355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db3f9a0 0x56028db37190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.437+0000 7f7e08c31640 1 -- 172.21.15.59:0/1927752355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56028db319a0 con 0x56028db33a10 2024-09-10T21:15:57.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.437+0000 7f7e09432640 1 --2- 172.21.15.59:0/1927752355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db330f0 0x56028db42d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:15:57.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.437+0000 7f7e08c31640 1 --2- 172.21.15.59:0/1927752355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db33a10 0x56028db43290 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7df40a8cf0 tx=0x7f7df40abee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549e723e8a445ef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:57.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.437+0000 7f7deeffd640 1 -- 172.21.15.59:0/1927752355 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df40b1030 con 0x56028db33a10 2024-09-10T21:15:57.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.438+0000 7f7deeffd640 1 -- 172.21.15.59:0/1927752355 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7df4005680 con 0x56028db33a10 2024-09-10T21:15:57.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.438+0000 7f7deeffd640 1 -- 172.21.15.59:0/1927752355 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df40ab9d0 con 0x56028db33a10 2024-09-10T21:15:57.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.438+0000 7f7e0da6b740 1 -- 172.21.15.59:0/1927752355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db33a10 msgr2=0x56028db43290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:57.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.438+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/1927752355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db33a10 0x56028db43290 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7df40a8cf0 tx=0x7f7df40abee0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.439+0000 7f7e0da6b740 1 -- 172.21.15.59:0/1927752355 shutdown_connections 2024-09-10T21:15:57.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.439+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/1927752355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db3f9a0 0x56028db37190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.439+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/1927752355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db33a10 0x56028db43290 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.439+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/1927752355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db330f0 0x56028db42d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.439+0000 7f7e0da6b740 1 -- 172.21.15.59:0/1927752355 >> 172.21.15.59:0/1927752355 conn(0x56028db30f20 msgr2=0x56028db59c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:57.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.439+0000 7f7e0da6b740 1 -- 172.21.15.59:0/1927752355 shutdown_connections 2024-09-10T21:15:57.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.439+0000 7f7e0da6b740 1 -- 172.21.15.59:0/1927752355 wait complete. 2024-09-10T21:15:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.439+0000 7f7e0da6b740 1 -- start start 2024-09-10T21:15:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.439+0000 7f7e0da6b740 1 Processor -- start 2024-09-10T21:15:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.440+0000 7f7e0da6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db330f0 0x56028db54040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.440+0000 7f7e0da6b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db33a10 0x56028db54580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.440+0000 7f7e0da6b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db3f9a0 0x56028db54ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.440+0000 7f7e0da6b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7e041ad4b0 con 0x56028db330f0 2024-09-10T21:15:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.440+0000 7f7e0da6b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e041acde0 con 0x56028db3f9a0 2024-09-10T21:15:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.440+0000 7f7e0da6b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7e041aa020 con 0x56028db33a10 2024-09-10T21:15:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.440+0000 7f7e0da6b740 10 client.0 _ll_register_callbacks cb 0x7f7dfc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:15:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.440+0000 7f7e09432640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db330f0 0x56028db54040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:57.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.440+0000 7f7e09432640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db330f0 0x56028db54040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33554/0 (socket says 172.21.15.59:33554) 2024-09-10T21:15:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.440+0000 7f7e09432640 1 -- 172.21.15.59:0/1671552193 learned_addr learned my addr 172.21.15.59:0/1671552193 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.440+0000 7f7e08c31640 1 --2- 172.21.15.59:0/1671552193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db33a10 0x56028db54580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.440+0000 7f7e09c33640 1 --2- 172.21.15.59:0/1671552193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db3f9a0 0x56028db54ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.440+0000 7f7e09432640 1 -- 172.21.15.59:0/1671552193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db33a10 msgr2=0x56028db54580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.440+0000 7f7e09432640 1 --2- 172.21.15.59:0/1671552193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db33a10 0x56028db54580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.440+0000 7f7e09432640 1 -- 172.21.15.59:0/1671552193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db3f9a0 msgr2=0x56028db54ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.440+0000 7f7e09432640 1 --2- 172.21.15.59:0/1671552193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db3f9a0 0x56028db54ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.440+0000 7f7e09432640 1 -- 172.21.15.59:0/1671552193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56028db511c0 con 0x56028db330f0 2024-09-10T21:15:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.441+0000 7f7e09432640 1 --2- 172.21.15.59:0/1671552193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db330f0 0x56028db54040 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000bd10 tx=0x7f7e00005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b51a3ba8c631744 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.441+0000 7f7decff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:15:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.441+0000 7f7decff9640 1 -- 172.21.15.59:0/1671552193 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e00032070 con 0x56028db330f0 2024-09-10T21:15:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.441+0000 7f7decff9640 1 -- 172.21.15.59:0/1671552193 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7e00005450 con 0x56028db330f0 2024-09-10T21:15:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.441+0000 7f7e0da6b740 1 -- 172.21.15.59:0/1671552193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7df4005680 con 0x56028db330f0 2024-09-10T21:15:57.450 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:15:57.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.441+0000 7f7decff9640 1 -- 172.21.15.59:0/1671552193 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7e0003e050 con 0x56028db330f0 2024-09-10T21:15:57.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.441+0000 7f7e0da6b740 10 client.15441 fetch_fsmap learned FSMap version 28 2024-09-10T21:15:57.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.441+0000 7f7e0da6b740 1 -- 172.21.15.59:0/1671552193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56028db467f0 con 0x56028db330f0 2024-09-10T21:15:57.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.441+0000 7f7decff9640 1 -- 172.21.15.59:0/1671552193 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e00005650 con 0x56028db330f0 2024-09-10T21:15:57.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.442+0000 7f7decff9640 1 -- 172.21.15.59:0/1671552193 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7e0002e6f0 con 0x56028db330f0 2024-09-10T21:15:57.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.442+0000 7f7e0da6b740 10 client.15441 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:15:57.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.442+0000 7f7e0da6b740 10 client.15441 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:15:57.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.442+0000 7f7e0da6b740 20 client.15441 populate_metadata read hostname 'smithi059' 2024-09-10T21:15:57.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.442+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/1671552193 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56028db46c40 0x56028db49030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.442+0000 7f7e0da6b740 4 client.15441 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:15:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.442+0000 7f7e0da6b740 1 -- 172.21.15.59:0/1671552193 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f7df4005680 con 0x56028db46c40 2024-09-10T21:15:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.442+0000 7f7e08c31640 1 --2- 172.21.15.59:0/1671552193 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56028db46c40 0x56028db49030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.442+0000 7f7e08c31640 1 --2- 172.21.15.59:0/1671552193 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56028db46c40 0x56028db49030 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d71e606aba220d14 server_cookie=69fca79aeccfc11 in_seq=0 out_seq=0 2024-09-10T21:15:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.442+0000 7f7decff9640 10 client.15441 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:15:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.443+0000 7f7decff9640 1 -- 172.21.15.59:0/1671552193 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f7df4005680 con 0x56028db46c40 2024-09-10T21:15:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.443+0000 7f7decff9640 10 client.15441 handle_command_reply: tid=0 2024-09-10T21:15:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.443+0000 7f7e0da6b740 1 client.15441 shutdown 2024-09-10T21:15:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.443+0000 7f7e0da6b740 1 -- 172.21.15.59:0/1671552193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db330f0 msgr2=0x56028db54040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.443+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/1671552193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db330f0 0x56028db54040 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000bd10 tx=0x7f7e00005a70 comp rx=0 tx=0).stop 2024-09-10T21:15:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.443+0000 7f7e0da6b740 1 -- 172.21.15.59:0/1671552193 shutdown_connections 2024-09-10T21:15:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.443+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/1671552193 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56028db46c40 0x56028db49030 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.443+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/1671552193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56028db3f9a0 0x56028db54ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.443+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/1671552193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56028db33a10 0x56028db54580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.443+0000 7f7e0da6b740 1 --2- 172.21.15.59:0/1671552193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56028db330f0 0x56028db54040 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.443+0000 7f7e0da6b740 1 -- 172.21.15.59:0/1671552193 >> 172.21.15.59:0/1671552193 conn(0x56028db30f20 msgr2=0x56028db42d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.443+0000 7f7decff9640 0 client.15441 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:15:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.443+0000 7f7e0da6b740 1 -- 172.21.15.59:0/1671552193 shutdown_connections 2024-09-10T21:15:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.443+0000 7f7e0da6b740 1 -- 172.21.15.59:0/1671552193 wait complete. 2024-09-10T21:15:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.443+0000 7f7e0da6b740 20 client.15441 trim_cache size 0 max 16384 2024-09-10T21:15:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.444+0000 7f7e0b696640 1 -- 172.21.15.59:0/4055946075 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7df00b53e0 msgr2=0x7f7df00b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.444+0000 7f7e0b696640 1 --2- 172.21.15.59:0/4055946075 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7df00b53e0 0x7f7df00b78a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc006010 tx=0x7f7dfc005d80 comp rx=0 tx=0).stop 2024-09-10T21:15:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.444+0000 7f7e0b696640 1 -- 172.21.15.59:0/4055946075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e041055a0 msgr2=0x7f7e041997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.444+0000 7f7e0b696640 1 --2- 172.21.15.59:0/4055946075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e041055a0 0x7f7e041997b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7df400e9f0 tx=0x7f7df400edf0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.444+0000 7f7e0b696640 1 -- 172.21.15.59:0/4055946075 shutdown_connections 2024-09-10T21:15:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.444+0000 7f7e0b696640 1 --2- 172.21.15.59:0/4055946075 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7df00b53e0 0x7f7df00b78a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.444+0000 7f7e0b696640 1 --2- 172.21.15.59:0/4055946075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e04105f40 0x7f7e0419eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.444+0000 7f7e0b696640 1 --2- 172.21.15.59:0/4055946075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e041055a0 0x7f7e041997b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.444+0000 7f7e0b696640 1 --2- 172.21.15.59:0/4055946075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e04101250 0x7f7e04199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:57.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.444+0000 7f7e0b696640 1 -- 172.21.15.59:0/4055946075 >> 172.21.15.59:0/4055946075 conn(0x7f7e04078140 msgr2=0x7f7e04108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:57.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.444+0000 7f7e0b696640 1 -- 172.21.15.59:0/4055946075 shutdown_connections 2024-09-10T21:15:57.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:57.444+0000 7f7e0b696640 1 -- 172.21.15.59:0/4055946075 wait complete. 2024-09-10T21:15:58.156 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:15:58.559 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:15:59.013 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:15:59 smithi059 ceph-mon[30888]: pgmap v361: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T21:15:59.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.214+0000 7f8a70251640 1 -- 172.21.15.59:0/1055281824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a68103ca0 msgr2=0x7f8a68104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:59.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.214+0000 7f8a70251640 1 --2- 172.21.15.59:0/1055281824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a68103ca0 0x7f8a68104080 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009900 tx=0x7f8a6402a410 comp rx=0 tx=0).stop 2024-09-10T21:15:59.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.214+0000 7f8a70251640 1 -- 172.21.15.59:0/1055281824 shutdown_connections 2024-09-10T21:15:59.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.214+0000 7f8a70251640 1 --2- 172.21.15.59:0/1055281824 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6810d100 0x7f8a6810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.214+0000 7f8a70251640 1 --2- 172.21.15.59:0/1055281824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a681045c0 0x7f8a6810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.214+0000 7f8a70251640 1 --2- 172.21.15.59:0/1055281824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a68103ca0 0x7f8a68104080 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.214+0000 7f8a70251640 1 -- 172.21.15.59:0/1055281824 >> 172.21.15.59:0/1055281824 conn(0x7f8a680fd700 msgr2=0x7f8a680ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.214+0000 7f8a70251640 1 -- 172.21.15.59:0/1055281824 shutdown_connections 2024-09-10T21:15:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.214+0000 7f8a70251640 1 -- 172.21.15.59:0/1055281824 wait complete. 2024-09-10T21:15:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.215+0000 7f8a70251640 1 Processor -- start 2024-09-10T21:15:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.215+0000 7f8a70251640 1 -- start start 2024-09-10T21:15:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.215+0000 7f8a70251640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a681045c0 0x7f8a681994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.216+0000 7f8a70251640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6810d100 0x7f8a681999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.216+0000 7f8a70251640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a6819ed90 0x7f8a6819f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.216+0000 7f8a70251640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8a68112d70 con 0x7f8a6819ed90 2024-09-10T21:15:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.216+0000 7f8a70251640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8a68112bf0 con 0x7f8a681045c0 2024-09-10T21:15:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.216+0000 7f8a70251640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8a68112ef0 con 0x7f8a6810d100 2024-09-10T21:15:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.216+0000 7f8a6dfed640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a681045c0 0x7f8a681994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.216+0000 7f8a6d7ec640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6810d100 0x7f8a681999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.216+0000 7f8a6dfed640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a681045c0 0x7f8a681994b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:40042/0 (socket says 172.21.15.59:40042) 2024-09-10T21:15:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.216+0000 7f8a6e7ee640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a6819ed90 0x7f8a6819f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.216+0000 7f8a6dfed640 1 -- 172.21.15.59:0/4009677431 learned_addr learned my addr 172.21.15.59:0/4009677431 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.216+0000 7f8a6dfed640 1 -- 172.21.15.59:0/4009677431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6810d100 msgr2=0x7f8a681999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.216+0000 7f8a6dfed640 1 --2- 172.21.15.59:0/4009677431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6810d100 0x7f8a681999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.216+0000 7f8a6dfed640 1 -- 172.21.15.59:0/4009677431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a6819ed90 msgr2=0x7f8a6819f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.216+0000 7f8a6dfed640 1 --2- 172.21.15.59:0/4009677431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a6819ed90 0x7f8a6819f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.216+0000 7f8a6dfed640 1 -- 172.21.15.59:0/4009677431 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6819f920 con 0x7f8a681045c0 2024-09-10T21:15:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.216+0000 7f8a6e7ee640 1 --2- 172.21.15.59:0/4009677431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a6819ed90 0x7f8a6819f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:15:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.217+0000 7f8a6dfed640 1 --2- 172.21.15.59:0/4009677431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a681045c0 0x7f8a681994b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8a64006010 tx=0x7f8a64004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.217+0000 7f8a5effd640 1 -- 172.21.15.59:0/4009677431 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a64048070 con 0x7f8a681045c0 2024-09-10T21:15:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.217+0000 7f8a5effd640 1 -- 172.21.15.59:0/4009677431 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a6403ab20 con 0x7f8a681045c0 2024-09-10T21:15:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.217+0000 7f8a70251640 1 -- 172.21.15.59:0/4009677431 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a6819fbb0 con 0x7f8a681045c0 2024-09-10T21:15:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.217+0000 7f8a5effd640 1 -- 172.21.15.59:0/4009677431 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a64035050 con 0x7f8a681045c0 2024-09-10T21:15:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.217+0000 7f8a70251640 1 -- 172.21.15.59:0/4009677431 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a68101af0 con 0x7f8a681045c0 2024-09-10T21:15:59.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.220+0000 7f8a72626740 1 Processor -- start 2024-09-10T21:15:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.221+0000 7f8a72626740 1 -- start start 2024-09-10T21:15:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.221+0000 7f8a5effd640 1 -- 172.21.15.59:0/4009677431 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f8a6403a670 con 0x7f8a681045c0 2024-09-10T21:15:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.221+0000 7f8a72626740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578410130f0 0x5578410134d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.221+0000 7f8a72626740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557841013a10 0x557841027c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.221+0000 7f8a72626740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410281b0 0x55784102a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.221+0000 7f8a72626740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557840f89ea0 con 0x5578410281b0 2024-09-10T21:15:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.221+0000 7f8a72626740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557840f792d0 con 0x5578410130f0 2024-09-10T21:15:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.221+0000 7f8a72626740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557840f7d0e0 con 0x557841013a10 2024-09-10T21:15:59.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.221+0000 7f8a6d7ec640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410281b0 0x55784102a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:59.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.221+0000 7f8a6d7ec640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410281b0 0x55784102a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45690/0 (socket says 172.21.15.59:45690) 2024-09-10T21:15:59.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.221+0000 7f8a6d7ec640 1 -- 172.21.15.59:0/1734120856 learned_addr learned my addr 172.21.15.59:0/1734120856 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:59.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.221+0000 7f8a6e7ee640 1 --2- 172.21.15.59:0/1734120856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578410130f0 0x5578410134d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:59.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.222+0000 7f8a6dfed640 1 --2- 172.21.15.59:0/1734120856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557841013a10 0x557841027c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:59.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.222+0000 7f8a6d7ec640 1 -- 172.21.15.59:0/1734120856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557841013a10 msgr2=0x557841027c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:59.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.222+0000 7f8a6d7ec640 1 --2- 172.21.15.59:0/1734120856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557841013a10 0x557841027c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.222+0000 7f8a6d7ec640 1 -- 172.21.15.59:0/1734120856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578410130f0 msgr2=0x5578410134d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:59.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.222+0000 7f8a6d7ec640 1 --2- 172.21.15.59:0/1734120856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578410130f0 0x5578410134d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.222+0000 7f8a6d7ec640 1 -- 172.21.15.59:0/1734120856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557840cd7650 con 0x5578410281b0 2024-09-10T21:15:59.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.222+0000 7f8a6d7ec640 1 --2- 172.21.15.59:0/1734120856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410281b0 0x55784102a5a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800bc60 tx=0x7f8a5800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f788743a60ffc20 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:59.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.222+0000 7f8a5effd640 1 --2- 172.21.15.59:0/4009677431 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8a540b52e0 0x7f8a540b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:59.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.222+0000 7f8a53fff640 1 -- 172.21.15.59:0/1734120856 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a58015070 con 0x5578410281b0 2024-09-10T21:15:59.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.223+0000 7f8a53fff640 1 -- 172.21.15.59:0/1734120856 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a5801a910 con 0x5578410281b0 2024-09-10T21:15:59.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.223+0000 7f8a53fff640 1 -- 172.21.15.59:0/1734120856 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a58011860 con 0x5578410281b0 2024-09-10T21:15:59.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.223+0000 7f8a5effd640 1 -- 172.21.15.59:0/4009677431 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8a64105950 con 0x7f8a681045c0 2024-09-10T21:15:59.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.223+0000 7f8a6e7ee640 1 --2- 172.21.15.59:0/4009677431 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8a540b52e0 0x7f8a540b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:59.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.223+0000 7f8a72626740 1 -- 172.21.15.59:0/1734120856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410281b0 msgr2=0x55784102a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:59.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.223+0000 7f8a6e7ee640 1 --2- 172.21.15.59:0/4009677431 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8a540b52e0 0x7f8a540b77a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8a60005fd0 tx=0x7f8a60009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:59.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.223+0000 7f8a72626740 1 --2- 172.21.15.59:0/1734120856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410281b0 0x55784102a5a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800bc60 tx=0x7f8a5800f730 comp rx=0 tx=0).stop 2024-09-10T21:15:59.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.224+0000 7f8a72626740 1 -- 172.21.15.59:0/1734120856 shutdown_connections 2024-09-10T21:15:59.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.224+0000 7f8a72626740 1 --2- 172.21.15.59:0/1734120856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410281b0 0x55784102a5a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.224+0000 7f8a72626740 1 --2- 172.21.15.59:0/1734120856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557841013a10 0x557841027c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.224+0000 7f8a72626740 1 --2- 172.21.15.59:0/1734120856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578410130f0 0x5578410134d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.224+0000 7f8a72626740 1 -- 172.21.15.59:0/1734120856 >> 172.21.15.59:0/1734120856 conn(0x557841010f20 msgr2=0x5578410120c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:59.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.224+0000 7f8a72626740 1 -- 172.21.15.59:0/1734120856 shutdown_connections 2024-09-10T21:15:59.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.224+0000 7f8a72626740 1 -- 172.21.15.59:0/1734120856 wait complete. 2024-09-10T21:15:59.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.224+0000 7f8a72626740 1 -- start start 2024-09-10T21:15:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.225+0000 7f8a72626740 1 Processor -- start 2024-09-10T21:15:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.225+0000 7f8a72626740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578410130f0 0x557841027ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.225+0000 7f8a72626740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557841013a10 0x557841024f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.225+0000 7f8a72626740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410281b0 0x557841025510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.226+0000 7f8a6e7ee640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410281b0 0x557841025510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.226+0000 7f8a6dfed640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578410130f0 0x557841027ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.226+0000 7f8a6d7ec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557841013a10 0x557841024f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.226+0000 7f8a6dfed640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578410130f0 0x557841027ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:43668/0 (socket says 172.21.15.59:43668) 2024-09-10T21:15:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.226+0000 7f8a6e7ee640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410281b0 0x557841025510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45696/0 (socket says 172.21.15.59:45696) 2024-09-10T21:15:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.226+0000 7f8a6dfed640 1 -- 172.21.15.59:0/3413156583 learned_addr learned my addr 172.21.15.59:0/3413156583 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.226+0000 7f8a72626740 1 -- 172.21.15.59:0/3413156583 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557840dda700 con 0x5578410281b0 2024-09-10T21:15:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.226+0000 7f8a72626740 1 -- 172.21.15.59:0/3413156583 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557840f14160 con 0x557841013a10 2024-09-10T21:15:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.226+0000 7f8a72626740 1 -- 172.21.15.59:0/3413156583 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55784102ae30 con 0x5578410130f0 2024-09-10T21:15:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.226+0000 7f8a6dfed640 1 -- 172.21.15.59:0/3413156583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557841013a10 msgr2=0x557841024f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.226+0000 7f8a72626740 10 client.0 _ll_register_callbacks cb 0x557840f2d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:15:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.226+0000 7f8a6d7ec640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557841013a10 0x557841024f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:40064/0 (socket says 172.21.15.59:40064) 2024-09-10T21:15:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.226+0000 7f8a6dfed640 1 --2- 172.21.15.59:0/3413156583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557841013a10 0x557841024f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.226+0000 7f8a6dfed640 1 -- 172.21.15.59:0/3413156583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410281b0 msgr2=0x557841025510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.226+0000 7f8a6dfed640 1 --2- 172.21.15.59:0/3413156583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410281b0 0x557841025510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.226+0000 7f8a6dfed640 1 -- 172.21.15.59:0/3413156583 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557840f41c90 con 0x5578410130f0 2024-09-10T21:15:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.226+0000 7f8a6e7ee640 1 --2- 172.21.15.59:0/3413156583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410281b0 0x557841025510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:15:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.227+0000 7f8a72626740 1 -- 172.21.15.59:0/3413156583 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a5801a910 con 0x5578410130f0 2024-09-10T21:15:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.227+0000 7f8a6dfed640 1 --2- 172.21.15.59:0/3413156583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578410130f0 0x557841027ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8a640d0480 tx=0x7f8a64005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5127d8c3d9724e80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.227+0000 7f8a6d7ec640 1 --2- 172.21.15.59:0/3413156583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557841013a10 0x557841024f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:15:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.227+0000 7f8a517fa640 10 client.25051 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-10T21:15:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.227+0000 7f8a517fa640 1 -- 172.21.15.59:0/3413156583 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a640cfc60 con 0x5578410130f0 2024-09-10T21:15:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.227+0000 7f8a517fa640 1 -- 172.21.15.59:0/3413156583 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8a640d0750 con 0x5578410130f0 2024-09-10T21:15:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.227+0000 7f8a517fa640 1 -- 172.21.15.59:0/3413156583 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8a640d0950 con 0x5578410130f0 2024-09-10T21:15:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.227+0000 7f8a72626740 10 client.25051 fetch_fsmap learned FSMap version 28 2024-09-10T21:15:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.227+0000 7f8a72626740 1 -- 172.21.15.59:0/3413156583 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5578410366f0 con 0x5578410130f0 2024-09-10T21:15:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.228+0000 7f8a517fa640 1 -- 172.21.15.59:0/3413156583 <== mon.1 v2:172.21.15.192:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8a640d95f0 con 0x5578410130f0 2024-09-10T21:15:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.228+0000 7f8a72626740 10 client.25051 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:15:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.228+0000 7f8a72626740 10 client.25051 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:15:59.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.228+0000 7f8a72626740 20 client.25051 populate_metadata read hostname 'smithi059' 2024-09-10T21:15:59.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.228+0000 7f8a72626740 1 --2- 172.21.15.59:0/3413156583 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x557841037a90 0x557841039f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:59.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.228+0000 7f8a72626740 4 client.25051 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:15:59.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.228+0000 7f8a72626740 1 -- 172.21.15.59:0/3413156583 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557840f8bdf0 con 0x557841037a90 2024-09-10T21:15:59.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.228+0000 7f8a6d7ec640 1 --2- 172.21.15.59:0/3413156583 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x557841037a90 0x557841039f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:59.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.229+0000 7f8a517fa640 10 client.25051 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:15:59.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.229+0000 7f8a6d7ec640 1 --2- 172.21.15.59:0/3413156583 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x557841037a90 0x557841039f00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=56c84afd9446c564 server_cookie=e2b086175ba8424f in_seq=0 out_seq=0 2024-09-10T21:15:59.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.230+0000 7f8a517fa640 1 -- 172.21.15.59:0/3413156583 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557840f8bdf0 con 0x557841037a90 2024-09-10T21:15:59.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.230+0000 7f8a517fa640 10 client.25051 handle_command_reply: tid=0 2024-09-10T21:15:59.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.230+0000 7f8a72626740 1 client.25051 shutdown 2024-09-10T21:15:59.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.230+0000 7f8a72626740 1 -- 172.21.15.59:0/3413156583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578410130f0 msgr2=0x557841027ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:59.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.230+0000 7f8a72626740 1 --2- 172.21.15.59:0/3413156583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578410130f0 0x557841027ab0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8a640d0480 tx=0x7f8a64005d50 comp rx=0 tx=0).stop 2024-09-10T21:15:59.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.230+0000 7f8a72626740 1 -- 172.21.15.59:0/3413156583 shutdown_connections 2024-09-10T21:15:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.230+0000 7f8a72626740 1 --2- 172.21.15.59:0/3413156583 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x557841037a90 0x557841039f00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.230+0000 7f8a72626740 1 --2- 172.21.15.59:0/3413156583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410281b0 0x557841025510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.230+0000 7f8a72626740 1 --2- 172.21.15.59:0/3413156583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557841013a10 0x557841024f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.230+0000 7f8a517fa640 0 client.25051 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:15:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.230+0000 7f8a72626740 1 --2- 172.21.15.59:0/3413156583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578410130f0 0x557841027ab0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.230+0000 7f8a72626740 1 -- 172.21.15.59:0/3413156583 >> 172.21.15.59:0/3413156583 conn(0x557841010f20 msgr2=0x557841016a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.231+0000 7f8a72626740 1 -- 172.21.15.59:0/3413156583 shutdown_connections 2024-09-10T21:15:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.231+0000 7f8a72626740 1 -- 172.21.15.59:0/3413156583 wait complete. 2024-09-10T21:15:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.231+0000 7f8a72626740 20 client.25051 trim_cache size 0 max 16384 2024-09-10T21:15:59.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.257+0000 7f8a72626740 1 Processor -- start 2024-09-10T21:15:59.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.257+0000 7f8a72626740 1 -- start start 2024-09-10T21:15:59.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.258+0000 7f8a72626740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410130f0 0x557841034090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:59.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.258+0000 7f8a6dfed640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410130f0 0x557841034090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.258+0000 7f8a6dfed640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410130f0 0x557841034090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45702/0 (socket says 172.21.15.59:45702) 2024-09-10T21:15:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.258+0000 7f8a6dfed640 1 -- 172.21.15.59:0/2814441428 learned_addr learned my addr 172.21.15.59:0/2814441428 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.258+0000 7f8a72626740 1 --2- 172.21.15.59:0/2814441428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557841013a10 0x557841028fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.258+0000 7f8a72626740 1 --2- 172.21.15.59:0/2814441428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578410281b0 0x557841029520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.258+0000 7f8a72626740 1 -- 172.21.15.59:0/2814441428 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8a681ac4c0 con 0x5578410130f0 2024-09-10T21:15:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.258+0000 7f8a72626740 1 -- 172.21.15.59:0/2814441428 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8a681ae000 con 0x557841013a10 2024-09-10T21:15:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.258+0000 7f8a72626740 1 -- 172.21.15.59:0/2814441428 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8a681acb90 con 0x5578410281b0 2024-09-10T21:15:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.259+0000 7f8a6d7ec640 1 --2- 172.21.15.59:0/2814441428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557841013a10 0x557841028fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:59.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.259+0000 7f8a6dfed640 1 -- 172.21.15.59:0/2814441428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578410281b0 msgr2=0x557841029520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:59.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.259+0000 7f8a6dfed640 1 --2- 172.21.15.59:0/2814441428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578410281b0 0x557841029520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.259+0000 7f8a6dfed640 1 -- 172.21.15.59:0/2814441428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557841013a10 msgr2=0x557841028fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:59.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.259+0000 7f8a6dfed640 1 --2- 172.21.15.59:0/2814441428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557841013a10 0x557841028fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.259+0000 7f8a6dfed640 1 -- 172.21.15.59:0/2814441428 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557841013840 con 0x5578410130f0 2024-09-10T21:15:59.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.259+0000 7f8a6d7ec640 1 --2- 172.21.15.59:0/2814441428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557841013a10 0x557841028fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:15:59.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.259+0000 7f8a6dfed640 1 --2- 172.21.15.59:0/2814441428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410130f0 0x557841034090 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8a64000ea0 tx=0x7f8a640b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1254db08ba60d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.259+0000 7f8a537fe640 1 -- 172.21.15.59:0/2814441428 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a640cfc60 con 0x5578410130f0 2024-09-10T21:15:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.259+0000 7f8a537fe640 1 -- 172.21.15.59:0/2814441428 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a5801a910 con 0x5578410130f0 2024-09-10T21:15:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.259+0000 7f8a537fe640 1 -- 172.21.15.59:0/2814441428 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a640d02c0 con 0x5578410130f0 2024-09-10T21:15:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.260+0000 7f8a72626740 1 -- 172.21.15.59:0/2814441428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410130f0 msgr2=0x557841034090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.261+0000 7f8a72626740 1 --2- 172.21.15.59:0/2814441428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410130f0 0x557841034090 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8a64000ea0 tx=0x7f8a640b7000 comp rx=0 tx=0).stop 2024-09-10T21:15:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.261+0000 7f8a72626740 1 -- 172.21.15.59:0/2814441428 shutdown_connections 2024-09-10T21:15:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.261+0000 7f8a72626740 1 --2- 172.21.15.59:0/2814441428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578410281b0 0x557841029520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.261+0000 7f8a72626740 1 --2- 172.21.15.59:0/2814441428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557841013a10 0x557841028fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.261+0000 7f8a72626740 1 --2- 172.21.15.59:0/2814441428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410130f0 0x557841034090 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.261+0000 7f8a72626740 1 -- 172.21.15.59:0/2814441428 >> 172.21.15.59:0/2814441428 conn(0x557841010f20 msgr2=0x557841029fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.261+0000 7f8a72626740 1 -- 172.21.15.59:0/2814441428 shutdown_connections 2024-09-10T21:15:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.261+0000 7f8a72626740 1 -- 172.21.15.59:0/2814441428 wait complete. 2024-09-10T21:15:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.262+0000 7f8a72626740 1 -- start start 2024-09-10T21:15:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.262+0000 7f8a72626740 1 Processor -- start 2024-09-10T21:15:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.262+0000 7f8a72626740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410130f0 0x5578410302d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.262+0000 7f8a72626740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557841013a10 0x557841030810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.262+0000 7f8a72626740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578410281b0 0x55784102d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.263+0000 7f8a72626740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8a681ad930 con 0x5578410130f0 2024-09-10T21:15:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.263+0000 7f8a6dfed640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410130f0 0x5578410302d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.263+0000 7f8a72626740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8a681ad260 con 0x557841013a10 2024-09-10T21:15:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.263+0000 7f8a72626740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8a681aa4a0 con 0x5578410281b0 2024-09-10T21:15:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.263+0000 7f8a6dfed640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410130f0 0x5578410302d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45718/0 (socket says 172.21.15.59:45718) 2024-09-10T21:15:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.263+0000 7f8a6dfed640 1 -- 172.21.15.59:0/1484621736 learned_addr learned my addr 172.21.15.59:0/1484621736 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:15:59.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.263+0000 7f8a6d7ec640 1 --2- 172.21.15.59:0/1484621736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557841013a10 0x557841030810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:59.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.263+0000 7f8a72626740 10 client.0 _ll_register_callbacks cb 0x7f8a64005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:15:59.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.263+0000 7f8a6e7ee640 1 --2- 172.21.15.59:0/1484621736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578410281b0 0x55784102d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:59.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.263+0000 7f8a6d7ec640 1 -- 172.21.15.59:0/1484621736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578410281b0 msgr2=0x55784102d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:59.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.263+0000 7f8a6d7ec640 1 --2- 172.21.15.59:0/1484621736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578410281b0 0x55784102d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.263+0000 7f8a6d7ec640 1 -- 172.21.15.59:0/1484621736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410130f0 msgr2=0x5578410302d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:15:59.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.263+0000 7f8a6d7ec640 1 --2- 172.21.15.59:0/1484621736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410130f0 0x5578410302d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.263+0000 7f8a6d7ec640 1 -- 172.21.15.59:0/1484621736 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55784102d800 con 0x557841013a10 2024-09-10T21:15:59.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.263+0000 7f8a6d7ec640 1 --2- 172.21.15.59:0/1484621736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557841013a10 0x557841030810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8a58000c00 tx=0x7f8a5801a670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e355a0b50800cea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:15:59.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.263+0000 7f8a517fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-10T21:15:59.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.264+0000 7f8a517fa640 1 -- 172.21.15.59:0/1484621736 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a58027070 con 0x557841013a10 2024-09-10T21:15:59.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.264+0000 7f8a517fa640 1 -- 172.21.15.59:0/1484621736 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8a58005040 con 0x557841013a10 2024-09-10T21:15:59.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.264+0000 7f8a72626740 1 -- 172.21.15.59:0/1484621736 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a5801a910 con 0x557841013a10 2024-09-10T21:15:59.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.264+0000 7f8a517fa640 1 -- 172.21.15.59:0/1484621736 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8a58033070 con 0x557841013a10 2024-09-10T21:15:59.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.264+0000 7f8a72626740 10 client.25022 fetch_fsmap learned FSMap version 28 2024-09-10T21:15:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.264+0000 7f8a72626740 1 -- 172.21.15.59:0/1484621736 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5578410a5330 con 0x557841013a10 2024-09-10T21:15:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.264+0000 7f8a517fa640 1 -- 172.21.15.59:0/1484621736 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a5801a910 con 0x557841013a10 2024-09-10T21:15:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.265+0000 7f8a517fa640 1 -- 172.21.15.59:0/1484621736 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8a58004780 con 0x557841013a10 2024-09-10T21:15:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.265+0000 7f8a72626740 10 client.25022 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:15:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.265+0000 7f8a72626740 10 client.25022 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:15:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.265+0000 7f8a72626740 20 client.25022 populate_metadata read hostname 'smithi059' 2024-09-10T21:15:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.265+0000 7f8a72626740 1 --2- 172.21.15.59:0/1484621736 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x557841037a90 0x5578410a7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:15:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.265+0000 7f8a72626740 4 client.25022 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:15:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.265+0000 7f8a72626740 1 -- 172.21.15.59:0/1484621736 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557840f878a0 con 0x557841037a90 2024-09-10T21:15:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.265+0000 7f8a6dfed640 1 --2- 172.21.15.59:0/1484621736 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x557841037a90 0x5578410a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:15:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.266+0000 7f8a6dfed640 1 --2- 172.21.15.59:0/1484621736 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x557841037a90 0x5578410a7740 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=65379ad6b6503592 server_cookie=fb660334df24e054 in_seq=0 out_seq=0 2024-09-10T21:15:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.266+0000 7f8a517fa640 10 client.25022 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:15:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.266+0000 7f8a517fa640 1 -- 172.21.15.59:0/1484621736 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557840f878a0 con 0x557841037a90 2024-09-10T21:15:59.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.266+0000 7f8a517fa640 10 client.25022 handle_command_reply: tid=0 2024-09-10T21:15:59.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.266+0000 7f8a72626740 1 client.25022 shutdown 2024-09-10T21:15:59.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.266+0000 7f8a72626740 1 -- 172.21.15.59:0/1484621736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557841013a10 msgr2=0x557841030810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:59.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.266+0000 7f8a72626740 1 --2- 172.21.15.59:0/1484621736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557841013a10 0x557841030810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8a58000c00 tx=0x7f8a5801a670 comp rx=0 tx=0).stop 2024-09-10T21:15:59.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.266+0000 7f8a72626740 1 -- 172.21.15.59:0/1484621736 shutdown_connections 2024-09-10T21:15:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.266+0000 7f8a72626740 1 --2- 172.21.15.59:0/1484621736 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x557841037a90 0x5578410a7740 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.266+0000 7f8a517fa640 0 client.25022 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:15:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.266+0000 7f8a72626740 1 --2- 172.21.15.59:0/1484621736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578410281b0 0x55784102d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.266+0000 7f8a72626740 1 --2- 172.21.15.59:0/1484621736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557841013a10 0x557841030810 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.266+0000 7f8a72626740 1 --2- 172.21.15.59:0/1484621736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578410130f0 0x5578410302d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.266+0000 7f8a72626740 1 -- 172.21.15.59:0/1484621736 >> 172.21.15.59:0/1484621736 conn(0x557841010f20 msgr2=0x557841029fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.267+0000 7f8a72626740 1 -- 172.21.15.59:0/1484621736 shutdown_connections 2024-09-10T21:15:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.267+0000 7f8a72626740 1 -- 172.21.15.59:0/1484621736 wait complete. 2024-09-10T21:15:59.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.267+0000 7f8a72626740 20 client.25022 trim_cache size 0 max 16384 2024-09-10T21:15:59.273 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:15:59.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.268+0000 7f8a70251640 1 -- 172.21.15.59:0/4009677431 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8a540b52e0 msgr2=0x7f8a540b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:59.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.268+0000 7f8a70251640 1 --2- 172.21.15.59:0/4009677431 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8a540b52e0 0x7f8a540b77a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8a60005fd0 tx=0x7f8a60009600 comp rx=0 tx=0).stop 2024-09-10T21:15:59.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.268+0000 7f8a70251640 1 -- 172.21.15.59:0/4009677431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a681045c0 msgr2=0x7f8a681994b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:15:59.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.268+0000 7f8a70251640 1 --2- 172.21.15.59:0/4009677431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a681045c0 0x7f8a681994b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8a64006010 tx=0x7f8a64004270 comp rx=0 tx=0).stop 2024-09-10T21:15:59.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.268+0000 7f8a70251640 1 -- 172.21.15.59:0/4009677431 shutdown_connections 2024-09-10T21:15:59.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.268+0000 7f8a70251640 1 --2- 172.21.15.59:0/4009677431 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8a540b52e0 0x7f8a540b77a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.268+0000 7f8a70251640 1 --2- 172.21.15.59:0/4009677431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a6819ed90 0x7f8a6819f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.268+0000 7f8a70251640 1 --2- 172.21.15.59:0/4009677431 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a6810d100 0x7f8a681999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.268+0000 7f8a70251640 1 --2- 172.21.15.59:0/4009677431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a681045c0 0x7f8a681994b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:15:59.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.268+0000 7f8a70251640 1 -- 172.21.15.59:0/4009677431 >> 172.21.15.59:0/4009677431 conn(0x7f8a680fd700 msgr2=0x7f8a680fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:15:59.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.268+0000 7f8a70251640 1 -- 172.21.15.59:0/4009677431 shutdown_connections 2024-09-10T21:15:59.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:15:59.268+0000 7f8a70251640 1 -- 172.21.15.59:0/4009677431 wait complete. 2024-09-10T21:15:59.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:15:59 smithi192 ceph-mon[35363]: pgmap v361: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T21:15:59.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:15:59 smithi154 ceph-mon[35041]: pgmap v361: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T21:15:59.948 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:16:00.245 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:16:00.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.782+0000 7f2f00b38640 1 -- 172.21.15.59:0/2933526503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2efc101c90 msgr2=0x7f2efc102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:00.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.782+0000 7f2f00b38640 1 --2- 172.21.15.59:0/2933526503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2efc101c90 0x7f2efc102070 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009900 tx=0x7f2eec02a410 comp rx=0 tx=0).stop 2024-09-10T21:16:00.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.782+0000 7f2f00b38640 1 -- 172.21.15.59:0/2933526503 shutdown_connections 2024-09-10T21:16:00.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.782+0000 7f2f00b38640 1 --2- 172.21.15.59:0/2933526503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2efc108020 0x7f2efc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.782+0000 7f2f00b38640 1 --2- 172.21.15.59:0/2933526503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc1076a0 0x7f2efc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.782+0000 7f2f00b38640 1 --2- 172.21.15.59:0/2933526503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2efc101c90 0x7f2efc102070 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.782+0000 7f2f00b38640 1 -- 172.21.15.59:0/2933526503 >> 172.21.15.59:0/2933526503 conn(0x7f2efc0fd700 msgr2=0x7f2efc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:00.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.782+0000 7f2f00b38640 1 -- 172.21.15.59:0/2933526503 shutdown_connections 2024-09-10T21:16:00.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.782+0000 7f2f00b38640 1 -- 172.21.15.59:0/2933526503 wait complete. 2024-09-10T21:16:00.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.783+0000 7f2f00b38640 1 Processor -- start 2024-09-10T21:16:00.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.783+0000 7f2f00b38640 1 -- start start 2024-09-10T21:16:00.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.784+0000 7f2f00b38640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2efc101c90 0x7f2efc113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:00.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.784+0000 7f2f00b38640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc1076a0 0x7f2efc112460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:00.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.784+0000 7f2f00b38640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2efc108020 0x7f2efc112a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:00.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.784+0000 7f2f00b38640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc111ce0 con 0x7f2efc101c90 2024-09-10T21:16:00.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.784+0000 7f2f00b38640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc111b60 con 0x7f2efc1076a0 2024-09-10T21:16:00.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.784+0000 7f2f00b38640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc111e60 con 0x7f2efc108020 2024-09-10T21:16:00.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.784+0000 7f2efa59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2efc101c90 0x7f2efc113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:00.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.784+0000 7f2efa59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2efc101c90 0x7f2efc113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45726/0 (socket says 172.21.15.59:45726) 2024-09-10T21:16:00.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.784+0000 7f2efa59c640 1 -- 172.21.15.59:0/39195727 learned_addr learned my addr 172.21.15.59:0/39195727 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:00.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.784+0000 7f2efad9d640 1 --2- 172.21.15.59:0/39195727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2efc108020 0x7f2efc112a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:00.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.784+0000 7f2ef3fff640 1 --2- 172.21.15.59:0/39195727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc1076a0 0x7f2efc112460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:00.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.784+0000 7f2efa59c640 1 -- 172.21.15.59:0/39195727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2efc108020 msgr2=0x7f2efc112a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:00.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.784+0000 7f2efa59c640 1 --2- 172.21.15.59:0/39195727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2efc108020 0x7f2efc112a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.784+0000 7f2efa59c640 1 -- 172.21.15.59:0/39195727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc1076a0 msgr2=0x7f2efc112460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:00.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.784+0000 7f2efa59c640 1 --2- 172.21.15.59:0/39195727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc1076a0 0x7f2efc112460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.784+0000 7f2efa59c640 1 -- 172.21.15.59:0/39195727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2efc1a7800 con 0x7f2efc101c90 2024-09-10T21:16:00.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.785+0000 7f2efa59c640 1 --2- 172.21.15.59:0/39195727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2efc101c90 0x7f2efc113fa0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2eec006010 tx=0x7f2eec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:00.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.785+0000 7f2ef37fe640 1 -- 172.21.15.59:0/39195727 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec03f030 con 0x7f2efc101c90 2024-09-10T21:16:00.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.785+0000 7f2ef37fe640 1 -- 172.21.15.59:0/39195727 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2eec003800 con 0x7f2efc101c90 2024-09-10T21:16:00.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.785+0000 7f2f00b38640 1 -- 172.21.15.59:0/39195727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2efc1a79d0 con 0x7f2efc101c90 2024-09-10T21:16:00.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.785+0000 7f2ef37fe640 1 -- 172.21.15.59:0/39195727 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec035070 con 0x7f2efc101c90 2024-09-10T21:16:00.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.786+0000 7f2f00b38640 1 -- 172.21.15.59:0/39195727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2efc1a7e00 con 0x7f2efc101c90 2024-09-10T21:16:00.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.789+0000 7f2ef37fe640 1 -- 172.21.15.59:0/39195727 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f2eec031b10 con 0x7f2efc101c90 2024-09-10T21:16:00.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.790+0000 7f2f02f0d740 1 Processor -- start 2024-09-10T21:16:00.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.790+0000 7f2ef37fe640 1 --2- 172.21.15.59:0/39195727 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2ee80b5360 0x7f2ee80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:00.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.790+0000 7f2f02f0d740 1 -- start start 2024-09-10T21:16:00.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.790+0000 7f2efad9d640 1 --2- 172.21.15.59:0/39195727 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2ee80b5360 0x7f2ee80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:00.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.791+0000 7f2ef37fe640 1 -- 172.21.15.59:0/39195727 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2eec105fa0 con 0x7f2efc101c90 2024-09-10T21:16:00.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.791+0000 7f2f02f0d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e149f4d0 0x5631e149f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:00.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.791+0000 7f2efad9d640 1 --2- 172.21.15.59:0/39195727 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2ee80b5360 0x7f2ee80b7820 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4007e30 tx=0x7f2ef4007520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:00.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.791+0000 7f2efa59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e149f4d0 0x5631e149f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:00.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.791+0000 7f2efa59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e149f4d0 0x5631e149f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:43720/0 (socket says 172.21.15.59:43720) 2024-09-10T21:16:00.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.791+0000 7f2efa59c640 1 -- 172.21.15.59:0/1165409444 learned_addr learned my addr 172.21.15.59:0/1165409444 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:00.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.792+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/1165409444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e149fdf0 0x5631e14ab840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:00.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.792+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/1165409444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e14abd80 0x5631e14ae170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:00.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.792+0000 7f2f02f0d740 1 -- 172.21.15.59:0/1165409444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5631e1415ea0 con 0x5631e14abd80 2024-09-10T21:16:00.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.792+0000 7f2f02f0d740 1 -- 172.21.15.59:0/1165409444 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5631e14052d0 con 0x5631e149fdf0 2024-09-10T21:16:00.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.792+0000 7f2f02f0d740 1 -- 172.21.15.59:0/1165409444 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5631e14090e0 con 0x5631e149f4d0 2024-09-10T21:16:00.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.792+0000 7f2ef3fff640 1 --2- 172.21.15.59:0/1165409444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e149fdf0 0x5631e14ab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:00.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.792+0000 7f2efad9d640 1 --2- 172.21.15.59:0/1165409444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e14abd80 0x5631e14ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:00.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.792+0000 7f2ef3fff640 1 -- 172.21.15.59:0/1165409444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e149f4d0 msgr2=0x5631e149f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:00.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.792+0000 7f2ef3fff640 1 --2- 172.21.15.59:0/1165409444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e149f4d0 0x5631e149f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.792+0000 7f2ef3fff640 1 -- 172.21.15.59:0/1165409444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e14abd80 msgr2=0x5631e14ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:00.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.793+0000 7f2ef3fff640 1 --2- 172.21.15.59:0/1165409444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e14abd80 0x5631e14ae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.793+0000 7f2ef3fff640 1 -- 172.21.15.59:0/1165409444 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631e1163650 con 0x5631e149fdf0 2024-09-10T21:16:00.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.793+0000 7f2efad9d640 1 --2- 172.21.15.59:0/1165409444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e14abd80 0x5631e14ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:16:00.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.793+0000 7f2ef3fff640 1 --2- 172.21.15.59:0/1165409444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e149fdf0 0x5631e14ab840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400b730 tx=0x7f2ee400bbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6e12d76775d801f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:00.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.793+0000 7f2ef0ff9640 1 -- 172.21.15.59:0/1165409444 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400be40 con 0x5631e149fdf0 2024-09-10T21:16:00.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.793+0000 7f2ef0ff9640 1 -- 172.21.15.59:0/1165409444 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ee4019070 con 0x5631e149fdf0 2024-09-10T21:16:00.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.793+0000 7f2ef0ff9640 1 -- 172.21.15.59:0/1165409444 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4014dc0 con 0x5631e149fdf0 2024-09-10T21:16:00.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.794+0000 7f2f02f0d740 1 -- 172.21.15.59:0/1165409444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e149fdf0 msgr2=0x5631e14ab840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:00.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.794+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/1165409444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e149fdf0 0x5631e14ab840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400b730 tx=0x7f2ee400bbf0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.794+0000 7f2f02f0d740 1 -- 172.21.15.59:0/1165409444 shutdown_connections 2024-09-10T21:16:00.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.794+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/1165409444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e14abd80 0x5631e14ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.794+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/1165409444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e149fdf0 0x5631e14ab840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.794+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/1165409444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e149f4d0 0x5631e149f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.794+0000 7f2f02f0d740 1 -- 172.21.15.59:0/1165409444 >> 172.21.15.59:0/1165409444 conn(0x5631e149d300 msgr2=0x5631e149e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:00.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.794+0000 7f2f02f0d740 1 -- 172.21.15.59:0/1165409444 shutdown_connections 2024-09-10T21:16:00.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.794+0000 7f2f02f0d740 1 -- 172.21.15.59:0/1165409444 wait complete. 2024-09-10T21:16:00.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.795+0000 7f2f02f0d740 1 -- start start 2024-09-10T21:16:00.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.795+0000 7f2f02f0d740 1 Processor -- start 2024-09-10T21:16:00.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.795+0000 7f2f02f0d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e149f4d0 0x5631e14ab670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:00.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.795+0000 7f2f02f0d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e149fdf0 0x5631e14a8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:00.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.795+0000 7f2f02f0d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e14abd80 0x5631e14a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:00.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.795+0000 7f2f02f0d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5631e1266700 con 0x5631e149fdf0 2024-09-10T21:16:00.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.795+0000 7f2f02f0d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5631e13a0160 con 0x5631e149f4d0 2024-09-10T21:16:00.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.795+0000 7f2f02f0d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5631e14aea00 con 0x5631e14abd80 2024-09-10T21:16:00.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.795+0000 7f2f02f0d740 10 client.0 _ll_register_callbacks cb 0x5631e13b99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:00.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.796+0000 7f2efad9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e14abd80 0x5631e14a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:00.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.796+0000 7f2ef3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e149fdf0 0x5631e14a8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:00.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.796+0000 7f2efad9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e14abd80 0x5631e14a90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:43728/0 (socket says 172.21.15.59:43728) 2024-09-10T21:16:00.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.796+0000 7f2efad9d640 1 -- 172.21.15.59:0/1909376249 learned_addr learned my addr 172.21.15.59:0/1909376249 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:00.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.796+0000 7f2efad9d640 1 -- 172.21.15.59:0/1909376249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e149f4d0 msgr2=0x5631e14ab670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:16:00.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.796+0000 7f2efad9d640 1 --2- 172.21.15.59:0/1909376249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e149f4d0 0x5631e14ab670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.796+0000 7f2efad9d640 1 -- 172.21.15.59:0/1909376249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e149fdf0 msgr2=0x5631e14a8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:00.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.796+0000 7f2efad9d640 1 --2- 172.21.15.59:0/1909376249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e149fdf0 0x5631e14a8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.796+0000 7f2efad9d640 1 -- 172.21.15.59:0/1909376249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631e13cdc90 con 0x5631e14abd80 2024-09-10T21:16:00.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.796+0000 7f2ef3fff640 1 --2- 172.21.15.59:0/1909376249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e149fdf0 0x5631e14a8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:16:00.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.796+0000 7f2efad9d640 1 --2- 172.21.15.59:0/1909376249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e14abd80 0x5631e14a90f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ef401c3b0 tx=0x7f2ef4004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74cbfa2aa3fbcfd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.796+0000 7f2ee1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-10T21:16:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.797+0000 7f2ee1ffb640 1 -- 172.21.15.59:0/1909376249 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4033060 con 0x5631e14abd80 2024-09-10T21:16:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.797+0000 7f2ee1ffb640 1 -- 172.21.15.59:0/1909376249 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2ef40195b0 con 0x5631e14abd80 2024-09-10T21:16:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.797+0000 7f2f02f0d740 1 -- 172.21.15.59:0/1909376249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ee4019070 con 0x5631e14abd80 2024-09-10T21:16:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.797+0000 7f2ee1ffb640 1 -- 172.21.15.59:0/1909376249 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2ef40197b0 con 0x5631e14abd80 2024-09-10T21:16:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.797+0000 7f2f02f0d740 10 client.25063 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.797+0000 7f2f02f0d740 1 -- 172.21.15.59:0/1909376249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5631e14ba390 con 0x5631e14abd80 2024-09-10T21:16:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.797+0000 7f2ee1ffb640 1 -- 172.21.15.59:0/1909376249 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ee4019070 con 0x5631e14abd80 2024-09-10T21:16:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.797+0000 7f2ee1ffb640 1 -- 172.21.15.59:0/1909376249 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2ef402e9b0 con 0x5631e14abd80 2024-09-10T21:16:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.797+0000 7f2f02f0d740 10 client.25063 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.798+0000 7f2f02f0d740 10 client.25063 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:16:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.798+0000 7f2f02f0d740 20 client.25063 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:00.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.798+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/1909376249 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5631e14bb8a0 0x5631e14bdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.798+0000 7f2f02f0d740 4 client.25063 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:16:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.798+0000 7f2f02f0d740 1 -- 172.21.15.59:0/1909376249 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631e1417df0 con 0x5631e14bb8a0 2024-09-10T21:16:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.798+0000 7f2efa59c640 1 --2- 172.21.15.59:0/1909376249 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5631e14bb8a0 0x5631e14bdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.798+0000 7f2efa59c640 1 --2- 172.21.15.59:0/1909376249 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5631e14bb8a0 0x5631e14bdce0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6960367131ad43ff server_cookie=ce5fd27fb06d7b88 in_seq=0 out_seq=0 2024-09-10T21:16:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.798+0000 7f2ee1ffb640 10 client.25063 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:16:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.799+0000 7f2ee1ffb640 1 -- 172.21.15.59:0/1909376249 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5631e1417df0 con 0x5631e14bb8a0 2024-09-10T21:16:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.799+0000 7f2ee1ffb640 10 client.25063 handle_command_reply: tid=0 2024-09-10T21:16:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.799+0000 7f2f02f0d740 1 client.25063 shutdown 2024-09-10T21:16:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.799+0000 7f2f02f0d740 1 -- 172.21.15.59:0/1909376249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e14abd80 msgr2=0x5631e14a90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.799+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/1909376249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e14abd80 0x5631e14a90f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ef401c3b0 tx=0x7f2ef4004ab0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.799+0000 7f2f02f0d740 1 -- 172.21.15.59:0/1909376249 shutdown_connections 2024-09-10T21:16:00.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.799+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/1909376249 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5631e14bb8a0 0x5631e14bdce0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.799+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/1909376249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e14abd80 0x5631e14a90f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.799+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/1909376249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e149fdf0 0x5631e14a8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.799+0000 7f2ee1ffb640 0 client.25063 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:16:00.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.799+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/1909376249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e149f4d0 0x5631e14ab670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.800+0000 7f2f02f0d740 1 -- 172.21.15.59:0/1909376249 >> 172.21.15.59:0/1909376249 conn(0x5631e149d300 msgr2=0x5631e14a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:00.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.800+0000 7f2f02f0d740 1 -- 172.21.15.59:0/1909376249 shutdown_connections 2024-09-10T21:16:00.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.800+0000 7f2f02f0d740 1 -- 172.21.15.59:0/1909376249 wait complete. 2024-09-10T21:16:00.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.800+0000 7f2f02f0d740 20 client.25063 trim_cache size 0 max 16384 2024-09-10T21:16:00.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.826+0000 7f2f02f0d740 1 Processor -- start 2024-09-10T21:16:00.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.826+0000 7f2f02f0d740 1 -- start start 2024-09-10T21:16:00.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.826+0000 7f2f02f0d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e149f4d0 0x5631e14b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:00.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.826+0000 7f2f02f0d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e149fdf0 0x5631e14a7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:00.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.826+0000 7f2f02f0d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e14abd80 0x5631e14a7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:00.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.826+0000 7f2f02f0d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc1ac060 con 0x5631e14abd80 2024-09-10T21:16:00.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.826+0000 7f2f02f0d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc1adba0 con 0x5631e149fdf0 2024-09-10T21:16:00.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.826+0000 7f2f02f0d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc1ac730 con 0x5631e149f4d0 2024-09-10T21:16:00.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.826+0000 7f2efad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e14abd80 0x5631e14a7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:00.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.827+0000 7f2efad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e14abd80 0x5631e14a7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45734/0 (socket says 172.21.15.59:45734) 2024-09-10T21:16:00.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.827+0000 7f2efad9d640 1 -- 172.21.15.59:0/608934147 learned_addr learned my addr 172.21.15.59:0/608934147 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:00.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.827+0000 7f2efa59c640 1 --2- 172.21.15.59:0/608934147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e149f4d0 0x5631e14b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:00.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.827+0000 7f2ef3fff640 1 --2- 172.21.15.59:0/608934147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e149fdf0 0x5631e14a7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:00.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.827+0000 7f2efa59c640 1 -- 172.21.15.59:0/608934147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e149fdf0 msgr2=0x5631e14a7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:00.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.827+0000 7f2efa59c640 1 --2- 172.21.15.59:0/608934147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e149fdf0 0x5631e14a7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.827+0000 7f2efa59c640 1 -- 172.21.15.59:0/608934147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e14abd80 msgr2=0x5631e14a7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:00.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.827+0000 7f2efa59c640 1 --2- 172.21.15.59:0/608934147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e14abd80 0x5631e14a7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.827+0000 7f2efa59c640 1 -- 172.21.15.59:0/608934147 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631e14a37e0 con 0x5631e149f4d0 2024-09-10T21:16:00.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.827+0000 7f2efad9d640 1 --2- 172.21.15.59:0/608934147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e14abd80 0x5631e14a7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:16:00.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.827+0000 7f2efa59c640 1 --2- 172.21.15.59:0/608934147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e149f4d0 0x5631e14b7c30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2eec0c9aa0 tx=0x7f2eec103f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=815095c01deed9b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:00.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.827+0000 7f2ee3fff640 1 -- 172.21.15.59:0/608934147 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec049040 con 0x5631e149f4d0 2024-09-10T21:16:00.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.827+0000 7f2ee3fff640 1 -- 172.21.15.59:0/608934147 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2eec0ccf30 con 0x5631e149f4d0 2024-09-10T21:16:00.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.827+0000 7f2ee3fff640 1 -- 172.21.15.59:0/608934147 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec003cb0 con 0x5631e149f4d0 2024-09-10T21:16:00.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.828+0000 7f2f02f0d740 1 -- 172.21.15.59:0/608934147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e149f4d0 msgr2=0x5631e14b7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:00.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.828+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/608934147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e149f4d0 0x5631e14b7c30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2eec0c9aa0 tx=0x7f2eec103f90 comp rx=0 tx=0).stop 2024-09-10T21:16:00.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.828+0000 7f2f02f0d740 1 -- 172.21.15.59:0/608934147 shutdown_connections 2024-09-10T21:16:00.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.828+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/608934147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e14abd80 0x5631e14a7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.828+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/608934147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e149fdf0 0x5631e14a7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.828+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/608934147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e149f4d0 0x5631e14b7c30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.828+0000 7f2f02f0d740 1 -- 172.21.15.59:0/608934147 >> 172.21.15.59:0/608934147 conn(0x5631e149d300 msgr2=0x5631e14a3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:00.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.828+0000 7f2f02f0d740 1 -- 172.21.15.59:0/608934147 shutdown_connections 2024-09-10T21:16:00.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.828+0000 7f2f02f0d740 1 -- 172.21.15.59:0/608934147 wait complete. 2024-09-10T21:16:00.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.829+0000 7f2f02f0d740 1 -- start start 2024-09-10T21:16:00.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.829+0000 7f2f02f0d740 1 Processor -- start 2024-09-10T21:16:00.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.829+0000 7f2f02f0d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e149f4d0 0x5631e14b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:00.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.829+0000 7f2f02f0d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e149fdf0 0x5631e14b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:00.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.829+0000 7f2f02f0d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e14abd80 0x5631e14aec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:00.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.829+0000 7f2f02f0d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc1ad4d0 con 0x5631e149f4d0 2024-09-10T21:16:00.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.829+0000 7f2f02f0d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc1ace00 con 0x5631e14abd80 2024-09-10T21:16:00.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.829+0000 7f2f02f0d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2efc1aa040 con 0x5631e149fdf0 2024-09-10T21:16:00.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.829+0000 7f2f02f0d740 10 client.0 _ll_register_callbacks cb 0x7f2ef4010510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:00.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.830+0000 7f2ef3fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e149fdf0 0x5631e14b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:00.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.830+0000 7f2efad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e14abd80 0x5631e14aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:00.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.830+0000 7f2efad9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e14abd80 0x5631e14aec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:40132/0 (socket says 172.21.15.59:40132) 2024-09-10T21:16:00.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.830+0000 7f2ef3fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e149fdf0 0x5631e14b41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:43744/0 (socket says 172.21.15.59:43744) 2024-09-10T21:16:00.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.830+0000 7f2efad9d640 1 -- 172.21.15.59:0/3353222958 learned_addr learned my addr 172.21.15.59:0/3353222958 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:00.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.830+0000 7f2efad9d640 1 -- 172.21.15.59:0/3353222958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e149fdf0 msgr2=0x5631e14b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:00.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.830+0000 7f2efad9d640 1 --2- 172.21.15.59:0/3353222958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e149fdf0 0x5631e14b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.830+0000 7f2efad9d640 1 -- 172.21.15.59:0/3353222958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e149f4d0 msgr2=0x5631e14b3ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:16:00.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.830+0000 7f2efad9d640 1 --2- 172.21.15.59:0/3353222958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e149f4d0 0x5631e14b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.830+0000 7f2efad9d640 1 -- 172.21.15.59:0/3353222958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631e14af190 con 0x5631e14abd80 2024-09-10T21:16:00.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.830+0000 7f2ef3fff640 1 --2- 172.21.15.59:0/3353222958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e149fdf0 0x5631e14b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:16:00.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.831+0000 7f2efad9d640 1 --2- 172.21.15.59:0/3353222958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e14abd80 0x5631e14aec50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2ef402eda0 tx=0x7f2ef4007fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff4ff6c1b866721a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:00.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.831+0000 7f2ee1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-10T21:16:00.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.831+0000 7f2ee1ffb640 1 -- 172.21.15.59:0/3353222958 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef403e070 con 0x5631e14abd80 2024-09-10T21:16:00.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.831+0000 7f2ee1ffb640 1 -- 172.21.15.59:0/3353222958 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2ef402e3e0 con 0x5631e14abd80 2024-09-10T21:16:00.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.831+0000 7f2f02f0d740 1 -- 172.21.15.59:0/3353222958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2eec0ccf30 con 0x5631e14abd80 2024-09-10T21:16:00.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.831+0000 7f2ee1ffb640 1 -- 172.21.15.59:0/3353222958 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2ef401cc40 con 0x5631e14abd80 2024-09-10T21:16:00.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.831+0000 7f2f02f0d740 10 client.25034 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:00.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.831+0000 7f2f02f0d740 1 -- 172.21.15.59:0/3353222958 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5631e1528ff0 con 0x5631e14abd80 2024-09-10T21:16:00.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.832+0000 7f2ee1ffb640 1 -- 172.21.15.59:0/3353222958 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2eec0ccf30 con 0x5631e14abd80 2024-09-10T21:16:00.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.832+0000 7f2ee1ffb640 1 -- 172.21.15.59:0/3353222958 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2ef4039a10 con 0x5631e14abd80 2024-09-10T21:16:00.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.832+0000 7f2f02f0d740 10 client.25034 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:00.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.832+0000 7f2f02f0d740 10 client.25034 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:16:00.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.832+0000 7f2f02f0d740 20 client.25034 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:00.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.832+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/3353222958 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5631e14bb8a0 0x5631e152b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:00.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.832+0000 7f2f02f0d740 4 client.25034 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:16:00.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.832+0000 7f2f02f0d740 1 -- 172.21.15.59:0/3353222958 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5631e14138a0 con 0x5631e14bb8a0 2024-09-10T21:16:00.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.832+0000 7f2efa59c640 1 --2- 172.21.15.59:0/3353222958 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5631e14bb8a0 0x5631e152b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:00.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.833+0000 7f2ee1ffb640 10 client.25034 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:16:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.833+0000 7f2efa59c640 1 --2- 172.21.15.59:0/3353222958 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5631e14bb8a0 0x5631e152b6d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e34b578e4198b454 server_cookie=9951f9ddc4913cfc in_seq=0 out_seq=0 2024-09-10T21:16:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.833+0000 7f2ee1ffb640 1 -- 172.21.15.59:0/3353222958 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5631e14138a0 con 0x5631e14bb8a0 2024-09-10T21:16:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.833+0000 7f2ee1ffb640 10 client.25034 handle_command_reply: tid=0 2024-09-10T21:16:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.833+0000 7f2f02f0d740 1 client.25034 shutdown 2024-09-10T21:16:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.833+0000 7f2f02f0d740 1 -- 172.21.15.59:0/3353222958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e14abd80 msgr2=0x5631e14aec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.833+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/3353222958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e14abd80 0x5631e14aec50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2ef402eda0 tx=0x7f2ef4007fd0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.833+0000 7f2f02f0d740 1 -- 172.21.15.59:0/3353222958 shutdown_connections 2024-09-10T21:16:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.833+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/3353222958 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5631e14bb8a0 0x5631e152b6d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.833+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/3353222958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5631e14abd80 0x5631e14aec50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.833+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/3353222958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5631e149fdf0 0x5631e14b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.833+0000 7f2f02f0d740 1 --2- 172.21.15.59:0/3353222958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5631e149f4d0 0x5631e14b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.833+0000 7f2f02f0d740 1 -- 172.21.15.59:0/3353222958 >> 172.21.15.59:0/3353222958 conn(0x5631e149d300 msgr2=0x5631e14aa0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:00.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.833+0000 7f2ee1ffb640 0 client.25034 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:16:00.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.834+0000 7f2f02f0d740 1 -- 172.21.15.59:0/3353222958 shutdown_connections 2024-09-10T21:16:00.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.834+0000 7f2f02f0d740 1 -- 172.21.15.59:0/3353222958 wait complete. 2024-09-10T21:16:00.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.834+0000 7f2f02f0d740 20 client.25034 trim_cache size 0 max 16384 2024-09-10T21:16:00.842 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:16:00.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.834+0000 7f2f00b38640 1 -- 172.21.15.59:0/39195727 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2ee80b5360 msgr2=0x7f2ee80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:00.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.834+0000 7f2f00b38640 1 --2- 172.21.15.59:0/39195727 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2ee80b5360 0x7f2ee80b7820 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4007e30 tx=0x7f2ef4007520 comp rx=0 tx=0).stop 2024-09-10T21:16:00.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.834+0000 7f2f00b38640 1 -- 172.21.15.59:0/39195727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2efc101c90 msgr2=0x7f2efc113fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:00.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.834+0000 7f2f00b38640 1 --2- 172.21.15.59:0/39195727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2efc101c90 0x7f2efc113fa0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2eec006010 tx=0x7f2eec0042f0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.835+0000 7f2f00b38640 1 -- 172.21.15.59:0/39195727 shutdown_connections 2024-09-10T21:16:00.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.835+0000 7f2f00b38640 1 --2- 172.21.15.59:0/39195727 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2ee80b5360 0x7f2ee80b7820 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.835+0000 7f2f00b38640 1 --2- 172.21.15.59:0/39195727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2efc108020 0x7f2efc112a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.835+0000 7f2f00b38640 1 --2- 172.21.15.59:0/39195727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2efc1076a0 0x7f2efc112460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.835+0000 7f2f00b38640 1 --2- 172.21.15.59:0/39195727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2efc101c90 0x7f2efc113fa0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:00.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.835+0000 7f2f00b38640 1 -- 172.21.15.59:0/39195727 >> 172.21.15.59:0/39195727 conn(0x7f2efc0fd700 msgr2=0x7f2efc06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:00.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.835+0000 7f2f00b38640 1 -- 172.21.15.59:0/39195727 shutdown_connections 2024-09-10T21:16:00.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:00.835+0000 7f2f00b38640 1 -- 172.21.15.59:0/39195727 wait complete. 2024-09-10T21:16:01.313 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:01 smithi059 ceph-mon[30888]: pgmap v362: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T21:16:01.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:01 smithi192 ceph-mon[35363]: pgmap v362: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T21:16:01.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:01 smithi154 ceph-mon[35041]: pgmap v362: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T21:16:01.625 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:16:01.929 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:16:02.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.417+0000 7f29c7e23640 1 -- 172.21.15.59:0/29661797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0103b70 msgr2=0x7f29c0103f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:02.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.417+0000 7f29c7e23640 1 --2- 172.21.15.59:0/29661797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0103b70 0x7f29c0103f50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009900 tx=0x7f29bc02a410 comp rx=0 tx=0).stop 2024-09-10T21:16:02.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.417+0000 7f29c7e23640 1 -- 172.21.15.59:0/29661797 shutdown_connections 2024-09-10T21:16:02.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.417+0000 7f29c7e23640 1 --2- 172.21.15.59:0/29661797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29c010d120 0x7f29c010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.417+0000 7f29c7e23640 1 --2- 172.21.15.59:0/29661797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29c0104570 0x7f29c010cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.417+0000 7f29c7e23640 1 --2- 172.21.15.59:0/29661797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0103b70 0x7f29c0103f50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.417+0000 7f29c7e23640 1 -- 172.21.15.59:0/29661797 >> 172.21.15.59:0/29661797 conn(0x7f29c00fd700 msgr2=0x7f29c00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:02.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.417+0000 7f29c7e23640 1 -- 172.21.15.59:0/29661797 shutdown_connections 2024-09-10T21:16:02.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.417+0000 7f29c7e23640 1 -- 172.21.15.59:0/29661797 wait complete. 2024-09-10T21:16:02.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.418+0000 7f29c7e23640 1 Processor -- start 2024-09-10T21:16:02.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.418+0000 7f29c7e23640 1 -- start start 2024-09-10T21:16:02.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.418+0000 7f29c7e23640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0103b70 0x7f29c0199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:02.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.418+0000 7f29c7e23640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29c0104570 0x7f29c01997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:02.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.418+0000 7f29c7e23640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29c010d120 0x7f29c019eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:02.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.418+0000 7f29c7e23640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f29c0112d60 con 0x7f29c0103b70 2024-09-10T21:16:02.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.418+0000 7f29c7e23640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f29c0112be0 con 0x7f29c010d120 2024-09-10T21:16:02.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.418+0000 7f29c7e23640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f29c0112ee0 con 0x7f29c0104570 2024-09-10T21:16:02.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.418+0000 7f29c5bbf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0103b70 0x7f29c0199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:02.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.419+0000 7f29c5bbf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0103b70 0x7f29c0199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45756/0 (socket says 172.21.15.59:45756) 2024-09-10T21:16:02.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.419+0000 7f29c5bbf640 1 -- 172.21.15.59:0/2411657324 learned_addr learned my addr 172.21.15.59:0/2411657324 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:02.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.419+0000 7f29c53be640 1 --2- 172.21.15.59:0/2411657324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29c0104570 0x7f29c01997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:02.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.419+0000 7f29c63c0640 1 --2- 172.21.15.59:0/2411657324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29c010d120 0x7f29c019eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:02.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.419+0000 7f29c53be640 1 -- 172.21.15.59:0/2411657324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29c010d120 msgr2=0x7f29c019eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:02.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.419+0000 7f29c53be640 1 --2- 172.21.15.59:0/2411657324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29c010d120 0x7f29c019eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.419+0000 7f29c53be640 1 -- 172.21.15.59:0/2411657324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0103b70 msgr2=0x7f29c0199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:02.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.419+0000 7f29c53be640 1 --2- 172.21.15.59:0/2411657324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0103b70 0x7f29c0199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.419+0000 7f29c53be640 1 -- 172.21.15.59:0/2411657324 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c019f340 con 0x7f29c0104570 2024-09-10T21:16:02.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.419+0000 7f29c5bbf640 1 --2- 172.21.15.59:0/2411657324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0103b70 0x7f29c0199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:16:02.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.419+0000 7f29c53be640 1 --2- 172.21.15.59:0/2411657324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29c0104570 0x7f29c01997d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f29b000ba60 tx=0x7f29b000bf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:02.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.419+0000 7f29b6ffd640 1 -- 172.21.15.59:0/2411657324 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b001e070 con 0x7f29c0104570 2024-09-10T21:16:02.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.420+0000 7f29b6ffd640 1 -- 172.21.15.59:0/2411657324 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29b000f460 con 0x7f29c0104570 2024-09-10T21:16:02.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.420+0000 7f29b6ffd640 1 -- 172.21.15.59:0/2411657324 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0005280 con 0x7f29c0104570 2024-09-10T21:16:02.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.420+0000 7f29c7e23640 1 -- 172.21.15.59:0/2411657324 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c019f630 con 0x7f29c0104570 2024-09-10T21:16:02.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.420+0000 7f29c7e23640 1 -- 172.21.15.59:0/2411657324 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c01018d0 con 0x7f29c0104570 2024-09-10T21:16:02.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.423+0000 7f29b6ffd640 1 -- 172.21.15.59:0/2411657324 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f29b0005420 con 0x7f29c0104570 2024-09-10T21:16:02.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.424+0000 7f29ca1f8740 1 Processor -- start 2024-09-10T21:16:02.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.424+0000 7f29ca1f8740 1 -- start start 2024-09-10T21:16:02.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.425+0000 7f29ca1f8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11e60f0 0x5614f11e64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:02.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.425+0000 7f29ca1f8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11e6a10 0x5614f11f2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:02.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.425+0000 7f29ca1f8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614f11f29a0 0x5614f11f4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:02.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.425+0000 7f29b6ffd640 1 --2- 172.21.15.59:0/2411657324 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f29ac0b52e0 0x7f29ac0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:02.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.425+0000 7f29ca1f8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5614f115cea0 con 0x5614f11e60f0 2024-09-10T21:16:02.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.425+0000 7f29ca1f8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5614f114c2d0 con 0x5614f11e6a10 2024-09-10T21:16:02.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.425+0000 7f29ca1f8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5614f11500e0 con 0x5614f11f29a0 2024-09-10T21:16:02.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.425+0000 7f29c63c0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11e60f0 0x5614f11e64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:02.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.425+0000 7f29c5bbf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11e6a10 0x5614f11f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.425+0000 7f29c63c0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11e60f0 0x5614f11e64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45762/0 (socket says 172.21.15.59:45762) 2024-09-10T21:16:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.425+0000 7f29c63c0640 1 -- 172.21.15.59:0/1765934013 learned_addr learned my addr 172.21.15.59:0/1765934013 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.425+0000 7f29c53be640 1 --2- 172.21.15.59:0/2411657324 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f29ac0b52e0 0x7f29ac0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.425+0000 7f29c5bbf640 1 -- 172.21.15.59:0/1765934013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614f11f29a0 msgr2=0x5614f11f4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.425+0000 7f29c5bbf640 1 --2- 172.21.15.59:0/1765934013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614f11f29a0 0x5614f11f4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.425+0000 7f29c5bbf640 1 -- 172.21.15.59:0/1765934013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11e60f0 msgr2=0x5614f11e64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.425+0000 7f29c5bbf640 1 --2- 172.21.15.59:0/1765934013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11e60f0 0x5614f11e64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.425+0000 7f29c5bbf640 1 -- 172.21.15.59:0/1765934013 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f0eaa650 con 0x5614f11e6a10 2024-09-10T21:16:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.425+0000 7f29b6ffd640 1 -- 172.21.15.59:0/2411657324 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f29b00edc00 con 0x7f29c0104570 2024-09-10T21:16:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.426+0000 7f29c63c0640 1 --2- 172.21.15.59:0/1765934013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11e60f0 0x5614f11e64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:16:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.426+0000 7f29c53be640 1 --2- 172.21.15.59:0/2411657324 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f29ac0b52e0 0x7f29ac0b77a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f29b00b42d0 tx=0x7f29b00ae8e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.426+0000 7f29c5bbf640 1 --2- 172.21.15.59:0/1765934013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11e6a10 0x5614f11f2460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f29bc004770 tx=0x7f29bc031550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39723f5a91725de2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.426+0000 7f29abfff640 1 -- 172.21.15.59:0/1765934013 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc035040 con 0x5614f11e6a10 2024-09-10T21:16:02.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.427+0000 7f29abfff640 1 -- 172.21.15.59:0/1765934013 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29bc005020 con 0x5614f11e6a10 2024-09-10T21:16:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.427+0000 7f29abfff640 1 -- 172.21.15.59:0/1765934013 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc004a00 con 0x5614f11e6a10 2024-09-10T21:16:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.427+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1765934013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11e6a10 msgr2=0x5614f11f2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.427+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1765934013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11e6a10 0x5614f11f2460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f29bc004770 tx=0x7f29bc031550 comp rx=0 tx=0).stop 2024-09-10T21:16:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.428+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1765934013 shutdown_connections 2024-09-10T21:16:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.428+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1765934013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614f11f29a0 0x5614f11f4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.428+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1765934013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11e6a10 0x5614f11f2460 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f29bc004770 tx=0x7f29bc031550 comp rx=0 tx=0).stop 2024-09-10T21:16:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.428+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1765934013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11e60f0 0x5614f11e64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.428+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1765934013 >> 172.21.15.59:0/1765934013 conn(0x5614f11e3f20 msgr2=0x5614f11e50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.428+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1765934013 shutdown_connections 2024-09-10T21:16:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.428+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1765934013 wait complete. 2024-09-10T21:16:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.428+0000 7f29ca1f8740 1 -- start start 2024-09-10T21:16:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.428+0000 7f29ca1f8740 1 Processor -- start 2024-09-10T21:16:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.429+0000 7f29ca1f8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11e60f0 0x5614f11efa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:02.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.429+0000 7f29ca1f8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614f11f29a0 0x5614f11effb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.429+0000 7f29ca1f8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11f04f0 0x5614f11fe8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.429+0000 7f29ca1f8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5614f0fad700 con 0x5614f11f04f0 2024-09-10T21:16:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.429+0000 7f29ca1f8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5614f10e7160 con 0x5614f11e60f0 2024-09-10T21:16:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.429+0000 7f29ca1f8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5614f11f55c0 con 0x5614f11f29a0 2024-09-10T21:16:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.429+0000 7f29ca1f8740 10 client.0 _ll_register_callbacks cb 0x5614f11009e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.429+0000 7f29c63c0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11f04f0 0x5614f11fe8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.429+0000 7f29c63c0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11f04f0 0x5614f11fe8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45774/0 (socket says 172.21.15.59:45774) 2024-09-10T21:16:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.429+0000 7f29c63c0640 1 -- 172.21.15.59:0/1291103741 learned_addr learned my addr 172.21.15.59:0/1291103741 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.429+0000 7f29c5bbf640 1 --2- 172.21.15.59:0/1291103741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614f11f29a0 0x5614f11effb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.429+0000 7f29c63c0640 1 -- 172.21.15.59:0/1291103741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614f11f29a0 msgr2=0x5614f11effb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.429+0000 7f29c63c0640 1 --2- 172.21.15.59:0/1291103741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614f11f29a0 0x5614f11effb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.429+0000 7f29c63c0640 1 -- 172.21.15.59:0/1291103741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11e60f0 msgr2=0x5614f11efa70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:16:02.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.429+0000 7f29c63c0640 1 --2- 172.21.15.59:0/1291103741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11e60f0 0x5614f11efa70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.429+0000 7f29c63c0640 1 -- 172.21.15.59:0/1291103741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614f1114c90 con 0x5614f11f04f0 2024-09-10T21:16:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.430+0000 7f29c63c0640 1 --2- 172.21.15.59:0/1291103741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11f04f0 0x5614f11fe8f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f29b8013ac0 tx=0x7f29b8013f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b07ece3fe91f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.430+0000 7f29a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.430+0000 7f29a97fa640 1 -- 172.21.15.59:0/1291103741 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b8020060 con 0x5614f11f04f0 2024-09-10T21:16:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.430+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1291103741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29bc005020 con 0x5614f11f04f0 2024-09-10T21:16:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.430+0000 7f29a97fa640 1 -- 172.21.15.59:0/1291103741 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f29b8012d90 con 0x5614f11f04f0 2024-09-10T21:16:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.430+0000 7f29a97fa640 1 -- 172.21.15.59:0/1291103741 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f29b801b3f0 con 0x5614f11f04f0 2024-09-10T21:16:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.430+0000 7f29ca1f8740 10 client.15486 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.430+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1291103741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5614f1201720 con 0x5614f11f04f0 2024-09-10T21:16:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.431+0000 7f29a97fa640 1 -- 172.21.15.59:0/1291103741 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29bc005020 con 0x5614f11f04f0 2024-09-10T21:16:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.431+0000 7f29a97fa640 1 -- 172.21.15.59:0/1291103741 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f29b801a030 con 0x5614f11f04f0 2024-09-10T21:16:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.431+0000 7f29ca1f8740 10 client.15486 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.431+0000 7f29ca1f8740 10 client.15486 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:16:02.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.431+0000 7f29ca1f8740 20 client.15486 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.431+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1291103741 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5614f1202f10 0x5614f1205330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.431+0000 7f29ca1f8740 4 client.15486 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:16:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.431+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1291103741 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614f115edf0 con 0x5614f1202f10 2024-09-10T21:16:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.431+0000 7f29c5bbf640 1 --2- 172.21.15.59:0/1291103741 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5614f1202f10 0x5614f1205330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.432+0000 7f29c5bbf640 1 --2- 172.21.15.59:0/1291103741 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5614f1202f10 0x5614f1205330 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b5ee7bde20552ffa server_cookie=87e71acc8b86bb8f in_seq=0 out_seq=0 2024-09-10T21:16:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.432+0000 7f29a97fa640 10 client.15486 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:16:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.433+0000 7f29a97fa640 1 -- 172.21.15.59:0/1291103741 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5614f115edf0 con 0x5614f1202f10 2024-09-10T21:16:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.433+0000 7f29a97fa640 10 client.15486 handle_command_reply: tid=0 2024-09-10T21:16:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.433+0000 7f29ca1f8740 1 client.15486 shutdown 2024-09-10T21:16:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.433+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1291103741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11f04f0 msgr2=0x5614f11fe8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.433+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1291103741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11f04f0 0x5614f11fe8f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f29b8013ac0 tx=0x7f29b8013f80 comp rx=0 tx=0).stop 2024-09-10T21:16:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.433+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1291103741 shutdown_connections 2024-09-10T21:16:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.433+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1291103741 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5614f1202f10 0x5614f1205330 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.433+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1291103741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11f04f0 0x5614f11fe8f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.433+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1291103741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614f11f29a0 0x5614f11effb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.433+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1291103741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11e60f0 0x5614f11efa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.433+0000 7f29a97fa640 0 client.15486 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:16:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.433+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1291103741 >> 172.21.15.59:0/1291103741 conn(0x5614f11e3f20 msgr2=0x5614f11e9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.433+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1291103741 shutdown_connections 2024-09-10T21:16:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.433+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1291103741 wait complete. 2024-09-10T21:16:02.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.433+0000 7f29ca1f8740 20 client.15486 trim_cache size 0 max 16384 2024-09-10T21:16:02.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.447+0000 7f29ca1f8740 1 Processor -- start 2024-09-10T21:16:02.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.447+0000 7f29ca1f8740 1 -- start start 2024-09-10T21:16:02.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.447+0000 7f29ca1f8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11e60f0 0x5614f11fe7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:02.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.447+0000 7f29ca1f8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11f04f0 0x5614f1204f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:02.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.447+0000 7f29ca1f8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614f11f29a0 0x5614f11ecc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:02.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.447+0000 7f29ca1f8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f29c01ac0f0 con 0x5614f11f04f0 2024-09-10T21:16:02.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.447+0000 7f29ca1f8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f29c01adc30 con 0x5614f11e60f0 2024-09-10T21:16:02.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.447+0000 7f29ca1f8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f29c01ac7c0 con 0x5614f11f29a0 2024-09-10T21:16:02.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.447+0000 7f29c5bbf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11f04f0 0x5614f1204f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:02.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.447+0000 7f29c5bbf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11f04f0 0x5614f1204f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45788/0 (socket says 172.21.15.59:45788) 2024-09-10T21:16:02.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.447+0000 7f29c5bbf640 1 -- 172.21.15.59:0/1517809509 learned_addr learned my addr 172.21.15.59:0/1517809509 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:02.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.447+0000 7f29c63c0640 1 --2- 172.21.15.59:0/1517809509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11e60f0 0x5614f11fe7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:02.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.447+0000 7f29c5bbf640 1 -- 172.21.15.59:0/1517809509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614f11f29a0 msgr2=0x5614f11ecc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:02.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.447+0000 7f29c5bbf640 1 --2- 172.21.15.59:0/1517809509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614f11f29a0 0x5614f11ecc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.447+0000 7f29c5bbf640 1 -- 172.21.15.59:0/1517809509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11e60f0 msgr2=0x5614f11fe7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:02.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.447+0000 7f29c5bbf640 1 --2- 172.21.15.59:0/1517809509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11e60f0 0x5614f11fe7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.447+0000 7f29c5bbf640 1 -- 172.21.15.59:0/1517809509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f11e49a0 con 0x5614f11f04f0 2024-09-10T21:16:02.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.448+0000 7f29c5bbf640 1 --2- 172.21.15.59:0/1517809509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11f04f0 0x5614f1204f20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f29bc032fd0 tx=0x7f29bc0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da5a25553f30d47 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:02.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.448+0000 7f29ab7fe640 1 -- 172.21.15.59:0/1517809509 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc000e60 con 0x5614f11f04f0 2024-09-10T21:16:02.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.448+0000 7f29ab7fe640 1 -- 172.21.15.59:0/1517809509 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29bc009520 con 0x5614f11f04f0 2024-09-10T21:16:02.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.448+0000 7f29ab7fe640 1 -- 172.21.15.59:0/1517809509 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc035040 con 0x5614f11f04f0 2024-09-10T21:16:02.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.449+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1517809509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11f04f0 msgr2=0x5614f1204f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:02.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.449+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1517809509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11f04f0 0x5614f1204f20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f29bc032fd0 tx=0x7f29bc0058d0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.449+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1517809509 shutdown_connections 2024-09-10T21:16:02.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.449+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1517809509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614f11f29a0 0x5614f11ecc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.449+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1517809509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11f04f0 0x5614f1204f20 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.449+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1517809509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11e60f0 0x5614f11fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.449+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1517809509 >> 172.21.15.59:0/1517809509 conn(0x5614f11e3f20 msgr2=0x5614f11ee2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:02.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.449+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1517809509 shutdown_connections 2024-09-10T21:16:02.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.449+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1517809509 wait complete. 2024-09-10T21:16:02.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.450+0000 7f29ca1f8740 1 -- start start 2024-09-10T21:16:02.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.450+0000 7f29ca1f8740 1 Processor -- start 2024-09-10T21:16:02.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.450+0000 7f29ca1f8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11e60f0 0x5614f11ecc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:02.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.450+0000 7f29ca1f8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11f04f0 0x5614f11ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:02.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.450+0000 7f29ca1f8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614f11f29a0 0x5614f11ed6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:02.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.450+0000 7f29ca1f8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f29c01ad560 con 0x5614f11e60f0 2024-09-10T21:16:02.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.450+0000 7f29ca1f8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f29c01ace90 con 0x5614f11f04f0 2024-09-10T21:16:02.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.450+0000 7f29ca1f8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f29c01aa0d0 con 0x5614f11f29a0 2024-09-10T21:16:02.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.450+0000 7f29c63c0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11e60f0 0x5614f11ecc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:02.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.450+0000 7f29ca1f8740 10 client.0 _ll_register_callbacks cb 0x7f29b8009dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:02.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.450+0000 7f29c63c0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11e60f0 0x5614f11ecc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45804/0 (socket says 172.21.15.59:45804) 2024-09-10T21:16:02.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.450+0000 7f29c63c0640 1 -- 172.21.15.59:0/1170374839 learned_addr learned my addr 172.21.15.59:0/1170374839 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:02.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.451+0000 7f29c5bbf640 1 --2- 172.21.15.59:0/1170374839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11f04f0 0x5614f11ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:02.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.451+0000 7f29c63c0640 1 --2- 172.21.15.59:0/1170374839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614f11f29a0 0x5614f11ed6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:02.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.451+0000 7f29c63c0640 1 -- 172.21.15.59:0/1170374839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614f11f29a0 msgr2=0x5614f11ed6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:02.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.451+0000 7f29c63c0640 1 --2- 172.21.15.59:0/1170374839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614f11f29a0 0x5614f11ed6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.451+0000 7f29c63c0640 1 -- 172.21.15.59:0/1170374839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11f04f0 msgr2=0x5614f11ed1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:02.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.451+0000 7f29c63c0640 1 --2- 172.21.15.59:0/1170374839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11f04f0 0x5614f11ed1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.451+0000 7f29c63c0640 1 -- 172.21.15.59:0/1170374839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614f11f6e50 con 0x5614f11e60f0 2024-09-10T21:16:02.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.451+0000 7f29c5bbf640 1 --2- 172.21.15.59:0/1170374839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11f04f0 0x5614f11ed1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:16:02.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.451+0000 7f29c63c0640 1 --2- 172.21.15.59:0/1170374839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11e60f0 0x5614f11ecc60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f29b8006010 tx=0x7f29b80103e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40372988ca6938b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:02.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.451+0000 7f29a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:02.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.451+0000 7f29a97fa640 1 -- 172.21.15.59:0/1170374839 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b802d070 con 0x5614f11e60f0 2024-09-10T21:16:02.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.451+0000 7f29a97fa640 1 -- 172.21.15.59:0/1170374839 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f29b8012e10 con 0x5614f11e60f0 2024-09-10T21:16:02.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.452+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1170374839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29bc009520 con 0x5614f11e60f0 2024-09-10T21:16:02.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.452+0000 7f29a97fa640 1 -- 172.21.15.59:0/1170374839 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f29b8010b30 con 0x5614f11e60f0 2024-09-10T21:16:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.452+0000 7f29ca1f8740 10 client.15492 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.452+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1170374839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5614f12701a0 con 0x5614f11e60f0 2024-09-10T21:16:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.452+0000 7f29a97fa640 1 -- 172.21.15.59:0/1170374839 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29bc009520 con 0x5614f11e60f0 2024-09-10T21:16:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.453+0000 7f29a97fa640 1 -- 172.21.15.59:0/1170374839 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f29b8032060 con 0x5614f11e60f0 2024-09-10T21:16:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.453+0000 7f29ca1f8740 10 client.15492 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.453+0000 7f29ca1f8740 10 client.15492 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:16:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.453+0000 7f29ca1f8740 20 client.15492 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.453+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1170374839 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5614f1270860 0x5614f1272c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.453+0000 7f29ca1f8740 4 client.15492 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:16:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.453+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1170374839 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5614f115a8a0 con 0x5614f1270860 2024-09-10T21:16:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.454+0000 7f29c5bbf640 1 --2- 172.21.15.59:0/1170374839 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5614f1270860 0x5614f1272c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.454+0000 7f29a97fa640 10 client.15492 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:16:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.454+0000 7f29c5bbf640 1 --2- 172.21.15.59:0/1170374839 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5614f1270860 0x5614f1272c80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f225e11b6127eef8 server_cookie=a49d259bffae693 in_seq=0 out_seq=0 2024-09-10T21:16:02.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.454+0000 7f29a97fa640 1 -- 172.21.15.59:0/1170374839 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5614f115a8a0 con 0x5614f1270860 2024-09-10T21:16:02.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.454+0000 7f29a97fa640 10 client.15492 handle_command_reply: tid=0 2024-09-10T21:16:02.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.454+0000 7f29ca1f8740 1 client.15492 shutdown 2024-09-10T21:16:02.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.455+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1170374839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11e60f0 msgr2=0x5614f11ecc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:02.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.455+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1170374839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11e60f0 0x5614f11ecc60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f29b8006010 tx=0x7f29b80103e0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.455+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1170374839 shutdown_connections 2024-09-10T21:16:02.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.455+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1170374839 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5614f1270860 0x5614f1272c80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.455+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1170374839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5614f11f29a0 0x5614f11ed6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.455+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1170374839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5614f11f04f0 0x5614f11ed1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.455+0000 7f29ca1f8740 1 --2- 172.21.15.59:0/1170374839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5614f11e60f0 0x5614f11ecc60 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.455+0000 7f29a97fa640 0 client.15492 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:16:02.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.455+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1170374839 >> 172.21.15.59:0/1170374839 conn(0x5614f11e3f20 msgr2=0x5614f11f10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:02.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.455+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1170374839 shutdown_connections 2024-09-10T21:16:02.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.455+0000 7f29ca1f8740 1 -- 172.21.15.59:0/1170374839 wait complete. 2024-09-10T21:16:02.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.456+0000 7f29ca1f8740 20 client.15492 trim_cache size 0 max 16384 2024-09-10T21:16:02.469 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:16:02.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.456+0000 7f29c7e23640 1 -- 172.21.15.59:0/2411657324 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f29ac0b52e0 msgr2=0x7f29ac0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:02.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.456+0000 7f29c7e23640 1 --2- 172.21.15.59:0/2411657324 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f29ac0b52e0 0x7f29ac0b77a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f29b00b42d0 tx=0x7f29b00ae8e0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.456+0000 7f29c7e23640 1 -- 172.21.15.59:0/2411657324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29c0104570 msgr2=0x7f29c01997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.456+0000 7f29c7e23640 1 --2- 172.21.15.59:0/2411657324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29c0104570 0x7f29c01997d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f29b000ba60 tx=0x7f29b000bf20 comp rx=0 tx=0).stop 2024-09-10T21:16:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.456+0000 7f29c7e23640 1 -- 172.21.15.59:0/2411657324 shutdown_connections 2024-09-10T21:16:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.456+0000 7f29c7e23640 1 --2- 172.21.15.59:0/2411657324 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f29ac0b52e0 0x7f29ac0b77a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.456+0000 7f29c7e23640 1 --2- 172.21.15.59:0/2411657324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29c010d120 0x7f29c019eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.456+0000 7f29c7e23640 1 --2- 172.21.15.59:0/2411657324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29c0104570 0x7f29c01997d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.456+0000 7f29c7e23640 1 --2- 172.21.15.59:0/2411657324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0103b70 0x7f29c0199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.456+0000 7f29c7e23640 1 -- 172.21.15.59:0/2411657324 >> 172.21.15.59:0/2411657324 conn(0x7f29c00fd700 msgr2=0x7f29c00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.457+0000 7f29c7e23640 1 -- 172.21.15.59:0/2411657324 shutdown_connections 2024-09-10T21:16:02.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:02.457+0000 7f29c7e23640 1 -- 172.21.15.59:0/2411657324 wait complete. 2024-09-10T21:16:03.219 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:16:03.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:03 smithi192 ceph-mon[35363]: pgmap v363: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T21:16:03.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:03 smithi059 ceph-mon[30888]: pgmap v363: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T21:16:03.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:03 smithi154 ceph-mon[35041]: pgmap v363: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T21:16:03.598 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:16:04.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.180+0000 7ffb329fc640 1 -- 172.21.15.59:0/861289133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb2c102dc0 msgr2=0x7ffb2c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:04.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.180+0000 7ffb329fc640 1 --2- 172.21.15.59:0/861289133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb2c102dc0 0x7ffb2c1031a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009900 tx=0x7ffb1c02a410 comp rx=0 tx=0).stop 2024-09-10T21:16:04.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.181+0000 7ffb329fc640 1 -- 172.21.15.59:0/861289133 shutdown_connections 2024-09-10T21:16:04.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.181+0000 7ffb329fc640 1 --2- 172.21.15.59:0/861289133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb2c109150 0x7ffb2c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.181+0000 7ffb329fc640 1 --2- 172.21.15.59:0/861289133 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb2c1087d0 0x7ffb2c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.181+0000 7ffb329fc640 1 --2- 172.21.15.59:0/861289133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb2c102dc0 0x7ffb2c1031a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.181+0000 7ffb329fc640 1 -- 172.21.15.59:0/861289133 >> 172.21.15.59:0/861289133 conn(0x7ffb2c0fe870 msgr2=0x7ffb2c100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:04.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.181+0000 7ffb329fc640 1 -- 172.21.15.59:0/861289133 shutdown_connections 2024-09-10T21:16:04.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.181+0000 7ffb329fc640 1 -- 172.21.15.59:0/861289133 wait complete. 2024-09-10T21:16:04.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.182+0000 7ffb329fc640 1 Processor -- start 2024-09-10T21:16:04.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.182+0000 7ffb329fc640 1 -- start start 2024-09-10T21:16:04.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.182+0000 7ffb329fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb2c1087d0 0x7ffb2c199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:04.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.182+0000 7ffb329fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb2c109150 0x7ffb2c1999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:04.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.182+0000 7ffb329fc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb2c19ed50 0x7ffb2c19f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:04.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.182+0000 7ffb329fc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c112e10 con 0x7ffb2c1087d0 2024-09-10T21:16:04.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.182+0000 7ffb329fc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c112c90 con 0x7ffb2c109150 2024-09-10T21:16:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.182+0000 7ffb329fc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c112f90 con 0x7ffb2c19ed50 2024-09-10T21:16:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.183+0000 7ffb2b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb2c109150 0x7ffb2c1999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.183+0000 7ffb2b7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb2c109150 0x7ffb2c1999b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:40216/0 (socket says 172.21.15.59:40216) 2024-09-10T21:16:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.183+0000 7ffb2b7fe640 1 -- 172.21.15.59:0/3313118591 learned_addr learned my addr 172.21.15.59:0/3313118591 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.183+0000 7ffb2bfff640 1 --2- 172.21.15.59:0/3313118591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb2c1087d0 0x7ffb2c199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.183+0000 7ffb30f99640 1 --2- 172.21.15.59:0/3313118591 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb2c19ed50 0x7ffb2c19f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.183+0000 7ffb2b7fe640 1 -- 172.21.15.59:0/3313118591 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb2c19ed50 msgr2=0x7ffb2c19f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.183+0000 7ffb2b7fe640 1 --2- 172.21.15.59:0/3313118591 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb2c19ed50 0x7ffb2c19f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.183+0000 7ffb2b7fe640 1 -- 172.21.15.59:0/3313118591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb2c1087d0 msgr2=0x7ffb2c199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.183+0000 7ffb2b7fe640 1 --2- 172.21.15.59:0/3313118591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb2c1087d0 0x7ffb2c199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.183+0000 7ffb2b7fe640 1 -- 172.21.15.59:0/3313118591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2c19f8e0 con 0x7ffb2c109150 2024-09-10T21:16:04.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.183+0000 7ffb2b7fe640 1 --2- 172.21.15.59:0/3313118591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb2c109150 0x7ffb2c1999b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000e9f0 tx=0x7ffb2000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.184+0000 7ffb297fa640 1 -- 172.21.15.59:0/3313118591 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2000cd80 con 0x7ffb2c109150 2024-09-10T21:16:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.184+0000 7ffb297fa640 1 -- 172.21.15.59:0/3313118591 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb200108e0 con 0x7ffb2c109150 2024-09-10T21:16:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.184+0000 7ffb329fc640 1 -- 172.21.15.59:0/3313118591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb2c075380 con 0x7ffb2c109150 2024-09-10T21:16:04.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.184+0000 7ffb297fa640 1 -- 172.21.15.59:0/3313118591 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20018880 con 0x7ffb2c109150 2024-09-10T21:16:04.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.184+0000 7ffb329fc640 1 -- 172.21.15.59:0/3313118591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb2c0758c0 con 0x7ffb2c109150 2024-09-10T21:16:04.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.187+0000 7ffb297fa640 1 -- 172.21.15.59:0/3313118591 <== mon.2 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7ffb20010430 con 0x7ffb2c109150 2024-09-10T21:16:04.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.187+0000 7ffb34dd1740 1 Processor -- start 2024-09-10T21:16:04.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.187+0000 7ffb34dd1740 1 -- start start 2024-09-10T21:16:04.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.187+0000 7ffb297fa640 1 --2- 172.21.15.59:0/3313118591 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffb140b52e0 0x7ffb140b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:04.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.188+0000 7ffb34dd1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be320f0 0x56208be324d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:04.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.188+0000 7ffb34dd1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be32a10 0x56208be3e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:04.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.188+0000 7ffb34dd1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 0x56208be40d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:04.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.188+0000 7ffb34dd1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56208bda8ea0 con 0x56208be320f0 2024-09-10T21:16:04.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.188+0000 7ffb34dd1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56208bd982d0 con 0x56208be3e9a0 2024-09-10T21:16:04.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.188+0000 7ffb34dd1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56208bd9c0e0 con 0x56208be32a10 2024-09-10T21:16:04.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.188+0000 7ffb30f99640 1 --2- 172.21.15.59:0/3313118591 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffb140b52e0 0x7ffb140b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:04.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.188+0000 7ffb297fa640 1 -- 172.21.15.59:0/3313118591 <== mon.2 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ffb200e6150 con 0x7ffb2c109150 2024-09-10T21:16:04.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.188+0000 7ffb30f99640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 0x56208be40d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:04.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.188+0000 7ffb30f99640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 0x56208be40d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:40218/0 (socket says 172.21.15.59:40218) 2024-09-10T21:16:04.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.188+0000 7ffb30f99640 1 -- 172.21.15.59:0/1707157992 learned_addr learned my addr 172.21.15.59:0/1707157992 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:04.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.188+0000 7ffb2bfff640 1 --2- 172.21.15.59:0/1707157992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be320f0 0x56208be324d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:04.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.188+0000 7ffb2b7fe640 1 --2- 172.21.15.59:0/1707157992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be32a10 0x56208be3e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:04.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.188+0000 7ffb30f99640 1 -- 172.21.15.59:0/1707157992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be32a10 msgr2=0x56208be3e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:04.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.188+0000 7ffb30f99640 1 --2- 172.21.15.59:0/1707157992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be32a10 0x56208be3e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.188+0000 7ffb30f99640 1 -- 172.21.15.59:0/1707157992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be320f0 msgr2=0x56208be324d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:04.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.188+0000 7ffb30f99640 1 --2- 172.21.15.59:0/1707157992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be320f0 0x56208be324d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.188+0000 7ffb30f99640 1 -- 172.21.15.59:0/1707157992 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56208baf6650 con 0x56208be3e9a0 2024-09-10T21:16:04.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.188+0000 7ffb30f99640 1 --2- 172.21.15.59:0/3313118591 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffb140b52e0 0x7ffb140b77a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ffb24011d00 tx=0x7ffb24011440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:04.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.189+0000 7ffb30f99640 1 --2- 172.21.15.59:0/1707157992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 0x56208be40d90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffb24011670 tx=0x7ffb2401d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afff1e746c572ce5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:04.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.189+0000 7ffb127fc640 1 -- 172.21.15.59:0/1707157992 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24024070 con 0x56208be3e9a0 2024-09-10T21:16:04.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.189+0000 7ffb127fc640 1 -- 172.21.15.59:0/1707157992 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb24011df0 con 0x56208be3e9a0 2024-09-10T21:16:04.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.189+0000 7ffb127fc640 1 -- 172.21.15.59:0/1707157992 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2401fde0 con 0x56208be3e9a0 2024-09-10T21:16:04.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.190+0000 7ffb34dd1740 1 -- 172.21.15.59:0/1707157992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 msgr2=0x56208be40d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:04.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.190+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/1707157992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 0x56208be40d90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffb24011670 tx=0x7ffb2401d000 comp rx=0 tx=0).stop 2024-09-10T21:16:04.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.190+0000 7ffb34dd1740 1 -- 172.21.15.59:0/1707157992 shutdown_connections 2024-09-10T21:16:04.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.190+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/1707157992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 0x56208be40d90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.190+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/1707157992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be32a10 0x56208be3e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.190+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/1707157992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be320f0 0x56208be324d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.190+0000 7ffb34dd1740 1 -- 172.21.15.59:0/1707157992 >> 172.21.15.59:0/1707157992 conn(0x56208be2ff20 msgr2=0x56208be310c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:04.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.190+0000 7ffb34dd1740 1 -- 172.21.15.59:0/1707157992 shutdown_connections 2024-09-10T21:16:04.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.190+0000 7ffb34dd1740 1 -- 172.21.15.59:0/1707157992 wait complete. 2024-09-10T21:16:04.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.190+0000 7ffb34dd1740 1 -- start start 2024-09-10T21:16:04.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.191+0000 7ffb34dd1740 1 Processor -- start 2024-09-10T21:16:04.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.191+0000 7ffb34dd1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be320f0 0x56208be3e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:04.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.191+0000 7ffb34dd1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be32a10 0x56208be3b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:04.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.191+0000 7ffb34dd1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 0x56208be3bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:04.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.191+0000 7ffb34dd1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56208bbf9700 con 0x56208be32a10 2024-09-10T21:16:04.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.191+0000 7ffb34dd1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56208bd33160 con 0x56208be3e9a0 2024-09-10T21:16:04.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.191+0000 7ffb34dd1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56208be415c0 con 0x56208be320f0 2024-09-10T21:16:04.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.191+0000 7ffb34dd1740 10 client.0 _ll_register_callbacks cb 0x56208bd4c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:04.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.191+0000 7ffb2b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be32a10 0x56208be3b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:04.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.191+0000 7ffb2bfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be320f0 0x56208be3e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:04.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.191+0000 7ffb2b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be32a10 0x56208be3b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45826/0 (socket says 172.21.15.59:45826) 2024-09-10T21:16:04.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.191+0000 7ffb2b7fe640 1 -- 172.21.15.59:0/780624217 learned_addr learned my addr 172.21.15.59:0/780624217 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:04.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.191+0000 7ffb30f99640 1 --2- 172.21.15.59:0/780624217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 0x56208be3bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:04.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.192+0000 7ffb2b7fe640 1 -- 172.21.15.59:0/780624217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be320f0 msgr2=0x56208be3e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:04.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.192+0000 7ffb2b7fe640 1 --2- 172.21.15.59:0/780624217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be320f0 0x56208be3e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.192+0000 7ffb2b7fe640 1 -- 172.21.15.59:0/780624217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 msgr2=0x56208be3bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:04.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.192+0000 7ffb2b7fe640 1 --2- 172.21.15.59:0/780624217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 0x56208be3bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.192+0000 7ffb2b7fe640 1 -- 172.21.15.59:0/780624217 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56208bd60c90 con 0x56208be32a10 2024-09-10T21:16:04.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.192+0000 7ffb2bfff640 1 --2- 172.21.15.59:0/780624217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be320f0 0x56208be3e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:16:04.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.192+0000 7ffb2b7fe640 1 --2- 172.21.15.59:0/780624217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be32a10 0x56208be3b740 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ffb20000c00 tx=0x7ffb200ac110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf390e0ed8e751e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:04.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.192+0000 7ffb0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:04.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.192+0000 7ffb0b7fe640 1 -- 172.21.15.59:0/780624217 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb200ac8e0 con 0x56208be32a10 2024-09-10T21:16:04.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.192+0000 7ffb0b7fe640 1 -- 172.21.15.59:0/780624217 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ffb2005c120 con 0x56208be32a10 2024-09-10T21:16:04.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.192+0000 7ffb34dd1740 1 -- 172.21.15.59:0/780624217 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb24011df0 con 0x56208be32a10 2024-09-10T21:16:04.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.192+0000 7ffb0b7fe640 1 -- 172.21.15.59:0/780624217 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffb2005c320 con 0x56208be32a10 2024-09-10T21:16:04.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.192+0000 7ffb34dd1740 10 client.15504 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:04.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.192+0000 7ffb34dd1740 1 -- 172.21.15.59:0/780624217 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56208be4cf50 con 0x56208be32a10 2024-09-10T21:16:04.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.193+0000 7ffb0b7fe640 1 -- 172.21.15.59:0/780624217 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb24011df0 con 0x56208be32a10 2024-09-10T21:16:04.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.193+0000 7ffb0b7fe640 1 -- 172.21.15.59:0/780624217 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffb200a8230 con 0x56208be32a10 2024-09-10T21:16:04.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.193+0000 7ffb34dd1740 10 client.15504 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:04.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.193+0000 7ffb34dd1740 10 client.15504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:16:04.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.193+0000 7ffb34dd1740 20 client.15504 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:04.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.193+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/780624217 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56208be4e2a0 0x56208be506f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:04.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.193+0000 7ffb34dd1740 4 client.15504 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:16:04.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.193+0000 7ffb34dd1740 1 -- 172.21.15.59:0/780624217 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56208bdaadf0 con 0x56208be4e2a0 2024-09-10T21:16:04.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.193+0000 7ffb2bfff640 1 --2- 172.21.15.59:0/780624217 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56208be4e2a0 0x56208be506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:04.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.194+0000 7ffb0b7fe640 10 client.15504 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:04.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.194+0000 7ffb2bfff640 1 --2- 172.21.15.59:0/780624217 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56208be4e2a0 0x56208be506f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e03135947ca7f0e1 server_cookie=3734e3380593a94 in_seq=0 out_seq=0 2024-09-10T21:16:04.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.194+0000 7ffb0b7fe640 1 -- 172.21.15.59:0/780624217 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56208bdaadf0 con 0x56208be4e2a0 2024-09-10T21:16:04.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.194+0000 7ffb0b7fe640 10 client.15504 handle_command_reply: tid=0 2024-09-10T21:16:04.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.194+0000 7ffb34dd1740 1 client.15504 shutdown 2024-09-10T21:16:04.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.194+0000 7ffb34dd1740 1 -- 172.21.15.59:0/780624217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be32a10 msgr2=0x56208be3b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:04.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.194+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/780624217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be32a10 0x56208be3b740 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ffb20000c00 tx=0x7ffb200ac110 comp rx=0 tx=0).stop 2024-09-10T21:16:04.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.195+0000 7ffb34dd1740 1 -- 172.21.15.59:0/780624217 shutdown_connections 2024-09-10T21:16:04.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.195+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/780624217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 0x56208be3bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.195+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/780624217 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56208be4e2a0 0x56208be506f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.195+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/780624217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be32a10 0x56208be3b740 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.195+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/780624217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be320f0 0x56208be3e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.195+0000 7ffb34dd1740 1 -- 172.21.15.59:0/780624217 >> 172.21.15.59:0/780624217 conn(0x56208be2ff20 msgr2=0x56208be35ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:04.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.195+0000 7ffb0b7fe640 0 client.15504 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:04.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.195+0000 7ffb34dd1740 1 -- 172.21.15.59:0/780624217 shutdown_connections 2024-09-10T21:16:04.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.195+0000 7ffb34dd1740 1 -- 172.21.15.59:0/780624217 wait complete. 2024-09-10T21:16:04.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.195+0000 7ffb34dd1740 20 client.15504 trim_cache size 0 max 16384 2024-09-10T21:16:04.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.208+0000 7ffb34dd1740 1 Processor -- start 2024-09-10T21:16:04.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.208+0000 7ffb34dd1740 1 -- start start 2024-09-10T21:16:04.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.208+0000 7ffb34dd1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be320f0 0x56208be4a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:04.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.208+0000 7ffb34dd1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 0x56208be51fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:04.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.208+0000 7ffb34dd1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be369f0 0x56208be36e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:04.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.208+0000 7ffb34dd1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c0734c0 con 0x56208be369f0 2024-09-10T21:16:04.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.208+0000 7ffb34dd1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c075000 con 0x56208be3e9a0 2024-09-10T21:16:04.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.208+0000 7ffb34dd1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c073b90 con 0x56208be320f0 2024-09-10T21:16:04.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.209+0000 7ffb30f99640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be369f0 0x56208be36e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:04.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.209+0000 7ffb30f99640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be369f0 0x56208be36e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45834/0 (socket says 172.21.15.59:45834) 2024-09-10T21:16:04.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.209+0000 7ffb30f99640 1 -- 172.21.15.59:0/3051694574 learned_addr learned my addr 172.21.15.59:0/3051694574 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:04.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.209+0000 7ffb2bfff640 1 --2- 172.21.15.59:0/3051694574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be320f0 0x56208be4a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:04.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.209+0000 7ffb30f99640 1 -- 172.21.15.59:0/3051694574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be320f0 msgr2=0x56208be4a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:04.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.209+0000 7ffb30f99640 1 --2- 172.21.15.59:0/3051694574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be320f0 0x56208be4a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.209+0000 7ffb30f99640 1 -- 172.21.15.59:0/3051694574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 msgr2=0x56208be51fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:04.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.209+0000 7ffb2b7fe640 1 --2- 172.21.15.59:0/3051694574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 0x56208be51fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:04.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.209+0000 7ffb30f99640 1 --2- 172.21.15.59:0/3051694574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 0x56208be51fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.209+0000 7ffb30f99640 1 -- 172.21.15.59:0/3051694574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56208be3b4f0 con 0x56208be369f0 2024-09-10T21:16:04.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.209+0000 7ffb2bfff640 1 --2- 172.21.15.59:0/3051694574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be320f0 0x56208be4a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:16:04.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.209+0000 7ffb30f99640 1 --2- 172.21.15.59:0/3051694574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be369f0 0x56208be36e70 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ffb24011640 tx=0x7ffb2401fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c60d29d9ffb6f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:04.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.210+0000 7ffb11ffb640 1 -- 172.21.15.59:0/3051694574 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24024040 con 0x56208be369f0 2024-09-10T21:16:04.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.210+0000 7ffb11ffb640 1 -- 172.21.15.59:0/3051694574 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb24011df0 con 0x56208be369f0 2024-09-10T21:16:04.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.210+0000 7ffb11ffb640 1 -- 172.21.15.59:0/3051694574 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2401f5e0 con 0x56208be369f0 2024-09-10T21:16:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.210+0000 7ffb34dd1740 1 -- 172.21.15.59:0/3051694574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be369f0 msgr2=0x56208be36e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.210+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/3051694574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be369f0 0x56208be36e70 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ffb24011640 tx=0x7ffb2401fa60 comp rx=0 tx=0).stop 2024-09-10T21:16:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.210+0000 7ffb34dd1740 1 -- 172.21.15.59:0/3051694574 shutdown_connections 2024-09-10T21:16:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.210+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/3051694574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be369f0 0x56208be36e70 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.211+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/3051694574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 0x56208be51fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.211+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/3051694574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be320f0 0x56208be4a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.211+0000 7ffb34dd1740 1 -- 172.21.15.59:0/3051694574 >> 172.21.15.59:0/3051694574 conn(0x56208be2ff20 msgr2=0x56208be502b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.211+0000 7ffb34dd1740 1 -- 172.21.15.59:0/3051694574 shutdown_connections 2024-09-10T21:16:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.211+0000 7ffb34dd1740 1 -- 172.21.15.59:0/3051694574 wait complete. 2024-09-10T21:16:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.211+0000 7ffb34dd1740 1 -- start start 2024-09-10T21:16:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.211+0000 7ffb34dd1740 1 Processor -- start 2024-09-10T21:16:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.212+0000 7ffb34dd1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be320f0 0x56208be40210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.212+0000 7ffb34dd1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be369f0 0x56208be40750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.212+0000 7ffb34dd1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 0x56208be3efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.212+0000 7ffb34dd1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c074930 con 0x56208be320f0 2024-09-10T21:16:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.212+0000 7ffb34dd1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c074260 con 0x56208be3e9a0 2024-09-10T21:16:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.212+0000 7ffb34dd1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c0714a0 con 0x56208be369f0 2024-09-10T21:16:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.212+0000 7ffb34dd1740 10 client.0 _ll_register_callbacks cb 0x7ffb200a8780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.212+0000 7ffb2bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be320f0 0x56208be40210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.212+0000 7ffb2bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be320f0 0x56208be40210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45850/0 (socket says 172.21.15.59:45850) 2024-09-10T21:16:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.212+0000 7ffb2bfff640 1 -- 172.21.15.59:0/680524745 learned_addr learned my addr 172.21.15.59:0/680524745 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.212+0000 7ffb2b7fe640 1 --2- 172.21.15.59:0/680524745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be369f0 0x56208be40750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.212+0000 7ffb30f99640 1 --2- 172.21.15.59:0/680524745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 0x56208be3efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.212+0000 7ffb2bfff640 1 -- 172.21.15.59:0/680524745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be369f0 msgr2=0x56208be40750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.212+0000 7ffb2bfff640 1 --2- 172.21.15.59:0/680524745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be369f0 0x56208be40750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.212+0000 7ffb2bfff640 1 -- 172.21.15.59:0/680524745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 msgr2=0x56208be3efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.212+0000 7ffb2bfff640 1 --2- 172.21.15.59:0/680524745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 0x56208be3efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.212+0000 7ffb2bfff640 1 -- 172.21.15.59:0/680524745 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56208be3f800 con 0x56208be320f0 2024-09-10T21:16:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.212+0000 7ffb2bfff640 1 --2- 172.21.15.59:0/680524745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be320f0 0x56208be40210 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0096c0 tx=0x7ffb1c031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87374d5762923663 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.212+0000 7ffb0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:04.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.213+0000 7ffb0b7fe640 1 -- 172.21.15.59:0/680524745 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c000e60 con 0x56208be320f0 2024-09-10T21:16:04.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.213+0000 7ffb0b7fe640 1 -- 172.21.15.59:0/680524745 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ffb1c004240 con 0x56208be320f0 2024-09-10T21:16:04.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.213+0000 7ffb34dd1740 1 -- 172.21.15.59:0/680524745 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb24011df0 con 0x56208be320f0 2024-09-10T21:16:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.213+0000 7ffb0b7fe640 1 -- 172.21.15.59:0/680524745 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffb1c035040 con 0x56208be320f0 2024-09-10T21:16:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.213+0000 7ffb34dd1740 10 client.15510 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.213+0000 7ffb34dd1740 1 -- 172.21.15.59:0/680524745 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56208be465c0 con 0x56208be320f0 2024-09-10T21:16:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.213+0000 7ffb0b7fe640 1 -- 172.21.15.59:0/680524745 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb24011df0 con 0x56208be320f0 2024-09-10T21:16:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.213+0000 7ffb0b7fe640 1 -- 172.21.15.59:0/680524745 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffb1c004920 con 0x56208be320f0 2024-09-10T21:16:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.213+0000 7ffb34dd1740 10 client.15510 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.213+0000 7ffb34dd1740 10 client.15510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:16:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.213+0000 7ffb34dd1740 20 client.15510 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.213+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/680524745 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56208be46d90 0x56208be471a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.213+0000 7ffb34dd1740 4 client.15510 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:16:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.213+0000 7ffb34dd1740 1 -- 172.21.15.59:0/680524745 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56208bda68a0 con 0x56208be46d90 2024-09-10T21:16:04.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.214+0000 7ffb2b7fe640 1 --2- 172.21.15.59:0/680524745 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56208be46d90 0x56208be471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:04.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.214+0000 7ffb0b7fe640 10 client.15510 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:04.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.214+0000 7ffb2b7fe640 1 --2- 172.21.15.59:0/680524745 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56208be46d90 0x56208be471a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75021106e151414a server_cookie=773f7b06744fa5f1 in_seq=0 out_seq=0 2024-09-10T21:16:04.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.214+0000 7ffb0b7fe640 1 -- 172.21.15.59:0/680524745 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56208bda68a0 con 0x56208be46d90 2024-09-10T21:16:04.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.214+0000 7ffb0b7fe640 10 client.15510 handle_command_reply: tid=0 2024-09-10T21:16:04.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.214+0000 7ffb34dd1740 1 client.15510 shutdown 2024-09-10T21:16:04.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.215+0000 7ffb34dd1740 1 -- 172.21.15.59:0/680524745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be320f0 msgr2=0x56208be40210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:04.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.215+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/680524745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be320f0 0x56208be40210 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0096c0 tx=0x7ffb1c031630 comp rx=0 tx=0).stop 2024-09-10T21:16:04.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.215+0000 7ffb34dd1740 1 -- 172.21.15.59:0/680524745 shutdown_connections 2024-09-10T21:16:04.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.215+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/680524745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56208be3e9a0 0x56208be3efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.215+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/680524745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56208be369f0 0x56208be40750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.215+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/680524745 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56208be46d90 0x56208be471a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.215+0000 7ffb34dd1740 1 --2- 172.21.15.59:0/680524745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56208be320f0 0x56208be40210 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.215+0000 7ffb34dd1740 1 -- 172.21.15.59:0/680524745 >> 172.21.15.59:0/680524745 conn(0x56208be2ff20 msgr2=0x56208be39fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:04.226 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:16:04.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.215+0000 7ffb0b7fe640 0 client.15510 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:04.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.215+0000 7ffb34dd1740 1 -- 172.21.15.59:0/680524745 shutdown_connections 2024-09-10T21:16:04.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.215+0000 7ffb34dd1740 1 -- 172.21.15.59:0/680524745 wait complete. 2024-09-10T21:16:04.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.215+0000 7ffb34dd1740 20 client.15510 trim_cache size 0 max 16384 2024-09-10T21:16:04.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.215+0000 7ffb329fc640 1 -- 172.21.15.59:0/3313118591 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffb140b52e0 msgr2=0x7ffb140b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:04.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.215+0000 7ffb329fc640 1 --2- 172.21.15.59:0/3313118591 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffb140b52e0 0x7ffb140b77a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ffb24011d00 tx=0x7ffb24011440 comp rx=0 tx=0).stop 2024-09-10T21:16:04.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.216+0000 7ffb329fc640 1 -- 172.21.15.59:0/3313118591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb2c109150 msgr2=0x7ffb2c1999b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:04.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.216+0000 7ffb329fc640 1 --2- 172.21.15.59:0/3313118591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb2c109150 0x7ffb2c1999b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000e9f0 tx=0x7ffb2000eeb0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.217+0000 7ffb329fc640 1 -- 172.21.15.59:0/3313118591 shutdown_connections 2024-09-10T21:16:04.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.217+0000 7ffb329fc640 1 --2- 172.21.15.59:0/3313118591 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffb140b52e0 0x7ffb140b77a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.217+0000 7ffb329fc640 1 --2- 172.21.15.59:0/3313118591 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb2c19ed50 0x7ffb2c19f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.217+0000 7ffb329fc640 1 --2- 172.21.15.59:0/3313118591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb2c109150 0x7ffb2c1999b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.217+0000 7ffb329fc640 1 --2- 172.21.15.59:0/3313118591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb2c1087d0 0x7ffb2c199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:04.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.217+0000 7ffb329fc640 1 -- 172.21.15.59:0/3313118591 >> 172.21.15.59:0/3313118591 conn(0x7ffb2c0fe870 msgr2=0x7ffb2c1002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:04.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.217+0000 7ffb329fc640 1 -- 172.21.15.59:0/3313118591 shutdown_connections 2024-09-10T21:16:04.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:04.217+0000 7ffb329fc640 1 -- 172.21.15.59:0/3313118591 wait complete. 2024-09-10T21:16:05.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:05 smithi192 ceph-mon[35363]: pgmap v364: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T21:16:05.381 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:05 smithi059 ceph-mon[30888]: pgmap v364: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T21:16:05.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:05 smithi154 ceph-mon[35041]: pgmap v364: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T21:16:07.228 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:16:07.229 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:16:07.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:07 smithi192 ceph-mon[35363]: pgmap v365: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-10T21:16:07.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:07 smithi059 ceph-mon[30888]: pgmap v365: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-10T21:16:07.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:07 smithi154 ceph-mon[35041]: pgmap v365: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-10T21:16:07.607 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:16:08.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.206+0000 7f542a888640 1 -- 172.21.15.59:0/2108539209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5424109170 msgr2=0x7f542410f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:08.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.206+0000 7f542a888640 1 --2- 172.21.15.59:0/2108539209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5424109170 0x7f542410f970 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f541c009ca0 tx=0x7f541c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.206+0000 7f542a888640 1 -- 172.21.15.59:0/2108539209 shutdown_connections 2024-09-10T21:16:08.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.206+0000 7f542a888640 1 --2- 172.21.15.59:0/2108539209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5424109170 0x7f542410f970 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.206+0000 7f542a888640 1 --2- 172.21.15.59:0/2108539209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54241087f0 0x7f5424108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.206+0000 7f542a888640 1 --2- 172.21.15.59:0/2108539209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5424102de0 0x7f54241031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.206+0000 7f542a888640 1 -- 172.21.15.59:0/2108539209 >> 172.21.15.59:0/2108539209 conn(0x7f54240fe830 msgr2=0x7f5424100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:08.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.206+0000 7f542a888640 1 -- 172.21.15.59:0/2108539209 shutdown_connections 2024-09-10T21:16:08.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.207+0000 7f542a888640 1 -- 172.21.15.59:0/2108539209 wait complete. 2024-09-10T21:16:08.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.207+0000 7f542a888640 1 Processor -- start 2024-09-10T21:16:08.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.207+0000 7f542a888640 1 -- start start 2024-09-10T21:16:08.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.208+0000 7f542a888640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5424102de0 0x7f5424074730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:08.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.208+0000 7f542a888640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54241087f0 0x7f5424074c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:08.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.208+0000 7f542a888640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5424109170 0x7f542406da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:08.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.208+0000 7f542a888640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5424112e40 con 0x7f5424109170 2024-09-10T21:16:08.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.208+0000 7f542a888640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5424112cc0 con 0x7f5424102de0 2024-09-10T21:16:08.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.208+0000 7f542a888640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5424112fc0 con 0x7f54241087f0 2024-09-10T21:16:08.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.208+0000 7f5428e25640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5424109170 0x7f542406da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:08.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.208+0000 7f5423fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5424102de0 0x7f5424074730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:08.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.208+0000 7f5428e25640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5424109170 0x7f542406da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45870/0 (socket says 172.21.15.59:45870) 2024-09-10T21:16:08.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.208+0000 7f5428e25640 1 -- 172.21.15.59:0/1715476497 learned_addr learned my addr 172.21.15.59:0/1715476497 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:08.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.208+0000 7f54237fe640 1 --2- 172.21.15.59:0/1715476497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54241087f0 0x7f5424074c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:08.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.209+0000 7f54237fe640 1 -- 172.21.15.59:0/1715476497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5424102de0 msgr2=0x7f5424074730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:08.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.209+0000 7f54237fe640 1 --2- 172.21.15.59:0/1715476497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5424102de0 0x7f5424074730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.209+0000 7f54237fe640 1 -- 172.21.15.59:0/1715476497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5424109170 msgr2=0x7f542406da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:08.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.209+0000 7f54237fe640 1 --2- 172.21.15.59:0/1715476497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5424109170 0x7f542406da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.209+0000 7f54237fe640 1 -- 172.21.15.59:0/1715476497 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542406e340 con 0x7f54241087f0 2024-09-10T21:16:08.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.209+0000 7f5428e25640 1 --2- 172.21.15.59:0/1715476497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5424109170 0x7f542406da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:16:08.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.209+0000 7f54237fe640 1 --2- 172.21.15.59:0/1715476497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54241087f0 0x7f5424074c70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f541800e9f0 tx=0x7f541800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:08.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.209+0000 7f54217fa640 1 -- 172.21.15.59:0/1715476497 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541800ccc0 con 0x7f54241087f0 2024-09-10T21:16:08.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.209+0000 7f542a888640 1 -- 172.21.15.59:0/1715476497 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f542406e630 con 0x7f54241087f0 2024-09-10T21:16:08.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.209+0000 7f542a888640 1 -- 172.21.15.59:0/1715476497 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54240735c0 con 0x7f54241087f0 2024-09-10T21:16:08.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.209+0000 7f54217fa640 1 -- 172.21.15.59:0/1715476497 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5418005020 con 0x7f54241087f0 2024-09-10T21:16:08.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.210+0000 7f54217fa640 1 -- 172.21.15.59:0/1715476497 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5418004a00 con 0x7f54241087f0 2024-09-10T21:16:08.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.212+0000 7f542cc5d740 1 Processor -- start 2024-09-10T21:16:08.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.212+0000 7f542cc5d740 1 -- start start 2024-09-10T21:16:08.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.213+0000 7f542cc5d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38deee0 0x55aba38df2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:08.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.213+0000 7f542cc5d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38df800 0x55aba38eb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:08.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.213+0000 7f542cc5d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38eb790 0x55aba38edb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:08.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.213+0000 7f542cc5d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55aba3855e60 con 0x55aba38df800 2024-09-10T21:16:08.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.213+0000 7f542cc5d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55aba3845290 con 0x55aba38deee0 2024-09-10T21:16:08.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.213+0000 7f542cc5d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55aba38490a0 con 0x55aba38eb790 2024-09-10T21:16:08.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.213+0000 7f5423fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38df800 0x55aba38eb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:08.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.213+0000 7f5423fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38df800 0x55aba38eb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45876/0 (socket says 172.21.15.59:45876) 2024-09-10T21:16:08.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.213+0000 7f5423fff640 1 -- 172.21.15.59:0/3856414579 learned_addr learned my addr 172.21.15.59:0/3856414579 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:08.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.213+0000 7f5423fff640 1 -- 172.21.15.59:0/3856414579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38eb790 msgr2=0x55aba38edb80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:16:08.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.213+0000 7f5423fff640 1 --2- 172.21.15.59:0/3856414579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38eb790 0x55aba38edb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.213+0000 7f5423fff640 1 -- 172.21.15.59:0/3856414579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38deee0 msgr2=0x55aba38df2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:08.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.213+0000 7f5423fff640 1 --2- 172.21.15.59:0/3856414579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38deee0 0x55aba38df2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.213+0000 7f5423fff640 1 -- 172.21.15.59:0/3856414579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aba35a3930 con 0x55aba38df800 2024-09-10T21:16:08.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.214+0000 7f54217fa640 1 -- 172.21.15.59:0/1715476497 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f5418004ba0 con 0x7f54241087f0 2024-09-10T21:16:08.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.214+0000 7f5423fff640 1 --2- 172.21.15.59:0/3856414579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38df800 0x55aba38eb250 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f541400bd40 tx=0x7f54140107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc97102fd108834 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:08.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.214+0000 7f540a7fc640 1 -- 172.21.15.59:0/3856414579 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414004230 con 0x55aba38df800 2024-09-10T21:16:08.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.214+0000 7f540a7fc640 1 -- 172.21.15.59:0/3856414579 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f541400be30 con 0x55aba38df800 2024-09-10T21:16:08.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.214+0000 7f540a7fc640 1 -- 172.21.15.59:0/3856414579 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541401a7a0 con 0x55aba38df800 2024-09-10T21:16:08.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.215+0000 7f54217fa640 1 --2- 172.21.15.59:0/1715476497 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f540c0b5360 0x7f540c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:08.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.215+0000 7f54217fa640 1 -- 172.21.15.59:0/1715476497 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f54180e59b0 con 0x7f54241087f0 2024-09-10T21:16:08.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.215+0000 7f542cc5d740 1 -- 172.21.15.59:0/3856414579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38df800 msgr2=0x55aba38eb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:08.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.215+0000 7f542cc5d740 1 --2- 172.21.15.59:0/3856414579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38df800 0x55aba38eb250 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f541400bd40 tx=0x7f54140107a0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.215+0000 7f5428e25640 1 --2- 172.21.15.59:0/1715476497 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f540c0b5360 0x7f540c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.215+0000 7f542cc5d740 1 -- 172.21.15.59:0/3856414579 shutdown_connections 2024-09-10T21:16:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.215+0000 7f542cc5d740 1 --2- 172.21.15.59:0/3856414579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38eb790 0x55aba38edb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.215+0000 7f542cc5d740 1 --2- 172.21.15.59:0/3856414579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38df800 0x55aba38eb250 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.215+0000 7f542cc5d740 1 --2- 172.21.15.59:0/3856414579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38deee0 0x55aba38df2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.215+0000 7f542cc5d740 1 -- 172.21.15.59:0/3856414579 >> 172.21.15.59:0/3856414579 conn(0x55aba38dcd10 msgr2=0x55aba38ddeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.215+0000 7f542cc5d740 1 -- 172.21.15.59:0/3856414579 shutdown_connections 2024-09-10T21:16:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.215+0000 7f542cc5d740 1 -- 172.21.15.59:0/3856414579 wait complete. 2024-09-10T21:16:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.216+0000 7f5428e25640 1 --2- 172.21.15.59:0/1715476497 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f540c0b5360 0x7f540c0b7820 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f541c004af0 tx=0x7f541c009540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.216+0000 7f542cc5d740 1 -- start start 2024-09-10T21:16:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.216+0000 7f542cc5d740 1 Processor -- start 2024-09-10T21:16:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.217+0000 7f542cc5d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38deee0 0x55aba38e89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.217+0000 7f542cc5d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38eb790 0x55aba38e8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:08.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.217+0000 7f542cc5d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38e9450 0x55aba3900010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.217+0000 7f542cc5d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55aba36a6890 con 0x55aba38deee0 2024-09-10T21:16:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.217+0000 7f542cc5d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55aba37dfd40 con 0x55aba38e9450 2024-09-10T21:16:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.217+0000 7f542cc5d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55aba38ee440 con 0x55aba38eb790 2024-09-10T21:16:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.217+0000 7f542cc5d740 10 client.0 _ll_register_callbacks cb 0x55aba3843c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.217+0000 7f54237fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38eb790 0x55aba38e8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.217+0000 7f54237fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38eb790 0x55aba38e8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:43870/0 (socket says 172.21.15.59:43870) 2024-09-10T21:16:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.217+0000 7f54237fe640 1 -- 172.21.15.59:0/1804901930 learned_addr learned my addr 172.21.15.59:0/1804901930 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.217+0000 7f5428e25640 1 --2- 172.21.15.59:0/1804901930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38e9450 0x55aba3900010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.217+0000 7f5423fff640 1 --2- 172.21.15.59:0/1804901930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38deee0 0x55aba38e89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.217+0000 7f5428e25640 1 -- 172.21.15.59:0/1804901930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38eb790 msgr2=0x55aba38e8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.217+0000 7f5428e25640 1 --2- 172.21.15.59:0/1804901930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38eb790 0x55aba38e8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.217+0000 7f5428e25640 1 -- 172.21.15.59:0/1804901930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38deee0 msgr2=0x55aba38e89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.217+0000 7f5428e25640 1 --2- 172.21.15.59:0/1804901930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38deee0 0x55aba38e89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.217+0000 7f5428e25640 1 -- 172.21.15.59:0/1804901930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aba3900720 con 0x55aba38e9450 2024-09-10T21:16:08.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.218+0000 7f54237fe640 1 --2- 172.21.15.59:0/1804901930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38eb790 0x55aba38e8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:16:08.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.218+0000 7f5423fff640 1 --2- 172.21.15.59:0/1804901930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38deee0 0x55aba38e89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:16:08.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.218+0000 7f5428e25640 1 --2- 172.21.15.59:0/1804901930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38e9450 0x55aba3900010 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f541c005e30 tx=0x7f541c005d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a4e82aea7936b5a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:08.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.218+0000 7f54037fe640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-10T21:16:08.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.218+0000 7f54037fe640 1 -- 172.21.15.59:0/1804901930 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c04f070 con 0x55aba38e9450 2024-09-10T21:16:08.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.218+0000 7f54037fe640 1 -- 172.21.15.59:0/1804901930 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f541c004450 con 0x55aba38e9450 2024-09-10T21:16:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.218+0000 7f542cc5d740 1 -- 172.21.15.59:0/1804901930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f541400be30 con 0x55aba38e9450 2024-09-10T21:16:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.219+0000 7f54037fe640 1 -- 172.21.15.59:0/1804901930 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f541c059050 con 0x55aba38e9450 2024-09-10T21:16:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.219+0000 7f542cc5d740 10 client.25073 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.219+0000 7f542cc5d740 1 -- 172.21.15.59:0/1804901930 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55aba39030d0 con 0x55aba38e9450 2024-09-10T21:16:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.219+0000 7f54037fe640 1 -- 172.21.15.59:0/1804901930 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f541400be30 con 0x55aba38e9450 2024-09-10T21:16:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.219+0000 7f54037fe640 1 -- 172.21.15.59:0/1804901930 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f541c044040 con 0x55aba38e9450 2024-09-10T21:16:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.219+0000 7f542cc5d740 10 client.25073 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.219+0000 7f542cc5d740 10 client.25073 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:16:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.220+0000 7f542cc5d740 20 client.25073 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.220+0000 7f542cc5d740 1 --2- 172.21.15.59:0/1804901930 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55aba39045d0 0x55aba39069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.220+0000 7f542cc5d740 4 client.25073 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:16:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.220+0000 7f542cc5d740 1 -- 172.21.15.59:0/1804901930 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aba3857db0 con 0x55aba39045d0 2024-09-10T21:16:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.220+0000 7f5423fff640 1 --2- 172.21.15.59:0/1804901930 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55aba39045d0 0x55aba39069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.220+0000 7f54037fe640 10 client.25073 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.220+0000 7f5423fff640 1 --2- 172.21.15.59:0/1804901930 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55aba39045d0 0x55aba39069e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7986fe54352c86d4 server_cookie=a90310ac6c6dd1eb in_seq=0 out_seq=0 2024-09-10T21:16:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.221+0000 7f54037fe640 1 -- 172.21.15.59:0/1804901930 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aba3857db0 con 0x55aba39045d0 2024-09-10T21:16:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.221+0000 7f54037fe640 10 client.25073 handle_command_reply: tid=0 2024-09-10T21:16:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.221+0000 7f542cc5d740 1 client.25073 shutdown 2024-09-10T21:16:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.222+0000 7f542cc5d740 1 -- 172.21.15.59:0/1804901930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38e9450 msgr2=0x55aba3900010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:08.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.222+0000 7f542cc5d740 1 --2- 172.21.15.59:0/1804901930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38e9450 0x55aba3900010 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f541c005e30 tx=0x7f541c005d80 comp rx=0 tx=0).stop 2024-09-10T21:16:08.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.222+0000 7f542cc5d740 1 -- 172.21.15.59:0/1804901930 shutdown_connections 2024-09-10T21:16:08.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.222+0000 7f542cc5d740 1 --2- 172.21.15.59:0/1804901930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38e9450 0x55aba3900010 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.222+0000 7f542cc5d740 1 --2- 172.21.15.59:0/1804901930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38eb790 0x55aba38e8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.222+0000 7f542cc5d740 1 --2- 172.21.15.59:0/1804901930 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55aba39045d0 0x55aba39069e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.222+0000 7f542cc5d740 1 --2- 172.21.15.59:0/1804901930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38deee0 0x55aba38e89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.222+0000 7f542cc5d740 1 -- 172.21.15.59:0/1804901930 >> 172.21.15.59:0/1804901930 conn(0x55aba38dcd10 msgr2=0x55aba38dbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:08.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.222+0000 7f54037fe640 0 client.25073 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:08.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.222+0000 7f542cc5d740 1 -- 172.21.15.59:0/1804901930 shutdown_connections 2024-09-10T21:16:08.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.222+0000 7f542cc5d740 1 -- 172.21.15.59:0/1804901930 wait complete. 2024-09-10T21:16:08.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.222+0000 7f542cc5d740 20 client.25073 trim_cache size 0 max 16384 2024-09-10T21:16:08.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.258+0000 7f542cc5d740 1 Processor -- start 2024-09-10T21:16:08.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.259+0000 7f542cc5d740 1 -- start start 2024-09-10T21:16:08.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.259+0000 7f542cc5d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38deee0 0x55aba38fff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:08.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.259+0000 7f542cc5d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38e9450 0x55aba38e5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:08.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.259+0000 7f542cc5d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38eb790 0x55aba38e6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:08.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.259+0000 7f54237fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38e9450 0x55aba38e5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:08.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.259+0000 7f5428e25640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38eb790 0x55aba38e6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.259+0000 7f54237fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38e9450 0x55aba38e5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:40296/0 (socket says 172.21.15.59:40296) 2024-09-10T21:16:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.259+0000 7f54237fe640 1 -- 172.21.15.59:0/1176046687 learned_addr learned my addr 172.21.15.59:0/1176046687 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.259+0000 7f542cc5d740 1 -- 172.21.15.59:0/1176046687 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f541000e3e0 con 0x55aba38eb790 2024-09-10T21:16:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.260+0000 7f5423fff640 1 --2- 172.21.15.59:0/1176046687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38deee0 0x55aba38fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.260+0000 7f542cc5d740 1 -- 172.21.15.59:0/1176046687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f541000ff20 con 0x55aba38e9450 2024-09-10T21:16:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.260+0000 7f542cc5d740 1 -- 172.21.15.59:0/1176046687 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f541000eab0 con 0x55aba38deee0 2024-09-10T21:16:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.260+0000 7f54237fe640 1 -- 172.21.15.59:0/1176046687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38deee0 msgr2=0x55aba38fff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.260+0000 7f54237fe640 1 --2- 172.21.15.59:0/1176046687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38deee0 0x55aba38fff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.260+0000 7f54237fe640 1 -- 172.21.15.59:0/1176046687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38eb790 msgr2=0x55aba38e6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.260+0000 7f54237fe640 1 --2- 172.21.15.59:0/1176046687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38eb790 0x55aba38e6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.260+0000 7f54237fe640 1 -- 172.21.15.59:0/1176046687 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aba38de8c0 con 0x55aba38e9450 2024-09-10T21:16:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.260+0000 7f54237fe640 1 --2- 172.21.15.59:0/1176046687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38e9450 0x55aba38e5c20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f54180a8710 tx=0x7f54180ab8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=852b8a2d464d4c26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.260+0000 7f5409ffb640 1 -- 172.21.15.59:0/1176046687 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541801c040 con 0x55aba38e9450 2024-09-10T21:16:08.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.261+0000 7f5409ffb640 1 -- 172.21.15.59:0/1176046687 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54180ac840 con 0x55aba38e9450 2024-09-10T21:16:08.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.261+0000 7f5409ffb640 1 -- 172.21.15.59:0/1176046687 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54180cdb20 con 0x55aba38e9450 2024-09-10T21:16:08.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.261+0000 7f542cc5d740 1 -- 172.21.15.59:0/1176046687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38e9450 msgr2=0x55aba38e5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.261+0000 7f542cc5d740 1 --2- 172.21.15.59:0/1176046687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38e9450 0x55aba38e5c20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f54180a8710 tx=0x7f54180ab8b0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.262+0000 7f542cc5d740 1 -- 172.21.15.59:0/1176046687 shutdown_connections 2024-09-10T21:16:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.262+0000 7f542cc5d740 1 --2- 172.21.15.59:0/1176046687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38eb790 0x55aba38e6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.262+0000 7f542cc5d740 1 --2- 172.21.15.59:0/1176046687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38e9450 0x55aba38e5c20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.262+0000 7f542cc5d740 1 --2- 172.21.15.59:0/1176046687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38deee0 0x55aba38fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.262+0000 7f542cc5d740 1 -- 172.21.15.59:0/1176046687 >> 172.21.15.59:0/1176046687 conn(0x55aba38dcd10 msgr2=0x55aba38e7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.262+0000 7f542cc5d740 1 -- 172.21.15.59:0/1176046687 shutdown_connections 2024-09-10T21:16:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.262+0000 7f542cc5d740 1 -- 172.21.15.59:0/1176046687 wait complete. 2024-09-10T21:16:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.262+0000 7f542cc5d740 1 -- start start 2024-09-10T21:16:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.263+0000 7f542cc5d740 1 Processor -- start 2024-09-10T21:16:08.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.263+0000 7f542cc5d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38deee0 0x55aba38fbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:08.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.263+0000 7f542cc5d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38e9450 0x55aba38fc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:08.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.264+0000 7f5423fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38deee0 0x55aba38fbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:08.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.264+0000 7f5423fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38deee0 0x55aba38fbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:40312/0 (socket says 172.21.15.59:40312) 2024-09-10T21:16:08.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.264+0000 7f5423fff640 1 -- 172.21.15.59:0/51898689 learned_addr learned my addr 172.21.15.59:0/51898689 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:08.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.264+0000 7f542cc5d740 1 --2- 172.21.15.59:0/51898689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38eb790 0x55aba38f8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:08.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.264+0000 7f54237fe640 1 --2- 172.21.15.59:0/51898689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38e9450 0x55aba38fc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.264+0000 7f542cc5d740 1 -- 172.21.15.59:0/51898689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f541000f850 con 0x55aba38eb790 2024-09-10T21:16:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.264+0000 7f542cc5d740 1 -- 172.21.15.59:0/51898689 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f541000f180 con 0x55aba38deee0 2024-09-10T21:16:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.264+0000 7f542cc5d740 1 -- 172.21.15.59:0/51898689 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f541000c3c0 con 0x55aba38e9450 2024-09-10T21:16:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.264+0000 7f5428e25640 1 --2- 172.21.15.59:0/51898689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38eb790 0x55aba38f8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.264+0000 7f542cc5d740 10 client.0 _ll_register_callbacks cb 0x7f541c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.265+0000 7f5423fff640 1 -- 172.21.15.59:0/51898689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38e9450 msgr2=0x55aba38fc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.265+0000 7f5423fff640 1 --2- 172.21.15.59:0/51898689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38e9450 0x55aba38fc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.265+0000 7f5423fff640 1 -- 172.21.15.59:0/51898689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38eb790 msgr2=0x55aba38f8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.265+0000 7f5423fff640 1 --2- 172.21.15.59:0/51898689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38eb790 0x55aba38f8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.265+0000 7f5423fff640 1 -- 172.21.15.59:0/51898689 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aba38f9500 con 0x55aba38deee0 2024-09-10T21:16:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.265+0000 7f5428e25640 1 --2- 172.21.15.59:0/51898689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38eb790 0x55aba38f8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:16:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.265+0000 7f542cc5d740 1 -- 172.21.15.59:0/51898689 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54180ac840 con 0x55aba38deee0 2024-09-10T21:16:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.265+0000 7f5423fff640 1 --2- 172.21.15.59:0/51898689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38deee0 0x55aba38fbff0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5414011010 tx=0x7f541400b970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90291fc9b729ac29 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.265+0000 7f54037fe640 10 client.25079 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-10T21:16:08.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.266+0000 7f54037fe640 1 -- 172.21.15.59:0/51898689 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5414005240 con 0x55aba38deee0 2024-09-10T21:16:08.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.266+0000 7f54037fe640 1 -- 172.21.15.59:0/51898689 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f54140053e0 con 0x55aba38deee0 2024-09-10T21:16:08.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.266+0000 7f54037fe640 1 -- 172.21.15.59:0/51898689 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f54140035f0 con 0x55aba38deee0 2024-09-10T21:16:08.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.266+0000 7f542cc5d740 10 client.25079 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:08.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.266+0000 7f542cc5d740 1 -- 172.21.15.59:0/51898689 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55aba3971ac0 con 0x55aba38deee0 2024-09-10T21:16:08.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.267+0000 7f54037fe640 1 -- 172.21.15.59:0/51898689 <== mon.2 v2:172.21.15.154:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5414003790 con 0x55aba38deee0 2024-09-10T21:16:08.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.267+0000 7f542cc5d740 10 client.25079 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:08.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.267+0000 7f542cc5d740 10 client.25079 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:16:08.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.267+0000 7f542cc5d740 20 client.25079 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:08.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.267+0000 7f542cc5d740 1 --2- 172.21.15.59:0/51898689 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55aba3971ef0 0x55aba39742e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:08.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.267+0000 7f542cc5d740 4 client.25079 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:16:08.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.267+0000 7f542cc5d740 1 -- 172.21.15.59:0/51898689 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55aba3853860 con 0x55aba3971ef0 2024-09-10T21:16:08.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.267+0000 7f54237fe640 1 --2- 172.21.15.59:0/51898689 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55aba3971ef0 0x55aba39742e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:08.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.268+0000 7f54237fe640 1 --2- 172.21.15.59:0/51898689 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55aba3971ef0 0x55aba39742e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85fceac3273ffa59 server_cookie=b0b00eb92a6faee7 in_seq=0 out_seq=0 2024-09-10T21:16:08.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.268+0000 7f54037fe640 10 client.25079 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:08.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.269+0000 7f54037fe640 1 -- 172.21.15.59:0/51898689 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55aba3853860 con 0x55aba3971ef0 2024-09-10T21:16:08.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.270+0000 7f54037fe640 10 client.25079 handle_command_reply: tid=0 2024-09-10T21:16:08.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.270+0000 7f542cc5d740 1 client.25079 shutdown 2024-09-10T21:16:08.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.270+0000 7f542cc5d740 1 -- 172.21.15.59:0/51898689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38deee0 msgr2=0x55aba38fbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:08.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.270+0000 7f542cc5d740 1 --2- 172.21.15.59:0/51898689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38deee0 0x55aba38fbff0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5414011010 tx=0x7f541400b970 comp rx=0 tx=0).stop 2024-09-10T21:16:08.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.270+0000 7f542cc5d740 1 -- 172.21.15.59:0/51898689 shutdown_connections 2024-09-10T21:16:08.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.270+0000 7f542cc5d740 1 --2- 172.21.15.59:0/51898689 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55aba3971ef0 0x55aba39742e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.270+0000 7f542cc5d740 1 --2- 172.21.15.59:0/51898689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55aba38eb790 0x55aba38f8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.270+0000 7f542cc5d740 1 --2- 172.21.15.59:0/51898689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55aba38e9450 0x55aba38fc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.270+0000 7f542cc5d740 1 --2- 172.21.15.59:0/51898689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aba38deee0 0x55aba38fbff0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.270+0000 7f542cc5d740 1 -- 172.21.15.59:0/51898689 >> 172.21.15.59:0/51898689 conn(0x55aba38dcd10 msgr2=0x55aba38e7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:08.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.270+0000 7f54037fe640 0 client.25079 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:08.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.271+0000 7f542cc5d740 1 -- 172.21.15.59:0/51898689 shutdown_connections 2024-09-10T21:16:08.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.271+0000 7f542cc5d740 1 -- 172.21.15.59:0/51898689 wait complete. 2024-09-10T21:16:08.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.271+0000 7f542cc5d740 20 client.25079 trim_cache size 0 max 16384 2024-09-10T21:16:08.276 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:16:08.276 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:16:08.276 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "e25ed439-dea8-471d-8eaa-846b9bc0b6b2", 2024-09-10T21:16:08.276 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:16:08.276 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:16:08.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.272+0000 7f542a888640 1 -- 172.21.15.59:0/1715476497 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f540c0b5360 msgr2=0x7f540c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:08.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.272+0000 7f542a888640 1 --2- 172.21.15.59:0/1715476497 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f540c0b5360 0x7f540c0b7820 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f541c004af0 tx=0x7f541c009540 comp rx=0 tx=0).stop 2024-09-10T21:16:08.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.272+0000 7f542a888640 1 -- 172.21.15.59:0/1715476497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54241087f0 msgr2=0x7f5424074c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:08.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.272+0000 7f542a888640 1 --2- 172.21.15.59:0/1715476497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54241087f0 0x7f5424074c70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f541800e9f0 tx=0x7f541800eeb0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.272+0000 7f542a888640 1 -- 172.21.15.59:0/1715476497 shutdown_connections 2024-09-10T21:16:08.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.272+0000 7f542a888640 1 --2- 172.21.15.59:0/1715476497 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f540c0b5360 0x7f540c0b7820 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.272+0000 7f542a888640 1 --2- 172.21.15.59:0/1715476497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5424109170 0x7f542406da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.272+0000 7f542a888640 1 --2- 172.21.15.59:0/1715476497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54241087f0 0x7f5424074c70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.272+0000 7f542a888640 1 --2- 172.21.15.59:0/1715476497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5424102de0 0x7f5424074730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:08.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.272+0000 7f542a888640 1 -- 172.21.15.59:0/1715476497 >> 172.21.15.59:0/1715476497 conn(0x7f54240fe830 msgr2=0x7f5424100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:08.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.272+0000 7f542a888640 1 -- 172.21.15.59:0/1715476497 shutdown_connections 2024-09-10T21:16:08.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:08.272+0000 7f542a888640 1 -- 172.21.15.59:0/1715476497 wait complete. 2024-09-10T21:16:08.984 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:16:09.319 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:16:09.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:09 smithi192 ceph-mon[35363]: pgmap v366: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-10T21:16:09.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:09 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:16:09.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:09 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:16:09.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:09 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:16:09.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:09 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:16:09.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:09 smithi059 ceph-mon[30888]: pgmap v366: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-10T21:16:09.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:09 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:16:09.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:09 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:16:09.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:09 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:16:09.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:09 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:16:09.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:09 smithi154 ceph-mon[35041]: pgmap v366: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-10T21:16:09.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:09 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:16:09.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:09 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:16:09.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:09 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:16:09.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:09 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:16:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.828+0000 7fdef46d7640 1 -- 172.21.15.59:0/3828379094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdeec103b30 msgr2=0x7fdeec103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.828+0000 7fdef46d7640 1 --2- 172.21.15.59:0/3828379094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdeec103b30 0x7fdeec103f10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009900 tx=0x7fdee802a410 comp rx=0 tx=0).stop 2024-09-10T21:16:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.828+0000 7fdef46d7640 1 -- 172.21.15.59:0/3828379094 shutdown_connections 2024-09-10T21:16:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.828+0000 7fdef46d7640 1 --2- 172.21.15.59:0/3828379094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdeec10d0e0 0x7fdeec10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.828+0000 7fdef46d7640 1 --2- 172.21.15.59:0/3828379094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdeec104530 0x7fdeec10cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.828+0000 7fdef46d7640 1 --2- 172.21.15.59:0/3828379094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdeec103b30 0x7fdeec103f10 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.828+0000 7fdef46d7640 1 -- 172.21.15.59:0/3828379094 >> 172.21.15.59:0/3828379094 conn(0x7fdeec0fd700 msgr2=0x7fdeec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.828+0000 7fdef46d7640 1 -- 172.21.15.59:0/3828379094 shutdown_connections 2024-09-10T21:16:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.828+0000 7fdef46d7640 1 -- 172.21.15.59:0/3828379094 wait complete. 2024-09-10T21:16:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.829+0000 7fdef46d7640 1 Processor -- start 2024-09-10T21:16:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.829+0000 7fdef46d7640 1 -- start start 2024-09-10T21:16:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.830+0000 7fdef46d7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdeec103b30 0x7fdeec199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.830+0000 7fdef46d7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdeec104530 0x7fdeec199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.830+0000 7fdef46d7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdeec10d0e0 0x7fdeec19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.830+0000 7fdef46d7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec112db0 con 0x7fdeec103b30 2024-09-10T21:16:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.830+0000 7fdef46d7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec112c30 con 0x7fdeec104530 2024-09-10T21:16:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.830+0000 7fdef46d7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec112f30 con 0x7fdeec10d0e0 2024-09-10T21:16:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.830+0000 7fdef2473640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdeec103b30 0x7fdeec199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.830+0000 7fdef2473640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdeec103b30 0x7fdeec199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37578/0 (socket says 172.21.15.59:37578) 2024-09-10T21:16:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.830+0000 7fdef2473640 1 -- 172.21.15.59:0/3258510395 learned_addr learned my addr 172.21.15.59:0/3258510395 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.830+0000 7fdef1c72640 1 --2- 172.21.15.59:0/3258510395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdeec104530 0x7fdeec199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.830+0000 7fdef2c74640 1 --2- 172.21.15.59:0/3258510395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdeec10d0e0 0x7fdeec19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.830+0000 7fdef2473640 1 -- 172.21.15.59:0/3258510395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdeec10d0e0 msgr2=0x7fdeec19eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.830+0000 7fdef2473640 1 --2- 172.21.15.59:0/3258510395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdeec10d0e0 0x7fdeec19eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.830+0000 7fdef2473640 1 -- 172.21.15.59:0/3258510395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdeec104530 msgr2=0x7fdeec199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.830+0000 7fdef2473640 1 --2- 172.21.15.59:0/3258510395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdeec104530 0x7fdeec199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.830+0000 7fdef2473640 1 -- 172.21.15.59:0/3258510395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeec19f2f0 con 0x7fdeec103b30 2024-09-10T21:16:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.830+0000 7fdef1c72640 1 --2- 172.21.15.59:0/3258510395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdeec104530 0x7fdeec199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:16:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.830+0000 7fdef2473640 1 --2- 172.21.15.59:0/3258510395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdeec103b30 0x7fdeec199240 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fdee8005ab0 tx=0x7fdee8003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.831+0000 7fdee37fe640 1 -- 172.21.15.59:0/3258510395 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee803f070 con 0x7fdeec103b30 2024-09-10T21:16:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.831+0000 7fdee37fe640 1 -- 172.21.15.59:0/3258510395 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdee8031d60 con 0x7fdeec103b30 2024-09-10T21:16:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.831+0000 7fdef46d7640 1 -- 172.21.15.59:0/3258510395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeec19f580 con 0x7fdeec103b30 2024-09-10T21:16:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.831+0000 7fdee37fe640 1 -- 172.21.15.59:0/3258510395 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee8035030 con 0x7fdeec103b30 2024-09-10T21:16:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.831+0000 7fdef46d7640 1 -- 172.21.15.59:0/3258510395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeec1a5ca0 con 0x7fdeec103b30 2024-09-10T21:16:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.833+0000 7fdef6aac740 1 Processor -- start 2024-09-10T21:16:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.834+0000 7fdef6aac740 1 -- start start 2024-09-10T21:16:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.834+0000 7fdee37fe640 1 -- 172.21.15.59:0/3258510395 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fdee803b460 con 0x7fdeec103b30 2024-09-10T21:16:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.834+0000 7fdef6aac740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71b40a0 0x5641c71b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.834+0000 7fdef6aac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71b49c0 0x5641c71c4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.834+0000 7fdef6aac740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71c4d60 0x5641c71c7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.834+0000 7fdef6aac740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5641c712ae50 con 0x5641c71c4d60 2024-09-10T21:16:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.834+0000 7fdef6aac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5641c711a280 con 0x5641c71b49c0 2024-09-10T21:16:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.834+0000 7fdef6aac740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5641c711e090 con 0x5641c71b40a0 2024-09-10T21:16:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.834+0000 7fdef1c72640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71c4d60 0x5641c71c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.834+0000 7fdef2473640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71b49c0 0x5641c71c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.834+0000 7fdef1c72640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71c4d60 0x5641c71c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37588/0 (socket says 172.21.15.59:37588) 2024-09-10T21:16:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.834+0000 7fdef1c72640 1 -- 172.21.15.59:0/2381777752 learned_addr learned my addr 172.21.15.59:0/2381777752 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.834+0000 7fdef2c74640 1 --2- 172.21.15.59:0/2381777752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71b40a0 0x5641c71b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.835+0000 7fdef1c72640 1 -- 172.21.15.59:0/2381777752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71b40a0 msgr2=0x5641c71b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.835+0000 7fdef1c72640 1 --2- 172.21.15.59:0/2381777752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71b40a0 0x5641c71b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.835+0000 7fdef1c72640 1 -- 172.21.15.59:0/2381777752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71b49c0 msgr2=0x5641c71c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.835+0000 7fdef1c72640 1 --2- 172.21.15.59:0/2381777752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71b49c0 0x5641c71c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.835+0000 7fdef1c72640 1 -- 172.21.15.59:0/2381777752 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c6e78650 con 0x5641c71c4d60 2024-09-10T21:16:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.835+0000 7fdef2473640 1 --2- 172.21.15.59:0/2381777752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71b49c0 0x5641c71c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:16:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.835+0000 7fdee37fe640 1 --2- 172.21.15.59:0/3258510395 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fded80b52e0 0x7fded80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:09.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.835+0000 7fdef1c72640 1 --2- 172.21.15.59:0/2381777752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71c4d60 0x5641c71c7150 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0104b0 tx=0x7fdedc010970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97eaa0f97a349bfe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.835+0000 7fdef2c74640 1 --2- 172.21.15.59:0/3258510395 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fded80b52e0 0x7fded80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.835+0000 7fdee37fe640 1 -- 172.21.15.59:0/3258510395 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdee8106670 con 0x7fdeec103b30 2024-09-10T21:16:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.835+0000 7fdee0ff9640 1 -- 172.21.15.59:0/2381777752 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc011760 con 0x5641c71c4d60 2024-09-10T21:16:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.835+0000 7fdee0ff9640 1 -- 172.21.15.59:0/2381777752 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdedc011db0 con 0x5641c71c4d60 2024-09-10T21:16:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.835+0000 7fdee0ff9640 1 -- 172.21.15.59:0/2381777752 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc00e3d0 con 0x5641c71c4d60 2024-09-10T21:16:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.836+0000 7fdef2c74640 1 --2- 172.21.15.59:0/3258510395 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fded80b52e0 0x7fded80b77a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdee4005fd0 tx=0x7fdee4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.836+0000 7fdef6aac740 1 -- 172.21.15.59:0/2381777752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71c4d60 msgr2=0x5641c71c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.836+0000 7fdef6aac740 1 --2- 172.21.15.59:0/2381777752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71c4d60 0x5641c71c7150 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdedc0104b0 tx=0x7fdedc010970 comp rx=0 tx=0).stop 2024-09-10T21:16:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.836+0000 7fdef6aac740 1 -- 172.21.15.59:0/2381777752 shutdown_connections 2024-09-10T21:16:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.836+0000 7fdef6aac740 1 --2- 172.21.15.59:0/2381777752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71c4d60 0x5641c71c7150 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.836+0000 7fdef6aac740 1 --2- 172.21.15.59:0/2381777752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71b49c0 0x5641c71c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.836+0000 7fdef6aac740 1 --2- 172.21.15.59:0/2381777752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71b40a0 0x5641c71b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.836+0000 7fdef6aac740 1 -- 172.21.15.59:0/2381777752 >> 172.21.15.59:0/2381777752 conn(0x5641c71b1ed0 msgr2=0x5641c71b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.836+0000 7fdef6aac740 1 -- 172.21.15.59:0/2381777752 shutdown_connections 2024-09-10T21:16:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.836+0000 7fdef6aac740 1 -- 172.21.15.59:0/2381777752 wait complete. 2024-09-10T21:16:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.837+0000 7fdef6aac740 1 -- start start 2024-09-10T21:16:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.837+0000 7fdef6aac740 1 Processor -- start 2024-09-10T21:16:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.837+0000 7fdef6aac740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71b40a0 0x5641c71c4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.837+0000 7fdef6aac740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 0x5641c71c1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.837+0000 7fdef6aac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71c4d60 0x5641c71c2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.837+0000 7fdef6aac740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5641c6f7b700 con 0x5641c71b49c0 2024-09-10T21:16:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.837+0000 7fdef6aac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5641c70b5110 con 0x5641c71c4d60 2024-09-10T21:16:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.837+0000 7fdef6aac740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5641c71c7a10 con 0x5641c71b40a0 2024-09-10T21:16:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.837+0000 7fdef6aac740 10 client.0 _ll_register_callbacks cb 0x5641c70ce990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:09.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.837+0000 7fdef1c72640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 0x5641c71c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.837+0000 7fdef1c72640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 0x5641c71c1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37600/0 (socket says 172.21.15.59:37600) 2024-09-10T21:16:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.837+0000 7fdef1c72640 1 -- 172.21.15.59:0/2974830508 learned_addr learned my addr 172.21.15.59:0/2974830508 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.837+0000 7fdef2473640 1 --2- 172.21.15.59:0/2974830508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71b40a0 0x5641c71c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.838+0000 7fdef2c74640 1 --2- 172.21.15.59:0/2974830508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71c4d60 0x5641c71c2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.838+0000 7fdef1c72640 1 -- 172.21.15.59:0/2974830508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71b40a0 msgr2=0x5641c71c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.838+0000 7fdef1c72640 1 --2- 172.21.15.59:0/2974830508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71b40a0 0x5641c71c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.838+0000 7fdef1c72640 1 -- 172.21.15.59:0/2974830508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71c4d60 msgr2=0x5641c71c2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.838+0000 7fdef1c72640 1 --2- 172.21.15.59:0/2974830508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71c4d60 0x5641c71c2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.838+0000 7fdef1c72640 1 -- 172.21.15.59:0/2974830508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641c70e2c40 con 0x5641c71b49c0 2024-09-10T21:16:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.838+0000 7fdef1c72640 1 --2- 172.21.15.59:0/2974830508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 0x5641c71c1a80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fdedc000c00 tx=0x7fdedc01c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e719c98f034a9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.838+0000 7fded5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.838+0000 7fded5ffb640 1 -- 172.21.15.59:0/2974830508 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc02a060 con 0x5641c71b49c0 2024-09-10T21:16:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.838+0000 7fded5ffb640 1 -- 172.21.15.59:0/2974830508 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdedc005450 con 0x5641c71b49c0 2024-09-10T21:16:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.838+0000 7fdef6aac740 1 -- 172.21.15.59:0/2974830508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdedc011db0 con 0x5641c71b49c0 2024-09-10T21:16:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.838+0000 7fded5ffb640 1 -- 172.21.15.59:0/2974830508 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdedc005650 con 0x5641c71b49c0 2024-09-10T21:16:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.838+0000 7fdef6aac740 10 client.15540 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.838+0000 7fdef6aac740 1 -- 172.21.15.59:0/2974830508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5641c71d3350 con 0x5641c71b49c0 2024-09-10T21:16:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.838+0000 7fded5ffb640 1 -- 172.21.15.59:0/2974830508 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdedc011db0 con 0x5641c71b49c0 2024-09-10T21:16:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.839+0000 7fded5ffb640 1 -- 172.21.15.59:0/2974830508 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdedc004920 con 0x5641c71b49c0 2024-09-10T21:16:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.839+0000 7fdef6aac740 10 client.15540 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.839+0000 7fdef6aac740 10 client.15540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:16:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.839+0000 7fdef6aac740 20 client.15540 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.839+0000 7fdef6aac740 1 --2- 172.21.15.59:0/2974830508 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5641c71d47b0 0x5641c71d6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.839+0000 7fdef6aac740 4 client.15540 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:16:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.839+0000 7fdef6aac740 1 -- 172.21.15.59:0/2974830508 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641c712cda0 con 0x5641c71d47b0 2024-09-10T21:16:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.839+0000 7fdef2473640 1 --2- 172.21.15.59:0/2974830508 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5641c71d47b0 0x5641c71d6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.839+0000 7fdef2473640 1 --2- 172.21.15.59:0/2974830508 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5641c71d47b0 0x5641c71d6ba0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=beb8790d8747f8df server_cookie=fdc00f89217bb0ab in_seq=0 out_seq=0 2024-09-10T21:16:09.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.839+0000 7fded5ffb640 10 client.15540 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:09.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.840+0000 7fded5ffb640 1 -- 172.21.15.59:0/2974830508 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5641c712cda0 con 0x5641c71d47b0 2024-09-10T21:16:09.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.840+0000 7fded5ffb640 10 client.15540 handle_command_reply: tid=0 2024-09-10T21:16:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.840+0000 7fdef6aac740 1 client.15540 shutdown 2024-09-10T21:16:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.840+0000 7fdef6aac740 1 -- 172.21.15.59:0/2974830508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 msgr2=0x5641c71c1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.840+0000 7fdef6aac740 1 --2- 172.21.15.59:0/2974830508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 0x5641c71c1a80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fdedc000c00 tx=0x7fdedc01c6b0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.840+0000 7fdef6aac740 1 -- 172.21.15.59:0/2974830508 shutdown_connections 2024-09-10T21:16:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.840+0000 7fdef6aac740 1 --2- 172.21.15.59:0/2974830508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71c4d60 0x5641c71c2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.840+0000 7fdef6aac740 1 --2- 172.21.15.59:0/2974830508 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5641c71d47b0 0x5641c71d6ba0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.840+0000 7fdef6aac740 1 --2- 172.21.15.59:0/2974830508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 0x5641c71c1a80 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.840+0000 7fded5ffb640 0 client.15540 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.840+0000 7fdef6aac740 1 --2- 172.21.15.59:0/2974830508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71b40a0 0x5641c71c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.840+0000 7fdef6aac740 1 -- 172.21.15.59:0/2974830508 >> 172.21.15.59:0/2974830508 conn(0x5641c71b1ed0 msgr2=0x5641c71b7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.841+0000 7fdef6aac740 1 -- 172.21.15.59:0/2974830508 shutdown_connections 2024-09-10T21:16:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.841+0000 7fdef6aac740 1 -- 172.21.15.59:0/2974830508 wait complete. 2024-09-10T21:16:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.841+0000 7fdef6aac740 20 client.15540 trim_cache size 0 max 16384 2024-09-10T21:16:09.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.858+0000 7fdef6aac740 1 Processor -- start 2024-09-10T21:16:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.858+0000 7fdef6aac740 1 -- start start 2024-09-10T21:16:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.859+0000 7fdef6aac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71b40a0 0x5641c71d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.859+0000 7fdef6aac740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 0x5641c71b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.859+0000 7fdef6aac740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71c4d60 0x5641c71b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.859+0000 7fdef6aac740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec1ac060 con 0x5641c71b49c0 2024-09-10T21:16:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.859+0000 7fdef6aac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec1adba0 con 0x5641c71b40a0 2024-09-10T21:16:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.859+0000 7fdef6aac740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec1ac730 con 0x5641c71c4d60 2024-09-10T21:16:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.859+0000 7fdef1c72640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 0x5641c71b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.859+0000 7fdef1c72640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 0x5641c71b2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37612/0 (socket says 172.21.15.59:37612) 2024-09-10T21:16:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.859+0000 7fdef1c72640 1 -- 172.21.15.59:0/394529507 learned_addr learned my addr 172.21.15.59:0/394529507 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.859+0000 7fdef2c74640 1 --2- 172.21.15.59:0/394529507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71c4d60 0x5641c71b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.859+0000 7fdef2473640 1 --2- 172.21.15.59:0/394529507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71b40a0 0x5641c71d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:09.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.859+0000 7fdef1c72640 1 -- 172.21.15.59:0/394529507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71c4d60 msgr2=0x5641c71b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:09.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.859+0000 7fdef1c72640 1 --2- 172.21.15.59:0/394529507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71c4d60 0x5641c71b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.859+0000 7fdef1c72640 1 -- 172.21.15.59:0/394529507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71b40a0 msgr2=0x5641c71d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:09.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.859+0000 7fdef1c72640 1 --2- 172.21.15.59:0/394529507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71b40a0 0x5641c71d0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.859+0000 7fdef1c72640 1 -- 172.21.15.59:0/394529507 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c71b2950 con 0x5641c71b49c0 2024-09-10T21:16:09.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.859+0000 7fdef2473640 1 --2- 172.21.15.59:0/394529507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71b40a0 0x5641c71d0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:16:09.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.859+0000 7fdef1c72640 1 --2- 172.21.15.59:0/394529507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 0x5641c71b2bb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdedc004d70 tx=0x7fdedc005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d7164dfe9820be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:09.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.860+0000 7fded7fff640 1 -- 172.21.15.59:0/394529507 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc035070 con 0x5641c71b49c0 2024-09-10T21:16:09.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.860+0000 7fded7fff640 1 -- 172.21.15.59:0/394529507 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdedc010e70 con 0x5641c71b49c0 2024-09-10T21:16:09.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.860+0000 7fded7fff640 1 -- 172.21.15.59:0/394529507 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc02a070 con 0x5641c71b49c0 2024-09-10T21:16:09.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.860+0000 7fdef6aac740 1 -- 172.21.15.59:0/394529507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 msgr2=0x5641c71b2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:09.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.860+0000 7fdef6aac740 1 --2- 172.21.15.59:0/394529507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 0x5641c71b2bb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdedc004d70 tx=0x7fdedc005d40 comp rx=0 tx=0).stop 2024-09-10T21:16:09.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.861+0000 7fdef6aac740 1 -- 172.21.15.59:0/394529507 shutdown_connections 2024-09-10T21:16:09.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.861+0000 7fdef6aac740 1 --2- 172.21.15.59:0/394529507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71c4d60 0x5641c71b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.861+0000 7fdef6aac740 1 --2- 172.21.15.59:0/394529507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 0x5641c71b2bb0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.861+0000 7fdef6aac740 1 --2- 172.21.15.59:0/394529507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71b40a0 0x5641c71d0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.861+0000 7fdef6aac740 1 -- 172.21.15.59:0/394529507 >> 172.21.15.59:0/394529507 conn(0x5641c71b1ed0 msgr2=0x5641c71c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:09.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.861+0000 7fdef6aac740 1 -- 172.21.15.59:0/394529507 shutdown_connections 2024-09-10T21:16:09.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.861+0000 7fdef6aac740 1 -- 172.21.15.59:0/394529507 wait complete. 2024-09-10T21:16:09.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.861+0000 7fdef6aac740 1 -- start start 2024-09-10T21:16:09.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.861+0000 7fdef6aac740 1 Processor -- start 2024-09-10T21:16:09.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.861+0000 7fdef6aac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71b40a0 0x5641c71ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:09.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.861+0000 7fdef6aac740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 0x5641c71cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:09.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.861+0000 7fdef6aac740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71c4d60 0x5641c71c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:09.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.861+0000 7fdef6aac740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec1ad4d0 con 0x5641c71b49c0 2024-09-10T21:16:09.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.861+0000 7fdef6aac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec1ace00 con 0x5641c71b40a0 2024-09-10T21:16:09.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.861+0000 7fdef6aac740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec1aa060 con 0x5641c71c4d60 2024-09-10T21:16:09.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.862+0000 7fdef6aac740 10 client.0 _ll_register_callbacks cb 0x7fdee810c420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:09.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.862+0000 7fdef1c72640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 0x5641c71cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:09.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.862+0000 7fdef1c72640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 0x5641c71cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37620/0 (socket says 172.21.15.59:37620) 2024-09-10T21:16:09.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.862+0000 7fdef1c72640 1 -- 172.21.15.59:0/3849588680 learned_addr learned my addr 172.21.15.59:0/3849588680 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:09.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.862+0000 7fdef2c74640 1 --2- 172.21.15.59:0/3849588680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71c4d60 0x5641c71c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:09.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.862+0000 7fdef2473640 1 --2- 172.21.15.59:0/3849588680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71b40a0 0x5641c71ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:09.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.862+0000 7fdef1c72640 1 -- 172.21.15.59:0/3849588680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71c4d60 msgr2=0x5641c71c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:09.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.862+0000 7fdef1c72640 1 --2- 172.21.15.59:0/3849588680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71c4d60 0x5641c71c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.862+0000 7fdef1c72640 1 -- 172.21.15.59:0/3849588680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71b40a0 msgr2=0x5641c71ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.862+0000 7fdef1c72640 1 --2- 172.21.15.59:0/3849588680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71b40a0 0x5641c71ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.862+0000 7fdef1c72640 1 -- 172.21.15.59:0/3849588680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641c71c81d0 con 0x5641c71b49c0 2024-09-10T21:16:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.862+0000 7fdef1c72640 1 --2- 172.21.15.59:0/3849588680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 0x5641c71cd220 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00b4e0 tx=0x7fdedc00bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883c359630d596a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.862+0000 7fded5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.862+0000 7fded5ffb640 1 -- 172.21.15.59:0/3849588680 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc03d070 con 0x5641c71b49c0 2024-09-10T21:16:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.862+0000 7fded5ffb640 1 -- 172.21.15.59:0/3849588680 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdedc004220 con 0x5641c71b49c0 2024-09-10T21:16:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.862+0000 7fdef6aac740 1 -- 172.21.15.59:0/3849588680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdedc010e70 con 0x5641c71b49c0 2024-09-10T21:16:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.863+0000 7fded5ffb640 1 -- 172.21.15.59:0/3849588680 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdedc048070 con 0x5641c71b49c0 2024-09-10T21:16:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.863+0000 7fdef6aac740 10 client.15546 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.863+0000 7fdef6aac740 1 -- 172.21.15.59:0/3849588680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5641c7241ac0 con 0x5641c71b49c0 2024-09-10T21:16:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.863+0000 7fded5ffb640 1 -- 172.21.15.59:0/3849588680 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdedc010e70 con 0x5641c71b49c0 2024-09-10T21:16:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.863+0000 7fded5ffb640 1 -- 172.21.15.59:0/3849588680 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdedc0309a0 con 0x5641c71b49c0 2024-09-10T21:16:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.863+0000 7fdef6aac740 10 client.15546 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.863+0000 7fdef6aac740 10 client.15546 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:16:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.863+0000 7fdef6aac740 20 client.15546 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.863+0000 7fdef6aac740 1 --2- 172.21.15.59:0/3849588680 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5641c71d47b0 0x5641c7244110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.863+0000 7fdef6aac740 4 client.15546 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:16:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.863+0000 7fdef6aac740 1 -- 172.21.15.59:0/3849588680 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5641c7128850 con 0x5641c71d47b0 2024-09-10T21:16:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.863+0000 7fdef2473640 1 --2- 172.21.15.59:0/3849588680 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5641c71d47b0 0x5641c7244110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.864+0000 7fdef2473640 1 --2- 172.21.15.59:0/3849588680 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5641c71d47b0 0x5641c7244110 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37b0c0578b851c37 server_cookie=1669780ff2ed3d44 in_seq=0 out_seq=0 2024-09-10T21:16:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.864+0000 7fded5ffb640 10 client.15546 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.864+0000 7fded5ffb640 1 -- 172.21.15.59:0/3849588680 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x5641c7128850 con 0x5641c71d47b0 2024-09-10T21:16:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.864+0000 7fded5ffb640 10 client.15546 handle_command_reply: tid=0 2024-09-10T21:16:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.864+0000 7fdef6aac740 1 client.15546 shutdown 2024-09-10T21:16:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.864+0000 7fdef6aac740 1 -- 172.21.15.59:0/3849588680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 msgr2=0x5641c71cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.864+0000 7fdef6aac740 1 --2- 172.21.15.59:0/3849588680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 0x5641c71cd220 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00b4e0 tx=0x7fdedc00bc90 comp rx=0 tx=0).stop 2024-09-10T21:16:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.864+0000 7fdef6aac740 1 -- 172.21.15.59:0/3849588680 shutdown_connections 2024-09-10T21:16:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.864+0000 7fdef6aac740 1 --2- 172.21.15.59:0/3849588680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5641c71c4d60 0x5641c71c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.864+0000 7fdef6aac740 1 --2- 172.21.15.59:0/3849588680 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5641c71d47b0 0x5641c7244110 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.864+0000 7fdef6aac740 1 --2- 172.21.15.59:0/3849588680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5641c71b49c0 0x5641c71cd220 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.864+0000 7fdef6aac740 1 --2- 172.21.15.59:0/3849588680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5641c71b40a0 0x5641c71ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.864+0000 7fdef6aac740 1 -- 172.21.15.59:0/3849588680 >> 172.21.15.59:0/3849588680 conn(0x5641c71b1ed0 msgr2=0x5641c71b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.864+0000 7fded5ffb640 0 client.15546 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.864+0000 7fdef6aac740 1 -- 172.21.15.59:0/3849588680 shutdown_connections 2024-09-10T21:16:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.864+0000 7fdef6aac740 1 -- 172.21.15.59:0/3849588680 wait complete. 2024-09-10T21:16:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.865+0000 7fdef6aac740 20 client.15546 trim_cache size 0 max 16384 2024-09-10T21:16:09.873 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:16:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:16:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:16:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:16:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:16:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:16:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:16:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:16:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:16:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:16:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:16:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:16:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:16:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:16:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:16:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:16:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:16:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:16:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:16:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:16:09.875 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:16:09.875 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:16:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.865+0000 7fdef46d7640 1 -- 172.21.15.59:0/3258510395 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fded80b52e0 msgr2=0x7fded80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.865+0000 7fdef46d7640 1 --2- 172.21.15.59:0/3258510395 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fded80b52e0 0x7fded80b77a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdee4005fd0 tx=0x7fdee4009500 comp rx=0 tx=0).stop 2024-09-10T21:16:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.865+0000 7fdef46d7640 1 -- 172.21.15.59:0/3258510395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdeec103b30 msgr2=0x7fdeec199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.865+0000 7fdef46d7640 1 --2- 172.21.15.59:0/3258510395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdeec103b30 0x7fdeec199240 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fdee8005ab0 tx=0x7fdee8003c80 comp rx=0 tx=0).stop 2024-09-10T21:16:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.865+0000 7fdef46d7640 1 -- 172.21.15.59:0/3258510395 shutdown_connections 2024-09-10T21:16:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.865+0000 7fdef46d7640 1 --2- 172.21.15.59:0/3258510395 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fded80b52e0 0x7fded80b77a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.865+0000 7fdef46d7640 1 --2- 172.21.15.59:0/3258510395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdeec10d0e0 0x7fdeec19eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.865+0000 7fdef46d7640 1 --2- 172.21.15.59:0/3258510395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdeec104530 0x7fdeec199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.865+0000 7fdef46d7640 1 --2- 172.21.15.59:0/3258510395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdeec103b30 0x7fdeec199240 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.865+0000 7fdef46d7640 1 -- 172.21.15.59:0/3258510395 >> 172.21.15.59:0/3258510395 conn(0x7fdeec0fd700 msgr2=0x7fdeec0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.865+0000 7fdef46d7640 1 -- 172.21.15.59:0/3258510395 shutdown_connections 2024-09-10T21:16:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:09.865+0000 7fdef46d7640 1 -- 172.21.15.59:0/3258510395 wait complete. 2024-09-10T21:16:10.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:10 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:16:10.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:10 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:16:10.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:10 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:16:10.821 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:16:10.821 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:16:11.092 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:16:11.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:11 smithi059 ceph-mon[30888]: pgmap v367: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-10T21:16:11.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:11 smithi192 ceph-mon[35363]: pgmap v367: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-10T21:16:11.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:11 smithi154 ceph-mon[35041]: pgmap v367: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-10T21:16:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.661+0000 7f2c680b7640 1 -- 172.21.15.59:0/230294388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6010d100 msgr2=0x7f2c6010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.661+0000 7f2c680b7640 1 --2- 172.21.15.59:0/230294388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6010d100 0x7f2c6010f560 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2c58009ca0 tx=0x7f2c5802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:16:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.661+0000 7f2c680b7640 1 -- 172.21.15.59:0/230294388 shutdown_connections 2024-09-10T21:16:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.661+0000 7f2c680b7640 1 --2- 172.21.15.59:0/230294388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6010d100 0x7f2c6010f560 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.661+0000 7f2c680b7640 1 --2- 172.21.15.59:0/230294388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c601045c0 0x7f2c6010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.661+0000 7f2c680b7640 1 --2- 172.21.15.59:0/230294388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c60103ca0 0x7f2c60104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.661+0000 7f2c680b7640 1 -- 172.21.15.59:0/230294388 >> 172.21.15.59:0/230294388 conn(0x7f2c600fd700 msgr2=0x7f2c600ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.661+0000 7f2c680b7640 1 -- 172.21.15.59:0/230294388 shutdown_connections 2024-09-10T21:16:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.661+0000 7f2c680b7640 1 -- 172.21.15.59:0/230294388 wait complete. 2024-09-10T21:16:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.662+0000 7f2c680b7640 1 Processor -- start 2024-09-10T21:16:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.662+0000 7f2c680b7640 1 -- start start 2024-09-10T21:16:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.662+0000 7f2c680b7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c60103ca0 0x7f2c60199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.662+0000 7f2c680b7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c601045c0 0x7f2c60199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.662+0000 7f2c680b7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6010d100 0x7f2c6019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.662+0000 7f2c680b7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2c60112db0 con 0x7f2c6010d100 2024-09-10T21:16:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.662+0000 7f2c680b7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2c60112c30 con 0x7f2c601045c0 2024-09-10T21:16:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.662+0000 7f2c680b7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2c60112f30 con 0x7f2c60103ca0 2024-09-10T21:16:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.662+0000 7f2c66654640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6010d100 0x7f2c6019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.663+0000 7f2c66654640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6010d100 0x7f2c6019eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37640/0 (socket says 172.21.15.59:37640) 2024-09-10T21:16:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.663+0000 7f2c66654640 1 -- 172.21.15.59:0/3577650818 learned_addr learned my addr 172.21.15.59:0/3577650818 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.663+0000 7f2c65e53640 1 --2- 172.21.15.59:0/3577650818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c60103ca0 0x7f2c60199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.663+0000 7f2c65652640 1 --2- 172.21.15.59:0/3577650818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c601045c0 0x7f2c60199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.663+0000 7f2c66654640 1 -- 172.21.15.59:0/3577650818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c60103ca0 msgr2=0x7f2c60199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.663+0000 7f2c66654640 1 --2- 172.21.15.59:0/3577650818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c60103ca0 0x7f2c60199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.663+0000 7f2c66654640 1 -- 172.21.15.59:0/3577650818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c601045c0 msgr2=0x7f2c60199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.663+0000 7f2c66654640 1 --2- 172.21.15.59:0/3577650818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c601045c0 0x7f2c60199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.663+0000 7f2c66654640 1 -- 172.21.15.59:0/3577650818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6019f2b0 con 0x7f2c6010d100 2024-09-10T21:16:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.663+0000 7f2c66654640 1 --2- 172.21.15.59:0/3577650818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6010d100 0x7f2c6019eae0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2c58005cc0 tx=0x7f2c5802f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.663+0000 7f2c56ffd640 1 -- 172.21.15.59:0/3577650818 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c58003cf0 con 0x7f2c6010d100 2024-09-10T21:16:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.663+0000 7f2c56ffd640 1 -- 172.21.15.59:0/3577650818 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c580044f0 con 0x7f2c6010d100 2024-09-10T21:16:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.663+0000 7f2c680b7640 1 -- 172.21.15.59:0/3577650818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6019f540 con 0x7f2c6010d100 2024-09-10T21:16:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.663+0000 7f2c56ffd640 1 -- 172.21.15.59:0/3577650818 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5802fd10 con 0x7f2c6010d100 2024-09-10T21:16:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.664+0000 7f2c680b7640 1 -- 172.21.15.59:0/3577650818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c601a5ce0 con 0x7f2c6010d100 2024-09-10T21:16:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.664+0000 7f2c680b7640 1 -- 172.21.15.59:0/3577650818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c60104080 con 0x7f2c6010d100 2024-09-10T21:16:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.666+0000 7f2c56ffd640 1 -- 172.21.15.59:0/3577650818 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f2c58004040 con 0x7f2c6010d100 2024-09-10T21:16:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.667+0000 7f2c56ffd640 1 --2- 172.21.15.59:0/3577650818 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2c4c0b52e0 0x7f2c4c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.667+0000 7f2c56ffd640 1 -- 172.21.15.59:0/3577650818 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2c58107550 con 0x7f2c6010d100 2024-09-10T21:16:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.667+0000 7f2c65e53640 1 --2- 172.21.15.59:0/3577650818 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2c4c0b52e0 0x7f2c4c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.668+0000 7f2c65e53640 1 --2- 172.21.15.59:0/3577650818 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2c4c0b52e0 0x7f2c4c0b77a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c009890 tx=0x7f2c5c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.670+0000 7f2c56ffd640 1 -- 172.21.15.59:0/3577650818 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2c580ce3e0 con 0x7f2c6010d100 2024-09-10T21:16:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.895+0000 7f2c680b7640 1 -- 172.21.15.59:0/3577650818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c601a5fd0 con 0x7f2c6010d100 2024-09-10T21:16:11.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.896+0000 7f2c56ffd640 1 -- 172.21.15.59:0/3577650818 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f2c580cdce0 con 0x7f2c6010d100 2024-09-10T21:16:11.900 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:16:11.900 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:16:11.901 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:16:11.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.898+0000 7f2c680b7640 1 -- 172.21.15.59:0/3577650818 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2c4c0b52e0 msgr2=0x7f2c4c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:11.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.898+0000 7f2c680b7640 1 --2- 172.21.15.59:0/3577650818 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2c4c0b52e0 0x7f2c4c0b77a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c009890 tx=0x7f2c5c008040 comp rx=0 tx=0).stop 2024-09-10T21:16:11.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.898+0000 7f2c680b7640 1 -- 172.21.15.59:0/3577650818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6010d100 msgr2=0x7f2c6019eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:11.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.898+0000 7f2c680b7640 1 --2- 172.21.15.59:0/3577650818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6010d100 0x7f2c6019eae0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2c58005cc0 tx=0x7f2c5802f470 comp rx=0 tx=0).stop 2024-09-10T21:16:11.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.898+0000 7f2c680b7640 1 -- 172.21.15.59:0/3577650818 shutdown_connections 2024-09-10T21:16:11.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.898+0000 7f2c680b7640 1 --2- 172.21.15.59:0/3577650818 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2c4c0b52e0 0x7f2c4c0b77a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:11.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.898+0000 7f2c680b7640 1 --2- 172.21.15.59:0/3577650818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c6010d100 0x7f2c6019eae0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:11.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.898+0000 7f2c680b7640 1 --2- 172.21.15.59:0/3577650818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c601045c0 0x7f2c60199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:11.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.898+0000 7f2c680b7640 1 --2- 172.21.15.59:0/3577650818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c60103ca0 0x7f2c60199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:11.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.898+0000 7f2c680b7640 1 -- 172.21.15.59:0/3577650818 >> 172.21.15.59:0/3577650818 conn(0x7f2c600fd700 msgr2=0x7f2c6010f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:11.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.898+0000 7f2c680b7640 1 -- 172.21.15.59:0/3577650818 shutdown_connections 2024-09-10T21:16:11.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:11.899+0000 7f2c680b7640 1 -- 172.21.15.59:0/3577650818 wait complete. 2024-09-10T21:16:12.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:12 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3577650818' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:16:12.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:12 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3577650818' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:16:12.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:12 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3577650818' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:16:12.562 INFO:tasks.workunit.client.0.smithi059.stderr:Updating files: 92% (11124/12088) Updating files: 93% (11242/12088) Updating files: 94% (11363/12088) Updating files: 95% (11484/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-10T21:16:12.741 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:16:13.004 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:16:13.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:13 smithi192 ceph-mon[35363]: pgmap v368: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2024-09-10T21:16:13.329 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:13 smithi059 ceph-mon[30888]: pgmap v368: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2024-09-10T21:16:13.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:13 smithi154 ceph-mon[35041]: pgmap v368: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2024-09-10T21:16:13.564 INFO:tasks.workunit.client.0.smithi059.stderr:Note: switching to '8f219c476cb4f26fc5719c661c0323719a45cb30'. 2024-09-10T21:16:13.565 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-10T21:16:13.565 INFO:tasks.workunit.client.0.smithi059.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T21:16:13.565 INFO:tasks.workunit.client.0.smithi059.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T21:16:13.565 INFO:tasks.workunit.client.0.smithi059.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T21:16:13.565 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-10T21:16:13.565 INFO:tasks.workunit.client.0.smithi059.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T21:16:13.565 INFO:tasks.workunit.client.0.smithi059.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T21:16:13.565 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-10T21:16:13.565 INFO:tasks.workunit.client.0.smithi059.stderr: git switch -c 2024-09-10T21:16:13.565 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-10T21:16:13.565 INFO:tasks.workunit.client.0.smithi059.stderr:Or undo this operation with: 2024-09-10T21:16:13.565 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-10T21:16:13.565 INFO:tasks.workunit.client.0.smithi059.stderr: git switch - 2024-09-10T21:16:13.566 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-10T21:16:13.566 INFO:tasks.workunit.client.0.smithi059.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T21:16:13.566 INFO:tasks.workunit.client.0.smithi059.stderr: 2024-09-10T21:16:13.566 INFO:tasks.workunit.client.0.smithi059.stderr:HEAD is now at 8f219c476cb Merge branch 'mgr-vol-mod-disable' of https://github.com/rishabh-d-dave/ceph into wip-hemanth-testing-2024-09-10-0723 2024-09-10T21:16:13.569 DEBUG:teuthology.orchestra.run.smithi059:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T21:16:13.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.573+0000 7f839dc55640 1 -- 172.21.15.59:0/1374743566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83981076a0 msgr2=0x7f8398107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:13.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.573+0000 7f839dc55640 1 --2- 172.21.15.59:0/1374743566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83981076a0 0x7f8398107ae0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8380009900 tx=0x7f838002a410 comp rx=0 tx=0).stop 2024-09-10T21:16:13.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.573+0000 7f839dc55640 1 -- 172.21.15.59:0/1374743566 shutdown_connections 2024-09-10T21:16:13.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.573+0000 7f839dc55640 1 --2- 172.21.15.59:0/1374743566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8398108020 0x7f839810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.573+0000 7f839dc55640 1 --2- 172.21.15.59:0/1374743566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83981076a0 0x7f8398107ae0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.573+0000 7f839dc55640 1 --2- 172.21.15.59:0/1374743566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8398101c90 0x7f8398102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.573+0000 7f839dc55640 1 -- 172.21.15.59:0/1374743566 >> 172.21.15.59:0/1374743566 conn(0x7f83980fd700 msgr2=0x7f83980ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.573+0000 7f839dc55640 1 -- 172.21.15.59:0/1374743566 shutdown_connections 2024-09-10T21:16:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.573+0000 7f839dc55640 1 -- 172.21.15.59:0/1374743566 wait complete. 2024-09-10T21:16:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.574+0000 7f839dc55640 1 Processor -- start 2024-09-10T21:16:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.574+0000 7f839dc55640 1 -- start start 2024-09-10T21:16:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.574+0000 7f839dc55640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8398101c90 0x7f8398197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.574+0000 7f839dc55640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83981076a0 0x7f83981983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.574+0000 7f839dc55640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8398108020 0x7f8398198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.574+0000 7f839dc55640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8398111ce0 con 0x7f8398108020 2024-09-10T21:16:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.574+0000 7f839dc55640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8398111b60 con 0x7f8398101c90 2024-09-10T21:16:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.574+0000 7f839dc55640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8398111e60 con 0x7f83981076a0 2024-09-10T21:16:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.575+0000 7f8397fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8398108020 0x7f8398198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.575+0000 7f8397fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8398108020 0x7f8398198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37660/0 (socket says 172.21.15.59:37660) 2024-09-10T21:16:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.575+0000 7f8397fff640 1 -- 172.21.15.59:0/1742297259 learned_addr learned my addr 172.21.15.59:0/1742297259 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.575+0000 7f83977fe640 1 --2- 172.21.15.59:0/1742297259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8398101c90 0x7f8398197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.575+0000 7f8396ffd640 1 --2- 172.21.15.59:0/1742297259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83981076a0 0x7f83981983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.575+0000 7f8397fff640 1 -- 172.21.15.59:0/1742297259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83981076a0 msgr2=0x7f83981983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.575+0000 7f8397fff640 1 --2- 172.21.15.59:0/1742297259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83981076a0 0x7f83981983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.575+0000 7f8397fff640 1 -- 172.21.15.59:0/1742297259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8398101c90 msgr2=0x7f8398197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.575+0000 7f8397fff640 1 --2- 172.21.15.59:0/1742297259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8398101c90 0x7f8398197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.575+0000 7f8397fff640 1 -- 172.21.15.59:0/1742297259 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83981a7690 con 0x7f8398108020 2024-09-10T21:16:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.575+0000 7f8396ffd640 1 --2- 172.21.15.59:0/1742297259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83981076a0 0x7f83981983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:16:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.575+0000 7f8397fff640 1 --2- 172.21.15.59:0/1742297259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8398108020 0x7f8398198930 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f839000cad0 tx=0x7f839000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.575+0000 7f8394ff9640 1 -- 172.21.15.59:0/1742297259 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839000ae20 con 0x7f8398108020 2024-09-10T21:16:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.575+0000 7f839dc55640 1 -- 172.21.15.59:0/1742297259 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83981a7980 con 0x7f8398108020 2024-09-10T21:16:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.576+0000 7f8394ff9640 1 -- 172.21.15.59:0/1742297259 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8390005020 con 0x7f8398108020 2024-09-10T21:16:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.576+0000 7f8394ff9640 1 -- 172.21.15.59:0/1742297259 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839000f6b0 con 0x7f8398108020 2024-09-10T21:16:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.576+0000 7f839dc55640 1 -- 172.21.15.59:0/1742297259 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83981a7e90 con 0x7f8398108020 2024-09-10T21:16:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.579+0000 7f8394ff9640 1 -- 172.21.15.59:0/1742297259 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f83900054f0 con 0x7f8398108020 2024-09-10T21:16:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.579+0000 7f83a002a740 1 Processor -- start 2024-09-10T21:16:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.579+0000 7f83a002a740 1 -- start start 2024-09-10T21:16:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.579+0000 7f83a002a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a020f0 0x560cf1a024d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.579+0000 7f83a002a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a02a10 0x560cf1a0e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.579+0000 7f83a002a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a0e9a0 0x560cf1a10d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.579+0000 7f83a002a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560cf1978ea0 con 0x560cf1a0e9a0 2024-09-10T21:16:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.579+0000 7f83a002a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560cf19682d0 con 0x560cf1a02a10 2024-09-10T21:16:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.579+0000 7f83a002a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x560cf196c0e0 con 0x560cf1a020f0 2024-09-10T21:16:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.580+0000 7f8396ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a0e9a0 0x560cf1a10d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.580+0000 7f8394ff9640 1 --2- 172.21.15.59:0/1742297259 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f83840b52e0 0x7f83840b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.580+0000 7f8396ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a0e9a0 0x560cf1a10d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37674/0 (socket says 172.21.15.59:37674) 2024-09-10T21:16:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.580+0000 7f8396ffd640 1 -- 172.21.15.59:0/855677704 learned_addr learned my addr 172.21.15.59:0/855677704 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.580+0000 7f8396ffd640 1 --2- 172.21.15.59:0/855677704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a020f0 0x560cf1a024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.580+0000 7f83977fe640 1 --2- 172.21.15.59:0/855677704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a02a10 0x560cf1a0e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.580+0000 7f8397fff640 1 --2- 172.21.15.59:0/1742297259 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f83840b52e0 0x7f83840b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.580+0000 7f83977fe640 1 -- 172.21.15.59:0/855677704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a020f0 msgr2=0x560cf1a024d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.580+0000 7f83977fe640 1 --2- 172.21.15.59:0/855677704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a020f0 0x560cf1a024d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.580+0000 7f83977fe640 1 -- 172.21.15.59:0/855677704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a0e9a0 msgr2=0x560cf1a10d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.580+0000 7f83977fe640 1 --2- 172.21.15.59:0/855677704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a0e9a0 0x560cf1a10d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.580+0000 7f83977fe640 1 -- 172.21.15.59:0/855677704 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cf16c6650 con 0x560cf1a02a10 2024-09-10T21:16:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.580+0000 7f8396ffd640 1 --2- 172.21.15.59:0/855677704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a0e9a0 0x560cf1a10d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:16:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.580+0000 7f8394ff9640 1 -- 172.21.15.59:0/1742297259 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f83900e5c10 con 0x7f8398108020 2024-09-10T21:16:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.580+0000 7f83977fe640 1 --2- 172.21.15.59:0/855677704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a02a10 0x560cf1a0e460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f838800bbf0 tx=0x7f83880107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2f3af7eed417c76 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.580+0000 7f8397fff640 1 --2- 172.21.15.59:0/1742297259 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f83840b52e0 0x7f83840b77a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f83900a83b0 tx=0x7f839006f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.581+0000 7f838dffb640 1 -- 172.21.15.59:0/855677704 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388004030 con 0x560cf1a02a10 2024-09-10T21:16:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.581+0000 7f838dffb640 1 -- 172.21.15.59:0/855677704 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83880035f0 con 0x560cf1a02a10 2024-09-10T21:16:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.581+0000 7f838dffb640 1 -- 172.21.15.59:0/855677704 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388011640 con 0x560cf1a02a10 2024-09-10T21:16:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.581+0000 7f83a002a740 1 -- 172.21.15.59:0/855677704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a02a10 msgr2=0x560cf1a0e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.581+0000 7f83a002a740 1 --2- 172.21.15.59:0/855677704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a02a10 0x560cf1a0e460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f838800bbf0 tx=0x7f83880107a0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.581+0000 7f83a002a740 1 -- 172.21.15.59:0/855677704 shutdown_connections 2024-09-10T21:16:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.581+0000 7f83a002a740 1 --2- 172.21.15.59:0/855677704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a0e9a0 0x560cf1a10d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.581+0000 7f83a002a740 1 --2- 172.21.15.59:0/855677704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a02a10 0x560cf1a0e460 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.581+0000 7f83a002a740 1 --2- 172.21.15.59:0/855677704 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a020f0 0x560cf1a024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.581+0000 7f83a002a740 1 -- 172.21.15.59:0/855677704 >> 172.21.15.59:0/855677704 conn(0x560cf19fff20 msgr2=0x560cf1a010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:13.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.581+0000 7f83a002a740 1 -- 172.21.15.59:0/855677704 shutdown_connections 2024-09-10T21:16:13.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.581+0000 7f83a002a740 1 -- 172.21.15.59:0/855677704 wait complete. 2024-09-10T21:16:13.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.582+0000 7f83a002a740 1 -- start start 2024-09-10T21:16:13.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.582+0000 7f83a002a740 1 Processor -- start 2024-09-10T21:16:13.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.582+0000 7f83a002a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a020f0 0x560cf1a0e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:13.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.582+0000 7f83a002a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 0x560cf1a0b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:13.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.582+0000 7f83a002a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a0e9a0 0x560cf1a0bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:13.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.582+0000 7f83a002a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560cf17c9700 con 0x560cf1a02a10 2024-09-10T21:16:13.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.582+0000 7f83a002a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560cf1903160 con 0x560cf1a0e9a0 2024-09-10T21:16:13.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.582+0000 7f83a002a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x560cf1a11620 con 0x560cf1a020f0 2024-09-10T21:16:13.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.582+0000 7f83a002a740 10 client.0 _ll_register_callbacks cb 0x560cf191c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:13.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.582+0000 7f83977fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 0x560cf1a0b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:13.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.582+0000 7f83977fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 0x560cf1a0b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37686/0 (socket says 172.21.15.59:37686) 2024-09-10T21:16:13.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.582+0000 7f83977fe640 1 -- 172.21.15.59:0/3538090472 learned_addr learned my addr 172.21.15.59:0/3538090472 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:13.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.583+0000 7f8396ffd640 1 --2- 172.21.15.59:0/3538090472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a0e9a0 0x560cf1a0bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:13.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.583+0000 7f8396ffd640 1 --2- 172.21.15.59:0/3538090472 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a020f0 0x560cf1a0e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:13.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.583+0000 7f83977fe640 1 -- 172.21.15.59:0/3538090472 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a020f0 msgr2=0x560cf1a0e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:13.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.583+0000 7f83977fe640 1 --2- 172.21.15.59:0/3538090472 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a020f0 0x560cf1a0e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.583+0000 7f83977fe640 1 -- 172.21.15.59:0/3538090472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a0e9a0 msgr2=0x560cf1a0bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:13.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.583+0000 7f83977fe640 1 --2- 172.21.15.59:0/3538090472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a0e9a0 0x560cf1a0bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.583+0000 7f83977fe640 1 -- 172.21.15.59:0/3538090472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cf1930c90 con 0x560cf1a02a10 2024-09-10T21:16:13.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.583+0000 7f83977fe640 1 --2- 172.21.15.59:0/3538090472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 0x560cf1a0b740 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f838800bfd0 tx=0x7f8388003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a179004b983a3de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:13.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.583+0000 7f8376ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:13.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.583+0000 7f8376ffd640 1 -- 172.21.15.59:0/3538090472 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838802a060 con 0x560cf1a02a10 2024-09-10T21:16:13.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.583+0000 7f8376ffd640 1 -- 172.21.15.59:0/3538090472 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f83880039b0 con 0x560cf1a02a10 2024-09-10T21:16:13.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.583+0000 7f83a002a740 1 -- 172.21.15.59:0/3538090472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83880035f0 con 0x560cf1a02a10 2024-09-10T21:16:13.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.583+0000 7f8376ffd640 1 -- 172.21.15.59:0/3538090472 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8388003fe0 con 0x560cf1a02a10 2024-09-10T21:16:13.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.584+0000 7f83a002a740 10 client.15564 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:13.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.584+0000 7f83a002a740 1 -- 172.21.15.59:0/3538090472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560cf1a1cfb0 con 0x560cf1a02a10 2024-09-10T21:16:13.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.584+0000 7f8376ffd640 1 -- 172.21.15.59:0/3538090472 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83880035f0 con 0x560cf1a02a10 2024-09-10T21:16:13.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.584+0000 7f8376ffd640 1 -- 172.21.15.59:0/3538090472 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f83880046c0 con 0x560cf1a02a10 2024-09-10T21:16:13.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.584+0000 7f83a002a740 10 client.15564 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:13.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.584+0000 7f83a002a740 10 client.15564 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:16:13.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.584+0000 7f83a002a740 20 client.15564 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:13.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.584+0000 7f83a002a740 1 --2- 172.21.15.59:0/3538090472 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x560cf1a1e3b0 0x560cf1a207a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:13.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.584+0000 7f83a002a740 4 client.15564 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:16:13.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.584+0000 7f83a002a740 1 -- 172.21.15.59:0/3538090472 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560cf197adf0 con 0x560cf1a1e3b0 2024-09-10T21:16:13.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.584+0000 7f8396ffd640 1 --2- 172.21.15.59:0/3538090472 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x560cf1a1e3b0 0x560cf1a207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:13.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.585+0000 7f8396ffd640 1 --2- 172.21.15.59:0/3538090472 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x560cf1a1e3b0 0x560cf1a207a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6b53e9f6f6fcbcbc server_cookie=7bb3f2a75731a20d in_seq=0 out_seq=0 2024-09-10T21:16:13.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.585+0000 7f8376ffd640 10 client.15564 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:16:13.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.585+0000 7f8376ffd640 1 -- 172.21.15.59:0/3538090472 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560cf197adf0 con 0x560cf1a1e3b0 2024-09-10T21:16:13.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.585+0000 7f8376ffd640 10 client.15564 handle_command_reply: tid=0 2024-09-10T21:16:13.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.585+0000 7f83a002a740 1 client.15564 shutdown 2024-09-10T21:16:13.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.586+0000 7f83a002a740 1 -- 172.21.15.59:0/3538090472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 msgr2=0x560cf1a0b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:13.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.586+0000 7f83a002a740 1 --2- 172.21.15.59:0/3538090472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 0x560cf1a0b740 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f838800bfd0 tx=0x7f8388003d70 comp rx=0 tx=0).stop 2024-09-10T21:16:13.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.586+0000 7f83a002a740 1 -- 172.21.15.59:0/3538090472 shutdown_connections 2024-09-10T21:16:13.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.586+0000 7f83a002a740 1 --2- 172.21.15.59:0/3538090472 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x560cf1a1e3b0 0x560cf1a207a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.586+0000 7f83a002a740 1 --2- 172.21.15.59:0/3538090472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a0e9a0 0x560cf1a0bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.586+0000 7f83a002a740 1 --2- 172.21.15.59:0/3538090472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 0x560cf1a0b740 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.586+0000 7f83a002a740 1 --2- 172.21.15.59:0/3538090472 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a020f0 0x560cf1a0e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.586+0000 7f83a002a740 1 -- 172.21.15.59:0/3538090472 >> 172.21.15.59:0/3538090472 conn(0x560cf19fff20 msgr2=0x560cf1a05ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:13.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.586+0000 7f8376ffd640 0 client.15564 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:16:13.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.586+0000 7f83a002a740 1 -- 172.21.15.59:0/3538090472 shutdown_connections 2024-09-10T21:16:13.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.586+0000 7f83a002a740 1 -- 172.21.15.59:0/3538090472 wait complete. 2024-09-10T21:16:13.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.586+0000 7f83a002a740 20 client.15564 trim_cache size 0 max 16384 2024-09-10T21:16:13.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.599+0000 7f83a002a740 1 Processor -- start 2024-09-10T21:16:13.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.599+0000 7f83a002a740 1 -- start start 2024-09-10T21:16:13.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.599+0000 7f83a002a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a020f0 0x560cf1a015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:13.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.599+0000 7f83a002a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 0x560cf19ff760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:13.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.599+0000 7f83a002a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a0e9a0 0x560cf1a0fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:13.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.599+0000 7f83a002a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f83981b04b0 con 0x560cf1a02a10 2024-09-10T21:16:13.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.599+0000 7f83a002a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f83981b1ff0 con 0x560cf1a020f0 2024-09-10T21:16:13.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.599+0000 7f83a002a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f83981b0b80 con 0x560cf1a0e9a0 2024-09-10T21:16:13.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.600+0000 7f83977fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 0x560cf19ff760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:13.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.600+0000 7f83977fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 0x560cf19ff760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37702/0 (socket says 172.21.15.59:37702) 2024-09-10T21:16:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.600+0000 7f83977fe640 1 -- 172.21.15.59:0/3782792304 learned_addr learned my addr 172.21.15.59:0/3782792304 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.600+0000 7f8396ffd640 1 --2- 172.21.15.59:0/3782792304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a020f0 0x560cf1a015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.600+0000 7f8396ffd640 1 --2- 172.21.15.59:0/3782792304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a0e9a0 0x560cf1a0fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.600+0000 7f83977fe640 1 -- 172.21.15.59:0/3782792304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a0e9a0 msgr2=0x560cf1a0fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.600+0000 7f83977fe640 1 --2- 172.21.15.59:0/3782792304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a0e9a0 0x560cf1a0fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.600+0000 7f83977fe640 1 -- 172.21.15.59:0/3782792304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a020f0 msgr2=0x560cf1a015e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.600+0000 7f83977fe640 1 --2- 172.21.15.59:0/3782792304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a020f0 0x560cf1a015e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.600+0000 7f83977fe640 1 -- 172.21.15.59:0/3782792304 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cf19fb7e0 con 0x560cf1a02a10 2024-09-10T21:16:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.600+0000 7f8396ffd640 1 --2- 172.21.15.59:0/3782792304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a020f0 0x560cf1a015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:16:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.600+0000 7f83977fe640 1 --2- 172.21.15.59:0/3782792304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 0x560cf19ff760 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f838800b3d0 tx=0x7f838800b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae735164effef654 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.600+0000 7f838d7fa640 1 -- 172.21.15.59:0/3782792304 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388035070 con 0x560cf1a02a10 2024-09-10T21:16:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.600+0000 7f838d7fa640 1 -- 172.21.15.59:0/3782792304 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f838800b770 con 0x560cf1a02a10 2024-09-10T21:16:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.600+0000 7f838d7fa640 1 -- 172.21.15.59:0/3782792304 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838802a030 con 0x560cf1a02a10 2024-09-10T21:16:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.601+0000 7f83a002a740 1 -- 172.21.15.59:0/3782792304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 msgr2=0x560cf19ff760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.601+0000 7f83a002a740 1 --2- 172.21.15.59:0/3782792304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 0x560cf19ff760 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f838800b3d0 tx=0x7f838800b6b0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.601+0000 7f83a002a740 1 -- 172.21.15.59:0/3782792304 shutdown_connections 2024-09-10T21:16:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.601+0000 7f83a002a740 1 --2- 172.21.15.59:0/3782792304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a0e9a0 0x560cf1a0fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.601+0000 7f83a002a740 1 --2- 172.21.15.59:0/3782792304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 0x560cf19ff760 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.601+0000 7f83a002a740 1 --2- 172.21.15.59:0/3782792304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a020f0 0x560cf1a015e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.601+0000 7f83a002a740 1 -- 172.21.15.59:0/3782792304 >> 172.21.15.59:0/3782792304 conn(0x560cf19fff20 msgr2=0x560cf1a0d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.601+0000 7f83a002a740 1 -- 172.21.15.59:0/3782792304 shutdown_connections 2024-09-10T21:16:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.601+0000 7f83a002a740 1 -- 172.21.15.59:0/3782792304 wait complete. 2024-09-10T21:16:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.601+0000 7f83a002a740 1 -- start start 2024-09-10T21:16:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.602+0000 7f83a002a740 1 Processor -- start 2024-09-10T21:16:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.602+0000 7f83a002a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a020f0 0x560cf1a25cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.602+0000 7f83a002a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 0x560cf1a26200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:13.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.602+0000 7f83a002a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a0e9a0 0x560cf1a26740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:13.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.602+0000 7f83a002a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f83981b1920 con 0x560cf1a02a10 2024-09-10T21:16:13.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.602+0000 7f83a002a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f83981b1250 con 0x560cf1a020f0 2024-09-10T21:16:13.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.602+0000 7f83a002a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f83981ae490 con 0x560cf1a0e9a0 2024-09-10T21:16:13.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.602+0000 7f83a002a740 10 client.0 _ll_register_callbacks cb 0x7f8380009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:13.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.602+0000 7f83977fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 0x560cf1a26200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:13.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.602+0000 7f83977fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 0x560cf1a26200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37704/0 (socket says 172.21.15.59:37704) 2024-09-10T21:16:13.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.602+0000 7f83977fe640 1 -- 172.21.15.59:0/2945434515 learned_addr learned my addr 172.21.15.59:0/2945434515 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:13.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.602+0000 7f8396ffd640 1 --2- 172.21.15.59:0/2945434515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a0e9a0 0x560cf1a26740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:13.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.602+0000 7f8396ffd640 1 --2- 172.21.15.59:0/2945434515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a020f0 0x560cf1a25cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:13.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.602+0000 7f83977fe640 1 -- 172.21.15.59:0/2945434515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a0e9a0 msgr2=0x560cf1a26740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:13.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.602+0000 7f83977fe640 1 --2- 172.21.15.59:0/2945434515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a0e9a0 0x560cf1a26740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.602+0000 7f83977fe640 1 -- 172.21.15.59:0/2945434515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a020f0 msgr2=0x560cf1a25cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:13.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.602+0000 7f83977fe640 1 --2- 172.21.15.59:0/2945434515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a020f0 0x560cf1a25cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.602+0000 7f83977fe640 1 -- 172.21.15.59:0/2945434515 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cf1a160a0 con 0x560cf1a02a10 2024-09-10T21:16:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.603+0000 7f83977fe640 1 --2- 172.21.15.59:0/2945434515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 0x560cf1a26200 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8388005c40 tx=0x7f8388003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88139567db1f7d8a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.603+0000 7f8376ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.603+0000 7f8376ffd640 1 -- 172.21.15.59:0/2945434515 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388035070 con 0x560cf1a02a10 2024-09-10T21:16:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.603+0000 7f8376ffd640 1 -- 172.21.15.59:0/2945434515 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f83880051d0 con 0x560cf1a02a10 2024-09-10T21:16:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.603+0000 7f83a002a740 1 -- 172.21.15.59:0/2945434515 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f838800b770 con 0x560cf1a02a10 2024-09-10T21:16:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.603+0000 7f8376ffd640 1 -- 172.21.15.59:0/2945434515 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f838802a040 con 0x560cf1a02a10 2024-09-10T21:16:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.603+0000 7f83a002a740 10 client.15570 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.603+0000 7f83a002a740 1 -- 172.21.15.59:0/2945434515 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560cf1a8b280 con 0x560cf1a02a10 2024-09-10T21:16:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.603+0000 7f8376ffd640 1 -- 172.21.15.59:0/2945434515 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f838800b770 con 0x560cf1a02a10 2024-09-10T21:16:13.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.603+0000 7f8376ffd640 1 -- 172.21.15.59:0/2945434515 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f83880444f0 con 0x560cf1a02a10 2024-09-10T21:16:13.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.603+0000 7f83a002a740 10 client.15570 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:13.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.603+0000 7f83a002a740 10 client.15570 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:16:13.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.603+0000 7f83a002a740 20 client.15570 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:13.662 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:16:13.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.603+0000 7f83a002a740 1 --2- 172.21.15.59:0/2945434515 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x560cf1a8b8f0 0x560cf1a8dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:13.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.603+0000 7f83a002a740 4 client.15570 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:16:13.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.603+0000 7f83a002a740 1 -- 172.21.15.59:0/2945434515 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560cf19768a0 con 0x560cf1a8b8f0 2024-09-10T21:16:13.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.604+0000 7f8396ffd640 1 --2- 172.21.15.59:0/2945434515 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x560cf1a8b8f0 0x560cf1a8dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:13.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.604+0000 7f8396ffd640 1 --2- 172.21.15.59:0/2945434515 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x560cf1a8b8f0 0x560cf1a8dd10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2c265c7ae46a5d24 server_cookie=17916269b5630a78 in_seq=0 out_seq=0 2024-09-10T21:16:13.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.604+0000 7f8376ffd640 10 client.15570 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:16:13.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.604+0000 7f8376ffd640 1 -- 172.21.15.59:0/2945434515 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560cf19768a0 con 0x560cf1a8b8f0 2024-09-10T21:16:13.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.604+0000 7f8376ffd640 10 client.15570 handle_command_reply: tid=0 2024-09-10T21:16:13.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.604+0000 7f83a002a740 1 client.15570 shutdown 2024-09-10T21:16:13.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f83a002a740 1 -- 172.21.15.59:0/2945434515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 msgr2=0x560cf1a26200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:13.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f83a002a740 1 --2- 172.21.15.59:0/2945434515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 0x560cf1a26200 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8388005c40 tx=0x7f8388003c60 comp rx=0 tx=0).stop 2024-09-10T21:16:13.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f83a002a740 1 -- 172.21.15.59:0/2945434515 shutdown_connections 2024-09-10T21:16:13.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f83a002a740 1 --2- 172.21.15.59:0/2945434515 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x560cf1a8b8f0 0x560cf1a8dd10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f83a002a740 1 --2- 172.21.15.59:0/2945434515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560cf1a0e9a0 0x560cf1a26740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f83a002a740 1 --2- 172.21.15.59:0/2945434515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560cf1a02a10 0x560cf1a26200 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f8376ffd640 0 client.15570 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:16:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f83a002a740 1 --2- 172.21.15.59:0/2945434515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560cf1a020f0 0x560cf1a25cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f83a002a740 1 -- 172.21.15.59:0/2945434515 >> 172.21.15.59:0/2945434515 conn(0x560cf19fff20 msgr2=0x560cf1a05180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f83a002a740 1 -- 172.21.15.59:0/2945434515 shutdown_connections 2024-09-10T21:16:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f83a002a740 1 -- 172.21.15.59:0/2945434515 wait complete. 2024-09-10T21:16:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f83a002a740 20 client.15570 trim_cache size 0 max 16384 2024-09-10T21:16:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f839dc55640 1 -- 172.21.15.59:0/1742297259 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f83840b52e0 msgr2=0x7f83840b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f839dc55640 1 --2- 172.21.15.59:0/1742297259 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f83840b52e0 0x7f83840b77a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f83900a83b0 tx=0x7f839006f040 comp rx=0 tx=0).stop 2024-09-10T21:16:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f839dc55640 1 -- 172.21.15.59:0/1742297259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8398108020 msgr2=0x7f8398198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f839dc55640 1 --2- 172.21.15.59:0/1742297259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8398108020 0x7f8398198930 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f839000cad0 tx=0x7f839000cf90 comp rx=0 tx=0).stop 2024-09-10T21:16:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f839dc55640 1 -- 172.21.15.59:0/1742297259 shutdown_connections 2024-09-10T21:16:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f839dc55640 1 --2- 172.21.15.59:0/1742297259 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f83840b52e0 0x7f83840b77a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f839dc55640 1 --2- 172.21.15.59:0/1742297259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8398108020 0x7f8398198930 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f839dc55640 1 --2- 172.21.15.59:0/1742297259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83981076a0 0x7f83981983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f839dc55640 1 --2- 172.21.15.59:0/1742297259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8398101c90 0x7f8398197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.605+0000 7f839dc55640 1 -- 172.21.15.59:0/1742297259 >> 172.21.15.59:0/1742297259 conn(0x7f83980fd700 msgr2=0x7f83980ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.606+0000 7f839dc55640 1 -- 172.21.15.59:0/1742297259 shutdown_connections 2024-09-10T21:16:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:13.606+0000 7f839dc55640 1 -- 172.21.15.59:0/1742297259 wait complete. 2024-09-10T21:16:13.665 INFO:tasks.workunit.client.0.smithi059.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T21:16:13.665 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T21:16:13.666 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T21:16:14.865 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:16:15.131 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:16:15.145 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T21:16:15.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:15 smithi059 ceph-mon[30888]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 10 op/s 2024-09-10T21:16:15.295 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T21:16:15.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:15 smithi192 ceph-mon[35363]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 10 op/s 2024-09-10T21:16:15.339 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T21:16:15.341 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T21:16:15.341 INFO:tasks.workunit.client.0.smithi059.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T21:16:15.389 INFO:tasks.workunit.client.0.smithi059.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T21:16:15.393 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T21:16:15.393 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T21:16:15.409 INFO:tasks.workunit:Running workunits matching fs/test_o_trunc.sh on client.0... 2024-09-10T21:16:15.411 INFO:tasks.workunit:Running workunit fs/test_o_trunc.sh... 2024-09-10T21:16:15.411 DEBUG:teuthology.orchestra.run.smithi059:workunit test fs/test_o_trunc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f219c476cb4f26fc5719c661c0323719a45cb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-10T21:16:15.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:15 smithi154 ceph-mon[35041]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 10 op/s 2024-09-10T21:16:15.472 INFO:tasks.workunit.client.0.smithi059.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-10T21:16:15.473 INFO:tasks.workunit.client.0.smithi059.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs 2024-09-10T21:16:15.473 INFO:tasks.workunit.client.0.smithi059.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc trunc.foo 600 2024-09-10T21:16:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.672+0000 7fc48cd6a640 1 -- 172.21.15.59:0/3377578414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4881076e0 msgr2=0x7fc488107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.672+0000 7fc48cd6a640 1 --2- 172.21.15.59:0/3377578414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4881076e0 0x7fc488107b20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc470009900 tx=0x7fc47002a410 comp rx=0 tx=0).stop 2024-09-10T21:16:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.673+0000 7fc48cd6a640 1 -- 172.21.15.59:0/3377578414 shutdown_connections 2024-09-10T21:16:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.673+0000 7fc48cd6a640 1 --2- 172.21.15.59:0/3377578414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc488108060 0x7fc48810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.673+0000 7fc48cd6a640 1 --2- 172.21.15.59:0/3377578414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4881076e0 0x7fc488107b20 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.673+0000 7fc48cd6a640 1 --2- 172.21.15.59:0/3377578414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc488101cd0 0x7fc4881020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.673+0000 7fc48cd6a640 1 -- 172.21.15.59:0/3377578414 >> 172.21.15.59:0/3377578414 conn(0x7fc4880fd700 msgr2=0x7fc4880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.673+0000 7fc48cd6a640 1 -- 172.21.15.59:0/3377578414 shutdown_connections 2024-09-10T21:16:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.673+0000 7fc48cd6a640 1 -- 172.21.15.59:0/3377578414 wait complete. 2024-09-10T21:16:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.674+0000 7fc48cd6a640 1 Processor -- start 2024-09-10T21:16:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.674+0000 7fc48cd6a640 1 -- start start 2024-09-10T21:16:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.674+0000 7fc48cd6a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc488101cd0 0x7fc48819a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.674+0000 7fc48cd6a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4881076e0 0x7fc48819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.674+0000 7fc48cd6a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc488108060 0x7fc48819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.674+0000 7fc48cd6a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc488111cb0 con 0x7fc4881076e0 2024-09-10T21:16:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.674+0000 7fc48cd6a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc488111b30 con 0x7fc488101cd0 2024-09-10T21:16:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.674+0000 7fc48cd6a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc488111e30 con 0x7fc488108060 2024-09-10T21:16:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.674+0000 7fc485d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4881076e0 0x7fc48819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.674+0000 7fc485d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4881076e0 0x7fc48819a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37724/0 (socket says 172.21.15.59:37724) 2024-09-10T21:16:15.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.674+0000 7fc485d9b640 1 -- 172.21.15.59:0/940170027 learned_addr learned my addr 172.21.15.59:0/940170027 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:15.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.674+0000 7fc48659c640 1 --2- 172.21.15.59:0/940170027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc488101cd0 0x7fc48819a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:15.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.674+0000 7fc486d9d640 1 --2- 172.21.15.59:0/940170027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc488108060 0x7fc48819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:15.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.674+0000 7fc485d9b640 1 -- 172.21.15.59:0/940170027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc488108060 msgr2=0x7fc48819aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:15.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.674+0000 7fc485d9b640 1 --2- 172.21.15.59:0/940170027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc488108060 0x7fc48819aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.674+0000 7fc485d9b640 1 -- 172.21.15.59:0/940170027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc488101cd0 msgr2=0x7fc48819a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:15.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.674+0000 7fc485d9b640 1 --2- 172.21.15.59:0/940170027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc488101cd0 0x7fc48819a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.674+0000 7fc485d9b640 1 -- 172.21.15.59:0/940170027 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4881a53e0 con 0x7fc4881076e0 2024-09-10T21:16:15.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.675+0000 7fc485d9b640 1 --2- 172.21.15.59:0/940170027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4881076e0 0x7fc48819a540 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc470005940 tx=0x7fc4700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:15.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.675+0000 7fc47f7fe640 1 -- 172.21.15.59:0/940170027 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47003f030 con 0x7fc4881076e0 2024-09-10T21:16:15.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.675+0000 7fc47f7fe640 1 -- 172.21.15.59:0/940170027 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc470003cb0 con 0x7fc4881076e0 2024-09-10T21:16:15.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.675+0000 7fc48cd6a640 1 -- 172.21.15.59:0/940170027 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4881a5670 con 0x7fc4881076e0 2024-09-10T21:16:15.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.675+0000 7fc47f7fe640 1 -- 172.21.15.59:0/940170027 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc470035070 con 0x7fc4881076e0 2024-09-10T21:16:15.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.675+0000 7fc48cd6a640 1 -- 172.21.15.59:0/940170027 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4881a5b50 con 0x7fc4881076e0 2024-09-10T21:16:15.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.677+0000 7fc47f7fe640 1 -- 172.21.15.59:0/940170027 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fc470003800 con 0x7fc4881076e0 2024-09-10T21:16:15.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.677+0000 7fc48f13f740 1 Processor -- start 2024-09-10T21:16:15.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.678+0000 7fc48f13f740 1 -- start start 2024-09-10T21:16:15.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.678+0000 7fc48f13f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b88974d0 0x5626b88978b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:15.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.678+0000 7fc48f13f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 0x5626b88a7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:15.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.678+0000 7fc48f13f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626b88a8190 0x5626b88aa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:15.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.678+0000 7fc48f13f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5626b880dea0 con 0x5626b8897df0 2024-09-10T21:16:15.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.678+0000 7fc48f13f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5626b87fd2d0 con 0x5626b88974d0 2024-09-10T21:16:15.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.678+0000 7fc48f13f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5626b88010e0 con 0x5626b88a8190 2024-09-10T21:16:15.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.678+0000 7fc48659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 0x5626b88a7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:15.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.678+0000 7fc48659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 0x5626b88a7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37732/0 (socket says 172.21.15.59:37732) 2024-09-10T21:16:15.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.678+0000 7fc48659c640 1 -- 172.21.15.59:0/2508022943 learned_addr learned my addr 172.21.15.59:0/2508022943 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:15.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.678+0000 7fc486d9d640 1 --2- 172.21.15.59:0/2508022943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b88974d0 0x5626b88978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:15.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.678+0000 7fc485d9b640 1 --2- 172.21.15.59:0/2508022943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626b88a8190 0x5626b88aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:15.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.678+0000 7fc48659c640 1 -- 172.21.15.59:0/2508022943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626b88a8190 msgr2=0x5626b88aa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:15.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.678+0000 7fc48659c640 1 --2- 172.21.15.59:0/2508022943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626b88a8190 0x5626b88aa580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.678+0000 7fc48659c640 1 -- 172.21.15.59:0/2508022943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b88974d0 msgr2=0x5626b88978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:15.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.678+0000 7fc48659c640 1 --2- 172.21.15.59:0/2508022943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b88974d0 0x5626b88978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.678+0000 7fc48659c640 1 -- 172.21.15.59:0/2508022943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626b855b650 con 0x5626b8897df0 2024-09-10T21:16:15.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.678+0000 7fc486d9d640 1 --2- 172.21.15.59:0/2508022943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b88974d0 0x5626b88978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:16:15.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.678+0000 7fc47f7fe640 1 --2- 172.21.15.59:0/940170027 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc4740b52e0 0x7fc4740b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:15.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.679+0000 7fc486d9d640 1 --2- 172.21.15.59:0/940170027 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc4740b52e0 0x7fc4740b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:15.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.679+0000 7fc48659c640 1 --2- 172.21.15.59:0/2508022943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 0x5626b88a7c50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc47800ad30 tx=0x7fc47800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d26e4de145dcc70 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:15.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.679+0000 7fc47f7fe640 1 -- 172.21.15.59:0/940170027 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc4701066f0 con 0x7fc4881076e0 2024-09-10T21:16:15.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.679+0000 7fc47cff9640 1 -- 172.21.15.59:0/2508022943 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc478010840 con 0x5626b8897df0 2024-09-10T21:16:15.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.679+0000 7fc47cff9640 1 -- 172.21.15.59:0/2508022943 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc478014070 con 0x5626b8897df0 2024-09-10T21:16:15.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.679+0000 7fc47cff9640 1 -- 172.21.15.59:0/2508022943 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc478018a80 con 0x5626b8897df0 2024-09-10T21:16:15.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.680+0000 7fc48f13f740 1 -- 172.21.15.59:0/2508022943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 msgr2=0x5626b88a7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:15.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.680+0000 7fc486d9d640 1 --2- 172.21.15.59:0/940170027 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc4740b52e0 0x7fc4740b77a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc48819afe0 tx=0x7fc480009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:15.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.680+0000 7fc48f13f740 1 --2- 172.21.15.59:0/2508022943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 0x5626b88a7c50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc47800ad30 tx=0x7fc47800f790 comp rx=0 tx=0).stop 2024-09-10T21:16:15.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.680+0000 7fc48f13f740 1 -- 172.21.15.59:0/2508022943 shutdown_connections 2024-09-10T21:16:15.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.680+0000 7fc48f13f740 1 --2- 172.21.15.59:0/2508022943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626b88a8190 0x5626b88aa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.680+0000 7fc48f13f740 1 --2- 172.21.15.59:0/2508022943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 0x5626b88a7c50 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.680+0000 7fc48f13f740 1 --2- 172.21.15.59:0/2508022943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b88974d0 0x5626b88978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.680+0000 7fc48f13f740 1 -- 172.21.15.59:0/2508022943 >> 172.21.15.59:0/2508022943 conn(0x5626b8895300 msgr2=0x5626b88964a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:15.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.680+0000 7fc48f13f740 1 -- 172.21.15.59:0/2508022943 shutdown_connections 2024-09-10T21:16:15.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.680+0000 7fc48f13f740 1 -- 172.21.15.59:0/2508022943 wait complete. 2024-09-10T21:16:15.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.680+0000 7fc48f13f740 1 -- start start 2024-09-10T21:16:15.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.680+0000 7fc48f13f740 1 Processor -- start 2024-09-10T21:16:15.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc48f13f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b88974d0 0x5626b88a7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:15.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc48f13f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626b8897df0 0x5626b88a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:15.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc48f13f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b88a8190 0x5626b88a5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:15.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc48f13f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5626b865e700 con 0x5626b88a8190 2024-09-10T21:16:15.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc48f13f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5626b8798160 con 0x5626b88974d0 2024-09-10T21:16:15.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc48f13f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5626b88aae40 con 0x5626b8897df0 2024-09-10T21:16:15.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc48f13f740 10 client.0 _ll_register_callbacks cb 0x5626b87b19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:15.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc486d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b88a8190 0x5626b88a5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:15.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc486d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b88a8190 0x5626b88a5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37744/0 (socket says 172.21.15.59:37744) 2024-09-10T21:16:15.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc486d9d640 1 -- 172.21.15.59:0/3021165496 learned_addr learned my addr 172.21.15.59:0/3021165496 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:15.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc485d9b640 1 --2- 172.21.15.59:0/3021165496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626b8897df0 0x5626b88a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:15.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc48659c640 1 --2- 172.21.15.59:0/3021165496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b88974d0 0x5626b88a7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:15.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc486d9d640 1 -- 172.21.15.59:0/3021165496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626b8897df0 msgr2=0x5626b88a4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:15.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc486d9d640 1 --2- 172.21.15.59:0/3021165496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626b8897df0 0x5626b88a4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc486d9d640 1 -- 172.21.15.59:0/3021165496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b88974d0 msgr2=0x5626b88a7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:15.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc486d9d640 1 --2- 172.21.15.59:0/3021165496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b88974d0 0x5626b88a7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc486d9d640 1 -- 172.21.15.59:0/3021165496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626b87c5c90 con 0x5626b88a8190 2024-09-10T21:16:15.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc48659c640 1 --2- 172.21.15.59:0/3021165496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b88974d0 0x5626b88a7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:16:15.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc486d9d640 1 --2- 172.21.15.59:0/3021165496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b88a8190 0x5626b88a5490 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc4800108f0 tx=0x7fc480004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce3ad109b618244 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:15.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.681+0000 7fc46dffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:15.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.682+0000 7fc46dffb640 1 -- 172.21.15.59:0/3021165496 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48001ecc0 con 0x5626b88a8190 2024-09-10T21:16:15.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.682+0000 7fc48f13f740 1 -- 172.21.15.59:0/3021165496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc478014070 con 0x5626b88a8190 2024-09-10T21:16:15.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.682+0000 7fc46dffb640 1 -- 172.21.15.59:0/3021165496 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc48001f420 con 0x5626b88a8190 2024-09-10T21:16:15.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.682+0000 7fc46dffb640 1 -- 172.21.15.59:0/3021165496 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc48001ee60 con 0x5626b88a8190 2024-09-10T21:16:15.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.682+0000 7fc48f13f740 10 client.15582 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:15.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.682+0000 7fc48f13f740 1 -- 172.21.15.59:0/3021165496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5626b88b67b0 con 0x5626b88a8190 2024-09-10T21:16:15.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.682+0000 7fc46dffb640 1 -- 172.21.15.59:0/3021165496 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc478014070 con 0x5626b88a8190 2024-09-10T21:16:15.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.682+0000 7fc46dffb640 1 -- 172.21.15.59:0/3021165496 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc48000f040 con 0x5626b88a8190 2024-09-10T21:16:15.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.682+0000 7fc48f13f740 10 client.15582 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:15.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.682+0000 7fc48f13f740 10 client.15582 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:16:15.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.682+0000 7fc48f13f740 20 client.15582 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:15.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.682+0000 7fc48f13f740 1 --2- 172.21.15.59:0/3021165496 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5626b88b7c80 0x5626b88ba0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:15.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.682+0000 7fc48f13f740 4 client.15582 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:16:15.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.682+0000 7fc48f13f740 1 -- 172.21.15.59:0/3021165496 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626b880fdf0 con 0x5626b88b7c80 2024-09-10T21:16:15.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.683+0000 7fc48659c640 1 --2- 172.21.15.59:0/3021165496 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5626b88b7c80 0x5626b88ba0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:15.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.683+0000 7fc48659c640 1 --2- 172.21.15.59:0/3021165496 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5626b88b7c80 0x5626b88ba0d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5326f0fb7693b717 server_cookie=206acc56856ff90e in_seq=0 out_seq=0 2024-09-10T21:16:15.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.683+0000 7fc46dffb640 10 client.15582 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:16:15.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.684+0000 7fc46dffb640 1 -- 172.21.15.59:0/3021165496 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5626b880fdf0 con 0x5626b88b7c80 2024-09-10T21:16:15.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.684+0000 7fc46dffb640 10 client.15582 handle_command_reply: tid=0 2024-09-10T21:16:15.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.684+0000 7fc48f13f740 1 client.15582 shutdown 2024-09-10T21:16:15.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.684+0000 7fc48f13f740 1 -- 172.21.15.59:0/3021165496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b88a8190 msgr2=0x5626b88a5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:15.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.684+0000 7fc48f13f740 1 --2- 172.21.15.59:0/3021165496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b88a8190 0x5626b88a5490 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc4800108f0 tx=0x7fc480004a40 comp rx=0 tx=0).stop 2024-09-10T21:16:15.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.684+0000 7fc48f13f740 1 -- 172.21.15.59:0/3021165496 shutdown_connections 2024-09-10T21:16:15.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.684+0000 7fc48f13f740 1 --2- 172.21.15.59:0/3021165496 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5626b88b7c80 0x5626b88ba0d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.684+0000 7fc48f13f740 1 --2- 172.21.15.59:0/3021165496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b88a8190 0x5626b88a5490 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.684+0000 7fc48f13f740 1 --2- 172.21.15.59:0/3021165496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626b8897df0 0x5626b88a4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.684+0000 7fc48f13f740 1 --2- 172.21.15.59:0/3021165496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b88974d0 0x5626b88a7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.684+0000 7fc48f13f740 1 -- 172.21.15.59:0/3021165496 >> 172.21.15.59:0/3021165496 conn(0x5626b8895300 msgr2=0x5626b889aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:15.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.684+0000 7fc46dffb640 0 client.15582 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:16:15.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.684+0000 7fc48f13f740 1 -- 172.21.15.59:0/3021165496 shutdown_connections 2024-09-10T21:16:15.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.684+0000 7fc48f13f740 1 -- 172.21.15.59:0/3021165496 wait complete. 2024-09-10T21:16:15.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.684+0000 7fc48f13f740 20 client.15582 trim_cache size 0 max 16384 2024-09-10T21:16:15.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.697+0000 7fc48f13f740 1 Processor -- start 2024-09-10T21:16:15.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.697+0000 7fc48f13f740 1 -- start start 2024-09-10T21:16:15.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.697+0000 7fc48f13f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626b8895300 0x5626b88b4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:15.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.697+0000 7fc48f13f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b88974d0 0x5626b88b9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:15.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.697+0000 7fc48f13f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 0x5626b88bf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:15.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.697+0000 7fc48f13f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc4881ac040 con 0x5626b8897df0 2024-09-10T21:16:15.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.697+0000 7fc48f13f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc4881adb80 con 0x5626b88974d0 2024-09-10T21:16:15.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.697+0000 7fc48f13f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc4881ac710 con 0x5626b8895300 2024-09-10T21:16:15.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.698+0000 7fc486d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 0x5626b88bf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:15.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.698+0000 7fc486d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 0x5626b88bf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37758/0 (socket says 172.21.15.59:37758) 2024-09-10T21:16:15.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.698+0000 7fc486d9d640 1 -- 172.21.15.59:0/1591744108 learned_addr learned my addr 172.21.15.59:0/1591744108 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:15.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.698+0000 7fc486d9d640 1 -- 172.21.15.59:0/1591744108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626b8895300 msgr2=0x5626b88b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:15.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.698+0000 7fc486d9d640 1 --2- 172.21.15.59:0/1591744108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626b8895300 0x5626b88b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.698+0000 7fc486d9d640 1 -- 172.21.15.59:0/1591744108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b88974d0 msgr2=0x5626b88b9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:15.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.698+0000 7fc486d9d640 1 --2- 172.21.15.59:0/1591744108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b88974d0 0x5626b88b9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.698+0000 7fc486d9d640 1 -- 172.21.15.59:0/1591744108 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626b88a8b10 con 0x5626b8897df0 2024-09-10T21:16:15.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.698+0000 7fc486d9d640 1 --2- 172.21.15.59:0/1591744108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 0x5626b88bf9a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc480000f80 tx=0x7fc480005fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f355a355295d5a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:15.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.698+0000 7fc46ffff640 1 -- 172.21.15.59:0/1591744108 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48001eac0 con 0x5626b8897df0 2024-09-10T21:16:15.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.698+0000 7fc46ffff640 1 -- 172.21.15.59:0/1591744108 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc48001ec60 con 0x5626b8897df0 2024-09-10T21:16:15.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.698+0000 7fc46ffff640 1 -- 172.21.15.59:0/1591744108 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4800053f0 con 0x5626b8897df0 2024-09-10T21:16:15.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.699+0000 7fc48f13f740 1 -- 172.21.15.59:0/1591744108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 msgr2=0x5626b88bf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:15.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.699+0000 7fc48f13f740 1 --2- 172.21.15.59:0/1591744108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 0x5626b88bf9a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc480000f80 tx=0x7fc480005fc0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.699+0000 7fc48f13f740 1 -- 172.21.15.59:0/1591744108 shutdown_connections 2024-09-10T21:16:15.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.699+0000 7fc48f13f740 1 --2- 172.21.15.59:0/1591744108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 0x5626b88bf9a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.699+0000 7fc48f13f740 1 --2- 172.21.15.59:0/1591744108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b88974d0 0x5626b88b9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.699+0000 7fc48f13f740 1 --2- 172.21.15.59:0/1591744108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626b8895300 0x5626b88b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.699+0000 7fc48f13f740 1 -- 172.21.15.59:0/1591744108 >> 172.21.15.59:0/1591744108 conn(0x5626b88a9700 msgr2=0x5626b88a9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:15.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.699+0000 7fc48f13f740 1 -- 172.21.15.59:0/1591744108 shutdown_connections 2024-09-10T21:16:15.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.699+0000 7fc48f13f740 1 -- 172.21.15.59:0/1591744108 wait complete. 2024-09-10T21:16:15.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.699+0000 7fc48f13f740 1 -- start start 2024-09-10T21:16:15.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.699+0000 7fc48f13f740 1 Processor -- start 2024-09-10T21:16:15.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.699+0000 7fc48f13f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b8895300 0x5626b88b0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:15.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.699+0000 7fc48f13f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626b88974d0 0x5626b88b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:15.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc48f13f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 0x5626b88ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:15.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc48f13f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc4881ad4b0 con 0x5626b8897df0 2024-09-10T21:16:15.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc48f13f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc4881acde0 con 0x5626b8895300 2024-09-10T21:16:15.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc48f13f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc4881aa020 con 0x5626b88974d0 2024-09-10T21:16:15.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc48f13f740 10 client.0 _ll_register_callbacks cb 0x7fc480009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:15.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc48659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b8895300 0x5626b88b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:15.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc486d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 0x5626b88ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:15.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc485d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626b88974d0 0x5626b88b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:15.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc48659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b8895300 0x5626b88b0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:38686/0 (socket says 172.21.15.59:38686) 2024-09-10T21:16:15.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc48659c640 1 -- 172.21.15.59:0/570644866 learned_addr learned my addr 172.21.15.59:0/570644866 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:15.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc486d9d640 1 -- 172.21.15.59:0/570644866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626b88974d0 msgr2=0x5626b88b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:15.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc486d9d640 1 --2- 172.21.15.59:0/570644866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626b88974d0 0x5626b88b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc486d9d640 1 -- 172.21.15.59:0/570644866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b8895300 msgr2=0x5626b88b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:15.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc486d9d640 1 --2- 172.21.15.59:0/570644866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b8895300 0x5626b88b0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc486d9d640 1 -- 172.21.15.59:0/570644866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626b88ada10 con 0x5626b8897df0 2024-09-10T21:16:15.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc486d9d640 1 --2- 172.21.15.59:0/570644866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 0x5626b88ad1e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc480000f80 tx=0x7fc480010ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc99cdbcf8c0a267 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:15.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc46dffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:15.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc46dffb640 1 -- 172.21.15.59:0/570644866 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480041030 con 0x5626b8897df0 2024-09-10T21:16:15.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc46dffb640 1 -- 172.21.15.59:0/570644866 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc480033b30 con 0x5626b8897df0 2024-09-10T21:16:15.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.700+0000 7fc48f13f740 1 -- 172.21.15.59:0/570644866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc48001ec60 con 0x5626b8897df0 2024-09-10T21:16:15.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.701+0000 7fc46dffb640 1 -- 172.21.15.59:0/570644866 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc4800049e0 con 0x5626b8897df0 2024-09-10T21:16:15.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.701+0000 7fc48f13f740 10 client.15588 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:15.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.701+0000 7fc48f13f740 1 -- 172.21.15.59:0/570644866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5626b89257d0 con 0x5626b8897df0 2024-09-10T21:16:15.725 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:16:15.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.701+0000 7fc46dffb640 1 -- 172.21.15.59:0/570644866 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc48001ec60 con 0x5626b8897df0 2024-09-10T21:16:15.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.701+0000 7fc46dffb640 1 -- 172.21.15.59:0/570644866 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc48003dce0 con 0x5626b8897df0 2024-09-10T21:16:15.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.701+0000 7fc48f13f740 10 client.15588 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:15.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.701+0000 7fc48f13f740 10 client.15588 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:16:15.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.701+0000 7fc48f13f740 20 client.15588 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:15.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.701+0000 7fc48f13f740 1 --2- 172.21.15.59:0/570644866 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5626b88a8190 0x5626b8927e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:15.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.701+0000 7fc48f13f740 4 client.15588 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:16:15.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.701+0000 7fc48f13f740 1 -- 172.21.15.59:0/570644866 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5626b88ba460 con 0x5626b88a8190 2024-09-10T21:16:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.701+0000 7fc48659c640 1 --2- 172.21.15.59:0/570644866 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5626b88a8190 0x5626b8927e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.702+0000 7fc46dffb640 10 client.15588 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:16:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.702+0000 7fc48659c640 1 --2- 172.21.15.59:0/570644866 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5626b88a8190 0x5626b8927e50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d1ca1db091a14e33 server_cookie=36dd1de28236468c in_seq=0 out_seq=0 2024-09-10T21:16:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.702+0000 7fc46dffb640 1 -- 172.21.15.59:0/570644866 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5626b88ba460 con 0x5626b88a8190 2024-09-10T21:16:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.702+0000 7fc46dffb640 10 client.15588 handle_command_reply: tid=0 2024-09-10T21:16:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.702+0000 7fc48f13f740 1 client.15588 shutdown 2024-09-10T21:16:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.702+0000 7fc48f13f740 1 -- 172.21.15.59:0/570644866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 msgr2=0x5626b88ad1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.702+0000 7fc48f13f740 1 --2- 172.21.15.59:0/570644866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 0x5626b88ad1e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc480000f80 tx=0x7fc480010ed0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.702+0000 7fc48f13f740 1 -- 172.21.15.59:0/570644866 shutdown_connections 2024-09-10T21:16:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.702+0000 7fc48f13f740 1 --2- 172.21.15.59:0/570644866 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5626b88a8190 0x5626b8927e50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.702+0000 7fc48f13f740 1 --2- 172.21.15.59:0/570644866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626b8897df0 0x5626b88ad1e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.702+0000 7fc48f13f740 1 --2- 172.21.15.59:0/570644866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5626b88974d0 0x5626b88b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.702+0000 7fc48f13f740 1 --2- 172.21.15.59:0/570644866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626b8895300 0x5626b88b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.702+0000 7fc48f13f740 1 -- 172.21.15.59:0/570644866 >> 172.21.15.59:0/570644866 conn(0x5626b88a9700 msgr2=0x5626b8893c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.702+0000 7fc46dffb640 0 client.15588 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:16:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.702+0000 7fc48f13f740 1 -- 172.21.15.59:0/570644866 shutdown_connections 2024-09-10T21:16:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.702+0000 7fc48f13f740 1 -- 172.21.15.59:0/570644866 wait complete. 2024-09-10T21:16:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.702+0000 7fc48f13f740 20 client.15588 trim_cache size 0 max 16384 2024-09-10T21:16:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.703+0000 7fc48cd6a640 1 -- 172.21.15.59:0/940170027 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc4740b52e0 msgr2=0x7fc4740b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.703+0000 7fc48cd6a640 1 --2- 172.21.15.59:0/940170027 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc4740b52e0 0x7fc4740b77a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc48819afe0 tx=0x7fc480009760 comp rx=0 tx=0).stop 2024-09-10T21:16:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.703+0000 7fc48cd6a640 1 -- 172.21.15.59:0/940170027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4881076e0 msgr2=0x7fc48819a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.703+0000 7fc48cd6a640 1 --2- 172.21.15.59:0/940170027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4881076e0 0x7fc48819a540 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc470005940 tx=0x7fc4700042f0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.703+0000 7fc48cd6a640 1 -- 172.21.15.59:0/940170027 shutdown_connections 2024-09-10T21:16:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.703+0000 7fc48cd6a640 1 --2- 172.21.15.59:0/940170027 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc4740b52e0 0x7fc4740b77a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.703+0000 7fc48cd6a640 1 --2- 172.21.15.59:0/940170027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc488108060 0x7fc48819aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.703+0000 7fc48cd6a640 1 --2- 172.21.15.59:0/940170027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4881076e0 0x7fc48819a540 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.703+0000 7fc48cd6a640 1 --2- 172.21.15.59:0/940170027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc488101cd0 0x7fc48819a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:15.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.703+0000 7fc48cd6a640 1 -- 172.21.15.59:0/940170027 >> 172.21.15.59:0/940170027 conn(0x7fc4880fd700 msgr2=0x7fc4880ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:15.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.703+0000 7fc48cd6a640 1 -- 172.21.15.59:0/940170027 shutdown_connections 2024-09-10T21:16:15.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:15.703+0000 7fc48cd6a640 1 -- 172.21.15.59:0/940170027 wait complete. 2024-09-10T21:16:16.437 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:16:16.740 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:16:17.136 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:17 smithi059 ceph-mon[30888]: pgmap v370: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-09-10T21:16:17.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.216+0000 7f26eab9c640 1 -- 172.21.15.59:0/2804063449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26e41087d0 msgr2=0x7f26e4108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:17.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.216+0000 7f26eab9c640 1 --2- 172.21.15.59:0/2804063449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26e41087d0 0x7f26e4108c10 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f26d4009ca0 tx=0x7f26d402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.216+0000 7f26eab9c640 1 -- 172.21.15.59:0/2804063449 shutdown_connections 2024-09-10T21:16:17.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.216+0000 7f26eab9c640 1 --2- 172.21.15.59:0/2804063449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26e4109150 0x7f26e410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.216+0000 7f26eab9c640 1 --2- 172.21.15.59:0/2804063449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26e41087d0 0x7f26e4108c10 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.216+0000 7f26eab9c640 1 --2- 172.21.15.59:0/2804063449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26e4102dc0 0x7f26e41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.216+0000 7f26eab9c640 1 -- 172.21.15.59:0/2804063449 >> 172.21.15.59:0/2804063449 conn(0x7f26e40fe830 msgr2=0x7f26e4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:17.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.216+0000 7f26eab9c640 1 -- 172.21.15.59:0/2804063449 shutdown_connections 2024-09-10T21:16:17.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.216+0000 7f26eab9c640 1 -- 172.21.15.59:0/2804063449 wait complete. 2024-09-10T21:16:17.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.217+0000 7f26eab9c640 1 Processor -- start 2024-09-10T21:16:17.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.217+0000 7f26eab9c640 1 -- start start 2024-09-10T21:16:17.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.217+0000 7f26eab9c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26e4102dc0 0x7f26e4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:17.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.217+0000 7f26eab9c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26e41087d0 0x7f26e4199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:17.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.217+0000 7f26eab9c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26e4109150 0x7f26e419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:17.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.217+0000 7f26eab9c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f26e4112e10 con 0x7f26e41087d0 2024-09-10T21:16:17.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.217+0000 7f26eab9c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26e4112c90 con 0x7f26e4109150 2024-09-10T21:16:17.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.217+0000 7f26eab9c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f26e4112f90 con 0x7f26e4102dc0 2024-09-10T21:16:17.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.217+0000 7f26e3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26e41087d0 0x7f26e4199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:17.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.217+0000 7f26e3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26e41087d0 0x7f26e4199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37790/0 (socket says 172.21.15.59:37790) 2024-09-10T21:16:17.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.217+0000 7f26e3fff640 1 -- 172.21.15.59:0/1224377407 learned_addr learned my addr 172.21.15.59:0/1224377407 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:17.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.217+0000 7f26e8938640 1 --2- 172.21.15.59:0/1224377407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26e4102dc0 0x7f26e4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:17.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.218+0000 7f26e9139640 1 --2- 172.21.15.59:0/1224377407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26e4109150 0x7f26e419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:17.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.218+0000 7f26e3fff640 1 -- 172.21.15.59:0/1224377407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26e4102dc0 msgr2=0x7f26e4199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:17.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.218+0000 7f26e3fff640 1 --2- 172.21.15.59:0/1224377407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26e4102dc0 0x7f26e4199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.218+0000 7f26e3fff640 1 -- 172.21.15.59:0/1224377407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26e4109150 msgr2=0x7f26e419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:17.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.218+0000 7f26e3fff640 1 --2- 172.21.15.59:0/1224377407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26e4109150 0x7f26e419ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.218+0000 7f26e3fff640 1 -- 172.21.15.59:0/1224377407 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e419f3b0 con 0x7f26e41087d0 2024-09-10T21:16:17.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.218+0000 7f26e9139640 1 --2- 172.21.15.59:0/1224377407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26e4109150 0x7f26e419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:16:17.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.218+0000 7f26e3fff640 1 --2- 172.21.15.59:0/1224377407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26e41087d0 0x7f26e4199840 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f26d4006010 tx=0x7f26d40319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:17.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.218+0000 7f26e1ffb640 1 -- 172.21.15.59:0/1224377407 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d4003bf0 con 0x7f26e41087d0 2024-09-10T21:16:17.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.218+0000 7f26eab9c640 1 -- 172.21.15.59:0/1224377407 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e419f640 con 0x7f26e41087d0 2024-09-10T21:16:17.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.218+0000 7f26e1ffb640 1 -- 172.21.15.59:0/1224377407 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26d4003d90 con 0x7f26e41087d0 2024-09-10T21:16:17.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.218+0000 7f26eab9c640 1 -- 172.21.15.59:0/1224377407 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e41a5d60 con 0x7f26e41087d0 2024-09-10T21:16:17.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.219+0000 7f26e1ffb640 1 -- 172.21.15.59:0/1224377407 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d402fbc0 con 0x7f26e41087d0 2024-09-10T21:16:17.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.221+0000 7f26e1ffb640 1 -- 172.21.15.59:0/1224377407 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f26d4004040 con 0x7f26e41087d0 2024-09-10T21:16:17.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.221+0000 7f26ecf71740 1 Processor -- start 2024-09-10T21:16:17.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.221+0000 7f26ecf71740 1 -- start start 2024-09-10T21:16:17.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.221+0000 7f26ecf71740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5605803144d0 0x5605803148b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:17.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.221+0000 7f26ecf71740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 0x560580324c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:17.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.221+0000 7f26ecf71740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580325190 0x560580327580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:17.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.221+0000 7f26ecf71740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56058028aea0 con 0x560580314df0 2024-09-10T21:16:17.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.221+0000 7f26ecf71740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56058027a2d0 con 0x560580325190 2024-09-10T21:16:17.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.221+0000 7f26ecf71740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56058027e0e0 con 0x5605803144d0 2024-09-10T21:16:17.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.221+0000 7f26e8938640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 0x560580324c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:17.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.222+0000 7f26e8938640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 0x560580324c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37806/0 (socket says 172.21.15.59:37806) 2024-09-10T21:16:17.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.222+0000 7f26e8938640 1 -- 172.21.15.59:0/825498372 learned_addr learned my addr 172.21.15.59:0/825498372 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:17.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.222+0000 7f26e9139640 1 --2- 172.21.15.59:0/825498372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5605803144d0 0x5605803148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:17.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.222+0000 7f26e3fff640 1 --2- 172.21.15.59:0/825498372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580325190 0x560580327580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:17.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.222+0000 7f26e8938640 1 -- 172.21.15.59:0/825498372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5605803144d0 msgr2=0x5605803148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:17.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.222+0000 7f26e8938640 1 --2- 172.21.15.59:0/825498372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5605803144d0 0x5605803148b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.222+0000 7f26e8938640 1 -- 172.21.15.59:0/825498372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580325190 msgr2=0x560580327580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:17.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.222+0000 7f26e8938640 1 --2- 172.21.15.59:0/825498372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580325190 0x560580327580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.222+0000 7f26e8938640 1 -- 172.21.15.59:0/825498372 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56057ffd8650 con 0x560580314df0 2024-09-10T21:16:17.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.222+0000 7f26e9139640 1 --2- 172.21.15.59:0/825498372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5605803144d0 0x5605803148b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:16:17.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.222+0000 7f26e1ffb640 1 --2- 172.21.15.59:0/1224377407 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f26d00b52e0 0x7f26d00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:17.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.222+0000 7f26e3fff640 1 --2- 172.21.15.59:0/825498372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580325190 0x560580327580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:16:17.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.222+0000 7f26e8938640 1 --2- 172.21.15.59:0/825498372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 0x560580324c50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00bd40 tx=0x7f26cc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372faef65a5172a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:17.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.222+0000 7f26e9139640 1 --2- 172.21.15.59:0/1224377407 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f26d00b52e0 0x7f26d00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:17.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.222+0000 7f26e1ffb640 1 -- 172.21.15.59:0/1224377407 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f26d4106fe0 con 0x7f26e41087d0 2024-09-10T21:16:17.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.222+0000 7f26daffd640 1 -- 172.21.15.59:0/825498372 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc004230 con 0x560580314df0 2024-09-10T21:16:17.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.222+0000 7f26daffd640 1 -- 172.21.15.59:0/825498372 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26cc00be30 con 0x560580314df0 2024-09-10T21:16:17.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.222+0000 7f26daffd640 1 -- 172.21.15.59:0/825498372 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc01a740 con 0x560580314df0 2024-09-10T21:16:17.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.223+0000 7f26ecf71740 1 -- 172.21.15.59:0/825498372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 msgr2=0x560580324c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:17.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.223+0000 7f26ecf71740 1 --2- 172.21.15.59:0/825498372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 0x560580324c50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00bd40 tx=0x7f26cc0107a0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.223+0000 7f26e9139640 1 --2- 172.21.15.59:0/1224377407 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f26d00b52e0 0x7f26d00b77a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00beb0 tx=0x7f26dc00b4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:17.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.223+0000 7f26ecf71740 1 -- 172.21.15.59:0/825498372 shutdown_connections 2024-09-10T21:16:17.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.223+0000 7f26ecf71740 1 --2- 172.21.15.59:0/825498372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580325190 0x560580327580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.223+0000 7f26ecf71740 1 --2- 172.21.15.59:0/825498372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 0x560580324c50 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.223+0000 7f26ecf71740 1 --2- 172.21.15.59:0/825498372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5605803144d0 0x5605803148b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.223+0000 7f26ecf71740 1 -- 172.21.15.59:0/825498372 >> 172.21.15.59:0/825498372 conn(0x560580312300 msgr2=0x5605803134a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:17.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.223+0000 7f26ecf71740 1 -- 172.21.15.59:0/825498372 shutdown_connections 2024-09-10T21:16:17.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.223+0000 7f26ecf71740 1 -- 172.21.15.59:0/825498372 wait complete. 2024-09-10T21:16:17.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.224+0000 7f26ecf71740 1 -- start start 2024-09-10T21:16:17.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.224+0000 7f26ecf71740 1 Processor -- start 2024-09-10T21:16:17.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.224+0000 7f26ecf71740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605803144d0 0x560580324af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:17.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.224+0000 7f26ecf71740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580314df0 0x560580321f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:17.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.224+0000 7f26ecf71740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560580325190 0x5605803225c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:17.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.224+0000 7f26ecf71740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5605800db700 con 0x5605803144d0 2024-09-10T21:16:17.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.224+0000 7f26ecf71740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560580215160 con 0x560580314df0 2024-09-10T21:16:17.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.224+0000 7f26ecf71740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x560580327e40 con 0x560580325190 2024-09-10T21:16:17.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.224+0000 7f26e8938640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605803144d0 0x560580324af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:17.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.224+0000 7f26ecf71740 10 client.0 _ll_register_callbacks cb 0x56058022e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:17.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.224+0000 7f26e8938640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605803144d0 0x560580324af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37812/0 (socket says 172.21.15.59:37812) 2024-09-10T21:16:17.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.224+0000 7f26e8938640 1 -- 172.21.15.59:0/2270530481 learned_addr learned my addr 172.21.15.59:0/2270530481 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:17.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.225+0000 7f26e3fff640 1 --2- 172.21.15.59:0/2270530481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580314df0 0x560580321f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:17.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.225+0000 7f26e9139640 1 --2- 172.21.15.59:0/2270530481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560580325190 0x5605803225c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:17.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.225+0000 7f26e8938640 1 -- 172.21.15.59:0/2270530481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560580325190 msgr2=0x5605803225c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:17.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.225+0000 7f26e8938640 1 --2- 172.21.15.59:0/2270530481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560580325190 0x5605803225c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.225+0000 7f26e8938640 1 -- 172.21.15.59:0/2270530481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580314df0 msgr2=0x560580321f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:17.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.225+0000 7f26e8938640 1 --2- 172.21.15.59:0/2270530481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580314df0 0x560580321f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.225+0000 7f26e8938640 1 -- 172.21.15.59:0/2270530481 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560580242c90 con 0x5605803144d0 2024-09-10T21:16:17.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.225+0000 7f26e3fff640 1 --2- 172.21.15.59:0/2270530481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580314df0 0x560580321f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:16:17.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.225+0000 7f26e9139640 1 --2- 172.21.15.59:0/2270530481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560580325190 0x5605803225c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:16:17.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.225+0000 7f26e8938640 1 --2- 172.21.15.59:0/2270530481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605803144d0 0x560580324af0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00b8e0 tx=0x7f26cc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb68a0b696983a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:17.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.225+0000 7f26c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:17.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.225+0000 7f26c3fff640 1 -- 172.21.15.59:0/2270530481 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc029060 con 0x5605803144d0 2024-09-10T21:16:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.225+0000 7f26c3fff640 1 -- 172.21.15.59:0/2270530481 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f26cc0042e0 con 0x5605803144d0 2024-09-10T21:16:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.225+0000 7f26ecf71740 1 -- 172.21.15.59:0/2270530481 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26cc00be30 con 0x5605803144d0 2024-09-10T21:16:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.225+0000 7f26c3fff640 1 -- 172.21.15.59:0/2270530481 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f26cc0044e0 con 0x5605803144d0 2024-09-10T21:16:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.225+0000 7f26ecf71740 10 client.15600 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.225+0000 7f26ecf71740 1 -- 172.21.15.59:0/2270530481 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5605803337f0 con 0x5605803144d0 2024-09-10T21:16:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.226+0000 7f26c3fff640 1 -- 172.21.15.59:0/2270530481 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26cc00be30 con 0x5605803144d0 2024-09-10T21:16:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.226+0000 7f26c3fff640 1 -- 172.21.15.59:0/2270530481 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f26cc0046c0 con 0x5605803144d0 2024-09-10T21:16:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.226+0000 7f26ecf71740 10 client.15600 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.226+0000 7f26ecf71740 10 client.15600 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:16:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.226+0000 7f26ecf71740 20 client.15600 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.226+0000 7f26ecf71740 1 --2- 172.21.15.59:0/2270530481 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x560580334ba0 0x560580336f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:17.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.226+0000 7f26ecf71740 4 client.15600 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:16:17.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.226+0000 7f26ecf71740 1 -- 172.21.15.59:0/2270530481 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56058028cdf0 con 0x560580334ba0 2024-09-10T21:16:17.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.226+0000 7f26e3fff640 1 --2- 172.21.15.59:0/2270530481 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x560580334ba0 0x560580336f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:17.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.227+0000 7f26c3fff640 10 client.15600 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:16:17.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.227+0000 7f26e3fff640 1 --2- 172.21.15.59:0/2270530481 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x560580334ba0 0x560580336f90 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6e7efaadeafd39e2 server_cookie=119b0f3f6fa03aa in_seq=0 out_seq=0 2024-09-10T21:16:17.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.227+0000 7f26c3fff640 1 -- 172.21.15.59:0/2270530481 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56058028cdf0 con 0x560580334ba0 2024-09-10T21:16:17.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.227+0000 7f26c3fff640 10 client.15600 handle_command_reply: tid=0 2024-09-10T21:16:17.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.227+0000 7f26ecf71740 1 client.15600 shutdown 2024-09-10T21:16:17.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.228+0000 7f26ecf71740 1 -- 172.21.15.59:0/2270530481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605803144d0 msgr2=0x560580324af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:17.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.228+0000 7f26ecf71740 1 --2- 172.21.15.59:0/2270530481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605803144d0 0x560580324af0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00b8e0 tx=0x7f26cc00b910 comp rx=0 tx=0).stop 2024-09-10T21:16:17.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.228+0000 7f26ecf71740 1 -- 172.21.15.59:0/2270530481 shutdown_connections 2024-09-10T21:16:17.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.228+0000 7f26ecf71740 1 --2- 172.21.15.59:0/2270530481 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x560580334ba0 0x560580336f90 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.228+0000 7f26ecf71740 1 --2- 172.21.15.59:0/2270530481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560580325190 0x5605803225c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.228+0000 7f26ecf71740 1 --2- 172.21.15.59:0/2270530481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580314df0 0x560580321f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.228+0000 7f26ecf71740 1 --2- 172.21.15.59:0/2270530481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605803144d0 0x560580324af0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.228+0000 7f26ecf71740 1 -- 172.21.15.59:0/2270530481 >> 172.21.15.59:0/2270530481 conn(0x560580312300 msgr2=0x560580317ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:17.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.228+0000 7f26c3fff640 0 client.15600 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:16:17.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.228+0000 7f26ecf71740 1 -- 172.21.15.59:0/2270530481 shutdown_connections 2024-09-10T21:16:17.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.228+0000 7f26ecf71740 1 -- 172.21.15.59:0/2270530481 wait complete. 2024-09-10T21:16:17.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.228+0000 7f26ecf71740 20 client.15600 trim_cache size 0 max 16384 2024-09-10T21:16:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.242+0000 7f26ecf71740 1 Processor -- start 2024-09-10T21:16:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.242+0000 7f26ecf71740 1 -- start start 2024-09-10T21:16:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.242+0000 7f26ecf71740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5605803144d0 0x560580331070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.242+0000 7f26ecf71740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 0x5605803207c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.242+0000 7f26ecf71740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580325190 0x560580320d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.242+0000 7f26ecf71740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f26e41ac1d0 con 0x560580314df0 2024-09-10T21:16:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.242+0000 7f26ecf71740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26e41add10 con 0x560580325190 2024-09-10T21:16:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.242+0000 7f26ecf71740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f26e41ac8a0 con 0x5605803144d0 2024-09-10T21:16:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.242+0000 7f26e3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 0x5605803207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.242+0000 7f26e3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 0x5605803207c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37814/0 (socket says 172.21.15.59:37814) 2024-09-10T21:16:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.242+0000 7f26e3fff640 1 -- 172.21.15.59:0/677679144 learned_addr learned my addr 172.21.15.59:0/677679144 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.242+0000 7f26e3fff640 1 -- 172.21.15.59:0/677679144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5605803144d0 msgr2=0x560580331070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.242+0000 7f26e8938640 1 --2- 172.21.15.59:0/677679144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5605803144d0 0x560580331070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.242+0000 7f26e3fff640 1 --2- 172.21.15.59:0/677679144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5605803144d0 0x560580331070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.242+0000 7f26e9139640 1 --2- 172.21.15.59:0/677679144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580325190 0x560580320d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.242+0000 7f26e3fff640 1 -- 172.21.15.59:0/677679144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580325190 msgr2=0x560580320d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.242+0000 7f26e3fff640 1 --2- 172.21.15.59:0/677679144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580325190 0x560580320d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.242+0000 7f26e3fff640 1 -- 172.21.15.59:0/677679144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56058030d990 con 0x560580314df0 2024-09-10T21:16:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.242+0000 7f26e9139640 1 --2- 172.21.15.59:0/677679144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580325190 0x560580320d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:16:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.243+0000 7f26e3fff640 1 --2- 172.21.15.59:0/677679144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 0x5605803207c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f26d40c9de0 tx=0x7f26d402f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5cc8eecba5267 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.243+0000 7f26da7fc640 1 -- 172.21.15.59:0/677679144 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d40ccf80 con 0x560580314df0 2024-09-10T21:16:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.243+0000 7f26da7fc640 1 -- 172.21.15.59:0/677679144 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26d4036070 con 0x560580314df0 2024-09-10T21:16:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.243+0000 7f26da7fc640 1 -- 172.21.15.59:0/677679144 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d4004360 con 0x560580314df0 2024-09-10T21:16:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.243+0000 7f26ecf71740 1 -- 172.21.15.59:0/677679144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 msgr2=0x5605803207c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.243+0000 7f26ecf71740 1 --2- 172.21.15.59:0/677679144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 0x5605803207c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f26d40c9de0 tx=0x7f26d402f660 comp rx=0 tx=0).stop 2024-09-10T21:16:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.243+0000 7f26ecf71740 1 -- 172.21.15.59:0/677679144 shutdown_connections 2024-09-10T21:16:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.243+0000 7f26ecf71740 1 --2- 172.21.15.59:0/677679144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580325190 0x560580320d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.243+0000 7f26ecf71740 1 --2- 172.21.15.59:0/677679144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 0x5605803207c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.243+0000 7f26ecf71740 1 --2- 172.21.15.59:0/677679144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5605803144d0 0x560580331070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.243+0000 7f26ecf71740 1 -- 172.21.15.59:0/677679144 >> 172.21.15.59:0/677679144 conn(0x560580312300 msgr2=0x560580326ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:17.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.244+0000 7f26ecf71740 1 -- 172.21.15.59:0/677679144 shutdown_connections 2024-09-10T21:16:17.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.244+0000 7f26ecf71740 1 -- 172.21.15.59:0/677679144 wait complete. 2024-09-10T21:16:17.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.244+0000 7f26ecf71740 1 -- start start 2024-09-10T21:16:17.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.244+0000 7f26ecf71740 1 Processor -- start 2024-09-10T21:16:17.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.244+0000 7f26ecf71740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5605803144d0 0x56058032da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:17.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.244+0000 7f26ecf71740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 0x56058033c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:17.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.244+0000 7f26ecf71740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580325190 0x56058033cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:17.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.244+0000 7f26ecf71740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f26e41ad640 con 0x560580314df0 2024-09-10T21:16:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.244+0000 7f26ecf71740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26e41acf70 con 0x560580325190 2024-09-10T21:16:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.244+0000 7f26ecf71740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f26e41aa1d0 con 0x5605803144d0 2024-09-10T21:16:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.244+0000 7f26ecf71740 10 client.0 _ll_register_callbacks cb 0x7f26dc00b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.245+0000 7f26e3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 0x56058033c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.245+0000 7f26e3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 0x56058033c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37830/0 (socket says 172.21.15.59:37830) 2024-09-10T21:16:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.245+0000 7f26e3fff640 1 -- 172.21.15.59:0/2938830960 learned_addr learned my addr 172.21.15.59:0/2938830960 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.245+0000 7f26e8938640 1 --2- 172.21.15.59:0/2938830960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5605803144d0 0x56058032da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.245+0000 7f26e9139640 1 --2- 172.21.15.59:0/2938830960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580325190 0x56058033cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.245+0000 7f26e3fff640 1 -- 172.21.15.59:0/2938830960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5605803144d0 msgr2=0x56058032da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.245+0000 7f26e3fff640 1 --2- 172.21.15.59:0/2938830960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5605803144d0 0x56058032da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.245+0000 7f26e3fff640 1 -- 172.21.15.59:0/2938830960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580325190 msgr2=0x56058033cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.245+0000 7f26e3fff640 1 --2- 172.21.15.59:0/2938830960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580325190 0x56058033cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.245+0000 7f26e3fff640 1 -- 172.21.15.59:0/2938830960 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56058032c690 con 0x560580314df0 2024-09-10T21:16:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.245+0000 7f26e3fff640 1 --2- 172.21.15.59:0/2938830960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 0x56058033c3b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f26d40c9f70 tx=0x7f26d402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987190bcade6f58c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.245+0000 7f26c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.245+0000 7f26c3fff640 1 -- 172.21.15.59:0/2938830960 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d40d2020 con 0x560580314df0 2024-09-10T21:16:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.245+0000 7f26c3fff640 1 -- 172.21.15.59:0/2938830960 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f26d40c9a80 con 0x560580314df0 2024-09-10T21:16:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.245+0000 7f26ecf71740 1 -- 172.21.15.59:0/2938830960 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26d4036070 con 0x560580314df0 2024-09-10T21:16:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.245+0000 7f26c3fff640 1 -- 172.21.15.59:0/2938830960 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f26d40ccf80 con 0x560580314df0 2024-09-10T21:16:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.245+0000 7f26ecf71740 10 client.15606 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.245+0000 7f26ecf71740 1 -- 172.21.15.59:0/2938830960 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5605803a19c0 con 0x560580314df0 2024-09-10T21:16:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.246+0000 7f26c3fff640 1 -- 172.21.15.59:0/2938830960 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26d4036070 con 0x560580314df0 2024-09-10T21:16:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.246+0000 7f26c3fff640 1 -- 172.21.15.59:0/2938830960 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f26d40046a0 con 0x560580314df0 2024-09-10T21:16:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.246+0000 7f26ecf71740 10 client.15606 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.246+0000 7f26ecf71740 10 client.15606 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:16:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.246+0000 7f26ecf71740 20 client.15606 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.246+0000 7f26ecf71740 1 --2- 172.21.15.59:0/2938830960 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5605803a2140 0x5605803a4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:17.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.246+0000 7f26ecf71740 4 client.15606 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:16:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.246+0000 7f26ecf71740 1 -- 172.21.15.59:0/2938830960 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5605802888a0 con 0x5605803a2140 2024-09-10T21:16:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.246+0000 7f26e8938640 1 --2- 172.21.15.59:0/2938830960 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5605803a2140 0x5605803a4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.247+0000 7f26c3fff640 10 client.15606 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:16:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.247+0000 7f26e8938640 1 --2- 172.21.15.59:0/2938830960 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5605803a2140 0x5605803a4560 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4cbda2eb3930ae3e server_cookie=30ebc7c0cb603645 in_seq=0 out_seq=0 2024-09-10T21:16:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.247+0000 7f26c3fff640 1 -- 172.21.15.59:0/2938830960 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5605802888a0 con 0x5605803a2140 2024-09-10T21:16:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.247+0000 7f26c3fff640 10 client.15606 handle_command_reply: tid=0 2024-09-10T21:16:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.247+0000 7f26ecf71740 1 client.15606 shutdown 2024-09-10T21:16:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.247+0000 7f26ecf71740 1 -- 172.21.15.59:0/2938830960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 msgr2=0x56058033c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.247+0000 7f26ecf71740 1 --2- 172.21.15.59:0/2938830960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 0x56058033c3b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f26d40c9f70 tx=0x7f26d402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.247+0000 7f26ecf71740 1 -- 172.21.15.59:0/2938830960 shutdown_connections 2024-09-10T21:16:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.247+0000 7f26ecf71740 1 --2- 172.21.15.59:0/2938830960 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5605803a2140 0x5605803a4560 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.247+0000 7f26ecf71740 1 --2- 172.21.15.59:0/2938830960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560580325190 0x56058033cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.247+0000 7f26ecf71740 1 --2- 172.21.15.59:0/2938830960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560580314df0 0x56058033c3b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.247+0000 7f26ecf71740 1 --2- 172.21.15.59:0/2938830960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5605803144d0 0x56058032da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.247+0000 7f26ecf71740 1 -- 172.21.15.59:0/2938830960 >> 172.21.15.59:0/2938830960 conn(0x560580312300 msgr2=0x5605803130a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:17.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.247+0000 7f26c3fff640 0 client.15606 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:16:17.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.247+0000 7f26ecf71740 1 -- 172.21.15.59:0/2938830960 shutdown_connections 2024-09-10T21:16:17.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.247+0000 7f26ecf71740 1 -- 172.21.15.59:0/2938830960 wait complete. 2024-09-10T21:16:17.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.247+0000 7f26ecf71740 20 client.15606 trim_cache size 0 max 16384 2024-09-10T21:16:17.257 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:16:17.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.248+0000 7f26eab9c640 1 -- 172.21.15.59:0/1224377407 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f26d00b52e0 msgr2=0x7f26d00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:17.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.248+0000 7f26eab9c640 1 --2- 172.21.15.59:0/1224377407 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f26d00b52e0 0x7f26d00b77a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00beb0 tx=0x7f26dc00b4d0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.248+0000 7f26eab9c640 1 -- 172.21.15.59:0/1224377407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26e41087d0 msgr2=0x7f26e4199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:17.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.248+0000 7f26eab9c640 1 --2- 172.21.15.59:0/1224377407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26e41087d0 0x7f26e4199840 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f26d4006010 tx=0x7f26d40319f0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.248+0000 7f26eab9c640 1 -- 172.21.15.59:0/1224377407 shutdown_connections 2024-09-10T21:16:17.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.248+0000 7f26eab9c640 1 --2- 172.21.15.59:0/1224377407 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f26d00b52e0 0x7f26d00b77a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.248+0000 7f26eab9c640 1 --2- 172.21.15.59:0/1224377407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26e4109150 0x7f26e419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.248+0000 7f26eab9c640 1 --2- 172.21.15.59:0/1224377407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26e41087d0 0x7f26e4199840 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.248+0000 7f26eab9c640 1 --2- 172.21.15.59:0/1224377407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26e4102dc0 0x7f26e4199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:17.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.248+0000 7f26eab9c640 1 -- 172.21.15.59:0/1224377407 >> 172.21.15.59:0/1224377407 conn(0x7f26e40fe830 msgr2=0x7f26e4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:17.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.248+0000 7f26eab9c640 1 -- 172.21.15.59:0/1224377407 shutdown_connections 2024-09-10T21:16:17.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:17.248+0000 7f26eab9c640 1 -- 172.21.15.59:0/1224377407 wait complete. 2024-09-10T21:16:17.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:17 smithi192 ceph-mon[35363]: pgmap v370: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-09-10T21:16:17.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:17 smithi154 ceph-mon[35041]: pgmap v370: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-09-10T21:16:17.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:16:18.143 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:16:18.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.682+0000 7f2440bda640 1 -- 172.21.15.59:0/2089980213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f243c1087d0 msgr2=0x7f243c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:18.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.682+0000 7f2440bda640 1 --2- 172.21.15.59:0/2089980213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f243c1087d0 0x7f243c108c10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2430009900 tx=0x7f243002a410 comp rx=0 tx=0).stop 2024-09-10T21:16:18.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.683+0000 7f2440bda640 1 -- 172.21.15.59:0/2089980213 shutdown_connections 2024-09-10T21:16:18.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.683+0000 7f2440bda640 1 --2- 172.21.15.59:0/2089980213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243c109150 0x7f243c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.683+0000 7f2440bda640 1 --2- 172.21.15.59:0/2089980213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f243c1087d0 0x7f243c108c10 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.683+0000 7f2440bda640 1 --2- 172.21.15.59:0/2089980213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f243c102dc0 0x7f243c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.683+0000 7f2440bda640 1 -- 172.21.15.59:0/2089980213 >> 172.21.15.59:0/2089980213 conn(0x7f243c0fe830 msgr2=0x7f243c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:18.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.683+0000 7f2440bda640 1 -- 172.21.15.59:0/2089980213 shutdown_connections 2024-09-10T21:16:18.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.683+0000 7f2440bda640 1 -- 172.21.15.59:0/2089980213 wait complete. 2024-09-10T21:16:18.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.683+0000 7f2440bda640 1 Processor -- start 2024-09-10T21:16:18.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.683+0000 7f2440bda640 1 -- start start 2024-09-10T21:16:18.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.684+0000 7f2440bda640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f243c102dc0 0x7f243c19b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.684+0000 7f2440bda640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f243c1087d0 0x7f243c19ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.684+0000 7f2440bda640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243c109150 0x7f243c1a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.684+0000 7f2440bda640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f243c112e10 con 0x7f243c102dc0 2024-09-10T21:16:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.684+0000 7f2440bda640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f243c112c90 con 0x7f243c109150 2024-09-10T21:16:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.684+0000 7f2440bda640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f243c112f90 con 0x7f243c1087d0 2024-09-10T21:16:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.684+0000 7f243a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f243c102dc0 0x7f243c19b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.684+0000 7f243a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f243c102dc0 0x7f243c19b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37848/0 (socket says 172.21.15.59:37848) 2024-09-10T21:16:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.684+0000 7f243a59c640 1 -- 172.21.15.59:0/2009769639 learned_addr learned my addr 172.21.15.59:0/2009769639 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.684+0000 7f243ad9d640 1 --2- 172.21.15.59:0/2009769639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243c109150 0x7f243c1a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.684+0000 7f2439d9b640 1 --2- 172.21.15.59:0/2009769639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f243c1087d0 0x7f243c19ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.684+0000 7f243a59c640 1 -- 172.21.15.59:0/2009769639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f243c1087d0 msgr2=0x7f243c19ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.684+0000 7f243a59c640 1 --2- 172.21.15.59:0/2009769639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f243c1087d0 0x7f243c19ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.684+0000 7f243a59c640 1 -- 172.21.15.59:0/2009769639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243c109150 msgr2=0x7f243c1a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.684+0000 7f243a59c640 1 --2- 172.21.15.59:0/2009769639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243c109150 0x7f243c1a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.684+0000 7f243a59c640 1 -- 172.21.15.59:0/2009769639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243c1a1590 con 0x7f243c102dc0 2024-09-10T21:16:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.684+0000 7f2439d9b640 1 --2- 172.21.15.59:0/2009769639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f243c1087d0 0x7f243c19ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:16:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.684+0000 7f243a59c640 1 --2- 172.21.15.59:0/2009769639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f243c102dc0 0x7f243c19b4e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f242c00d770 tx=0x7f242c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.684+0000 7f242b7fe640 1 -- 172.21.15.59:0/2009769639 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c017070 con 0x7f243c102dc0 2024-09-10T21:16:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.685+0000 7f2440bda640 1 -- 172.21.15.59:0/2009769639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f243c1a1880 con 0x7f243c102dc0 2024-09-10T21:16:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.685+0000 7f242b7fe640 1 -- 172.21.15.59:0/2009769639 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f242c0054d0 con 0x7f243c102dc0 2024-09-10T21:16:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.685+0000 7f242b7fe640 1 -- 172.21.15.59:0/2009769639 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c004c30 con 0x7f243c102dc0 2024-09-10T21:16:18.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.685+0000 7f2440bda640 1 -- 172.21.15.59:0/2009769639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f243c1a7f40 con 0x7f243c102dc0 2024-09-10T21:16:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.687+0000 7f242b7fe640 1 -- 172.21.15.59:0/2009769639 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f242c004eb0 con 0x7f243c102dc0 2024-09-10T21:16:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.687+0000 7f2442faf740 1 Processor -- start 2024-09-10T21:16:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.688+0000 7f2442faf740 1 -- start start 2024-09-10T21:16:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.688+0000 7f2442faf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a6b0f0 0x564618a6b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.688+0000 7f2442faf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a6ba10 0x564618a77460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.688+0000 7f2442faf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a779a0 0x564618a79d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.688+0000 7f2442faf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5646189e1ea0 con 0x564618a779a0 2024-09-10T21:16:18.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.688+0000 7f2442faf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5646189d12d0 con 0x564618a6b0f0 2024-09-10T21:16:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.688+0000 7f2442faf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5646189d50e0 con 0x564618a6ba10 2024-09-10T21:16:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.688+0000 7f2439d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a779a0 0x564618a79d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.688+0000 7f2439d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a779a0 0x564618a79d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37860/0 (socket says 172.21.15.59:37860) 2024-09-10T21:16:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.688+0000 7f2439d9b640 1 -- 172.21.15.59:0/1645789181 learned_addr learned my addr 172.21.15.59:0/1645789181 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.688+0000 7f243a59c640 1 --2- 172.21.15.59:0/1645789181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a6ba10 0x564618a77460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.688+0000 7f243ad9d640 1 --2- 172.21.15.59:0/1645789181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a6b0f0 0x564618a6b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.688+0000 7f242b7fe640 1 --2- 172.21.15.59:0/2009769639 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f24240b52e0 0x7f24240b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.688+0000 7f2439d9b640 1 -- 172.21.15.59:0/1645789181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a6ba10 msgr2=0x564618a77460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.688+0000 7f2439d9b640 1 --2- 172.21.15.59:0/1645789181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a6ba10 0x564618a77460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.688+0000 7f2439d9b640 1 -- 172.21.15.59:0/1645789181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a6b0f0 msgr2=0x564618a6b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.688+0000 7f2439d9b640 1 --2- 172.21.15.59:0/1645789181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a6b0f0 0x564618a6b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.688+0000 7f243ad9d640 1 --2- 172.21.15.59:0/2009769639 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f24240b52e0 0x7f24240b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:18.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.688+0000 7f2439d9b640 1 -- 172.21.15.59:0/1645789181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56461872f650 con 0x564618a779a0 2024-09-10T21:16:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.689+0000 7f242b7fe640 1 -- 172.21.15.59:0/2009769639 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f242c0e56f0 con 0x7f243c102dc0 2024-09-10T21:16:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.689+0000 7f2439d9b640 1 --2- 172.21.15.59:0/1645789181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a779a0 0x564618a79d90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f243002a930 tx=0x7f2430032e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37b6088a41319f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.689+0000 7f2428ff9640 1 -- 172.21.15.59:0/1645789181 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243003f070 con 0x564618a779a0 2024-09-10T21:16:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.689+0000 7f243ad9d640 1 --2- 172.21.15.59:0/2009769639 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f24240b52e0 0x7f24240b77a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2434007310 tx=0x7f2434004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.689+0000 7f2428ff9640 1 -- 172.21.15.59:0/1645789181 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2430031760 con 0x564618a779a0 2024-09-10T21:16:18.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.689+0000 7f2428ff9640 1 -- 172.21.15.59:0/1645789181 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430035070 con 0x564618a779a0 2024-09-10T21:16:18.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.690+0000 7f2442faf740 1 -- 172.21.15.59:0/1645789181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a779a0 msgr2=0x564618a79d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.690+0000 7f2442faf740 1 --2- 172.21.15.59:0/1645789181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a779a0 0x564618a79d90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f243002a930 tx=0x7f2430032e70 comp rx=0 tx=0).stop 2024-09-10T21:16:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.690+0000 7f2442faf740 1 -- 172.21.15.59:0/1645789181 shutdown_connections 2024-09-10T21:16:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.690+0000 7f2442faf740 1 --2- 172.21.15.59:0/1645789181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a779a0 0x564618a79d90 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.690+0000 7f2442faf740 1 --2- 172.21.15.59:0/1645789181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a6ba10 0x564618a77460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.690+0000 7f2442faf740 1 --2- 172.21.15.59:0/1645789181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a6b0f0 0x564618a6b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.690+0000 7f2442faf740 1 -- 172.21.15.59:0/1645789181 >> 172.21.15.59:0/1645789181 conn(0x564618a68f20 msgr2=0x564618a6a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.690+0000 7f2442faf740 1 -- 172.21.15.59:0/1645789181 shutdown_connections 2024-09-10T21:16:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.690+0000 7f2442faf740 1 -- 172.21.15.59:0/1645789181 wait complete. 2024-09-10T21:16:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.690+0000 7f2442faf740 1 -- start start 2024-09-10T21:16:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.690+0000 7f2442faf740 1 Processor -- start 2024-09-10T21:16:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f2442faf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a6b0f0 0x564618a77280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f2442faf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a6ba10 0x564618a746d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:18.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f2442faf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a779a0 0x564618a74d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f2442faf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564618832700 con 0x564618a6ba10 2024-09-10T21:16:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f2442faf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56461896c160 con 0x564618a779a0 2024-09-10T21:16:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f2442faf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564618a7a5c0 con 0x564618a6b0f0 2024-09-10T21:16:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f2442faf740 10 client.0 _ll_register_callbacks cb 0x5646189859e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f2439d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a6ba10 0x564618a746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f243a59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a6b0f0 0x564618a77280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f2439d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a6ba10 0x564618a746d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37868/0 (socket says 172.21.15.59:37868) 2024-09-10T21:16:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f2439d9b640 1 -- 172.21.15.59:0/87026829 learned_addr learned my addr 172.21.15.59:0/87026829 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f243ad9d640 1 --2- 172.21.15.59:0/87026829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a779a0 0x564618a74d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f2439d9b640 1 -- 172.21.15.59:0/87026829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a6b0f0 msgr2=0x564618a77280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f2439d9b640 1 --2- 172.21.15.59:0/87026829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a6b0f0 0x564618a77280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f2439d9b640 1 -- 172.21.15.59:0/87026829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a779a0 msgr2=0x564618a74d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:18.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f2439d9b640 1 --2- 172.21.15.59:0/87026829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a779a0 0x564618a74d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f2439d9b640 1 -- 172.21.15.59:0/87026829 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564618999c90 con 0x564618a6ba10 2024-09-10T21:16:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f2439d9b640 1 --2- 172.21.15.59:0/87026829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a6ba10 0x564618a746d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2430005940 tx=0x7f2430005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ba628bf651e988 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f2421ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.691+0000 7f2421ffb640 1 -- 172.21.15.59:0/87026829 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243003f070 con 0x564618a6ba10 2024-09-10T21:16:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.692+0000 7f2421ffb640 1 -- 172.21.15.59:0/87026829 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f243003cbd0 con 0x564618a6ba10 2024-09-10T21:16:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.692+0000 7f2442faf740 1 -- 172.21.15.59:0/87026829 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2430031760 con 0x564618a6ba10 2024-09-10T21:16:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.692+0000 7f2421ffb640 1 -- 172.21.15.59:0/87026829 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2430035040 con 0x564618a6ba10 2024-09-10T21:16:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.692+0000 7f2442faf740 10 client.15618 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.692+0000 7f2442faf740 1 -- 172.21.15.59:0/87026829 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564618a85ee0 con 0x564618a6ba10 2024-09-10T21:16:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.692+0000 7f2421ffb640 1 -- 172.21.15.59:0/87026829 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2430031760 con 0x564618a6ba10 2024-09-10T21:16:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.692+0000 7f2421ffb640 1 -- 172.21.15.59:0/87026829 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f24300035f0 con 0x564618a6ba10 2024-09-10T21:16:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.692+0000 7f2442faf740 10 client.15618 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.692+0000 7f2442faf740 10 client.15618 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:16:18.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.692+0000 7f2442faf740 20 client.15618 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.692+0000 7f2442faf740 1 --2- 172.21.15.59:0/87026829 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564618a87230 0x564618a89620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.692+0000 7f2442faf740 4 client.15618 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:16:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.692+0000 7f2442faf740 1 -- 172.21.15.59:0/87026829 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646189e3df0 con 0x564618a87230 2024-09-10T21:16:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.693+0000 7f243a59c640 1 --2- 172.21.15.59:0/87026829 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564618a87230 0x564618a89620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.693+0000 7f243a59c640 1 --2- 172.21.15.59:0/87026829 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564618a87230 0x564618a89620 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bbe17aef3118e5a4 server_cookie=b803e7773095d8fd in_seq=0 out_seq=0 2024-09-10T21:16:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.693+0000 7f2421ffb640 10 client.15618 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:16:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.694+0000 7f2421ffb640 1 -- 172.21.15.59:0/87026829 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5646189e3df0 con 0x564618a87230 2024-09-10T21:16:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.694+0000 7f2421ffb640 10 client.15618 handle_command_reply: tid=0 2024-09-10T21:16:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.694+0000 7f2442faf740 1 client.15618 shutdown 2024-09-10T21:16:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.694+0000 7f2442faf740 1 -- 172.21.15.59:0/87026829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a6ba10 msgr2=0x564618a746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.694+0000 7f2442faf740 1 --2- 172.21.15.59:0/87026829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a6ba10 0x564618a746d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2430005940 tx=0x7f2430005d50 comp rx=0 tx=0).stop 2024-09-10T21:16:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.694+0000 7f2442faf740 1 -- 172.21.15.59:0/87026829 shutdown_connections 2024-09-10T21:16:18.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.694+0000 7f2442faf740 1 --2- 172.21.15.59:0/87026829 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564618a87230 0x564618a89620 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.694+0000 7f2442faf740 1 --2- 172.21.15.59:0/87026829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a779a0 0x564618a74d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.694+0000 7f2442faf740 1 --2- 172.21.15.59:0/87026829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a6ba10 0x564618a746d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.694+0000 7f2442faf740 1 --2- 172.21.15.59:0/87026829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a6b0f0 0x564618a77280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.694+0000 7f2421ffb640 0 client.15618 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:16:18.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.694+0000 7f2442faf740 1 -- 172.21.15.59:0/87026829 >> 172.21.15.59:0/87026829 conn(0x564618a68f20 msgr2=0x564618a6ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:18.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.694+0000 7f2442faf740 1 -- 172.21.15.59:0/87026829 shutdown_connections 2024-09-10T21:16:18.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.694+0000 7f2442faf740 1 -- 172.21.15.59:0/87026829 wait complete. 2024-09-10T21:16:18.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.694+0000 7f2442faf740 20 client.15618 trim_cache size 0 max 16384 2024-09-10T21:16:18.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.707+0000 7f2442faf740 1 Processor -- start 2024-09-10T21:16:18.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.707+0000 7f2442faf740 1 -- start start 2024-09-10T21:16:18.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f2442faf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a6b0f0 0x564618a837f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:18.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f2442faf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a6ba10 0x564618a78d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:18.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f2442faf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a779a0 0x564618a792d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:18.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f2442faf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f243c1b0430 con 0x564618a6ba10 2024-09-10T21:16:18.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f2442faf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f243c1b1f70 con 0x564618a6b0f0 2024-09-10T21:16:18.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f2442faf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f243c1b0b00 con 0x564618a779a0 2024-09-10T21:16:18.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f2439d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a6ba10 0x564618a78d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:18.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f2439d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a6ba10 0x564618a78d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37878/0 (socket says 172.21.15.59:37878) 2024-09-10T21:16:18.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f2439d9b640 1 -- 172.21.15.59:0/3553970383 learned_addr learned my addr 172.21.15.59:0/3553970383 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:18.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f243ad9d640 1 --2- 172.21.15.59:0/3553970383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a779a0 0x564618a792d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:18.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f243a59c640 1 --2- 172.21.15.59:0/3553970383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a6b0f0 0x564618a837f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:18.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f2439d9b640 1 -- 172.21.15.59:0/3553970383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a779a0 msgr2=0x564618a792d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:18.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f2439d9b640 1 --2- 172.21.15.59:0/3553970383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a779a0 0x564618a792d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f2439d9b640 1 -- 172.21.15.59:0/3553970383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a6b0f0 msgr2=0x564618a837f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:18.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f2439d9b640 1 --2- 172.21.15.59:0/3553970383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a6b0f0 0x564618a837f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f2439d9b640 1 -- 172.21.15.59:0/3553970383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564618a699a0 con 0x564618a6ba10 2024-09-10T21:16:18.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f243a59c640 1 --2- 172.21.15.59:0/3553970383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a6b0f0 0x564618a837f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:16:18.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f2439d9b640 1 --2- 172.21.15.59:0/3553970383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a6ba10 0x564618a78d90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f243002a930 tx=0x7f2430005490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f864523f259dc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:18.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f2423fff640 1 -- 172.21.15.59:0/3553970383 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243003f030 con 0x564618a6ba10 2024-09-10T21:16:18.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f2423fff640 1 -- 172.21.15.59:0/3553970383 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f243004b070 con 0x564618a6ba10 2024-09-10T21:16:18.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.708+0000 7f2423fff640 1 -- 172.21.15.59:0/3553970383 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430031560 con 0x564618a6ba10 2024-09-10T21:16:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.709+0000 7f2442faf740 1 -- 172.21.15.59:0/3553970383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a6ba10 msgr2=0x564618a78d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.709+0000 7f2442faf740 1 --2- 172.21.15.59:0/3553970383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a6ba10 0x564618a78d90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f243002a930 tx=0x7f2430005490 comp rx=0 tx=0).stop 2024-09-10T21:16:18.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.709+0000 7f2442faf740 1 -- 172.21.15.59:0/3553970383 shutdown_connections 2024-09-10T21:16:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.709+0000 7f2442faf740 1 --2- 172.21.15.59:0/3553970383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a779a0 0x564618a792d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.709+0000 7f2442faf740 1 --2- 172.21.15.59:0/3553970383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a6ba10 0x564618a78d90 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.709+0000 7f2442faf740 1 --2- 172.21.15.59:0/3553970383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a6b0f0 0x564618a837f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.709+0000 7f2442faf740 1 -- 172.21.15.59:0/3553970383 >> 172.21.15.59:0/3553970383 conn(0x564618a68f20 msgr2=0x564618a76520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.709+0000 7f2442faf740 1 -- 172.21.15.59:0/3553970383 shutdown_connections 2024-09-10T21:16:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.709+0000 7f2442faf740 1 -- 172.21.15.59:0/3553970383 wait complete. 2024-09-10T21:16:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.709+0000 7f2442faf740 1 -- start start 2024-09-10T21:16:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.709+0000 7f2442faf740 1 Processor -- start 2024-09-10T21:16:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f2442faf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a6b0f0 0x564618a7fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f2442faf740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a6ba10 0x564618a7d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f2442faf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a779a0 0x564618a7dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f2442faf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f243c1b18a0 con 0x564618a779a0 2024-09-10T21:16:18.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f2442faf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f243c1b11d0 con 0x564618a6b0f0 2024-09-10T21:16:18.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f2442faf740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f243c1ae410 con 0x564618a6ba10 2024-09-10T21:16:18.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f2442faf740 10 client.0 _ll_register_callbacks cb 0x7f2434007860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:18.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f243ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a779a0 0x564618a7dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:18.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f243ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a779a0 0x564618a7dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37884/0 (socket says 172.21.15.59:37884) 2024-09-10T21:16:18.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f243ad9d640 1 -- 172.21.15.59:0/2730102781 learned_addr learned my addr 172.21.15.59:0/2730102781 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:18.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f243a59c640 1 --2- 172.21.15.59:0/2730102781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a6b0f0 0x564618a7fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:18.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f2439d9b640 1 --2- 172.21.15.59:0/2730102781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a6ba10 0x564618a7d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:18.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f243ad9d640 1 -- 172.21.15.59:0/2730102781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a6ba10 msgr2=0x564618a7d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:18.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f243ad9d640 1 --2- 172.21.15.59:0/2730102781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a6ba10 0x564618a7d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f243ad9d640 1 -- 172.21.15.59:0/2730102781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a6b0f0 msgr2=0x564618a7fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:18.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f243ad9d640 1 --2- 172.21.15.59:0/2730102781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a6b0f0 0x564618a7fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f243ad9d640 1 -- 172.21.15.59:0/2730102781 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564618a7e420 con 0x564618a779a0 2024-09-10T21:16:18.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f243ad9d640 1 --2- 172.21.15.59:0/2730102781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a779a0 0x564618a7dde0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f243401e6d0 tx=0x7f2434007520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db16b2f2f2258476 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:18.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f2421ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:18.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.710+0000 7f2421ffb640 1 -- 172.21.15.59:0/2730102781 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243402d060 con 0x564618a779a0 2024-09-10T21:16:18.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.711+0000 7f2421ffb640 1 -- 172.21.15.59:0/2730102781 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f243400f610 con 0x564618a779a0 2024-09-10T21:16:18.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.711+0000 7f2442faf740 1 -- 172.21.15.59:0/2730102781 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f243004b070 con 0x564618a779a0 2024-09-10T21:16:18.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.711+0000 7f2421ffb640 1 -- 172.21.15.59:0/2730102781 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f243400f810 con 0x564618a779a0 2024-09-10T21:16:18.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.711+0000 7f2442faf740 10 client.15624 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:18.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.711+0000 7f2442faf740 1 -- 172.21.15.59:0/2730102781 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564618af4bc0 con 0x564618a779a0 2024-09-10T21:16:18.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.711+0000 7f2421ffb640 1 -- 172.21.15.59:0/2730102781 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f243004b070 con 0x564618a779a0 2024-09-10T21:16:18.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.711+0000 7f2421ffb640 1 -- 172.21.15.59:0/2730102781 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2434027070 con 0x564618a779a0 2024-09-10T21:16:18.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.711+0000 7f2442faf740 10 client.15624 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:18.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.711+0000 7f2442faf740 10 client.15624 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:16:18.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.711+0000 7f2442faf740 20 client.15624 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:18.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.711+0000 7f2442faf740 1 --2- 172.21.15.59:0/2730102781 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564618af5310 0x564618af7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:18.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.711+0000 7f2442faf740 4 client.15624 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:16:18.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.711+0000 7f2442faf740 1 -- 172.21.15.59:0/2730102781 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5646189df8a0 con 0x564618af5310 2024-09-10T21:16:18.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.711+0000 7f243a59c640 1 --2- 172.21.15.59:0/2730102781 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564618af5310 0x564618af7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:18.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.712+0000 7f243a59c640 1 --2- 172.21.15.59:0/2730102781 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564618af5310 0x564618af7730 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f7b3cbcd9b46e21e server_cookie=ef29ad57f5c3eae5 in_seq=0 out_seq=0 2024-09-10T21:16:18.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.712+0000 7f2421ffb640 10 client.15624 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:16:18.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.712+0000 7f2421ffb640 1 -- 172.21.15.59:0/2730102781 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5646189df8a0 con 0x564618af5310 2024-09-10T21:16:18.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.712+0000 7f2421ffb640 10 client.15624 handle_command_reply: tid=0 2024-09-10T21:16:18.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.712+0000 7f2442faf740 1 client.15624 shutdown 2024-09-10T21:16:18.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.712+0000 7f2442faf740 1 -- 172.21.15.59:0/2730102781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a779a0 msgr2=0x564618a7dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:18.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.712+0000 7f2442faf740 1 --2- 172.21.15.59:0/2730102781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a779a0 0x564618a7dde0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f243401e6d0 tx=0x7f2434007520 comp rx=0 tx=0).stop 2024-09-10T21:16:18.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.712+0000 7f2442faf740 1 -- 172.21.15.59:0/2730102781 shutdown_connections 2024-09-10T21:16:18.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.712+0000 7f2442faf740 1 --2- 172.21.15.59:0/2730102781 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564618af5310 0x564618af7730 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.712+0000 7f2442faf740 1 --2- 172.21.15.59:0/2730102781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564618a779a0 0x564618a7dde0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.712+0000 7f2442faf740 1 --2- 172.21.15.59:0/2730102781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564618a6ba10 0x564618a7d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.712+0000 7f2421ffb640 0 client.15624 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:16:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.712+0000 7f2442faf740 1 --2- 172.21.15.59:0/2730102781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564618a6b0f0 0x564618a7fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.712+0000 7f2442faf740 1 -- 172.21.15.59:0/2730102781 >> 172.21.15.59:0/2730102781 conn(0x564618a68f20 msgr2=0x564618a67750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.712+0000 7f2442faf740 1 -- 172.21.15.59:0/2730102781 shutdown_connections 2024-09-10T21:16:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.712+0000 7f2442faf740 1 -- 172.21.15.59:0/2730102781 wait complete. 2024-09-10T21:16:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.713+0000 7f2442faf740 20 client.15624 trim_cache size 0 max 16384 2024-09-10T21:16:18.722 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:16:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.713+0000 7f2440bda640 1 -- 172.21.15.59:0/2009769639 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f24240b52e0 msgr2=0x7f24240b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.713+0000 7f2440bda640 1 --2- 172.21.15.59:0/2009769639 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f24240b52e0 0x7f24240b77a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2434007310 tx=0x7f2434004ab0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.713+0000 7f2440bda640 1 -- 172.21.15.59:0/2009769639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f243c102dc0 msgr2=0x7f243c19b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.713+0000 7f2440bda640 1 --2- 172.21.15.59:0/2009769639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f243c102dc0 0x7f243c19b4e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f242c00d770 tx=0x7f242c00dc30 comp rx=0 tx=0).stop 2024-09-10T21:16:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.713+0000 7f2440bda640 1 -- 172.21.15.59:0/2009769639 shutdown_connections 2024-09-10T21:16:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.713+0000 7f2440bda640 1 --2- 172.21.15.59:0/2009769639 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f24240b52e0 0x7f24240b77a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.713+0000 7f2440bda640 1 --2- 172.21.15.59:0/2009769639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f243c109150 0x7f243c1a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.713+0000 7f2440bda640 1 --2- 172.21.15.59:0/2009769639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f243c1087d0 0x7f243c19ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.713+0000 7f2440bda640 1 --2- 172.21.15.59:0/2009769639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f243c102dc0 0x7f243c19b4e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.713+0000 7f2440bda640 1 -- 172.21.15.59:0/2009769639 >> 172.21.15.59:0/2009769639 conn(0x7f243c0fe830 msgr2=0x7f243c104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.713+0000 7f2440bda640 1 -- 172.21.15.59:0/2009769639 shutdown_connections 2024-09-10T21:16:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:18.713+0000 7f2440bda640 1 -- 172.21.15.59:0/2009769639 wait complete. 2024-09-10T21:16:19.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:19 smithi059 ceph-mon[30888]: pgmap v371: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-10T21:16:19.318 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:16:19.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:19 smithi192 ceph-mon[35363]: pgmap v371: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-10T21:16:19.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:19 smithi154 ceph-mon[35041]: pgmap v371: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-10T21:16:19.577 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:16:20.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.074+0000 7f467ad6b640 1 -- 172.21.15.59:0/3939022027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46741087f0 msgr2=0x7f4674108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:20.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.074+0000 7f467ad6b640 1 --2- 172.21.15.59:0/3939022027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46741087f0 0x7f4674108c30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4664009ca0 tx=0x7f466402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.074+0000 7f467ad6b640 1 -- 172.21.15.59:0/3939022027 shutdown_connections 2024-09-10T21:16:20.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.074+0000 7f467ad6b640 1 --2- 172.21.15.59:0/3939022027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4674109170 0x7f467410f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.074+0000 7f467ad6b640 1 --2- 172.21.15.59:0/3939022027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46741087f0 0x7f4674108c30 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.074+0000 7f467ad6b640 1 --2- 172.21.15.59:0/3939022027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4674102de0 0x7f46741031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.074+0000 7f467ad6b640 1 -- 172.21.15.59:0/3939022027 >> 172.21.15.59:0/3939022027 conn(0x7f46740fe830 msgr2=0x7f4674100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.074+0000 7f467ad6b640 1 -- 172.21.15.59:0/3939022027 shutdown_connections 2024-09-10T21:16:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.074+0000 7f467ad6b640 1 -- 172.21.15.59:0/3939022027 wait complete. 2024-09-10T21:16:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.074+0000 7f467ad6b640 1 Processor -- start 2024-09-10T21:16:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.074+0000 7f467ad6b640 1 -- start start 2024-09-10T21:16:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.075+0000 7f467ad6b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4674102de0 0x7f46740754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.075+0000 7f467ad6b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46741087f0 0x7f46740759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.075+0000 7f467ad6b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4674109170 0x7f4674075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.075+0000 7f467ad6b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4674112e70 con 0x7f4674109170 2024-09-10T21:16:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.075+0000 7f467ad6b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4674112cf0 con 0x7f46741087f0 2024-09-10T21:16:20.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.075+0000 7f467ad6b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4674112ff0 con 0x7f4674102de0 2024-09-10T21:16:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.075+0000 7f4679308640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4674109170 0x7f4674075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.075+0000 7f4679308640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4674109170 0x7f4674075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32856/0 (socket says 172.21.15.59:32856) 2024-09-10T21:16:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.075+0000 7f4679308640 1 -- 172.21.15.59:0/1621313051 learned_addr learned my addr 172.21.15.59:0/1621313051 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.075+0000 7f4673fff640 1 --2- 172.21.15.59:0/1621313051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46741087f0 0x7f46740759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.075+0000 7f4678b07640 1 --2- 172.21.15.59:0/1621313051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4674102de0 0x7f46740754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.075+0000 7f4679308640 1 -- 172.21.15.59:0/1621313051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4674102de0 msgr2=0x7f46740754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.075+0000 7f4679308640 1 --2- 172.21.15.59:0/1621313051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4674102de0 0x7f46740754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.075+0000 7f4679308640 1 -- 172.21.15.59:0/1621313051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46741087f0 msgr2=0x7f46740759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.075+0000 7f4679308640 1 --2- 172.21.15.59:0/1621313051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46741087f0 0x7f46740759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.075+0000 7f4679308640 1 -- 172.21.15.59:0/1621313051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46741a7860 con 0x7f4674109170 2024-09-10T21:16:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.075+0000 7f4679308640 1 --2- 172.21.15.59:0/1621313051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4674109170 0x7f4674075f20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f465c009fd0 tx=0x7f465c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.076+0000 7f4671ffb640 1 -- 172.21.15.59:0/1621313051 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c011830 con 0x7f4674109170 2024-09-10T21:16:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.076+0000 7f467ad6b640 1 -- 172.21.15.59:0/1621313051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46741a7b50 con 0x7f4674109170 2024-09-10T21:16:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.076+0000 7f4671ffb640 1 -- 172.21.15.59:0/1621313051 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f465c016070 con 0x7f4674109170 2024-09-10T21:16:20.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.076+0000 7f4671ffb640 1 -- 172.21.15.59:0/1621313051 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c010de0 con 0x7f4674109170 2024-09-10T21:16:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.076+0000 7f467ad6b640 1 -- 172.21.15.59:0/1621313051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46741a8040 con 0x7f4674109170 2024-09-10T21:16:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.078+0000 7f4671ffb640 1 -- 172.21.15.59:0/1621313051 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f465c0119d0 con 0x7f4674109170 2024-09-10T21:16:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.078+0000 7f467d140740 1 Processor -- start 2024-09-10T21:16:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.079+0000 7f467d140740 1 -- start start 2024-09-10T21:16:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.079+0000 7f467d140740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dce90f0 0x55b30dce94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.079+0000 7f467d140740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce9a10 0x55b30dcf5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.079+0000 7f467d140740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dcf59a0 0x55b30dcf7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.079+0000 7f467d140740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b30dc5fea0 con 0x55b30dce90f0 2024-09-10T21:16:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.079+0000 7f467d140740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b30dc4f2d0 con 0x55b30dcf59a0 2024-09-10T21:16:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.079+0000 7f467d140740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b30dc530e0 con 0x55b30dce9a10 2024-09-10T21:16:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.079+0000 7f4673fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dce90f0 0x55b30dce94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.079+0000 7f4673fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dce90f0 0x55b30dce94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32866/0 (socket says 172.21.15.59:32866) 2024-09-10T21:16:20.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.079+0000 7f4673fff640 1 -- 172.21.15.59:0/3509047946 learned_addr learned my addr 172.21.15.59:0/3509047946 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.079+0000 7f4678b07640 1 --2- 172.21.15.59:0/3509047946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce9a10 0x55b30dcf5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.079+0000 7f4673fff640 1 --2- 172.21.15.59:0/3509047946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dcf59a0 0x55b30dcf7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.079+0000 7f4673fff640 1 -- 172.21.15.59:0/3509047946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce9a10 msgr2=0x55b30dcf5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.079+0000 7f4673fff640 1 --2- 172.21.15.59:0/3509047946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce9a10 0x55b30dcf5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.079+0000 7f4673fff640 1 -- 172.21.15.59:0/3509047946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dcf59a0 msgr2=0x55b30dcf7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.079+0000 7f4673fff640 1 --2- 172.21.15.59:0/3509047946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dcf59a0 0x55b30dcf7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.079+0000 7f4673fff640 1 -- 172.21.15.59:0/3509047946 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b30d9ad650 con 0x55b30dce90f0 2024-09-10T21:16:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.079+0000 7f4671ffb640 1 --2- 172.21.15.59:0/1621313051 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f46600b52e0 0x7f46600b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.080+0000 7f4673fff640 1 --2- 172.21.15.59:0/3509047946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dce90f0 0x55b30dce94d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4664009ca0 tx=0x7f4664005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5941ad9b68d4239a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.080+0000 7f4678b07640 1 --2- 172.21.15.59:0/1621313051 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f46600b52e0 0x7f46600b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:20.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.080+0000 7f4671ffb640 1 -- 172.21.15.59:0/1621313051 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f465c0e51f0 con 0x7f4674109170 2024-09-10T21:16:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.080+0000 7f466affd640 1 -- 172.21.15.59:0/3509047946 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664031450 con 0x55b30dce90f0 2024-09-10T21:16:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.080+0000 7f466affd640 1 -- 172.21.15.59:0/3509047946 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4664036040 con 0x55b30dce90f0 2024-09-10T21:16:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.080+0000 7f466affd640 1 -- 172.21.15.59:0/3509047946 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664004320 con 0x55b30dce90f0 2024-09-10T21:16:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.081+0000 7f467d140740 1 -- 172.21.15.59:0/3509047946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dce90f0 msgr2=0x55b30dce94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.081+0000 7f4678b07640 1 --2- 172.21.15.59:0/1621313051 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f46600b52e0 0x7f46600b77a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55b30dce7e00 tx=0x7f466c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.081+0000 7f467d140740 1 --2- 172.21.15.59:0/3509047946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dce90f0 0x55b30dce94d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4664009ca0 tx=0x7f4664005fa0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.081+0000 7f467d140740 1 -- 172.21.15.59:0/3509047946 shutdown_connections 2024-09-10T21:16:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.081+0000 7f467d140740 1 --2- 172.21.15.59:0/3509047946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dcf59a0 0x55b30dcf7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.081+0000 7f467d140740 1 --2- 172.21.15.59:0/3509047946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce9a10 0x55b30dcf5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.081+0000 7f467d140740 1 --2- 172.21.15.59:0/3509047946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dce90f0 0x55b30dce94d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.081+0000 7f467d140740 1 -- 172.21.15.59:0/3509047946 >> 172.21.15.59:0/3509047946 conn(0x55b30dce6f20 msgr2=0x55b30dce80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.081+0000 7f467d140740 1 -- 172.21.15.59:0/3509047946 shutdown_connections 2024-09-10T21:16:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.081+0000 7f467d140740 1 -- 172.21.15.59:0/3509047946 wait complete. 2024-09-10T21:16:20.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.081+0000 7f467d140740 1 -- start start 2024-09-10T21:16:20.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.081+0000 7f467d140740 1 Processor -- start 2024-09-10T21:16:20.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f467d140740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dce90f0 0x55b30dcf5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:20.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f467d140740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce9a10 0x55b30dcf26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:20.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f467d140740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dcf59a0 0x55b30dcf2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:20.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f467d140740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b30dab0700 con 0x55b30dcf59a0 2024-09-10T21:16:20.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f467d140740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b30dbea160 con 0x55b30dce90f0 2024-09-10T21:16:20.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f467d140740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b30dcf85c0 con 0x55b30dce9a10 2024-09-10T21:16:20.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f467d140740 10 client.0 _ll_register_callbacks cb 0x55b30dc039e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:20.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f4679308640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dcf59a0 0x55b30dcf2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:20.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f4679308640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dcf59a0 0x55b30dcf2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32880/0 (socket says 172.21.15.59:32880) 2024-09-10T21:16:20.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f4679308640 1 -- 172.21.15.59:0/412599466 learned_addr learned my addr 172.21.15.59:0/412599466 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:20.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f4673fff640 1 --2- 172.21.15.59:0/412599466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce9a10 0x55b30dcf26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f4678b07640 1 --2- 172.21.15.59:0/412599466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dce90f0 0x55b30dcf5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f4679308640 1 -- 172.21.15.59:0/412599466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce9a10 msgr2=0x55b30dcf26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f4679308640 1 --2- 172.21.15.59:0/412599466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce9a10 0x55b30dcf26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f4679308640 1 -- 172.21.15.59:0/412599466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dce90f0 msgr2=0x55b30dcf5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f4679308640 1 --2- 172.21.15.59:0/412599466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dce90f0 0x55b30dcf5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f4679308640 1 -- 172.21.15.59:0/412599466 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b30dc17c90 con 0x55b30dcf59a0 2024-09-10T21:16:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f4679308640 1 --2- 172.21.15.59:0/412599466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dcf59a0 0x55b30dcf2ca0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f465c0a8bf0 tx=0x7f465c0ab490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974377fa3fe8449d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f4653fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f4653fff640 1 -- 172.21.15.59:0/412599466 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c0ab980 con 0x55b30dcf59a0 2024-09-10T21:16:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f4653fff640 1 -- 172.21.15.59:0/412599466 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f465c0aabe0 con 0x55b30dcf59a0 2024-09-10T21:16:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.082+0000 7f467d140740 1 -- 172.21.15.59:0/412599466 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4664036040 con 0x55b30dcf59a0 2024-09-10T21:16:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.083+0000 7f4653fff640 1 -- 172.21.15.59:0/412599466 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f465c0b0460 con 0x55b30dcf59a0 2024-09-10T21:16:20.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.083+0000 7f467d140740 10 client.15636 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.083+0000 7f467d140740 1 -- 172.21.15.59:0/412599466 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b30dd03f90 con 0x55b30dcf59a0 2024-09-10T21:16:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.083+0000 7f4653fff640 1 -- 172.21.15.59:0/412599466 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4664036040 con 0x55b30dcf59a0 2024-09-10T21:16:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.083+0000 7f4653fff640 1 -- 172.21.15.59:0/412599466 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f465c0d0ce0 con 0x55b30dcf59a0 2024-09-10T21:16:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.083+0000 7f467d140740 10 client.15636 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.083+0000 7f467d140740 10 client.15636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:16:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.083+0000 7f467d140740 20 client.15636 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.083+0000 7f467d140740 1 --2- 172.21.15.59:0/412599466 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b30dd053f0 0x55b30dd07820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.083+0000 7f467d140740 4 client.15636 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:16:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.083+0000 7f467d140740 1 -- 172.21.15.59:0/412599466 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b30dc61df0 con 0x55b30dd053f0 2024-09-10T21:16:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.083+0000 7f4678b07640 1 --2- 172.21.15.59:0/412599466 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b30dd053f0 0x55b30dd07820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:20.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.084+0000 7f4678b07640 1 --2- 172.21.15.59:0/412599466 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b30dd053f0 0x55b30dd07820 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e354824d751f0e39 server_cookie=f0cc9f0ed08e7079 in_seq=0 out_seq=0 2024-09-10T21:16:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.084+0000 7f4653fff640 10 client.15636 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.084+0000 7f4653fff640 1 -- 172.21.15.59:0/412599466 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b30dc61df0 con 0x55b30dd053f0 2024-09-10T21:16:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.085+0000 7f4653fff640 10 client.15636 handle_command_reply: tid=0 2024-09-10T21:16:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.085+0000 7f467d140740 1 client.15636 shutdown 2024-09-10T21:16:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.085+0000 7f467d140740 1 -- 172.21.15.59:0/412599466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dcf59a0 msgr2=0x55b30dcf2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.085+0000 7f467d140740 1 --2- 172.21.15.59:0/412599466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dcf59a0 0x55b30dcf2ca0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f465c0a8bf0 tx=0x7f465c0ab490 comp rx=0 tx=0).stop 2024-09-10T21:16:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.085+0000 7f467d140740 1 -- 172.21.15.59:0/412599466 shutdown_connections 2024-09-10T21:16:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.085+0000 7f467d140740 1 --2- 172.21.15.59:0/412599466 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b30dd053f0 0x55b30dd07820 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.085+0000 7f467d140740 1 --2- 172.21.15.59:0/412599466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dcf59a0 0x55b30dcf2ca0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.085+0000 7f467d140740 1 --2- 172.21.15.59:0/412599466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce9a10 0x55b30dcf26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.085+0000 7f4653fff640 0 client.15636 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.085+0000 7f467d140740 1 --2- 172.21.15.59:0/412599466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dce90f0 0x55b30dcf5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.085+0000 7f467d140740 1 -- 172.21.15.59:0/412599466 >> 172.21.15.59:0/412599466 conn(0x55b30dce6f20 msgr2=0x55b30dceca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:20.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.085+0000 7f467d140740 1 -- 172.21.15.59:0/412599466 shutdown_connections 2024-09-10T21:16:20.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.085+0000 7f467d140740 1 -- 172.21.15.59:0/412599466 wait complete. 2024-09-10T21:16:20.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.085+0000 7f467d140740 20 client.15636 trim_cache size 0 max 16384 2024-09-10T21:16:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.098+0000 7f467d140740 1 Processor -- start 2024-09-10T21:16:20.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.098+0000 7f467d140740 1 -- start start 2024-09-10T21:16:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f467d140740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dce90f0 0x55b30dd01850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f467d140740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce9a10 0x55b30dce7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f467d140740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dcf59a0 0x55b30dcf4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f467d140740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f46741b04a0 con 0x55b30dcf59a0 2024-09-10T21:16:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f467d140740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f46741b1fe0 con 0x55b30dce90f0 2024-09-10T21:16:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f467d140740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f46741b0b70 con 0x55b30dce9a10 2024-09-10T21:16:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f4679308640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dcf59a0 0x55b30dcf4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f4678b07640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dce90f0 0x55b30dd01850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f4673fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce9a10 0x55b30dce7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f4678b07640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dce90f0 0x55b30dd01850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:56330/0 (socket says 172.21.15.59:56330) 2024-09-10T21:16:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f4673fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce9a10 0x55b30dce7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:45752/0 (socket says 172.21.15.59:45752) 2024-09-10T21:16:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f4678b07640 1 -- 172.21.15.59:0/3482272456 learned_addr learned my addr 172.21.15.59:0/3482272456 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f4679308640 1 -- 172.21.15.59:0/3482272456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce9a10 msgr2=0x55b30dce7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f4679308640 1 --2- 172.21.15.59:0/3482272456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce9a10 0x55b30dce7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f4679308640 1 -- 172.21.15.59:0/3482272456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dce90f0 msgr2=0x55b30dd01850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f4679308640 1 --2- 172.21.15.59:0/3482272456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dce90f0 0x55b30dd01850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f4679308640 1 -- 172.21.15.59:0/3482272456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b30dcf0bc0 con 0x55b30dcf59a0 2024-09-10T21:16:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f4678b07640 1 --2- 172.21.15.59:0/3482272456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dce90f0 0x55b30dd01850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:16:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f4679308640 1 --2- 172.21.15.59:0/3482272456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dcf59a0 0x55b30dcf4400 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f465c0ab080 tx=0x7f465c010660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f6e663d9442131 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.099+0000 7f466a7fc640 1 -- 172.21.15.59:0/3482272456 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c0b01c0 con 0x55b30dcf59a0 2024-09-10T21:16:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.100+0000 7f466a7fc640 1 -- 172.21.15.59:0/3482272456 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f465c0e4040 con 0x55b30dcf59a0 2024-09-10T21:16:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.100+0000 7f466a7fc640 1 -- 172.21.15.59:0/3482272456 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c0aae40 con 0x55b30dcf59a0 2024-09-10T21:16:20.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.100+0000 7f467d140740 1 -- 172.21.15.59:0/3482272456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dcf59a0 msgr2=0x55b30dcf4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.100+0000 7f467d140740 1 --2- 172.21.15.59:0/3482272456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dcf59a0 0x55b30dcf4400 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f465c0ab080 tx=0x7f465c010660 comp rx=0 tx=0).stop 2024-09-10T21:16:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.100+0000 7f467d140740 1 -- 172.21.15.59:0/3482272456 shutdown_connections 2024-09-10T21:16:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.100+0000 7f467d140740 1 --2- 172.21.15.59:0/3482272456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dcf59a0 0x55b30dcf4400 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.100+0000 7f467d140740 1 --2- 172.21.15.59:0/3482272456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce9a10 0x55b30dce7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.100+0000 7f467d140740 1 --2- 172.21.15.59:0/3482272456 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dce90f0 0x55b30dd01850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.100+0000 7f467d140740 1 -- 172.21.15.59:0/3482272456 >> 172.21.15.59:0/3482272456 conn(0x55b30dce6f20 msgr2=0x55b30dcf3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.100+0000 7f467d140740 1 -- 172.21.15.59:0/3482272456 shutdown_connections 2024-09-10T21:16:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.100+0000 7f467d140740 1 -- 172.21.15.59:0/3482272456 wait complete. 2024-09-10T21:16:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.101+0000 7f467d140740 1 -- start start 2024-09-10T21:16:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.101+0000 7f467d140740 1 Processor -- start 2024-09-10T21:16:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.101+0000 7f467d140740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce90f0 0x55b30dcfa340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.101+0000 7f467d140740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dce9a10 0x55b30dcfa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.101+0000 7f467d140740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dcf59a0 0x55b30dd6b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.101+0000 7f467d140740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f46741b1910 con 0x55b30dce9a10 2024-09-10T21:16:20.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.101+0000 7f467d140740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f46741b1240 con 0x55b30dcf59a0 2024-09-10T21:16:20.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.101+0000 7f467d140740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f46741ae480 con 0x55b30dce90f0 2024-09-10T21:16:20.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.101+0000 7f467d140740 10 client.0 _ll_register_callbacks cb 0x7f465c010700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:20.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.101+0000 7f4673fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dce9a10 0x55b30dcfa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:20.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.101+0000 7f4673fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dce9a10 0x55b30dcfa8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32896/0 (socket says 172.21.15.59:32896) 2024-09-10T21:16:20.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.101+0000 7f4673fff640 1 -- 172.21.15.59:0/3953234518 learned_addr learned my addr 172.21.15.59:0/3953234518 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:20.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.101+0000 7f4678b07640 1 --2- 172.21.15.59:0/3953234518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce90f0 0x55b30dcfa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:20.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.101+0000 7f4679308640 1 --2- 172.21.15.59:0/3953234518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dcf59a0 0x55b30dd6b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:20.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.101+0000 7f4673fff640 1 -- 172.21.15.59:0/3953234518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce90f0 msgr2=0x55b30dcfa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:20.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.102+0000 7f4673fff640 1 --2- 172.21.15.59:0/3953234518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce90f0 0x55b30dcfa340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.102+0000 7f4673fff640 1 -- 172.21.15.59:0/3953234518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dcf59a0 msgr2=0x55b30dd6b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:20.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.102+0000 7f4673fff640 1 --2- 172.21.15.59:0/3953234518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dcf59a0 0x55b30dd6b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.102+0000 7f4673fff640 1 -- 172.21.15.59:0/3953234518 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b30dd6bab0 con 0x55b30dce9a10 2024-09-10T21:16:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.102+0000 7f4673fff640 1 --2- 172.21.15.59:0/3953234518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dce9a10 0x55b30dcfa8c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4664009ca0 tx=0x7f4664031680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9260e7bde6d6522 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.102+0000 7f4653fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.102+0000 7f4653fff640 1 -- 172.21.15.59:0/3953234518 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f466402f660 con 0x55b30dce9a10 2024-09-10T21:16:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.102+0000 7f4653fff640 1 -- 172.21.15.59:0/3953234518 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f466402f800 con 0x55b30dce9a10 2024-09-10T21:16:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.102+0000 7f467d140740 1 -- 172.21.15.59:0/3953234518 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f465c0e4040 con 0x55b30dce9a10 2024-09-10T21:16:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.102+0000 7f4653fff640 1 -- 172.21.15.59:0/3953234518 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4664004b40 con 0x55b30dce9a10 2024-09-10T21:16:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.102+0000 7f467d140740 10 client.15642 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.102+0000 7f467d140740 1 -- 172.21.15.59:0/3953234518 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b30dd72f40 con 0x55b30dce9a10 2024-09-10T21:16:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.102+0000 7f4653fff640 1 -- 172.21.15.59:0/3953234518 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f465c0e4040 con 0x55b30dce9a10 2024-09-10T21:16:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.102+0000 7f4653fff640 1 -- 172.21.15.59:0/3953234518 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4664030860 con 0x55b30dce9a10 2024-09-10T21:16:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.102+0000 7f467d140740 10 client.15642 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.103+0000 7f467d140740 10 client.15642 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:16:20.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.103+0000 7f467d140740 20 client.15642 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:20.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.103+0000 7f467d140740 1 --2- 172.21.15.59:0/3953234518 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b30dd732a0 0x55b30dd75690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:20.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.103+0000 7f467d140740 4 client.15642 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:16:20.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.103+0000 7f467d140740 1 -- 172.21.15.59:0/3953234518 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b30dc5d8a0 con 0x55b30dd732a0 2024-09-10T21:16:20.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.103+0000 7f4678b07640 1 --2- 172.21.15.59:0/3953234518 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b30dd732a0 0x55b30dd75690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:20.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.103+0000 7f4678b07640 1 --2- 172.21.15.59:0/3953234518 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b30dd732a0 0x55b30dd75690 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64b927dcdced0acc server_cookie=f5ef1f60743141cc in_seq=0 out_seq=0 2024-09-10T21:16:20.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.103+0000 7f4653fff640 10 client.15642 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:20.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.103+0000 7f4653fff640 1 -- 172.21.15.59:0/3953234518 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b30dc5d8a0 con 0x55b30dd732a0 2024-09-10T21:16:20.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.103+0000 7f4653fff640 10 client.15642 handle_command_reply: tid=0 2024-09-10T21:16:20.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.103+0000 7f467d140740 1 client.15642 shutdown 2024-09-10T21:16:20.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.103+0000 7f467d140740 1 -- 172.21.15.59:0/3953234518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dce9a10 msgr2=0x55b30dcfa8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:20.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.103+0000 7f467d140740 1 --2- 172.21.15.59:0/3953234518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dce9a10 0x55b30dcfa8c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4664009ca0 tx=0x7f4664031680 comp rx=0 tx=0).stop 2024-09-10T21:16:20.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.104+0000 7f467d140740 1 -- 172.21.15.59:0/3953234518 shutdown_connections 2024-09-10T21:16:20.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.104+0000 7f467d140740 1 --2- 172.21.15.59:0/3953234518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b30dcf59a0 0x55b30dd6b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.104+0000 7f467d140740 1 --2- 172.21.15.59:0/3953234518 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b30dd732a0 0x55b30dd75690 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.104+0000 7f467d140740 1 --2- 172.21.15.59:0/3953234518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b30dce9a10 0x55b30dcfa8c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.104+0000 7f467d140740 1 --2- 172.21.15.59:0/3953234518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b30dce90f0 0x55b30dcfa340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.104+0000 7f467d140740 1 -- 172.21.15.59:0/3953234518 >> 172.21.15.59:0/3953234518 conn(0x55b30dce6f20 msgr2=0x55b30dcf4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:20.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.104+0000 7f4653fff640 0 client.15642 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:20.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.104+0000 7f467d140740 1 -- 172.21.15.59:0/3953234518 shutdown_connections 2024-09-10T21:16:20.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.104+0000 7f467d140740 1 -- 172.21.15.59:0/3953234518 wait complete. 2024-09-10T21:16:20.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.104+0000 7f467d140740 20 client.15642 trim_cache size 0 max 16384 2024-09-10T21:16:20.115 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:16:20.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.104+0000 7f467ad6b640 1 -- 172.21.15.59:0/1621313051 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f46600b52e0 msgr2=0x7f46600b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.104+0000 7f467ad6b640 1 --2- 172.21.15.59:0/1621313051 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f46600b52e0 0x7f46600b77a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55b30dce7e00 tx=0x7f466c008040 comp rx=0 tx=0).stop 2024-09-10T21:16:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.104+0000 7f467ad6b640 1 -- 172.21.15.59:0/1621313051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4674109170 msgr2=0x7f4674075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.104+0000 7f467ad6b640 1 --2- 172.21.15.59:0/1621313051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4674109170 0x7f4674075f20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f465c009fd0 tx=0x7f465c00b8e0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.104+0000 7f467ad6b640 1 -- 172.21.15.59:0/1621313051 shutdown_connections 2024-09-10T21:16:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.105+0000 7f467ad6b640 1 --2- 172.21.15.59:0/1621313051 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f46600b52e0 0x7f46600b77a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.105+0000 7f467ad6b640 1 --2- 172.21.15.59:0/1621313051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4674109170 0x7f4674075f20 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.105+0000 7f467ad6b640 1 --2- 172.21.15.59:0/1621313051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46741087f0 0x7f46740759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.105+0000 7f467ad6b640 1 --2- 172.21.15.59:0/1621313051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4674102de0 0x7f46740754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.105+0000 7f467ad6b640 1 -- 172.21.15.59:0/1621313051 >> 172.21.15.59:0/1621313051 conn(0x7f46740fe830 msgr2=0x7f4674100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.105+0000 7f467ad6b640 1 -- 172.21.15.59:0/1621313051 shutdown_connections 2024-09-10T21:16:20.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:20.105+0000 7f467ad6b640 1 -- 172.21.15.59:0/1621313051 wait complete. 2024-09-10T21:16:21.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:21 smithi192 ceph-mon[35363]: pgmap v372: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T21:16:21.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:21 smithi059 ceph-mon[30888]: pgmap v372: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T21:16:21.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:21 smithi154 ceph-mon[35041]: pgmap v372: 97 pgs: 97 active+clean; 659 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T21:16:21.871 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:16:21.871 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:16:22.145 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:16:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.652+0000 7f53b7e35640 1 -- 172.21.15.59:0/2231809429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53b0109170 msgr2=0x7f53b010f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.652+0000 7f53b7e35640 1 --2- 172.21.15.59:0/2231809429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53b0109170 0x7f53b010f970 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009ca0 tx=0x7f53a802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.652+0000 7f53b7e35640 1 -- 172.21.15.59:0/2231809429 shutdown_connections 2024-09-10T21:16:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.652+0000 7f53b7e35640 1 --2- 172.21.15.59:0/2231809429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53b0109170 0x7f53b010f970 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.652+0000 7f53b7e35640 1 --2- 172.21.15.59:0/2231809429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b01087f0 0x7f53b0108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.652+0000 7f53b7e35640 1 --2- 172.21.15.59:0/2231809429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53b0102de0 0x7f53b01031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.652+0000 7f53b7e35640 1 -- 172.21.15.59:0/2231809429 >> 172.21.15.59:0/2231809429 conn(0x7f53b00fe870 msgr2=0x7f53b0100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:22.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.652+0000 7f53b7e35640 1 -- 172.21.15.59:0/2231809429 shutdown_connections 2024-09-10T21:16:22.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.652+0000 7f53b7e35640 1 -- 172.21.15.59:0/2231809429 wait complete. 2024-09-10T21:16:22.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.652+0000 7f53b7e35640 1 Processor -- start 2024-09-10T21:16:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.653+0000 7f53b7e35640 1 -- start start 2024-09-10T21:16:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.653+0000 7f53b7e35640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53b0102de0 0x7f53b0199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.653+0000 7f53b7e35640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b01087f0 0x7f53b01997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.653+0000 7f53b7e35640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53b0109170 0x7f53b019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.653+0000 7f53b7e35640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53b0112e40 con 0x7f53b0102de0 2024-09-10T21:16:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.653+0000 7f53b7e35640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53b0112cc0 con 0x7f53b01087f0 2024-09-10T21:16:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.653+0000 7f53b7e35640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f53b0112fc0 con 0x7f53b0109170 2024-09-10T21:16:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.653+0000 7f53b5bd1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53b0102de0 0x7f53b0199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.653+0000 7f53b63d2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53b0109170 0x7f53b019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.653+0000 7f53b63d2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53b0109170 0x7f53b019eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:45766/0 (socket says 172.21.15.59:45766) 2024-09-10T21:16:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.653+0000 7f53b63d2640 1 -- 172.21.15.59:0/2408198712 learned_addr learned my addr 172.21.15.59:0/2408198712 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.653+0000 7f53b53d0640 1 --2- 172.21.15.59:0/2408198712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b01087f0 0x7f53b01997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:22.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.653+0000 7f53b5bd1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53b0102de0 0x7f53b0199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32912/0 (socket says 172.21.15.59:32912) 2024-09-10T21:16:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.654+0000 7f53b5bd1640 1 -- 172.21.15.59:0/2408198712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53b0109170 msgr2=0x7f53b019eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.654+0000 7f53b5bd1640 1 --2- 172.21.15.59:0/2408198712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53b0109170 0x7f53b019eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.654+0000 7f53b5bd1640 1 -- 172.21.15.59:0/2408198712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b01087f0 msgr2=0x7f53b01997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.654+0000 7f53b5bd1640 1 --2- 172.21.15.59:0/2408198712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b01087f0 0x7f53b01997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.654+0000 7f53b5bd1640 1 -- 172.21.15.59:0/2408198712 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b019f320 con 0x7f53b0102de0 2024-09-10T21:16:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.654+0000 7f53b63d2640 1 --2- 172.21.15.59:0/2408198712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53b0109170 0x7f53b019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:16:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.654+0000 7f53b5bd1640 1 --2- 172.21.15.59:0/2408198712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53b0102de0 0x7f53b0199270 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f53ac005fd0 tx=0x7f53ac00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.654+0000 7f53a6ffd640 1 -- 172.21.15.59:0/2408198712 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac009c30 con 0x7f53b0102de0 2024-09-10T21:16:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.654+0000 7f53a6ffd640 1 -- 172.21.15.59:0/2408198712 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53ac009dd0 con 0x7f53b0102de0 2024-09-10T21:16:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.654+0000 7f53a6ffd640 1 -- 172.21.15.59:0/2408198712 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac003e20 con 0x7f53b0102de0 2024-09-10T21:16:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.654+0000 7f53b7e35640 1 -- 172.21.15.59:0/2408198712 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b019f610 con 0x7f53b0102de0 2024-09-10T21:16:22.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.654+0000 7f53b7e35640 1 -- 172.21.15.59:0/2408198712 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b0075550 con 0x7f53b0102de0 2024-09-10T21:16:22.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.657+0000 7f53ba20a740 1 Processor -- start 2024-09-10T21:16:22.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.657+0000 7f53ba20a740 1 -- start start 2024-09-10T21:16:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.658+0000 7f53ba20a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524efefee0 0x56524eff02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:22.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.658+0000 7f53ba20a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524eff0800 0x56524effc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:22.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.658+0000 7f53ba20a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524effc790 0x56524effeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:22.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.658+0000 7f53ba20a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56524ef66e60 con 0x56524efefee0 2024-09-10T21:16:22.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.658+0000 7f53ba20a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56524ef56290 con 0x56524eff0800 2024-09-10T21:16:22.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.658+0000 7f53ba20a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56524ef5a0a0 con 0x56524effc790 2024-09-10T21:16:22.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.658+0000 7f53a6ffd640 1 -- 172.21.15.59:0/2408198712 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f53ac003fe0 con 0x7f53b0102de0 2024-09-10T21:16:22.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.658+0000 7f53b53d0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524effc790 0x56524effeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:22.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.658+0000 7f53b53d0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524effc790 0x56524effeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:45780/0 (socket says 172.21.15.59:45780) 2024-09-10T21:16:22.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.658+0000 7f53b53d0640 1 -- 172.21.15.59:0/521449695 learned_addr learned my addr 172.21.15.59:0/521449695 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:22.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.658+0000 7f53b63d2640 1 --2- 172.21.15.59:0/521449695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524efefee0 0x56524eff02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:22.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.658+0000 7f53b5bd1640 1 --2- 172.21.15.59:0/521449695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524eff0800 0x56524effc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:22.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.658+0000 7f53b53d0640 1 -- 172.21.15.59:0/521449695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524eff0800 msgr2=0x56524effc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:22.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.658+0000 7f53b53d0640 1 --2- 172.21.15.59:0/521449695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524eff0800 0x56524effc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.658+0000 7f53b53d0640 1 -- 172.21.15.59:0/521449695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524efefee0 msgr2=0x56524eff02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:22.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.658+0000 7f53b53d0640 1 --2- 172.21.15.59:0/521449695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524efefee0 0x56524eff02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.658+0000 7f53b53d0640 1 -- 172.21.15.59:0/521449695 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56524ecb4930 con 0x56524effc790 2024-09-10T21:16:22.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.659+0000 7f53b53d0640 1 --2- 172.21.15.59:0/521449695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524effc790 0x56524effeb80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f53a000bc60 tx=0x7f53a00107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64b43ad25634263e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:22.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.659+0000 7f53a6ffd640 1 --2- 172.21.15.59:0/2408198712 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f539c0b5360 0x7f539c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:22.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.659+0000 7f539bfff640 1 -- 172.21.15.59:0/521449695 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a001c480 con 0x56524effc790 2024-09-10T21:16:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.659+0000 7f53b63d2640 1 --2- 172.21.15.59:0/2408198712 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f539c0b5360 0x7f539c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.659+0000 7f539bfff640 1 -- 172.21.15.59:0/521449695 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53a001cad0 con 0x56524effc790 2024-09-10T21:16:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.659+0000 7f53a6ffd640 1 -- 172.21.15.59:0/2408198712 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f53ac0e5690 con 0x7f53b0102de0 2024-09-10T21:16:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.660+0000 7f539bfff640 1 -- 172.21.15.59:0/521449695 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0011a70 con 0x56524effc790 2024-09-10T21:16:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.660+0000 7f53ba20a740 1 -- 172.21.15.59:0/521449695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524effc790 msgr2=0x56524effeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.660+0000 7f53b63d2640 1 --2- 172.21.15.59:0/2408198712 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f539c0b5360 0x7f539c0b7820 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f53a8004af0 tx=0x7f53a8005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.660+0000 7f53ba20a740 1 --2- 172.21.15.59:0/521449695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524effc790 0x56524effeb80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f53a000bc60 tx=0x7f53a00107a0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.660+0000 7f53ba20a740 1 -- 172.21.15.59:0/521449695 shutdown_connections 2024-09-10T21:16:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.660+0000 7f53ba20a740 1 --2- 172.21.15.59:0/521449695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524effc790 0x56524effeb80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.660+0000 7f53ba20a740 1 --2- 172.21.15.59:0/521449695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524eff0800 0x56524effc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.660+0000 7f53ba20a740 1 --2- 172.21.15.59:0/521449695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524efefee0 0x56524eff02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.660+0000 7f53ba20a740 1 -- 172.21.15.59:0/521449695 >> 172.21.15.59:0/521449695 conn(0x56524efedd10 msgr2=0x56524efeeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:22.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.660+0000 7f53ba20a740 1 -- 172.21.15.59:0/521449695 shutdown_connections 2024-09-10T21:16:22.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.661+0000 7f53ba20a740 1 -- 172.21.15.59:0/521449695 wait complete. 2024-09-10T21:16:22.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.661+0000 7f53ba20a740 1 -- start start 2024-09-10T21:16:22.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.661+0000 7f53ba20a740 1 Processor -- start 2024-09-10T21:16:22.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.661+0000 7f53ba20a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524efefee0 0x56524eff9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:22.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.661+0000 7f53ba20a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 0x56524eff9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:22.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.661+0000 7f53ba20a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524effc790 0x56524effa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:22.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.661+0000 7f53ba20a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56524edb7890 con 0x56524eff0800 2024-09-10T21:16:22.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.661+0000 7f53ba20a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56524eef0d40 con 0x56524efefee0 2024-09-10T21:16:22.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.661+0000 7f53ba20a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56524efff490 con 0x56524effc790 2024-09-10T21:16:22.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.661+0000 7f53ba20a740 10 client.0 _ll_register_callbacks cb 0x56524ef54c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:22.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.662+0000 7f53b53d0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 0x56524eff9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:22.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.662+0000 7f53b53d0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 0x56524eff9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32930/0 (socket says 172.21.15.59:32930) 2024-09-10T21:16:22.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.662+0000 7f53b5bd1640 1 --2- 172.21.15.59:0/569823787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524efefee0 0x56524eff9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:22.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.662+0000 7f53b53d0640 1 -- 172.21.15.59:0/569823787 learned_addr learned my addr 172.21.15.59:0/569823787 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:22.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.662+0000 7f53b63d2640 1 --2- 172.21.15.59:0/569823787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524effc790 0x56524effa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:22.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.662+0000 7f53b53d0640 1 -- 172.21.15.59:0/569823787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524effc790 msgr2=0x56524effa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:22.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.662+0000 7f53b53d0640 1 --2- 172.21.15.59:0/569823787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524effc790 0x56524effa180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.662+0000 7f53b53d0640 1 -- 172.21.15.59:0/569823787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524efefee0 msgr2=0x56524eff9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:22.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.662+0000 7f53b53d0640 1 --2- 172.21.15.59:0/569823787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524efefee0 0x56524eff9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.662+0000 7f53b53d0640 1 -- 172.21.15.59:0/569823787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56524f008840 con 0x56524eff0800 2024-09-10T21:16:22.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.662+0000 7f53b53d0640 1 --2- 172.21.15.59:0/569823787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 0x56524eff9c40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f53a000b5f0 tx=0x7f53a00116f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9beebc70bd72b728 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:22.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.662+0000 7f53997fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:22.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.663+0000 7f53997fa640 1 -- 172.21.15.59:0/569823787 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a001c680 con 0x56524eff0800 2024-09-10T21:16:22.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.663+0000 7f53997fa640 1 -- 172.21.15.59:0/569823787 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f53a001c820 con 0x56524eff0800 2024-09-10T21:16:22.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.663+0000 7f53ba20a740 1 -- 172.21.15.59:0/569823787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53a001cad0 con 0x56524eff0800 2024-09-10T21:16:22.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.663+0000 7f53997fa640 1 -- 172.21.15.59:0/569823787 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53a002e070 con 0x56524eff0800 2024-09-10T21:16:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.663+0000 7f53ba20a740 10 client.15654 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.663+0000 7f53ba20a740 1 -- 172.21.15.59:0/569823787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56524f00b1f0 con 0x56524eff0800 2024-09-10T21:16:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.663+0000 7f53997fa640 1 -- 172.21.15.59:0/569823787 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53a001cad0 con 0x56524eff0800 2024-09-10T21:16:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.663+0000 7f53997fa640 1 -- 172.21.15.59:0/569823787 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f53a0011c80 con 0x56524eff0800 2024-09-10T21:16:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.663+0000 7f53ba20a740 10 client.15654 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.663+0000 7f53ba20a740 10 client.15654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:16:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.663+0000 7f53ba20a740 20 client.15654 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.663+0000 7f53ba20a740 1 --2- 172.21.15.59:0/569823787 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56524f00c5a0 0x56524f00e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.663+0000 7f53ba20a740 4 client.15654 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:16:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.663+0000 7f53ba20a740 1 -- 172.21.15.59:0/569823787 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56524ef68db0 con 0x56524f00c5a0 2024-09-10T21:16:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.664+0000 7f53b5bd1640 1 --2- 172.21.15.59:0/569823787 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56524f00c5a0 0x56524f00e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.664+0000 7f53b5bd1640 1 --2- 172.21.15.59:0/569823787 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56524f00c5a0 0x56524f00e990 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdc1bf5e7ef2833e server_cookie=cc8864f66b1ab50b in_seq=0 out_seq=0 2024-09-10T21:16:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.664+0000 7f53997fa640 10 client.15654 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:22.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.665+0000 7f53997fa640 1 -- 172.21.15.59:0/569823787 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56524ef68db0 con 0x56524f00c5a0 2024-09-10T21:16:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.665+0000 7f53997fa640 10 client.15654 handle_command_reply: tid=0 2024-09-10T21:16:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.665+0000 7f53ba20a740 1 client.15654 shutdown 2024-09-10T21:16:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.665+0000 7f53ba20a740 1 -- 172.21.15.59:0/569823787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 msgr2=0x56524eff9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.665+0000 7f53ba20a740 1 --2- 172.21.15.59:0/569823787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 0x56524eff9c40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f53a000b5f0 tx=0x7f53a00116f0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.665+0000 7f53ba20a740 1 -- 172.21.15.59:0/569823787 shutdown_connections 2024-09-10T21:16:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.665+0000 7f53ba20a740 1 --2- 172.21.15.59:0/569823787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524effc790 0x56524effa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.665+0000 7f53ba20a740 1 --2- 172.21.15.59:0/569823787 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56524f00c5a0 0x56524f00e990 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.665+0000 7f53ba20a740 1 --2- 172.21.15.59:0/569823787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 0x56524eff9c40 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.665+0000 7f53ba20a740 1 --2- 172.21.15.59:0/569823787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524efefee0 0x56524eff9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.665+0000 7f53997fa640 0 client.15654 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.665+0000 7f53ba20a740 1 -- 172.21.15.59:0/569823787 >> 172.21.15.59:0/569823787 conn(0x56524efedd10 msgr2=0x56524efecf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.666+0000 7f53ba20a740 1 -- 172.21.15.59:0/569823787 shutdown_connections 2024-09-10T21:16:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.666+0000 7f53ba20a740 1 -- 172.21.15.59:0/569823787 wait complete. 2024-09-10T21:16:22.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.666+0000 7f53ba20a740 20 client.15654 trim_cache size 0 max 16384 2024-09-10T21:16:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.683+0000 7f53ba20a740 1 Processor -- start 2024-09-10T21:16:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.683+0000 7f53ba20a740 1 -- start start 2024-09-10T21:16:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.683+0000 7f53ba20a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524efefee0 0x56524effb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.683+0000 7f53ba20a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 0x56524f013f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.683+0000 7f53ba20a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524effc790 0x56524f0144a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.683+0000 7f53ba20a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53b01b05e0 con 0x56524eff0800 2024-09-10T21:16:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.683+0000 7f53ba20a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53b01b2120 con 0x56524effc790 2024-09-10T21:16:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.683+0000 7f53ba20a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f53b01b0cb0 con 0x56524efefee0 2024-09-10T21:16:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.684+0000 7f53b53d0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 0x56524f013f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.684+0000 7f53b53d0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 0x56524f013f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32934/0 (socket says 172.21.15.59:32934) 2024-09-10T21:16:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.684+0000 7f53b53d0640 1 -- 172.21.15.59:0/1319576664 learned_addr learned my addr 172.21.15.59:0/1319576664 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.684+0000 7f53b63d2640 1 --2- 172.21.15.59:0/1319576664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524effc790 0x56524f0144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.684+0000 7f53b5bd1640 1 --2- 172.21.15.59:0/1319576664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524efefee0 0x56524effb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.684+0000 7f53b53d0640 1 -- 172.21.15.59:0/1319576664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524efefee0 msgr2=0x56524effb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.684+0000 7f53b53d0640 1 --2- 172.21.15.59:0/1319576664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524efefee0 0x56524effb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.684+0000 7f53b53d0640 1 -- 172.21.15.59:0/1319576664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524effc790 msgr2=0x56524f0144a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.684+0000 7f53b53d0640 1 --2- 172.21.15.59:0/1319576664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524effc790 0x56524f0144a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.684+0000 7f53b53d0640 1 -- 172.21.15.59:0/1319576664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56524efee790 con 0x56524eff0800 2024-09-10T21:16:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.684+0000 7f53b5bd1640 1 --2- 172.21.15.59:0/1319576664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524efefee0 0x56524effb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:16:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.684+0000 7f53b53d0640 1 --2- 172.21.15.59:0/1319576664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 0x56524f013f60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f53a0011010 tx=0x7f53a001cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9de02edb5b0232d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:22.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.684+0000 7f539b7fe640 1 -- 172.21.15.59:0/1319576664 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0038070 con 0x56524eff0800 2024-09-10T21:16:22.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.684+0000 7f539b7fe640 1 -- 172.21.15.59:0/1319576664 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53a00044e0 con 0x56524eff0800 2024-09-10T21:16:22.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.684+0000 7f539b7fe640 1 -- 172.21.15.59:0/1319576664 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0011760 con 0x56524eff0800 2024-09-10T21:16:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.685+0000 7f53ba20a740 1 -- 172.21.15.59:0/1319576664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 msgr2=0x56524f013f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.685+0000 7f53ba20a740 1 --2- 172.21.15.59:0/1319576664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 0x56524f013f60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f53a0011010 tx=0x7f53a001cf10 comp rx=0 tx=0).stop 2024-09-10T21:16:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.685+0000 7f53ba20a740 1 -- 172.21.15.59:0/1319576664 shutdown_connections 2024-09-10T21:16:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.685+0000 7f53ba20a740 1 --2- 172.21.15.59:0/1319576664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524effc790 0x56524f0144a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.685+0000 7f53ba20a740 1 --2- 172.21.15.59:0/1319576664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 0x56524f013f60 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.685+0000 7f53ba20a740 1 --2- 172.21.15.59:0/1319576664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524efefee0 0x56524effb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.685+0000 7f53ba20a740 1 -- 172.21.15.59:0/1319576664 >> 172.21.15.59:0/1319576664 conn(0x56524efedd10 msgr2=0x56524effad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.685+0000 7f53ba20a740 1 -- 172.21.15.59:0/1319576664 shutdown_connections 2024-09-10T21:16:22.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.685+0000 7f53ba20a740 1 -- 172.21.15.59:0/1319576664 wait complete. 2024-09-10T21:16:22.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.685+0000 7f53ba20a740 1 -- start start 2024-09-10T21:16:22.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.686+0000 7f53ba20a740 1 Processor -- start 2024-09-10T21:16:22.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.686+0000 7f53ba20a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524efefee0 0x56524f005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:22.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.686+0000 7f53ba20a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 0x56524efff710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:22.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.686+0000 7f53ba20a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524effc790 0x56524efffea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:22.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.686+0000 7f53ba20a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53b01b1a50 con 0x56524eff0800 2024-09-10T21:16:22.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.686+0000 7f53ba20a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53b01b1380 con 0x56524effc790 2024-09-10T21:16:22.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.686+0000 7f53ba20a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f53b01ae5c0 con 0x56524efefee0 2024-09-10T21:16:22.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.686+0000 7f53ba20a740 10 client.0 _ll_register_callbacks cb 0x7f53a000ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:22.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.686+0000 7f53b53d0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 0x56524efff710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:22.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.686+0000 7f53b53d0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 0x56524efff710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32950/0 (socket says 172.21.15.59:32950) 2024-09-10T21:16:22.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.686+0000 7f53b53d0640 1 -- 172.21.15.59:0/1207571301 learned_addr learned my addr 172.21.15.59:0/1207571301 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:22.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.686+0000 7f53b63d2640 1 --2- 172.21.15.59:0/1207571301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524effc790 0x56524efffea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:22.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.686+0000 7f53b5bd1640 1 --2- 172.21.15.59:0/1207571301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524efefee0 0x56524f005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:22.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.686+0000 7f53b53d0640 1 -- 172.21.15.59:0/1207571301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524efefee0 msgr2=0x56524f005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:22.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.686+0000 7f53b53d0640 1 --2- 172.21.15.59:0/1207571301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524efefee0 0x56524f005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.686+0000 7f53b53d0640 1 -- 172.21.15.59:0/1207571301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524effc790 msgr2=0x56524efffea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:22.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.686+0000 7f53b53d0640 1 --2- 172.21.15.59:0/1207571301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524effc790 0x56524efffea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.686+0000 7f53b53d0640 1 -- 172.21.15.59:0/1207571301 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56524f079160 con 0x56524eff0800 2024-09-10T21:16:22.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.687+0000 7f53b53d0640 1 --2- 172.21.15.59:0/1207571301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 0x56524efff710 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f53a0004690 tx=0x7f53a001cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c841b8798474eb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:22.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.687+0000 7f53997fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:22.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.687+0000 7f53997fa640 1 -- 172.21.15.59:0/1207571301 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0038030 con 0x56524eff0800 2024-09-10T21:16:22.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.687+0000 7f53997fa640 1 -- 172.21.15.59:0/1207571301 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f53a0004240 con 0x56524eff0800 2024-09-10T21:16:22.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.687+0000 7f53ba20a740 1 -- 172.21.15.59:0/1207571301 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53a00044e0 con 0x56524eff0800 2024-09-10T21:16:22.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.687+0000 7f53997fa640 1 -- 172.21.15.59:0/1207571301 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53a001c480 con 0x56524eff0800 2024-09-10T21:16:22.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.687+0000 7f53ba20a740 10 client.15660 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:22.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.687+0000 7f53ba20a740 1 -- 172.21.15.59:0/1207571301 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56524f07a420 con 0x56524eff0800 2024-09-10T21:16:22.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.687+0000 7f53997fa640 1 -- 172.21.15.59:0/1207571301 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53a00044e0 con 0x56524eff0800 2024-09-10T21:16:22.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.687+0000 7f53997fa640 1 -- 172.21.15.59:0/1207571301 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f53a00115e0 con 0x56524eff0800 2024-09-10T21:16:22.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.687+0000 7f53ba20a740 10 client.15660 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:22.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.688+0000 7f53ba20a740 10 client.15660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:16:22.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.688+0000 7f53ba20a740 20 client.15660 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:22.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.688+0000 7f53ba20a740 1 --2- 172.21.15.59:0/1207571301 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56524f07aae0 0x56524f07cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:22.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.688+0000 7f53ba20a740 4 client.15660 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:16:22.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.688+0000 7f53ba20a740 1 -- 172.21.15.59:0/1207571301 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56524ef64860 con 0x56524f07aae0 2024-09-10T21:16:22.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.688+0000 7f53b5bd1640 1 --2- 172.21.15.59:0/1207571301 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56524f07aae0 0x56524f07cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:22.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.688+0000 7f53b5bd1640 1 --2- 172.21.15.59:0/1207571301 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56524f07aae0 0x56524f07cf00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d60bdcf3f1822694 server_cookie=ddcade18ec4e7238 in_seq=0 out_seq=0 2024-09-10T21:16:22.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.688+0000 7f53997fa640 10 client.15660 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:22.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.690+0000 7f53997fa640 1 -- 172.21.15.59:0/1207571301 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56524ef64860 con 0x56524f07aae0 2024-09-10T21:16:22.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.690+0000 7f53997fa640 10 client.15660 handle_command_reply: tid=0 2024-09-10T21:16:22.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.690+0000 7f53ba20a740 1 client.15660 shutdown 2024-09-10T21:16:22.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.691+0000 7f53ba20a740 1 -- 172.21.15.59:0/1207571301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 msgr2=0x56524efff710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:22.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.691+0000 7f53ba20a740 1 --2- 172.21.15.59:0/1207571301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 0x56524efff710 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f53a0004690 tx=0x7f53a001cc50 comp rx=0 tx=0).stop 2024-09-10T21:16:22.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.691+0000 7f53ba20a740 1 -- 172.21.15.59:0/1207571301 shutdown_connections 2024-09-10T21:16:22.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.691+0000 7f53ba20a740 1 --2- 172.21.15.59:0/1207571301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56524effc790 0x56524efffea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.691+0000 7f53ba20a740 1 --2- 172.21.15.59:0/1207571301 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56524f07aae0 0x56524f07cf00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.691+0000 7f53ba20a740 1 --2- 172.21.15.59:0/1207571301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56524eff0800 0x56524efff710 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.691+0000 7f53ba20a740 1 --2- 172.21.15.59:0/1207571301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56524efefee0 0x56524f005110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.691+0000 7f53997fa640 0 client.15660 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:22.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.691+0000 7f53ba20a740 1 -- 172.21.15.59:0/1207571301 >> 172.21.15.59:0/1207571301 conn(0x56524efedd10 msgr2=0x56524eff38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:22.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.691+0000 7f53ba20a740 1 -- 172.21.15.59:0/1207571301 shutdown_connections 2024-09-10T21:16:22.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.691+0000 7f53ba20a740 1 -- 172.21.15.59:0/1207571301 wait complete. 2024-09-10T21:16:22.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.691+0000 7f53ba20a740 20 client.15660 trim_cache size 0 max 16384 2024-09-10T21:16:22.699 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:16:22.700 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:16:22.700 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "bab9510a-4461-4875-9c64-5fdb6a2556e4", 2024-09-10T21:16:22.700 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:16:22.700 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:16:22.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.692+0000 7f53b7e35640 1 -- 172.21.15.59:0/2408198712 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f539c0b5360 msgr2=0x7f539c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:22.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.692+0000 7f53b7e35640 1 --2- 172.21.15.59:0/2408198712 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f539c0b5360 0x7f539c0b7820 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f53a8004af0 tx=0x7f53a8005d80 comp rx=0 tx=0).stop 2024-09-10T21:16:22.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.692+0000 7f53b7e35640 1 -- 172.21.15.59:0/2408198712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53b0102de0 msgr2=0x7f53b0199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:22.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.692+0000 7f53b7e35640 1 --2- 172.21.15.59:0/2408198712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53b0102de0 0x7f53b0199270 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f53ac005fd0 tx=0x7f53ac00dde0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.692+0000 7f53b7e35640 1 -- 172.21.15.59:0/2408198712 shutdown_connections 2024-09-10T21:16:22.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.692+0000 7f53b7e35640 1 --2- 172.21.15.59:0/2408198712 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f539c0b5360 0x7f539c0b7820 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.692+0000 7f53b7e35640 1 --2- 172.21.15.59:0/2408198712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53b0109170 0x7f53b019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.692+0000 7f53b7e35640 1 --2- 172.21.15.59:0/2408198712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b01087f0 0x7f53b01997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.692+0000 7f53b7e35640 1 --2- 172.21.15.59:0/2408198712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53b0102de0 0x7f53b0199270 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:22.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.692+0000 7f53b7e35640 1 -- 172.21.15.59:0/2408198712 >> 172.21.15.59:0/2408198712 conn(0x7f53b00fe870 msgr2=0x7f53b00ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:22.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.692+0000 7f53b7e35640 1 -- 172.21.15.59:0/2408198712 shutdown_connections 2024-09-10T21:16:22.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:22.692+0000 7f53b7e35640 1 -- 172.21.15.59:0/2408198712 wait complete. 2024-09-10T21:16:23.311 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:23 smithi059 ceph-mon[30888]: pgmap v373: 97 pgs: 97 active+clean; 724 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.7 KiB/s wr, 12 op/s 2024-09-10T21:16:23.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:23 smithi192 ceph-mon[35363]: pgmap v373: 97 pgs: 97 active+clean; 724 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.7 KiB/s wr, 12 op/s 2024-09-10T21:16:23.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:23 smithi154 ceph-mon[35041]: pgmap v373: 97 pgs: 97 active+clean; 724 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.7 KiB/s wr, 12 op/s 2024-09-10T21:16:23.553 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:16:23.819 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:16:24.237 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:24 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:16:24.237 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:24 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:16:24.237 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:24 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:16:24.237 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:24 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:16:24.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.233+0000 7f921f24d640 1 -- 172.21.15.59:0/3138189819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92181076e0 msgr2=0x7f9218107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.233+0000 7f921f24d640 1 --2- 172.21.15.59:0/3138189819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92181076e0 0x7f9218107b20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9200009900 tx=0x7f920002a410 comp rx=0 tx=0).stop 2024-09-10T21:16:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.233+0000 7f921f24d640 1 -- 172.21.15.59:0/3138189819 shutdown_connections 2024-09-10T21:16:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.233+0000 7f921f24d640 1 --2- 172.21.15.59:0/3138189819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9218108060 0x7f921810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.233+0000 7f921f24d640 1 --2- 172.21.15.59:0/3138189819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92181076e0 0x7f9218107b20 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.233+0000 7f921f24d640 1 --2- 172.21.15.59:0/3138189819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9218101cd0 0x7f92181020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.233+0000 7f921f24d640 1 -- 172.21.15.59:0/3138189819 >> 172.21.15.59:0/3138189819 conn(0x7f92180fd720 msgr2=0x7f92180ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.233+0000 7f921f24d640 1 -- 172.21.15.59:0/3138189819 shutdown_connections 2024-09-10T21:16:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.233+0000 7f921f24d640 1 -- 172.21.15.59:0/3138189819 wait complete. 2024-09-10T21:16:24.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.234+0000 7f921f24d640 1 Processor -- start 2024-09-10T21:16:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.234+0000 7f921f24d640 1 -- start start 2024-09-10T21:16:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.235+0000 7f921f24d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9218101cd0 0x7f9218199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.235+0000 7f921f24d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92181076e0 0x7f9218199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.235+0000 7f921f24d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9218108060 0x7f921819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.235+0000 7f921f24d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9218111d20 con 0x7f9218108060 2024-09-10T21:16:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.235+0000 7f921f24d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9218111ba0 con 0x7f92181076e0 2024-09-10T21:16:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.235+0000 7f921f24d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9218111ea0 con 0x7f9218101cd0 2024-09-10T21:16:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.235+0000 7f921d7ea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9218108060 0x7f921819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.235+0000 7f921d7ea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9218108060 0x7f921819ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32976/0 (socket says 172.21.15.59:32976) 2024-09-10T21:16:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.235+0000 7f921d7ea640 1 -- 172.21.15.59:0/3685497480 learned_addr learned my addr 172.21.15.59:0/3685497480 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.235+0000 7f921cfe9640 1 --2- 172.21.15.59:0/3685497480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9218101cd0 0x7f9218199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.235+0000 7f9217fff640 1 --2- 172.21.15.59:0/3685497480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92181076e0 0x7f9218199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.235+0000 7f921d7ea640 1 -- 172.21.15.59:0/3685497480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9218101cd0 msgr2=0x7f9218199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:24.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.235+0000 7f921d7ea640 1 --2- 172.21.15.59:0/3685497480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9218101cd0 0x7f9218199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.235+0000 7f921d7ea640 1 -- 172.21.15.59:0/3685497480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92181076e0 msgr2=0x7f9218199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:24.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.235+0000 7f921d7ea640 1 --2- 172.21.15.59:0/3685497480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92181076e0 0x7f9218199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.235+0000 7f921d7ea640 1 -- 172.21.15.59:0/3685497480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f921819f3b0 con 0x7f9218108060 2024-09-10T21:16:24.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.235+0000 7f921d7ea640 1 --2- 172.21.15.59:0/3685497480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9218108060 0x7f921819ebe0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f921000cad0 tx=0x7f921000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:24.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.235+0000 7f9215ffb640 1 -- 172.21.15.59:0/3685497480 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921000ae20 con 0x7f9218108060 2024-09-10T21:16:24.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.236+0000 7f921f24d640 1 -- 172.21.15.59:0/3685497480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f921819f6a0 con 0x7f9218108060 2024-09-10T21:16:24.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.236+0000 7f9215ffb640 1 -- 172.21.15.59:0/3685497480 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9210005020 con 0x7f9218108060 2024-09-10T21:16:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.236+0000 7f9215ffb640 1 -- 172.21.15.59:0/3685497480 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921000f6b0 con 0x7f9218108060 2024-09-10T21:16:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.236+0000 7f921f24d640 1 -- 172.21.15.59:0/3685497480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92181a5d60 con 0x7f9218108060 2024-09-10T21:16:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.238+0000 7f9215ffb640 1 -- 172.21.15.59:0/3685497480 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f92100054f0 con 0x7f9218108060 2024-09-10T21:16:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.238+0000 7f9221622740 1 Processor -- start 2024-09-10T21:16:24.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f9221622740 1 -- start start 2024-09-10T21:16:24.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f9221622740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0b964b0 0x55c8b0b96890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:24.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f9221622740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0b96dd0 0x55c8b0ba2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:24.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f9221622740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0ba2d60 0x55c8b0ba5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:24.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f9221622740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c8b0b08e50 con 0x55c8b0b96dd0 2024-09-10T21:16:24.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f9221622740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c8b0af8280 con 0x55c8b0ba2d60 2024-09-10T21:16:24.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f9221622740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c8b0afc090 con 0x55c8b0b964b0 2024-09-10T21:16:24.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f921cfe9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0b96dd0 0x55c8b0ba2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:24.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f921cfe9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0b96dd0 0x55c8b0ba2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32986/0 (socket says 172.21.15.59:32986) 2024-09-10T21:16:24.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f921cfe9640 1 -- 172.21.15.59:0/1299170195 learned_addr learned my addr 172.21.15.59:0/1299170195 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:24.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f9217fff640 1 --2- 172.21.15.59:0/1299170195 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0b964b0 0x55c8b0b96890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:24.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f9215ffb640 1 --2- 172.21.15.59:0/3685497480 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f92040b52e0 0x7f92040b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:24.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f9217fff640 1 --2- 172.21.15.59:0/1299170195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0ba2d60 0x55c8b0ba5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:24.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f921cfe9640 1 -- 172.21.15.59:0/1299170195 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0b964b0 msgr2=0x55c8b0b96890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:24.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f921cfe9640 1 --2- 172.21.15.59:0/1299170195 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0b964b0 0x55c8b0b96890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f921cfe9640 1 -- 172.21.15.59:0/1299170195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0ba2d60 msgr2=0x55c8b0ba5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:24.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f921cfe9640 1 --2- 172.21.15.59:0/1299170195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0ba2d60 0x55c8b0ba5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f921cfe9640 1 -- 172.21.15.59:0/1299170195 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8b0856650 con 0x55c8b0b96dd0 2024-09-10T21:16:24.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f9217fff640 1 --2- 172.21.15.59:0/1299170195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0ba2d60 0x55c8b0ba5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:16:24.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f921d7ea640 1 --2- 172.21.15.59:0/3685497480 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f92040b52e0 0x7f92040b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:24.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.239+0000 7f9215ffb640 1 -- 172.21.15.59:0/3685497480 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f92100e5b00 con 0x7f9218108060 2024-09-10T21:16:24.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.240+0000 7f921cfe9640 1 --2- 172.21.15.59:0/1299170195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0b96dd0 0x55c8b0ba2820 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f920800b760 tx=0x7f920800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c77c507e4736159 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:24.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.240+0000 7f920effd640 1 -- 172.21.15.59:0/1299170195 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208003dd0 con 0x55c8b0b96dd0 2024-09-10T21:16:24.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.240+0000 7f920effd640 1 -- 172.21.15.59:0/1299170195 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9208015070 con 0x55c8b0b96dd0 2024-09-10T21:16:24.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.240+0000 7f920effd640 1 -- 172.21.15.59:0/1299170195 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208004da0 con 0x55c8b0b96dd0 2024-09-10T21:16:24.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.241+0000 7f9221622740 1 -- 172.21.15.59:0/1299170195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0b96dd0 msgr2=0x55c8b0ba2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.241+0000 7f9221622740 1 --2- 172.21.15.59:0/1299170195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0b96dd0 0x55c8b0ba2820 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f920800b760 tx=0x7f920800bc20 comp rx=0 tx=0).stop 2024-09-10T21:16:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.241+0000 7f921d7ea640 1 --2- 172.21.15.59:0/3685497480 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f92040b52e0 0x7f92040b77a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f92100a9610 tx=0x7f9210070b10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.241+0000 7f9221622740 1 -- 172.21.15.59:0/1299170195 shutdown_connections 2024-09-10T21:16:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.241+0000 7f9221622740 1 --2- 172.21.15.59:0/1299170195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0ba2d60 0x55c8b0ba5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.241+0000 7f9221622740 1 --2- 172.21.15.59:0/1299170195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0b96dd0 0x55c8b0ba2820 secure :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f920800b760 tx=0x7f920800bc20 comp rx=0 tx=0).stop 2024-09-10T21:16:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.241+0000 7f9221622740 1 --2- 172.21.15.59:0/1299170195 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0b964b0 0x55c8b0b96890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.241+0000 7f9221622740 1 -- 172.21.15.59:0/1299170195 >> 172.21.15.59:0/1299170195 conn(0x55c8b0b942e0 msgr2=0x55c8b0b95480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.241+0000 7f9221622740 1 -- 172.21.15.59:0/1299170195 shutdown_connections 2024-09-10T21:16:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.241+0000 7f9221622740 1 -- 172.21.15.59:0/1299170195 wait complete. 2024-09-10T21:16:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.242+0000 7f9221622740 1 -- start start 2024-09-10T21:16:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.242+0000 7f9221622740 1 Processor -- start 2024-09-10T21:16:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.242+0000 7f9221622740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0b964b0 0x55c8b0b9fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.242+0000 7f9221622740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0ba2d60 0x55c8b0ba0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.242+0000 7f9221622740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0ba0770 0x55c8b0baed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.242+0000 7f9221622740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c8b0959700 con 0x55c8b0b964b0 2024-09-10T21:16:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.242+0000 7f9221622740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c8b0a93110 con 0x55c8b0ba2d60 2024-09-10T21:16:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.242+0000 7f9221622740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c8b0ba59e0 con 0x55c8b0ba0770 2024-09-10T21:16:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.242+0000 7f9221622740 10 client.0 _ll_register_callbacks cb 0x55c8b0aac990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.242+0000 7f9217fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0b964b0 0x55c8b0b9fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.242+0000 7f9217fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0b964b0 0x55c8b0b9fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33000/0 (socket says 172.21.15.59:33000) 2024-09-10T21:16:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.242+0000 7f9217fff640 1 -- 172.21.15.59:0/3199582898 learned_addr learned my addr 172.21.15.59:0/3199582898 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.242+0000 7f921cfe9640 1 --2- 172.21.15.59:0/3199582898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0ba2d60 0x55c8b0ba0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.243+0000 7f9217fff640 1 --2- 172.21.15.59:0/3199582898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0ba0770 0x55c8b0baed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.243+0000 7f9217fff640 1 -- 172.21.15.59:0/3199582898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0ba0770 msgr2=0x55c8b0baed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.243+0000 7f9217fff640 1 --2- 172.21.15.59:0/3199582898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0ba0770 0x55c8b0baed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.243+0000 7f9217fff640 1 -- 172.21.15.59:0/3199582898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0ba2d60 msgr2=0x55c8b0ba0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.243+0000 7f9217fff640 1 --2- 172.21.15.59:0/3199582898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0ba2d60 0x55c8b0ba0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.243+0000 7f9217fff640 1 -- 172.21.15.59:0/3199582898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8b0ac0c40 con 0x55c8b0b964b0 2024-09-10T21:16:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.243+0000 7f9217fff640 1 --2- 172.21.15.59:0/3199582898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0b964b0 0x55c8b0b9fcf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f920002a930 tx=0x7f9200009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b8ae11d4790147 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.243+0000 7f91f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.243+0000 7f91f7fff640 1 -- 172.21.15.59:0/3199582898 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200035040 con 0x55c8b0b964b0 2024-09-10T21:16:24.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.243+0000 7f91f7fff640 1 -- 172.21.15.59:0/3199582898 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9200004300 con 0x55c8b0b964b0 2024-09-10T21:16:24.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.243+0000 7f9221622740 1 -- 172.21.15.59:0/3199582898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9208015070 con 0x55c8b0b964b0 2024-09-10T21:16:24.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.243+0000 7f91f7fff640 1 -- 172.21.15.59:0/3199582898 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9200052050 con 0x55c8b0b964b0 2024-09-10T21:16:24.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.244+0000 7f9221622740 10 client.15672 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:24.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.244+0000 7f9221622740 1 -- 172.21.15.59:0/3199582898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c8b0bb1910 con 0x55c8b0b964b0 2024-09-10T21:16:24.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.244+0000 7f91f7fff640 1 -- 172.21.15.59:0/3199582898 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9208015070 con 0x55c8b0b964b0 2024-09-10T21:16:24.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.244+0000 7f91f7fff640 1 -- 172.21.15.59:0/3199582898 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f920003d5e0 con 0x55c8b0b964b0 2024-09-10T21:16:24.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.244+0000 7f9221622740 10 client.15672 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:24.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.244+0000 7f9221622740 10 client.15672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:16:24.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.244+0000 7f9221622740 20 client.15672 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:24.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.244+0000 7f9221622740 1 --2- 172.21.15.59:0/3199582898 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55c8b0bb2d70 0x55c8b0bb5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:24.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.244+0000 7f9221622740 4 client.15672 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:16:24.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.244+0000 7f9221622740 1 -- 172.21.15.59:0/3199582898 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8b0b0ada0 con 0x55c8b0bb2d70 2024-09-10T21:16:24.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.244+0000 7f921cfe9640 1 --2- 172.21.15.59:0/3199582898 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55c8b0bb2d70 0x55c8b0bb5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:24.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.245+0000 7f921cfe9640 1 --2- 172.21.15.59:0/3199582898 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55c8b0bb2d70 0x55c8b0bb5180 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=669e268a9771b50a server_cookie=fd3ad988505790d8 in_seq=0 out_seq=0 2024-09-10T21:16:24.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.245+0000 7f91f7fff640 10 client.15672 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:24.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.245+0000 7f91f7fff640 1 -- 172.21.15.59:0/3199582898 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c8b0b0ada0 con 0x55c8b0bb2d70 2024-09-10T21:16:24.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.245+0000 7f91f7fff640 10 client.15672 handle_command_reply: tid=0 2024-09-10T21:16:24.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.245+0000 7f9221622740 1 client.15672 shutdown 2024-09-10T21:16:24.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.246+0000 7f9221622740 1 -- 172.21.15.59:0/3199582898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0b964b0 msgr2=0x55c8b0b9fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:24.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.246+0000 7f9221622740 1 --2- 172.21.15.59:0/3199582898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0b964b0 0x55c8b0b9fcf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f920002a930 tx=0x7f9200009260 comp rx=0 tx=0).stop 2024-09-10T21:16:24.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.246+0000 7f9221622740 1 -- 172.21.15.59:0/3199582898 shutdown_connections 2024-09-10T21:16:24.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.246+0000 7f9221622740 1 --2- 172.21.15.59:0/3199582898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0ba0770 0x55c8b0baed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.246+0000 7f9221622740 1 --2- 172.21.15.59:0/3199582898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0ba2d60 0x55c8b0ba0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.246+0000 7f9221622740 1 --2- 172.21.15.59:0/3199582898 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55c8b0bb2d70 0x55c8b0bb5180 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.246+0000 7f9221622740 1 --2- 172.21.15.59:0/3199582898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0b964b0 0x55c8b0b9fcf0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.246+0000 7f91f7fff640 0 client.15672 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:24.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.246+0000 7f9221622740 1 -- 172.21.15.59:0/3199582898 >> 172.21.15.59:0/3199582898 conn(0x55c8b0b942e0 msgr2=0x55c8b0b99e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:24.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.246+0000 7f9221622740 1 -- 172.21.15.59:0/3199582898 shutdown_connections 2024-09-10T21:16:24.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.246+0000 7f9221622740 1 -- 172.21.15.59:0/3199582898 wait complete. 2024-09-10T21:16:24.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.246+0000 7f9221622740 20 client.15672 trim_cache size 0 max 16384 2024-09-10T21:16:24.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.267+0000 7f9221622740 1 Processor -- start 2024-09-10T21:16:24.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.267+0000 7f9221622740 1 -- start start 2024-09-10T21:16:24.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.267+0000 7f9221622740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0b964b0 0x55c8b0b8ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:24.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.267+0000 7f9221622740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0ba0770 0x55c8b0b9cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:24.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.267+0000 7f9221622740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0ba2d60 0x55c8b0b9d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:24.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.267+0000 7f9221622740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f92181ac0e0 con 0x55c8b0ba0770 2024-09-10T21:16:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.267+0000 7f9221622740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f92181adc20 con 0x55c8b0b964b0 2024-09-10T21:16:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.267+0000 7f9221622740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f92181ac7b0 con 0x55c8b0ba2d60 2024-09-10T21:16:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.267+0000 7f921cfe9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0ba0770 0x55c8b0b9cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.267+0000 7f921cfe9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0ba0770 0x55c8b0b9cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33008/0 (socket says 172.21.15.59:33008) 2024-09-10T21:16:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.267+0000 7f921cfe9640 1 -- 172.21.15.59:0/571643333 learned_addr learned my addr 172.21.15.59:0/571643333 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.267+0000 7f9217fff640 1 --2- 172.21.15.59:0/571643333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0b964b0 0x55c8b0b8ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.268+0000 7f9217fff640 1 --2- 172.21.15.59:0/571643333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0ba2d60 0x55c8b0b9d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.268+0000 7f921cfe9640 1 -- 172.21.15.59:0/571643333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0ba2d60 msgr2=0x55c8b0b9d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.268+0000 7f921cfe9640 1 --2- 172.21.15.59:0/571643333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0ba2d60 0x55c8b0b9d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.268+0000 7f921cfe9640 1 -- 172.21.15.59:0/571643333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0b964b0 msgr2=0x55c8b0b8ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.268+0000 7f921cfe9640 1 --2- 172.21.15.59:0/571643333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0b964b0 0x55c8b0b8ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.268+0000 7f921cfe9640 1 -- 172.21.15.59:0/571643333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8b0b94ff0 con 0x55c8b0ba0770 2024-09-10T21:16:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.268+0000 7f9217fff640 1 --2- 172.21.15.59:0/571643333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0ba2d60 0x55c8b0b9d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:16:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.268+0000 7f921cfe9640 1 --2- 172.21.15.59:0/571643333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0ba0770 0x55c8b0b9cf00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f920800b760 tx=0x7f92080049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801015bcbfc80ce4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.268+0000 7f920e7fc640 1 -- 172.21.15.59:0/571643333 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208003dd0 con 0x55c8b0ba0770 2024-09-10T21:16:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.268+0000 7f920e7fc640 1 -- 172.21.15.59:0/571643333 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9208015040 con 0x55c8b0ba0770 2024-09-10T21:16:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.268+0000 7f920e7fc640 1 -- 172.21.15.59:0/571643333 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208019420 con 0x55c8b0ba0770 2024-09-10T21:16:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.269+0000 7f9221622740 1 -- 172.21.15.59:0/571643333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0ba0770 msgr2=0x55c8b0b9cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.269+0000 7f9221622740 1 --2- 172.21.15.59:0/571643333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0ba0770 0x55c8b0b9cf00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f920800b760 tx=0x7f92080049e0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.269+0000 7f9221622740 1 -- 172.21.15.59:0/571643333 shutdown_connections 2024-09-10T21:16:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.269+0000 7f9221622740 1 --2- 172.21.15.59:0/571643333 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0ba2d60 0x55c8b0b9d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.269+0000 7f9221622740 1 --2- 172.21.15.59:0/571643333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0ba0770 0x55c8b0b9cf00 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.269+0000 7f9221622740 1 --2- 172.21.15.59:0/571643333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0b964b0 0x55c8b0b8ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.269+0000 7f9221622740 1 -- 172.21.15.59:0/571643333 >> 172.21.15.59:0/571643333 conn(0x55c8b0b942e0 msgr2=0x55c8b0b8e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.269+0000 7f9221622740 1 -- 172.21.15.59:0/571643333 shutdown_connections 2024-09-10T21:16:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.269+0000 7f9221622740 1 -- 172.21.15.59:0/571643333 wait complete. 2024-09-10T21:16:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.269+0000 7f9221622740 1 -- start start 2024-09-10T21:16:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.269+0000 7f9221622740 1 Processor -- start 2024-09-10T21:16:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f9221622740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0b964b0 0x55c8b0bab500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f9221622740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0ba0770 0x55c8b0ba79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f9221622740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0ba2d60 0x55c8b0ba7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f9221622740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f92181ad550 con 0x55c8b0ba2d60 2024-09-10T21:16:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f9221622740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f92181ace80 con 0x55c8b0ba0770 2024-09-10T21:16:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f9221622740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f92181aa0e0 con 0x55c8b0b964b0 2024-09-10T21:16:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f9221622740 10 client.0 _ll_register_callbacks cb 0x7f9200005e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f9217fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0ba2d60 0x55c8b0ba7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f9217fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0ba2d60 0x55c8b0ba7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33012/0 (socket says 172.21.15.59:33012) 2024-09-10T21:16:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f9217fff640 1 -- 172.21.15.59:0/2385620871 learned_addr learned my addr 172.21.15.59:0/2385620871 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f9217fff640 1 --2- 172.21.15.59:0/2385620871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0b964b0 0x55c8b0bab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f921cfe9640 1 --2- 172.21.15.59:0/2385620871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0ba0770 0x55c8b0ba79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f9217fff640 1 -- 172.21.15.59:0/2385620871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0b964b0 msgr2=0x55c8b0bab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f9217fff640 1 --2- 172.21.15.59:0/2385620871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0b964b0 0x55c8b0bab500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f9217fff640 1 -- 172.21.15.59:0/2385620871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0ba0770 msgr2=0x55c8b0ba79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f9217fff640 1 --2- 172.21.15.59:0/2385620871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0ba0770 0x55c8b0ba79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f9217fff640 1 -- 172.21.15.59:0/2385620871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8b0ba87d0 con 0x55c8b0ba2d60 2024-09-10T21:16:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f921cfe9640 1 --2- 172.21.15.59:0/2385620871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0ba0770 0x55c8b0ba79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:16:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f9217fff640 1 --2- 172.21.15.59:0/2385620871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0ba2d60 0x55c8b0ba7fa0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9200009900 tx=0x7f9200031d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ee2fec4361a21a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f91f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f91f7fff640 1 -- 172.21.15.59:0/2385620871 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920004f020 con 0x55c8b0ba2d60 2024-09-10T21:16:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.270+0000 7f91f7fff640 1 -- 172.21.15.59:0/2385620871 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f920003d710 con 0x55c8b0ba2d60 2024-09-10T21:16:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.271+0000 7f9221622740 1 -- 172.21.15.59:0/2385620871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9208015040 con 0x55c8b0ba2d60 2024-09-10T21:16:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.271+0000 7f91f7fff640 1 -- 172.21.15.59:0/2385620871 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9200041040 con 0x55c8b0ba2d60 2024-09-10T21:16:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.271+0000 7f9221622740 10 client.15678 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.271+0000 7f9221622740 1 -- 172.21.15.59:0/2385620871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c8b0c20c70 con 0x55c8b0ba2d60 2024-09-10T21:16:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.271+0000 7f91f7fff640 1 -- 172.21.15.59:0/2385620871 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9208015040 con 0x55c8b0ba2d60 2024-09-10T21:16:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.271+0000 7f91f7fff640 1 -- 172.21.15.59:0/2385620871 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f92000046c0 con 0x55c8b0ba2d60 2024-09-10T21:16:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.271+0000 7f9221622740 10 client.15678 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.271+0000 7f9221622740 10 client.15678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:16:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.271+0000 7f9221622740 20 client.15678 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.271+0000 7f9221622740 1 --2- 172.21.15.59:0/2385620871 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55c8b0c21370 0x55c8b0c23790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:24.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.271+0000 7f9221622740 4 client.15678 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:16:24.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.271+0000 7f9221622740 1 -- 172.21.15.59:0/2385620871 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c8b0b06850 con 0x55c8b0c21370 2024-09-10T21:16:24.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.271+0000 7f921cfe9640 1 --2- 172.21.15.59:0/2385620871 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55c8b0c21370 0x55c8b0c23790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:24.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.272+0000 7f921cfe9640 1 --2- 172.21.15.59:0/2385620871 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55c8b0c21370 0x55c8b0c23790 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5b194ca647b6999 server_cookie=74e7549e2b2d0fd4 in_seq=0 out_seq=0 2024-09-10T21:16:24.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.272+0000 7f91f7fff640 10 client.15678 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:24.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.272+0000 7f91f7fff640 1 -- 172.21.15.59:0/2385620871 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x55c8b0b06850 con 0x55c8b0c21370 2024-09-10T21:16:24.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.272+0000 7f91f7fff640 10 client.15678 handle_command_reply: tid=0 2024-09-10T21:16:24.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.272+0000 7f9221622740 1 client.15678 shutdown 2024-09-10T21:16:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.272+0000 7f9221622740 1 -- 172.21.15.59:0/2385620871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0ba2d60 msgr2=0x55c8b0ba7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.272+0000 7f9221622740 1 --2- 172.21.15.59:0/2385620871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0ba2d60 0x55c8b0ba7fa0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9200009900 tx=0x7f9200031d20 comp rx=0 tx=0).stop 2024-09-10T21:16:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.272+0000 7f9221622740 1 -- 172.21.15.59:0/2385620871 shutdown_connections 2024-09-10T21:16:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.272+0000 7f9221622740 1 --2- 172.21.15.59:0/2385620871 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55c8b0c21370 0x55c8b0c23790 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.272+0000 7f9221622740 1 --2- 172.21.15.59:0/2385620871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8b0ba2d60 0x55c8b0ba7fa0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.272+0000 7f9221622740 1 --2- 172.21.15.59:0/2385620871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8b0ba0770 0x55c8b0ba79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.272+0000 7f9221622740 1 --2- 172.21.15.59:0/2385620871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8b0b964b0 0x55c8b0bab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.272+0000 7f9221622740 1 -- 172.21.15.59:0/2385620871 >> 172.21.15.59:0/2385620871 conn(0x55c8b0b942e0 msgr2=0x55c8b0b8ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:24.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.272+0000 7f91f7fff640 0 client.15678 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:24.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.273+0000 7f9221622740 1 -- 172.21.15.59:0/2385620871 shutdown_connections 2024-09-10T21:16:24.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.273+0000 7f9221622740 1 -- 172.21.15.59:0/2385620871 wait complete. 2024-09-10T21:16:24.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.273+0000 7f9221622740 20 client.15678 trim_cache size 0 max 16384 2024-09-10T21:16:24.286 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:16:24.286 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:16:24.286 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-09-10T21:16:24.287 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:16:24.287 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:16:24.287 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "bab9510a-4461-4875-9c64-5fdb6a2556e4", 2024-09-10T21:16:24.287 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2024-09-10T21:16:24.287 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:16:24.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:16:24.287 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:16:24.287 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:16:24.287 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:16:24.287 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:16:24.287 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:16:24.287 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:16:24.287 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:16:24.287 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:16:24.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:16:24.288 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:16:24.288 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:16:24.288 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:16:24.288 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:16:24.288 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:16:24.288 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:16:24.288 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:16:24.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:16:24.288 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:16:24.288 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:16:24.288 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:16:24.288 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:16:24.288 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:16:24.288 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:16:24.288 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:16:24.289 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:16:24.289 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:16:24.289 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:16:24.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.273+0000 7f921f24d640 1 -- 172.21.15.59:0/3685497480 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f92040b52e0 msgr2=0x7f92040b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:24.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.273+0000 7f921f24d640 1 --2- 172.21.15.59:0/3685497480 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f92040b52e0 0x7f92040b77a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f92100a9610 tx=0x7f9210070b10 comp rx=0 tx=0).stop 2024-09-10T21:16:24.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.273+0000 7f921f24d640 1 -- 172.21.15.59:0/3685497480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9218108060 msgr2=0x7f921819ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:24.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.273+0000 7f921f24d640 1 --2- 172.21.15.59:0/3685497480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9218108060 0x7f921819ebe0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f921000cad0 tx=0x7f921000cf90 comp rx=0 tx=0).stop 2024-09-10T21:16:24.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.273+0000 7f921f24d640 1 -- 172.21.15.59:0/3685497480 shutdown_connections 2024-09-10T21:16:24.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.273+0000 7f921f24d640 1 --2- 172.21.15.59:0/3685497480 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f92040b52e0 0x7f92040b77a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.273+0000 7f921f24d640 1 --2- 172.21.15.59:0/3685497480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9218108060 0x7f921819ebe0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.273+0000 7f921f24d640 1 --2- 172.21.15.59:0/3685497480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92181076e0 0x7f9218199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.273+0000 7f921f24d640 1 --2- 172.21.15.59:0/3685497480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9218101cd0 0x7f9218199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:24.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.273+0000 7f921f24d640 1 -- 172.21.15.59:0/3685497480 >> 172.21.15.59:0/3685497480 conn(0x7f92180fd720 msgr2=0x7f921806b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:24.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.273+0000 7f921f24d640 1 -- 172.21.15.59:0/3685497480 shutdown_connections 2024-09-10T21:16:24.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:24.274+0000 7f921f24d640 1 -- 172.21.15.59:0/3685497480 wait complete. 2024-09-10T21:16:24.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:24 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:16:24.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:24 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:16:24.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:24 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:16:24.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:24 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:16:24.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:24 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:16:24.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:24 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:16:24.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:24 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:16:24.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:24 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:16:24.962 INFO:tasks.cephfs.filesystem:scrub status for tag:bab9510a-4461-4875-9c64-5fdb6a2556e4 - {'path': '/', 'tag': 'bab9510a-4461-4875-9c64-5fdb6a2556e4', 'options': 'recursive,force'} 2024-09-10T21:16:25.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:25 smithi192 ceph-mon[35363]: pgmap v374: 97 pgs: 97 active+clean; 724 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.7 KiB/s wr, 12 op/s 2024-09-10T21:16:25.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:25 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:16:25.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:25 smithi059 ceph-mon[30888]: pgmap v374: 97 pgs: 97 active+clean; 724 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.7 KiB/s wr, 12 op/s 2024-09-10T21:16:25.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:25 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:16:25.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:25 smithi154 ceph-mon[35041]: pgmap v374: 97 pgs: 97 active+clean; 724 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.7 KiB/s wr, 12 op/s 2024-09-10T21:16:25.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:25 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:16:26.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:26 smithi059 ceph-mon[30888]: pgmap v375: 97 pgs: 97 active+clean; 724 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.7 KiB/s wr, 11 op/s 2024-09-10T21:16:26.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:26 smithi154 ceph-mon[35041]: pgmap v375: 97 pgs: 97 active+clean; 724 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.7 KiB/s wr, 11 op/s 2024-09-10T21:16:26.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:26 smithi192 ceph-mon[35363]: pgmap v375: 97 pgs: 97 active+clean; 724 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.7 KiB/s wr, 11 op/s 2024-09-10T21:16:27.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:27 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:16:27.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:27 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:16:27.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:27 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:16:28.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:28 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:16:28.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:28 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:16:28.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:28 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:16:28.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:28 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:16:28.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:28 smithi059 ceph-mon[30888]: pgmap v376: 97 pgs: 97 active+clean; 780 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:16:28.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:28 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:16:28.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:28 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:16:28.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:28 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:16:28.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:28 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:16:28.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:28 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:16:28.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:28 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:16:28.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:28 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:16:28.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:28 smithi154 ceph-mon[35041]: pgmap v376: 97 pgs: 97 active+clean; 780 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:16:28.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:28 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:16:28.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:28 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:16:28.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:28 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:16:28.581 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:28 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:16:28.581 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:28 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:16:28.581 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:28 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:16:28.581 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:28 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:16:28.581 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:28 smithi192 ceph-mon[35363]: pgmap v376: 97 pgs: 97 active+clean; 780 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:16:28.581 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:28 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:16:28.581 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:28 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:16:28.581 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:28 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:16:30.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:30 smithi059 ceph-mon[30888]: pgmap v377: 97 pgs: 97 active+clean; 780 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:16:30.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:30 smithi154 ceph-mon[35041]: pgmap v377: 97 pgs: 97 active+clean; 780 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:16:30.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:30 smithi192 ceph-mon[35363]: pgmap v377: 97 pgs: 97 active+clean; 780 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:16:32.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:32 smithi059 ceph-mon[30888]: pgmap v378: 97 pgs: 97 active+clean; 837 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:16:32.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:32 smithi154 ceph-mon[35041]: pgmap v378: 97 pgs: 97 active+clean; 837 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:16:32.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:32 smithi192 ceph-mon[35363]: pgmap v378: 97 pgs: 97 active+clean; 837 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:16:34.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:34 smithi059 ceph-mon[30888]: pgmap v379: 97 pgs: 97 active+clean; 837 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:16:34.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:34 smithi154 ceph-mon[35041]: pgmap v379: 97 pgs: 97 active+clean; 837 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:16:34.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:34 smithi192 ceph-mon[35363]: pgmap v379: 97 pgs: 97 active+clean; 837 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:16:36.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:36 smithi059 ceph-mon[30888]: pgmap v380: 97 pgs: 97 active+clean; 837 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-10T21:16:36.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:36 smithi154 ceph-mon[35041]: pgmap v380: 97 pgs: 97 active+clean; 837 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-10T21:16:36.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:36 smithi192 ceph-mon[35363]: pgmap v380: 97 pgs: 97 active+clean; 837 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-10T21:16:38.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:38 smithi059 ceph-mon[30888]: pgmap v381: 97 pgs: 97 active+clean; 897 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:16:38.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:38 smithi154 ceph-mon[35041]: pgmap v381: 97 pgs: 97 active+clean; 897 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:16:38.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:38 smithi192 ceph-mon[35363]: pgmap v381: 97 pgs: 97 active+clean; 897 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:16:40.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:40 smithi059 ceph-mon[30888]: pgmap v382: 97 pgs: 97 active+clean; 897 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:16:40.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:40 smithi154 ceph-mon[35041]: pgmap v382: 97 pgs: 97 active+clean; 897 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:16:40.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:40 smithi192 ceph-mon[35363]: pgmap v382: 97 pgs: 97 active+clean; 897 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:16:42.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:42 smithi059 ceph-mon[30888]: pgmap v383: 97 pgs: 97 active+clean; 954 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:16:42.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:42 smithi154 ceph-mon[35041]: pgmap v383: 97 pgs: 97 active+clean; 954 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:16:42.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:42 smithi192 ceph-mon[35363]: pgmap v383: 97 pgs: 97 active+clean; 954 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:16:44.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:44 smithi059 ceph-mon[30888]: pgmap v384: 97 pgs: 97 active+clean; 954 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:16:44.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:44 smithi154 ceph-mon[35041]: pgmap v384: 97 pgs: 97 active+clean; 954 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:16:44.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:44 smithi192 ceph-mon[35363]: pgmap v384: 97 pgs: 97 active+clean; 954 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:16:46.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:46 smithi059 ceph-mon[30888]: pgmap v385: 97 pgs: 97 active+clean; 954 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:16:46.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:46 smithi154 ceph-mon[35041]: pgmap v385: 97 pgs: 97 active+clean; 954 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:16:46.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:46 smithi192 ceph-mon[35363]: pgmap v385: 97 pgs: 97 active+clean; 954 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:16:48.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:48 smithi059 ceph-mon[30888]: pgmap v386: 97 pgs: 97 active+clean; 1015 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:16:48.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:48 smithi154 ceph-mon[35041]: pgmap v386: 97 pgs: 97 active+clean; 1015 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:16:48.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:48 smithi192 ceph-mon[35363]: pgmap v386: 97 pgs: 97 active+clean; 1015 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:16:50.630 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:50 smithi192 ceph-mon[35363]: pgmap v387: 97 pgs: 97 active+clean; 1015 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:16:50.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:50 smithi059 ceph-mon[30888]: pgmap v387: 97 pgs: 97 active+clean; 1015 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:16:50.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:50 smithi154 ceph-mon[35041]: pgmap v387: 97 pgs: 97 active+clean; 1015 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:16:52.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:52 smithi059 ceph-mon[30888]: pgmap v388: 97 pgs: 97 active+clean; 1.0 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:16:52.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:52 smithi154 ceph-mon[35041]: pgmap v388: 97 pgs: 97 active+clean; 1.0 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:16:52.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:52 smithi192 ceph-mon[35363]: pgmap v388: 97 pgs: 97 active+clean; 1.0 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:16:54.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:54 smithi059 ceph-mon[30888]: pgmap v389: 97 pgs: 97 active+clean; 1.0 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:16:54.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:54 smithi154 ceph-mon[35041]: pgmap v389: 97 pgs: 97 active+clean; 1.0 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:16:54.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:54 smithi192 ceph-mon[35363]: pgmap v389: 97 pgs: 97 active+clean; 1.0 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:16:54.963 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:16:55.239 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:16:55.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.767+0000 7f71c79d5640 1 -- 172.21.15.59:0/3779656209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71c0108020 msgr2=0x7f71c010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:55.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.767+0000 7f71c79d5640 1 --2- 172.21.15.59:0/3779656209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71c0108020 0x7f71c010e820 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009ca0 tx=0x7f71b802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.767+0000 7f71c79d5640 1 -- 172.21.15.59:0/3779656209 shutdown_connections 2024-09-10T21:16:55.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.767+0000 7f71c79d5640 1 --2- 172.21.15.59:0/3779656209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71c0108020 0x7f71c010e820 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.767+0000 7f71c79d5640 1 --2- 172.21.15.59:0/3779656209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71c01076a0 0x7f71c0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.767+0000 7f71c79d5640 1 --2- 172.21.15.59:0/3779656209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71c0101c90 0x7f71c0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.767+0000 7f71c79d5640 1 -- 172.21.15.59:0/3779656209 >> 172.21.15.59:0/3779656209 conn(0x7f71c00fd700 msgr2=0x7f71c00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:55.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.767+0000 7f71c79d5640 1 -- 172.21.15.59:0/3779656209 shutdown_connections 2024-09-10T21:16:55.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.767+0000 7f71c79d5640 1 -- 172.21.15.59:0/3779656209 wait complete. 2024-09-10T21:16:55.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.767+0000 7f71c79d5640 1 Processor -- start 2024-09-10T21:16:55.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.768+0000 7f71c79d5640 1 -- start start 2024-09-10T21:16:55.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.768+0000 7f71c79d5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71c0101c90 0x7f71c0197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:55.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.768+0000 7f71c79d5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71c01076a0 0x7f71c01983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:55.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.768+0000 7f71c79d5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71c0108020 0x7f71c0198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:55.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.768+0000 7f71c79d5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f71c0111ce0 con 0x7f71c0101c90 2024-09-10T21:16:55.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.768+0000 7f71c79d5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f71c0111b60 con 0x7f71c01076a0 2024-09-10T21:16:55.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.768+0000 7f71c79d5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f71c0111e60 con 0x7f71c0108020 2024-09-10T21:16:55.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.768+0000 7f71c5771640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71c0101c90 0x7f71c0197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:55.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.768+0000 7f71c4f70640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71c01076a0 0x7f71c01983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:55.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.768+0000 7f71c5771640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71c0101c90 0x7f71c0197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47202/0 (socket says 172.21.15.59:47202) 2024-09-10T21:16:55.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.768+0000 7f71c5771640 1 -- 172.21.15.59:0/689528830 learned_addr learned my addr 172.21.15.59:0/689528830 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:55.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.768+0000 7f71c5f72640 1 --2- 172.21.15.59:0/689528830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71c0108020 0x7f71c0198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:55.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.768+0000 7f71c5771640 1 -- 172.21.15.59:0/689528830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71c0108020 msgr2=0x7f71c0198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:55.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.768+0000 7f71c5771640 1 --2- 172.21.15.59:0/689528830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71c0108020 0x7f71c0198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.768+0000 7f71c5771640 1 -- 172.21.15.59:0/689528830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71c01076a0 msgr2=0x7f71c01983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:55.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.768+0000 7f71c5771640 1 --2- 172.21.15.59:0/689528830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71c01076a0 0x7f71c01983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.768+0000 7f71c5771640 1 -- 172.21.15.59:0/689528830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c01a7660 con 0x7f71c0101c90 2024-09-10T21:16:55.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.769+0000 7f71c5771640 1 --2- 172.21.15.59:0/689528830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71c0101c90 0x7f71c0197e80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00e9f0 tx=0x7f71bc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:55.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.769+0000 7f71b67fc640 1 -- 172.21.15.59:0/689528830 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc00cd80 con 0x7f71c0101c90 2024-09-10T21:16:55.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.769+0000 7f71c79d5640 1 -- 172.21.15.59:0/689528830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c01a7950 con 0x7f71c0101c90 2024-09-10T21:16:55.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.769+0000 7f71b67fc640 1 -- 172.21.15.59:0/689528830 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71bc0108e0 con 0x7f71c0101c90 2024-09-10T21:16:55.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.769+0000 7f71b67fc640 1 -- 172.21.15.59:0/689528830 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc018980 con 0x7f71c0101c90 2024-09-10T21:16:55.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.769+0000 7f71c79d5640 1 -- 172.21.15.59:0/689528830 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c01a7ee0 con 0x7f71c0101c90 2024-09-10T21:16:55.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.771+0000 7f71b67fc640 1 -- 172.21.15.59:0/689528830 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f71bc010430 con 0x7f71c0101c90 2024-09-10T21:16:55.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.772+0000 7f71b67fc640 1 --2- 172.21.15.59:0/689528830 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f71ac0b52e0 0x7f71ac0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:55.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.772+0000 7f71c4f70640 1 --2- 172.21.15.59:0/689528830 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f71ac0b52e0 0x7f71ac0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:55.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.772+0000 7f71b67fc640 1 -- 172.21.15.59:0/689528830 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f71bc0e5ef0 con 0x7f71c0101c90 2024-09-10T21:16:55.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.773+0000 7f71c9daa740 1 Processor -- start 2024-09-10T21:16:55.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.773+0000 7f71c4f70640 1 --2- 172.21.15.59:0/689528830 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f71ac0b52e0 0x7f71ac0b77a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f71c0107290 tx=0x7f71b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:55.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.773+0000 7f71c9daa740 1 -- start start 2024-09-10T21:16:55.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.773+0000 7f71c9daa740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a70a0 0x5584258a7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:55.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.773+0000 7f71c9daa740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258a79c0 0x5584258b3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:55.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.773+0000 7f71c9daa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258b3950 0x5584258b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:55.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.773+0000 7f71c9daa740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55842581de50 con 0x5584258a70a0 2024-09-10T21:16:55.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.773+0000 7f71c9daa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55842580d280 con 0x5584258b3950 2024-09-10T21:16:55.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.773+0000 7f71c9daa740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558425811090 con 0x5584258a79c0 2024-09-10T21:16:55.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.773+0000 7f71c5771640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a70a0 0x5584258a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:55.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.773+0000 7f71c5771640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a70a0 0x5584258a7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47216/0 (socket says 172.21.15.59:47216) 2024-09-10T21:16:55.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.773+0000 7f71c5771640 1 -- 172.21.15.59:0/2089562068 learned_addr learned my addr 172.21.15.59:0/2089562068 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:55.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.773+0000 7f71c4f70640 1 --2- 172.21.15.59:0/2089562068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258a79c0 0x5584258b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:55.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.773+0000 7f71c5771640 1 -- 172.21.15.59:0/2089562068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258a79c0 msgr2=0x5584258b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:55.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.773+0000 7f71c5f72640 1 --2- 172.21.15.59:0/2089562068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258b3950 0x5584258b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:55.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.773+0000 7f71c5771640 1 --2- 172.21.15.59:0/2089562068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258a79c0 0x5584258b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.774+0000 7f71c5771640 1 -- 172.21.15.59:0/2089562068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258b3950 msgr2=0x5584258b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:55.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.774+0000 7f71c5771640 1 --2- 172.21.15.59:0/2089562068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258b3950 0x5584258b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.774+0000 7f71c5771640 1 -- 172.21.15.59:0/2089562068 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55842556b650 con 0x5584258a70a0 2024-09-10T21:16:55.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.774+0000 7f71c4f70640 1 --2- 172.21.15.59:0/2089562068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258a79c0 0x5584258b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:16:55.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.774+0000 7f71c5f72640 1 --2- 172.21.15.59:0/2089562068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258b3950 0x5584258b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:16:55.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.774+0000 7f71c5771640 1 --2- 172.21.15.59:0/2089562068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a70a0 0x5584258a7480 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0a9a00 tx=0x7f71bc0abf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee26bfc1ab5738da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:55.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.774+0000 7f71ab7fe640 1 -- 172.21.15.59:0/2089562068 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc0b11c0 con 0x5584258a70a0 2024-09-10T21:16:55.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.774+0000 7f71ab7fe640 1 -- 172.21.15.59:0/2089562068 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71bc0b5c70 con 0x5584258a70a0 2024-09-10T21:16:55.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.774+0000 7f71ab7fe640 1 -- 172.21.15.59:0/2089562068 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc0a8340 con 0x5584258a70a0 2024-09-10T21:16:55.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.775+0000 7f71c9daa740 1 -- 172.21.15.59:0/2089562068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a70a0 msgr2=0x5584258a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:55.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.775+0000 7f71c9daa740 1 --2- 172.21.15.59:0/2089562068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a70a0 0x5584258a7480 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0a9a00 tx=0x7f71bc0abf00 comp rx=0 tx=0).stop 2024-09-10T21:16:55.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.775+0000 7f71c9daa740 1 -- 172.21.15.59:0/2089562068 shutdown_connections 2024-09-10T21:16:55.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.775+0000 7f71c9daa740 1 --2- 172.21.15.59:0/2089562068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258b3950 0x5584258b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.775+0000 7f71c9daa740 1 --2- 172.21.15.59:0/2089562068 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258a79c0 0x5584258b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.775+0000 7f71c9daa740 1 --2- 172.21.15.59:0/2089562068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a70a0 0x5584258a7480 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.775+0000 7f71c9daa740 1 -- 172.21.15.59:0/2089562068 >> 172.21.15.59:0/2089562068 conn(0x5584258a4ed0 msgr2=0x5584258a6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:55.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.775+0000 7f71c9daa740 1 -- 172.21.15.59:0/2089562068 shutdown_connections 2024-09-10T21:16:55.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.775+0000 7f71c9daa740 1 -- 172.21.15.59:0/2089562068 wait complete. 2024-09-10T21:16:55.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.775+0000 7f71c9daa740 1 -- start start 2024-09-10T21:16:55.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.775+0000 7f71c9daa740 1 Processor -- start 2024-09-10T21:16:55.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.776+0000 7f71c9daa740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258a70a0 0x5584258b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:55.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.776+0000 7f71c9daa740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 0x5584258b0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:55.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.776+0000 7f71c9daa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258b3950 0x5584258b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:55.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.776+0000 7f71c9daa740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55842566e700 con 0x5584258a79c0 2024-09-10T21:16:55.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.776+0000 7f71c9daa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5584257a8110 con 0x5584258b3950 2024-09-10T21:16:55.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.776+0000 7f71c9daa740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5584258b6570 con 0x5584258a70a0 2024-09-10T21:16:55.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.776+0000 7f71c9daa740 10 client.0 _ll_register_callbacks cb 0x5584257c1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:55.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.776+0000 7f71c4f70640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 0x5584258b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:55.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.776+0000 7f71c4f70640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 0x5584258b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47218/0 (socket says 172.21.15.59:47218) 2024-09-10T21:16:55.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.776+0000 7f71c4f70640 1 -- 172.21.15.59:0/2519032385 learned_addr learned my addr 172.21.15.59:0/2519032385 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:55.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.776+0000 7f71c5771640 1 --2- 172.21.15.59:0/2519032385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258a70a0 0x5584258b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:55.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.776+0000 7f71c5f72640 1 --2- 172.21.15.59:0/2519032385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258b3950 0x5584258b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:55.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.776+0000 7f71c4f70640 1 -- 172.21.15.59:0/2519032385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258a70a0 msgr2=0x5584258b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:55.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.776+0000 7f71c4f70640 1 --2- 172.21.15.59:0/2519032385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258a70a0 0x5584258b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.776+0000 7f71c4f70640 1 -- 172.21.15.59:0/2519032385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258b3950 msgr2=0x5584258b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:55.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.776+0000 7f71c4f70640 1 --2- 172.21.15.59:0/2519032385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258b3950 0x5584258b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.776+0000 7f71c4f70640 1 -- 172.21.15.59:0/2519032385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584257d5c40 con 0x5584258a79c0 2024-09-10T21:16:55.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.776+0000 7f71c5771640 1 --2- 172.21.15.59:0/2519032385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258a70a0 0x5584258b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:16:55.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.776+0000 7f71c5f72640 1 --2- 172.21.15.59:0/2519032385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258b3950 0x5584258b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:16:55.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.777+0000 7f71c4f70640 1 --2- 172.21.15.59:0/2519032385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 0x5584258b0640 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f71b0003870 tx=0x7f71b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd59751b22cc0dee server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:55.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.777+0000 7f71a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:55.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.777+0000 7f71a8ff9640 1 -- 172.21.15.59:0/2519032385 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b001db30 con 0x5584258a79c0 2024-09-10T21:16:55.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.777+0000 7f71a8ff9640 1 -- 172.21.15.59:0/2519032385 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f71b001dcd0 con 0x5584258a79c0 2024-09-10T21:16:55.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.777+0000 7f71c9daa740 1 -- 172.21.15.59:0/2519032385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71bc0b5c70 con 0x5584258a79c0 2024-09-10T21:16:55.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.777+0000 7f71a8ff9640 1 -- 172.21.15.59:0/2519032385 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f71b001e420 con 0x5584258a79c0 2024-09-10T21:16:55.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.777+0000 7f71c9daa740 10 client.15690 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:55.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.777+0000 7f71c9daa740 1 -- 172.21.15.59:0/2519032385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5584258c1e30 con 0x5584258a79c0 2024-09-10T21:16:55.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.777+0000 7f71a8ff9640 1 -- 172.21.15.59:0/2519032385 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71bc0b5c70 con 0x5584258a79c0 2024-09-10T21:16:55.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.777+0000 7f71a8ff9640 1 -- 172.21.15.59:0/2519032385 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f71b0032750 con 0x5584258a79c0 2024-09-10T21:16:55.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.778+0000 7f71c9daa740 10 client.15690 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:55.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.778+0000 7f71c9daa740 10 client.15690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:16:55.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.778+0000 7f71c9daa740 20 client.15690 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:55.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.778+0000 7f71c9daa740 1 --2- 172.21.15.59:0/2519032385 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5584258c3300 0x5584258c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:55.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.778+0000 7f71c9daa740 4 client.15690 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:16:55.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.778+0000 7f71c9daa740 1 -- 172.21.15.59:0/2519032385 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55842581fda0 con 0x5584258c3300 2024-09-10T21:16:55.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.778+0000 7f71c5771640 1 --2- 172.21.15.59:0/2519032385 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5584258c3300 0x5584258c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:55.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.778+0000 7f71a8ff9640 10 client.15690 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:55.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.778+0000 7f71c5771640 1 --2- 172.21.15.59:0/2519032385 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5584258c3300 0x5584258c56f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92e6107f30f423ef server_cookie=c03521d2bfae15b in_seq=0 out_seq=0 2024-09-10T21:16:55.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.779+0000 7f71a8ff9640 1 -- 172.21.15.59:0/2519032385 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55842581fda0 con 0x5584258c3300 2024-09-10T21:16:55.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.779+0000 7f71a8ff9640 10 client.15690 handle_command_reply: tid=0 2024-09-10T21:16:55.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.779+0000 7f71c9daa740 1 client.15690 shutdown 2024-09-10T21:16:55.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.779+0000 7f71c9daa740 1 -- 172.21.15.59:0/2519032385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 msgr2=0x5584258b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:55.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.779+0000 7f71c9daa740 1 --2- 172.21.15.59:0/2519032385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 0x5584258b0640 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f71b0003870 tx=0x7f71b0004730 comp rx=0 tx=0).stop 2024-09-10T21:16:55.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.779+0000 7f71c9daa740 1 -- 172.21.15.59:0/2519032385 shutdown_connections 2024-09-10T21:16:55.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.779+0000 7f71c9daa740 1 --2- 172.21.15.59:0/2519032385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258b3950 0x5584258b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.779+0000 7f71c9daa740 1 --2- 172.21.15.59:0/2519032385 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5584258c3300 0x5584258c56f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.779+0000 7f71c9daa740 1 --2- 172.21.15.59:0/2519032385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 0x5584258b0640 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.779+0000 7f71c9daa740 1 --2- 172.21.15.59:0/2519032385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258a70a0 0x5584258b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.779+0000 7f71a8ff9640 0 client.15690 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:55.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.779+0000 7f71c9daa740 1 -- 172.21.15.59:0/2519032385 >> 172.21.15.59:0/2519032385 conn(0x5584258a4ed0 msgr2=0x5584258aaa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:55.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.779+0000 7f71c9daa740 1 -- 172.21.15.59:0/2519032385 shutdown_connections 2024-09-10T21:16:55.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.779+0000 7f71c9daa740 1 -- 172.21.15.59:0/2519032385 wait complete. 2024-09-10T21:16:55.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.780+0000 7f71c9daa740 20 client.15690 trim_cache size 0 max 16384 2024-09-10T21:16:55.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.797+0000 7f71c9daa740 1 Processor -- start 2024-09-10T21:16:55.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.797+0000 7f71c9daa740 1 -- start start 2024-09-10T21:16:55.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.798+0000 7f71c9daa740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258a70a0 0x5584258a4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:55.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.798+0000 7f71c9daa740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 0x5584258aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:55.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.798+0000 7f71c9daa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258b3950 0x5584258af400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:55.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.798+0000 7f71c9daa740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f71c01b05a0 con 0x5584258a79c0 2024-09-10T21:16:55.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.798+0000 7f71c9daa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f71c01b20e0 con 0x5584258b3950 2024-09-10T21:16:55.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.798+0000 7f71c9daa740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f71c01b0c70 con 0x5584258a70a0 2024-09-10T21:16:55.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.798+0000 7f71c4f70640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 0x5584258aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:55.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.798+0000 7f71c4f70640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 0x5584258aeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47234/0 (socket says 172.21.15.59:47234) 2024-09-10T21:16:55.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.798+0000 7f71c5771640 1 --2- 172.21.15.59:0/4249584954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258a70a0 0x5584258a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:55.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.798+0000 7f71c4f70640 1 -- 172.21.15.59:0/4249584954 learned_addr learned my addr 172.21.15.59:0/4249584954 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:55.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.798+0000 7f71c5f72640 1 --2- 172.21.15.59:0/4249584954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258b3950 0x5584258af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:55.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.798+0000 7f71c5f72640 1 -- 172.21.15.59:0/4249584954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258a70a0 msgr2=0x5584258a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:55.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.798+0000 7f71c5f72640 1 --2- 172.21.15.59:0/4249584954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258a70a0 0x5584258a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.798+0000 7f71c5f72640 1 -- 172.21.15.59:0/4249584954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 msgr2=0x5584258aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:55.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.798+0000 7f71c5f72640 1 --2- 172.21.15.59:0/4249584954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 0x5584258aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.798+0000 7f71c5f72640 1 -- 172.21.15.59:0/4249584954 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584258b1910 con 0x5584258b3950 2024-09-10T21:16:55.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.798+0000 7f71c4f70640 1 --2- 172.21.15.59:0/4249584954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 0x5584258aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:16:55.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.799+0000 7f71c5f72640 1 --2- 172.21.15.59:0/4249584954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258b3950 0x5584258af400 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f71b8006010 tx=0x7f71b8005f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d821ebdad582ac7e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:55.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.799+0000 7f71aaffd640 1 -- 172.21.15.59:0/4249584954 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b8031cf0 con 0x5584258b3950 2024-09-10T21:16:55.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.799+0000 7f71aaffd640 1 -- 172.21.15.59:0/4249584954 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71b8036040 con 0x5584258b3950 2024-09-10T21:16:55.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.799+0000 7f71aaffd640 1 -- 172.21.15.59:0/4249584954 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b8004040 con 0x5584258b3950 2024-09-10T21:16:55.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.800+0000 7f71c9daa740 1 -- 172.21.15.59:0/4249584954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258b3950 msgr2=0x5584258af400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:55.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.800+0000 7f71c9daa740 1 --2- 172.21.15.59:0/4249584954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258b3950 0x5584258af400 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f71b8006010 tx=0x7f71b8005f70 comp rx=0 tx=0).stop 2024-09-10T21:16:55.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.800+0000 7f71c9daa740 1 -- 172.21.15.59:0/4249584954 shutdown_connections 2024-09-10T21:16:55.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.800+0000 7f71c9daa740 1 --2- 172.21.15.59:0/4249584954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258b3950 0x5584258af400 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.800+0000 7f71c9daa740 1 --2- 172.21.15.59:0/4249584954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 0x5584258aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.800+0000 7f71c9daa740 1 --2- 172.21.15.59:0/4249584954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258a70a0 0x5584258a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.800+0000 7f71c9daa740 1 -- 172.21.15.59:0/4249584954 >> 172.21.15.59:0/4249584954 conn(0x5584258a4ed0 msgr2=0x5584258a5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:55.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.800+0000 7f71c9daa740 1 -- 172.21.15.59:0/4249584954 shutdown_connections 2024-09-10T21:16:55.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.800+0000 7f71c9daa740 1 -- 172.21.15.59:0/4249584954 wait complete. 2024-09-10T21:16:55.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.800+0000 7f71c9daa740 1 -- start start 2024-09-10T21:16:55.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.800+0000 7f71c9daa740 1 Processor -- start 2024-09-10T21:16:55.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.801+0000 7f71c9daa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258a70a0 0x5584258bb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:55.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.801+0000 7f71c9daa740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 0x5584258bbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:55.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.801+0000 7f71c9daa740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258b3950 0x5584258b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:55.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.801+0000 7f71c9daa740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f71c01b1a10 con 0x5584258a79c0 2024-09-10T21:16:55.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.801+0000 7f71c9daa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f71c01b1340 con 0x5584258a70a0 2024-09-10T21:16:55.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.801+0000 7f71c9daa740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f71c01ae580 con 0x5584258b3950 2024-09-10T21:16:55.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.801+0000 7f71c9daa740 10 client.0 _ll_register_callbacks cb 0x7f71b00045b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:55.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.801+0000 7f71c4f70640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 0x5584258bbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:55.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.801+0000 7f71c4f70640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 0x5584258bbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47246/0 (socket says 172.21.15.59:47246) 2024-09-10T21:16:55.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.801+0000 7f71c4f70640 1 -- 172.21.15.59:0/2304460843 learned_addr learned my addr 172.21.15.59:0/2304460843 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:55.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.801+0000 7f71c5771640 1 --2- 172.21.15.59:0/2304460843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258a70a0 0x5584258bb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:55.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.801+0000 7f71c5f72640 1 --2- 172.21.15.59:0/2304460843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258b3950 0x5584258b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:55.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.801+0000 7f71c4f70640 1 -- 172.21.15.59:0/2304460843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258b3950 msgr2=0x5584258b67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:55.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.801+0000 7f71c4f70640 1 --2- 172.21.15.59:0/2304460843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258b3950 0x5584258b67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.801+0000 7f71c4f70640 1 -- 172.21.15.59:0/2304460843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258a70a0 msgr2=0x5584258bb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:55.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.801+0000 7f71c4f70640 1 --2- 172.21.15.59:0/2304460843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258a70a0 0x5584258bb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.801+0000 7f71c4f70640 1 -- 172.21.15.59:0/2304460843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584258b6d50 con 0x5584258a79c0 2024-09-10T21:16:55.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.801+0000 7f71c4f70640 1 --2- 172.21.15.59:0/2304460843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 0x5584258bbd50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f71b0003870 tx=0x7f71b001da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a290a026ffd7ee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:55.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.801+0000 7f71a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:55.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.802+0000 7f71a8ff9640 1 -- 172.21.15.59:0/2304460843 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b001de30 con 0x5584258a79c0 2024-09-10T21:16:55.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.802+0000 7f71c9daa740 1 -- 172.21.15.59:0/2304460843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71b8036040 con 0x5584258a79c0 2024-09-10T21:16:55.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.802+0000 7f71a8ff9640 1 -- 172.21.15.59:0/2304460843 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f71b001e5c0 con 0x5584258a79c0 2024-09-10T21:16:55.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.802+0000 7f71a8ff9640 1 -- 172.21.15.59:0/2304460843 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f71b001e7c0 con 0x5584258a79c0 2024-09-10T21:16:55.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.802+0000 7f71c9daa740 10 client.15696 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:55.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.802+0000 7f71c9daa740 1 -- 172.21.15.59:0/2304460843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558425930a50 con 0x5584258a79c0 2024-09-10T21:16:55.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.802+0000 7f71a8ff9640 1 -- 172.21.15.59:0/2304460843 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71b8036040 con 0x5584258a79c0 2024-09-10T21:16:55.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.802+0000 7f71a8ff9640 1 -- 172.21.15.59:0/2304460843 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f71b001b5b0 con 0x5584258a79c0 2024-09-10T21:16:55.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.802+0000 7f71c9daa740 10 client.15696 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:55.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.802+0000 7f71c9daa740 10 client.15696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:16:55.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.802+0000 7f71c9daa740 20 client.15696 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:55.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.802+0000 7f71c9daa740 1 --2- 172.21.15.59:0/2304460843 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5584259311f0 0x558425933610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:55.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.802+0000 7f71c9daa740 4 client.15696 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:16:55.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.802+0000 7f71c9daa740 1 -- 172.21.15.59:0/2304460843 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55842581b850 con 0x5584259311f0 2024-09-10T21:16:55.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.803+0000 7f71c5771640 1 --2- 172.21.15.59:0/2304460843 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5584259311f0 0x558425933610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:55.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.803+0000 7f71a8ff9640 10 client.15696 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:55.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.803+0000 7f71c5771640 1 --2- 172.21.15.59:0/2304460843 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5584259311f0 0x558425933610 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55e771bdc41c79a3 server_cookie=7626a78c6eeb158d in_seq=0 out_seq=0 2024-09-10T21:16:55.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.803+0000 7f71a8ff9640 1 -- 172.21.15.59:0/2304460843 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x55842581b850 con 0x5584259311f0 2024-09-10T21:16:55.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.803+0000 7f71a8ff9640 10 client.15696 handle_command_reply: tid=0 2024-09-10T21:16:55.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.803+0000 7f71c9daa740 1 client.15696 shutdown 2024-09-10T21:16:55.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.804+0000 7f71c9daa740 1 -- 172.21.15.59:0/2304460843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 msgr2=0x5584258bbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:55.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.804+0000 7f71c9daa740 1 --2- 172.21.15.59:0/2304460843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 0x5584258bbd50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f71b0003870 tx=0x7f71b001da30 comp rx=0 tx=0).stop 2024-09-10T21:16:55.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.804+0000 7f71c9daa740 1 -- 172.21.15.59:0/2304460843 shutdown_connections 2024-09-10T21:16:55.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.804+0000 7f71c9daa740 1 --2- 172.21.15.59:0/2304460843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584258b3950 0x5584258b67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.804+0000 7f71c9daa740 1 --2- 172.21.15.59:0/2304460843 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5584259311f0 0x558425933610 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.804+0000 7f71c9daa740 1 --2- 172.21.15.59:0/2304460843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584258a79c0 0x5584258bbd50 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.804+0000 7f71a8ff9640 0 client.15696 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:16:55.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.804+0000 7f71c9daa740 1 --2- 172.21.15.59:0/2304460843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584258a70a0 0x5584258bb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.804+0000 7f71c9daa740 1 -- 172.21.15.59:0/2304460843 >> 172.21.15.59:0/2304460843 conn(0x5584258a4ed0 msgr2=0x5584258aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:55.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.804+0000 7f71c9daa740 1 -- 172.21.15.59:0/2304460843 shutdown_connections 2024-09-10T21:16:55.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.804+0000 7f71c9daa740 1 -- 172.21.15.59:0/2304460843 wait complete. 2024-09-10T21:16:55.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.804+0000 7f71c9daa740 20 client.15696 trim_cache size 0 max 16384 2024-09-10T21:16:55.813 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:16:55.813 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:16:55.813 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:16:55.813 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:16:55.814 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:16:55.814 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:16:55.814 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:16:55.814 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:16:55.814 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:16:55.814 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:16:55.814 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:16:55.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:16:55.814 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:16:55.814 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:16:55.814 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:16:55.814 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:16:55.814 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:16:55.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:16:55.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:16:55.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:16:55.815 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:16:55.815 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:16:55.815 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:16:55.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:16:55.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:16:55.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:16:55.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:16:55.815 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:16:55.815 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:16:55.815 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:16:55.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.805+0000 7f71c79d5640 1 -- 172.21.15.59:0/689528830 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f71ac0b52e0 msgr2=0x7f71ac0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:55.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.805+0000 7f71c79d5640 1 --2- 172.21.15.59:0/689528830 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f71ac0b52e0 0x7f71ac0b77a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f71c0107290 tx=0x7f71b0005f90 comp rx=0 tx=0).stop 2024-09-10T21:16:55.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.805+0000 7f71c79d5640 1 -- 172.21.15.59:0/689528830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71c0101c90 msgr2=0x7f71c0197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:55.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.805+0000 7f71c79d5640 1 --2- 172.21.15.59:0/689528830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71c0101c90 0x7f71c0197e80 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00e9f0 tx=0x7f71bc00eeb0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.805+0000 7f71c79d5640 1 -- 172.21.15.59:0/689528830 shutdown_connections 2024-09-10T21:16:55.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.805+0000 7f71c79d5640 1 --2- 172.21.15.59:0/689528830 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f71ac0b52e0 0x7f71ac0b77a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.805+0000 7f71c79d5640 1 --2- 172.21.15.59:0/689528830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71c0108020 0x7f71c0198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.805+0000 7f71c79d5640 1 --2- 172.21.15.59:0/689528830 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71c01076a0 0x7f71c01983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.805+0000 7f71c79d5640 1 --2- 172.21.15.59:0/689528830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71c0101c90 0x7f71c0197e80 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:55.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.805+0000 7f71c79d5640 1 -- 172.21.15.59:0/689528830 >> 172.21.15.59:0/689528830 conn(0x7f71c00fd700 msgr2=0x7f71c00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:55.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.805+0000 7f71c79d5640 1 -- 172.21.15.59:0/689528830 shutdown_connections 2024-09-10T21:16:55.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:55.805+0000 7f71c79d5640 1 -- 172.21.15.59:0/689528830 wait complete. 2024-09-10T21:16:56.597 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:16:56.598 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:16:56.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:56 smithi059 ceph-mon[30888]: pgmap v390: 97 pgs: 97 active+clean; 1.0 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:16:56.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:56 smithi154 ceph-mon[35041]: pgmap v390: 97 pgs: 97 active+clean; 1.0 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:16:56.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:56 smithi192 ceph-mon[35363]: pgmap v390: 97 pgs: 97 active+clean; 1.0 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:16:56.869 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:16:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.369+0000 7f40babd4640 1 -- 172.21.15.59:0/2188676122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b41087a0 msgr2=0x7f40b4108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.369+0000 7f40babd4640 1 --2- 172.21.15.59:0/2188676122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b41087a0 0x7f40b4108be0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f409c009900 tx=0x7f409c02a3f0 comp rx=0 tx=0).stop 2024-09-10T21:16:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.369+0000 7f40babd4640 1 -- 172.21.15.59:0/2188676122 shutdown_connections 2024-09-10T21:16:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.369+0000 7f40babd4640 1 --2- 172.21.15.59:0/2188676122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40b4109120 0x7f40b410f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.369+0000 7f40babd4640 1 --2- 172.21.15.59:0/2188676122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b41087a0 0x7f40b4108be0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.369+0000 7f40babd4640 1 --2- 172.21.15.59:0/2188676122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40b4102d90 0x7f40b4103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.369+0000 7f40babd4640 1 -- 172.21.15.59:0/2188676122 >> 172.21.15.59:0/2188676122 conn(0x7f40b40fe820 msgr2=0x7f40b4100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.369+0000 7f40babd4640 1 -- 172.21.15.59:0/2188676122 shutdown_connections 2024-09-10T21:16:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.369+0000 7f40babd4640 1 -- 172.21.15.59:0/2188676122 wait complete. 2024-09-10T21:16:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.370+0000 7f40babd4640 1 Processor -- start 2024-09-10T21:16:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.370+0000 7f40babd4640 1 -- start start 2024-09-10T21:16:57.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.370+0000 7f40babd4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40b4102d90 0x7f40b4199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:57.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.370+0000 7f40babd4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b41087a0 0x7f40b4199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:57.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.370+0000 7f40babd4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40b4109120 0x7f40b419eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:57.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.370+0000 7f40babd4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f40b4112de0 con 0x7f40b41087a0 2024-09-10T21:16:57.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.370+0000 7f40babd4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f40b4112c60 con 0x7f40b4109120 2024-09-10T21:16:57.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.370+0000 7f40babd4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f40b4112f60 con 0x7f40b4102d90 2024-09-10T21:16:57.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.370+0000 7f40b3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b41087a0 0x7f40b4199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:57.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.370+0000 7f40b3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b41087a0 0x7f40b4199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47276/0 (socket says 172.21.15.59:47276) 2024-09-10T21:16:57.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.370+0000 7f40b3fff640 1 -- 172.21.15.59:0/2314063720 learned_addr learned my addr 172.21.15.59:0/2314063720 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:57.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.370+0000 7f40b8970640 1 --2- 172.21.15.59:0/2314063720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40b4102d90 0x7f40b4199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:57.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.370+0000 7f40b3fff640 1 -- 172.21.15.59:0/2314063720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40b4102d90 msgr2=0x7f40b4199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:57.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.370+0000 7f40b3fff640 1 --2- 172.21.15.59:0/2314063720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40b4102d90 0x7f40b4199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:57.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.370+0000 7f40b3fff640 1 -- 172.21.15.59:0/2314063720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40b4109120 msgr2=0x7f40b419eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:57.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.370+0000 7f40b3fff640 1 --2- 172.21.15.59:0/2314063720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40b4109120 0x7f40b419eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:57.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.370+0000 7f40b3fff640 1 -- 172.21.15.59:0/2314063720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b419f2c0 con 0x7f40b41087a0 2024-09-10T21:16:57.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.371+0000 7f40b3fff640 1 --2- 172.21.15.59:0/2314063720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b41087a0 0x7f40b4199750 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f409c006010 tx=0x7f409c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:57.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.371+0000 7f40b1ffb640 1 -- 172.21.15.59:0/2314063720 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c03f030 con 0x7f40b41087a0 2024-09-10T21:16:57.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.371+0000 7f40b1ffb640 1 -- 172.21.15.59:0/2314063720 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f409c003800 con 0x7f40b41087a0 2024-09-10T21:16:57.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.371+0000 7f40b1ffb640 1 -- 172.21.15.59:0/2314063720 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c035070 con 0x7f40b41087a0 2024-09-10T21:16:57.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.371+0000 7f40babd4640 1 -- 172.21.15.59:0/2314063720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b419f550 con 0x7f40b41087a0 2024-09-10T21:16:57.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.371+0000 7f40babd4640 1 -- 172.21.15.59:0/2314063720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b41a5c70 con 0x7f40b41087a0 2024-09-10T21:16:57.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.372+0000 7f40babd4640 1 -- 172.21.15.59:0/2314063720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40b4103170 con 0x7f40b41087a0 2024-09-10T21:16:57.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.374+0000 7f40b1ffb640 1 -- 172.21.15.59:0/2314063720 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f409c031b10 con 0x7f40b41087a0 2024-09-10T21:16:57.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.374+0000 7f40b1ffb640 1 --2- 172.21.15.59:0/2314063720 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f40a00b5360 0x7f40a00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:57.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.374+0000 7f40b8970640 1 --2- 172.21.15.59:0/2314063720 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f40a00b5360 0x7f40a00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:57.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.374+0000 7f40b1ffb640 1 -- 172.21.15.59:0/2314063720 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f409c1067c0 con 0x7f40b41087a0 2024-09-10T21:16:57.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.375+0000 7f40b8970640 1 --2- 172.21.15.59:0/2314063720 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f40a00b5360 0x7f40a00b7820 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f40a4005e10 tx=0x7f40a4005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:57.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.377+0000 7f40b1ffb640 1 -- 172.21.15.59:0/2314063720 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f409c0cd6b0 con 0x7f40b41087a0 2024-09-10T21:16:57.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.599+0000 7f40babd4640 1 -- 172.21.15.59:0/2314063720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40b41a6070 con 0x7f40b41087a0 2024-09-10T21:16:57.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.599+0000 7f40b1ffb640 1 -- 172.21.15.59:0/2314063720 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f409c0ccfb0 con 0x7f40b41087a0 2024-09-10T21:16:57.604 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:16:57.605 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:16:57.605 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:16:57.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.602+0000 7f40babd4640 1 -- 172.21.15.59:0/2314063720 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f40a00b5360 msgr2=0x7f40a00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:57.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.602+0000 7f40babd4640 1 --2- 172.21.15.59:0/2314063720 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f40a00b5360 0x7f40a00b7820 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f40a4005e10 tx=0x7f40a4005da0 comp rx=0 tx=0).stop 2024-09-10T21:16:57.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.602+0000 7f40babd4640 1 -- 172.21.15.59:0/2314063720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b41087a0 msgr2=0x7f40b4199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:57.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.602+0000 7f40babd4640 1 --2- 172.21.15.59:0/2314063720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b41087a0 0x7f40b4199750 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f409c006010 tx=0x7f409c0042f0 comp rx=0 tx=0).stop 2024-09-10T21:16:57.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.602+0000 7f40babd4640 1 -- 172.21.15.59:0/2314063720 shutdown_connections 2024-09-10T21:16:57.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.602+0000 7f40babd4640 1 --2- 172.21.15.59:0/2314063720 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f40a00b5360 0x7f40a00b7820 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:57.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.602+0000 7f40babd4640 1 --2- 172.21.15.59:0/2314063720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40b4109120 0x7f40b419eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:57.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.602+0000 7f40babd4640 1 --2- 172.21.15.59:0/2314063720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b41087a0 0x7f40b4199750 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:57.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.602+0000 7f40babd4640 1 --2- 172.21.15.59:0/2314063720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40b4102d90 0x7f40b4199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:57.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.602+0000 7f40babd4640 1 -- 172.21.15.59:0/2314063720 >> 172.21.15.59:0/2314063720 conn(0x7f40b40fe820 msgr2=0x7f40b4100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:57.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.602+0000 7f40babd4640 1 -- 172.21.15.59:0/2314063720 shutdown_connections 2024-09-10T21:16:57.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:57.602+0000 7f40babd4640 1 -- 172.21.15.59:0/2314063720 wait complete. 2024-09-10T21:16:58.233 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:16:58.494 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:16:58.616 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:58 smithi059 ceph-mon[30888]: pgmap v391: 97 pgs: 97 active+clean; 1.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:16:58.616 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:16:58 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2314063720' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:16:58.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:58 smithi154 ceph-mon[35041]: pgmap v391: 97 pgs: 97 active+clean; 1.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:16:58.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:16:58 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2314063720' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:16:58.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:58 smithi192 ceph-mon[35363]: pgmap v391: 97 pgs: 97 active+clean; 1.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:16:58.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:16:58 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2314063720' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:16:58.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.994+0000 7f484ffe7640 1 -- 172.21.15.59:0/4293048525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48481076a0 msgr2=0x7f4848107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:58.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.994+0000 7f484ffe7640 1 --2- 172.21.15.59:0/4293048525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48481076a0 0x7f4848107ae0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4838009900 tx=0x7f483802a410 comp rx=0 tx=0).stop 2024-09-10T21:16:58.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.994+0000 7f484ffe7640 1 -- 172.21.15.59:0/4293048525 shutdown_connections 2024-09-10T21:16:58.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.994+0000 7f484ffe7640 1 --2- 172.21.15.59:0/4293048525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4848108020 0x7f484810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:58.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.994+0000 7f484ffe7640 1 --2- 172.21.15.59:0/4293048525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48481076a0 0x7f4848107ae0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:58.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.994+0000 7f484ffe7640 1 --2- 172.21.15.59:0/4293048525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4848101c90 0x7f4848102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.994+0000 7f484ffe7640 1 -- 172.21.15.59:0/4293048525 >> 172.21.15.59:0/4293048525 conn(0x7f48480fd700 msgr2=0x7f48480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:59.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.994+0000 7f484ffe7640 1 -- 172.21.15.59:0/4293048525 shutdown_connections 2024-09-10T21:16:59.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.994+0000 7f484ffe7640 1 -- 172.21.15.59:0/4293048525 wait complete. 2024-09-10T21:16:59.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.995+0000 7f484ffe7640 1 Processor -- start 2024-09-10T21:16:59.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.995+0000 7f484ffe7640 1 -- start start 2024-09-10T21:16:59.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.995+0000 7f484ffe7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4848101c90 0x7f484819b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:59.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.995+0000 7f484ffe7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48481076a0 0x7f484819bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:59.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.995+0000 7f484ffe7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4848108020 0x7f48481a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:59.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.995+0000 7f484ffe7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4848111d20 con 0x7f4848108020 2024-09-10T21:16:59.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.995+0000 7f484ffe7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4848111ba0 con 0x7f48481076a0 2024-09-10T21:16:59.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.995+0000 7f484ffe7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4848111ea0 con 0x7f4848101c90 2024-09-10T21:16:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.995+0000 7f484e584640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4848108020 0x7f48481a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.995+0000 7f484e584640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4848108020 0x7f48481a0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47290/0 (socket says 172.21.15.59:47290) 2024-09-10T21:16:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.995+0000 7f484e584640 1 -- 172.21.15.59:0/1856012775 learned_addr learned my addr 172.21.15.59:0/1856012775 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.995+0000 7f484dd83640 1 --2- 172.21.15.59:0/1856012775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4848101c90 0x7f484819b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.995+0000 7f484d582640 1 --2- 172.21.15.59:0/1856012775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48481076a0 0x7f484819bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.995+0000 7f484e584640 1 -- 172.21.15.59:0/1856012775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4848101c90 msgr2=0x7f484819b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.995+0000 7f484e584640 1 --2- 172.21.15.59:0/1856012775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4848101c90 0x7f484819b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.995+0000 7f484e584640 1 -- 172.21.15.59:0/1856012775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48481076a0 msgr2=0x7f484819bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.995+0000 7f484e584640 1 --2- 172.21.15.59:0/1856012775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48481076a0 0x7f484819bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.995+0000 7f484e584640 1 -- 172.21.15.59:0/1856012775 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48481a1690 con 0x7f4848108020 2024-09-10T21:16:59.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.995+0000 7f484dd83640 1 --2- 172.21.15.59:0/1856012775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4848101c90 0x7f484819b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:16:59.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.996+0000 7f484e584640 1 --2- 172.21.15.59:0/1856012775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4848108020 0x7f48481a0ec0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f484000b970 tx=0x7f484000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:59.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.996+0000 7f483effd640 1 -- 172.21.15.59:0/1856012775 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4840019070 con 0x7f4848108020 2024-09-10T21:16:59.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.996+0000 7f483effd640 1 -- 172.21.15.59:0/1856012775 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4840014440 con 0x7f4848108020 2024-09-10T21:16:59.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.996+0000 7f484ffe7640 1 -- 172.21.15.59:0/1856012775 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48481a1980 con 0x7f4848108020 2024-09-10T21:16:59.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.996+0000 7f483effd640 1 -- 172.21.15.59:0/1856012775 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48400075d0 con 0x7f4848108020 2024-09-10T21:16:59.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.996+0000 7f484ffe7640 1 -- 172.21.15.59:0/1856012775 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48481a80c0 con 0x7f4848108020 2024-09-10T21:16:59.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.998+0000 7f48523bc740 1 Processor -- start 2024-09-10T21:16:59.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.998+0000 7f483effd640 1 -- 172.21.15.59:0/1856012775 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f484000cb40 con 0x7f4848108020 2024-09-10T21:16:59.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.999+0000 7f48523bc740 1 -- start start 2024-09-10T21:16:59.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.999+0000 7f48523bc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b44d0 0x560c410b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:59.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.999+0000 7f48523bc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410b4df0 0x560c410c0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:59.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.999+0000 7f48523bc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410c0d80 0x560c410c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:59.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.999+0000 7f48523bc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560c4102aea0 con 0x560c410b44d0 2024-09-10T21:16:59.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.999+0000 7f48523bc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560c4101a2d0 con 0x560c410c0d80 2024-09-10T21:16:59.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.999+0000 7f48523bc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x560c4101e0e0 con 0x560c410b4df0 2024-09-10T21:16:59.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.999+0000 7f484d582640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b44d0 0x560c410b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:59.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.999+0000 7f484d582640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b44d0 0x560c410b48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47296/0 (socket says 172.21.15.59:47296) 2024-09-10T21:16:59.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.999+0000 7f484d582640 1 -- 172.21.15.59:0/3423576725 learned_addr learned my addr 172.21.15.59:0/3423576725 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:59.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.999+0000 7f484dd83640 1 --2- 172.21.15.59:0/3423576725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410b4df0 0x560c410c0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:59.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.999+0000 7f484d582640 1 -- 172.21.15.59:0/3423576725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410b4df0 msgr2=0x560c410c0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:59.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.999+0000 7f484d582640 1 --2- 172.21.15.59:0/3423576725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410b4df0 0x560c410c0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.999+0000 7f484d582640 1 -- 172.21.15.59:0/3423576725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410c0d80 msgr2=0x560c410c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.999+0000 7f484d582640 1 --2- 172.21.15.59:0/3423576725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410c0d80 0x560c410c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.999+0000 7f484d582640 1 -- 172.21.15.59:0/3423576725 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c40d78650 con 0x560c410b44d0 2024-09-10T21:16:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:58.999+0000 7f483effd640 1 --2- 172.21.15.59:0/1856012775 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f48340b5360 0x7f48340b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.000+0000 7f484d582640 1 --2- 172.21.15.59:0/3423576725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b44d0 0x560c410b48b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f483802a930 tx=0x7f4838005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d12e32791bdc30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.000+0000 7f484dd83640 1 --2- 172.21.15.59:0/1856012775 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f48340b5360 0x7f48340b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.000+0000 7f483effd640 1 -- 172.21.15.59:0/1856012775 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f48400e5340 con 0x7f4848108020 2024-09-10T21:16:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.000+0000 7f4833fff640 1 -- 172.21.15.59:0/3423576725 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838035050 con 0x560c410b44d0 2024-09-10T21:16:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.000+0000 7f4833fff640 1 -- 172.21.15.59:0/3423576725 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48380316a0 con 0x560c410b44d0 2024-09-10T21:16:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.000+0000 7f4833fff640 1 -- 172.21.15.59:0/3423576725 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48380047a0 con 0x560c410b44d0 2024-09-10T21:16:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.001+0000 7f48523bc740 1 -- 172.21.15.59:0/3423576725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b44d0 msgr2=0x560c410b48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.001+0000 7f484dd83640 1 --2- 172.21.15.59:0/1856012775 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f48340b5360 0x7f48340b7820 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x560c410b31e0 tx=0x7f4844008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:59.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.001+0000 7f48523bc740 1 --2- 172.21.15.59:0/3423576725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b44d0 0x560c410b48b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f483802a930 tx=0x7f4838005df0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.001+0000 7f48523bc740 1 -- 172.21.15.59:0/3423576725 shutdown_connections 2024-09-10T21:16:59.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.001+0000 7f48523bc740 1 --2- 172.21.15.59:0/3423576725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410c0d80 0x560c410c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.001+0000 7f48523bc740 1 --2- 172.21.15.59:0/3423576725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410b4df0 0x560c410c0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.001+0000 7f48523bc740 1 --2- 172.21.15.59:0/3423576725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b44d0 0x560c410b48b0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.001+0000 7f48523bc740 1 -- 172.21.15.59:0/3423576725 >> 172.21.15.59:0/3423576725 conn(0x560c410b2300 msgr2=0x560c410b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:59.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.001+0000 7f48523bc740 1 -- 172.21.15.59:0/3423576725 shutdown_connections 2024-09-10T21:16:59.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.001+0000 7f48523bc740 1 -- 172.21.15.59:0/3423576725 wait complete. 2024-09-10T21:16:59.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.001+0000 7f48523bc740 1 -- start start 2024-09-10T21:16:59.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.001+0000 7f48523bc740 1 Processor -- start 2024-09-10T21:16:59.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f48523bc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b44d0 0x560c410c0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:59.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f48523bc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410b4df0 0x560c410bda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:59.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f48523bc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410c0d80 0x560c410be070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:59.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f48523bc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560c40e7b700 con 0x560c410b44d0 2024-09-10T21:16:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f48523bc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560c40fb5160 con 0x560c410b4df0 2024-09-10T21:16:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f48523bc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x560c410c39a0 con 0x560c410c0d80 2024-09-10T21:16:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f48523bc740 10 client.0 _ll_register_callbacks cb 0x560c40fce9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f484dd83640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b44d0 0x560c410c0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f484dd83640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b44d0 0x560c410c0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47310/0 (socket says 172.21.15.59:47310) 2024-09-10T21:16:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f484dd83640 1 -- 172.21.15.59:0/3810853959 learned_addr learned my addr 172.21.15.59:0/3810853959 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f484d582640 1 --2- 172.21.15.59:0/3810853959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410b4df0 0x560c410bda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f484e584640 1 --2- 172.21.15.59:0/3810853959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410c0d80 0x560c410be070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f484dd83640 1 -- 172.21.15.59:0/3810853959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410c0d80 msgr2=0x560c410be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f484dd83640 1 --2- 172.21.15.59:0/3810853959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410c0d80 0x560c410be070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f484dd83640 1 -- 172.21.15.59:0/3810853959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410b4df0 msgr2=0x560c410bda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f484dd83640 1 --2- 172.21.15.59:0/3810853959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410b4df0 0x560c410bda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f484dd83640 1 -- 172.21.15.59:0/3810853959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c40fe2c90 con 0x560c410b44d0 2024-09-10T21:16:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f484e584640 1 --2- 172.21.15.59:0/3810853959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410c0d80 0x560c410be070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:16:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f484dd83640 1 --2- 172.21.15.59:0/3810853959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b44d0 0x560c410c0640 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4844014710 tx=0x7f48440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7323a6208652653e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.002+0000 7f48317fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.003+0000 7f48317fa640 1 -- 172.21.15.59:0/3810853959 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484401b050 con 0x560c410b44d0 2024-09-10T21:16:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.003+0000 7f48317fa640 1 -- 172.21.15.59:0/3810853959 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4844015820 con 0x560c410b44d0 2024-09-10T21:16:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.003+0000 7f48523bc740 1 -- 172.21.15.59:0/3810853959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48380316a0 con 0x560c410b44d0 2024-09-10T21:16:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.003+0000 7f48317fa640 1 -- 172.21.15.59:0/3810853959 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4844015a20 con 0x560c410b44d0 2024-09-10T21:16:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.003+0000 7f48523bc740 10 client.15714 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.003+0000 7f48523bc740 1 -- 172.21.15.59:0/3810853959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560c410cf330 con 0x560c410b44d0 2024-09-10T21:16:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.003+0000 7f48317fa640 1 -- 172.21.15.59:0/3810853959 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48380316a0 con 0x560c410b44d0 2024-09-10T21:16:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.003+0000 7f48317fa640 1 -- 172.21.15.59:0/3810853959 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4844020440 con 0x560c410b44d0 2024-09-10T21:16:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.003+0000 7f48523bc740 10 client.15714 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.003+0000 7f48523bc740 10 client.15714 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:16:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.003+0000 7f48523bc740 20 client.15714 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.003+0000 7f48523bc740 1 --2- 172.21.15.59:0/3810853959 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x560c410d08e0 0x560c410d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.003+0000 7f48523bc740 4 client.15714 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:16:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.003+0000 7f48523bc740 1 -- 172.21.15.59:0/3810853959 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c4102cdf0 con 0x560c410d08e0 2024-09-10T21:16:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.004+0000 7f484d582640 1 --2- 172.21.15.59:0/3810853959 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x560c410d08e0 0x560c410d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.004+0000 7f48317fa640 10 client.15714 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:16:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.004+0000 7f484d582640 1 --2- 172.21.15.59:0/3810853959 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x560c410d08e0 0x560c410d2d40 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6c40bbc56ace0ee0 server_cookie=444c55c24df45cbb in_seq=0 out_seq=0 2024-09-10T21:16:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.005+0000 7f48317fa640 1 -- 172.21.15.59:0/3810853959 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c4102cdf0 con 0x560c410d08e0 2024-09-10T21:16:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.005+0000 7f48317fa640 10 client.15714 handle_command_reply: tid=0 2024-09-10T21:16:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.005+0000 7f48523bc740 1 client.15714 shutdown 2024-09-10T21:16:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.005+0000 7f48523bc740 1 -- 172.21.15.59:0/3810853959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b44d0 msgr2=0x560c410c0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.005+0000 7f48523bc740 1 --2- 172.21.15.59:0/3810853959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b44d0 0x560c410c0640 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4844014710 tx=0x7f48440046c0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.005+0000 7f48523bc740 1 -- 172.21.15.59:0/3810853959 shutdown_connections 2024-09-10T21:16:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.005+0000 7f48523bc740 1 --2- 172.21.15.59:0/3810853959 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x560c410d08e0 0x560c410d2d40 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.005+0000 7f48523bc740 1 --2- 172.21.15.59:0/3810853959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410c0d80 0x560c410be070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.005+0000 7f48523bc740 1 --2- 172.21.15.59:0/3810853959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410b4df0 0x560c410bda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.005+0000 7f48523bc740 1 --2- 172.21.15.59:0/3810853959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b44d0 0x560c410c0640 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.005+0000 7f48523bc740 1 -- 172.21.15.59:0/3810853959 >> 172.21.15.59:0/3810853959 conn(0x560c410b2300 msgr2=0x560c410b7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.005+0000 7f48317fa640 0 client.15714 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:16:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.005+0000 7f48523bc740 1 -- 172.21.15.59:0/3810853959 shutdown_connections 2024-09-10T21:16:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.005+0000 7f48523bc740 1 -- 172.21.15.59:0/3810853959 wait complete. 2024-09-10T21:16:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.005+0000 7f48523bc740 20 client.15714 trim_cache size 0 max 16384 2024-09-10T21:16:59.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f48523bc740 1 Processor -- start 2024-09-10T21:16:59.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f48523bc740 1 -- start start 2024-09-10T21:16:59.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f48523bc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410b44d0 0x560c410ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:59.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f48523bc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b4df0 0x560c410b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:59.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f48523bc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410c0d80 0x560c410b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:59.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f48523bc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f48481b0530 con 0x560c410b4df0 2024-09-10T21:16:59.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f48523bc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f48481b2070 con 0x560c410b44d0 2024-09-10T21:16:59.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f48523bc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f48481b0c00 con 0x560c410c0d80 2024-09-10T21:16:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f484d582640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b4df0 0x560c410b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f484d582640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b4df0 0x560c410b3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47326/0 (socket says 172.21.15.59:47326) 2024-09-10T21:16:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f484d582640 1 -- 172.21.15.59:0/4235610253 learned_addr learned my addr 172.21.15.59:0/4235610253 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f484e584640 1 --2- 172.21.15.59:0/4235610253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410c0d80 0x560c410b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f484d582640 1 -- 172.21.15.59:0/4235610253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410c0d80 msgr2=0x560c410b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f484dd83640 1 --2- 172.21.15.59:0/4235610253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410b44d0 0x560c410ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f484d582640 1 --2- 172.21.15.59:0/4235610253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410c0d80 0x560c410b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f484d582640 1 -- 172.21.15.59:0/4235610253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410b44d0 msgr2=0x560c410ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f484d582640 1 --2- 172.21.15.59:0/4235610253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410b44d0 0x560c410ccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f484d582640 1 -- 172.21.15.59:0/4235610253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c410b2fe0 con 0x560c410b4df0 2024-09-10T21:16:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f484e584640 1 --2- 172.21.15.59:0/4235610253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410c0d80 0x560c410b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:16:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.019+0000 7f484dd83640 1 --2- 172.21.15.59:0/4235610253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410b44d0 0x560c410ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:16:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.020+0000 7f484d582640 1 --2- 172.21.15.59:0/4235610253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b4df0 0x560c410b3ad0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4838005ab0 tx=0x7f4838005380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10def9637a125438 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.020+0000 7f48337fe640 1 -- 172.21.15.59:0/4235610253 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838035040 con 0x560c410b4df0 2024-09-10T21:16:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.020+0000 7f48337fe640 1 -- 172.21.15.59:0/4235610253 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4838004040 con 0x560c410b4df0 2024-09-10T21:16:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.020+0000 7f48337fe640 1 -- 172.21.15.59:0/4235610253 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838003930 con 0x560c410b4df0 2024-09-10T21:16:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.020+0000 7f48523bc740 1 -- 172.21.15.59:0/4235610253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b4df0 msgr2=0x560c410b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.020+0000 7f48523bc740 1 --2- 172.21.15.59:0/4235610253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b4df0 0x560c410b3ad0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4838005ab0 tx=0x7f4838005380 comp rx=0 tx=0).stop 2024-09-10T21:16:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.021+0000 7f48523bc740 1 -- 172.21.15.59:0/4235610253 shutdown_connections 2024-09-10T21:16:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.021+0000 7f48523bc740 1 --2- 172.21.15.59:0/4235610253 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410c0d80 0x560c410b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.021+0000 7f48523bc740 1 --2- 172.21.15.59:0/4235610253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b4df0 0x560c410b3ad0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.021+0000 7f48523bc740 1 --2- 172.21.15.59:0/4235610253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410b44d0 0x560c410ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.021+0000 7f48523bc740 1 -- 172.21.15.59:0/4235610253 >> 172.21.15.59:0/4235610253 conn(0x560c410b2300 msgr2=0x560c410b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.021+0000 7f48523bc740 1 -- 172.21.15.59:0/4235610253 shutdown_connections 2024-09-10T21:16:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.021+0000 7f48523bc740 1 -- 172.21.15.59:0/4235610253 wait complete. 2024-09-10T21:16:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.021+0000 7f48523bc740 1 -- start start 2024-09-10T21:16:59.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.021+0000 7f48523bc740 1 Processor -- start 2024-09-10T21:16:59.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.022+0000 7f48523bc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410b44d0 0x560c410c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:59.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.022+0000 7f48523bc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b4df0 0x560c410d83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:59.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.022+0000 7f48523bc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410c0d80 0x560c410d8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:59.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.022+0000 7f48523bc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f48481b19a0 con 0x560c410b4df0 2024-09-10T21:16:59.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.022+0000 7f48523bc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f48481b12d0 con 0x560c410c0d80 2024-09-10T21:16:59.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.022+0000 7f48523bc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f48481ae510 con 0x560c410b44d0 2024-09-10T21:16:59.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.022+0000 7f48523bc740 10 client.0 _ll_register_callbacks cb 0x7f484400b6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:16:59.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.022+0000 7f484d582640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b4df0 0x560c410d83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:59.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.022+0000 7f484d582640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b4df0 0x560c410d83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47338/0 (socket says 172.21.15.59:47338) 2024-09-10T21:16:59.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.022+0000 7f484d582640 1 -- 172.21.15.59:0/4054942866 learned_addr learned my addr 172.21.15.59:0/4054942866 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:16:59.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.022+0000 7f484e584640 1 --2- 172.21.15.59:0/4054942866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410c0d80 0x560c410d8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:59.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.022+0000 7f484dd83640 1 --2- 172.21.15.59:0/4054942866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410b44d0 0x560c410c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:59.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.022+0000 7f484d582640 1 -- 172.21.15.59:0/4054942866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410b44d0 msgr2=0x560c410c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:59.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.022+0000 7f484d582640 1 --2- 172.21.15.59:0/4054942866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410b44d0 0x560c410c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.022+0000 7f484d582640 1 -- 172.21.15.59:0/4054942866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410c0d80 msgr2=0x560c410d8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:16:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.022+0000 7f484d582640 1 --2- 172.21.15.59:0/4054942866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410c0d80 0x560c410d8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.022+0000 7f484d582640 1 -- 172.21.15.59:0/4054942866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c410c81b0 con 0x560c410b4df0 2024-09-10T21:16:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.022+0000 7f484d582640 1 --2- 172.21.15.59:0/4054942866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b4df0 0x560c410d83c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4838009850 tx=0x7f4838031c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9babf6d9ff7758 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:16:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.022+0000 7f48317fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:16:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.023+0000 7f48317fa640 1 -- 172.21.15.59:0/4054942866 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483805c070 con 0x560c410b4df0 2024-09-10T21:16:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.023+0000 7f48523bc740 1 -- 172.21.15.59:0/4054942866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4838004040 con 0x560c410b4df0 2024-09-10T21:16:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.023+0000 7f48317fa640 1 -- 172.21.15.59:0/4054942866 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f48380315e0 con 0x560c410b4df0 2024-09-10T21:16:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.023+0000 7f48317fa640 1 -- 172.21.15.59:0/4054942866 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4838035070 con 0x560c410b4df0 2024-09-10T21:16:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.023+0000 7f48523bc740 10 client.15720 fetch_fsmap learned FSMap version 28 2024-09-10T21:16:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.023+0000 7f48523bc740 1 -- 172.21.15.59:0/4054942866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560c4113d990 con 0x560c410b4df0 2024-09-10T21:16:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.023+0000 7f48317fa640 1 -- 172.21.15.59:0/4054942866 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4838004040 con 0x560c410b4df0 2024-09-10T21:16:59.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.023+0000 7f48317fa640 1 -- 172.21.15.59:0/4054942866 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4838056070 con 0x560c410b4df0 2024-09-10T21:16:59.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.023+0000 7f48523bc740 10 client.15720 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:16:59.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.023+0000 7f48523bc740 10 client.15720 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:16:59.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.023+0000 7f48523bc740 20 client.15720 populate_metadata read hostname 'smithi059' 2024-09-10T21:16:59.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.023+0000 7f48523bc740 1 --2- 172.21.15.59:0/4054942866 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x560c4113dd00 0x560c41140120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:16:59.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.023+0000 7f48523bc740 4 client.15720 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:16:59.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.023+0000 7f48523bc740 1 -- 172.21.15.59:0/4054942866 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560c410288a0 con 0x560c4113dd00 2024-09-10T21:16:59.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.023+0000 7f484dd83640 1 --2- 172.21.15.59:0/4054942866 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x560c4113dd00 0x560c41140120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:16:59.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.024+0000 7f48317fa640 10 client.15720 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:16:59.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.024+0000 7f484dd83640 1 --2- 172.21.15.59:0/4054942866 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x560c4113dd00 0x560c41140120 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=215b9026ff3c45ca server_cookie=710ba4d122b6539d in_seq=0 out_seq=0 2024-09-10T21:16:59.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.024+0000 7f48317fa640 1 -- 172.21.15.59:0/4054942866 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560c410288a0 con 0x560c4113dd00 2024-09-10T21:16:59.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.024+0000 7f48317fa640 10 client.15720 handle_command_reply: tid=0 2024-09-10T21:16:59.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.024+0000 7f48523bc740 1 client.15720 shutdown 2024-09-10T21:16:59.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.024+0000 7f48523bc740 1 -- 172.21.15.59:0/4054942866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b4df0 msgr2=0x560c410d83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:59.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.024+0000 7f48523bc740 1 --2- 172.21.15.59:0/4054942866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b4df0 0x560c410d83c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4838009850 tx=0x7f4838031c30 comp rx=0 tx=0).stop 2024-09-10T21:16:59.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.024+0000 7f48523bc740 1 -- 172.21.15.59:0/4054942866 shutdown_connections 2024-09-10T21:16:59.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.024+0000 7f48523bc740 1 --2- 172.21.15.59:0/4054942866 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x560c4113dd00 0x560c41140120 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.024+0000 7f48523bc740 1 --2- 172.21.15.59:0/4054942866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c410c0d80 0x560c410d8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.024+0000 7f48523bc740 1 --2- 172.21.15.59:0/4054942866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560c410b4df0 0x560c410d83c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.024+0000 7f48317fa640 0 client.15720 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:16:59.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.024+0000 7f48523bc740 1 --2- 172.21.15.59:0/4054942866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560c410b44d0 0x560c410c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.024+0000 7f48523bc740 1 -- 172.21.15.59:0/4054942866 >> 172.21.15.59:0/4054942866 conn(0x560c410b2300 msgr2=0x560c410bf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:59.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.024+0000 7f48523bc740 1 -- 172.21.15.59:0/4054942866 shutdown_connections 2024-09-10T21:16:59.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.024+0000 7f48523bc740 1 -- 172.21.15.59:0/4054942866 wait complete. 2024-09-10T21:16:59.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.024+0000 7f48523bc740 20 client.15720 trim_cache size 0 max 16384 2024-09-10T21:16:59.036 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:16:59.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.025+0000 7f484ffe7640 1 -- 172.21.15.59:0/1856012775 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f48340b5360 msgr2=0x7f48340b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:59.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.025+0000 7f484ffe7640 1 --2- 172.21.15.59:0/1856012775 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f48340b5360 0x7f48340b7820 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x560c410b31e0 tx=0x7f4844008040 comp rx=0 tx=0).stop 2024-09-10T21:16:59.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.025+0000 7f484ffe7640 1 -- 172.21.15.59:0/1856012775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4848108020 msgr2=0x7f48481a0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:16:59.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.025+0000 7f484ffe7640 1 --2- 172.21.15.59:0/1856012775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4848108020 0x7f48481a0ec0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f484000b970 tx=0x7f484000be30 comp rx=0 tx=0).stop 2024-09-10T21:16:59.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.025+0000 7f484ffe7640 1 -- 172.21.15.59:0/1856012775 shutdown_connections 2024-09-10T21:16:59.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.025+0000 7f484ffe7640 1 --2- 172.21.15.59:0/1856012775 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f48340b5360 0x7f48340b7820 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.025+0000 7f484ffe7640 1 --2- 172.21.15.59:0/1856012775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4848108020 0x7f48481a0ec0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.025+0000 7f484ffe7640 1 --2- 172.21.15.59:0/1856012775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48481076a0 0x7f484819bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.025+0000 7f484ffe7640 1 --2- 172.21.15.59:0/1856012775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4848101c90 0x7f484819b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:16:59.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.025+0000 7f484ffe7640 1 -- 172.21.15.59:0/1856012775 >> 172.21.15.59:0/1856012775 conn(0x7f48480fd700 msgr2=0x7f484806b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:16:59.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.025+0000 7f484ffe7640 1 -- 172.21.15.59:0/1856012775 shutdown_connections 2024-09-10T21:16:59.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:16:59.025+0000 7f484ffe7640 1 -- 172.21.15.59:0/1856012775 wait complete. 2024-09-10T21:16:59.798 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:17:00.056 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:17:00.449 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:00 smithi059 ceph-mon[30888]: pgmap v392: 97 pgs: 97 active+clean; 1.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:00.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.528+0000 7f1965ec1640 1 -- 172.21.15.59:0/4104849099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1960102dc0 msgr2=0x7f19601031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:00.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.528+0000 7f1965ec1640 1 --2- 172.21.15.59:0/4104849099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1960102dc0 0x7f19601031a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1950009900 tx=0x7f195002a410 comp rx=0 tx=0).stop 2024-09-10T21:17:00.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.528+0000 7f1965ec1640 1 -- 172.21.15.59:0/4104849099 shutdown_connections 2024-09-10T21:17:00.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.528+0000 7f1965ec1640 1 --2- 172.21.15.59:0/4104849099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1960109150 0x7f196010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.528+0000 7f1965ec1640 1 --2- 172.21.15.59:0/4104849099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f19601087d0 0x7f1960108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.528+0000 7f1965ec1640 1 --2- 172.21.15.59:0/4104849099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1960102dc0 0x7f19601031a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.528+0000 7f1965ec1640 1 -- 172.21.15.59:0/4104849099 >> 172.21.15.59:0/4104849099 conn(0x7f19600fe830 msgr2=0x7f1960100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:00.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.528+0000 7f1965ec1640 1 -- 172.21.15.59:0/4104849099 shutdown_connections 2024-09-10T21:17:00.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.528+0000 7f1965ec1640 1 -- 172.21.15.59:0/4104849099 wait complete. 2024-09-10T21:17:00.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.529+0000 7f1965ec1640 1 Processor -- start 2024-09-10T21:17:00.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.529+0000 7f1965ec1640 1 -- start start 2024-09-10T21:17:00.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.529+0000 7f1965ec1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1960102dc0 0x7f19600754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:00.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.529+0000 7f1965ec1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19601087d0 0x7f19600759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:00.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.529+0000 7f1965ec1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1960109150 0x7f1960075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:00.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.529+0000 7f1965ec1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1960112e10 con 0x7f1960109150 2024-09-10T21:17:00.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.529+0000 7f1965ec1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1960112c90 con 0x7f1960102dc0 2024-09-10T21:17:00.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.529+0000 7f1965ec1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1960112f90 con 0x7f19601087d0 2024-09-10T21:17:00.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.529+0000 7f195ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1960109150 0x7f1960075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:00.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.529+0000 7f195ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1960109150 0x7f1960075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39770/0 (socket says 172.21.15.59:39770) 2024-09-10T21:17:00.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.529+0000 7f195ffff640 1 -- 172.21.15.59:0/2124861107 learned_addr learned my addr 172.21.15.59:0/2124861107 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:00.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.529+0000 7f195f7fe640 1 --2- 172.21.15.59:0/2124861107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1960102dc0 0x7f19600754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:00.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.529+0000 7f195effd640 1 --2- 172.21.15.59:0/2124861107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19601087d0 0x7f19600759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.530+0000 7f195ffff640 1 -- 172.21.15.59:0/2124861107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19601087d0 msgr2=0x7f19600759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.530+0000 7f195ffff640 1 --2- 172.21.15.59:0/2124861107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19601087d0 0x7f19600759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.530+0000 7f195ffff640 1 -- 172.21.15.59:0/2124861107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1960102dc0 msgr2=0x7f19600754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.530+0000 7f195ffff640 1 --2- 172.21.15.59:0/2124861107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1960102dc0 0x7f19600754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.530+0000 7f195ffff640 1 -- 172.21.15.59:0/2124861107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19601a76c0 con 0x7f1960109150 2024-09-10T21:17:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.530+0000 7f195ffff640 1 --2- 172.21.15.59:0/2124861107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1960109150 0x7f1960075f20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f195800b970 tx=0x7f195800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.530+0000 7f195cff9640 1 -- 172.21.15.59:0/2124861107 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1958019070 con 0x7f1960109150 2024-09-10T21:17:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.530+0000 7f195cff9640 1 -- 172.21.15.59:0/2124861107 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1958014440 con 0x7f1960109150 2024-09-10T21:17:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.530+0000 7f1965ec1640 1 -- 172.21.15.59:0/2124861107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19601a79b0 con 0x7f1960109150 2024-09-10T21:17:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.530+0000 7f195cff9640 1 -- 172.21.15.59:0/2124861107 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19580075d0 con 0x7f1960109150 2024-09-10T21:17:00.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.530+0000 7f1965ec1640 1 -- 172.21.15.59:0/2124861107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19601a7f20 con 0x7f1960109150 2024-09-10T21:17:00.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.532+0000 7f1968296740 1 Processor -- start 2024-09-10T21:17:00.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.532+0000 7f195cff9640 1 -- 172.21.15.59:0/2124861107 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f195800cb40 con 0x7f1960109150 2024-09-10T21:17:00.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.533+0000 7f1968296740 1 -- start start 2024-09-10T21:17:00.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.533+0000 7f1968296740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebf14d0 0x55e20ebf18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:00.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.533+0000 7f1968296740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf1df0 0x55e20ebfd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:00.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.533+0000 7f1968296740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebfdd80 0x55e20ec00170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:00.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.533+0000 7f1968296740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e20eb67ea0 con 0x55e20ebfdd80 2024-09-10T21:17:00.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.533+0000 7f1968296740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e20eb572d0 con 0x55e20ebf1df0 2024-09-10T21:17:00.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.533+0000 7f1968296740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55e20eb5b0e0 con 0x55e20ebf14d0 2024-09-10T21:17:00.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.533+0000 7f195effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebfdd80 0x55e20ec00170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:00.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.533+0000 7f195effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebfdd80 0x55e20ec00170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39782/0 (socket says 172.21.15.59:39782) 2024-09-10T21:17:00.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.533+0000 7f195effd640 1 -- 172.21.15.59:0/1088072777 learned_addr learned my addr 172.21.15.59:0/1088072777 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:00.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.533+0000 7f195f7fe640 1 --2- 172.21.15.59:0/1088072777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf1df0 0x55e20ebfd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:00.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.533+0000 7f195effd640 1 --2- 172.21.15.59:0/1088072777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebf14d0 0x55e20ebf18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:00.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.533+0000 7f195effd640 1 -- 172.21.15.59:0/1088072777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebf14d0 msgr2=0x55e20ebf18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:00.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.533+0000 7f195effd640 1 --2- 172.21.15.59:0/1088072777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebf14d0 0x55e20ebf18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.533+0000 7f195effd640 1 -- 172.21.15.59:0/1088072777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf1df0 msgr2=0x55e20ebfd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:00.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.533+0000 7f195effd640 1 --2- 172.21.15.59:0/1088072777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf1df0 0x55e20ebfd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.533+0000 7f195cff9640 1 --2- 172.21.15.59:0/2124861107 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f19480b52e0 0x7f19480b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:00.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.533+0000 7f195effd640 1 -- 172.21.15.59:0/1088072777 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e20e8b5650 con 0x55e20ebfdd80 2024-09-10T21:17:00.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.534+0000 7f195f7fe640 1 --2- 172.21.15.59:0/2124861107 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f19480b52e0 0x7f19480b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:00.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.534+0000 7f195effd640 1 --2- 172.21.15.59:0/1088072777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebfdd80 0x55e20ec00170 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1954013930 tx=0x7f195400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c27159c236364c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:00.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.534+0000 7f195cff9640 1 -- 172.21.15.59:0/2124861107 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f19580e5340 con 0x7f1960109150 2024-09-10T21:17:00.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.534+0000 7f1945ffb640 1 -- 172.21.15.59:0/1088072777 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195400e950 con 0x55e20ebfdd80 2024-09-10T21:17:00.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.534+0000 7f1945ffb640 1 -- 172.21.15.59:0/1088072777 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1954011440 con 0x55e20ebfdd80 2024-09-10T21:17:00.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.534+0000 7f1945ffb640 1 -- 172.21.15.59:0/1088072777 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1954010670 con 0x55e20ebfdd80 2024-09-10T21:17:00.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.535+0000 7f1968296740 1 -- 172.21.15.59:0/1088072777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebfdd80 msgr2=0x55e20ec00170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:00.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.535+0000 7f195f7fe640 1 --2- 172.21.15.59:0/2124861107 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f19480b52e0 0x7f19480b77a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1950031440 tx=0x7f1950005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:00.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.535+0000 7f1968296740 1 --2- 172.21.15.59:0/1088072777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebfdd80 0x55e20ec00170 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1954013930 tx=0x7f195400b460 comp rx=0 tx=0).stop 2024-09-10T21:17:00.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.535+0000 7f1968296740 1 -- 172.21.15.59:0/1088072777 shutdown_connections 2024-09-10T21:17:00.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.535+0000 7f1968296740 1 --2- 172.21.15.59:0/1088072777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebfdd80 0x55e20ec00170 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.535+0000 7f1968296740 1 --2- 172.21.15.59:0/1088072777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf1df0 0x55e20ebfd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.535+0000 7f1968296740 1 --2- 172.21.15.59:0/1088072777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebf14d0 0x55e20ebf18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.535+0000 7f1968296740 1 -- 172.21.15.59:0/1088072777 >> 172.21.15.59:0/1088072777 conn(0x55e20ebef300 msgr2=0x55e20ebf04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:00.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.535+0000 7f1968296740 1 -- 172.21.15.59:0/1088072777 shutdown_connections 2024-09-10T21:17:00.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.535+0000 7f1968296740 1 -- 172.21.15.59:0/1088072777 wait complete. 2024-09-10T21:17:00.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.535+0000 7f1968296740 1 -- start start 2024-09-10T21:17:00.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.535+0000 7f1968296740 1 Processor -- start 2024-09-10T21:17:00.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f1968296740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebf14d0 0x55e20ebfd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:00.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f1968296740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf1df0 0x55e20ebfab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:00.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f1968296740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebfdd80 0x55e20ebfb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:00.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f1968296740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e20e9b8700 con 0x55e20ebf14d0 2024-09-10T21:17:00.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f1968296740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e20eaf2160 con 0x55e20ebf1df0 2024-09-10T21:17:00.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f1968296740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55e20ec00a00 con 0x55e20ebfdd80 2024-09-10T21:17:00.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f1968296740 10 client.0 _ll_register_callbacks cb 0x55e20eb0b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:00.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f195f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebf14d0 0x55e20ebfd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f195f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebf14d0 0x55e20ebfd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39784/0 (socket says 172.21.15.59:39784) 2024-09-10T21:17:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f195f7fe640 1 -- 172.21.15.59:0/1461741262 learned_addr learned my addr 172.21.15.59:0/1461741262 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f195effd640 1 --2- 172.21.15.59:0/1461741262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf1df0 0x55e20ebfab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f195ffff640 1 --2- 172.21.15.59:0/1461741262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebfdd80 0x55e20ebfb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f195f7fe640 1 -- 172.21.15.59:0/1461741262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebfdd80 msgr2=0x55e20ebfb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f195f7fe640 1 --2- 172.21.15.59:0/1461741262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebfdd80 0x55e20ebfb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f195f7fe640 1 -- 172.21.15.59:0/1461741262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf1df0 msgr2=0x55e20ebfab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f195f7fe640 1 --2- 172.21.15.59:0/1461741262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf1df0 0x55e20ebfab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f195f7fe640 1 -- 172.21.15.59:0/1461741262 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e20eb1fc90 con 0x55e20ebf14d0 2024-09-10T21:17:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f195effd640 1 --2- 172.21.15.59:0/1461741262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf1df0 0x55e20ebfab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f195f7fe640 1 --2- 172.21.15.59:0/1461741262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebf14d0 0x55e20ebfd720 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1950033000 tx=0x7f1950009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3d97796254bc22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f193effd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.536+0000 7f193effd640 1 -- 172.21.15.59:0/1461741262 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195004d030 con 0x55e20ebf14d0 2024-09-10T21:17:00.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.537+0000 7f193effd640 1 -- 172.21.15.59:0/1461741262 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f19500035f0 con 0x55e20ebf14d0 2024-09-10T21:17:00.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.537+0000 7f1968296740 1 -- 172.21.15.59:0/1461741262 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1954011440 con 0x55e20ebf14d0 2024-09-10T21:17:00.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.537+0000 7f193effd640 1 -- 172.21.15.59:0/1461741262 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1950035040 con 0x55e20ebf14d0 2024-09-10T21:17:00.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.537+0000 7f1968296740 10 client.15732 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:00.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.537+0000 7f1968296740 1 -- 172.21.15.59:0/1461741262 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e20ec0c3e0 con 0x55e20ebf14d0 2024-09-10T21:17:00.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.537+0000 7f193effd640 1 -- 172.21.15.59:0/1461741262 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1954011440 con 0x55e20ebf14d0 2024-09-10T21:17:00.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.537+0000 7f193effd640 1 -- 172.21.15.59:0/1461741262 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f195003d890 con 0x55e20ebf14d0 2024-09-10T21:17:00.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.537+0000 7f1968296740 10 client.15732 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:00.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.537+0000 7f1968296740 10 client.15732 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:17:00.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.537+0000 7f1968296740 20 client.15732 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:00.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.537+0000 7f1968296740 1 --2- 172.21.15.59:0/1461741262 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55e20ec0d940 0x55e20ec0fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:00.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.537+0000 7f1968296740 4 client.15732 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:17:00.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.537+0000 7f1968296740 1 -- 172.21.15.59:0/1461741262 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e20eb69df0 con 0x55e20ec0d940 2024-09-10T21:17:00.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.538+0000 7f195effd640 1 --2- 172.21.15.59:0/1461741262 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55e20ec0d940 0x55e20ec0fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:00.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.538+0000 7f195effd640 1 --2- 172.21.15.59:0/1461741262 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55e20ec0d940 0x55e20ec0fd70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=132eaa4e6ca3bb85 server_cookie=b06d152fd1627209 in_seq=0 out_seq=0 2024-09-10T21:17:00.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.538+0000 7f193effd640 10 client.15732 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:17:00.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.539+0000 7f193effd640 1 -- 172.21.15.59:0/1461741262 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e20eb69df0 con 0x55e20ec0d940 2024-09-10T21:17:00.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.539+0000 7f193effd640 10 client.15732 handle_command_reply: tid=0 2024-09-10T21:17:00.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.539+0000 7f1968296740 1 client.15732 shutdown 2024-09-10T21:17:00.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.539+0000 7f1968296740 1 -- 172.21.15.59:0/1461741262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebf14d0 msgr2=0x55e20ebfd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:00.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.539+0000 7f1968296740 1 --2- 172.21.15.59:0/1461741262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebf14d0 0x55e20ebfd720 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1950033000 tx=0x7f1950009260 comp rx=0 tx=0).stop 2024-09-10T21:17:00.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.539+0000 7f1968296740 1 -- 172.21.15.59:0/1461741262 shutdown_connections 2024-09-10T21:17:00.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.539+0000 7f1968296740 1 --2- 172.21.15.59:0/1461741262 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55e20ec0d940 0x55e20ec0fd70 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.539+0000 7f193effd640 0 client.15732 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:17:00.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.539+0000 7f1968296740 1 --2- 172.21.15.59:0/1461741262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebfdd80 0x55e20ebfb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.539+0000 7f1968296740 1 --2- 172.21.15.59:0/1461741262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf1df0 0x55e20ebfab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.539+0000 7f1968296740 1 --2- 172.21.15.59:0/1461741262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebf14d0 0x55e20ebfd720 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.539+0000 7f1968296740 1 -- 172.21.15.59:0/1461741262 >> 172.21.15.59:0/1461741262 conn(0x55e20ebef300 msgr2=0x55e20ebf4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:00.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.539+0000 7f1968296740 1 -- 172.21.15.59:0/1461741262 shutdown_connections 2024-09-10T21:17:00.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.539+0000 7f1968296740 1 -- 172.21.15.59:0/1461741262 wait complete. 2024-09-10T21:17:00.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.539+0000 7f1968296740 20 client.15732 trim_cache size 0 max 16384 2024-09-10T21:17:00.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.552+0000 7f1968296740 1 Processor -- start 2024-09-10T21:17:00.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.552+0000 7f1968296740 1 -- start start 2024-09-10T21:17:00.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.553+0000 7f1968296740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebf14d0 0x55e20ebeec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.553+0000 7f1968296740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf1df0 0x55e20ebfc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.553+0000 7f1968296740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebfdd80 0x55e20ebff170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.553+0000 7f1968296740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f19601b0510 con 0x55e20ebfdd80 2024-09-10T21:17:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.553+0000 7f1968296740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f19601b2050 con 0x55e20ebf1df0 2024-09-10T21:17:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.553+0000 7f1968296740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f19601b0be0 con 0x55e20ebf14d0 2024-09-10T21:17:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.553+0000 7f195ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebfdd80 0x55e20ebff170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.553+0000 7f195ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebfdd80 0x55e20ebff170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39794/0 (socket says 172.21.15.59:39794) 2024-09-10T21:17:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.553+0000 7f195ffff640 1 -- 172.21.15.59:0/1563526661 learned_addr learned my addr 172.21.15.59:0/1563526661 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.553+0000 7f195f7fe640 1 --2- 172.21.15.59:0/1563526661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebf14d0 0x55e20ebeec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.553+0000 7f195ffff640 1 -- 172.21.15.59:0/1563526661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebf14d0 msgr2=0x55e20ebeec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.553+0000 7f195ffff640 1 --2- 172.21.15.59:0/1563526661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebf14d0 0x55e20ebeec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.553+0000 7f195effd640 1 --2- 172.21.15.59:0/1563526661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf1df0 0x55e20ebfc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:00.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.553+0000 7f195ffff640 1 -- 172.21.15.59:0/1563526661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf1df0 msgr2=0x55e20ebfc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:00.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.553+0000 7f195ffff640 1 --2- 172.21.15.59:0/1563526661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf1df0 0x55e20ebfc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.553+0000 7f195ffff640 1 -- 172.21.15.59:0/1563526661 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e20ebefd80 con 0x55e20ebfdd80 2024-09-10T21:17:00.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.553+0000 7f195effd640 1 --2- 172.21.15.59:0/1563526661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf1df0 0x55e20ebfc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:00.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.553+0000 7f195ffff640 1 --2- 172.21.15.59:0/1563526661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebfdd80 0x55e20ebff170 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f19580e2e70 tx=0x7f1958014b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a95cf5c386c5e4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:00.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.553+0000 7f19457fa640 1 -- 172.21.15.59:0/1563526661 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19580ace60 con 0x55e20ebfdd80 2024-09-10T21:17:00.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.554+0000 7f19457fa640 1 -- 172.21.15.59:0/1563526661 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19580ab6f0 con 0x55e20ebfdd80 2024-09-10T21:17:00.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.554+0000 7f19457fa640 1 -- 172.21.15.59:0/1563526661 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19580a7e50 con 0x55e20ebfdd80 2024-09-10T21:17:00.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.554+0000 7f1968296740 1 -- 172.21.15.59:0/1563526661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebfdd80 msgr2=0x55e20ebff170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:00.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.554+0000 7f1968296740 1 --2- 172.21.15.59:0/1563526661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebfdd80 0x55e20ebff170 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f19580e2e70 tx=0x7f1958014b60 comp rx=0 tx=0).stop 2024-09-10T21:17:00.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.554+0000 7f1968296740 1 -- 172.21.15.59:0/1563526661 shutdown_connections 2024-09-10T21:17:00.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.554+0000 7f1968296740 1 --2- 172.21.15.59:0/1563526661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebfdd80 0x55e20ebff170 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.554+0000 7f1968296740 1 --2- 172.21.15.59:0/1563526661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf1df0 0x55e20ebfc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.554+0000 7f1968296740 1 --2- 172.21.15.59:0/1563526661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebf14d0 0x55e20ebeec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.554+0000 7f1968296740 1 -- 172.21.15.59:0/1563526661 >> 172.21.15.59:0/1563526661 conn(0x55e20ebef300 msgr2=0x55e20ebfc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:00.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.554+0000 7f1968296740 1 -- 172.21.15.59:0/1563526661 shutdown_connections 2024-09-10T21:17:00.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.554+0000 7f1968296740 1 -- 172.21.15.59:0/1563526661 wait complete. 2024-09-10T21:17:00.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.555+0000 7f1968296740 1 -- start start 2024-09-10T21:17:00.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.555+0000 7f1968296740 1 Processor -- start 2024-09-10T21:17:00.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.555+0000 7f1968296740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf14d0 0x55e20ec05e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:00.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.555+0000 7f1968296740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebf1df0 0x55e20ec063b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:00.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.555+0000 7f1968296740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebfdd80 0x55e20ebf6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:00.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.555+0000 7f1968296740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f19601b1980 con 0x55e20ebf1df0 2024-09-10T21:17:00.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.555+0000 7f1968296740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f19601b12b0 con 0x55e20ebf14d0 2024-09-10T21:17:00.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.555+0000 7f1968296740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f19601ae4f0 con 0x55e20ebfdd80 2024-09-10T21:17:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.555+0000 7f1968296740 10 client.0 _ll_register_callbacks cb 0x7f1950031cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.555+0000 7f195effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebf1df0 0x55e20ec063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.555+0000 7f195effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebf1df0 0x55e20ec063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39802/0 (socket says 172.21.15.59:39802) 2024-09-10T21:17:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.555+0000 7f195effd640 1 -- 172.21.15.59:0/1958070362 learned_addr learned my addr 172.21.15.59:0/1958070362 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.555+0000 7f195ffff640 1 --2- 172.21.15.59:0/1958070362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebfdd80 0x55e20ebf6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.555+0000 7f195f7fe640 1 --2- 172.21.15.59:0/1958070362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf14d0 0x55e20ec05e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.556+0000 7f195effd640 1 -- 172.21.15.59:0/1958070362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebfdd80 msgr2=0x55e20ebf6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.556+0000 7f195effd640 1 --2- 172.21.15.59:0/1958070362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebfdd80 0x55e20ebf6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.556+0000 7f195effd640 1 -- 172.21.15.59:0/1958070362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf14d0 msgr2=0x55e20ec05e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.556+0000 7f195effd640 1 --2- 172.21.15.59:0/1958070362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf14d0 0x55e20ec05e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.556+0000 7f195effd640 1 -- 172.21.15.59:0/1958070362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e20ebf73f0 con 0x55e20ebf1df0 2024-09-10T21:17:00.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.556+0000 7f195f7fe640 1 --2- 172.21.15.59:0/1958070362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf14d0 0x55e20ec05e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.556+0000 7f195effd640 1 --2- 172.21.15.59:0/1958070362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebf1df0 0x55e20ec063b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1954000c00 tx=0x7f1954011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfa6eca3d160463 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.556+0000 7f193effd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.556+0000 7f193effd640 1 -- 172.21.15.59:0/1958070362 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195402b020 con 0x55e20ebf1df0 2024-09-10T21:17:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.556+0000 7f193effd640 1 -- 172.21.15.59:0/1958070362 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1954005240 con 0x55e20ebf1df0 2024-09-10T21:17:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.556+0000 7f1968296740 1 -- 172.21.15.59:0/1958070362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19580ab6f0 con 0x55e20ebf1df0 2024-09-10T21:17:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.556+0000 7f193effd640 1 -- 172.21.15.59:0/1958070362 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1954005480 con 0x55e20ebf1df0 2024-09-10T21:17:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.556+0000 7f1968296740 10 client.15738 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.556+0000 7f1968296740 1 -- 172.21.15.59:0/1958070362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e20ebf86a0 con 0x55e20ebf1df0 2024-09-10T21:17:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.557+0000 7f193effd640 1 -- 172.21.15.59:0/1958070362 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19580ab6f0 con 0x55e20ebf1df0 2024-09-10T21:17:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.557+0000 7f193effd640 1 -- 172.21.15.59:0/1958070362 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1954004680 con 0x55e20ebf1df0 2024-09-10T21:17:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.557+0000 7f1968296740 10 client.15738 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.557+0000 7f1968296740 10 client.15738 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:17:00.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.557+0000 7f1968296740 20 client.15738 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.557+0000 7f1968296740 1 --2- 172.21.15.59:0/1958070362 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55e20ec0d940 0x55e20ec7d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.557+0000 7f1968296740 4 client.15738 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:17:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.557+0000 7f1968296740 1 -- 172.21.15.59:0/1958070362 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e20eb658a0 con 0x55e20ec0d940 2024-09-10T21:17:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.557+0000 7f195f7fe640 1 --2- 172.21.15.59:0/1958070362 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55e20ec0d940 0x55e20ec7d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.557+0000 7f195f7fe640 1 --2- 172.21.15.59:0/1958070362 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55e20ec0d940 0x55e20ec7d8a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dbc6758f958a1d8d server_cookie=8430e329ba6239a2 in_seq=0 out_seq=0 2024-09-10T21:17:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.557+0000 7f193effd640 10 client.15738 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:17:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.558+0000 7f193effd640 1 -- 172.21.15.59:0/1958070362 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e20eb658a0 con 0x55e20ec0d940 2024-09-10T21:17:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.558+0000 7f193effd640 10 client.15738 handle_command_reply: tid=0 2024-09-10T21:17:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.558+0000 7f1968296740 1 client.15738 shutdown 2024-09-10T21:17:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.558+0000 7f1968296740 1 -- 172.21.15.59:0/1958070362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebf1df0 msgr2=0x55e20ec063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.558+0000 7f1968296740 1 --2- 172.21.15.59:0/1958070362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebf1df0 0x55e20ec063b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1954000c00 tx=0x7f1954011f90 comp rx=0 tx=0).stop 2024-09-10T21:17:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.558+0000 7f1968296740 1 -- 172.21.15.59:0/1958070362 shutdown_connections 2024-09-10T21:17:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.558+0000 7f1968296740 1 --2- 172.21.15.59:0/1958070362 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55e20ec0d940 0x55e20ec7d8a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.558+0000 7f1968296740 1 --2- 172.21.15.59:0/1958070362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e20ebfdd80 0x55e20ebf6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.558+0000 7f1968296740 1 --2- 172.21.15.59:0/1958070362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e20ebf1df0 0x55e20ec063b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.558+0000 7f193effd640 0 client.15738 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:17:00.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.558+0000 7f1968296740 1 --2- 172.21.15.59:0/1958070362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e20ebf14d0 0x55e20ec05e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.558+0000 7f1968296740 1 -- 172.21.15.59:0/1958070362 >> 172.21.15.59:0/1958070362 conn(0x55e20ebef300 msgr2=0x55e20ebfc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:00.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.558+0000 7f1968296740 1 -- 172.21.15.59:0/1958070362 shutdown_connections 2024-09-10T21:17:00.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.558+0000 7f1968296740 1 -- 172.21.15.59:0/1958070362 wait complete. 2024-09-10T21:17:00.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.558+0000 7f1968296740 20 client.15738 trim_cache size 0 max 16384 2024-09-10T21:17:00.571 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:17:00.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.559+0000 7f1965ec1640 1 -- 172.21.15.59:0/2124861107 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f19480b52e0 msgr2=0x7f19480b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:00.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.559+0000 7f1965ec1640 1 --2- 172.21.15.59:0/2124861107 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f19480b52e0 0x7f19480b77a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1950031440 tx=0x7f1950005e80 comp rx=0 tx=0).stop 2024-09-10T21:17:00.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.559+0000 7f1965ec1640 1 -- 172.21.15.59:0/2124861107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1960109150 msgr2=0x7f1960075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:00.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.559+0000 7f1965ec1640 1 --2- 172.21.15.59:0/2124861107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1960109150 0x7f1960075f20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f195800b970 tx=0x7f195800be30 comp rx=0 tx=0).stop 2024-09-10T21:17:00.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.559+0000 7f1965ec1640 1 -- 172.21.15.59:0/2124861107 shutdown_connections 2024-09-10T21:17:00.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.559+0000 7f1965ec1640 1 --2- 172.21.15.59:0/2124861107 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f19480b52e0 0x7f19480b77a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.559+0000 7f1965ec1640 1 --2- 172.21.15.59:0/2124861107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1960109150 0x7f1960075f20 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.559+0000 7f1965ec1640 1 --2- 172.21.15.59:0/2124861107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19601087d0 0x7f19600759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.559+0000 7f1965ec1640 1 --2- 172.21.15.59:0/2124861107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1960102dc0 0x7f19600754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:00.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.559+0000 7f1965ec1640 1 -- 172.21.15.59:0/2124861107 >> 172.21.15.59:0/2124861107 conn(0x7f19600fe830 msgr2=0x7f1960100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:00.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.559+0000 7f1965ec1640 1 -- 172.21.15.59:0/2124861107 shutdown_connections 2024-09-10T21:17:00.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:00.559+0000 7f1965ec1640 1 -- 172.21.15.59:0/2124861107 wait complete. 2024-09-10T21:17:00.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:00 smithi154 ceph-mon[35041]: pgmap v392: 97 pgs: 97 active+clean; 1.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:00.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:00 smithi192 ceph-mon[35363]: pgmap v392: 97 pgs: 97 active+clean; 1.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:01.283 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:17:01.541 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:17:02.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.004+0000 7f3c2e89e640 1 -- 172.21.15.59:0/2877972172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c28108030 msgr2=0x7f3c2810f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:02.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.004+0000 7f3c2e89e640 1 --2- 172.21.15.59:0/2877972172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c28108030 0x7f3c2810f920 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009ca0 tx=0x7f3c2002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.004+0000 7f3c2e89e640 1 -- 172.21.15.59:0/2877972172 shutdown_connections 2024-09-10T21:17:02.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.004+0000 7f3c2e89e640 1 --2- 172.21.15.59:0/2877972172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c28108030 0x7f3c2810f920 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.004+0000 7f3c2e89e640 1 --2- 172.21.15.59:0/2877972172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c281076b0 0x7f3c28107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.004+0000 7f3c2e89e640 1 --2- 172.21.15.59:0/2877972172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c28100d30 0x7f3c28101110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.004+0000 7f3c2e89e640 1 -- 172.21.15.59:0/2877972172 >> 172.21.15.59:0/2877972172 conn(0x7f3c280fca20 msgr2=0x7f3c280fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:02.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.004+0000 7f3c2e89e640 1 -- 172.21.15.59:0/2877972172 shutdown_connections 2024-09-10T21:17:02.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.004+0000 7f3c2e89e640 1 -- 172.21.15.59:0/2877972172 wait complete. 2024-09-10T21:17:02.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.004+0000 7f3c2e89e640 1 Processor -- start 2024-09-10T21:17:02.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.004+0000 7f3c2e89e640 1 -- start start 2024-09-10T21:17:02.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.004+0000 7f3c2e89e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c28100d30 0x7f3c28199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:02.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.004+0000 7f3c2e89e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c281076b0 0x7f3c281997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:02.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.005+0000 7f3c2e89e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c28108030 0x7f3c2819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.005+0000 7f3c2e89e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3c28112e30 con 0x7f3c28108030 2024-09-10T21:17:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.005+0000 7f3c2e89e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c28112cb0 con 0x7f3c281076b0 2024-09-10T21:17:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.005+0000 7f3c2e89e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3c28112fb0 con 0x7f3c28100d30 2024-09-10T21:17:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.005+0000 7f3c2ce3b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c28108030 0x7f3c2819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.005+0000 7f3c2ce3b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c28108030 0x7f3c2819eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39826/0 (socket says 172.21.15.59:39826) 2024-09-10T21:17:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.005+0000 7f3c2ce3b640 1 -- 172.21.15.59:0/2057976002 learned_addr learned my addr 172.21.15.59:0/2057976002 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.005+0000 7f3c1ffff640 1 --2- 172.21.15.59:0/2057976002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c281076b0 0x7f3c281997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.005+0000 7f3c27fff640 1 --2- 172.21.15.59:0/2057976002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c28100d30 0x7f3c28199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.005+0000 7f3c2ce3b640 1 -- 172.21.15.59:0/2057976002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c28100d30 msgr2=0x7f3c28199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.005+0000 7f3c2ce3b640 1 --2- 172.21.15.59:0/2057976002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c28100d30 0x7f3c28199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.005+0000 7f3c2ce3b640 1 -- 172.21.15.59:0/2057976002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c281076b0 msgr2=0x7f3c281997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.005+0000 7f3c2ce3b640 1 --2- 172.21.15.59:0/2057976002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c281076b0 0x7f3c281997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.005+0000 7f3c2ce3b640 1 -- 172.21.15.59:0/2057976002 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2819f310 con 0x7f3c28108030 2024-09-10T21:17:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.005+0000 7f3c2ce3b640 1 --2- 172.21.15.59:0/2057976002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c28108030 0x7f3c2819eb40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009430 tx=0x7f3c200319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.005+0000 7f3c25ffb640 1 -- 172.21.15.59:0/2057976002 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20003c30 con 0x7f3c28108030 2024-09-10T21:17:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.005+0000 7f3c25ffb640 1 -- 172.21.15.59:0/2057976002 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c20003dd0 con 0x7f3c28108030 2024-09-10T21:17:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.005+0000 7f3c2e89e640 1 -- 172.21.15.59:0/2057976002 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c2819f5a0 con 0x7f3c28108030 2024-09-10T21:17:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.005+0000 7f3c25ffb640 1 -- 172.21.15.59:0/2057976002 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2002faa0 con 0x7f3c28108030 2024-09-10T21:17:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.006+0000 7f3c2e89e640 1 -- 172.21.15.59:0/2057976002 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c281a5cc0 con 0x7f3c28108030 2024-09-10T21:17:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.008+0000 7f3c30c73740 1 Processor -- start 2024-09-10T21:17:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.008+0000 7f3c25ffb640 1 -- 172.21.15.59:0/2057976002 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f3c2002fc40 con 0x7f3c28108030 2024-09-10T21:17:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.008+0000 7f3c30c73740 1 -- start start 2024-09-10T21:17:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.008+0000 7f3c30c73740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f3854d0 0x56129f3858b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.008+0000 7f3c30c73740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 0x56129f391840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c30c73740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f391d80 0x56129f394170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c30c73740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56129f2fbea0 con 0x56129f385df0 2024-09-10T21:17:02.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c30c73740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56129f2eb2d0 con 0x56129f3854d0 2024-09-10T21:17:02.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c30c73740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56129f2ef0e0 con 0x56129f391d80 2024-09-10T21:17:02.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c27fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 0x56129f391840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:02.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c27fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 0x56129f391840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39832/0 (socket says 172.21.15.59:39832) 2024-09-10T21:17:02.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c27fff640 1 -- 172.21.15.59:0/2798698799 learned_addr learned my addr 172.21.15.59:0/2798698799 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:02.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c1ffff640 1 --2- 172.21.15.59:0/2798698799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f391d80 0x56129f394170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:02.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c1ffff640 1 --2- 172.21.15.59:0/2798698799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f3854d0 0x56129f3858b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:02.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c27fff640 1 -- 172.21.15.59:0/2798698799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f391d80 msgr2=0x56129f394170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:02.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c27fff640 1 --2- 172.21.15.59:0/2798698799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f391d80 0x56129f394170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c27fff640 1 -- 172.21.15.59:0/2798698799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f3854d0 msgr2=0x56129f3858b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:02.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c27fff640 1 --2- 172.21.15.59:0/2798698799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f3854d0 0x56129f3858b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c27fff640 1 -- 172.21.15.59:0/2798698799 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56129f049650 con 0x56129f385df0 2024-09-10T21:17:02.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c27fff640 1 --2- 172.21.15.59:0/2798698799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 0x56129f391840 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800ac20 tx=0x7f3c1800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45f4b8047320f63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:02.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c25ffb640 1 --2- 172.21.15.59:0/2057976002 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3c140b52e0 0x7f3c140b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:02.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c1e7fc640 1 -- 172.21.15.59:0/2798698799 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1801d070 con 0x56129f385df0 2024-09-10T21:17:02.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c1ffff640 1 --2- 172.21.15.59:0/2057976002 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3c140b52e0 0x7f3c140b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:02.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c1e7fc640 1 -- 172.21.15.59:0/2798698799 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c18018af0 con 0x56129f385df0 2024-09-10T21:17:02.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c1e7fc640 1 -- 172.21.15.59:0/2798698799 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18010ab0 con 0x56129f385df0 2024-09-10T21:17:02.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.009+0000 7f3c25ffb640 1 -- 172.21.15.59:0/2057976002 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3c20106ea0 con 0x7f3c28108030 2024-09-10T21:17:02.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.010+0000 7f3c30c73740 1 -- 172.21.15.59:0/2798698799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 msgr2=0x56129f391840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:02.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.010+0000 7f3c1ffff640 1 --2- 172.21.15.59:0/2057976002 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3c140b52e0 0x7f3c140b77a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3c280ff240 tx=0x7f3c10004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:02.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.010+0000 7f3c30c73740 1 --2- 172.21.15.59:0/2798698799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 0x56129f391840 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800ac20 tx=0x7f3c1800f790 comp rx=0 tx=0).stop 2024-09-10T21:17:02.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.010+0000 7f3c30c73740 1 -- 172.21.15.59:0/2798698799 shutdown_connections 2024-09-10T21:17:02.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.010+0000 7f3c30c73740 1 --2- 172.21.15.59:0/2798698799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f391d80 0x56129f394170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.010+0000 7f3c30c73740 1 --2- 172.21.15.59:0/2798698799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 0x56129f391840 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.010+0000 7f3c30c73740 1 --2- 172.21.15.59:0/2798698799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f3854d0 0x56129f3858b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.010+0000 7f3c30c73740 1 -- 172.21.15.59:0/2798698799 >> 172.21.15.59:0/2798698799 conn(0x56129f383300 msgr2=0x56129f3844a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:02.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.010+0000 7f3c30c73740 1 -- 172.21.15.59:0/2798698799 shutdown_connections 2024-09-10T21:17:02.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.010+0000 7f3c30c73740 1 -- 172.21.15.59:0/2798698799 wait complete. 2024-09-10T21:17:02.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.011+0000 7f3c30c73740 1 -- start start 2024-09-10T21:17:02.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.011+0000 7f3c30c73740 1 Processor -- start 2024-09-10T21:17:02.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.011+0000 7f3c30c73740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f3854d0 0x56129f391650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:02.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.011+0000 7f3c30c73740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 0x56129f38eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:02.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.011+0000 7f3c30c73740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f391d80 0x56129f38f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:02.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.011+0000 7f3c30c73740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56129f14c700 con 0x56129f385df0 2024-09-10T21:17:02.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.011+0000 7f3c30c73740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56129f286160 con 0x56129f391d80 2024-09-10T21:17:02.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.011+0000 7f3c30c73740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56129f394a00 con 0x56129f3854d0 2024-09-10T21:17:02.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.011+0000 7f3c30c73740 10 client.0 _ll_register_callbacks cb 0x56129f29f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:02.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.011+0000 7f3c1ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 0x56129f38eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:02.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.011+0000 7f3c1ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 0x56129f38eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39836/0 (socket says 172.21.15.59:39836) 2024-09-10T21:17:02.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.011+0000 7f3c1ffff640 1 -- 172.21.15.59:0/979274633 learned_addr learned my addr 172.21.15.59:0/979274633 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:02.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.011+0000 7f3c27fff640 1 --2- 172.21.15.59:0/979274633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f3854d0 0x56129f391650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:02.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.011+0000 7f3c2ce3b640 1 --2- 172.21.15.59:0/979274633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f391d80 0x56129f38f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:02.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.012+0000 7f3c1ffff640 1 -- 172.21.15.59:0/979274633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f3854d0 msgr2=0x56129f391650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:02.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.012+0000 7f3c1ffff640 1 --2- 172.21.15.59:0/979274633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f3854d0 0x56129f391650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.012+0000 7f3c1ffff640 1 -- 172.21.15.59:0/979274633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f391d80 msgr2=0x56129f38f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:02.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.012+0000 7f3c1ffff640 1 --2- 172.21.15.59:0/979274633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f391d80 0x56129f38f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.012+0000 7f3c1ffff640 1 -- 172.21.15.59:0/979274633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56129f2b3c90 con 0x56129f385df0 2024-09-10T21:17:02.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.012+0000 7f3c1ffff640 1 --2- 172.21.15.59:0/979274633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 0x56129f38eaa0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3c10012010 tx=0x7f3c100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54d01e0703bc744 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:02.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.012+0000 7f3c077fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:02.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.012+0000 7f3c077fe640 1 -- 172.21.15.59:0/979274633 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10012e60 con 0x56129f385df0 2024-09-10T21:17:02.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.012+0000 7f3c30c73740 1 -- 172.21.15.59:0/979274633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c18018af0 con 0x56129f385df0 2024-09-10T21:17:02.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.012+0000 7f3c077fe640 1 -- 172.21.15.59:0/979274633 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3c10020b90 con 0x56129f385df0 2024-09-10T21:17:02.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.012+0000 7f3c077fe640 1 -- 172.21.15.59:0/979274633 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3c10020d90 con 0x56129f385df0 2024-09-10T21:17:02.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.012+0000 7f3c30c73740 10 client.15750 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:02.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.012+0000 7f3c30c73740 1 -- 172.21.15.59:0/979274633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56129f3a03d0 con 0x56129f385df0 2024-09-10T21:17:02.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.012+0000 7f3c077fe640 1 -- 172.21.15.59:0/979274633 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c18018af0 con 0x56129f385df0 2024-09-10T21:17:02.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.013+0000 7f3c077fe640 1 -- 172.21.15.59:0/979274633 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3c1001c040 con 0x56129f385df0 2024-09-10T21:17:02.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.013+0000 7f3c30c73740 10 client.15750 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:02.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.013+0000 7f3c30c73740 10 client.15750 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:17:02.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.013+0000 7f3c30c73740 20 client.15750 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:02.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.013+0000 7f3c30c73740 1 --2- 172.21.15.59:0/979274633 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56129f3a18a0 0x56129f3a3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:02.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.013+0000 7f3c30c73740 4 client.15750 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:17:02.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.013+0000 7f3c30c73740 1 -- 172.21.15.59:0/979274633 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56129f2fddf0 con 0x56129f3a18a0 2024-09-10T21:17:02.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.013+0000 7f3c27fff640 1 --2- 172.21.15.59:0/979274633 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56129f3a18a0 0x56129f3a3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:02.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.013+0000 7f3c27fff640 1 --2- 172.21.15.59:0/979274633 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56129f3a18a0 0x56129f3a3c90 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f2a8cafd84ae30d2 server_cookie=92b7b4666a6cfb2b in_seq=0 out_seq=0 2024-09-10T21:17:02.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.013+0000 7f3c077fe640 10 client.15750 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:17:02.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.014+0000 7f3c077fe640 1 -- 172.21.15.59:0/979274633 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56129f2fddf0 con 0x56129f3a18a0 2024-09-10T21:17:02.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.014+0000 7f3c077fe640 10 client.15750 handle_command_reply: tid=0 2024-09-10T21:17:02.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.014+0000 7f3c30c73740 1 client.15750 shutdown 2024-09-10T21:17:02.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.014+0000 7f3c30c73740 1 -- 172.21.15.59:0/979274633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 msgr2=0x56129f38eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:02.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.014+0000 7f3c30c73740 1 --2- 172.21.15.59:0/979274633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 0x56129f38eaa0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3c10012010 tx=0x7f3c100046c0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.014+0000 7f3c30c73740 1 -- 172.21.15.59:0/979274633 shutdown_connections 2024-09-10T21:17:02.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.014+0000 7f3c30c73740 1 --2- 172.21.15.59:0/979274633 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56129f3a18a0 0x56129f3a3c90 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.014+0000 7f3c077fe640 0 client.15750 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:17:02.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.014+0000 7f3c30c73740 1 --2- 172.21.15.59:0/979274633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f391d80 0x56129f38f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.015+0000 7f3c30c73740 1 --2- 172.21.15.59:0/979274633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 0x56129f38eaa0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.015+0000 7f3c30c73740 1 --2- 172.21.15.59:0/979274633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f3854d0 0x56129f391650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.015+0000 7f3c30c73740 1 -- 172.21.15.59:0/979274633 >> 172.21.15.59:0/979274633 conn(0x56129f383300 msgr2=0x56129f388ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:02.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.015+0000 7f3c30c73740 1 -- 172.21.15.59:0/979274633 shutdown_connections 2024-09-10T21:17:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.015+0000 7f3c30c73740 1 -- 172.21.15.59:0/979274633 wait complete. 2024-09-10T21:17:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.015+0000 7f3c30c73740 20 client.15750 trim_cache size 0 max 16384 2024-09-10T21:17:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.028+0000 7f3c30c73740 1 Processor -- start 2024-09-10T21:17:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.028+0000 7f3c30c73740 1 -- start start 2024-09-10T21:17:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.028+0000 7f3c30c73740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f3854d0 0x56129f39dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.028+0000 7f3c30c73740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f385df0 0x56129f38df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.028+0000 7f3c30c73740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f391d80 0x56129f393170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.028+0000 7f3c30c73740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3c281ae290 con 0x56129f3854d0 2024-09-10T21:17:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.028+0000 7f3c30c73740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c281afdd0 con 0x56129f385df0 2024-09-10T21:17:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.028+0000 7f3c30c73740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3c281ae960 con 0x56129f391d80 2024-09-10T21:17:02.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.028+0000 7f3c27fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f3854d0 0x56129f39dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:02.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.028+0000 7f3c27fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f3854d0 0x56129f39dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39852/0 (socket says 172.21.15.59:39852) 2024-09-10T21:17:02.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.028+0000 7f3c27fff640 1 -- 172.21.15.59:0/587829367 learned_addr learned my addr 172.21.15.59:0/587829367 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:02.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.028+0000 7f3c1ffff640 1 --2- 172.21.15.59:0/587829367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f385df0 0x56129f38df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:02.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.028+0000 7f3c2ce3b640 1 --2- 172.21.15.59:0/587829367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f391d80 0x56129f393170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:02.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.028+0000 7f3c27fff640 1 -- 172.21.15.59:0/587829367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f391d80 msgr2=0x56129f393170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:02.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.028+0000 7f3c27fff640 1 --2- 172.21.15.59:0/587829367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f391d80 0x56129f393170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.028+0000 7f3c27fff640 1 -- 172.21.15.59:0/587829367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f385df0 msgr2=0x56129f38df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:02.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.028+0000 7f3c27fff640 1 --2- 172.21.15.59:0/587829367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f385df0 0x56129f38df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.028+0000 7f3c27fff640 1 -- 172.21.15.59:0/587829367 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56129f3a4000 con 0x56129f3854d0 2024-09-10T21:17:02.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.028+0000 7f3c2ce3b640 1 --2- 172.21.15.59:0/587829367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f391d80 0x56129f393170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:02.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.029+0000 7f3c27fff640 1 --2- 172.21.15.59:0/587829367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f3854d0 0x56129f39dc90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800ac20 tx=0x7f3c1800a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5acf90b8773a75e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:02.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.029+0000 7f3c1dffb640 1 -- 172.21.15.59:0/587829367 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1802f020 con 0x56129f3854d0 2024-09-10T21:17:02.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.029+0000 7f3c1dffb640 1 -- 172.21.15.59:0/587829367 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c1801e040 con 0x56129f3854d0 2024-09-10T21:17:02.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.029+0000 7f3c1dffb640 1 -- 172.21.15.59:0/587829367 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1801d040 con 0x56129f3854d0 2024-09-10T21:17:02.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.029+0000 7f3c30c73740 1 -- 172.21.15.59:0/587829367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f3854d0 msgr2=0x56129f39dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:02.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.029+0000 7f3c30c73740 1 --2- 172.21.15.59:0/587829367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f3854d0 0x56129f39dc90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800ac20 tx=0x7f3c1800a4c0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.029+0000 7f3c30c73740 1 -- 172.21.15.59:0/587829367 shutdown_connections 2024-09-10T21:17:02.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.029+0000 7f3c30c73740 1 --2- 172.21.15.59:0/587829367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f391d80 0x56129f393170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.029+0000 7f3c30c73740 1 --2- 172.21.15.59:0/587829367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f385df0 0x56129f38df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.029+0000 7f3c30c73740 1 --2- 172.21.15.59:0/587829367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f3854d0 0x56129f39dc90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.029+0000 7f3c30c73740 1 -- 172.21.15.59:0/587829367 >> 172.21.15.59:0/587829367 conn(0x56129f383300 msgr2=0x56129f38d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:02.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.030+0000 7f3c30c73740 1 -- 172.21.15.59:0/587829367 shutdown_connections 2024-09-10T21:17:02.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.030+0000 7f3c30c73740 1 -- 172.21.15.59:0/587829367 wait complete. 2024-09-10T21:17:02.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.030+0000 7f3c30c73740 1 -- start start 2024-09-10T21:17:02.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.030+0000 7f3c30c73740 1 Processor -- start 2024-09-10T21:17:02.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.030+0000 7f3c30c73740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f3854d0 0x56129f399f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:02.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.030+0000 7f3c30c73740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 0x56129f39a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:02.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.030+0000 7f3c30c73740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f391d80 0x56129f394cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:02.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.030+0000 7f3c30c73740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3c281af700 con 0x56129f385df0 2024-09-10T21:17:02.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.030+0000 7f3c30c73740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c281af030 con 0x56129f391d80 2024-09-10T21:17:02.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.030+0000 7f3c30c73740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3c281ac270 con 0x56129f3854d0 2024-09-10T21:17:02.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.030+0000 7f3c30c73740 10 client.0 _ll_register_callbacks cb 0x7f3c1000bd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:02.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.030+0000 7f3c1ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 0x56129f39a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:02.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.031+0000 7f3c1ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 0x56129f39a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39868/0 (socket says 172.21.15.59:39868) 2024-09-10T21:17:02.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.031+0000 7f3c1ffff640 1 -- 172.21.15.59:0/3059881260 learned_addr learned my addr 172.21.15.59:0/3059881260 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:02.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.031+0000 7f3c27fff640 1 --2- 172.21.15.59:0/3059881260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f3854d0 0x56129f399f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:02.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.031+0000 7f3c2ce3b640 1 --2- 172.21.15.59:0/3059881260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f391d80 0x56129f394cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:02.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.031+0000 7f3c1ffff640 1 -- 172.21.15.59:0/3059881260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f3854d0 msgr2=0x56129f399f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:02.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.031+0000 7f3c1ffff640 1 --2- 172.21.15.59:0/3059881260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f3854d0 0x56129f399f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.031+0000 7f3c1ffff640 1 -- 172.21.15.59:0/3059881260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f391d80 msgr2=0x56129f394cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:02.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.031+0000 7f3c1ffff640 1 --2- 172.21.15.59:0/3059881260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f391d80 0x56129f394cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.031+0000 7f3c1ffff640 1 -- 172.21.15.59:0/3059881260 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56129f395500 con 0x56129f385df0 2024-09-10T21:17:02.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.031+0000 7f3c1ffff640 1 --2- 172.21.15.59:0/3059881260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 0x56129f39a4f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000bfd0 tx=0x7f3c100208d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b53ba441ea812d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:02.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.031+0000 7f3c077fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:02.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.031+0000 7f3c077fe640 1 -- 172.21.15.59:0/3059881260 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1003a070 con 0x56129f385df0 2024-09-10T21:17:02.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.031+0000 7f3c077fe640 1 -- 172.21.15.59:0/3059881260 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3c100035f0 con 0x56129f385df0 2024-09-10T21:17:02.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.031+0000 7f3c30c73740 1 -- 172.21.15.59:0/3059881260 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c1801e040 con 0x56129f385df0 2024-09-10T21:17:02.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.031+0000 7f3c077fe640 1 -- 172.21.15.59:0/3059881260 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3c10045050 con 0x56129f385df0 2024-09-10T21:17:02.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.031+0000 7f3c30c73740 10 client.15756 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:02.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.031+0000 7f3c30c73740 1 -- 172.21.15.59:0/3059881260 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56129f413640 con 0x56129f385df0 2024-09-10T21:17:02.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.031+0000 7f3c077fe640 1 -- 172.21.15.59:0/3059881260 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c1801e040 con 0x56129f385df0 2024-09-10T21:17:02.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.032+0000 7f3c077fe640 1 -- 172.21.15.59:0/3059881260 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3c1001c040 con 0x56129f385df0 2024-09-10T21:17:02.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.032+0000 7f3c30c73740 10 client.15756 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:02.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.032+0000 7f3c30c73740 10 client.15756 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:17:02.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.032+0000 7f3c30c73740 20 client.15756 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:02.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.032+0000 7f3c30c73740 1 --2- 172.21.15.59:0/3059881260 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56129f3a18a0 0x56129f415d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:02.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.032+0000 7f3c30c73740 4 client.15756 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:17:02.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.032+0000 7f3c30c73740 1 -- 172.21.15.59:0/3059881260 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56129f2f98a0 con 0x56129f3a18a0 2024-09-10T21:17:02.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.032+0000 7f3c27fff640 1 --2- 172.21.15.59:0/3059881260 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56129f3a18a0 0x56129f415d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:02.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.032+0000 7f3c27fff640 1 --2- 172.21.15.59:0/3059881260 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56129f3a18a0 0x56129f415d10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=52a2835a8c32a305 server_cookie=319175ec4364d202 in_seq=0 out_seq=0 2024-09-10T21:17:02.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.032+0000 7f3c077fe640 10 client.15756 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:17:02.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.032+0000 7f3c077fe640 1 -- 172.21.15.59:0/3059881260 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56129f2f98a0 con 0x56129f3a18a0 2024-09-10T21:17:02.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.032+0000 7f3c077fe640 10 client.15756 handle_command_reply: tid=0 2024-09-10T21:17:02.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.033+0000 7f3c30c73740 1 client.15756 shutdown 2024-09-10T21:17:02.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.033+0000 7f3c30c73740 1 -- 172.21.15.59:0/3059881260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 msgr2=0x56129f39a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:02.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.033+0000 7f3c30c73740 1 --2- 172.21.15.59:0/3059881260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 0x56129f39a4f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000bfd0 tx=0x7f3c100208d0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.033+0000 7f3c30c73740 1 -- 172.21.15.59:0/3059881260 shutdown_connections 2024-09-10T21:17:02.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.033+0000 7f3c30c73740 1 --2- 172.21.15.59:0/3059881260 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56129f3a18a0 0x56129f415d10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.033+0000 7f3c30c73740 1 --2- 172.21.15.59:0/3059881260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56129f391d80 0x56129f394cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.033+0000 7f3c30c73740 1 --2- 172.21.15.59:0/3059881260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129f385df0 0x56129f39a4f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.033+0000 7f3c30c73740 1 --2- 172.21.15.59:0/3059881260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56129f3854d0 0x56129f399f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.033+0000 7f3c30c73740 1 -- 172.21.15.59:0/3059881260 >> 172.21.15.59:0/3059881260 conn(0x56129f383300 msgr2=0x56129f381c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:02.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.033+0000 7f3c077fe640 0 client.15756 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:17:02.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.033+0000 7f3c30c73740 1 -- 172.21.15.59:0/3059881260 shutdown_connections 2024-09-10T21:17:02.084 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:17:02.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.033+0000 7f3c30c73740 1 -- 172.21.15.59:0/3059881260 wait complete. 2024-09-10T21:17:02.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.033+0000 7f3c30c73740 20 client.15756 trim_cache size 0 max 16384 2024-09-10T21:17:02.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.034+0000 7f3c2e89e640 1 -- 172.21.15.59:0/2057976002 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3c140b52e0 msgr2=0x7f3c140b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:02.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.034+0000 7f3c2e89e640 1 --2- 172.21.15.59:0/2057976002 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3c140b52e0 0x7f3c140b77a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3c280ff240 tx=0x7f3c10004730 comp rx=0 tx=0).stop 2024-09-10T21:17:02.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.034+0000 7f3c2e89e640 1 -- 172.21.15.59:0/2057976002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c28108030 msgr2=0x7f3c2819eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:02.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.034+0000 7f3c2e89e640 1 --2- 172.21.15.59:0/2057976002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c28108030 0x7f3c2819eb40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009430 tx=0x7f3c200319f0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.034+0000 7f3c2e89e640 1 -- 172.21.15.59:0/2057976002 shutdown_connections 2024-09-10T21:17:02.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.034+0000 7f3c2e89e640 1 --2- 172.21.15.59:0/2057976002 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3c140b52e0 0x7f3c140b77a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.034+0000 7f3c2e89e640 1 --2- 172.21.15.59:0/2057976002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c28108030 0x7f3c2819eb40 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.034+0000 7f3c2e89e640 1 --2- 172.21.15.59:0/2057976002 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c281076b0 0x7f3c281997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.034+0000 7f3c2e89e640 1 --2- 172.21.15.59:0/2057976002 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c28100d30 0x7f3c28199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:02.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.034+0000 7f3c2e89e640 1 -- 172.21.15.59:0/2057976002 >> 172.21.15.59:0/2057976002 conn(0x7f3c280fca20 msgr2=0x7f3c280fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:02.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.034+0000 7f3c2e89e640 1 -- 172.21.15.59:0/2057976002 shutdown_connections 2024-09-10T21:17:02.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:02.034+0000 7f3c2e89e640 1 -- 172.21.15.59:0/2057976002 wait complete. 2024-09-10T21:17:02.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:02 smithi059 ceph-mon[30888]: pgmap v393: 97 pgs: 97 active+clean; 1.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:17:02.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:02 smithi154 ceph-mon[35041]: pgmap v393: 97 pgs: 97 active+clean; 1.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:17:02.799 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:17:02.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:02 smithi192 ceph-mon[35363]: pgmap v393: 97 pgs: 97 active+clean; 1.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:17:03.056 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:17:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.487+0000 7f2bdbcc6640 1 -- 172.21.15.59:0/2490023749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bd4101cd0 msgr2=0x7f2bd41020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.487+0000 7f2bdbcc6640 1 --2- 172.21.15.59:0/2490023749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bd4101cd0 0x7f2bd41020b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009900 tx=0x7f2bd002a410 comp rx=0 tx=0).stop 2024-09-10T21:17:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.487+0000 7f2bdbcc6640 1 -- 172.21.15.59:0/2490023749 shutdown_connections 2024-09-10T21:17:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.487+0000 7f2bdbcc6640 1 --2- 172.21.15.59:0/2490023749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bd4108060 0x7f2bd410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.487+0000 7f2bdbcc6640 1 --2- 172.21.15.59:0/2490023749 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bd41076e0 0x7f2bd4107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.487+0000 7f2bdbcc6640 1 --2- 172.21.15.59:0/2490023749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bd4101cd0 0x7f2bd41020b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.487+0000 7f2bdbcc6640 1 -- 172.21.15.59:0/2490023749 >> 172.21.15.59:0/2490023749 conn(0x7f2bd40fd720 msgr2=0x7f2bd40ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.488+0000 7f2bdbcc6640 1 -- 172.21.15.59:0/2490023749 shutdown_connections 2024-09-10T21:17:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.488+0000 7f2bdbcc6640 1 -- 172.21.15.59:0/2490023749 wait complete. 2024-09-10T21:17:03.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.488+0000 7f2bdbcc6640 1 Processor -- start 2024-09-10T21:17:03.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.488+0000 7f2bdbcc6640 1 -- start start 2024-09-10T21:17:03.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.488+0000 7f2bdbcc6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bd4101cd0 0x7f2bd4199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:03.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.488+0000 7f2bdbcc6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bd41076e0 0x7f2bd41997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:03.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.488+0000 7f2bdbcc6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bd4108060 0x7f2bd419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:03.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.488+0000 7f2bdbcc6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4111d20 con 0x7f2bd41076e0 2024-09-10T21:17:03.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.488+0000 7f2bdbcc6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4111ba0 con 0x7f2bd4108060 2024-09-10T21:17:03.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.488+0000 7f2bdbcc6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd4111ea0 con 0x7f2bd4101cd0 2024-09-10T21:17:03.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.489+0000 7f2bd9261640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bd41076e0 0x7f2bd41997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:03.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.489+0000 7f2bd9261640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bd41076e0 0x7f2bd41997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39878/0 (socket says 172.21.15.59:39878) 2024-09-10T21:17:03.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.489+0000 7f2bd9261640 1 -- 172.21.15.59:0/249219780 learned_addr learned my addr 172.21.15.59:0/249219780 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:03.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.489+0000 7f2bd9a62640 1 --2- 172.21.15.59:0/249219780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bd4101cd0 0x7f2bd4199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:03.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.489+0000 7f2bda263640 1 --2- 172.21.15.59:0/249219780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bd4108060 0x7f2bd419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:03.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.489+0000 7f2bd9261640 1 -- 172.21.15.59:0/249219780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bd4101cd0 msgr2=0x7f2bd4199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:03.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.489+0000 7f2bd9261640 1 --2- 172.21.15.59:0/249219780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bd4101cd0 0x7f2bd4199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.489+0000 7f2bd9261640 1 -- 172.21.15.59:0/249219780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bd4108060 msgr2=0x7f2bd419eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:03.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.489+0000 7f2bd9261640 1 --2- 172.21.15.59:0/249219780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bd4108060 0x7f2bd419eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.489+0000 7f2bd9261640 1 -- 172.21.15.59:0/249219780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd419f310 con 0x7f2bd41076e0 2024-09-10T21:17:03.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.489+0000 7f2bd9261640 1 --2- 172.21.15.59:0/249219780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bd41076e0 0x7f2bd41997a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2bc400c890 tx=0x7f2bc400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:03.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.489+0000 7f2bcaffd640 1 -- 172.21.15.59:0/249219780 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4004220 con 0x7f2bd41076e0 2024-09-10T21:17:03.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.489+0000 7f2bcaffd640 1 -- 172.21.15.59:0/249219780 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bc40043c0 con 0x7f2bd41076e0 2024-09-10T21:17:03.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.489+0000 7f2bdbcc6640 1 -- 172.21.15.59:0/249219780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd419f600 con 0x7f2bd41076e0 2024-09-10T21:17:03.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.489+0000 7f2bcaffd640 1 -- 172.21.15.59:0/249219780 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4004a00 con 0x7f2bd41076e0 2024-09-10T21:17:03.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.490+0000 7f2bdbcc6640 1 -- 172.21.15.59:0/249219780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd41a5cc0 con 0x7f2bd41076e0 2024-09-10T21:17:03.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.492+0000 7f2bde09b740 1 Processor -- start 2024-09-10T21:17:03.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.492+0000 7f2bde09b740 1 -- start start 2024-09-10T21:17:03.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.492+0000 7f2bcaffd640 1 -- 172.21.15.59:0/249219780 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f2bc40079b0 con 0x7f2bd41076e0 2024-09-10T21:17:03.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.493+0000 7f2bde09b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643926054d0 0x5643926058b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:03.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.493+0000 7f2bde09b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392605df0 0x564392615c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:03.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.493+0000 7f2bde09b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564392616190 0x564392618580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:03.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.493+0000 7f2bde09b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56439257bea0 con 0x5643926054d0 2024-09-10T21:17:03.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.493+0000 7f2bde09b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56439256b2d0 con 0x564392616190 2024-09-10T21:17:03.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.493+0000 7f2bde09b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56439256f0e0 con 0x564392605df0 2024-09-10T21:17:03.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.493+0000 7f2bda263640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643926054d0 0x5643926058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:03.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.493+0000 7f2bda263640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643926054d0 0x5643926058b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39886/0 (socket says 172.21.15.59:39886) 2024-09-10T21:17:03.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.493+0000 7f2bda263640 1 -- 172.21.15.59:0/235012362 learned_addr learned my addr 172.21.15.59:0/235012362 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:03.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.493+0000 7f2bd9261640 1 --2- 172.21.15.59:0/235012362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564392616190 0x564392618580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:03.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.493+0000 7f2bd9a62640 1 --2- 172.21.15.59:0/235012362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392605df0 0x564392615c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:03.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.493+0000 7f2bda263640 1 -- 172.21.15.59:0/235012362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392605df0 msgr2=0x564392615c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:03.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.493+0000 7f2bda263640 1 --2- 172.21.15.59:0/235012362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392605df0 0x564392615c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.493+0000 7f2bda263640 1 -- 172.21.15.59:0/235012362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564392616190 msgr2=0x564392618580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:03.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.493+0000 7f2bda263640 1 --2- 172.21.15.59:0/235012362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564392616190 0x564392618580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.493+0000 7f2bda263640 1 -- 172.21.15.59:0/235012362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643922c9650 con 0x5643926054d0 2024-09-10T21:17:03.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.493+0000 7f2bd9261640 1 --2- 172.21.15.59:0/235012362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564392616190 0x564392618580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:17:03.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.493+0000 7f2bda263640 1 --2- 172.21.15.59:0/235012362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643926054d0 0x5643926058b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc007f70 tx=0x7f2bcc00f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a794f411aa3d44 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:03.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.493+0000 7f2bcaffd640 1 --2- 172.21.15.59:0/249219780 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2bc00b52e0 0x7f2bc00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:03.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.494+0000 7f2bd9a62640 1 --2- 172.21.15.59:0/249219780 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2bc00b52e0 0x7f2bc00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:03.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.494+0000 7f2bbffff640 1 -- 172.21.15.59:0/235012362 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc010900 con 0x5643926054d0 2024-09-10T21:17:03.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.494+0000 7f2bcaffd640 1 -- 172.21.15.59:0/249219780 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2bc40e5890 con 0x7f2bd41076e0 2024-09-10T21:17:03.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.494+0000 7f2bbffff640 1 -- 172.21.15.59:0/235012362 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bcc014070 con 0x5643926054d0 2024-09-10T21:17:03.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.494+0000 7f2bbffff640 1 -- 172.21.15.59:0/235012362 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc017cc0 con 0x5643926054d0 2024-09-10T21:17:03.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.495+0000 7f2bde09b740 1 -- 172.21.15.59:0/235012362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643926054d0 msgr2=0x5643926058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:03.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.495+0000 7f2bde09b740 1 --2- 172.21.15.59:0/235012362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643926054d0 0x5643926058b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc007f70 tx=0x7f2bcc00f850 comp rx=0 tx=0).stop 2024-09-10T21:17:03.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.495+0000 7f2bd9a62640 1 --2- 172.21.15.59:0/249219780 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2bc00b52e0 0x7f2bc00b77a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0031440 tx=0x7f2bd0005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:03.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.495+0000 7f2bde09b740 1 -- 172.21.15.59:0/235012362 shutdown_connections 2024-09-10T21:17:03.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.495+0000 7f2bde09b740 1 --2- 172.21.15.59:0/235012362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564392616190 0x564392618580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.495+0000 7f2bde09b740 1 --2- 172.21.15.59:0/235012362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392605df0 0x564392615c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.495+0000 7f2bde09b740 1 --2- 172.21.15.59:0/235012362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643926054d0 0x5643926058b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.495+0000 7f2bde09b740 1 -- 172.21.15.59:0/235012362 >> 172.21.15.59:0/235012362 conn(0x564392603300 msgr2=0x5643926044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:03.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.495+0000 7f2bde09b740 1 -- 172.21.15.59:0/235012362 shutdown_connections 2024-09-10T21:17:03.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.495+0000 7f2bde09b740 1 -- 172.21.15.59:0/235012362 wait complete. 2024-09-10T21:17:03.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.495+0000 7f2bde09b740 1 -- start start 2024-09-10T21:17:03.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.495+0000 7f2bde09b740 1 Processor -- start 2024-09-10T21:17:03.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.496+0000 7f2bde09b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643926054d0 0x564392615a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:03.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.496+0000 7f2bde09b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392605df0 0x564392612eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:03.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.496+0000 7f2bde09b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564392616190 0x564392613490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:03.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.496+0000 7f2bde09b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5643923cc700 con 0x564392616190 2024-09-10T21:17:03.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.496+0000 7f2bde09b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564392506160 con 0x5643926054d0 2024-09-10T21:17:03.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.496+0000 7f2bde09b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564392618e40 con 0x564392605df0 2024-09-10T21:17:03.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.496+0000 7f2bde09b740 10 client.0 _ll_register_callbacks cb 0x56439251f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:03.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.496+0000 7f2bda263640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564392616190 0x564392613490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:03.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.496+0000 7f2bda263640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564392616190 0x564392613490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39894/0 (socket says 172.21.15.59:39894) 2024-09-10T21:17:03.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.496+0000 7f2bda263640 1 -- 172.21.15.59:0/3668713583 learned_addr learned my addr 172.21.15.59:0/3668713583 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:03.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.496+0000 7f2bd9a62640 1 --2- 172.21.15.59:0/3668713583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643926054d0 0x564392615a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:03.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.496+0000 7f2bd9261640 1 --2- 172.21.15.59:0/3668713583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392605df0 0x564392612eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:03.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.496+0000 7f2bda263640 1 -- 172.21.15.59:0/3668713583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392605df0 msgr2=0x564392612eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:03.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.496+0000 7f2bda263640 1 --2- 172.21.15.59:0/3668713583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392605df0 0x564392612eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.496+0000 7f2bda263640 1 -- 172.21.15.59:0/3668713583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643926054d0 msgr2=0x564392615a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:03.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.496+0000 7f2bda263640 1 --2- 172.21.15.59:0/3668713583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643926054d0 0x564392615a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.496+0000 7f2bda263640 1 -- 172.21.15.59:0/3668713583 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564392533c90 con 0x564392616190 2024-09-10T21:17:03.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.496+0000 7f2bda263640 1 --2- 172.21.15.59:0/3668713583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564392616190 0x564392613490 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0072e0 tx=0x7f2bcc004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7874842071816a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:03.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.496+0000 7f2bbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:03.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.497+0000 7f2bbd7fa640 1 -- 172.21.15.59:0/3668713583 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc027060 con 0x564392616190 2024-09-10T21:17:03.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.497+0000 7f2bbd7fa640 1 -- 172.21.15.59:0/3668713583 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2bcc017c50 con 0x564392616190 2024-09-10T21:17:03.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.497+0000 7f2bde09b740 1 -- 172.21.15.59:0/3668713583 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bcc014070 con 0x564392616190 2024-09-10T21:17:03.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.497+0000 7f2bbd7fa640 1 -- 172.21.15.59:0/3668713583 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2bcc004e60 con 0x564392616190 2024-09-10T21:17:03.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.497+0000 7f2bde09b740 10 client.15768 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:03.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.497+0000 7f2bde09b740 1 -- 172.21.15.59:0/3668713583 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564392624750 con 0x564392616190 2024-09-10T21:17:03.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.497+0000 7f2bbd7fa640 1 -- 172.21.15.59:0/3668713583 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bcc014070 con 0x564392616190 2024-09-10T21:17:03.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.497+0000 7f2bbd7fa640 1 -- 172.21.15.59:0/3668713583 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2bcc005040 con 0x564392616190 2024-09-10T21:17:03.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.497+0000 7f2bde09b740 10 client.15768 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:03.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.497+0000 7f2bde09b740 10 client.15768 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:17:03.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.497+0000 7f2bde09b740 20 client.15768 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:03.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.497+0000 7f2bde09b740 1 --2- 172.21.15.59:0/3668713583 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564392625bb0 0x564392627fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:03.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.497+0000 7f2bde09b740 4 client.15768 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:17:03.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.497+0000 7f2bde09b740 1 -- 172.21.15.59:0/3668713583 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56439257ddf0 con 0x564392625bb0 2024-09-10T21:17:03.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.498+0000 7f2bd9a62640 1 --2- 172.21.15.59:0/3668713583 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564392625bb0 0x564392627fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:03.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.498+0000 7f2bd9a62640 1 --2- 172.21.15.59:0/3668713583 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564392625bb0 0x564392627fa0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ac6342f91ff984fe server_cookie=826868e61fde55cb in_seq=0 out_seq=0 2024-09-10T21:17:03.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.498+0000 7f2bbd7fa640 10 client.15768 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:17:03.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.499+0000 7f2bbd7fa640 1 -- 172.21.15.59:0/3668713583 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56439257ddf0 con 0x564392625bb0 2024-09-10T21:17:03.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.499+0000 7f2bbd7fa640 10 client.15768 handle_command_reply: tid=0 2024-09-10T21:17:03.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.499+0000 7f2bde09b740 1 client.15768 shutdown 2024-09-10T21:17:03.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.499+0000 7f2bde09b740 1 -- 172.21.15.59:0/3668713583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564392616190 msgr2=0x564392613490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:03.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.499+0000 7f2bde09b740 1 --2- 172.21.15.59:0/3668713583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564392616190 0x564392613490 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0072e0 tx=0x7f2bcc004c70 comp rx=0 tx=0).stop 2024-09-10T21:17:03.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.499+0000 7f2bde09b740 1 -- 172.21.15.59:0/3668713583 shutdown_connections 2024-09-10T21:17:03.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.499+0000 7f2bde09b740 1 --2- 172.21.15.59:0/3668713583 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564392625bb0 0x564392627fa0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.499+0000 7f2bbd7fa640 0 client.15768 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:17:03.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.499+0000 7f2bde09b740 1 --2- 172.21.15.59:0/3668713583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564392616190 0x564392613490 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.499+0000 7f2bde09b740 1 --2- 172.21.15.59:0/3668713583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392605df0 0x564392612eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.499+0000 7f2bde09b740 1 --2- 172.21.15.59:0/3668713583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643926054d0 0x564392615a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.499+0000 7f2bde09b740 1 -- 172.21.15.59:0/3668713583 >> 172.21.15.59:0/3668713583 conn(0x564392603300 msgr2=0x564392602420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:03.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.499+0000 7f2bde09b740 1 -- 172.21.15.59:0/3668713583 shutdown_connections 2024-09-10T21:17:03.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.499+0000 7f2bde09b740 1 -- 172.21.15.59:0/3668713583 wait complete. 2024-09-10T21:17:03.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.500+0000 7f2bde09b740 20 client.15768 trim_cache size 0 max 16384 2024-09-10T21:17:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.513+0000 7f2bde09b740 1 Processor -- start 2024-09-10T21:17:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.513+0000 7f2bde09b740 1 -- start start 2024-09-10T21:17:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.513+0000 7f2bde09b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564392603300 0x564392622070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.513+0000 7f2bde09b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643926054d0 0x564392604a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:03.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.513+0000 7f2bde09b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392605df0 0x56439262d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.513+0000 7f2bde09b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41ac130 con 0x5643926054d0 2024-09-10T21:17:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.513+0000 7f2bde09b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41adc70 con 0x564392603300 2024-09-10T21:17:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.513+0000 7f2bde09b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41ac800 con 0x564392605df0 2024-09-10T21:17:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.513+0000 7f2bd9261640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643926054d0 0x564392604a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.513+0000 7f2bd9261640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643926054d0 0x564392604a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39898/0 (socket says 172.21.15.59:39898) 2024-09-10T21:17:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.513+0000 7f2bd9261640 1 -- 172.21.15.59:0/1266864914 learned_addr learned my addr 172.21.15.59:0/1266864914 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.513+0000 7f2bd9a62640 1 --2- 172.21.15.59:0/1266864914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564392603300 0x564392622070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.513+0000 7f2bda263640 1 --2- 172.21.15.59:0/1266864914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392605df0 0x56439262d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.513+0000 7f2bd9261640 1 -- 172.21.15.59:0/1266864914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392605df0 msgr2=0x56439262d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:03.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.513+0000 7f2bd9261640 1 --2- 172.21.15.59:0/1266864914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392605df0 0x56439262d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.513+0000 7f2bd9261640 1 -- 172.21.15.59:0/1266864914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564392603300 msgr2=0x564392622070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:03.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.513+0000 7f2bd9261640 1 --2- 172.21.15.59:0/1266864914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564392603300 0x564392622070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.513+0000 7f2bd9261640 1 -- 172.21.15.59:0/1266864914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564392603130 con 0x5643926054d0 2024-09-10T21:17:03.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.514+0000 7f2bd9261640 1 --2- 172.21.15.59:0/1266864914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643926054d0 0x564392604a60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40e33c0 tx=0x7f2bc40e9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1239d388dbf9ea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:03.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.514+0000 7f2bbf7fe640 1 -- 172.21.15.59:0/1266864914 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc401d040 con 0x5643926054d0 2024-09-10T21:17:03.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.514+0000 7f2bbf7fe640 1 -- 172.21.15.59:0/1266864914 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bc4005290 con 0x5643926054d0 2024-09-10T21:17:03.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.514+0000 7f2bbf7fe640 1 -- 172.21.15.59:0/1266864914 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc40ac130 con 0x5643926054d0 2024-09-10T21:17:03.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.514+0000 7f2bde09b740 1 -- 172.21.15.59:0/1266864914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643926054d0 msgr2=0x564392604a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:03.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.514+0000 7f2bde09b740 1 --2- 172.21.15.59:0/1266864914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643926054d0 0x564392604a60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40e33c0 tx=0x7f2bc40e9040 comp rx=0 tx=0).stop 2024-09-10T21:17:03.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.515+0000 7f2bde09b740 1 -- 172.21.15.59:0/1266864914 shutdown_connections 2024-09-10T21:17:03.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.515+0000 7f2bde09b740 1 --2- 172.21.15.59:0/1266864914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392605df0 0x56439262d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.515+0000 7f2bde09b740 1 --2- 172.21.15.59:0/1266864914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643926054d0 0x564392604a60 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.515+0000 7f2bde09b740 1 --2- 172.21.15.59:0/1266864914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564392603300 0x564392622070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.515+0000 7f2bde09b740 1 -- 172.21.15.59:0/1266864914 >> 172.21.15.59:0/1266864914 conn(0x5643926135f0 msgr2=0x564392604350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:03.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.515+0000 7f2bde09b740 1 -- 172.21.15.59:0/1266864914 shutdown_connections 2024-09-10T21:17:03.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.515+0000 7f2bde09b740 1 -- 172.21.15.59:0/1266864914 wait complete. 2024-09-10T21:17:03.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.515+0000 7f2bde09b740 1 -- start start 2024-09-10T21:17:03.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.515+0000 7f2bde09b740 1 Processor -- start 2024-09-10T21:17:03.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.515+0000 7f2bde09b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392603300 0x56439261e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:03.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.515+0000 7f2bde09b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643926054d0 0x56439261b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:03.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.515+0000 7f2bde09b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564392605df0 0x56439261b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:03.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.515+0000 7f2bde09b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41ad5a0 con 0x564392605df0 2024-09-10T21:17:03.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.516+0000 7f2bde09b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41aced0 con 0x5643926054d0 2024-09-10T21:17:03.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.516+0000 7f2bde09b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41aa110 con 0x564392603300 2024-09-10T21:17:03.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.516+0000 7f2bde09b740 10 client.0 _ll_register_callbacks cb 0x7f2bc40eb420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:03.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.516+0000 7f2bda263640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564392605df0 0x56439261b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:03.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.516+0000 7f2bda263640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564392605df0 0x56439261b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39914/0 (socket says 172.21.15.59:39914) 2024-09-10T21:17:03.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.516+0000 7f2bda263640 1 -- 172.21.15.59:0/3693897711 learned_addr learned my addr 172.21.15.59:0/3693897711 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:03.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.516+0000 7f2bd9261640 1 --2- 172.21.15.59:0/3693897711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643926054d0 0x56439261b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:03.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.516+0000 7f2bd9a62640 1 --2- 172.21.15.59:0/3693897711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392603300 0x56439261e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.516+0000 7f2bda263640 1 -- 172.21.15.59:0/3693897711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392603300 msgr2=0x56439261e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.516+0000 7f2bda263640 1 --2- 172.21.15.59:0/3693897711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392603300 0x56439261e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.516+0000 7f2bda263640 1 -- 172.21.15.59:0/3693897711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643926054d0 msgr2=0x56439261b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.516+0000 7f2bda263640 1 --2- 172.21.15.59:0/3693897711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643926054d0 0x56439261b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.516+0000 7f2bda263640 1 -- 172.21.15.59:0/3693897711 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56439261bd50 con 0x564392605df0 2024-09-10T21:17:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.516+0000 7f2bda263640 1 --2- 172.21.15.59:0/3693897711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564392605df0 0x56439261b5e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00f890 tx=0x7f2bcc007230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1810009b25e22e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.516+0000 7f2bbd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.516+0000 7f2bbd7fa640 1 -- 172.21.15.59:0/3693897711 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc027070 con 0x564392605df0 2024-09-10T21:17:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.516+0000 7f2bbd7fa640 1 -- 172.21.15.59:0/3693897711 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2bcc002030 con 0x564392605df0 2024-09-10T21:17:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.516+0000 7f2bde09b740 1 -- 172.21.15.59:0/3693897711 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5643925798a0 con 0x564392605df0 2024-09-10T21:17:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.517+0000 7f2bbd7fa640 1 -- 172.21.15.59:0/3693897711 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2bcc007860 con 0x564392605df0 2024-09-10T21:17:03.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.517+0000 7f2bde09b740 10 client.15774 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.517+0000 7f2bde09b740 1 -- 172.21.15.59:0/3693897711 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564392693770 con 0x564392605df0 2024-09-10T21:17:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.517+0000 7f2bbd7fa640 1 -- 172.21.15.59:0/3693897711 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5643925798a0 con 0x564392605df0 2024-09-10T21:17:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.517+0000 7f2bbd7fa640 1 -- 172.21.15.59:0/3693897711 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2bcc005000 con 0x564392605df0 2024-09-10T21:17:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.517+0000 7f2bde09b740 10 client.15774 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.517+0000 7f2bde09b740 10 client.15774 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:17:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.517+0000 7f2bde09b740 20 client.15774 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.517+0000 7f2bde09b740 1 --2- 172.21.15.59:0/3693897711 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564392616190 0x564392695ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.517+0000 7f2bde09b740 4 client.15774 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:17:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.517+0000 7f2bde09b740 1 -- 172.21.15.59:0/3693897711 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564392576cd0 con 0x564392616190 2024-09-10T21:17:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.517+0000 7f2bd9a62640 1 --2- 172.21.15.59:0/3693897711 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564392616190 0x564392695ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.518+0000 7f2bbd7fa640 10 client.15774 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:17:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.518+0000 7f2bd9a62640 1 --2- 172.21.15.59:0/3693897711 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564392616190 0x564392695ef0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e088304a9817cd7c server_cookie=2271bffbaa1fd7d4 in_seq=0 out_seq=0 2024-09-10T21:17:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.518+0000 7f2bbd7fa640 1 -- 172.21.15.59:0/3693897711 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564392576cd0 con 0x564392616190 2024-09-10T21:17:03.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.518+0000 7f2bbd7fa640 10 client.15774 handle_command_reply: tid=0 2024-09-10T21:17:03.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.518+0000 7f2bde09b740 1 client.15774 shutdown 2024-09-10T21:17:03.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.518+0000 7f2bde09b740 1 -- 172.21.15.59:0/3693897711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564392605df0 msgr2=0x56439261b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:03.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.518+0000 7f2bde09b740 1 --2- 172.21.15.59:0/3693897711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564392605df0 0x56439261b5e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00f890 tx=0x7f2bcc007230 comp rx=0 tx=0).stop 2024-09-10T21:17:03.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.518+0000 7f2bde09b740 1 -- 172.21.15.59:0/3693897711 shutdown_connections 2024-09-10T21:17:03.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.518+0000 7f2bde09b740 1 --2- 172.21.15.59:0/3693897711 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564392616190 0x564392695ef0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.518+0000 7f2bde09b740 1 --2- 172.21.15.59:0/3693897711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564392605df0 0x56439261b5e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.518+0000 7f2bde09b740 1 --2- 172.21.15.59:0/3693897711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5643926054d0 0x56439261b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.518+0000 7f2bde09b740 1 --2- 172.21.15.59:0/3693897711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564392603300 0x56439261e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.518+0000 7f2bbd7fa640 0 client.15774 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:17:03.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.518+0000 7f2bde09b740 1 -- 172.21.15.59:0/3693897711 >> 172.21.15.59:0/3693897711 conn(0x5643926135f0 msgr2=0x5643926144e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:03.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.518+0000 7f2bde09b740 1 -- 172.21.15.59:0/3693897711 shutdown_connections 2024-09-10T21:17:03.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.518+0000 7f2bde09b740 1 -- 172.21.15.59:0/3693897711 wait complete. 2024-09-10T21:17:03.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.518+0000 7f2bde09b740 20 client.15774 trim_cache size 0 max 16384 2024-09-10T21:17:03.531 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:17:03.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.519+0000 7f2bdbcc6640 1 -- 172.21.15.59:0/249219780 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2bc00b52e0 msgr2=0x7f2bc00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:03.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.519+0000 7f2bdbcc6640 1 --2- 172.21.15.59:0/249219780 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2bc00b52e0 0x7f2bc00b77a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0031440 tx=0x7f2bd0005e80 comp rx=0 tx=0).stop 2024-09-10T21:17:03.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.519+0000 7f2bdbcc6640 1 -- 172.21.15.59:0/249219780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bd41076e0 msgr2=0x7f2bd41997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:03.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.519+0000 7f2bdbcc6640 1 --2- 172.21.15.59:0/249219780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bd41076e0 0x7f2bd41997a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2bc400c890 tx=0x7f2bc400cd50 comp rx=0 tx=0).stop 2024-09-10T21:17:03.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.519+0000 7f2bdbcc6640 1 -- 172.21.15.59:0/249219780 shutdown_connections 2024-09-10T21:17:03.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.519+0000 7f2bdbcc6640 1 --2- 172.21.15.59:0/249219780 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2bc00b52e0 0x7f2bc00b77a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.519+0000 7f2bdbcc6640 1 --2- 172.21.15.59:0/249219780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bd4108060 0x7f2bd419eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.519+0000 7f2bdbcc6640 1 --2- 172.21.15.59:0/249219780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bd41076e0 0x7f2bd41997a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.519+0000 7f2bdbcc6640 1 --2- 172.21.15.59:0/249219780 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bd4101cd0 0x7f2bd4199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:03.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.519+0000 7f2bdbcc6640 1 -- 172.21.15.59:0/249219780 >> 172.21.15.59:0/249219780 conn(0x7f2bd40fd720 msgr2=0x7f2bd40ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:03.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.519+0000 7f2bdbcc6640 1 -- 172.21.15.59:0/249219780 shutdown_connections 2024-09-10T21:17:03.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:03.519+0000 7f2bdbcc6640 1 -- 172.21.15.59:0/249219780 wait complete. 2024-09-10T21:17:04.272 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:17:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:17:04.655 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:04 smithi059 ceph-mon[30888]: pgmap v394: 97 pgs: 97 active+clean; 1.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:04.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:04 smithi154 ceph-mon[35041]: pgmap v394: 97 pgs: 97 active+clean; 1.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:04.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:04 smithi192 ceph-mon[35363]: pgmap v394: 97 pgs: 97 active+clean; 1.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.004+0000 7f45885f3640 1 -- 172.21.15.59:0/2514435862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f458010d0e0 msgr2=0x7f458010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.004+0000 7f45885f3640 1 --2- 172.21.15.59:0/2514435862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f458010d0e0 0x7f458010f550 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4578009ca0 tx=0x7f457802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.004+0000 7f45885f3640 1 -- 172.21.15.59:0/2514435862 shutdown_connections 2024-09-10T21:17:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.004+0000 7f45885f3640 1 --2- 172.21.15.59:0/2514435862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f458010d0e0 0x7f458010f550 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.004+0000 7f45885f3640 1 --2- 172.21.15.59:0/2514435862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4580104530 0x7f458010cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.004+0000 7f45885f3640 1 --2- 172.21.15.59:0/2514435862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4580103b30 0x7f4580103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.004+0000 7f45885f3640 1 -- 172.21.15.59:0/2514435862 >> 172.21.15.59:0/2514435862 conn(0x7f45800fd700 msgr2=0x7f45800ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.005+0000 7f45885f3640 1 -- 172.21.15.59:0/2514435862 shutdown_connections 2024-09-10T21:17:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.005+0000 7f45885f3640 1 -- 172.21.15.59:0/2514435862 wait complete. 2024-09-10T21:17:05.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.005+0000 7f45885f3640 1 Processor -- start 2024-09-10T21:17:05.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.005+0000 7f45885f3640 1 -- start start 2024-09-10T21:17:05.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.005+0000 7f45885f3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4580103b30 0x7f4580199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:05.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.005+0000 7f45885f3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4580104530 0x7f4580199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:05.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.005+0000 7f45885f3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f458010d0e0 0x7f458019eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:05.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.005+0000 7f45885f3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4580112d60 con 0x7f4580103b30 2024-09-10T21:17:05.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.005+0000 7f45885f3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4580112be0 con 0x7f458010d0e0 2024-09-10T21:17:05.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.005+0000 7f45885f3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4580112ee0 con 0x7f4580104530 2024-09-10T21:17:05.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.006+0000 7f458638f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4580103b30 0x7f4580199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.006+0000 7f458638f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4580103b30 0x7f4580199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39928/0 (socket says 172.21.15.59:39928) 2024-09-10T21:17:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.006+0000 7f458638f640 1 -- 172.21.15.59:0/2842303205 learned_addr learned my addr 172.21.15.59:0/2842303205 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.006+0000 7f4585b8e640 1 --2- 172.21.15.59:0/2842303205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4580104530 0x7f4580199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.006+0000 7f4586b90640 1 --2- 172.21.15.59:0/2842303205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f458010d0e0 0x7f458019eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.006+0000 7f458638f640 1 -- 172.21.15.59:0/2842303205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4580104530 msgr2=0x7f4580199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.006+0000 7f458638f640 1 --2- 172.21.15.59:0/2842303205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4580104530 0x7f4580199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.006+0000 7f458638f640 1 -- 172.21.15.59:0/2842303205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f458010d0e0 msgr2=0x7f458019eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.006+0000 7f458638f640 1 --2- 172.21.15.59:0/2842303205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f458010d0e0 0x7f458019eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.006+0000 7f458638f640 1 -- 172.21.15.59:0/2842303205 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458019f2c0 con 0x7f4580103b30 2024-09-10T21:17:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.006+0000 7f4586b90640 1 --2- 172.21.15.59:0/2842303205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f458010d0e0 0x7f458019eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.006+0000 7f458638f640 1 --2- 172.21.15.59:0/2842303205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4580103b30 0x7f4580199210 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f457c00d770 tx=0x7f457c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:05.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.006+0000 7f45777fe640 1 -- 172.21.15.59:0/2842303205 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c017070 con 0x7f4580103b30 2024-09-10T21:17:05.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.006+0000 7f45777fe640 1 -- 172.21.15.59:0/2842303205 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f457c0054d0 con 0x7f4580103b30 2024-09-10T21:17:05.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.006+0000 7f45885f3640 1 -- 172.21.15.59:0/2842303205 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f458019f5b0 con 0x7f4580103b30 2024-09-10T21:17:05.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.006+0000 7f45777fe640 1 -- 172.21.15.59:0/2842303205 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c004c30 con 0x7f4580103b30 2024-09-10T21:17:05.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.006+0000 7f45885f3640 1 -- 172.21.15.59:0/2842303205 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45801a5c70 con 0x7f4580103b30 2024-09-10T21:17:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.009+0000 7f458a9c8740 1 Processor -- start 2024-09-10T21:17:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.010+0000 7f458a9c8740 1 -- start start 2024-09-10T21:17:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.010+0000 7f458a9c8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 0x563a44d928b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.010+0000 7f458a9c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563a44d92df0 0x563a44d9e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.010+0000 7f458a9c8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d9ed80 0x563a44da1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.010+0000 7f45777fe640 1 -- 172.21.15.59:0/2842303205 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f457c004e10 con 0x7f4580103b30 2024-09-10T21:17:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.010+0000 7f458a9c8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563a44d08ea0 con 0x563a44d924d0 2024-09-10T21:17:05.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.010+0000 7f458a9c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563a44cf82d0 con 0x563a44d92df0 2024-09-10T21:17:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.010+0000 7f458a9c8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563a44cfc0e0 con 0x563a44d9ed80 2024-09-10T21:17:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.010+0000 7f4586b90640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 0x563a44d928b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.010+0000 7f4586b90640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 0x563a44d928b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39942/0 (socket says 172.21.15.59:39942) 2024-09-10T21:17:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.010+0000 7f4586b90640 1 -- 172.21.15.59:0/3775504446 learned_addr learned my addr 172.21.15.59:0/3775504446 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.010+0000 7f4585b8e640 1 --2- 172.21.15.59:0/3775504446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d9ed80 0x563a44da1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.011+0000 7f4586b90640 1 -- 172.21.15.59:0/3775504446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d9ed80 msgr2=0x563a44da1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.011+0000 7f4586b90640 1 --2- 172.21.15.59:0/3775504446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d9ed80 0x563a44da1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.011+0000 7f4586b90640 1 -- 172.21.15.59:0/3775504446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563a44d92df0 msgr2=0x563a44d9e840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T21:17:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.011+0000 7f4586b90640 1 --2- 172.21.15.59:0/3775504446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563a44d92df0 0x563a44d9e840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.011+0000 7f4586b90640 1 -- 172.21.15.59:0/3775504446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a44a56650 con 0x563a44d924d0 2024-09-10T21:17:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.011+0000 7f4586b90640 1 --2- 172.21.15.59:0/3775504446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 0x563a44d928b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4578031b70 tx=0x7f4578009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64abe9e79264c2ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:05.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.011+0000 7f45777fe640 1 --2- 172.21.15.59:0/2842303205 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f456c0b5360 0x7f456c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:05.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.011+0000 7f4574ff9640 1 -- 172.21.15.59:0/3775504446 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4578031650 con 0x563a44d924d0 2024-09-10T21:17:05.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.011+0000 7f4574ff9640 1 -- 172.21.15.59:0/3775504446 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4578036040 con 0x563a44d924d0 2024-09-10T21:17:05.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.011+0000 7f458638f640 1 --2- 172.21.15.59:0/2842303205 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f456c0b5360 0x7f456c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:05.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.011+0000 7f4574ff9640 1 -- 172.21.15.59:0/3775504446 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45780044b0 con 0x563a44d924d0 2024-09-10T21:17:05.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.011+0000 7f45777fe640 1 -- 172.21.15.59:0/2842303205 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f457c0e5620 con 0x7f4580103b30 2024-09-10T21:17:05.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.012+0000 7f458a9c8740 1 -- 172.21.15.59:0/3775504446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 msgr2=0x563a44d928b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:05.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.012+0000 7f458a9c8740 1 --2- 172.21.15.59:0/3775504446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 0x563a44d928b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4578031b70 tx=0x7f4578009a20 comp rx=0 tx=0).stop 2024-09-10T21:17:05.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.012+0000 7f458638f640 1 --2- 172.21.15.59:0/2842303205 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f456c0b5360 0x7f456c0b7820 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f457c0abda0 tx=0x7f457c009f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:05.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.012+0000 7f458a9c8740 1 -- 172.21.15.59:0/3775504446 shutdown_connections 2024-09-10T21:17:05.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.012+0000 7f458a9c8740 1 --2- 172.21.15.59:0/3775504446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d9ed80 0x563a44da1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.012+0000 7f458a9c8740 1 --2- 172.21.15.59:0/3775504446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563a44d92df0 0x563a44d9e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.012+0000 7f458a9c8740 1 --2- 172.21.15.59:0/3775504446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 0x563a44d928b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.012+0000 7f458a9c8740 1 -- 172.21.15.59:0/3775504446 >> 172.21.15.59:0/3775504446 conn(0x563a44d90300 msgr2=0x563a44d914a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:05.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.012+0000 7f458a9c8740 1 -- 172.21.15.59:0/3775504446 shutdown_connections 2024-09-10T21:17:05.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.012+0000 7f458a9c8740 1 -- 172.21.15.59:0/3775504446 wait complete. 2024-09-10T21:17:05.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.012+0000 7f458a9c8740 1 -- start start 2024-09-10T21:17:05.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.013+0000 7f458a9c8740 1 Processor -- start 2024-09-10T21:17:05.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.013+0000 7f458a9c8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 0x563a44d9e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:05.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.013+0000 7f458a9c8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d92df0 0x563a44d9bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:05.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.013+0000 7f458a9c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563a44d9ed80 0x563a44d9c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:05.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.013+0000 7f458a9c8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563a44b59700 con 0x563a44d924d0 2024-09-10T21:17:05.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.013+0000 7f458a9c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563a44c93160 con 0x563a44d9ed80 2024-09-10T21:17:05.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.013+0000 7f458a9c8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563a44da19a0 con 0x563a44d92df0 2024-09-10T21:17:05.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.013+0000 7f458a9c8740 10 client.0 _ll_register_callbacks cb 0x563a44cac9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:05.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.013+0000 7f4586b90640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 0x563a44d9e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:05.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.013+0000 7f4586b90640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 0x563a44d9e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39948/0 (socket says 172.21.15.59:39948) 2024-09-10T21:17:05.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.013+0000 7f4586b90640 1 -- 172.21.15.59:0/2221637546 learned_addr learned my addr 172.21.15.59:0/2221637546 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:05.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.013+0000 7f4585b8e640 1 --2- 172.21.15.59:0/2221637546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d92df0 0x563a44d9bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:05.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.013+0000 7f4586b90640 1 -- 172.21.15.59:0/2221637546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d92df0 msgr2=0x563a44d9bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:05.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.013+0000 7f4586b90640 1 --2- 172.21.15.59:0/2221637546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d92df0 0x563a44d9bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.013+0000 7f4586b90640 1 -- 172.21.15.59:0/2221637546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563a44d9ed80 msgr2=0x563a44d9c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:05.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.013+0000 7f4586b90640 1 --2- 172.21.15.59:0/2221637546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563a44d9ed80 0x563a44d9c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.013+0000 7f4586b90640 1 -- 172.21.15.59:0/2221637546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a44cc0c90 con 0x563a44d924d0 2024-09-10T21:17:05.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.013+0000 7f4586b90640 1 --2- 172.21.15.59:0/2221637546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 0x563a44d9e6b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4578006010 tx=0x7f45780095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5070214ea1b268b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:05.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.013+0000 7f4569ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.014+0000 7f4569ffb640 1 -- 172.21.15.59:0/2221637546 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4578031660 con 0x563a44d924d0 2024-09-10T21:17:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.014+0000 7f4569ffb640 1 -- 172.21.15.59:0/2221637546 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4578031800 con 0x563a44d924d0 2024-09-10T21:17:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.014+0000 7f458a9c8740 1 -- 172.21.15.59:0/2221637546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4578036040 con 0x563a44d924d0 2024-09-10T21:17:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.014+0000 7f4569ffb640 1 -- 172.21.15.59:0/2221637546 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4578003970 con 0x563a44d924d0 2024-09-10T21:17:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.014+0000 7f458a9c8740 10 client.15786 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.014+0000 7f458a9c8740 1 -- 172.21.15.59:0/2221637546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563a44dad370 con 0x563a44d924d0 2024-09-10T21:17:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.014+0000 7f4569ffb640 1 -- 172.21.15.59:0/2221637546 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4578036040 con 0x563a44d924d0 2024-09-10T21:17:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.014+0000 7f4569ffb640 1 -- 172.21.15.59:0/2221637546 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f457802f6f0 con 0x563a44d924d0 2024-09-10T21:17:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.014+0000 7f458a9c8740 10 client.15786 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.014+0000 7f458a9c8740 10 client.15786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:17:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.014+0000 7f458a9c8740 20 client.15786 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.014+0000 7f458a9c8740 1 --2- 172.21.15.59:0/2221637546 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x563a44dae6c0 0x563a44db0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.014+0000 7f458a9c8740 4 client.15786 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:17:05.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.014+0000 7f458a9c8740 1 -- 172.21.15.59:0/2221637546 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a44d0adf0 con 0x563a44dae6c0 2024-09-10T21:17:05.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.015+0000 7f4585b8e640 1 --2- 172.21.15.59:0/2221637546 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x563a44dae6c0 0x563a44db0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:05.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.015+0000 7f4569ffb640 10 client.15786 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:05.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.015+0000 7f4585b8e640 1 --2- 172.21.15.59:0/2221637546 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x563a44dae6c0 0x563a44db0ab0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=190fa925421570b3 server_cookie=5fd7a4af8d9d13c9 in_seq=0 out_seq=0 2024-09-10T21:17:05.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.016+0000 7f4569ffb640 1 -- 172.21.15.59:0/2221637546 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563a44d0adf0 con 0x563a44dae6c0 2024-09-10T21:17:05.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.016+0000 7f4569ffb640 10 client.15786 handle_command_reply: tid=0 2024-09-10T21:17:05.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.016+0000 7f458a9c8740 1 client.15786 shutdown 2024-09-10T21:17:05.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.016+0000 7f458a9c8740 1 -- 172.21.15.59:0/2221637546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 msgr2=0x563a44d9e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:05.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.016+0000 7f458a9c8740 1 --2- 172.21.15.59:0/2221637546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 0x563a44d9e6b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4578006010 tx=0x7f45780095d0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.016+0000 7f458a9c8740 1 -- 172.21.15.59:0/2221637546 shutdown_connections 2024-09-10T21:17:05.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.016+0000 7f458a9c8740 1 --2- 172.21.15.59:0/2221637546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563a44d9ed80 0x563a44d9c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.016+0000 7f458a9c8740 1 --2- 172.21.15.59:0/2221637546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d92df0 0x563a44d9bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.016+0000 7f458a9c8740 1 --2- 172.21.15.59:0/2221637546 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x563a44dae6c0 0x563a44db0ab0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.016+0000 7f458a9c8740 1 --2- 172.21.15.59:0/2221637546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 0x563a44d9e6b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.016+0000 7f458a9c8740 1 -- 172.21.15.59:0/2221637546 >> 172.21.15.59:0/2221637546 conn(0x563a44d90300 msgr2=0x563a44d95e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:05.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.016+0000 7f4569ffb640 0 client.15786 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:05.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.016+0000 7f458a9c8740 1 -- 172.21.15.59:0/2221637546 shutdown_connections 2024-09-10T21:17:05.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.016+0000 7f458a9c8740 1 -- 172.21.15.59:0/2221637546 wait complete. 2024-09-10T21:17:05.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.016+0000 7f458a9c8740 20 client.15786 trim_cache size 0 max 16384 2024-09-10T21:17:05.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.029+0000 7f458a9c8740 1 Processor -- start 2024-09-10T21:17:05.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.029+0000 7f458a9c8740 1 -- start start 2024-09-10T21:17:05.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f458a9c8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 0x563a44daaca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:05.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f458a9c8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d92df0 0x563a44d8f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:05.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f458a9c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563a44d9ed80 0x563a44da0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:05.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f458a9c8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f45801ae310 con 0x563a44d924d0 2024-09-10T21:17:05.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f458a9c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45801afe50 con 0x563a44d9ed80 2024-09-10T21:17:05.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f458a9c8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f45801ae9e0 con 0x563a44d92df0 2024-09-10T21:17:05.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f4586b90640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 0x563a44daaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:05.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f4586b90640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 0x563a44daaca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39962/0 (socket says 172.21.15.59:39962) 2024-09-10T21:17:05.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f4586b90640 1 -- 172.21.15.59:0/3405691413 learned_addr learned my addr 172.21.15.59:0/3405691413 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:05.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f4585b8e640 1 --2- 172.21.15.59:0/3405691413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d92df0 0x563a44d8f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:05.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f4586b90640 1 -- 172.21.15.59:0/3405691413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d92df0 msgr2=0x563a44d8f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:05.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f4586b90640 1 --2- 172.21.15.59:0/3405691413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d92df0 0x563a44d8f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f4586b90640 1 -- 172.21.15.59:0/3405691413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563a44d9ed80 msgr2=0x563a44da0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:05.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f4586b90640 1 --2- 172.21.15.59:0/3405691413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563a44d9ed80 0x563a44da0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f4586b90640 1 -- 172.21.15.59:0/3405691413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a44d9a000 con 0x563a44d924d0 2024-09-10T21:17:05.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f4585b8e640 1 --2- 172.21.15.59:0/3405691413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d92df0 0x563a44d8f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:05.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f4586b90640 1 --2- 172.21.15.59:0/3405691413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 0x563a44daaca0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4578000f80 tx=0x7f4578031bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d89dd4876186d2f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:05.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f456bfff640 1 -- 172.21.15.59:0/3405691413 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457802f3e0 con 0x563a44d924d0 2024-09-10T21:17:05.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f456bfff640 1 -- 172.21.15.59:0/3405691413 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4578036040 con 0x563a44d924d0 2024-09-10T21:17:05.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.030+0000 7f456bfff640 1 -- 172.21.15.59:0/3405691413 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457802f7c0 con 0x563a44d924d0 2024-09-10T21:17:05.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.031+0000 7f458a9c8740 1 -- 172.21.15.59:0/3405691413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 msgr2=0x563a44daaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:05.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.031+0000 7f458a9c8740 1 --2- 172.21.15.59:0/3405691413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 0x563a44daaca0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4578000f80 tx=0x7f4578031bd0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.031+0000 7f458a9c8740 1 -- 172.21.15.59:0/3405691413 shutdown_connections 2024-09-10T21:17:05.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.031+0000 7f458a9c8740 1 --2- 172.21.15.59:0/3405691413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563a44d9ed80 0x563a44da0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.031+0000 7f458a9c8740 1 --2- 172.21.15.59:0/3405691413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d92df0 0x563a44d8f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.031+0000 7f458a9c8740 1 --2- 172.21.15.59:0/3405691413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d924d0 0x563a44daaca0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.031+0000 7f458a9c8740 1 -- 172.21.15.59:0/3405691413 >> 172.21.15.59:0/3405691413 conn(0x563a44d90300 msgr2=0x563a44d8ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:05.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.031+0000 7f458a9c8740 1 -- 172.21.15.59:0/3405691413 shutdown_connections 2024-09-10T21:17:05.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.031+0000 7f458a9c8740 1 -- 172.21.15.59:0/3405691413 wait complete. 2024-09-10T21:17:05.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.031+0000 7f458a9c8740 1 -- start start 2024-09-10T21:17:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f458a9c8740 1 Processor -- start 2024-09-10T21:17:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f458a9c8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563a44d924d0 0x563a44daf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f458a9c8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d92df0 0x563a44dafc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f458a9c8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d9ed80 0x563a44db0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f458a9c8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f45801af780 con 0x563a44d92df0 2024-09-10T21:17:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f458a9c8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45801af0b0 con 0x563a44d924d0 2024-09-10T21:17:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f458a9c8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f45801ac310 con 0x563a44d9ed80 2024-09-10T21:17:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f458a9c8740 10 client.0 _ll_register_callbacks cb 0x7f457000a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f4585b8e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d92df0 0x563a44dafc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f4585b8e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d92df0 0x563a44dafc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39976/0 (socket says 172.21.15.59:39976) 2024-09-10T21:17:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f4585b8e640 1 -- 172.21.15.59:0/2694414840 learned_addr learned my addr 172.21.15.59:0/2694414840 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f4586b90640 1 --2- 172.21.15.59:0/2694414840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d9ed80 0x563a44db0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f4586b90640 1 --2- 172.21.15.59:0/2694414840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563a44d924d0 0x563a44daf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:05.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f4585b8e640 1 -- 172.21.15.59:0/2694414840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d9ed80 msgr2=0x563a44db0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f4585b8e640 1 --2- 172.21.15.59:0/2694414840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d9ed80 0x563a44db0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f4585b8e640 1 -- 172.21.15.59:0/2694414840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563a44d924d0 msgr2=0x563a44daf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f4585b8e640 1 --2- 172.21.15.59:0/2694414840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563a44d924d0 0x563a44daf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f4585b8e640 1 -- 172.21.15.59:0/2694414840 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a44e1a2f0 con 0x563a44d92df0 2024-09-10T21:17:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f4586b90640 1 --2- 172.21.15.59:0/2694414840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563a44d924d0 0x563a44daf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f4585b8e640 1 --2- 172.21.15.59:0/2694414840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d92df0 0x563a44dafc30 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f458010f800 tx=0x7f45700108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea7463b554e242a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.032+0000 7f4569ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.033+0000 7f4569ffb640 1 -- 172.21.15.59:0/2694414840 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570028030 con 0x563a44d92df0 2024-09-10T21:17:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.033+0000 7f4569ffb640 1 -- 172.21.15.59:0/2694414840 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4570004020 con 0x563a44d92df0 2024-09-10T21:17:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.033+0000 7f458a9c8740 1 -- 172.21.15.59:0/2694414840 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4578036040 con 0x563a44d92df0 2024-09-10T21:17:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.033+0000 7f4569ffb640 1 -- 172.21.15.59:0/2694414840 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4570004220 con 0x563a44d92df0 2024-09-10T21:17:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.033+0000 7f458a9c8740 10 client.15792 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:05.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.033+0000 7f458a9c8740 1 -- 172.21.15.59:0/2694414840 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563a44e1b680 con 0x563a44d92df0 2024-09-10T21:17:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.033+0000 7f4569ffb640 1 -- 172.21.15.59:0/2694414840 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4578036040 con 0x563a44d92df0 2024-09-10T21:17:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.033+0000 7f4569ffb640 1 -- 172.21.15.59:0/2694414840 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4570003820 con 0x563a44d92df0 2024-09-10T21:17:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.033+0000 7f458a9c8740 10 client.15792 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.033+0000 7f458a9c8740 10 client.15792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:17:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.033+0000 7f458a9c8740 20 client.15792 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.033+0000 7f458a9c8740 1 --2- 172.21.15.59:0/2694414840 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x563a44e1be80 0x563a44e1e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.033+0000 7f458a9c8740 4 client.15792 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:17:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.033+0000 7f458a9c8740 1 -- 172.21.15.59:0/2694414840 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563a44d068a0 con 0x563a44e1be80 2024-09-10T21:17:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.034+0000 7f4586b90640 1 --2- 172.21.15.59:0/2694414840 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x563a44e1be80 0x563a44e1e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.034+0000 7f4586b90640 1 --2- 172.21.15.59:0/2694414840 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x563a44e1be80 0x563a44e1e2a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36d2259fe2007bc8 server_cookie=e41b761a7d636f47 in_seq=0 out_seq=0 2024-09-10T21:17:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.034+0000 7f4569ffb640 10 client.15792 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.034+0000 7f4569ffb640 1 -- 172.21.15.59:0/2694414840 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563a44d068a0 con 0x563a44e1be80 2024-09-10T21:17:05.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.034+0000 7f4569ffb640 10 client.15792 handle_command_reply: tid=0 2024-09-10T21:17:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.034+0000 7f458a9c8740 1 client.15792 shutdown 2024-09-10T21:17:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.034+0000 7f458a9c8740 1 -- 172.21.15.59:0/2694414840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d92df0 msgr2=0x563a44dafc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.034+0000 7f458a9c8740 1 --2- 172.21.15.59:0/2694414840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d92df0 0x563a44dafc30 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f458010f800 tx=0x7f45700108c0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.034+0000 7f458a9c8740 1 -- 172.21.15.59:0/2694414840 shutdown_connections 2024-09-10T21:17:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.034+0000 7f458a9c8740 1 --2- 172.21.15.59:0/2694414840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563a44d9ed80 0x563a44db0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.034+0000 7f458a9c8740 1 --2- 172.21.15.59:0/2694414840 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x563a44e1be80 0x563a44e1e2a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.034+0000 7f458a9c8740 1 --2- 172.21.15.59:0/2694414840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a44d92df0 0x563a44dafc30 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.035+0000 7f458a9c8740 1 --2- 172.21.15.59:0/2694414840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563a44d924d0 0x563a44daf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.035+0000 7f458a9c8740 1 -- 172.21.15.59:0/2694414840 >> 172.21.15.59:0/2694414840 conn(0x563a44d90300 msgr2=0x563a44d9d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.035+0000 7f4569ffb640 0 client.15792 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.035+0000 7f458a9c8740 1 -- 172.21.15.59:0/2694414840 shutdown_connections 2024-09-10T21:17:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.035+0000 7f458a9c8740 1 -- 172.21.15.59:0/2694414840 wait complete. 2024-09-10T21:17:05.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.035+0000 7f458a9c8740 20 client.15792 trim_cache size 0 max 16384 2024-09-10T21:17:05.047 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:17:05.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.035+0000 7f45885f3640 1 -- 172.21.15.59:0/2842303205 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f456c0b5360 msgr2=0x7f456c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:05.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.035+0000 7f45885f3640 1 --2- 172.21.15.59:0/2842303205 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f456c0b5360 0x7f456c0b7820 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f457c0abda0 tx=0x7f457c009f90 comp rx=0 tx=0).stop 2024-09-10T21:17:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.035+0000 7f45885f3640 1 -- 172.21.15.59:0/2842303205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4580103b30 msgr2=0x7f4580199210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.035+0000 7f45885f3640 1 --2- 172.21.15.59:0/2842303205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4580103b30 0x7f4580199210 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f457c00d770 tx=0x7f457c00dc30 comp rx=0 tx=0).stop 2024-09-10T21:17:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.035+0000 7f45885f3640 1 -- 172.21.15.59:0/2842303205 shutdown_connections 2024-09-10T21:17:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.035+0000 7f45885f3640 1 --2- 172.21.15.59:0/2842303205 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f456c0b5360 0x7f456c0b7820 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.035+0000 7f45885f3640 1 --2- 172.21.15.59:0/2842303205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f458010d0e0 0x7f458019eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.035+0000 7f45885f3640 1 --2- 172.21.15.59:0/2842303205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4580104530 0x7f4580199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.035+0000 7f45885f3640 1 --2- 172.21.15.59:0/2842303205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4580103b30 0x7f4580199210 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.035+0000 7f45885f3640 1 -- 172.21.15.59:0/2842303205 >> 172.21.15.59:0/2842303205 conn(0x7f45800fd700 msgr2=0x7f45800fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.035+0000 7f45885f3640 1 -- 172.21.15.59:0/2842303205 shutdown_connections 2024-09-10T21:17:05.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:05.035+0000 7f45885f3640 1 -- 172.21.15.59:0/2842303205 wait complete. 2024-09-10T21:17:06.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:06 smithi059 ceph-mon[30888]: pgmap v395: 97 pgs: 97 active+clean; 1.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:17:06.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:06 smithi154 ceph-mon[35041]: pgmap v395: 97 pgs: 97 active+clean; 1.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:17:06.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:06 smithi192 ceph-mon[35363]: pgmap v395: 97 pgs: 97 active+clean; 1.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:17:06.828 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:17:06.828 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:17:07.103 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:17:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.585+0000 7f71fd405640 1 -- 172.21.15.59:0/409983234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f81076b0 msgr2=0x7f71f8107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.585+0000 7f71fd405640 1 --2- 172.21.15.59:0/409983234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f81076b0 0x7f71f8107af0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009900 tx=0x7f71ec02a410 comp rx=0 tx=0).stop 2024-09-10T21:17:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.585+0000 7f71fd405640 1 -- 172.21.15.59:0/409983234 shutdown_connections 2024-09-10T21:17:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.585+0000 7f71fd405640 1 --2- 172.21.15.59:0/409983234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f8108030 0x7f71f810e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.585+0000 7f71fd405640 1 --2- 172.21.15.59:0/409983234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f81076b0 0x7f71f8107af0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.585+0000 7f71fd405640 1 --2- 172.21.15.59:0/409983234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f8101ca0 0x7f71f8102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.585+0000 7f71fd405640 1 -- 172.21.15.59:0/409983234 >> 172.21.15.59:0/409983234 conn(0x7f71f80fd730 msgr2=0x7f71f80ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.586+0000 7f71fd405640 1 -- 172.21.15.59:0/409983234 shutdown_connections 2024-09-10T21:17:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.586+0000 7f71fd405640 1 -- 172.21.15.59:0/409983234 wait complete. 2024-09-10T21:17:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.586+0000 7f71fd405640 1 Processor -- start 2024-09-10T21:17:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.586+0000 7f71fd405640 1 -- start start 2024-09-10T21:17:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71fd405640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f8101ca0 0x7f71f819a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71fd405640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f81076b0 0x7f71f819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71fd405640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f8108030 0x7f71f819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71fd405640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f71f8111cb0 con 0x7f71f8101ca0 2024-09-10T21:17:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71fd405640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f71f8111b30 con 0x7f71f8108030 2024-09-10T21:17:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71fd405640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f71f8111e30 con 0x7f71f81076b0 2024-09-10T21:17:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71f6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f8101ca0 0x7f71f819a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71f6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f8101ca0 0x7f71f819a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39998/0 (socket says 172.21.15.59:39998) 2024-09-10T21:17:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71f6ffd640 1 -- 172.21.15.59:0/1714255703 learned_addr learned my addr 172.21.15.59:0/1714255703 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71f67fc640 1 --2- 172.21.15.59:0/1714255703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f81076b0 0x7f71f819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71f77fe640 1 --2- 172.21.15.59:0/1714255703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f8108030 0x7f71f819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71f6ffd640 1 -- 172.21.15.59:0/1714255703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f81076b0 msgr2=0x7f71f819a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71f6ffd640 1 --2- 172.21.15.59:0/1714255703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f81076b0 0x7f71f819a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71f6ffd640 1 -- 172.21.15.59:0/1714255703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f8108030 msgr2=0x7f71f819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71f6ffd640 1 --2- 172.21.15.59:0/1714255703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f8108030 0x7f71f819aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71f6ffd640 1 -- 172.21.15.59:0/1714255703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f81a54e0 con 0x7f71f8101ca0 2024-09-10T21:17:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71f6ffd640 1 --2- 172.21.15.59:0/1714255703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f8101ca0 0x7f71f819a100 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f71e800db80 tx=0x7f71e800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71dffff640 1 -- 172.21.15.59:0/1714255703 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e8017070 con 0x7f71f8101ca0 2024-09-10T21:17:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71fd405640 1 -- 172.21.15.59:0/1714255703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f81a57d0 con 0x7f71f8101ca0 2024-09-10T21:17:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71dffff640 1 -- 172.21.15.59:0/1714255703 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71e8003b70 con 0x7f71f8101ca0 2024-09-10T21:17:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71dffff640 1 -- 172.21.15.59:0/1714255703 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e80106c0 con 0x7f71f8101ca0 2024-09-10T21:17:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.587+0000 7f71fd405640 1 -- 172.21.15.59:0/1714255703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f81a5d30 con 0x7f71f8101ca0 2024-09-10T21:17:07.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.590+0000 7f71dffff640 1 -- 172.21.15.59:0/1714255703 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f71e8023060 con 0x7f71f8101ca0 2024-09-10T21:17:07.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.590+0000 7f71ff7da740 1 Processor -- start 2024-09-10T21:17:07.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.590+0000 7f71ff7da740 1 -- start start 2024-09-10T21:17:07.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.591+0000 7f71ff7da740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a42ee0 0x555bf6a432c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:07.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.591+0000 7f71ff7da740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a43800 0x555bf6a4f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:07.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.591+0000 7f71ff7da740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a4f790 0x555bf6a51b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:07.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.591+0000 7f71ff7da740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555bf69b9e60 con 0x555bf6a4f790 2024-09-10T21:17:07.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.591+0000 7f71ff7da740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555bf69a9290 con 0x555bf6a42ee0 2024-09-10T21:17:07.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.591+0000 7f71ff7da740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555bf69ad0a0 con 0x555bf6a43800 2024-09-10T21:17:07.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.591+0000 7f71f67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a4f790 0x555bf6a51b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:07.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.591+0000 7f71f67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a4f790 0x555bf6a51b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40006/0 (socket says 172.21.15.59:40006) 2024-09-10T21:17:07.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.591+0000 7f71f6ffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a43800 0x555bf6a4f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:07.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.591+0000 7f71f67fc640 1 -- 172.21.15.59:0/2812531102 learned_addr learned my addr 172.21.15.59:0/2812531102 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:07.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.591+0000 7f71f77fe640 1 --2- 172.21.15.59:0/2812531102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a42ee0 0x555bf6a432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:07.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.591+0000 7f71dffff640 1 --2- 172.21.15.59:0/1714255703 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f71e00b52e0 0x7f71e00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:07.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.591+0000 7f71f67fc640 1 -- 172.21.15.59:0/2812531102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a43800 msgr2=0x555bf6a4f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:07.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.591+0000 7f71f67fc640 1 --2- 172.21.15.59:0/2812531102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a43800 0x555bf6a4f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.591+0000 7f71f67fc640 1 -- 172.21.15.59:0/2812531102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a42ee0 msgr2=0x555bf6a432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:07.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.591+0000 7f71f67fc640 1 --2- 172.21.15.59:0/2812531102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a42ee0 0x555bf6a432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.591+0000 7f71f67fc640 1 -- 172.21.15.59:0/2812531102 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bf6707930 con 0x555bf6a4f790 2024-09-10T21:17:07.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.591+0000 7f71f77fe640 1 --2- 172.21.15.59:0/1714255703 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f71e00b52e0 0x7f71e00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:07.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.591+0000 7f71dffff640 1 -- 172.21.15.59:0/1714255703 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f71e80e59e0 con 0x7f71f8101ca0 2024-09-10T21:17:07.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.592+0000 7f71f67fc640 1 --2- 172.21.15.59:0/2812531102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a4f790 0x555bf6a51b80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f71ec033000 tx=0x7f71ec032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef00956e62bf230 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:07.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.592+0000 7f71dd7fa640 1 -- 172.21.15.59:0/2812531102 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec035030 con 0x555bf6a4f790 2024-09-10T21:17:07.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.592+0000 7f71dd7fa640 1 -- 172.21.15.59:0/2812531102 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71ec0316a0 con 0x555bf6a4f790 2024-09-10T21:17:07.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.592+0000 7f71dd7fa640 1 -- 172.21.15.59:0/2812531102 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec005640 con 0x555bf6a4f790 2024-09-10T21:17:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.593+0000 7f71ff7da740 1 -- 172.21.15.59:0/2812531102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a4f790 msgr2=0x555bf6a51b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.593+0000 7f71f77fe640 1 --2- 172.21.15.59:0/1714255703 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f71e00b52e0 0x7f71e00b77a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f71f0005fd0 tx=0x7f71f00046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.593+0000 7f71ff7da740 1 --2- 172.21.15.59:0/2812531102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a4f790 0x555bf6a51b80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f71ec033000 tx=0x7f71ec032c40 comp rx=0 tx=0).stop 2024-09-10T21:17:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.593+0000 7f71ff7da740 1 -- 172.21.15.59:0/2812531102 shutdown_connections 2024-09-10T21:17:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.593+0000 7f71ff7da740 1 --2- 172.21.15.59:0/2812531102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a4f790 0x555bf6a51b80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.593+0000 7f71ff7da740 1 --2- 172.21.15.59:0/2812531102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a43800 0x555bf6a4f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.593+0000 7f71ff7da740 1 --2- 172.21.15.59:0/2812531102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a42ee0 0x555bf6a432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.593+0000 7f71ff7da740 1 -- 172.21.15.59:0/2812531102 >> 172.21.15.59:0/2812531102 conn(0x555bf6a40d10 msgr2=0x555bf6a41eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.593+0000 7f71ff7da740 1 -- 172.21.15.59:0/2812531102 shutdown_connections 2024-09-10T21:17:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.593+0000 7f71ff7da740 1 -- 172.21.15.59:0/2812531102 wait complete. 2024-09-10T21:17:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.593+0000 7f71ff7da740 1 -- start start 2024-09-10T21:17:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.593+0000 7f71ff7da740 1 Processor -- start 2024-09-10T21:17:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.593+0000 7f71ff7da740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a42ee0 0x555bf6a4c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.593+0000 7f71ff7da740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a43800 0x555bf6a4cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.593+0000 7f71ff7da740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a4f790 0x555bf6a4d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.593+0000 7f71ff7da740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555bf680a890 con 0x555bf6a42ee0 2024-09-10T21:17:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.593+0000 7f71ff7da740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555bf6943d40 con 0x555bf6a4f790 2024-09-10T21:17:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.593+0000 7f71ff7da740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555bf6a523e0 con 0x555bf6a43800 2024-09-10T21:17:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.594+0000 7f71ff7da740 10 client.0 _ll_register_callbacks cb 0x555bf69a7c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.594+0000 7f71f6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a42ee0 0x555bf6a4c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.594+0000 7f71f6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a42ee0 0x555bf6a4c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40018/0 (socket says 172.21.15.59:40018) 2024-09-10T21:17:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.594+0000 7f71f6ffd640 1 -- 172.21.15.59:0/1329234969 learned_addr learned my addr 172.21.15.59:0/1329234969 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.594+0000 7f71f67fc640 1 --2- 172.21.15.59:0/1329234969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a43800 0x555bf6a4cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.594+0000 7f71f77fe640 1 --2- 172.21.15.59:0/1329234969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a4f790 0x555bf6a4d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.594+0000 7f71f6ffd640 1 -- 172.21.15.59:0/1329234969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a43800 msgr2=0x555bf6a4cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.594+0000 7f71f6ffd640 1 --2- 172.21.15.59:0/1329234969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a43800 0x555bf6a4cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.594+0000 7f71f6ffd640 1 -- 172.21.15.59:0/1329234969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a4f790 msgr2=0x555bf6a4d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.594+0000 7f71f6ffd640 1 --2- 172.21.15.59:0/1329234969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a4f790 0x555bf6a4d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.594+0000 7f71f6ffd640 1 -- 172.21.15.59:0/1329234969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bf6a5fba0 con 0x555bf6a42ee0 2024-09-10T21:17:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.594+0000 7f71f6ffd640 1 --2- 172.21.15.59:0/1329234969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a42ee0 0x555bf6a4c730 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f71e80abeb0 tx=0x7f71e80048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fe2ec3b969e1f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.594+0000 7f71daff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.594+0000 7f71daff5640 1 -- 172.21.15.59:0/1329234969 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e80ab920 con 0x555bf6a42ee0 2024-09-10T21:17:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.594+0000 7f71daff5640 1 -- 172.21.15.59:0/1329234969 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f71e80cdb90 con 0x555bf6a42ee0 2024-09-10T21:17:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.594+0000 7f71ff7da740 1 -- 172.21.15.59:0/1329234969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71ec0316a0 con 0x555bf6a42ee0 2024-09-10T21:17:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.594+0000 7f71daff5640 1 -- 172.21.15.59:0/1329234969 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f71e80b5080 con 0x555bf6a42ee0 2024-09-10T21:17:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.595+0000 7f71ff7da740 10 client.15804 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.595+0000 7f71ff7da740 1 -- 172.21.15.59:0/1329234969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555bf6a62550 con 0x555bf6a42ee0 2024-09-10T21:17:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.595+0000 7f71daff5640 1 -- 172.21.15.59:0/1329234969 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71ec0316a0 con 0x555bf6a42ee0 2024-09-10T21:17:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.595+0000 7f71daff5640 1 -- 172.21.15.59:0/1329234969 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f71e8004020 con 0x555bf6a42ee0 2024-09-10T21:17:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.595+0000 7f71ff7da740 10 client.15804 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.595+0000 7f71ff7da740 10 client.15804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:17:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.595+0000 7f71ff7da740 20 client.15804 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.595+0000 7f71ff7da740 1 --2- 172.21.15.59:0/1329234969 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555bf6a63a10 0x555bf6a65e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:07.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.595+0000 7f71ff7da740 4 client.15804 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:17:07.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.595+0000 7f71ff7da740 1 -- 172.21.15.59:0/1329234969 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555bf69bbdb0 con 0x555bf6a63a10 2024-09-10T21:17:07.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.595+0000 7f71f67fc640 1 --2- 172.21.15.59:0/1329234969 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555bf6a63a10 0x555bf6a65e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:07.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.596+0000 7f71f67fc640 1 --2- 172.21.15.59:0/1329234969 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555bf6a63a10 0x555bf6a65e20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bdcb4adbe420500 server_cookie=6be08d009711ba8b in_seq=0 out_seq=0 2024-09-10T21:17:07.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.596+0000 7f71daff5640 10 client.15804 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:07.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.597+0000 7f71daff5640 1 -- 172.21.15.59:0/1329234969 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555bf69bbdb0 con 0x555bf6a63a10 2024-09-10T21:17:07.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.597+0000 7f71daff5640 10 client.15804 handle_command_reply: tid=0 2024-09-10T21:17:07.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.597+0000 7f71ff7da740 1 client.15804 shutdown 2024-09-10T21:17:07.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.597+0000 7f71ff7da740 1 -- 172.21.15.59:0/1329234969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a42ee0 msgr2=0x555bf6a4c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:07.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.597+0000 7f71ff7da740 1 --2- 172.21.15.59:0/1329234969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a42ee0 0x555bf6a4c730 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f71e80abeb0 tx=0x7f71e80048d0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.597+0000 7f71ff7da740 1 -- 172.21.15.59:0/1329234969 shutdown_connections 2024-09-10T21:17:07.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.597+0000 7f71ff7da740 1 --2- 172.21.15.59:0/1329234969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a4f790 0x555bf6a4d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.597+0000 7f71ff7da740 1 --2- 172.21.15.59:0/1329234969 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a43800 0x555bf6a4cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.597+0000 7f71ff7da740 1 --2- 172.21.15.59:0/1329234969 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555bf6a63a10 0x555bf6a65e20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.597+0000 7f71ff7da740 1 --2- 172.21.15.59:0/1329234969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a42ee0 0x555bf6a4c730 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.597+0000 7f71ff7da740 1 -- 172.21.15.59:0/1329234969 >> 172.21.15.59:0/1329234969 conn(0x555bf6a40d10 msgr2=0x555bf6a3ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:07.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.597+0000 7f71daff5640 0 client.15804 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:07.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.597+0000 7f71ff7da740 1 -- 172.21.15.59:0/1329234969 shutdown_connections 2024-09-10T21:17:07.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.597+0000 7f71ff7da740 1 -- 172.21.15.59:0/1329234969 wait complete. 2024-09-10T21:17:07.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.597+0000 7f71ff7da740 20 client.15804 trim_cache size 0 max 16384 2024-09-10T21:17:07.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.614+0000 7f71ff7da740 1 Processor -- start 2024-09-10T21:17:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.615+0000 7f71ff7da740 1 -- start start 2024-09-10T21:17:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.615+0000 7f71ff7da740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a42ee0 0x555bf6a46f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.615+0000 7f71ff7da740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a43800 0x555bf6a5ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.615+0000 7f71ff7da740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a4f790 0x555bf6a49960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.615+0000 7f71ff7da740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f71f81ac070 con 0x555bf6a43800 2024-09-10T21:17:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.615+0000 7f71ff7da740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f71f81adbb0 con 0x555bf6a4f790 2024-09-10T21:17:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.615+0000 7f71ff7da740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f71f81ac740 con 0x555bf6a42ee0 2024-09-10T21:17:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.615+0000 7f71f67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a43800 0x555bf6a5ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.615+0000 7f71f67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a43800 0x555bf6a5ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40032/0 (socket says 172.21.15.59:40032) 2024-09-10T21:17:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.615+0000 7f71f67fc640 1 -- 172.21.15.59:0/3200863184 learned_addr learned my addr 172.21.15.59:0/3200863184 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.615+0000 7f71f77fe640 1 --2- 172.21.15.59:0/3200863184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a4f790 0x555bf6a49960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.615+0000 7f71f6ffd640 1 --2- 172.21.15.59:0/3200863184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a42ee0 0x555bf6a46f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:07.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.615+0000 7f71f67fc640 1 -- 172.21.15.59:0/3200863184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a42ee0 msgr2=0x555bf6a46f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.615+0000 7f71f67fc640 1 --2- 172.21.15.59:0/3200863184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a42ee0 0x555bf6a46f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.615+0000 7f71f67fc640 1 -- 172.21.15.59:0/3200863184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a4f790 msgr2=0x555bf6a49960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.615+0000 7f71f67fc640 1 --2- 172.21.15.59:0/3200863184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a4f790 0x555bf6a49960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.615+0000 7f71f67fc640 1 -- 172.21.15.59:0/3200863184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bf6a474c0 con 0x555bf6a43800 2024-09-10T21:17:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.615+0000 7f71f77fe640 1 --2- 172.21.15.59:0/3200863184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a4f790 0x555bf6a49960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.615+0000 7f71f67fc640 1 --2- 172.21.15.59:0/3200863184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a43800 0x555bf6a5ad10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x555bf6a42e90 tx=0x7f71ec0052e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37faae3175c4384 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.616+0000 7f71dcff9640 1 -- 172.21.15.59:0/3200863184 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec052070 con 0x555bf6a43800 2024-09-10T21:17:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.616+0000 7f71dcff9640 1 -- 172.21.15.59:0/3200863184 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71ec0046c0 con 0x555bf6a43800 2024-09-10T21:17:07.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.616+0000 7f71dcff9640 1 -- 172.21.15.59:0/3200863184 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec035040 con 0x555bf6a43800 2024-09-10T21:17:07.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.616+0000 7f71ff7da740 1 -- 172.21.15.59:0/3200863184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a43800 msgr2=0x555bf6a5ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:07.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.616+0000 7f71ff7da740 1 --2- 172.21.15.59:0/3200863184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a43800 0x555bf6a5ad10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x555bf6a42e90 tx=0x7f71ec0052e0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.616+0000 7f71ff7da740 1 -- 172.21.15.59:0/3200863184 shutdown_connections 2024-09-10T21:17:07.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.616+0000 7f71ff7da740 1 --2- 172.21.15.59:0/3200863184 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a4f790 0x555bf6a49960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.616+0000 7f71ff7da740 1 --2- 172.21.15.59:0/3200863184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a43800 0x555bf6a5ad10 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.616+0000 7f71ff7da740 1 --2- 172.21.15.59:0/3200863184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a42ee0 0x555bf6a46f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.616+0000 7f71ff7da740 1 -- 172.21.15.59:0/3200863184 >> 172.21.15.59:0/3200863184 conn(0x555bf6a40d10 msgr2=0x555bf6a5a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:07.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.616+0000 7f71ff7da740 1 -- 172.21.15.59:0/3200863184 shutdown_connections 2024-09-10T21:17:07.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.616+0000 7f71ff7da740 1 -- 172.21.15.59:0/3200863184 wait complete. 2024-09-10T21:17:07.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.616+0000 7f71ff7da740 1 -- start start 2024-09-10T21:17:07.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.617+0000 7f71ff7da740 1 Processor -- start 2024-09-10T21:17:07.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.617+0000 7f71ff7da740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a42ee0 0x555bf6a57c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:07.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.617+0000 7f71ff7da740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a43800 0x555bf6a54640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:07.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.617+0000 7f71ff7da740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a4f790 0x555bf6a54b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:07.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.617+0000 7f71ff7da740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f71f81ad4e0 con 0x555bf6a4f790 2024-09-10T21:17:07.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.617+0000 7f71ff7da740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f71f81ace10 con 0x555bf6a43800 2024-09-10T21:17:07.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.617+0000 7f71ff7da740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f71f81aa070 con 0x555bf6a42ee0 2024-09-10T21:17:07.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.617+0000 7f71ff7da740 10 client.0 _ll_register_callbacks cb 0x7f71e800be60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:07.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.617+0000 7f71f77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a4f790 0x555bf6a54b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:07.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.617+0000 7f71f77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a4f790 0x555bf6a54b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40044/0 (socket says 172.21.15.59:40044) 2024-09-10T21:17:07.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.617+0000 7f71f77fe640 1 -- 172.21.15.59:0/3883649913 learned_addr learned my addr 172.21.15.59:0/3883649913 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:07.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.617+0000 7f71f6ffd640 1 --2- 172.21.15.59:0/3883649913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a42ee0 0x555bf6a57c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.617+0000 7f71f67fc640 1 --2- 172.21.15.59:0/3883649913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a43800 0x555bf6a54640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.617+0000 7f71f77fe640 1 -- 172.21.15.59:0/3883649913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a42ee0 msgr2=0x555bf6a57c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.617+0000 7f71f77fe640 1 --2- 172.21.15.59:0/3883649913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a42ee0 0x555bf6a57c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.617+0000 7f71f77fe640 1 -- 172.21.15.59:0/3883649913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a43800 msgr2=0x555bf6a54640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.617+0000 7f71f77fe640 1 --2- 172.21.15.59:0/3883649913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a43800 0x555bf6a54640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.617+0000 7f71f77fe640 1 -- 172.21.15.59:0/3883649913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bf6a551f0 con 0x555bf6a4f790 2024-09-10T21:17:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.617+0000 7f71f67fc640 1 --2- 172.21.15.59:0/3883649913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a43800 0x555bf6a54640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.618+0000 7f71f77fe640 1 --2- 172.21.15.59:0/3883649913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a4f790 0x555bf6a54b80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f71f001f710 tx=0x7f71f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5683cf98f556ac91 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.618+0000 7f71daff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.618+0000 7f71daff5640 1 -- 172.21.15.59:0/3883649913 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f001b770 con 0x555bf6a4f790 2024-09-10T21:17:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.618+0000 7f71daff5640 1 -- 172.21.15.59:0/3883649913 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f71f001b910 con 0x555bf6a4f790 2024-09-10T21:17:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.618+0000 7f71ff7da740 1 -- 172.21.15.59:0/3883649913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71ec0046c0 con 0x555bf6a4f790 2024-09-10T21:17:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.618+0000 7f71daff5640 1 -- 172.21.15.59:0/3883649913 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f71f001bb10 con 0x555bf6a4f790 2024-09-10T21:17:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.618+0000 7f71ff7da740 10 client.15810 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:07.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.618+0000 7f71ff7da740 1 -- 172.21.15.59:0/3883649913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555bf6ad1800 con 0x555bf6a4f790 2024-09-10T21:17:07.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.618+0000 7f71daff5640 1 -- 172.21.15.59:0/3883649913 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71ec0046c0 con 0x555bf6a4f790 2024-09-10T21:17:07.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.618+0000 7f71daff5640 1 -- 172.21.15.59:0/3883649913 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f71f000f040 con 0x555bf6a4f790 2024-09-10T21:17:07.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.618+0000 7f71ff7da740 10 client.15810 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:07.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.618+0000 7f71ff7da740 10 client.15810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:17:07.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.618+0000 7f71ff7da740 20 client.15810 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:07.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.618+0000 7f71ff7da740 1 --2- 172.21.15.59:0/3883649913 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555bf6ad1f70 0x555bf6ad4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:07.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.618+0000 7f71ff7da740 4 client.15810 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:17:07.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.619+0000 7f71ff7da740 1 -- 172.21.15.59:0/3883649913 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555bf69b7860 con 0x555bf6ad1f70 2024-09-10T21:17:07.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.619+0000 7f71f6ffd640 1 --2- 172.21.15.59:0/3883649913 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555bf6ad1f70 0x555bf6ad4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:07.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.619+0000 7f71f6ffd640 1 --2- 172.21.15.59:0/3883649913 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555bf6ad1f70 0x555bf6ad4390 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=600a9f7132aa946c server_cookie=4ebdc2015d22304d in_seq=0 out_seq=0 2024-09-10T21:17:07.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.619+0000 7f71daff5640 10 client.15810 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:07.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.621+0000 7f71daff5640 1 -- 172.21.15.59:0/3883649913 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555bf69b7860 con 0x555bf6ad1f70 2024-09-10T21:17:07.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.621+0000 7f71daff5640 10 client.15810 handle_command_reply: tid=0 2024-09-10T21:17:07.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.621+0000 7f71ff7da740 1 client.15810 shutdown 2024-09-10T21:17:07.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.621+0000 7f71ff7da740 1 -- 172.21.15.59:0/3883649913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a4f790 msgr2=0x555bf6a54b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:07.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.621+0000 7f71ff7da740 1 --2- 172.21.15.59:0/3883649913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a4f790 0x555bf6a54b80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f71f001f710 tx=0x7f71f0004730 comp rx=0 tx=0).stop 2024-09-10T21:17:07.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.621+0000 7f71ff7da740 1 -- 172.21.15.59:0/3883649913 shutdown_connections 2024-09-10T21:17:07.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.621+0000 7f71ff7da740 1 --2- 172.21.15.59:0/3883649913 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555bf6ad1f70 0x555bf6ad4390 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.621+0000 7f71ff7da740 1 --2- 172.21.15.59:0/3883649913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555bf6a4f790 0x555bf6a54b80 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.621+0000 7f71ff7da740 1 --2- 172.21.15.59:0/3883649913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555bf6a43800 0x555bf6a54640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.621+0000 7f71ff7da740 1 --2- 172.21.15.59:0/3883649913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555bf6a42ee0 0x555bf6a57c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.621+0000 7f71ff7da740 1 -- 172.21.15.59:0/3883649913 >> 172.21.15.59:0/3883649913 conn(0x555bf6a40d10 msgr2=0x555bf6a3ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:07.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.622+0000 7f71daff5640 0 client.15810 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:07.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.622+0000 7f71ff7da740 1 -- 172.21.15.59:0/3883649913 shutdown_connections 2024-09-10T21:17:07.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.622+0000 7f71ff7da740 1 -- 172.21.15.59:0/3883649913 wait complete. 2024-09-10T21:17:07.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.622+0000 7f71ff7da740 20 client.15810 trim_cache size 0 max 16384 2024-09-10T21:17:07.631 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:17:07.631 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:17:07.631 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "5159b619-53a5-44b8-9752-1966beb29939", 2024-09-10T21:17:07.631 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:17:07.631 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:17:07.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.622+0000 7f71fd405640 1 -- 172.21.15.59:0/1714255703 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f71e00b52e0 msgr2=0x7f71e00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:07.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.622+0000 7f71fd405640 1 --2- 172.21.15.59:0/1714255703 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f71e00b52e0 0x7f71e00b77a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f71f0005fd0 tx=0x7f71f00046c0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.622+0000 7f71fd405640 1 -- 172.21.15.59:0/1714255703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f8101ca0 msgr2=0x7f71f819a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:07.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.622+0000 7f71fd405640 1 --2- 172.21.15.59:0/1714255703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f8101ca0 0x7f71f819a100 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f71e800db80 tx=0x7f71e800b630 comp rx=0 tx=0).stop 2024-09-10T21:17:07.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.622+0000 7f71fd405640 1 -- 172.21.15.59:0/1714255703 shutdown_connections 2024-09-10T21:17:07.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.622+0000 7f71fd405640 1 --2- 172.21.15.59:0/1714255703 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f71e00b52e0 0x7f71e00b77a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.622+0000 7f71fd405640 1 --2- 172.21.15.59:0/1714255703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71f8108030 0x7f71f819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.622+0000 7f71fd405640 1 --2- 172.21.15.59:0/1714255703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f81076b0 0x7f71f819a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.622+0000 7f71fd405640 1 --2- 172.21.15.59:0/1714255703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f8101ca0 0x7f71f819a100 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:07.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.622+0000 7f71fd405640 1 -- 172.21.15.59:0/1714255703 >> 172.21.15.59:0/1714255703 conn(0x7f71f80fd730 msgr2=0x7f71f80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:07.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.622+0000 7f71fd405640 1 -- 172.21.15.59:0/1714255703 shutdown_connections 2024-09-10T21:17:07.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:07.623+0000 7f71fd405640 1 -- 172.21.15.59:0/1714255703 wait complete. 2024-09-10T21:17:08.418 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:17:08.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:08 smithi059 ceph-mon[30888]: pgmap v396: 97 pgs: 97 active+clean; 1.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:17:08.680 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:17:08.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:08 smithi154 ceph-mon[35041]: pgmap v396: 97 pgs: 97 active+clean; 1.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:17:08.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:08 smithi192 ceph-mon[35363]: pgmap v396: 97 pgs: 97 active+clean; 1.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:17:09.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.353+0000 7eff03d53640 1 -- 172.21.15.59:0/1364404489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efefc1087d0 msgr2=0x7efefc108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:09.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.353+0000 7eff03d53640 1 --2- 172.21.15.59:0/1364404489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efefc1087d0 0x7efefc108c10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7efeec009900 tx=0x7efeec02a410 comp rx=0 tx=0).stop 2024-09-10T21:17:09.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.353+0000 7eff03d53640 1 -- 172.21.15.59:0/1364404489 shutdown_connections 2024-09-10T21:17:09.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.353+0000 7eff03d53640 1 --2- 172.21.15.59:0/1364404489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efefc109150 0x7efefc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.353+0000 7eff03d53640 1 --2- 172.21.15.59:0/1364404489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efefc1087d0 0x7efefc108c10 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.353+0000 7eff03d53640 1 --2- 172.21.15.59:0/1364404489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efefc102dc0 0x7efefc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.353+0000 7eff03d53640 1 -- 172.21.15.59:0/1364404489 >> 172.21.15.59:0/1364404489 conn(0x7efefc0fe830 msgr2=0x7efefc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:09.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.353+0000 7eff03d53640 1 -- 172.21.15.59:0/1364404489 shutdown_connections 2024-09-10T21:17:09.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.353+0000 7eff03d53640 1 -- 172.21.15.59:0/1364404489 wait complete. 2024-09-10T21:17:09.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.354+0000 7eff03d53640 1 Processor -- start 2024-09-10T21:17:09.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.354+0000 7eff03d53640 1 -- start start 2024-09-10T21:17:09.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.354+0000 7eff03d53640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efefc102dc0 0x7efefc199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:09.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.354+0000 7eff03d53640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efefc1087d0 0x7efefc1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:09.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.354+0000 7eff03d53640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efefc109150 0x7efefc19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:09.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.354+0000 7eff03d53640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efefc112e10 con 0x7efefc1087d0 2024-09-10T21:17:09.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.354+0000 7eff03d53640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efefc112c90 con 0x7efefc109150 2024-09-10T21:17:09.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.354+0000 7eff03d53640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efefc112f90 con 0x7efefc102dc0 2024-09-10T21:17:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.354+0000 7eff012ee640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efefc1087d0 0x7efefc1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.354+0000 7eff012ee640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efefc1087d0 0x7efefc1997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42992/0 (socket says 172.21.15.59:42992) 2024-09-10T21:17:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.354+0000 7eff012ee640 1 -- 172.21.15.59:0/1121818176 learned_addr learned my addr 172.21.15.59:0/1121818176 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.355+0000 7eff022f0640 1 --2- 172.21.15.59:0/1121818176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efefc109150 0x7efefc19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.355+0000 7eff01aef640 1 --2- 172.21.15.59:0/1121818176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efefc102dc0 0x7efefc199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.355+0000 7eff012ee640 1 -- 172.21.15.59:0/1121818176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efefc102dc0 msgr2=0x7efefc199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.355+0000 7eff012ee640 1 --2- 172.21.15.59:0/1121818176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efefc102dc0 0x7efefc199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.355+0000 7eff012ee640 1 -- 172.21.15.59:0/1121818176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efefc109150 msgr2=0x7efefc19eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.355+0000 7eff012ee640 1 --2- 172.21.15.59:0/1121818176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efefc109150 0x7efefc19eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.355+0000 7eff012ee640 1 -- 172.21.15.59:0/1121818176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efefc19f330 con 0x7efefc1087d0 2024-09-10T21:17:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.355+0000 7eff01aef640 1 --2- 172.21.15.59:0/1121818176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efefc102dc0 0x7efefc199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.355+0000 7eff012ee640 1 --2- 172.21.15.59:0/1121818176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efefc1087d0 0x7efefc1997c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7efeec005940 tx=0x7efeec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.355+0000 7efef2ffd640 1 -- 172.21.15.59:0/1121818176 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec03f030 con 0x7efefc1087d0 2024-09-10T21:17:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.355+0000 7eff03d53640 1 -- 172.21.15.59:0/1121818176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efefc19f5c0 con 0x7efefc1087d0 2024-09-10T21:17:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.355+0000 7efef2ffd640 1 -- 172.21.15.59:0/1121818176 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efeec003cb0 con 0x7efefc1087d0 2024-09-10T21:17:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.355+0000 7efef2ffd640 1 -- 172.21.15.59:0/1121818176 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec035070 con 0x7efefc1087d0 2024-09-10T21:17:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.355+0000 7eff03d53640 1 -- 172.21.15.59:0/1121818176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efefc1a5ce0 con 0x7efefc1087d0 2024-09-10T21:17:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.358+0000 7efef2ffd640 1 -- 172.21.15.59:0/1121818176 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7efeec03bbf0 con 0x7efefc1087d0 2024-09-10T21:17:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.358+0000 7eff06128740 1 Processor -- start 2024-09-10T21:17:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.358+0000 7eff06128740 1 -- start start 2024-09-10T21:17:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.358+0000 7eff06128740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809e480 0x56204809e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.358+0000 7eff06128740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56204809eda0 0x5620480aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.358+0000 7eff06128740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620480aad30 0x5620480ad120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.358+0000 7eff06128740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562048014e50 con 0x56204809eda0 2024-09-10T21:17:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.358+0000 7eff06128740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562048004280 con 0x5620480aad30 2024-09-10T21:17:09.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.358+0000 7eff06128740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562048008090 con 0x56204809e480 2024-09-10T21:17:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.359+0000 7eff01aef640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56204809eda0 0x5620480aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.359+0000 7eff01aef640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56204809eda0 0x5620480aa7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42994/0 (socket says 172.21.15.59:42994) 2024-09-10T21:17:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.359+0000 7eff01aef640 1 -- 172.21.15.59:0/4201467000 learned_addr learned my addr 172.21.15.59:0/4201467000 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.359+0000 7eff012ee640 1 --2- 172.21.15.59:0/4201467000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620480aad30 0x5620480ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.359+0000 7eff022f0640 1 --2- 172.21.15.59:0/4201467000 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809e480 0x56204809e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.359+0000 7eff01aef640 1 -- 172.21.15.59:0/4201467000 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809e480 msgr2=0x56204809e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.359+0000 7eff01aef640 1 --2- 172.21.15.59:0/4201467000 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809e480 0x56204809e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.359+0000 7efef2ffd640 1 --2- 172.21.15.59:0/1121818176 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efee80b52e0 0x7efee80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.359+0000 7eff01aef640 1 -- 172.21.15.59:0/4201467000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620480aad30 msgr2=0x5620480ad120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.359+0000 7eff01aef640 1 --2- 172.21.15.59:0/4201467000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620480aad30 0x5620480ad120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.359+0000 7eff01aef640 1 -- 172.21.15.59:0/4201467000 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562047d62650 con 0x56204809eda0 2024-09-10T21:17:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.359+0000 7eff022f0640 1 --2- 172.21.15.59:0/4201467000 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809e480 0x56204809e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.359+0000 7eff022f0640 1 --2- 172.21.15.59:0/1121818176 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efee80b52e0 0x7efee80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:09.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.359+0000 7efef2ffd640 1 -- 172.21.15.59:0/1121818176 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7efeec106720 con 0x7efefc1087d0 2024-09-10T21:17:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.359+0000 7eff01aef640 1 --2- 172.21.15.59:0/4201467000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56204809eda0 0x5620480aa7f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7efef800bd40 tx=0x7efef800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce55cc818c778b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.359+0000 7efee7fff640 1 -- 172.21.15.59:0/4201467000 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8015070 con 0x56204809eda0 2024-09-10T21:17:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.359+0000 7efee7fff640 1 -- 172.21.15.59:0/4201467000 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efef800be30 con 0x56204809eda0 2024-09-10T21:17:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.359+0000 7efee7fff640 1 -- 172.21.15.59:0/4201467000 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8011900 con 0x56204809eda0 2024-09-10T21:17:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.360+0000 7eff06128740 1 -- 172.21.15.59:0/4201467000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56204809eda0 msgr2=0x5620480aa7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.360+0000 7eff022f0640 1 --2- 172.21.15.59:0/1121818176 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efee80b52e0 0x7efee80b77a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efef4005fd0 tx=0x7efef40096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.360+0000 7eff06128740 1 --2- 172.21.15.59:0/4201467000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56204809eda0 0x5620480aa7f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7efef800bd40 tx=0x7efef800f730 comp rx=0 tx=0).stop 2024-09-10T21:17:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.360+0000 7eff06128740 1 -- 172.21.15.59:0/4201467000 shutdown_connections 2024-09-10T21:17:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.360+0000 7eff06128740 1 --2- 172.21.15.59:0/4201467000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620480aad30 0x5620480ad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.360+0000 7eff06128740 1 --2- 172.21.15.59:0/4201467000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56204809eda0 0x5620480aa7f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.360+0000 7eff06128740 1 --2- 172.21.15.59:0/4201467000 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809e480 0x56204809e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.360+0000 7eff06128740 1 -- 172.21.15.59:0/4201467000 >> 172.21.15.59:0/4201467000 conn(0x56204809c2b0 msgr2=0x56204809d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.360+0000 7eff06128740 1 -- 172.21.15.59:0/4201467000 shutdown_connections 2024-09-10T21:17:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.360+0000 7eff06128740 1 -- 172.21.15.59:0/4201467000 wait complete. 2024-09-10T21:17:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.361+0000 7eff06128740 1 -- start start 2024-09-10T21:17:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.361+0000 7eff06128740 1 Processor -- start 2024-09-10T21:17:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.361+0000 7eff06128740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204809e480 0x5620480aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.361+0000 7eff06128740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809eda0 0x5620480a7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.361+0000 7eff06128740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620480aad30 0x5620480a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.361+0000 7eff06128740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562047e65700 con 0x5620480aad30 2024-09-10T21:17:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.361+0000 7eff06128740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562047f9f110 con 0x56204809e480 2024-09-10T21:17:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.361+0000 7eff06128740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5620480ad9b0 con 0x56204809eda0 2024-09-10T21:17:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.361+0000 7eff06128740 10 client.0 _ll_register_callbacks cb 0x562047fb8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.361+0000 7eff022f0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620480aad30 0x5620480a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.361+0000 7eff022f0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620480aad30 0x5620480a81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43008/0 (socket says 172.21.15.59:43008) 2024-09-10T21:17:09.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.361+0000 7eff022f0640 1 -- 172.21.15.59:0/872429148 learned_addr learned my addr 172.21.15.59:0/872429148 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.361+0000 7eff012ee640 1 --2- 172.21.15.59:0/872429148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809eda0 0x5620480a7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.361+0000 7eff01aef640 1 --2- 172.21.15.59:0/872429148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204809e480 0x5620480aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.362+0000 7eff022f0640 1 -- 172.21.15.59:0/872429148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809eda0 msgr2=0x5620480a7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.362+0000 7eff022f0640 1 --2- 172.21.15.59:0/872429148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809eda0 0x5620480a7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.362+0000 7eff022f0640 1 -- 172.21.15.59:0/872429148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204809e480 msgr2=0x5620480aa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.362+0000 7eff022f0640 1 --2- 172.21.15.59:0/872429148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204809e480 0x5620480aa6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.362+0000 7eff022f0640 1 -- 172.21.15.59:0/872429148 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562047fccc40 con 0x5620480aad30 2024-09-10T21:17:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.362+0000 7eff022f0640 1 --2- 172.21.15.59:0/872429148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620480aad30 0x5620480a81e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7efef40126d0 tx=0x7efef4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cea659cedc167c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.362+0000 7efee57fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.362+0000 7efee57fa640 1 -- 172.21.15.59:0/872429148 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4010a30 con 0x5620480aad30 2024-09-10T21:17:09.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.362+0000 7efee57fa640 1 -- 172.21.15.59:0/872429148 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7efef4010bd0 con 0x5620480aad30 2024-09-10T21:17:09.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.362+0000 7eff06128740 1 -- 172.21.15.59:0/872429148 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efef800be30 con 0x5620480aad30 2024-09-10T21:17:09.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.362+0000 7efee57fa640 1 -- 172.21.15.59:0/872429148 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efef4010dd0 con 0x5620480aad30 2024-09-10T21:17:09.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.362+0000 7eff06128740 10 client.15822 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:09.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.362+0000 7eff06128740 1 -- 172.21.15.59:0/872429148 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5620480b93e0 con 0x5620480aad30 2024-09-10T21:17:09.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.363+0000 7efee57fa640 1 -- 172.21.15.59:0/872429148 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efef800be30 con 0x5620480aad30 2024-09-10T21:17:09.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.363+0000 7efee57fa640 1 -- 172.21.15.59:0/872429148 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efef4024070 con 0x5620480aad30 2024-09-10T21:17:09.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.363+0000 7eff06128740 10 client.15822 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:09.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.363+0000 7eff06128740 10 client.15822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:17:09.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.363+0000 7eff06128740 20 client.15822 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:09.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.363+0000 7eff06128740 1 --2- 172.21.15.59:0/872429148 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5620480ba940 0x5620480bcd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:09.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.363+0000 7eff06128740 4 client.15822 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:17:09.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.363+0000 7eff06128740 1 -- 172.21.15.59:0/872429148 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562048016da0 con 0x5620480ba940 2024-09-10T21:17:09.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.363+0000 7eff01aef640 1 --2- 172.21.15.59:0/872429148 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5620480ba940 0x5620480bcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:09.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.364+0000 7efee57fa640 10 client.15822 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:09.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.364+0000 7eff01aef640 1 --2- 172.21.15.59:0/872429148 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5620480ba940 0x5620480bcd30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bef0c919e8854090 server_cookie=79339e16f2d33c37 in_seq=0 out_seq=0 2024-09-10T21:17:09.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.364+0000 7efee57fa640 1 -- 172.21.15.59:0/872429148 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562048016da0 con 0x5620480ba940 2024-09-10T21:17:09.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.364+0000 7efee57fa640 10 client.15822 handle_command_reply: tid=0 2024-09-10T21:17:09.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.364+0000 7eff06128740 1 client.15822 shutdown 2024-09-10T21:17:09.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.364+0000 7eff06128740 1 -- 172.21.15.59:0/872429148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620480aad30 msgr2=0x5620480a81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:09.404 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:17:09.404 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:17:09.404 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-09-10T21:17:09.404 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:17:09.404 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:17:09.404 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "5159b619-53a5-44b8-9752-1966beb29939", 2024-09-10T21:17:09.405 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2024-09-10T21:17:09.405 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:17:09.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:17:09.405 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:17:09.405 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:17:09.405 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:17:09.405 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:17:09.405 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:17:09.405 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:17:09.405 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:17:09.405 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:17:09.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:17:09.405 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:17:09.405 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:17:09.406 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:17:09.406 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:17:09.406 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:17:09.406 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:17:09.406 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:17:09.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:17:09.406 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:17:09.406 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:17:09.406 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:17:09.406 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:17:09.406 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:17:09.406 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:17:09.406 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:17:09.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:17:09.407 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:17:09.407 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:17:09.407 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:17:09.407 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:17:09.407 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:17:09.407 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:17:09.407 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:17:09.407 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:17:09.407 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:17:09.407 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:17:09.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.364+0000 7eff06128740 1 --2- 172.21.15.59:0/872429148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620480aad30 0x5620480a81e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7efef40126d0 tx=0x7efef4004a40 comp rx=0 tx=0).stop 2024-09-10T21:17:09.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.364+0000 7eff06128740 1 -- 172.21.15.59:0/872429148 shutdown_connections 2024-09-10T21:17:09.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.364+0000 7eff06128740 1 --2- 172.21.15.59:0/872429148 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5620480ba940 0x5620480bcd30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.364+0000 7eff06128740 1 --2- 172.21.15.59:0/872429148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620480aad30 0x5620480a81e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.364+0000 7eff06128740 1 --2- 172.21.15.59:0/872429148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809eda0 0x5620480a7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.364+0000 7eff06128740 1 --2- 172.21.15.59:0/872429148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204809e480 0x5620480aa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.364+0000 7efee57fa640 0 client.15822 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:09.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.364+0000 7eff06128740 1 -- 172.21.15.59:0/872429148 >> 172.21.15.59:0/872429148 conn(0x56204809c2b0 msgr2=0x5620480a1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:09.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.365+0000 7eff06128740 1 -- 172.21.15.59:0/872429148 shutdown_connections 2024-09-10T21:17:09.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.365+0000 7eff06128740 1 -- 172.21.15.59:0/872429148 wait complete. 2024-09-10T21:17:09.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.365+0000 7eff06128740 20 client.15822 trim_cache size 0 max 16384 2024-09-10T21:17:09.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.382+0000 7eff06128740 1 Processor -- start 2024-09-10T21:17:09.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.382+0000 7eff06128740 1 -- start start 2024-09-10T21:17:09.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.382+0000 7eff06128740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204809e480 0x5620480b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:09.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.382+0000 7eff06128740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809eda0 0x5620480b3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:09.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.382+0000 7eff06128740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620480aad30 0x5620480b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:09.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.382+0000 7eff06128740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1ae2a0 con 0x5620480aad30 2024-09-10T21:17:09.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.382+0000 7eff06128740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1afde0 con 0x56204809e480 2024-09-10T21:17:09.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.382+0000 7eff06128740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1ae970 con 0x56204809eda0 2024-09-10T21:17:09.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.383+0000 7eff022f0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620480aad30 0x5620480b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:09.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.383+0000 7eff022f0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620480aad30 0x5620480b3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43010/0 (socket says 172.21.15.59:43010) 2024-09-10T21:17:09.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.383+0000 7eff022f0640 1 -- 172.21.15.59:0/4199764381 learned_addr learned my addr 172.21.15.59:0/4199764381 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:09.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.383+0000 7eff012ee640 1 --2- 172.21.15.59:0/4199764381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809eda0 0x5620480b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:09.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.383+0000 7eff022f0640 1 -- 172.21.15.59:0/4199764381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809eda0 msgr2=0x5620480b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:09.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.383+0000 7eff022f0640 1 --2- 172.21.15.59:0/4199764381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809eda0 0x5620480b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.383+0000 7eff01aef640 1 --2- 172.21.15.59:0/4199764381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204809e480 0x5620480b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:09.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.383+0000 7eff022f0640 1 -- 172.21.15.59:0/4199764381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204809e480 msgr2=0x5620480b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:09.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.383+0000 7eff022f0640 1 --2- 172.21.15.59:0/4199764381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204809e480 0x5620480b6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.383+0000 7eff022f0640 1 -- 172.21.15.59:0/4199764381 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56204809cd30 con 0x5620480aad30 2024-09-10T21:17:09.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.383+0000 7eff022f0640 1 --2- 172.21.15.59:0/4199764381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620480aad30 0x5620480b3560 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7efef40265e0 tx=0x7efef4005c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f73be0c71de8d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:09.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.383+0000 7efee77fe640 1 -- 172.21.15.59:0/4199764381 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4004cb0 con 0x5620480aad30 2024-09-10T21:17:09.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.383+0000 7efee77fe640 1 -- 172.21.15.59:0/4199764381 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efef4004e50 con 0x5620480aad30 2024-09-10T21:17:09.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.383+0000 7efee77fe640 1 -- 172.21.15.59:0/4199764381 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef40052a0 con 0x5620480aad30 2024-09-10T21:17:09.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.384+0000 7eff06128740 1 -- 172.21.15.59:0/4199764381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620480aad30 msgr2=0x5620480b3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:09.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.384+0000 7eff06128740 1 --2- 172.21.15.59:0/4199764381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620480aad30 0x5620480b3560 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7efef40265e0 tx=0x7efef4005c10 comp rx=0 tx=0).stop 2024-09-10T21:17:09.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.384+0000 7eff06128740 1 -- 172.21.15.59:0/4199764381 shutdown_connections 2024-09-10T21:17:09.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.384+0000 7eff06128740 1 --2- 172.21.15.59:0/4199764381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5620480aad30 0x5620480b3560 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.384+0000 7eff06128740 1 --2- 172.21.15.59:0/4199764381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809eda0 0x5620480b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.384+0000 7eff06128740 1 --2- 172.21.15.59:0/4199764381 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56204809e480 0x5620480b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.384+0000 7eff06128740 1 -- 172.21.15.59:0/4199764381 >> 172.21.15.59:0/4199764381 conn(0x56204809c2b0 msgr2=0x5620480a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:09.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.384+0000 7eff06128740 1 -- 172.21.15.59:0/4199764381 shutdown_connections 2024-09-10T21:17:09.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.384+0000 7eff06128740 1 -- 172.21.15.59:0/4199764381 wait complete. 2024-09-10T21:17:09.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.384+0000 7eff06128740 1 -- start start 2024-09-10T21:17:09.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.384+0000 7eff06128740 1 Processor -- start 2024-09-10T21:17:09.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7eff06128740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809e480 0x5620480a4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:09.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7eff06128740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56204809eda0 0x5620480a5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:09.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7eff06128740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620480aad30 0x5620480c1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:09.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7eff06128740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1af710 con 0x56204809eda0 2024-09-10T21:17:09.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7eff06128740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1af040 con 0x5620480aad30 2024-09-10T21:17:09.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7eff06128740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1ac280 con 0x56204809e480 2024-09-10T21:17:09.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7eff06128740 10 client.0 _ll_register_callbacks cb 0x7efef4004880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:09.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7eff012ee640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56204809eda0 0x5620480a5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:09.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7eff012ee640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56204809eda0 0x5620480a5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43024/0 (socket says 172.21.15.59:43024) 2024-09-10T21:17:09.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7eff012ee640 1 -- 172.21.15.59:0/4159827736 learned_addr learned my addr 172.21.15.59:0/4159827736 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:09.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7eff022f0640 1 --2- 172.21.15.59:0/4159827736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620480aad30 0x5620480c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:09.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7eff01aef640 1 --2- 172.21.15.59:0/4159827736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809e480 0x5620480a4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:09.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7eff012ee640 1 -- 172.21.15.59:0/4159827736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809e480 msgr2=0x5620480a4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:09.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7eff012ee640 1 --2- 172.21.15.59:0/4159827736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809e480 0x5620480a4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7eff012ee640 1 -- 172.21.15.59:0/4159827736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620480aad30 msgr2=0x5620480c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:09.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7eff012ee640 1 --2- 172.21.15.59:0/4159827736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620480aad30 0x5620480c1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7eff012ee640 1 -- 172.21.15.59:0/4159827736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620480c1ba0 con 0x56204809eda0 2024-09-10T21:17:09.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7eff01aef640 1 --2- 172.21.15.59:0/4159827736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809e480 0x5620480a4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:09.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7eff012ee640 1 --2- 172.21.15.59:0/4159827736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56204809eda0 0x5620480a5460 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7efeec0ca180 tx=0x7efeec009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e13ab674266e984 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:09.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.385+0000 7efee57fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:09.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.386+0000 7efee57fa640 1 -- 172.21.15.59:0/4159827736 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec049030 con 0x56204809eda0 2024-09-10T21:17:09.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.386+0000 7efee57fa640 1 -- 172.21.15.59:0/4159827736 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7efeec0cd370 con 0x56204809eda0 2024-09-10T21:17:09.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.386+0000 7eff06128740 1 -- 172.21.15.59:0/4159827736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efef4004e50 con 0x56204809eda0 2024-09-10T21:17:09.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.386+0000 7efee57fa640 1 -- 172.21.15.59:0/4159827736 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efeec0ccce0 con 0x56204809eda0 2024-09-10T21:17:09.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.386+0000 7eff06128740 10 client.15828 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:09.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.386+0000 7eff06128740 1 -- 172.21.15.59:0/4159827736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5620480c2f10 con 0x56204809eda0 2024-09-10T21:17:09.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.386+0000 7efee57fa640 1 -- 172.21.15.59:0/4159827736 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efef4004e50 con 0x56204809eda0 2024-09-10T21:17:09.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.386+0000 7efee57fa640 1 -- 172.21.15.59:0/4159827736 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efeec0d1070 con 0x56204809eda0 2024-09-10T21:17:09.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.386+0000 7eff06128740 10 client.15828 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:09.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.386+0000 7eff06128740 10 client.15828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:17:09.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.386+0000 7eff06128740 20 client.15828 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:09.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.386+0000 7eff06128740 1 --2- 172.21.15.59:0/4159827736 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56204812c970 0x56204812ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:09.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.386+0000 7eff06128740 4 client.15828 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:17:09.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.386+0000 7eff06128740 1 -- 172.21.15.59:0/4159827736 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562048012850 con 0x56204812c970 2024-09-10T21:17:09.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.386+0000 7eff01aef640 1 --2- 172.21.15.59:0/4159827736 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56204812c970 0x56204812ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:09.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.387+0000 7eff01aef640 1 --2- 172.21.15.59:0/4159827736 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56204812c970 0x56204812ed90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5f337550da24bfd server_cookie=9ac947a33dd9ca14 in_seq=0 out_seq=0 2024-09-10T21:17:09.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.387+0000 7efee57fa640 10 client.15828 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:09.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.387+0000 7efee57fa640 1 -- 172.21.15.59:0/4159827736 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x562048012850 con 0x56204812c970 2024-09-10T21:17:09.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.387+0000 7efee57fa640 10 client.15828 handle_command_reply: tid=0 2024-09-10T21:17:09.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.387+0000 7eff06128740 1 client.15828 shutdown 2024-09-10T21:17:09.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.387+0000 7eff06128740 1 -- 172.21.15.59:0/4159827736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56204809eda0 msgr2=0x5620480a5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:09.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.387+0000 7eff06128740 1 --2- 172.21.15.59:0/4159827736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56204809eda0 0x5620480a5460 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7efeec0ca180 tx=0x7efeec009620 comp rx=0 tx=0).stop 2024-09-10T21:17:09.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.387+0000 7eff06128740 1 -- 172.21.15.59:0/4159827736 shutdown_connections 2024-09-10T21:17:09.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.387+0000 7eff06128740 1 --2- 172.21.15.59:0/4159827736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620480aad30 0x5620480c1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.387+0000 7eff06128740 1 --2- 172.21.15.59:0/4159827736 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56204812c970 0x56204812ed90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.387+0000 7eff06128740 1 --2- 172.21.15.59:0/4159827736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56204809eda0 0x5620480a5460 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.387+0000 7efee57fa640 0 client.15828 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:09.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.387+0000 7eff06128740 1 --2- 172.21.15.59:0/4159827736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56204809e480 0x5620480a4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.387+0000 7eff06128740 1 -- 172.21.15.59:0/4159827736 >> 172.21.15.59:0/4159827736 conn(0x56204809c2b0 msgr2=0x5620480a9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:09.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.387+0000 7eff06128740 1 -- 172.21.15.59:0/4159827736 shutdown_connections 2024-09-10T21:17:09.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.387+0000 7eff06128740 1 -- 172.21.15.59:0/4159827736 wait complete. 2024-09-10T21:17:09.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.387+0000 7eff06128740 20 client.15828 trim_cache size 0 max 16384 2024-09-10T21:17:09.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.388+0000 7eff03d53640 1 -- 172.21.15.59:0/1121818176 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efee80b52e0 msgr2=0x7efee80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:09.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.388+0000 7eff03d53640 1 --2- 172.21.15.59:0/1121818176 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efee80b52e0 0x7efee80b77a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efef4005fd0 tx=0x7efef40096a0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.388+0000 7eff03d53640 1 -- 172.21.15.59:0/1121818176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efefc1087d0 msgr2=0x7efefc1997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:09.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.388+0000 7eff03d53640 1 --2- 172.21.15.59:0/1121818176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efefc1087d0 0x7efefc1997c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7efeec005940 tx=0x7efeec0042f0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.388+0000 7eff03d53640 1 -- 172.21.15.59:0/1121818176 shutdown_connections 2024-09-10T21:17:09.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.388+0000 7eff03d53640 1 --2- 172.21.15.59:0/1121818176 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efee80b52e0 0x7efee80b77a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.388+0000 7eff03d53640 1 --2- 172.21.15.59:0/1121818176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efefc109150 0x7efefc19eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.388+0000 7eff03d53640 1 --2- 172.21.15.59:0/1121818176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efefc1087d0 0x7efefc1997c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.388+0000 7eff03d53640 1 --2- 172.21.15.59:0/1121818176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efefc102dc0 0x7efefc199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:09.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.388+0000 7eff03d53640 1 -- 172.21.15.59:0/1121818176 >> 172.21.15.59:0/1121818176 conn(0x7efefc0fe830 msgr2=0x7efefc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:09.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.388+0000 7eff03d53640 1 -- 172.21.15.59:0/1121818176 shutdown_connections 2024-09-10T21:17:09.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:09.388+0000 7eff03d53640 1 -- 172.21.15.59:0/1121818176 wait complete. 2024-09-10T21:17:09.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:09 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:17:09.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:09 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:17:09.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:09 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:17:09.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:09 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:17:09.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:09 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:17:09.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:09 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:17:09.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:09 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:17:09.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:09 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:17:09.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:09 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:17:09.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:09 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:17:09.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:09 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:17:09.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:09 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:17:10.113 INFO:tasks.cephfs.filesystem:scrub status for tag:5159b619-53a5-44b8-9752-1966beb29939 - {'path': '/', 'tag': '5159b619-53a5-44b8-9752-1966beb29939', 'options': 'recursive,force'} 2024-09-10T21:17:10.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:10 smithi059 ceph-mon[30888]: pgmap v397: 97 pgs: 97 active+clean; 1.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:10.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:10 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:17:10.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:10 smithi154 ceph-mon[35041]: pgmap v397: 97 pgs: 97 active+clean; 1.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:10.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:10 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:17:10.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:10 smithi192 ceph-mon[35363]: pgmap v397: 97 pgs: 97 active+clean; 1.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:10.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:10 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:17:12.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:12 smithi059 ceph-mon[30888]: pgmap v398: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:17:12.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:12 smithi154 ceph-mon[35041]: pgmap v398: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:17:12.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:12 smithi192 ceph-mon[35363]: pgmap v398: 97 pgs: 97 active+clean; 1.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:17:14.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:14 smithi059 ceph-mon[30888]: pgmap v399: 97 pgs: 97 active+clean; 1.3 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:14.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:14 smithi154 ceph-mon[35041]: pgmap v399: 97 pgs: 97 active+clean; 1.3 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:14.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:14 smithi192 ceph-mon[35363]: pgmap v399: 97 pgs: 97 active+clean; 1.3 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:16.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:16 smithi154 ceph-mon[35041]: pgmap v400: 97 pgs: 97 active+clean; 1.3 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-10T21:17:16.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:16 smithi192 ceph-mon[35363]: pgmap v400: 97 pgs: 97 active+clean; 1.3 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-10T21:17:16.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:16 smithi059 ceph-mon[30888]: pgmap v400: 97 pgs: 97 active+clean; 1.3 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-10T21:17:18.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:18 smithi154 ceph-mon[35041]: pgmap v401: 97 pgs: 97 active+clean; 1.3 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:17:18.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:18 smithi192 ceph-mon[35363]: pgmap v401: 97 pgs: 97 active+clean; 1.3 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:17:18.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:18 smithi059 ceph-mon[30888]: pgmap v401: 97 pgs: 97 active+clean; 1.3 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:17:18.933 INFO:tasks.workunit.client.0.smithi059.stdout:1/600: open fd = 3 2024-09-10T21:17:18.933 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.933 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.933 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.933 INFO:tasks.workunit.client.0.smithi059.stdout:2/600: open fd = 3 2024-09-10T21:17:18.933 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.934 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.934 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.934 INFO:tasks.workunit.client.0.smithi059.stdout:3/600: open fd = 3 2024-09-10T21:17:18.934 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.934 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.934 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.934 INFO:tasks.workunit.client.0.smithi059.stdout:4/600: open fd = 3 2024-09-10T21:17:18.934 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.934 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.934 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.934 INFO:tasks.workunit.client.0.smithi059.stdout:5/600: open fd = 3 2024-09-10T21:17:18.934 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.934 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.934 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.934 INFO:tasks.workunit.client.0.smithi059.stdout:6/600: open fd = 3 2024-09-10T21:17:18.935 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.935 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.935 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.935 INFO:tasks.workunit.client.0.smithi059.stdout:7/600: open fd = 3 2024-09-10T21:17:18.935 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.935 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.935 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.935 INFO:tasks.workunit.client.0.smithi059.stdout:8/600: open fd = 3 2024-09-10T21:17:18.935 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.935 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.935 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.935 INFO:tasks.workunit.client.0.smithi059.stdout:9/600: open fd = 3 2024-09-10T21:17:18.935 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.935 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.936 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.936 INFO:tasks.workunit.client.0.smithi059.stdout:10/600: open fd = 3 2024-09-10T21:17:18.936 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.936 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.936 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.936 INFO:tasks.workunit.client.0.smithi059.stdout:11/600: open fd = 3 2024-09-10T21:17:18.936 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.936 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.936 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.936 INFO:tasks.workunit.client.0.smithi059.stdout:12/600: open fd = 3 2024-09-10T21:17:18.936 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.936 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.936 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.936 INFO:tasks.workunit.client.0.smithi059.stdout:13/600: open fd = 3 2024-09-10T21:17:18.936 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.937 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.937 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.937 INFO:tasks.workunit.client.0.smithi059.stdout:14/600: open fd = 3 2024-09-10T21:17:18.937 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.937 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.937 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.937 INFO:tasks.workunit.client.0.smithi059.stdout:15/600: open fd = 3 2024-09-10T21:17:18.937 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.937 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.937 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.937 INFO:tasks.workunit.client.0.smithi059.stdout:16/600: open fd = 3 2024-09-10T21:17:18.937 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.937 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.937 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.937 INFO:tasks.workunit.client.0.smithi059.stdout:17/600: open fd = 3 2024-09-10T21:17:18.938 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.938 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.938 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.938 INFO:tasks.workunit.client.0.smithi059.stdout:18/600: open fd = 3 2024-09-10T21:17:18.938 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.938 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.938 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.938 INFO:tasks.workunit.client.0.smithi059.stdout:19/600: open fd = 3 2024-09-10T21:17:18.938 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.938 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.938 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.938 INFO:tasks.workunit.client.0.smithi059.stdout:20/600: open fd = 3 2024-09-10T21:17:18.938 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.938 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.938 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.938 INFO:tasks.workunit.client.0.smithi059.stdout:21/600: open fd = 3 2024-09-10T21:17:18.939 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.939 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.939 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.939 INFO:tasks.workunit.client.0.smithi059.stdout:22/600: open fd = 3 2024-09-10T21:17:18.939 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.939 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.939 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.939 INFO:tasks.workunit.client.0.smithi059.stdout:23/600: open fd = 3 2024-09-10T21:17:18.939 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.939 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.939 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.939 INFO:tasks.workunit.client.0.smithi059.stdout:24/600: open fd = 3 2024-09-10T21:17:18.939 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.939 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.939 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.939 INFO:tasks.workunit.client.0.smithi059.stdout:25/600: open fd = 3 2024-09-10T21:17:18.940 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.940 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.940 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.940 INFO:tasks.workunit.client.0.smithi059.stdout:26/600: open fd = 3 2024-09-10T21:17:18.940 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.940 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.940 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.940 INFO:tasks.workunit.client.0.smithi059.stdout:27/600: open fd = 3 2024-09-10T21:17:18.940 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.940 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.940 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.940 INFO:tasks.workunit.client.0.smithi059.stdout:28/600: open fd = 3 2024-09-10T21:17:18.940 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.940 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.940 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.941 INFO:tasks.workunit.client.0.smithi059.stdout:29/600: open fd = 3 2024-09-10T21:17:18.941 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.941 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.941 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.941 INFO:tasks.workunit.client.0.smithi059.stdout:30/600: open fd = 3 2024-09-10T21:17:18.941 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.941 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.941 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.941 INFO:tasks.workunit.client.0.smithi059.stdout:31/600: open fd = 3 2024-09-10T21:17:18.941 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.941 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.941 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.941 INFO:tasks.workunit.client.0.smithi059.stdout:32/600: open fd = 3 2024-09-10T21:17:18.941 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.941 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.941 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.942 INFO:tasks.workunit.client.0.smithi059.stdout:33/600: open fd = 3 2024-09-10T21:17:18.942 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.942 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.942 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.942 INFO:tasks.workunit.client.0.smithi059.stdout:34/600: open fd = 3 2024-09-10T21:17:18.942 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.942 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.942 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.942 INFO:tasks.workunit.client.0.smithi059.stdout:35/600: open fd = 3 2024-09-10T21:17:18.942 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.942 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.942 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.942 INFO:tasks.workunit.client.0.smithi059.stdout:36/600: open fd = 3 2024-09-10T21:17:18.942 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.942 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.942 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.943 INFO:tasks.workunit.client.0.smithi059.stdout:37/600: open fd = 3 2024-09-10T21:17:18.943 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.943 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.943 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.943 INFO:tasks.workunit.client.0.smithi059.stdout:38/600: open fd = 3 2024-09-10T21:17:18.943 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.943 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.943 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.943 INFO:tasks.workunit.client.0.smithi059.stdout:39/600: open fd = 3 2024-09-10T21:17:18.943 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.943 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.943 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.943 INFO:tasks.workunit.client.0.smithi059.stdout:40/600: open fd = 3 2024-09-10T21:17:18.943 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.943 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.943 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.944 INFO:tasks.workunit.client.0.smithi059.stdout:41/600: open fd = 3 2024-09-10T21:17:18.944 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.944 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.944 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.944 INFO:tasks.workunit.client.0.smithi059.stdout:42/600: open fd = 3 2024-09-10T21:17:18.944 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.944 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.944 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.944 INFO:tasks.workunit.client.0.smithi059.stdout:43/600: open fd = 3 2024-09-10T21:17:18.944 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.944 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.944 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.944 INFO:tasks.workunit.client.0.smithi059.stdout:44/600: open fd = 3 2024-09-10T21:17:18.944 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.944 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.944 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.945 INFO:tasks.workunit.client.0.smithi059.stdout:45/600: open fd = 3 2024-09-10T21:17:18.945 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.945 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.945 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.945 INFO:tasks.workunit.client.0.smithi059.stdout:46/600: open fd = 3 2024-09-10T21:17:18.945 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.945 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.945 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.945 INFO:tasks.workunit.client.0.smithi059.stdout:47/600: open fd = 3 2024-09-10T21:17:18.945 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.945 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.945 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.945 INFO:tasks.workunit.client.0.smithi059.stdout:48/600: open fd = 3 2024-09-10T21:17:18.945 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.945 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.946 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.946 INFO:tasks.workunit.client.0.smithi059.stdout:49/600: open fd = 3 2024-09-10T21:17:18.946 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.946 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.946 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.946 INFO:tasks.workunit.client.0.smithi059.stdout:50/600: open fd = 3 2024-09-10T21:17:18.946 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.946 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.946 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.946 INFO:tasks.workunit.client.0.smithi059.stdout:51/600: open fd = 3 2024-09-10T21:17:18.946 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.946 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.946 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.946 INFO:tasks.workunit.client.0.smithi059.stdout:52/600: open fd = 3 2024-09-10T21:17:18.946 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.946 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.947 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.947 INFO:tasks.workunit.client.0.smithi059.stdout:53/600: open fd = 3 2024-09-10T21:17:18.947 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.947 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.947 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.947 INFO:tasks.workunit.client.0.smithi059.stdout:54/600: open fd = 3 2024-09-10T21:17:18.947 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.947 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.947 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.947 INFO:tasks.workunit.client.0.smithi059.stdout:55/600: open fd = 3 2024-09-10T21:17:18.947 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.947 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.947 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.947 INFO:tasks.workunit.client.0.smithi059.stdout:56/600: open fd = 3 2024-09-10T21:17:18.948 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.948 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.948 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.948 INFO:tasks.workunit.client.0.smithi059.stdout:57/600: open fd = 3 2024-09-10T21:17:18.948 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.948 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.948 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.948 INFO:tasks.workunit.client.0.smithi059.stdout:58/600: open fd = 3 2024-09-10T21:17:18.948 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.948 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.948 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.948 INFO:tasks.workunit.client.0.smithi059.stdout:59/600: open fd = 3 2024-09-10T21:17:18.948 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.948 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.948 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.949 INFO:tasks.workunit.client.0.smithi059.stdout:60/600: open fd = 3 2024-09-10T21:17:18.949 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.949 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.949 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.949 INFO:tasks.workunit.client.0.smithi059.stdout:61/600: open fd = 3 2024-09-10T21:17:18.949 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.949 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.949 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.949 INFO:tasks.workunit.client.0.smithi059.stdout:62/600: open fd = 3 2024-09-10T21:17:18.949 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.949 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.949 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:18.949 INFO:tasks.workunit.client.0.smithi059.stdout:63/600: open fd = 3 2024-09-10T21:17:18.949 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.949 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:17:18.950 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:17:20.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:20 smithi059 ceph-mon[30888]: pgmap v402: 97 pgs: 97 active+clean; 1.3 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:17:20.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:20 smithi154 ceph-mon[35041]: pgmap v402: 97 pgs: 97 active+clean; 1.3 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:17:20.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:20 smithi192 ceph-mon[35363]: pgmap v402: 97 pgs: 97 active+clean; 1.3 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:17:22.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:22 smithi154 ceph-mon[35041]: pgmap v403: 97 pgs: 97 active+clean; 1.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:17:22.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:22 smithi192 ceph-mon[35363]: pgmap v403: 97 pgs: 97 active+clean; 1.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:17:22.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:22 smithi059 ceph-mon[30888]: pgmap v403: 97 pgs: 97 active+clean; 1.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:17:25.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:24 smithi192 ceph-mon[35363]: pgmap v404: 97 pgs: 97 active+clean; 1.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:25.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:24 smithi059 ceph-mon[30888]: pgmap v404: 97 pgs: 97 active+clean; 1.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:25.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:24 smithi154 ceph-mon[35041]: pgmap v404: 97 pgs: 97 active+clean; 1.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:27.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:26 smithi192 ceph-mon[35363]: pgmap v405: 97 pgs: 97 active+clean; 1.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:17:27.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:26 smithi059 ceph-mon[30888]: pgmap v405: 97 pgs: 97 active+clean; 1.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:17:27.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:26 smithi154 ceph-mon[35041]: pgmap v405: 97 pgs: 97 active+clean; 1.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:17:28.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:27 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:17:28.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:27 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:17:28.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:27 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:17:29.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:28 smithi192 ceph-mon[35363]: pgmap v406: 97 pgs: 97 active+clean; 1.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:17:29.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:28 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:17:29.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:28 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:17:29.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:28 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:17:29.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:28 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:17:29.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:28 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:17:29.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:28 smithi059 ceph-mon[30888]: pgmap v406: 97 pgs: 97 active+clean; 1.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:17:29.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:28 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:17:29.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:28 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:17:29.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:28 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:17:29.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:28 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:17:29.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:28 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:17:29.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:28 smithi154 ceph-mon[35041]: pgmap v406: 97 pgs: 97 active+clean; 1.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:17:29.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:28 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:17:29.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:28 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:17:29.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:28 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:17:29.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:28 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:17:29.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:28 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:17:31.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:30 smithi192 ceph-mon[35363]: pgmap v407: 97 pgs: 97 active+clean; 1.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:31.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:30 smithi059 ceph-mon[30888]: pgmap v407: 97 pgs: 97 active+clean; 1.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:31.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:30 smithi154 ceph-mon[35041]: pgmap v407: 97 pgs: 97 active+clean; 1.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:33.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:33 smithi192 ceph-mon[35363]: pgmap v408: 97 pgs: 97 active+clean; 1.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:17:33.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:33 smithi059 ceph-mon[30888]: pgmap v408: 97 pgs: 97 active+clean; 1.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:17:33.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:33 smithi154 ceph-mon[35041]: pgmap v408: 97 pgs: 97 active+clean; 1.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:17:35.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:35 smithi192 ceph-mon[35363]: pgmap v409: 97 pgs: 97 active+clean; 1.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:35.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:35 smithi059 ceph-mon[30888]: pgmap v409: 97 pgs: 97 active+clean; 1.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:35.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:35 smithi154 ceph-mon[35041]: pgmap v409: 97 pgs: 97 active+clean; 1.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:37.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:37 smithi192 ceph-mon[35363]: pgmap v410: 97 pgs: 97 active+clean; 1.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:17:37.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:37 smithi059 ceph-mon[30888]: pgmap v410: 97 pgs: 97 active+clean; 1.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:17:37.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:37 smithi154 ceph-mon[35041]: pgmap v410: 97 pgs: 97 active+clean; 1.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:17:39.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:39 smithi192 ceph-mon[35363]: pgmap v411: 97 pgs: 97 active+clean; 1.6 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:17:39.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:39 smithi059 ceph-mon[30888]: pgmap v411: 97 pgs: 97 active+clean; 1.6 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:17:39.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:39 smithi154 ceph-mon[35041]: pgmap v411: 97 pgs: 97 active+clean; 1.6 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:17:40.115 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:17:40.388 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:17:40.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.976+0000 7fe99cbbd640 1 -- 172.21.15.59:0/1791190554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe998104570 msgr2=0x7fe99810cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:40.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.976+0000 7fe99cbbd640 1 --2- 172.21.15.59:0/1791190554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe998104570 0x7fe99810cb50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe980009900 tx=0x7fe98002a410 comp rx=0 tx=0).stop 2024-09-10T21:17:40.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.976+0000 7fe99cbbd640 1 -- 172.21.15.59:0/1791190554 shutdown_connections 2024-09-10T21:17:40.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.976+0000 7fe99cbbd640 1 --2- 172.21.15.59:0/1791190554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe99810d120 0x7fe99810f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:40.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.976+0000 7fe99cbbd640 1 --2- 172.21.15.59:0/1791190554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe998104570 0x7fe99810cb50 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:40.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.976+0000 7fe99cbbd640 1 --2- 172.21.15.59:0/1791190554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe998103b70 0x7fe998103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:40.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.976+0000 7fe99cbbd640 1 -- 172.21.15.59:0/1791190554 >> 172.21.15.59:0/1791190554 conn(0x7fe9980fd700 msgr2=0x7fe9980ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:40.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.976+0000 7fe99cbbd640 1 -- 172.21.15.59:0/1791190554 shutdown_connections 2024-09-10T21:17:40.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.976+0000 7fe99cbbd640 1 -- 172.21.15.59:0/1791190554 wait complete. 2024-09-10T21:17:40.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.977+0000 7fe99cbbd640 1 Processor -- start 2024-09-10T21:17:40.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.977+0000 7fe99cbbd640 1 -- start start 2024-09-10T21:17:40.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.978+0000 7fe99cbbd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe998103b70 0x7fe9981993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:40.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.978+0000 7fe99cbbd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe998104570 0x7fe998199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:40.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.978+0000 7fe99cbbd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99810d120 0x7fe99819ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:40.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.978+0000 7fe99cbbd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe998112e60 con 0x7fe99810d120 2024-09-10T21:17:40.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.978+0000 7fe99cbbd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe998112ce0 con 0x7fe998103b70 2024-09-10T21:17:40.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.978+0000 7fe99cbbd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe998112fe0 con 0x7fe998104570 2024-09-10T21:17:40.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.978+0000 7fe996d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99810d120 0x7fe99819ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:40.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.978+0000 7fe996d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99810d120 0x7fe99819ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45308/0 (socket says 172.21.15.59:45308) 2024-09-10T21:17:40.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.978+0000 7fe996d9d640 1 -- 172.21.15.59:0/813107774 learned_addr learned my addr 172.21.15.59:0/813107774 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:40.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.978+0000 7fe98ffff640 1 --2- 172.21.15.59:0/813107774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe998104570 0x7fe998199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:40.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.978+0000 7fe99659c640 1 --2- 172.21.15.59:0/813107774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe998103b70 0x7fe9981993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:40.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.978+0000 7fe996d9d640 1 -- 172.21.15.59:0/813107774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe998104570 msgr2=0x7fe998199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:40.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.978+0000 7fe996d9d640 1 --2- 172.21.15.59:0/813107774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe998104570 0x7fe998199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:40.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.978+0000 7fe996d9d640 1 -- 172.21.15.59:0/813107774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe998103b70 msgr2=0x7fe9981993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:40.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.978+0000 7fe996d9d640 1 --2- 172.21.15.59:0/813107774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe998103b70 0x7fe9981993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:40.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.978+0000 7fe996d9d640 1 -- 172.21.15.59:0/813107774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99819f480 con 0x7fe99810d120 2024-09-10T21:17:40.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.978+0000 7fe996d9d640 1 --2- 172.21.15.59:0/813107774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99810d120 0x7fe99819ecb0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe99000b970 tx=0x7fe99000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:40.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.978+0000 7fe98f7fe640 1 -- 172.21.15.59:0/813107774 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe990019070 con 0x7fe99810d120 2024-09-10T21:17:40.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.979+0000 7fe99cbbd640 1 -- 172.21.15.59:0/813107774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99819f770 con 0x7fe99810d120 2024-09-10T21:17:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.979+0000 7fe98f7fe640 1 -- 172.21.15.59:0/813107774 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe990014440 con 0x7fe99810d120 2024-09-10T21:17:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.979+0000 7fe98f7fe640 1 -- 172.21.15.59:0/813107774 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9900075d0 con 0x7fe99810d120 2024-09-10T21:17:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.979+0000 7fe99cbbd640 1 -- 172.21.15.59:0/813107774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9981a5eb0 con 0x7fe99810d120 2024-09-10T21:17:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.981+0000 7fe98f7fe640 1 -- 172.21.15.59:0/813107774 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fe9900145f0 con 0x7fe99810d120 2024-09-10T21:17:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.981+0000 7fe99ef92740 1 Processor -- start 2024-09-10T21:17:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.981+0000 7fe99ef92740 1 -- start start 2024-09-10T21:17:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.981+0000 7fe99ef92740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871480 0x557196871860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.981+0000 7fe99ef92740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 0x55719687d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe99ef92740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 0x557196880120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe99ef92740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5571967e7e50 con 0x557196871da0 2024-09-10T21:17:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe99ef92740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5571967d7280 con 0x55719687dd30 2024-09-10T21:17:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe99ef92740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5571967db090 con 0x557196871480 2024-09-10T21:17:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe99659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 0x55719687d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe99659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 0x55719687d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45314/0 (socket says 172.21.15.59:45314) 2024-09-10T21:17:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe99659c640 1 -- 172.21.15.59:0/864967261 learned_addr learned my addr 172.21.15.59:0/864967261 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe98ffff640 1 --2- 172.21.15.59:0/864967261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 0x557196880120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe98ffff640 1 --2- 172.21.15.59:0/864967261 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871480 0x557196871860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe99659c640 1 -- 172.21.15.59:0/864967261 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871480 msgr2=0x557196871860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe99659c640 1 --2- 172.21.15.59:0/864967261 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871480 0x557196871860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe99659c640 1 -- 172.21.15.59:0/864967261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 msgr2=0x557196880120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe99659c640 1 --2- 172.21.15.59:0/864967261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 0x557196880120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe99659c640 1 -- 172.21.15.59:0/864967261 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557196535650 con 0x557196871da0 2024-09-10T21:17:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe98ffff640 1 --2- 172.21.15.59:0/864967261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 0x557196880120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe99659c640 1 --2- 172.21.15.59:0/864967261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 0x55719687d7f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe988009a70 tx=0x7fe988009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1510a24599d8cfd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe98f7fe640 1 --2- 172.21.15.59:0/813107774 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe9840b52e0 0x7fe9840b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe98cff9640 1 -- 172.21.15.59:0/864967261 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988017070 con 0x557196871da0 2024-09-10T21:17:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe98ffff640 1 --2- 172.21.15.59:0/813107774 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe9840b52e0 0x7fe9840b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe98cff9640 1 -- 172.21.15.59:0/864967261 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe988013470 con 0x557196871da0 2024-09-10T21:17:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe98cff9640 1 -- 172.21.15.59:0/864967261 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988012630 con 0x557196871da0 2024-09-10T21:17:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.982+0000 7fe98f7fe640 1 -- 172.21.15.59:0/813107774 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe9900e5280 con 0x7fe99810d120 2024-09-10T21:17:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.983+0000 7fe98ffff640 1 --2- 172.21.15.59:0/813107774 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe9840b52e0 0x7fe9840b77a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe980031440 tx=0x7fe980009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.983+0000 7fe99ef92740 1 -- 172.21.15.59:0/864967261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 msgr2=0x55719687d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.983+0000 7fe99ef92740 1 --2- 172.21.15.59:0/864967261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 0x55719687d7f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe988009a70 tx=0x7fe988009f30 comp rx=0 tx=0).stop 2024-09-10T21:17:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.983+0000 7fe99ef92740 1 -- 172.21.15.59:0/864967261 shutdown_connections 2024-09-10T21:17:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.983+0000 7fe99ef92740 1 --2- 172.21.15.59:0/864967261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 0x557196880120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.983+0000 7fe99ef92740 1 --2- 172.21.15.59:0/864967261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 0x55719687d7f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.983+0000 7fe99ef92740 1 --2- 172.21.15.59:0/864967261 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871480 0x557196871860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.983+0000 7fe99ef92740 1 -- 172.21.15.59:0/864967261 >> 172.21.15.59:0/864967261 conn(0x55719686f2b0 msgr2=0x557196870450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.983+0000 7fe99ef92740 1 -- 172.21.15.59:0/864967261 shutdown_connections 2024-09-10T21:17:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.983+0000 7fe99ef92740 1 -- 172.21.15.59:0/864967261 wait complete. 2024-09-10T21:17:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe99ef92740 1 -- start start 2024-09-10T21:17:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe99ef92740 1 Processor -- start 2024-09-10T21:17:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe99ef92740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871480 0x55719687d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe99ef92740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 0x55719687aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe99ef92740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 0x55719687afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe99ef92740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557196638700 con 0x557196871da0 2024-09-10T21:17:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe99ef92740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557196772110 con 0x55719687dd30 2024-09-10T21:17:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe99ef92740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5571968809b0 con 0x557196871480 2024-09-10T21:17:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe99ef92740 10 client.0 _ll_register_callbacks cb 0x55719678b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe98ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 0x55719687aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe98ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 0x55719687aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45330/0 (socket says 172.21.15.59:45330) 2024-09-10T21:17:41.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe98ffff640 1 -- 172.21.15.59:0/3059841549 learned_addr learned my addr 172.21.15.59:0/3059841549 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe99659c640 1 --2- 172.21.15.59:0/3059841549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871480 0x55719687d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe996d9d640 1 --2- 172.21.15.59:0/3059841549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 0x55719687afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe98ffff640 1 -- 172.21.15.59:0/3059841549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871480 msgr2=0x55719687d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe98ffff640 1 --2- 172.21.15.59:0/3059841549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871480 0x55719687d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe98ffff640 1 -- 172.21.15.59:0/3059841549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 msgr2=0x55719687afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe98ffff640 1 --2- 172.21.15.59:0/3059841549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 0x55719687afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe98ffff640 1 -- 172.21.15.59:0/3059841549 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55719679fc40 con 0x557196871da0 2024-09-10T21:17:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.984+0000 7fe99659c640 1 --2- 172.21.15.59:0/3059841549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871480 0x55719687d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.985+0000 7fe996d9d640 1 --2- 172.21.15.59:0/3059841549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 0x55719687afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.985+0000 7fe98ffff640 1 --2- 172.21.15.59:0/3059841549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 0x55719687aa20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe980033000 tx=0x7fe980005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da628eac8f82f3dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.985+0000 7fe97dffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.985+0000 7fe97dffb640 1 -- 172.21.15.59:0/3059841549 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9800043c0 con 0x557196871da0 2024-09-10T21:17:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.985+0000 7fe99ef92740 1 -- 172.21.15.59:0/3059841549 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe988013470 con 0x557196871da0 2024-09-10T21:17:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.985+0000 7fe97dffb640 1 -- 172.21.15.59:0/3059841549 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe9800035f0 con 0x557196871da0 2024-09-10T21:17:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.985+0000 7fe97dffb640 1 -- 172.21.15.59:0/3059841549 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe9800037f0 con 0x557196871da0 2024-09-10T21:17:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.985+0000 7fe99ef92740 10 client.15840 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.985+0000 7fe99ef92740 1 -- 172.21.15.59:0/3059841549 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55719688c2d0 con 0x557196871da0 2024-09-10T21:17:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.985+0000 7fe97dffb640 1 -- 172.21.15.59:0/3059841549 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe988013470 con 0x557196871da0 2024-09-10T21:17:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.985+0000 7fe97dffb640 1 -- 172.21.15.59:0/3059841549 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe980046070 con 0x557196871da0 2024-09-10T21:17:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.985+0000 7fe99ef92740 10 client.15840 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.985+0000 7fe99ef92740 10 client.15840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:17:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.985+0000 7fe99ef92740 20 client.15840 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.985+0000 7fe99ef92740 1 --2- 172.21.15.59:0/3059841549 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55719688d830 0x55719688fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.985+0000 7fe99ef92740 4 client.15840 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:17:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.985+0000 7fe99ef92740 1 -- 172.21.15.59:0/3059841549 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571967e9da0 con 0x55719688d830 2024-09-10T21:17:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.986+0000 7fe99659c640 1 --2- 172.21.15.59:0/3059841549 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55719688d830 0x55719688fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.986+0000 7fe97dffb640 10 client.15840 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.986+0000 7fe99659c640 1 --2- 172.21.15.59:0/3059841549 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55719688d830 0x55719688fc80 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9815493fdaa5540b server_cookie=a1dcd0d0c8b1c0fd in_seq=0 out_seq=0 2024-09-10T21:17:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.987+0000 7fe97dffb640 1 -- 172.21.15.59:0/3059841549 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5571967e9da0 con 0x55719688d830 2024-09-10T21:17:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.987+0000 7fe97dffb640 10 client.15840 handle_command_reply: tid=0 2024-09-10T21:17:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.987+0000 7fe99ef92740 1 client.15840 shutdown 2024-09-10T21:17:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.987+0000 7fe99ef92740 1 -- 172.21.15.59:0/3059841549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 msgr2=0x55719687aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.987+0000 7fe99ef92740 1 --2- 172.21.15.59:0/3059841549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 0x55719687aa20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe980033000 tx=0x7fe980005e80 comp rx=0 tx=0).stop 2024-09-10T21:17:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.987+0000 7fe99ef92740 1 -- 172.21.15.59:0/3059841549 shutdown_connections 2024-09-10T21:17:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.987+0000 7fe99ef92740 1 --2- 172.21.15.59:0/3059841549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 0x55719687afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.987+0000 7fe99ef92740 1 --2- 172.21.15.59:0/3059841549 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55719688d830 0x55719688fc80 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.987+0000 7fe99ef92740 1 --2- 172.21.15.59:0/3059841549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 0x55719687aa20 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.987+0000 7fe97dffb640 0 client.15840 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.987+0000 7fe99ef92740 1 --2- 172.21.15.59:0/3059841549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871480 0x55719687d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.987+0000 7fe99ef92740 1 -- 172.21.15.59:0/3059841549 >> 172.21.15.59:0/3059841549 conn(0x55719686f2b0 msgr2=0x557196874e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.987+0000 7fe99ef92740 1 -- 172.21.15.59:0/3059841549 shutdown_connections 2024-09-10T21:17:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.987+0000 7fe99ef92740 1 -- 172.21.15.59:0/3059841549 wait complete. 2024-09-10T21:17:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:40.987+0000 7fe99ef92740 20 client.15840 trim_cache size 0 max 16384 2024-09-10T21:17:41.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.005+0000 7fe99ef92740 1 Processor -- start 2024-09-10T21:17:41.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.005+0000 7fe99ef92740 1 -- start start 2024-09-10T21:17:41.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.005+0000 7fe99ef92740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871480 0x557196889c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:41.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.005+0000 7fe99ef92740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 0x557196877c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:41.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.005+0000 7fe99ef92740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 0x557196878170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:41.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.005+0000 7fe99ef92740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe9981b0530 con 0x557196871da0 2024-09-10T21:17:41.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.005+0000 7fe99ef92740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9981b2070 con 0x55719687dd30 2024-09-10T21:17:41.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.005+0000 7fe99ef92740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe9981b0c00 con 0x557196871480 2024-09-10T21:17:41.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.005+0000 7fe98ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 0x557196877c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:41.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.005+0000 7fe98ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 0x557196877c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45334/0 (socket says 172.21.15.59:45334) 2024-09-10T21:17:41.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.005+0000 7fe98ffff640 1 -- 172.21.15.59:0/496237493 learned_addr learned my addr 172.21.15.59:0/496237493 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:41.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.005+0000 7fe99659c640 1 --2- 172.21.15.59:0/496237493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871480 0x557196889c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:41.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.005+0000 7fe996d9d640 1 --2- 172.21.15.59:0/496237493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 0x557196878170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:41.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.005+0000 7fe98ffff640 1 -- 172.21.15.59:0/496237493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871480 msgr2=0x557196889c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:41.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.005+0000 7fe98ffff640 1 --2- 172.21.15.59:0/496237493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871480 0x557196889c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.005+0000 7fe98ffff640 1 -- 172.21.15.59:0/496237493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 msgr2=0x557196878170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:41.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.005+0000 7fe98ffff640 1 --2- 172.21.15.59:0/496237493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 0x557196878170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.005+0000 7fe98ffff640 1 -- 172.21.15.59:0/496237493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557196890300 con 0x557196871da0 2024-09-10T21:17:41.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.005+0000 7fe99659c640 1 --2- 172.21.15.59:0/496237493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871480 0x557196889c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:17:41.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.006+0000 7fe98ffff640 1 --2- 172.21.15.59:0/496237493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 0x557196877c30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe98002a930 tx=0x7fe9800319c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7ce2c564255eef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:41.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.006+0000 7fe97ffff640 1 -- 172.21.15.59:0/496237493 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe980062070 con 0x557196871da0 2024-09-10T21:17:41.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.006+0000 7fe97ffff640 1 -- 172.21.15.59:0/496237493 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe98003d450 con 0x557196871da0 2024-09-10T21:17:41.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.006+0000 7fe97ffff640 1 -- 172.21.15.59:0/496237493 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98003c540 con 0x557196871da0 2024-09-10T21:17:41.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.006+0000 7fe99ef92740 1 -- 172.21.15.59:0/496237493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 msgr2=0x557196877c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:41.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.006+0000 7fe99ef92740 1 --2- 172.21.15.59:0/496237493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 0x557196877c30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe98002a930 tx=0x7fe9800319c0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.006+0000 7fe99ef92740 1 -- 172.21.15.59:0/496237493 shutdown_connections 2024-09-10T21:17:41.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.006+0000 7fe99ef92740 1 --2- 172.21.15.59:0/496237493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 0x557196878170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.006+0000 7fe99ef92740 1 --2- 172.21.15.59:0/496237493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871da0 0x557196877c30 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.006+0000 7fe99ef92740 1 --2- 172.21.15.59:0/496237493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871480 0x557196889c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.006+0000 7fe99ef92740 1 -- 172.21.15.59:0/496237493 >> 172.21.15.59:0/496237493 conn(0x55719686f2b0 msgr2=0x557196875c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:41.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.007+0000 7fe99ef92740 1 -- 172.21.15.59:0/496237493 shutdown_connections 2024-09-10T21:17:41.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.007+0000 7fe99ef92740 1 -- 172.21.15.59:0/496237493 wait complete. 2024-09-10T21:17:41.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.007+0000 7fe99ef92740 1 -- start start 2024-09-10T21:17:41.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.007+0000 7fe99ef92740 1 Processor -- start 2024-09-10T21:17:41.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.007+0000 7fe99ef92740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871480 0x5571968865d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:41.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.007+0000 7fe99ef92740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871da0 0x557196881aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:41.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.007+0000 7fe99ef92740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 0x557196882190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:41.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.007+0000 7fe99ef92740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe9981b19a0 con 0x557196871480 2024-09-10T21:17:41.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.007+0000 7fe99ef92740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe9981b12d0 con 0x55719687dd30 2024-09-10T21:17:41.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.007+0000 7fe99ef92740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe9981ae510 con 0x557196871da0 2024-09-10T21:17:41.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.007+0000 7fe99ef92740 10 client.0 _ll_register_callbacks cb 0x7fe980031cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:41.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.007+0000 7fe99659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871480 0x5571968865d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:41.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.007+0000 7fe99659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871480 0x5571968865d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45348/0 (socket says 172.21.15.59:45348) 2024-09-10T21:17:41.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.007+0000 7fe99659c640 1 -- 172.21.15.59:0/440333017 learned_addr learned my addr 172.21.15.59:0/440333017 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:41.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.008+0000 7fe996d9d640 1 --2- 172.21.15.59:0/440333017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 0x557196882190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:41.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.008+0000 7fe98ffff640 1 --2- 172.21.15.59:0/440333017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871da0 0x557196881aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:41.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.008+0000 7fe99659c640 1 -- 172.21.15.59:0/440333017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871da0 msgr2=0x557196881aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:41.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.008+0000 7fe99659c640 1 --2- 172.21.15.59:0/440333017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871da0 0x557196881aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.008+0000 7fe99659c640 1 -- 172.21.15.59:0/440333017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 msgr2=0x557196882190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:41.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.008+0000 7fe99659c640 1 --2- 172.21.15.59:0/440333017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 0x557196882190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.008+0000 7fe99659c640 1 -- 172.21.15.59:0/440333017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571968f9750 con 0x557196871480 2024-09-10T21:17:41.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.008+0000 7fe98ffff640 1 --2- 172.21.15.59:0/440333017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871da0 0x557196881aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:41.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.008+0000 7fe99659c640 1 --2- 172.21.15.59:0/440333017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871480 0x5571968865d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe988013ee0 tx=0x7fe9880047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c3930fd6cd2ab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:41.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.008+0000 7fe97dffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:41.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.008+0000 7fe97dffb640 1 -- 172.21.15.59:0/440333017 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988017040 con 0x557196871480 2024-09-10T21:17:41.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.008+0000 7fe97dffb640 1 -- 172.21.15.59:0/440333017 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe98800edc0 con 0x557196871480 2024-09-10T21:17:41.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.008+0000 7fe99ef92740 1 -- 172.21.15.59:0/440333017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe98003d450 con 0x557196871480 2024-09-10T21:17:41.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.008+0000 7fe97dffb640 1 -- 172.21.15.59:0/440333017 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe9880059c0 con 0x557196871480 2024-09-10T21:17:41.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.008+0000 7fe99ef92740 10 client.15846 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:41.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.008+0000 7fe99ef92740 1 -- 172.21.15.59:0/440333017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5571968fa970 con 0x557196871480 2024-09-10T21:17:41.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.008+0000 7fe97dffb640 1 -- 172.21.15.59:0/440333017 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe98003d450 con 0x557196871480 2024-09-10T21:17:41.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.009+0000 7fe97dffb640 1 -- 172.21.15.59:0/440333017 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe98802b070 con 0x557196871480 2024-09-10T21:17:41.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.009+0000 7fe99ef92740 10 client.15846 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:41.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.009+0000 7fe99ef92740 10 client.15846 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:17:41.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.009+0000 7fe99ef92740 20 client.15846 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:41.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.009+0000 7fe99ef92740 1 --2- 172.21.15.59:0/440333017 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5571968fad60 0x5571968fd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:41.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.009+0000 7fe99ef92740 4 client.15846 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:17:41.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.009+0000 7fe99ef92740 1 -- 172.21.15.59:0/440333017 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5571967e5850 con 0x5571968fad60 2024-09-10T21:17:41.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.009+0000 7fe98ffff640 1 --2- 172.21.15.59:0/440333017 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5571968fad60 0x5571968fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:41.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.009+0000 7fe98ffff640 1 --2- 172.21.15.59:0/440333017 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5571968fad60 0x5571968fd180 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffbf6545de29f0b4 server_cookie=42b12b04703ac629 in_seq=0 out_seq=0 2024-09-10T21:17:41.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.009+0000 7fe97dffb640 10 client.15846 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:41.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.010+0000 7fe97dffb640 1 -- 172.21.15.59:0/440333017 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x5571967e5850 con 0x5571968fad60 2024-09-10T21:17:41.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.010+0000 7fe97dffb640 10 client.15846 handle_command_reply: tid=0 2024-09-10T21:17:41.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.010+0000 7fe99ef92740 1 client.15846 shutdown 2024-09-10T21:17:41.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.010+0000 7fe99ef92740 1 -- 172.21.15.59:0/440333017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871480 msgr2=0x5571968865d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:41.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.010+0000 7fe99ef92740 1 --2- 172.21.15.59:0/440333017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871480 0x5571968865d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe988013ee0 tx=0x7fe9880047d0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.010+0000 7fe99ef92740 1 -- 172.21.15.59:0/440333017 shutdown_connections 2024-09-10T21:17:41.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.010+0000 7fe99ef92740 1 --2- 172.21.15.59:0/440333017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55719687dd30 0x557196882190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.010+0000 7fe99ef92740 1 --2- 172.21.15.59:0/440333017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557196871da0 0x557196881aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.010+0000 7fe99ef92740 1 --2- 172.21.15.59:0/440333017 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5571968fad60 0x5571968fd180 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.010+0000 7fe99ef92740 1 --2- 172.21.15.59:0/440333017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557196871480 0x5571968865d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.010+0000 7fe97dffb640 0 client.15846 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:41.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.010+0000 7fe99ef92740 1 -- 172.21.15.59:0/440333017 >> 172.21.15.59:0/440333017 conn(0x55719686f2b0 msgr2=0x55719687c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:41.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.010+0000 7fe99ef92740 1 -- 172.21.15.59:0/440333017 shutdown_connections 2024-09-10T21:17:41.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.010+0000 7fe99ef92740 1 -- 172.21.15.59:0/440333017 wait complete. 2024-09-10T21:17:41.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.010+0000 7fe99ef92740 20 client.15846 trim_cache size 0 max 16384 2024-09-10T21:17:41.020 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:17:41.020 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:17:41.020 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:17:41.020 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:17:41.021 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:17:41.021 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:17:41.021 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:17:41.021 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:17:41.021 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:17:41.021 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:17:41.021 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:17:41.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:17:41.021 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:17:41.021 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:17:41.021 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:17:41.021 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:17:41.021 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:17:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:17:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:17:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:17:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:17:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:17:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:17:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:17:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:17:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:17:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:17:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:17:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:17:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:17:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:17:41.022 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:17:41.023 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:17:41.023 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:17:41.023 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:17:41.023 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:17:41.023 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:17:41.023 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:17:41.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.010+0000 7fe99cbbd640 1 -- 172.21.15.59:0/813107774 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe9840b52e0 msgr2=0x7fe9840b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:41.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.010+0000 7fe99cbbd640 1 --2- 172.21.15.59:0/813107774 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe9840b52e0 0x7fe9840b77a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe980031440 tx=0x7fe980009560 comp rx=0 tx=0).stop 2024-09-10T21:17:41.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.010+0000 7fe99cbbd640 1 -- 172.21.15.59:0/813107774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99810d120 msgr2=0x7fe99819ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:41.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.010+0000 7fe99cbbd640 1 --2- 172.21.15.59:0/813107774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99810d120 0x7fe99819ecb0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe99000b970 tx=0x7fe99000bd70 comp rx=0 tx=0).stop 2024-09-10T21:17:41.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.011+0000 7fe99cbbd640 1 -- 172.21.15.59:0/813107774 shutdown_connections 2024-09-10T21:17:41.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.011+0000 7fe99cbbd640 1 --2- 172.21.15.59:0/813107774 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe9840b52e0 0x7fe9840b77a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.011+0000 7fe99cbbd640 1 --2- 172.21.15.59:0/813107774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe99810d120 0x7fe99819ecb0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.011+0000 7fe99cbbd640 1 --2- 172.21.15.59:0/813107774 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe998104570 0x7fe998199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.011+0000 7fe99cbbd640 1 --2- 172.21.15.59:0/813107774 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe998103b70 0x7fe9981993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:41.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.011+0000 7fe99cbbd640 1 -- 172.21.15.59:0/813107774 >> 172.21.15.59:0/813107774 conn(0x7fe9980fd700 msgr2=0x7fe9980fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:41.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.011+0000 7fe99cbbd640 1 -- 172.21.15.59:0/813107774 shutdown_connections 2024-09-10T21:17:41.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:41.011+0000 7fe99cbbd640 1 -- 172.21.15.59:0/813107774 wait complete. 2024-09-10T21:17:41.025 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:41 smithi059 ceph-mon[30888]: pgmap v412: 97 pgs: 97 active+clean; 1.6 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:41.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:41 smithi192 ceph-mon[35363]: pgmap v412: 97 pgs: 97 active+clean; 1.6 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:41.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:41 smithi154 ceph-mon[35041]: pgmap v412: 97 pgs: 97 active+clean; 1.6 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:41.898 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:17:41.898 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:17:42.163 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:17:42.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.778+0000 7f4427614640 1 -- 172.21.15.59:0/1952742297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4420108020 msgr2=0x7f442010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.778+0000 7f4427614640 1 --2- 172.21.15.59:0/1952742297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4420108020 0x7f442010e820 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4418009ca0 tx=0x7f441802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:17:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.778+0000 7f4427614640 1 -- 172.21.15.59:0/1952742297 shutdown_connections 2024-09-10T21:17:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.778+0000 7f4427614640 1 --2- 172.21.15.59:0/1952742297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4420108020 0x7f442010e820 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.778+0000 7f4427614640 1 --2- 172.21.15.59:0/1952742297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44201076a0 0x7f4420107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.778+0000 7f4427614640 1 --2- 172.21.15.59:0/1952742297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4420101c90 0x7f4420102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.778+0000 7f4427614640 1 -- 172.21.15.59:0/1952742297 >> 172.21.15.59:0/1952742297 conn(0x7f44200fd700 msgr2=0x7f44200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.778+0000 7f4427614640 1 -- 172.21.15.59:0/1952742297 shutdown_connections 2024-09-10T21:17:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.778+0000 7f4427614640 1 -- 172.21.15.59:0/1952742297 wait complete. 2024-09-10T21:17:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.778+0000 7f4427614640 1 Processor -- start 2024-09-10T21:17:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.778+0000 7f4427614640 1 -- start start 2024-09-10T21:17:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.779+0000 7f4427614640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4420101c90 0x7f44200fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:42.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.779+0000 7f4427614640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44201076a0 0x7f44200fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.779+0000 7f4427614640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4420108020 0x7f44200fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.779+0000 7f4427614640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4420111ce0 con 0x7f4420101c90 2024-09-10T21:17:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.779+0000 7f4427614640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4420111b60 con 0x7f44201076a0 2024-09-10T21:17:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.779+0000 7f4427614640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4420111e60 con 0x7f4420108020 2024-09-10T21:17:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.779+0000 7f44253b0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4420101c90 0x7f44200fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.779+0000 7f44253b0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4420101c90 0x7f44200fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45362/0 (socket says 172.21.15.59:45362) 2024-09-10T21:17:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.779+0000 7f44253b0640 1 -- 172.21.15.59:0/2575513674 learned_addr learned my addr 172.21.15.59:0/2575513674 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.779+0000 7f4425bb1640 1 --2- 172.21.15.59:0/2575513674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4420108020 0x7f44200fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.779+0000 7f4424baf640 1 --2- 172.21.15.59:0/2575513674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44201076a0 0x7f44200fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.779+0000 7f44253b0640 1 -- 172.21.15.59:0/2575513674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4420108020 msgr2=0x7f44200fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.779+0000 7f44253b0640 1 --2- 172.21.15.59:0/2575513674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4420108020 0x7f44200fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.779+0000 7f44253b0640 1 -- 172.21.15.59:0/2575513674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44201076a0 msgr2=0x7f44200fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:42.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.779+0000 7f44253b0640 1 --2- 172.21.15.59:0/2575513674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44201076a0 0x7f44200fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.779+0000 7f44253b0640 1 -- 172.21.15.59:0/2575513674 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44201a76d0 con 0x7f4420101c90 2024-09-10T21:17:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.779+0000 7f4425bb1640 1 --2- 172.21.15.59:0/2575513674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4420108020 0x7f44200fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.779+0000 7f44253b0640 1 --2- 172.21.15.59:0/2575513674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4420101c90 0x7f44200fdc00 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c920 tx=0x7f441c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.780+0000 7f44167fc640 1 -- 172.21.15.59:0/2575513674 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c007c70 con 0x7f4420101c90 2024-09-10T21:17:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.780+0000 7f44167fc640 1 -- 172.21.15.59:0/2575513674 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f441c007e10 con 0x7f4420101c90 2024-09-10T21:17:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.780+0000 7f4427614640 1 -- 172.21.15.59:0/2575513674 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44201a79c0 con 0x7f4420101c90 2024-09-10T21:17:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.780+0000 7f44167fc640 1 -- 172.21.15.59:0/2575513674 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c018820 con 0x7f4420101c90 2024-09-10T21:17:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.780+0000 7f4427614640 1 -- 172.21.15.59:0/2575513674 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44201a7f80 con 0x7f4420101c90 2024-09-10T21:17:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.781+0000 7f4427614640 1 -- 172.21.15.59:0/2575513674 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4420102070 con 0x7f4420101c90 2024-09-10T21:17:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.782+0000 7f44167fc640 1 -- 172.21.15.59:0/2575513674 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f441c00f450 con 0x7f4420101c90 2024-09-10T21:17:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.783+0000 7f44167fc640 1 --2- 172.21.15.59:0/2575513674 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f440c0b52e0 0x7f440c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.783+0000 7f4424baf640 1 --2- 172.21.15.59:0/2575513674 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f440c0b52e0 0x7f440c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.783+0000 7f44167fc640 1 -- 172.21.15.59:0/2575513674 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f441c0e6000 con 0x7f4420101c90 2024-09-10T21:17:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.784+0000 7f4424baf640 1 --2- 172.21.15.59:0/2575513674 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f440c0b52e0 0x7f440c0b77a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f44200ff6f0 tx=0x7f4410008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:42.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:42.786+0000 7f44167fc640 1 -- 172.21.15.59:0/2575513674 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f441c014030 con 0x7f4420101c90 2024-09-10T21:17:43.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:43.009+0000 7f4427614640 1 -- 172.21.15.59:0/2575513674 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44201a83b0 con 0x7f4420101c90 2024-09-10T21:17:43.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:43.009+0000 7f44167fc640 1 -- 172.21.15.59:0/2575513674 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f441c0acf80 con 0x7f4420101c90 2024-09-10T21:17:43.014 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:17:43.014 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:17:43.014 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:17:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:43.011+0000 7f4427614640 1 -- 172.21.15.59:0/2575513674 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f440c0b52e0 msgr2=0x7f440c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:43.012+0000 7f4427614640 1 --2- 172.21.15.59:0/2575513674 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f440c0b52e0 0x7f440c0b77a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f44200ff6f0 tx=0x7f4410008040 comp rx=0 tx=0).stop 2024-09-10T21:17:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:43.012+0000 7f4427614640 1 -- 172.21.15.59:0/2575513674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4420101c90 msgr2=0x7f44200fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:43.012+0000 7f4427614640 1 --2- 172.21.15.59:0/2575513674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4420101c90 0x7f44200fdc00 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c920 tx=0x7f441c00cde0 comp rx=0 tx=0).stop 2024-09-10T21:17:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:43.012+0000 7f4427614640 1 -- 172.21.15.59:0/2575513674 shutdown_connections 2024-09-10T21:17:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:43.012+0000 7f4427614640 1 --2- 172.21.15.59:0/2575513674 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f440c0b52e0 0x7f440c0b77a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:43.012+0000 7f4427614640 1 --2- 172.21.15.59:0/2575513674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4420108020 0x7f44200fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:43.012+0000 7f4427614640 1 --2- 172.21.15.59:0/2575513674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44201076a0 0x7f44200fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:43.012+0000 7f4427614640 1 --2- 172.21.15.59:0/2575513674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4420101c90 0x7f44200fdc00 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:43.012+0000 7f4427614640 1 -- 172.21.15.59:0/2575513674 >> 172.21.15.59:0/2575513674 conn(0x7f44200fd700 msgr2=0x7f442006adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:43.012+0000 7f4427614640 1 -- 172.21.15.59:0/2575513674 shutdown_connections 2024-09-10T21:17:43.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:43.012+0000 7f4427614640 1 -- 172.21.15.59:0/2575513674 wait complete. 2024-09-10T21:17:43.318 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:43 smithi059 ceph-mon[30888]: pgmap v413: 97 pgs: 97 active+clean; 1.6 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:17:43.318 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:43 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2575513674' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:17:43.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:43 smithi192 ceph-mon[35363]: pgmap v413: 97 pgs: 97 active+clean; 1.6 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:17:43.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:43 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2575513674' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:17:43.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:43 smithi154 ceph-mon[35041]: pgmap v413: 97 pgs: 97 active+clean; 1.6 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:17:43.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:43 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2575513674' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:17:43.727 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:17:43.991 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:17:44.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.486+0000 7f3245aa7640 1 -- 172.21.15.59:0/1813798585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f324010d140 msgr2=0x7f324010f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:44.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.486+0000 7f3245aa7640 1 --2- 172.21.15.59:0/1813798585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f324010d140 0x7f324010f5a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f3238009ca0 tx=0x7f323802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.486+0000 7f3245aa7640 1 -- 172.21.15.59:0/1813798585 shutdown_connections 2024-09-10T21:17:44.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.486+0000 7f3245aa7640 1 --2- 172.21.15.59:0/1813798585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f324010d140 0x7f324010f5a0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.486+0000 7f3245aa7640 1 --2- 172.21.15.59:0/1813798585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3240104600 0x7f324010caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.486+0000 7f3245aa7640 1 --2- 172.21.15.59:0/1813798585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3240103ce0 0x7f32401040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.486+0000 7f3245aa7640 1 -- 172.21.15.59:0/1813798585 >> 172.21.15.59:0/1813798585 conn(0x7f32400fd700 msgr2=0x7f32400ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:44.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.486+0000 7f3245aa7640 1 -- 172.21.15.59:0/1813798585 shutdown_connections 2024-09-10T21:17:44.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.486+0000 7f3245aa7640 1 -- 172.21.15.59:0/1813798585 wait complete. 2024-09-10T21:17:44.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.487+0000 7f3245aa7640 1 Processor -- start 2024-09-10T21:17:44.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.487+0000 7f3245aa7640 1 -- start start 2024-09-10T21:17:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.487+0000 7f3245aa7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3240103ce0 0x7f3240101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.487+0000 7f3245aa7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3240104600 0x7f3240101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.487+0000 7f3245aa7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f324010d140 0x7f3240102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.487+0000 7f3245aa7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3240112db0 con 0x7f3240104600 2024-09-10T21:17:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.487+0000 7f3245aa7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3240112c30 con 0x7f3240103ce0 2024-09-10T21:17:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.487+0000 7f3245aa7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3240112f30 con 0x7f324010d140 2024-09-10T21:17:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.487+0000 7f323effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3240104600 0x7f3240101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.487+0000 7f323effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3240104600 0x7f3240101ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45380/0 (socket says 172.21.15.59:45380) 2024-09-10T21:17:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.487+0000 7f323effd640 1 -- 172.21.15.59:0/4185455078 learned_addr learned my addr 172.21.15.59:0/4185455078 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:44.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.487+0000 7f323ffff640 1 --2- 172.21.15.59:0/4185455078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f324010d140 0x7f3240102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:44.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.487+0000 7f323f7fe640 1 --2- 172.21.15.59:0/4185455078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3240103ce0 0x7f3240101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:44.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.487+0000 7f323effd640 1 -- 172.21.15.59:0/4185455078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f324010d140 msgr2=0x7f3240102410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:44.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.487+0000 7f323effd640 1 --2- 172.21.15.59:0/4185455078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f324010d140 0x7f3240102410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.487+0000 7f323effd640 1 -- 172.21.15.59:0/4185455078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3240103ce0 msgr2=0x7f3240101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:44.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.487+0000 7f323effd640 1 --2- 172.21.15.59:0/4185455078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3240103ce0 0x7f3240101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.487+0000 7f323effd640 1 -- 172.21.15.59:0/4185455078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32401a7680 con 0x7f3240104600 2024-09-10T21:17:44.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.487+0000 7f323f7fe640 1 --2- 172.21.15.59:0/4185455078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3240103ce0 0x7f3240101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:44.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.488+0000 7f323effd640 1 --2- 172.21.15.59:0/4185455078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3240104600 0x7f3240101ed0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f323400c970 tx=0x7f323400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:44.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.488+0000 7f323cff9640 1 -- 172.21.15.59:0/4185455078 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3234004220 con 0x7f3240104600 2024-09-10T21:17:44.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.488+0000 7f323cff9640 1 -- 172.21.15.59:0/4185455078 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32340043c0 con 0x7f3240104600 2024-09-10T21:17:44.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.488+0000 7f3245aa7640 1 -- 172.21.15.59:0/4185455078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32401a7970 con 0x7f3240104600 2024-09-10T21:17:44.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.488+0000 7f323cff9640 1 -- 172.21.15.59:0/4185455078 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3234003e30 con 0x7f3240104600 2024-09-10T21:17:44.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.488+0000 7f3245aa7640 1 -- 172.21.15.59:0/4185455078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32401a7f00 con 0x7f3240104600 2024-09-10T21:17:44.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.490+0000 7f3247e7c740 1 Processor -- start 2024-09-10T21:17:44.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.490+0000 7f3247e7c740 1 -- start start 2024-09-10T21:17:44.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.490+0000 7f323cff9640 1 -- 172.21.15.59:0/4185455078 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f32340079b0 con 0x7f3240104600 2024-09-10T21:17:44.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.491+0000 7f3247e7c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc0f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:44.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.491+0000 7f3247e7c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0fdf0 0x55a2bcc1b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:44.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.491+0000 7f3247e7c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc1e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:44.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.491+0000 7f3247e7c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a2bcb85ea0 con 0x55a2bcc0f4d0 2024-09-10T21:17:44.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.491+0000 7f3247e7c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a2bcb752d0 con 0x55a2bcc1bd80 2024-09-10T21:17:44.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.491+0000 7f3247e7c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a2bcb790e0 con 0x55a2bcc0fdf0 2024-09-10T21:17:44.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.491+0000 7f323ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc0f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:44.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.491+0000 7f323ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc0f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45382/0 (socket says 172.21.15.59:45382) 2024-09-10T21:17:44.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.491+0000 7f323ffff640 1 -- 172.21.15.59:0/3817792389 learned_addr learned my addr 172.21.15.59:0/3817792389 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:44.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.491+0000 7f323f7fe640 1 --2- 172.21.15.59:0/3817792389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0fdf0 0x55a2bcc1b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:44.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.491+0000 7f323effd640 1 --2- 172.21.15.59:0/3817792389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc1e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:44.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.491+0000 7f323ffff640 1 -- 172.21.15.59:0/3817792389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0fdf0 msgr2=0x55a2bcc1b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:44.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.491+0000 7f323ffff640 1 --2- 172.21.15.59:0/3817792389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0fdf0 0x55a2bcc1b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.491+0000 7f323ffff640 1 -- 172.21.15.59:0/3817792389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc1bd80 msgr2=0x55a2bcc1e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:44.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.491+0000 7f323ffff640 1 --2- 172.21.15.59:0/3817792389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc1e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.491+0000 7f323ffff640 1 -- 172.21.15.59:0/3817792389 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2bc8d3650 con 0x55a2bcc0f4d0 2024-09-10T21:17:44.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.491+0000 7f323effd640 1 --2- 172.21.15.59:0/3817792389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc1e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:44.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.491+0000 7f323ffff640 1 --2- 172.21.15.59:0/3817792389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc0f8b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3238005cc0 tx=0x7f3238009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af64f836de36a600 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:44.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.491+0000 7f323cff9640 1 --2- 172.21.15.59:0/4185455078 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f32280b5360 0x7f32280b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:44.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.492+0000 7f3225ffb640 1 -- 172.21.15.59:0/3817792389 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3238031df0 con 0x55a2bcc0f4d0 2024-09-10T21:17:44.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.492+0000 7f323f7fe640 1 --2- 172.21.15.59:0/4185455078 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f32280b5360 0x7f32280b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:44.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.492+0000 7f3225ffb640 1 -- 172.21.15.59:0/3817792389 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3238036040 con 0x55a2bcc0f4d0 2024-09-10T21:17:44.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.492+0000 7f3225ffb640 1 -- 172.21.15.59:0/3817792389 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32380042a0 con 0x55a2bcc0f4d0 2024-09-10T21:17:44.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.492+0000 7f323cff9640 1 -- 172.21.15.59:0/4185455078 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f32340e5be0 con 0x7f3240104600 2024-09-10T21:17:44.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.492+0000 7f3247e7c740 1 -- 172.21.15.59:0/3817792389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc0f4d0 msgr2=0x55a2bcc0f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:44.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.492+0000 7f3247e7c740 1 --2- 172.21.15.59:0/3817792389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc0f8b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3238005cc0 tx=0x7f3238009930 comp rx=0 tx=0).stop 2024-09-10T21:17:44.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.492+0000 7f323f7fe640 1 --2- 172.21.15.59:0/4185455078 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f32280b5360 0x7f32280b7820 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55a2bcc0e1e0 tx=0x7f323000b3f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:44.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.493+0000 7f3247e7c740 1 -- 172.21.15.59:0/3817792389 shutdown_connections 2024-09-10T21:17:44.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.493+0000 7f3247e7c740 1 --2- 172.21.15.59:0/3817792389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc1e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.493+0000 7f3247e7c740 1 --2- 172.21.15.59:0/3817792389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0fdf0 0x55a2bcc1b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.493+0000 7f3247e7c740 1 --2- 172.21.15.59:0/3817792389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc0f8b0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.493+0000 7f3247e7c740 1 -- 172.21.15.59:0/3817792389 >> 172.21.15.59:0/3817792389 conn(0x55a2bcc0d300 msgr2=0x55a2bcc0e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:44.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.493+0000 7f3247e7c740 1 -- 172.21.15.59:0/3817792389 shutdown_connections 2024-09-10T21:17:44.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.493+0000 7f3247e7c740 1 -- 172.21.15.59:0/3817792389 wait complete. 2024-09-10T21:17:44.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.493+0000 7f3247e7c740 1 -- start start 2024-09-10T21:17:44.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.493+0000 7f3247e7c740 1 Processor -- start 2024-09-10T21:17:44.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.493+0000 7f3247e7c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc1b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:44.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.493+0000 7f3247e7c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0fdf0 0x55a2bcc18a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:44.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.493+0000 7f3247e7c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc18f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:44.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.493+0000 7f3247e7c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a2bc9d6700 con 0x55a2bcc1bd80 2024-09-10T21:17:44.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.493+0000 7f3247e7c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a2bcb10160 con 0x55a2bcc0f4d0 2024-09-10T21:17:44.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.493+0000 7f3247e7c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a2bcc1e9a0 con 0x55a2bcc0fdf0 2024-09-10T21:17:44.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.494+0000 7f3247e7c740 10 client.0 _ll_register_callbacks cb 0x55a2bcb299e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:44.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.494+0000 7f323ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc18f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:44.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.494+0000 7f323ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc18f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45388/0 (socket says 172.21.15.59:45388) 2024-09-10T21:17:44.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.494+0000 7f323ffff640 1 -- 172.21.15.59:0/2451716251 learned_addr learned my addr 172.21.15.59:0/2451716251 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:44.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.494+0000 7f323effd640 1 --2- 172.21.15.59:0/2451716251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0fdf0 0x55a2bcc18a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:44.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.494+0000 7f323f7fe640 1 --2- 172.21.15.59:0/2451716251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc1b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:44.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.494+0000 7f323ffff640 1 -- 172.21.15.59:0/2451716251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0fdf0 msgr2=0x55a2bcc18a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:44.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.494+0000 7f323ffff640 1 --2- 172.21.15.59:0/2451716251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0fdf0 0x55a2bcc18a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.494+0000 7f323ffff640 1 -- 172.21.15.59:0/2451716251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc0f4d0 msgr2=0x55a2bcc1b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:44.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.494+0000 7f323ffff640 1 --2- 172.21.15.59:0/2451716251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc1b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.494+0000 7f323ffff640 1 -- 172.21.15.59:0/2451716251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2bcb3dc90 con 0x55a2bcc1bd80 2024-09-10T21:17:44.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.494+0000 7f323ffff640 1 --2- 172.21.15.59:0/2451716251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc18f40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3238003d40 tx=0x7f323802f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0da6e94c5c6e89 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:44.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.494+0000 7f321effd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:44.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.494+0000 7f321effd640 1 -- 172.21.15.59:0/2451716251 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323804a040 con 0x55a2bcc1bd80 2024-09-10T21:17:44.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.494+0000 7f321effd640 1 -- 172.21.15.59:0/2451716251 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3238031650 con 0x55a2bcc1bd80 2024-09-10T21:17:44.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.494+0000 7f3247e7c740 1 -- 172.21.15.59:0/2451716251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3238036040 con 0x55a2bcc1bd80 2024-09-10T21:17:44.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.494+0000 7f321effd640 1 -- 172.21.15.59:0/2451716251 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3238031850 con 0x55a2bcc1bd80 2024-09-10T21:17:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.495+0000 7f3247e7c740 10 client.15864 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.495+0000 7f3247e7c740 1 -- 172.21.15.59:0/2451716251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a2bcc2a1b0 con 0x55a2bcc1bd80 2024-09-10T21:17:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.495+0000 7f321effd640 1 -- 172.21.15.59:0/2451716251 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3238036040 con 0x55a2bcc1bd80 2024-09-10T21:17:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.495+0000 7f321effd640 1 -- 172.21.15.59:0/2451716251 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f323804d070 con 0x55a2bcc1bd80 2024-09-10T21:17:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.495+0000 7f3247e7c740 10 client.15864 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.495+0000 7f3247e7c740 10 client.15864 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:17:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.495+0000 7f3247e7c740 20 client.15864 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.495+0000 7f3247e7c740 1 --2- 172.21.15.59:0/2451716251 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55a2bcc2b500 0x55a2bcc2d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.495+0000 7f3247e7c740 4 client.15864 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:17:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.495+0000 7f3247e7c740 1 -- 172.21.15.59:0/2451716251 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2bcb87df0 con 0x55a2bcc2b500 2024-09-10T21:17:44.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.495+0000 7f323f7fe640 1 --2- 172.21.15.59:0/2451716251 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55a2bcc2b500 0x55a2bcc2d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:44.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.496+0000 7f323f7fe640 1 --2- 172.21.15.59:0/2451716251 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55a2bcc2b500 0x55a2bcc2d8f0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=730e18fcf8de6e65 server_cookie=9e38442e872a306d in_seq=0 out_seq=0 2024-09-10T21:17:44.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.496+0000 7f321effd640 10 client.15864 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:17:44.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.496+0000 7f321effd640 1 -- 172.21.15.59:0/2451716251 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a2bcb87df0 con 0x55a2bcc2b500 2024-09-10T21:17:44.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.496+0000 7f321effd640 10 client.15864 handle_command_reply: tid=0 2024-09-10T21:17:44.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.497+0000 7f3247e7c740 1 client.15864 shutdown 2024-09-10T21:17:44.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.497+0000 7f3247e7c740 1 -- 172.21.15.59:0/2451716251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc1bd80 msgr2=0x55a2bcc18f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:44.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.497+0000 7f3247e7c740 1 --2- 172.21.15.59:0/2451716251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc18f40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3238003d40 tx=0x7f323802f410 comp rx=0 tx=0).stop 2024-09-10T21:17:44.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.497+0000 7f3247e7c740 1 -- 172.21.15.59:0/2451716251 shutdown_connections 2024-09-10T21:17:44.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.497+0000 7f3247e7c740 1 --2- 172.21.15.59:0/2451716251 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55a2bcc2b500 0x55a2bcc2d8f0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.497+0000 7f3247e7c740 1 --2- 172.21.15.59:0/2451716251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc18f40 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.497+0000 7f3247e7c740 1 --2- 172.21.15.59:0/2451716251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0fdf0 0x55a2bcc18a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.497+0000 7f321effd640 0 client.15864 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:17:44.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.497+0000 7f3247e7c740 1 --2- 172.21.15.59:0/2451716251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc1b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.497+0000 7f3247e7c740 1 -- 172.21.15.59:0/2451716251 >> 172.21.15.59:0/2451716251 conn(0x55a2bcc0d300 msgr2=0x55a2bcc12e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:44.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.497+0000 7f3247e7c740 1 -- 172.21.15.59:0/2451716251 shutdown_connections 2024-09-10T21:17:44.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.497+0000 7f3247e7c740 1 -- 172.21.15.59:0/2451716251 wait complete. 2024-09-10T21:17:44.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.497+0000 7f3247e7c740 20 client.15864 trim_cache size 0 max 16384 2024-09-10T21:17:44.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.510+0000 7f3247e7c740 1 Processor -- start 2024-09-10T21:17:44.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.510+0000 7f3247e7c740 1 -- start start 2024-09-10T21:17:44.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.510+0000 7f3247e7c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc0ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:44.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.510+0000 7f3247e7c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc0fdf0 0x55a2bcc15c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:44.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.510+0000 7f3247e7c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc16150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:44.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.510+0000 7f3247e7c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f32401b0550 con 0x55a2bcc1bd80 2024-09-10T21:17:44.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.510+0000 7f3247e7c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f32401b2090 con 0x55a2bcc0fdf0 2024-09-10T21:17:44.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.510+0000 7f3247e7c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f32401b0c20 con 0x55a2bcc0f4d0 2024-09-10T21:17:44.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.511+0000 7f323ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc16150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:44.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.511+0000 7f323ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc16150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45402/0 (socket says 172.21.15.59:45402) 2024-09-10T21:17:44.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.511+0000 7f323ffff640 1 -- 172.21.15.59:0/406259768 learned_addr learned my addr 172.21.15.59:0/406259768 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:44.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.511+0000 7f323f7fe640 1 --2- 172.21.15.59:0/406259768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc0ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:44.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.511+0000 7f323effd640 1 --2- 172.21.15.59:0/406259768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc0fdf0 0x55a2bcc15c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:44.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.511+0000 7f323ffff640 1 -- 172.21.15.59:0/406259768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0f4d0 msgr2=0x55a2bcc0ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:44.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.511+0000 7f323ffff640 1 --2- 172.21.15.59:0/406259768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc0ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.511+0000 7f323ffff640 1 -- 172.21.15.59:0/406259768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc0fdf0 msgr2=0x55a2bcc15c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:44.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.511+0000 7f323ffff640 1 --2- 172.21.15.59:0/406259768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc0fdf0 0x55a2bcc15c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.511+0000 7f323ffff640 1 -- 172.21.15.59:0/406259768 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2bcc135d0 con 0x55a2bcc1bd80 2024-09-10T21:17:44.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.511+0000 7f323ffff640 1 --2- 172.21.15.59:0/406259768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc16150 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3238009a60 tx=0x7f3238009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e271ef4ec268129a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:44.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.511+0000 7f32257fa640 1 -- 172.21.15.59:0/406259768 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32380305c0 con 0x55a2bcc1bd80 2024-09-10T21:17:44.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.511+0000 7f32257fa640 1 -- 172.21.15.59:0/406259768 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3238036040 con 0x55a2bcc1bd80 2024-09-10T21:17:44.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.511+0000 7f32257fa640 1 -- 172.21.15.59:0/406259768 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323802f660 con 0x55a2bcc1bd80 2024-09-10T21:17:44.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.512+0000 7f3247e7c740 1 -- 172.21.15.59:0/406259768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc1bd80 msgr2=0x55a2bcc16150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:44.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.512+0000 7f3247e7c740 1 --2- 172.21.15.59:0/406259768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc16150 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3238009a60 tx=0x7f3238009930 comp rx=0 tx=0).stop 2024-09-10T21:17:44.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.512+0000 7f3247e7c740 1 -- 172.21.15.59:0/406259768 shutdown_connections 2024-09-10T21:17:44.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.512+0000 7f3247e7c740 1 --2- 172.21.15.59:0/406259768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc16150 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.512+0000 7f3247e7c740 1 --2- 172.21.15.59:0/406259768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc0fdf0 0x55a2bcc15c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.512+0000 7f3247e7c740 1 --2- 172.21.15.59:0/406259768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc0ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.512+0000 7f3247e7c740 1 -- 172.21.15.59:0/406259768 >> 172.21.15.59:0/406259768 conn(0x55a2bcc0d300 msgr2=0x55a2bcc0e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:44.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.512+0000 7f3247e7c740 1 -- 172.21.15.59:0/406259768 shutdown_connections 2024-09-10T21:17:44.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.512+0000 7f3247e7c740 1 -- 172.21.15.59:0/406259768 wait complete. 2024-09-10T21:17:44.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.512+0000 7f3247e7c740 1 -- start start 2024-09-10T21:17:44.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f3247e7c740 1 Processor -- start 2024-09-10T21:17:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f3247e7c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc20310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f3247e7c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0fdf0 0x55a2bcc20850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f3247e7c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc97120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f3247e7c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f32401b19c0 con 0x55a2bcc0f4d0 2024-09-10T21:17:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f3247e7c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f32401b12f0 con 0x55a2bcc1bd80 2024-09-10T21:17:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f3247e7c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f32401ae530 con 0x55a2bcc0fdf0 2024-09-10T21:17:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f3247e7c740 10 client.0 _ll_register_callbacks cb 0x7f323000b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f323f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc20310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f323f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc20310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45410/0 (socket says 172.21.15.59:45410) 2024-09-10T21:17:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f323f7fe640 1 -- 172.21.15.59:0/2922483698 learned_addr learned my addr 172.21.15.59:0/2922483698 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f323ffff640 1 --2- 172.21.15.59:0/2922483698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc97120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:44.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f323effd640 1 --2- 172.21.15.59:0/2922483698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0fdf0 0x55a2bcc20850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f323f7fe640 1 -- 172.21.15.59:0/2922483698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0fdf0 msgr2=0x55a2bcc20850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f323f7fe640 1 --2- 172.21.15.59:0/2922483698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0fdf0 0x55a2bcc20850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f323f7fe640 1 -- 172.21.15.59:0/2922483698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc1bd80 msgr2=0x55a2bcc97120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f323f7fe640 1 --2- 172.21.15.59:0/2922483698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc97120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f323f7fe640 1 -- 172.21.15.59:0/2922483698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2bcc976e0 con 0x55a2bcc0f4d0 2024-09-10T21:17:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f323ffff640 1 --2- 172.21.15.59:0/2922483698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc97120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.513+0000 7f323effd640 1 --2- 172.21.15.59:0/2922483698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0fdf0 0x55a2bcc20850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.514+0000 7f323f7fe640 1 --2- 172.21.15.59:0/2922483698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc20310 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x55a2bcc2dec0 tx=0x7f32300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f60362cadc0a73 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.514+0000 7f321effd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.514+0000 7f321effd640 1 -- 172.21.15.59:0/2922483698 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3230033060 con 0x55a2bcc0f4d0 2024-09-10T21:17:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.514+0000 7f3247e7c740 1 -- 172.21.15.59:0/2922483698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3238036040 con 0x55a2bcc0f4d0 2024-09-10T21:17:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.514+0000 7f321effd640 1 -- 172.21.15.59:0/2922483698 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f323001c460 con 0x55a2bcc0f4d0 2024-09-10T21:17:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.514+0000 7f321effd640 1 -- 172.21.15.59:0/2922483698 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f323001c660 con 0x55a2bcc0f4d0 2024-09-10T21:17:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.514+0000 7f3247e7c740 10 client.15870 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.514+0000 7f3247e7c740 1 -- 172.21.15.59:0/2922483698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a2bcc98a90 con 0x55a2bcc0f4d0 2024-09-10T21:17:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.514+0000 7f321effd640 1 -- 172.21.15.59:0/2922483698 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3238036040 con 0x55a2bcc0f4d0 2024-09-10T21:17:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.514+0000 7f321effd640 1 -- 172.21.15.59:0/2922483698 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f323002e7f0 con 0x55a2bcc0f4d0 2024-09-10T21:17:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.514+0000 7f3247e7c740 10 client.15870 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.514+0000 7f3247e7c740 10 client.15870 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:17:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.514+0000 7f3247e7c740 20 client.15870 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.514+0000 7f3247e7c740 1 --2- 172.21.15.59:0/2922483698 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55a2bcc99190 0x55a2bcc9b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.514+0000 7f3247e7c740 4 client.15870 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:17:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.514+0000 7f3247e7c740 1 -- 172.21.15.59:0/2922483698 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a2bcb838a0 con 0x55a2bcc99190 2024-09-10T21:17:44.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.515+0000 7f323effd640 1 --2- 172.21.15.59:0/2922483698 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55a2bcc99190 0x55a2bcc9b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.515+0000 7f323effd640 1 --2- 172.21.15.59:0/2922483698 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55a2bcc99190 0x55a2bcc9b5b0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a1d57bfd862b42f8 server_cookie=d32a7a07c6bcc768 in_seq=0 out_seq=0 2024-09-10T21:17:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.515+0000 7f321effd640 10 client.15870 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:17:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.515+0000 7f321effd640 1 -- 172.21.15.59:0/2922483698 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a2bcb838a0 con 0x55a2bcc99190 2024-09-10T21:17:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.515+0000 7f321effd640 10 client.15870 handle_command_reply: tid=0 2024-09-10T21:17:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.515+0000 7f3247e7c740 1 client.15870 shutdown 2024-09-10T21:17:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.516+0000 7f3247e7c740 1 -- 172.21.15.59:0/2922483698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc0f4d0 msgr2=0x55a2bcc20310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.516+0000 7f3247e7c740 1 --2- 172.21.15.59:0/2922483698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc20310 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x55a2bcc2dec0 tx=0x7f32300046c0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.516+0000 7f3247e7c740 1 -- 172.21.15.59:0/2922483698 shutdown_connections 2024-09-10T21:17:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.516+0000 7f3247e7c740 1 --2- 172.21.15.59:0/2922483698 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55a2bcc99190 0x55a2bcc9b5b0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.516+0000 7f3247e7c740 1 --2- 172.21.15.59:0/2922483698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2bcc1bd80 0x55a2bcc97120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.516+0000 7f3247e7c740 1 --2- 172.21.15.59:0/2922483698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a2bcc0fdf0 0x55a2bcc20850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.516+0000 7f3247e7c740 1 --2- 172.21.15.59:0/2922483698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2bcc0f4d0 0x55a2bcc20310 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.516+0000 7f3247e7c740 1 -- 172.21.15.59:0/2922483698 >> 172.21.15.59:0/2922483698 conn(0x55a2bcc0d300 msgr2=0x55a2bcc1a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:44.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.516+0000 7f321effd640 0 client.15870 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:17:44.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.516+0000 7f3247e7c740 1 -- 172.21.15.59:0/2922483698 shutdown_connections 2024-09-10T21:17:44.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.516+0000 7f3247e7c740 1 -- 172.21.15.59:0/2922483698 wait complete. 2024-09-10T21:17:44.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.516+0000 7f3247e7c740 20 client.15870 trim_cache size 0 max 16384 2024-09-10T21:17:44.531 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:17:44.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.516+0000 7f3245aa7640 1 -- 172.21.15.59:0/4185455078 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f32280b5360 msgr2=0x7f32280b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:44.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.516+0000 7f3245aa7640 1 --2- 172.21.15.59:0/4185455078 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f32280b5360 0x7f32280b7820 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55a2bcc0e1e0 tx=0x7f323000b3f0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.516+0000 7f3245aa7640 1 -- 172.21.15.59:0/4185455078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3240104600 msgr2=0x7f3240101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:44.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.516+0000 7f3245aa7640 1 --2- 172.21.15.59:0/4185455078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3240104600 0x7f3240101ed0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f323400c970 tx=0x7f323400ce30 comp rx=0 tx=0).stop 2024-09-10T21:17:44.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.516+0000 7f3245aa7640 1 -- 172.21.15.59:0/4185455078 shutdown_connections 2024-09-10T21:17:44.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.516+0000 7f3245aa7640 1 --2- 172.21.15.59:0/4185455078 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f32280b5360 0x7f32280b7820 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.516+0000 7f3245aa7640 1 --2- 172.21.15.59:0/4185455078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f324010d140 0x7f3240102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.517+0000 7f3245aa7640 1 --2- 172.21.15.59:0/4185455078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3240104600 0x7f3240101ed0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.517+0000 7f3245aa7640 1 --2- 172.21.15.59:0/4185455078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3240103ce0 0x7f3240101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:44.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.517+0000 7f3245aa7640 1 -- 172.21.15.59:0/4185455078 >> 172.21.15.59:0/4185455078 conn(0x7f32400fd700 msgr2=0x7f32400fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:44.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.517+0000 7f3245aa7640 1 -- 172.21.15.59:0/4185455078 shutdown_connections 2024-09-10T21:17:44.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:44.517+0000 7f3245aa7640 1 -- 172.21.15.59:0/4185455078 wait complete. 2024-09-10T21:17:45.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:45 smithi192 ceph-mon[35363]: pgmap v414: 97 pgs: 97 active+clean; 1.6 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:45.369 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:45 smithi059 ceph-mon[30888]: pgmap v414: 97 pgs: 97 active+clean; 1.6 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:45.402 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:17:45.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:45 smithi154 ceph-mon[35041]: pgmap v414: 97 pgs: 97 active+clean; 1.6 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:45.664 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:17:46.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.188+0000 7f6da3ef1640 1 -- 172.21.15.59:0/2834940412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c075f40 msgr2=0x7f6d9c10ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:46.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.188+0000 7f6da3ef1640 1 --2- 172.21.15.59:0/2834940412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c075f40 0x7f6d9c10ee10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009900 tx=0x7f6d8c02a410 comp rx=0 tx=0).stop 2024-09-10T21:17:46.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.189+0000 7f6da3ef1640 1 -- 172.21.15.59:0/2834940412 shutdown_connections 2024-09-10T21:17:46.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.189+0000 7f6da3ef1640 1 --2- 172.21.15.59:0/2834940412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d9c10f3e0 0x7f6d9c1117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.189+0000 7f6da3ef1640 1 --2- 172.21.15.59:0/2834940412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c075f40 0x7f6d9c10ee10 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.189+0000 7f6da3ef1640 1 --2- 172.21.15.59:0/2834940412 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d9c075540 0x7f6d9c075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.189+0000 7f6da3ef1640 1 -- 172.21.15.59:0/2834940412 >> 172.21.15.59:0/2834940412 conn(0x7f6d9c0fe830 msgr2=0x7f6d9c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:46.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.189+0000 7f6da3ef1640 1 -- 172.21.15.59:0/2834940412 shutdown_connections 2024-09-10T21:17:46.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.189+0000 7f6da3ef1640 1 -- 172.21.15.59:0/2834940412 wait complete. 2024-09-10T21:17:46.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.189+0000 7f6da3ef1640 1 Processor -- start 2024-09-10T21:17:46.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.189+0000 7f6da3ef1640 1 -- start start 2024-09-10T21:17:46.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.190+0000 7f6da3ef1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d9c075540 0x7f6d9c19b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:46.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.190+0000 7f6da3ef1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d9c075f40 0x7f6d9c19baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:46.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.190+0000 7f6da3ef1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c10f3e0 0x7f6d9c1a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:46.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.190+0000 7f6da3ef1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c114f80 con 0x7f6d9c10f3e0 2024-09-10T21:17:46.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.190+0000 7f6da3ef1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c114e00 con 0x7f6d9c075540 2024-09-10T21:17:46.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.190+0000 7f6da3ef1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c115100 con 0x7f6d9c075f40 2024-09-10T21:17:46.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.190+0000 7f6da248e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c10f3e0 0x7f6d9c1a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:46.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.190+0000 7f6da248e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c10f3e0 0x7f6d9c1a0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45426/0 (socket says 172.21.15.59:45426) 2024-09-10T21:17:46.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.190+0000 7f6da248e640 1 -- 172.21.15.59:0/694270925 learned_addr learned my addr 172.21.15.59:0/694270925 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:46.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.190+0000 7f6da1c8d640 1 --2- 172.21.15.59:0/694270925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d9c075540 0x7f6d9c19b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:46.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.190+0000 7f6da148c640 1 --2- 172.21.15.59:0/694270925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d9c075f40 0x7f6d9c19baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:46.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.190+0000 7f6da248e640 1 -- 172.21.15.59:0/694270925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d9c075f40 msgr2=0x7f6d9c19baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:46.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.190+0000 7f6da248e640 1 --2- 172.21.15.59:0/694270925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d9c075f40 0x7f6d9c19baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.190+0000 7f6da248e640 1 -- 172.21.15.59:0/694270925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d9c075540 msgr2=0x7f6d9c19b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:46.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.190+0000 7f6da248e640 1 --2- 172.21.15.59:0/694270925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d9c075540 0x7f6d9c19b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.190+0000 7f6da248e640 1 -- 172.21.15.59:0/694270925 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d9c1a1660 con 0x7f6d9c10f3e0 2024-09-10T21:17:46.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.190+0000 7f6da148c640 1 --2- 172.21.15.59:0/694270925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d9c075f40 0x7f6d9c19baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:46.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.190+0000 7f6da248e640 1 --2- 172.21.15.59:0/694270925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c10f3e0 0x7f6d9c1a0e90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400dac0 tx=0x7f6d9400df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:46.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.191+0000 7f6d92ffd640 1 -- 172.21.15.59:0/694270925 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94017070 con 0x7f6d9c10f3e0 2024-09-10T21:17:46.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.191+0000 7f6d92ffd640 1 -- 172.21.15.59:0/694270925 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d9400be30 con 0x7f6d9c10f3e0 2024-09-10T21:17:46.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.191+0000 7f6da3ef1640 1 -- 172.21.15.59:0/694270925 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d9c1a1950 con 0x7f6d9c10f3e0 2024-09-10T21:17:46.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.191+0000 7f6d92ffd640 1 -- 172.21.15.59:0/694270925 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94010460 con 0x7f6d9c10f3e0 2024-09-10T21:17:46.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.191+0000 7f6da3ef1640 1 -- 172.21.15.59:0/694270925 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d9c1a8010 con 0x7f6d9c10f3e0 2024-09-10T21:17:46.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.193+0000 7f6d92ffd640 1 -- 172.21.15.59:0/694270925 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f6d940040b0 con 0x7f6d9c10f3e0 2024-09-10T21:17:46.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.193+0000 7f6da62c6740 1 Processor -- start 2024-09-10T21:17:46.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.193+0000 7f6da62c6740 1 -- start start 2024-09-10T21:17:46.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6da62c6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99a994d0 0x55dc99a998b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:46.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6da62c6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 0x55dc99aa5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:46.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6da62c6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99aa5d80 0x55dc99aa8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:46.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6da62c6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55dc99a0fea0 con 0x55dc99a99df0 2024-09-10T21:17:46.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6da62c6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dc999ff2d0 con 0x55dc99a994d0 2024-09-10T21:17:46.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6da62c6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55dc99a030e0 con 0x55dc99aa5d80 2024-09-10T21:17:46.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6da1c8d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 0x55dc99aa5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:46.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6da1c8d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 0x55dc99aa5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45436/0 (socket says 172.21.15.59:45436) 2024-09-10T21:17:46.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6da1c8d640 1 -- 172.21.15.59:0/3367746275 learned_addr learned my addr 172.21.15.59:0/3367746275 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:46.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6da148c640 1 --2- 172.21.15.59:0/3367746275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99a994d0 0x55dc99a998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:46.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6da148c640 1 --2- 172.21.15.59:0/3367746275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99aa5d80 0x55dc99aa8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:46.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6da1c8d640 1 -- 172.21.15.59:0/3367746275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99aa5d80 msgr2=0x55dc99aa8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:46.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6da1c8d640 1 --2- 172.21.15.59:0/3367746275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99aa5d80 0x55dc99aa8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6da1c8d640 1 -- 172.21.15.59:0/3367746275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99a994d0 msgr2=0x55dc99a998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:46.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6da1c8d640 1 --2- 172.21.15.59:0/3367746275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99a994d0 0x55dc99a998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6da1c8d640 1 -- 172.21.15.59:0/3367746275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc9975d650 con 0x55dc99a99df0 2024-09-10T21:17:46.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6d92ffd640 1 --2- 172.21.15.59:0/694270925 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6d880b5360 0x7f6d880b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:46.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6da148c640 1 --2- 172.21.15.59:0/694270925 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6d880b5360 0x7f6d880b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:46.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6d92ffd640 1 -- 172.21.15.59:0/694270925 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6d940e5820 con 0x7f6d9c10f3e0 2024-09-10T21:17:46.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.194+0000 7f6da1c8d640 1 --2- 172.21.15.59:0/3367746275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 0x55dc99aa5840 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800bcd0 tx=0x7f6d980107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c448073a9888603c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:46.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.195+0000 7f6d87fff640 1 -- 172.21.15.59:0/3367746275 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98005220 con 0x55dc99a99df0 2024-09-10T21:17:46.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.195+0000 7f6d87fff640 1 -- 172.21.15.59:0/3367746275 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d98004c50 con 0x55dc99a99df0 2024-09-10T21:17:46.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.195+0000 7f6d87fff640 1 -- 172.21.15.59:0/3367746275 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d980116a0 con 0x55dc99a99df0 2024-09-10T21:17:46.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.195+0000 7f6da62c6740 1 -- 172.21.15.59:0/3367746275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 msgr2=0x55dc99aa5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:46.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.195+0000 7f6da148c640 1 --2- 172.21.15.59:0/694270925 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6d880b5360 0x7f6d880b7820 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0057c0 tx=0x7f6d8c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:46.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.195+0000 7f6da62c6740 1 --2- 172.21.15.59:0/3367746275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 0x55dc99aa5840 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800bcd0 tx=0x7f6d980107a0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.195+0000 7f6da62c6740 1 -- 172.21.15.59:0/3367746275 shutdown_connections 2024-09-10T21:17:46.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.195+0000 7f6da62c6740 1 --2- 172.21.15.59:0/3367746275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99aa5d80 0x55dc99aa8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.195+0000 7f6da62c6740 1 --2- 172.21.15.59:0/3367746275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 0x55dc99aa5840 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.195+0000 7f6da62c6740 1 --2- 172.21.15.59:0/3367746275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99a994d0 0x55dc99a998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.195+0000 7f6da62c6740 1 -- 172.21.15.59:0/3367746275 >> 172.21.15.59:0/3367746275 conn(0x55dc99a97300 msgr2=0x55dc99a984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:46.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.196+0000 7f6da62c6740 1 -- 172.21.15.59:0/3367746275 shutdown_connections 2024-09-10T21:17:46.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.196+0000 7f6da62c6740 1 -- 172.21.15.59:0/3367746275 wait complete. 2024-09-10T21:17:46.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.196+0000 7f6da62c6740 1 -- start start 2024-09-10T21:17:46.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.196+0000 7f6da62c6740 1 Processor -- start 2024-09-10T21:17:46.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.196+0000 7f6da62c6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99a994d0 0x55dc99aa5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:46.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6da62c6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 0x55dc99aa2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:46.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6da62c6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99aa5d80 0x55dc99aa30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:46.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6da62c6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55dc99860700 con 0x55dc99a99df0 2024-09-10T21:17:46.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6da62c6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dc9999a160 con 0x55dc99aa5d80 2024-09-10T21:17:46.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6da62c6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55dc99aa8a00 con 0x55dc99a994d0 2024-09-10T21:17:46.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6da62c6740 10 client.0 _ll_register_callbacks cb 0x55dc999b39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:46.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6da148c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 0x55dc99aa2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:46.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6da148c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 0x55dc99aa2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45446/0 (socket says 172.21.15.59:45446) 2024-09-10T21:17:46.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6da148c640 1 -- 172.21.15.59:0/2464571199 learned_addr learned my addr 172.21.15.59:0/2464571199 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:46.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6da1c8d640 1 --2- 172.21.15.59:0/2464571199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99a994d0 0x55dc99aa5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:46.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6da248e640 1 --2- 172.21.15.59:0/2464571199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99aa5d80 0x55dc99aa30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:46.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6da148c640 1 -- 172.21.15.59:0/2464571199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99a994d0 msgr2=0x55dc99aa5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6da148c640 1 --2- 172.21.15.59:0/2464571199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99a994d0 0x55dc99aa5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6da148c640 1 -- 172.21.15.59:0/2464571199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99aa5d80 msgr2=0x55dc99aa30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6da148c640 1 --2- 172.21.15.59:0/2464571199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99aa5d80 0x55dc99aa30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6da148c640 1 -- 172.21.15.59:0/2464571199 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc999c7c90 con 0x55dc99a99df0 2024-09-10T21:17:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6da248e640 1 --2- 172.21.15.59:0/2464571199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99aa5d80 0x55dc99aa30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6da148c640 1 --2- 172.21.15.59:0/2464571199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 0x55dc99aa2ad0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c033000 tx=0x7f6d8c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11440153ca56b1a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6d857fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6d857fa640 1 -- 172.21.15.59:0/2464571199 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c044070 con 0x55dc99a99df0 2024-09-10T21:17:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6d857fa640 1 -- 172.21.15.59:0/2464571199 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6d8c004040 con 0x55dc99a99df0 2024-09-10T21:17:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.197+0000 7f6da62c6740 1 -- 172.21.15.59:0/2464571199 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d98004c50 con 0x55dc99a99df0 2024-09-10T21:17:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.198+0000 7f6d857fa640 1 -- 172.21.15.59:0/2464571199 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6d8c035040 con 0x55dc99a99df0 2024-09-10T21:17:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.198+0000 7f6da62c6740 10 client.15882 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:46.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.198+0000 7f6da62c6740 1 -- 172.21.15.59:0/2464571199 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dc99ab4350 con 0x55dc99a99df0 2024-09-10T21:17:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.198+0000 7f6d857fa640 1 -- 172.21.15.59:0/2464571199 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d98004c50 con 0x55dc99a99df0 2024-09-10T21:17:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.198+0000 7f6d857fa640 1 -- 172.21.15.59:0/2464571199 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6d8c04b470 con 0x55dc99a99df0 2024-09-10T21:17:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.198+0000 7f6da62c6740 10 client.15882 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.198+0000 7f6da62c6740 10 client.15882 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:17:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.198+0000 7f6da62c6740 20 client.15882 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.198+0000 7f6da62c6740 1 --2- 172.21.15.59:0/2464571199 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55dc99ab5900 0x55dc99ab7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.198+0000 7f6da62c6740 4 client.15882 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:17:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.198+0000 7f6da62c6740 1 -- 172.21.15.59:0/2464571199 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc99a11df0 con 0x55dc99ab5900 2024-09-10T21:17:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.198+0000 7f6da1c8d640 1 --2- 172.21.15.59:0/2464571199 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55dc99ab5900 0x55dc99ab7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.199+0000 7f6d857fa640 10 client.15882 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:17:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.199+0000 7f6da1c8d640 1 --2- 172.21.15.59:0/2464571199 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55dc99ab5900 0x55dc99ab7d80 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4a6ba5b718ebded5 server_cookie=4f2027eb53ba6456 in_seq=0 out_seq=0 2024-09-10T21:17:46.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.200+0000 7f6d857fa640 1 -- 172.21.15.59:0/2464571199 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dc99a11df0 con 0x55dc99ab5900 2024-09-10T21:17:46.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.200+0000 7f6d857fa640 10 client.15882 handle_command_reply: tid=0 2024-09-10T21:17:46.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.200+0000 7f6da62c6740 1 client.15882 shutdown 2024-09-10T21:17:46.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.200+0000 7f6da62c6740 1 -- 172.21.15.59:0/2464571199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 msgr2=0x55dc99aa2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:46.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.200+0000 7f6da62c6740 1 --2- 172.21.15.59:0/2464571199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 0x55dc99aa2ad0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c033000 tx=0x7f6d8c02a410 comp rx=0 tx=0).stop 2024-09-10T21:17:46.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.200+0000 7f6da62c6740 1 -- 172.21.15.59:0/2464571199 shutdown_connections 2024-09-10T21:17:46.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.200+0000 7f6da62c6740 1 --2- 172.21.15.59:0/2464571199 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55dc99ab5900 0x55dc99ab7d80 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.200+0000 7f6da62c6740 1 --2- 172.21.15.59:0/2464571199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99aa5d80 0x55dc99aa30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.200+0000 7f6da62c6740 1 --2- 172.21.15.59:0/2464571199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 0x55dc99aa2ad0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.200+0000 7f6da62c6740 1 --2- 172.21.15.59:0/2464571199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99a994d0 0x55dc99aa5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.200+0000 7f6d857fa640 0 client.15882 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:17:46.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.200+0000 7f6da62c6740 1 -- 172.21.15.59:0/2464571199 >> 172.21.15.59:0/2464571199 conn(0x55dc99a97300 msgr2=0x55dc99a9cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:46.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.200+0000 7f6da62c6740 1 -- 172.21.15.59:0/2464571199 shutdown_connections 2024-09-10T21:17:46.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.200+0000 7f6da62c6740 1 -- 172.21.15.59:0/2464571199 wait complete. 2024-09-10T21:17:46.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.200+0000 7f6da62c6740 20 client.15882 trim_cache size 0 max 16384 2024-09-10T21:17:46.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.213+0000 7f6da62c6740 1 Processor -- start 2024-09-10T21:17:46.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.214+0000 7f6da62c6740 1 -- start start 2024-09-10T21:17:46.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.214+0000 7f6da62c6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99a97300 0x55dc99ab1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:46.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.214+0000 7f6da62c6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99a994d0 0x55dc99a9dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:46.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.214+0000 7f6da62c6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 0x55dc99aa7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:46.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.214+0000 7f6da62c6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c1b05a0 con 0x55dc99a99df0 2024-09-10T21:17:46.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.214+0000 7f6da62c6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c1b20e0 con 0x55dc99a994d0 2024-09-10T21:17:46.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.214+0000 7f6da62c6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c1b0c70 con 0x55dc99a97300 2024-09-10T21:17:46.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.214+0000 7f6da248e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 0x55dc99aa7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:46.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.214+0000 7f6da248e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 0x55dc99aa7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45462/0 (socket says 172.21.15.59:45462) 2024-09-10T21:17:46.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.214+0000 7f6da248e640 1 -- 172.21.15.59:0/819874271 learned_addr learned my addr 172.21.15.59:0/819874271 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:46.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.214+0000 7f6da148c640 1 --2- 172.21.15.59:0/819874271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99a994d0 0x55dc99a9dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:46.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.214+0000 7f6da1c8d640 1 --2- 172.21.15.59:0/819874271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99a97300 0x55dc99ab1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:46.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.214+0000 7f6da248e640 1 -- 172.21.15.59:0/819874271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99a97300 msgr2=0x55dc99ab1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:46.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.214+0000 7f6da248e640 1 --2- 172.21.15.59:0/819874271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99a97300 0x55dc99ab1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.214+0000 7f6da248e640 1 -- 172.21.15.59:0/819874271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99a994d0 msgr2=0x55dc99a9dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:46.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.214+0000 7f6da248e640 1 --2- 172.21.15.59:0/819874271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99a994d0 0x55dc99a9dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.214+0000 7f6da248e640 1 -- 172.21.15.59:0/819874271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc99aa2880 con 0x55dc99a99df0 2024-09-10T21:17:46.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.214+0000 7f6da148c640 1 --2- 172.21.15.59:0/819874271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99a994d0 0x55dc99a9dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:46.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.214+0000 7f6da248e640 1 --2- 172.21.15.59:0/819874271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 0x55dc99aa7170 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6d940e32f0 tx=0x7f6d94009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809ab234d5eab022 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:46.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.215+0000 7f6d877fe640 1 -- 172.21.15.59:0/819874271 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94020040 con 0x55dc99a99df0 2024-09-10T21:17:46.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.215+0000 7f6d877fe640 1 -- 172.21.15.59:0/819874271 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d940b0a90 con 0x55dc99a99df0 2024-09-10T21:17:46.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.215+0000 7f6d877fe640 1 -- 172.21.15.59:0/819874271 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d940aaee0 con 0x55dc99a99df0 2024-09-10T21:17:46.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.215+0000 7f6da62c6740 1 -- 172.21.15.59:0/819874271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 msgr2=0x55dc99aa7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:46.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.215+0000 7f6da62c6740 1 --2- 172.21.15.59:0/819874271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 0x55dc99aa7170 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6d940e32f0 tx=0x7f6d94009520 comp rx=0 tx=0).stop 2024-09-10T21:17:46.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.215+0000 7f6da62c6740 1 -- 172.21.15.59:0/819874271 shutdown_connections 2024-09-10T21:17:46.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.215+0000 7f6da62c6740 1 --2- 172.21.15.59:0/819874271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a99df0 0x55dc99aa7170 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.215+0000 7f6da62c6740 1 --2- 172.21.15.59:0/819874271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99a994d0 0x55dc99a9dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.215+0000 7f6da62c6740 1 --2- 172.21.15.59:0/819874271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99a97300 0x55dc99ab1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.215+0000 7f6da62c6740 1 -- 172.21.15.59:0/819874271 >> 172.21.15.59:0/819874271 conn(0x55dc99a9e470 msgr2=0x55dc99a96420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:46.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.215+0000 7f6da62c6740 1 -- 172.21.15.59:0/819874271 shutdown_connections 2024-09-10T21:17:46.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.215+0000 7f6da62c6740 1 -- 172.21.15.59:0/819874271 wait complete. 2024-09-10T21:17:46.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.216+0000 7f6da62c6740 1 -- start start 2024-09-10T21:17:46.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.216+0000 7f6da62c6740 1 Processor -- start 2024-09-10T21:17:46.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.216+0000 7f6da62c6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99a97300 0x55dc99aae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:46.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.216+0000 7f6da62c6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a994d0 0x55dc99aa8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:46.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.216+0000 7f6da62c6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99a99df0 0x55dc99aa9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:46.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.216+0000 7f6da62c6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c1b1a10 con 0x55dc99a994d0 2024-09-10T21:17:46.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.216+0000 7f6da62c6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c1b1340 con 0x55dc99a97300 2024-09-10T21:17:46.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.216+0000 7f6da62c6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c1ae580 con 0x55dc99a99df0 2024-09-10T21:17:46.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.216+0000 7f6da62c6740 10 client.0 _ll_register_callbacks cb 0x7f6d8c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:46.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.216+0000 7f6da148c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a994d0 0x55dc99aa8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:46.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.216+0000 7f6da148c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a994d0 0x55dc99aa8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45466/0 (socket says 172.21.15.59:45466) 2024-09-10T21:17:46.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.216+0000 7f6da148c640 1 -- 172.21.15.59:0/2024578152 learned_addr learned my addr 172.21.15.59:0/2024578152 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:46.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.217+0000 7f6da248e640 1 --2- 172.21.15.59:0/2024578152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99a99df0 0x55dc99aa9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:46.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.217+0000 7f6da1c8d640 1 --2- 172.21.15.59:0/2024578152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99a97300 0x55dc99aae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:46.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.217+0000 7f6da148c640 1 -- 172.21.15.59:0/2024578152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99a99df0 msgr2=0x55dc99aa9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:46.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.217+0000 7f6da148c640 1 --2- 172.21.15.59:0/2024578152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99a99df0 0x55dc99aa9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.217+0000 7f6da148c640 1 -- 172.21.15.59:0/2024578152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99a97300 msgr2=0x55dc99aae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:46.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.217+0000 7f6da148c640 1 --2- 172.21.15.59:0/2024578152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99a97300 0x55dc99aae5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.217+0000 7f6da148c640 1 -- 172.21.15.59:0/2024578152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc99b22850 con 0x55dc99a994d0 2024-09-10T21:17:46.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.217+0000 7f6da148c640 1 --2- 172.21.15.59:0/2024578152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a994d0 0x55dc99aa8c50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c000c00 tx=0x7f6d8c032f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b005cbfbd911ac97 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:46.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.217+0000 7f6d857fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:46.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.217+0000 7f6d857fa640 1 -- 172.21.15.59:0/2024578152 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c063020 con 0x55dc99a994d0 2024-09-10T21:17:46.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.217+0000 7f6d857fa640 1 -- 172.21.15.59:0/2024578152 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6d8c004450 con 0x55dc99a994d0 2024-09-10T21:17:46.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.217+0000 7f6da62c6740 1 -- 172.21.15.59:0/2024578152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d940b0a90 con 0x55dc99a994d0 2024-09-10T21:17:46.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.217+0000 7f6d857fa640 1 -- 172.21.15.59:0/2024578152 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6d8c044050 con 0x55dc99a994d0 2024-09-10T21:17:46.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.217+0000 7f6da62c6740 10 client.15888 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:46.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.217+0000 7f6da62c6740 1 -- 172.21.15.59:0/2024578152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dc99b23a60 con 0x55dc99a994d0 2024-09-10T21:17:46.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.218+0000 7f6d857fa640 1 -- 172.21.15.59:0/2024578152 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d940b0a90 con 0x55dc99a994d0 2024-09-10T21:17:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.218+0000 7f6d857fa640 1 -- 172.21.15.59:0/2024578152 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6d8c057620 con 0x55dc99a994d0 2024-09-10T21:17:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.218+0000 7f6da62c6740 10 client.15888 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.218+0000 7f6da62c6740 10 client.15888 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:17:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.218+0000 7f6da62c6740 20 client.15888 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.218+0000 7f6da62c6740 1 --2- 172.21.15.59:0/2024578152 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55dc99aa5d80 0x55dc99b26030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.218+0000 7f6da62c6740 4 client.15888 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:17:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.218+0000 7f6da62c6740 1 -- 172.21.15.59:0/2024578152 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dc99a0d8a0 con 0x55dc99aa5d80 2024-09-10T21:17:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.218+0000 7f6da1c8d640 1 --2- 172.21.15.59:0/2024578152 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55dc99aa5d80 0x55dc99b26030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.218+0000 7f6da1c8d640 1 --2- 172.21.15.59:0/2024578152 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55dc99aa5d80 0x55dc99b26030 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=78124c7e92709b79 server_cookie=3a5931648210bc0 in_seq=0 out_seq=0 2024-09-10T21:17:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.218+0000 7f6d857fa640 10 client.15888 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:17:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.219+0000 7f6d857fa640 1 -- 172.21.15.59:0/2024578152 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dc99a0d8a0 con 0x55dc99aa5d80 2024-09-10T21:17:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.219+0000 7f6d857fa640 10 client.15888 handle_command_reply: tid=0 2024-09-10T21:17:46.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.219+0000 7f6da62c6740 1 client.15888 shutdown 2024-09-10T21:17:46.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.219+0000 7f6da62c6740 1 -- 172.21.15.59:0/2024578152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a994d0 msgr2=0x55dc99aa8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:46.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.219+0000 7f6da62c6740 1 --2- 172.21.15.59:0/2024578152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a994d0 0x55dc99aa8c50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c000c00 tx=0x7f6d8c032f10 comp rx=0 tx=0).stop 2024-09-10T21:17:46.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.219+0000 7f6da62c6740 1 -- 172.21.15.59:0/2024578152 shutdown_connections 2024-09-10T21:17:46.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.219+0000 7f6da62c6740 1 --2- 172.21.15.59:0/2024578152 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55dc99aa5d80 0x55dc99b26030 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.219+0000 7f6da62c6740 1 --2- 172.21.15.59:0/2024578152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dc99a99df0 0x55dc99aa9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.219+0000 7f6da62c6740 1 --2- 172.21.15.59:0/2024578152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dc99a994d0 0x55dc99aa8c50 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.219+0000 7f6da62c6740 1 --2- 172.21.15.59:0/2024578152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dc99a97300 0x55dc99aae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.219+0000 7f6d857fa640 0 client.15888 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:17:46.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.219+0000 7f6da62c6740 1 -- 172.21.15.59:0/2024578152 >> 172.21.15.59:0/2024578152 conn(0x55dc99a9e470 msgr2=0x55dc99aa4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:46.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.219+0000 7f6da62c6740 1 -- 172.21.15.59:0/2024578152 shutdown_connections 2024-09-10T21:17:46.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.219+0000 7f6da62c6740 1 -- 172.21.15.59:0/2024578152 wait complete. 2024-09-10T21:17:46.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.219+0000 7f6da62c6740 20 client.15888 trim_cache size 0 max 16384 2024-09-10T21:17:46.237 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:17:46.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.220+0000 7f6da3ef1640 1 -- 172.21.15.59:0/694270925 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6d880b5360 msgr2=0x7f6d880b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:46.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.220+0000 7f6da3ef1640 1 --2- 172.21.15.59:0/694270925 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6d880b5360 0x7f6d880b7820 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0057c0 tx=0x7f6d8c031400 comp rx=0 tx=0).stop 2024-09-10T21:17:46.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.220+0000 7f6da3ef1640 1 -- 172.21.15.59:0/694270925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c10f3e0 msgr2=0x7f6d9c1a0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:46.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.220+0000 7f6da3ef1640 1 --2- 172.21.15.59:0/694270925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c10f3e0 0x7f6d9c1a0e90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400dac0 tx=0x7f6d9400df80 comp rx=0 tx=0).stop 2024-09-10T21:17:46.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.220+0000 7f6da3ef1640 1 -- 172.21.15.59:0/694270925 shutdown_connections 2024-09-10T21:17:46.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.220+0000 7f6da3ef1640 1 --2- 172.21.15.59:0/694270925 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6d880b5360 0x7f6d880b7820 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.220+0000 7f6da3ef1640 1 --2- 172.21.15.59:0/694270925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c10f3e0 0x7f6d9c1a0e90 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.220+0000 7f6da3ef1640 1 --2- 172.21.15.59:0/694270925 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d9c075f40 0x7f6d9c19baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.220+0000 7f6da3ef1640 1 --2- 172.21.15.59:0/694270925 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d9c075540 0x7f6d9c19b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:46.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.220+0000 7f6da3ef1640 1 -- 172.21.15.59:0/694270925 >> 172.21.15.59:0/694270925 conn(0x7f6d9c0fe830 msgr2=0x7f6d9c0ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:46.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.220+0000 7f6da3ef1640 1 -- 172.21.15.59:0/694270925 shutdown_connections 2024-09-10T21:17:46.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:46.220+0000 7f6da3ef1640 1 -- 172.21.15.59:0/694270925 wait complete. 2024-09-10T21:17:46.998 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:17:47.263 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:17:47.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:47 smithi192 ceph-mon[35363]: pgmap v415: 97 pgs: 97 active+clean; 1.6 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:17:47.384 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:47 smithi059 ceph-mon[30888]: pgmap v415: 97 pgs: 97 active+clean; 1.6 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:17:47.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:47 smithi154 ceph-mon[35041]: pgmap v415: 97 pgs: 97 active+clean; 1.6 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:17:47.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.772+0000 7fcd48fad640 1 -- 172.21.15.59:0/3185482490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd44108020 msgr2=0x7fcd4410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:47.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.772+0000 7fcd48fad640 1 --2- 172.21.15.59:0/3185482490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd44108020 0x7fcd4410e820 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009900 tx=0x7fcd3c02a410 comp rx=0 tx=0).stop 2024-09-10T21:17:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.772+0000 7fcd48fad640 1 -- 172.21.15.59:0/3185482490 shutdown_connections 2024-09-10T21:17:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.772+0000 7fcd48fad640 1 --2- 172.21.15.59:0/3185482490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd44108020 0x7fcd4410e820 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.772+0000 7fcd48fad640 1 --2- 172.21.15.59:0/3185482490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd441076a0 0x7fcd44107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.772+0000 7fcd48fad640 1 --2- 172.21.15.59:0/3185482490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd44101c90 0x7fcd44102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.772+0000 7fcd48fad640 1 -- 172.21.15.59:0/3185482490 >> 172.21.15.59:0/3185482490 conn(0x7fcd440fd700 msgr2=0x7fcd440ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.772+0000 7fcd48fad640 1 -- 172.21.15.59:0/3185482490 shutdown_connections 2024-09-10T21:17:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.772+0000 7fcd48fad640 1 -- 172.21.15.59:0/3185482490 wait complete. 2024-09-10T21:17:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.772+0000 7fcd48fad640 1 Processor -- start 2024-09-10T21:17:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd48fad640 1 -- start start 2024-09-10T21:17:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd48fad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd44101c90 0x7fcd44199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd48fad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd441076a0 0x7fcd441997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd48fad640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd44108020 0x7fcd4419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd48fad640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcd44112de0 con 0x7fcd441076a0 2024-09-10T21:17:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd48fad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd44112c60 con 0x7fcd44101c90 2024-09-10T21:17:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd48fad640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcd44112f60 con 0x7fcd44108020 2024-09-10T21:17:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd41d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd441076a0 0x7fcd441997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd41d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd441076a0 0x7fcd441997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45486/0 (socket says 172.21.15.59:45486) 2024-09-10T21:17:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd41d9b640 1 -- 172.21.15.59:0/65776158 learned_addr learned my addr 172.21.15.59:0/65776158 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd42d9d640 1 --2- 172.21.15.59:0/65776158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd44108020 0x7fcd4419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd4259c640 1 --2- 172.21.15.59:0/65776158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd44101c90 0x7fcd44199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd41d9b640 1 -- 172.21.15.59:0/65776158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd44108020 msgr2=0x7fcd4419eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd41d9b640 1 --2- 172.21.15.59:0/65776158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd44108020 0x7fcd4419eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd41d9b640 1 -- 172.21.15.59:0/65776158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd44101c90 msgr2=0x7fcd44199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd41d9b640 1 --2- 172.21.15.59:0/65776158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd44101c90 0x7fcd44199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd41d9b640 1 -- 172.21.15.59:0/65776158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4419f340 con 0x7fcd441076a0 2024-09-10T21:17:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd42d9d640 1 --2- 172.21.15.59:0/65776158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd44108020 0x7fcd4419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:47.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd4259c640 1 --2- 172.21.15.59:0/65776158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd44101c90 0x7fcd44199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:47.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.773+0000 7fcd41d9b640 1 --2- 172.21.15.59:0/65776158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd441076a0 0x7fcd441997d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800cce0 tx=0x7fcd3800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:47.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.774+0000 7fcd337fe640 1 -- 172.21.15.59:0/65776158 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd38004b20 con 0x7fcd441076a0 2024-09-10T21:17:47.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.774+0000 7fcd337fe640 1 -- 172.21.15.59:0/65776158 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd38004cc0 con 0x7fcd441076a0 2024-09-10T21:17:47.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.774+0000 7fcd48fad640 1 -- 172.21.15.59:0/65776158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4419f630 con 0x7fcd441076a0 2024-09-10T21:17:47.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.774+0000 7fcd337fe640 1 -- 172.21.15.59:0/65776158 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3800f7c0 con 0x7fcd441076a0 2024-09-10T21:17:47.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.774+0000 7fcd48fad640 1 -- 172.21.15.59:0/65776158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd441a5cf0 con 0x7fcd441076a0 2024-09-10T21:17:47.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.776+0000 7fcd4b382740 1 Processor -- start 2024-09-10T21:17:47.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.776+0000 7fcd4b382740 1 -- start start 2024-09-10T21:17:47.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.777+0000 7fcd337fe640 1 -- 172.21.15.59:0/65776158 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fcd38005560 con 0x7fcd441076a0 2024-09-10T21:17:47.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.777+0000 7fcd4b382740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 0x56124726c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:47.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.777+0000 7fcd4b382740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726cdf0 0x561247278840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:47.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.777+0000 7fcd4b382740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 0x56124727b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:47.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.777+0000 7fcd4b382740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5612471e2ea0 con 0x56124726c4d0 2024-09-10T21:17:47.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.777+0000 7fcd4b382740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5612471d22d0 con 0x561247278d80 2024-09-10T21:17:47.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.777+0000 7fcd4b382740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5612471d60e0 con 0x56124726cdf0 2024-09-10T21:17:47.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.777+0000 7fcd42d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 0x56124726c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:47.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.777+0000 7fcd42d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 0x56124726c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45496/0 (socket says 172.21.15.59:45496) 2024-09-10T21:17:47.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.777+0000 7fcd42d9d640 1 -- 172.21.15.59:0/1473892332 learned_addr learned my addr 172.21.15.59:0/1473892332 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:47.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.777+0000 7fcd41d9b640 1 --2- 172.21.15.59:0/1473892332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 0x56124727b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:47.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.777+0000 7fcd4259c640 1 --2- 172.21.15.59:0/1473892332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726cdf0 0x561247278840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:47.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.777+0000 7fcd42d9d640 1 -- 172.21.15.59:0/1473892332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726cdf0 msgr2=0x561247278840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:47.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.777+0000 7fcd42d9d640 1 --2- 172.21.15.59:0/1473892332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726cdf0 0x561247278840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.777+0000 7fcd42d9d640 1 -- 172.21.15.59:0/1473892332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 msgr2=0x56124727b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:47.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.777+0000 7fcd42d9d640 1 --2- 172.21.15.59:0/1473892332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 0x56124727b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.777+0000 7fcd42d9d640 1 -- 172.21.15.59:0/1473892332 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561246f30650 con 0x56124726c4d0 2024-09-10T21:17:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.778+0000 7fcd42d9d640 1 --2- 172.21.15.59:0/1473892332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 0x56124726c8b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c031440 tx=0x7fcd3c032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff7c556279dd524 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.778+0000 7fcd337fe640 1 --2- 172.21.15.59:0/65776158 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcd2c0b5360 0x7fcd2c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.778+0000 7fcd30ff9640 1 -- 172.21.15.59:0/1473892332 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c03f070 con 0x56124726c4d0 2024-09-10T21:17:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.778+0000 7fcd30ff9640 1 -- 172.21.15.59:0/1473892332 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd3c0316a0 con 0x56124726c4d0 2024-09-10T21:17:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.778+0000 7fcd30ff9640 1 -- 172.21.15.59:0/1473892332 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c035070 con 0x56124726c4d0 2024-09-10T21:17:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.778+0000 7fcd4259c640 1 --2- 172.21.15.59:0/65776158 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcd2c0b5360 0x7fcd2c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.778+0000 7fcd337fe640 1 -- 172.21.15.59:0/65776158 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcd380e5cb0 con 0x7fcd441076a0 2024-09-10T21:17:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.779+0000 7fcd4b382740 1 -- 172.21.15.59:0/1473892332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 msgr2=0x56124726c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.779+0000 7fcd4259c640 1 --2- 172.21.15.59:0/65776158 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcd2c0b5360 0x7fcd2c0b7820 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcd34005fd0 tx=0x7fcd340094a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.779+0000 7fcd4b382740 1 --2- 172.21.15.59:0/1473892332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 0x56124726c8b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c031440 tx=0x7fcd3c032c80 comp rx=0 tx=0).stop 2024-09-10T21:17:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.779+0000 7fcd4b382740 1 -- 172.21.15.59:0/1473892332 shutdown_connections 2024-09-10T21:17:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.779+0000 7fcd4b382740 1 --2- 172.21.15.59:0/1473892332 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 0x56124727b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.779+0000 7fcd4b382740 1 --2- 172.21.15.59:0/1473892332 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726cdf0 0x561247278840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.779+0000 7fcd4b382740 1 --2- 172.21.15.59:0/1473892332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 0x56124726c8b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.779+0000 7fcd4b382740 1 -- 172.21.15.59:0/1473892332 >> 172.21.15.59:0/1473892332 conn(0x56124726a300 msgr2=0x56124726b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:47.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.779+0000 7fcd4b382740 1 -- 172.21.15.59:0/1473892332 shutdown_connections 2024-09-10T21:17:47.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.779+0000 7fcd4b382740 1 -- 172.21.15.59:0/1473892332 wait complete. 2024-09-10T21:17:47.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.779+0000 7fcd4b382740 1 -- start start 2024-09-10T21:17:47.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.779+0000 7fcd4b382740 1 Processor -- start 2024-09-10T21:17:47.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.779+0000 7fcd4b382740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 0x561247278580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:47.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd4b382740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726cdf0 0x5612472759d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:47.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd4b382740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 0x561247275f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:47.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd4b382740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561247033700 con 0x56124726c4d0 2024-09-10T21:17:47.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd4b382740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56124716d160 con 0x561247278d80 2024-09-10T21:17:47.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd4b382740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56124727fdb0 con 0x56124726cdf0 2024-09-10T21:17:47.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd4b382740 10 client.0 _ll_register_callbacks cb 0x5612471869e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:47.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd4259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 0x561247278580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:47.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd4259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 0x561247278580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45504/0 (socket says 172.21.15.59:45504) 2024-09-10T21:17:47.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd4259c640 1 -- 172.21.15.59:0/3915237164 learned_addr learned my addr 172.21.15.59:0/3915237164 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:47.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd41d9b640 1 --2- 172.21.15.59:0/3915237164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726cdf0 0x5612472759d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:47.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd42d9d640 1 --2- 172.21.15.59:0/3915237164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 0x561247275f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:47.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd4259c640 1 -- 172.21.15.59:0/3915237164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726cdf0 msgr2=0x5612472759d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:47.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd4259c640 1 --2- 172.21.15.59:0/3915237164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726cdf0 0x5612472759d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd4259c640 1 -- 172.21.15.59:0/3915237164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 msgr2=0x561247275f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:47.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd4259c640 1 --2- 172.21.15.59:0/3915237164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 0x561247275f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd4259c640 1 -- 172.21.15.59:0/3915237164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56124719ac90 con 0x56124726c4d0 2024-09-10T21:17:47.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd4259c640 1 --2- 172.21.15.59:0/3915237164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 0x561247278580 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fcd340126d0 tx=0x7fcd340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85046d22372245d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:47.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:47.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd29ffb640 1 -- 172.21.15.59:0/3915237164 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34005220 con 0x56124726c4d0 2024-09-10T21:17:47.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd29ffb640 1 -- 172.21.15.59:0/3915237164 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcd340053c0 con 0x56124726c4d0 2024-09-10T21:17:47.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.780+0000 7fcd4b382740 1 -- 172.21.15.59:0/3915237164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd3c0316a0 con 0x56124726c4d0 2024-09-10T21:17:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.781+0000 7fcd29ffb640 1 -- 172.21.15.59:0/3915237164 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcd34005600 con 0x56124726c4d0 2024-09-10T21:17:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.781+0000 7fcd4b382740 10 client.15900 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.781+0000 7fcd4b382740 1 -- 172.21.15.59:0/3915237164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56124728b6b0 con 0x56124726c4d0 2024-09-10T21:17:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.781+0000 7fcd29ffb640 1 -- 172.21.15.59:0/3915237164 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd3c0316a0 con 0x56124726c4d0 2024-09-10T21:17:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.781+0000 7fcd29ffb640 1 -- 172.21.15.59:0/3915237164 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcd3400f040 con 0x56124726c4d0 2024-09-10T21:17:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.781+0000 7fcd4b382740 10 client.15900 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.781+0000 7fcd4b382740 10 client.15900 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:17:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.781+0000 7fcd4b382740 20 client.15900 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.781+0000 7fcd4b382740 1 --2- 172.21.15.59:0/3915237164 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56124728cb60 0x56124728efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.781+0000 7fcd4b382740 4 client.15900 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:17:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.781+0000 7fcd4b382740 1 -- 172.21.15.59:0/3915237164 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612471e4df0 con 0x56124728cb60 2024-09-10T21:17:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.781+0000 7fcd41d9b640 1 --2- 172.21.15.59:0/3915237164 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56124728cb60 0x56124728efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.782+0000 7fcd41d9b640 1 --2- 172.21.15.59:0/3915237164 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56124728cb60 0x56124728efa0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e03184b6a53d785b server_cookie=41c341a7ed0afaf8 in_seq=0 out_seq=0 2024-09-10T21:17:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.782+0000 7fcd29ffb640 10 client.15900 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:17:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.782+0000 7fcd29ffb640 1 -- 172.21.15.59:0/3915237164 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5612471e4df0 con 0x56124728cb60 2024-09-10T21:17:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.782+0000 7fcd29ffb640 10 client.15900 handle_command_reply: tid=0 2024-09-10T21:17:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.782+0000 7fcd4b382740 1 client.15900 shutdown 2024-09-10T21:17:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.783+0000 7fcd4b382740 1 -- 172.21.15.59:0/3915237164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 msgr2=0x561247278580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.783+0000 7fcd4b382740 1 --2- 172.21.15.59:0/3915237164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 0x561247278580 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fcd340126d0 tx=0x7fcd340046c0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.783+0000 7fcd4b382740 1 -- 172.21.15.59:0/3915237164 shutdown_connections 2024-09-10T21:17:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.783+0000 7fcd4b382740 1 --2- 172.21.15.59:0/3915237164 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56124728cb60 0x56124728efa0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.783+0000 7fcd4b382740 1 --2- 172.21.15.59:0/3915237164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 0x561247275f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.783+0000 7fcd4b382740 1 --2- 172.21.15.59:0/3915237164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726cdf0 0x5612472759d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.783+0000 7fcd4b382740 1 --2- 172.21.15.59:0/3915237164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 0x561247278580 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.783+0000 7fcd4b382740 1 -- 172.21.15.59:0/3915237164 >> 172.21.15.59:0/3915237164 conn(0x56124726a300 msgr2=0x56124726fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.783+0000 7fcd29ffb640 0 client.15900 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:17:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.783+0000 7fcd4b382740 1 -- 172.21.15.59:0/3915237164 shutdown_connections 2024-09-10T21:17:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.783+0000 7fcd4b382740 1 -- 172.21.15.59:0/3915237164 wait complete. 2024-09-10T21:17:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.783+0000 7fcd4b382740 20 client.15900 trim_cache size 0 max 16384 2024-09-10T21:17:47.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.796+0000 7fcd4b382740 1 Processor -- start 2024-09-10T21:17:47.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.796+0000 7fcd4b382740 1 -- start start 2024-09-10T21:17:47.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.797+0000 7fcd4b382740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 0x561247275e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:47.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.797+0000 7fcd4b382740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726cdf0 0x561247272be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:47.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.797+0000 7fcd4b382740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 0x561247273120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:47.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.797+0000 7fcd4b382740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcd441ac050 con 0x56124726c4d0 2024-09-10T21:17:47.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.797+0000 7fcd4b382740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd441adb90 con 0x561247278d80 2024-09-10T21:17:47.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.797+0000 7fcd4b382740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcd441ac720 con 0x56124726cdf0 2024-09-10T21:17:47.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.797+0000 7fcd4259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 0x561247275e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:47.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.797+0000 7fcd4259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 0x561247275e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45512/0 (socket says 172.21.15.59:45512) 2024-09-10T21:17:47.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.797+0000 7fcd4259c640 1 -- 172.21.15.59:0/1469958984 learned_addr learned my addr 172.21.15.59:0/1469958984 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:47.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.797+0000 7fcd42d9d640 1 --2- 172.21.15.59:0/1469958984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 0x561247273120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.797+0000 7fcd41d9b640 1 --2- 172.21.15.59:0/1469958984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726cdf0 0x561247272be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.797+0000 7fcd4259c640 1 -- 172.21.15.59:0/1469958984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726cdf0 msgr2=0x561247272be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.797+0000 7fcd4259c640 1 --2- 172.21.15.59:0/1469958984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726cdf0 0x561247272be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.797+0000 7fcd4259c640 1 -- 172.21.15.59:0/1469958984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 msgr2=0x561247273120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.797+0000 7fcd4259c640 1 --2- 172.21.15.59:0/1469958984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 0x561247273120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.797+0000 7fcd4259c640 1 -- 172.21.15.59:0/1469958984 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56124726ad80 con 0x56124726c4d0 2024-09-10T21:17:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.797+0000 7fcd41d9b640 1 --2- 172.21.15.59:0/1469958984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726cdf0 0x561247272be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.797+0000 7fcd4259c640 1 --2- 172.21.15.59:0/1469958984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 0x561247275e90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fcd3401fca0 tx=0x7fcd34011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76684bb998e791d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.798+0000 7fcd2bfff640 1 -- 172.21.15.59:0/1469958984 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3401f6f0 con 0x56124726c4d0 2024-09-10T21:17:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.798+0000 7fcd2bfff640 1 -- 172.21.15.59:0/1469958984 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd3401f890 con 0x56124726c4d0 2024-09-10T21:17:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.798+0000 7fcd2bfff640 1 -- 172.21.15.59:0/1469958984 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34027660 con 0x56124726c4d0 2024-09-10T21:17:47.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.798+0000 7fcd4b382740 1 -- 172.21.15.59:0/1469958984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 msgr2=0x561247275e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.798+0000 7fcd4b382740 1 --2- 172.21.15.59:0/1469958984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 0x561247275e90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fcd3401fca0 tx=0x7fcd34011cb0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.798+0000 7fcd4b382740 1 -- 172.21.15.59:0/1469958984 shutdown_connections 2024-09-10T21:17:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.798+0000 7fcd4b382740 1 --2- 172.21.15.59:0/1469958984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 0x561247273120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.798+0000 7fcd4b382740 1 --2- 172.21.15.59:0/1469958984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726cdf0 0x561247272be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.798+0000 7fcd4b382740 1 --2- 172.21.15.59:0/1469958984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726c4d0 0x561247275e90 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.798+0000 7fcd4b382740 1 -- 172.21.15.59:0/1469958984 >> 172.21.15.59:0/1469958984 conn(0x56124726a300 msgr2=0x561247275780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.798+0000 7fcd4b382740 1 -- 172.21.15.59:0/1469958984 shutdown_connections 2024-09-10T21:17:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.798+0000 7fcd4b382740 1 -- 172.21.15.59:0/1469958984 wait complete. 2024-09-10T21:17:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.799+0000 7fcd4b382740 1 -- start start 2024-09-10T21:17:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.799+0000 7fcd4b382740 1 Processor -- start 2024-09-10T21:17:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.799+0000 7fcd4b382740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726c4d0 0x561247285a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.799+0000 7fcd4b382740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726cdf0 0x561247280fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:47.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.799+0000 7fcd4b382740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 0x561247281730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:47.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.799+0000 7fcd4b382740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcd441ad4c0 con 0x56124726cdf0 2024-09-10T21:17:47.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.799+0000 7fcd4b382740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd441acdf0 con 0x561247278d80 2024-09-10T21:17:47.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.799+0000 7fcd4b382740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcd441aa030 con 0x56124726c4d0 2024-09-10T21:17:47.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.799+0000 7fcd4b382740 10 client.0 _ll_register_callbacks cb 0x7fcd34009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:47.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.799+0000 7fcd41d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726cdf0 0x561247280fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:47.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.799+0000 7fcd41d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726cdf0 0x561247280fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45518/0 (socket says 172.21.15.59:45518) 2024-09-10T21:17:47.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.799+0000 7fcd41d9b640 1 -- 172.21.15.59:0/2593286330 learned_addr learned my addr 172.21.15.59:0/2593286330 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:47.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.799+0000 7fcd4259c640 1 --2- 172.21.15.59:0/2593286330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726c4d0 0x561247285a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:47.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.799+0000 7fcd42d9d640 1 --2- 172.21.15.59:0/2593286330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 0x561247281730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:47.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.800+0000 7fcd41d9b640 1 -- 172.21.15.59:0/2593286330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726c4d0 msgr2=0x561247285a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:47.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.800+0000 7fcd41d9b640 1 --2- 172.21.15.59:0/2593286330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726c4d0 0x561247285a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.800+0000 7fcd41d9b640 1 -- 172.21.15.59:0/2593286330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 msgr2=0x561247281730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:47.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.800+0000 7fcd41d9b640 1 --2- 172.21.15.59:0/2593286330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 0x561247281730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.800+0000 7fcd41d9b640 1 -- 172.21.15.59:0/2593286330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612472f8a70 con 0x56124726cdf0 2024-09-10T21:17:47.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.800+0000 7fcd41d9b640 1 --2- 172.21.15.59:0/2593286330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726cdf0 0x561247280fa0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fcd380a8a70 tx=0x7fcd380e36b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f36a16b1a662440 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:47.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.800+0000 7fcd29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:47.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.800+0000 7fcd29ffb640 1 -- 172.21.15.59:0/2593286330 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3801d040 con 0x56124726cdf0 2024-09-10T21:17:47.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.800+0000 7fcd29ffb640 1 -- 172.21.15.59:0/2593286330 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcd380b55a0 con 0x56124726cdf0 2024-09-10T21:17:47.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.800+0000 7fcd4b382740 1 -- 172.21.15.59:0/2593286330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd3401f890 con 0x56124726cdf0 2024-09-10T21:17:47.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.800+0000 7fcd29ffb640 1 -- 172.21.15.59:0/2593286330 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcd380b5370 con 0x56124726cdf0 2024-09-10T21:17:47.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.800+0000 7fcd4b382740 10 client.15906 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:47.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.800+0000 7fcd4b382740 1 -- 172.21.15.59:0/2593286330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5612472f9d80 con 0x56124726cdf0 2024-09-10T21:17:47.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.800+0000 7fcd29ffb640 1 -- 172.21.15.59:0/2593286330 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd3401f890 con 0x56124726cdf0 2024-09-10T21:17:47.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.800+0000 7fcd29ffb640 1 -- 172.21.15.59:0/2593286330 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcd380a6ba0 con 0x56124726cdf0 2024-09-10T21:17:47.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.800+0000 7fcd4b382740 10 client.15906 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:47.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.800+0000 7fcd4b382740 10 client.15906 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:17:47.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.800+0000 7fcd4b382740 20 client.15906 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:47.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.800+0000 7fcd4b382740 1 --2- 172.21.15.59:0/2593286330 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5612472fa440 0x5612472fc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:47.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.801+0000 7fcd4b382740 4 client.15906 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:17:47.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.801+0000 7fcd4b382740 1 -- 172.21.15.59:0/2593286330 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5612471e08a0 con 0x5612472fa440 2024-09-10T21:17:47.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.801+0000 7fcd4259c640 1 --2- 172.21.15.59:0/2593286330 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5612472fa440 0x5612472fc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:47.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.801+0000 7fcd4259c640 1 --2- 172.21.15.59:0/2593286330 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5612472fa440 0x5612472fc860 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ddb2b33a0761f0a9 server_cookie=e07bd9dbc44c0459 in_seq=0 out_seq=0 2024-09-10T21:17:47.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.801+0000 7fcd29ffb640 10 client.15906 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:17:47.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.801+0000 7fcd29ffb640 1 -- 172.21.15.59:0/2593286330 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5612471e08a0 con 0x5612472fa440 2024-09-10T21:17:47.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.801+0000 7fcd29ffb640 10 client.15906 handle_command_reply: tid=0 2024-09-10T21:17:47.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.801+0000 7fcd4b382740 1 client.15906 shutdown 2024-09-10T21:17:47.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.801+0000 7fcd4b382740 1 -- 172.21.15.59:0/2593286330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726cdf0 msgr2=0x561247280fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:47.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd4b382740 1 --2- 172.21.15.59:0/2593286330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726cdf0 0x561247280fa0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fcd380a8a70 tx=0x7fcd380e36b0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd4b382740 1 -- 172.21.15.59:0/2593286330 shutdown_connections 2024-09-10T21:17:47.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd4b382740 1 --2- 172.21.15.59:0/2593286330 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5612472fa440 0x5612472fc860 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd4b382740 1 --2- 172.21.15.59:0/2593286330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561247278d80 0x561247281730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd29ffb640 0 client.15906 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:17:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd4b382740 1 --2- 172.21.15.59:0/2593286330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56124726cdf0 0x561247280fa0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd4b382740 1 --2- 172.21.15.59:0/2593286330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56124726c4d0 0x561247285a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd4b382740 1 -- 172.21.15.59:0/2593286330 >> 172.21.15.59:0/2593286330 conn(0x56124726a300 msgr2=0x561247268c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd4b382740 1 -- 172.21.15.59:0/2593286330 shutdown_connections 2024-09-10T21:17:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd4b382740 1 -- 172.21.15.59:0/2593286330 wait complete. 2024-09-10T21:17:47.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd4b382740 20 client.15906 trim_cache size 0 max 16384 2024-09-10T21:17:47.811 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:17:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd48fad640 1 -- 172.21.15.59:0/65776158 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcd2c0b5360 msgr2=0x7fcd2c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd48fad640 1 --2- 172.21.15.59:0/65776158 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcd2c0b5360 0x7fcd2c0b7820 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcd34005fd0 tx=0x7fcd340094a0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd48fad640 1 -- 172.21.15.59:0/65776158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd441076a0 msgr2=0x7fcd441997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd48fad640 1 --2- 172.21.15.59:0/65776158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd441076a0 0x7fcd441997d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800cce0 tx=0x7fcd3800a620 comp rx=0 tx=0).stop 2024-09-10T21:17:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd48fad640 1 -- 172.21.15.59:0/65776158 shutdown_connections 2024-09-10T21:17:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd48fad640 1 --2- 172.21.15.59:0/65776158 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcd2c0b5360 0x7fcd2c0b7820 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd48fad640 1 --2- 172.21.15.59:0/65776158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd44108020 0x7fcd4419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd48fad640 1 --2- 172.21.15.59:0/65776158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd441076a0 0x7fcd441997d0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd48fad640 1 --2- 172.21.15.59:0/65776158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd44101c90 0x7fcd44199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:47.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd48fad640 1 -- 172.21.15.59:0/65776158 >> 172.21.15.59:0/65776158 conn(0x7fcd440fd700 msgr2=0x7fcd440ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:47.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd48fad640 1 -- 172.21.15.59:0/65776158 shutdown_connections 2024-09-10T21:17:47.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:47.802+0000 7fcd48fad640 1 -- 172.21.15.59:0/65776158 wait complete. 2024-09-10T21:17:48.601 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:17:48.863 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:17:49.233 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:49 smithi059 ceph-mon[30888]: pgmap v416: 97 pgs: 97 active+clean; 1.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:17:49.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:49 smithi192 ceph-mon[35363]: pgmap v416: 97 pgs: 97 active+clean; 1.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:17:49.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.312+0000 7fadf301b640 1 -- 172.21.15.59:0/3852624836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadec10d120 msgr2=0x7fadec10f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:49.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.312+0000 7fadf301b640 1 --2- 172.21.15.59:0/3852624836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadec10d120 0x7fadec10f590 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fade4009ca0 tx=0x7fade402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.312+0000 7fadf301b640 1 -- 172.21.15.59:0/3852624836 shutdown_connections 2024-09-10T21:17:49.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.312+0000 7fadf301b640 1 --2- 172.21.15.59:0/3852624836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadec10d120 0x7fadec10f590 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.312+0000 7fadf301b640 1 --2- 172.21.15.59:0/3852624836 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadec104570 0x7fadec10cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.312+0000 7fadf301b640 1 --2- 172.21.15.59:0/3852624836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadec103b70 0x7fadec103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.312+0000 7fadf301b640 1 -- 172.21.15.59:0/3852624836 >> 172.21.15.59:0/3852624836 conn(0x7fadec0fd700 msgr2=0x7fadec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.312+0000 7fadf301b640 1 -- 172.21.15.59:0/3852624836 shutdown_connections 2024-09-10T21:17:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.312+0000 7fadf301b640 1 -- 172.21.15.59:0/3852624836 wait complete. 2024-09-10T21:17:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.313+0000 7fadf301b640 1 Processor -- start 2024-09-10T21:17:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.313+0000 7fadf301b640 1 -- start start 2024-09-10T21:17:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.313+0000 7fadf301b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadec103b70 0x7fadec1019f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.313+0000 7fadf301b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadec104570 0x7fadec101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.313+0000 7fadf301b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadec10d120 0x7fadec102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.313+0000 7fadf301b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fadec112e60 con 0x7fadec104570 2024-09-10T21:17:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.313+0000 7fadf301b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fadec112ce0 con 0x7fadec10d120 2024-09-10T21:17:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.313+0000 7fadf301b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fadec112fe0 con 0x7fadec103b70 2024-09-10T21:17:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.313+0000 7fadebfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadec104570 0x7fadec101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.313+0000 7fadebfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadec104570 0x7fadec101f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40920/0 (socket says 172.21.15.59:40920) 2024-09-10T21:17:49.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.313+0000 7fadebfff640 1 -- 172.21.15.59:0/3033711271 learned_addr learned my addr 172.21.15.59:0/3033711271 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.313+0000 7fadf0db7640 1 --2- 172.21.15.59:0/3033711271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadec103b70 0x7fadec1019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.313+0000 7fadebfff640 1 -- 172.21.15.59:0/3033711271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadec103b70 msgr2=0x7fadec1019f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.313+0000 7fadebfff640 1 --2- 172.21.15.59:0/3033711271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadec103b70 0x7fadec1019f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.313+0000 7fadebfff640 1 -- 172.21.15.59:0/3033711271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadec10d120 msgr2=0x7fadec102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.313+0000 7fadebfff640 1 --2- 172.21.15.59:0/3033711271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadec10d120 0x7fadec102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.313+0000 7fadebfff640 1 -- 172.21.15.59:0/3033711271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadec1a7790 con 0x7fadec104570 2024-09-10T21:17:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.313+0000 7fadf0db7640 1 --2- 172.21.15.59:0/3033711271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadec103b70 0x7fadec1019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.314+0000 7fadebfff640 1 --2- 172.21.15.59:0/3033711271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadec104570 0x7fadec101f30 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fadd800b4a0 tx=0x7fadd800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.314+0000 7fade9ffb640 1 -- 172.21.15.59:0/3033711271 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8014070 con 0x7fadec104570 2024-09-10T21:17:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.314+0000 7fade9ffb640 1 -- 172.21.15.59:0/3033711271 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadd8010ac0 con 0x7fadec104570 2024-09-10T21:17:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.314+0000 7fadf301b640 1 -- 172.21.15.59:0/3033711271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadec1a7a80 con 0x7fadec104570 2024-09-10T21:17:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.314+0000 7fade9ffb640 1 -- 172.21.15.59:0/3033711271 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8017c30 con 0x7fadec104570 2024-09-10T21:17:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.314+0000 7fadf301b640 1 -- 172.21.15.59:0/3033711271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadec1a8090 con 0x7fadec104570 2024-09-10T21:17:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.317+0000 7fadf53f0740 1 Processor -- start 2024-09-10T21:17:49.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.317+0000 7fade9ffb640 1 -- 172.21.15.59:0/3033711271 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fadd8010610 con 0x7fadec104570 2024-09-10T21:17:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.317+0000 7fadf53f0740 1 -- start start 2024-09-10T21:17:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.317+0000 7fadf53f0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b3100d0f0 0x564b3100d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.317+0000 7fadf53f0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100da10 0x564b31019460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.317+0000 7fadf53f0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b310199a0 0x564b3101bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.317+0000 7fadf53f0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564b30f83ea0 con 0x564b3100da10 2024-09-10T21:17:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.317+0000 7fadf53f0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564b30f732d0 con 0x564b3100d0f0 2024-09-10T21:17:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.317+0000 7fadf53f0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564b30f770e0 con 0x564b310199a0 2024-09-10T21:17:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.317+0000 7fadf0db7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100da10 0x564b31019460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.317+0000 7fadf0db7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100da10 0x564b31019460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40936/0 (socket says 172.21.15.59:40936) 2024-09-10T21:17:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.317+0000 7fadf0db7640 1 -- 172.21.15.59:0/298730867 learned_addr learned my addr 172.21.15.59:0/298730867 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.317+0000 7fadf15b8640 1 --2- 172.21.15.59:0/298730867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b3100d0f0 0x564b3100d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.317+0000 7fadebfff640 1 --2- 172.21.15.59:0/298730867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b310199a0 0x564b3101bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:49.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.317+0000 7fadf0db7640 1 -- 172.21.15.59:0/298730867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b310199a0 msgr2=0x564b3101bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.317+0000 7fadf0db7640 1 --2- 172.21.15.59:0/298730867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b310199a0 0x564b3101bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.317+0000 7fadf0db7640 1 -- 172.21.15.59:0/298730867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b3100d0f0 msgr2=0x564b3100d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.317+0000 7fadf0db7640 1 --2- 172.21.15.59:0/298730867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b3100d0f0 0x564b3100d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.317+0000 7fadf0db7640 1 -- 172.21.15.59:0/298730867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b30cd1650 con 0x564b3100da10 2024-09-10T21:17:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.318+0000 7fade9ffb640 1 --2- 172.21.15.59:0/3033711271 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7faddc0b5360 0x7faddc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.318+0000 7fadf0db7640 1 --2- 172.21.15.59:0/298730867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100da10 0x564b31019460 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fade000aa10 tx=0x7fade000aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6783ff9577f31424 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.318+0000 7fadf15b8640 1 --2- 172.21.15.59:0/3033711271 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7faddc0b5360 0x7faddc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.318+0000 7fadd6ffd640 1 -- 172.21.15.59:0/298730867 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0015070 con 0x564b3100da10 2024-09-10T21:17:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.318+0000 7fade9ffb640 1 -- 172.21.15.59:0/3033711271 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fadd80e54e0 con 0x7fadec104570 2024-09-10T21:17:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.318+0000 7fadd6ffd640 1 -- 172.21.15.59:0/298730867 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fade000cc60 con 0x564b3100da10 2024-09-10T21:17:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.318+0000 7fadd6ffd640 1 -- 172.21.15.59:0/298730867 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade00105b0 con 0x564b3100da10 2024-09-10T21:17:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.319+0000 7fadf53f0740 1 -- 172.21.15.59:0/298730867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100da10 msgr2=0x564b31019460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.319+0000 7fadf15b8640 1 --2- 172.21.15.59:0/3033711271 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7faddc0b5360 0x7faddc0b7820 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fade4009430 tx=0x7fade402f3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:49.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.319+0000 7fadf53f0740 1 --2- 172.21.15.59:0/298730867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100da10 0x564b31019460 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fade000aa10 tx=0x7fade000aed0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.319+0000 7fadf53f0740 1 -- 172.21.15.59:0/298730867 shutdown_connections 2024-09-10T21:17:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.319+0000 7fadf53f0740 1 --2- 172.21.15.59:0/298730867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b310199a0 0x564b3101bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.319+0000 7fadf53f0740 1 --2- 172.21.15.59:0/298730867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100da10 0x564b31019460 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.319+0000 7fadf53f0740 1 --2- 172.21.15.59:0/298730867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b3100d0f0 0x564b3100d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.319+0000 7fadf53f0740 1 -- 172.21.15.59:0/298730867 >> 172.21.15.59:0/298730867 conn(0x564b3100af20 msgr2=0x564b3100c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.319+0000 7fadf53f0740 1 -- 172.21.15.59:0/298730867 shutdown_connections 2024-09-10T21:17:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.319+0000 7fadf53f0740 1 -- 172.21.15.59:0/298730867 wait complete. 2024-09-10T21:17:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.319+0000 7fadf53f0740 1 -- start start 2024-09-10T21:17:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.319+0000 7fadf53f0740 1 Processor -- start 2024-09-10T21:17:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadf53f0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b3100d0f0 0x564b31019270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadf53f0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100da10 0x564b310166c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadf53f0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b310199a0 0x564b31016ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadf53f0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564b30dd4700 con 0x564b3100da10 2024-09-10T21:17:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadf53f0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564b30f0e160 con 0x564b310199a0 2024-09-10T21:17:49.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadf53f0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564b3101c620 con 0x564b3100d0f0 2024-09-10T21:17:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadf53f0740 10 client.0 _ll_register_callbacks cb 0x564b30f279e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadebfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100da10 0x564b310166c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadebfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100da10 0x564b310166c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40942/0 (socket says 172.21.15.59:40942) 2024-09-10T21:17:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadebfff640 1 -- 172.21.15.59:0/2595373391 learned_addr learned my addr 172.21.15.59:0/2595373391 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadf0db7640 1 --2- 172.21.15.59:0/2595373391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b3100d0f0 0x564b31019270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadf15b8640 1 --2- 172.21.15.59:0/2595373391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b310199a0 0x564b31016ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadebfff640 1 -- 172.21.15.59:0/2595373391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b3100d0f0 msgr2=0x564b31019270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadebfff640 1 --2- 172.21.15.59:0/2595373391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b3100d0f0 0x564b31019270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadebfff640 1 -- 172.21.15.59:0/2595373391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b310199a0 msgr2=0x564b31016ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadebfff640 1 --2- 172.21.15.59:0/2595373391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b310199a0 0x564b31016ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadebfff640 1 -- 172.21.15.59:0/2595373391 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b30f3bc90 con 0x564b3100da10 2024-09-10T21:17:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadf15b8640 1 --2- 172.21.15.59:0/2595373391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b310199a0 0x564b31016ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadebfff640 1 --2- 172.21.15.59:0/2595373391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100da10 0x564b310166c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fadd80ab970 tx=0x7fadd80ab5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f362f48ffe70c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:49.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.320+0000 7fadcbfff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.321+0000 7fadcbfff640 1 -- 172.21.15.59:0/2595373391 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd801e030 con 0x564b3100da10 2024-09-10T21:17:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.321+0000 7fadcbfff640 1 -- 172.21.15.59:0/2595373391 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fadd8010c70 con 0x564b3100da10 2024-09-10T21:17:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.321+0000 7fadf53f0740 1 -- 172.21.15.59:0/2595373391 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fade000cc60 con 0x564b3100da10 2024-09-10T21:17:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.321+0000 7fadcbfff640 1 -- 172.21.15.59:0/2595373391 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fadd8017360 con 0x564b3100da10 2024-09-10T21:17:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.321+0000 7fadf53f0740 10 client.15918 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.321+0000 7fadf53f0740 1 -- 172.21.15.59:0/2595373391 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564b31027ff0 con 0x564b3100da10 2024-09-10T21:17:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.321+0000 7fadcbfff640 1 -- 172.21.15.59:0/2595373391 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fade000cc60 con 0x564b3100da10 2024-09-10T21:17:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.321+0000 7fadcbfff640 1 -- 172.21.15.59:0/2595373391 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fadd80a7ee0 con 0x564b3100da10 2024-09-10T21:17:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.321+0000 7fadf53f0740 10 client.15918 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.321+0000 7fadf53f0740 10 client.15918 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:17:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.321+0000 7fadf53f0740 20 client.15918 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.321+0000 7fadf53f0740 1 --2- 172.21.15.59:0/2595373391 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564b310294a0 0x564b3102b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.321+0000 7fadf53f0740 4 client.15918 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:17:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.321+0000 7fadf53f0740 1 -- 172.21.15.59:0/2595373391 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b30f85df0 con 0x564b310294a0 2024-09-10T21:17:49.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.322+0000 7fadf0db7640 1 --2- 172.21.15.59:0/2595373391 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564b310294a0 0x564b3102b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.322+0000 7fadf0db7640 1 --2- 172.21.15.59:0/2595373391 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564b310294a0 0x564b3102b890 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fb0189c057f326c0 server_cookie=d5055fe6d3a458c5 in_seq=0 out_seq=0 2024-09-10T21:17:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.322+0000 7fadcbfff640 10 client.15918 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:17:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.323+0000 7fadcbfff640 1 -- 172.21.15.59:0/2595373391 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b30f85df0 con 0x564b310294a0 2024-09-10T21:17:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.323+0000 7fadcbfff640 10 client.15918 handle_command_reply: tid=0 2024-09-10T21:17:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.323+0000 7fadf53f0740 1 client.15918 shutdown 2024-09-10T21:17:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.323+0000 7fadf53f0740 1 -- 172.21.15.59:0/2595373391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100da10 msgr2=0x564b310166c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.323+0000 7fadf53f0740 1 --2- 172.21.15.59:0/2595373391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100da10 0x564b310166c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fadd80ab970 tx=0x7fadd80ab5c0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.323+0000 7fadf53f0740 1 -- 172.21.15.59:0/2595373391 shutdown_connections 2024-09-10T21:17:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.323+0000 7fadf53f0740 1 --2- 172.21.15.59:0/2595373391 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564b310294a0 0x564b3102b890 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.323+0000 7fadcbfff640 0 client.15918 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:17:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.323+0000 7fadf53f0740 1 --2- 172.21.15.59:0/2595373391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b310199a0 0x564b31016ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.323+0000 7fadf53f0740 1 --2- 172.21.15.59:0/2595373391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100da10 0x564b310166c0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.323+0000 7fadf53f0740 1 --2- 172.21.15.59:0/2595373391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b3100d0f0 0x564b31019270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.323+0000 7fadf53f0740 1 -- 172.21.15.59:0/2595373391 >> 172.21.15.59:0/2595373391 conn(0x564b3100af20 msgr2=0x564b31010ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:49.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.323+0000 7fadf53f0740 1 -- 172.21.15.59:0/2595373391 shutdown_connections 2024-09-10T21:17:49.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.323+0000 7fadf53f0740 1 -- 172.21.15.59:0/2595373391 wait complete. 2024-09-10T21:17:49.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.323+0000 7fadf53f0740 20 client.15918 trim_cache size 0 max 16384 2024-09-10T21:17:49.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.337+0000 7fadf53f0740 1 Processor -- start 2024-09-10T21:17:49.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.337+0000 7fadf53f0740 1 -- start start 2024-09-10T21:17:49.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.337+0000 7fadf53f0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b3100d0f0 0x564b310258b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:49.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.337+0000 7fadf53f0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b3100da10 0x564b31018400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:49.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.337+0000 7fadf53f0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b310199a0 0x564b310138d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:49.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.337+0000 7fadf53f0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fadec1b0710 con 0x564b310199a0 2024-09-10T21:17:49.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.337+0000 7fadf53f0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fadec1b2250 con 0x564b3100da10 2024-09-10T21:17:49.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.337+0000 7fadf53f0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fadec1b0de0 con 0x564b3100d0f0 2024-09-10T21:17:49.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.337+0000 7fadf15b8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b310199a0 0x564b310138d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:49.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.337+0000 7fadf15b8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b310199a0 0x564b310138d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40948/0 (socket says 172.21.15.59:40948) 2024-09-10T21:17:49.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.337+0000 7fadf15b8640 1 -- 172.21.15.59:0/1646943294 learned_addr learned my addr 172.21.15.59:0/1646943294 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:49.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.337+0000 7fadebfff640 1 --2- 172.21.15.59:0/1646943294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b3100da10 0x564b31018400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:49.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.337+0000 7fadf0db7640 1 --2- 172.21.15.59:0/1646943294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b3100d0f0 0x564b310258b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:49.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.337+0000 7fadf15b8640 1 -- 172.21.15.59:0/1646943294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b3100d0f0 msgr2=0x564b310258b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:49.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.337+0000 7fadf15b8640 1 --2- 172.21.15.59:0/1646943294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b3100d0f0 0x564b310258b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.337+0000 7fadf15b8640 1 -- 172.21.15.59:0/1646943294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b3100da10 msgr2=0x564b31018400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:49.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.337+0000 7fadf15b8640 1 --2- 172.21.15.59:0/1646943294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b3100da10 0x564b31018400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.337+0000 7fadf15b8640 1 -- 172.21.15.59:0/1646943294 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b3100b9a0 con 0x564b310199a0 2024-09-10T21:17:49.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.337+0000 7fadf0db7640 1 --2- 172.21.15.59:0/1646943294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b3100d0f0 0x564b310258b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:49.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.338+0000 7fadf15b8640 1 --2- 172.21.15.59:0/1646943294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b310199a0 0x564b310138d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fade4031f00 tx=0x7fade403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1a55638d51fd29 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:49.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.338+0000 7fadd67fc640 1 -- 172.21.15.59:0/1646943294 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade40318e0 con 0x564b310199a0 2024-09-10T21:17:49.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.338+0000 7fadd67fc640 1 -- 172.21.15.59:0/1646943294 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fade4036040 con 0x564b310199a0 2024-09-10T21:17:49.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.338+0000 7fadd67fc640 1 -- 172.21.15.59:0/1646943294 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4030c20 con 0x564b310199a0 2024-09-10T21:17:49.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.339+0000 7fadf53f0740 1 -- 172.21.15.59:0/1646943294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b310199a0 msgr2=0x564b310138d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:49.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.339+0000 7fadf53f0740 1 --2- 172.21.15.59:0/1646943294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b310199a0 0x564b310138d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fade4031f00 tx=0x7fade403f000 comp rx=0 tx=0).stop 2024-09-10T21:17:49.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.339+0000 7fadf53f0740 1 -- 172.21.15.59:0/1646943294 shutdown_connections 2024-09-10T21:17:49.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.339+0000 7fadf53f0740 1 --2- 172.21.15.59:0/1646943294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b310199a0 0x564b310138d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.339+0000 7fadf53f0740 1 --2- 172.21.15.59:0/1646943294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b3100da10 0x564b31018400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.339+0000 7fadf53f0740 1 --2- 172.21.15.59:0/1646943294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b3100d0f0 0x564b310258b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.339+0000 7fadf53f0740 1 -- 172.21.15.59:0/1646943294 >> 172.21.15.59:0/1646943294 conn(0x564b3100af20 msgr2=0x564b31017cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:49.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.339+0000 7fadf53f0740 1 -- 172.21.15.59:0/1646943294 shutdown_connections 2024-09-10T21:17:49.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.339+0000 7fadf53f0740 1 -- 172.21.15.59:0/1646943294 wait complete. 2024-09-10T21:17:49.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.339+0000 7fadf53f0740 1 -- start start 2024-09-10T21:17:49.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.339+0000 7fadf53f0740 1 Processor -- start 2024-09-10T21:17:49.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadf53f0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100d0f0 0x564b3101e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:49.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadf53f0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b3100da10 0x564b3101e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:49.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadf53f0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b310199a0 0x564b3108f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:49.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadf53f0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fadec1b1b80 con 0x564b3100d0f0 2024-09-10T21:17:49.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadf53f0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fadec1b14b0 con 0x564b310199a0 2024-09-10T21:17:49.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadf53f0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fadec1ae6f0 con 0x564b3100da10 2024-09-10T21:17:49.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadf53f0740 10 client.0 _ll_register_callbacks cb 0x7fadd80e8a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:49.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadf0db7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100d0f0 0x564b3101e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:49.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadf0db7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100d0f0 0x564b3101e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40954/0 (socket says 172.21.15.59:40954) 2024-09-10T21:17:49.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadf0db7640 1 -- 172.21.15.59:0/1549076226 learned_addr learned my addr 172.21.15.59:0/1549076226 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:49.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadebfff640 1 --2- 172.21.15.59:0/1549076226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b3100da10 0x564b3101e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:49.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadf15b8640 1 --2- 172.21.15.59:0/1549076226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b310199a0 0x564b3108f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:49.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadf0db7640 1 -- 172.21.15.59:0/1549076226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b3100da10 msgr2=0x564b3101e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:49.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadf0db7640 1 --2- 172.21.15.59:0/1549076226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b3100da10 0x564b3101e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadf0db7640 1 -- 172.21.15.59:0/1549076226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b310199a0 msgr2=0x564b3108f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:49.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadf0db7640 1 --2- 172.21.15.59:0/1549076226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b310199a0 0x564b3108f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadf0db7640 1 -- 172.21.15.59:0/1549076226 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b3108fc20 con 0x564b3100d0f0 2024-09-10T21:17:49.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadf15b8640 1 --2- 172.21.15.59:0/1549076226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b310199a0 0x564b3108f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:49.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadf0db7640 1 --2- 172.21.15.59:0/1549076226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100d0f0 0x564b3101e430 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fade000cba0 tx=0x7fade000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422005ea8049ffb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:49.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadcbfff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:49.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadcbfff640 1 -- 172.21.15.59:0/1549076226 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0031060 con 0x564b3100d0f0 2024-09-10T21:17:49.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadcbfff640 1 -- 172.21.15.59:0/1549076226 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fade00113f0 con 0x564b3100d0f0 2024-09-10T21:17:49.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.340+0000 7fadf53f0740 1 -- 172.21.15.59:0/1549076226 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fade4036040 con 0x564b3100d0f0 2024-09-10T21:17:49.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.341+0000 7fadcbfff640 1 -- 172.21.15.59:0/1549076226 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fade0015040 con 0x564b3100d0f0 2024-09-10T21:17:49.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.341+0000 7fadf53f0740 10 client.15924 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:49.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.341+0000 7fadf53f0740 1 -- 172.21.15.59:0/1549076226 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564b310970a0 con 0x564b3100d0f0 2024-09-10T21:17:49.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.341+0000 7fadcbfff640 1 -- 172.21.15.59:0/1549076226 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fade4036040 con 0x564b3100d0f0 2024-09-10T21:17:49.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.341+0000 7fadcbfff640 1 -- 172.21.15.59:0/1549076226 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fade001a750 con 0x564b3100d0f0 2024-09-10T21:17:49.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.341+0000 7fadf53f0740 10 client.15924 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:49.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.341+0000 7fadf53f0740 10 client.15924 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:17:49.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.341+0000 7fadf53f0740 20 client.15924 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:49.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.341+0000 7fadf53f0740 1 --2- 172.21.15.59:0/1549076226 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564b310294a0 0x564b310995b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:49.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.341+0000 7fadf53f0740 4 client.15924 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:17:49.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.341+0000 7fadf53f0740 1 -- 172.21.15.59:0/1549076226 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564b30f818a0 con 0x564b310294a0 2024-09-10T21:17:49.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.341+0000 7fadebfff640 1 --2- 172.21.15.59:0/1549076226 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564b310294a0 0x564b310995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:49.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.342+0000 7fadcbfff640 10 client.15924 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:17:49.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.342+0000 7fadebfff640 1 --2- 172.21.15.59:0/1549076226 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564b310294a0 0x564b310995b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8f8b64a152cc19f8 server_cookie=60aa9452bb36c2bf in_seq=0 out_seq=0 2024-09-10T21:17:49.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.342+0000 7fadcbfff640 1 -- 172.21.15.59:0/1549076226 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564b30f818a0 con 0x564b310294a0 2024-09-10T21:17:49.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.342+0000 7fadcbfff640 10 client.15924 handle_command_reply: tid=0 2024-09-10T21:17:49.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.342+0000 7fadf53f0740 1 client.15924 shutdown 2024-09-10T21:17:49.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.342+0000 7fadf53f0740 1 -- 172.21.15.59:0/1549076226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100d0f0 msgr2=0x564b3101e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:49.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.342+0000 7fadf53f0740 1 --2- 172.21.15.59:0/1549076226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100d0f0 0x564b3101e430 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fade000cba0 tx=0x7fade000cee0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.342+0000 7fadf53f0740 1 -- 172.21.15.59:0/1549076226 shutdown_connections 2024-09-10T21:17:49.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.342+0000 7fadf53f0740 1 --2- 172.21.15.59:0/1549076226 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564b310294a0 0x564b310995b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.342+0000 7fadf53f0740 1 --2- 172.21.15.59:0/1549076226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b310199a0 0x564b3108f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.342+0000 7fadf53f0740 1 --2- 172.21.15.59:0/1549076226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b3100da10 0x564b3101e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.342+0000 7fadf53f0740 1 --2- 172.21.15.59:0/1549076226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b3100d0f0 0x564b3101e430 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.342+0000 7fadf53f0740 1 -- 172.21.15.59:0/1549076226 >> 172.21.15.59:0/1549076226 conn(0x564b3100af20 msgr2=0x564b31018510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:49.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.342+0000 7fadcbfff640 0 client.15924 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:17:49.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.342+0000 7fadf53f0740 1 -- 172.21.15.59:0/1549076226 shutdown_connections 2024-09-10T21:17:49.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.342+0000 7fadf53f0740 1 -- 172.21.15.59:0/1549076226 wait complete. 2024-09-10T21:17:49.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.342+0000 7fadf53f0740 20 client.15924 trim_cache size 0 max 16384 2024-09-10T21:17:49.353 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:17:49.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.343+0000 7fadf301b640 1 -- 172.21.15.59:0/3033711271 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7faddc0b5360 msgr2=0x7faddc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.343+0000 7fadf301b640 1 --2- 172.21.15.59:0/3033711271 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7faddc0b5360 0x7faddc0b7820 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fade4009430 tx=0x7fade402f3b0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.343+0000 7fadf301b640 1 -- 172.21.15.59:0/3033711271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadec104570 msgr2=0x7fadec101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.343+0000 7fadf301b640 1 --2- 172.21.15.59:0/3033711271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadec104570 0x7fadec101f30 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fadd800b4a0 tx=0x7fadd800b960 comp rx=0 tx=0).stop 2024-09-10T21:17:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.343+0000 7fadf301b640 1 -- 172.21.15.59:0/3033711271 shutdown_connections 2024-09-10T21:17:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.343+0000 7fadf301b640 1 --2- 172.21.15.59:0/3033711271 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7faddc0b5360 0x7faddc0b7820 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.343+0000 7fadf301b640 1 --2- 172.21.15.59:0/3033711271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fadec10d120 0x7fadec102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.343+0000 7fadf301b640 1 --2- 172.21.15.59:0/3033711271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadec104570 0x7fadec101f30 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.343+0000 7fadf301b640 1 --2- 172.21.15.59:0/3033711271 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fadec103b70 0x7fadec1019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.343+0000 7fadf301b640 1 -- 172.21.15.59:0/3033711271 >> 172.21.15.59:0/3033711271 conn(0x7fadec0fd700 msgr2=0x7fadec0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.343+0000 7fadf301b640 1 -- 172.21.15.59:0/3033711271 shutdown_connections 2024-09-10T21:17:49.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:49.343+0000 7fadf301b640 1 -- 172.21.15.59:0/3033711271 wait complete. 2024-09-10T21:17:49.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:49 smithi154 ceph-mon[35041]: pgmap v416: 97 pgs: 97 active+clean; 1.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:17:50.147 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:17:50.410 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:17:50.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.881+0000 7f34fbb22640 1 -- 172.21.15.59:0/2259594410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34f4102dc0 msgr2=0x7f34f41031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:50.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.881+0000 7f34fbb22640 1 --2- 172.21.15.59:0/2259594410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34f4102dc0 0x7f34f41031a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f34f0009ca0 tx=0x7f34f002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.881+0000 7f34fbb22640 1 -- 172.21.15.59:0/2259594410 shutdown_connections 2024-09-10T21:17:50.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.881+0000 7f34fbb22640 1 --2- 172.21.15.59:0/2259594410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34f4109150 0x7f34f410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.881+0000 7f34fbb22640 1 --2- 172.21.15.59:0/2259594410 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f41087d0 0x7f34f4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.881+0000 7f34fbb22640 1 --2- 172.21.15.59:0/2259594410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34f4102dc0 0x7f34f41031a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.881+0000 7f34fbb22640 1 -- 172.21.15.59:0/2259594410 >> 172.21.15.59:0/2259594410 conn(0x7f34f40fe830 msgr2=0x7f34f4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:50.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.881+0000 7f34fbb22640 1 -- 172.21.15.59:0/2259594410 shutdown_connections 2024-09-10T21:17:50.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.881+0000 7f34fbb22640 1 -- 172.21.15.59:0/2259594410 wait complete. 2024-09-10T21:17:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.882+0000 7f34fbb22640 1 Processor -- start 2024-09-10T21:17:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.882+0000 7f34fbb22640 1 -- start start 2024-09-10T21:17:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.882+0000 7f34fbb22640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34f4102dc0 0x7f34f40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.882+0000 7f34fbb22640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f41087d0 0x7f34f40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.882+0000 7f34fbb22640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34f4109150 0x7f34f4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.882+0000 7f34fbb22640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f34f4112e50 con 0x7f34f4109150 2024-09-10T21:17:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.882+0000 7f34fbb22640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f34f4112cd0 con 0x7f34f41087d0 2024-09-10T21:17:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.882+0000 7f34fbb22640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f34f4112fd0 con 0x7f34f4102dc0 2024-09-10T21:17:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.882+0000 7f34fa0bf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34f4109150 0x7f34f4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.882+0000 7f34fa0bf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34f4109150 0x7f34f4075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40966/0 (socket says 172.21.15.59:40966) 2024-09-10T21:17:50.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.882+0000 7f34fa0bf640 1 -- 172.21.15.59:0/4051200994 learned_addr learned my addr 172.21.15.59:0/4051200994 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.882+0000 7f34f98be640 1 --2- 172.21.15.59:0/4051200994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34f4102dc0 0x7f34f40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.883+0000 7f34f90bd640 1 --2- 172.21.15.59:0/4051200994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f41087d0 0x7f34f40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.883+0000 7f34fa0bf640 1 -- 172.21.15.59:0/4051200994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34f4102dc0 msgr2=0x7f34f40754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.883+0000 7f34fa0bf640 1 --2- 172.21.15.59:0/4051200994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34f4102dc0 0x7f34f40754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.883+0000 7f34fa0bf640 1 -- 172.21.15.59:0/4051200994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f41087d0 msgr2=0x7f34f40759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.883+0000 7f34fa0bf640 1 --2- 172.21.15.59:0/4051200994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f41087d0 0x7f34f40759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.883+0000 7f34fa0bf640 1 -- 172.21.15.59:0/4051200994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34f41a7860 con 0x7f34f4109150 2024-09-10T21:17:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.883+0000 7f34f90bd640 1 --2- 172.21.15.59:0/4051200994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f41087d0 0x7f34f40759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.883+0000 7f34fa0bf640 1 --2- 172.21.15.59:0/4051200994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34f4109150 0x7f34f4075f20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f34ec009fd0 tx=0x7f34ec00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.883+0000 7f34eaffd640 1 -- 172.21.15.59:0/4051200994 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec011830 con 0x7f34f4109150 2024-09-10T21:17:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.883+0000 7f34eaffd640 1 -- 172.21.15.59:0/4051200994 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34ec016070 con 0x7f34f4109150 2024-09-10T21:17:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.883+0000 7f34fbb22640 1 -- 172.21.15.59:0/4051200994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34f41a7b50 con 0x7f34f4109150 2024-09-10T21:17:50.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.883+0000 7f34eaffd640 1 -- 172.21.15.59:0/4051200994 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec010de0 con 0x7f34f4109150 2024-09-10T21:17:50.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.883+0000 7f34fbb22640 1 -- 172.21.15.59:0/4051200994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34f41a8040 con 0x7f34f4109150 2024-09-10T21:17:50.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.886+0000 7f34eaffd640 1 -- 172.21.15.59:0/4051200994 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f34ec0119d0 con 0x7f34f4109150 2024-09-10T21:17:50.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.886+0000 7f34fdef7740 1 Processor -- start 2024-09-10T21:17:50.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.886+0000 7f34fdef7740 1 -- start start 2024-09-10T21:17:50.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.886+0000 7f34fdef7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2de164d0 0x559d2de168b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:50.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.886+0000 7f34fdef7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de16df0 0x559d2de22840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:50.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.886+0000 7f34fdef7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de22d80 0x559d2de25170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:50.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.886+0000 7f34fdef7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559d2dd8cea0 con 0x559d2de22d80 2024-09-10T21:17:50.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.886+0000 7f34fdef7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559d2dd7c2d0 con 0x559d2de164d0 2024-09-10T21:17:50.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.886+0000 7f34fdef7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559d2dd800e0 con 0x559d2de16df0 2024-09-10T21:17:50.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.887+0000 7f34f90bd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de22d80 0x559d2de25170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:50.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.887+0000 7f34f90bd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de22d80 0x559d2de25170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40968/0 (socket says 172.21.15.59:40968) 2024-09-10T21:17:50.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.887+0000 7f34f90bd640 1 -- 172.21.15.59:0/2006425856 learned_addr learned my addr 172.21.15.59:0/2006425856 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:50.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.887+0000 7f34f98be640 1 --2- 172.21.15.59:0/2006425856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de16df0 0x559d2de22840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:50.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.887+0000 7f34f90bd640 1 --2- 172.21.15.59:0/2006425856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2de164d0 0x559d2de168b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:50.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.887+0000 7f34eaffd640 1 --2- 172.21.15.59:0/4051200994 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f34e00b52e0 0x7f34e00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:50.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.887+0000 7f34f90bd640 1 -- 172.21.15.59:0/2006425856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de16df0 msgr2=0x559d2de22840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:50.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.887+0000 7f34f90bd640 1 --2- 172.21.15.59:0/2006425856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de16df0 0x559d2de22840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.887+0000 7f34f90bd640 1 -- 172.21.15.59:0/2006425856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2de164d0 msgr2=0x559d2de168b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:50.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.887+0000 7f34f90bd640 1 --2- 172.21.15.59:0/2006425856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2de164d0 0x559d2de168b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.887+0000 7f34f90bd640 1 -- 172.21.15.59:0/2006425856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d2dada650 con 0x559d2de22d80 2024-09-10T21:17:50.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.887+0000 7f34fa0bf640 1 --2- 172.21.15.59:0/4051200994 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f34e00b52e0 0x7f34e00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:50.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.887+0000 7f34eaffd640 1 -- 172.21.15.59:0/4051200994 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f34ec0e51f0 con 0x7f34f4109150 2024-09-10T21:17:50.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.887+0000 7f34f90bd640 1 --2- 172.21.15.59:0/2006425856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de22d80 0x559d2de25170 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f34e4016560 tx=0x7f34e400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34146889ff658e9c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:50.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.887+0000 7f34dffff640 1 -- 172.21.15.59:0/2006425856 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e4018430 con 0x559d2de22d80 2024-09-10T21:17:50.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.887+0000 7f34dffff640 1 -- 172.21.15.59:0/2006425856 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34e4018a80 con 0x559d2de22d80 2024-09-10T21:17:50.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.887+0000 7f34dffff640 1 -- 172.21.15.59:0/2006425856 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e40177f0 con 0x559d2de22d80 2024-09-10T21:17:50.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.888+0000 7f34fdef7740 1 -- 172.21.15.59:0/2006425856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de22d80 msgr2=0x559d2de25170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:50.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.888+0000 7f34fdef7740 1 --2- 172.21.15.59:0/2006425856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de22d80 0x559d2de25170 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f34e4016560 tx=0x7f34e400a340 comp rx=0 tx=0).stop 2024-09-10T21:17:50.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.888+0000 7f34fa0bf640 1 --2- 172.21.15.59:0/4051200994 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f34e00b52e0 0x7f34e00b77a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00bde0 tx=0x7f34ec0a0230 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:50.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.888+0000 7f34fdef7740 1 -- 172.21.15.59:0/2006425856 shutdown_connections 2024-09-10T21:17:50.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.888+0000 7f34fdef7740 1 --2- 172.21.15.59:0/2006425856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de22d80 0x559d2de25170 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.888+0000 7f34fdef7740 1 --2- 172.21.15.59:0/2006425856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de16df0 0x559d2de22840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.888+0000 7f34fdef7740 1 --2- 172.21.15.59:0/2006425856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2de164d0 0x559d2de168b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.888+0000 7f34fdef7740 1 -- 172.21.15.59:0/2006425856 >> 172.21.15.59:0/2006425856 conn(0x559d2de14300 msgr2=0x559d2de154a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:50.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.888+0000 7f34fdef7740 1 -- 172.21.15.59:0/2006425856 shutdown_connections 2024-09-10T21:17:50.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.888+0000 7f34fdef7740 1 -- 172.21.15.59:0/2006425856 wait complete. 2024-09-10T21:17:50.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.889+0000 7f34fdef7740 1 -- start start 2024-09-10T21:17:50.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.889+0000 7f34fdef7740 1 Processor -- start 2024-09-10T21:17:50.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.889+0000 7f34fdef7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de164d0 0x559d2de226b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:50.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.889+0000 7f34fdef7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de16df0 0x559d2de1fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:50.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.889+0000 7f34fdef7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2de22d80 0x559d2de20180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:50.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.889+0000 7f34fdef7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559d2dbdd700 con 0x559d2de164d0 2024-09-10T21:17:50.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.889+0000 7f34fdef7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559d2dd17160 con 0x559d2de22d80 2024-09-10T21:17:50.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.889+0000 7f34fdef7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559d2de259a0 con 0x559d2de16df0 2024-09-10T21:17:50.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.889+0000 7f34fdef7740 10 client.0 _ll_register_callbacks cb 0x559d2dd309e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:50.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.890+0000 7f34f90bd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de164d0 0x559d2de226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:50.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.890+0000 7f34f90bd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de164d0 0x559d2de226b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40970/0 (socket says 172.21.15.59:40970) 2024-09-10T21:17:50.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.890+0000 7f34f90bd640 1 -- 172.21.15.59:0/1872852058 learned_addr learned my addr 172.21.15.59:0/1872852058 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:50.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.890+0000 7f34f98be640 1 --2- 172.21.15.59:0/1872852058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de16df0 0x559d2de1fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:50.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.890+0000 7f34f90bd640 1 -- 172.21.15.59:0/1872852058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de16df0 msgr2=0x559d2de1fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:50.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.890+0000 7f34f90bd640 1 --2- 172.21.15.59:0/1872852058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de16df0 0x559d2de1fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.890+0000 7f34f90bd640 1 -- 172.21.15.59:0/1872852058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2de22d80 msgr2=0x559d2de20180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:50.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.890+0000 7f34f90bd640 1 --2- 172.21.15.59:0/1872852058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2de22d80 0x559d2de20180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.890+0000 7f34f90bd640 1 -- 172.21.15.59:0/1872852058 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d2dd44c90 con 0x559d2de164d0 2024-09-10T21:17:50.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.890+0000 7f34f98be640 1 --2- 172.21.15.59:0/1872852058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de16df0 0x559d2de1fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:50.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.890+0000 7f34f90bd640 1 --2- 172.21.15.59:0/1872852058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de164d0 0x559d2de226b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f34e400a5e0 tx=0x7f34e4006ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a14b6d1639e07a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:50.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.890+0000 7f34dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:50.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.890+0000 7f34dd7fa640 1 -- 172.21.15.59:0/1872852058 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e4026060 con 0x559d2de164d0 2024-09-10T21:17:50.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.890+0000 7f34dd7fa640 1 -- 172.21.15.59:0/1872852058 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f34e4018840 con 0x559d2de164d0 2024-09-10T21:17:50.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.890+0000 7f34fdef7740 1 -- 172.21.15.59:0/1872852058 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34e4018a80 con 0x559d2de164d0 2024-09-10T21:17:50.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.890+0000 7f34dd7fa640 1 -- 172.21.15.59:0/1872852058 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f34e40175d0 con 0x559d2de164d0 2024-09-10T21:17:50.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.890+0000 7f34fdef7740 10 client.15936 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:50.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.890+0000 7f34fdef7740 1 -- 172.21.15.59:0/1872852058 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559d2de31340 con 0x559d2de164d0 2024-09-10T21:17:50.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.891+0000 7f34dd7fa640 1 -- 172.21.15.59:0/1872852058 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34e4018a80 con 0x559d2de164d0 2024-09-10T21:17:50.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.891+0000 7f34dd7fa640 1 -- 172.21.15.59:0/1872852058 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f34e4012050 con 0x559d2de164d0 2024-09-10T21:17:50.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.891+0000 7f34fdef7740 10 client.15936 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:50.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.891+0000 7f34fdef7740 10 client.15936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:17:50.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.891+0000 7f34fdef7740 20 client.15936 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:50.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.891+0000 7f34fdef7740 1 --2- 172.21.15.59:0/1872852058 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559d2de326f0 0x559d2de34ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:50.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.891+0000 7f34fdef7740 4 client.15936 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:17:50.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.891+0000 7f34fdef7740 1 -- 172.21.15.59:0/1872852058 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d2dd8edf0 con 0x559d2de326f0 2024-09-10T21:17:50.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.891+0000 7f34f98be640 1 --2- 172.21.15.59:0/1872852058 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559d2de326f0 0x559d2de34ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:50.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.892+0000 7f34f98be640 1 --2- 172.21.15.59:0/1872852058 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559d2de326f0 0x559d2de34ae0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5133941c5db4bfa1 server_cookie=4c413b536c397dc in_seq=0 out_seq=0 2024-09-10T21:17:50.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.892+0000 7f34dd7fa640 10 client.15936 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:50.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.893+0000 7f34dd7fa640 1 -- 172.21.15.59:0/1872852058 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559d2dd8edf0 con 0x559d2de326f0 2024-09-10T21:17:50.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.893+0000 7f34dd7fa640 10 client.15936 handle_command_reply: tid=0 2024-09-10T21:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.893+0000 7f34fdef7740 1 client.15936 shutdown 2024-09-10T21:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.893+0000 7f34fdef7740 1 -- 172.21.15.59:0/1872852058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de164d0 msgr2=0x559d2de226b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.893+0000 7f34fdef7740 1 --2- 172.21.15.59:0/1872852058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de164d0 0x559d2de226b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f34e400a5e0 tx=0x7f34e4006ad0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.893+0000 7f34fdef7740 1 -- 172.21.15.59:0/1872852058 shutdown_connections 2024-09-10T21:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.893+0000 7f34fdef7740 1 --2- 172.21.15.59:0/1872852058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2de22d80 0x559d2de20180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.893+0000 7f34fdef7740 1 --2- 172.21.15.59:0/1872852058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de16df0 0x559d2de1fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.893+0000 7f34fdef7740 1 --2- 172.21.15.59:0/1872852058 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559d2de326f0 0x559d2de34ae0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.893+0000 7f34fdef7740 1 --2- 172.21.15.59:0/1872852058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de164d0 0x559d2de226b0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.893+0000 7f34dd7fa640 0 client.15936 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.893+0000 7f34fdef7740 1 -- 172.21.15.59:0/1872852058 >> 172.21.15.59:0/1872852058 conn(0x559d2de14300 msgr2=0x559d2de19e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.893+0000 7f34fdef7740 1 -- 172.21.15.59:0/1872852058 shutdown_connections 2024-09-10T21:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.893+0000 7f34fdef7740 1 -- 172.21.15.59:0/1872852058 wait complete. 2024-09-10T21:17:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.893+0000 7f34fdef7740 20 client.15936 trim_cache size 0 max 16384 2024-09-10T21:17:50.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.906+0000 7f34fdef7740 1 Processor -- start 2024-09-10T21:17:50.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.906+0000 7f34fdef7740 1 -- start start 2024-09-10T21:17:50.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.907+0000 7f34fdef7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2de164d0 0x559d2de1a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:50.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.907+0000 7f34fdef7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de16df0 0x559d2de13c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:50.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.907+0000 7f34fdef7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de22d80 0x559d2de21840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:50.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.907+0000 7f34fdef7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f34f41b0660 con 0x559d2de16df0 2024-09-10T21:17:50.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.907+0000 7f34fdef7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f34f41b21a0 con 0x559d2de164d0 2024-09-10T21:17:50.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.907+0000 7f34fdef7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f34f41b0d30 con 0x559d2de22d80 2024-09-10T21:17:50.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.907+0000 7f34f98be640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de16df0 0x559d2de13c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:50.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.907+0000 7f34f98be640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de16df0 0x559d2de13c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40982/0 (socket says 172.21.15.59:40982) 2024-09-10T21:17:50.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.907+0000 7f34f98be640 1 -- 172.21.15.59:0/3048318258 learned_addr learned my addr 172.21.15.59:0/3048318258 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:50.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.907+0000 7f34f90bd640 1 --2- 172.21.15.59:0/3048318258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2de164d0 0x559d2de1a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:50.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.907+0000 7f34f90bd640 1 --2- 172.21.15.59:0/3048318258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de22d80 0x559d2de21840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:50.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.907+0000 7f34f98be640 1 -- 172.21.15.59:0/3048318258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de22d80 msgr2=0x559d2de21840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:50.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.907+0000 7f34f98be640 1 --2- 172.21.15.59:0/3048318258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de22d80 0x559d2de21840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.907+0000 7f34f98be640 1 -- 172.21.15.59:0/3048318258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2de164d0 msgr2=0x559d2de1a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:50.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.907+0000 7f34f98be640 1 --2- 172.21.15.59:0/3048318258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2de164d0 0x559d2de1a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.907+0000 7f34f98be640 1 -- 172.21.15.59:0/3048318258 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d2de1f8b0 con 0x559d2de16df0 2024-09-10T21:17:50.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.907+0000 7f34f90bd640 1 --2- 172.21.15.59:0/3048318258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de22d80 0x559d2de21840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:50.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.907+0000 7f34f98be640 1 --2- 172.21.15.59:0/3048318258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de16df0 0x559d2de13c10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f34f002ade0 tx=0x7f34f0005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c407b0ae9a2632 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:50.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.907+0000 7f34df7fe640 1 -- 172.21.15.59:0/3048318258 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f00318f0 con 0x559d2de16df0 2024-09-10T21:17:50.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.908+0000 7f34df7fe640 1 -- 172.21.15.59:0/3048318258 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34f0036040 con 0x559d2de16df0 2024-09-10T21:17:50.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.908+0000 7f34df7fe640 1 -- 172.21.15.59:0/3048318258 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f002f660 con 0x559d2de16df0 2024-09-10T21:17:50.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.908+0000 7f34fdef7740 1 -- 172.21.15.59:0/3048318258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de16df0 msgr2=0x559d2de13c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:50.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.908+0000 7f34fdef7740 1 --2- 172.21.15.59:0/3048318258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de16df0 0x559d2de13c10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f34f002ade0 tx=0x7f34f0005fa0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.908+0000 7f34fdef7740 1 -- 172.21.15.59:0/3048318258 shutdown_connections 2024-09-10T21:17:50.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.908+0000 7f34fdef7740 1 --2- 172.21.15.59:0/3048318258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de22d80 0x559d2de21840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.908+0000 7f34fdef7740 1 --2- 172.21.15.59:0/3048318258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de16df0 0x559d2de13c10 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.908+0000 7f34fdef7740 1 --2- 172.21.15.59:0/3048318258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2de164d0 0x559d2de1a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.908+0000 7f34fdef7740 1 -- 172.21.15.59:0/3048318258 >> 172.21.15.59:0/3048318258 conn(0x559d2de14300 msgr2=0x559d2de21130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:50.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.908+0000 7f34fdef7740 1 -- 172.21.15.59:0/3048318258 shutdown_connections 2024-09-10T21:17:50.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.908+0000 7f34fdef7740 1 -- 172.21.15.59:0/3048318258 wait complete. 2024-09-10T21:17:50.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.909+0000 7f34fdef7740 1 -- start start 2024-09-10T21:17:50.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.909+0000 7f34fdef7740 1 Processor -- start 2024-09-10T21:17:50.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.909+0000 7f34fdef7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de164d0 0x559d2de2af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:50.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.909+0000 7f34fdef7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2de16df0 0x559d2de2b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:50.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.909+0000 7f34fdef7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de22d80 0x559d2de25cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:50.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.909+0000 7f34fdef7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f34f41b1ad0 con 0x559d2de164d0 2024-09-10T21:17:50.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.909+0000 7f34fdef7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f34f41b1400 con 0x559d2de16df0 2024-09-10T21:17:50.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.909+0000 7f34fdef7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f34f41ae640 con 0x559d2de22d80 2024-09-10T21:17:50.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.909+0000 7f34fdef7740 10 client.0 _ll_register_callbacks cb 0x7f34e400acd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:50.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.909+0000 7f34f90bd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de164d0 0x559d2de2af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:50.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.909+0000 7f34f90bd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de164d0 0x559d2de2af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40984/0 (socket says 172.21.15.59:40984) 2024-09-10T21:17:50.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.909+0000 7f34f90bd640 1 -- 172.21.15.59:0/429185706 learned_addr learned my addr 172.21.15.59:0/429185706 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:50.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.910+0000 7f34f98be640 1 --2- 172.21.15.59:0/429185706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2de16df0 0x559d2de2b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:50.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.910+0000 7f34f90bd640 1 -- 172.21.15.59:0/429185706 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de22d80 msgr2=0x559d2de25cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:50.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.910+0000 7f34f90bd640 1 --2- 172.21.15.59:0/429185706 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de22d80 0x559d2de25cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.910+0000 7f34f90bd640 1 -- 172.21.15.59:0/429185706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2de16df0 msgr2=0x559d2de2b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:50.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.910+0000 7f34f90bd640 1 --2- 172.21.15.59:0/429185706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2de16df0 0x559d2de2b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.910+0000 7f34f90bd640 1 -- 172.21.15.59:0/429185706 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d2de264f0 con 0x559d2de164d0 2024-09-10T21:17:50.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.910+0000 7f34f90bd640 1 --2- 172.21.15.59:0/429185706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de164d0 0x559d2de2af90 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f34e400aba0 tx=0x7f34e400ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e421a3e52b6f39 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:50.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.910+0000 7f34dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:50.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.910+0000 7f34dd7fa640 1 -- 172.21.15.59:0/429185706 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e403c060 con 0x559d2de164d0 2024-09-10T21:17:50.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.910+0000 7f34dd7fa640 1 -- 172.21.15.59:0/429185706 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f34e4017240 con 0x559d2de164d0 2024-09-10T21:17:50.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.910+0000 7f34fdef7740 1 -- 172.21.15.59:0/429185706 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34f0036040 con 0x559d2de164d0 2024-09-10T21:17:50.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.910+0000 7f34dd7fa640 1 -- 172.21.15.59:0/429185706 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f34e4031070 con 0x559d2de164d0 2024-09-10T21:17:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.910+0000 7f34fdef7740 10 client.15942 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.910+0000 7f34fdef7740 1 -- 172.21.15.59:0/429185706 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559d2de9fde0 con 0x559d2de164d0 2024-09-10T21:17:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.911+0000 7f34dd7fa640 1 -- 172.21.15.59:0/429185706 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f34f0036040 con 0x559d2de164d0 2024-09-10T21:17:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.911+0000 7f34dd7fa640 1 -- 172.21.15.59:0/429185706 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f34e4012040 con 0x559d2de164d0 2024-09-10T21:17:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.911+0000 7f34fdef7740 10 client.15942 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.911+0000 7f34fdef7740 10 client.15942 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:17:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.911+0000 7f34fdef7740 20 client.15942 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.911+0000 7f34fdef7740 1 --2- 172.21.15.59:0/429185706 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559d2dea0530 0x559d2dea2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.911+0000 7f34fdef7740 4 client.15942 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:17:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.911+0000 7f34fdef7740 1 -- 172.21.15.59:0/429185706 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559d2dd8a8a0 con 0x559d2dea0530 2024-09-10T21:17:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.911+0000 7f34f98be640 1 --2- 172.21.15.59:0/429185706 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559d2dea0530 0x559d2dea2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.911+0000 7f34f98be640 1 --2- 172.21.15.59:0/429185706 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559d2dea0530 0x559d2dea2950 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c2d6791a1216dd3 server_cookie=13f0450736c720c6 in_seq=0 out_seq=0 2024-09-10T21:17:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.911+0000 7f34dd7fa640 10 client.15942 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.912+0000 7f34dd7fa640 1 -- 172.21.15.59:0/429185706 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559d2dd8a8a0 con 0x559d2dea0530 2024-09-10T21:17:50.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.912+0000 7f34dd7fa640 10 client.15942 handle_command_reply: tid=0 2024-09-10T21:17:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.912+0000 7f34fdef7740 1 client.15942 shutdown 2024-09-10T21:17:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.912+0000 7f34fdef7740 1 -- 172.21.15.59:0/429185706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de164d0 msgr2=0x559d2de2af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.912+0000 7f34fdef7740 1 --2- 172.21.15.59:0/429185706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de164d0 0x559d2de2af90 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f34e400aba0 tx=0x7f34e400ad80 comp rx=0 tx=0).stop 2024-09-10T21:17:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.912+0000 7f34fdef7740 1 -- 172.21.15.59:0/429185706 shutdown_connections 2024-09-10T21:17:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.912+0000 7f34fdef7740 1 --2- 172.21.15.59:0/429185706 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559d2de22d80 0x559d2de25cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.912+0000 7f34fdef7740 1 --2- 172.21.15.59:0/429185706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559d2de16df0 0x559d2de2b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.912+0000 7f34fdef7740 1 --2- 172.21.15.59:0/429185706 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559d2dea0530 0x559d2dea2950 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.912+0000 7f34fdef7740 1 --2- 172.21.15.59:0/429185706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559d2de164d0 0x559d2de2af90 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.912+0000 7f34fdef7740 1 -- 172.21.15.59:0/429185706 >> 172.21.15.59:0/429185706 conn(0x559d2de14300 msgr2=0x559d2de21950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.912+0000 7f34dd7fa640 0 client.15942 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.912+0000 7f34fdef7740 1 -- 172.21.15.59:0/429185706 shutdown_connections 2024-09-10T21:17:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.912+0000 7f34fdef7740 1 -- 172.21.15.59:0/429185706 wait complete. 2024-09-10T21:17:50.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.912+0000 7f34fdef7740 20 client.15942 trim_cache size 0 max 16384 2024-09-10T21:17:50.921 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:17:50.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.913+0000 7f34fbb22640 1 -- 172.21.15.59:0/4051200994 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f34e00b52e0 msgr2=0x7f34e00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:50.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.913+0000 7f34fbb22640 1 --2- 172.21.15.59:0/4051200994 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f34e00b52e0 0x7f34e00b77a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00bde0 tx=0x7f34ec0a0230 comp rx=0 tx=0).stop 2024-09-10T21:17:50.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.913+0000 7f34fbb22640 1 -- 172.21.15.59:0/4051200994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34f4109150 msgr2=0x7f34f4075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:50.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.913+0000 7f34fbb22640 1 --2- 172.21.15.59:0/4051200994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34f4109150 0x7f34f4075f20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f34ec009fd0 tx=0x7f34ec00b8e0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.913+0000 7f34fbb22640 1 -- 172.21.15.59:0/4051200994 shutdown_connections 2024-09-10T21:17:50.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.913+0000 7f34fbb22640 1 --2- 172.21.15.59:0/4051200994 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f34e00b52e0 0x7f34e00b77a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.913+0000 7f34fbb22640 1 --2- 172.21.15.59:0/4051200994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34f4109150 0x7f34f4075f20 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.913+0000 7f34fbb22640 1 --2- 172.21.15.59:0/4051200994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34f41087d0 0x7f34f40759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.913+0000 7f34fbb22640 1 --2- 172.21.15.59:0/4051200994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34f4102dc0 0x7f34f40754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:50.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.913+0000 7f34fbb22640 1 -- 172.21.15.59:0/4051200994 >> 172.21.15.59:0/4051200994 conn(0x7f34f40fe830 msgr2=0x7f34f4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:50.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.913+0000 7f34fbb22640 1 -- 172.21.15.59:0/4051200994 shutdown_connections 2024-09-10T21:17:50.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:50.913+0000 7f34fbb22640 1 -- 172.21.15.59:0/4051200994 wait complete. 2024-09-10T21:17:51.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:51 smithi059 ceph-mon[30888]: pgmap v417: 97 pgs: 97 active+clean; 1.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:51.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:51 smithi192 ceph-mon[35363]: pgmap v417: 97 pgs: 97 active+clean; 1.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:51.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:51 smithi154 ceph-mon[35041]: pgmap v417: 97 pgs: 97 active+clean; 1.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:52.751 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:17:52.751 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:17:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:17:53.298 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:53 smithi059 ceph-mon[30888]: pgmap v418: 97 pgs: 97 active+clean; 1.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:17:53.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:53 smithi192 ceph-mon[35363]: pgmap v418: 97 pgs: 97 active+clean; 1.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:17:53.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:53 smithi154 ceph-mon[35041]: pgmap v418: 97 pgs: 97 active+clean; 1.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:17:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.527+0000 7fbdf6aed640 1 -- 172.21.15.59:0/2592535173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf01087d0 msgr2=0x7fbdf0108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.527+0000 7fbdf6aed640 1 --2- 172.21.15.59:0/2592535173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf01087d0 0x7fbdf0108c10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8009900 tx=0x7fbdd802a410 comp rx=0 tx=0).stop 2024-09-10T21:17:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.527+0000 7fbdf6aed640 1 -- 172.21.15.59:0/2592535173 shutdown_connections 2024-09-10T21:17:53.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.527+0000 7fbdf6aed640 1 --2- 172.21.15.59:0/2592535173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf0109150 0x7fbdf010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.527+0000 7fbdf6aed640 1 --2- 172.21.15.59:0/2592535173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf01087d0 0x7fbdf0108c10 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.527+0000 7fbdf6aed640 1 --2- 172.21.15.59:0/2592535173 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdf0102dc0 0x7fbdf01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.527+0000 7fbdf6aed640 1 -- 172.21.15.59:0/2592535173 >> 172.21.15.59:0/2592535173 conn(0x7fbdf00fe830 msgr2=0x7fbdf0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:53.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.527+0000 7fbdf6aed640 1 -- 172.21.15.59:0/2592535173 shutdown_connections 2024-09-10T21:17:53.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.527+0000 7fbdf6aed640 1 -- 172.21.15.59:0/2592535173 wait complete. 2024-09-10T21:17:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdf6aed640 1 Processor -- start 2024-09-10T21:17:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdf6aed640 1 -- start start 2024-09-10T21:17:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdf6aed640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf0102dc0 0x7fbdf0199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdf6aed640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdf01087d0 0x7fbdf01997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdf6aed640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf0109150 0x7fbdf019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdf6aed640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf0112e10 con 0x7fbdf0102dc0 2024-09-10T21:17:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdf6aed640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf0112c90 con 0x7fbdf0109150 2024-09-10T21:17:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdf6aed640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf0112f90 con 0x7fbdf01087d0 2024-09-10T21:17:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdf4889640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf0102dc0 0x7fbdf0199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdf4889640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf0102dc0 0x7fbdf0199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40988/0 (socket says 172.21.15.59:40988) 2024-09-10T21:17:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdf4889640 1 -- 172.21.15.59:0/1351534608 learned_addr learned my addr 172.21.15.59:0/1351534608 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:53.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdeffff640 1 --2- 172.21.15.59:0/1351534608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdf01087d0 0x7fbdf01997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:53.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdf508a640 1 --2- 172.21.15.59:0/1351534608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf0109150 0x7fbdf019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:53.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdf4889640 1 -- 172.21.15.59:0/1351534608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdf01087d0 msgr2=0x7fbdf01997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:53.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdf4889640 1 --2- 172.21.15.59:0/1351534608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdf01087d0 0x7fbdf01997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdf4889640 1 -- 172.21.15.59:0/1351534608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf0109150 msgr2=0x7fbdf019eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:53.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdf4889640 1 --2- 172.21.15.59:0/1351534608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf0109150 0x7fbdf019eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdf4889640 1 -- 172.21.15.59:0/1351534608 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf019f330 con 0x7fbdf0102dc0 2024-09-10T21:17:53.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdf508a640 1 --2- 172.21.15.59:0/1351534608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf0109150 0x7fbdf019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:53.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.528+0000 7fbdeffff640 1 --2- 172.21.15.59:0/1351534608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdf01087d0 0x7fbdf01997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:53.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.529+0000 7fbdf4889640 1 --2- 172.21.15.59:0/1351534608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf0102dc0 0x7fbdf0199280 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fbde000c970 tx=0x7fbde000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:53.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.529+0000 7fbdedffb640 1 -- 172.21.15.59:0/1351534608 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde0007bb0 con 0x7fbdf0102dc0 2024-09-10T21:17:53.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.529+0000 7fbdedffb640 1 -- 172.21.15.59:0/1351534608 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbde0007d50 con 0x7fbdf0102dc0 2024-09-10T21:17:53.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.529+0000 7fbdf6aed640 1 -- 172.21.15.59:0/1351534608 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf019f620 con 0x7fbdf0102dc0 2024-09-10T21:17:53.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.529+0000 7fbdedffb640 1 -- 172.21.15.59:0/1351534608 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde000f450 con 0x7fbdf0102dc0 2024-09-10T21:17:53.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.529+0000 7fbdf6aed640 1 -- 172.21.15.59:0/1351534608 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf01a5ce0 con 0x7fbdf0102dc0 2024-09-10T21:17:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.531+0000 7fbdedffb640 1 -- 172.21.15.59:0/1351534608 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fbde0004f20 con 0x7fbdf0102dc0 2024-09-10T21:17:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.532+0000 7fbdf8ec2740 1 Processor -- start 2024-09-10T21:17:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.532+0000 7fbdf8ec2740 1 -- start start 2024-09-10T21:17:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.532+0000 7fbdf8ec2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d91ee0 0x557e36d922c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.532+0000 7fbdf8ec2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d92800 0x557e36d9e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.532+0000 7fbdf8ec2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557e36d9e790 0x557e36da0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.532+0000 7fbdf8ec2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557e36d08e60 con 0x557e36d91ee0 2024-09-10T21:17:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.532+0000 7fbdf8ec2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557e36cf8290 con 0x557e36d92800 2024-09-10T21:17:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.532+0000 7fbdf8ec2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557e36cfc0a0 con 0x557e36d9e790 2024-09-10T21:17:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.532+0000 7fbdf508a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d91ee0 0x557e36d922c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.532+0000 7fbdf508a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d91ee0 0x557e36d922c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41000/0 (socket says 172.21.15.59:41000) 2024-09-10T21:17:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.532+0000 7fbdf508a640 1 -- 172.21.15.59:0/1366134717 learned_addr learned my addr 172.21.15.59:0/1366134717 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.532+0000 7fbdf4889640 1 --2- 172.21.15.59:0/1366134717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d92800 0x557e36d9e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.532+0000 7fbdeffff640 1 --2- 172.21.15.59:0/1366134717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557e36d9e790 0x557e36da0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.533+0000 7fbdf508a640 1 -- 172.21.15.59:0/1366134717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557e36d9e790 msgr2=0x557e36da0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.533+0000 7fbdf508a640 1 --2- 172.21.15.59:0/1366134717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557e36d9e790 0x557e36da0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.533+0000 7fbdf508a640 1 -- 172.21.15.59:0/1366134717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d92800 msgr2=0x557e36d9e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.533+0000 7fbdf508a640 1 --2- 172.21.15.59:0/1366134717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d92800 0x557e36d9e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.533+0000 7fbdf508a640 1 -- 172.21.15.59:0/1366134717 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e36a56930 con 0x557e36d91ee0 2024-09-10T21:17:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.533+0000 7fbdf4889640 1 --2- 172.21.15.59:0/1366134717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d92800 0x557e36d9e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.533+0000 7fbdedffb640 1 --2- 172.21.15.59:0/1351534608 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbddc0b5360 0x7fbddc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.533+0000 7fbdf508a640 1 --2- 172.21.15.59:0/1366134717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d91ee0 0x557e36d922c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fbde8010370 tx=0x7fbde8010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a0b15487332e5d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.533+0000 7fbdf4889640 1 --2- 172.21.15.59:0/1351534608 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbddc0b5360 0x7fbddc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.533+0000 7fbdedffb640 1 -- 172.21.15.59:0/1351534608 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbde00e5980 con 0x7fbdf0102dc0 2024-09-10T21:17:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.533+0000 7fbde6ffd640 1 -- 172.21.15.59:0/1366134717 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8016070 con 0x557e36d91ee0 2024-09-10T21:17:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.533+0000 7fbde6ffd640 1 -- 172.21.15.59:0/1366134717 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbde8012bc0 con 0x557e36d91ee0 2024-09-10T21:17:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.533+0000 7fbde6ffd640 1 -- 172.21.15.59:0/1366134717 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde801bc80 con 0x557e36d91ee0 2024-09-10T21:17:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.534+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1366134717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d91ee0 msgr2=0x557e36d922c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.534+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/1366134717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d91ee0 0x557e36d922c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fbde8010370 tx=0x7fbde8010830 comp rx=0 tx=0).stop 2024-09-10T21:17:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.534+0000 7fbdf4889640 1 --2- 172.21.15.59:0/1351534608 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbddc0b5360 0x7fbddc0b7820 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbde00058c0 tx=0x7fbde0004980 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.534+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1366134717 shutdown_connections 2024-09-10T21:17:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.534+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/1366134717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557e36d9e790 0x557e36da0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.534+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/1366134717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d92800 0x557e36d9e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.534+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/1366134717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d91ee0 0x557e36d922c0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.534+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1366134717 >> 172.21.15.59:0/1366134717 conn(0x557e36d8fd10 msgr2=0x557e36d90eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.534+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1366134717 shutdown_connections 2024-09-10T21:17:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.534+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1366134717 wait complete. 2024-09-10T21:17:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.534+0000 7fbdf8ec2740 1 -- start start 2024-09-10T21:17:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.534+0000 7fbdf8ec2740 1 Processor -- start 2024-09-10T21:17:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdf8ec2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557e36d91ee0 0x557e36d9b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdf8ec2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d92800 0x557e36d9bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdf8ec2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d9e790 0x557e36d9c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdf8ec2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557e36b59890 con 0x557e36d9e790 2024-09-10T21:17:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdf8ec2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557e36c92d40 con 0x557e36d92800 2024-09-10T21:17:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdf8ec2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557e36da1440 con 0x557e36d91ee0 2024-09-10T21:17:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdf8ec2740 10 client.0 _ll_register_callbacks cb 0x557e36cf6c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdf508a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d9e790 0x557e36d9c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdf508a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d9e790 0x557e36d9c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41010/0 (socket says 172.21.15.59:41010) 2024-09-10T21:17:53.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdf508a640 1 -- 172.21.15.59:0/1050967541 learned_addr learned my addr 172.21.15.59:0/1050967541 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:53.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdf508a640 1 --2- 172.21.15.59:0/1050967541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557e36d91ee0 0x557e36d9b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:53.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdeffff640 1 --2- 172.21.15.59:0/1050967541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d92800 0x557e36d9bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:53.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdf508a640 1 -- 172.21.15.59:0/1050967541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557e36d91ee0 msgr2=0x557e36d9b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:53.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdf508a640 1 --2- 172.21.15.59:0/1050967541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557e36d91ee0 0x557e36d9b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdf508a640 1 -- 172.21.15.59:0/1050967541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d92800 msgr2=0x557e36d9bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:53.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdf508a640 1 --2- 172.21.15.59:0/1050967541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d92800 0x557e36d9bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdf508a640 1 -- 172.21.15.59:0/1050967541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e36daa7c0 con 0x557e36d9e790 2024-09-10T21:17:53.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdeffff640 1 --2- 172.21.15.59:0/1050967541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d92800 0x557e36d9bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:53.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdf508a640 1 --2- 172.21.15.59:0/1050967541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d9e790 0x557e36d9c170 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbde801bcf0 tx=0x7fbde801b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd9da0807901a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:53.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.535+0000 7fbdcffff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:53.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.536+0000 7fbdcffff640 1 -- 172.21.15.59:0/1050967541 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde802e060 con 0x557e36d9e790 2024-09-10T21:17:53.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.536+0000 7fbdcffff640 1 -- 172.21.15.59:0/1050967541 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbde8012720 con 0x557e36d9e790 2024-09-10T21:17:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.536+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1050967541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbde8012bc0 con 0x557e36d9e790 2024-09-10T21:17:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.536+0000 7fbdcffff640 1 -- 172.21.15.59:0/1050967541 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbde8016030 con 0x557e36d9e790 2024-09-10T21:17:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.536+0000 7fbdf8ec2740 10 client.15954 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.536+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1050967541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557e36dad0c0 con 0x557e36d9e790 2024-09-10T21:17:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.536+0000 7fbdcffff640 1 -- 172.21.15.59:0/1050967541 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbde8012bc0 con 0x557e36d9e790 2024-09-10T21:17:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.536+0000 7fbdcffff640 1 -- 172.21.15.59:0/1050967541 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbde800f040 con 0x557e36d9e790 2024-09-10T21:17:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.536+0000 7fbdf8ec2740 10 client.15954 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.536+0000 7fbdf8ec2740 10 client.15954 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:17:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.536+0000 7fbdf8ec2740 20 client.15954 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.536+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/1050967541 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557e36dae4d0 0x557e36db08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.536+0000 7fbdf8ec2740 4 client.15954 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:17:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.536+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1050967541 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e36d0adb0 con 0x557e36dae4d0 2024-09-10T21:17:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.537+0000 7fbdeffff640 1 --2- 172.21.15.59:0/1050967541 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557e36dae4d0 0x557e36db08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.537+0000 7fbdeffff640 1 --2- 172.21.15.59:0/1050967541 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557e36dae4d0 0x557e36db08c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3216dd3c2e0318 server_cookie=fcd4b3f5ed96bc96 in_seq=0 out_seq=0 2024-09-10T21:17:53.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.537+0000 7fbdcffff640 10 client.15954 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.538+0000 7fbdcffff640 1 -- 172.21.15.59:0/1050967541 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557e36d0adb0 con 0x557e36dae4d0 2024-09-10T21:17:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.538+0000 7fbdcffff640 10 client.15954 handle_command_reply: tid=0 2024-09-10T21:17:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.538+0000 7fbdf8ec2740 1 client.15954 shutdown 2024-09-10T21:17:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.538+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1050967541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d9e790 msgr2=0x557e36d9c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.538+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/1050967541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d9e790 0x557e36d9c170 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbde801bcf0 tx=0x7fbde801b860 comp rx=0 tx=0).stop 2024-09-10T21:17:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.538+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1050967541 shutdown_connections 2024-09-10T21:17:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.538+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/1050967541 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557e36dae4d0 0x557e36db08c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.538+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/1050967541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d9e790 0x557e36d9c170 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.538+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/1050967541 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d92800 0x557e36d9bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.538+0000 7fbdcffff640 0 client.15954 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.538+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/1050967541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557e36d91ee0 0x557e36d9b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.538+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1050967541 >> 172.21.15.59:0/1050967541 conn(0x557e36d8fd10 msgr2=0x557e36d8ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.538+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1050967541 shutdown_connections 2024-09-10T21:17:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.538+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1050967541 wait complete. 2024-09-10T21:17:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.538+0000 7fbdf8ec2740 20 client.15954 trim_cache size 0 max 16384 2024-09-10T21:17:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.556+0000 7fbdf8ec2740 1 Processor -- start 2024-09-10T21:17:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.556+0000 7fbdf8ec2740 1 -- start start 2024-09-10T21:17:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.556+0000 7fbdf8ec2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d91ee0 0x557e36d9bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.556+0000 7fbdf8ec2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d92800 0x557e36d98900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.556+0000 7fbdf8ec2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557e36d9e790 0x557e36d98e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.556+0000 7fbdf8ec2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf01ae320 con 0x557e36d91ee0 2024-09-10T21:17:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.556+0000 7fbdf8ec2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf01afe60 con 0x557e36d92800 2024-09-10T21:17:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.556+0000 7fbdf8ec2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf01ae9f0 con 0x557e36d9e790 2024-09-10T21:17:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.556+0000 7fbdf508a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d91ee0 0x557e36d9bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.557+0000 7fbdf508a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d91ee0 0x557e36d9bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41018/0 (socket says 172.21.15.59:41018) 2024-09-10T21:17:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.557+0000 7fbdf508a640 1 -- 172.21.15.59:0/3459505127 learned_addr learned my addr 172.21.15.59:0/3459505127 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.557+0000 7fbdeffff640 1 --2- 172.21.15.59:0/3459505127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d92800 0x557e36d98900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.557+0000 7fbdf508a640 1 -- 172.21.15.59:0/3459505127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557e36d9e790 msgr2=0x557e36d98e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.557+0000 7fbdf508a640 1 --2- 172.21.15.59:0/3459505127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557e36d9e790 0x557e36d98e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.557+0000 7fbdf508a640 1 -- 172.21.15.59:0/3459505127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d92800 msgr2=0x557e36d98900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.557+0000 7fbdf508a640 1 --2- 172.21.15.59:0/3459505127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d92800 0x557e36d98900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.557+0000 7fbdf508a640 1 -- 172.21.15.59:0/3459505127 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e36d90790 con 0x557e36d91ee0 2024-09-10T21:17:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.557+0000 7fbdf508a640 1 --2- 172.21.15.59:0/3459505127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d91ee0 0x557e36d9bd70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009d40 tx=0x7fbde8009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad060aef9b5a7666 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.557+0000 7fbde67fc640 1 -- 172.21.15.59:0/3459505127 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde802e070 con 0x557e36d91ee0 2024-09-10T21:17:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.557+0000 7fbde67fc640 1 -- 172.21.15.59:0/3459505127 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbde801b8d0 con 0x557e36d91ee0 2024-09-10T21:17:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.557+0000 7fbde67fc640 1 -- 172.21.15.59:0/3459505127 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8012cb0 con 0x557e36d91ee0 2024-09-10T21:17:53.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.558+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/3459505127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d91ee0 msgr2=0x557e36d9bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:53.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.558+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/3459505127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d91ee0 0x557e36d9bd70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009d40 tx=0x7fbde8009ba0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.558+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/3459505127 shutdown_connections 2024-09-10T21:17:53.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.558+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/3459505127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557e36d9e790 0x557e36d98e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.558+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/3459505127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d92800 0x557e36d98900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.558+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/3459505127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d91ee0 0x557e36d9bd70 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.558+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/3459505127 >> 172.21.15.59:0/3459505127 conn(0x557e36d8fd10 msgr2=0x557e36d9b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:53.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.558+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/3459505127 shutdown_connections 2024-09-10T21:17:53.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.558+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/3459505127 wait complete. 2024-09-10T21:17:53.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.558+0000 7fbdf8ec2740 1 -- start start 2024-09-10T21:17:53.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.558+0000 7fbdf8ec2740 1 Processor -- start 2024-09-10T21:17:53.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdf8ec2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557e36d91ee0 0x557e36da2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:53.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdf8ec2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d92800 0x557e36da2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:53.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdf8ec2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d9e790 0x557e36da32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:53.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdf8ec2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf01af790 con 0x557e36d92800 2024-09-10T21:17:53.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdf8ec2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf01af0c0 con 0x557e36d9e790 2024-09-10T21:17:53.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdf8ec2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf01ac300 con 0x557e36d91ee0 2024-09-10T21:17:53.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdf8ec2740 10 client.0 _ll_register_callbacks cb 0x7fbde8009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:53.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdeffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d92800 0x557e36da2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:53.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdeffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d92800 0x557e36da2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41028/0 (socket says 172.21.15.59:41028) 2024-09-10T21:17:53.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdeffff640 1 -- 172.21.15.59:0/1692484513 learned_addr learned my addr 172.21.15.59:0/1692484513 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:53.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdf508a640 1 --2- 172.21.15.59:0/1692484513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557e36d91ee0 0x557e36da2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:53.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdeffff640 1 -- 172.21.15.59:0/1692484513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557e36d91ee0 msgr2=0x557e36da2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:53.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdf508a640 1 --2- 172.21.15.59:0/1692484513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d9e790 0x557e36da32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:53.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdeffff640 1 --2- 172.21.15.59:0/1692484513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557e36d91ee0 0x557e36da2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdeffff640 1 -- 172.21.15.59:0/1692484513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d9e790 msgr2=0x557e36da32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:53.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdeffff640 1 --2- 172.21.15.59:0/1692484513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d9e790 0x557e36da32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdeffff640 1 -- 172.21.15.59:0/1692484513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e36e1a310 con 0x557e36d92800 2024-09-10T21:17:53.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdf508a640 1 --2- 172.21.15.59:0/1692484513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d9e790 0x557e36da32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:53.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdeffff640 1 --2- 172.21.15.59:0/1692484513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d92800 0x557e36da2d70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8031440 tx=0x7fbdd8009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e733a8ba446ee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:53.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.559+0000 7fbdcffff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:53.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.560+0000 7fbdcffff640 1 -- 172.21.15.59:0/1692484513 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd8035040 con 0x557e36d92800 2024-09-10T21:17:53.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.560+0000 7fbdcffff640 1 -- 172.21.15.59:0/1692484513 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbdd8004390 con 0x557e36d92800 2024-09-10T21:17:53.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.560+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1692484513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557e36d06860 con 0x557e36d92800 2024-09-10T21:17:53.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.560+0000 7fbdcffff640 1 -- 172.21.15.59:0/1692484513 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbdd8005040 con 0x557e36d92800 2024-09-10T21:17:53.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.560+0000 7fbdf8ec2740 10 client.15960 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:53.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.560+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1692484513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557e36e1b680 con 0x557e36d92800 2024-09-10T21:17:53.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.560+0000 7fbdcffff640 1 -- 172.21.15.59:0/1692484513 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557e36d06860 con 0x557e36d92800 2024-09-10T21:17:53.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.560+0000 7fbdcffff640 1 -- 172.21.15.59:0/1692484513 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbdd8004cd0 con 0x557e36d92800 2024-09-10T21:17:53.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.560+0000 7fbdf8ec2740 10 client.15960 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:53.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.560+0000 7fbdf8ec2740 10 client.15960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:17:53.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.560+0000 7fbdf8ec2740 20 client.15960 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:53.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.560+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/1692484513 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557e36e1be00 0x557e36e1e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:53.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.560+0000 7fbdf8ec2740 4 client.15960 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:17:53.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.560+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1692484513 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557e36d03c90 con 0x557e36e1be00 2024-09-10T21:17:53.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.561+0000 7fbdf508a640 1 --2- 172.21.15.59:0/1692484513 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557e36e1be00 0x557e36e1e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:53.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.561+0000 7fbdf508a640 1 --2- 172.21.15.59:0/1692484513 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557e36e1be00 0x557e36e1e220 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91af8a52f088d5f9 server_cookie=310c5eb00208247c in_seq=0 out_seq=0 2024-09-10T21:17:53.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.561+0000 7fbdcffff640 10 client.15960 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:53.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.562+0000 7fbdcffff640 1 -- 172.21.15.59:0/1692484513 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557e36d03c90 con 0x557e36e1be00 2024-09-10T21:17:53.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.562+0000 7fbdcffff640 10 client.15960 handle_command_reply: tid=0 2024-09-10T21:17:53.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.562+0000 7fbdf8ec2740 1 client.15960 shutdown 2024-09-10T21:17:53.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.563+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1692484513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d92800 msgr2=0x557e36da2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:53.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.563+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/1692484513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d92800 0x557e36da2d70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8031440 tx=0x7fbdd8009680 comp rx=0 tx=0).stop 2024-09-10T21:17:53.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.563+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1692484513 shutdown_connections 2024-09-10T21:17:53.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.563+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/1692484513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557e36d9e790 0x557e36da32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.563+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/1692484513 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557e36e1be00 0x557e36e1e220 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.563+0000 7fbdcffff640 0 client.15960 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:53.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.563+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/1692484513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557e36d92800 0x557e36da2d70 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.563+0000 7fbdf8ec2740 1 --2- 172.21.15.59:0/1692484513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557e36d91ee0 0x557e36da2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.563+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1692484513 >> 172.21.15.59:0/1692484513 conn(0x557e36d8fd10 msgr2=0x557e36d9be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:53.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.563+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1692484513 shutdown_connections 2024-09-10T21:17:53.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.563+0000 7fbdf8ec2740 1 -- 172.21.15.59:0/1692484513 wait complete. 2024-09-10T21:17:53.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.563+0000 7fbdf8ec2740 20 client.15960 trim_cache size 0 max 16384 2024-09-10T21:17:53.573 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:17:53.573 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:17:53.574 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "3015d1d1-d386-4ffb-9222-3fd73032185b", 2024-09-10T21:17:53.574 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:17:53.574 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:17:53.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.564+0000 7fbdf6aed640 1 -- 172.21.15.59:0/1351534608 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbddc0b5360 msgr2=0x7fbddc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:53.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.564+0000 7fbdf6aed640 1 --2- 172.21.15.59:0/1351534608 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbddc0b5360 0x7fbddc0b7820 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbde00058c0 tx=0x7fbde0004980 comp rx=0 tx=0).stop 2024-09-10T21:17:53.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.564+0000 7fbdf6aed640 1 -- 172.21.15.59:0/1351534608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf0102dc0 msgr2=0x7fbdf0199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:53.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.564+0000 7fbdf6aed640 1 --2- 172.21.15.59:0/1351534608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf0102dc0 0x7fbdf0199280 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fbde000c970 tx=0x7fbde000ce30 comp rx=0 tx=0).stop 2024-09-10T21:17:53.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.564+0000 7fbdf6aed640 1 -- 172.21.15.59:0/1351534608 shutdown_connections 2024-09-10T21:17:53.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.564+0000 7fbdf6aed640 1 --2- 172.21.15.59:0/1351534608 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbddc0b5360 0x7fbddc0b7820 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.564+0000 7fbdf6aed640 1 --2- 172.21.15.59:0/1351534608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbdf0109150 0x7fbdf019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.564+0000 7fbdf6aed640 1 --2- 172.21.15.59:0/1351534608 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdf01087d0 0x7fbdf01997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.564+0000 7fbdf6aed640 1 --2- 172.21.15.59:0/1351534608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdf0102dc0 0x7fbdf0199280 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:53.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.564+0000 7fbdf6aed640 1 -- 172.21.15.59:0/1351534608 >> 172.21.15.59:0/1351534608 conn(0x7fbdf00fe830 msgr2=0x7fbdf0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:53.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.564+0000 7fbdf6aed640 1 -- 172.21.15.59:0/1351534608 shutdown_connections 2024-09-10T21:17:53.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:53.564+0000 7fbdf6aed640 1 -- 172.21.15.59:0/1351534608 wait complete. 2024-09-10T21:17:54.280 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:17:54.540 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:17:55.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:54.999+0000 7fcfbe962640 1 -- 172.21.15.59:0/249169812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb81076b0 msgr2=0x7fcfb8107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:55.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:54.999+0000 7fcfbe962640 1 --2- 172.21.15.59:0/249169812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb81076b0 0x7fcfb8107af0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009900 tx=0x7fcfa002a410 comp rx=0 tx=0).stop 2024-09-10T21:17:55.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:54.999+0000 7fcfbe962640 1 -- 172.21.15.59:0/249169812 shutdown_connections 2024-09-10T21:17:55.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:54.999+0000 7fcfbe962640 1 --2- 172.21.15.59:0/249169812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfb8108030 0x7fcfb810e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:54.999+0000 7fcfbe962640 1 --2- 172.21.15.59:0/249169812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb81076b0 0x7fcfb8107af0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:54.999+0000 7fcfbe962640 1 --2- 172.21.15.59:0/249169812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb8101ca0 0x7fcfb8102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:54.999+0000 7fcfbe962640 1 -- 172.21.15.59:0/249169812 >> 172.21.15.59:0/249169812 conn(0x7fcfb80fd730 msgr2=0x7fcfb80ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:55.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:54.999+0000 7fcfbe962640 1 -- 172.21.15.59:0/249169812 shutdown_connections 2024-09-10T21:17:55.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:54.999+0000 7fcfbe962640 1 -- 172.21.15.59:0/249169812 wait complete. 2024-09-10T21:17:55.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.000+0000 7fcfbe962640 1 Processor -- start 2024-09-10T21:17:55.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.000+0000 7fcfbe962640 1 -- start start 2024-09-10T21:17:55.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.000+0000 7fcfbe962640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb8101ca0 0x7fcfb81992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:55.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.000+0000 7fcfbe962640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb81076b0 0x7fcfb8199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:55.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.000+0000 7fcfbe962640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfb8108030 0x7fcfb819ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:55.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.000+0000 7fcfbe962640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb8111cf0 con 0x7fcfb81076b0 2024-09-10T21:17:55.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.000+0000 7fcfbe962640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb8111b70 con 0x7fcfb8101ca0 2024-09-10T21:17:55.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.000+0000 7fcfbe962640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb8111e70 con 0x7fcfb8108030 2024-09-10T21:17:55.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.000+0000 7fcfaffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb81076b0 0x7fcfb8199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.000+0000 7fcfaffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb81076b0 0x7fcfb8199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41048/0 (socket says 172.21.15.59:41048) 2024-09-10T21:17:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.000+0000 7fcfaffff640 1 -- 172.21.15.59:0/1168024788 learned_addr learned my addr 172.21.15.59:0/1168024788 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.000+0000 7fcfbceff640 1 --2- 172.21.15.59:0/1168024788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfb8108030 0x7fcfb819ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.000+0000 7fcfb7fff640 1 --2- 172.21.15.59:0/1168024788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb8101ca0 0x7fcfb81992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.000+0000 7fcfaffff640 1 -- 172.21.15.59:0/1168024788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfb8108030 msgr2=0x7fcfb819ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.000+0000 7fcfaffff640 1 --2- 172.21.15.59:0/1168024788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfb8108030 0x7fcfb819ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.000+0000 7fcfaffff640 1 -- 172.21.15.59:0/1168024788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb8101ca0 msgr2=0x7fcfb81992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.000+0000 7fcfaffff640 1 --2- 172.21.15.59:0/1168024788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb8101ca0 0x7fcfb81992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.000+0000 7fcfaffff640 1 -- 172.21.15.59:0/1168024788 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb819f390 con 0x7fcfb81076b0 2024-09-10T21:17:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.000+0000 7fcfb7fff640 1 --2- 172.21.15.59:0/1168024788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb8101ca0 0x7fcfb81992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:55.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.001+0000 7fcfaffff640 1 --2- 172.21.15.59:0/1168024788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb81076b0 0x7fcfb8199820 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0005940 tx=0x7fcfa00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:55.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.001+0000 7fcfb5ffb640 1 -- 172.21.15.59:0/1168024788 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa003f030 con 0x7fcfb81076b0 2024-09-10T21:17:55.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.001+0000 7fcfb5ffb640 1 -- 172.21.15.59:0/1168024788 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfa0003cb0 con 0x7fcfb81076b0 2024-09-10T21:17:55.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.001+0000 7fcfbe962640 1 -- 172.21.15.59:0/1168024788 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb819f620 con 0x7fcfb81076b0 2024-09-10T21:17:55.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.001+0000 7fcfb5ffb640 1 -- 172.21.15.59:0/1168024788 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0035070 con 0x7fcfb81076b0 2024-09-10T21:17:55.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.001+0000 7fcfbe962640 1 -- 172.21.15.59:0/1168024788 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb81a5d40 con 0x7fcfb81076b0 2024-09-10T21:17:55.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.003+0000 7fcfb5ffb640 1 -- 172.21.15.59:0/1168024788 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fcfa003bbf0 con 0x7fcfb81076b0 2024-09-10T21:17:55.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.003+0000 7fcfc0d37740 1 Processor -- start 2024-09-10T21:17:55.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.004+0000 7fcfc0d37740 1 -- start start 2024-09-10T21:17:55.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.004+0000 7fcfc0d37740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 0x5582b586d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:55.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.004+0000 7fcfc0d37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b586dda0 0x5582b587dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:55.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.004+0000 7fcfc0d37740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b587e140 0x5582b5880530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:55.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.004+0000 7fcfc0d37740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5582b57e3e50 con 0x5582b586d480 2024-09-10T21:17:55.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.004+0000 7fcfc0d37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5582b57d3280 con 0x5582b586dda0 2024-09-10T21:17:55.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.004+0000 7fcfc0d37740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5582b57d7090 con 0x5582b587e140 2024-09-10T21:17:55.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.004+0000 7fcfbceff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 0x5582b586d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:55.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.004+0000 7fcfbceff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 0x5582b586d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41064/0 (socket says 172.21.15.59:41064) 2024-09-10T21:17:55.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.004+0000 7fcfbceff640 1 -- 172.21.15.59:0/1798015505 learned_addr learned my addr 172.21.15.59:0/1798015505 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:55.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.004+0000 7fcfb7fff640 1 --2- 172.21.15.59:0/1798015505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b586dda0 0x5582b587dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:55.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.004+0000 7fcfaffff640 1 --2- 172.21.15.59:0/1798015505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b587e140 0x5582b5880530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:55.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.004+0000 7fcfbceff640 1 -- 172.21.15.59:0/1798015505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b587e140 msgr2=0x5582b5880530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:55.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.004+0000 7fcfbceff640 1 --2- 172.21.15.59:0/1798015505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b587e140 0x5582b5880530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.004+0000 7fcfbceff640 1 -- 172.21.15.59:0/1798015505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b586dda0 msgr2=0x5582b587dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:55.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.004+0000 7fcfbceff640 1 --2- 172.21.15.59:0/1798015505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b586dda0 0x5582b587dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.004+0000 7fcfbceff640 1 -- 172.21.15.59:0/1798015505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582b5531650 con 0x5582b586d480 2024-09-10T21:17:55.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.005+0000 7fcfbceff640 1 --2- 172.21.15.59:0/1798015505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 0x5582b586d860 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009f10 tx=0x7fcfb0010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b688d0a6c6688e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:55.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.005+0000 7fcfae7fc640 1 -- 172.21.15.59:0/1798015505 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0016070 con 0x5582b586d480 2024-09-10T21:17:55.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.005+0000 7fcfb5ffb640 1 --2- 172.21.15.59:0/1168024788 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcfa40b5360 0x7fcfa40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:55.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.005+0000 7fcfae7fc640 1 -- 172.21.15.59:0/1798015505 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfb0004d20 con 0x5582b586d480 2024-09-10T21:17:55.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.005+0000 7fcfae7fc640 1 -- 172.21.15.59:0/1798015505 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb00127b0 con 0x5582b586d480 2024-09-10T21:17:55.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.005+0000 7fcfb7fff640 1 --2- 172.21.15.59:0/1168024788 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcfa40b5360 0x7fcfa40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:55.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.005+0000 7fcfb5ffb640 1 -- 172.21.15.59:0/1168024788 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcfa0106790 con 0x7fcfb81076b0 2024-09-10T21:17:55.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.006+0000 7fcfc0d37740 1 -- 172.21.15.59:0/1798015505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 msgr2=0x5582b586d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:55.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.006+0000 7fcfb7fff640 1 --2- 172.21.15.59:0/1168024788 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcfa40b5360 0x7fcfa40b7820 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x5582b586cf60 tx=0x7fcfa8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:55.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.006+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/1798015505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 0x5582b586d860 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009f10 tx=0x7fcfb0010740 comp rx=0 tx=0).stop 2024-09-10T21:17:55.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.006+0000 7fcfc0d37740 1 -- 172.21.15.59:0/1798015505 shutdown_connections 2024-09-10T21:17:55.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.006+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/1798015505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b587e140 0x5582b5880530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.006+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/1798015505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b586dda0 0x5582b587dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.006+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/1798015505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 0x5582b586d860 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.006+0000 7fcfc0d37740 1 -- 172.21.15.59:0/1798015505 >> 172.21.15.59:0/1798015505 conn(0x5582b586b2b0 msgr2=0x5582b586c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:55.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.006+0000 7fcfc0d37740 1 -- 172.21.15.59:0/1798015505 shutdown_connections 2024-09-10T21:17:55.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.006+0000 7fcfc0d37740 1 -- 172.21.15.59:0/1798015505 wait complete. 2024-09-10T21:17:55.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.006+0000 7fcfc0d37740 1 -- start start 2024-09-10T21:17:55.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.006+0000 7fcfc0d37740 1 Processor -- start 2024-09-10T21:17:55.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.006+0000 7fcfc0d37740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 0x5582b587da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:55.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.006+0000 7fcfc0d37740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b586dda0 0x5582b587aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:55.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.006+0000 7fcfc0d37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b587e140 0x5582b587b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:55.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.006+0000 7fcfc0d37740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5582b5634700 con 0x5582b586d480 2024-09-10T21:17:55.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.006+0000 7fcfc0d37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5582b576e110 con 0x5582b587e140 2024-09-10T21:17:55.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.006+0000 7fcfc0d37740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5582b5880df0 con 0x5582b586dda0 2024-09-10T21:17:55.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.007+0000 7fcfc0d37740 10 client.0 _ll_register_callbacks cb 0x5582b5787990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:55.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.007+0000 7fcfb7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 0x5582b587da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:55.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.007+0000 7fcfb7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 0x5582b587da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41068/0 (socket says 172.21.15.59:41068) 2024-09-10T21:17:55.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.007+0000 7fcfb7fff640 1 -- 172.21.15.59:0/1455893247 learned_addr learned my addr 172.21.15.59:0/1455893247 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:55.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.007+0000 7fcfaffff640 1 --2- 172.21.15.59:0/1455893247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b586dda0 0x5582b587aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:55.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.007+0000 7fcfbceff640 1 --2- 172.21.15.59:0/1455893247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b587e140 0x5582b587b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:55.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.007+0000 7fcfb7fff640 1 -- 172.21.15.59:0/1455893247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b586dda0 msgr2=0x5582b587aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:55.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.007+0000 7fcfb7fff640 1 --2- 172.21.15.59:0/1455893247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b586dda0 0x5582b587aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.007+0000 7fcfb7fff640 1 -- 172.21.15.59:0/1455893247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b587e140 msgr2=0x5582b587b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:55.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.007+0000 7fcfb7fff640 1 --2- 172.21.15.59:0/1455893247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b587e140 0x5582b587b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.007+0000 7fcfb7fff640 1 -- 172.21.15.59:0/1455893247 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582b579bc40 con 0x5582b586d480 2024-09-10T21:17:55.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.007+0000 7fcfb7fff640 1 --2- 172.21.15.59:0/1455893247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 0x5582b587da70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80157f0 tx=0x7fcfa80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20b589765a0382d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:55.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.007+0000 7fcf977fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:55.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.007+0000 7fcf977fe640 1 -- 172.21.15.59:0/1455893247 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8023070 con 0x5582b586d480 2024-09-10T21:17:55.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.007+0000 7fcf977fe640 1 -- 172.21.15.59:0/1455893247 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcfa8013b20 con 0x5582b586d480 2024-09-10T21:17:55.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.007+0000 7fcfc0d37740 1 -- 172.21.15.59:0/1455893247 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfb0004d20 con 0x5582b586d480 2024-09-10T21:17:55.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.008+0000 7fcf977fe640 1 -- 172.21.15.59:0/1455893247 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcfa802f050 con 0x5582b586d480 2024-09-10T21:17:55.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.008+0000 7fcfc0d37740 10 client.15972 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:55.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.008+0000 7fcfc0d37740 1 -- 172.21.15.59:0/1455893247 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5582b588c7f0 con 0x5582b586d480 2024-09-10T21:17:55.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.008+0000 7fcf977fe640 1 -- 172.21.15.59:0/1455893247 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfb0004d20 con 0x5582b586d480 2024-09-10T21:17:55.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.008+0000 7fcf977fe640 1 -- 172.21.15.59:0/1455893247 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcfa801e070 con 0x5582b586d480 2024-09-10T21:17:55.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.008+0000 7fcfc0d37740 10 client.15972 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:55.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.008+0000 7fcfc0d37740 10 client.15972 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:17:55.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.008+0000 7fcfc0d37740 20 client.15972 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:55.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.008+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/1455893247 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5582b588dca0 0x5582b58900b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:55.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.008+0000 7fcfc0d37740 4 client.15972 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:17:55.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.008+0000 7fcfc0d37740 1 -- 172.21.15.59:0/1455893247 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582b57e5da0 con 0x5582b588dca0 2024-09-10T21:17:55.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.008+0000 7fcfaffff640 1 --2- 172.21.15.59:0/1455893247 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5582b588dca0 0x5582b58900b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:55.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.009+0000 7fcfaffff640 1 --2- 172.21.15.59:0/1455893247 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5582b588dca0 0x5582b58900b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fa35df93e5245ea server_cookie=3dfb3c3c7a7321dd in_seq=0 out_seq=0 2024-09-10T21:17:55.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.009+0000 7fcf977fe640 10 client.15972 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.009+0000 7fcf977fe640 1 -- 172.21.15.59:0/1455893247 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5582b57e5da0 con 0x5582b588dca0 2024-09-10T21:17:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.009+0000 7fcf977fe640 10 client.15972 handle_command_reply: tid=0 2024-09-10T21:17:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.009+0000 7fcfc0d37740 1 client.15972 shutdown 2024-09-10T21:17:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.010+0000 7fcfc0d37740 1 -- 172.21.15.59:0/1455893247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 msgr2=0x5582b587da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.010+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/1455893247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 0x5582b587da70 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80157f0 tx=0x7fcfa80046c0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.010+0000 7fcfc0d37740 1 -- 172.21.15.59:0/1455893247 shutdown_connections 2024-09-10T21:17:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.010+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/1455893247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b587e140 0x5582b587b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.010+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/1455893247 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b586dda0 0x5582b587aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.010+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/1455893247 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5582b588dca0 0x5582b58900b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.010+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/1455893247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 0x5582b587da70 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.010+0000 7fcf977fe640 0 client.15972 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.010+0000 7fcfc0d37740 1 -- 172.21.15.59:0/1455893247 >> 172.21.15.59:0/1455893247 conn(0x5582b586b2b0 msgr2=0x5582b586a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.010+0000 7fcfc0d37740 1 -- 172.21.15.59:0/1455893247 shutdown_connections 2024-09-10T21:17:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.010+0000 7fcfc0d37740 1 -- 172.21.15.59:0/1455893247 wait complete. 2024-09-10T21:17:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.010+0000 7fcfc0d37740 20 client.15972 trim_cache size 0 max 16384 2024-09-10T21:17:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.027+0000 7fcfc0d37740 1 Processor -- start 2024-09-10T21:17:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.027+0000 7fcfc0d37740 1 -- start start 2024-09-10T21:17:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.027+0000 7fcfc0d37740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 0x5582b586abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.027+0000 7fcfc0d37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b586dda0 0x5582b588a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.027+0000 7fcfc0d37740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b587e140 0x5582b587a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.027+0000 7fcfc0d37740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb81ac160 con 0x5582b586d480 2024-09-10T21:17:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.027+0000 7fcfc0d37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb81adca0 con 0x5582b586dda0 2024-09-10T21:17:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.027+0000 7fcfc0d37740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb81ac830 con 0x5582b587e140 2024-09-10T21:17:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.028+0000 7fcfb7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 0x5582b586abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:55.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.028+0000 7fcfb7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 0x5582b586abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41074/0 (socket says 172.21.15.59:41074) 2024-09-10T21:17:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.028+0000 7fcfb7fff640 1 -- 172.21.15.59:0/2092979451 learned_addr learned my addr 172.21.15.59:0/2092979451 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.028+0000 7fcfb7fff640 1 -- 172.21.15.59:0/2092979451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b587e140 msgr2=0x5582b587a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.028+0000 7fcfaffff640 1 --2- 172.21.15.59:0/2092979451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b586dda0 0x5582b588a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.028+0000 7fcfbceff640 1 --2- 172.21.15.59:0/2092979451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b587e140 0x5582b587a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.028+0000 7fcfb7fff640 1 --2- 172.21.15.59:0/2092979451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b587e140 0x5582b587a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.028+0000 7fcfb7fff640 1 -- 172.21.15.59:0/2092979451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b586dda0 msgr2=0x5582b588a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.028+0000 7fcfb7fff640 1 --2- 172.21.15.59:0/2092979451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b586dda0 0x5582b588a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.028+0000 7fcfb7fff640 1 -- 172.21.15.59:0/2092979451 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582b587ea80 con 0x5582b586d480 2024-09-10T21:17:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.028+0000 7fcfbceff640 1 --2- 172.21.15.59:0/2092979451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b587e140 0x5582b587a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.028+0000 7fcfaffff640 1 --2- 172.21.15.59:0/2092979451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b586dda0 0x5582b588a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.028+0000 7fcfb7fff640 1 --2- 172.21.15.59:0/2092979451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 0x5582b586abc0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800a3c0 tx=0x7fcfa800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca63dbd59a94419 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.028+0000 7fcfadffb640 1 -- 172.21.15.59:0/2092979451 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8023040 con 0x5582b586d480 2024-09-10T21:17:55.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.028+0000 7fcfadffb640 1 -- 172.21.15.59:0/2092979451 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfa8019070 con 0x5582b586d480 2024-09-10T21:17:55.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.028+0000 7fcfadffb640 1 -- 172.21.15.59:0/2092979451 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa801f3f0 con 0x5582b586d480 2024-09-10T21:17:55.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.029+0000 7fcfc0d37740 1 -- 172.21.15.59:0/2092979451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 msgr2=0x5582b586abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:55.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.029+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/2092979451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 0x5582b586abc0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800a3c0 tx=0x7fcfa800f690 comp rx=0 tx=0).stop 2024-09-10T21:17:55.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.029+0000 7fcfc0d37740 1 -- 172.21.15.59:0/2092979451 shutdown_connections 2024-09-10T21:17:55.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.029+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/2092979451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b587e140 0x5582b587a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.029+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/2092979451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b586dda0 0x5582b588a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.029+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/2092979451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b586d480 0x5582b586abc0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.029+0000 7fcfc0d37740 1 -- 172.21.15.59:0/2092979451 >> 172.21.15.59:0/2092979451 conn(0x5582b586b2b0 msgr2=0x5582b587efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:55.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.029+0000 7fcfc0d37740 1 -- 172.21.15.59:0/2092979451 shutdown_connections 2024-09-10T21:17:55.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.029+0000 7fcfc0d37740 1 -- 172.21.15.59:0/2092979451 wait complete. 2024-09-10T21:17:55.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.029+0000 7fcfc0d37740 1 -- start start 2024-09-10T21:17:55.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.030+0000 7fcfc0d37740 1 Processor -- start 2024-09-10T21:17:55.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.030+0000 7fcfc0d37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b586d480 0x5582b5886290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:55.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.030+0000 7fcfc0d37740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b586dda0 0x5582b58867d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:55.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.030+0000 7fcfc0d37740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b587e140 0x5582b5883080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:55.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.030+0000 7fcfc0d37740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb81ad5d0 con 0x5582b587e140 2024-09-10T21:17:55.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.030+0000 7fcfc0d37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb81acf00 con 0x5582b586d480 2024-09-10T21:17:55.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.030+0000 7fcfc0d37740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb81aa160 con 0x5582b586dda0 2024-09-10T21:17:55.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.030+0000 7fcfc0d37740 10 client.0 _ll_register_callbacks cb 0x7fcfa800a790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:55.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.030+0000 7fcfbceff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b587e140 0x5582b5883080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:55.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.030+0000 7fcfb7fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b586d480 0x5582b5886290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:55.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.030+0000 7fcfbceff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b587e140 0x5582b5883080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41084/0 (socket says 172.21.15.59:41084) 2024-09-10T21:17:55.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.030+0000 7fcfbceff640 1 -- 172.21.15.59:0/3955588105 learned_addr learned my addr 172.21.15.59:0/3955588105 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:55.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.030+0000 7fcfaffff640 1 --2- 172.21.15.59:0/3955588105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b586dda0 0x5582b58867d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:55.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.030+0000 7fcfbceff640 1 -- 172.21.15.59:0/3955588105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b586dda0 msgr2=0x5582b58867d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:55.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.030+0000 7fcfbceff640 1 --2- 172.21.15.59:0/3955588105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b586dda0 0x5582b58867d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.030+0000 7fcfbceff640 1 -- 172.21.15.59:0/3955588105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b586d480 msgr2=0x5582b5886290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:55.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.030+0000 7fcfbceff640 1 --2- 172.21.15.59:0/3955588105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b586d480 0x5582b5886290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.030+0000 7fcfbceff640 1 -- 172.21.15.59:0/3955588105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582b58837c0 con 0x5582b587e140 2024-09-10T21:17:55.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.031+0000 7fcfbceff640 1 --2- 172.21.15.59:0/3955588105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b587e140 0x5582b5883080 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0010c40 tx=0x7fcfb0009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80745457a8cb7719 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:55.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.031+0000 7fcf977fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:55.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.034+0000 7fcf977fe640 1 -- 172.21.15.59:0/3955588105 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0028060 con 0x5582b587e140 2024-09-10T21:17:55.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.034+0000 7fcf977fe640 1 -- 172.21.15.59:0/3955588105 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcfb00126f0 con 0x5582b587e140 2024-09-10T21:17:55.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.034+0000 7fcfc0d37740 1 -- 172.21.15.59:0/3955588105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfa8019070 con 0x5582b587e140 2024-09-10T21:17:55.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.034+0000 7fcf977fe640 1 -- 172.21.15.59:0/3955588105 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcfb0016040 con 0x5582b587e140 2024-09-10T21:17:55.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.034+0000 7fcfc0d37740 10 client.15978 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:55.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.034+0000 7fcfc0d37740 1 -- 172.21.15.59:0/3955588105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5582b58fb510 con 0x5582b587e140 2024-09-10T21:17:55.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.034+0000 7fcf977fe640 1 -- 172.21.15.59:0/3955588105 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfa8019070 con 0x5582b587e140 2024-09-10T21:17:55.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.034+0000 7fcf977fe640 1 -- 172.21.15.59:0/3955588105 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcfb000f040 con 0x5582b587e140 2024-09-10T21:17:55.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.035+0000 7fcfc0d37740 10 client.15978 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:55.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.035+0000 7fcfc0d37740 10 client.15978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:17:55.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.035+0000 7fcfc0d37740 20 client.15978 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:55.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.035+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/3955588105 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5582b58fb980 0x5582b58fdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:55.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.035+0000 7fcfc0d37740 4 client.15978 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:17:55.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.035+0000 7fcfc0d37740 1 -- 172.21.15.59:0/3955588105 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5582b57e1850 con 0x5582b58fb980 2024-09-10T21:17:55.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.035+0000 7fcfb7fff640 1 --2- 172.21.15.59:0/3955588105 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5582b58fb980 0x5582b58fdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:55.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.035+0000 7fcf977fe640 10 client.15978 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:55.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.035+0000 7fcfb7fff640 1 --2- 172.21.15.59:0/3955588105 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5582b58fb980 0x5582b58fdda0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b570f62f40b7fe8 server_cookie=253b403194fa8c4c in_seq=0 out_seq=0 2024-09-10T21:17:55.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.035+0000 7fcf977fe640 1 -- 172.21.15.59:0/3955588105 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x5582b57e1850 con 0x5582b58fb980 2024-09-10T21:17:55.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.035+0000 7fcf977fe640 10 client.15978 handle_command_reply: tid=0 2024-09-10T21:17:55.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.036+0000 7fcfc0d37740 1 client.15978 shutdown 2024-09-10T21:17:55.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.036+0000 7fcfc0d37740 1 -- 172.21.15.59:0/3955588105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b587e140 msgr2=0x5582b5883080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:55.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.036+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/3955588105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b587e140 0x5582b5883080 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0010c40 tx=0x7fcfb0009c50 comp rx=0 tx=0).stop 2024-09-10T21:17:55.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.036+0000 7fcfc0d37740 1 -- 172.21.15.59:0/3955588105 shutdown_connections 2024-09-10T21:17:55.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.036+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/3955588105 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5582b58fb980 0x5582b58fdda0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.036+0000 7fcf977fe640 0 client.15978 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:17:55.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.036+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/3955588105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582b587e140 0x5582b5883080 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.036+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/3955588105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5582b586dda0 0x5582b58867d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.036+0000 7fcfc0d37740 1 --2- 172.21.15.59:0/3955588105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5582b586d480 0x5582b5886290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.036+0000 7fcfc0d37740 1 -- 172.21.15.59:0/3955588105 >> 172.21.15.59:0/3955588105 conn(0x5582b586b2b0 msgr2=0x5582b586c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:55.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.036+0000 7fcfc0d37740 1 -- 172.21.15.59:0/3955588105 shutdown_connections 2024-09-10T21:17:55.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.036+0000 7fcfc0d37740 1 -- 172.21.15.59:0/3955588105 wait complete. 2024-09-10T21:17:55.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.036+0000 7fcfc0d37740 20 client.15978 trim_cache size 0 max 16384 2024-09-10T21:17:55.054 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:17:55.054 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:17:55.054 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:17:55.054 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:17:55.055 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:17:55.055 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:17:55.055 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:17:55.055 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:17:55.055 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:17:55.055 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:17:55.055 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:17:55.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:17:55.055 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:17:55.055 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:17:55.055 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:17:55.055 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:17:55.055 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:17:55.055 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:17:55.056 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:17:55.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:17:55.056 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:17:55.056 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:17:55.056 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:17:55.056 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:17:55.056 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:17:55.056 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:17:55.056 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:17:55.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:17:55.056 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:17:55.056 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:17:55.056 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:17:55.057 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:17:55.057 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:17:55.057 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:17:55.057 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:17:55.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:17:55.057 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:17:55.057 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:17:55.057 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:17:55.057 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:17:55.057 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:17:55.057 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:17:55.057 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:17:55.058 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:17:55.058 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:17:55.058 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:17:55.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.036+0000 7fcfbe962640 1 -- 172.21.15.59:0/1168024788 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcfa40b5360 msgr2=0x7fcfa40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:55.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.036+0000 7fcfbe962640 1 --2- 172.21.15.59:0/1168024788 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcfa40b5360 0x7fcfa40b7820 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x5582b586cf60 tx=0x7fcfa8008040 comp rx=0 tx=0).stop 2024-09-10T21:17:55.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.036+0000 7fcfbe962640 1 -- 172.21.15.59:0/1168024788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb81076b0 msgr2=0x7fcfb8199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:55.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.036+0000 7fcfbe962640 1 --2- 172.21.15.59:0/1168024788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb81076b0 0x7fcfb8199820 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0005940 tx=0x7fcfa00042f0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.037+0000 7fcfbe962640 1 -- 172.21.15.59:0/1168024788 shutdown_connections 2024-09-10T21:17:55.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.037+0000 7fcfbe962640 1 --2- 172.21.15.59:0/1168024788 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcfa40b5360 0x7fcfa40b7820 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.037+0000 7fcfbe962640 1 --2- 172.21.15.59:0/1168024788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfb8108030 0x7fcfb819ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.037+0000 7fcfbe962640 1 --2- 172.21.15.59:0/1168024788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb81076b0 0x7fcfb8199820 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.037+0000 7fcfbe962640 1 --2- 172.21.15.59:0/1168024788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfb8101ca0 0x7fcfb81992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:55.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.037+0000 7fcfbe962640 1 -- 172.21.15.59:0/1168024788 >> 172.21.15.59:0/1168024788 conn(0x7fcfb80fd730 msgr2=0x7fcfb8100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:55.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.037+0000 7fcfbe962640 1 -- 172.21.15.59:0/1168024788 shutdown_connections 2024-09-10T21:17:55.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:55.037+0000 7fcfbe962640 1 -- 172.21.15.59:0/1168024788 wait complete. 2024-09-10T21:17:55.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:55 smithi192 ceph-mon[35363]: pgmap v419: 97 pgs: 97 active+clean; 1.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:55.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:55 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:17:55.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:55 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:17:55.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:55 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:17:55.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:55 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:17:55.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:55 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:17:55.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:55 smithi059 ceph-mon[30888]: pgmap v419: 97 pgs: 97 active+clean; 1.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:55.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:55 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:17:55.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:55 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:17:55.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:55 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:17:55.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:55 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:17:55.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:55 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:17:55.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:55 smithi154 ceph-mon[35041]: pgmap v419: 97 pgs: 97 active+clean; 1.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:17:55.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:55 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:17:55.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:55 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:17:55.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:55 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:17:55.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:55 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:17:55.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:55 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:17:55.945 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:17:55.945 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:17:56.211 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:17:56.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.718+0000 7f1b12bee640 1 -- 172.21.15.59:0/1146874055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c108060 msgr2=0x7f1b0c10e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:56.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.718+0000 7f1b12bee640 1 --2- 172.21.15.59:0/1146874055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c108060 0x7f1b0c10e860 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009ca0 tx=0x7f1b0402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:17:56.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.718+0000 7f1b12bee640 1 -- 172.21.15.59:0/1146874055 shutdown_connections 2024-09-10T21:17:56.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.718+0000 7f1b12bee640 1 --2- 172.21.15.59:0/1146874055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c108060 0x7f1b0c10e860 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:56.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.718+0000 7f1b12bee640 1 --2- 172.21.15.59:0/1146874055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b0c1076e0 0x7f1b0c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:56.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.718+0000 7f1b12bee640 1 --2- 172.21.15.59:0/1146874055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b0c101cd0 0x7f1b0c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:56.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.718+0000 7f1b12bee640 1 -- 172.21.15.59:0/1146874055 >> 172.21.15.59:0/1146874055 conn(0x7f1b0c0fd700 msgr2=0x7f1b0c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:56.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.718+0000 7f1b12bee640 1 -- 172.21.15.59:0/1146874055 shutdown_connections 2024-09-10T21:17:56.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.718+0000 7f1b12bee640 1 -- 172.21.15.59:0/1146874055 wait complete. 2024-09-10T21:17:56.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.719+0000 7f1b12bee640 1 Processor -- start 2024-09-10T21:17:56.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.719+0000 7f1b12bee640 1 -- start start 2024-09-10T21:17:56.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.719+0000 7f1b12bee640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c101cd0 0x7f1b0c0fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:56.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.719+0000 7f1b12bee640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b0c1076e0 0x7f1b0c0fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:56.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.719+0000 7f1b12bee640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b0c108060 0x7f1b0c0fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:56.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.719+0000 7f1b12bee640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c111d20 con 0x7f1b0c101cd0 2024-09-10T21:17:56.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.719+0000 7f1b12bee640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c111ba0 con 0x7f1b0c1076e0 2024-09-10T21:17:56.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.719+0000 7f1b12bee640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c111ea0 con 0x7f1b0c108060 2024-09-10T21:17:56.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.719+0000 7f1b1098a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c101cd0 0x7f1b0c0fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:56.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.719+0000 7f1b1098a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c101cd0 0x7f1b0c0fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41110/0 (socket says 172.21.15.59:41110) 2024-09-10T21:17:56.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.719+0000 7f1b1098a640 1 -- 172.21.15.59:0/3282650758 learned_addr learned my addr 172.21.15.59:0/3282650758 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:56.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.719+0000 7f1b1118b640 1 --2- 172.21.15.59:0/3282650758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b0c108060 0x7f1b0c0fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:56.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.719+0000 7f1b0bfff640 1 --2- 172.21.15.59:0/3282650758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b0c1076e0 0x7f1b0c0fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:56.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.720+0000 7f1b1098a640 1 -- 172.21.15.59:0/3282650758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b0c108060 msgr2=0x7f1b0c0fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:56.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.720+0000 7f1b1098a640 1 --2- 172.21.15.59:0/3282650758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b0c108060 0x7f1b0c0fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:56.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.720+0000 7f1b1098a640 1 -- 172.21.15.59:0/3282650758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b0c1076e0 msgr2=0x7f1b0c0fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:56.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.720+0000 7f1b1098a640 1 --2- 172.21.15.59:0/3282650758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b0c1076e0 0x7f1b0c0fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:56.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.720+0000 7f1b1098a640 1 -- 172.21.15.59:0/3282650758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0c1a7620 con 0x7f1b0c101cd0 2024-09-10T21:17:56.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.720+0000 7f1b1098a640 1 --2- 172.21.15.59:0/3282650758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c101cd0 0x7f1b0c0fdc00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000c920 tx=0x7f1b0000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:56.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.720+0000 7f1b09ffb640 1 -- 172.21.15.59:0/3282650758 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00007bb0 con 0x7f1b0c101cd0 2024-09-10T21:17:56.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.720+0000 7f1b09ffb640 1 -- 172.21.15.59:0/3282650758 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b00007d50 con 0x7f1b0c101cd0 2024-09-10T21:17:56.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.720+0000 7f1b12bee640 1 -- 172.21.15.59:0/3282650758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b0c1a7910 con 0x7f1b0c101cd0 2024-09-10T21:17:56.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.720+0000 7f1b09ffb640 1 -- 172.21.15.59:0/3282650758 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00018730 con 0x7f1b0c101cd0 2024-09-10T21:17:56.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.720+0000 7f1b12bee640 1 -- 172.21.15.59:0/3282650758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b0c1a7f20 con 0x7f1b0c101cd0 2024-09-10T21:17:56.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.721+0000 7f1b12bee640 1 -- 172.21.15.59:0/3282650758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b0c1020b0 con 0x7f1b0c101cd0 2024-09-10T21:17:56.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.723+0000 7f1b09ffb640 1 -- 172.21.15.59:0/3282650758 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f1b0000f450 con 0x7f1b0c101cd0 2024-09-10T21:17:56.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.723+0000 7f1b09ffb640 1 --2- 172.21.15.59:0/3282650758 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1afc0b5360 0x7f1afc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:56.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.723+0000 7f1b09ffb640 1 -- 172.21.15.59:0/3282650758 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1b000e5ed0 con 0x7f1b0c101cd0 2024-09-10T21:17:56.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.723+0000 7f1b0bfff640 1 --2- 172.21.15.59:0/3282650758 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1afc0b5360 0x7f1afc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:56.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.724+0000 7f1b0bfff640 1 --2- 172.21.15.59:0/3282650758 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1afc0b5360 0x7f1afc0b7820 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0ff6f0 tx=0x7f1af8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:56.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.726+0000 7f1b09ffb640 1 -- 172.21.15.59:0/3282650758 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1b00014030 con 0x7f1b0c101cd0 2024-09-10T21:17:56.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.949+0000 7f1b12bee640 1 -- 172.21.15.59:0/3282650758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b0c1a8350 con 0x7f1b0c101cd0 2024-09-10T21:17:56.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.949+0000 7f1b09ffb640 1 -- 172.21.15.59:0/3282650758 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f1b000ace70 con 0x7f1b0c101cd0 2024-09-10T21:17:56.953 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:17:56.954 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:17:56.954 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:17:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.952+0000 7f1b12bee640 1 -- 172.21.15.59:0/3282650758 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1afc0b5360 msgr2=0x7f1afc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.952+0000 7f1b12bee640 1 --2- 172.21.15.59:0/3282650758 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1afc0b5360 0x7f1afc0b7820 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0ff6f0 tx=0x7f1af8009110 comp rx=0 tx=0).stop 2024-09-10T21:17:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.952+0000 7f1b12bee640 1 -- 172.21.15.59:0/3282650758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c101cd0 msgr2=0x7f1b0c0fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.952+0000 7f1b12bee640 1 --2- 172.21.15.59:0/3282650758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c101cd0 0x7f1b0c0fdc00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000c920 tx=0x7f1b0000cd20 comp rx=0 tx=0).stop 2024-09-10T21:17:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.952+0000 7f1b12bee640 1 -- 172.21.15.59:0/3282650758 shutdown_connections 2024-09-10T21:17:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.952+0000 7f1b12bee640 1 --2- 172.21.15.59:0/3282650758 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1afc0b5360 0x7f1afc0b7820 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.952+0000 7f1b12bee640 1 --2- 172.21.15.59:0/3282650758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b0c108060 0x7f1b0c0fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:56.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.952+0000 7f1b12bee640 1 --2- 172.21.15.59:0/3282650758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b0c1076e0 0x7f1b0c0fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:56.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.952+0000 7f1b12bee640 1 --2- 172.21.15.59:0/3282650758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b0c101cd0 0x7f1b0c0fdc00 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:56.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.952+0000 7f1b12bee640 1 -- 172.21.15.59:0/3282650758 >> 172.21.15.59:0/3282650758 conn(0x7f1b0c0fd700 msgr2=0x7f1b0c104cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:56.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.952+0000 7f1b12bee640 1 -- 172.21.15.59:0/3282650758 shutdown_connections 2024-09-10T21:17:56.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:56.952+0000 7f1b12bee640 1 -- 172.21.15.59:0/3282650758 wait complete. 2024-09-10T21:17:57.324 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:57 smithi059 ceph-mon[30888]: pgmap v420: 97 pgs: 97 active+clean; 1.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:17:57.324 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:57 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3282650758' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:17:57.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:57 smithi192 ceph-mon[35363]: pgmap v420: 97 pgs: 97 active+clean; 1.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:17:57.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:57 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3282650758' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:17:57.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:57 smithi154 ceph-mon[35041]: pgmap v420: 97 pgs: 97 active+clean; 1.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:17:57.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:57 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3282650758' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:17:57.636 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:17:57.900 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:17:58.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.367+0000 7f16cee3c640 1 -- 172.21.15.59:0/1406892566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c81076e0 msgr2=0x7f16c8107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:58.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.367+0000 7f16cee3c640 1 --2- 172.21.15.59:0/1406892566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c81076e0 0x7f16c8107b20 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009900 tx=0x7f16bc02a410 comp rx=0 tx=0).stop 2024-09-10T21:17:58.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.367+0000 7f16cee3c640 1 -- 172.21.15.59:0/1406892566 shutdown_connections 2024-09-10T21:17:58.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.367+0000 7f16cee3c640 1 --2- 172.21.15.59:0/1406892566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16c8108060 0x7f16c810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.367+0000 7f16cee3c640 1 --2- 172.21.15.59:0/1406892566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c81076e0 0x7f16c8107b20 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.367+0000 7f16cee3c640 1 --2- 172.21.15.59:0/1406892566 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16c8101cd0 0x7f16c81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.367+0000 7f16cee3c640 1 -- 172.21.15.59:0/1406892566 >> 172.21.15.59:0/1406892566 conn(0x7f16c80fd720 msgr2=0x7f16c80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:58.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.367+0000 7f16cee3c640 1 -- 172.21.15.59:0/1406892566 shutdown_connections 2024-09-10T21:17:58.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.367+0000 7f16cee3c640 1 -- 172.21.15.59:0/1406892566 wait complete. 2024-09-10T21:17:58.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.368+0000 7f16cee3c640 1 Processor -- start 2024-09-10T21:17:58.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.368+0000 7f16cee3c640 1 -- start start 2024-09-10T21:17:58.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.368+0000 7f16cee3c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16c8101cd0 0x7f16c8199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:58.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.368+0000 7f16cee3c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16c81076e0 0x7f16c8199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.368+0000 7f16cee3c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c8108060 0x7f16c819eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.368+0000 7f16cee3c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f16c8112e40 con 0x7f16c8108060 2024-09-10T21:17:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.368+0000 7f16cee3c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16c8112cc0 con 0x7f16c8101cd0 2024-09-10T21:17:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.368+0000 7f16cee3c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f16c8112fc0 con 0x7f16c81076e0 2024-09-10T21:17:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.368+0000 7f16cd3d9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c8108060 0x7f16c819eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.369+0000 7f16cd3d9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c8108060 0x7f16c819eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41118/0 (socket says 172.21.15.59:41118) 2024-09-10T21:17:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.369+0000 7f16cd3d9640 1 -- 172.21.15.59:0/198846508 learned_addr learned my addr 172.21.15.59:0/198846508 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.369+0000 7f16c7fff640 1 --2- 172.21.15.59:0/198846508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16c81076e0 0x7f16c8199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.369+0000 7f16ccbd8640 1 --2- 172.21.15.59:0/198846508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16c8101cd0 0x7f16c8199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.369+0000 7f16cd3d9640 1 -- 172.21.15.59:0/198846508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16c81076e0 msgr2=0x7f16c8199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.369+0000 7f16cd3d9640 1 --2- 172.21.15.59:0/198846508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16c81076e0 0x7f16c8199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.369+0000 7f16cd3d9640 1 -- 172.21.15.59:0/198846508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16c8101cd0 msgr2=0x7f16c8199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.369+0000 7f16cd3d9640 1 --2- 172.21.15.59:0/198846508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16c8101cd0 0x7f16c8199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.369+0000 7f16cd3d9640 1 -- 172.21.15.59:0/198846508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c819f2e0 con 0x7f16c8108060 2024-09-10T21:17:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.369+0000 7f16ccbd8640 1 --2- 172.21.15.59:0/198846508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16c8101cd0 0x7f16c8199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.369+0000 7f16cd3d9640 1 --2- 172.21.15.59:0/198846508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c8108060 0x7f16c819eb10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f16c000cce0 tx=0x7f16c000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.369+0000 7f16c5ffb640 1 -- 172.21.15.59:0/198846508 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c000f450 con 0x7f16c8108060 2024-09-10T21:17:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.369+0000 7f16c5ffb640 1 -- 172.21.15.59:0/198846508 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16c000faa0 con 0x7f16c8108060 2024-09-10T21:17:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.369+0000 7f16cee3c640 1 -- 172.21.15.59:0/198846508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c819f5d0 con 0x7f16c8108060 2024-09-10T21:17:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.369+0000 7f16c5ffb640 1 -- 172.21.15.59:0/198846508 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c0018b70 con 0x7f16c8108060 2024-09-10T21:17:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.369+0000 7f16cee3c640 1 -- 172.21.15.59:0/198846508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c81a5c90 con 0x7f16c8108060 2024-09-10T21:17:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.373+0000 7f16c5ffb640 1 -- 172.21.15.59:0/198846508 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f16c000f5f0 con 0x7f16c8108060 2024-09-10T21:17:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.373+0000 7f16d1211740 1 Processor -- start 2024-09-10T21:17:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.373+0000 7f16d1211740 1 -- start start 2024-09-10T21:17:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.373+0000 7f16d1211740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfe9d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.373+0000 7f16d1211740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8dfe9da10 0x55c8dfea9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.373+0000 7f16d1211740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfea99a0 0x55c8dfeabd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:58.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.373+0000 7f16d1211740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c8dfe13ea0 con 0x55c8dfe9d0f0 2024-09-10T21:17:58.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.373+0000 7f16d1211740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c8dfe032d0 con 0x55c8dfea99a0 2024-09-10T21:17:58.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.373+0000 7f16d1211740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c8dfe070e0 con 0x55c8dfe9da10 2024-09-10T21:17:58.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.373+0000 7f16c7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfe9d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:58.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.373+0000 7f16c7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfe9d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41128/0 (socket says 172.21.15.59:41128) 2024-09-10T21:17:58.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.373+0000 7f16c7fff640 1 -- 172.21.15.59:0/1318189583 learned_addr learned my addr 172.21.15.59:0/1318189583 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:58.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.373+0000 7f16ccbd8640 1 --2- 172.21.15.59:0/1318189583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8dfe9da10 0x55c8dfea9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:58.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.373+0000 7f16c7fff640 1 -- 172.21.15.59:0/1318189583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8dfe9da10 msgr2=0x55c8dfea9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:58.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.373+0000 7f16c7fff640 1 --2- 172.21.15.59:0/1318189583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8dfe9da10 0x55c8dfea9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.373+0000 7f16c7fff640 1 -- 172.21.15.59:0/1318189583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfea99a0 msgr2=0x55c8dfeabd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.373+0000 7f16c7fff640 1 --2- 172.21.15.59:0/1318189583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfea99a0 0x55c8dfeabd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.373+0000 7f16c7fff640 1 -- 172.21.15.59:0/1318189583 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8dfb61650 con 0x55c8dfe9d0f0 2024-09-10T21:17:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.374+0000 7f16c5ffb640 1 --2- 172.21.15.59:0/198846508 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f16b00b52e0 0x7f16b00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.374+0000 7f16c7fff640 1 --2- 172.21.15.59:0/1318189583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfe9d4d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009900 tx=0x7f16bc009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6161dc5f3a3b533 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.374+0000 7f16ccbd8640 1 --2- 172.21.15.59:0/198846508 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f16b00b52e0 0x7f16b00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.374+0000 7f16c5ffb640 1 -- 172.21.15.59:0/198846508 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f16c00e6350 con 0x7f16c8108060 2024-09-10T21:17:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.374+0000 7f16aeffd640 1 -- 172.21.15.59:0/1318189583 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc035040 con 0x55c8dfe9d0f0 2024-09-10T21:17:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.374+0000 7f16aeffd640 1 -- 172.21.15.59:0/1318189583 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16bc0316a0 con 0x55c8dfe9d0f0 2024-09-10T21:17:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.374+0000 7f16aeffd640 1 -- 172.21.15.59:0/1318189583 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc004750 con 0x55c8dfe9d0f0 2024-09-10T21:17:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.375+0000 7f16d1211740 1 -- 172.21.15.59:0/1318189583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfe9d0f0 msgr2=0x55c8dfe9d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.375+0000 7f16d1211740 1 --2- 172.21.15.59:0/1318189583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfe9d4d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009900 tx=0x7f16bc009680 comp rx=0 tx=0).stop 2024-09-10T21:17:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.375+0000 7f16ccbd8640 1 --2- 172.21.15.59:0/198846508 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f16b00b52e0 0x7f16b00b77a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x55c8dfe9be00 tx=0x7f16b800b710 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.375+0000 7f16d1211740 1 -- 172.21.15.59:0/1318189583 shutdown_connections 2024-09-10T21:17:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.375+0000 7f16d1211740 1 --2- 172.21.15.59:0/1318189583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfea99a0 0x55c8dfeabd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.375+0000 7f16d1211740 1 --2- 172.21.15.59:0/1318189583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8dfe9da10 0x55c8dfea9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.375+0000 7f16d1211740 1 --2- 172.21.15.59:0/1318189583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfe9d4d0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.375+0000 7f16d1211740 1 -- 172.21.15.59:0/1318189583 >> 172.21.15.59:0/1318189583 conn(0x55c8dfe9af20 msgr2=0x55c8dfe9c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.375+0000 7f16d1211740 1 -- 172.21.15.59:0/1318189583 shutdown_connections 2024-09-10T21:17:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.375+0000 7f16d1211740 1 -- 172.21.15.59:0/1318189583 wait complete. 2024-09-10T21:17:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.375+0000 7f16d1211740 1 -- start start 2024-09-10T21:17:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.375+0000 7f16d1211740 1 Processor -- start 2024-09-10T21:17:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.375+0000 7f16d1211740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfea92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.375+0000 7f16d1211740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8dfe9da10 0x55c8dfea6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16d1211740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfea99a0 0x55c8dfea6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16d1211740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c8dfc64700 con 0x55c8dfea99a0 2024-09-10T21:17:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16d1211740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c8dfd9e160 con 0x55c8dfe9d0f0 2024-09-10T21:17:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16d1211740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c8dfeac5c0 con 0x55c8dfe9da10 2024-09-10T21:17:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16d1211740 10 client.0 _ll_register_callbacks cb 0x55c8dfdb79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16cd3d9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfea99a0 0x55c8dfea6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16cd3d9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfea99a0 0x55c8dfea6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41130/0 (socket says 172.21.15.59:41130) 2024-09-10T21:17:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16cd3d9640 1 -- 172.21.15.59:0/1763612731 learned_addr learned my addr 172.21.15.59:0/1763612731 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16c7fff640 1 --2- 172.21.15.59:0/1763612731 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8dfe9da10 0x55c8dfea6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16ccbd8640 1 --2- 172.21.15.59:0/1763612731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfea92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16cd3d9640 1 -- 172.21.15.59:0/1763612731 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8dfe9da10 msgr2=0x55c8dfea6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16cd3d9640 1 --2- 172.21.15.59:0/1763612731 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8dfe9da10 0x55c8dfea6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16cd3d9640 1 -- 172.21.15.59:0/1763612731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfe9d0f0 msgr2=0x55c8dfea92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16cd3d9640 1 --2- 172.21.15.59:0/1763612731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfea92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16cd3d9640 1 -- 172.21.15.59:0/1763612731 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8dfdcbc90 con 0x55c8dfea99a0 2024-09-10T21:17:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16ccbd8640 1 --2- 172.21.15.59:0/1763612731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfea92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:17:58.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16cd3d9640 1 --2- 172.21.15.59:0/1763612731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfea99a0 0x55c8dfea6d30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f16c000ab20 tx=0x7f16c00ac970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732c18f7db87de12 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:58.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:58.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16a7fff640 1 -- 172.21.15.59:0/1763612731 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c00b1020 con 0x55c8dfea99a0 2024-09-10T21:17:58.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16a7fff640 1 -- 172.21.15.59:0/1763612731 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f16c00b5be0 con 0x55c8dfea99a0 2024-09-10T21:17:58.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.376+0000 7f16d1211740 1 -- 172.21.15.59:0/1763612731 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16bc0316a0 con 0x55c8dfea99a0 2024-09-10T21:17:58.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.377+0000 7f16a7fff640 1 -- 172.21.15.59:0/1763612731 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f16c00b13c0 con 0x55c8dfea99a0 2024-09-10T21:17:58.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.377+0000 7f16d1211740 10 client.15996 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:58.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.377+0000 7f16d1211740 1 -- 172.21.15.59:0/1763612731 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c8dfeb7f80 con 0x55c8dfea99a0 2024-09-10T21:17:58.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.377+0000 7f16a7fff640 1 -- 172.21.15.59:0/1763612731 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16bc0316a0 con 0x55c8dfea99a0 2024-09-10T21:17:58.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.377+0000 7f16a7fff640 1 -- 172.21.15.59:0/1763612731 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f16c00a8430 con 0x55c8dfea99a0 2024-09-10T21:17:58.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.377+0000 7f16d1211740 10 client.15996 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.377+0000 7f16d1211740 10 client.15996 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:17:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.377+0000 7f16d1211740 20 client.15996 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.377+0000 7f16d1211740 1 --2- 172.21.15.59:0/1763612731 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55c8dfeb9430 0x55c8dfebb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.377+0000 7f16d1211740 4 client.15996 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:17:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.377+0000 7f16d1211740 1 -- 172.21.15.59:0/1763612731 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8dfe15df0 con 0x55c8dfeb9430 2024-09-10T21:17:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.377+0000 7f16ccbd8640 1 --2- 172.21.15.59:0/1763612731 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55c8dfeb9430 0x55c8dfebb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.378+0000 7f16ccbd8640 1 --2- 172.21.15.59:0/1763612731 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55c8dfeb9430 0x55c8dfebb820 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ed5ee22e2b2eb0ea server_cookie=87dc106ce206dd69 in_seq=0 out_seq=0 2024-09-10T21:17:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.378+0000 7f16a7fff640 10 client.15996 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:17:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.378+0000 7f16a7fff640 1 -- 172.21.15.59:0/1763612731 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c8dfe15df0 con 0x55c8dfeb9430 2024-09-10T21:17:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.378+0000 7f16a7fff640 10 client.15996 handle_command_reply: tid=0 2024-09-10T21:17:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.378+0000 7f16d1211740 1 client.15996 shutdown 2024-09-10T21:17:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.379+0000 7f16d1211740 1 -- 172.21.15.59:0/1763612731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfea99a0 msgr2=0x55c8dfea6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.379+0000 7f16d1211740 1 --2- 172.21.15.59:0/1763612731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfea99a0 0x55c8dfea6d30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f16c000ab20 tx=0x7f16c00ac970 comp rx=0 tx=0).stop 2024-09-10T21:17:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.379+0000 7f16d1211740 1 -- 172.21.15.59:0/1763612731 shutdown_connections 2024-09-10T21:17:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.379+0000 7f16d1211740 1 --2- 172.21.15.59:0/1763612731 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55c8dfeb9430 0x55c8dfebb820 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.379+0000 7f16d1211740 1 --2- 172.21.15.59:0/1763612731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfea99a0 0x55c8dfea6d30 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.379+0000 7f16d1211740 1 --2- 172.21.15.59:0/1763612731 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8dfe9da10 0x55c8dfea6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.379+0000 7f16d1211740 1 --2- 172.21.15.59:0/1763612731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfea92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.379+0000 7f16d1211740 1 -- 172.21.15.59:0/1763612731 >> 172.21.15.59:0/1763612731 conn(0x55c8dfe9af20 msgr2=0x55c8dfea0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.379+0000 7f16a7fff640 0 client.15996 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:17:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.379+0000 7f16d1211740 1 -- 172.21.15.59:0/1763612731 shutdown_connections 2024-09-10T21:17:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.379+0000 7f16d1211740 1 -- 172.21.15.59:0/1763612731 wait complete. 2024-09-10T21:17:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.379+0000 7f16d1211740 20 client.15996 trim_cache size 0 max 16384 2024-09-10T21:17:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.392+0000 7f16d1211740 1 Processor -- start 2024-09-10T21:17:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.392+0000 7f16d1211740 1 -- start start 2024-09-10T21:17:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.392+0000 7f16d1211740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfeb57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:58.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.392+0000 7f16d1211740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfe9da10 0x55c8dfea8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:58.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.392+0000 7f16d1211740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8dfea99a0 0x55c8dfeaad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:58.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.392+0000 7f16d1211740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81ae150 con 0x55c8dfe9d0f0 2024-09-10T21:17:58.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.392+0000 7f16d1211740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81afc90 con 0x55c8dfe9da10 2024-09-10T21:17:58.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.392+0000 7f16d1211740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81ae820 con 0x55c8dfea99a0 2024-09-10T21:17:58.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.392+0000 7f16ccbd8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfeb57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:58.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.392+0000 7f16ccbd8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfeb57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41140/0 (socket says 172.21.15.59:41140) 2024-09-10T21:17:58.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.392+0000 7f16ccbd8640 1 -- 172.21.15.59:0/646146767 learned_addr learned my addr 172.21.15.59:0/646146767 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:58.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.393+0000 7f16c7fff640 1 --2- 172.21.15.59:0/646146767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfe9da10 0x55c8dfea8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:58.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.393+0000 7f16ccbd8640 1 -- 172.21.15.59:0/646146767 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8dfea99a0 msgr2=0x55c8dfeaad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:58.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.393+0000 7f16ccbd8640 1 --2- 172.21.15.59:0/646146767 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8dfea99a0 0x55c8dfeaad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.393+0000 7f16ccbd8640 1 -- 172.21.15.59:0/646146767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfe9da10 msgr2=0x55c8dfea8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:58.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.393+0000 7f16ccbd8640 1 --2- 172.21.15.59:0/646146767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfe9da10 0x55c8dfea8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.393+0000 7f16ccbd8640 1 -- 172.21.15.59:0/646146767 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8dfe9d840 con 0x55c8dfe9d0f0 2024-09-10T21:17:58.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.393+0000 7f16c7fff640 1 --2- 172.21.15.59:0/646146767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfe9da10 0x55c8dfea8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:58.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.393+0000 7f16ccbd8640 1 --2- 172.21.15.59:0/646146767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfeb57f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f16b800b640 tx=0x7f16b8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ef0adfa1ab2fce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:58.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.393+0000 7f16ae7fc640 1 -- 172.21.15.59:0/646146767 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8020810 con 0x55c8dfe9d0f0 2024-09-10T21:17:58.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.393+0000 7f16ae7fc640 1 -- 172.21.15.59:0/646146767 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16b802c070 con 0x55c8dfe9d0f0 2024-09-10T21:17:58.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.393+0000 7f16ae7fc640 1 -- 172.21.15.59:0/646146767 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b8031da0 con 0x55c8dfe9d0f0 2024-09-10T21:17:58.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.393+0000 7f16d1211740 1 -- 172.21.15.59:0/646146767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfe9d0f0 msgr2=0x55c8dfeb57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:58.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.393+0000 7f16d1211740 1 --2- 172.21.15.59:0/646146767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfeb57f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f16b800b640 tx=0x7f16b8014000 comp rx=0 tx=0).stop 2024-09-10T21:17:58.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.394+0000 7f16d1211740 1 -- 172.21.15.59:0/646146767 shutdown_connections 2024-09-10T21:17:58.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.394+0000 7f16d1211740 1 --2- 172.21.15.59:0/646146767 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8dfea99a0 0x55c8dfeaad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.394+0000 7f16d1211740 1 --2- 172.21.15.59:0/646146767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfe9da10 0x55c8dfea8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.394+0000 7f16d1211740 1 --2- 172.21.15.59:0/646146767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfeb57f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.394+0000 7f16d1211740 1 -- 172.21.15.59:0/646146767 >> 172.21.15.59:0/646146767 conn(0x55c8dfe9af20 msgr2=0x55c8dfea7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:58.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.394+0000 7f16d1211740 1 -- 172.21.15.59:0/646146767 shutdown_connections 2024-09-10T21:17:58.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.394+0000 7f16d1211740 1 -- 172.21.15.59:0/646146767 wait complete. 2024-09-10T21:17:58.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.394+0000 7f16d1211740 1 -- start start 2024-09-10T21:17:58.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.394+0000 7f16d1211740 1 Processor -- start 2024-09-10T21:17:58.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.394+0000 7f16d1211740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfeb1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:58.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.394+0000 7f16d1211740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8dfe9da10 0x55c8dfeb2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:58.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.394+0000 7f16d1211740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfea99a0 0x55c8dfeac810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:58.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.394+0000 7f16d1211740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81af5c0 con 0x55c8dfea99a0 2024-09-10T21:17:58.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.394+0000 7f16d1211740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81aeef0 con 0x55c8dfe9d0f0 2024-09-10T21:17:58.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.394+0000 7f16d1211740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81ac130 con 0x55c8dfe9da10 2024-09-10T21:17:58.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.394+0000 7f16d1211740 10 client.0 _ll_register_callbacks cb 0x7f16c0018400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:58.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.395+0000 7f16cd3d9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfea99a0 0x55c8dfeac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:58.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.395+0000 7f16cd3d9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfea99a0 0x55c8dfeac810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41148/0 (socket says 172.21.15.59:41148) 2024-09-10T21:17:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.395+0000 7f16cd3d9640 1 -- 172.21.15.59:0/2714131924 learned_addr learned my addr 172.21.15.59:0/2714131924 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.395+0000 7f16c7fff640 1 --2- 172.21.15.59:0/2714131924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8dfe9da10 0x55c8dfeb2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.395+0000 7f16ccbd8640 1 --2- 172.21.15.59:0/2714131924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfeb1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.395+0000 7f16cd3d9640 1 -- 172.21.15.59:0/2714131924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8dfe9da10 msgr2=0x55c8dfeb2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.395+0000 7f16cd3d9640 1 --2- 172.21.15.59:0/2714131924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8dfe9da10 0x55c8dfeb2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.395+0000 7f16cd3d9640 1 -- 172.21.15.59:0/2714131924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfe9d0f0 msgr2=0x55c8dfeb1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.395+0000 7f16cd3d9640 1 --2- 172.21.15.59:0/2714131924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfeb1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.395+0000 7f16cd3d9640 1 -- 172.21.15.59:0/2714131924 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8dfead040 con 0x55c8dfea99a0 2024-09-10T21:17:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.395+0000 7f16cd3d9640 1 --2- 172.21.15.59:0/2714131924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfea99a0 0x55c8dfeac810 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f16c005a040 tx=0x7f16c0018580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ccfa51415809b3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.395+0000 7f16a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.395+0000 7f16a7fff640 1 -- 172.21.15.59:0/2714131924 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c00c6030 con 0x55c8dfea99a0 2024-09-10T21:17:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.395+0000 7f16a7fff640 1 -- 172.21.15.59:0/2714131924 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f16c00b5be0 con 0x55c8dfea99a0 2024-09-10T21:17:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.395+0000 7f16d1211740 1 -- 172.21.15.59:0/2714131924 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16b802c070 con 0x55c8dfea99a0 2024-09-10T21:17:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.395+0000 7f16a7fff640 1 -- 172.21.15.59:0/2714131924 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f16c00b1040 con 0x55c8dfea99a0 2024-09-10T21:17:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.395+0000 7f16d1211740 10 client.16002 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.395+0000 7f16d1211740 1 -- 172.21.15.59:0/2714131924 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c8dff26d70 con 0x55c8dfea99a0 2024-09-10T21:17:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.396+0000 7f16a7fff640 1 -- 172.21.15.59:0/2714131924 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16b802c070 con 0x55c8dfea99a0 2024-09-10T21:17:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.396+0000 7f16a7fff640 1 -- 172.21.15.59:0/2714131924 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f16c00c7b00 con 0x55c8dfea99a0 2024-09-10T21:17:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.396+0000 7f16d1211740 10 client.16002 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.396+0000 7f16d1211740 10 client.16002 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:17:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.396+0000 7f16d1211740 20 client.16002 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.396+0000 7f16d1211740 1 --2- 172.21.15.59:0/2714131924 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55c8dff27360 0x55c8dff29780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.396+0000 7f16d1211740 4 client.16002 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:17:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.396+0000 7f16d1211740 1 -- 172.21.15.59:0/2714131924 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c8dfe118a0 con 0x55c8dff27360 2024-09-10T21:17:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.396+0000 7f16ccbd8640 1 --2- 172.21.15.59:0/2714131924 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55c8dff27360 0x55c8dff29780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:58.420 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:17:58.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.396+0000 7f16a7fff640 10 client.16002 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:17:58.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.396+0000 7f16ccbd8640 1 --2- 172.21.15.59:0/2714131924 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55c8dff27360 0x55c8dff29780 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b07de1b76ee6e7c5 server_cookie=9ba905c27cd09cef in_seq=0 out_seq=0 2024-09-10T21:17:58.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.397+0000 7f16a7fff640 1 -- 172.21.15.59:0/2714131924 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c8dfe118a0 con 0x55c8dff27360 2024-09-10T21:17:58.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.397+0000 7f16a7fff640 10 client.16002 handle_command_reply: tid=0 2024-09-10T21:17:58.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.397+0000 7f16d1211740 1 client.16002 shutdown 2024-09-10T21:17:58.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.397+0000 7f16d1211740 1 -- 172.21.15.59:0/2714131924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfea99a0 msgr2=0x55c8dfeac810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:58.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.397+0000 7f16d1211740 1 --2- 172.21.15.59:0/2714131924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfea99a0 0x55c8dfeac810 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f16c005a040 tx=0x7f16c0018580 comp rx=0 tx=0).stop 2024-09-10T21:17:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.397+0000 7f16d1211740 1 -- 172.21.15.59:0/2714131924 shutdown_connections 2024-09-10T21:17:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.397+0000 7f16d1211740 1 --2- 172.21.15.59:0/2714131924 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55c8dff27360 0x55c8dff29780 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.397+0000 7f16d1211740 1 --2- 172.21.15.59:0/2714131924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c8dfea99a0 0x55c8dfeac810 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.397+0000 7f16d1211740 1 --2- 172.21.15.59:0/2714131924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c8dfe9da10 0x55c8dfeb2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.397+0000 7f16d1211740 1 --2- 172.21.15.59:0/2714131924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c8dfe9d0f0 0x55c8dfeb1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.397+0000 7f16d1211740 1 -- 172.21.15.59:0/2714131924 >> 172.21.15.59:0/2714131924 conn(0x55c8dfe9af20 msgr2=0x55c8dfea8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.397+0000 7f16a7fff640 0 client.16002 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:17:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.397+0000 7f16d1211740 1 -- 172.21.15.59:0/2714131924 shutdown_connections 2024-09-10T21:17:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.397+0000 7f16d1211740 1 -- 172.21.15.59:0/2714131924 wait complete. 2024-09-10T21:17:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.397+0000 7f16d1211740 20 client.16002 trim_cache size 0 max 16384 2024-09-10T21:17:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.398+0000 7f16cee3c640 1 -- 172.21.15.59:0/198846508 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f16b00b52e0 msgr2=0x7f16b00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.398+0000 7f16cee3c640 1 --2- 172.21.15.59:0/198846508 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f16b00b52e0 0x7f16b00b77a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x55c8dfe9be00 tx=0x7f16b800b710 comp rx=0 tx=0).stop 2024-09-10T21:17:58.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.398+0000 7f16cee3c640 1 -- 172.21.15.59:0/198846508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c8108060 msgr2=0x7f16c819eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:58.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.398+0000 7f16cee3c640 1 --2- 172.21.15.59:0/198846508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c8108060 0x7f16c819eb10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f16c000cce0 tx=0x7f16c000a620 comp rx=0 tx=0).stop 2024-09-10T21:17:58.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.398+0000 7f16cee3c640 1 -- 172.21.15.59:0/198846508 shutdown_connections 2024-09-10T21:17:58.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.398+0000 7f16cee3c640 1 --2- 172.21.15.59:0/198846508 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f16b00b52e0 0x7f16b00b77a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.398+0000 7f16cee3c640 1 --2- 172.21.15.59:0/198846508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c8108060 0x7f16c819eb10 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.398+0000 7f16cee3c640 1 --2- 172.21.15.59:0/198846508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16c81076e0 0x7f16c8199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.398+0000 7f16cee3c640 1 --2- 172.21.15.59:0/198846508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16c8101cd0 0x7f16c8199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:58.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.398+0000 7f16cee3c640 1 -- 172.21.15.59:0/198846508 >> 172.21.15.59:0/198846508 conn(0x7f16c80fd720 msgr2=0x7f16c80ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:58.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.398+0000 7f16cee3c640 1 -- 172.21.15.59:0/198846508 shutdown_connections 2024-09-10T21:17:58.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:58.398+0000 7f16cee3c640 1 -- 172.21.15.59:0/198846508 wait complete. 2024-09-10T21:17:59.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:17:59.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:17:59 smithi192 ceph-mon[35363]: pgmap v421: 97 pgs: 97 active+clean; 1.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:17:59.373 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:17:59.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:17:59 smithi059 ceph-mon[30888]: pgmap v421: 97 pgs: 97 active+clean; 1.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:17:59.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:17:59 smithi154 ceph-mon[35041]: pgmap v421: 97 pgs: 97 active+clean; 1.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:17:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.867+0000 7f8b88d42640 1 -- 172.21.15.59:0/597391963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b84104600 msgr2=0x7f8b8410caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.867+0000 7f8b88d42640 1 --2- 172.21.15.59:0/597391963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b84104600 0x7f8b8410caf0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c009900 tx=0x7f8b6c02a410 comp rx=0 tx=0).stop 2024-09-10T21:17:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.867+0000 7f8b88d42640 1 -- 172.21.15.59:0/597391963 shutdown_connections 2024-09-10T21:17:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.867+0000 7f8b88d42640 1 --2- 172.21.15.59:0/597391963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b8410d140 0x7f8b8410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.867+0000 7f8b88d42640 1 --2- 172.21.15.59:0/597391963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b84104600 0x7f8b8410caf0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.867+0000 7f8b88d42640 1 --2- 172.21.15.59:0/597391963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b84103ce0 0x7f8b841040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.867+0000 7f8b88d42640 1 -- 172.21.15.59:0/597391963 >> 172.21.15.59:0/597391963 conn(0x7f8b840fd720 msgr2=0x7f8b840ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.867+0000 7f8b88d42640 1 -- 172.21.15.59:0/597391963 shutdown_connections 2024-09-10T21:17:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.867+0000 7f8b88d42640 1 -- 172.21.15.59:0/597391963 wait complete. 2024-09-10T21:17:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.868+0000 7f8b88d42640 1 Processor -- start 2024-09-10T21:17:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.868+0000 7f8b88d42640 1 -- start start 2024-09-10T21:17:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.868+0000 7f8b88d42640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b84103ce0 0x7f8b84199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.868+0000 7f8b88d42640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b84104600 0x7f8b84199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.868+0000 7f8b88d42640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b8410d140 0x7f8b8419ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.868+0000 7f8b88d42640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8b84112df0 con 0x7f8b8410d140 2024-09-10T21:17:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.868+0000 7f8b88d42640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b84112c70 con 0x7f8b84104600 2024-09-10T21:17:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.868+0000 7f8b88d42640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8b84112f70 con 0x7f8b84103ce0 2024-09-10T21:17:59.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.868+0000 7f8b82d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b8410d140 0x7f8b8419ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:59.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.869+0000 7f8b82d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b8410d140 0x7f8b8419ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45748/0 (socket says 172.21.15.59:45748) 2024-09-10T21:17:59.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.869+0000 7f8b82d9d640 1 -- 172.21.15.59:0/2412236490 learned_addr learned my addr 172.21.15.59:0/2412236490 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:59.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.869+0000 7f8b7bfff640 1 --2- 172.21.15.59:0/2412236490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b84104600 0x7f8b84199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:59.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.869+0000 7f8b8259c640 1 --2- 172.21.15.59:0/2412236490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b84103ce0 0x7f8b84199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:59.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.869+0000 7f8b82d9d640 1 -- 172.21.15.59:0/2412236490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b84103ce0 msgr2=0x7f8b84199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:59.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.869+0000 7f8b82d9d640 1 --2- 172.21.15.59:0/2412236490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b84103ce0 0x7f8b84199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.869+0000 7f8b82d9d640 1 -- 172.21.15.59:0/2412236490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b84104600 msgr2=0x7f8b84199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:59.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.869+0000 7f8b82d9d640 1 --2- 172.21.15.59:0/2412236490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b84104600 0x7f8b84199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.869+0000 7f8b82d9d640 1 -- 172.21.15.59:0/2412236490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8419f3f0 con 0x7f8b8410d140 2024-09-10T21:17:59.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.869+0000 7f8b82d9d640 1 --2- 172.21.15.59:0/2412236490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b8410d140 0x7f8b8419ec20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00eaa0 tx=0x7f8b7c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:59.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.869+0000 7f8b7b7fe640 1 -- 172.21.15.59:0/2412236490 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c004d20 con 0x7f8b8410d140 2024-09-10T21:17:59.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.869+0000 7f8b7b7fe640 1 -- 172.21.15.59:0/2412236490 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b7c005020 con 0x7f8b8410d140 2024-09-10T21:17:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.869+0000 7f8b7b7fe640 1 -- 172.21.15.59:0/2412236490 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c0116b0 con 0x7f8b8410d140 2024-09-10T21:17:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.869+0000 7f8b88d42640 1 -- 172.21.15.59:0/2412236490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b8419f6e0 con 0x7f8b8410d140 2024-09-10T21:17:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.869+0000 7f8b88d42640 1 -- 172.21.15.59:0/2412236490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b841a5da0 con 0x7f8b8410d140 2024-09-10T21:17:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.872+0000 7f8b7b7fe640 1 -- 172.21.15.59:0/2412236490 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f8b7c00f040 con 0x7f8b8410d140 2024-09-10T21:17:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.872+0000 7f8b8b117740 1 Processor -- start 2024-09-10T21:17:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.872+0000 7f8b8b117740 1 -- start start 2024-09-10T21:17:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.872+0000 7f8b8b117740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f04d0 0x558ecd9f08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.872+0000 7f8b8b117740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f0df0 0x558ecda00c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.872+0000 7f8b8b117740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecda03580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.872+0000 7f8b8b117740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558ecd966ea0 con 0x558ecda01190 2024-09-10T21:17:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.872+0000 7f8b8b117740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558ecd9562d0 con 0x558ecd9f0df0 2024-09-10T21:17:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.872+0000 7f8b8b117740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558ecd95a0e0 con 0x558ecd9f04d0 2024-09-10T21:17:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.873+0000 7f8b7bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecda03580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.873+0000 7f8b8259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f0df0 0x558ecda00c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.873+0000 7f8b7bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecda03580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45762/0 (socket says 172.21.15.59:45762) 2024-09-10T21:17:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.873+0000 7f8b7bfff640 1 -- 172.21.15.59:0/2813473869 learned_addr learned my addr 172.21.15.59:0/2813473869 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.873+0000 7f8b7bfff640 1 --2- 172.21.15.59:0/2813473869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f04d0 0x558ecd9f08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.873+0000 7f8b8259c640 1 -- 172.21.15.59:0/2813473869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f04d0 msgr2=0x558ecd9f08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.873+0000 7f8b8259c640 1 --2- 172.21.15.59:0/2813473869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f04d0 0x558ecd9f08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.873+0000 7f8b8259c640 1 -- 172.21.15.59:0/2813473869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 msgr2=0x558ecda03580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.873+0000 7f8b8259c640 1 --2- 172.21.15.59:0/2813473869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecda03580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.873+0000 7f8b8259c640 1 -- 172.21.15.59:0/2813473869 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ecd6b4650 con 0x558ecd9f0df0 2024-09-10T21:17:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.873+0000 7f8b7b7fe640 1 --2- 172.21.15.59:0/2412236490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8b700b52e0 0x7f8b700b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.873+0000 7f8b7bfff640 1 --2- 172.21.15.59:0/2412236490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8b700b52e0 0x7f8b700b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.873+0000 7f8b8259c640 1 --2- 172.21.15.59:0/2813473869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f0df0 0x558ecda00c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8b740099a0 tx=0x7f8b74009e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3faf52f62022e361 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.873+0000 7f8b7b7fe640 1 -- 172.21.15.59:0/2412236490 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8b7c0e5a10 con 0x7f8b8410d140 2024-09-10T21:17:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.873+0000 7f8b78ff9640 1 -- 172.21.15.59:0/2813473869 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74017070 con 0x558ecd9f0df0 2024-09-10T21:17:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.874+0000 7f8b78ff9640 1 -- 172.21.15.59:0/2813473869 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b74013470 con 0x558ecd9f0df0 2024-09-10T21:17:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.874+0000 7f8b78ff9640 1 -- 172.21.15.59:0/2813473869 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74012630 con 0x558ecd9f0df0 2024-09-10T21:17:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.874+0000 7f8b8b117740 1 -- 172.21.15.59:0/2813473869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f0df0 msgr2=0x558ecda00c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.874+0000 7f8b8b117740 1 --2- 172.21.15.59:0/2813473869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f0df0 0x558ecda00c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8b740099a0 tx=0x7f8b74009e60 comp rx=0 tx=0).stop 2024-09-10T21:17:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.874+0000 7f8b7bfff640 1 --2- 172.21.15.59:0/2412236490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8b700b52e0 0x7f8b700b77a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0096c0 tx=0x7f8b6c041040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.875+0000 7f8b8b117740 1 -- 172.21.15.59:0/2813473869 shutdown_connections 2024-09-10T21:17:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.875+0000 7f8b8b117740 1 --2- 172.21.15.59:0/2813473869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecda03580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.875+0000 7f8b8b117740 1 --2- 172.21.15.59:0/2813473869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f0df0 0x558ecda00c50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.875+0000 7f8b8b117740 1 --2- 172.21.15.59:0/2813473869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f04d0 0x558ecd9f08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.875+0000 7f8b8b117740 1 -- 172.21.15.59:0/2813473869 >> 172.21.15.59:0/2813473869 conn(0x558ecd9ee300 msgr2=0x558ecd9ef4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.875+0000 7f8b8b117740 1 -- 172.21.15.59:0/2813473869 shutdown_connections 2024-09-10T21:17:59.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.875+0000 7f8b8b117740 1 -- 172.21.15.59:0/2813473869 wait complete. 2024-09-10T21:17:59.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.876+0000 7f8b8b117740 1 -- start start 2024-09-10T21:17:59.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.876+0000 7f8b8b117740 1 Processor -- start 2024-09-10T21:17:59.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.876+0000 7f8b8b117740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f04d0 0x558ecda009b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:59.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.876+0000 7f8b8b117740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f0df0 0x558ecd9fde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:59.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.876+0000 7f8b8b117740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecd9fe390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:59.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.876+0000 7f8b8b117740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558ecd7b7700 con 0x558ecda01190 2024-09-10T21:17:59.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.876+0000 7f8b8b117740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558ecd8f1160 con 0x558ecd9f04d0 2024-09-10T21:17:59.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.876+0000 7f8b8b117740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558ecda03e40 con 0x558ecd9f0df0 2024-09-10T21:17:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.876+0000 7f8b8b117740 10 client.0 _ll_register_callbacks cb 0x558ecd90a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.876+0000 7f8b82d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecd9fe390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.876+0000 7f8b82d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecd9fe390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45766/0 (socket says 172.21.15.59:45766) 2024-09-10T21:17:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.876+0000 7f8b82d9d640 1 -- 172.21.15.59:0/4163910405 learned_addr learned my addr 172.21.15.59:0/4163910405 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.876+0000 7f8b7bfff640 1 --2- 172.21.15.59:0/4163910405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f0df0 0x558ecd9fde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.876+0000 7f8b8259c640 1 --2- 172.21.15.59:0/4163910405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f04d0 0x558ecda009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.876+0000 7f8b82d9d640 1 -- 172.21.15.59:0/4163910405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f0df0 msgr2=0x558ecd9fde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.876+0000 7f8b82d9d640 1 --2- 172.21.15.59:0/4163910405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f0df0 0x558ecd9fde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.876+0000 7f8b82d9d640 1 -- 172.21.15.59:0/4163910405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f04d0 msgr2=0x558ecda009b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.876+0000 7f8b82d9d640 1 --2- 172.21.15.59:0/4163910405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f04d0 0x558ecda009b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.876+0000 7f8b82d9d640 1 -- 172.21.15.59:0/4163910405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ecd91ec90 con 0x558ecda01190 2024-09-10T21:17:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.877+0000 7f8b82d9d640 1 --2- 172.21.15.59:0/4163910405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecd9fe390 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0a87d0 tx=0x7f8b7c0abd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ecdc7ae74aac7a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.877+0000 7f8b69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:59.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.877+0000 7f8b69ffb640 1 -- 172.21.15.59:0/4163910405 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c01f030 con 0x558ecda01190 2024-09-10T21:17:59.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.877+0000 7f8b69ffb640 1 -- 172.21.15.59:0/4163910405 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8b7c0cf070 con 0x558ecda01190 2024-09-10T21:17:59.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.877+0000 7f8b8b117740 1 -- 172.21.15.59:0/4163910405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b74013470 con 0x558ecda01190 2024-09-10T21:17:59.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.877+0000 7f8b69ffb640 1 -- 172.21.15.59:0/4163910405 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8b7c0cf270 con 0x558ecda01190 2024-09-10T21:17:59.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.877+0000 7f8b8b117740 10 client.16014 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:59.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.877+0000 7f8b8b117740 1 -- 172.21.15.59:0/4163910405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558ecda0f710 con 0x558ecda01190 2024-09-10T21:17:59.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.877+0000 7f8b69ffb640 1 -- 172.21.15.59:0/4163910405 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b74013470 con 0x558ecda01190 2024-09-10T21:17:59.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.877+0000 7f8b69ffb640 1 -- 172.21.15.59:0/4163910405 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8b7c0cdbe0 con 0x558ecda01190 2024-09-10T21:17:59.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.878+0000 7f8b8b117740 10 client.16014 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:59.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.878+0000 7f8b8b117740 10 client.16014 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:17:59.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.878+0000 7f8b8b117740 20 client.16014 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:59.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.878+0000 7f8b8b117740 1 --2- 172.21.15.59:0/4163910405 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x558ecda10c40 0x558ecda13070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.878+0000 7f8b8b117740 4 client.16014 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:17:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.878+0000 7f8b8b117740 1 -- 172.21.15.59:0/4163910405 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ecd968df0 con 0x558ecda10c40 2024-09-10T21:17:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.878+0000 7f8b8259c640 1 --2- 172.21.15.59:0/4163910405 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x558ecda10c40 0x558ecda13070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.878+0000 7f8b8259c640 1 --2- 172.21.15.59:0/4163910405 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x558ecda10c40 0x558ecda13070 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1666feacae187da4 server_cookie=6e03b6053338e589 in_seq=0 out_seq=0 2024-09-10T21:17:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.878+0000 7f8b69ffb640 10 client.16014 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:17:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.879+0000 7f8b69ffb640 1 -- 172.21.15.59:0/4163910405 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558ecd968df0 con 0x558ecda10c40 2024-09-10T21:17:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.879+0000 7f8b69ffb640 10 client.16014 handle_command_reply: tid=0 2024-09-10T21:17:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.879+0000 7f8b8b117740 1 client.16014 shutdown 2024-09-10T21:17:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.879+0000 7f8b8b117740 1 -- 172.21.15.59:0/4163910405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 msgr2=0x558ecd9fe390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.879+0000 7f8b8b117740 1 --2- 172.21.15.59:0/4163910405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecd9fe390 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0a87d0 tx=0x7f8b7c0abd10 comp rx=0 tx=0).stop 2024-09-10T21:17:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.879+0000 7f8b8b117740 1 -- 172.21.15.59:0/4163910405 shutdown_connections 2024-09-10T21:17:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.879+0000 7f8b8b117740 1 --2- 172.21.15.59:0/4163910405 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x558ecda10c40 0x558ecda13070 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.879+0000 7f8b8b117740 1 --2- 172.21.15.59:0/4163910405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecd9fe390 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.879+0000 7f8b8b117740 1 --2- 172.21.15.59:0/4163910405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f0df0 0x558ecd9fde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.879+0000 7f8b69ffb640 0 client.16014 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:17:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.879+0000 7f8b8b117740 1 --2- 172.21.15.59:0/4163910405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f04d0 0x558ecda009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.879+0000 7f8b8b117740 1 -- 172.21.15.59:0/4163910405 >> 172.21.15.59:0/4163910405 conn(0x558ecd9ee300 msgr2=0x558ecd9ed420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.879+0000 7f8b8b117740 1 -- 172.21.15.59:0/4163910405 shutdown_connections 2024-09-10T21:17:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.879+0000 7f8b8b117740 1 -- 172.21.15.59:0/4163910405 wait complete. 2024-09-10T21:17:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.880+0000 7f8b8b117740 20 client.16014 trim_cache size 0 max 16384 2024-09-10T21:17:59.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.893+0000 7f8b8b117740 1 Processor -- start 2024-09-10T21:17:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.893+0000 7f8b8b117740 1 -- start start 2024-09-10T21:17:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.893+0000 7f8b8b117740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f04d0 0x558ecda18940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.893+0000 7f8b8b117740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f0df0 0x558ecda18e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.893+0000 7f8b8b117740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecd9f3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.893+0000 7f8b8b117740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8b841ac1e0 con 0x558ecda01190 2024-09-10T21:17:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.893+0000 7f8b8b117740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b841add20 con 0x558ecd9f04d0 2024-09-10T21:17:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.893+0000 7f8b8b117740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8b841ac8b0 con 0x558ecd9f0df0 2024-09-10T21:17:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.893+0000 7f8b82d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecd9f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.893+0000 7f8b82d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecd9f3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45768/0 (socket says 172.21.15.59:45768) 2024-09-10T21:17:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.893+0000 7f8b82d9d640 1 -- 172.21.15.59:0/3923874531 learned_addr learned my addr 172.21.15.59:0/3923874531 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.893+0000 7f8b7bfff640 1 --2- 172.21.15.59:0/3923874531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f0df0 0x558ecda18e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.893+0000 7f8b82d9d640 1 -- 172.21.15.59:0/3923874531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f0df0 msgr2=0x558ecda18e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:59.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.893+0000 7f8b82d9d640 1 --2- 172.21.15.59:0/3923874531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f0df0 0x558ecda18e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.893+0000 7f8b82d9d640 1 -- 172.21.15.59:0/3923874531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f04d0 msgr2=0x558ecda18940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:59.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.893+0000 7f8b82d9d640 1 --2- 172.21.15.59:0/3923874531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f04d0 0x558ecda18940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.893+0000 7f8b82d9d640 1 -- 172.21.15.59:0/3923874531 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ecd9fc350 con 0x558ecda01190 2024-09-10T21:17:59.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.893+0000 7f8b7bfff640 1 --2- 172.21.15.59:0/3923874531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f0df0 0x558ecda18e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:59.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.893+0000 7f8b82d9d640 1 --2- 172.21.15.59:0/3923874531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecd9f3680 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0ac190 tx=0x7f8b7c009730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd16ed31643638c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:59.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.894+0000 7f8b6bfff640 1 -- 172.21.15.59:0/3923874531 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c05a070 con 0x558ecda01190 2024-09-10T21:17:59.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.894+0000 7f8b6bfff640 1 -- 172.21.15.59:0/3923874531 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b7c0b0ce0 con 0x558ecda01190 2024-09-10T21:17:59.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.894+0000 7f8b6bfff640 1 -- 172.21.15.59:0/3923874531 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c01f020 con 0x558ecda01190 2024-09-10T21:17:59.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.894+0000 7f8b8b117740 1 -- 172.21.15.59:0/3923874531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 msgr2=0x558ecd9f3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:59.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.894+0000 7f8b8b117740 1 --2- 172.21.15.59:0/3923874531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecd9f3680 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0ac190 tx=0x7f8b7c009730 comp rx=0 tx=0).stop 2024-09-10T21:17:59.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.894+0000 7f8b8b117740 1 -- 172.21.15.59:0/3923874531 shutdown_connections 2024-09-10T21:17:59.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.894+0000 7f8b8b117740 1 --2- 172.21.15.59:0/3923874531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecd9f3680 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.894+0000 7f8b8b117740 1 --2- 172.21.15.59:0/3923874531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f0df0 0x558ecda18e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.894+0000 7f8b8b117740 1 --2- 172.21.15.59:0/3923874531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f04d0 0x558ecda18940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.894+0000 7f8b8b117740 1 -- 172.21.15.59:0/3923874531 >> 172.21.15.59:0/3923874531 conn(0x558ecd9ee300 msgr2=0x558ecda02eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:59.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.894+0000 7f8b8b117740 1 -- 172.21.15.59:0/3923874531 shutdown_connections 2024-09-10T21:17:59.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.894+0000 7f8b8b117740 1 -- 172.21.15.59:0/3923874531 wait complete. 2024-09-10T21:17:59.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.895+0000 7f8b8b117740 1 -- start start 2024-09-10T21:17:59.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.895+0000 7f8b8b117740 1 Processor -- start 2024-09-10T21:17:59.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.895+0000 7f8b8b117740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f04d0 0x558ecda09780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:59.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.895+0000 7f8b8b117740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f0df0 0x558ecda060a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:59.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.895+0000 7f8b8b117740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecda065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:59.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.895+0000 7f8b8b117740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8b841ad650 con 0x558ecda01190 2024-09-10T21:17:59.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.895+0000 7f8b8b117740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b841acf80 con 0x558ecd9f04d0 2024-09-10T21:17:59.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.895+0000 7f8b8b117740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8b841aa1c0 con 0x558ecd9f0df0 2024-09-10T21:17:59.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.895+0000 7f8b8b117740 10 client.0 _ll_register_callbacks cb 0x7f8b7c004ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:17:59.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.895+0000 7f8b82d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecda065e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:59.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.895+0000 7f8b82d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecda065e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45772/0 (socket says 172.21.15.59:45772) 2024-09-10T21:17:59.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.895+0000 7f8b82d9d640 1 -- 172.21.15.59:0/4160709533 learned_addr learned my addr 172.21.15.59:0/4160709533 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:17:59.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.895+0000 7f8b8259c640 1 --2- 172.21.15.59:0/4160709533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f04d0 0x558ecda09780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:59.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.895+0000 7f8b7bfff640 1 --2- 172.21.15.59:0/4160709533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f0df0 0x558ecda060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:59.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b82d9d640 1 -- 172.21.15.59:0/4160709533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f0df0 msgr2=0x558ecda060a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:59.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b82d9d640 1 --2- 172.21.15.59:0/4160709533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f0df0 0x558ecda060a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b82d9d640 1 -- 172.21.15.59:0/4160709533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f04d0 msgr2=0x558ecda09780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:17:59.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b82d9d640 1 --2- 172.21.15.59:0/4160709533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f04d0 0x558ecda09780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b82d9d640 1 -- 172.21.15.59:0/4160709533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ecda06d20 con 0x558ecda01190 2024-09-10T21:17:59.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b7bfff640 1 --2- 172.21.15.59:0/4160709533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f0df0 0x558ecda060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:17:59.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b82d9d640 1 --2- 172.21.15.59:0/4160709533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecda065e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009270 tx=0x7f8b7c0ac900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d846fd5cd82f4238 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:17:59.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:17:59.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b69ffb640 1 -- 172.21.15.59:0/4160709533 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c05a020 con 0x558ecda01190 2024-09-10T21:17:59.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b69ffb640 1 -- 172.21.15.59:0/4160709533 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8b7c0ab460 con 0x558ecda01190 2024-09-10T21:17:59.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b8b117740 1 -- 172.21.15.59:0/4160709533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b7c0b0ce0 con 0x558ecda01190 2024-09-10T21:17:59.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b69ffb640 1 -- 172.21.15.59:0/4160709533 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8b7c0c7020 con 0x558ecda01190 2024-09-10T21:17:59.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b8b117740 10 client.16020 fetch_fsmap learned FSMap version 28 2024-09-10T21:17:59.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b8b117740 1 -- 172.21.15.59:0/4160709533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558ecda7ea30 con 0x558ecda01190 2024-09-10T21:17:59.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b69ffb640 1 -- 172.21.15.59:0/4160709533 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b7c0b0ce0 con 0x558ecda01190 2024-09-10T21:17:59.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b69ffb640 1 -- 172.21.15.59:0/4160709533 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8b7c0aaed0 con 0x558ecda01190 2024-09-10T21:17:59.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b8b117740 10 client.16020 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:17:59.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b8b117740 10 client.16020 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:17:59.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b8b117740 20 client.16020 populate_metadata read hostname 'smithi059' 2024-09-10T21:17:59.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b8b117740 1 --2- 172.21.15.59:0/4160709533 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x558ecda7ef30 0x558ecda81350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:17:59.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b8b117740 4 client.16020 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:17:59.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.896+0000 7f8b8b117740 1 -- 172.21.15.59:0/4160709533 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558ecd9648a0 con 0x558ecda7ef30 2024-09-10T21:17:59.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.897+0000 7f8b8259c640 1 --2- 172.21.15.59:0/4160709533 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x558ecda7ef30 0x558ecda81350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:17:59.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.897+0000 7f8b8259c640 1 --2- 172.21.15.59:0/4160709533 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x558ecda7ef30 0x558ecda81350 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=df5e578d58162d03 server_cookie=41ef7cbd1c100fdd in_seq=0 out_seq=0 2024-09-10T21:17:59.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.897+0000 7f8b69ffb640 10 client.16020 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:17:59.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.898+0000 7f8b69ffb640 1 -- 172.21.15.59:0/4160709533 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558ecd9648a0 con 0x558ecda7ef30 2024-09-10T21:17:59.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.898+0000 7f8b69ffb640 10 client.16020 handle_command_reply: tid=0 2024-09-10T21:17:59.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.898+0000 7f8b8b117740 1 client.16020 shutdown 2024-09-10T21:17:59.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.898+0000 7f8b8b117740 1 -- 172.21.15.59:0/4160709533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 msgr2=0x558ecda065e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:59.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.898+0000 7f8b8b117740 1 --2- 172.21.15.59:0/4160709533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecda065e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009270 tx=0x7f8b7c0ac900 comp rx=0 tx=0).stop 2024-09-10T21:17:59.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.898+0000 7f8b8b117740 1 -- 172.21.15.59:0/4160709533 shutdown_connections 2024-09-10T21:17:59.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.898+0000 7f8b8b117740 1 --2- 172.21.15.59:0/4160709533 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x558ecda7ef30 0x558ecda81350 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.898+0000 7f8b8b117740 1 --2- 172.21.15.59:0/4160709533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ecda01190 0x558ecda065e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.898+0000 7f8b8b117740 1 --2- 172.21.15.59:0/4160709533 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ecd9f0df0 0x558ecda060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.898+0000 7f8b8b117740 1 --2- 172.21.15.59:0/4160709533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ecd9f04d0 0x558ecda09780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.898+0000 7f8b8b117740 1 -- 172.21.15.59:0/4160709533 >> 172.21.15.59:0/4160709533 conn(0x558ecd9ee300 msgr2=0x558ecd9f3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:59.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.898+0000 7f8b69ffb640 0 client.16020 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:17:59.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.898+0000 7f8b8b117740 1 -- 172.21.15.59:0/4160709533 shutdown_connections 2024-09-10T21:17:59.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.898+0000 7f8b8b117740 1 -- 172.21.15.59:0/4160709533 wait complete. 2024-09-10T21:17:59.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.898+0000 7f8b8b117740 20 client.16020 trim_cache size 0 max 16384 2024-09-10T21:17:59.908 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:17:59.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.898+0000 7f8b88d42640 1 -- 172.21.15.59:0/2412236490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8b700b52e0 msgr2=0x7f8b700b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:59.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.898+0000 7f8b88d42640 1 --2- 172.21.15.59:0/2412236490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8b700b52e0 0x7f8b700b77a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0096c0 tx=0x7f8b6c041040 comp rx=0 tx=0).stop 2024-09-10T21:17:59.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.898+0000 7f8b88d42640 1 -- 172.21.15.59:0/2412236490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b8410d140 msgr2=0x7f8b8419ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:17:59.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.898+0000 7f8b88d42640 1 --2- 172.21.15.59:0/2412236490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b8410d140 0x7f8b8419ec20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00eaa0 tx=0x7f8b7c00eea0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.899+0000 7f8b88d42640 1 -- 172.21.15.59:0/2412236490 shutdown_connections 2024-09-10T21:17:59.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.899+0000 7f8b88d42640 1 --2- 172.21.15.59:0/2412236490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8b700b52e0 0x7f8b700b77a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.899+0000 7f8b88d42640 1 --2- 172.21.15.59:0/2412236490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b8410d140 0x7f8b8419ec20 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.899+0000 7f8b88d42640 1 --2- 172.21.15.59:0/2412236490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b84104600 0x7f8b84199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.899+0000 7f8b88d42640 1 --2- 172.21.15.59:0/2412236490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b84103ce0 0x7f8b84199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:17:59.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.899+0000 7f8b88d42640 1 -- 172.21.15.59:0/2412236490 >> 172.21.15.59:0/2412236490 conn(0x7f8b840fd720 msgr2=0x7f8b840fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:17:59.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.899+0000 7f8b88d42640 1 -- 172.21.15.59:0/2412236490 shutdown_connections 2024-09-10T21:17:59.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:17:59.899+0000 7f8b88d42640 1 -- 172.21.15.59:0/2412236490 wait complete. 2024-09-10T21:18:00.675 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:18:00.937 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:18:01.307 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:01 smithi154 ceph-mon[35041]: pgmap v422: 97 pgs: 97 active+clean; 1.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:18:01.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:01 smithi192 ceph-mon[35363]: pgmap v422: 97 pgs: 97 active+clean; 1.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:18:01.328 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:01 smithi059 ceph-mon[30888]: pgmap v422: 97 pgs: 97 active+clean; 1.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:18:01.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.409+0000 7f76d259f640 1 -- 172.21.15.59:0/3975133296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76cc102dc0 msgr2=0x7f76cc1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:01.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.409+0000 7f76d259f640 1 --2- 172.21.15.59:0/3975133296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76cc102dc0 0x7f76cc1031a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009900 tx=0x7f76bc02a410 comp rx=0 tx=0).stop 2024-09-10T21:18:01.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.409+0000 7f76d259f640 1 -- 172.21.15.59:0/3975133296 shutdown_connections 2024-09-10T21:18:01.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.409+0000 7f76d259f640 1 --2- 172.21.15.59:0/3975133296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76cc109150 0x7f76cc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.409+0000 7f76d259f640 1 --2- 172.21.15.59:0/3975133296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76cc1087d0 0x7f76cc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.409+0000 7f76d259f640 1 --2- 172.21.15.59:0/3975133296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76cc102dc0 0x7f76cc1031a0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.409+0000 7f76d259f640 1 -- 172.21.15.59:0/3975133296 >> 172.21.15.59:0/3975133296 conn(0x7f76cc0fe830 msgr2=0x7f76cc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:01.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.410+0000 7f76d259f640 1 -- 172.21.15.59:0/3975133296 shutdown_connections 2024-09-10T21:18:01.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.410+0000 7f76d259f640 1 -- 172.21.15.59:0/3975133296 wait complete. 2024-09-10T21:18:01.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.410+0000 7f76d259f640 1 Processor -- start 2024-09-10T21:18:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.410+0000 7f76d259f640 1 -- start start 2024-09-10T21:18:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.411+0000 7f76d259f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76cc102dc0 0x7f76cc199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.411+0000 7f76d259f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76cc1087d0 0x7f76cc199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.411+0000 7f76d259f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76cc109150 0x7f76cc19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.411+0000 7f76d259f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc112dd0 con 0x7f76cc109150 2024-09-10T21:18:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.411+0000 7f76d259f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc112c50 con 0x7f76cc102dc0 2024-09-10T21:18:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.411+0000 7f76d259f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc112f50 con 0x7f76cc1087d0 2024-09-10T21:18:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.411+0000 7f76d0b3c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76cc109150 0x7f76cc19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.411+0000 7f76d0b3c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76cc109150 0x7f76cc19eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45782/0 (socket says 172.21.15.59:45782) 2024-09-10T21:18:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.411+0000 7f76d0b3c640 1 -- 172.21.15.59:0/3919201739 learned_addr learned my addr 172.21.15.59:0/3919201739 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.411+0000 7f76cbfff640 1 --2- 172.21.15.59:0/3919201739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76cc102dc0 0x7f76cc199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.411+0000 7f76cb7fe640 1 --2- 172.21.15.59:0/3919201739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76cc1087d0 0x7f76cc199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:01.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.411+0000 7f76d0b3c640 1 -- 172.21.15.59:0/3919201739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76cc1087d0 msgr2=0x7f76cc199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:01.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.411+0000 7f76d0b3c640 1 --2- 172.21.15.59:0/3919201739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76cc1087d0 0x7f76cc199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.411+0000 7f76d0b3c640 1 -- 172.21.15.59:0/3919201739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76cc102dc0 msgr2=0x7f76cc199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:01.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.411+0000 7f76d0b3c640 1 --2- 172.21.15.59:0/3919201739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76cc102dc0 0x7f76cc199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.411+0000 7f76d0b3c640 1 -- 172.21.15.59:0/3919201739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76cc19f2f0 con 0x7f76cc109150 2024-09-10T21:18:01.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.411+0000 7f76cb7fe640 1 --2- 172.21.15.59:0/3919201739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76cc1087d0 0x7f76cc199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:01.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.411+0000 7f76d0b3c640 1 --2- 172.21.15.59:0/3919201739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76cc109150 0x7f76cc19eb20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009fd0 tx=0x7f76c400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:01.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.412+0000 7f76c97fa640 1 -- 172.21.15.59:0/3919201739 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4017070 con 0x7f76cc109150 2024-09-10T21:18:01.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.412+0000 7f76c97fa640 1 -- 172.21.15.59:0/3919201739 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76c4003e20 con 0x7f76cc109150 2024-09-10T21:18:01.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.412+0000 7f76d259f640 1 -- 172.21.15.59:0/3919201739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76cc19f5e0 con 0x7f76cc109150 2024-09-10T21:18:01.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.412+0000 7f76c97fa640 1 -- 172.21.15.59:0/3919201739 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4010460 con 0x7f76cc109150 2024-09-10T21:18:01.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.412+0000 7f76d259f640 1 -- 172.21.15.59:0/3919201739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76cc1a5ca0 con 0x7f76cc109150 2024-09-10T21:18:01.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.414+0000 7f76d4974740 1 Processor -- start 2024-09-10T21:18:01.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.414+0000 7f76c97fa640 1 -- 172.21.15.59:0/3919201739 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f76c4003970 con 0x7f76cc109150 2024-09-10T21:18:01.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.414+0000 7f76d4974740 1 -- start start 2024-09-10T21:18:01.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.414+0000 7f76d4974740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b85f0f0 0x56113b85f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:01.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.414+0000 7f76d4974740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b85fa10 0x56113b86b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:01.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.414+0000 7f76d4974740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b86b9a0 0x56113b86dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:01.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.414+0000 7f76d4974740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56113b7d5ea0 con 0x56113b86b9a0 2024-09-10T21:18:01.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.414+0000 7f76d4974740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56113b7c52d0 con 0x56113b85fa10 2024-09-10T21:18:01.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.414+0000 7f76d4974740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56113b7c90e0 con 0x56113b85f0f0 2024-09-10T21:18:01.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.415+0000 7f76cb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b86b9a0 0x56113b86dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:01.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.415+0000 7f76cb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b86b9a0 0x56113b86dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45790/0 (socket says 172.21.15.59:45790) 2024-09-10T21:18:01.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.415+0000 7f76cb7fe640 1 -- 172.21.15.59:0/2466750752 learned_addr learned my addr 172.21.15.59:0/2466750752 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:01.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.415+0000 7f76cb7fe640 1 --2- 172.21.15.59:0/2466750752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b85f0f0 0x56113b85f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:01.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.415+0000 7f76cbfff640 1 --2- 172.21.15.59:0/2466750752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b85fa10 0x56113b86b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:01.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.415+0000 7f76cb7fe640 1 -- 172.21.15.59:0/2466750752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b85f0f0 msgr2=0x56113b85f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:01.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.415+0000 7f76cb7fe640 1 --2- 172.21.15.59:0/2466750752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b85f0f0 0x56113b85f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.415+0000 7f76cb7fe640 1 -- 172.21.15.59:0/2466750752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b85fa10 msgr2=0x56113b86b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:01.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.415+0000 7f76cb7fe640 1 --2- 172.21.15.59:0/2466750752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b85fa10 0x56113b86b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.415+0000 7f76cb7fe640 1 -- 172.21.15.59:0/2466750752 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56113b523650 con 0x56113b86b9a0 2024-09-10T21:18:01.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.415+0000 7f76c97fa640 1 --2- 172.21.15.59:0/3919201739 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f76b40b5360 0x7f76b40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:01.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.415+0000 7f76cb7fe640 1 --2- 172.21.15.59:0/2466750752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b86b9a0 0x56113b86dd90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f76c0012880 tx=0x7f76c000d440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c58dcedaac4f21 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:01.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.415+0000 7f76cbfff640 1 --2- 172.21.15.59:0/3919201739 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f76b40b5360 0x7f76b40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:01.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.415+0000 7f76b27fc640 1 -- 172.21.15.59:0/2466750752 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c000aa60 con 0x56113b86b9a0 2024-09-10T21:18:01.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.415+0000 7f76c97fa640 1 -- 172.21.15.59:0/3919201739 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f76c40e5990 con 0x7f76cc109150 2024-09-10T21:18:01.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.416+0000 7f76b27fc640 1 -- 172.21.15.59:0/2466750752 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76c00054d0 con 0x56113b86b9a0 2024-09-10T21:18:01.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.416+0000 7f76b27fc640 1 -- 172.21.15.59:0/2466750752 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c0004a90 con 0x56113b86b9a0 2024-09-10T21:18:01.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.416+0000 7f76d4974740 1 -- 172.21.15.59:0/2466750752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b86b9a0 msgr2=0x56113b86dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:01.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.416+0000 7f76cbfff640 1 --2- 172.21.15.59:0/3919201739 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f76b40b5360 0x7f76b40b7820 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f76bc031440 tx=0x7f76bc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:01.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.416+0000 7f76d4974740 1 --2- 172.21.15.59:0/2466750752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b86b9a0 0x56113b86dd90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f76c0012880 tx=0x7f76c000d440 comp rx=0 tx=0).stop 2024-09-10T21:18:01.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.416+0000 7f76d4974740 1 -- 172.21.15.59:0/2466750752 shutdown_connections 2024-09-10T21:18:01.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.416+0000 7f76d4974740 1 --2- 172.21.15.59:0/2466750752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b86b9a0 0x56113b86dd90 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.416+0000 7f76d4974740 1 --2- 172.21.15.59:0/2466750752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b85fa10 0x56113b86b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.416+0000 7f76d4974740 1 --2- 172.21.15.59:0/2466750752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b85f0f0 0x56113b85f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.416+0000 7f76d4974740 1 -- 172.21.15.59:0/2466750752 >> 172.21.15.59:0/2466750752 conn(0x56113b85cf20 msgr2=0x56113b85e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:01.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.416+0000 7f76d4974740 1 -- 172.21.15.59:0/2466750752 shutdown_connections 2024-09-10T21:18:01.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.416+0000 7f76d4974740 1 -- 172.21.15.59:0/2466750752 wait complete. 2024-09-10T21:18:01.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.417+0000 7f76d4974740 1 -- start start 2024-09-10T21:18:01.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.417+0000 7f76d4974740 1 Processor -- start 2024-09-10T21:18:01.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.417+0000 7f76d4974740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b85f0f0 0x56113b86b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:01.451 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:18:01.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.417+0000 7f76d4974740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b85fa10 0x56113b868740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:01.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.417+0000 7f76d4974740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b86b9a0 0x56113b868da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:01.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.417+0000 7f76d4974740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56113b626700 con 0x56113b85f0f0 2024-09-10T21:18:01.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.417+0000 7f76d4974740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56113b760160 con 0x56113b86b9a0 2024-09-10T21:18:01.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.417+0000 7f76d4974740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56113b86e620 con 0x56113b85fa10 2024-09-10T21:18:01.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.417+0000 7f76d4974740 10 client.0 _ll_register_callbacks cb 0x56113b7799e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:01.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.417+0000 7f76cbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b85f0f0 0x56113b86b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:01.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.417+0000 7f76cbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b85f0f0 0x56113b86b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45792/0 (socket says 172.21.15.59:45792) 2024-09-10T21:18:01.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.417+0000 7f76cbfff640 1 -- 172.21.15.59:0/3298368236 learned_addr learned my addr 172.21.15.59:0/3298368236 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:01.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.417+0000 7f76cb7fe640 1 --2- 172.21.15.59:0/3298368236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b85fa10 0x56113b868740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:01.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.418+0000 7f76d0b3c640 1 --2- 172.21.15.59:0/3298368236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b86b9a0 0x56113b868da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:01.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.418+0000 7f76cbfff640 1 -- 172.21.15.59:0/3298368236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b85fa10 msgr2=0x56113b868740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:01.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.418+0000 7f76cbfff640 1 --2- 172.21.15.59:0/3298368236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b85fa10 0x56113b868740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.418+0000 7f76cbfff640 1 -- 172.21.15.59:0/3298368236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b86b9a0 msgr2=0x56113b868da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:01.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.418+0000 7f76cbfff640 1 --2- 172.21.15.59:0/3298368236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b86b9a0 0x56113b868da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.418+0000 7f76cbfff640 1 -- 172.21.15.59:0/3298368236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56113b78dc90 con 0x56113b85f0f0 2024-09-10T21:18:01.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.418+0000 7f76cbfff640 1 --2- 172.21.15.59:0/3298368236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b85f0f0 0x56113b86b2f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f76bc032fd0 tx=0x7f76bc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb86fe86e97217a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:01.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.418+0000 7f76ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:01.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.418+0000 7f76ab7fe640 1 -- 172.21.15.59:0/3298368236 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76bc04c070 con 0x56113b85f0f0 2024-09-10T21:18:01.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.418+0000 7f76ab7fe640 1 -- 172.21.15.59:0/3298368236 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f76bc005260 con 0x56113b85f0f0 2024-09-10T21:18:01.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.418+0000 7f76d4974740 1 -- 172.21.15.59:0/3298368236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76c00054d0 con 0x56113b85f0f0 2024-09-10T21:18:01.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.418+0000 7f76ab7fe640 1 -- 172.21.15.59:0/3298368236 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f76bc058050 con 0x56113b85f0f0 2024-09-10T21:18:01.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.418+0000 7f76d4974740 10 client.16032 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:01.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.418+0000 7f76d4974740 1 -- 172.21.15.59:0/3298368236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56113b879fb0 con 0x56113b85f0f0 2024-09-10T21:18:01.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.419+0000 7f76ab7fe640 1 -- 172.21.15.59:0/3298368236 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76c00054d0 con 0x56113b85f0f0 2024-09-10T21:18:01.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.419+0000 7f76ab7fe640 1 -- 172.21.15.59:0/3298368236 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f76bc0037b0 con 0x56113b85f0f0 2024-09-10T21:18:01.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.419+0000 7f76d4974740 10 client.16032 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:01.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.419+0000 7f76d4974740 10 client.16032 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:18:01.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.419+0000 7f76d4974740 20 client.16032 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:01.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.419+0000 7f76d4974740 1 --2- 172.21.15.59:0/3298368236 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56113b87b480 0x56113b87d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:01.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.419+0000 7f76d4974740 4 client.16032 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:18:01.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.419+0000 7f76d4974740 1 -- 172.21.15.59:0/3298368236 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56113b7d7df0 con 0x56113b87b480 2024-09-10T21:18:01.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.419+0000 7f76cb7fe640 1 --2- 172.21.15.59:0/3298368236 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56113b87b480 0x56113b87d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:01.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.420+0000 7f76cb7fe640 1 --2- 172.21.15.59:0/3298368236 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56113b87b480 0x56113b87d8b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2ba1d57f6d08a569 server_cookie=774e783d2437fce7 in_seq=0 out_seq=0 2024-09-10T21:18:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.420+0000 7f76ab7fe640 10 client.16032 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:18:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.420+0000 7f76ab7fe640 1 -- 172.21.15.59:0/3298368236 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56113b7d7df0 con 0x56113b87b480 2024-09-10T21:18:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.420+0000 7f76ab7fe640 10 client.16032 handle_command_reply: tid=0 2024-09-10T21:18:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.420+0000 7f76d4974740 1 client.16032 shutdown 2024-09-10T21:18:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.421+0000 7f76d4974740 1 -- 172.21.15.59:0/3298368236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b85f0f0 msgr2=0x56113b86b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.421+0000 7f76d4974740 1 --2- 172.21.15.59:0/3298368236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b85f0f0 0x56113b86b2f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f76bc032fd0 tx=0x7f76bc009260 comp rx=0 tx=0).stop 2024-09-10T21:18:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.421+0000 7f76d4974740 1 -- 172.21.15.59:0/3298368236 shutdown_connections 2024-09-10T21:18:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.421+0000 7f76d4974740 1 --2- 172.21.15.59:0/3298368236 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56113b87b480 0x56113b87d8b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.421+0000 7f76d4974740 1 --2- 172.21.15.59:0/3298368236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b86b9a0 0x56113b868da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.421+0000 7f76d4974740 1 --2- 172.21.15.59:0/3298368236 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b85fa10 0x56113b868740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.421+0000 7f76ab7fe640 0 client.16032 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:18:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.421+0000 7f76d4974740 1 --2- 172.21.15.59:0/3298368236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b85f0f0 0x56113b86b2f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.421+0000 7f76d4974740 1 -- 172.21.15.59:0/3298368236 >> 172.21.15.59:0/3298368236 conn(0x56113b85cf20 msgr2=0x56113b862ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.421+0000 7f76d4974740 1 -- 172.21.15.59:0/3298368236 shutdown_connections 2024-09-10T21:18:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.421+0000 7f76d4974740 1 -- 172.21.15.59:0/3298368236 wait complete. 2024-09-10T21:18:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.421+0000 7f76d4974740 20 client.16032 trim_cache size 0 max 16384 2024-09-10T21:18:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.434+0000 7f76d4974740 1 Processor -- start 2024-09-10T21:18:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.434+0000 7f76d4974740 1 -- start start 2024-09-10T21:18:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.434+0000 7f76d4974740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b85f0f0 0x56113b85c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.434+0000 7f76d4974740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b85fa10 0x56113b86a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.434+0000 7f76d4974740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b86b9a0 0x56113b86cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.434+0000 7f76d4974740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc1ae310 con 0x56113b85fa10 2024-09-10T21:18:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.434+0000 7f76d4974740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc1afe50 con 0x56113b85f0f0 2024-09-10T21:18:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.435+0000 7f76d4974740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc1ae9e0 con 0x56113b86b9a0 2024-09-10T21:18:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.435+0000 7f76cb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b85fa10 0x56113b86a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:01.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.435+0000 7f76cb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b85fa10 0x56113b86a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45798/0 (socket says 172.21.15.59:45798) 2024-09-10T21:18:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.435+0000 7f76cb7fe640 1 -- 172.21.15.59:0/3561004859 learned_addr learned my addr 172.21.15.59:0/3561004859 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.435+0000 7f76cbfff640 1 --2- 172.21.15.59:0/3561004859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b85f0f0 0x56113b85c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.435+0000 7f76d0b3c640 1 --2- 172.21.15.59:0/3561004859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b86b9a0 0x56113b86cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.435+0000 7f76cb7fe640 1 -- 172.21.15.59:0/3561004859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b86b9a0 msgr2=0x56113b86cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.435+0000 7f76cb7fe640 1 --2- 172.21.15.59:0/3561004859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b86b9a0 0x56113b86cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.435+0000 7f76cb7fe640 1 -- 172.21.15.59:0/3561004859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b85f0f0 msgr2=0x56113b85c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.435+0000 7f76cb7fe640 1 --2- 172.21.15.59:0/3561004859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b85f0f0 0x56113b85c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.435+0000 7f76cb7fe640 1 -- 172.21.15.59:0/3561004859 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56113b8587e0 con 0x56113b85fa10 2024-09-10T21:18:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.435+0000 7f76cbfff640 1 --2- 172.21.15.59:0/3561004859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b85f0f0 0x56113b85c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.435+0000 7f76d0b3c640 1 --2- 172.21.15.59:0/3561004859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b86b9a0 0x56113b86cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.435+0000 7f76cb7fe640 1 --2- 172.21.15.59:0/3561004859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b85fa10 0x56113b86a480 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f76c000a620 tx=0x7f76c001f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fecef63a0fd6f3eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.435+0000 7f76b1ffb640 1 -- 172.21.15.59:0/3561004859 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c0035070 con 0x56113b85fa10 2024-09-10T21:18:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.435+0000 7f76b1ffb640 1 -- 172.21.15.59:0/3561004859 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76c0012520 con 0x56113b85fa10 2024-09-10T21:18:01.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.435+0000 7f76b1ffb640 1 -- 172.21.15.59:0/3561004859 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c0030d40 con 0x56113b85fa10 2024-09-10T21:18:01.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.436+0000 7f76d4974740 1 -- 172.21.15.59:0/3561004859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b85fa10 msgr2=0x56113b86a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:01.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.436+0000 7f76d4974740 1 --2- 172.21.15.59:0/3561004859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b85fa10 0x56113b86a480 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f76c000a620 tx=0x7f76c001f040 comp rx=0 tx=0).stop 2024-09-10T21:18:01.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.436+0000 7f76d4974740 1 -- 172.21.15.59:0/3561004859 shutdown_connections 2024-09-10T21:18:01.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.436+0000 7f76d4974740 1 --2- 172.21.15.59:0/3561004859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b86b9a0 0x56113b86cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.436+0000 7f76d4974740 1 --2- 172.21.15.59:0/3561004859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b85fa10 0x56113b86a480 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.436+0000 7f76d4974740 1 --2- 172.21.15.59:0/3561004859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b85f0f0 0x56113b85c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.436+0000 7f76d4974740 1 -- 172.21.15.59:0/3561004859 >> 172.21.15.59:0/3561004859 conn(0x56113b85cf20 msgr2=0x56113b869d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:01.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.436+0000 7f76d4974740 1 -- 172.21.15.59:0/3561004859 shutdown_connections 2024-09-10T21:18:01.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.436+0000 7f76d4974740 1 -- 172.21.15.59:0/3561004859 wait complete. 2024-09-10T21:18:01.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.436+0000 7f76d4974740 1 -- start start 2024-09-10T21:18:01.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.437+0000 7f76d4974740 1 Processor -- start 2024-09-10T21:18:01.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.437+0000 7f76d4974740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b85f0f0 0x56113b873c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:01.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.437+0000 7f76d4974740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b85fa10 0x56113b8741f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:01.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.437+0000 7f76d4974740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b86b9a0 0x56113b86ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.437+0000 7f76d4974740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc1af780 con 0x56113b86b9a0 2024-09-10T21:18:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.437+0000 7f76d4974740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc1af0b0 con 0x56113b85f0f0 2024-09-10T21:18:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.437+0000 7f76d4974740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc1ac2f0 con 0x56113b85fa10 2024-09-10T21:18:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.437+0000 7f76d4974740 10 client.0 _ll_register_callbacks cb 0x7f76bc005df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.437+0000 7f76d0b3c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b86b9a0 0x56113b86ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.437+0000 7f76d0b3c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b86b9a0 0x56113b86ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45812/0 (socket says 172.21.15.59:45812) 2024-09-10T21:18:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.437+0000 7f76d0b3c640 1 -- 172.21.15.59:0/2768411233 learned_addr learned my addr 172.21.15.59:0/2768411233 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.437+0000 7f76cb7fe640 1 --2- 172.21.15.59:0/2768411233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b85fa10 0x56113b8741f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.437+0000 7f76cbfff640 1 --2- 172.21.15.59:0/2768411233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b85f0f0 0x56113b873c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.437+0000 7f76d0b3c640 1 -- 172.21.15.59:0/2768411233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b85fa10 msgr2=0x56113b8741f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.437+0000 7f76d0b3c640 1 --2- 172.21.15.59:0/2768411233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b85fa10 0x56113b8741f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.437+0000 7f76d0b3c640 1 -- 172.21.15.59:0/2768411233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b85f0f0 msgr2=0x56113b873c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.437+0000 7f76d0b3c640 1 --2- 172.21.15.59:0/2768411233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b85f0f0 0x56113b873c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.437+0000 7f76d0b3c640 1 -- 172.21.15.59:0/2768411233 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56113b85d9a0 con 0x56113b86b9a0 2024-09-10T21:18:01.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.437+0000 7f76cbfff640 1 --2- 172.21.15.59:0/2768411233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b85f0f0 0x56113b873c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:01.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.438+0000 7f76d0b3c640 1 --2- 172.21.15.59:0/2768411233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b86b9a0 0x56113b86ea00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f76c4004430 tx=0x7f76c40042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9bdb53ca497144a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:01.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.438+0000 7f76ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:01.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.438+0000 7f76ab7fe640 1 -- 172.21.15.59:0/2768411233 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4020040 con 0x56113b86b9a0 2024-09-10T21:18:01.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.438+0000 7f76ab7fe640 1 -- 172.21.15.59:0/2768411233 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f76c40cdb60 con 0x56113b86b9a0 2024-09-10T21:18:01.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.438+0000 7f76d4974740 1 -- 172.21.15.59:0/2768411233 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76c0012520 con 0x56113b86b9a0 2024-09-10T21:18:01.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.438+0000 7f76ab7fe640 1 -- 172.21.15.59:0/2768411233 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f76c40ac180 con 0x56113b86b9a0 2024-09-10T21:18:01.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.438+0000 7f76d4974740 10 client.16038 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:01.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.438+0000 7f76d4974740 1 -- 172.21.15.59:0/2768411233 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56113b8e8de0 con 0x56113b86b9a0 2024-09-10T21:18:01.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.438+0000 7f76ab7fe640 1 -- 172.21.15.59:0/2768411233 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76c0012520 con 0x56113b86b9a0 2024-09-10T21:18:01.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.438+0000 7f76ab7fe640 1 -- 172.21.15.59:0/2768411233 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f76c40a7ad0 con 0x56113b86b9a0 2024-09-10T21:18:01.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.438+0000 7f76d4974740 10 client.16038 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:01.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.438+0000 7f76d4974740 10 client.16038 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:18:01.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.438+0000 7f76d4974740 20 client.16038 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:01.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.438+0000 7f76d4974740 1 --2- 172.21.15.59:0/2768411233 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56113b8e9510 0x56113b8eb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:01.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.438+0000 7f76d4974740 4 client.16038 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:18:01.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.438+0000 7f76d4974740 1 -- 172.21.15.59:0/2768411233 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56113b7d38a0 con 0x56113b8e9510 2024-09-10T21:18:01.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.439+0000 7f76cbfff640 1 --2- 172.21.15.59:0/2768411233 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56113b8e9510 0x56113b8eb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:01.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.439+0000 7f76cbfff640 1 --2- 172.21.15.59:0/2768411233 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56113b8e9510 0x56113b8eb930 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a43267edc1c348c4 server_cookie=ea34fbb5502223b1 in_seq=0 out_seq=0 2024-09-10T21:18:01.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.439+0000 7f76ab7fe640 10 client.16038 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:18:01.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.439+0000 7f76ab7fe640 1 -- 172.21.15.59:0/2768411233 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56113b7d38a0 con 0x56113b8e9510 2024-09-10T21:18:01.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.439+0000 7f76ab7fe640 10 client.16038 handle_command_reply: tid=0 2024-09-10T21:18:01.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.439+0000 7f76d4974740 1 client.16038 shutdown 2024-09-10T21:18:01.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.439+0000 7f76d4974740 1 -- 172.21.15.59:0/2768411233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b86b9a0 msgr2=0x56113b86ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:01.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.439+0000 7f76d4974740 1 --2- 172.21.15.59:0/2768411233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b86b9a0 0x56113b86ea00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f76c4004430 tx=0x7f76c40042e0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d4974740 1 -- 172.21.15.59:0/2768411233 shutdown_connections 2024-09-10T21:18:01.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d4974740 1 --2- 172.21.15.59:0/2768411233 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x56113b8e9510 0x56113b8eb930 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d4974740 1 --2- 172.21.15.59:0/2768411233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56113b86b9a0 0x56113b86ea00 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d4974740 1 --2- 172.21.15.59:0/2768411233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56113b85fa10 0x56113b8741f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76ab7fe640 0 client.16038 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:18:01.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d4974740 1 --2- 172.21.15.59:0/2768411233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56113b85f0f0 0x56113b873c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d4974740 1 -- 172.21.15.59:0/2768411233 >> 172.21.15.59:0/2768411233 conn(0x56113b85cf20 msgr2=0x56113b86a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:01.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d4974740 1 -- 172.21.15.59:0/2768411233 shutdown_connections 2024-09-10T21:18:01.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d4974740 1 -- 172.21.15.59:0/2768411233 wait complete. 2024-09-10T21:18:01.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d4974740 20 client.16038 trim_cache size 0 max 16384 2024-09-10T21:18:01.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d259f640 1 -- 172.21.15.59:0/3919201739 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f76b40b5360 msgr2=0x7f76b40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:01.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d259f640 1 --2- 172.21.15.59:0/3919201739 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f76b40b5360 0x7f76b40b7820 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f76bc031440 tx=0x7f76bc005a20 comp rx=0 tx=0).stop 2024-09-10T21:18:01.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d259f640 1 -- 172.21.15.59:0/3919201739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76cc109150 msgr2=0x7f76cc19eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:01.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d259f640 1 --2- 172.21.15.59:0/3919201739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76cc109150 0x7f76cc19eb20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009fd0 tx=0x7f76c400b260 comp rx=0 tx=0).stop 2024-09-10T21:18:01.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d259f640 1 -- 172.21.15.59:0/3919201739 shutdown_connections 2024-09-10T21:18:01.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d259f640 1 --2- 172.21.15.59:0/3919201739 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f76b40b5360 0x7f76b40b7820 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d259f640 1 --2- 172.21.15.59:0/3919201739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76cc109150 0x7f76cc19eb20 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d259f640 1 --2- 172.21.15.59:0/3919201739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76cc1087d0 0x7f76cc199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d259f640 1 --2- 172.21.15.59:0/3919201739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76cc102dc0 0x7f76cc199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:01.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d259f640 1 -- 172.21.15.59:0/3919201739 >> 172.21.15.59:0/3919201739 conn(0x7f76cc0fe830 msgr2=0x7f76cc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:01.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d259f640 1 -- 172.21.15.59:0/3919201739 shutdown_connections 2024-09-10T21:18:01.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:01.440+0000 7f76d259f640 1 -- 172.21.15.59:0/3919201739 wait complete. 2024-09-10T21:18:02.219 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:18:02.483 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:18:03.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.001+0000 7efe5a15c640 1 -- 172.21.15.59:0/3531693295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe5410d100 msgr2=0x7efe5410f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:03.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.001+0000 7efe5a15c640 1 --2- 172.21.15.59:0/3531693295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe5410d100 0x7efe5410f560 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efe4c009ca0 tx=0x7efe4c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.001+0000 7efe5a15c640 1 -- 172.21.15.59:0/3531693295 shutdown_connections 2024-09-10T21:18:03.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.001+0000 7efe5a15c640 1 --2- 172.21.15.59:0/3531693295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe5410d100 0x7efe5410f560 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.001+0000 7efe5a15c640 1 --2- 172.21.15.59:0/3531693295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe541045c0 0x7efe5410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.001+0000 7efe5a15c640 1 --2- 172.21.15.59:0/3531693295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe54103ca0 0x7efe54104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.001+0000 7efe5a15c640 1 -- 172.21.15.59:0/3531693295 >> 172.21.15.59:0/3531693295 conn(0x7efe540fd700 msgr2=0x7efe540ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:03.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.001+0000 7efe5a15c640 1 -- 172.21.15.59:0/3531693295 shutdown_connections 2024-09-10T21:18:03.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.001+0000 7efe5a15c640 1 -- 172.21.15.59:0/3531693295 wait complete. 2024-09-10T21:18:03.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe5a15c640 1 Processor -- start 2024-09-10T21:18:03.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe5a15c640 1 -- start start 2024-09-10T21:18:03.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe5a15c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe54103ca0 0x7efe54199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:03.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe5a15c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe541045c0 0x7efe54199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:03.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe5a15c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe5410d100 0x7efe5419ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:03.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe5a15c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efe54112d70 con 0x7efe54103ca0 2024-09-10T21:18:03.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe5a15c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efe54112bf0 con 0x7efe541045c0 2024-09-10T21:18:03.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe5a15c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efe54112ef0 con 0x7efe5410d100 2024-09-10T21:18:03.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe537fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe54103ca0 0x7efe54199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:03.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe537fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe54103ca0 0x7efe54199120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45826/0 (socket says 172.21.15.59:45826) 2024-09-10T21:18:03.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe537fe640 1 -- 172.21.15.59:0/1708747513 learned_addr learned my addr 172.21.15.59:0/1708747513 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:03.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe53fff640 1 --2- 172.21.15.59:0/1708747513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe5410d100 0x7efe5419ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:03.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe4bfff640 1 --2- 172.21.15.59:0/1708747513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe541045c0 0x7efe54199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:03.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe537fe640 1 -- 172.21.15.59:0/1708747513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe5410d100 msgr2=0x7efe5419ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:03.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe537fe640 1 --2- 172.21.15.59:0/1708747513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe5410d100 0x7efe5419ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe537fe640 1 -- 172.21.15.59:0/1708747513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe541045c0 msgr2=0x7efe54199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:03.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe537fe640 1 --2- 172.21.15.59:0/1708747513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe541045c0 0x7efe54199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe537fe640 1 -- 172.21.15.59:0/1708747513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5419f1d0 con 0x7efe54103ca0 2024-09-10T21:18:03.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe4bfff640 1 --2- 172.21.15.59:0/1708747513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe541045c0 0x7efe54199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:03.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.002+0000 7efe53fff640 1 --2- 172.21.15.59:0/1708747513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe5410d100 0x7efe5419ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:03.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.003+0000 7efe537fe640 1 --2- 172.21.15.59:0/1708747513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe54103ca0 0x7efe54199120 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7efe4400c920 tx=0x7efe4400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:03.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.003+0000 7efe517fa640 1 -- 172.21.15.59:0/1708747513 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe44007c70 con 0x7efe54103ca0 2024-09-10T21:18:03.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.003+0000 7efe5a15c640 1 -- 172.21.15.59:0/1708747513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe5419f4c0 con 0x7efe54103ca0 2024-09-10T21:18:03.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.003+0000 7efe517fa640 1 -- 172.21.15.59:0/1708747513 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe44007e10 con 0x7efe54103ca0 2024-09-10T21:18:03.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.003+0000 7efe517fa640 1 -- 172.21.15.59:0/1708747513 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe44018820 con 0x7efe54103ca0 2024-09-10T21:18:03.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.003+0000 7efe5a15c640 1 -- 172.21.15.59:0/1708747513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe541a5d50 con 0x7efe54103ca0 2024-09-10T21:18:03.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.005+0000 7efe517fa640 1 -- 172.21.15.59:0/1708747513 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7efe4400f450 con 0x7efe54103ca0 2024-09-10T21:18:03.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.006+0000 7efe5c531740 1 Processor -- start 2024-09-10T21:18:03.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.006+0000 7efe5c531740 1 -- start start 2024-09-10T21:18:03.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.006+0000 7efe5c531740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d630f0 0x561c36d634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:03.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.006+0000 7efe5c531740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d63a10 0x561c36d6f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:03.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.006+0000 7efe5c531740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d6f9a0 0x561c36d71d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:03.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.006+0000 7efe5c531740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561c36cd9ea0 con 0x561c36d63a10 2024-09-10T21:18:03.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.006+0000 7efe5c531740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561c36cc92d0 con 0x561c36d630f0 2024-09-10T21:18:03.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.006+0000 7efe5c531740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561c36ccd0e0 con 0x561c36d6f9a0 2024-09-10T21:18:03.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.006+0000 7efe537fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d63a10 0x561c36d6f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:03.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.006+0000 7efe537fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d63a10 0x561c36d6f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45828/0 (socket says 172.21.15.59:45828) 2024-09-10T21:18:03.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.006+0000 7efe537fe640 1 -- 172.21.15.59:0/4078701240 learned_addr learned my addr 172.21.15.59:0/4078701240 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:03.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.006+0000 7efe53fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d630f0 0x561c36d634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:03.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.006+0000 7efe517fa640 1 --2- 172.21.15.59:0/1708747513 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efe400b52e0 0x7efe400b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:03.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.006+0000 7efe4bfff640 1 --2- 172.21.15.59:0/4078701240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d6f9a0 0x561c36d71d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:03.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.006+0000 7efe53fff640 1 --2- 172.21.15.59:0/1708747513 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efe400b52e0 0x7efe400b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:03.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.007+0000 7efe517fa640 1 -- 172.21.15.59:0/1708747513 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7efe440e5e30 con 0x7efe54103ca0 2024-09-10T21:18:03.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.007+0000 7efe537fe640 1 -- 172.21.15.59:0/4078701240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d6f9a0 msgr2=0x561c36d71d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:03.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.007+0000 7efe537fe640 1 --2- 172.21.15.59:0/4078701240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d6f9a0 0x561c36d71d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.007+0000 7efe537fe640 1 -- 172.21.15.59:0/4078701240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d630f0 msgr2=0x561c36d634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:03.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.007+0000 7efe537fe640 1 --2- 172.21.15.59:0/4078701240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d630f0 0x561c36d634d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.007+0000 7efe537fe640 1 -- 172.21.15.59:0/4078701240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c36a27650 con 0x561c36d63a10 2024-09-10T21:18:03.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.007+0000 7efe53fff640 1 --2- 172.21.15.59:0/4078701240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d630f0 0x561c36d634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:18:03.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.007+0000 7efe537fe640 1 --2- 172.21.15.59:0/4078701240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d63a10 0x561c36d6f460 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7efe440ac550 tx=0x7efe44000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a864109de1706197 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:03.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.007+0000 7efe53fff640 1 --2- 172.21.15.59:0/1708747513 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efe400b52e0 0x7efe400b77a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efe4c005fa0 tx=0x7efe4c02a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:03.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.007+0000 7efe49ffb640 1 -- 172.21.15.59:0/4078701240 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe440ac0d0 con 0x561c36d63a10 2024-09-10T21:18:03.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.007+0000 7efe49ffb640 1 -- 172.21.15.59:0/4078701240 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe440accc0 con 0x561c36d63a10 2024-09-10T21:18:03.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.007+0000 7efe49ffb640 1 -- 172.21.15.59:0/4078701240 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4401f300 con 0x561c36d63a10 2024-09-10T21:18:03.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.008+0000 7efe5c531740 1 -- 172.21.15.59:0/4078701240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d63a10 msgr2=0x561c36d6f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:03.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.008+0000 7efe5c531740 1 --2- 172.21.15.59:0/4078701240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d63a10 0x561c36d6f460 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7efe440ac550 tx=0x7efe44000bc0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.008+0000 7efe5c531740 1 -- 172.21.15.59:0/4078701240 shutdown_connections 2024-09-10T21:18:03.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.008+0000 7efe5c531740 1 --2- 172.21.15.59:0/4078701240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d6f9a0 0x561c36d71d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.008+0000 7efe5c531740 1 --2- 172.21.15.59:0/4078701240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d63a10 0x561c36d6f460 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.008+0000 7efe5c531740 1 --2- 172.21.15.59:0/4078701240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d630f0 0x561c36d634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.008+0000 7efe5c531740 1 -- 172.21.15.59:0/4078701240 >> 172.21.15.59:0/4078701240 conn(0x561c36d60f20 msgr2=0x561c36d620c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:03.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.008+0000 7efe5c531740 1 -- 172.21.15.59:0/4078701240 shutdown_connections 2024-09-10T21:18:03.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.008+0000 7efe5c531740 1 -- 172.21.15.59:0/4078701240 wait complete. 2024-09-10T21:18:03.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.008+0000 7efe5c531740 1 -- start start 2024-09-10T21:18:03.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe5c531740 1 Processor -- start 2024-09-10T21:18:03.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe5c531740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d630f0 0x561c36d6f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:03.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe5c531740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d63a10 0x561c36d6c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:03.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe5c531740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d6f9a0 0x561c36d6cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:03.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe5c531740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561c36b2a700 con 0x561c36d6f9a0 2024-09-10T21:18:03.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe5c531740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561c36c64160 con 0x561c36d630f0 2024-09-10T21:18:03.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe5c531740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561c36d72560 con 0x561c36d63a10 2024-09-10T21:18:03.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe5c531740 10 client.0 _ll_register_callbacks cb 0x561c36c7d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:03.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe53fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d6f9a0 0x561c36d6cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:03.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe53fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d6f9a0 0x561c36d6cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45830/0 (socket says 172.21.15.59:45830) 2024-09-10T21:18:03.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe53fff640 1 -- 172.21.15.59:0/2691659695 learned_addr learned my addr 172.21.15.59:0/2691659695 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:03.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe4bfff640 1 --2- 172.21.15.59:0/2691659695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d63a10 0x561c36d6c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:03.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe537fe640 1 --2- 172.21.15.59:0/2691659695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d630f0 0x561c36d6f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:03.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe53fff640 1 -- 172.21.15.59:0/2691659695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d63a10 msgr2=0x561c36d6c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:03.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe53fff640 1 --2- 172.21.15.59:0/2691659695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d63a10 0x561c36d6c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe53fff640 1 -- 172.21.15.59:0/2691659695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d630f0 msgr2=0x561c36d6f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:03.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe53fff640 1 --2- 172.21.15.59:0/2691659695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d630f0 0x561c36d6f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe53fff640 1 -- 172.21.15.59:0/2691659695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c36c91c90 con 0x561c36d6f9a0 2024-09-10T21:18:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe53fff640 1 --2- 172.21.15.59:0/2691659695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d6f9a0 0x561c36d6cca0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7efe4c035000 tx=0x7efe4c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f080b99be43443ed server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.009+0000 7efe32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.010+0000 7efe32ffd640 1 -- 172.21.15.59:0/2691659695 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4c045070 con 0x561c36d6f9a0 2024-09-10T21:18:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.010+0000 7efe5c531740 1 -- 172.21.15.59:0/2691659695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe440accc0 con 0x561c36d6f9a0 2024-09-10T21:18:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.010+0000 7efe32ffd640 1 -- 172.21.15.59:0/2691659695 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7efe4c02f660 con 0x561c36d6f9a0 2024-09-10T21:18:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.010+0000 7efe32ffd640 1 -- 172.21.15.59:0/2691659695 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efe4c004b40 con 0x561c36d6f9a0 2024-09-10T21:18:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.010+0000 7efe5c531740 10 client.16050 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.010+0000 7efe5c531740 1 -- 172.21.15.59:0/2691659695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561c36d7dec0 con 0x561c36d6f9a0 2024-09-10T21:18:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.010+0000 7efe32ffd640 1 -- 172.21.15.59:0/2691659695 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe440accc0 con 0x561c36d6f9a0 2024-09-10T21:18:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.010+0000 7efe32ffd640 1 -- 172.21.15.59:0/2691659695 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efe4c0308f0 con 0x561c36d6f9a0 2024-09-10T21:18:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.010+0000 7efe5c531740 10 client.16050 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.010+0000 7efe5c531740 10 client.16050 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:18:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.010+0000 7efe5c531740 20 client.16050 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:03.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.010+0000 7efe5c531740 1 --2- 172.21.15.59:0/2691659695 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x561c36d7f370 0x561c36d817d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.010+0000 7efe5c531740 4 client.16050 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:18:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.010+0000 7efe5c531740 1 -- 172.21.15.59:0/2691659695 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c36cdbdf0 con 0x561c36d7f370 2024-09-10T21:18:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.011+0000 7efe537fe640 1 --2- 172.21.15.59:0/2691659695 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x561c36d7f370 0x561c36d817d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.011+0000 7efe537fe640 1 --2- 172.21.15.59:0/2691659695 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x561c36d7f370 0x561c36d817d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8501dab1e5745fc8 server_cookie=3e0e7db4da84b846 in_seq=0 out_seq=0 2024-09-10T21:18:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.011+0000 7efe32ffd640 10 client.16050 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:18:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.012+0000 7efe32ffd640 1 -- 172.21.15.59:0/2691659695 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561c36cdbdf0 con 0x561c36d7f370 2024-09-10T21:18:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.012+0000 7efe32ffd640 10 client.16050 handle_command_reply: tid=0 2024-09-10T21:18:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.012+0000 7efe5c531740 1 client.16050 shutdown 2024-09-10T21:18:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.012+0000 7efe5c531740 1 -- 172.21.15.59:0/2691659695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d6f9a0 msgr2=0x561c36d6cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.012+0000 7efe5c531740 1 --2- 172.21.15.59:0/2691659695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d6f9a0 0x561c36d6cca0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7efe4c035000 tx=0x7efe4c0095c0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.012+0000 7efe5c531740 1 -- 172.21.15.59:0/2691659695 shutdown_connections 2024-09-10T21:18:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.012+0000 7efe5c531740 1 --2- 172.21.15.59:0/2691659695 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x561c36d7f370 0x561c36d817d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.012+0000 7efe5c531740 1 --2- 172.21.15.59:0/2691659695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d6f9a0 0x561c36d6cca0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.012+0000 7efe5c531740 1 --2- 172.21.15.59:0/2691659695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d63a10 0x561c36d6c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.012+0000 7efe32ffd640 0 client.16050 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:18:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.012+0000 7efe5c531740 1 --2- 172.21.15.59:0/2691659695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d630f0 0x561c36d6f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.012+0000 7efe5c531740 1 -- 172.21.15.59:0/2691659695 >> 172.21.15.59:0/2691659695 conn(0x561c36d60f20 msgr2=0x561c36d66ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.012+0000 7efe5c531740 1 -- 172.21.15.59:0/2691659695 shutdown_connections 2024-09-10T21:18:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.012+0000 7efe5c531740 1 -- 172.21.15.59:0/2691659695 wait complete. 2024-09-10T21:18:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.012+0000 7efe5c531740 20 client.16050 trim_cache size 0 max 16384 2024-09-10T21:18:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.026+0000 7efe5c531740 1 Processor -- start 2024-09-10T21:18:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.026+0000 7efe5c531740 1 -- start start 2024-09-10T21:18:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.026+0000 7efe5c531740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d630f0 0x561c36d60760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.026+0000 7efe5c531740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d63a10 0x561c36d6e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.026+0000 7efe5c531740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d6f9a0 0x561c36d70d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.026+0000 7efe5c531740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efe541ae260 con 0x561c36d63a10 2024-09-10T21:18:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.026+0000 7efe5c531740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efe541afda0 con 0x561c36d6f9a0 2024-09-10T21:18:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.026+0000 7efe5c531740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efe541ae930 con 0x561c36d630f0 2024-09-10T21:18:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.026+0000 7efe4bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d63a10 0x561c36d6e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.026+0000 7efe4bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d63a10 0x561c36d6e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45842/0 (socket says 172.21.15.59:45842) 2024-09-10T21:18:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.026+0000 7efe4bfff640 1 -- 172.21.15.59:0/3224200515 learned_addr learned my addr 172.21.15.59:0/3224200515 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.026+0000 7efe537fe640 1 --2- 172.21.15.59:0/3224200515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d630f0 0x561c36d60760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.026+0000 7efe53fff640 1 --2- 172.21.15.59:0/3224200515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d6f9a0 0x561c36d70d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.026+0000 7efe4bfff640 1 -- 172.21.15.59:0/3224200515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d630f0 msgr2=0x561c36d60760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.026+0000 7efe4bfff640 1 --2- 172.21.15.59:0/3224200515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d630f0 0x561c36d60760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.026+0000 7efe4bfff640 1 -- 172.21.15.59:0/3224200515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d6f9a0 msgr2=0x561c36d70d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.026+0000 7efe4bfff640 1 --2- 172.21.15.59:0/3224200515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d6f9a0 0x561c36d70d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.026+0000 7efe4bfff640 1 -- 172.21.15.59:0/3224200515 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c36d5c7e0 con 0x561c36d63a10 2024-09-10T21:18:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.026+0000 7efe53fff640 1 --2- 172.21.15.59:0/3224200515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d6f9a0 0x561c36d70d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.027+0000 7efe4bfff640 1 --2- 172.21.15.59:0/3224200515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d63a10 0x561c36d6e400 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00bd60 tx=0x7efe3c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69518333a7b4fba9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.027+0000 7efe497fa640 1 -- 172.21.15.59:0/3224200515 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c004030 con 0x561c36d63a10 2024-09-10T21:18:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.027+0000 7efe497fa640 1 -- 172.21.15.59:0/3224200515 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe3c0041d0 con 0x561c36d63a10 2024-09-10T21:18:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.027+0000 7efe497fa640 1 -- 172.21.15.59:0/3224200515 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c01b680 con 0x561c36d63a10 2024-09-10T21:18:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.027+0000 7efe5c531740 1 -- 172.21.15.59:0/3224200515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d63a10 msgr2=0x561c36d6e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.027+0000 7efe5c531740 1 --2- 172.21.15.59:0/3224200515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d63a10 0x561c36d6e400 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00bd60 tx=0x7efe3c011810 comp rx=0 tx=0).stop 2024-09-10T21:18:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.027+0000 7efe5c531740 1 -- 172.21.15.59:0/3224200515 shutdown_connections 2024-09-10T21:18:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.028+0000 7efe5c531740 1 --2- 172.21.15.59:0/3224200515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d6f9a0 0x561c36d70d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.028+0000 7efe5c531740 1 --2- 172.21.15.59:0/3224200515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d63a10 0x561c36d6e400 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.028+0000 7efe5c531740 1 --2- 172.21.15.59:0/3224200515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d630f0 0x561c36d60760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.028+0000 7efe5c531740 1 -- 172.21.15.59:0/3224200515 >> 172.21.15.59:0/3224200515 conn(0x561c36d60f20 msgr2=0x561c36d6dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.028+0000 7efe5c531740 1 -- 172.21.15.59:0/3224200515 shutdown_connections 2024-09-10T21:18:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.028+0000 7efe5c531740 1 -- 172.21.15.59:0/3224200515 wait complete. 2024-09-10T21:18:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.028+0000 7efe5c531740 1 -- start start 2024-09-10T21:18:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.028+0000 7efe5c531740 1 Processor -- start 2024-09-10T21:18:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.028+0000 7efe5c531740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d630f0 0x561c36d77b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.028+0000 7efe5c531740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d63a10 0x561c36d780c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe5c531740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d6f9a0 0x561c36d728a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe5c531740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efe541af6d0 con 0x561c36d630f0 2024-09-10T21:18:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe5c531740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efe541af000 con 0x561c36d63a10 2024-09-10T21:18:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe5c531740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efe541ac240 con 0x561c36d6f9a0 2024-09-10T21:18:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe5c531740 10 client.0 _ll_register_callbacks cb 0x7efe4c005d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe537fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d630f0 0x561c36d77b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe537fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d630f0 0x561c36d77b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45850/0 (socket says 172.21.15.59:45850) 2024-09-10T21:18:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe537fe640 1 -- 172.21.15.59:0/3487271279 learned_addr learned my addr 172.21.15.59:0/3487271279 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe4bfff640 1 --2- 172.21.15.59:0/3487271279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d63a10 0x561c36d780c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe53fff640 1 --2- 172.21.15.59:0/3487271279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d6f9a0 0x561c36d728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe537fe640 1 -- 172.21.15.59:0/3487271279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d6f9a0 msgr2=0x561c36d728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe537fe640 1 --2- 172.21.15.59:0/3487271279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d6f9a0 0x561c36d728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe537fe640 1 -- 172.21.15.59:0/3487271279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d63a10 msgr2=0x561c36d780c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe537fe640 1 --2- 172.21.15.59:0/3487271279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d63a10 0x561c36d780c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe537fe640 1 -- 172.21.15.59:0/3487271279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c36d730d0 con 0x561c36d630f0 2024-09-10T21:18:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe53fff640 1 --2- 172.21.15.59:0/3487271279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d6f9a0 0x561c36d728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe537fe640 1 --2- 172.21.15.59:0/3487271279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d630f0 0x561c36d77b40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7efe440a8b90 tx=0x7efe440a8cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cc69ef654de179 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe32ffd640 1 -- 172.21.15.59:0/3487271279 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe44097070 con 0x561c36d630f0 2024-09-10T21:18:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe32ffd640 1 -- 172.21.15.59:0/3487271279 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7efe440a8830 con 0x561c36d630f0 2024-09-10T21:18:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.029+0000 7efe5c531740 1 -- 172.21.15.59:0/3487271279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe3c0041d0 con 0x561c36d630f0 2024-09-10T21:18:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.030+0000 7efe32ffd640 1 -- 172.21.15.59:0/3487271279 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efe440accc0 con 0x561c36d630f0 2024-09-10T21:18:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.030+0000 7efe5c531740 10 client.16056 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.030+0000 7efe5c531740 1 -- 172.21.15.59:0/3487271279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561c36dece90 con 0x561c36d630f0 2024-09-10T21:18:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.030+0000 7efe32ffd640 1 -- 172.21.15.59:0/3487271279 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe3c0041d0 con 0x561c36d630f0 2024-09-10T21:18:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.030+0000 7efe32ffd640 1 -- 172.21.15.59:0/3487271279 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efe440e9020 con 0x561c36d630f0 2024-09-10T21:18:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.030+0000 7efe5c531740 10 client.16056 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.030+0000 7efe5c531740 10 client.16056 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:18:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.030+0000 7efe5c531740 20 client.16056 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.030+0000 7efe5c531740 1 --2- 172.21.15.59:0/3487271279 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x561c36ded180 0x561c36def570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.030+0000 7efe5c531740 4 client.16056 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:18:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.030+0000 7efe5c531740 1 -- 172.21.15.59:0/3487271279 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561c36cd78a0 con 0x561c36ded180 2024-09-10T21:18:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.030+0000 7efe4bfff640 1 --2- 172.21.15.59:0/3487271279 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x561c36ded180 0x561c36def570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.031+0000 7efe4bfff640 1 --2- 172.21.15.59:0/3487271279 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x561c36ded180 0x561c36def570 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e74a4dc3614902bf server_cookie=e2bcc20c21dff62e in_seq=0 out_seq=0 2024-09-10T21:18:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.031+0000 7efe32ffd640 10 client.16056 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:18:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.031+0000 7efe32ffd640 1 -- 172.21.15.59:0/3487271279 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561c36cd78a0 con 0x561c36ded180 2024-09-10T21:18:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.031+0000 7efe32ffd640 10 client.16056 handle_command_reply: tid=0 2024-09-10T21:18:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.031+0000 7efe5c531740 1 client.16056 shutdown 2024-09-10T21:18:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.031+0000 7efe5c531740 1 -- 172.21.15.59:0/3487271279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d630f0 msgr2=0x561c36d77b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.031+0000 7efe5c531740 1 --2- 172.21.15.59:0/3487271279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d630f0 0x561c36d77b40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7efe440a8b90 tx=0x7efe440a8cf0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.031+0000 7efe5c531740 1 -- 172.21.15.59:0/3487271279 shutdown_connections 2024-09-10T21:18:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.031+0000 7efe5c531740 1 --2- 172.21.15.59:0/3487271279 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x561c36ded180 0x561c36def570 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.031+0000 7efe5c531740 1 --2- 172.21.15.59:0/3487271279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c36d6f9a0 0x561c36d728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.031+0000 7efe32ffd640 0 client.16056 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:18:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.031+0000 7efe5c531740 1 --2- 172.21.15.59:0/3487271279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c36d63a10 0x561c36d780c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.031+0000 7efe5c531740 1 --2- 172.21.15.59:0/3487271279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c36d630f0 0x561c36d77b40 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.031+0000 7efe5c531740 1 -- 172.21.15.59:0/3487271279 >> 172.21.15.59:0/3487271279 conn(0x561c36d60f20 msgr2=0x561c36d6e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.031+0000 7efe5c531740 1 -- 172.21.15.59:0/3487271279 shutdown_connections 2024-09-10T21:18:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.031+0000 7efe5c531740 1 -- 172.21.15.59:0/3487271279 wait complete. 2024-09-10T21:18:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.031+0000 7efe5c531740 20 client.16056 trim_cache size 0 max 16384 2024-09-10T21:18:03.052 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:18:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.032+0000 7efe5a15c640 1 -- 172.21.15.59:0/1708747513 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efe400b52e0 msgr2=0x7efe400b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.032+0000 7efe5a15c640 1 --2- 172.21.15.59:0/1708747513 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efe400b52e0 0x7efe400b77a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efe4c005fa0 tx=0x7efe4c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.032+0000 7efe5a15c640 1 -- 172.21.15.59:0/1708747513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe54103ca0 msgr2=0x7efe54199120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.032+0000 7efe5a15c640 1 --2- 172.21.15.59:0/1708747513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe54103ca0 0x7efe54199120 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7efe4400c920 tx=0x7efe4400cde0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.032+0000 7efe5a15c640 1 -- 172.21.15.59:0/1708747513 shutdown_connections 2024-09-10T21:18:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.032+0000 7efe5a15c640 1 --2- 172.21.15.59:0/1708747513 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efe400b52e0 0x7efe400b77a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.032+0000 7efe5a15c640 1 --2- 172.21.15.59:0/1708747513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe5410d100 0x7efe5419ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.032+0000 7efe5a15c640 1 --2- 172.21.15.59:0/1708747513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe541045c0 0x7efe54199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.032+0000 7efe5a15c640 1 --2- 172.21.15.59:0/1708747513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe54103ca0 0x7efe54199120 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.032+0000 7efe5a15c640 1 -- 172.21.15.59:0/1708747513 >> 172.21.15.59:0/1708747513 conn(0x7efe540fd700 msgr2=0x7efe5410f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.032+0000 7efe5a15c640 1 -- 172.21.15.59:0/1708747513 shutdown_connections 2024-09-10T21:18:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:03.032+0000 7efe5a15c640 1 -- 172.21.15.59:0/1708747513 wait complete. 2024-09-10T21:18:03.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:03 smithi192 ceph-mon[35363]: pgmap v423: 97 pgs: 97 active+clean; 1.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:18:03.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:03 smithi059 ceph-mon[30888]: pgmap v423: 97 pgs: 97 active+clean; 1.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:18:03.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:03 smithi154 ceph-mon[35041]: pgmap v423: 97 pgs: 97 active+clean; 1.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:18:03.846 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:18:04.112 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:18:04.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.601+0000 7f57a23c1640 1 -- 172.21.15.59:0/3492101535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c102dc0 msgr2=0x7f579c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.601+0000 7f57a23c1640 1 --2- 172.21.15.59:0/3492101535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c102dc0 0x7f579c1031a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f578c009900 tx=0x7f578c02a410 comp rx=0 tx=0).stop 2024-09-10T21:18:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.601+0000 7f57a23c1640 1 -- 172.21.15.59:0/3492101535 shutdown_connections 2024-09-10T21:18:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.601+0000 7f57a23c1640 1 --2- 172.21.15.59:0/3492101535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f579c109150 0x7f579c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.601+0000 7f57a23c1640 1 --2- 172.21.15.59:0/3492101535 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f579c1087d0 0x7f579c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.601+0000 7f57a23c1640 1 --2- 172.21.15.59:0/3492101535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c102dc0 0x7f579c1031a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.601+0000 7f57a23c1640 1 -- 172.21.15.59:0/3492101535 >> 172.21.15.59:0/3492101535 conn(0x7f579c0fe830 msgr2=0x7f579c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.601+0000 7f57a23c1640 1 -- 172.21.15.59:0/3492101535 shutdown_connections 2024-09-10T21:18:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.601+0000 7f57a23c1640 1 -- 172.21.15.59:0/3492101535 wait complete. 2024-09-10T21:18:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.602+0000 7f57a23c1640 1 Processor -- start 2024-09-10T21:18:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.602+0000 7f57a23c1640 1 -- start start 2024-09-10T21:18:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.602+0000 7f57a23c1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f579c102dc0 0x7f579c1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:04.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.602+0000 7f57a23c1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f579c1087d0 0x7f579c1997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.602+0000 7f57a23c1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c109150 0x7f579c19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.602+0000 7f57a23c1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f579c112e10 con 0x7f579c109150 2024-09-10T21:18:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.602+0000 7f57a23c1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f579c112c90 con 0x7f579c1087d0 2024-09-10T21:18:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.602+0000 7f57a23c1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f579c112f90 con 0x7f579c102dc0 2024-09-10T21:18:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.602+0000 7f57a095e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c109150 0x7f579c19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.602+0000 7f57a095e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c109150 0x7f579c19eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45868/0 (socket says 172.21.15.59:45868) 2024-09-10T21:18:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.602+0000 7f57a095e640 1 -- 172.21.15.59:0/959071621 learned_addr learned my addr 172.21.15.59:0/959071621 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.603+0000 7f579bfff640 1 --2- 172.21.15.59:0/959071621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f579c102dc0 0x7f579c1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.603+0000 7f579b7fe640 1 --2- 172.21.15.59:0/959071621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f579c1087d0 0x7f579c1997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.603+0000 7f57a095e640 1 -- 172.21.15.59:0/959071621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f579c102dc0 msgr2=0x7f579c1992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:04.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.603+0000 7f57a095e640 1 --2- 172.21.15.59:0/959071621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f579c102dc0 0x7f579c1992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.603+0000 7f57a095e640 1 -- 172.21.15.59:0/959071621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f579c1087d0 msgr2=0x7f579c1997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.603+0000 7f57a095e640 1 --2- 172.21.15.59:0/959071621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f579c1087d0 0x7f579c1997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.603+0000 7f57a095e640 1 -- 172.21.15.59:0/959071621 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579c19f350 con 0x7f579c109150 2024-09-10T21:18:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.603+0000 7f579bfff640 1 --2- 172.21.15.59:0/959071621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f579c102dc0 0x7f579c1992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.603+0000 7f57a095e640 1 --2- 172.21.15.59:0/959071621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c109150 0x7f579c19eb80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f579400b970 tx=0x7f579400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.603+0000 7f57997fa640 1 -- 172.21.15.59:0/959071621 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5794019070 con 0x7f579c109150 2024-09-10T21:18:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.603+0000 7f57997fa640 1 -- 172.21.15.59:0/959071621 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5794014440 con 0x7f579c109150 2024-09-10T21:18:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.603+0000 7f57a23c1640 1 -- 172.21.15.59:0/959071621 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f579c19f640 con 0x7f579c109150 2024-09-10T21:18:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.603+0000 7f57997fa640 1 -- 172.21.15.59:0/959071621 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57940075d0 con 0x7f579c109150 2024-09-10T21:18:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.603+0000 7f57a23c1640 1 -- 172.21.15.59:0/959071621 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f579c1a5d80 con 0x7f579c109150 2024-09-10T21:18:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f57997fa640 1 -- 172.21.15.59:0/959071621 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f579400cb40 con 0x7f579c109150 2024-09-10T21:18:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f57a4796740 1 Processor -- start 2024-09-10T21:18:04.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f57a4796740 1 -- start start 2024-09-10T21:18:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f57a4796740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e72068d4d0 0x55e72068d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f57a4796740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068ddf0 0x55e720699840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f57a4796740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e720699d80 0x55e72069c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f57a4796740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e720603ea0 con 0x55e720699d80 2024-09-10T21:18:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f57a4796740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e7205f32d0 con 0x55e72068ddf0 2024-09-10T21:18:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f57a4796740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55e7205f70e0 con 0x55e72068d4d0 2024-09-10T21:18:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f579b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e720699d80 0x55e72069c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f579b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e720699d80 0x55e72069c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45872/0 (socket says 172.21.15.59:45872) 2024-09-10T21:18:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f579b7fe640 1 -- 172.21.15.59:0/302821935 learned_addr learned my addr 172.21.15.59:0/302821935 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f579b7fe640 1 --2- 172.21.15.59:0/302821935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e72068d4d0 0x55e72068d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:04.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f57997fa640 1 --2- 172.21.15.59:0/959071621 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f57840b52e0 0x7f57840b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f579bfff640 1 --2- 172.21.15.59:0/302821935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068ddf0 0x55e720699840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f579b7fe640 1 -- 172.21.15.59:0/302821935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e72068d4d0 msgr2=0x55e72068d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f579b7fe640 1 --2- 172.21.15.59:0/302821935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e72068d4d0 0x55e72068d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f579b7fe640 1 -- 172.21.15.59:0/302821935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068ddf0 msgr2=0x55e720699840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f579b7fe640 1 --2- 172.21.15.59:0/302821935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068ddf0 0x55e720699840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f579b7fe640 1 -- 172.21.15.59:0/302821935 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e720351650 con 0x55e720699d80 2024-09-10T21:18:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.606+0000 7f579bfff640 1 --2- 172.21.15.59:0/302821935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068ddf0 0x55e720699840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.607+0000 7f57a095e640 1 --2- 172.21.15.59:0/959071621 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f57840b52e0 0x7f57840b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.607+0000 7f57997fa640 1 -- 172.21.15.59:0/959071621 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f57940e5470 con 0x7f579c109150 2024-09-10T21:18:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.607+0000 7f579b7fe640 1 --2- 172.21.15.59:0/302821935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e720699d80 0x55e72069c170 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f579000cfa0 tx=0x7f579000c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125d331300161fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.607+0000 7f57827fc640 1 -- 172.21.15.59:0/302821935 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5790018030 con 0x55e720699d80 2024-09-10T21:18:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.607+0000 7f57827fc640 1 -- 172.21.15.59:0/302821935 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57900054d0 con 0x55e720699d80 2024-09-10T21:18:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.607+0000 7f57827fc640 1 -- 172.21.15.59:0/302821935 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5790010640 con 0x55e720699d80 2024-09-10T21:18:04.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.608+0000 7f57a4796740 1 -- 172.21.15.59:0/302821935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e720699d80 msgr2=0x55e72069c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.608+0000 7f57a4796740 1 --2- 172.21.15.59:0/302821935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e720699d80 0x55e72069c170 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f579000cfa0 tx=0x7f579000c620 comp rx=0 tx=0).stop 2024-09-10T21:18:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.608+0000 7f57a095e640 1 --2- 172.21.15.59:0/959071621 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f57840b52e0 0x7f57840b77a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f57940abb90 tx=0x7f5794077e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.608+0000 7f57a4796740 1 -- 172.21.15.59:0/302821935 shutdown_connections 2024-09-10T21:18:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.608+0000 7f57a4796740 1 --2- 172.21.15.59:0/302821935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e720699d80 0x55e72069c170 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.608+0000 7f57a4796740 1 --2- 172.21.15.59:0/302821935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068ddf0 0x55e720699840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.608+0000 7f57a4796740 1 --2- 172.21.15.59:0/302821935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e72068d4d0 0x55e72068d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.608+0000 7f57a4796740 1 -- 172.21.15.59:0/302821935 >> 172.21.15.59:0/302821935 conn(0x55e72068b300 msgr2=0x55e72068c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.608+0000 7f57a4796740 1 -- 172.21.15.59:0/302821935 shutdown_connections 2024-09-10T21:18:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.608+0000 7f57a4796740 1 -- 172.21.15.59:0/302821935 wait complete. 2024-09-10T21:18:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.608+0000 7f57a4796740 1 -- start start 2024-09-10T21:18:04.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.608+0000 7f57a4796740 1 Processor -- start 2024-09-10T21:18:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f57a4796740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068d4d0 0x55e7206996c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f57a4796740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e72068ddf0 0x55e720696b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f57a4796740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e720699d80 0x55e720697190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f57a4796740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e720454700 con 0x55e72068ddf0 2024-09-10T21:18:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f57a4796740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e72058e160 con 0x55e72068d4d0 2024-09-10T21:18:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f57a4796740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55e72069ca00 con 0x55e720699d80 2024-09-10T21:18:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f57a4796740 10 client.0 _ll_register_callbacks cb 0x55e7205a79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f579bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e72068ddf0 0x55e720696b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f579bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e72068ddf0 0x55e720696b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45884/0 (socket says 172.21.15.59:45884) 2024-09-10T21:18:04.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f579bfff640 1 -- 172.21.15.59:0/541569103 learned_addr learned my addr 172.21.15.59:0/541569103 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f579b7fe640 1 --2- 172.21.15.59:0/541569103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068d4d0 0x55e7206996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f579b7fe640 1 --2- 172.21.15.59:0/541569103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e720699d80 0x55e720697190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f579bfff640 1 -- 172.21.15.59:0/541569103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e720699d80 msgr2=0x55e720697190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f579bfff640 1 --2- 172.21.15.59:0/541569103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e720699d80 0x55e720697190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f579bfff640 1 -- 172.21.15.59:0/541569103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068d4d0 msgr2=0x55e7206996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f579bfff640 1 --2- 172.21.15.59:0/541569103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068d4d0 0x55e7206996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f579bfff640 1 -- 172.21.15.59:0/541569103 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7205bbc90 con 0x55e72068ddf0 2024-09-10T21:18:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f579b7fe640 1 --2- 172.21.15.59:0/541569103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068d4d0 0x55e7206996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f579bfff640 1 --2- 172.21.15.59:0/541569103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e72068ddf0 0x55e720696b10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f578c02a930 tx=0x7f578c031750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae677236595ba757 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f577b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:04.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f577b7fe640 1 -- 172.21.15.59:0/541569103 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c03f070 con 0x55e72068ddf0 2024-09-10T21:18:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f577b7fe640 1 -- 172.21.15.59:0/541569103 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f578c004450 con 0x55e72068ddf0 2024-09-10T21:18:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.609+0000 7f57a4796740 1 -- 172.21.15.59:0/541569103 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57900054d0 con 0x55e72068ddf0 2024-09-10T21:18:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.610+0000 7f577b7fe640 1 -- 172.21.15.59:0/541569103 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f578c04b070 con 0x55e72068ddf0 2024-09-10T21:18:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.610+0000 7f57a4796740 10 client.16068 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.610+0000 7f57a4796740 1 -- 172.21.15.59:0/541569103 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e7206a82f0 con 0x55e72068ddf0 2024-09-10T21:18:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.610+0000 7f577b7fe640 1 -- 172.21.15.59:0/541569103 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57900054d0 con 0x55e72068ddf0 2024-09-10T21:18:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.610+0000 7f577b7fe640 1 -- 172.21.15.59:0/541569103 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f578c03b650 con 0x55e72068ddf0 2024-09-10T21:18:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.610+0000 7f57a4796740 10 client.16068 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.610+0000 7f57a4796740 10 client.16068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:18:04.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.610+0000 7f57a4796740 20 client.16068 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.610+0000 7f57a4796740 1 --2- 172.21.15.59:0/541569103 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e7206a97b0 0x55e7206abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.610+0000 7f57a4796740 4 client.16068 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:18:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.610+0000 7f57a4796740 1 -- 172.21.15.59:0/541569103 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e720605df0 con 0x55e7206a97b0 2024-09-10T21:18:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.610+0000 7f579b7fe640 1 --2- 172.21.15.59:0/541569103 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e7206a97b0 0x55e7206abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.611+0000 7f577b7fe640 10 client.16068 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.611+0000 7f579b7fe640 1 --2- 172.21.15.59:0/541569103 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e7206a97b0 0x55e7206abbc0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c35cafa4e6b4ae9 server_cookie=4e96b5ee56aaf9a7 in_seq=0 out_seq=0 2024-09-10T21:18:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.612+0000 7f577b7fe640 1 -- 172.21.15.59:0/541569103 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e720605df0 con 0x55e7206a97b0 2024-09-10T21:18:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.612+0000 7f577b7fe640 10 client.16068 handle_command_reply: tid=0 2024-09-10T21:18:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.612+0000 7f57a4796740 1 client.16068 shutdown 2024-09-10T21:18:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.612+0000 7f57a4796740 1 -- 172.21.15.59:0/541569103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e72068ddf0 msgr2=0x55e720696b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:04.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.612+0000 7f57a4796740 1 --2- 172.21.15.59:0/541569103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e72068ddf0 0x55e720696b10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f578c02a930 tx=0x7f578c031750 comp rx=0 tx=0).stop 2024-09-10T21:18:04.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.612+0000 7f57a4796740 1 -- 172.21.15.59:0/541569103 shutdown_connections 2024-09-10T21:18:04.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.612+0000 7f57a4796740 1 --2- 172.21.15.59:0/541569103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e720699d80 0x55e720697190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.612+0000 7f57a4796740 1 --2- 172.21.15.59:0/541569103 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e7206a97b0 0x55e7206abbc0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.612+0000 7f57a4796740 1 --2- 172.21.15.59:0/541569103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e72068ddf0 0x55e720696b10 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.612+0000 7f57a4796740 1 --2- 172.21.15.59:0/541569103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068d4d0 0x55e7206996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.612+0000 7f577b7fe640 0 client.16068 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:04.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.612+0000 7f57a4796740 1 -- 172.21.15.59:0/541569103 >> 172.21.15.59:0/541569103 conn(0x55e72068b300 msgr2=0x55e720690ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:04.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.612+0000 7f57a4796740 1 -- 172.21.15.59:0/541569103 shutdown_connections 2024-09-10T21:18:04.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.612+0000 7f57a4796740 1 -- 172.21.15.59:0/541569103 wait complete. 2024-09-10T21:18:04.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.612+0000 7f57a4796740 20 client.16068 trim_cache size 0 max 16384 2024-09-10T21:18:04.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.625+0000 7f57a4796740 1 Processor -- start 2024-09-10T21:18:04.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.625+0000 7f57a4796740 1 -- start start 2024-09-10T21:18:04.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.625+0000 7f57a4796740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068d4d0 0x55e72068a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:04.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.625+0000 7f57a4796740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e72068ddf0 0x55e72069b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:04.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.625+0000 7f57a4796740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e720699d80 0x55e72069b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.625+0000 7f57a4796740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f579c1ae340 con 0x55e720699d80 2024-09-10T21:18:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.625+0000 7f57a4796740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f579c1afe80 con 0x55e72068d4d0 2024-09-10T21:18:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.625+0000 7f57a4796740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f579c1aea10 con 0x55e72068ddf0 2024-09-10T21:18:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.626+0000 7f579b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e720699d80 0x55e72069b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.626+0000 7f579b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e720699d80 0x55e72069b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45896/0 (socket says 172.21.15.59:45896) 2024-09-10T21:18:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.626+0000 7f579b7fe640 1 -- 172.21.15.59:0/111625110 learned_addr learned my addr 172.21.15.59:0/111625110 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.626+0000 7f579bfff640 1 --2- 172.21.15.59:0/111625110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e72068ddf0 0x55e72069b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.626+0000 7f579b7fe640 1 -- 172.21.15.59:0/111625110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e72068ddf0 msgr2=0x55e72069b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.626+0000 7f579b7fe640 1 --2- 172.21.15.59:0/111625110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e72068ddf0 0x55e72069b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.626+0000 7f579b7fe640 1 -- 172.21.15.59:0/111625110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068d4d0 msgr2=0x55e72068a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.626+0000 7f579b7fe640 1 --2- 172.21.15.59:0/111625110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068d4d0 0x55e72068a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.626+0000 7f579b7fe640 1 -- 172.21.15.59:0/111625110 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e72068cd40 con 0x55e720699d80 2024-09-10T21:18:04.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.626+0000 7f579b7fe640 1 --2- 172.21.15.59:0/111625110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e720699d80 0x55e72069b6b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f579000cfd0 tx=0x7f5790020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187074949c2a0b25 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.626+0000 7f5781ffb640 1 -- 172.21.15.59:0/111625110 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5790018070 con 0x55e720699d80 2024-09-10T21:18:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.626+0000 7f5781ffb640 1 -- 172.21.15.59:0/111625110 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5790019040 con 0x55e720699d80 2024-09-10T21:18:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.626+0000 7f5781ffb640 1 -- 172.21.15.59:0/111625110 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579002c040 con 0x55e720699d80 2024-09-10T21:18:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.627+0000 7f57a4796740 1 -- 172.21.15.59:0/111625110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e720699d80 msgr2=0x55e72069b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.627+0000 7f57a4796740 1 --2- 172.21.15.59:0/111625110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e720699d80 0x55e72069b6b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f579000cfd0 tx=0x7f5790020040 comp rx=0 tx=0).stop 2024-09-10T21:18:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.627+0000 7f57a4796740 1 -- 172.21.15.59:0/111625110 shutdown_connections 2024-09-10T21:18:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.627+0000 7f57a4796740 1 --2- 172.21.15.59:0/111625110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e720699d80 0x55e72069b6b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.627+0000 7f57a4796740 1 --2- 172.21.15.59:0/111625110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e72068ddf0 0x55e72069b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.627+0000 7f57a4796740 1 --2- 172.21.15.59:0/111625110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068d4d0 0x55e72068a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.627+0000 7f57a4796740 1 -- 172.21.15.59:0/111625110 >> 172.21.15.59:0/111625110 conn(0x55e72068b300 msgr2=0x55e720689c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.627+0000 7f57a4796740 1 -- 172.21.15.59:0/111625110 shutdown_connections 2024-09-10T21:18:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.627+0000 7f57a4796740 1 -- 172.21.15.59:0/111625110 wait complete. 2024-09-10T21:18:04.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.627+0000 7f57a4796740 1 -- start start 2024-09-10T21:18:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.628+0000 7f57a4796740 1 Processor -- start 2024-09-10T21:18:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.628+0000 7f57a4796740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e72068d4d0 0x55e7206a20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.628+0000 7f57a4796740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068ddf0 0x55e7206a2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.628+0000 7f57a4796740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e720699d80 0x55e72069ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.628+0000 7f57a4796740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f579c1af7b0 con 0x55e72068d4d0 2024-09-10T21:18:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.628+0000 7f57a4796740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f579c1af0e0 con 0x55e72068ddf0 2024-09-10T21:18:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.628+0000 7f57a4796740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f579c1ac340 con 0x55e720699d80 2024-09-10T21:18:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.628+0000 7f57a4796740 10 client.0 _ll_register_callbacks cb 0x7f578c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.628+0000 7f579b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e72068d4d0 0x55e7206a20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.628+0000 7f579b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e72068d4d0 0x55e7206a20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45910/0 (socket says 172.21.15.59:45910) 2024-09-10T21:18:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.628+0000 7f579b7fe640 1 -- 172.21.15.59:0/3640833868 learned_addr learned my addr 172.21.15.59:0/3640833868 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.628+0000 7f579b7fe640 1 --2- 172.21.15.59:0/3640833868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e720699d80 0x55e72069ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:04.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.628+0000 7f579bfff640 1 --2- 172.21.15.59:0/3640833868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068ddf0 0x55e7206a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.628+0000 7f579b7fe640 1 -- 172.21.15.59:0/3640833868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e720699d80 msgr2=0x55e72069ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.628+0000 7f579b7fe640 1 --2- 172.21.15.59:0/3640833868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e720699d80 0x55e72069ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.628+0000 7f579b7fe640 1 -- 172.21.15.59:0/3640833868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068ddf0 msgr2=0x55e7206a2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.628+0000 7f579b7fe640 1 --2- 172.21.15.59:0/3640833868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068ddf0 0x55e7206a2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.628+0000 7f579b7fe640 1 -- 172.21.15.59:0/3640833868 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e72069d630 con 0x55e72068d4d0 2024-09-10T21:18:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.629+0000 7f579b7fe640 1 --2- 172.21.15.59:0/3640833868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e72068d4d0 0x55e7206a20a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5790012fa0 tx=0x7f5790012f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8d32423788eca3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.629+0000 7f577b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.629+0000 7f577b7fe640 1 -- 172.21.15.59:0/3640833868 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579002c030 con 0x55e72068d4d0 2024-09-10T21:18:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.629+0000 7f577b7fe640 1 -- 172.21.15.59:0/3640833868 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5790005210 con 0x55e72068d4d0 2024-09-10T21:18:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.629+0000 7f57a4796740 1 -- 172.21.15.59:0/3640833868 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5790019040 con 0x55e72068d4d0 2024-09-10T21:18:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.629+0000 7f577b7fe640 1 -- 172.21.15.59:0/3640833868 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5790018040 con 0x55e72068d4d0 2024-09-10T21:18:04.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.629+0000 7f57a4796740 10 client.16074 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.629+0000 7f57a4796740 1 -- 172.21.15.59:0/3640833868 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e72071b770 con 0x55e72068d4d0 2024-09-10T21:18:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.629+0000 7f577b7fe640 1 -- 172.21.15.59:0/3640833868 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5790019040 con 0x55e72068d4d0 2024-09-10T21:18:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.629+0000 7f577b7fe640 1 -- 172.21.15.59:0/3640833868 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f579002a050 con 0x55e72068d4d0 2024-09-10T21:18:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.629+0000 7f57a4796740 10 client.16074 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.629+0000 7f57a4796740 10 client.16074 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:18:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.629+0000 7f57a4796740 20 client.16074 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.629+0000 7f57a4796740 1 --2- 172.21.15.59:0/3640833868 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e72071bba0 0x55e72071df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.629+0000 7f57a4796740 4 client.16074 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:18:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.629+0000 7f57a4796740 1 -- 172.21.15.59:0/3640833868 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e7206018a0 con 0x55e72071bba0 2024-09-10T21:18:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.630+0000 7f579bfff640 1 --2- 172.21.15.59:0/3640833868 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e72071bba0 0x55e72071df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.630+0000 7f579bfff640 1 --2- 172.21.15.59:0/3640833868 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e72071bba0 0x55e72071df90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2087aa5cd3929cb server_cookie=1a4b1ce88981b154 in_seq=0 out_seq=0 2024-09-10T21:18:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.630+0000 7f577b7fe640 10 client.16074 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.630+0000 7f577b7fe640 1 -- 172.21.15.59:0/3640833868 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e7206018a0 con 0x55e72071bba0 2024-09-10T21:18:04.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.630+0000 7f577b7fe640 10 client.16074 handle_command_reply: tid=0 2024-09-10T21:18:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.630+0000 7f57a4796740 1 client.16074 shutdown 2024-09-10T21:18:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.630+0000 7f57a4796740 1 -- 172.21.15.59:0/3640833868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e72068d4d0 msgr2=0x55e7206a20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.630+0000 7f57a4796740 1 --2- 172.21.15.59:0/3640833868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e72068d4d0 0x55e7206a20a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5790012fa0 tx=0x7f5790012f30 comp rx=0 tx=0).stop 2024-09-10T21:18:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.631+0000 7f57a4796740 1 -- 172.21.15.59:0/3640833868 shutdown_connections 2024-09-10T21:18:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.631+0000 7f57a4796740 1 --2- 172.21.15.59:0/3640833868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e720699d80 0x55e72069ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.631+0000 7f57a4796740 1 --2- 172.21.15.59:0/3640833868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e72068ddf0 0x55e7206a2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.631+0000 7f57a4796740 1 --2- 172.21.15.59:0/3640833868 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e72071bba0 0x55e72071df90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.631+0000 7f57a4796740 1 --2- 172.21.15.59:0/3640833868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e72068d4d0 0x55e7206a20a0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.631+0000 7f577b7fe640 0 client.16074 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.631+0000 7f57a4796740 1 -- 172.21.15.59:0/3640833868 >> 172.21.15.59:0/3640833868 conn(0x55e72068b300 msgr2=0x55e72068a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.631+0000 7f57a4796740 1 -- 172.21.15.59:0/3640833868 shutdown_connections 2024-09-10T21:18:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.631+0000 7f57a4796740 1 -- 172.21.15.59:0/3640833868 wait complete. 2024-09-10T21:18:04.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.631+0000 7f57a4796740 20 client.16074 trim_cache size 0 max 16384 2024-09-10T21:18:04.645 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:18:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.631+0000 7f57a23c1640 1 -- 172.21.15.59:0/959071621 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f57840b52e0 msgr2=0x7f57840b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.631+0000 7f57a23c1640 1 --2- 172.21.15.59:0/959071621 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f57840b52e0 0x7f57840b77a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f57940abb90 tx=0x7f5794077e30 comp rx=0 tx=0).stop 2024-09-10T21:18:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.631+0000 7f57a23c1640 1 -- 172.21.15.59:0/959071621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c109150 msgr2=0x7f579c19eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.631+0000 7f57a23c1640 1 --2- 172.21.15.59:0/959071621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c109150 0x7f579c19eb80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f579400b970 tx=0x7f579400be30 comp rx=0 tx=0).stop 2024-09-10T21:18:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.632+0000 7f57a23c1640 1 -- 172.21.15.59:0/959071621 shutdown_connections 2024-09-10T21:18:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.632+0000 7f57a23c1640 1 --2- 172.21.15.59:0/959071621 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f57840b52e0 0x7f57840b77a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.632+0000 7f57a23c1640 1 --2- 172.21.15.59:0/959071621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f579c109150 0x7f579c19eb80 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.632+0000 7f57a23c1640 1 --2- 172.21.15.59:0/959071621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f579c1087d0 0x7f579c1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.632+0000 7f57a23c1640 1 --2- 172.21.15.59:0/959071621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f579c102dc0 0x7f579c1992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.632+0000 7f57a23c1640 1 -- 172.21.15.59:0/959071621 >> 172.21.15.59:0/959071621 conn(0x7f579c0fe830 msgr2=0x7f579c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.632+0000 7f57a23c1640 1 -- 172.21.15.59:0/959071621 shutdown_connections 2024-09-10T21:18:04.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:04.632+0000 7f57a23c1640 1 -- 172.21.15.59:0/959071621 wait complete. 2024-09-10T21:18:05.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:05 smithi192 ceph-mon[35363]: pgmap v424: 97 pgs: 97 active+clean; 1.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:05.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:05 smithi059 ceph-mon[30888]: pgmap v424: 97 pgs: 97 active+clean; 1.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:05.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:05 smithi154 ceph-mon[35041]: pgmap v424: 97 pgs: 97 active+clean; 1.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:06.515 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:18:06.515 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:18:06.791 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:18:07.181 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:07 smithi059 ceph-mon[30888]: pgmap v425: 97 pgs: 97 active+clean; 1.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:18:07.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.265+0000 7f5b67807640 1 -- 172.21.15.59:0/2799245361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b601076a0 msgr2=0x7f5b60107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:07.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.265+0000 7f5b67807640 1 --2- 172.21.15.59:0/2799245361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b601076a0 0x7f5b60107ae0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5b50009900 tx=0x7f5b5002a3f0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.265+0000 7f5b67807640 1 -- 172.21.15.59:0/2799245361 shutdown_connections 2024-09-10T21:18:07.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.265+0000 7f5b67807640 1 --2- 172.21.15.59:0/2799245361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b60108020 0x7f5b6010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.265+0000 7f5b67807640 1 --2- 172.21.15.59:0/2799245361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b601076a0 0x7f5b60107ae0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.265+0000 7f5b67807640 1 --2- 172.21.15.59:0/2799245361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b60101c90 0x7f5b60102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.265+0000 7f5b67807640 1 -- 172.21.15.59:0/2799245361 >> 172.21.15.59:0/2799245361 conn(0x7f5b600fd700 msgr2=0x7f5b600ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:07.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.265+0000 7f5b67807640 1 -- 172.21.15.59:0/2799245361 shutdown_connections 2024-09-10T21:18:07.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.265+0000 7f5b67807640 1 -- 172.21.15.59:0/2799245361 wait complete. 2024-09-10T21:18:07.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.265+0000 7f5b67807640 1 Processor -- start 2024-09-10T21:18:07.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.265+0000 7f5b67807640 1 -- start start 2024-09-10T21:18:07.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.266+0000 7f5b67807640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b60101c90 0x7f5b60198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:07.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.266+0000 7f5b67807640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b601076a0 0x7f5b601986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:07.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.266+0000 7f5b67807640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b60108020 0x7f5b6019da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:07.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.266+0000 7f5b67807640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5b60111ce0 con 0x7f5b60108020 2024-09-10T21:18:07.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.266+0000 7f5b67807640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5b60111b60 con 0x7f5b601076a0 2024-09-10T21:18:07.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.266+0000 7f5b67807640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5b60111e60 con 0x7f5b60101c90 2024-09-10T21:18:07.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.266+0000 7f5b65da4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b60108020 0x7f5b6019da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:07.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.266+0000 7f5b64da2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b601076a0 0x7f5b601986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:07.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.266+0000 7f5b655a3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b60101c90 0x7f5b60198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:07.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.266+0000 7f5b64da2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b601076a0 0x7f5b601986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:34650/0 (socket says 172.21.15.59:34650) 2024-09-10T21:18:07.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.266+0000 7f5b65da4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b60108020 0x7f5b6019da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45924/0 (socket says 172.21.15.59:45924) 2024-09-10T21:18:07.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.266+0000 7f5b64da2640 1 -- 172.21.15.59:0/2985316789 learned_addr learned my addr 172.21.15.59:0/2985316789 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:07.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.266+0000 7f5b65da4640 1 -- 172.21.15.59:0/2985316789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b60101c90 msgr2=0x7f5b60198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:07.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.266+0000 7f5b65da4640 1 --2- 172.21.15.59:0/2985316789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b60101c90 0x7f5b60198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.266+0000 7f5b65da4640 1 -- 172.21.15.59:0/2985316789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b601076a0 msgr2=0x7f5b601986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:07.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.266+0000 7f5b65da4640 1 --2- 172.21.15.59:0/2985316789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b601076a0 0x7f5b601986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.266+0000 7f5b65da4640 1 -- 172.21.15.59:0/2985316789 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6019e220 con 0x7f5b60108020 2024-09-10T21:18:07.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.266+0000 7f5b64da2640 1 --2- 172.21.15.59:0/2985316789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b601076a0 0x7f5b601986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:18:07.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.267+0000 7f5b65da4640 1 --2- 172.21.15.59:0/2985316789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b60108020 0x7f5b6019da50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800be20 tx=0x7f5b58009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:07.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.267+0000 7f5b567fc640 1 -- 172.21.15.59:0/2985316789 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b58019070 con 0x7f5b60108020 2024-09-10T21:18:07.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.267+0000 7f5b567fc640 1 -- 172.21.15.59:0/2985316789 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b5800cd70 con 0x7f5b60108020 2024-09-10T21:18:07.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.267+0000 7f5b67807640 1 -- 172.21.15.59:0/2985316789 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b6019e510 con 0x7f5b60108020 2024-09-10T21:18:07.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.267+0000 7f5b567fc640 1 -- 172.21.15.59:0/2985316789 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b58012720 con 0x7f5b60108020 2024-09-10T21:18:07.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.267+0000 7f5b67807640 1 -- 172.21.15.59:0/2985316789 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b6006ab30 con 0x7f5b60108020 2024-09-10T21:18:07.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.270+0000 7f5b69bdc740 1 Processor -- start 2024-09-10T21:18:07.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.270+0000 7f5b567fc640 1 -- 172.21.15.59:0/2985316789 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f5b58014440 con 0x7f5b60108020 2024-09-10T21:18:07.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.270+0000 7f5b69bdc740 1 -- start start 2024-09-10T21:18:07.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.270+0000 7f5b69bdc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d82ee0 0x557432d832c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:07.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.270+0000 7f5b69bdc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d83800 0x557432d93660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:07.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.270+0000 7f5b69bdc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 0x557432d95f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:07.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.270+0000 7f5b69bdc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557432cf9e60 con 0x557432d93ba0 2024-09-10T21:18:07.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.270+0000 7f5b69bdc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557432ce9290 con 0x557432d82ee0 2024-09-10T21:18:07.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.270+0000 7f5b69bdc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557432ced0a0 con 0x557432d83800 2024-09-10T21:18:07.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.270+0000 7f5b64da2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 0x557432d95f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:07.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.270+0000 7f5b64da2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 0x557432d95f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45936/0 (socket says 172.21.15.59:45936) 2024-09-10T21:18:07.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.270+0000 7f5b64da2640 1 -- 172.21.15.59:0/2490848848 learned_addr learned my addr 172.21.15.59:0/2490848848 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:07.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.271+0000 7f5b655a3640 1 --2- 172.21.15.59:0/2490848848 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d83800 0x557432d93660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:07.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.271+0000 7f5b64da2640 1 --2- 172.21.15.59:0/2490848848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d82ee0 0x557432d832c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:07.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.271+0000 7f5b64da2640 1 -- 172.21.15.59:0/2490848848 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d83800 msgr2=0x557432d93660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.271+0000 7f5b64da2640 1 --2- 172.21.15.59:0/2490848848 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d83800 0x557432d93660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.271+0000 7f5b64da2640 1 -- 172.21.15.59:0/2490848848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d82ee0 msgr2=0x557432d832c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.271+0000 7f5b64da2640 1 --2- 172.21.15.59:0/2490848848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d82ee0 0x557432d832c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.271+0000 7f5b64da2640 1 -- 172.21.15.59:0/2490848848 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557432a47930 con 0x557432d93ba0 2024-09-10T21:18:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.271+0000 7f5b655a3640 1 --2- 172.21.15.59:0/2490848848 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d83800 0x557432d93660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.271+0000 7f5b567fc640 1 --2- 172.21.15.59:0/2985316789 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5b4c0b5360 0x7f5b4c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.271+0000 7f5b64da2640 1 --2- 172.21.15.59:0/2490848848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 0x557432d95f90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5b50006010 tx=0x7f5b500058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8c87e9762e1fa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.271+0000 7f5b655a3640 1 --2- 172.21.15.59:0/2985316789 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5b4c0b5360 0x7f5b4c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.271+0000 7f5b567fc640 1 -- 172.21.15.59:0/2985316789 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5b580e54a0 con 0x7f5b60108020 2024-09-10T21:18:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.271+0000 7f5b4b7fe640 1 -- 172.21.15.59:0/2490848848 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50035040 con 0x557432d93ba0 2024-09-10T21:18:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.271+0000 7f5b4b7fe640 1 -- 172.21.15.59:0/2490848848 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b500054d0 con 0x557432d93ba0 2024-09-10T21:18:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.271+0000 7f5b4b7fe640 1 -- 172.21.15.59:0/2490848848 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50004ce0 con 0x557432d93ba0 2024-09-10T21:18:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.272+0000 7f5b69bdc740 1 -- 172.21.15.59:0/2490848848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 msgr2=0x557432d95f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:07.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.272+0000 7f5b655a3640 1 --2- 172.21.15.59:0/2985316789 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5b4c0b5360 0x7f5b4c0b7820 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x557432d87120 tx=0x7f5b5c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:07.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.272+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/2490848848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 0x557432d95f90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5b50006010 tx=0x7f5b500058d0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.272+0000 7f5b69bdc740 1 -- 172.21.15.59:0/2490848848 shutdown_connections 2024-09-10T21:18:07.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.272+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/2490848848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 0x557432d95f90 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.272+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/2490848848 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d83800 0x557432d93660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.272+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/2490848848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d82ee0 0x557432d832c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.272+0000 7f5b69bdc740 1 -- 172.21.15.59:0/2490848848 >> 172.21.15.59:0/2490848848 conn(0x557432d80d10 msgr2=0x557432d81eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:07.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.272+0000 7f5b69bdc740 1 -- 172.21.15.59:0/2490848848 shutdown_connections 2024-09-10T21:18:07.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.272+0000 7f5b69bdc740 1 -- 172.21.15.59:0/2490848848 wait complete. 2024-09-10T21:18:07.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.273+0000 7f5b69bdc740 1 -- start start 2024-09-10T21:18:07.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.273+0000 7f5b69bdc740 1 Processor -- start 2024-09-10T21:18:07.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.273+0000 7f5b69bdc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d82ee0 0x557432d90b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:07.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.273+0000 7f5b69bdc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d83800 0x557432d910c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:07.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.273+0000 7f5b69bdc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d93ba0 0x557432d91600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:07.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.273+0000 7f5b69bdc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557432b4a890 con 0x557432d82ee0 2024-09-10T21:18:07.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.273+0000 7f5b69bdc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557432c83d40 con 0x557432d83800 2024-09-10T21:18:07.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.273+0000 7f5b69bdc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557432d967f0 con 0x557432d93ba0 2024-09-10T21:18:07.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.273+0000 7f5b69bdc740 10 client.0 _ll_register_callbacks cb 0x557432ce7c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:07.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.273+0000 7f5b655a3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d82ee0 0x557432d90b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:07.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.273+0000 7f5b655a3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d82ee0 0x557432d90b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45938/0 (socket says 172.21.15.59:45938) 2024-09-10T21:18:07.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.273+0000 7f5b655a3640 1 -- 172.21.15.59:0/4290860274 learned_addr learned my addr 172.21.15.59:0/4290860274 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:07.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.274+0000 7f5b65da4640 1 --2- 172.21.15.59:0/4290860274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d93ba0 0x557432d91600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:07.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.274+0000 7f5b64da2640 1 --2- 172.21.15.59:0/4290860274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d83800 0x557432d910c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:07.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.274+0000 7f5b655a3640 1 -- 172.21.15.59:0/4290860274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d93ba0 msgr2=0x557432d91600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:07.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.274+0000 7f5b655a3640 1 --2- 172.21.15.59:0/4290860274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d93ba0 0x557432d91600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.274+0000 7f5b655a3640 1 -- 172.21.15.59:0/4290860274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d83800 msgr2=0x557432d910c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:07.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.274+0000 7f5b655a3640 1 --2- 172.21.15.59:0/4290860274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d83800 0x557432d910c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.274+0000 7f5b655a3640 1 -- 172.21.15.59:0/4290860274 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557432d9fbf0 con 0x557432d82ee0 2024-09-10T21:18:07.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.274+0000 7f5b64da2640 1 --2- 172.21.15.59:0/4290860274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d83800 0x557432d910c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:07.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.274+0000 7f5b655a3640 1 --2- 172.21.15.59:0/4290860274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d82ee0 0x557432d90b80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c010e20 tx=0x7f5b5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed7d9887eb66e4e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:07.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.274+0000 7f5b48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:07.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.274+0000 7f5b48ff9640 1 -- 172.21.15.59:0/4290860274 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00f8c0 con 0x557432d82ee0 2024-09-10T21:18:07.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.274+0000 7f5b48ff9640 1 -- 172.21.15.59:0/4290860274 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5b5c00fa60 con 0x557432d82ee0 2024-09-10T21:18:07.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.274+0000 7f5b69bdc740 1 -- 172.21.15.59:0/4290860274 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b500054d0 con 0x557432d82ee0 2024-09-10T21:18:07.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.274+0000 7f5b48ff9640 1 -- 172.21.15.59:0/4290860274 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5b5c00fc60 con 0x557432d82ee0 2024-09-10T21:18:07.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.274+0000 7f5b69bdc740 10 client.16086 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:07.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.274+0000 7f5b69bdc740 1 -- 172.21.15.59:0/4290860274 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557432da2600 con 0x557432d82ee0 2024-09-10T21:18:07.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.274+0000 7f5b48ff9640 1 -- 172.21.15.59:0/4290860274 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b500054d0 con 0x557432d82ee0 2024-09-10T21:18:07.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.275+0000 7f5b48ff9640 1 -- 172.21.15.59:0/4290860274 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5b5c032440 con 0x557432d82ee0 2024-09-10T21:18:07.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.275+0000 7f5b69bdc740 10 client.16086 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:07.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.275+0000 7f5b69bdc740 10 client.16086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:18:07.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.275+0000 7f5b69bdc740 20 client.16086 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:07.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.275+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/4290860274 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557432da3ac0 0x557432da5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:07.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.275+0000 7f5b69bdc740 4 client.16086 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:18:07.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.275+0000 7f5b69bdc740 1 -- 172.21.15.59:0/4290860274 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557432cfbdb0 con 0x557432da3ac0 2024-09-10T21:18:07.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.275+0000 7f5b64da2640 1 --2- 172.21.15.59:0/4290860274 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557432da3ac0 0x557432da5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:07.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.276+0000 7f5b48ff9640 10 client.16086 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:07.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.276+0000 7f5b64da2640 1 --2- 172.21.15.59:0/4290860274 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557432da3ac0 0x557432da5f60 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8da9d8fcdd7555 server_cookie=1f851e13badf4fc4 in_seq=0 out_seq=0 2024-09-10T21:18:07.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.276+0000 7f5b48ff9640 1 -- 172.21.15.59:0/4290860274 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557432cfbdb0 con 0x557432da3ac0 2024-09-10T21:18:07.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.276+0000 7f5b48ff9640 10 client.16086 handle_command_reply: tid=0 2024-09-10T21:18:07.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.276+0000 7f5b69bdc740 1 client.16086 shutdown 2024-09-10T21:18:07.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.277+0000 7f5b69bdc740 1 -- 172.21.15.59:0/4290860274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d82ee0 msgr2=0x557432d90b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:07.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.277+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/4290860274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d82ee0 0x557432d90b80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c010e20 tx=0x7f5b5c0046c0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.277+0000 7f5b69bdc740 1 -- 172.21.15.59:0/4290860274 shutdown_connections 2024-09-10T21:18:07.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.277+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/4290860274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d93ba0 0x557432d91600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.277+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/4290860274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d83800 0x557432d910c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.277+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/4290860274 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557432da3ac0 0x557432da5f60 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.277+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/4290860274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d82ee0 0x557432d90b80 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.277+0000 7f5b69bdc740 1 -- 172.21.15.59:0/4290860274 >> 172.21.15.59:0/4290860274 conn(0x557432d80d10 msgr2=0x557432d7ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:07.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.277+0000 7f5b48ff9640 0 client.16086 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:07.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.277+0000 7f5b69bdc740 1 -- 172.21.15.59:0/4290860274 shutdown_connections 2024-09-10T21:18:07.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.277+0000 7f5b69bdc740 1 -- 172.21.15.59:0/4290860274 wait complete. 2024-09-10T21:18:07.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.277+0000 7f5b69bdc740 20 client.16086 trim_cache size 0 max 16384 2024-09-10T21:18:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.295+0000 7f5b69bdc740 1 Processor -- start 2024-09-10T21:18:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.295+0000 7f5b69bdc740 1 -- start start 2024-09-10T21:18:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.295+0000 7f5b69bdc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d82ee0 0x557432da5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.295+0000 7f5b69bdc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d83800 0x557432d822c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.295+0000 7f5b69bdc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 0x557432dab830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.295+0000 7f5b69bdc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5b601ac050 con 0x557432d93ba0 2024-09-10T21:18:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.295+0000 7f5b69bdc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5b601adb90 con 0x557432d83800 2024-09-10T21:18:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.295+0000 7f5b69bdc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5b601ac720 con 0x557432d82ee0 2024-09-10T21:18:07.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.295+0000 7f5b65da4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 0x557432dab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.295+0000 7f5b65da4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 0x557432dab830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45948/0 (socket says 172.21.15.59:45948) 2024-09-10T21:18:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.295+0000 7f5b65da4640 1 -- 172.21.15.59:0/1589037835 learned_addr learned my addr 172.21.15.59:0/1589037835 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.295+0000 7f5b64da2640 1 --2- 172.21.15.59:0/1589037835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d83800 0x557432d822c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.295+0000 7f5b655a3640 1 --2- 172.21.15.59:0/1589037835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d82ee0 0x557432da5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.295+0000 7f5b65da4640 1 -- 172.21.15.59:0/1589037835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d82ee0 msgr2=0x557432da5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.295+0000 7f5b65da4640 1 --2- 172.21.15.59:0/1589037835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d82ee0 0x557432da5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.295+0000 7f5b65da4640 1 -- 172.21.15.59:0/1589037835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d83800 msgr2=0x557432d822c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.295+0000 7f5b65da4640 1 --2- 172.21.15.59:0/1589037835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d83800 0x557432d822c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.295+0000 7f5b65da4640 1 -- 172.21.15.59:0/1589037835 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557432d8fae0 con 0x557432d93ba0 2024-09-10T21:18:07.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.296+0000 7f5b65da4640 1 --2- 172.21.15.59:0/1589037835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 0x557432dab830 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800bdf0 tx=0x7f5b58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839f73eaa46ad3d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.296+0000 7f5b4affd640 1 -- 172.21.15.59:0/1589037835 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b580ab7f0 con 0x557432d93ba0 2024-09-10T21:18:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.296+0000 7f5b4affd640 1 -- 172.21.15.59:0/1589037835 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b580abce0 con 0x557432d93ba0 2024-09-10T21:18:07.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.296+0000 7f5b4affd640 1 -- 172.21.15.59:0/1589037835 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b580e50b0 con 0x557432d93ba0 2024-09-10T21:18:07.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.296+0000 7f5b69bdc740 1 -- 172.21.15.59:0/1589037835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 msgr2=0x557432dab830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:07.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.296+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/1589037835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 0x557432dab830 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800bdf0 tx=0x7f5b58004a40 comp rx=0 tx=0).stop 2024-09-10T21:18:07.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.296+0000 7f5b69bdc740 1 -- 172.21.15.59:0/1589037835 shutdown_connections 2024-09-10T21:18:07.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.296+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/1589037835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 0x557432dab830 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.296+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/1589037835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d83800 0x557432d822c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.296+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/1589037835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d82ee0 0x557432da5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.296+0000 7f5b69bdc740 1 -- 172.21.15.59:0/1589037835 >> 172.21.15.59:0/1589037835 conn(0x557432d80d10 msgr2=0x557432d81bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.296+0000 7f5b69bdc740 1 -- 172.21.15.59:0/1589037835 shutdown_connections 2024-09-10T21:18:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.296+0000 7f5b69bdc740 1 -- 172.21.15.59:0/1589037835 wait complete. 2024-09-10T21:18:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.297+0000 7f5b69bdc740 1 -- start start 2024-09-10T21:18:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.297+0000 7f5b69bdc740 1 Processor -- start 2024-09-10T21:18:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.297+0000 7f5b69bdc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d82ee0 0x557432d9c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.297+0000 7f5b69bdc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d83800 0x557432d99ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.297+0000 7f5b69bdc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 0x557432d9a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.297+0000 7f5b69bdc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5b601ad4c0 con 0x557432d93ba0 2024-09-10T21:18:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.297+0000 7f5b69bdc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5b601acdf0 con 0x557432d82ee0 2024-09-10T21:18:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.297+0000 7f5b69bdc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5b601aa030 con 0x557432d83800 2024-09-10T21:18:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.297+0000 7f5b69bdc740 10 client.0 _ll_register_callbacks cb 0x7f5b5c00aa50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:07.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.298+0000 7f5b65da4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 0x557432d9a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.298+0000 7f5b65da4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 0x557432d9a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45952/0 (socket says 172.21.15.59:45952) 2024-09-10T21:18:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.298+0000 7f5b65da4640 1 -- 172.21.15.59:0/3734946135 learned_addr learned my addr 172.21.15.59:0/3734946135 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.298+0000 7f5b655a3640 1 --2- 172.21.15.59:0/3734946135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d82ee0 0x557432d9c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.298+0000 7f5b64da2640 1 --2- 172.21.15.59:0/3734946135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d83800 0x557432d99ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.298+0000 7f5b65da4640 1 -- 172.21.15.59:0/3734946135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d83800 msgr2=0x557432d99ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.298+0000 7f5b65da4640 1 --2- 172.21.15.59:0/3734946135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d83800 0x557432d99ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.298+0000 7f5b65da4640 1 -- 172.21.15.59:0/3734946135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d82ee0 msgr2=0x557432d9c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.298+0000 7f5b65da4640 1 --2- 172.21.15.59:0/3734946135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d82ee0 0x557432d9c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.298+0000 7f5b65da4640 1 -- 172.21.15.59:0/3734946135 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557432d83630 con 0x557432d93ba0 2024-09-10T21:18:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.298+0000 7f5b65da4640 1 --2- 172.21.15.59:0/3734946135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 0x557432d9a010 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5b580a82b0 tx=0x7f5b580ab7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b12bbd56995bc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.298+0000 7f5b48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.298+0000 7f5b48ff9640 1 -- 172.21.15.59:0/3734946135 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b580b51c0 con 0x557432d93ba0 2024-09-10T21:18:07.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.298+0000 7f5b48ff9640 1 -- 172.21.15.59:0/3734946135 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5b580e50e0 con 0x557432d93ba0 2024-09-10T21:18:07.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.298+0000 7f5b69bdc740 1 -- 172.21.15.59:0/3734946135 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b580abce0 con 0x557432d93ba0 2024-09-10T21:18:07.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.298+0000 7f5b48ff9640 1 -- 172.21.15.59:0/3734946135 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5b58097020 con 0x557432d93ba0 2024-09-10T21:18:07.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.298+0000 7f5b69bdc740 10 client.16092 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:07.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.298+0000 7f5b69bdc740 1 -- 172.21.15.59:0/3734946135 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557432e116d0 con 0x557432d93ba0 2024-09-10T21:18:07.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.299+0000 7f5b48ff9640 1 -- 172.21.15.59:0/3734946135 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b580abce0 con 0x557432d93ba0 2024-09-10T21:18:07.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.299+0000 7f5b48ff9640 1 -- 172.21.15.59:0/3734946135 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5b58091c20 con 0x557432d93ba0 2024-09-10T21:18:07.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.299+0000 7f5b69bdc740 10 client.16092 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:07.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.299+0000 7f5b69bdc740 10 client.16092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:18:07.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.299+0000 7f5b69bdc740 20 client.16092 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:07.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.299+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/3734946135 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557432e11d60 0x557432e14180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:07.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.299+0000 7f5b69bdc740 4 client.16092 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:18:07.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.299+0000 7f5b69bdc740 1 -- 172.21.15.59:0/3734946135 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557432cf7860 con 0x557432e11d60 2024-09-10T21:18:07.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.299+0000 7f5b655a3640 1 --2- 172.21.15.59:0/3734946135 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557432e11d60 0x557432e14180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:07.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.300+0000 7f5b655a3640 1 --2- 172.21.15.59:0/3734946135 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557432e11d60 0x557432e14180 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8b146b3fa704cda server_cookie=3084d6d000533d31 in_seq=0 out_seq=0 2024-09-10T21:18:07.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.300+0000 7f5b48ff9640 10 client.16092 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.302+0000 7f5b48ff9640 1 -- 172.21.15.59:0/3734946135 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557432cf7860 con 0x557432e11d60 2024-09-10T21:18:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.302+0000 7f5b48ff9640 10 client.16092 handle_command_reply: tid=0 2024-09-10T21:18:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.302+0000 7f5b69bdc740 1 client.16092 shutdown 2024-09-10T21:18:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.302+0000 7f5b69bdc740 1 -- 172.21.15.59:0/3734946135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 msgr2=0x557432d9a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.303+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/3734946135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 0x557432d9a010 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5b580a82b0 tx=0x7f5b580ab7f0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.303+0000 7f5b69bdc740 1 -- 172.21.15.59:0/3734946135 shutdown_connections 2024-09-10T21:18:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.303+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/3734946135 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557432e11d60 0x557432e14180 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.303+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/3734946135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557432d93ba0 0x557432d9a010 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.303+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/3734946135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557432d83800 0x557432d99ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.303+0000 7f5b69bdc740 1 --2- 172.21.15.59:0/3734946135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557432d82ee0 0x557432d9c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.303+0000 7f5b69bdc740 1 -- 172.21.15.59:0/3734946135 >> 172.21.15.59:0/3734946135 conn(0x557432d80d10 msgr2=0x557432d91310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:07.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.303+0000 7f5b48ff9640 0 client.16092 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:07.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.303+0000 7f5b69bdc740 1 -- 172.21.15.59:0/3734946135 shutdown_connections 2024-09-10T21:18:07.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.303+0000 7f5b69bdc740 1 -- 172.21.15.59:0/3734946135 wait complete. 2024-09-10T21:18:07.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.303+0000 7f5b69bdc740 20 client.16092 trim_cache size 0 max 16384 2024-09-10T21:18:07.311 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:18:07.311 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:18:07.312 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "f8c32dfe-dde0-4d7e-898f-021c024019e0", 2024-09-10T21:18:07.312 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:18:07.312 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:18:07.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.304+0000 7f5b67807640 1 -- 172.21.15.59:0/2985316789 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5b4c0b5360 msgr2=0x7f5b4c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:07.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.304+0000 7f5b67807640 1 --2- 172.21.15.59:0/2985316789 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5b4c0b5360 0x7f5b4c0b7820 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x557432d87120 tx=0x7f5b5c00a2d0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.304+0000 7f5b67807640 1 -- 172.21.15.59:0/2985316789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b60108020 msgr2=0x7f5b6019da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:07.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.304+0000 7f5b67807640 1 --2- 172.21.15.59:0/2985316789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b60108020 0x7f5b6019da50 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800be20 tx=0x7f5b58009ed0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.304+0000 7f5b67807640 1 -- 172.21.15.59:0/2985316789 shutdown_connections 2024-09-10T21:18:07.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.304+0000 7f5b67807640 1 --2- 172.21.15.59:0/2985316789 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5b4c0b5360 0x7f5b4c0b7820 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.304+0000 7f5b67807640 1 --2- 172.21.15.59:0/2985316789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b60108020 0x7f5b6019da50 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.304+0000 7f5b67807640 1 --2- 172.21.15.59:0/2985316789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b601076a0 0x7f5b601986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.304+0000 7f5b67807640 1 --2- 172.21.15.59:0/2985316789 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b60101c90 0x7f5b60198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:07.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.304+0000 7f5b67807640 1 -- 172.21.15.59:0/2985316789 >> 172.21.15.59:0/2985316789 conn(0x7f5b600fd700 msgr2=0x7f5b600ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:07.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.304+0000 7f5b67807640 1 -- 172.21.15.59:0/2985316789 shutdown_connections 2024-09-10T21:18:07.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:07.304+0000 7f5b67807640 1 -- 172.21.15.59:0/2985316789 wait complete. 2024-09-10T21:18:07.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:07 smithi192 ceph-mon[35363]: pgmap v425: 97 pgs: 97 active+clean; 1.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:18:07.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:07 smithi154 ceph-mon[35041]: pgmap v425: 97 pgs: 97 active+clean; 1.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:18:08.196 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:08 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:18:08.196 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:08 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:18:08.196 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:08 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:18:08.196 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:08 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:18:08.229 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:18:08.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:08 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:18:08.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:08 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:18:08.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:08 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:18:08.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:08 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:18:08.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:08 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:18:08.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:08 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:18:08.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:08 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:18:08.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:08 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:18:08.493 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:18:08.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.904+0000 7fb913948640 1 -- 172.21.15.59:0/1038473790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb90c102dc0 msgr2=0x7fb90c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:08.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.904+0000 7fb913948640 1 --2- 172.21.15.59:0/1038473790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb90c102dc0 0x7fb90c1031a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fb908009900 tx=0x7fb90802a410 comp rx=0 tx=0).stop 2024-09-10T21:18:08.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.904+0000 7fb913948640 1 -- 172.21.15.59:0/1038473790 shutdown_connections 2024-09-10T21:18:08.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.904+0000 7fb913948640 1 --2- 172.21.15.59:0/1038473790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb90c109150 0x7fb90c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.904+0000 7fb913948640 1 --2- 172.21.15.59:0/1038473790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb90c1087d0 0x7fb90c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.904+0000 7fb913948640 1 --2- 172.21.15.59:0/1038473790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb90c102dc0 0x7fb90c1031a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.904+0000 7fb913948640 1 -- 172.21.15.59:0/1038473790 >> 172.21.15.59:0/1038473790 conn(0x7fb90c0fe830 msgr2=0x7fb90c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:08.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.905+0000 7fb913948640 1 -- 172.21.15.59:0/1038473790 shutdown_connections 2024-09-10T21:18:08.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.905+0000 7fb913948640 1 -- 172.21.15.59:0/1038473790 wait complete. 2024-09-10T21:18:08.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.905+0000 7fb913948640 1 Processor -- start 2024-09-10T21:18:08.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.905+0000 7fb913948640 1 -- start start 2024-09-10T21:18:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.905+0000 7fb913948640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb90c102dc0 0x7fb90c1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.905+0000 7fb913948640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb90c1087d0 0x7fb90c1997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.905+0000 7fb913948640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb90c109150 0x7fb90c19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.905+0000 7fb913948640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb90c112e10 con 0x7fb90c109150 2024-09-10T21:18:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.905+0000 7fb913948640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb90c112c90 con 0x7fb90c102dc0 2024-09-10T21:18:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.905+0000 7fb913948640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb90c112f90 con 0x7fb90c1087d0 2024-09-10T21:18:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.906+0000 7fb911ee5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb90c109150 0x7fb90c19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.906+0000 7fb911ee5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb90c109150 0x7fb90c19eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45982/0 (socket says 172.21.15.59:45982) 2024-09-10T21:18:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.906+0000 7fb911ee5640 1 -- 172.21.15.59:0/1201321642 learned_addr learned my addr 172.21.15.59:0/1201321642 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.906+0000 7fb9116e4640 1 --2- 172.21.15.59:0/1201321642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb90c102dc0 0x7fb90c1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.906+0000 7fb910ee3640 1 --2- 172.21.15.59:0/1201321642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb90c1087d0 0x7fb90c1997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.906+0000 7fb911ee5640 1 -- 172.21.15.59:0/1201321642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb90c1087d0 msgr2=0x7fb90c1997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.906+0000 7fb911ee5640 1 --2- 172.21.15.59:0/1201321642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb90c1087d0 0x7fb90c1997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.906+0000 7fb911ee5640 1 -- 172.21.15.59:0/1201321642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb90c102dc0 msgr2=0x7fb90c1992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:08.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.906+0000 7fb911ee5640 1 --2- 172.21.15.59:0/1201321642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb90c102dc0 0x7fb90c1992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.906+0000 7fb911ee5640 1 -- 172.21.15.59:0/1201321642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb90c19f350 con 0x7fb90c109150 2024-09-10T21:18:08.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.906+0000 7fb910ee3640 1 --2- 172.21.15.59:0/1201321642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb90c1087d0 0x7fb90c1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:08.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.906+0000 7fb911ee5640 1 --2- 172.21.15.59:0/1201321642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb90c109150 0x7fb90c19eb80 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb90400eaa0 tx=0x7fb90400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:08.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.906+0000 7fb9027fc640 1 -- 172.21.15.59:0/1201321642 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90400cdb0 con 0x7fb90c109150 2024-09-10T21:18:08.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.906+0000 7fb9027fc640 1 -- 172.21.15.59:0/1201321642 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb904005020 con 0x7fb90c109150 2024-09-10T21:18:08.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.906+0000 7fb913948640 1 -- 172.21.15.59:0/1201321642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb90c19f640 con 0x7fb90c109150 2024-09-10T21:18:08.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.906+0000 7fb9027fc640 1 -- 172.21.15.59:0/1201321642 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9040116d0 con 0x7fb90c109150 2024-09-10T21:18:08.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.906+0000 7fb913948640 1 -- 172.21.15.59:0/1201321642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb90c1a5d00 con 0x7fb90c109150 2024-09-10T21:18:08.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.909+0000 7fb915d1d740 1 Processor -- start 2024-09-10T21:18:08.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.909+0000 7fb9027fc640 1 -- 172.21.15.59:0/1201321642 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fb90400f040 con 0x7fb90c109150 2024-09-10T21:18:08.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.909+0000 7fb915d1d740 1 -- start start 2024-09-10T21:18:08.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.909+0000 7fb915d1d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 0x5647bbcc1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:08.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.909+0000 7fb915d1d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbcc1da0 0x5647bbccd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:08.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.909+0000 7fb915d1d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbccdd30 0x5647bbcd0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:08.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.910+0000 7fb915d1d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5647bbc37e50 con 0x5647bbcc1480 2024-09-10T21:18:08.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.910+0000 7fb915d1d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5647bbc27280 con 0x5647bbccdd30 2024-09-10T21:18:08.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.910+0000 7fb915d1d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5647bbc2b090 con 0x5647bbcc1da0 2024-09-10T21:18:08.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.910+0000 7fb910ee3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 0x5647bbcc1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:08.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.910+0000 7fb910ee3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 0x5647bbcc1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45984/0 (socket says 172.21.15.59:45984) 2024-09-10T21:18:08.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.910+0000 7fb910ee3640 1 -- 172.21.15.59:0/84972345 learned_addr learned my addr 172.21.15.59:0/84972345 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.910+0000 7fb9116e4640 1 --2- 172.21.15.59:0/84972345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbcc1da0 0x5647bbccd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.910+0000 7fb910ee3640 1 --2- 172.21.15.59:0/84972345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbccdd30 0x5647bbcd0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.910+0000 7fb910ee3640 1 -- 172.21.15.59:0/84972345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbcc1da0 msgr2=0x5647bbccd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.910+0000 7fb910ee3640 1 --2- 172.21.15.59:0/84972345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbcc1da0 0x5647bbccd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.910+0000 7fb910ee3640 1 -- 172.21.15.59:0/84972345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbccdd30 msgr2=0x5647bbcd0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.910+0000 7fb910ee3640 1 --2- 172.21.15.59:0/84972345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbccdd30 0x5647bbcd0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.910+0000 7fb910ee3640 1 -- 172.21.15.59:0/84972345 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647bb985650 con 0x5647bbcc1480 2024-09-10T21:18:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.910+0000 7fb910ee3640 1 --2- 172.21.15.59:0/84972345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 0x5647bbcc1860 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00bfa0 tx=0x7fb8fc00b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b30e934639c42d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.910+0000 7fb9027fc640 1 --2- 172.21.15.59:0/1201321642 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb8f80b52e0 0x7fb8f80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.910+0000 7fb8f77fe640 1 -- 172.21.15.59:0/84972345 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc005020 con 0x5647bbcc1480 2024-09-10T21:18:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.911+0000 7fb9116e4640 1 --2- 172.21.15.59:0/1201321642 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb8f80b52e0 0x7fb8f80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.911+0000 7fb8f77fe640 1 -- 172.21.15.59:0/84972345 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8fc0047a0 con 0x5647bbcc1480 2024-09-10T21:18:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.911+0000 7fb8f77fe640 1 -- 172.21.15.59:0/84972345 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc00f650 con 0x5647bbcc1480 2024-09-10T21:18:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.911+0000 7fb9027fc640 1 -- 172.21.15.59:0/1201321642 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fb9040e5a50 con 0x7fb90c109150 2024-09-10T21:18:08.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.911+0000 7fb915d1d740 1 -- 172.21.15.59:0/84972345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 msgr2=0x5647bbcc1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:08.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.911+0000 7fb9116e4640 1 --2- 172.21.15.59:0/1201321642 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb8f80b52e0 0x7fb8f80b77a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb908031440 tx=0x7fb908005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:08.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.911+0000 7fb915d1d740 1 --2- 172.21.15.59:0/84972345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 0x5647bbcc1860 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00bfa0 tx=0x7fb8fc00b730 comp rx=0 tx=0).stop 2024-09-10T21:18:08.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.911+0000 7fb915d1d740 1 -- 172.21.15.59:0/84972345 shutdown_connections 2024-09-10T21:18:08.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.911+0000 7fb915d1d740 1 --2- 172.21.15.59:0/84972345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbccdd30 0x5647bbcd0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.912+0000 7fb915d1d740 1 --2- 172.21.15.59:0/84972345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbcc1da0 0x5647bbccd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.912+0000 7fb915d1d740 1 --2- 172.21.15.59:0/84972345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 0x5647bbcc1860 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.912+0000 7fb915d1d740 1 -- 172.21.15.59:0/84972345 >> 172.21.15.59:0/84972345 conn(0x5647bbcbf2b0 msgr2=0x5647bbcc0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:08.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.912+0000 7fb915d1d740 1 -- 172.21.15.59:0/84972345 shutdown_connections 2024-09-10T21:18:08.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.912+0000 7fb915d1d740 1 -- 172.21.15.59:0/84972345 wait complete. 2024-09-10T21:18:08.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.912+0000 7fb915d1d740 1 -- start start 2024-09-10T21:18:08.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.912+0000 7fb915d1d740 1 Processor -- start 2024-09-10T21:18:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.912+0000 7fb915d1d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbcc1480 0x5647bbccd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.912+0000 7fb915d1d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbcc1da0 0x5647bbccaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.912+0000 7fb915d1d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbccdd30 0x5647bbccb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.912+0000 7fb915d1d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5647bba88700 con 0x5647bbccdd30 2024-09-10T21:18:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.912+0000 7fb915d1d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5647bbbc2110 con 0x5647bbcc1480 2024-09-10T21:18:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.912+0000 7fb915d1d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5647bbcd09b0 con 0x5647bbcc1da0 2024-09-10T21:18:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.913+0000 7fb915d1d740 10 client.0 _ll_register_callbacks cb 0x5647bbbdb990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.913+0000 7fb911ee5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbccdd30 0x5647bbccb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.913+0000 7fb911ee5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbccdd30 0x5647bbccb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45994/0 (socket says 172.21.15.59:45994) 2024-09-10T21:18:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.913+0000 7fb911ee5640 1 -- 172.21.15.59:0/3361540558 learned_addr learned my addr 172.21.15.59:0/3361540558 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.913+0000 7fb9116e4640 1 --2- 172.21.15.59:0/3361540558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbcc1480 0x5647bbccd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.913+0000 7fb910ee3640 1 --2- 172.21.15.59:0/3361540558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbcc1da0 0x5647bbccaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.913+0000 7fb911ee5640 1 -- 172.21.15.59:0/3361540558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbcc1da0 msgr2=0x5647bbccaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.913+0000 7fb911ee5640 1 --2- 172.21.15.59:0/3361540558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbcc1da0 0x5647bbccaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.913+0000 7fb911ee5640 1 -- 172.21.15.59:0/3361540558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbcc1480 msgr2=0x5647bbccd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.913+0000 7fb911ee5640 1 --2- 172.21.15.59:0/3361540558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbcc1480 0x5647bbccd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.913+0000 7fb911ee5640 1 -- 172.21.15.59:0/3361540558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647bbbefc40 con 0x5647bbccdd30 2024-09-10T21:18:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.913+0000 7fb911ee5640 1 --2- 172.21.15.59:0/3361540558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbccdd30 0x5647bbccb020 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb9040a94b0 tx=0x7fb9040abaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b857fe9ed0bdc13e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.913+0000 7fb8f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.913+0000 7fb8f4ff9640 1 -- 172.21.15.59:0/3361540558 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90401f030 con 0x5647bbccdd30 2024-09-10T21:18:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.913+0000 7fb8f4ff9640 1 -- 172.21.15.59:0/3361540558 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fb9040cf070 con 0x5647bbccdd30 2024-09-10T21:18:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.913+0000 7fb915d1d740 1 -- 172.21.15.59:0/3361540558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8fc0047a0 con 0x5647bbccdd30 2024-09-10T21:18:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.914+0000 7fb8f4ff9640 1 -- 172.21.15.59:0/3361540558 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb9040b0d20 con 0x5647bbccdd30 2024-09-10T21:18:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.914+0000 7fb915d1d740 10 client.16104 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.914+0000 7fb915d1d740 1 -- 172.21.15.59:0/3361540558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5647bbcdc310 con 0x5647bbccdd30 2024-09-10T21:18:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.914+0000 7fb8f4ff9640 1 -- 172.21.15.59:0/3361540558 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8fc0047a0 con 0x5647bbccdd30 2024-09-10T21:18:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.914+0000 7fb8f4ff9640 1 -- 172.21.15.59:0/3361540558 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb9040a7b90 con 0x5647bbccdd30 2024-09-10T21:18:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.914+0000 7fb915d1d740 10 client.16104 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.914+0000 7fb915d1d740 10 client.16104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:18:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.914+0000 7fb915d1d740 20 client.16104 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.914+0000 7fb915d1d740 1 --2- 172.21.15.59:0/3361540558 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5647bbcdd820 0x5647bbcdfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.914+0000 7fb915d1d740 4 client.16104 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:18:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.914+0000 7fb915d1d740 1 -- 172.21.15.59:0/3361540558 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647bbc39da0 con 0x5647bbcdd820 2024-09-10T21:18:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.914+0000 7fb9116e4640 1 --2- 172.21.15.59:0/3361540558 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5647bbcdd820 0x5647bbcdfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.915+0000 7fb9116e4640 1 --2- 172.21.15.59:0/3361540558 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5647bbcdd820 0x5647bbcdfc10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29e715fb5d0cbb7b server_cookie=f4fec3ae2fcaa962 in_seq=0 out_seq=0 2024-09-10T21:18:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.915+0000 7fb8f4ff9640 10 client.16104 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.915+0000 7fb8f4ff9640 1 -- 172.21.15.59:0/3361540558 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5647bbc39da0 con 0x5647bbcdd820 2024-09-10T21:18:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.915+0000 7fb8f4ff9640 10 client.16104 handle_command_reply: tid=0 2024-09-10T21:18:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.915+0000 7fb915d1d740 1 client.16104 shutdown 2024-09-10T21:18:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.916+0000 7fb915d1d740 1 -- 172.21.15.59:0/3361540558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbccdd30 msgr2=0x5647bbccb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.916+0000 7fb915d1d740 1 --2- 172.21.15.59:0/3361540558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbccdd30 0x5647bbccb020 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb9040a94b0 tx=0x7fb9040abaa0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.916+0000 7fb915d1d740 1 -- 172.21.15.59:0/3361540558 shutdown_connections 2024-09-10T21:18:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.916+0000 7fb915d1d740 1 --2- 172.21.15.59:0/3361540558 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5647bbcdd820 0x5647bbcdfc10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.916+0000 7fb915d1d740 1 --2- 172.21.15.59:0/3361540558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbccdd30 0x5647bbccb020 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.916+0000 7fb915d1d740 1 --2- 172.21.15.59:0/3361540558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbcc1da0 0x5647bbccaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.916+0000 7fb915d1d740 1 --2- 172.21.15.59:0/3361540558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbcc1480 0x5647bbccd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.916+0000 7fb915d1d740 1 -- 172.21.15.59:0/3361540558 >> 172.21.15.59:0/3361540558 conn(0x5647bbcbf2b0 msgr2=0x5647bbcc4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.916+0000 7fb8f4ff9640 0 client.16104 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.916+0000 7fb915d1d740 1 -- 172.21.15.59:0/3361540558 shutdown_connections 2024-09-10T21:18:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.916+0000 7fb915d1d740 1 -- 172.21.15.59:0/3361540558 wait complete. 2024-09-10T21:18:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.916+0000 7fb915d1d740 20 client.16104 trim_cache size 0 max 16384 2024-09-10T21:18:08.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.933+0000 7fb915d1d740 1 Processor -- start 2024-09-10T21:18:08.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.933+0000 7fb915d1d740 1 -- start start 2024-09-10T21:18:08.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.934+0000 7fb915d1d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 0x5647bbcc0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:08.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.934+0000 7fb915d1d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbcc1da0 0x5647bbcbebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:08.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.934+0000 7fb915d1d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbccdd30 0x5647bbccf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:08.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.934+0000 7fb915d1d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb90c1ae260 con 0x5647bbcc1480 2024-09-10T21:18:08.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.934+0000 7fb915d1d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb90c1afda0 con 0x5647bbcc1da0 2024-09-10T21:18:08.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.934+0000 7fb915d1d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb90c1ae930 con 0x5647bbccdd30 2024-09-10T21:18:08.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.934+0000 7fb9116e4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 0x5647bbcc0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:08.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.934+0000 7fb9116e4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 0x5647bbcc0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46002/0 (socket says 172.21.15.59:46002) 2024-09-10T21:18:08.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.934+0000 7fb9116e4640 1 -- 172.21.15.59:0/712960091 learned_addr learned my addr 172.21.15.59:0/712960091 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:08.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.934+0000 7fb911ee5640 1 --2- 172.21.15.59:0/712960091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbccdd30 0x5647bbccf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:08.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.934+0000 7fb9116e4640 1 -- 172.21.15.59:0/712960091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbccdd30 msgr2=0x5647bbccf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:08.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.934+0000 7fb9116e4640 1 --2- 172.21.15.59:0/712960091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbccdd30 0x5647bbccf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.934+0000 7fb9116e4640 1 -- 172.21.15.59:0/712960091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbcc1da0 msgr2=0x5647bbcbebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:08.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.934+0000 7fb9116e4640 1 --2- 172.21.15.59:0/712960091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbcc1da0 0x5647bbcbebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.934+0000 7fb9116e4640 1 -- 172.21.15.59:0/712960091 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647bbcc8f40 con 0x5647bbcc1480 2024-09-10T21:18:08.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.934+0000 7fb9116e4640 1 --2- 172.21.15.59:0/712960091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 0x5647bbcc0a80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb908032fd0 tx=0x7fb90803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5e6e7b2fd73d1b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:08.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.934+0000 7fb8f6ffd640 1 -- 172.21.15.59:0/712960091 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908035040 con 0x5647bbcc1480 2024-09-10T21:18:08.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.934+0000 7fb8f6ffd640 1 -- 172.21.15.59:0/712960091 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9080043c0 con 0x5647bbcc1480 2024-09-10T21:18:08.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.934+0000 7fb8f6ffd640 1 -- 172.21.15.59:0/712960091 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908004e00 con 0x5647bbcc1480 2024-09-10T21:18:08.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.935+0000 7fb915d1d740 1 -- 172.21.15.59:0/712960091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 msgr2=0x5647bbcc0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:08.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.935+0000 7fb915d1d740 1 --2- 172.21.15.59:0/712960091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 0x5647bbcc0a80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb908032fd0 tx=0x7fb90803f000 comp rx=0 tx=0).stop 2024-09-10T21:18:08.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.935+0000 7fb915d1d740 1 -- 172.21.15.59:0/712960091 shutdown_connections 2024-09-10T21:18:08.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.935+0000 7fb915d1d740 1 --2- 172.21.15.59:0/712960091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbccdd30 0x5647bbccf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.935+0000 7fb915d1d740 1 --2- 172.21.15.59:0/712960091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbcc1da0 0x5647bbcbebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.935+0000 7fb915d1d740 1 --2- 172.21.15.59:0/712960091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 0x5647bbcc0a80 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.935+0000 7fb915d1d740 1 -- 172.21.15.59:0/712960091 >> 172.21.15.59:0/712960091 conn(0x5647bbcbf2b0 msgr2=0x5647bbcc0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:08.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.935+0000 7fb915d1d740 1 -- 172.21.15.59:0/712960091 shutdown_connections 2024-09-10T21:18:08.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.935+0000 7fb915d1d740 1 -- 172.21.15.59:0/712960091 wait complete. 2024-09-10T21:18:08.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.935+0000 7fb915d1d740 1 -- start start 2024-09-10T21:18:08.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.936+0000 7fb915d1d740 1 Processor -- start 2024-09-10T21:18:08.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.936+0000 7fb915d1d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 0x5647bbcd6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:08.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.936+0000 7fb915d1d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbcc1da0 0x5647bbcd0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:08.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.936+0000 7fb915d1d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbccdd30 0x5647bbcd11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:08.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.936+0000 7fb915d1d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb90c1af6d0 con 0x5647bbcc1480 2024-09-10T21:18:08.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.936+0000 7fb915d1d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb90c1af000 con 0x5647bbcc1da0 2024-09-10T21:18:08.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.936+0000 7fb915d1d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb90c1ac240 con 0x5647bbccdd30 2024-09-10T21:18:08.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.936+0000 7fb915d1d740 10 client.0 _ll_register_callbacks cb 0x7fb90400cf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:08.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.936+0000 7fb9116e4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 0x5647bbcd6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:08.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.936+0000 7fb9116e4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 0x5647bbcd6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46008/0 (socket says 172.21.15.59:46008) 2024-09-10T21:18:08.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.936+0000 7fb9116e4640 1 -- 172.21.15.59:0/3781814420 learned_addr learned my addr 172.21.15.59:0/3781814420 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:08.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.936+0000 7fb910ee3640 1 --2- 172.21.15.59:0/3781814420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbcc1da0 0x5647bbcd0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:08.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.936+0000 7fb911ee5640 1 --2- 172.21.15.59:0/3781814420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbccdd30 0x5647bbcd11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:08.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.936+0000 7fb9116e4640 1 -- 172.21.15.59:0/3781814420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbccdd30 msgr2=0x5647bbcd11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:08.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.936+0000 7fb9116e4640 1 --2- 172.21.15.59:0/3781814420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbccdd30 0x5647bbcd11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.936+0000 7fb9116e4640 1 -- 172.21.15.59:0/3781814420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbcc1da0 msgr2=0x5647bbcd0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:08.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.936+0000 7fb9116e4640 1 --2- 172.21.15.59:0/3781814420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbcc1da0 0x5647bbcd0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.936+0000 7fb9116e4640 1 -- 172.21.15.59:0/3781814420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647bbcd19d0 con 0x5647bbcc1480 2024-09-10T21:18:08.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.936+0000 7fb910ee3640 1 --2- 172.21.15.59:0/3781814420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbcc1da0 0x5647bbcd0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:08.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.937+0000 7fb9116e4640 1 --2- 172.21.15.59:0/3781814420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 0x5647bbcd6490 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb90804c040 tx=0x7fb908004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c9460b7f07d487 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:08.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.937+0000 7fb8f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:08.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.937+0000 7fb8f4ff9640 1 -- 172.21.15.59:0/3781814420 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90805f020 con 0x5647bbcc1480 2024-09-10T21:18:08.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.937+0000 7fb8f4ff9640 1 -- 172.21.15.59:0/3781814420 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fb908003a00 con 0x5647bbcc1480 2024-09-10T21:18:08.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.937+0000 7fb915d1d740 1 -- 172.21.15.59:0/3781814420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9080043c0 con 0x5647bbcc1480 2024-09-10T21:18:08.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.937+0000 7fb8f4ff9640 1 -- 172.21.15.59:0/3781814420 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb908003c00 con 0x5647bbcc1480 2024-09-10T21:18:08.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.937+0000 7fb915d1d740 10 client.16110 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:08.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.937+0000 7fb915d1d740 1 -- 172.21.15.59:0/3781814420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5647bbd4fbd0 con 0x5647bbcc1480 2024-09-10T21:18:08.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.937+0000 7fb8f4ff9640 1 -- 172.21.15.59:0/3781814420 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9080043c0 con 0x5647bbcc1480 2024-09-10T21:18:08.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.937+0000 7fb8f4ff9640 1 -- 172.21.15.59:0/3781814420 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb90805b440 con 0x5647bbcc1480 2024-09-10T21:18:08.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.937+0000 7fb915d1d740 10 client.16110 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:08.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.937+0000 7fb915d1d740 10 client.16110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:18:08.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.937+0000 7fb915d1d740 20 client.16110 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:08.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.937+0000 7fb915d1d740 1 --2- 172.21.15.59:0/3781814420 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5647bbd50320 0x5647bbd52740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:08.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.937+0000 7fb915d1d740 4 client.16110 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:18:08.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.938+0000 7fb915d1d740 1 -- 172.21.15.59:0/3781814420 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5647bbc35850 con 0x5647bbd50320 2024-09-10T21:18:08.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.938+0000 7fb910ee3640 1 --2- 172.21.15.59:0/3781814420 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5647bbd50320 0x5647bbd52740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:08.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.938+0000 7fb8f4ff9640 10 client.16110 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:08.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.938+0000 7fb910ee3640 1 --2- 172.21.15.59:0/3781814420 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5647bbd50320 0x5647bbd52740 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a530210960d3de3b server_cookie=763b756a9a4731ce in_seq=0 out_seq=0 2024-09-10T21:18:08.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.938+0000 7fb8f4ff9640 1 -- 172.21.15.59:0/3781814420 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x5647bbc35850 con 0x5647bbd50320 2024-09-10T21:18:08.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.938+0000 7fb8f4ff9640 10 client.16110 handle_command_reply: tid=0 2024-09-10T21:18:08.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.938+0000 7fb915d1d740 1 client.16110 shutdown 2024-09-10T21:18:08.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.939+0000 7fb915d1d740 1 -- 172.21.15.59:0/3781814420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 msgr2=0x5647bbcd6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:08.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.939+0000 7fb915d1d740 1 --2- 172.21.15.59:0/3781814420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 0x5647bbcd6490 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb90804c040 tx=0x7fb908004320 comp rx=0 tx=0).stop 2024-09-10T21:18:08.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.939+0000 7fb915d1d740 1 -- 172.21.15.59:0/3781814420 shutdown_connections 2024-09-10T21:18:08.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.939+0000 7fb915d1d740 1 --2- 172.21.15.59:0/3781814420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bbccdd30 0x5647bbcd11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.939+0000 7fb915d1d740 1 --2- 172.21.15.59:0/3781814420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bbcc1da0 0x5647bbcd0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.939+0000 7fb915d1d740 1 --2- 172.21.15.59:0/3781814420 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5647bbd50320 0x5647bbd52740 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.939+0000 7fb915d1d740 1 --2- 172.21.15.59:0/3781814420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bbcc1480 0x5647bbcd6490 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.939+0000 7fb915d1d740 1 -- 172.21.15.59:0/3781814420 >> 172.21.15.59:0/3781814420 conn(0x5647bbcbf2b0 msgr2=0x5647bbcc9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:08.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.939+0000 7fb8f4ff9640 0 client.16110 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:08.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.939+0000 7fb915d1d740 1 -- 172.21.15.59:0/3781814420 shutdown_connections 2024-09-10T21:18:08.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.939+0000 7fb915d1d740 1 -- 172.21.15.59:0/3781814420 wait complete. 2024-09-10T21:18:08.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.939+0000 7fb915d1d740 20 client.16110 trim_cache size 0 max 16384 2024-09-10T21:18:08.948 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:18:08.948 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:18:08.948 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-09-10T21:18:08.948 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:18:08.948 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "f8c32dfe-dde0-4d7e-898f-021c024019e0", 2024-09-10T21:18:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2024-09-10T21:18:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:18:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:18:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:18:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:18:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:18:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:18:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:18:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:18:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:18:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:18:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:18:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:18:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:18:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:18:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:18:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:18:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:18:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:18:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:18:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:18:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:18:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:18:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:18:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:18:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:18:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:18:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:18:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:18:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:18:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:18:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:18:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:18:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:18:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:18:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:18:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:18:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:18:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:18:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:18:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:18:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:18:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:18:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:18:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:18:08.953 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:18:08.953 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:18:08.953 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:18:08.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.939+0000 7fb913948640 1 -- 172.21.15.59:0/1201321642 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb8f80b52e0 msgr2=0x7fb8f80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:08.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.939+0000 7fb913948640 1 --2- 172.21.15.59:0/1201321642 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb8f80b52e0 0x7fb8f80b77a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb908031440 tx=0x7fb908005c00 comp rx=0 tx=0).stop 2024-09-10T21:18:08.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.939+0000 7fb913948640 1 -- 172.21.15.59:0/1201321642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb90c109150 msgr2=0x7fb90c19eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:08.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.939+0000 7fb913948640 1 --2- 172.21.15.59:0/1201321642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb90c109150 0x7fb90c19eb80 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb90400eaa0 tx=0x7fb90400ef60 comp rx=0 tx=0).stop 2024-09-10T21:18:08.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.940+0000 7fb913948640 1 -- 172.21.15.59:0/1201321642 shutdown_connections 2024-09-10T21:18:08.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.940+0000 7fb913948640 1 --2- 172.21.15.59:0/1201321642 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb8f80b52e0 0x7fb8f80b77a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.940+0000 7fb913948640 1 --2- 172.21.15.59:0/1201321642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb90c109150 0x7fb90c19eb80 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.940+0000 7fb913948640 1 --2- 172.21.15.59:0/1201321642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb90c1087d0 0x7fb90c1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.940+0000 7fb913948640 1 --2- 172.21.15.59:0/1201321642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb90c102dc0 0x7fb90c1992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:08.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.940+0000 7fb913948640 1 -- 172.21.15.59:0/1201321642 >> 172.21.15.59:0/1201321642 conn(0x7fb90c0fe830 msgr2=0x7fb90c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:08.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.940+0000 7fb913948640 1 -- 172.21.15.59:0/1201321642 shutdown_connections 2024-09-10T21:18:08.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:08.940+0000 7fb913948640 1 -- 172.21.15.59:0/1201321642 wait complete. 2024-09-10T21:18:09.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:09 smithi059 ceph-mon[30888]: pgmap v426: 97 pgs: 97 active+clean; 1.9 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:18:09.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:09 smithi192 ceph-mon[35363]: pgmap v426: 97 pgs: 97 active+clean; 1.9 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:18:09.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:09 smithi154 ceph-mon[35041]: pgmap v426: 97 pgs: 97 active+clean; 1.9 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:18:09.664 INFO:tasks.cephfs.filesystem:scrub status for tag:f8c32dfe-dde0-4d7e-898f-021c024019e0 - {'path': '/', 'tag': 'f8c32dfe-dde0-4d7e-898f-021c024019e0', 'options': 'recursive,force'} 2024-09-10T21:18:10.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:10 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:18:10.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:10 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:18:10.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:10 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:18:11.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:11 smithi192 ceph-mon[35363]: pgmap v427: 97 pgs: 97 active+clean; 1.9 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:11.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:11 smithi059 ceph-mon[30888]: pgmap v427: 97 pgs: 97 active+clean; 1.9 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:11.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:11 smithi154 ceph-mon[35041]: pgmap v427: 97 pgs: 97 active+clean; 1.9 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:13.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:13 smithi192 ceph-mon[35363]: pgmap v428: 97 pgs: 97 active+clean; 2.0 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:18:13.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:13 smithi059 ceph-mon[30888]: pgmap v428: 97 pgs: 97 active+clean; 2.0 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:18:13.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:13 smithi154 ceph-mon[35041]: pgmap v428: 97 pgs: 97 active+clean; 2.0 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:18:15.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:15 smithi192 ceph-mon[35363]: pgmap v429: 97 pgs: 97 active+clean; 2.0 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:15.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:15 smithi059 ceph-mon[30888]: pgmap v429: 97 pgs: 97 active+clean; 2.0 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:15.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:15 smithi154 ceph-mon[35041]: pgmap v429: 97 pgs: 97 active+clean; 2.0 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:17.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:17 smithi192 ceph-mon[35363]: pgmap v430: 97 pgs: 97 active+clean; 2.0 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:18:17.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:17 smithi059 ceph-mon[30888]: pgmap v430: 97 pgs: 97 active+clean; 2.0 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:18:17.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:17 smithi154 ceph-mon[35041]: pgmap v430: 97 pgs: 97 active+clean; 2.0 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:18:19.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:19 smithi059 ceph-mon[30888]: pgmap v431: 97 pgs: 97 active+clean; 2.0 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:18:19.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:19 smithi154 ceph-mon[35041]: pgmap v431: 97 pgs: 97 active+clean; 2.0 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:18:19.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:19 smithi192 ceph-mon[35363]: pgmap v431: 97 pgs: 97 active+clean; 2.0 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:18:20.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:20 smithi059 ceph-mon[30888]: pgmap v432: 97 pgs: 97 active+clean; 2.0 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:20.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:20 smithi154 ceph-mon[35041]: pgmap v432: 97 pgs: 97 active+clean; 2.0 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:20.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:20 smithi192 ceph-mon[35363]: pgmap v432: 97 pgs: 97 active+clean; 2.0 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:22.416 INFO:tasks.workunit.client.0.smithi059.stdout:64/600: open fd = 3 2024-09-10T21:18:22.416 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.416 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.416 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.416 INFO:tasks.workunit.client.0.smithi059.stdout:65/600: open fd = 3 2024-09-10T21:18:22.416 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.416 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.417 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.417 INFO:tasks.workunit.client.0.smithi059.stdout:66/600: open fd = 3 2024-09-10T21:18:22.417 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.417 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.417 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.417 INFO:tasks.workunit.client.0.smithi059.stdout:67/600: open fd = 3 2024-09-10T21:18:22.417 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.417 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.417 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.417 INFO:tasks.workunit.client.0.smithi059.stdout:68/600: open fd = 3 2024-09-10T21:18:22.417 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.417 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.418 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.418 INFO:tasks.workunit.client.0.smithi059.stdout:69/600: open fd = 3 2024-09-10T21:18:22.418 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.418 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.418 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.418 INFO:tasks.workunit.client.0.smithi059.stdout:70/600: open fd = 3 2024-09-10T21:18:22.418 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.418 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.418 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.418 INFO:tasks.workunit.client.0.smithi059.stdout:71/600: open fd = 3 2024-09-10T21:18:22.418 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.418 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.418 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.418 INFO:tasks.workunit.client.0.smithi059.stdout:72/600: open fd = 3 2024-09-10T21:18:22.419 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.419 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.419 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.419 INFO:tasks.workunit.client.0.smithi059.stdout:73/600: open fd = 3 2024-09-10T21:18:22.419 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.419 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.419 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.419 INFO:tasks.workunit.client.0.smithi059.stdout:74/600: open fd = 3 2024-09-10T21:18:22.419 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.419 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.419 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.419 INFO:tasks.workunit.client.0.smithi059.stdout:75/600: open fd = 3 2024-09-10T21:18:22.419 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.419 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.420 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.420 INFO:tasks.workunit.client.0.smithi059.stdout:76/600: open fd = 3 2024-09-10T21:18:22.420 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.420 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.420 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.420 INFO:tasks.workunit.client.0.smithi059.stdout:77/600: open fd = 3 2024-09-10T21:18:22.420 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.420 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.420 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.420 INFO:tasks.workunit.client.0.smithi059.stdout:78/600: open fd = 3 2024-09-10T21:18:22.420 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.420 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.420 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.420 INFO:tasks.workunit.client.0.smithi059.stdout:79/600: open fd = 3 2024-09-10T21:18:22.421 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.421 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.421 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.421 INFO:tasks.workunit.client.0.smithi059.stdout:80/600: open fd = 3 2024-09-10T21:18:22.421 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.421 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.421 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.421 INFO:tasks.workunit.client.0.smithi059.stdout:81/600: open fd = 3 2024-09-10T21:18:22.421 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.421 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.421 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.421 INFO:tasks.workunit.client.0.smithi059.stdout:82/600: open fd = 3 2024-09-10T21:18:22.421 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.421 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.422 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.422 INFO:tasks.workunit.client.0.smithi059.stdout:83/600: open fd = 3 2024-09-10T21:18:22.422 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.422 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.422 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.422 INFO:tasks.workunit.client.0.smithi059.stdout:84/600: open fd = 3 2024-09-10T21:18:22.422 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.422 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.422 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.422 INFO:tasks.workunit.client.0.smithi059.stdout:85/600: open fd = 3 2024-09-10T21:18:22.422 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.422 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.422 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.422 INFO:tasks.workunit.client.0.smithi059.stdout:86/600: open fd = 3 2024-09-10T21:18:22.422 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.422 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.423 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.423 INFO:tasks.workunit.client.0.smithi059.stdout:87/600: open fd = 3 2024-09-10T21:18:22.423 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.423 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.423 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.423 INFO:tasks.workunit.client.0.smithi059.stdout:88/600: open fd = 3 2024-09-10T21:18:22.423 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.423 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.423 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.423 INFO:tasks.workunit.client.0.smithi059.stdout:89/600: open fd = 3 2024-09-10T21:18:22.423 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.423 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.423 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.423 INFO:tasks.workunit.client.0.smithi059.stdout:90/600: open fd = 3 2024-09-10T21:18:22.423 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.424 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.424 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.424 INFO:tasks.workunit.client.0.smithi059.stdout:91/600: open fd = 3 2024-09-10T21:18:22.424 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.424 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.424 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.424 INFO:tasks.workunit.client.0.smithi059.stdout:92/600: open fd = 3 2024-09-10T21:18:22.424 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.424 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.424 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.424 INFO:tasks.workunit.client.0.smithi059.stdout:93/600: open fd = 3 2024-09-10T21:18:22.424 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.424 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.424 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.425 INFO:tasks.workunit.client.0.smithi059.stdout:94/600: open fd = 3 2024-09-10T21:18:22.425 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.425 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.425 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.425 INFO:tasks.workunit.client.0.smithi059.stdout:95/600: open fd = 3 2024-09-10T21:18:22.425 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.425 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.425 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.425 INFO:tasks.workunit.client.0.smithi059.stdout:96/600: open fd = 3 2024-09-10T21:18:22.425 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.425 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.425 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.425 INFO:tasks.workunit.client.0.smithi059.stdout:97/600: open fd = 3 2024-09-10T21:18:22.426 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.426 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.426 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.426 INFO:tasks.workunit.client.0.smithi059.stdout:98/600: open fd = 3 2024-09-10T21:18:22.426 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.426 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.426 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.426 INFO:tasks.workunit.client.0.smithi059.stdout:99/600: open fd = 3 2024-09-10T21:18:22.426 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.426 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.426 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.426 INFO:tasks.workunit.client.0.smithi059.stdout:100/600: open fd = 3 2024-09-10T21:18:22.426 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.426 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.426 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.427 INFO:tasks.workunit.client.0.smithi059.stdout:101/600: open fd = 3 2024-09-10T21:18:22.427 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.427 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.427 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.427 INFO:tasks.workunit.client.0.smithi059.stdout:102/600: open fd = 3 2024-09-10T21:18:22.427 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.427 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.427 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.427 INFO:tasks.workunit.client.0.smithi059.stdout:103/600: open fd = 3 2024-09-10T21:18:22.427 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.427 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.427 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.428 INFO:tasks.workunit.client.0.smithi059.stdout:104/600: open fd = 3 2024-09-10T21:18:22.428 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.428 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.428 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.428 INFO:tasks.workunit.client.0.smithi059.stdout:105/600: open fd = 3 2024-09-10T21:18:22.428 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.428 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.428 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.428 INFO:tasks.workunit.client.0.smithi059.stdout:106/600: open fd = 3 2024-09-10T21:18:22.428 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.428 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.428 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.428 INFO:tasks.workunit.client.0.smithi059.stdout:107/600: open fd = 3 2024-09-10T21:18:22.429 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.429 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.429 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.429 INFO:tasks.workunit.client.0.smithi059.stdout:108/600: open fd = 3 2024-09-10T21:18:22.429 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.429 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.429 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.429 INFO:tasks.workunit.client.0.smithi059.stdout:109/600: open fd = 3 2024-09-10T21:18:22.429 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.429 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.429 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.429 INFO:tasks.workunit.client.0.smithi059.stdout:110/600: open fd = 3 2024-09-10T21:18:22.430 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.430 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.430 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.430 INFO:tasks.workunit.client.0.smithi059.stdout:111/600: open fd = 3 2024-09-10T21:18:22.430 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.430 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.430 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.430 INFO:tasks.workunit.client.0.smithi059.stdout:112/600: open fd = 3 2024-09-10T21:18:22.430 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.430 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.430 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.430 INFO:tasks.workunit.client.0.smithi059.stdout:113/600: open fd = 3 2024-09-10T21:18:22.430 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.430 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.430 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.430 INFO:tasks.workunit.client.0.smithi059.stdout:114/600: open fd = 3 2024-09-10T21:18:22.431 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.431 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.431 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.431 INFO:tasks.workunit.client.0.smithi059.stdout:115/600: open fd = 3 2024-09-10T21:18:22.431 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.431 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.431 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.431 INFO:tasks.workunit.client.0.smithi059.stdout:116/600: open fd = 3 2024-09-10T21:18:22.431 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.431 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.431 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.431 INFO:tasks.workunit.client.0.smithi059.stdout:117/600: open fd = 3 2024-09-10T21:18:22.431 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.432 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.432 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.432 INFO:tasks.workunit.client.0.smithi059.stdout:118/600: open fd = 3 2024-09-10T21:18:22.432 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.432 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.432 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.432 INFO:tasks.workunit.client.0.smithi059.stdout:119/600: open fd = 3 2024-09-10T21:18:22.432 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.432 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.432 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.432 INFO:tasks.workunit.client.0.smithi059.stdout:120/600: open fd = 3 2024-09-10T21:18:22.432 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.432 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.433 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.433 INFO:tasks.workunit.client.0.smithi059.stdout:121/600: open fd = 3 2024-09-10T21:18:22.433 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.433 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.433 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.433 INFO:tasks.workunit.client.0.smithi059.stdout:122/600: open fd = 3 2024-09-10T21:18:22.433 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.433 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.433 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.433 INFO:tasks.workunit.client.0.smithi059.stdout:123/600: open fd = 3 2024-09-10T21:18:22.433 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.433 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.433 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.434 INFO:tasks.workunit.client.0.smithi059.stdout:124/600: open fd = 3 2024-09-10T21:18:22.434 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.434 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.434 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.434 INFO:tasks.workunit.client.0.smithi059.stdout:125/600: open fd = 3 2024-09-10T21:18:22.434 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.434 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.434 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:18:22.434 INFO:tasks.workunit.client.0.smithi059.stdout:126/600: open fd = 3 2024-09-10T21:18:22.434 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:18:22.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:22 smithi059 ceph-mon[30888]: pgmap v433: 97 pgs: 97 active+clean; 2.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:18:22.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:22 smithi154 ceph-mon[35041]: pgmap v433: 97 pgs: 97 active+clean; 2.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:18:22.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:22 smithi192 ceph-mon[35363]: pgmap v433: 97 pgs: 97 active+clean; 2.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:18:24.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:24 smithi059 ceph-mon[30888]: pgmap v434: 97 pgs: 97 active+clean; 2.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:24.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:24 smithi154 ceph-mon[35041]: pgmap v434: 97 pgs: 97 active+clean; 2.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:24.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:24 smithi192 ceph-mon[35363]: pgmap v434: 97 pgs: 97 active+clean; 2.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:26.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:26 smithi059 ceph-mon[30888]: pgmap v435: 97 pgs: 97 active+clean; 2.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:18:26.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:26 smithi154 ceph-mon[35041]: pgmap v435: 97 pgs: 97 active+clean; 2.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:18:26.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:26 smithi192 ceph-mon[35363]: pgmap v435: 97 pgs: 97 active+clean; 2.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:18:28.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:28 smithi059 ceph-mon[30888]: pgmap v436: 97 pgs: 97 active+clean; 2.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:18:28.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:28 smithi154 ceph-mon[35041]: pgmap v436: 97 pgs: 97 active+clean; 2.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:18:28.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:28 smithi192 ceph-mon[35363]: pgmap v436: 97 pgs: 97 active+clean; 2.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:18:29.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:18:29.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:18:29.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:18:29.662 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:29 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:18:29.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:29 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:18:29.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:29 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:18:29.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:29 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:18:29.683 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:29 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:18:29.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:29 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:18:29.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:29 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:18:29.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:29 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:18:29.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:29 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:18:31.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:30 smithi192 ceph-mon[35363]: pgmap v437: 97 pgs: 97 active+clean; 2.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:31.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:30 smithi059 ceph-mon[30888]: pgmap v437: 97 pgs: 97 active+clean; 2.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:31.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:30 smithi154 ceph-mon[35041]: pgmap v437: 97 pgs: 97 active+clean; 2.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:33.236 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:32 smithi059 ceph-mon[30888]: pgmap v438: 97 pgs: 97 active+clean; 2.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:18:33.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:32 smithi192 ceph-mon[35363]: pgmap v438: 97 pgs: 97 active+clean; 2.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:18:33.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:32 smithi154 ceph-mon[35041]: pgmap v438: 97 pgs: 97 active+clean; 2.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:18:35.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:34 smithi192 ceph-mon[35363]: pgmap v439: 97 pgs: 97 active+clean; 2.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:35.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:34 smithi059 ceph-mon[30888]: pgmap v439: 97 pgs: 97 active+clean; 2.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:35.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:34 smithi154 ceph-mon[35041]: pgmap v439: 97 pgs: 97 active+clean; 2.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:37.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:36 smithi192 ceph-mon[35363]: pgmap v440: 97 pgs: 97 active+clean; 2.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:18:37.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:36 smithi059 ceph-mon[30888]: pgmap v440: 97 pgs: 97 active+clean; 2.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:18:37.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:36 smithi154 ceph-mon[35041]: pgmap v440: 97 pgs: 97 active+clean; 2.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:18:39.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:38 smithi192 ceph-mon[35363]: pgmap v441: 97 pgs: 97 active+clean; 2.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:18:39.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:38 smithi059 ceph-mon[30888]: pgmap v441: 97 pgs: 97 active+clean; 2.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:18:39.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:38 smithi154 ceph-mon[35041]: pgmap v441: 97 pgs: 97 active+clean; 2.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:18:39.665 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:18:39.941 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:18:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.412+0000 7fd27c74c640 1 -- 172.21.15.59:0/240271484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2741087d0 msgr2=0x7fd274108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.412+0000 7fd27c74c640 1 --2- 172.21.15.59:0/240271484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2741087d0 0x7fd274108c10 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fd264009900 tx=0x7fd26402a410 comp rx=0 tx=0).stop 2024-09-10T21:18:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.412+0000 7fd27c74c640 1 -- 172.21.15.59:0/240271484 shutdown_connections 2024-09-10T21:18:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.412+0000 7fd27c74c640 1 --2- 172.21.15.59:0/240271484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd274109150 0x7fd27410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.412+0000 7fd27c74c640 1 --2- 172.21.15.59:0/240271484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2741087d0 0x7fd274108c10 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.412+0000 7fd27c74c640 1 --2- 172.21.15.59:0/240271484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd274102dc0 0x7fd2741031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.412+0000 7fd27c74c640 1 -- 172.21.15.59:0/240271484 >> 172.21.15.59:0/240271484 conn(0x7fd2740fe830 msgr2=0x7fd274100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.412+0000 7fd27c74c640 1 -- 172.21.15.59:0/240271484 shutdown_connections 2024-09-10T21:18:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.412+0000 7fd27c74c640 1 -- 172.21.15.59:0/240271484 wait complete. 2024-09-10T21:18:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.413+0000 7fd27c74c640 1 Processor -- start 2024-09-10T21:18:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.413+0000 7fd27c74c640 1 -- start start 2024-09-10T21:18:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.413+0000 7fd27c74c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd274102dc0 0x7fd274199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.413+0000 7fd27c74c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2741087d0 0x7fd274199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.413+0000 7fd27c74c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd274109150 0x7fd27419ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.413+0000 7fd27c74c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd274112e10 con 0x7fd274102dc0 2024-09-10T21:18:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.413+0000 7fd27c74c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd274112c90 con 0x7fd2741087d0 2024-09-10T21:18:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.413+0000 7fd27c74c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd274112f90 con 0x7fd274109150 2024-09-10T21:18:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.413+0000 7fd27a4e8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd274102dc0 0x7fd274199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.413+0000 7fd27a4e8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd274102dc0 0x7fd274199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42104/0 (socket says 172.21.15.59:42104) 2024-09-10T21:18:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.413+0000 7fd27a4e8640 1 -- 172.21.15.59:0/2752324293 learned_addr learned my addr 172.21.15.59:0/2752324293 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.414+0000 7fd27ace9640 1 --2- 172.21.15.59:0/2752324293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd274109150 0x7fd27419ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.414+0000 7fd279ce7640 1 --2- 172.21.15.59:0/2752324293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2741087d0 0x7fd274199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:40.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.414+0000 7fd27a4e8640 1 -- 172.21.15.59:0/2752324293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd274109150 msgr2=0x7fd27419ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.414+0000 7fd27a4e8640 1 --2- 172.21.15.59:0/2752324293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd274109150 0x7fd27419ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.414+0000 7fd27a4e8640 1 -- 172.21.15.59:0/2752324293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2741087d0 msgr2=0x7fd274199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.414+0000 7fd27a4e8640 1 --2- 172.21.15.59:0/2752324293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2741087d0 0x7fd274199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.414+0000 7fd27a4e8640 1 -- 172.21.15.59:0/2752324293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd27419f3f0 con 0x7fd274102dc0 2024-09-10T21:18:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.414+0000 7fd27ace9640 1 --2- 172.21.15.59:0/2752324293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd274109150 0x7fd27419ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.414+0000 7fd279ce7640 1 --2- 172.21.15.59:0/2752324293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2741087d0 0x7fd274199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.414+0000 7fd27a4e8640 1 --2- 172.21.15.59:0/2752324293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd274102dc0 0x7fd274199340 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd27000d770 tx=0x7fd27000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.414+0000 7fd26b7fe640 1 -- 172.21.15.59:0/2752324293 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270017070 con 0x7fd274102dc0 2024-09-10T21:18:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.414+0000 7fd26b7fe640 1 -- 172.21.15.59:0/2752324293 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2700054d0 con 0x7fd274102dc0 2024-09-10T21:18:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.414+0000 7fd27c74c640 1 -- 172.21.15.59:0/2752324293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd27419f6e0 con 0x7fd274102dc0 2024-09-10T21:18:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.414+0000 7fd26b7fe640 1 -- 172.21.15.59:0/2752324293 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270004c30 con 0x7fd274102dc0 2024-09-10T21:18:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.414+0000 7fd27c74c640 1 -- 172.21.15.59:0/2752324293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2741a5da0 con 0x7fd274102dc0 2024-09-10T21:18:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.417+0000 7fd26b7fe640 1 -- 172.21.15.59:0/2752324293 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd270004e10 con 0x7fd274102dc0 2024-09-10T21:18:40.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.417+0000 7fd27eb21740 1 Processor -- start 2024-09-10T21:18:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.417+0000 7fd27eb21740 1 -- start start 2024-09-10T21:18:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.417+0000 7fd27eb21740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466480 0x562966466860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.418+0000 7fd27eb21740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966466da0 0x562966476c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.418+0000 7fd27eb21740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562966477140 0x562966479530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.418+0000 7fd27eb21740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5629663dce50 con 0x562966466480 2024-09-10T21:18:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.418+0000 7fd27eb21740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5629663cc280 con 0x562966477140 2024-09-10T21:18:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.418+0000 7fd27eb21740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5629663d0090 con 0x562966466da0 2024-09-10T21:18:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.418+0000 7fd27ace9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466480 0x562966466860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.418+0000 7fd27ace9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466480 0x562966466860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42118/0 (socket says 172.21.15.59:42118) 2024-09-10T21:18:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.418+0000 7fd27ace9640 1 -- 172.21.15.59:0/1968207126 learned_addr learned my addr 172.21.15.59:0/1968207126 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.418+0000 7fd27a4e8640 1 --2- 172.21.15.59:0/1968207126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966466da0 0x562966476c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.418+0000 7fd26b7fe640 1 --2- 172.21.15.59:0/2752324293 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2600b5360 0x7fd2600b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:40.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.418+0000 7fd279ce7640 1 --2- 172.21.15.59:0/1968207126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562966477140 0x562966479530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.418+0000 7fd27ace9640 1 -- 172.21.15.59:0/1968207126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966466da0 msgr2=0x562966476c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.418+0000 7fd27ace9640 1 --2- 172.21.15.59:0/1968207126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966466da0 0x562966476c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.418+0000 7fd27ace9640 1 -- 172.21.15.59:0/1968207126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562966477140 msgr2=0x562966479530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.418+0000 7fd27ace9640 1 --2- 172.21.15.59:0/1968207126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562966477140 0x562966479530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.418+0000 7fd27ace9640 1 -- 172.21.15.59:0/1968207126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296612a650 con 0x562966466480 2024-09-10T21:18:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.418+0000 7fd27ace9640 1 --2- 172.21.15.59:0/2752324293 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2600b5360 0x7fd2600b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.418+0000 7fd26b7fe640 1 -- 172.21.15.59:0/2752324293 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd2700e5750 con 0x7fd274102dc0 2024-09-10T21:18:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.418+0000 7fd27ace9640 1 --2- 172.21.15.59:0/1968207126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466480 0x562966466860 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd26c010450 tx=0x7fd26c010910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07942ea704dc76f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.419+0000 7fd268ff9640 1 -- 172.21.15.59:0/1968207126 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c01d400 con 0x562966466480 2024-09-10T21:18:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.419+0000 7fd268ff9640 1 -- 172.21.15.59:0/1968207126 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd26c0134c0 con 0x562966466480 2024-09-10T21:18:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.419+0000 7fd268ff9640 1 -- 172.21.15.59:0/1968207126 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c011740 con 0x562966466480 2024-09-10T21:18:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.419+0000 7fd27eb21740 1 -- 172.21.15.59:0/1968207126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466480 msgr2=0x562966466860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:40.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.419+0000 7fd27ace9640 1 --2- 172.21.15.59:0/2752324293 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2600b5360 0x7fd2600b7820 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd26c021000 tx=0x7fd26c01e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.419+0000 7fd27eb21740 1 --2- 172.21.15.59:0/1968207126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466480 0x562966466860 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd26c010450 tx=0x7fd26c010910 comp rx=0 tx=0).stop 2024-09-10T21:18:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.419+0000 7fd27eb21740 1 -- 172.21.15.59:0/1968207126 shutdown_connections 2024-09-10T21:18:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.419+0000 7fd27eb21740 1 --2- 172.21.15.59:0/1968207126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562966477140 0x562966479530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.419+0000 7fd27eb21740 1 --2- 172.21.15.59:0/1968207126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966466da0 0x562966476c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.419+0000 7fd27eb21740 1 --2- 172.21.15.59:0/1968207126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466480 0x562966466860 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.419+0000 7fd27eb21740 1 -- 172.21.15.59:0/1968207126 >> 172.21.15.59:0/1968207126 conn(0x5629664642b0 msgr2=0x562966465450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.419+0000 7fd27eb21740 1 -- 172.21.15.59:0/1968207126 shutdown_connections 2024-09-10T21:18:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.419+0000 7fd27eb21740 1 -- 172.21.15.59:0/1968207126 wait complete. 2024-09-10T21:18:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.420+0000 7fd27eb21740 1 -- start start 2024-09-10T21:18:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.420+0000 7fd27eb21740 1 Processor -- start 2024-09-10T21:18:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.420+0000 7fd27eb21740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966466480 0x562966476990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.420+0000 7fd27eb21740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466da0 0x562966473de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.420+0000 7fd27eb21740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562966477140 0x562966474340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:40.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.420+0000 7fd27eb21740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56296622d700 con 0x562966466da0 2024-09-10T21:18:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.420+0000 7fd27eb21740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562966367110 con 0x562966477140 2024-09-10T21:18:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.420+0000 7fd27eb21740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562966479df0 con 0x562966466480 2024-09-10T21:18:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.420+0000 7fd27eb21740 10 client.0 _ll_register_callbacks cb 0x562966380990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.420+0000 7fd279ce7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466da0 0x562966473de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.420+0000 7fd279ce7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466da0 0x562966473de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42128/0 (socket says 172.21.15.59:42128) 2024-09-10T21:18:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.420+0000 7fd279ce7640 1 -- 172.21.15.59:0/4246352220 learned_addr learned my addr 172.21.15.59:0/4246352220 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.420+0000 7fd27a4e8640 1 --2- 172.21.15.59:0/4246352220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966466480 0x562966476990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.421+0000 7fd279ce7640 1 -- 172.21.15.59:0/4246352220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966466480 msgr2=0x562966476990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.421+0000 7fd279ce7640 1 --2- 172.21.15.59:0/4246352220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966466480 0x562966476990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.421+0000 7fd279ce7640 1 -- 172.21.15.59:0/4246352220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562966477140 msgr2=0x562966474340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.421+0000 7fd279ce7640 1 --2- 172.21.15.59:0/4246352220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562966477140 0x562966474340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.421+0000 7fd279ce7640 1 -- 172.21.15.59:0/4246352220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562966394c40 con 0x562966466da0 2024-09-10T21:18:40.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.421+0000 7fd279ce7640 1 --2- 172.21.15.59:0/4246352220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466da0 0x562966473de0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd264009900 tx=0x7fd264031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13abe50ca623ffe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:40.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.421+0000 7fd25dffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:40.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.421+0000 7fd25dffb640 1 -- 172.21.15.59:0/4246352220 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd264035070 con 0x562966466da0 2024-09-10T21:18:40.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.421+0000 7fd25dffb640 1 -- 172.21.15.59:0/4246352220 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd264004240 con 0x562966466da0 2024-09-10T21:18:40.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.421+0000 7fd27eb21740 1 -- 172.21.15.59:0/4246352220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd26c0134c0 con 0x562966466da0 2024-09-10T21:18:40.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.421+0000 7fd25dffb640 1 -- 172.21.15.59:0/4246352220 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd264004440 con 0x562966466da0 2024-09-10T21:18:40.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.421+0000 7fd27eb21740 10 client.16122 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:40.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.421+0000 7fd27eb21740 1 -- 172.21.15.59:0/4246352220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5629664856b0 con 0x562966466da0 2024-09-10T21:18:40.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.421+0000 7fd25dffb640 1 -- 172.21.15.59:0/4246352220 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd26c0134c0 con 0x562966466da0 2024-09-10T21:18:40.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.421+0000 7fd25dffb640 1 -- 172.21.15.59:0/4246352220 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd264004b10 con 0x562966466da0 2024-09-10T21:18:40.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.422+0000 7fd27eb21740 10 client.16122 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:40.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.422+0000 7fd27eb21740 10 client.16122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:18:40.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.422+0000 7fd27eb21740 20 client.16122 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.422+0000 7fd27eb21740 1 --2- 172.21.15.59:0/4246352220 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562966486c10 0x562966489040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.422+0000 7fd27eb21740 4 client.16122 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:18:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.422+0000 7fd27eb21740 1 -- 172.21.15.59:0/4246352220 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629663deda0 con 0x562966486c10 2024-09-10T21:18:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.422+0000 7fd27a4e8640 1 --2- 172.21.15.59:0/4246352220 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562966486c10 0x562966489040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.422+0000 7fd25dffb640 10 client.16122 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.422+0000 7fd27a4e8640 1 --2- 172.21.15.59:0/4246352220 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562966486c10 0x562966489040 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5ad36b82715c753 server_cookie=558d061ee4e70050 in_seq=0 out_seq=0 2024-09-10T21:18:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.423+0000 7fd25dffb640 1 -- 172.21.15.59:0/4246352220 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5629663deda0 con 0x562966486c10 2024-09-10T21:18:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.423+0000 7fd25dffb640 10 client.16122 handle_command_reply: tid=0 2024-09-10T21:18:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.423+0000 7fd27eb21740 1 client.16122 shutdown 2024-09-10T21:18:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.423+0000 7fd27eb21740 1 -- 172.21.15.59:0/4246352220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466da0 msgr2=0x562966473de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.423+0000 7fd27eb21740 1 --2- 172.21.15.59:0/4246352220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466da0 0x562966473de0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd264009900 tx=0x7fd264031740 comp rx=0 tx=0).stop 2024-09-10T21:18:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.423+0000 7fd27eb21740 1 -- 172.21.15.59:0/4246352220 shutdown_connections 2024-09-10T21:18:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.423+0000 7fd27eb21740 1 --2- 172.21.15.59:0/4246352220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562966477140 0x562966474340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.423+0000 7fd27eb21740 1 --2- 172.21.15.59:0/4246352220 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562966486c10 0x562966489040 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.423+0000 7fd27eb21740 1 --2- 172.21.15.59:0/4246352220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466da0 0x562966473de0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.423+0000 7fd25dffb640 0 client.16122 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:40.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.423+0000 7fd27eb21740 1 --2- 172.21.15.59:0/4246352220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966466480 0x562966476990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.423+0000 7fd27eb21740 1 -- 172.21.15.59:0/4246352220 >> 172.21.15.59:0/4246352220 conn(0x5629664642b0 msgr2=0x562966469e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:40.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.423+0000 7fd27eb21740 1 -- 172.21.15.59:0/4246352220 shutdown_connections 2024-09-10T21:18:40.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.423+0000 7fd27eb21740 1 -- 172.21.15.59:0/4246352220 wait complete. 2024-09-10T21:18:40.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.423+0000 7fd27eb21740 20 client.16122 trim_cache size 0 max 16384 2024-09-10T21:18:40.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.442+0000 7fd27eb21740 1 Processor -- start 2024-09-10T21:18:40.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.442+0000 7fd27eb21740 1 -- start start 2024-09-10T21:18:40.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.442+0000 7fd27eb21740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562966466480 0x56296648e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:40.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.442+0000 7fd27eb21740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966466da0 0x56296648ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:40.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.442+0000 7fd27eb21740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966477140 0x562966472680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:40.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.442+0000 7fd27eb21740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd2741ac0c0 con 0x562966477140 2024-09-10T21:18:40.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.442+0000 7fd27eb21740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd2741adc00 con 0x562966466480 2024-09-10T21:18:40.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.442+0000 7fd27eb21740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd2741ac790 con 0x562966466da0 2024-09-10T21:18:40.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.442+0000 7fd27ace9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966477140 0x562966472680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:40.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.442+0000 7fd27ace9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966477140 0x562966472680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42134/0 (socket says 172.21.15.59:42134) 2024-09-10T21:18:40.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.442+0000 7fd27ace9640 1 -- 172.21.15.59:0/551923622 learned_addr learned my addr 172.21.15.59:0/551923622 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:40.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.442+0000 7fd279ce7640 1 --2- 172.21.15.59:0/551923622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966466da0 0x56296648ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:40.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.442+0000 7fd27a4e8640 1 --2- 172.21.15.59:0/551923622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562966466480 0x56296648e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:40.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.442+0000 7fd27ace9640 1 -- 172.21.15.59:0/551923622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966466da0 msgr2=0x56296648ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:40.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.442+0000 7fd27ace9640 1 --2- 172.21.15.59:0/551923622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966466da0 0x56296648ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.442+0000 7fd27ace9640 1 -- 172.21.15.59:0/551923622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562966466480 msgr2=0x56296648e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:40.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.442+0000 7fd27ace9640 1 --2- 172.21.15.59:0/551923622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562966466480 0x56296648e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.442+0000 7fd27ace9640 1 -- 172.21.15.59:0/551923622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296645f940 con 0x562966477140 2024-09-10T21:18:40.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.443+0000 7fd27ace9640 1 --2- 172.21.15.59:0/551923622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966477140 0x562966472680 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd26c010e10 tx=0x7fd26c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b816491e9df8f22 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:40.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.443+0000 7fd25ffff640 1 -- 172.21.15.59:0/551923622 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c0134c0 con 0x562966477140 2024-09-10T21:18:40.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.443+0000 7fd25ffff640 1 -- 172.21.15.59:0/551923622 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd26c004a00 con 0x562966477140 2024-09-10T21:18:40.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.443+0000 7fd25ffff640 1 -- 172.21.15.59:0/551923622 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c011cc0 con 0x562966477140 2024-09-10T21:18:40.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.444+0000 7fd27eb21740 1 -- 172.21.15.59:0/551923622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966477140 msgr2=0x562966472680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:40.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.444+0000 7fd27eb21740 1 --2- 172.21.15.59:0/551923622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966477140 0x562966472680 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fd26c010e10 tx=0x7fd26c009f90 comp rx=0 tx=0).stop 2024-09-10T21:18:40.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.444+0000 7fd27eb21740 1 -- 172.21.15.59:0/551923622 shutdown_connections 2024-09-10T21:18:40.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.444+0000 7fd27eb21740 1 --2- 172.21.15.59:0/551923622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966477140 0x562966472680 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.444+0000 7fd27eb21740 1 --2- 172.21.15.59:0/551923622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966466da0 0x56296648ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.444+0000 7fd27eb21740 1 --2- 172.21.15.59:0/551923622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562966466480 0x56296648e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.444+0000 7fd27eb21740 1 -- 172.21.15.59:0/551923622 >> 172.21.15.59:0/551923622 conn(0x5629664642b0 msgr2=0x562966478e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:40.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.444+0000 7fd27eb21740 1 -- 172.21.15.59:0/551923622 shutdown_connections 2024-09-10T21:18:40.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.444+0000 7fd27eb21740 1 -- 172.21.15.59:0/551923622 wait complete. 2024-09-10T21:18:40.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.444+0000 7fd27eb21740 1 -- start start 2024-09-10T21:18:40.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.444+0000 7fd27eb21740 1 Processor -- start 2024-09-10T21:18:40.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.444+0000 7fd27eb21740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466480 0x56296647f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:40.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.444+0000 7fd27eb21740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562966466da0 0x56296647f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:40.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.444+0000 7fd27eb21740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966477140 0x56296647c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:40.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.444+0000 7fd27eb21740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd2741ad530 con 0x562966466480 2024-09-10T21:18:40.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.444+0000 7fd27eb21740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd2741ace60 con 0x562966466da0 2024-09-10T21:18:40.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.444+0000 7fd27eb21740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd2741aa0a0 con 0x562966477140 2024-09-10T21:18:40.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.444+0000 7fd27eb21740 10 client.0 _ll_register_callbacks cb 0x7fd264009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:40.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.444+0000 7fd27a4e8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466480 0x56296647f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:40.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.445+0000 7fd27a4e8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466480 0x56296647f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42142/0 (socket says 172.21.15.59:42142) 2024-09-10T21:18:40.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.445+0000 7fd27a4e8640 1 -- 172.21.15.59:0/1485247273 learned_addr learned my addr 172.21.15.59:0/1485247273 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:40.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.445+0000 7fd27ace9640 1 --2- 172.21.15.59:0/1485247273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966477140 0x56296647c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:40.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.445+0000 7fd279ce7640 1 --2- 172.21.15.59:0/1485247273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562966466da0 0x56296647f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:40.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.445+0000 7fd27a4e8640 1 -- 172.21.15.59:0/1485247273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966477140 msgr2=0x56296647c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:40.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.445+0000 7fd27a4e8640 1 --2- 172.21.15.59:0/1485247273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966477140 0x56296647c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.445+0000 7fd27a4e8640 1 -- 172.21.15.59:0/1485247273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562966466da0 msgr2=0x56296647f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:40.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.445+0000 7fd27a4e8640 1 --2- 172.21.15.59:0/1485247273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562966466da0 0x56296647f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.445+0000 7fd27a4e8640 1 -- 172.21.15.59:0/1485247273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56296647c7c0 con 0x562966466480 2024-09-10T21:18:40.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.445+0000 7fd27a4e8640 1 --2- 172.21.15.59:0/1485247273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466480 0x56296647f290 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd2700abe70 tx=0x7fd270093040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f25c0685261867f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:40.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.445+0000 7fd25dffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:40.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.445+0000 7fd25dffb640 1 -- 172.21.15.59:0/1485247273 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270020040 con 0x562966466480 2024-09-10T21:18:40.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.445+0000 7fd25dffb640 1 -- 172.21.15.59:0/1485247273 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd270005130 con 0x562966466480 2024-09-10T21:18:40.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.445+0000 7fd27eb21740 1 -- 172.21.15.59:0/1485247273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd26c004a00 con 0x562966466480 2024-09-10T21:18:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.445+0000 7fd25dffb640 1 -- 172.21.15.59:0/1485247273 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd270005330 con 0x562966466480 2024-09-10T21:18:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.445+0000 7fd27eb21740 10 client.16128 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.445+0000 7fd27eb21740 1 -- 172.21.15.59:0/1485247273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5629664f45d0 con 0x562966466480 2024-09-10T21:18:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.446+0000 7fd25dffb640 1 -- 172.21.15.59:0/1485247273 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd26c004a00 con 0x562966466480 2024-09-10T21:18:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.446+0000 7fd25dffb640 1 -- 172.21.15.59:0/1485247273 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd2700970d0 con 0x562966466480 2024-09-10T21:18:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.446+0000 7fd27eb21740 10 client.16128 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.446+0000 7fd27eb21740 10 client.16128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:18:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.446+0000 7fd27eb21740 20 client.16128 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.446+0000 7fd27eb21740 1 --2- 172.21.15.59:0/1485247273 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5629664f4cf0 0x5629664f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.446+0000 7fd27eb21740 4 client.16128 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:18:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.446+0000 7fd27eb21740 1 -- 172.21.15.59:0/1485247273 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5629663da850 con 0x5629664f4cf0 2024-09-10T21:18:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.446+0000 7fd279ce7640 1 --2- 172.21.15.59:0/1485247273 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5629664f4cf0 0x5629664f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.447+0000 7fd25dffb640 10 client.16128 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:40.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.447+0000 7fd279ce7640 1 --2- 172.21.15.59:0/1485247273 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5629664f4cf0 0x5629664f70e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a4af89956e4c245 server_cookie=9ee3d9a1863d3d5b in_seq=0 out_seq=0 2024-09-10T21:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.447+0000 7fd25dffb640 1 -- 172.21.15.59:0/1485247273 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x5629663da850 con 0x5629664f4cf0 2024-09-10T21:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.447+0000 7fd25dffb640 10 client.16128 handle_command_reply: tid=0 2024-09-10T21:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.447+0000 7fd27eb21740 1 client.16128 shutdown 2024-09-10T21:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.447+0000 7fd27eb21740 1 -- 172.21.15.59:0/1485247273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466480 msgr2=0x56296647f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.447+0000 7fd27eb21740 1 --2- 172.21.15.59:0/1485247273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466480 0x56296647f290 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd2700abe70 tx=0x7fd270093040 comp rx=0 tx=0).stop 2024-09-10T21:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.447+0000 7fd27eb21740 1 -- 172.21.15.59:0/1485247273 shutdown_connections 2024-09-10T21:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.447+0000 7fd27eb21740 1 --2- 172.21.15.59:0/1485247273 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562966477140 0x56296647c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.447+0000 7fd27eb21740 1 --2- 172.21.15.59:0/1485247273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562966466da0 0x56296647f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.447+0000 7fd27eb21740 1 --2- 172.21.15.59:0/1485247273 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5629664f4cf0 0x5629664f70e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.447+0000 7fd27eb21740 1 --2- 172.21.15.59:0/1485247273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562966466480 0x56296647f290 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.447+0000 7fd25dffb640 0 client.16128 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.447+0000 7fd27eb21740 1 -- 172.21.15.59:0/1485247273 >> 172.21.15.59:0/1485247273 conn(0x5629664642b0 msgr2=0x562966475410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.447+0000 7fd27eb21740 1 -- 172.21.15.59:0/1485247273 shutdown_connections 2024-09-10T21:18:40.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.447+0000 7fd27eb21740 1 -- 172.21.15.59:0/1485247273 wait complete. 2024-09-10T21:18:40.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.447+0000 7fd27eb21740 20 client.16128 trim_cache size 0 max 16384 2024-09-10T21:18:40.462 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:18:40.462 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:18:40.462 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:18:40.462 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:18:40.462 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:18:40.462 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:18:40.462 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:40.462 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:18:40.463 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:18:40.463 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:18:40.463 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:18:40.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:18:40.463 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:18:40.463 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:18:40.463 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:40.463 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:18:40.463 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:18:40.463 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:18:40.463 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:18:40.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:18:40.463 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:18:40.463 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:18:40.463 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:40.464 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:18:40.464 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:18:40.464 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:18:40.464 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:18:40.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:18:40.464 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:18:40.464 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:18:40.464 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:40.464 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:18:40.464 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:18:40.464 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:18:40.464 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:18:40.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:18:40.464 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:18:40.465 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:18:40.465 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:40.465 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:18:40.465 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:18:40.465 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:18:40.465 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:18:40.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:18:40.465 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:18:40.465 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:18:40.465 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:40.465 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:18:40.465 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:18:40.465 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:18:40.465 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:18:40.466 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:18:40.466 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:18:40.466 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:18:40.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.448+0000 7fd27c74c640 1 -- 172.21.15.59:0/2752324293 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2600b5360 msgr2=0x7fd2600b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:40.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.448+0000 7fd27c74c640 1 --2- 172.21.15.59:0/2752324293 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2600b5360 0x7fd2600b7820 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd26c021000 tx=0x7fd26c01e000 comp rx=0 tx=0).stop 2024-09-10T21:18:40.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.448+0000 7fd27c74c640 1 -- 172.21.15.59:0/2752324293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd274102dc0 msgr2=0x7fd274199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:40.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.448+0000 7fd27c74c640 1 --2- 172.21.15.59:0/2752324293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd274102dc0 0x7fd274199340 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd27000d770 tx=0x7fd27000dc30 comp rx=0 tx=0).stop 2024-09-10T21:18:40.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.448+0000 7fd27c74c640 1 -- 172.21.15.59:0/2752324293 shutdown_connections 2024-09-10T21:18:40.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.448+0000 7fd27c74c640 1 --2- 172.21.15.59:0/2752324293 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2600b5360 0x7fd2600b7820 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.448+0000 7fd27c74c640 1 --2- 172.21.15.59:0/2752324293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd274109150 0x7fd27419ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.448+0000 7fd27c74c640 1 --2- 172.21.15.59:0/2752324293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2741087d0 0x7fd274199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.448+0000 7fd27c74c640 1 --2- 172.21.15.59:0/2752324293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd274102dc0 0x7fd274199340 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:40.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.448+0000 7fd27c74c640 1 -- 172.21.15.59:0/2752324293 >> 172.21.15.59:0/2752324293 conn(0x7fd2740fe830 msgr2=0x7fd274100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:40.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.448+0000 7fd27c74c640 1 -- 172.21.15.59:0/2752324293 shutdown_connections 2024-09-10T21:18:40.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:40.448+0000 7fd27c74c640 1 -- 172.21.15.59:0/2752324293 wait complete. 2024-09-10T21:18:41.311 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:40 smithi059 ceph-mon[30888]: pgmap v442: 97 pgs: 97 active+clean; 2.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:41.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:40 smithi192 ceph-mon[35363]: pgmap v442: 97 pgs: 97 active+clean; 2.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:41.344 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:18:41.345 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:18:41.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:40 smithi154 ceph-mon[35041]: pgmap v442: 97 pgs: 97 active+clean; 2.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:41.610 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:18:42.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.127+0000 7f88cb053640 1 -- 172.21.15.59:0/1202258864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c4104570 msgr2=0x7f88c410cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:42.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.127+0000 7f88cb053640 1 --2- 172.21.15.59:0/1202258864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c4104570 0x7f88c410cb50 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009900 tx=0x7f88ac02a410 comp rx=0 tx=0).stop 2024-09-10T21:18:42.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.127+0000 7f88cb053640 1 -- 172.21.15.59:0/1202258864 shutdown_connections 2024-09-10T21:18:42.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.127+0000 7f88cb053640 1 --2- 172.21.15.59:0/1202258864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88c410d120 0x7f88c410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:42.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.127+0000 7f88cb053640 1 --2- 172.21.15.59:0/1202258864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c4104570 0x7f88c410cb50 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:42.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.127+0000 7f88cb053640 1 --2- 172.21.15.59:0/1202258864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88c4103b70 0x7f88c4103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:42.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.127+0000 7f88cb053640 1 -- 172.21.15.59:0/1202258864 >> 172.21.15.59:0/1202258864 conn(0x7f88c40fd700 msgr2=0x7f88c40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:42.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.127+0000 7f88cb053640 1 -- 172.21.15.59:0/1202258864 shutdown_connections 2024-09-10T21:18:42.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.127+0000 7f88cb053640 1 -- 172.21.15.59:0/1202258864 wait complete. 2024-09-10T21:18:42.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.128+0000 7f88cb053640 1 Processor -- start 2024-09-10T21:18:42.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.128+0000 7f88cb053640 1 -- start start 2024-09-10T21:18:42.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.128+0000 7f88cb053640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88c4103b70 0x7f88c41019f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:42.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.128+0000 7f88cb053640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88c4104570 0x7f88c4101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:42.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.128+0000 7f88cb053640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c410d120 0x7f88c4102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:42.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.128+0000 7f88cb053640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f88c4112d60 con 0x7f88c410d120 2024-09-10T21:18:42.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.128+0000 7f88cb053640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f88c4112be0 con 0x7f88c4104570 2024-09-10T21:18:42.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.128+0000 7f88cb053640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f88c4112ee0 con 0x7f88c4103b70 2024-09-10T21:18:42.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.128+0000 7f88c95f0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c410d120 0x7f88c4102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:42.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.128+0000 7f88c95f0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c410d120 0x7f88c4102470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42154/0 (socket says 172.21.15.59:42154) 2024-09-10T21:18:42.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.128+0000 7f88c95f0640 1 -- 172.21.15.59:0/2110753290 learned_addr learned my addr 172.21.15.59:0/2110753290 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:42.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.128+0000 7f88c3fff640 1 --2- 172.21.15.59:0/2110753290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88c4104570 0x7f88c4101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:42.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.128+0000 7f88c8def640 1 --2- 172.21.15.59:0/2110753290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88c4103b70 0x7f88c41019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:42.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.128+0000 7f88c95f0640 1 -- 172.21.15.59:0/2110753290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88c4103b70 msgr2=0x7f88c41019f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:42.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.128+0000 7f88c95f0640 1 --2- 172.21.15.59:0/2110753290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88c4103b70 0x7f88c41019f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:42.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.128+0000 7f88c95f0640 1 -- 172.21.15.59:0/2110753290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88c4104570 msgr2=0x7f88c4101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:42.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.128+0000 7f88c95f0640 1 --2- 172.21.15.59:0/2110753290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88c4104570 0x7f88c4101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:42.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.128+0000 7f88c95f0640 1 -- 172.21.15.59:0/2110753290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c41a7690 con 0x7f88c410d120 2024-09-10T21:18:42.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.128+0000 7f88c8def640 1 --2- 172.21.15.59:0/2110753290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88c4103b70 0x7f88c41019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:42.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.129+0000 7f88c95f0640 1 --2- 172.21.15.59:0/2110753290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c410d120 0x7f88c4102470 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f88bc00cce0 tx=0x7f88bc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:42.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.129+0000 7f88c1ffb640 1 -- 172.21.15.59:0/2110753290 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc00f450 con 0x7f88c410d120 2024-09-10T21:18:42.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.129+0000 7f88c1ffb640 1 -- 172.21.15.59:0/2110753290 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88bc00faa0 con 0x7f88c410d120 2024-09-10T21:18:42.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.129+0000 7f88cb053640 1 -- 172.21.15.59:0/2110753290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c41a7980 con 0x7f88c410d120 2024-09-10T21:18:42.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.129+0000 7f88c1ffb640 1 -- 172.21.15.59:0/2110753290 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc018b70 con 0x7f88c410d120 2024-09-10T21:18:42.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.129+0000 7f88cb053640 1 -- 172.21.15.59:0/2110753290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c41a7e40 con 0x7f88c410d120 2024-09-10T21:18:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.130+0000 7f88cb053640 1 -- 172.21.15.59:0/2110753290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c4103f50 con 0x7f88c410d120 2024-09-10T21:18:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.131+0000 7f88c1ffb640 1 -- 172.21.15.59:0/2110753290 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f88bc00f5f0 con 0x7f88c410d120 2024-09-10T21:18:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.132+0000 7f88c1ffb640 1 --2- 172.21.15.59:0/2110753290 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f88b00b52e0 0x7f88b00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.132+0000 7f88c8def640 1 --2- 172.21.15.59:0/2110753290 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f88b00b52e0 0x7f88b00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.133+0000 7f88c1ffb640 1 -- 172.21.15.59:0/2110753290 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f88bc0e6320 con 0x7f88c410d120 2024-09-10T21:18:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.133+0000 7f88c8def640 1 --2- 172.21.15.59:0/2110753290 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f88b00b52e0 0x7f88b00b77a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f88b40058c0 tx=0x7f88b4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:42.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.137+0000 7f88c1ffb640 1 -- 172.21.15.59:0/2110753290 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f88bc014030 con 0x7f88c410d120 2024-09-10T21:18:42.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.359+0000 7f88cb053640 1 -- 172.21.15.59:0/2110753290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88c402e5c0 con 0x7f88c410d120 2024-09-10T21:18:42.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.360+0000 7f88c1ffb640 1 -- 172.21.15.59:0/2110753290 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f88bc0a8070 con 0x7f88c410d120 2024-09-10T21:18:42.364 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:18:42.364 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:18:42.364 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:18:42.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.362+0000 7f88cb053640 1 -- 172.21.15.59:0/2110753290 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f88b00b52e0 msgr2=0x7f88b00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:42.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.362+0000 7f88cb053640 1 --2- 172.21.15.59:0/2110753290 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f88b00b52e0 0x7f88b00b77a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f88b40058c0 tx=0x7f88b4005850 comp rx=0 tx=0).stop 2024-09-10T21:18:42.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.362+0000 7f88cb053640 1 -- 172.21.15.59:0/2110753290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c410d120 msgr2=0x7f88c4102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:42.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.362+0000 7f88cb053640 1 --2- 172.21.15.59:0/2110753290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c410d120 0x7f88c4102470 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f88bc00cce0 tx=0x7f88bc00a620 comp rx=0 tx=0).stop 2024-09-10T21:18:42.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.362+0000 7f88cb053640 1 -- 172.21.15.59:0/2110753290 shutdown_connections 2024-09-10T21:18:42.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.362+0000 7f88cb053640 1 --2- 172.21.15.59:0/2110753290 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f88b00b52e0 0x7f88b00b77a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:42.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.362+0000 7f88cb053640 1 --2- 172.21.15.59:0/2110753290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c410d120 0x7f88c4102470 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:42.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.362+0000 7f88cb053640 1 --2- 172.21.15.59:0/2110753290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f88c4104570 0x7f88c4101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:42.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.362+0000 7f88cb053640 1 --2- 172.21.15.59:0/2110753290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88c4103b70 0x7f88c41019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:42.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.362+0000 7f88cb053640 1 -- 172.21.15.59:0/2110753290 >> 172.21.15.59:0/2110753290 conn(0x7f88c40fd700 msgr2=0x7f88c40fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:42.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.362+0000 7f88cb053640 1 -- 172.21.15.59:0/2110753290 shutdown_connections 2024-09-10T21:18:42.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:42.362+0000 7f88cb053640 1 -- 172.21.15.59:0/2110753290 wait complete. 2024-09-10T21:18:43.036 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:18:43.298 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:18:43.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:42 smithi192 ceph-mon[35363]: pgmap v443: 97 pgs: 97 active+clean; 2.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:18:43.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:42 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2110753290' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:18:43.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:42 smithi059 ceph-mon[30888]: pgmap v443: 97 pgs: 97 active+clean; 2.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:18:43.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:42 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2110753290' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:18:43.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:42 smithi154 ceph-mon[35041]: pgmap v443: 97 pgs: 97 active+clean; 2.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:18:43.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:42 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2110753290' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:18:43.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.804+0000 7f26c51d8640 1 -- 172.21.15.59:0/449628073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26c0109150 msgr2=0x7f26c010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:43.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.804+0000 7f26c51d8640 1 --2- 172.21.15.59:0/449628073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26c0109150 0x7f26c010f950 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f26b8009ca0 tx=0x7f26b802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.804+0000 7f26c51d8640 1 -- 172.21.15.59:0/449628073 shutdown_connections 2024-09-10T21:18:43.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.804+0000 7f26c51d8640 1 --2- 172.21.15.59:0/449628073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26c0109150 0x7f26c010f950 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.804+0000 7f26c51d8640 1 --2- 172.21.15.59:0/449628073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26c01087d0 0x7f26c0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.804+0000 7f26c51d8640 1 --2- 172.21.15.59:0/449628073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26c0102dc0 0x7f26c01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.804+0000 7f26c51d8640 1 -- 172.21.15.59:0/449628073 >> 172.21.15.59:0/449628073 conn(0x7f26c00fe830 msgr2=0x7f26c0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:43.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.804+0000 7f26c51d8640 1 -- 172.21.15.59:0/449628073 shutdown_connections 2024-09-10T21:18:43.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.804+0000 7f26c51d8640 1 -- 172.21.15.59:0/449628073 wait complete. 2024-09-10T21:18:43.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.805+0000 7f26c51d8640 1 Processor -- start 2024-09-10T21:18:43.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.805+0000 7f26c51d8640 1 -- start start 2024-09-10T21:18:43.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.805+0000 7f26c51d8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26c0102dc0 0x7f26c01993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:43.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.805+0000 7f26c51d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26c01087d0 0x7f26c0199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:43.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.805+0000 7f26c51d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26c0109150 0x7f26c019eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.805+0000 7f26c51d8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f26c0112e50 con 0x7f26c0109150 2024-09-10T21:18:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.805+0000 7f26c51d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26c0112cd0 con 0x7f26c01087d0 2024-09-10T21:18:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.805+0000 7f26c51d8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f26c0112fd0 con 0x7f26c0102dc0 2024-09-10T21:18:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.805+0000 7f26bf59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26c0109150 0x7f26c019eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.805+0000 7f26bf59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26c0109150 0x7f26c019eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42172/0 (socket says 172.21.15.59:42172) 2024-09-10T21:18:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.805+0000 7f26bf59e640 1 -- 172.21.15.59:0/454174754 learned_addr learned my addr 172.21.15.59:0/454174754 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.805+0000 7f26bed9d640 1 --2- 172.21.15.59:0/454174754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26c0102dc0 0x7f26c01993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.805+0000 7f26be59c640 1 --2- 172.21.15.59:0/454174754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26c01087d0 0x7f26c0199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.805+0000 7f26bf59e640 1 -- 172.21.15.59:0/454174754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26c0102dc0 msgr2=0x7f26c01993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.805+0000 7f26bf59e640 1 --2- 172.21.15.59:0/454174754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26c0102dc0 0x7f26c01993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.805+0000 7f26bf59e640 1 -- 172.21.15.59:0/454174754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26c01087d0 msgr2=0x7f26c0199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.805+0000 7f26bf59e640 1 --2- 172.21.15.59:0/454174754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26c01087d0 0x7f26c0199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.806+0000 7f26bf59e640 1 -- 172.21.15.59:0/454174754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c019f470 con 0x7f26c0109150 2024-09-10T21:18:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.806+0000 7f26bed9d640 1 --2- 172.21.15.59:0/454174754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26c0102dc0 0x7f26c01993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.806+0000 7f26bf59e640 1 --2- 172.21.15.59:0/454174754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26c0109150 0x7f26c019eca0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f26b8005cc0 tx=0x7f26b802f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.806+0000 7f26a7fff640 1 -- 172.21.15.59:0/454174754 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b8003cf0 con 0x7f26c0109150 2024-09-10T21:18:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.806+0000 7f26a7fff640 1 -- 172.21.15.59:0/454174754 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26b80044f0 con 0x7f26c0109150 2024-09-10T21:18:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.806+0000 7f26c51d8640 1 -- 172.21.15.59:0/454174754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c019f700 con 0x7f26c0109150 2024-09-10T21:18:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.806+0000 7f26a7fff640 1 -- 172.21.15.59:0/454174754 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b802fd10 con 0x7f26c0109150 2024-09-10T21:18:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.806+0000 7f26c51d8640 1 -- 172.21.15.59:0/454174754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c01a5ea0 con 0x7f26c0109150 2024-09-10T21:18:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.809+0000 7f26c75ad740 1 Processor -- start 2024-09-10T21:18:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.809+0000 7f26a7fff640 1 -- 172.21.15.59:0/454174754 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f26b8004040 con 0x7f26c0109150 2024-09-10T21:18:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.809+0000 7f26c75ad740 1 -- start start 2024-09-10T21:18:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.809+0000 7f26c75ad740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48d64d0 0x5557c48d68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.809+0000 7f26c75ad740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d6df0 0x5557c48e2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.809+0000 7f26c75ad740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48e2d80 0x5557c48e5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.809+0000 7f26c75ad740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5557c484cea0 con 0x5557c48e2d80 2024-09-10T21:18:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.809+0000 7f26c75ad740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5557c483c2d0 con 0x5557c48d64d0 2024-09-10T21:18:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.809+0000 7f26c75ad740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5557c48400e0 con 0x5557c48d6df0 2024-09-10T21:18:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.809+0000 7f26be59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48e2d80 0x5557c48e5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.809+0000 7f26be59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48e2d80 0x5557c48e5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42182/0 (socket says 172.21.15.59:42182) 2024-09-10T21:18:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.809+0000 7f26be59c640 1 -- 172.21.15.59:0/113012172 learned_addr learned my addr 172.21.15.59:0/113012172 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.809+0000 7f26bed9d640 1 --2- 172.21.15.59:0/113012172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d6df0 0x5557c48e2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.809+0000 7f26be59c640 1 --2- 172.21.15.59:0/113012172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48d64d0 0x5557c48d68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.810+0000 7f26be59c640 1 -- 172.21.15.59:0/113012172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d6df0 msgr2=0x5557c48e2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.810+0000 7f26be59c640 1 --2- 172.21.15.59:0/113012172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d6df0 0x5557c48e2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.810+0000 7f26be59c640 1 -- 172.21.15.59:0/113012172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48d64d0 msgr2=0x5557c48d68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.810+0000 7f26be59c640 1 --2- 172.21.15.59:0/113012172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48d64d0 0x5557c48d68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.810+0000 7f26be59c640 1 -- 172.21.15.59:0/113012172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557c459a650 con 0x5557c48e2d80 2024-09-10T21:18:43.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.810+0000 7f26be59c640 1 --2- 172.21.15.59:0/113012172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48e2d80 0x5557c48e5170 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f26b400ae00 tx=0x7f26b400a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c44fdf459e7e19a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:43.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.810+0000 7f26a7fff640 1 --2- 172.21.15.59:0/454174754 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f26a80b52e0 0x7f26a80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:43.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.810+0000 7f26a57fa640 1 -- 172.21.15.59:0/113012172 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b401b070 con 0x5557c48e2d80 2024-09-10T21:18:43.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.810+0000 7f26bed9d640 1 --2- 172.21.15.59:0/454174754 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f26a80b52e0 0x7f26a80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:43.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.810+0000 7f26a57fa640 1 -- 172.21.15.59:0/113012172 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26b400fd70 con 0x5557c48e2d80 2024-09-10T21:18:43.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.810+0000 7f26a57fa640 1 -- 172.21.15.59:0/113012172 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4014650 con 0x5557c48e2d80 2024-09-10T21:18:43.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.810+0000 7f26a7fff640 1 -- 172.21.15.59:0/454174754 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f26b81072b0 con 0x7f26c0109150 2024-09-10T21:18:43.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.811+0000 7f26c75ad740 1 -- 172.21.15.59:0/113012172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48e2d80 msgr2=0x5557c48e5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:43.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.811+0000 7f26bed9d640 1 --2- 172.21.15.59:0/454174754 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f26a80b52e0 0x7f26a80b77a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x5557c48d51e0 tx=0x7f26b0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:43.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.811+0000 7f26c75ad740 1 --2- 172.21.15.59:0/113012172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48e2d80 0x5557c48e5170 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f26b400ae00 tx=0x7f26b400a490 comp rx=0 tx=0).stop 2024-09-10T21:18:43.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.811+0000 7f26c75ad740 1 -- 172.21.15.59:0/113012172 shutdown_connections 2024-09-10T21:18:43.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.811+0000 7f26c75ad740 1 --2- 172.21.15.59:0/113012172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48e2d80 0x5557c48e5170 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.811+0000 7f26c75ad740 1 --2- 172.21.15.59:0/113012172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d6df0 0x5557c48e2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.811+0000 7f26c75ad740 1 --2- 172.21.15.59:0/113012172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48d64d0 0x5557c48d68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.811+0000 7f26c75ad740 1 -- 172.21.15.59:0/113012172 >> 172.21.15.59:0/113012172 conn(0x5557c48d4300 msgr2=0x5557c48d54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:43.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.811+0000 7f26c75ad740 1 -- 172.21.15.59:0/113012172 shutdown_connections 2024-09-10T21:18:43.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.811+0000 7f26c75ad740 1 -- 172.21.15.59:0/113012172 wait complete. 2024-09-10T21:18:43.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.811+0000 7f26c75ad740 1 -- start start 2024-09-10T21:18:43.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26c75ad740 1 Processor -- start 2024-09-10T21:18:43.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26c75ad740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48d64d0 0x5557c48e2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:43.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26c75ad740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d6df0 0x5557c48dfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:43.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26c75ad740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48e2d80 0x5557c48e0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:43.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26c75ad740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5557c469d700 con 0x5557c48d64d0 2024-09-10T21:18:43.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26c75ad740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5557c47d7160 con 0x5557c48e2d80 2024-09-10T21:18:43.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26c75ad740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5557c48e5a00 con 0x5557c48d6df0 2024-09-10T21:18:43.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26c75ad740 10 client.0 _ll_register_callbacks cb 0x5557c47f09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:43.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26bed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48d64d0 0x5557c48e2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:43.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26bed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48d64d0 0x5557c48e2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42198/0 (socket says 172.21.15.59:42198) 2024-09-10T21:18:43.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26bed9d640 1 -- 172.21.15.59:0/2415510812 learned_addr learned my addr 172.21.15.59:0/2415510812 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:43.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26be59c640 1 --2- 172.21.15.59:0/2415510812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d6df0 0x5557c48dfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:43.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26bed9d640 1 -- 172.21.15.59:0/2415510812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d6df0 msgr2=0x5557c48dfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:43.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26bed9d640 1 --2- 172.21.15.59:0/2415510812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d6df0 0x5557c48dfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26bf59e640 1 --2- 172.21.15.59:0/2415510812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48e2d80 0x5557c48e0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:43.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26bed9d640 1 -- 172.21.15.59:0/2415510812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48e2d80 msgr2=0x5557c48e0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:43.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26bed9d640 1 --2- 172.21.15.59:0/2415510812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48e2d80 0x5557c48e0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26bed9d640 1 -- 172.21.15.59:0/2415510812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557c4804c90 con 0x5557c48d64d0 2024-09-10T21:18:43.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26be59c640 1 --2- 172.21.15.59:0/2415510812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d6df0 0x5557c48dfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:43.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.812+0000 7f26bf59e640 1 --2- 172.21.15.59:0/2415510812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48e2d80 0x5557c48e0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:43.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.813+0000 7f26bed9d640 1 --2- 172.21.15.59:0/2415510812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48d64d0 0x5557c48e2710 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f26b0007450 tx=0x7f26b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1735a8532d8c62 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:43.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.813+0000 7f26a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.813+0000 7f26a2ff5640 1 -- 172.21.15.59:0/2415510812 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b001c050 con 0x5557c48d64d0 2024-09-10T21:18:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.813+0000 7f26a2ff5640 1 -- 172.21.15.59:0/2415510812 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f26b0014b40 con 0x5557c48d64d0 2024-09-10T21:18:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.813+0000 7f26c75ad740 1 -- 172.21.15.59:0/2415510812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26b400fd70 con 0x5557c48d64d0 2024-09-10T21:18:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.813+0000 7f26a2ff5640 1 -- 172.21.15.59:0/2415510812 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f26b0014d40 con 0x5557c48d64d0 2024-09-10T21:18:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.813+0000 7f26c75ad740 10 client.16146 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.813+0000 7f26c75ad740 1 -- 172.21.15.59:0/2415510812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5557c48f1460 con 0x5557c48d64d0 2024-09-10T21:18:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.813+0000 7f26a2ff5640 1 -- 172.21.15.59:0/2415510812 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26b400fd70 con 0x5557c48d64d0 2024-09-10T21:18:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.813+0000 7f26a2ff5640 1 -- 172.21.15.59:0/2415510812 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f26b0006510 con 0x5557c48d64d0 2024-09-10T21:18:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.813+0000 7f26c75ad740 10 client.16146 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.813+0000 7f26c75ad740 10 client.16146 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:18:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.813+0000 7f26c75ad740 20 client.16146 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.813+0000 7f26c75ad740 1 --2- 172.21.15.59:0/2415510812 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5557c48f29c0 0x5557c48f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.813+0000 7f26c75ad740 4 client.16146 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:18:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.813+0000 7f26c75ad740 1 -- 172.21.15.59:0/2415510812 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557c484edf0 con 0x5557c48f29c0 2024-09-10T21:18:43.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.814+0000 7f26be59c640 1 --2- 172.21.15.59:0/2415510812 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5557c48f29c0 0x5557c48f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:43.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.814+0000 7f26be59c640 1 --2- 172.21.15.59:0/2415510812 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5557c48f29c0 0x5557c48f4e20 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7762edbd22423256 server_cookie=984f0efffb89bdc6 in_seq=0 out_seq=0 2024-09-10T21:18:43.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.814+0000 7f26a2ff5640 10 client.16146 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:18:43.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.815+0000 7f26a2ff5640 1 -- 172.21.15.59:0/2415510812 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5557c484edf0 con 0x5557c48f29c0 2024-09-10T21:18:43.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.815+0000 7f26a2ff5640 10 client.16146 handle_command_reply: tid=0 2024-09-10T21:18:43.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.815+0000 7f26c75ad740 1 client.16146 shutdown 2024-09-10T21:18:43.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.815+0000 7f26c75ad740 1 -- 172.21.15.59:0/2415510812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48d64d0 msgr2=0x5557c48e2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:43.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.815+0000 7f26c75ad740 1 --2- 172.21.15.59:0/2415510812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48d64d0 0x5557c48e2710 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f26b0007450 tx=0x7f26b00046c0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.815+0000 7f26c75ad740 1 -- 172.21.15.59:0/2415510812 shutdown_connections 2024-09-10T21:18:43.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.815+0000 7f26c75ad740 1 --2- 172.21.15.59:0/2415510812 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5557c48f29c0 0x5557c48f4e20 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.815+0000 7f26c75ad740 1 --2- 172.21.15.59:0/2415510812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48e2d80 0x5557c48e0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.815+0000 7f26c75ad740 1 --2- 172.21.15.59:0/2415510812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d6df0 0x5557c48dfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.815+0000 7f26a2ff5640 0 client.16146 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:18:43.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.815+0000 7f26c75ad740 1 --2- 172.21.15.59:0/2415510812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48d64d0 0x5557c48e2710 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.815+0000 7f26c75ad740 1 -- 172.21.15.59:0/2415510812 >> 172.21.15.59:0/2415510812 conn(0x5557c48d4300 msgr2=0x5557c48d9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:43.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.815+0000 7f26c75ad740 1 -- 172.21.15.59:0/2415510812 shutdown_connections 2024-09-10T21:18:43.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.815+0000 7f26c75ad740 1 -- 172.21.15.59:0/2415510812 wait complete. 2024-09-10T21:18:43.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.815+0000 7f26c75ad740 20 client.16146 trim_cache size 0 max 16384 2024-09-10T21:18:43.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.828+0000 7f26c75ad740 1 Processor -- start 2024-09-10T21:18:43.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.829+0000 7f26c75ad740 1 -- start start 2024-09-10T21:18:43.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.829+0000 7f26c75ad740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d64d0 0x5557c48eec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:43.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.829+0000 7f26c75ad740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48d6df0 0x5557c48cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:43.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.829+0000 7f26c75ad740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48e2d80 0x5557c48e18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:43.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.829+0000 7f26c75ad740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f26c01ae400 con 0x5557c48d6df0 2024-09-10T21:18:43.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.829+0000 7f26c75ad740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26c01aff40 con 0x5557c48e2d80 2024-09-10T21:18:43.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.829+0000 7f26c75ad740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f26c01aead0 con 0x5557c48d64d0 2024-09-10T21:18:43.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.829+0000 7f26be59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48d6df0 0x5557c48cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:43.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.829+0000 7f26be59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48d6df0 0x5557c48cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42212/0 (socket says 172.21.15.59:42212) 2024-09-10T21:18:43.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.829+0000 7f26be59c640 1 -- 172.21.15.59:0/3840499255 learned_addr learned my addr 172.21.15.59:0/3840499255 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:43.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.829+0000 7f26bf59e640 1 --2- 172.21.15.59:0/3840499255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48e2d80 0x5557c48e18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:43.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.829+0000 7f26be59c640 1 -- 172.21.15.59:0/3840499255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d64d0 msgr2=0x5557c48eec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:43.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.829+0000 7f26be59c640 1 --2- 172.21.15.59:0/3840499255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d64d0 0x5557c48eec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.829+0000 7f26be59c640 1 -- 172.21.15.59:0/3840499255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48e2d80 msgr2=0x5557c48e18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:43.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.829+0000 7f26be59c640 1 --2- 172.21.15.59:0/3840499255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48e2d80 0x5557c48e18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.829+0000 7f26be59c640 1 -- 172.21.15.59:0/3840499255 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557c48f54a0 con 0x5557c48d6df0 2024-09-10T21:18:43.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.829+0000 7f26bf59e640 1 --2- 172.21.15.59:0/3840499255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48e2d80 0x5557c48e18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:43.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.829+0000 7f26be59c640 1 --2- 172.21.15.59:0/3840499255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48d6df0 0x5557c48cf320 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f26b400fa40 tx=0x7f26b4006a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd378d735f784b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:43.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.830+0000 7f26a4ff9640 1 -- 172.21.15.59:0/3840499255 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b402d020 con 0x5557c48d6df0 2024-09-10T21:18:43.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.830+0000 7f26a4ff9640 1 -- 172.21.15.59:0/3840499255 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26b401c040 con 0x5557c48d6df0 2024-09-10T21:18:43.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.830+0000 7f26a4ff9640 1 -- 172.21.15.59:0/3840499255 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b401b040 con 0x5557c48d6df0 2024-09-10T21:18:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.830+0000 7f26c75ad740 1 -- 172.21.15.59:0/3840499255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48d6df0 msgr2=0x5557c48cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.830+0000 7f26c75ad740 1 --2- 172.21.15.59:0/3840499255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48d6df0 0x5557c48cf320 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f26b400fa40 tx=0x7f26b4006a30 comp rx=0 tx=0).stop 2024-09-10T21:18:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.830+0000 7f26c75ad740 1 -- 172.21.15.59:0/3840499255 shutdown_connections 2024-09-10T21:18:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.830+0000 7f26c75ad740 1 --2- 172.21.15.59:0/3840499255 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48e2d80 0x5557c48e18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.830+0000 7f26c75ad740 1 --2- 172.21.15.59:0/3840499255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48d6df0 0x5557c48cf320 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.830+0000 7f26c75ad740 1 --2- 172.21.15.59:0/3840499255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d64d0 0x5557c48eec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.830+0000 7f26c75ad740 1 -- 172.21.15.59:0/3840499255 >> 172.21.15.59:0/3840499255 conn(0x5557c48d4300 msgr2=0x5557c48e1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.830+0000 7f26c75ad740 1 -- 172.21.15.59:0/3840499255 shutdown_connections 2024-09-10T21:18:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.830+0000 7f26c75ad740 1 -- 172.21.15.59:0/3840499255 wait complete. 2024-09-10T21:18:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.831+0000 7f26c75ad740 1 -- start start 2024-09-10T21:18:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.831+0000 7f26c75ad740 1 Processor -- start 2024-09-10T21:18:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.831+0000 7f26c75ad740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d64d0 0x5557c48eacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.831+0000 7f26c75ad740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48d6df0 0x5557c48eb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.831+0000 7f26c75ad740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48e2d80 0x5557c48e5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.831+0000 7f26c75ad740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f26c01af870 con 0x5557c48e2d80 2024-09-10T21:18:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.831+0000 7f26c75ad740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f26c01af1a0 con 0x5557c48d6df0 2024-09-10T21:18:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.831+0000 7f26c75ad740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f26c01ac3e0 con 0x5557c48d64d0 2024-09-10T21:18:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.831+0000 7f26c75ad740 10 client.0 _ll_register_callbacks cb 0x7f26b00077c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.831+0000 7f26bf59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48e2d80 0x5557c48e5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.831+0000 7f26bf59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48e2d80 0x5557c48e5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42220/0 (socket says 172.21.15.59:42220) 2024-09-10T21:18:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.831+0000 7f26bf59e640 1 -- 172.21.15.59:0/2059349838 learned_addr learned my addr 172.21.15.59:0/2059349838 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.831+0000 7f26be59c640 1 --2- 172.21.15.59:0/2059349838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48d6df0 0x5557c48eb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26bed9d640 1 --2- 172.21.15.59:0/2059349838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d64d0 0x5557c48eacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26bf59e640 1 -- 172.21.15.59:0/2059349838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d64d0 msgr2=0x5557c48eacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26bf59e640 1 --2- 172.21.15.59:0/2059349838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d64d0 0x5557c48eacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26bf59e640 1 -- 172.21.15.59:0/2059349838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48d6df0 msgr2=0x5557c48eb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26bf59e640 1 --2- 172.21.15.59:0/2059349838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48d6df0 0x5557c48eb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26bf59e640 1 -- 172.21.15.59:0/2059349838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557c48eb9a0 con 0x5557c48e2d80 2024-09-10T21:18:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26bed9d640 1 --2- 172.21.15.59:0/2059349838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d64d0 0x5557c48eacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26bf59e640 1 --2- 172.21.15.59:0/2059349838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48e2d80 0x5557c48e5c80 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f26b80cd7a0 tx=0x7f26b80cd930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb5293ab6777a21 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26a2ff5640 1 -- 172.21.15.59:0/2059349838 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b802feb0 con 0x5557c48e2d80 2024-09-10T21:18:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26a2ff5640 1 -- 172.21.15.59:0/2059349838 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f26b80d6ba0 con 0x5557c48e2d80 2024-09-10T21:18:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26c75ad740 1 -- 172.21.15.59:0/2059349838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26b401c040 con 0x5557c48e2d80 2024-09-10T21:18:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26a2ff5640 1 -- 172.21.15.59:0/2059349838 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f26b80098d0 con 0x5557c48e2d80 2024-09-10T21:18:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26c75ad740 10 client.16152 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26c75ad740 1 -- 172.21.15.59:0/2059349838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5557c495fee0 con 0x5557c48e2d80 2024-09-10T21:18:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26a2ff5640 1 -- 172.21.15.59:0/2059349838 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26b401c040 con 0x5557c48e2d80 2024-09-10T21:18:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26a2ff5640 1 -- 172.21.15.59:0/2059349838 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f26b8004b40 con 0x5557c48e2d80 2024-09-10T21:18:43.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26c75ad740 10 client.16152 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:43.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26c75ad740 10 client.16152 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:18:43.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26c75ad740 20 client.16152 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:43.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.832+0000 7f26c75ad740 1 --2- 172.21.15.59:0/2059349838 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5557c4960660 0x5557c4962a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:43.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.833+0000 7f26c75ad740 4 client.16152 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:18:43.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.833+0000 7f26c75ad740 1 -- 172.21.15.59:0/2059349838 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5557c484a8a0 con 0x5557c4960660 2024-09-10T21:18:43.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.833+0000 7f26bed9d640 1 --2- 172.21.15.59:0/2059349838 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5557c4960660 0x5557c4962a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:43.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.833+0000 7f26bed9d640 1 --2- 172.21.15.59:0/2059349838 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5557c4960660 0x5557c4962a80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9c723b012d393ef4 server_cookie=b7b06de961410b9b in_seq=0 out_seq=0 2024-09-10T21:18:43.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.833+0000 7f26a2ff5640 10 client.16152 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:18:43.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.833+0000 7f26a2ff5640 1 -- 172.21.15.59:0/2059349838 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5557c484a8a0 con 0x5557c4960660 2024-09-10T21:18:43.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26a2ff5640 10 client.16152 handle_command_reply: tid=0 2024-09-10T21:18:43.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c75ad740 1 client.16152 shutdown 2024-09-10T21:18:43.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c75ad740 1 -- 172.21.15.59:0/2059349838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48e2d80 msgr2=0x5557c48e5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:43.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c75ad740 1 --2- 172.21.15.59:0/2059349838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48e2d80 0x5557c48e5c80 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f26b80cd7a0 tx=0x7f26b80cd930 comp rx=0 tx=0).stop 2024-09-10T21:18:43.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c75ad740 1 -- 172.21.15.59:0/2059349838 shutdown_connections 2024-09-10T21:18:43.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c75ad740 1 --2- 172.21.15.59:0/2059349838 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5557c4960660 0x5557c4962a80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c75ad740 1 --2- 172.21.15.59:0/2059349838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5557c48e2d80 0x5557c48e5c80 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c75ad740 1 --2- 172.21.15.59:0/2059349838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5557c48d6df0 0x5557c48eb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26a2ff5640 0 client.16152 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:18:43.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c75ad740 1 --2- 172.21.15.59:0/2059349838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5557c48d64d0 0x5557c48eacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c75ad740 1 -- 172.21.15.59:0/2059349838 >> 172.21.15.59:0/2059349838 conn(0x5557c48d4300 msgr2=0x5557c48e19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:43.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c75ad740 1 -- 172.21.15.59:0/2059349838 shutdown_connections 2024-09-10T21:18:43.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c75ad740 1 -- 172.21.15.59:0/2059349838 wait complete. 2024-09-10T21:18:43.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c75ad740 20 client.16152 trim_cache size 0 max 16384 2024-09-10T21:18:43.844 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:18:43.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c51d8640 1 -- 172.21.15.59:0/454174754 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f26a80b52e0 msgr2=0x7f26a80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:43.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c51d8640 1 --2- 172.21.15.59:0/454174754 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f26a80b52e0 0x7f26a80b77a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x5557c48d51e0 tx=0x7f26b0008040 comp rx=0 tx=0).stop 2024-09-10T21:18:43.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c51d8640 1 -- 172.21.15.59:0/454174754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26c0109150 msgr2=0x7f26c019eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:43.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c51d8640 1 --2- 172.21.15.59:0/454174754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26c0109150 0x7f26c019eca0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f26b8005cc0 tx=0x7f26b802f470 comp rx=0 tx=0).stop 2024-09-10T21:18:43.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c51d8640 1 -- 172.21.15.59:0/454174754 shutdown_connections 2024-09-10T21:18:43.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c51d8640 1 --2- 172.21.15.59:0/454174754 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f26a80b52e0 0x7f26a80b77a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c51d8640 1 --2- 172.21.15.59:0/454174754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26c0109150 0x7f26c019eca0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c51d8640 1 --2- 172.21.15.59:0/454174754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26c01087d0 0x7f26c0199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c51d8640 1 --2- 172.21.15.59:0/454174754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26c0102dc0 0x7f26c01993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:43.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.834+0000 7f26c51d8640 1 -- 172.21.15.59:0/454174754 >> 172.21.15.59:0/454174754 conn(0x7f26c00fe830 msgr2=0x7f26c0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:43.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.835+0000 7f26c51d8640 1 -- 172.21.15.59:0/454174754 shutdown_connections 2024-09-10T21:18:43.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:43.835+0000 7f26c51d8640 1 -- 172.21.15.59:0/454174754 wait complete. 2024-09-10T21:18:44.729 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:18:44.993 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:18:45.282 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:44 smithi059 ceph-mon[30888]: pgmap v444: 97 pgs: 97 active+clean; 2.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:45.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:44 smithi192 ceph-mon[35363]: pgmap v444: 97 pgs: 97 active+clean; 2.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:45.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:44 smithi154 ceph-mon[35041]: pgmap v444: 97 pgs: 97 active+clean; 2.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.528+0000 7ff4f41f8640 1 -- 172.21.15.59:0/1085289772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4ec104600 msgr2=0x7ff4ec10caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.528+0000 7ff4f41f8640 1 --2- 172.21.15.59:0/1085289772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4ec104600 0x7ff4ec10caf0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009900 tx=0x7ff4dc02a410 comp rx=0 tx=0).stop 2024-09-10T21:18:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.528+0000 7ff4f41f8640 1 -- 172.21.15.59:0/1085289772 shutdown_connections 2024-09-10T21:18:45.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.528+0000 7ff4f41f8640 1 --2- 172.21.15.59:0/1085289772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4ec10d140 0x7ff4ec10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.528+0000 7ff4f41f8640 1 --2- 172.21.15.59:0/1085289772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4ec104600 0x7ff4ec10caf0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.528+0000 7ff4f41f8640 1 --2- 172.21.15.59:0/1085289772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4ec103ce0 0x7ff4ec1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.528+0000 7ff4f41f8640 1 -- 172.21.15.59:0/1085289772 >> 172.21.15.59:0/1085289772 conn(0x7ff4ec0fd700 msgr2=0x7ff4ec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.528+0000 7ff4f41f8640 1 -- 172.21.15.59:0/1085289772 shutdown_connections 2024-09-10T21:18:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.528+0000 7ff4f41f8640 1 -- 172.21.15.59:0/1085289772 wait complete. 2024-09-10T21:18:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.529+0000 7ff4f41f8640 1 Processor -- start 2024-09-10T21:18:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.529+0000 7ff4f41f8640 1 -- start start 2024-09-10T21:18:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.529+0000 7ff4f41f8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4ec103ce0 0x7ff4ec101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.529+0000 7ff4f41f8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4ec104600 0x7ff4ec101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.529+0000 7ff4f41f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4ec10d140 0x7ff4ec102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.529+0000 7ff4f41f8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec112db0 con 0x7ff4ec103ce0 2024-09-10T21:18:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.529+0000 7ff4f41f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec112c30 con 0x7ff4ec10d140 2024-09-10T21:18:45.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.529+0000 7ff4f41f8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec112f30 con 0x7ff4ec104600 2024-09-10T21:18:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.529+0000 7ff4f1f94640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4ec103ce0 0x7ff4ec101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.529+0000 7ff4f1f94640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4ec103ce0 0x7ff4ec101990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42236/0 (socket says 172.21.15.59:42236) 2024-09-10T21:18:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.529+0000 7ff4f1f94640 1 -- 172.21.15.59:0/2199377511 learned_addr learned my addr 172.21.15.59:0/2199377511 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.529+0000 7ff4f1793640 1 --2- 172.21.15.59:0/2199377511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4ec104600 0x7ff4ec101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.530+0000 7ff4f2795640 1 --2- 172.21.15.59:0/2199377511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4ec10d140 0x7ff4ec102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.530+0000 7ff4f1f94640 1 -- 172.21.15.59:0/2199377511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4ec104600 msgr2=0x7ff4ec101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.530+0000 7ff4f1f94640 1 --2- 172.21.15.59:0/2199377511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4ec104600 0x7ff4ec101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.530+0000 7ff4f1f94640 1 -- 172.21.15.59:0/2199377511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4ec10d140 msgr2=0x7ff4ec102410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.530+0000 7ff4f1f94640 1 --2- 172.21.15.59:0/2199377511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4ec10d140 0x7ff4ec102410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.530+0000 7ff4f1f94640 1 -- 172.21.15.59:0/2199377511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec1a7720 con 0x7ff4ec103ce0 2024-09-10T21:18:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.530+0000 7ff4f1f94640 1 --2- 172.21.15.59:0/2199377511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4ec103ce0 0x7ff4ec101990 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800d950 tx=0x7ff4e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.530+0000 7ff4e2ffd640 1 -- 172.21.15.59:0/2199377511 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8017030 con 0x7ff4ec103ce0 2024-09-10T21:18:45.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.530+0000 7ff4e2ffd640 1 -- 172.21.15.59:0/2199377511 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4e8004020 con 0x7ff4ec103ce0 2024-09-10T21:18:45.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.530+0000 7ff4f41f8640 1 -- 172.21.15.59:0/2199377511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4ec1a7a10 con 0x7ff4ec103ce0 2024-09-10T21:18:45.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.530+0000 7ff4e2ffd640 1 -- 172.21.15.59:0/2199377511 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80047a0 con 0x7ff4ec103ce0 2024-09-10T21:18:45.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.530+0000 7ff4f41f8640 1 -- 172.21.15.59:0/2199377511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4ec1a7f70 con 0x7ff4ec103ce0 2024-09-10T21:18:45.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.533+0000 7ff4e2ffd640 1 -- 172.21.15.59:0/2199377511 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7ff4e8009a30 con 0x7ff4ec103ce0 2024-09-10T21:18:45.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.533+0000 7ff4f65cd740 1 Processor -- start 2024-09-10T21:18:45.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.533+0000 7ff4f65cd740 1 -- start start 2024-09-10T21:18:45.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.533+0000 7ff4f65cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf84d0 0x55bc89bf88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:45.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.533+0000 7ff4f65cd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc89bf8df0 0x55bc89c04840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:45.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.533+0000 7ff4f65cd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89c04d80 0x55bc89c07170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:45.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.533+0000 7ff4f65cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bc89b6eea0 con 0x55bc89bf84d0 2024-09-10T21:18:45.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.533+0000 7ff4f65cd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bc89b5e2d0 con 0x55bc89c04d80 2024-09-10T21:18:45.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.533+0000 7ff4f65cd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55bc89b620e0 con 0x55bc89bf8df0 2024-09-10T21:18:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.533+0000 7ff4f2795640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf84d0 0x55bc89bf88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.533+0000 7ff4f2795640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf84d0 0x55bc89bf88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42252/0 (socket says 172.21.15.59:42252) 2024-09-10T21:18:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.533+0000 7ff4f1f94640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc89bf8df0 0x55bc89c04840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.533+0000 7ff4f2795640 1 -- 172.21.15.59:0/340780953 learned_addr learned my addr 172.21.15.59:0/340780953 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.534+0000 7ff4f1793640 1 --2- 172.21.15.59:0/340780953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89c04d80 0x55bc89c07170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.534+0000 7ff4f2795640 1 -- 172.21.15.59:0/340780953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc89bf8df0 msgr2=0x55bc89c04840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.534+0000 7ff4f2795640 1 --2- 172.21.15.59:0/340780953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc89bf8df0 0x55bc89c04840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.534+0000 7ff4f2795640 1 -- 172.21.15.59:0/340780953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89c04d80 msgr2=0x55bc89c07170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.534+0000 7ff4f2795640 1 --2- 172.21.15.59:0/340780953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89c04d80 0x55bc89c07170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.534+0000 7ff4f2795640 1 -- 172.21.15.59:0/340780953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc898bc650 con 0x55bc89bf84d0 2024-09-10T21:18:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.534+0000 7ff4e2ffd640 1 --2- 172.21.15.59:0/2199377511 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff4d80b5360 0x7ff4d80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.534+0000 7ff4f2795640 1 --2- 172.21.15.59:0/340780953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf84d0 0x55bc89bf88b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009d30 tx=0x7ff4e400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d072a36cec1e06 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.534+0000 7ff4f1f94640 1 --2- 172.21.15.59:0/2199377511 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff4d80b5360 0x7ff4d80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.534+0000 7ff4d7fff640 1 -- 172.21.15.59:0/340780953 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4004d20 con 0x55bc89bf84d0 2024-09-10T21:18:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.534+0000 7ff4d7fff640 1 -- 172.21.15.59:0/340780953 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4e4009e20 con 0x55bc89bf84d0 2024-09-10T21:18:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.534+0000 7ff4d7fff640 1 -- 172.21.15.59:0/340780953 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4011730 con 0x55bc89bf84d0 2024-09-10T21:18:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.534+0000 7ff4e2ffd640 1 -- 172.21.15.59:0/2199377511 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff4e80e5600 con 0x7ff4ec103ce0 2024-09-10T21:18:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.535+0000 7ff4f65cd740 1 -- 172.21.15.59:0/340780953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf84d0 msgr2=0x55bc89bf88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.535+0000 7ff4f1f94640 1 --2- 172.21.15.59:0/2199377511 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff4d80b5360 0x7ff4d80b7820 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80e34a0 tx=0x7ff4e80eb550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.535+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/340780953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf84d0 0x55bc89bf88b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009d30 tx=0x7ff4e400f730 comp rx=0 tx=0).stop 2024-09-10T21:18:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.535+0000 7ff4f65cd740 1 -- 172.21.15.59:0/340780953 shutdown_connections 2024-09-10T21:18:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.535+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/340780953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89c04d80 0x55bc89c07170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.535+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/340780953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc89bf8df0 0x55bc89c04840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.535+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/340780953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf84d0 0x55bc89bf88b0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.535+0000 7ff4f65cd740 1 -- 172.21.15.59:0/340780953 >> 172.21.15.59:0/340780953 conn(0x55bc89bf6300 msgr2=0x55bc89bf74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.535+0000 7ff4f65cd740 1 -- 172.21.15.59:0/340780953 shutdown_connections 2024-09-10T21:18:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.535+0000 7ff4f65cd740 1 -- 172.21.15.59:0/340780953 wait complete. 2024-09-10T21:18:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.535+0000 7ff4f65cd740 1 -- start start 2024-09-10T21:18:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.535+0000 7ff4f65cd740 1 Processor -- start 2024-09-10T21:18:45.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.536+0000 7ff4f65cd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89bf84d0 0x55bc89c046b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:45.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.536+0000 7ff4f65cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 0x55bc89c01b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:45.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.536+0000 7ff4f65cd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc89c04d80 0x55bc89c02180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:45.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.536+0000 7ff4f65cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bc899bf700 con 0x55bc89bf8df0 2024-09-10T21:18:45.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.536+0000 7ff4f65cd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bc89af9160 con 0x55bc89bf84d0 2024-09-10T21:18:45.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.536+0000 7ff4f65cd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55bc89c07a00 con 0x55bc89c04d80 2024-09-10T21:18:45.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.536+0000 7ff4f65cd740 10 client.0 _ll_register_callbacks cb 0x55bc89b129e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:45.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.536+0000 7ff4f1793640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 0x55bc89c01b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:45.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.536+0000 7ff4f1793640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 0x55bc89c01b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42260/0 (socket says 172.21.15.59:42260) 2024-09-10T21:18:45.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.536+0000 7ff4f1793640 1 -- 172.21.15.59:0/501313430 learned_addr learned my addr 172.21.15.59:0/501313430 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:45.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.536+0000 7ff4f2795640 1 --2- 172.21.15.59:0/501313430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89bf84d0 0x55bc89c046b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:45.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.536+0000 7ff4f2795640 1 --2- 172.21.15.59:0/501313430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc89c04d80 0x55bc89c02180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:45.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.536+0000 7ff4f1793640 1 -- 172.21.15.59:0/501313430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc89c04d80 msgr2=0x55bc89c02180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.536+0000 7ff4f1793640 1 --2- 172.21.15.59:0/501313430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc89c04d80 0x55bc89c02180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.536+0000 7ff4f1793640 1 -- 172.21.15.59:0/501313430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89bf84d0 msgr2=0x55bc89c046b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.536+0000 7ff4f1793640 1 --2- 172.21.15.59:0/501313430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89bf84d0 0x55bc89c046b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.536+0000 7ff4f1793640 1 -- 172.21.15.59:0/501313430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc89b26c90 con 0x55bc89bf8df0 2024-09-10T21:18:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.536+0000 7ff4f2795640 1 --2- 172.21.15.59:0/501313430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89bf84d0 0x55bc89c046b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.537+0000 7ff4f1793640 1 --2- 172.21.15.59:0/501313430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 0x55bc89c01b00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009900 tx=0x7ff4dc032f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c60f88d135579a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.537+0000 7ff4d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.537+0000 7ff4d57fa640 1 -- 172.21.15.59:0/501313430 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc035040 con 0x55bc89bf8df0 2024-09-10T21:18:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.537+0000 7ff4d57fa640 1 -- 172.21.15.59:0/501313430 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff4dc031720 con 0x55bc89bf8df0 2024-09-10T21:18:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.537+0000 7ff4f65cd740 1 -- 172.21.15.59:0/501313430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4e4009e20 con 0x55bc89bf8df0 2024-09-10T21:18:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.537+0000 7ff4d57fa640 1 -- 172.21.15.59:0/501313430 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff4dc04c070 con 0x55bc89bf8df0 2024-09-10T21:18:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.537+0000 7ff4f65cd740 10 client.16164 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.537+0000 7ff4f65cd740 1 -- 172.21.15.59:0/501313430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bc89c13370 con 0x55bc89bf8df0 2024-09-10T21:18:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.537+0000 7ff4d57fa640 1 -- 172.21.15.59:0/501313430 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4e4009e20 con 0x55bc89bf8df0 2024-09-10T21:18:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.537+0000 7ff4d57fa640 1 -- 172.21.15.59:0/501313430 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff4dc004750 con 0x55bc89bf8df0 2024-09-10T21:18:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.537+0000 7ff4f65cd740 10 client.16164 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.537+0000 7ff4f65cd740 10 client.16164 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:18:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.537+0000 7ff4f65cd740 20 client.16164 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.537+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/501313430 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55bc89c14830 0x55bc89c16c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.537+0000 7ff4f65cd740 4 client.16164 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:18:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.537+0000 7ff4f65cd740 1 -- 172.21.15.59:0/501313430 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc89b70df0 con 0x55bc89c14830 2024-09-10T21:18:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.538+0000 7ff4f2795640 1 --2- 172.21.15.59:0/501313430 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55bc89c14830 0x55bc89c16c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.538+0000 7ff4d57fa640 10 client.16164 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:18:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.538+0000 7ff4f2795640 1 --2- 172.21.15.59:0/501313430 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55bc89c14830 0x55bc89c16c60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=674a4340dbe32456 server_cookie=4a2c4ce21c273202 in_seq=0 out_seq=0 2024-09-10T21:18:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.539+0000 7ff4d57fa640 1 -- 172.21.15.59:0/501313430 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bc89b70df0 con 0x55bc89c14830 2024-09-10T21:18:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.539+0000 7ff4d57fa640 10 client.16164 handle_command_reply: tid=0 2024-09-10T21:18:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.539+0000 7ff4f65cd740 1 client.16164 shutdown 2024-09-10T21:18:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.539+0000 7ff4f65cd740 1 -- 172.21.15.59:0/501313430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 msgr2=0x55bc89c01b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.539+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/501313430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 0x55bc89c01b00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009900 tx=0x7ff4dc032f00 comp rx=0 tx=0).stop 2024-09-10T21:18:45.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.539+0000 7ff4f65cd740 1 -- 172.21.15.59:0/501313430 shutdown_connections 2024-09-10T21:18:45.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.539+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/501313430 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55bc89c14830 0x55bc89c16c60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.539+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/501313430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc89c04d80 0x55bc89c02180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.539+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/501313430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 0x55bc89c01b00 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.539+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/501313430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89bf84d0 0x55bc89c046b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.539+0000 7ff4d57fa640 0 client.16164 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:18:45.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.539+0000 7ff4f65cd740 1 -- 172.21.15.59:0/501313430 >> 172.21.15.59:0/501313430 conn(0x55bc89bf6300 msgr2=0x55bc89bfbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:45.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.539+0000 7ff4f65cd740 1 -- 172.21.15.59:0/501313430 shutdown_connections 2024-09-10T21:18:45.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.539+0000 7ff4f65cd740 1 -- 172.21.15.59:0/501313430 wait complete. 2024-09-10T21:18:45.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.539+0000 7ff4f65cd740 20 client.16164 trim_cache size 0 max 16384 2024-09-10T21:18:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.552+0000 7ff4f65cd740 1 Processor -- start 2024-09-10T21:18:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.553+0000 7ff4f65cd740 1 -- start start 2024-09-10T21:18:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.553+0000 7ff4f65cd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89bf84d0 0x55bc89c10c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.553+0000 7ff4f65cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 0x55bc89c00ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.553+0000 7ff4f65cd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc89c04d80 0x55bc89c00380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.553+0000 7ff4f65cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec1b05e0 con 0x55bc89bf8df0 2024-09-10T21:18:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.553+0000 7ff4f65cd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec1b2120 con 0x55bc89bf84d0 2024-09-10T21:18:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.553+0000 7ff4f65cd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec1b0cb0 con 0x55bc89c04d80 2024-09-10T21:18:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.553+0000 7ff4f1793640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 0x55bc89c00ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.553+0000 7ff4f1793640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 0x55bc89c00ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42268/0 (socket says 172.21.15.59:42268) 2024-09-10T21:18:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.553+0000 7ff4f1793640 1 -- 172.21.15.59:0/2137603800 learned_addr learned my addr 172.21.15.59:0/2137603800 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.553+0000 7ff4f2795640 1 --2- 172.21.15.59:0/2137603800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89bf84d0 0x55bc89c10c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.553+0000 7ff4f2795640 1 --2- 172.21.15.59:0/2137603800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc89c04d80 0x55bc89c00380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.553+0000 7ff4f1793640 1 -- 172.21.15.59:0/2137603800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc89c04d80 msgr2=0x55bc89c00380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.553+0000 7ff4f1793640 1 --2- 172.21.15.59:0/2137603800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc89c04d80 0x55bc89c00380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.553+0000 7ff4f1793640 1 -- 172.21.15.59:0/2137603800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89bf84d0 msgr2=0x55bc89c10c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.553+0000 7ff4f1793640 1 --2- 172.21.15.59:0/2137603800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89bf84d0 0x55bc89c10c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.553+0000 7ff4f1793640 1 -- 172.21.15.59:0/2137603800 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc89bf6fe0 con 0x55bc89bf8df0 2024-09-10T21:18:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.553+0000 7ff4f1793640 1 --2- 172.21.15.59:0/2137603800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 0x55bc89c00ff0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc004ba0 tx=0x7ff4dc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94977688f572c290 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.553+0000 7ff4d77fe640 1 -- 172.21.15.59:0/2137603800 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc035030 con 0x55bc89bf8df0 2024-09-10T21:18:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.554+0000 7ff4d77fe640 1 -- 172.21.15.59:0/2137603800 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4dc005240 con 0x55bc89bf8df0 2024-09-10T21:18:45.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.554+0000 7ff4d77fe640 1 -- 172.21.15.59:0/2137603800 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc032640 con 0x55bc89bf8df0 2024-09-10T21:18:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.554+0000 7ff4f65cd740 1 -- 172.21.15.59:0/2137603800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 msgr2=0x55bc89c00ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.554+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/2137603800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 0x55bc89c00ff0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc004ba0 tx=0x7ff4dc02a410 comp rx=0 tx=0).stop 2024-09-10T21:18:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.554+0000 7ff4f65cd740 1 -- 172.21.15.59:0/2137603800 shutdown_connections 2024-09-10T21:18:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.554+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/2137603800 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc89c04d80 0x55bc89c00380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.554+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/2137603800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 0x55bc89c00ff0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.554+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/2137603800 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89bf84d0 0x55bc89c10c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.554+0000 7ff4f65cd740 1 -- 172.21.15.59:0/2137603800 >> 172.21.15.59:0/2137603800 conn(0x55bc89bf6300 msgr2=0x55bc89bfcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.554+0000 7ff4f65cd740 1 -- 172.21.15.59:0/2137603800 shutdown_connections 2024-09-10T21:18:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.554+0000 7ff4f65cd740 1 -- 172.21.15.59:0/2137603800 wait complete. 2024-09-10T21:18:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.555+0000 7ff4f65cd740 1 -- start start 2024-09-10T21:18:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.555+0000 7ff4f65cd740 1 Processor -- start 2024-09-10T21:18:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.555+0000 7ff4f65cd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89bf84d0 0x55bc89c0cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.555+0000 7ff4f65cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 0x55bc89c0d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.555+0000 7ff4f65cd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc89c04d80 0x55bc89c07c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.555+0000 7ff4f65cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec1b1a50 con 0x55bc89bf8df0 2024-09-10T21:18:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.555+0000 7ff4f65cd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec1b1380 con 0x55bc89bf84d0 2024-09-10T21:18:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.555+0000 7ff4f65cd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec1ae5c0 con 0x55bc89c04d80 2024-09-10T21:18:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.555+0000 7ff4f65cd740 10 client.0 _ll_register_callbacks cb 0x7ff4dc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.555+0000 7ff4f1793640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 0x55bc89c0d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.555+0000 7ff4f1793640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 0x55bc89c0d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42272/0 (socket says 172.21.15.59:42272) 2024-09-10T21:18:45.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.555+0000 7ff4f1793640 1 -- 172.21.15.59:0/1626743348 learned_addr learned my addr 172.21.15.59:0/1626743348 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:45.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.555+0000 7ff4f2795640 1 --2- 172.21.15.59:0/1626743348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89bf84d0 0x55bc89c0cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:45.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.555+0000 7ff4f1793640 1 -- 172.21.15.59:0/1626743348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc89c04d80 msgr2=0x55bc89c07c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:45.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.555+0000 7ff4f1793640 1 --2- 172.21.15.59:0/1626743348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc89c04d80 0x55bc89c07c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.555+0000 7ff4f1793640 1 -- 172.21.15.59:0/1626743348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89bf84d0 msgr2=0x55bc89c0cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:45.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.555+0000 7ff4f1793640 1 --2- 172.21.15.59:0/1626743348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89bf84d0 0x55bc89c0cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.556+0000 7ff4f1793640 1 -- 172.21.15.59:0/1626743348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc89c08190 con 0x55bc89bf8df0 2024-09-10T21:18:45.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.556+0000 7ff4f1793640 1 --2- 172.21.15.59:0/1626743348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 0x55bc89c0d1e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc006010 tx=0x7ff4dc005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171c59c5b0229e98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:45.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.556+0000 7ff4d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:45.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.556+0000 7ff4d57fa640 1 -- 172.21.15.59:0/1626743348 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc05d070 con 0x55bc89bf8df0 2024-09-10T21:18:45.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.556+0000 7ff4d57fa640 1 -- 172.21.15.59:0/1626743348 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff4dc004f90 con 0x55bc89bf8df0 2024-09-10T21:18:45.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.556+0000 7ff4f65cd740 1 -- 172.21.15.59:0/1626743348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4dc005240 con 0x55bc89bf8df0 2024-09-10T21:18:45.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.556+0000 7ff4d57fa640 1 -- 172.21.15.59:0/1626743348 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff4dc035030 con 0x55bc89bf8df0 2024-09-10T21:18:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.556+0000 7ff4f65cd740 10 client.16170 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.556+0000 7ff4f65cd740 1 -- 172.21.15.59:0/1626743348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bc89c81e90 con 0x55bc89bf8df0 2024-09-10T21:18:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.556+0000 7ff4d57fa640 1 -- 172.21.15.59:0/1626743348 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4dc005240 con 0x55bc89bf8df0 2024-09-10T21:18:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.556+0000 7ff4d57fa640 1 -- 172.21.15.59:0/1626743348 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff4dc060020 con 0x55bc89bf8df0 2024-09-10T21:18:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.556+0000 7ff4f65cd740 10 client.16170 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.557+0000 7ff4f65cd740 10 client.16170 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:18:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.557+0000 7ff4f65cd740 20 client.16170 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.557+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/1626743348 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55bc89c824f0 0x55bc89c848e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.557+0000 7ff4f65cd740 4 client.16170 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:18:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.557+0000 7ff4f65cd740 1 -- 172.21.15.59:0/1626743348 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bc89b6c8a0 con 0x55bc89c824f0 2024-09-10T21:18:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.557+0000 7ff4f2795640 1 --2- 172.21.15.59:0/1626743348 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55bc89c824f0 0x55bc89c848e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:45.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.557+0000 7ff4f2795640 1 --2- 172.21.15.59:0/1626743348 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55bc89c824f0 0x55bc89c848e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3614f1e359d61109 server_cookie=d23e066803387a35 in_seq=0 out_seq=0 2024-09-10T21:18:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.557+0000 7ff4d57fa640 10 client.16170 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:18:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.557+0000 7ff4d57fa640 1 -- 172.21.15.59:0/1626743348 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bc89b6c8a0 con 0x55bc89c824f0 2024-09-10T21:18:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.557+0000 7ff4d57fa640 10 client.16170 handle_command_reply: tid=0 2024-09-10T21:18:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.557+0000 7ff4f65cd740 1 client.16170 shutdown 2024-09-10T21:18:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f65cd740 1 -- 172.21.15.59:0/1626743348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 msgr2=0x55bc89c0d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/1626743348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 0x55bc89c0d1e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc006010 tx=0x7ff4dc005990 comp rx=0 tx=0).stop 2024-09-10T21:18:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f65cd740 1 -- 172.21.15.59:0/1626743348 shutdown_connections 2024-09-10T21:18:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/1626743348 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55bc89c824f0 0x55bc89c848e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/1626743348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc89c04d80 0x55bc89c07c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/1626743348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc89bf8df0 0x55bc89c0d1e0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4d57fa640 0 client.16170 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:18:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f65cd740 1 --2- 172.21.15.59:0/1626743348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc89bf84d0 0x55bc89c0cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f65cd740 1 -- 172.21.15.59:0/1626743348 >> 172.21.15.59:0/1626743348 conn(0x55bc89bf6300 msgr2=0x55bc89c00310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:45.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f65cd740 1 -- 172.21.15.59:0/1626743348 shutdown_connections 2024-09-10T21:18:45.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f65cd740 1 -- 172.21.15.59:0/1626743348 wait complete. 2024-09-10T21:18:45.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f65cd740 20 client.16170 trim_cache size 0 max 16384 2024-09-10T21:18:45.567 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:18:45.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f41f8640 1 -- 172.21.15.59:0/2199377511 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff4d80b5360 msgr2=0x7ff4d80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:45.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f41f8640 1 --2- 172.21.15.59:0/2199377511 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff4d80b5360 0x7ff4d80b7820 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80e34a0 tx=0x7ff4e80eb550 comp rx=0 tx=0).stop 2024-09-10T21:18:45.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f41f8640 1 -- 172.21.15.59:0/2199377511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4ec103ce0 msgr2=0x7ff4ec101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:45.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f41f8640 1 --2- 172.21.15.59:0/2199377511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4ec103ce0 0x7ff4ec101990 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800d950 tx=0x7ff4e800de10 comp rx=0 tx=0).stop 2024-09-10T21:18:45.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f41f8640 1 -- 172.21.15.59:0/2199377511 shutdown_connections 2024-09-10T21:18:45.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f41f8640 1 --2- 172.21.15.59:0/2199377511 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff4d80b5360 0x7ff4d80b7820 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f41f8640 1 --2- 172.21.15.59:0/2199377511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4ec10d140 0x7ff4ec102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f41f8640 1 --2- 172.21.15.59:0/2199377511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4ec104600 0x7ff4ec101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f41f8640 1 --2- 172.21.15.59:0/2199377511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4ec103ce0 0x7ff4ec101990 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:45.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.558+0000 7ff4f41f8640 1 -- 172.21.15.59:0/2199377511 >> 172.21.15.59:0/2199377511 conn(0x7ff4ec0fd700 msgr2=0x7ff4ec0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:45.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.559+0000 7ff4f41f8640 1 -- 172.21.15.59:0/2199377511 shutdown_connections 2024-09-10T21:18:45.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:45.559+0000 7ff4f41f8640 1 -- 172.21.15.59:0/2199377511 wait complete. 2024-09-10T21:18:46.369 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:18:46.631 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:18:47.066 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:46 smithi059 ceph-mon[30888]: pgmap v445: 97 pgs: 97 active+clean; 2.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:18:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.146+0000 7f89a9420640 1 -- 172.21.15.59:0/449564757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a41087d0 msgr2=0x7f89a4108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.146+0000 7f89a9420640 1 --2- 172.21.15.59:0/449564757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a41087d0 0x7f89a4108c10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f898c009900 tx=0x7f898c02a410 comp rx=0 tx=0).stop 2024-09-10T21:18:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.146+0000 7f89a9420640 1 -- 172.21.15.59:0/449564757 shutdown_connections 2024-09-10T21:18:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.146+0000 7f89a9420640 1 --2- 172.21.15.59:0/449564757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89a4109150 0x7f89a410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.146+0000 7f89a9420640 1 --2- 172.21.15.59:0/449564757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a41087d0 0x7f89a4108c10 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.146+0000 7f89a9420640 1 --2- 172.21.15.59:0/449564757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89a4102dc0 0x7f89a41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.146+0000 7f89a9420640 1 -- 172.21.15.59:0/449564757 >> 172.21.15.59:0/449564757 conn(0x7f89a40fe830 msgr2=0x7f89a4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.146+0000 7f89a9420640 1 -- 172.21.15.59:0/449564757 shutdown_connections 2024-09-10T21:18:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.146+0000 7f89a9420640 1 -- 172.21.15.59:0/449564757 wait complete. 2024-09-10T21:18:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.146+0000 7f89a9420640 1 Processor -- start 2024-09-10T21:18:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.147+0000 7f89a9420640 1 -- start start 2024-09-10T21:18:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.147+0000 7f89a9420640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89a4102dc0 0x7f89a4199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.147+0000 7f89a9420640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a41087d0 0x7f89a4199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.147+0000 7f89a9420640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89a4109150 0x7f89a419ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.147+0000 7f89a9420640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f89a4112e10 con 0x7f89a41087d0 2024-09-10T21:18:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.147+0000 7f89a9420640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f89a4112c90 con 0x7f89a4102dc0 2024-09-10T21:18:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.147+0000 7f89a9420640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f89a4112f90 con 0x7f89a4109150 2024-09-10T21:18:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.147+0000 7f899a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a41087d0 0x7f89a4199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.147+0000 7f899a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a41087d0 0x7f89a4199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42280/0 (socket says 172.21.15.59:42280) 2024-09-10T21:18:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.147+0000 7f899a7fc640 1 -- 172.21.15.59:0/3278960339 learned_addr learned my addr 172.21.15.59:0/3278960339 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.147+0000 7f89a2ffd640 1 --2- 172.21.15.59:0/3278960339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89a4102dc0 0x7f89a4199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.147+0000 7f89a37fe640 1 --2- 172.21.15.59:0/3278960339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89a4109150 0x7f89a419ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.147+0000 7f899a7fc640 1 -- 172.21.15.59:0/3278960339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89a4109150 msgr2=0x7f89a419ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.147+0000 7f899a7fc640 1 --2- 172.21.15.59:0/3278960339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89a4109150 0x7f89a419ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.147+0000 7f899a7fc640 1 -- 172.21.15.59:0/3278960339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89a4102dc0 msgr2=0x7f89a4199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.147+0000 7f899a7fc640 1 --2- 172.21.15.59:0/3278960339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89a4102dc0 0x7f89a4199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.147+0000 7f899a7fc640 1 -- 172.21.15.59:0/3278960339 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a419f3d0 con 0x7f89a41087d0 2024-09-10T21:18:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.147+0000 7f89a37fe640 1 --2- 172.21.15.59:0/3278960339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89a4109150 0x7f89a419ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.148+0000 7f89a2ffd640 1 --2- 172.21.15.59:0/3278960339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89a4102dc0 0x7f89a4199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.148+0000 7f899a7fc640 1 --2- 172.21.15.59:0/3278960339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a41087d0 0x7f89a4199860 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f898c005940 tx=0x7f898c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.148+0000 7f89a0ff9640 1 -- 172.21.15.59:0/3278960339 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c03f030 con 0x7f89a41087d0 2024-09-10T21:18:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.148+0000 7f89a0ff9640 1 -- 172.21.15.59:0/3278960339 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f898c003cb0 con 0x7f89a41087d0 2024-09-10T21:18:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.148+0000 7f89a9420640 1 -- 172.21.15.59:0/3278960339 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a419f660 con 0x7f89a41087d0 2024-09-10T21:18:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.148+0000 7f89a0ff9640 1 -- 172.21.15.59:0/3278960339 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c035070 con 0x7f89a41087d0 2024-09-10T21:18:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.148+0000 7f89a9420640 1 -- 172.21.15.59:0/3278960339 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a41a5d80 con 0x7f89a41087d0 2024-09-10T21:18:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.151+0000 7f89ab7f5740 1 Processor -- start 2024-09-10T21:18:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.151+0000 7f89ab7f5740 1 -- start start 2024-09-10T21:18:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.151+0000 7f89ab7f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba864d0 0x5584cba868b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.151+0000 7f89ab7f5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba86df0 0x5584cba96c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.151+0000 7f89ab7f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba97190 0x5584cba99580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.151+0000 7f89ab7f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5584cb9fcea0 con 0x5584cba97190 2024-09-10T21:18:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.151+0000 7f89ab7f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5584cb9ec2d0 con 0x5584cba864d0 2024-09-10T21:18:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.151+0000 7f89ab7f5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5584cb9f00e0 con 0x5584cba86df0 2024-09-10T21:18:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.151+0000 7f89a0ff9640 1 -- 172.21.15.59:0/3278960339 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f898c03bbf0 con 0x7f89a41087d0 2024-09-10T21:18:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.152+0000 7f899a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba97190 0x5584cba99580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.152+0000 7f89a37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba864d0 0x5584cba868b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.152+0000 7f899a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba97190 0x5584cba99580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42296/0 (socket says 172.21.15.59:42296) 2024-09-10T21:18:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.152+0000 7f899a7fc640 1 -- 172.21.15.59:0/2874078196 learned_addr learned my addr 172.21.15.59:0/2874078196 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.152+0000 7f89a2ffd640 1 --2- 172.21.15.59:0/2874078196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba86df0 0x5584cba96c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.152+0000 7f899a7fc640 1 -- 172.21.15.59:0/2874078196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba86df0 msgr2=0x5584cba96c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.152+0000 7f899a7fc640 1 --2- 172.21.15.59:0/2874078196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba86df0 0x5584cba96c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.152+0000 7f899a7fc640 1 -- 172.21.15.59:0/2874078196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba864d0 msgr2=0x5584cba868b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.152+0000 7f899a7fc640 1 --2- 172.21.15.59:0/2874078196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba864d0 0x5584cba868b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.152+0000 7f899a7fc640 1 -- 172.21.15.59:0/2874078196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584cb74a650 con 0x5584cba97190 2024-09-10T21:18:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.152+0000 7f899a7fc640 1 --2- 172.21.15.59:0/2874078196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba97190 0x5584cba99580 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f898c10cc10 tx=0x7f898c10cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7c906eadf01f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.152+0000 7f89a0ff9640 1 --2- 172.21.15.59:0/3278960339 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f89900b5360 0x7f89900b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.152+0000 7f89997fa640 1 -- 172.21.15.59:0/2874078196 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c115070 con 0x5584cba97190 2024-09-10T21:18:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.153+0000 7f89997fa640 1 -- 172.21.15.59:0/2874078196 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f898c0cca90 con 0x5584cba97190 2024-09-10T21:18:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.153+0000 7f89997fa640 1 -- 172.21.15.59:0/2874078196 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c08e320 con 0x5584cba97190 2024-09-10T21:18:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.153+0000 7f89a37fe640 1 --2- 172.21.15.59:0/3278960339 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f89900b5360 0x7f89900b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.153+0000 7f89a0ff9640 1 -- 172.21.15.59:0/3278960339 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f898c106790 con 0x7f89a41087d0 2024-09-10T21:18:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.153+0000 7f89ab7f5740 1 -- 172.21.15.59:0/2874078196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba97190 msgr2=0x5584cba99580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.153+0000 7f89a37fe640 1 --2- 172.21.15.59:0/3278960339 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f89900b5360 0x7f89900b7820 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f899c00c610 tx=0x7f899c00e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.153+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/2874078196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba97190 0x5584cba99580 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f898c10cc10 tx=0x7f898c10cd00 comp rx=0 tx=0).stop 2024-09-10T21:18:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.154+0000 7f89ab7f5740 1 -- 172.21.15.59:0/2874078196 shutdown_connections 2024-09-10T21:18:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.154+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/2874078196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba97190 0x5584cba99580 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.154+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/2874078196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba86df0 0x5584cba96c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.154+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/2874078196 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba864d0 0x5584cba868b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.154+0000 7f89ab7f5740 1 -- 172.21.15.59:0/2874078196 >> 172.21.15.59:0/2874078196 conn(0x5584cba84300 msgr2=0x5584cba854a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.154+0000 7f89ab7f5740 1 -- 172.21.15.59:0/2874078196 shutdown_connections 2024-09-10T21:18:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.154+0000 7f89ab7f5740 1 -- 172.21.15.59:0/2874078196 wait complete. 2024-09-10T21:18:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.154+0000 7f89ab7f5740 1 -- start start 2024-09-10T21:18:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.154+0000 7f89ab7f5740 1 Processor -- start 2024-09-10T21:18:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.154+0000 7f89ab7f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba864d0 0x5584cba96970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.154+0000 7f89ab7f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 0x5584cba93dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.154+0000 7f89ab7f5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba97190 0x5584cba94300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.154+0000 7f89ab7f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5584cb84d700 con 0x5584cba86df0 2024-09-10T21:18:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.154+0000 7f89ab7f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5584cb987160 con 0x5584cba864d0 2024-09-10T21:18:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.154+0000 7f89ab7f5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5584cba99c00 con 0x5584cba97190 2024-09-10T21:18:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.154+0000 7f89ab7f5740 10 client.0 _ll_register_callbacks cb 0x5584cb9a09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.155+0000 7f899a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 0x5584cba93dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.155+0000 7f899a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 0x5584cba93dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42298/0 (socket says 172.21.15.59:42298) 2024-09-10T21:18:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.155+0000 7f899a7fc640 1 -- 172.21.15.59:0/2652219602 learned_addr learned my addr 172.21.15.59:0/2652219602 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.155+0000 7f89a2ffd640 1 --2- 172.21.15.59:0/2652219602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba864d0 0x5584cba96970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.155+0000 7f89a37fe640 1 --2- 172.21.15.59:0/2652219602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba97190 0x5584cba94300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.155+0000 7f899a7fc640 1 -- 172.21.15.59:0/2652219602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba97190 msgr2=0x5584cba94300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.155+0000 7f899a7fc640 1 --2- 172.21.15.59:0/2652219602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba97190 0x5584cba94300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.155+0000 7f899a7fc640 1 -- 172.21.15.59:0/2652219602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba864d0 msgr2=0x5584cba96970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.155+0000 7f899a7fc640 1 --2- 172.21.15.59:0/2652219602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba864d0 0x5584cba96970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.155+0000 7f899a7fc640 1 -- 172.21.15.59:0/2652219602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584cb9b4c90 con 0x5584cba86df0 2024-09-10T21:18:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.155+0000 7f899a7fc640 1 --2- 172.21.15.59:0/2652219602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 0x5584cba93dc0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f898c0ccc80 tx=0x7f898c03b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b5f12cb901d02e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.155+0000 7f898a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.155+0000 7f898a7fc640 1 -- 172.21.15.59:0/2652219602 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c0906b0 con 0x5584cba86df0 2024-09-10T21:18:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.155+0000 7f898a7fc640 1 -- 172.21.15.59:0/2652219602 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f898c08f100 con 0x5584cba86df0 2024-09-10T21:18:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.155+0000 7f89ab7f5740 1 -- 172.21.15.59:0/2652219602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f898c0cca90 con 0x5584cba86df0 2024-09-10T21:18:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.155+0000 7f898a7fc640 1 -- 172.21.15.59:0/2652219602 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f898c049030 con 0x5584cba86df0 2024-09-10T21:18:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.155+0000 7f89ab7f5740 10 client.16182 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.155+0000 7f89ab7f5740 1 -- 172.21.15.59:0/2652219602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5584cbaa53b0 con 0x5584cba86df0 2024-09-10T21:18:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.156+0000 7f898a7fc640 1 -- 172.21.15.59:0/2652219602 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f898c0cca90 con 0x5584cba86df0 2024-09-10T21:18:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.156+0000 7f898a7fc640 1 -- 172.21.15.59:0/2652219602 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f898c0c91f0 con 0x5584cba86df0 2024-09-10T21:18:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.156+0000 7f89ab7f5740 10 client.16182 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.156+0000 7f89ab7f5740 10 client.16182 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:18:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.156+0000 7f89ab7f5740 20 client.16182 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.156+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/2652219602 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5584cbaa6700 0x5584cbaa8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:47.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.156+0000 7f89ab7f5740 4 client.16182 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:18:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.156+0000 7f89ab7f5740 1 -- 172.21.15.59:0/2652219602 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584cb9fedf0 con 0x5584cbaa6700 2024-09-10T21:18:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.156+0000 7f89a2ffd640 1 --2- 172.21.15.59:0/2652219602 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5584cbaa6700 0x5584cbaa8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.157+0000 7f898a7fc640 10 client.16182 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:18:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.157+0000 7f89a2ffd640 1 --2- 172.21.15.59:0/2652219602 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5584cbaa6700 0x5584cbaa8af0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cc6d7a361d3257ca server_cookie=f353ffe0523ba420 in_seq=0 out_seq=0 2024-09-10T21:18:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.157+0000 7f898a7fc640 1 -- 172.21.15.59:0/2652219602 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5584cb9fedf0 con 0x5584cbaa6700 2024-09-10T21:18:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.157+0000 7f898a7fc640 10 client.16182 handle_command_reply: tid=0 2024-09-10T21:18:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.157+0000 7f89ab7f5740 1 client.16182 shutdown 2024-09-10T21:18:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.157+0000 7f89ab7f5740 1 -- 172.21.15.59:0/2652219602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 msgr2=0x5584cba93dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.157+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/2652219602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 0x5584cba93dc0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f898c0ccc80 tx=0x7f898c03b6b0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.157+0000 7f89ab7f5740 1 -- 172.21.15.59:0/2652219602 shutdown_connections 2024-09-10T21:18:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.157+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/2652219602 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5584cbaa6700 0x5584cbaa8af0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.157+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/2652219602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba97190 0x5584cba94300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.157+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/2652219602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 0x5584cba93dc0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.157+0000 7f898a7fc640 0 client.16182 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:18:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.157+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/2652219602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba864d0 0x5584cba96970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.157+0000 7f89ab7f5740 1 -- 172.21.15.59:0/2652219602 >> 172.21.15.59:0/2652219602 conn(0x5584cba84300 msgr2=0x5584cba89e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.158+0000 7f89ab7f5740 1 -- 172.21.15.59:0/2652219602 shutdown_connections 2024-09-10T21:18:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.158+0000 7f89ab7f5740 1 -- 172.21.15.59:0/2652219602 wait complete. 2024-09-10T21:18:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.158+0000 7f89ab7f5740 20 client.16182 trim_cache size 0 max 16384 2024-09-10T21:18:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.171+0000 7f89ab7f5740 1 Processor -- start 2024-09-10T21:18:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.171+0000 7f89ab7f5740 1 -- start start 2024-09-10T21:18:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.171+0000 7f89ab7f5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba864d0 0x5584cba95b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.171+0000 7f89ab7f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 0x5584cbaae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.171+0000 7f89ab7f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba97190 0x5584cbaae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.171+0000 7f89ab7f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f89a41ac170 con 0x5584cba86df0 2024-09-10T21:18:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.171+0000 7f89ab7f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f89a41adcb0 con 0x5584cba97190 2024-09-10T21:18:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.171+0000 7f89ab7f5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f89a41ac840 con 0x5584cba864d0 2024-09-10T21:18:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.171+0000 7f899a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 0x5584cbaae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.171+0000 7f899a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 0x5584cbaae2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42302/0 (socket says 172.21.15.59:42302) 2024-09-10T21:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.171+0000 7f899a7fc640 1 -- 172.21.15.59:0/3461648170 learned_addr learned my addr 172.21.15.59:0/3461648170 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.172+0000 7f89a2ffd640 1 --2- 172.21.15.59:0/3461648170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba864d0 0x5584cba95b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.172+0000 7f89a37fe640 1 --2- 172.21.15.59:0/3461648170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba97190 0x5584cbaae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.172+0000 7f899a7fc640 1 -- 172.21.15.59:0/3461648170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba864d0 msgr2=0x5584cba95b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.172+0000 7f899a7fc640 1 --2- 172.21.15.59:0/3461648170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba864d0 0x5584cba95b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.172+0000 7f899a7fc640 1 -- 172.21.15.59:0/3461648170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba97190 msgr2=0x5584cbaae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.172+0000 7f899a7fc640 1 --2- 172.21.15.59:0/3461648170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba97190 0x5584cbaae7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.172+0000 7f899a7fc640 1 -- 172.21.15.59:0/3461648170 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584cba7fbb0 con 0x5584cba86df0 2024-09-10T21:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.172+0000 7f89a37fe640 1 --2- 172.21.15.59:0/3461648170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba97190 0x5584cbaae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.172+0000 7f89a2ffd640 1 --2- 172.21.15.59:0/3461648170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba864d0 0x5584cba95b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.172+0000 7f899a7fc640 1 --2- 172.21.15.59:0/3461648170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 0x5584cbaae2b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f898c006010 tx=0x7f898c10cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f46ce8ec62d5142 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.172+0000 7f8998ff9640 1 -- 172.21.15.59:0/3461648170 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c115070 con 0x5584cba86df0 2024-09-10T21:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.172+0000 7f8998ff9640 1 -- 172.21.15.59:0/3461648170 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f898c10c320 con 0x5584cba86df0 2024-09-10T21:18:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.172+0000 7f8998ff9640 1 -- 172.21.15.59:0/3461648170 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c0909e0 con 0x5584cba86df0 2024-09-10T21:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.173+0000 7f89ab7f5740 1 -- 172.21.15.59:0/3461648170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 msgr2=0x5584cbaae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.173+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/3461648170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 0x5584cbaae2b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f898c006010 tx=0x7f898c10cd00 comp rx=0 tx=0).stop 2024-09-10T21:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.173+0000 7f89ab7f5740 1 -- 172.21.15.59:0/3461648170 shutdown_connections 2024-09-10T21:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.173+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/3461648170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba97190 0x5584cbaae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.173+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/3461648170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 0x5584cbaae2b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.173+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/3461648170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba864d0 0x5584cba95b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.173+0000 7f89ab7f5740 1 -- 172.21.15.59:0/3461648170 >> 172.21.15.59:0/3461648170 conn(0x5584cba84300 msgr2=0x5584cba953f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.173+0000 7f89ab7f5740 1 -- 172.21.15.59:0/3461648170 shutdown_connections 2024-09-10T21:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.173+0000 7f89ab7f5740 1 -- 172.21.15.59:0/3461648170 wait complete. 2024-09-10T21:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.173+0000 7f89ab7f5740 1 -- start start 2024-09-10T21:18:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.173+0000 7f89ab7f5740 1 Processor -- start 2024-09-10T21:18:47.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f89ab7f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba864d0 0x5584cba9ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:47.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f89ab7f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 0x5584cba9f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:47.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f89ab7f5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba97190 0x5584cba9be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:47.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f89ab7f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f89a41ad5e0 con 0x5584cba86df0 2024-09-10T21:18:47.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f89ab7f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f89a41acf10 con 0x5584cba864d0 2024-09-10T21:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f89ab7f5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f89a41aa150 con 0x5584cba97190 2024-09-10T21:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f89ab7f5740 10 client.0 _ll_register_callbacks cb 0x7f899c0096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f899a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 0x5584cba9f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f899a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 0x5584cba9f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42304/0 (socket says 172.21.15.59:42304) 2024-09-10T21:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f899a7fc640 1 -- 172.21.15.59:0/3188191426 learned_addr learned my addr 172.21.15.59:0/3188191426 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f89a2ffd640 1 --2- 172.21.15.59:0/3188191426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba864d0 0x5584cba9ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f89a37fe640 1 --2- 172.21.15.59:0/3188191426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba97190 0x5584cba9be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f899a7fc640 1 -- 172.21.15.59:0/3188191426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba97190 msgr2=0x5584cba9be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f899a7fc640 1 --2- 172.21.15.59:0/3188191426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba97190 0x5584cba9be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f899a7fc640 1 -- 172.21.15.59:0/3188191426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba864d0 msgr2=0x5584cba9ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f899a7fc640 1 --2- 172.21.15.59:0/3188191426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba864d0 0x5584cba9ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f899a7fc640 1 -- 172.21.15.59:0/3188191426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584cba9c360 con 0x5584cba86df0 2024-09-10T21:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f899a7fc640 1 --2- 172.21.15.59:0/3188191426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 0x5584cba9f390 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f898c0ccc80 tx=0x7f898c0c95d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b892831e537f4d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f898a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f898a7fc640 1 -- 172.21.15.59:0/3188191426 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c115070 con 0x5584cba86df0 2024-09-10T21:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f898a7fc640 1 -- 172.21.15.59:0/3188191426 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f898c0cd1e0 con 0x5584cba86df0 2024-09-10T21:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.174+0000 7f89ab7f5740 1 -- 172.21.15.59:0/3188191426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f898c10c320 con 0x5584cba86df0 2024-09-10T21:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.175+0000 7f898a7fc640 1 -- 172.21.15.59:0/3188191426 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f898c090bc0 con 0x5584cba86df0 2024-09-10T21:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.175+0000 7f89ab7f5740 10 client.16188 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.175+0000 7f89ab7f5740 1 -- 172.21.15.59:0/3188191426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5584cba9c360 con 0x5584cba86df0 2024-09-10T21:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.175+0000 7f898a7fc640 1 -- 172.21.15.59:0/3188191426 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f898c10c320 con 0x5584cba86df0 2024-09-10T21:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.175+0000 7f898a7fc640 1 -- 172.21.15.59:0/3188191426 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f898c0cc1e0 con 0x5584cba86df0 2024-09-10T21:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.175+0000 7f89ab7f5740 10 client.16188 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.175+0000 7f89ab7f5740 10 client.16188 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.175+0000 7f89ab7f5740 20 client.16188 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:47.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.175+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/3188191426 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5584cbb13ed0 0x5584cbb162f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.175+0000 7f89ab7f5740 4 client.16188 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:18:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.175+0000 7f89ab7f5740 1 -- 172.21.15.59:0/3188191426 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5584cb9fa8a0 con 0x5584cbb13ed0 2024-09-10T21:18:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.175+0000 7f89a2ffd640 1 --2- 172.21.15.59:0/3188191426 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5584cbb13ed0 0x5584cbb162f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.176+0000 7f89a2ffd640 1 --2- 172.21.15.59:0/3188191426 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5584cbb13ed0 0x5584cbb162f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2179b37bf406b9d5 server_cookie=17689c904c5b8cef in_seq=0 out_seq=0 2024-09-10T21:18:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.176+0000 7f898a7fc640 10 client.16188 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:18:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.176+0000 7f898a7fc640 1 -- 172.21.15.59:0/3188191426 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5584cb9fa8a0 con 0x5584cbb13ed0 2024-09-10T21:18:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.176+0000 7f898a7fc640 10 client.16188 handle_command_reply: tid=0 2024-09-10T21:18:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.176+0000 7f89ab7f5740 1 client.16188 shutdown 2024-09-10T21:18:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.176+0000 7f89ab7f5740 1 -- 172.21.15.59:0/3188191426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 msgr2=0x5584cba9f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.176+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/3188191426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 0x5584cba9f390 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f898c0ccc80 tx=0x7f898c0c95d0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.176+0000 7f89ab7f5740 1 -- 172.21.15.59:0/3188191426 shutdown_connections 2024-09-10T21:18:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.176+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/3188191426 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5584cbb13ed0 0x5584cbb162f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.176+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/3188191426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584cba97190 0x5584cba9be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.176+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/3188191426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584cba86df0 0x5584cba9f390 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.176+0000 7f898a7fc640 0 client.16188 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:18:47.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.176+0000 7f89ab7f5740 1 --2- 172.21.15.59:0/3188191426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584cba864d0 0x5584cba9ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.176+0000 7f89ab7f5740 1 -- 172.21.15.59:0/3188191426 >> 172.21.15.59:0/3188191426 conn(0x5584cba84300 msgr2=0x5584cba95c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:47.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.176+0000 7f89ab7f5740 1 -- 172.21.15.59:0/3188191426 shutdown_connections 2024-09-10T21:18:47.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.176+0000 7f89ab7f5740 1 -- 172.21.15.59:0/3188191426 wait complete. 2024-09-10T21:18:47.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.176+0000 7f89ab7f5740 20 client.16188 trim_cache size 0 max 16384 2024-09-10T21:18:47.195 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:18:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.177+0000 7f89a9420640 1 -- 172.21.15.59:0/3278960339 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f89900b5360 msgr2=0x7f89900b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.177+0000 7f89a9420640 1 --2- 172.21.15.59:0/3278960339 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f89900b5360 0x7f89900b7820 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f899c00c610 tx=0x7f899c00e040 comp rx=0 tx=0).stop 2024-09-10T21:18:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.177+0000 7f89a9420640 1 -- 172.21.15.59:0/3278960339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a41087d0 msgr2=0x7f89a4199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.177+0000 7f89a9420640 1 --2- 172.21.15.59:0/3278960339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a41087d0 0x7f89a4199860 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f898c005940 tx=0x7f898c0042f0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.177+0000 7f89a9420640 1 -- 172.21.15.59:0/3278960339 shutdown_connections 2024-09-10T21:18:47.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.177+0000 7f89a9420640 1 --2- 172.21.15.59:0/3278960339 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f89900b5360 0x7f89900b7820 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.177+0000 7f89a9420640 1 --2- 172.21.15.59:0/3278960339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f89a4109150 0x7f89a419ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.177+0000 7f89a9420640 1 --2- 172.21.15.59:0/3278960339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a41087d0 0x7f89a4199860 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.177+0000 7f89a9420640 1 --2- 172.21.15.59:0/3278960339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f89a4102dc0 0x7f89a4199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:47.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.177+0000 7f89a9420640 1 -- 172.21.15.59:0/3278960339 >> 172.21.15.59:0/3278960339 conn(0x7f89a40fe830 msgr2=0x7f89a4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:47.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.177+0000 7f89a9420640 1 -- 172.21.15.59:0/3278960339 shutdown_connections 2024-09-10T21:18:47.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:47.177+0000 7f89a9420640 1 -- 172.21.15.59:0/3278960339 wait complete. 2024-09-10T21:18:47.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:46 smithi192 ceph-mon[35363]: pgmap v445: 97 pgs: 97 active+clean; 2.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:18:47.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:46 smithi154 ceph-mon[35041]: pgmap v445: 97 pgs: 97 active+clean; 2.3 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:18:47.983 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:18:48.248 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:18:48.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.730+0000 7f432f448640 1 -- 172.21.15.59:0/2796418688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4328106e40 msgr2=0x7f4328107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:48.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.730+0000 7f432f448640 1 --2- 172.21.15.59:0/2796418688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4328106e40 0x7f4328107280 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4318009900 tx=0x7f431802a410 comp rx=0 tx=0).stop 2024-09-10T21:18:48.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.730+0000 7f432f448640 1 -- 172.21.15.59:0/2796418688 shutdown_connections 2024-09-10T21:18:48.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.730+0000 7f432f448640 1 --2- 172.21.15.59:0/2796418688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43281077c0 0x7f432810dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.730+0000 7f432f448640 1 --2- 172.21.15.59:0/2796418688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4328106e40 0x7f4328107280 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.730+0000 7f432f448640 1 --2- 172.21.15.59:0/2796418688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4328101810 0x7f4328101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.730+0000 7f432f448640 1 -- 172.21.15.59:0/2796418688 >> 172.21.15.59:0/2796418688 conn(0x7f4328076f50 msgr2=0x7f4328077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:48.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.730+0000 7f432f448640 1 -- 172.21.15.59:0/2796418688 shutdown_connections 2024-09-10T21:18:48.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.730+0000 7f432f448640 1 -- 172.21.15.59:0/2796418688 wait complete. 2024-09-10T21:18:48.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.731+0000 7f432f448640 1 Processor -- start 2024-09-10T21:18:48.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.731+0000 7f432f448640 1 -- start start 2024-09-10T21:18:48.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.731+0000 7f432f448640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328101810 0x7f432819b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:48.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.731+0000 7f432f448640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4328106e40 0x7f432819b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:48.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.731+0000 7f432f448640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43281077c0 0x7f43281a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:48.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.731+0000 7f432f448640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4328110ba0 con 0x7f43281077c0 2024-09-10T21:18:48.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.731+0000 7f432f448640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4328110a20 con 0x7f4328101810 2024-09-10T21:18:48.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.731+0000 7f432f448640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4328110d20 con 0x7f4328106e40 2024-09-10T21:18:48.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.731+0000 7f432d9e5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43281077c0 0x7f43281a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:48.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.731+0000 7f432d9e5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43281077c0 0x7f43281a0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42324/0 (socket says 172.21.15.59:42324) 2024-09-10T21:18:48.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.731+0000 7f432d9e5640 1 -- 172.21.15.59:0/439847959 learned_addr learned my addr 172.21.15.59:0/439847959 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:48.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.731+0000 7f432c9e3640 1 --2- 172.21.15.59:0/439847959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4328106e40 0x7f432819b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:48.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.732+0000 7f432d1e4640 1 --2- 172.21.15.59:0/439847959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328101810 0x7f432819b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:48.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.732+0000 7f432d9e5640 1 -- 172.21.15.59:0/439847959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4328106e40 msgr2=0x7f432819b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:48.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.732+0000 7f432d9e5640 1 --2- 172.21.15.59:0/439847959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4328106e40 0x7f432819b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.732+0000 7f432d9e5640 1 -- 172.21.15.59:0/439847959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328101810 msgr2=0x7f432819b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:48.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.732+0000 7f432d9e5640 1 --2- 172.21.15.59:0/439847959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328101810 0x7f432819b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.732+0000 7f432d9e5640 1 -- 172.21.15.59:0/439847959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43281a14f0 con 0x7f43281077c0 2024-09-10T21:18:48.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.732+0000 7f432d1e4640 1 --2- 172.21.15.59:0/439847959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328101810 0x7f432819b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:48.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.732+0000 7f432d9e5640 1 --2- 172.21.15.59:0/439847959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43281077c0 0x7f43281a0d20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f432000cad0 tx=0x7f432000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.732+0000 7f431e7fc640 1 -- 172.21.15.59:0/439847959 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432000ae20 con 0x7f43281077c0 2024-09-10T21:18:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.732+0000 7f431e7fc640 1 -- 172.21.15.59:0/439847959 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4320005020 con 0x7f43281077c0 2024-09-10T21:18:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.732+0000 7f432f448640 1 -- 172.21.15.59:0/439847959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43281a17e0 con 0x7f43281077c0 2024-09-10T21:18:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.732+0000 7f431e7fc640 1 -- 172.21.15.59:0/439847959 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432000f6b0 con 0x7f43281077c0 2024-09-10T21:18:48.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.732+0000 7f432f448640 1 -- 172.21.15.59:0/439847959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43281a7ea0 con 0x7f43281077c0 2024-09-10T21:18:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.735+0000 7f433181d740 1 Processor -- start 2024-09-10T21:18:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.735+0000 7f431e7fc640 1 -- 172.21.15.59:0/439847959 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f43200054f0 con 0x7f43281077c0 2024-09-10T21:18:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.735+0000 7f433181d740 1 -- start start 2024-09-10T21:18:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f433181d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dcc4d0 0x563891dcc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f433181d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dccdf0 0x563891dd8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f433181d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dd8d80 0x563891ddb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f433181d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563891d42ea0 con 0x563891dccdf0 2024-09-10T21:18:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f433181d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563891d322d0 con 0x563891dd8d80 2024-09-10T21:18:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f433181d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563891d360e0 con 0x563891dcc4d0 2024-09-10T21:18:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f432d1e4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dccdf0 0x563891dd8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f432d1e4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dccdf0 0x563891dd8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42326/0 (socket says 172.21.15.59:42326) 2024-09-10T21:18:48.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f432d1e4640 1 -- 172.21.15.59:0/3466917234 learned_addr learned my addr 172.21.15.59:0/3466917234 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f432c9e3640 1 --2- 172.21.15.59:0/3466917234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dd8d80 0x563891ddb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f432c9e3640 1 --2- 172.21.15.59:0/3466917234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dcc4d0 0x563891dcc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f432d1e4640 1 -- 172.21.15.59:0/3466917234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dcc4d0 msgr2=0x563891dcc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f432d1e4640 1 --2- 172.21.15.59:0/3466917234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dcc4d0 0x563891dcc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f432d1e4640 1 -- 172.21.15.59:0/3466917234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dd8d80 msgr2=0x563891ddb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f432d1e4640 1 --2- 172.21.15.59:0/3466917234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dd8d80 0x563891ddb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f432d1e4640 1 -- 172.21.15.59:0/3466917234 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563891a90650 con 0x563891dccdf0 2024-09-10T21:18:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f432c9e3640 1 --2- 172.21.15.59:0/3466917234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dcc4d0 0x563891dcc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f431e7fc640 1 --2- 172.21.15.59:0/439847959 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43140b5360 0x7f43140b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f432d1e4640 1 --2- 172.21.15.59:0/3466917234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dccdf0 0x563891dd8840 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f4324008c60 tx=0x7f432400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6abb0e9492bbaa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:48.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.736+0000 7f432c9e3640 1 --2- 172.21.15.59:0/439847959 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43140b5360 0x7f43140b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.737+0000 7f431e7fc640 1 -- 172.21.15.59:0/439847959 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f43200e5b30 con 0x7f43281077c0 2024-09-10T21:18:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.737+0000 7f43137fe640 1 -- 172.21.15.59:0/3466917234 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4324014070 con 0x563891dccdf0 2024-09-10T21:18:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.737+0000 7f43137fe640 1 -- 172.21.15.59:0/3466917234 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43240047a0 con 0x563891dccdf0 2024-09-10T21:18:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.737+0000 7f43137fe640 1 -- 172.21.15.59:0/3466917234 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4324010690 con 0x563891dccdf0 2024-09-10T21:18:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.737+0000 7f433181d740 1 -- 172.21.15.59:0/3466917234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dccdf0 msgr2=0x563891dd8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.737+0000 7f432c9e3640 1 --2- 172.21.15.59:0/439847959 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43140b5360 0x7f43140b7820 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4318031440 tx=0x7f4318005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.737+0000 7f433181d740 1 --2- 172.21.15.59:0/3466917234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dccdf0 0x563891dd8840 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f4324008c60 tx=0x7f432400e720 comp rx=0 tx=0).stop 2024-09-10T21:18:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.738+0000 7f433181d740 1 -- 172.21.15.59:0/3466917234 shutdown_connections 2024-09-10T21:18:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.738+0000 7f433181d740 1 --2- 172.21.15.59:0/3466917234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dd8d80 0x563891ddb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.738+0000 7f433181d740 1 --2- 172.21.15.59:0/3466917234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dccdf0 0x563891dd8840 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.738+0000 7f433181d740 1 --2- 172.21.15.59:0/3466917234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dcc4d0 0x563891dcc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.738+0000 7f433181d740 1 -- 172.21.15.59:0/3466917234 >> 172.21.15.59:0/3466917234 conn(0x563891dca300 msgr2=0x563891dcb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:48.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.738+0000 7f433181d740 1 -- 172.21.15.59:0/3466917234 shutdown_connections 2024-09-10T21:18:48.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.738+0000 7f433181d740 1 -- 172.21.15.59:0/3466917234 wait complete. 2024-09-10T21:18:48.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.738+0000 7f433181d740 1 -- start start 2024-09-10T21:18:48.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.738+0000 7f433181d740 1 Processor -- start 2024-09-10T21:18:48.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.738+0000 7f433181d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dcc4d0 0x563891dd8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:48.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.738+0000 7f433181d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dccdf0 0x563891dd5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:48.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.738+0000 7f433181d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dd8d80 0x563891dd6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:48.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.739+0000 7f433181d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563891b93700 con 0x563891dcc4d0 2024-09-10T21:18:48.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.739+0000 7f433181d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563891ccd160 con 0x563891dccdf0 2024-09-10T21:18:48.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.739+0000 7f433181d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563891ddba00 con 0x563891dd8d80 2024-09-10T21:18:48.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.739+0000 7f433181d740 10 client.0 _ll_register_callbacks cb 0x563891ce69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:48.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.739+0000 7f432d1e4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dcc4d0 0x563891dd8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:48.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.739+0000 7f432d1e4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dcc4d0 0x563891dd8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42330/0 (socket says 172.21.15.59:42330) 2024-09-10T21:18:48.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.739+0000 7f432d1e4640 1 -- 172.21.15.59:0/2857970353 learned_addr learned my addr 172.21.15.59:0/2857970353 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:48.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.739+0000 7f432c9e3640 1 --2- 172.21.15.59:0/2857970353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dccdf0 0x563891dd5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:48.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.739+0000 7f432d9e5640 1 --2- 172.21.15.59:0/2857970353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dd8d80 0x563891dd6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:48.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.739+0000 7f432d1e4640 1 -- 172.21.15.59:0/2857970353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dd8d80 msgr2=0x563891dd6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:48.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.739+0000 7f432d1e4640 1 --2- 172.21.15.59:0/2857970353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dd8d80 0x563891dd6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.739+0000 7f432d1e4640 1 -- 172.21.15.59:0/2857970353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dccdf0 msgr2=0x563891dd5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:48.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.739+0000 7f432d1e4640 1 --2- 172.21.15.59:0/2857970353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dccdf0 0x563891dd5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.739+0000 7f432d1e4640 1 -- 172.21.15.59:0/2857970353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563891cfac90 con 0x563891dcc4d0 2024-09-10T21:18:48.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.739+0000 7f432d1e4640 1 --2- 172.21.15.59:0/2857970353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dcc4d0 0x563891dd8620 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4324010c60 tx=0x7f4324010c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e1183f4e7b9207 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:48.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.739+0000 7f4310ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:48.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.739+0000 7f4310ff9640 1 -- 172.21.15.59:0/2857970353 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4324027060 con 0x563891dcc4d0 2024-09-10T21:18:48.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.739+0000 7f4310ff9640 1 -- 172.21.15.59:0/2857970353 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4324018820 con 0x563891dcc4d0 2024-09-10T21:18:48.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.739+0000 7f433181d740 1 -- 172.21.15.59:0/2857970353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43240047a0 con 0x563891dcc4d0 2024-09-10T21:18:48.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.740+0000 7f4310ff9640 1 -- 172.21.15.59:0/2857970353 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4324014070 con 0x563891dcc4d0 2024-09-10T21:18:48.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.740+0000 7f433181d740 10 client.16200 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:48.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.740+0000 7f433181d740 1 -- 172.21.15.59:0/2857970353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563891de7290 con 0x563891dcc4d0 2024-09-10T21:18:48.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.740+0000 7f4310ff9640 1 -- 172.21.15.59:0/2857970353 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43240047a0 con 0x563891dcc4d0 2024-09-10T21:18:48.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.740+0000 7f4310ff9640 1 -- 172.21.15.59:0/2857970353 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f43240215e0 con 0x563891dcc4d0 2024-09-10T21:18:48.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.740+0000 7f433181d740 10 client.16200 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:48.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.740+0000 7f433181d740 10 client.16200 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:18:48.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.740+0000 7f433181d740 20 client.16200 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:48.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.740+0000 7f433181d740 1 --2- 172.21.15.59:0/2857970353 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x563891de85e0 0x563891dea9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:48.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.740+0000 7f433181d740 4 client.16200 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:18:48.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.740+0000 7f433181d740 1 -- 172.21.15.59:0/2857970353 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563891d44df0 con 0x563891de85e0 2024-09-10T21:18:48.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.740+0000 7f432c9e3640 1 --2- 172.21.15.59:0/2857970353 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x563891de85e0 0x563891dea9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:48.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.741+0000 7f4310ff9640 10 client.16200 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:18:48.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.741+0000 7f432c9e3640 1 --2- 172.21.15.59:0/2857970353 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x563891de85e0 0x563891dea9d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=10084e8562955530 server_cookie=fa39b067d9f608de in_seq=0 out_seq=0 2024-09-10T21:18:48.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.742+0000 7f4310ff9640 1 -- 172.21.15.59:0/2857970353 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563891d44df0 con 0x563891de85e0 2024-09-10T21:18:48.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.742+0000 7f4310ff9640 10 client.16200 handle_command_reply: tid=0 2024-09-10T21:18:48.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.742+0000 7f433181d740 1 client.16200 shutdown 2024-09-10T21:18:48.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.742+0000 7f433181d740 1 -- 172.21.15.59:0/2857970353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dcc4d0 msgr2=0x563891dd8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:48.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.742+0000 7f433181d740 1 --2- 172.21.15.59:0/2857970353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dcc4d0 0x563891dd8620 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4324010c60 tx=0x7f4324010c90 comp rx=0 tx=0).stop 2024-09-10T21:18:48.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.742+0000 7f433181d740 1 -- 172.21.15.59:0/2857970353 shutdown_connections 2024-09-10T21:18:48.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.742+0000 7f433181d740 1 --2- 172.21.15.59:0/2857970353 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x563891de85e0 0x563891dea9d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.742+0000 7f433181d740 1 --2- 172.21.15.59:0/2857970353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dd8d80 0x563891dd6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.742+0000 7f433181d740 1 --2- 172.21.15.59:0/2857970353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dccdf0 0x563891dd5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.742+0000 7f433181d740 1 --2- 172.21.15.59:0/2857970353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dcc4d0 0x563891dd8620 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.742+0000 7f433181d740 1 -- 172.21.15.59:0/2857970353 >> 172.21.15.59:0/2857970353 conn(0x563891dca300 msgr2=0x563891dcfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:48.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.742+0000 7f4310ff9640 0 client.16200 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:18:48.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.742+0000 7f433181d740 1 -- 172.21.15.59:0/2857970353 shutdown_connections 2024-09-10T21:18:48.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.742+0000 7f433181d740 1 -- 172.21.15.59:0/2857970353 wait complete. 2024-09-10T21:18:48.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.742+0000 7f433181d740 20 client.16200 trim_cache size 0 max 16384 2024-09-10T21:18:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.755+0000 7f433181d740 1 Processor -- start 2024-09-10T21:18:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.755+0000 7f433181d740 1 -- start start 2024-09-10T21:18:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f433181d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dcc4d0 0x563891dd42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f433181d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dccdf0 0x563891dd4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f433181d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dd8d80 0x563891dd2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f433181d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f43281b04e0 con 0x563891dd8d80 2024-09-10T21:18:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f433181d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43281b2020 con 0x563891dcc4d0 2024-09-10T21:18:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f433181d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f43281b0bb0 con 0x563891dccdf0 2024-09-10T21:18:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f432d9e5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dd8d80 0x563891dd2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f432d9e5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dd8d80 0x563891dd2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42342/0 (socket says 172.21.15.59:42342) 2024-09-10T21:18:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f432d9e5640 1 -- 172.21.15.59:0/194904126 learned_addr learned my addr 172.21.15.59:0/194904126 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f432c9e3640 1 --2- 172.21.15.59:0/194904126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dccdf0 0x563891dd4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f432d1e4640 1 --2- 172.21.15.59:0/194904126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dcc4d0 0x563891dd42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f432d9e5640 1 -- 172.21.15.59:0/194904126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dccdf0 msgr2=0x563891dd4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f432d9e5640 1 --2- 172.21.15.59:0/194904126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dccdf0 0x563891dd4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f432d9e5640 1 -- 172.21.15.59:0/194904126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dcc4d0 msgr2=0x563891dd42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f432d9e5640 1 --2- 172.21.15.59:0/194904126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dcc4d0 0x563891dd42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f432d9e5640 1 -- 172.21.15.59:0/194904126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563891dc5bb0 con 0x563891dd8d80 2024-09-10T21:18:48.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f432d9e5640 1 --2- 172.21.15.59:0/194904126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dd8d80 0x563891dd2c80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f43200a8330 tx=0x7f43200b5310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2680fe222355869f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:48.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f4312ffd640 1 -- 172.21.15.59:0/194904126 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432001d040 con 0x563891dd8d80 2024-09-10T21:18:48.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f4312ffd640 1 -- 172.21.15.59:0/194904126 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43200b5040 con 0x563891dd8d80 2024-09-10T21:18:48.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.756+0000 7f4312ffd640 1 -- 172.21.15.59:0/194904126 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43200cf2d0 con 0x563891dd8d80 2024-09-10T21:18:48.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.757+0000 7f433181d740 1 -- 172.21.15.59:0/194904126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dd8d80 msgr2=0x563891dd2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:48.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.757+0000 7f433181d740 1 --2- 172.21.15.59:0/194904126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dd8d80 0x563891dd2c80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f43200a8330 tx=0x7f43200b5310 comp rx=0 tx=0).stop 2024-09-10T21:18:48.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.757+0000 7f433181d740 1 -- 172.21.15.59:0/194904126 shutdown_connections 2024-09-10T21:18:48.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.757+0000 7f433181d740 1 --2- 172.21.15.59:0/194904126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dd8d80 0x563891dd2c80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.757+0000 7f433181d740 1 --2- 172.21.15.59:0/194904126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dccdf0 0x563891dd4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.757+0000 7f433181d740 1 --2- 172.21.15.59:0/194904126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dcc4d0 0x563891dd42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.757+0000 7f433181d740 1 -- 172.21.15.59:0/194904126 >> 172.21.15.59:0/194904126 conn(0x563891dca300 msgr2=0x563891dcafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:48.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.757+0000 7f433181d740 1 -- 172.21.15.59:0/194904126 shutdown_connections 2024-09-10T21:18:48.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.757+0000 7f433181d740 1 -- 172.21.15.59:0/194904126 wait complete. 2024-09-10T21:18:48.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.758+0000 7f433181d740 1 -- start start 2024-09-10T21:18:48.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.758+0000 7f433181d740 1 Processor -- start 2024-09-10T21:18:48.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.758+0000 7f433181d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dcc4d0 0x563891de0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:48.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.758+0000 7f433181d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dccdf0 0x563891de1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:48.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.758+0000 7f433181d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dd8d80 0x563891ddbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:48.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.758+0000 7f433181d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f43281b1950 con 0x563891dcc4d0 2024-09-10T21:18:48.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.758+0000 7f433181d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43281b1280 con 0x563891dccdf0 2024-09-10T21:18:48.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.758+0000 7f433181d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f43281ae4c0 con 0x563891dd8d80 2024-09-10T21:18:48.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.758+0000 7f433181d740 10 client.0 _ll_register_callbacks cb 0x7f4324008ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:48.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.758+0000 7f432d1e4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dcc4d0 0x563891de0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:48.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.758+0000 7f432d1e4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dcc4d0 0x563891de0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42356/0 (socket says 172.21.15.59:42356) 2024-09-10T21:18:48.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.758+0000 7f432d1e4640 1 -- 172.21.15.59:0/3509276263 learned_addr learned my addr 172.21.15.59:0/3509276263 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:48.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.758+0000 7f432d9e5640 1 --2- 172.21.15.59:0/3509276263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dd8d80 0x563891ddbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:48.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.758+0000 7f432c9e3640 1 --2- 172.21.15.59:0/3509276263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dccdf0 0x563891de1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:48.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.759+0000 7f432d1e4640 1 -- 172.21.15.59:0/3509276263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dd8d80 msgr2=0x563891ddbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:48.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.759+0000 7f432d1e4640 1 --2- 172.21.15.59:0/3509276263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dd8d80 0x563891ddbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.759+0000 7f432d1e4640 1 -- 172.21.15.59:0/3509276263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dccdf0 msgr2=0x563891de1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:48.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.759+0000 7f432d1e4640 1 --2- 172.21.15.59:0/3509276263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dccdf0 0x563891de1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.759+0000 7f432d1e4640 1 -- 172.21.15.59:0/3509276263 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563891ddc1c0 con 0x563891dcc4d0 2024-09-10T21:18:48.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.759+0000 7f432d9e5640 1 --2- 172.21.15.59:0/3509276263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dd8d80 0x563891ddbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:48.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.759+0000 7f432d1e4640 1 --2- 172.21.15.59:0/3509276263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dcc4d0 0x563891de0cd0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f43240219b0 tx=0x7f43240107b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7341fc20155335f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:48.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.759+0000 7f4310ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:48.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.759+0000 7f4310ff9640 1 -- 172.21.15.59:0/3509276263 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4324027070 con 0x563891dcc4d0 2024-09-10T21:18:48.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.759+0000 7f4310ff9640 1 -- 172.21.15.59:0/3509276263 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f43240215d0 con 0x563891dcc4d0 2024-09-10T21:18:48.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.759+0000 7f433181d740 1 -- 172.21.15.59:0/3509276263 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43200b5040 con 0x563891dcc4d0 2024-09-10T21:18:48.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.759+0000 7f4310ff9640 1 -- 172.21.15.59:0/3509276263 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f432403d070 con 0x563891dcc4d0 2024-09-10T21:18:48.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.759+0000 7f433181d740 10 client.16206 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:48.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.759+0000 7f433181d740 1 -- 172.21.15.59:0/3509276263 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563891e55970 con 0x563891dcc4d0 2024-09-10T21:18:48.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.759+0000 7f4310ff9640 1 -- 172.21.15.59:0/3509276263 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43200b5040 con 0x563891dcc4d0 2024-09-10T21:18:48.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.759+0000 7f4310ff9640 1 -- 172.21.15.59:0/3509276263 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f43240188c0 con 0x563891dcc4d0 2024-09-10T21:18:48.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.760+0000 7f433181d740 10 client.16206 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:48.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.760+0000 7f433181d740 10 client.16206 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:18:48.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.760+0000 7f433181d740 20 client.16206 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:48.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.760+0000 7f433181d740 1 --2- 172.21.15.59:0/3509276263 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x563891e56120 0x563891e58540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:48.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.760+0000 7f433181d740 4 client.16206 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:18:48.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.760+0000 7f433181d740 1 -- 172.21.15.59:0/3509276263 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563891d408a0 con 0x563891e56120 2024-09-10T21:18:48.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.760+0000 7f432c9e3640 1 --2- 172.21.15.59:0/3509276263 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x563891e56120 0x563891e58540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:48.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.760+0000 7f4310ff9640 10 client.16206 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:18:48.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.760+0000 7f432c9e3640 1 --2- 172.21.15.59:0/3509276263 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x563891e56120 0x563891e58540 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fc8a4de5c5db0baa server_cookie=48c8f3825eb37c7b in_seq=0 out_seq=0 2024-09-10T21:18:48.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.760+0000 7f4310ff9640 1 -- 172.21.15.59:0/3509276263 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563891d408a0 con 0x563891e56120 2024-09-10T21:18:48.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.760+0000 7f4310ff9640 10 client.16206 handle_command_reply: tid=0 2024-09-10T21:18:48.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.760+0000 7f433181d740 1 client.16206 shutdown 2024-09-10T21:18:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.761+0000 7f433181d740 1 -- 172.21.15.59:0/3509276263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dcc4d0 msgr2=0x563891de0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.761+0000 7f433181d740 1 --2- 172.21.15.59:0/3509276263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dcc4d0 0x563891de0cd0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f43240219b0 tx=0x7f43240107b0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.761+0000 7f433181d740 1 -- 172.21.15.59:0/3509276263 shutdown_connections 2024-09-10T21:18:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.761+0000 7f433181d740 1 --2- 172.21.15.59:0/3509276263 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x563891e56120 0x563891e58540 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.761+0000 7f433181d740 1 --2- 172.21.15.59:0/3509276263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563891dd8d80 0x563891ddbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.761+0000 7f433181d740 1 --2- 172.21.15.59:0/3509276263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563891dccdf0 0x563891de1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.761+0000 7f4310ff9640 0 client.16206 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:18:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.761+0000 7f433181d740 1 --2- 172.21.15.59:0/3509276263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563891dcc4d0 0x563891de0cd0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.761+0000 7f433181d740 1 -- 172.21.15.59:0/3509276263 >> 172.21.15.59:0/3509276263 conn(0x563891dca300 msgr2=0x563891dd4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.761+0000 7f433181d740 1 -- 172.21.15.59:0/3509276263 shutdown_connections 2024-09-10T21:18:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.761+0000 7f433181d740 1 -- 172.21.15.59:0/3509276263 wait complete. 2024-09-10T21:18:48.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.761+0000 7f433181d740 20 client.16206 trim_cache size 0 max 16384 2024-09-10T21:18:48.771 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:18:48.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.761+0000 7f432f448640 1 -- 172.21.15.59:0/439847959 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43140b5360 msgr2=0x7f43140b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:48.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.761+0000 7f432f448640 1 --2- 172.21.15.59:0/439847959 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43140b5360 0x7f43140b7820 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4318031440 tx=0x7f4318005b50 comp rx=0 tx=0).stop 2024-09-10T21:18:48.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.761+0000 7f432f448640 1 -- 172.21.15.59:0/439847959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43281077c0 msgr2=0x7f43281a0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:48.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.761+0000 7f432f448640 1 --2- 172.21.15.59:0/439847959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43281077c0 0x7f43281a0d20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f432000cad0 tx=0x7f432000cf90 comp rx=0 tx=0).stop 2024-09-10T21:18:48.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.762+0000 7f432f448640 1 -- 172.21.15.59:0/439847959 shutdown_connections 2024-09-10T21:18:48.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.762+0000 7f432f448640 1 --2- 172.21.15.59:0/439847959 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43140b5360 0x7f43140b7820 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.762+0000 7f432f448640 1 --2- 172.21.15.59:0/439847959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43281077c0 0x7f43281a0d20 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.762+0000 7f432f448640 1 --2- 172.21.15.59:0/439847959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4328106e40 0x7f432819b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.762+0000 7f432f448640 1 --2- 172.21.15.59:0/439847959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4328101810 0x7f432819b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:48.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.762+0000 7f432f448640 1 -- 172.21.15.59:0/439847959 >> 172.21.15.59:0/439847959 conn(0x7f4328076f50 msgr2=0x7f43281005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:48.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.762+0000 7f432f448640 1 -- 172.21.15.59:0/439847959 shutdown_connections 2024-09-10T21:18:48.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:48.762+0000 7f432f448640 1 -- 172.21.15.59:0/439847959 wait complete. 2024-09-10T21:18:49.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:48 smithi192 ceph-mon[35363]: pgmap v446: 97 pgs: 97 active+clean; 2.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:18:49.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:48 smithi059 ceph-mon[30888]: pgmap v446: 97 pgs: 97 active+clean; 2.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:18:49.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:48 smithi154 ceph-mon[35041]: pgmap v446: 97 pgs: 97 active+clean; 2.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:18:49.668 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:18:49.932 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:18:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.457+0000 7f6a35c47640 1 -- 172.21.15.59:0/1396955152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a3010a920 msgr2=0x7f6a3010cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.457+0000 7f6a35c47640 1 --2- 172.21.15.59:0/1396955152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a3010a920 0x7f6a3010cd10 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6a24009900 tx=0x7f6a2402a410 comp rx=0 tx=0).stop 2024-09-10T21:18:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.457+0000 7f6a35c47640 1 -- 172.21.15.59:0/1396955152 shutdown_connections 2024-09-10T21:18:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.457+0000 7f6a35c47640 1 --2- 172.21.15.59:0/1396955152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a3010d250 0x7f6a3010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.458+0000 7f6a35c47640 1 --2- 172.21.15.59:0/1396955152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a3010a920 0x7f6a3010cd10 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.458+0000 7f6a35c47640 1 --2- 172.21.15.59:0/1396955152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a30101810 0x7f6a30101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.458+0000 7f6a35c47640 1 -- 172.21.15.59:0/1396955152 >> 172.21.15.59:0/1396955152 conn(0x7f6a30076f50 msgr2=0x7f6a30077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.458+0000 7f6a35c47640 1 -- 172.21.15.59:0/1396955152 shutdown_connections 2024-09-10T21:18:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.458+0000 7f6a35c47640 1 -- 172.21.15.59:0/1396955152 wait complete. 2024-09-10T21:18:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.458+0000 7f6a35c47640 1 Processor -- start 2024-09-10T21:18:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.458+0000 7f6a35c47640 1 -- start start 2024-09-10T21:18:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a35c47640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a30101810 0x7f6a3019b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a35c47640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a3010a920 0x7f6a3019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a35c47640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a3010d250 0x7f6a301a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a35c47640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6a30112d50 con 0x7f6a3010a920 2024-09-10T21:18:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a35c47640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6a30112bd0 con 0x7f6a3010d250 2024-09-10T21:18:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a35c47640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6a30112ed0 con 0x7f6a30101810 2024-09-10T21:18:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a2effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a3010a920 0x7f6a3019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a2effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a3010a920 0x7f6a3019b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49510/0 (socket says 172.21.15.59:49510) 2024-09-10T21:18:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a2effd640 1 -- 172.21.15.59:0/3848429361 learned_addr learned my addr 172.21.15.59:0/3848429361 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a2f7fe640 1 --2- 172.21.15.59:0/3848429361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a30101810 0x7f6a3019b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a2ffff640 1 --2- 172.21.15.59:0/3848429361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a3010d250 0x7f6a301a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a2effd640 1 -- 172.21.15.59:0/3848429361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a30101810 msgr2=0x7f6a3019b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a2effd640 1 --2- 172.21.15.59:0/3848429361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a30101810 0x7f6a3019b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a2effd640 1 -- 172.21.15.59:0/3848429361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a3010d250 msgr2=0x7f6a301a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a2effd640 1 --2- 172.21.15.59:0/3848429361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a3010d250 0x7f6a301a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a2effd640 1 -- 172.21.15.59:0/3848429361 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a301a1560 con 0x7f6a3010a920 2024-09-10T21:18:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a2effd640 1 --2- 172.21.15.59:0/3848429361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a3010a920 0x7f6a3019b9f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6a24006010 tx=0x7f6a240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a2cff9640 1 -- 172.21.15.59:0/3848429361 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2403f030 con 0x7f6a3010a920 2024-09-10T21:18:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a2cff9640 1 -- 172.21.15.59:0/3848429361 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a24003800 con 0x7f6a3010a920 2024-09-10T21:18:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a2cff9640 1 -- 172.21.15.59:0/3848429361 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24035070 con 0x7f6a3010a920 2024-09-10T21:18:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.459+0000 7f6a35c47640 1 -- 172.21.15.59:0/3848429361 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a301a17f0 con 0x7f6a3010a920 2024-09-10T21:18:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.460+0000 7f6a35c47640 1 -- 172.21.15.59:0/3848429361 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a301a7f10 con 0x7f6a3010a920 2024-09-10T21:18:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.462+0000 7f6a3801c740 1 Processor -- start 2024-09-10T21:18:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.462+0000 7f6a3801c740 1 -- start start 2024-09-10T21:18:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.462+0000 7f6a2cff9640 1 -- 172.21.15.59:0/3848429361 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f6a24003cb0 con 0x7f6a3010a920 2024-09-10T21:18:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.462+0000 7f6a3801c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac4d0f0 0x561e4ac4d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.462+0000 7f6a3801c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4da10 0x561e4ac59460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.462+0000 7f6a3801c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac599a0 0x561e4ac5bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.462+0000 7f6a3801c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561e4abc3ea0 con 0x561e4ac4da10 2024-09-10T21:18:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.462+0000 7f6a3801c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561e4abb32d0 con 0x561e4ac4d0f0 2024-09-10T21:18:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.462+0000 7f6a3801c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561e4abb70e0 con 0x561e4ac599a0 2024-09-10T21:18:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.462+0000 7f6a2f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4da10 0x561e4ac59460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.462+0000 7f6a2f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4da10 0x561e4ac59460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49524/0 (socket says 172.21.15.59:49524) 2024-09-10T21:18:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.462+0000 7f6a2f7fe640 1 -- 172.21.15.59:0/1800434587 learned_addr learned my addr 172.21.15.59:0/1800434587 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.463+0000 7f6a2effd640 1 --2- 172.21.15.59:0/1800434587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac599a0 0x561e4ac5bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.463+0000 7f6a2ffff640 1 --2- 172.21.15.59:0/1800434587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac4d0f0 0x561e4ac4d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.463+0000 7f6a2f7fe640 1 -- 172.21.15.59:0/1800434587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac599a0 msgr2=0x561e4ac5bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.463+0000 7f6a2f7fe640 1 --2- 172.21.15.59:0/1800434587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac599a0 0x561e4ac5bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.463+0000 7f6a2f7fe640 1 -- 172.21.15.59:0/1800434587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac4d0f0 msgr2=0x561e4ac4d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.463+0000 7f6a2f7fe640 1 --2- 172.21.15.59:0/1800434587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac4d0f0 0x561e4ac4d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.463+0000 7f6a2f7fe640 1 -- 172.21.15.59:0/1800434587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e4a911650 con 0x561e4ac4da10 2024-09-10T21:18:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.463+0000 7f6a2ffff640 1 --2- 172.21.15.59:0/1800434587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac4d0f0 0x561e4ac4d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.463+0000 7f6a2f7fe640 1 --2- 172.21.15.59:0/1800434587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4da10 0x561e4ac59460 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000ad00 tx=0x7f6a2000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a8e050d59cb393 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.463+0000 7f6a15ffb640 1 -- 172.21.15.59:0/1800434587 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2001d070 con 0x561e4ac4da10 2024-09-10T21:18:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.463+0000 7f6a2cff9640 1 --2- 172.21.15.59:0/3848429361 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6a180b52e0 0x7f6a180b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.463+0000 7f6a15ffb640 1 -- 172.21.15.59:0/1800434587 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a20018af0 con 0x561e4ac4da10 2024-09-10T21:18:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.463+0000 7f6a15ffb640 1 -- 172.21.15.59:0/1800434587 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20010ae0 con 0x561e4ac4da10 2024-09-10T21:18:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.463+0000 7f6a2ffff640 1 --2- 172.21.15.59:0/3848429361 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6a180b52e0 0x7f6a180b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.463+0000 7f6a2cff9640 1 -- 172.21.15.59:0/3848429361 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6a24106430 con 0x7f6a3010a920 2024-09-10T21:18:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.464+0000 7f6a3801c740 1 -- 172.21.15.59:0/1800434587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4da10 msgr2=0x561e4ac59460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.464+0000 7f6a2ffff640 1 --2- 172.21.15.59:0/3848429361 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6a180b52e0 0x7f6a180b77a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800ae30 tx=0x7f6a2800a4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.464+0000 7f6a3801c740 1 --2- 172.21.15.59:0/1800434587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4da10 0x561e4ac59460 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000ad00 tx=0x7f6a2000f790 comp rx=0 tx=0).stop 2024-09-10T21:18:50.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.464+0000 7f6a3801c740 1 -- 172.21.15.59:0/1800434587 shutdown_connections 2024-09-10T21:18:50.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.464+0000 7f6a3801c740 1 --2- 172.21.15.59:0/1800434587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac599a0 0x561e4ac5bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.464+0000 7f6a3801c740 1 --2- 172.21.15.59:0/1800434587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4da10 0x561e4ac59460 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.464+0000 7f6a3801c740 1 --2- 172.21.15.59:0/1800434587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac4d0f0 0x561e4ac4d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.464+0000 7f6a3801c740 1 -- 172.21.15.59:0/1800434587 >> 172.21.15.59:0/1800434587 conn(0x561e4ac4af20 msgr2=0x561e4ac4c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:50.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.464+0000 7f6a3801c740 1 -- 172.21.15.59:0/1800434587 shutdown_connections 2024-09-10T21:18:50.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.464+0000 7f6a3801c740 1 -- 172.21.15.59:0/1800434587 wait complete. 2024-09-10T21:18:50.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.464+0000 7f6a3801c740 1 -- start start 2024-09-10T21:18:50.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.465+0000 7f6a3801c740 1 Processor -- start 2024-09-10T21:18:50.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.465+0000 7f6a3801c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4d0f0 0x561e4ac592e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:50.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.465+0000 7f6a3801c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac4da10 0x561e4ac56730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:50.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.465+0000 7f6a3801c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac599a0 0x561e4ac56db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:50.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.465+0000 7f6a3801c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561e4aa14700 con 0x561e4ac4d0f0 2024-09-10T21:18:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.465+0000 7f6a3801c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561e4ab4e160 con 0x561e4ac4da10 2024-09-10T21:18:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.465+0000 7f6a3801c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561e4ac5c620 con 0x561e4ac599a0 2024-09-10T21:18:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.465+0000 7f6a3801c740 10 client.0 _ll_register_callbacks cb 0x561e4ab679e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.465+0000 7f6a2f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4d0f0 0x561e4ac592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.465+0000 7f6a2f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4d0f0 0x561e4ac592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49538/0 (socket says 172.21.15.59:49538) 2024-09-10T21:18:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.465+0000 7f6a2f7fe640 1 -- 172.21.15.59:0/1481776469 learned_addr learned my addr 172.21.15.59:0/1481776469 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.465+0000 7f6a2ffff640 1 --2- 172.21.15.59:0/1481776469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac599a0 0x561e4ac56db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.465+0000 7f6a2effd640 1 --2- 172.21.15.59:0/1481776469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac4da10 0x561e4ac56730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.465+0000 7f6a2f7fe640 1 -- 172.21.15.59:0/1481776469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac599a0 msgr2=0x561e4ac56db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.465+0000 7f6a2f7fe640 1 --2- 172.21.15.59:0/1481776469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac599a0 0x561e4ac56db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.465+0000 7f6a2f7fe640 1 -- 172.21.15.59:0/1481776469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac4da10 msgr2=0x561e4ac56730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.465+0000 7f6a2f7fe640 1 --2- 172.21.15.59:0/1481776469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac4da10 0x561e4ac56730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.465+0000 7f6a2f7fe640 1 -- 172.21.15.59:0/1481776469 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e4ab7bc90 con 0x561e4ac4d0f0 2024-09-10T21:18:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.466+0000 7f6a2f7fe640 1 --2- 172.21.15.59:0/1481776469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4d0f0 0x561e4ac592e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6a2001b040 tx=0x7f6a200186f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6481ba597360f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.466+0000 7f6a0effd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.466+0000 7f6a0effd640 1 -- 172.21.15.59:0/1481776469 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20026020 con 0x561e4ac4d0f0 2024-09-10T21:18:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.466+0000 7f6a3801c740 1 -- 172.21.15.59:0/1481776469 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a20018af0 con 0x561e4ac4d0f0 2024-09-10T21:18:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.466+0000 7f6a0effd640 1 -- 172.21.15.59:0/1481776469 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6a20010a80 con 0x561e4ac4d0f0 2024-09-10T21:18:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.466+0000 7f6a0effd640 1 -- 172.21.15.59:0/1481776469 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6a2001d070 con 0x561e4ac4d0f0 2024-09-10T21:18:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.466+0000 7f6a3801c740 10 client.16218 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.466+0000 7f6a3801c740 1 -- 172.21.15.59:0/1481776469 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561e4ac67f40 con 0x561e4ac4d0f0 2024-09-10T21:18:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.466+0000 7f6a0effd640 1 -- 172.21.15.59:0/1481776469 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a20018af0 con 0x561e4ac4d0f0 2024-09-10T21:18:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.466+0000 7f6a0effd640 1 -- 172.21.15.59:0/1481776469 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6a200046c0 con 0x561e4ac4d0f0 2024-09-10T21:18:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.466+0000 7f6a3801c740 10 client.16218 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.466+0000 7f6a3801c740 10 client.16218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:18:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.466+0000 7f6a3801c740 20 client.16218 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.466+0000 7f6a3801c740 1 --2- 172.21.15.59:0/1481776469 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561e4ac69290 0x561e4ac6b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.466+0000 7f6a3801c740 4 client.16218 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:18:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.466+0000 7f6a3801c740 1 -- 172.21.15.59:0/1481776469 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e4abc5df0 con 0x561e4ac69290 2024-09-10T21:18:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.467+0000 7f6a2effd640 1 --2- 172.21.15.59:0/1481776469 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561e4ac69290 0x561e4ac6b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.467+0000 7f6a0effd640 10 client.16218 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.467+0000 7f6a2effd640 1 --2- 172.21.15.59:0/1481776469 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561e4ac69290 0x561e4ac6b680 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60e8ea35332e7df8 server_cookie=62bc12d448019acd in_seq=0 out_seq=0 2024-09-10T21:18:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.468+0000 7f6a0effd640 1 -- 172.21.15.59:0/1481776469 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e4abc5df0 con 0x561e4ac69290 2024-09-10T21:18:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.468+0000 7f6a0effd640 10 client.16218 handle_command_reply: tid=0 2024-09-10T21:18:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.468+0000 7f6a3801c740 1 client.16218 shutdown 2024-09-10T21:18:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.468+0000 7f6a3801c740 1 -- 172.21.15.59:0/1481776469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4d0f0 msgr2=0x561e4ac592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.468+0000 7f6a3801c740 1 --2- 172.21.15.59:0/1481776469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4d0f0 0x561e4ac592e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6a2001b040 tx=0x7f6a200186f0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.468+0000 7f6a3801c740 1 -- 172.21.15.59:0/1481776469 shutdown_connections 2024-09-10T21:18:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.468+0000 7f6a3801c740 1 --2- 172.21.15.59:0/1481776469 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac599a0 0x561e4ac56db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.468+0000 7f6a3801c740 1 --2- 172.21.15.59:0/1481776469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac4da10 0x561e4ac56730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.468+0000 7f6a3801c740 1 --2- 172.21.15.59:0/1481776469 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561e4ac69290 0x561e4ac6b680 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.468+0000 7f6a3801c740 1 --2- 172.21.15.59:0/1481776469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4d0f0 0x561e4ac592e0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.468+0000 7f6a0effd640 0 client.16218 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.468+0000 7f6a3801c740 1 -- 172.21.15.59:0/1481776469 >> 172.21.15.59:0/1481776469 conn(0x561e4ac4af20 msgr2=0x561e4ac50ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.468+0000 7f6a3801c740 1 -- 172.21.15.59:0/1481776469 shutdown_connections 2024-09-10T21:18:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.468+0000 7f6a3801c740 1 -- 172.21.15.59:0/1481776469 wait complete. 2024-09-10T21:18:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.468+0000 7f6a3801c740 20 client.16218 trim_cache size 0 max 16384 2024-09-10T21:18:50.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.482+0000 7f6a3801c740 1 Processor -- start 2024-09-10T21:18:50.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.482+0000 7f6a3801c740 1 -- start start 2024-09-10T21:18:50.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.482+0000 7f6a3801c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac4d0f0 0x561e4ac4a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:50.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.482+0000 7f6a3801c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac4da10 0x561e4ac54fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:50.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.482+0000 7f6a3801c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac599a0 0x561e4ac554f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:50.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.482+0000 7f6a3801c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6a301b0500 con 0x561e4ac599a0 2024-09-10T21:18:50.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.482+0000 7f6a3801c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6a301b2040 con 0x561e4ac4da10 2024-09-10T21:18:50.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.482+0000 7f6a3801c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6a301b0bd0 con 0x561e4ac4d0f0 2024-09-10T21:18:50.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.482+0000 7f6a2f7fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac4d0f0 0x561e4ac4a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:50.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.482+0000 7f6a2effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac4da10 0x561e4ac54fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:50.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.482+0000 7f6a2f7fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac4d0f0 0x561e4ac4a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:44736/0 (socket says 172.21.15.59:44736) 2024-09-10T21:18:50.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.482+0000 7f6a2f7fe640 1 -- 172.21.15.59:0/3797938698 learned_addr learned my addr 172.21.15.59:0/3797938698 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:50.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.482+0000 7f6a2ffff640 1 --2- 172.21.15.59:0/3797938698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac599a0 0x561e4ac554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:50.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.483+0000 7f6a2effd640 1 -- 172.21.15.59:0/3797938698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac4d0f0 msgr2=0x561e4ac4a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:50.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.483+0000 7f6a2effd640 1 --2- 172.21.15.59:0/3797938698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac4d0f0 0x561e4ac4a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.483+0000 7f6a2effd640 1 -- 172.21.15.59:0/3797938698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac599a0 msgr2=0x561e4ac554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:50.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.483+0000 7f6a2effd640 1 --2- 172.21.15.59:0/3797938698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac599a0 0x561e4ac554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.483+0000 7f6a2effd640 1 -- 172.21.15.59:0/3797938698 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e4ac4d840 con 0x561e4ac4da10 2024-09-10T21:18:50.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.483+0000 7f6a2f7fe640 1 --2- 172.21.15.59:0/3797938698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac4d0f0 0x561e4ac4a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:18:50.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.483+0000 7f6a2effd640 1 --2- 172.21.15.59:0/3797938698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac4da10 0x561e4ac54fb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6a24103fb0 tx=0x7f6a24103e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81c3bc2e2be23ff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:50.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.483+0000 7f6a157fa640 1 -- 172.21.15.59:0/3797938698 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24049040 con 0x561e4ac4da10 2024-09-10T21:18:50.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.483+0000 7f6a157fa640 1 -- 172.21.15.59:0/3797938698 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a240cc730 con 0x561e4ac4da10 2024-09-10T21:18:50.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.483+0000 7f6a157fa640 1 -- 172.21.15.59:0/3797938698 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a240d61b0 con 0x561e4ac4da10 2024-09-10T21:18:50.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.484+0000 7f6a3801c740 1 -- 172.21.15.59:0/3797938698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac4da10 msgr2=0x561e4ac54fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:50.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.484+0000 7f6a3801c740 1 --2- 172.21.15.59:0/3797938698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac4da10 0x561e4ac54fb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6a24103fb0 tx=0x7f6a24103e30 comp rx=0 tx=0).stop 2024-09-10T21:18:50.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.484+0000 7f6a3801c740 1 -- 172.21.15.59:0/3797938698 shutdown_connections 2024-09-10T21:18:50.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.484+0000 7f6a3801c740 1 --2- 172.21.15.59:0/3797938698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac599a0 0x561e4ac554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.484+0000 7f6a3801c740 1 --2- 172.21.15.59:0/3797938698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac4da10 0x561e4ac54fb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.484+0000 7f6a3801c740 1 --2- 172.21.15.59:0/3797938698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac4d0f0 0x561e4ac4a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.484+0000 7f6a3801c740 1 -- 172.21.15.59:0/3797938698 >> 172.21.15.59:0/3797938698 conn(0x561e4ac4af20 msgr2=0x561e4ac4bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:50.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.484+0000 7f6a3801c740 1 -- 172.21.15.59:0/3797938698 shutdown_connections 2024-09-10T21:18:50.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.484+0000 7f6a3801c740 1 -- 172.21.15.59:0/3797938698 wait complete. 2024-09-10T21:18:50.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.484+0000 7f6a3801c740 1 -- start start 2024-09-10T21:18:50.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.485+0000 7f6a3801c740 1 Processor -- start 2024-09-10T21:18:50.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.485+0000 7f6a3801c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4d0f0 0x561e4ac71680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:50.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.485+0000 7f6a3801c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac4da10 0x561e4ac61910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:50.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.485+0000 7f6a3801c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac599a0 0x561e4ac620a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:50.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.485+0000 7f6a3801c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6a301b1970 con 0x561e4ac4d0f0 2024-09-10T21:18:50.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.485+0000 7f6a3801c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6a301b12a0 con 0x561e4ac599a0 2024-09-10T21:18:50.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.485+0000 7f6a3801c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6a301ae4e0 con 0x561e4ac4da10 2024-09-10T21:18:50.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.485+0000 7f6a3801c740 10 client.0 _ll_register_callbacks cb 0x7f6a2001b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:50.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.485+0000 7f6a2f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4d0f0 0x561e4ac71680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:50.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.485+0000 7f6a2f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4d0f0 0x561e4ac71680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49560/0 (socket says 172.21.15.59:49560) 2024-09-10T21:18:50.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.485+0000 7f6a2f7fe640 1 -- 172.21.15.59:0/3295168542 learned_addr learned my addr 172.21.15.59:0/3295168542 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:50.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.485+0000 7f6a2effd640 1 --2- 172.21.15.59:0/3295168542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac4da10 0x561e4ac61910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:50.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.485+0000 7f6a2ffff640 1 --2- 172.21.15.59:0/3295168542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac599a0 0x561e4ac620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:50.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.486+0000 7f6a2f7fe640 1 -- 172.21.15.59:0/3295168542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac4da10 msgr2=0x561e4ac61910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:50.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.486+0000 7f6a2f7fe640 1 --2- 172.21.15.59:0/3295168542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac4da10 0x561e4ac61910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.486+0000 7f6a2f7fe640 1 -- 172.21.15.59:0/3295168542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac599a0 msgr2=0x561e4ac620a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.486+0000 7f6a2f7fe640 1 --2- 172.21.15.59:0/3295168542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac599a0 0x561e4ac620a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.486+0000 7f6a2f7fe640 1 -- 172.21.15.59:0/3295168542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e4ac5c920 con 0x561e4ac4d0f0 2024-09-10T21:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.486+0000 7f6a2ffff640 1 --2- 172.21.15.59:0/3295168542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac599a0 0x561e4ac620a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.486+0000 7f6a2f7fe640 1 --2- 172.21.15.59:0/3295168542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4d0f0 0x561e4ac71680 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6a2002f040 tx=0x7f6a20004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1eef6953745505e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.486+0000 7f6a0effd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.486+0000 7f6a0effd640 1 -- 172.21.15.59:0/3295168542 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2003b060 con 0x561e4ac4d0f0 2024-09-10T21:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.486+0000 7f6a0effd640 1 -- 172.21.15.59:0/3295168542 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6a200109f0 con 0x561e4ac4d0f0 2024-09-10T21:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.486+0000 7f6a3801c740 1 -- 172.21.15.59:0/3295168542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a240cc730 con 0x561e4ac4d0f0 2024-09-10T21:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.486+0000 7f6a0effd640 1 -- 172.21.15.59:0/3295168542 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6a20026040 con 0x561e4ac4d0f0 2024-09-10T21:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.486+0000 7f6a3801c740 10 client.16224 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.486+0000 7f6a3801c740 1 -- 172.21.15.59:0/3295168542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561e4acd6200 con 0x561e4ac4d0f0 2024-09-10T21:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.487+0000 7f6a0effd640 1 -- 172.21.15.59:0/3295168542 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a240cc730 con 0x561e4ac4d0f0 2024-09-10T21:18:50.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.487+0000 7f6a0effd640 1 -- 172.21.15.59:0/3295168542 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6a200051c0 con 0x561e4ac4d0f0 2024-09-10T21:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.487+0000 7f6a3801c740 10 client.16224 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.487+0000 7f6a3801c740 10 client.16224 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.487+0000 7f6a3801c740 20 client.16224 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.487+0000 7f6a3801c740 1 --2- 172.21.15.59:0/3295168542 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561e4acd69b0 0x561e4acd8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.487+0000 7f6a3801c740 4 client.16224 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.487+0000 7f6a3801c740 1 -- 172.21.15.59:0/3295168542 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561e4abc18a0 con 0x561e4acd69b0 2024-09-10T21:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.487+0000 7f6a2effd640 1 --2- 172.21.15.59:0/3295168542 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561e4acd69b0 0x561e4acd8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.487+0000 7f6a2effd640 1 --2- 172.21.15.59:0/3295168542 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561e4acd69b0 0x561e4acd8dd0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1e9e3613cf9b46f server_cookie=4522ab74bc174 in_seq=0 out_seq=0 2024-09-10T21:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.488+0000 7f6a0effd640 10 client.16224 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.488+0000 7f6a0effd640 1 -- 172.21.15.59:0/3295168542 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561e4abc18a0 con 0x561e4acd69b0 2024-09-10T21:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.488+0000 7f6a0effd640 10 client.16224 handle_command_reply: tid=0 2024-09-10T21:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.488+0000 7f6a3801c740 1 client.16224 shutdown 2024-09-10T21:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.488+0000 7f6a3801c740 1 -- 172.21.15.59:0/3295168542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4d0f0 msgr2=0x561e4ac71680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:50.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.488+0000 7f6a3801c740 1 --2- 172.21.15.59:0/3295168542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4d0f0 0x561e4ac71680 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6a2002f040 tx=0x7f6a20004970 comp rx=0 tx=0).stop 2024-09-10T21:18:50.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.488+0000 7f6a3801c740 1 -- 172.21.15.59:0/3295168542 shutdown_connections 2024-09-10T21:18:50.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.488+0000 7f6a3801c740 1 --2- 172.21.15.59:0/3295168542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561e4ac599a0 0x561e4ac620a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.488+0000 7f6a3801c740 1 --2- 172.21.15.59:0/3295168542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561e4ac4da10 0x561e4ac61910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.488+0000 7f6a3801c740 1 --2- 172.21.15.59:0/3295168542 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561e4acd69b0 0x561e4acd8dd0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.488+0000 7f6a3801c740 1 --2- 172.21.15.59:0/3295168542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561e4ac4d0f0 0x561e4ac71680 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.488+0000 7f6a0effd640 0 client.16224 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:50.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.488+0000 7f6a3801c740 1 -- 172.21.15.59:0/3295168542 >> 172.21.15.59:0/3295168542 conn(0x561e4ac4af20 msgr2=0x561e4ac4bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:50.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.488+0000 7f6a3801c740 1 -- 172.21.15.59:0/3295168542 shutdown_connections 2024-09-10T21:18:50.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.488+0000 7f6a3801c740 1 -- 172.21.15.59:0/3295168542 wait complete. 2024-09-10T21:18:50.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.488+0000 7f6a3801c740 20 client.16224 trim_cache size 0 max 16384 2024-09-10T21:18:50.506 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:18:50.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.489+0000 7f6a35c47640 1 -- 172.21.15.59:0/3848429361 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6a180b52e0 msgr2=0x7f6a180b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:50.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.489+0000 7f6a35c47640 1 --2- 172.21.15.59:0/3848429361 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6a180b52e0 0x7f6a180b77a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800ae30 tx=0x7f6a2800a4d0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.489+0000 7f6a35c47640 1 -- 172.21.15.59:0/3848429361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a3010a920 msgr2=0x7f6a3019b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:50.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.489+0000 7f6a35c47640 1 --2- 172.21.15.59:0/3848429361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a3010a920 0x7f6a3019b9f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6a24006010 tx=0x7f6a240042f0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.489+0000 7f6a35c47640 1 -- 172.21.15.59:0/3848429361 shutdown_connections 2024-09-10T21:18:50.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.489+0000 7f6a35c47640 1 --2- 172.21.15.59:0/3848429361 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6a180b52e0 0x7f6a180b77a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.489+0000 7f6a35c47640 1 --2- 172.21.15.59:0/3848429361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a3010d250 0x7f6a301a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.489+0000 7f6a35c47640 1 --2- 172.21.15.59:0/3848429361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a3010a920 0x7f6a3019b9f0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.489+0000 7f6a35c47640 1 --2- 172.21.15.59:0/3848429361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a30101810 0x7f6a3019b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:50.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.489+0000 7f6a35c47640 1 -- 172.21.15.59:0/3848429361 >> 172.21.15.59:0/3848429361 conn(0x7f6a30076f50 msgr2=0x7f6a30108ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:50.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.489+0000 7f6a35c47640 1 -- 172.21.15.59:0/3848429361 shutdown_connections 2024-09-10T21:18:50.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:50.489+0000 7f6a35c47640 1 -- 172.21.15.59:0/3848429361 wait complete. 2024-09-10T21:18:51.264 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:50 smithi059 ceph-mon[30888]: pgmap v447: 97 pgs: 97 active+clean; 2.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:51.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:50 smithi192 ceph-mon[35363]: pgmap v447: 97 pgs: 97 active+clean; 2.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:51.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:50 smithi154 ceph-mon[35041]: pgmap v447: 97 pgs: 97 active+clean; 2.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:52.297 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:18:52.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:18:52.570 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:18:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.058+0000 7f56a8234640 1 -- 172.21.15.59:0/3758151225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a0101c90 msgr2=0x7f56a0102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.058+0000 7f56a8234640 1 --2- 172.21.15.59:0/3758151225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a0101c90 0x7f56a0102070 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f569c009900 tx=0x7f569c02a410 comp rx=0 tx=0).stop 2024-09-10T21:18:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.058+0000 7f56a8234640 1 -- 172.21.15.59:0/3758151225 shutdown_connections 2024-09-10T21:18:53.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.058+0000 7f56a8234640 1 --2- 172.21.15.59:0/3758151225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56a0108020 0x7f56a010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.058+0000 7f56a8234640 1 --2- 172.21.15.59:0/3758151225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56a01076a0 0x7f56a0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.058+0000 7f56a8234640 1 --2- 172.21.15.59:0/3758151225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a0101c90 0x7f56a0102070 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.058+0000 7f56a8234640 1 -- 172.21.15.59:0/3758151225 >> 172.21.15.59:0/3758151225 conn(0x7f56a00fd700 msgr2=0x7f56a00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:53.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.058+0000 7f56a8234640 1 -- 172.21.15.59:0/3758151225 shutdown_connections 2024-09-10T21:18:53.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.058+0000 7f56a8234640 1 -- 172.21.15.59:0/3758151225 wait complete. 2024-09-10T21:18:53.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.059+0000 7f56a8234640 1 Processor -- start 2024-09-10T21:18:53.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.059+0000 7f56a8234640 1 -- start start 2024-09-10T21:18:53.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.059+0000 7f56a8234640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56a0101c90 0x7f56a019a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:53.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.059+0000 7f56a8234640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56a01076a0 0x7f56a019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:53.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.059+0000 7f56a8234640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a0108020 0x7f56a019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:53.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.059+0000 7f56a8234640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f56a0111ce0 con 0x7f56a0108020 2024-09-10T21:18:53.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.059+0000 7f56a8234640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56a0111b60 con 0x7f56a01076a0 2024-09-10T21:18:53.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.059+0000 7f56a8234640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f56a0111e60 con 0x7f56a0101c90 2024-09-10T21:18:53.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.059+0000 7f56a67d1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a0108020 0x7f56a019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:53.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.059+0000 7f56a67d1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a0108020 0x7f56a019abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49566/0 (socket says 172.21.15.59:49566) 2024-09-10T21:18:53.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.059+0000 7f56a67d1640 1 -- 172.21.15.59:0/2006923461 learned_addr learned my addr 172.21.15.59:0/2006923461 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:53.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.060+0000 7f56a5fd0640 1 --2- 172.21.15.59:0/2006923461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56a0101c90 0x7f56a019a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.060+0000 7f56a57cf640 1 --2- 172.21.15.59:0/2006923461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56a01076a0 0x7f56a019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.060+0000 7f56a67d1640 1 -- 172.21.15.59:0/2006923461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56a0101c90 msgr2=0x7f56a019a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.060+0000 7f56a67d1640 1 --2- 172.21.15.59:0/2006923461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56a0101c90 0x7f56a019a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.060+0000 7f56a67d1640 1 -- 172.21.15.59:0/2006923461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56a01076a0 msgr2=0x7f56a019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.060+0000 7f56a67d1640 1 --2- 172.21.15.59:0/2006923461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56a01076a0 0x7f56a019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.060+0000 7f56a67d1640 1 -- 172.21.15.59:0/2006923461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a01a54f0 con 0x7f56a0108020 2024-09-10T21:18:53.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.060+0000 7f56a57cf640 1 --2- 172.21.15.59:0/2006923461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56a01076a0 0x7f56a019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:53.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.060+0000 7f56a67d1640 1 --2- 172.21.15.59:0/2006923461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a0108020 0x7f56a019abb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f569800cad0 tx=0x7f569800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:53.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.060+0000 7f5696ffd640 1 -- 172.21.15.59:0/2006923461 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569800ae20 con 0x7f56a0108020 2024-09-10T21:18:53.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.060+0000 7f56a8234640 1 -- 172.21.15.59:0/2006923461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56a01a57e0 con 0x7f56a0108020 2024-09-10T21:18:53.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.060+0000 7f5696ffd640 1 -- 172.21.15.59:0/2006923461 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5698005020 con 0x7f56a0108020 2024-09-10T21:18:53.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.060+0000 7f5696ffd640 1 -- 172.21.15.59:0/2006923461 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569800f6b0 con 0x7f56a0108020 2024-09-10T21:18:53.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.060+0000 7f56a8234640 1 -- 172.21.15.59:0/2006923461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56a01a5cd0 con 0x7f56a0108020 2024-09-10T21:18:53.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.063+0000 7f56aa609740 1 Processor -- start 2024-09-10T21:18:53.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.063+0000 7f5696ffd640 1 -- 172.21.15.59:0/2006923461 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f56980054f0 con 0x7f56a0108020 2024-09-10T21:18:53.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.063+0000 7f56aa609740 1 -- start start 2024-09-10T21:18:53.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.063+0000 7f56aa609740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562152890ee0 0x5621528912c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:53.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.063+0000 7f56aa609740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152891800 0x56215289d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:53.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.063+0000 7f56aa609740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56215289d790 0x56215289fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:53.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.063+0000 7f56aa609740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562152807e60 con 0x562152891800 2024-09-10T21:18:53.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.063+0000 7f56aa609740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5621527f7290 con 0x562152890ee0 2024-09-10T21:18:53.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.063+0000 7f56aa609740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5621527fb0a0 con 0x56215289d790 2024-09-10T21:18:53.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.064+0000 7f56a5fd0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152891800 0x56215289d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:53.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.064+0000 7f56a5fd0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152891800 0x56215289d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49574/0 (socket says 172.21.15.59:49574) 2024-09-10T21:18:53.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.064+0000 7f56a5fd0640 1 -- 172.21.15.59:0/1089645394 learned_addr learned my addr 172.21.15.59:0/1089645394 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:53.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.064+0000 7f56a57cf640 1 --2- 172.21.15.59:0/1089645394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562152890ee0 0x5621528912c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:53.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.064+0000 7f56a57cf640 1 --2- 172.21.15.59:0/1089645394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56215289d790 0x56215289fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:53.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.064+0000 7f56a5fd0640 1 -- 172.21.15.59:0/1089645394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56215289d790 msgr2=0x56215289fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:53.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.064+0000 7f56a5fd0640 1 --2- 172.21.15.59:0/1089645394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56215289d790 0x56215289fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.064+0000 7f56a5fd0640 1 -- 172.21.15.59:0/1089645394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562152890ee0 msgr2=0x5621528912c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:53.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.064+0000 7f56a5fd0640 1 --2- 172.21.15.59:0/1089645394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562152890ee0 0x5621528912c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.064+0000 7f56a5fd0640 1 -- 172.21.15.59:0/1089645394 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562152555930 con 0x562152891800 2024-09-10T21:18:53.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.064+0000 7f56a57cf640 1 --2- 172.21.15.59:0/1089645394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56215289d790 0x56215289fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:53.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.064+0000 7f56a5fd0640 1 --2- 172.21.15.59:0/1089645394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152891800 0x56215289d250 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f569c009900 tx=0x7f569c032c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad6b49ce07d4c09 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:53.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.064+0000 7f5696ffd640 1 --2- 172.21.15.59:0/2006923461 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f568c0b52e0 0x7f568c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:53.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.064+0000 7f568bfff640 1 -- 172.21.15.59:0/1089645394 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c035030 con 0x562152891800 2024-09-10T21:18:53.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.064+0000 7f56a57cf640 1 --2- 172.21.15.59:0/2006923461 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f568c0b52e0 0x7f568c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:53.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.064+0000 7f5696ffd640 1 -- 172.21.15.59:0/2006923461 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f56980e5ca0 con 0x7f56a0108020 2024-09-10T21:18:53.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.064+0000 7f568bfff640 1 -- 172.21.15.59:0/1089645394 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f569c032e20 con 0x562152891800 2024-09-10T21:18:53.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.064+0000 7f568bfff640 1 -- 172.21.15.59:0/1089645394 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c0055f0 con 0x562152891800 2024-09-10T21:18:53.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.065+0000 7f56a57cf640 1 --2- 172.21.15.59:0/2006923461 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f568c0b52e0 0x7f568c0b77a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f56900058c0 tx=0x7f5690014040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:53.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.065+0000 7f56aa609740 1 -- 172.21.15.59:0/1089645394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152891800 msgr2=0x56215289d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:53.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.065+0000 7f56aa609740 1 --2- 172.21.15.59:0/1089645394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152891800 0x56215289d250 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f569c009900 tx=0x7f569c032c30 comp rx=0 tx=0).stop 2024-09-10T21:18:53.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.065+0000 7f56aa609740 1 -- 172.21.15.59:0/1089645394 shutdown_connections 2024-09-10T21:18:53.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.065+0000 7f56aa609740 1 --2- 172.21.15.59:0/1089645394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56215289d790 0x56215289fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.065+0000 7f56aa609740 1 --2- 172.21.15.59:0/1089645394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152891800 0x56215289d250 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.065+0000 7f56aa609740 1 --2- 172.21.15.59:0/1089645394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562152890ee0 0x5621528912c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.065+0000 7f56aa609740 1 -- 172.21.15.59:0/1089645394 >> 172.21.15.59:0/1089645394 conn(0x56215288ed10 msgr2=0x56215288feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:53.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.065+0000 7f56aa609740 1 -- 172.21.15.59:0/1089645394 shutdown_connections 2024-09-10T21:18:53.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.065+0000 7f56aa609740 1 -- 172.21.15.59:0/1089645394 wait complete. 2024-09-10T21:18:53.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.066+0000 7f56aa609740 1 -- start start 2024-09-10T21:18:53.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.066+0000 7f56aa609740 1 Processor -- start 2024-09-10T21:18:53.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.066+0000 7f56aa609740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 0x56215289a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:53.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.066+0000 7f56aa609740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562152891800 0x56215289ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:53.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.066+0000 7f56aa609740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215289d790 0x56215289b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:53.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.066+0000 7f56aa609740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562152658890 con 0x562152890ee0 2024-09-10T21:18:53.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.066+0000 7f56aa609740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562152791d40 con 0x56215289d790 2024-09-10T21:18:53.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.066+0000 7f56aa609740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5621528a03e0 con 0x562152891800 2024-09-10T21:18:53.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.066+0000 7f56aa609740 10 client.0 _ll_register_callbacks cb 0x5621527f5c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:53.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.066+0000 7f56a5fd0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 0x56215289a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:53.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.066+0000 7f56a5fd0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 0x56215289a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49586/0 (socket says 172.21.15.59:49586) 2024-09-10T21:18:53.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.066+0000 7f56a5fd0640 1 -- 172.21.15.59:0/3222284795 learned_addr learned my addr 172.21.15.59:0/3222284795 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:53.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.067+0000 7f56a57cf640 1 --2- 172.21.15.59:0/3222284795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562152891800 0x56215289ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:53.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.067+0000 7f56a67d1640 1 --2- 172.21.15.59:0/3222284795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215289d790 0x56215289b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:53.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.067+0000 7f56a5fd0640 1 -- 172.21.15.59:0/3222284795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562152891800 msgr2=0x56215289ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:53.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.067+0000 7f56a5fd0640 1 --2- 172.21.15.59:0/3222284795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562152891800 0x56215289ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.067+0000 7f56a5fd0640 1 -- 172.21.15.59:0/3222284795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215289d790 msgr2=0x56215289b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:53.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.067+0000 7f56a5fd0640 1 --2- 172.21.15.59:0/3222284795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215289d790 0x56215289b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.067+0000 7f56a5fd0640 1 -- 172.21.15.59:0/3222284795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621528a9810 con 0x562152890ee0 2024-09-10T21:18:53.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.067+0000 7f56a67d1640 1 --2- 172.21.15.59:0/3222284795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215289d790 0x56215289b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:53.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.067+0000 7f56a57cf640 1 --2- 172.21.15.59:0/3222284795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562152891800 0x56215289ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:53.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.067+0000 7f56a5fd0640 1 --2- 172.21.15.59:0/3222284795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 0x56215289a7a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f569c02a450 tx=0x7f569c031750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e21c593fdde3957 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:53.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.067+0000 7f56897fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:53.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.067+0000 7f56897fa640 1 -- 172.21.15.59:0/3222284795 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c035040 con 0x562152890ee0 2024-09-10T21:18:53.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.067+0000 7f56897fa640 1 -- 172.21.15.59:0/3222284795 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f569c004460 con 0x562152890ee0 2024-09-10T21:18:53.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.067+0000 7f56aa609740 1 -- 172.21.15.59:0/3222284795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f569c032e20 con 0x562152890ee0 2024-09-10T21:18:53.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.067+0000 7f56897fa640 1 -- 172.21.15.59:0/3222284795 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f569c0046c0 con 0x562152890ee0 2024-09-10T21:18:53.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.067+0000 7f56aa609740 10 client.16236 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:53.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.067+0000 7f56aa609740 1 -- 172.21.15.59:0/3222284795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5621528ac1c0 con 0x562152890ee0 2024-09-10T21:18:53.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.068+0000 7f56897fa640 1 -- 172.21.15.59:0/3222284795 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f569c032e20 con 0x562152890ee0 2024-09-10T21:18:53.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.068+0000 7f56897fa640 1 -- 172.21.15.59:0/3222284795 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f569c003b50 con 0x562152890ee0 2024-09-10T21:18:53.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.068+0000 7f56aa609740 10 client.16236 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:53.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.068+0000 7f56aa609740 10 client.16236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:18:53.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.068+0000 7f56aa609740 20 client.16236 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.068+0000 7f56aa609740 1 --2- 172.21.15.59:0/3222284795 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5621528ad510 0x5621528af900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.068+0000 7f56aa609740 4 client.16236 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:18:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.068+0000 7f56aa609740 1 -- 172.21.15.59:0/3222284795 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562152809db0 con 0x5621528ad510 2024-09-10T21:18:53.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.068+0000 7f56a57cf640 1 --2- 172.21.15.59:0/3222284795 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5621528ad510 0x5621528af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:53.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.069+0000 7f56a57cf640 1 --2- 172.21.15.59:0/3222284795 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5621528ad510 0x5621528af900 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e2da6063527c266 server_cookie=879ece41f775bbbc in_seq=0 out_seq=0 2024-09-10T21:18:53.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.069+0000 7f56897fa640 10 client.16236 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:53.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.069+0000 7f56897fa640 1 -- 172.21.15.59:0/3222284795 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562152809db0 con 0x5621528ad510 2024-09-10T21:18:53.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.070+0000 7f56897fa640 10 client.16236 handle_command_reply: tid=0 2024-09-10T21:18:53.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.070+0000 7f56aa609740 1 client.16236 shutdown 2024-09-10T21:18:53.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.070+0000 7f56aa609740 1 -- 172.21.15.59:0/3222284795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 msgr2=0x56215289a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:53.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.070+0000 7f56aa609740 1 --2- 172.21.15.59:0/3222284795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 0x56215289a7a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f569c02a450 tx=0x7f569c031750 comp rx=0 tx=0).stop 2024-09-10T21:18:53.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.070+0000 7f56aa609740 1 -- 172.21.15.59:0/3222284795 shutdown_connections 2024-09-10T21:18:53.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.070+0000 7f56aa609740 1 --2- 172.21.15.59:0/3222284795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56215289d790 0x56215289b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.070+0000 7f56aa609740 1 --2- 172.21.15.59:0/3222284795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562152891800 0x56215289ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.070+0000 7f56aa609740 1 --2- 172.21.15.59:0/3222284795 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5621528ad510 0x5621528af900 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.070+0000 7f56aa609740 1 --2- 172.21.15.59:0/3222284795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 0x56215289a7a0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.070+0000 7f56897fa640 0 client.16236 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:53.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.070+0000 7f56aa609740 1 -- 172.21.15.59:0/3222284795 >> 172.21.15.59:0/3222284795 conn(0x56215288ed10 msgr2=0x56215288df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:53.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.070+0000 7f56aa609740 1 -- 172.21.15.59:0/3222284795 shutdown_connections 2024-09-10T21:18:53.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.070+0000 7f56aa609740 1 -- 172.21.15.59:0/3222284795 wait complete. 2024-09-10T21:18:53.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.070+0000 7f56aa609740 20 client.16236 trim_cache size 0 max 16384 2024-09-10T21:18:53.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56aa609740 1 Processor -- start 2024-09-10T21:18:53.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56aa609740 1 -- start start 2024-09-10T21:18:53.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56aa609740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 0x56215289c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:53.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56aa609740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562152891800 0x5621528979d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:53.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56aa609740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56215289d790 0x562152897f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:53.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56aa609740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f56a01ae2b0 con 0x562152890ee0 2024-09-10T21:18:53.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56aa609740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56a01afdf0 con 0x562152891800 2024-09-10T21:18:53.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56aa609740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f56a01ae980 con 0x56215289d790 2024-09-10T21:18:53.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56a5fd0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 0x56215289c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:53.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56a5fd0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 0x56215289c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49588/0 (socket says 172.21.15.59:49588) 2024-09-10T21:18:53.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56a5fd0640 1 -- 172.21.15.59:0/898664042 learned_addr learned my addr 172.21.15.59:0/898664042 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:53.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56a57cf640 1 --2- 172.21.15.59:0/898664042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562152891800 0x5621528979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:53.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56a67d1640 1 --2- 172.21.15.59:0/898664042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56215289d790 0x562152897f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:53.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56a5fd0640 1 -- 172.21.15.59:0/898664042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56215289d790 msgr2=0x562152897f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:53.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56a5fd0640 1 --2- 172.21.15.59:0/898664042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56215289d790 0x562152897f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56a5fd0640 1 -- 172.21.15.59:0/898664042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562152891800 msgr2=0x5621528979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:53.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56a5fd0640 1 --2- 172.21.15.59:0/898664042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562152891800 0x5621528979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56a5fd0640 1 -- 172.21.15.59:0/898664042 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562152899700 con 0x562152890ee0 2024-09-10T21:18:53.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56a57cf640 1 --2- 172.21.15.59:0/898664042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562152891800 0x5621528979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:53.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.088+0000 7f56a67d1640 1 --2- 172.21.15.59:0/898664042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56215289d790 0x562152897f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:53.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.089+0000 7f56a5fd0640 1 --2- 172.21.15.59:0/898664042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 0x56215289c4e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f569c03b810 tx=0x7f569c005110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf5d5c08175d45 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:53.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.089+0000 7f568b7fe640 1 -- 172.21.15.59:0/898664042 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c035070 con 0x562152890ee0 2024-09-10T21:18:53.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.089+0000 7f568b7fe640 1 -- 172.21.15.59:0/898664042 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f569c04c070 con 0x562152890ee0 2024-09-10T21:18:53.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.089+0000 7f568b7fe640 1 -- 172.21.15.59:0/898664042 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c004860 con 0x562152890ee0 2024-09-10T21:18:53.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.089+0000 7f56aa609740 1 -- 172.21.15.59:0/898664042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 msgr2=0x56215289c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:53.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.089+0000 7f56aa609740 1 --2- 172.21.15.59:0/898664042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 0x56215289c4e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f569c03b810 tx=0x7f569c005110 comp rx=0 tx=0).stop 2024-09-10T21:18:53.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.089+0000 7f56aa609740 1 -- 172.21.15.59:0/898664042 shutdown_connections 2024-09-10T21:18:53.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.089+0000 7f56aa609740 1 --2- 172.21.15.59:0/898664042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56215289d790 0x562152897f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.089+0000 7f56aa609740 1 --2- 172.21.15.59:0/898664042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562152891800 0x5621528979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.089+0000 7f56aa609740 1 --2- 172.21.15.59:0/898664042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 0x56215289c4e0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.090+0000 7f56aa609740 1 -- 172.21.15.59:0/898664042 >> 172.21.15.59:0/898664042 conn(0x56215288ed10 msgr2=0x56215289bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:53.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.090+0000 7f56aa609740 1 -- 172.21.15.59:0/898664042 shutdown_connections 2024-09-10T21:18:53.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.090+0000 7f56aa609740 1 -- 172.21.15.59:0/898664042 wait complete. 2024-09-10T21:18:53.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.090+0000 7f56aa609740 1 -- start start 2024-09-10T21:18:53.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.090+0000 7f56aa609740 1 Processor -- start 2024-09-10T21:18:53.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56aa609740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 0x5621528a5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:53.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56aa609740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562152891800 0x5621528a5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:53.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56aa609740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56215289d790 0x5621528a2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:53.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56aa609740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f56a01af720 con 0x562152890ee0 2024-09-10T21:18:53.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56aa609740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f56a01af050 con 0x562152891800 2024-09-10T21:18:53.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56aa609740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f56a01ac290 con 0x56215289d790 2024-09-10T21:18:53.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56aa609740 10 client.0 _ll_register_callbacks cb 0x7f5690009990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:53.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56a5fd0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 0x5621528a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:53.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56a5fd0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 0x5621528a5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49592/0 (socket says 172.21.15.59:49592) 2024-09-10T21:18:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56a5fd0640 1 -- 172.21.15.59:0/906294712 learned_addr learned my addr 172.21.15.59:0/906294712 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56a57cf640 1 --2- 172.21.15.59:0/906294712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562152891800 0x5621528a5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56a67d1640 1 --2- 172.21.15.59:0/906294712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56215289d790 0x5621528a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56a5fd0640 1 -- 172.21.15.59:0/906294712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56215289d790 msgr2=0x5621528a2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56a5fd0640 1 --2- 172.21.15.59:0/906294712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56215289d790 0x5621528a2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56a5fd0640 1 -- 172.21.15.59:0/906294712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562152891800 msgr2=0x5621528a5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56a5fd0640 1 --2- 172.21.15.59:0/906294712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562152891800 0x5621528a5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56a5fd0640 1 -- 172.21.15.59:0/906294712 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621528a2f40 con 0x562152890ee0 2024-09-10T21:18:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56a5fd0640 1 --2- 172.21.15.59:0/906294712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 0x5621528a5990 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f569c03b450 tx=0x7f569c0044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d2352437f8301e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56897fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56897fa640 1 -- 172.21.15.59:0/906294712 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c061070 con 0x562152890ee0 2024-09-10T21:18:53.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56897fa640 1 -- 172.21.15.59:0/906294712 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f569c03b970 con 0x562152890ee0 2024-09-10T21:18:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.091+0000 7f56aa609740 1 -- 172.21.15.59:0/906294712 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f569c04c070 con 0x562152890ee0 2024-09-10T21:18:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.092+0000 7f56897fa640 1 -- 172.21.15.59:0/906294712 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f569c047070 con 0x562152890ee0 2024-09-10T21:18:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.092+0000 7f56aa609740 10 client.16242 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.092+0000 7f56aa609740 1 -- 172.21.15.59:0/906294712 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56215291acc0 con 0x562152890ee0 2024-09-10T21:18:53.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.092+0000 7f56897fa640 1 -- 172.21.15.59:0/906294712 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f569c04c070 con 0x562152890ee0 2024-09-10T21:18:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.092+0000 7f56897fa640 1 -- 172.21.15.59:0/906294712 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f569c05b020 con 0x562152890ee0 2024-09-10T21:18:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.092+0000 7f56aa609740 10 client.16242 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.092+0000 7f56aa609740 10 client.16242 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:18:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.092+0000 7f56aa609740 20 client.16242 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.092+0000 7f56aa609740 1 --2- 172.21.15.59:0/906294712 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56215291b1a0 0x56215291d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:53.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.092+0000 7f56aa609740 4 client.16242 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:18:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.092+0000 7f56aa609740 1 -- 172.21.15.59:0/906294712 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562152805860 con 0x56215291b1a0 2024-09-10T21:18:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.092+0000 7f56a57cf640 1 --2- 172.21.15.59:0/906294712 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56215291b1a0 0x56215291d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.093+0000 7f56a57cf640 1 --2- 172.21.15.59:0/906294712 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56215291b1a0 0x56215291d5c0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=655220d8508db69c server_cookie=1da6f899837ac8f0 in_seq=0 out_seq=0 2024-09-10T21:18:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.093+0000 7f56897fa640 10 client.16242 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:53.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.095+0000 7f56897fa640 1 -- 172.21.15.59:0/906294712 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562152805860 con 0x56215291b1a0 2024-09-10T21:18:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.095+0000 7f56897fa640 10 client.16242 handle_command_reply: tid=0 2024-09-10T21:18:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.095+0000 7f56aa609740 1 client.16242 shutdown 2024-09-10T21:18:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.095+0000 7f56aa609740 1 -- 172.21.15.59:0/906294712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 msgr2=0x5621528a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.095+0000 7f56aa609740 1 --2- 172.21.15.59:0/906294712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 0x5621528a5990 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f569c03b450 tx=0x7f569c0044e0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.095+0000 7f56aa609740 1 -- 172.21.15.59:0/906294712 shutdown_connections 2024-09-10T21:18:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.095+0000 7f56aa609740 1 --2- 172.21.15.59:0/906294712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56215289d790 0x5621528a2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.095+0000 7f56aa609740 1 --2- 172.21.15.59:0/906294712 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562152891800 0x5621528a5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.095+0000 7f56aa609740 1 --2- 172.21.15.59:0/906294712 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56215291b1a0 0x56215291d5c0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.095+0000 7f56aa609740 1 --2- 172.21.15.59:0/906294712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562152890ee0 0x5621528a5990 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.095+0000 7f56897fa640 0 client.16242 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.095+0000 7f56aa609740 1 -- 172.21.15.59:0/906294712 >> 172.21.15.59:0/906294712 conn(0x56215288ed10 msgr2=0x5621528a8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.096+0000 7f56aa609740 1 -- 172.21.15.59:0/906294712 shutdown_connections 2024-09-10T21:18:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.096+0000 7f56aa609740 1 -- 172.21.15.59:0/906294712 wait complete. 2024-09-10T21:18:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.096+0000 7f56aa609740 20 client.16242 trim_cache size 0 max 16384 2024-09-10T21:18:53.121 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:18:53.122 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:18:53.122 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "423e6232-f4ea-4996-bf2f-e554320ff5d0", 2024-09-10T21:18:53.122 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:18:53.122 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:18:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.096+0000 7f56a8234640 1 -- 172.21.15.59:0/2006923461 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f568c0b52e0 msgr2=0x7f568c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.096+0000 7f56a8234640 1 --2- 172.21.15.59:0/2006923461 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f568c0b52e0 0x7f568c0b77a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f56900058c0 tx=0x7f5690014040 comp rx=0 tx=0).stop 2024-09-10T21:18:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.096+0000 7f56a8234640 1 -- 172.21.15.59:0/2006923461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a0108020 msgr2=0x7f56a019abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.096+0000 7f56a8234640 1 --2- 172.21.15.59:0/2006923461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a0108020 0x7f56a019abb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f569800cad0 tx=0x7f569800cf90 comp rx=0 tx=0).stop 2024-09-10T21:18:53.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.096+0000 7f56a8234640 1 -- 172.21.15.59:0/2006923461 shutdown_connections 2024-09-10T21:18:53.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.096+0000 7f56a8234640 1 --2- 172.21.15.59:0/2006923461 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f568c0b52e0 0x7f568c0b77a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.096+0000 7f56a8234640 1 --2- 172.21.15.59:0/2006923461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a0108020 0x7f56a019abb0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.096+0000 7f56a8234640 1 --2- 172.21.15.59:0/2006923461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56a01076a0 0x7f56a019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.096+0000 7f56a8234640 1 --2- 172.21.15.59:0/2006923461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f56a0101c90 0x7f56a019a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:53.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.096+0000 7f56a8234640 1 -- 172.21.15.59:0/2006923461 >> 172.21.15.59:0/2006923461 conn(0x7f56a00fd700 msgr2=0x7f56a00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:53.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.096+0000 7f56a8234640 1 -- 172.21.15.59:0/2006923461 shutdown_connections 2024-09-10T21:18:53.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:53.096+0000 7f56a8234640 1 -- 172.21.15.59:0/2006923461 wait complete. 2024-09-10T21:18:53.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:53 smithi192 ceph-mon[35363]: pgmap v448: 97 pgs: 97 active+clean; 2.4 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:18:53.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:53 smithi059 ceph-mon[30888]: pgmap v448: 97 pgs: 97 active+clean; 2.4 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:18:53.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:53 smithi154 ceph-mon[35041]: pgmap v448: 97 pgs: 97 active+clean; 2.4 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:18:54.004 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:18:54.267 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:18:54.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:54 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:18:54.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:54 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:18:54.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:54 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:18:54.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:54 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:18:54.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:54 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:18:54.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:54 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:18:54.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:54 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:18:54.389 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:54 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:18:54.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:54 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:18:54.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:54 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:18:54.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:54 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:18:54.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:54 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:18:54.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.765+0000 7f73efe3b640 1 -- 172.21.15.59:0/824857669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73e81077c0 msgr2=0x7f73e810dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:54.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.765+0000 7f73efe3b640 1 --2- 172.21.15.59:0/824857669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73e81077c0 0x7f73e810dfc0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009ca0 tx=0x7f73e002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.765+0000 7f73efe3b640 1 -- 172.21.15.59:0/824857669 shutdown_connections 2024-09-10T21:18:54.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.765+0000 7f73efe3b640 1 --2- 172.21.15.59:0/824857669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73e81077c0 0x7f73e810dfc0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.765+0000 7f73efe3b640 1 --2- 172.21.15.59:0/824857669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e8106e40 0x7f73e8107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.765+0000 7f73efe3b640 1 --2- 172.21.15.59:0/824857669 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73e8101810 0x7f73e8101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.765+0000 7f73efe3b640 1 -- 172.21.15.59:0/824857669 >> 172.21.15.59:0/824857669 conn(0x7f73e8076f50 msgr2=0x7f73e8077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:54.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.765+0000 7f73efe3b640 1 -- 172.21.15.59:0/824857669 shutdown_connections 2024-09-10T21:18:54.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.765+0000 7f73efe3b640 1 -- 172.21.15.59:0/824857669 wait complete. 2024-09-10T21:18:54.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.765+0000 7f73efe3b640 1 Processor -- start 2024-09-10T21:18:54.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.765+0000 7f73efe3b640 1 -- start start 2024-09-10T21:18:54.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73efe3b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73e8101810 0x7f73e81992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:54.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73efe3b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e8106e40 0x7f73e8199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:54.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73efe3b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73e81077c0 0x7f73e819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:54.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73efe3b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f73e8111440 con 0x7f73e8101810 2024-09-10T21:18:54.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73efe3b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f73e81112c0 con 0x7f73e81077c0 2024-09-10T21:18:54.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73efe3b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f73e81115c0 con 0x7f73e8106e40 2024-09-10T21:18:54.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73edbd7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73e8101810 0x7f73e81992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:54.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73edbd7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73e8101810 0x7f73e81992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49618/0 (socket says 172.21.15.59:49618) 2024-09-10T21:18:54.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73edbd7640 1 -- 172.21.15.59:0/1990545293 learned_addr learned my addr 172.21.15.59:0/1990545293 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:54.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73ee3d8640 1 --2- 172.21.15.59:0/1990545293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73e81077c0 0x7f73e819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:54.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73ed3d6640 1 --2- 172.21.15.59:0/1990545293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e8106e40 0x7f73e8199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:54.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73edbd7640 1 -- 172.21.15.59:0/1990545293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e8106e40 msgr2=0x7f73e8199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:54.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73edbd7640 1 --2- 172.21.15.59:0/1990545293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e8106e40 0x7f73e8199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73edbd7640 1 -- 172.21.15.59:0/1990545293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73e81077c0 msgr2=0x7f73e819eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:54.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73edbd7640 1 --2- 172.21.15.59:0/1990545293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73e81077c0 0x7f73e819eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73edbd7640 1 -- 172.21.15.59:0/1990545293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73e819f370 con 0x7f73e8101810 2024-09-10T21:18:54.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73edbd7640 1 --2- 172.21.15.59:0/1990545293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73e8101810 0x7f73e81992c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f73e400d950 tx=0x7f73e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:54.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73deffd640 1 -- 172.21.15.59:0/1990545293 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e4017070 con 0x7f73e8101810 2024-09-10T21:18:54.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73efe3b640 1 -- 172.21.15.59:0/1990545293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73e819f660 con 0x7f73e8101810 2024-09-10T21:18:54.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.766+0000 7f73deffd640 1 -- 172.21.15.59:0/1990545293 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73e4009c30 con 0x7f73e8101810 2024-09-10T21:18:54.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.767+0000 7f73deffd640 1 -- 172.21.15.59:0/1990545293 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e400f620 con 0x7f73e8101810 2024-09-10T21:18:54.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.767+0000 7f73efe3b640 1 -- 172.21.15.59:0/1990545293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73e81a5da0 con 0x7f73e8101810 2024-09-10T21:18:54.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.770+0000 7f73f2210740 1 Processor -- start 2024-09-10T21:18:54.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.770+0000 7f73f2210740 1 -- start start 2024-09-10T21:18:54.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.770+0000 7f73deffd640 1 -- 172.21.15.59:0/1990545293 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f73e4010460 con 0x7f73e8101810 2024-09-10T21:18:54.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.770+0000 7f73f2210740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514d8480 0x5618514d8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:54.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.770+0000 7f73f2210740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514d8da0 0x5618514e47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:54.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.770+0000 7f73f2210740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514e4d30 0x5618514e7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:54.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.770+0000 7f73f2210740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56185144ee50 con 0x5618514d8480 2024-09-10T21:18:54.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.770+0000 7f73f2210740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56185143e280 con 0x5618514e4d30 2024-09-10T21:18:54.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.770+0000 7f73f2210740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561851442090 con 0x5618514d8da0 2024-09-10T21:18:54.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.770+0000 7f73ee3d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514d8480 0x5618514d8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:54.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.770+0000 7f73ee3d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514d8480 0x5618514d8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49620/0 (socket says 172.21.15.59:49620) 2024-09-10T21:18:54.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.770+0000 7f73ee3d8640 1 -- 172.21.15.59:0/2828899457 learned_addr learned my addr 172.21.15.59:0/2828899457 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:54.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.770+0000 7f73ed3d6640 1 --2- 172.21.15.59:0/2828899457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514e4d30 0x5618514e7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:54.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.770+0000 7f73edbd7640 1 --2- 172.21.15.59:0/2828899457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514d8da0 0x5618514e47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:54.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.771+0000 7f73ed3d6640 1 -- 172.21.15.59:0/2828899457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514d8da0 msgr2=0x5618514e47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:54.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.771+0000 7f73ed3d6640 1 --2- 172.21.15.59:0/2828899457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514d8da0 0x5618514e47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.771+0000 7f73ed3d6640 1 -- 172.21.15.59:0/2828899457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514d8480 msgr2=0x5618514d8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:54.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.771+0000 7f73ed3d6640 1 --2- 172.21.15.59:0/2828899457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514d8480 0x5618514d8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.771+0000 7f73ed3d6640 1 -- 172.21.15.59:0/2828899457 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56185119c650 con 0x5618514e4d30 2024-09-10T21:18:54.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.771+0000 7f73ee3d8640 1 --2- 172.21.15.59:0/2828899457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514d8480 0x5618514d8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:18:54.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.771+0000 7f73ed3d6640 1 --2- 172.21.15.59:0/2828899457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514e4d30 0x5618514e7120 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f73d800b730 tx=0x7f73d800bbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fd115cc7098b75f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:54.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.771+0000 7f73d3fff640 1 -- 172.21.15.59:0/2828899457 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d800be40 con 0x5618514e4d30 2024-09-10T21:18:54.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.771+0000 7f73d3fff640 1 -- 172.21.15.59:0/2828899457 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73d8019070 con 0x5618514e4d30 2024-09-10T21:18:54.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.771+0000 7f73deffd640 1 --2- 172.21.15.59:0/1990545293 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f73d40b52e0 0x7f73d40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:54.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.771+0000 7f73d3fff640 1 -- 172.21.15.59:0/2828899457 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d8014dc0 con 0x5618514e4d30 2024-09-10T21:18:54.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.771+0000 7f73ee3d8640 1 --2- 172.21.15.59:0/1990545293 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f73d40b52e0 0x7f73d40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:54.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.771+0000 7f73deffd640 1 -- 172.21.15.59:0/1990545293 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f73e40e5840 con 0x7f73e8101810 2024-09-10T21:18:54.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.772+0000 7f73f2210740 1 -- 172.21.15.59:0/2828899457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514e4d30 msgr2=0x5618514e7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:54.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.772+0000 7f73ee3d8640 1 --2- 172.21.15.59:0/1990545293 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f73d40b52e0 0x7f73d40b77a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f73e002f500 tx=0x7f73e0005fa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:54.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.772+0000 7f73f2210740 1 --2- 172.21.15.59:0/2828899457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514e4d30 0x5618514e7120 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f73d800b730 tx=0x7f73d800bbf0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.772+0000 7f73f2210740 1 -- 172.21.15.59:0/2828899457 shutdown_connections 2024-09-10T21:18:54.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.772+0000 7f73f2210740 1 --2- 172.21.15.59:0/2828899457 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514e4d30 0x5618514e7120 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.772+0000 7f73f2210740 1 --2- 172.21.15.59:0/2828899457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514d8da0 0x5618514e47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.772+0000 7f73f2210740 1 --2- 172.21.15.59:0/2828899457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514d8480 0x5618514d8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.772+0000 7f73f2210740 1 -- 172.21.15.59:0/2828899457 >> 172.21.15.59:0/2828899457 conn(0x5618514d62b0 msgr2=0x5618514d7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:54.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.772+0000 7f73f2210740 1 -- 172.21.15.59:0/2828899457 shutdown_connections 2024-09-10T21:18:54.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.772+0000 7f73f2210740 1 -- 172.21.15.59:0/2828899457 wait complete. 2024-09-10T21:18:54.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.772+0000 7f73f2210740 1 -- start start 2024-09-10T21:18:54.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.772+0000 7f73f2210740 1 Processor -- start 2024-09-10T21:18:54.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73f2210740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514d8480 0x5618514e4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:54.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73f2210740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514d8da0 0x5618514e1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:54.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73f2210740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514e4d30 0x5618514e2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:54.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73f2210740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56185129f700 con 0x5618514d8da0 2024-09-10T21:18:54.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73f2210740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5618513d9110 con 0x5618514d8480 2024-09-10T21:18:54.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73f2210740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5618514e79b0 con 0x5618514e4d30 2024-09-10T21:18:54.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73f2210740 10 client.0 _ll_register_callbacks cb 0x5618513f2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:54.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73ed3d6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514d8da0 0x5618514e1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:54.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73ed3d6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514d8da0 0x5618514e1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49634/0 (socket says 172.21.15.59:49634) 2024-09-10T21:18:54.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73ed3d6640 1 -- 172.21.15.59:0/2951935948 learned_addr learned my addr 172.21.15.59:0/2951935948 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:54.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73edbd7640 1 --2- 172.21.15.59:0/2951935948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514d8480 0x5618514e4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:54.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73ee3d8640 1 --2- 172.21.15.59:0/2951935948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514e4d30 0x5618514e2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:54.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73ed3d6640 1 -- 172.21.15.59:0/2951935948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514e4d30 msgr2=0x5618514e2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:54.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73ed3d6640 1 --2- 172.21.15.59:0/2951935948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514e4d30 0x5618514e2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73ed3d6640 1 -- 172.21.15.59:0/2951935948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514d8480 msgr2=0x5618514e4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:54.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73ed3d6640 1 --2- 172.21.15.59:0/2951935948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514d8480 0x5618514e4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73ed3d6640 1 -- 172.21.15.59:0/2951935948 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561851406c40 con 0x5618514d8da0 2024-09-10T21:18:54.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73ee3d8640 1 --2- 172.21.15.59:0/2951935948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514e4d30 0x5618514e2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73ed3d6640 1 --2- 172.21.15.59:0/2951935948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514d8da0 0x5618514e1a50 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f73d8014aa0 tx=0x7f73d8014660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b42f305c3c2cd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.773+0000 7f73d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.774+0000 7f73d17fa640 1 -- 172.21.15.59:0/2951935948 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d8023070 con 0x5618514d8da0 2024-09-10T21:18:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.774+0000 7f73f2210740 1 -- 172.21.15.59:0/2951935948 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73d8019070 con 0x5618514d8da0 2024-09-10T21:18:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.774+0000 7f73d17fa640 1 -- 172.21.15.59:0/2951935948 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f73d800d950 con 0x5618514d8da0 2024-09-10T21:18:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.774+0000 7f73d17fa640 1 -- 172.21.15.59:0/2951935948 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f73d802f050 con 0x5618514d8da0 2024-09-10T21:18:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.774+0000 7f73f2210740 10 client.16254 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.774+0000 7f73f2210740 1 -- 172.21.15.59:0/2951935948 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5618514f3320 con 0x5618514d8da0 2024-09-10T21:18:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.774+0000 7f73d17fa640 1 -- 172.21.15.59:0/2951935948 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73d8019070 con 0x5618514d8da0 2024-09-10T21:18:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.774+0000 7f73d17fa640 1 -- 172.21.15.59:0/2951935948 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f73d8013070 con 0x5618514d8da0 2024-09-10T21:18:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.774+0000 7f73f2210740 10 client.16254 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.774+0000 7f73f2210740 10 client.16254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:18:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.774+0000 7f73f2210740 20 client.16254 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:54.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.774+0000 7f73f2210740 1 --2- 172.21.15.59:0/2951935948 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5618514f46d0 0x5618514f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:54.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.774+0000 7f73f2210740 4 client.16254 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:18:54.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.774+0000 7f73f2210740 1 -- 172.21.15.59:0/2951935948 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561851450da0 con 0x5618514f46d0 2024-09-10T21:18:54.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.775+0000 7f73edbd7640 1 --2- 172.21.15.59:0/2951935948 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5618514f46d0 0x5618514f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:54.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.775+0000 7f73edbd7640 1 --2- 172.21.15.59:0/2951935948 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5618514f46d0 0x5618514f6ac0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9ffbff3a32a249 server_cookie=de0df9b8d6d74ebd in_seq=0 out_seq=0 2024-09-10T21:18:54.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.775+0000 7f73d17fa640 10 client.16254 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:54.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.776+0000 7f73d17fa640 1 -- 172.21.15.59:0/2951935948 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561851450da0 con 0x5618514f46d0 2024-09-10T21:18:54.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.776+0000 7f73d17fa640 10 client.16254 handle_command_reply: tid=0 2024-09-10T21:18:54.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.776+0000 7f73f2210740 1 client.16254 shutdown 2024-09-10T21:18:54.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.776+0000 7f73f2210740 1 -- 172.21.15.59:0/2951935948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514d8da0 msgr2=0x5618514e1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:54.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.776+0000 7f73f2210740 1 --2- 172.21.15.59:0/2951935948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514d8da0 0x5618514e1a50 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f73d8014aa0 tx=0x7f73d8014660 comp rx=0 tx=0).stop 2024-09-10T21:18:54.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.776+0000 7f73f2210740 1 -- 172.21.15.59:0/2951935948 shutdown_connections 2024-09-10T21:18:54.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.776+0000 7f73f2210740 1 --2- 172.21.15.59:0/2951935948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514e4d30 0x5618514e2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.776+0000 7f73f2210740 1 --2- 172.21.15.59:0/2951935948 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5618514f46d0 0x5618514f6ac0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.776+0000 7f73f2210740 1 --2- 172.21.15.59:0/2951935948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514d8da0 0x5618514e1a50 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.776+0000 7f73d17fa640 0 client.16254 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:54.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.776+0000 7f73f2210740 1 --2- 172.21.15.59:0/2951935948 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514d8480 0x5618514e4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.776+0000 7f73f2210740 1 -- 172.21.15.59:0/2951935948 >> 172.21.15.59:0/2951935948 conn(0x5618514d62b0 msgr2=0x5618514dbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:54.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.776+0000 7f73f2210740 1 -- 172.21.15.59:0/2951935948 shutdown_connections 2024-09-10T21:18:54.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.776+0000 7f73f2210740 1 -- 172.21.15.59:0/2951935948 wait complete. 2024-09-10T21:18:54.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.776+0000 7f73f2210740 20 client.16254 trim_cache size 0 max 16384 2024-09-10T21:18:54.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73f2210740 1 Processor -- start 2024-09-10T21:18:54.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73f2210740 1 -- start start 2024-09-10T21:18:54.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73f2210740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514d8480 0x5618514d5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:54.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73f2210740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514d8da0 0x5618514e3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:54.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73f2210740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514e4d30 0x5618514ed080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:54.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73f2210740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f73e81ae430 con 0x5618514e4d30 2024-09-10T21:18:54.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73f2210740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f73e81aff70 con 0x5618514d8480 2024-09-10T21:18:54.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73f2210740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f73e81aeb00 con 0x5618514d8da0 2024-09-10T21:18:54.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73ee3d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514e4d30 0x5618514ed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:54.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73ee3d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514e4d30 0x5618514ed080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49640/0 (socket says 172.21.15.59:49640) 2024-09-10T21:18:54.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73ee3d8640 1 -- 172.21.15.59:0/1666409324 learned_addr learned my addr 172.21.15.59:0/1666409324 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:54.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73edbd7640 1 --2- 172.21.15.59:0/1666409324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514d8480 0x5618514d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:54.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73ed3d6640 1 --2- 172.21.15.59:0/1666409324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514d8da0 0x5618514e3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:54.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73ee3d8640 1 -- 172.21.15.59:0/1666409324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514d8da0 msgr2=0x5618514e3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:54.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73ee3d8640 1 --2- 172.21.15.59:0/1666409324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514d8da0 0x5618514e3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73ee3d8640 1 -- 172.21.15.59:0/1666409324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514d8480 msgr2=0x5618514d5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:54.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73ee3d8640 1 --2- 172.21.15.59:0/1666409324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514d8480 0x5618514d5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73ee3d8640 1 -- 172.21.15.59:0/1666409324 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618514d6d30 con 0x5618514e4d30 2024-09-10T21:18:54.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73edbd7640 1 --2- 172.21.15.59:0/1666409324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514d8480 0x5618514d5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:18:54.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.794+0000 7f73ed3d6640 1 --2- 172.21.15.59:0/1666409324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514d8da0 0x5618514e3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:54.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.795+0000 7f73ee3d8640 1 --2- 172.21.15.59:0/1666409324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514e4d30 0x5618514ed080 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f73e0035000 tx=0x7f73e0041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f797ee5850f24e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:54.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.795+0000 7f73d37fe640 1 -- 172.21.15.59:0/1666409324 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e0003970 con 0x5618514e4d30 2024-09-10T21:18:54.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.795+0000 7f73d37fe640 1 -- 172.21.15.59:0/1666409324 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73e0036050 con 0x5618514e4d30 2024-09-10T21:18:54.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.795+0000 7f73d37fe640 1 -- 172.21.15.59:0/1666409324 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e002f660 con 0x5618514e4d30 2024-09-10T21:18:54.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.795+0000 7f73f2210740 1 -- 172.21.15.59:0/1666409324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514e4d30 msgr2=0x5618514ed080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:54.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.795+0000 7f73f2210740 1 --2- 172.21.15.59:0/1666409324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514e4d30 0x5618514ed080 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f73e0035000 tx=0x7f73e0041000 comp rx=0 tx=0).stop 2024-09-10T21:18:54.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.796+0000 7f73f2210740 1 -- 172.21.15.59:0/1666409324 shutdown_connections 2024-09-10T21:18:54.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.796+0000 7f73f2210740 1 --2- 172.21.15.59:0/1666409324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514e4d30 0x5618514ed080 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.796+0000 7f73f2210740 1 --2- 172.21.15.59:0/1666409324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514d8da0 0x5618514e3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.796+0000 7f73f2210740 1 --2- 172.21.15.59:0/1666409324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514d8480 0x5618514d5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.796+0000 7f73f2210740 1 -- 172.21.15.59:0/1666409324 >> 172.21.15.59:0/1666409324 conn(0x5618514d62b0 msgr2=0x5618514e3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:54.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.796+0000 7f73f2210740 1 -- 172.21.15.59:0/1666409324 shutdown_connections 2024-09-10T21:18:54.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.796+0000 7f73f2210740 1 -- 172.21.15.59:0/1666409324 wait complete. 2024-09-10T21:18:54.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.796+0000 7f73f2210740 1 -- start start 2024-09-10T21:18:54.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.796+0000 7f73f2210740 1 Processor -- start 2024-09-10T21:18:54.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.796+0000 7f73f2210740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514d8480 0x5618514fc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:54.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.796+0000 7f73f2210740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514d8da0 0x5618514fb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:54.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.796+0000 7f73f2210740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514e4d30 0x5618514fb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:54.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.796+0000 7f73f2210740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f73e81af8a0 con 0x5618514e4d30 2024-09-10T21:18:54.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.796+0000 7f73f2210740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f73e81af1d0 con 0x5618514d8480 2024-09-10T21:18:54.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.796+0000 7f73f2210740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f73e81ac410 con 0x5618514d8da0 2024-09-10T21:18:54.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.796+0000 7f73f2210740 10 client.0 _ll_register_callbacks cb 0x7f73e0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:54.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.797+0000 7f73edbd7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514d8480 0x5618514fc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:54.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.797+0000 7f73ed3d6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514d8da0 0x5618514fb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:54.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.797+0000 7f73edbd7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514d8480 0x5618514fc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:57066/0 (socket says 172.21.15.59:57066) 2024-09-10T21:18:54.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.797+0000 7f73edbd7640 1 -- 172.21.15.59:0/2329849698 learned_addr learned my addr 172.21.15.59:0/2329849698 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:54.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.797+0000 7f73ee3d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514e4d30 0x5618514fb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:54.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.797+0000 7f73edbd7640 1 -- 172.21.15.59:0/2329849698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514d8da0 msgr2=0x5618514fb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:54.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.797+0000 7f73edbd7640 1 --2- 172.21.15.59:0/2329849698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514d8da0 0x5618514fb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.797+0000 7f73edbd7640 1 -- 172.21.15.59:0/2329849698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514e4d30 msgr2=0x5618514fb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:54.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.797+0000 7f73edbd7640 1 --2- 172.21.15.59:0/2329849698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514e4d30 0x5618514fb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.797+0000 7f73edbd7640 1 -- 172.21.15.59:0/2329849698 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618514fbdb0 con 0x5618514d8480 2024-09-10T21:18:54.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.797+0000 7f73ee3d8640 1 --2- 172.21.15.59:0/2329849698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514e4d30 0x5618514fb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:18:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.797+0000 7f73edbd7640 1 --2- 172.21.15.59:0/2329849698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514d8480 0x5618514fc820 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f73e40e36e0 tx=0x7f73e40b5050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa8eefaa11f91849 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.797+0000 7f73d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-10T21:18:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.797+0000 7f73d17fa640 1 -- 172.21.15.59:0/2329849698 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e4020040 con 0x5618514d8480 2024-09-10T21:18:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.797+0000 7f73d17fa640 1 -- 172.21.15.59:0/2329849698 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f73e40ab490 con 0x5618514d8480 2024-09-10T21:18:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.797+0000 7f73f2210740 1 -- 172.21.15.59:0/2329849698 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73e0036050 con 0x5618514d8480 2024-09-10T21:18:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.797+0000 7f73d17fa640 1 -- 172.21.15.59:0/2329849698 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f73e4009de0 con 0x5618514d8480 2024-09-10T21:18:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.797+0000 7f73f2210740 10 client.25541 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.798+0000 7f73f2210740 1 -- 172.21.15.59:0/2329849698 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561851566310 con 0x5618514d8480 2024-09-10T21:18:54.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.798+0000 7f73d17fa640 1 -- 172.21.15.59:0/2329849698 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73e0036050 con 0x5618514d8480 2024-09-10T21:18:54.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.798+0000 7f73d17fa640 1 -- 172.21.15.59:0/2329849698 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f73e4010780 con 0x5618514d8480 2024-09-10T21:18:54.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.798+0000 7f73f2210740 10 client.25541 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:54.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.798+0000 7f73f2210740 10 client.25541 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:18:54.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.798+0000 7f73f2210740 20 client.25541 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:54.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.798+0000 7f73f2210740 1 --2- 172.21.15.59:0/2329849698 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561851566a60 0x561851568e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:54.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.798+0000 7f73f2210740 4 client.25541 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:18:54.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.798+0000 7f73f2210740 1 -- 172.21.15.59:0/2329849698 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56185144c850 con 0x561851566a60 2024-09-10T21:18:54.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.798+0000 7f73ed3d6640 1 --2- 172.21.15.59:0/2329849698 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561851566a60 0x561851568e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:54.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.798+0000 7f73ed3d6640 1 --2- 172.21.15.59:0/2329849698 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561851566a60 0x561851568e80 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d3827182e3e3ccd server_cookie=bc4b50d778267320 in_seq=0 out_seq=0 2024-09-10T21:18:54.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.798+0000 7f73d17fa640 10 client.25541 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:54.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.799+0000 7f73d17fa640 1 -- 172.21.15.59:0/2329849698 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x56185144c850 con 0x561851566a60 2024-09-10T21:18:54.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.799+0000 7f73d17fa640 10 client.25541 handle_command_reply: tid=0 2024-09-10T21:18:54.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.799+0000 7f73f2210740 1 client.25541 shutdown 2024-09-10T21:18:54.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.799+0000 7f73f2210740 1 -- 172.21.15.59:0/2329849698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514d8480 msgr2=0x5618514fc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:54.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.799+0000 7f73f2210740 1 --2- 172.21.15.59:0/2329849698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514d8480 0x5618514fc820 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f73e40e36e0 tx=0x7f73e40b5050 comp rx=0 tx=0).stop 2024-09-10T21:18:54.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.799+0000 7f73f2210740 1 -- 172.21.15.59:0/2329849698 shutdown_connections 2024-09-10T21:18:54.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.799+0000 7f73f2210740 1 --2- 172.21.15.59:0/2329849698 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561851566a60 0x561851568e80 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.799+0000 7f73f2210740 1 --2- 172.21.15.59:0/2329849698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5618514e4d30 0x5618514fb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.799+0000 7f73f2210740 1 --2- 172.21.15.59:0/2329849698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5618514d8da0 0x5618514fb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.799+0000 7f73d17fa640 0 client.25541 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:18:54.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.799+0000 7f73f2210740 1 --2- 172.21.15.59:0/2329849698 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5618514d8480 0x5618514fc820 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.799+0000 7f73f2210740 1 -- 172.21.15.59:0/2329849698 >> 172.21.15.59:0/2329849698 conn(0x5618514d62b0 msgr2=0x5618514d78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:54.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.799+0000 7f73f2210740 1 -- 172.21.15.59:0/2329849698 shutdown_connections 2024-09-10T21:18:54.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.799+0000 7f73f2210740 1 -- 172.21.15.59:0/2329849698 wait complete. 2024-09-10T21:18:54.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.799+0000 7f73f2210740 20 client.25541 trim_cache size 0 max 16384 2024-09-10T21:18:54.811 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:18:54.811 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:18:54.811 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:18:54.811 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:18:54.811 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:18:54.811 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:18:54.811 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:54.811 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:18:54.811 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:18:54.811 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:18:54.812 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:18:54.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:18:54.812 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:18:54.812 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:18:54.812 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:54.812 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:18:54.812 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:18:54.812 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:18:54.812 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:18:54.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:18:54.813 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:18:54.813 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:18:54.813 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:54.813 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:18:54.813 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:18:54.813 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:18:54.813 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:18:54.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:18:54.813 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:18:54.813 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:18:54.813 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:54.813 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:18:54.813 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:18:54.814 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:18:54.814 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:18:54.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:18:54.814 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:18:54.814 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:18:54.814 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:54.814 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:18:54.814 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:18:54.814 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:18:54.814 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:18:54.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:18:54.814 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:18:54.814 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:18:54.815 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:54.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:18:54.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:18:54.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:18:54.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:18:54.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:18:54.815 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:18:54.815 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:18:54.815 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:18:54.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:18:54.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:18:54.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:18:54.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:18:54.816 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:18:54.816 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:18:54.816 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:18:54.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.800+0000 7f73efe3b640 1 -- 172.21.15.59:0/1990545293 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f73d40b52e0 msgr2=0x7f73d40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:54.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.800+0000 7f73efe3b640 1 --2- 172.21.15.59:0/1990545293 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f73d40b52e0 0x7f73d40b77a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f73e002f500 tx=0x7f73e0005fa0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.800+0000 7f73efe3b640 1 -- 172.21.15.59:0/1990545293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73e8101810 msgr2=0x7f73e81992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:54.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.800+0000 7f73efe3b640 1 --2- 172.21.15.59:0/1990545293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73e8101810 0x7f73e81992c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f73e400d950 tx=0x7f73e400de10 comp rx=0 tx=0).stop 2024-09-10T21:18:54.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.800+0000 7f73efe3b640 1 -- 172.21.15.59:0/1990545293 shutdown_connections 2024-09-10T21:18:54.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.800+0000 7f73efe3b640 1 --2- 172.21.15.59:0/1990545293 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f73d40b52e0 0x7f73d40b77a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.800+0000 7f73efe3b640 1 --2- 172.21.15.59:0/1990545293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73e81077c0 0x7f73e819eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.800+0000 7f73efe3b640 1 --2- 172.21.15.59:0/1990545293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e8106e40 0x7f73e8199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.800+0000 7f73efe3b640 1 --2- 172.21.15.59:0/1990545293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73e8101810 0x7f73e81992c0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:54.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.800+0000 7f73efe3b640 1 -- 172.21.15.59:0/1990545293 >> 172.21.15.59:0/1990545293 conn(0x7f73e8076f50 msgr2=0x7f73e8105530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:54.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.800+0000 7f73efe3b640 1 -- 172.21.15.59:0/1990545293 shutdown_connections 2024-09-10T21:18:54.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:54.800+0000 7f73efe3b640 1 -- 172.21.15.59:0/1990545293 wait complete. 2024-09-10T21:18:55.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:55 smithi192 ceph-mon[35363]: pgmap v449: 97 pgs: 97 active+clean; 2.4 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:55.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:55 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:18:55.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:55 smithi059 ceph-mon[30888]: pgmap v449: 97 pgs: 97 active+clean; 2.4 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:55.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:55 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:18:55.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:55 smithi154 ceph-mon[35041]: pgmap v449: 97 pgs: 97 active+clean; 2.4 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:18:55.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:55 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:18:55.553 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:18:55.599 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:18:55.859 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:18:56.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.323+0000 7f3efb375640 1 -- 172.21.15.59:0/2827823769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef4109150 msgr2=0x7f3ef410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:56.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.323+0000 7f3efb375640 1 --2- 172.21.15.59:0/2827823769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef4109150 0x7f3ef410f950 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009ca0 tx=0x7f3eec02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:18:56.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.323+0000 7f3efb375640 1 -- 172.21.15.59:0/2827823769 shutdown_connections 2024-09-10T21:18:56.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.323+0000 7f3efb375640 1 --2- 172.21.15.59:0/2827823769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef4109150 0x7f3ef410f950 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:56.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.323+0000 7f3efb375640 1 --2- 172.21.15.59:0/2827823769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ef41087d0 0x7f3ef4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:56.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.323+0000 7f3efb375640 1 --2- 172.21.15.59:0/2827823769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ef4102dc0 0x7f3ef41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:56.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.323+0000 7f3efb375640 1 -- 172.21.15.59:0/2827823769 >> 172.21.15.59:0/2827823769 conn(0x7f3ef40fe830 msgr2=0x7f3ef4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:56.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.323+0000 7f3efb375640 1 -- 172.21.15.59:0/2827823769 shutdown_connections 2024-09-10T21:18:56.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.323+0000 7f3efb375640 1 -- 172.21.15.59:0/2827823769 wait complete. 2024-09-10T21:18:56.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.324+0000 7f3efb375640 1 Processor -- start 2024-09-10T21:18:56.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.324+0000 7f3efb375640 1 -- start start 2024-09-10T21:18:56.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.324+0000 7f3efb375640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ef4102dc0 0x7f3ef4199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:56.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.324+0000 7f3efb375640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ef41087d0 0x7f3ef4199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:56.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.324+0000 7f3efb375640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef4109150 0x7f3ef419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:56.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.324+0000 7f3efb375640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef4112dd0 con 0x7f3ef4109150 2024-09-10T21:18:56.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.324+0000 7f3efb375640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef4112c50 con 0x7f3ef4102dc0 2024-09-10T21:18:56.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.324+0000 7f3efb375640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef4112f50 con 0x7f3ef41087d0 2024-09-10T21:18:56.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.324+0000 7f3ef9912640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef4109150 0x7f3ef419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:56.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.324+0000 7f3ef9912640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef4109150 0x7f3ef419eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49684/0 (socket says 172.21.15.59:49684) 2024-09-10T21:18:56.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.324+0000 7f3ef9912640 1 -- 172.21.15.59:0/3906707079 learned_addr learned my addr 172.21.15.59:0/3906707079 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:56.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.324+0000 7f3ef9111640 1 --2- 172.21.15.59:0/3906707079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ef4102dc0 0x7f3ef4199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:56.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.324+0000 7f3ef8910640 1 --2- 172.21.15.59:0/3906707079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ef41087d0 0x7f3ef4199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:56.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.325+0000 7f3ef9912640 1 -- 172.21.15.59:0/3906707079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ef41087d0 msgr2=0x7f3ef4199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:56.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.325+0000 7f3ef9912640 1 --2- 172.21.15.59:0/3906707079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ef41087d0 0x7f3ef4199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:56.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.325+0000 7f3ef9912640 1 -- 172.21.15.59:0/3906707079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ef4102dc0 msgr2=0x7f3ef4199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:56.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.325+0000 7f3ef9912640 1 --2- 172.21.15.59:0/3906707079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ef4102dc0 0x7f3ef4199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:56.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.325+0000 7f3ef9912640 1 -- 172.21.15.59:0/3906707079 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef419f2f0 con 0x7f3ef4109150 2024-09-10T21:18:56.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.325+0000 7f3ef8910640 1 --2- 172.21.15.59:0/3906707079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ef41087d0 0x7f3ef4199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:56.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.325+0000 7f3ef9912640 1 --2- 172.21.15.59:0/3906707079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef4109150 0x7f3ef419eb20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0098d0 tx=0x7f3eec0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:56.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.325+0000 7f3eea7fc640 1 -- 172.21.15.59:0/3906707079 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eec003b70 con 0x7f3ef4109150 2024-09-10T21:18:56.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.325+0000 7f3efb375640 1 -- 172.21.15.59:0/3906707079 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef419f580 con 0x7f3ef4109150 2024-09-10T21:18:56.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.325+0000 7f3eea7fc640 1 -- 172.21.15.59:0/3906707079 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3eec003d10 con 0x7f3ef4109150 2024-09-10T21:18:56.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.325+0000 7f3eea7fc640 1 -- 172.21.15.59:0/3906707079 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eec02fa20 con 0x7f3ef4109150 2024-09-10T21:18:56.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.325+0000 7f3efb375640 1 -- 172.21.15.59:0/3906707079 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ef41a5ca0 con 0x7f3ef4109150 2024-09-10T21:18:56.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.326+0000 7f3efb375640 1 -- 172.21.15.59:0/3906707079 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ef41031a0 con 0x7f3ef4109150 2024-09-10T21:18:56.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.327+0000 7f3eea7fc640 1 -- 172.21.15.59:0/3906707079 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f3eec02fc00 con 0x7f3ef4109150 2024-09-10T21:18:56.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.328+0000 7f3eea7fc640 1 --2- 172.21.15.59:0/3906707079 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3ee00b52e0 0x7f3ee00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:56.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.328+0000 7f3ef9111640 1 --2- 172.21.15.59:0/3906707079 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3ee00b52e0 0x7f3ee00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:56.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.328+0000 7f3eea7fc640 1 -- 172.21.15.59:0/3906707079 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3eec1070e0 con 0x7f3ef4109150 2024-09-10T21:18:56.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.329+0000 7f3ef9111640 1 --2- 172.21.15.59:0/3906707079 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3ee00b52e0 0x7f3ee00b77a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000bbe0 tx=0x7f3ef000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:56.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.332+0000 7f3eea7fc640 1 -- 172.21.15.59:0/3906707079 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3eec0cdf70 con 0x7f3ef4109150 2024-09-10T21:18:56.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.555+0000 7f3efb375640 1 -- 172.21.15.59:0/3906707079 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ef410af60 con 0x7f3ef4109150 2024-09-10T21:18:56.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.555+0000 7f3eea7fc640 1 -- 172.21.15.59:0/3906707079 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f3eec0cd870 con 0x7f3ef4109150 2024-09-10T21:18:56.559 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:18:56.560 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:18:56.560 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:18:56.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.558+0000 7f3efb375640 1 -- 172.21.15.59:0/3906707079 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3ee00b52e0 msgr2=0x7f3ee00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:56.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.558+0000 7f3efb375640 1 --2- 172.21.15.59:0/3906707079 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3ee00b52e0 0x7f3ee00b77a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000bbe0 tx=0x7f3ef000b390 comp rx=0 tx=0).stop 2024-09-10T21:18:56.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.558+0000 7f3efb375640 1 -- 172.21.15.59:0/3906707079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef4109150 msgr2=0x7f3ef419eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:56.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.558+0000 7f3efb375640 1 --2- 172.21.15.59:0/3906707079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef4109150 0x7f3ef419eb20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0098d0 tx=0x7f3eec0317b0 comp rx=0 tx=0).stop 2024-09-10T21:18:56.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.558+0000 7f3efb375640 1 -- 172.21.15.59:0/3906707079 shutdown_connections 2024-09-10T21:18:56.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.558+0000 7f3efb375640 1 --2- 172.21.15.59:0/3906707079 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3ee00b52e0 0x7f3ee00b77a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:56.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.558+0000 7f3efb375640 1 --2- 172.21.15.59:0/3906707079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ef4109150 0x7f3ef419eb20 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:56.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.558+0000 7f3efb375640 1 --2- 172.21.15.59:0/3906707079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ef41087d0 0x7f3ef4199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:56.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.558+0000 7f3efb375640 1 --2- 172.21.15.59:0/3906707079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ef4102dc0 0x7f3ef4199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:56.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.558+0000 7f3efb375640 1 -- 172.21.15.59:0/3906707079 >> 172.21.15.59:0/3906707079 conn(0x7f3ef40fe830 msgr2=0x7f3ef40ff120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:56.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.558+0000 7f3efb375640 1 -- 172.21.15.59:0/3906707079 shutdown_connections 2024-09-10T21:18:56.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:56.558+0000 7f3efb375640 1 -- 172.21.15.59:0/3906707079 wait complete. 2024-09-10T21:18:57.282 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:57 smithi059 ceph-mon[30888]: pgmap v450: 97 pgs: 97 active+clean; 2.4 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:18:57.282 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:57 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3906707079' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:18:57.315 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:18:57.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:57 smithi192 ceph-mon[35363]: pgmap v450: 97 pgs: 97 active+clean; 2.4 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:18:57.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:57 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3906707079' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:18:57.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:57 smithi154 ceph-mon[35041]: pgmap v450: 97 pgs: 97 active+clean; 2.4 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:18:57.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:57 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3906707079' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:18:57.589 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:18:58.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.059+0000 7fe34ff49640 1 -- 172.21.15.59:0/37600132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe348108060 msgr2=0x7fe34810e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:58.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.059+0000 7fe34ff49640 1 --2- 172.21.15.59:0/37600132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe348108060 0x7fe34810e860 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe340009ca0 tx=0x7fe34002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.059+0000 7fe34ff49640 1 -- 172.21.15.59:0/37600132 shutdown_connections 2024-09-10T21:18:58.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.059+0000 7fe34ff49640 1 --2- 172.21.15.59:0/37600132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe348108060 0x7fe34810e860 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.059+0000 7fe34ff49640 1 --2- 172.21.15.59:0/37600132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3481076e0 0x7fe348107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.059+0000 7fe34ff49640 1 --2- 172.21.15.59:0/37600132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe348101cd0 0x7fe3481020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.059+0000 7fe34ff49640 1 -- 172.21.15.59:0/37600132 >> 172.21.15.59:0/37600132 conn(0x7fe3480fd700 msgr2=0x7fe3480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:58.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.059+0000 7fe34ff49640 1 -- 172.21.15.59:0/37600132 shutdown_connections 2024-09-10T21:18:58.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.059+0000 7fe34ff49640 1 -- 172.21.15.59:0/37600132 wait complete. 2024-09-10T21:18:58.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.060+0000 7fe34ff49640 1 Processor -- start 2024-09-10T21:18:58.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.060+0000 7fe34ff49640 1 -- start start 2024-09-10T21:18:58.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.060+0000 7fe34ff49640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe348101cd0 0x7fe348199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:58.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.060+0000 7fe34ff49640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3481076e0 0x7fe348199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:58.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.060+0000 7fe34ff49640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe348108060 0x7fe34819eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:58.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.060+0000 7fe34ff49640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe348112e00 con 0x7fe3481076e0 2024-09-10T21:18:58.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.060+0000 7fe34ff49640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe348112c80 con 0x7fe348108060 2024-09-10T21:18:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.060+0000 7fe34ff49640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe348112f80 con 0x7fe348101cd0 2024-09-10T21:18:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.060+0000 7fe34d4e4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3481076e0 0x7fe348199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.060+0000 7fe34d4e4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3481076e0 0x7fe348199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49704/0 (socket says 172.21.15.59:49704) 2024-09-10T21:18:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.060+0000 7fe34d4e4640 1 -- 172.21.15.59:0/115938101 learned_addr learned my addr 172.21.15.59:0/115938101 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.061+0000 7fe34dce5640 1 --2- 172.21.15.59:0/115938101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe348101cd0 0x7fe348199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.061+0000 7fe34d4e4640 1 -- 172.21.15.59:0/115938101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe348101cd0 msgr2=0x7fe348199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.061+0000 7fe34d4e4640 1 --2- 172.21.15.59:0/115938101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe348101cd0 0x7fe348199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.061+0000 7fe34e4e6640 1 --2- 172.21.15.59:0/115938101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe348108060 0x7fe34819eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.061+0000 7fe34d4e4640 1 -- 172.21.15.59:0/115938101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe348108060 msgr2=0x7fe34819eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.061+0000 7fe34d4e4640 1 --2- 172.21.15.59:0/115938101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe348108060 0x7fe34819eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.061+0000 7fe34d4e4640 1 -- 172.21.15.59:0/115938101 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34819f300 con 0x7fe3481076e0 2024-09-10T21:18:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.061+0000 7fe34dce5640 1 --2- 172.21.15.59:0/115938101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe348101cd0 0x7fe348199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:58.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.061+0000 7fe34e4e6640 1 --2- 172.21.15.59:0/115938101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe348108060 0x7fe34819eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:58.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.061+0000 7fe34d4e4640 1 --2- 172.21.15.59:0/115938101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3481076e0 0x7fe348199790 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe33800e9f0 tx=0x7fe33800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:58.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.061+0000 7fe33effd640 1 -- 172.21.15.59:0/115938101 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33800cd80 con 0x7fe3481076e0 2024-09-10T21:18:58.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.061+0000 7fe33effd640 1 -- 172.21.15.59:0/115938101 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3380054d0 con 0x7fe3481076e0 2024-09-10T21:18:58.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.061+0000 7fe34ff49640 1 -- 172.21.15.59:0/115938101 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe34819f5f0 con 0x7fe3481076e0 2024-09-10T21:18:58.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.061+0000 7fe33effd640 1 -- 172.21.15.59:0/115938101 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338010690 con 0x7fe3481076e0 2024-09-10T21:18:58.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.061+0000 7fe34ff49640 1 -- 172.21.15.59:0/115938101 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3481a5cb0 con 0x7fe3481076e0 2024-09-10T21:18:58.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.063+0000 7fe35231e740 1 Processor -- start 2024-09-10T21:18:58.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.063+0000 7fe33effd640 1 -- 172.21.15.59:0/115938101 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fe338004e90 con 0x7fe3481076e0 2024-09-10T21:18:58.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.064+0000 7fe35231e740 1 -- start start 2024-09-10T21:18:58.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.064+0000 7fe35231e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982cc4d0 0x5651982cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:58.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.064+0000 7fe35231e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982ccdf0 0x5651982dcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:58.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.064+0000 7fe35231e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982dd190 0x5651982df580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:58.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.064+0000 7fe35231e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x565198242ea0 con 0x5651982ccdf0 2024-09-10T21:18:58.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.064+0000 7fe35231e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5651982322d0 con 0x5651982dd190 2024-09-10T21:18:58.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.064+0000 7fe35231e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5651982360e0 con 0x5651982cc4d0 2024-09-10T21:18:58.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.064+0000 7fe34dce5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982ccdf0 0x5651982dcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:58.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.064+0000 7fe34dce5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982ccdf0 0x5651982dcc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49712/0 (socket says 172.21.15.59:49712) 2024-09-10T21:18:58.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.064+0000 7fe34dce5640 1 -- 172.21.15.59:0/1384999054 learned_addr learned my addr 172.21.15.59:0/1384999054 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:58.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.064+0000 7fe34e4e6640 1 --2- 172.21.15.59:0/1384999054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982cc4d0 0x5651982cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:58.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.064+0000 7fe34d4e4640 1 --2- 172.21.15.59:0/1384999054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982dd190 0x5651982df580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:58.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.064+0000 7fe34dce5640 1 -- 172.21.15.59:0/1384999054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982cc4d0 msgr2=0x5651982cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:58.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.065+0000 7fe34dce5640 1 --2- 172.21.15.59:0/1384999054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982cc4d0 0x5651982cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.065+0000 7fe34dce5640 1 -- 172.21.15.59:0/1384999054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982dd190 msgr2=0x5651982df580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:58.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.065+0000 7fe34dce5640 1 --2- 172.21.15.59:0/1384999054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982dd190 0x5651982df580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.065+0000 7fe34dce5640 1 -- 172.21.15.59:0/1384999054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565197f90650 con 0x5651982ccdf0 2024-09-10T21:18:58.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.065+0000 7fe33effd640 1 --2- 172.21.15.59:0/115938101 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe3340b52e0 0x7fe3340b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:58.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.065+0000 7fe34dce5640 1 --2- 172.21.15.59:0/1384999054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982ccdf0 0x5651982dcc50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fe344009c50 tx=0x7fe34400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5326ecf67483fea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:58.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.065+0000 7fe34e4e6640 1 --2- 172.21.15.59:0/115938101 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe3340b52e0 0x7fe3340b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:58.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.065+0000 7fe33effd640 1 -- 172.21.15.59:0/115938101 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe3380e6110 con 0x7fe3481076e0 2024-09-10T21:18:58.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.065+0000 7fe333fff640 1 -- 172.21.15.59:0/1384999054 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344016070 con 0x5651982ccdf0 2024-09-10T21:18:58.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.065+0000 7fe333fff640 1 -- 172.21.15.59:0/1384999054 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3440054d0 con 0x5651982ccdf0 2024-09-10T21:18:58.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.065+0000 7fe333fff640 1 -- 172.21.15.59:0/1384999054 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344011470 con 0x5651982ccdf0 2024-09-10T21:18:58.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.066+0000 7fe35231e740 1 -- 172.21.15.59:0/1384999054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982ccdf0 msgr2=0x5651982dcc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:58.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.066+0000 7fe34e4e6640 1 --2- 172.21.15.59:0/115938101 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe3340b52e0 0x7fe3340b77a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe340005e30 tx=0x7fe3400098c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:58.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.066+0000 7fe35231e740 1 --2- 172.21.15.59:0/1384999054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982ccdf0 0x5651982dcc50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fe344009c50 tx=0x7fe34400e6c0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.066+0000 7fe35231e740 1 -- 172.21.15.59:0/1384999054 shutdown_connections 2024-09-10T21:18:58.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.066+0000 7fe35231e740 1 --2- 172.21.15.59:0/1384999054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982dd190 0x5651982df580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.066+0000 7fe35231e740 1 --2- 172.21.15.59:0/1384999054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982ccdf0 0x5651982dcc50 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.066+0000 7fe35231e740 1 --2- 172.21.15.59:0/1384999054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982cc4d0 0x5651982cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.066+0000 7fe35231e740 1 -- 172.21.15.59:0/1384999054 >> 172.21.15.59:0/1384999054 conn(0x5651982ca300 msgr2=0x5651982cb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:58.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.066+0000 7fe35231e740 1 -- 172.21.15.59:0/1384999054 shutdown_connections 2024-09-10T21:18:58.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.066+0000 7fe35231e740 1 -- 172.21.15.59:0/1384999054 wait complete. 2024-09-10T21:18:58.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.066+0000 7fe35231e740 1 -- start start 2024-09-10T21:18:58.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.066+0000 7fe35231e740 1 Processor -- start 2024-09-10T21:18:58.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.067+0000 7fe35231e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982cc4d0 0x5651982dc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:58.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.067+0000 7fe35231e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982ccdf0 0x5651982d9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:58.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.067+0000 7fe35231e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982dd190 0x5651982da390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:58.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.067+0000 7fe35231e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x565198093700 con 0x5651982cc4d0 2024-09-10T21:18:58.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.067+0000 7fe35231e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5651981cd160 con 0x5651982ccdf0 2024-09-10T21:18:58.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.067+0000 7fe35231e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5651982dfe10 con 0x5651982dd190 2024-09-10T21:18:58.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.067+0000 7fe35231e740 10 client.0 _ll_register_callbacks cb 0x5651981e69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:58.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.067+0000 7fe34dce5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982cc4d0 0x5651982dc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:58.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.067+0000 7fe34dce5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982cc4d0 0x5651982dc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49722/0 (socket says 172.21.15.59:49722) 2024-09-10T21:18:58.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.067+0000 7fe34dce5640 1 -- 172.21.15.59:0/1339050627 learned_addr learned my addr 172.21.15.59:0/1339050627 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:58.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.067+0000 7fe34e4e6640 1 --2- 172.21.15.59:0/1339050627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982dd190 0x5651982da390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:58.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.067+0000 7fe34d4e4640 1 --2- 172.21.15.59:0/1339050627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982ccdf0 0x5651982d9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:58.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.067+0000 7fe34dce5640 1 -- 172.21.15.59:0/1339050627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982dd190 msgr2=0x5651982da390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:58.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.067+0000 7fe34dce5640 1 --2- 172.21.15.59:0/1339050627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982dd190 0x5651982da390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.067+0000 7fe34dce5640 1 -- 172.21.15.59:0/1339050627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982ccdf0 msgr2=0x5651982d9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:58.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.067+0000 7fe34dce5640 1 --2- 172.21.15.59:0/1339050627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982ccdf0 0x5651982d9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.067+0000 7fe34dce5640 1 -- 172.21.15.59:0/1339050627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651981fac90 con 0x5651982cc4d0 2024-09-10T21:18:58.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.067+0000 7fe34e4e6640 1 --2- 172.21.15.59:0/1339050627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982dd190 0x5651982da390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:58.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.068+0000 7fe34dce5640 1 --2- 172.21.15.59:0/1339050627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982cc4d0 0x5651982dc9b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe344005e50 tx=0x7fe344005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3cb6eac7289480 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:58.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.068+0000 7fe3317fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:58.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.068+0000 7fe3317fa640 1 -- 172.21.15.59:0/1339050627 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344028060 con 0x5651982cc4d0 2024-09-10T21:18:58.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.068+0000 7fe3317fa640 1 -- 172.21.15.59:0/1339050627 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe344009760 con 0x5651982cc4d0 2024-09-10T21:18:58.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.068+0000 7fe35231e740 1 -- 172.21.15.59:0/1339050627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3440054d0 con 0x5651982cc4d0 2024-09-10T21:18:58.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.068+0000 7fe3317fa640 1 -- 172.21.15.59:0/1339050627 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe344016040 con 0x5651982cc4d0 2024-09-10T21:18:58.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.068+0000 7fe35231e740 10 client.16278 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.068+0000 7fe35231e740 1 -- 172.21.15.59:0/1339050627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5651982eb6b0 con 0x5651982cc4d0 2024-09-10T21:18:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.068+0000 7fe3317fa640 1 -- 172.21.15.59:0/1339050627 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3440054d0 con 0x5651982cc4d0 2024-09-10T21:18:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.068+0000 7fe3317fa640 1 -- 172.21.15.59:0/1339050627 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe34400f040 con 0x5651982cc4d0 2024-09-10T21:18:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.068+0000 7fe35231e740 10 client.16278 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.068+0000 7fe35231e740 10 client.16278 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:18:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.068+0000 7fe35231e740 20 client.16278 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.068+0000 7fe35231e740 1 --2- 172.21.15.59:0/1339050627 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5651982eca60 0x5651982eee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.068+0000 7fe35231e740 4 client.16278 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:18:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.068+0000 7fe35231e740 1 -- 172.21.15.59:0/1339050627 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565198244df0 con 0x5651982eca60 2024-09-10T21:18:58.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.069+0000 7fe34d4e4640 1 --2- 172.21.15.59:0/1339050627 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5651982eca60 0x5651982eee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:58.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.069+0000 7fe34d4e4640 1 --2- 172.21.15.59:0/1339050627 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5651982eca60 0x5651982eee50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9cdc24177e1ce1bc server_cookie=287f2c63c87a6c19 in_seq=0 out_seq=0 2024-09-10T21:18:58.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.069+0000 7fe3317fa640 10 client.16278 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:18:58.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.070+0000 7fe3317fa640 1 -- 172.21.15.59:0/1339050627 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565198244df0 con 0x5651982eca60 2024-09-10T21:18:58.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.070+0000 7fe3317fa640 10 client.16278 handle_command_reply: tid=0 2024-09-10T21:18:58.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.070+0000 7fe35231e740 1 client.16278 shutdown 2024-09-10T21:18:58.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.070+0000 7fe35231e740 1 -- 172.21.15.59:0/1339050627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982cc4d0 msgr2=0x5651982dc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:58.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.070+0000 7fe35231e740 1 --2- 172.21.15.59:0/1339050627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982cc4d0 0x5651982dc9b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe344005e50 tx=0x7fe344005e80 comp rx=0 tx=0).stop 2024-09-10T21:18:58.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.070+0000 7fe35231e740 1 -- 172.21.15.59:0/1339050627 shutdown_connections 2024-09-10T21:18:58.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.070+0000 7fe35231e740 1 --2- 172.21.15.59:0/1339050627 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5651982eca60 0x5651982eee50 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.070+0000 7fe35231e740 1 --2- 172.21.15.59:0/1339050627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982dd190 0x5651982da390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.070+0000 7fe35231e740 1 --2- 172.21.15.59:0/1339050627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982ccdf0 0x5651982d9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.070+0000 7fe35231e740 1 --2- 172.21.15.59:0/1339050627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982cc4d0 0x5651982dc9b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.070+0000 7fe3317fa640 0 client.16278 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:18:58.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.070+0000 7fe35231e740 1 -- 172.21.15.59:0/1339050627 >> 172.21.15.59:0/1339050627 conn(0x5651982ca300 msgr2=0x5651982cfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:58.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.070+0000 7fe35231e740 1 -- 172.21.15.59:0/1339050627 shutdown_connections 2024-09-10T21:18:58.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.070+0000 7fe35231e740 1 -- 172.21.15.59:0/1339050627 wait complete. 2024-09-10T21:18:58.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.070+0000 7fe35231e740 20 client.16278 trim_cache size 0 max 16384 2024-09-10T21:18:58.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.083+0000 7fe35231e740 1 Processor -- start 2024-09-10T21:18:58.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.083+0000 7fe35231e740 1 -- start start 2024-09-10T21:18:58.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe35231e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982cc4d0 0x5651982cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:58.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe35231e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982ccdf0 0x5651982f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:58.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe35231e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982dd190 0x5651982f49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe35231e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe3481ac150 con 0x5651982cc4d0 2024-09-10T21:18:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe35231e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe3481adc90 con 0x5651982ccdf0 2024-09-10T21:18:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe35231e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe3481ac820 con 0x5651982dd190 2024-09-10T21:18:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe34dce5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982cc4d0 0x5651982cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe34dce5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982cc4d0 0x5651982cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49728/0 (socket says 172.21.15.59:49728) 2024-09-10T21:18:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe34dce5640 1 -- 172.21.15.59:0/2433770649 learned_addr learned my addr 172.21.15.59:0/2433770649 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe34e4e6640 1 --2- 172.21.15.59:0/2433770649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982dd190 0x5651982f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe34dce5640 1 -- 172.21.15.59:0/2433770649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982dd190 msgr2=0x5651982f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe34dce5640 1 --2- 172.21.15.59:0/2433770649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982dd190 0x5651982f49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe34d4e4640 1 --2- 172.21.15.59:0/2433770649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982ccdf0 0x5651982f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe34dce5640 1 -- 172.21.15.59:0/2433770649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982ccdf0 msgr2=0x5651982f44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe34dce5640 1 --2- 172.21.15.59:0/2433770649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982ccdf0 0x5651982f44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe34dce5640 1 -- 172.21.15.59:0/2433770649 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651982c5bb0 con 0x5651982cc4d0 2024-09-10T21:18:58.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe34d4e4640 1 --2- 172.21.15.59:0/2433770649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982ccdf0 0x5651982f44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:58.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe34dce5640 1 --2- 172.21.15.59:0/2433770649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982cc4d0 0x5651982cb6f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe3440058d0 tx=0x7fe344009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b399ec8db88b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:58.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe3337fe640 1 -- 172.21.15.59:0/2433770649 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344034030 con 0x5651982cc4d0 2024-09-10T21:18:58.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe3337fe640 1 -- 172.21.15.59:0/2433770649 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe344009760 con 0x5651982cc4d0 2024-09-10T21:18:58.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.084+0000 7fe3337fe640 1 -- 172.21.15.59:0/2433770649 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344028070 con 0x5651982cc4d0 2024-09-10T21:18:58.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.085+0000 7fe35231e740 1 -- 172.21.15.59:0/2433770649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982cc4d0 msgr2=0x5651982cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:58.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.085+0000 7fe35231e740 1 --2- 172.21.15.59:0/2433770649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982cc4d0 0x5651982cb6f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe3440058d0 tx=0x7fe344009540 comp rx=0 tx=0).stop 2024-09-10T21:18:58.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.085+0000 7fe35231e740 1 -- 172.21.15.59:0/2433770649 shutdown_connections 2024-09-10T21:18:58.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.085+0000 7fe35231e740 1 --2- 172.21.15.59:0/2433770649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982dd190 0x5651982f49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.085+0000 7fe35231e740 1 --2- 172.21.15.59:0/2433770649 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982ccdf0 0x5651982f44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.085+0000 7fe35231e740 1 --2- 172.21.15.59:0/2433770649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982cc4d0 0x5651982cb6f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.085+0000 7fe35231e740 1 -- 172.21.15.59:0/2433770649 >> 172.21.15.59:0/2433770649 conn(0x5651982ca300 msgr2=0x5651982cafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:58.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.085+0000 7fe35231e740 1 -- 172.21.15.59:0/2433770649 shutdown_connections 2024-09-10T21:18:58.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.085+0000 7fe35231e740 1 -- 172.21.15.59:0/2433770649 wait complete. 2024-09-10T21:18:58.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.085+0000 7fe35231e740 1 -- start start 2024-09-10T21:18:58.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.086+0000 7fe35231e740 1 Processor -- start 2024-09-10T21:18:58.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.086+0000 7fe35231e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982cc4d0 0x5651982e50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:58.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.086+0000 7fe35231e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982ccdf0 0x5651982e5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:58.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.086+0000 7fe35231e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982dd190 0x5651982e20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.086+0000 7fe35231e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe3481ad5c0 con 0x5651982ccdf0 2024-09-10T21:18:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.086+0000 7fe35231e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe3481acef0 con 0x5651982dd190 2024-09-10T21:18:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.086+0000 7fe35231e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe3481aa130 con 0x5651982cc4d0 2024-09-10T21:18:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.086+0000 7fe35231e740 10 client.0 _ll_register_callbacks cb 0x7fe344009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.086+0000 7fe34d4e4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982ccdf0 0x5651982e5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.086+0000 7fe34d4e4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982ccdf0 0x5651982e5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49734/0 (socket says 172.21.15.59:49734) 2024-09-10T21:18:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.086+0000 7fe34d4e4640 1 -- 172.21.15.59:0/2881101752 learned_addr learned my addr 172.21.15.59:0/2881101752 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.086+0000 7fe34dce5640 1 --2- 172.21.15.59:0/2881101752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982cc4d0 0x5651982e50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.086+0000 7fe34d4e4640 1 -- 172.21.15.59:0/2881101752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982cc4d0 msgr2=0x5651982e50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.086+0000 7fe34d4e4640 1 --2- 172.21.15.59:0/2881101752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982cc4d0 0x5651982e50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.086+0000 7fe34d4e4640 1 -- 172.21.15.59:0/2881101752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982dd190 msgr2=0x5651982e20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.086+0000 7fe34e4e6640 1 --2- 172.21.15.59:0/2881101752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982dd190 0x5651982e20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.086+0000 7fe34d4e4640 1 --2- 172.21.15.59:0/2881101752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982dd190 0x5651982e20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.087+0000 7fe34d4e4640 1 -- 172.21.15.59:0/2881101752 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651982e5e40 con 0x5651982ccdf0 2024-09-10T21:18:58.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.087+0000 7fe34d4e4640 1 --2- 172.21.15.59:0/2881101752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982ccdf0 0x5651982e5610 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fe3380a9b70 tx=0x7fe3380ac130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21c12c259b9b79c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:58.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.087+0000 7fe3317fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:58.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.087+0000 7fe3317fa640 1 -- 172.21.15.59:0/2881101752 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3380b1070 con 0x5651982ccdf0 2024-09-10T21:18:58.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.087+0000 7fe3317fa640 1 -- 172.21.15.59:0/2881101752 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe3380a8b70 con 0x5651982ccdf0 2024-09-10T21:18:58.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.087+0000 7fe35231e740 1 -- 172.21.15.59:0/2881101752 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe344009760 con 0x5651982ccdf0 2024-09-10T21:18:58.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.087+0000 7fe3317fa640 1 -- 172.21.15.59:0/2881101752 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe3380ad000 con 0x5651982ccdf0 2024-09-10T21:18:58.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.087+0000 7fe35231e740 10 client.16284 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:58.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.087+0000 7fe35231e740 1 -- 172.21.15.59:0/2881101752 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x565198359c90 con 0x5651982ccdf0 2024-09-10T21:18:58.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.087+0000 7fe3317fa640 1 -- 172.21.15.59:0/2881101752 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe344009760 con 0x5651982ccdf0 2024-09-10T21:18:58.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.087+0000 7fe3317fa640 1 -- 172.21.15.59:0/2881101752 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe3380b5a00 con 0x5651982ccdf0 2024-09-10T21:18:58.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.087+0000 7fe35231e740 10 client.16284 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.087+0000 7fe35231e740 10 client.16284 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:18:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.087+0000 7fe35231e740 20 client.16284 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.087+0000 7fe35231e740 1 --2- 172.21.15.59:0/2881101752 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56519835a3c0 0x56519835c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.087+0000 7fe35231e740 4 client.16284 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:18:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.087+0000 7fe35231e740 1 -- 172.21.15.59:0/2881101752 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5651982408a0 con 0x56519835a3c0 2024-09-10T21:18:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.088+0000 7fe34dce5640 1 --2- 172.21.15.59:0/2881101752 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56519835a3c0 0x56519835c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.088+0000 7fe34dce5640 1 --2- 172.21.15.59:0/2881101752 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56519835a3c0 0x56519835c7e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7c9b0468581287c4 server_cookie=501124fa6ae238a3 in_seq=0 out_seq=0 2024-09-10T21:18:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.088+0000 7fe3317fa640 10 client.16284 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:18:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.088+0000 7fe3317fa640 1 -- 172.21.15.59:0/2881101752 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5651982408a0 con 0x56519835a3c0 2024-09-10T21:18:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.088+0000 7fe3317fa640 10 client.16284 handle_command_reply: tid=0 2024-09-10T21:18:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.088+0000 7fe35231e740 1 client.16284 shutdown 2024-09-10T21:18:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.088+0000 7fe35231e740 1 -- 172.21.15.59:0/2881101752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982ccdf0 msgr2=0x5651982e5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.088+0000 7fe35231e740 1 --2- 172.21.15.59:0/2881101752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982ccdf0 0x5651982e5610 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fe3380a9b70 tx=0x7fe3380ac130 comp rx=0 tx=0).stop 2024-09-10T21:18:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe35231e740 1 -- 172.21.15.59:0/2881101752 shutdown_connections 2024-09-10T21:18:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe35231e740 1 --2- 172.21.15.59:0/2881101752 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56519835a3c0 0x56519835c7e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe35231e740 1 --2- 172.21.15.59:0/2881101752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5651982dd190 0x5651982e20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe35231e740 1 --2- 172.21.15.59:0/2881101752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5651982ccdf0 0x5651982e5610 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe35231e740 1 --2- 172.21.15.59:0/2881101752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5651982cc4d0 0x5651982e50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe3317fa640 0 client.16284 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:18:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe35231e740 1 -- 172.21.15.59:0/2881101752 >> 172.21.15.59:0/2881101752 conn(0x5651982ca300 msgr2=0x5651982c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:58.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe35231e740 1 -- 172.21.15.59:0/2881101752 shutdown_connections 2024-09-10T21:18:58.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe35231e740 1 -- 172.21.15.59:0/2881101752 wait complete. 2024-09-10T21:18:58.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe35231e740 20 client.16284 trim_cache size 0 max 16384 2024-09-10T21:18:58.099 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:18:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe34ff49640 1 -- 172.21.15.59:0/115938101 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe3340b52e0 msgr2=0x7fe3340b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe34ff49640 1 --2- 172.21.15.59:0/115938101 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe3340b52e0 0x7fe3340b77a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe340005e30 tx=0x7fe3400098c0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe34ff49640 1 -- 172.21.15.59:0/115938101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3481076e0 msgr2=0x7fe348199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe34ff49640 1 --2- 172.21.15.59:0/115938101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3481076e0 0x7fe348199790 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe33800e9f0 tx=0x7fe33800edf0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe34ff49640 1 -- 172.21.15.59:0/115938101 shutdown_connections 2024-09-10T21:18:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe34ff49640 1 --2- 172.21.15.59:0/115938101 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe3340b52e0 0x7fe3340b77a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe34ff49640 1 --2- 172.21.15.59:0/115938101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe348108060 0x7fe34819eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe34ff49640 1 --2- 172.21.15.59:0/115938101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3481076e0 0x7fe348199790 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe34ff49640 1 --2- 172.21.15.59:0/115938101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe348101cd0 0x7fe348199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.089+0000 7fe34ff49640 1 -- 172.21.15.59:0/115938101 >> 172.21.15.59:0/115938101 conn(0x7fe3480fd700 msgr2=0x7fe3480ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:58.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.090+0000 7fe34ff49640 1 -- 172.21.15.59:0/115938101 shutdown_connections 2024-09-10T21:18:58.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:58.090+0000 7fe34ff49640 1 -- 172.21.15.59:0/115938101 wait complete. 2024-09-10T21:18:58.940 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:18:59.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:18:59 smithi059 ceph-mon[30888]: pgmap v451: 97 pgs: 97 active+clean; 2.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:18:59.202 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:18:59.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:18:59 smithi192 ceph-mon[35363]: pgmap v451: 97 pgs: 97 active+clean; 2.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:18:59.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:18:59 smithi154 ceph-mon[35041]: pgmap v451: 97 pgs: 97 active+clean; 2.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:18:59.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.684+0000 7fcf3d7a7640 1 -- 172.21.15.59:0/4070047776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38109170 msgr2=0x7fcf3810f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:59.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.684+0000 7fcf3d7a7640 1 --2- 172.21.15.59:0/4070047776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38109170 0x7fcf3810f970 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009900 tx=0x7fcf3002a410 comp rx=0 tx=0).stop 2024-09-10T21:18:59.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.684+0000 7fcf3d7a7640 1 -- 172.21.15.59:0/4070047776 shutdown_connections 2024-09-10T21:18:59.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.684+0000 7fcf3d7a7640 1 --2- 172.21.15.59:0/4070047776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38109170 0x7fcf3810f970 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.684+0000 7fcf3d7a7640 1 --2- 172.21.15.59:0/4070047776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf381087f0 0x7fcf38108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.684+0000 7fcf3d7a7640 1 --2- 172.21.15.59:0/4070047776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf38102de0 0x7fcf381031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.684+0000 7fcf3d7a7640 1 -- 172.21.15.59:0/4070047776 >> 172.21.15.59:0/4070047776 conn(0x7fcf380fe830 msgr2=0x7fcf38100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.684+0000 7fcf3d7a7640 1 -- 172.21.15.59:0/4070047776 shutdown_connections 2024-09-10T21:18:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.684+0000 7fcf3d7a7640 1 -- 172.21.15.59:0/4070047776 wait complete. 2024-09-10T21:18:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.684+0000 7fcf3d7a7640 1 Processor -- start 2024-09-10T21:18:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.685+0000 7fcf3d7a7640 1 -- start start 2024-09-10T21:18:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.685+0000 7fcf3d7a7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf38102de0 0x7fcf380754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.685+0000 7fcf3d7a7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf381087f0 0x7fcf380759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.685+0000 7fcf3d7a7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38109170 0x7fcf38075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.685+0000 7fcf3d7a7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcf38112e30 con 0x7fcf38109170 2024-09-10T21:18:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.685+0000 7fcf3d7a7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcf38112cb0 con 0x7fcf381087f0 2024-09-10T21:18:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.685+0000 7fcf3d7a7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcf38112fb0 con 0x7fcf38102de0 2024-09-10T21:18:59.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.685+0000 7fcf377fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38109170 0x7fcf38075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:59.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.685+0000 7fcf377fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38109170 0x7fcf38075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35730/0 (socket says 172.21.15.59:35730) 2024-09-10T21:18:59.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.685+0000 7fcf377fe640 1 -- 172.21.15.59:0/94431890 learned_addr learned my addr 172.21.15.59:0/94431890 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:59.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.685+0000 7fcf36ffd640 1 --2- 172.21.15.59:0/94431890 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf38102de0 0x7fcf380754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:59.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.685+0000 7fcf367fc640 1 --2- 172.21.15.59:0/94431890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf381087f0 0x7fcf380759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:59.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.685+0000 7fcf377fe640 1 -- 172.21.15.59:0/94431890 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf38102de0 msgr2=0x7fcf380754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:59.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.685+0000 7fcf377fe640 1 --2- 172.21.15.59:0/94431890 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf38102de0 0x7fcf380754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.685+0000 7fcf377fe640 1 -- 172.21.15.59:0/94431890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf381087f0 msgr2=0x7fcf380759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:59.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.685+0000 7fcf377fe640 1 --2- 172.21.15.59:0/94431890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf381087f0 0x7fcf380759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.685+0000 7fcf377fe640 1 -- 172.21.15.59:0/94431890 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf381a7640 con 0x7fcf38109170 2024-09-10T21:18:59.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.686+0000 7fcf377fe640 1 --2- 172.21.15.59:0/94431890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38109170 0x7fcf38075f20 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fcf30004770 tx=0x7fcf30004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:59.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.686+0000 7fcf1ffff640 1 -- 172.21.15.59:0/94431890 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3003f030 con 0x7fcf38109170 2024-09-10T21:18:59.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.686+0000 7fcf1ffff640 1 -- 172.21.15.59:0/94431890 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf30003aa0 con 0x7fcf38109170 2024-09-10T21:18:59.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.686+0000 7fcf3d7a7640 1 -- 172.21.15.59:0/94431890 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf381a78d0 con 0x7fcf38109170 2024-09-10T21:18:59.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.686+0000 7fcf1ffff640 1 -- 172.21.15.59:0/94431890 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf30035070 con 0x7fcf38109170 2024-09-10T21:18:59.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.686+0000 7fcf3d7a7640 1 -- 172.21.15.59:0/94431890 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf381a7db0 con 0x7fcf38109170 2024-09-10T21:18:59.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.688+0000 7fcf3fb7c740 1 Processor -- start 2024-09-10T21:18:59.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.688+0000 7fcf1ffff640 1 -- 172.21.15.59:0/94431890 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fcf300035f0 con 0x7fcf38109170 2024-09-10T21:18:59.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.688+0000 7fcf3fb7c740 1 -- start start 2024-09-10T21:18:59.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf3fb7c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c4b4d0 0x5652d3c4b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:59.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf3fb7c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4bdf0 0x5652d3c57840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:59.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf3fb7c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c57d80 0x5652d3c5a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:59.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf3fb7c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5652d3bc1ea0 con 0x5652d3c57d80 2024-09-10T21:18:59.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf3fb7c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5652d3bb12d0 con 0x5652d3c4bdf0 2024-09-10T21:18:59.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf3fb7c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5652d3bb50e0 con 0x5652d3c4b4d0 2024-09-10T21:18:59.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf367fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c57d80 0x5652d3c5a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf367fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c57d80 0x5652d3c5a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35732/0 (socket says 172.21.15.59:35732) 2024-09-10T21:18:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf367fc640 1 -- 172.21.15.59:0/304698328 learned_addr learned my addr 172.21.15.59:0/304698328 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf36ffd640 1 --2- 172.21.15.59:0/304698328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4bdf0 0x5652d3c57840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf367fc640 1 --2- 172.21.15.59:0/304698328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c4b4d0 0x5652d3c4b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf1ffff640 1 --2- 172.21.15.59:0/94431890 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcf200b52e0 0x7fcf200b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf367fc640 1 -- 172.21.15.59:0/304698328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c4b4d0 msgr2=0x5652d3c4b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf367fc640 1 --2- 172.21.15.59:0/304698328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c4b4d0 0x5652d3c4b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf367fc640 1 -- 172.21.15.59:0/304698328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4bdf0 msgr2=0x5652d3c57840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf367fc640 1 --2- 172.21.15.59:0/304698328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4bdf0 0x5652d3c57840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf367fc640 1 -- 172.21.15.59:0/304698328 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652d390f650 con 0x5652d3c57d80 2024-09-10T21:18:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf36ffd640 1 --2- 172.21.15.59:0/304698328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4bdf0 0x5652d3c57840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf377fe640 1 --2- 172.21.15.59:0/94431890 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcf200b52e0 0x7fcf200b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:59.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.689+0000 7fcf1ffff640 1 -- 172.21.15.59:0/94431890 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcf301066a0 con 0x7fcf38109170 2024-09-10T21:18:59.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.690+0000 7fcf367fc640 1 --2- 172.21.15.59:0/304698328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c57d80 0x5652d3c5a170 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c013580 tx=0x7fcf2c00c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268d429dedecc684 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:59.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.690+0000 7fcf1d7fa640 1 -- 172.21.15.59:0/304698328 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c019030 con 0x5652d3c57d80 2024-09-10T21:18:59.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.690+0000 7fcf1d7fa640 1 -- 172.21.15.59:0/304698328 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf2c0119d0 con 0x5652d3c57d80 2024-09-10T21:18:59.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.690+0000 7fcf1d7fa640 1 -- 172.21.15.59:0/304698328 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c00fa60 con 0x5652d3c57d80 2024-09-10T21:18:59.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.690+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/304698328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c57d80 msgr2=0x5652d3c5a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:59.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.690+0000 7fcf377fe640 1 --2- 172.21.15.59:0/94431890 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcf200b52e0 0x7fcf200b77a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcf300ccb90 tx=0x7fcf30091550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:59.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.690+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/304698328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c57d80 0x5652d3c5a170 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c013580 tx=0x7fcf2c00c6b0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.691+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/304698328 shutdown_connections 2024-09-10T21:18:59.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.691+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/304698328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c57d80 0x5652d3c5a170 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.691+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/304698328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4bdf0 0x5652d3c57840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.691+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/304698328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c4b4d0 0x5652d3c4b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.691+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/304698328 >> 172.21.15.59:0/304698328 conn(0x5652d3c49300 msgr2=0x5652d3c4a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:59.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.691+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/304698328 shutdown_connections 2024-09-10T21:18:59.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.691+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/304698328 wait complete. 2024-09-10T21:18:59.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.691+0000 7fcf3fb7c740 1 -- start start 2024-09-10T21:18:59.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.691+0000 7fcf3fb7c740 1 Processor -- start 2024-09-10T21:18:59.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.691+0000 7fcf3fb7c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4b4d0 0x5652d3c576b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:59.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.691+0000 7fcf3fb7c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4bdf0 0x5652d3c54b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:59.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.691+0000 7fcf3fb7c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c57d80 0x5652d3c55180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:59.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.691+0000 7fcf3fb7c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5652d3a12700 con 0x5652d3c4bdf0 2024-09-10T21:18:59.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.691+0000 7fcf3fb7c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5652d3b4c160 con 0x5652d3c4b4d0 2024-09-10T21:18:59.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.691+0000 7fcf3fb7c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5652d3c5aa00 con 0x5652d3c57d80 2024-09-10T21:18:59.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.691+0000 7fcf3fb7c740 10 client.0 _ll_register_callbacks cb 0x5652d3b659e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.692+0000 7fcf36ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4bdf0 0x5652d3c54b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.692+0000 7fcf36ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4bdf0 0x5652d3c54b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35734/0 (socket says 172.21.15.59:35734) 2024-09-10T21:18:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.692+0000 7fcf36ffd640 1 -- 172.21.15.59:0/1599176735 learned_addr learned my addr 172.21.15.59:0/1599176735 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.692+0000 7fcf367fc640 1 --2- 172.21.15.59:0/1599176735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4b4d0 0x5652d3c576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.692+0000 7fcf367fc640 1 --2- 172.21.15.59:0/1599176735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c57d80 0x5652d3c55180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.692+0000 7fcf36ffd640 1 -- 172.21.15.59:0/1599176735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c57d80 msgr2=0x5652d3c55180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.692+0000 7fcf36ffd640 1 --2- 172.21.15.59:0/1599176735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c57d80 0x5652d3c55180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.692+0000 7fcf36ffd640 1 -- 172.21.15.59:0/1599176735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4b4d0 msgr2=0x5652d3c576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.692+0000 7fcf36ffd640 1 --2- 172.21.15.59:0/1599176735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4b4d0 0x5652d3c576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.692+0000 7fcf36ffd640 1 -- 172.21.15.59:0/1599176735 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652d3b79c90 con 0x5652d3c4bdf0 2024-09-10T21:18:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.692+0000 7fcf367fc640 1 --2- 172.21.15.59:0/1599176735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c57d80 0x5652d3c55180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:18:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.692+0000 7fcf36ffd640 1 --2- 172.21.15.59:0/1599176735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4bdf0 0x5652d3c54b00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fcf28009f30 tx=0x7fcf280044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9d4a88ae9d0a26 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:59.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.692+0000 7fcf1aff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.692+0000 7fcf1aff5640 1 -- 172.21.15.59:0/1599176735 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf28011860 con 0x5652d3c4bdf0 2024-09-10T21:18:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.692+0000 7fcf1aff5640 1 -- 172.21.15.59:0/1599176735 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcf28011a00 con 0x5652d3c4bdf0 2024-09-10T21:18:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.692+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/1599176735 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf2c0119d0 con 0x5652d3c4bdf0 2024-09-10T21:18:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.692+0000 7fcf1aff5640 1 -- 172.21.15.59:0/1599176735 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcf28011c00 con 0x5652d3c4bdf0 2024-09-10T21:18:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.692+0000 7fcf3fb7c740 10 client.16296 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.692+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/1599176735 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5652d3c66400 con 0x5652d3c4bdf0 2024-09-10T21:18:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.693+0000 7fcf1aff5640 1 -- 172.21.15.59:0/1599176735 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf2c0119d0 con 0x5652d3c4bdf0 2024-09-10T21:18:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.693+0000 7fcf1aff5640 1 -- 172.21.15.59:0/1599176735 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcf2800f040 con 0x5652d3c4bdf0 2024-09-10T21:18:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.693+0000 7fcf3fb7c740 10 client.16296 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.693+0000 7fcf3fb7c740 10 client.16296 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:18:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.693+0000 7fcf3fb7c740 20 client.16296 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.693+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/1599176735 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5652d3c678c0 0x5652d3c69d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.693+0000 7fcf3fb7c740 4 client.16296 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:18:59.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.693+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/1599176735 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652d3bc3df0 con 0x5652d3c678c0 2024-09-10T21:18:59.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.693+0000 7fcf367fc640 1 --2- 172.21.15.59:0/1599176735 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5652d3c678c0 0x5652d3c69d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:59.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.694+0000 7fcf367fc640 1 --2- 172.21.15.59:0/1599176735 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5652d3c678c0 0x5652d3c69d10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a5426949c115c273 server_cookie=39abe3cb2141b9c8 in_seq=0 out_seq=0 2024-09-10T21:18:59.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.694+0000 7fcf1aff5640 10 client.16296 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:18:59.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.694+0000 7fcf1aff5640 1 -- 172.21.15.59:0/1599176735 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5652d3bc3df0 con 0x5652d3c678c0 2024-09-10T21:18:59.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.694+0000 7fcf1aff5640 10 client.16296 handle_command_reply: tid=0 2024-09-10T21:18:59.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.694+0000 7fcf3fb7c740 1 client.16296 shutdown 2024-09-10T21:18:59.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.694+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/1599176735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4bdf0 msgr2=0x5652d3c54b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:59.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.694+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/1599176735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4bdf0 0x5652d3c54b00 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fcf28009f30 tx=0x7fcf280044d0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.695+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/1599176735 shutdown_connections 2024-09-10T21:18:59.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.695+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/1599176735 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5652d3c678c0 0x5652d3c69d10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.695+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/1599176735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c57d80 0x5652d3c55180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.695+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/1599176735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4bdf0 0x5652d3c54b00 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.695+0000 7fcf1aff5640 0 client.16296 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:18:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.695+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/1599176735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4b4d0 0x5652d3c576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.695+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/1599176735 >> 172.21.15.59:0/1599176735 conn(0x5652d3c49300 msgr2=0x5652d3c4ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.695+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/1599176735 shutdown_connections 2024-09-10T21:18:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.695+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/1599176735 wait complete. 2024-09-10T21:18:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.695+0000 7fcf3fb7c740 20 client.16296 trim_cache size 0 max 16384 2024-09-10T21:18:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.708+0000 7fcf3fb7c740 1 Processor -- start 2024-09-10T21:18:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.708+0000 7fcf3fb7c740 1 -- start start 2024-09-10T21:18:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.708+0000 7fcf3fb7c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4b4d0 0x5652d3c63c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.708+0000 7fcf3fb7c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4bdf0 0x5652d3c53ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.708+0000 7fcf3fb7c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c57d80 0x5652d3c53380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.708+0000 7fcf3fb7c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcf381b0450 con 0x5652d3c4b4d0 2024-09-10T21:18:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.708+0000 7fcf3fb7c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcf381b1f90 con 0x5652d3c4bdf0 2024-09-10T21:18:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.708+0000 7fcf3fb7c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcf381b0b20 con 0x5652d3c57d80 2024-09-10T21:18:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.709+0000 7fcf367fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4b4d0 0x5652d3c63c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.709+0000 7fcf367fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4b4d0 0x5652d3c63c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35742/0 (socket says 172.21.15.59:35742) 2024-09-10T21:18:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.709+0000 7fcf367fc640 1 -- 172.21.15.59:0/2962073618 learned_addr learned my addr 172.21.15.59:0/2962073618 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.709+0000 7fcf36ffd640 1 --2- 172.21.15.59:0/2962073618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4bdf0 0x5652d3c53ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.709+0000 7fcf367fc640 1 -- 172.21.15.59:0/2962073618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c57d80 msgr2=0x5652d3c53380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.709+0000 7fcf367fc640 1 --2- 172.21.15.59:0/2962073618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c57d80 0x5652d3c53380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.709+0000 7fcf367fc640 1 -- 172.21.15.59:0/2962073618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4bdf0 msgr2=0x5652d3c53ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.709+0000 7fcf367fc640 1 --2- 172.21.15.59:0/2962073618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4bdf0 0x5652d3c53ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.709+0000 7fcf367fc640 1 -- 172.21.15.59:0/2962073618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652d3c4bc20 con 0x5652d3c4b4d0 2024-09-10T21:18:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.709+0000 7fcf367fc640 1 --2- 172.21.15.59:0/2962073618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4b4d0 0x5652d3c63c60 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00f6d0 tx=0x7fcf2c00f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91c08d55aa39fe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.709+0000 7fcf1cff9640 1 -- 172.21.15.59:0/2962073618 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c019040 con 0x5652d3c4b4d0 2024-09-10T21:18:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.709+0000 7fcf1cff9640 1 -- 172.21.15.59:0/2962073618 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf2c005050 con 0x5652d3c4b4d0 2024-09-10T21:18:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.709+0000 7fcf1cff9640 1 -- 172.21.15.59:0/2962073618 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c00f770 con 0x5652d3c4b4d0 2024-09-10T21:18:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.710+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/2962073618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4b4d0 msgr2=0x5652d3c63c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.710+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/2962073618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4b4d0 0x5652d3c63c60 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00f6d0 tx=0x7fcf2c00f700 comp rx=0 tx=0).stop 2024-09-10T21:18:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.710+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/2962073618 shutdown_connections 2024-09-10T21:18:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.710+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/2962073618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c57d80 0x5652d3c53380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.710+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/2962073618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4bdf0 0x5652d3c53ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.710+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/2962073618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4b4d0 0x5652d3c63c60 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.710+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/2962073618 >> 172.21.15.59:0/2962073618 conn(0x5652d3c49300 msgr2=0x5652d3c4fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.710+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/2962073618 shutdown_connections 2024-09-10T21:18:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.710+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/2962073618 wait complete. 2024-09-10T21:18:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.710+0000 7fcf3fb7c740 1 -- start start 2024-09-10T21:18:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.710+0000 7fcf3fb7c740 1 Processor -- start 2024-09-10T21:18:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf3fb7c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4b4d0 0x5652d3c5fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf3fb7c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4bdf0 0x5652d3c60210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf3fb7c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c57d80 0x5652d3c5ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf3fb7c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcf381b18c0 con 0x5652d3c4bdf0 2024-09-10T21:18:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf3fb7c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcf381b11f0 con 0x5652d3c4b4d0 2024-09-10T21:18:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf3fb7c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcf381ae430 con 0x5652d3c57d80 2024-09-10T21:18:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf3fb7c740 10 client.0 _ll_register_callbacks cb 0x7fcf28003b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:18:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf36ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4bdf0 0x5652d3c60210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf36ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4bdf0 0x5652d3c60210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35744/0 (socket says 172.21.15.59:35744) 2024-09-10T21:18:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf36ffd640 1 -- 172.21.15.59:0/4210497844 learned_addr learned my addr 172.21.15.59:0/4210497844 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:18:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf367fc640 1 --2- 172.21.15.59:0/4210497844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c57d80 0x5652d3c5ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf367fc640 1 --2- 172.21.15.59:0/4210497844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4b4d0 0x5652d3c5fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf36ffd640 1 -- 172.21.15.59:0/4210497844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c57d80 msgr2=0x5652d3c5ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf36ffd640 1 --2- 172.21.15.59:0/4210497844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c57d80 0x5652d3c5ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf36ffd640 1 -- 172.21.15.59:0/4210497844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4b4d0 msgr2=0x5652d3c5fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:18:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf36ffd640 1 --2- 172.21.15.59:0/4210497844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4b4d0 0x5652d3c5fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf36ffd640 1 -- 172.21.15.59:0/4210497844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652d3c60a40 con 0x5652d3c4bdf0 2024-09-10T21:18:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf367fc640 1 --2- 172.21.15.59:0/4210497844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4b4d0 0x5652d3c5fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:18:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf36ffd640 1 --2- 172.21.15.59:0/4210497844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4bdf0 0x5652d3c60210 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x5652d3c48c50 tx=0x7fcf28011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd89ab735c8b0d35 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:18:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf1aff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:18:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf1aff5640 1 -- 172.21.15.59:0/4210497844 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf28011660 con 0x5652d3c4bdf0 2024-09-10T21:18:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf1aff5640 1 -- 172.21.15.59:0/4210497844 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcf28011800 con 0x5652d3c4bdf0 2024-09-10T21:18:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.711+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/4210497844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf2c005050 con 0x5652d3c4bdf0 2024-09-10T21:18:59.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.712+0000 7fcf1aff5640 1 -- 172.21.15.59:0/4210497844 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcf28011a00 con 0x5652d3c4bdf0 2024-09-10T21:18:59.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.712+0000 7fcf3fb7c740 10 client.16302 fetch_fsmap learned FSMap version 28 2024-09-10T21:18:59.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.712+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/4210497844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5652d3cd4e60 con 0x5652d3c4bdf0 2024-09-10T21:18:59.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.712+0000 7fcf1aff5640 1 -- 172.21.15.59:0/4210497844 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf2c005050 con 0x5652d3c4bdf0 2024-09-10T21:18:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.712+0000 7fcf1aff5640 1 -- 172.21.15.59:0/4210497844 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcf2801b860 con 0x5652d3c4bdf0 2024-09-10T21:18:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.712+0000 7fcf3fb7c740 10 client.16302 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:18:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.712+0000 7fcf3fb7c740 10 client.16302 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:18:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.712+0000 7fcf3fb7c740 20 client.16302 populate_metadata read hostname 'smithi059' 2024-09-10T21:18:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.712+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/4210497844 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5652d3cd5600 0x5652d3cd7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:18:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.712+0000 7fcf3fb7c740 4 client.16302 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:18:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.712+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/4210497844 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5652d3bbf8a0 con 0x5652d3cd5600 2024-09-10T21:18:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.713+0000 7fcf367fc640 1 --2- 172.21.15.59:0/4210497844 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5652d3cd5600 0x5652d3cd7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:18:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.713+0000 7fcf367fc640 1 --2- 172.21.15.59:0/4210497844 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5652d3cd5600 0x5652d3cd7a20 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6f7e22bdc63eff88 server_cookie=33ff14d80f674712 in_seq=0 out_seq=0 2024-09-10T21:18:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.713+0000 7fcf1aff5640 10 client.16302 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:18:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.713+0000 7fcf1aff5640 1 -- 172.21.15.59:0/4210497844 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5652d3bbf8a0 con 0x5652d3cd5600 2024-09-10T21:18:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.713+0000 7fcf1aff5640 10 client.16302 handle_command_reply: tid=0 2024-09-10T21:18:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.713+0000 7fcf3fb7c740 1 client.16302 shutdown 2024-09-10T21:18:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.713+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/4210497844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4bdf0 msgr2=0x5652d3c60210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.713+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/4210497844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4bdf0 0x5652d3c60210 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x5652d3c48c50 tx=0x7fcf28011da0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.713+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/4210497844 shutdown_connections 2024-09-10T21:18:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.713+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/4210497844 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5652d3cd5600 0x5652d3cd7a20 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.713+0000 7fcf1aff5640 0 client.16302 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:18:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.713+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/4210497844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5652d3c57d80 0x5652d3c5ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.713+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/4210497844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5652d3c4bdf0 0x5652d3c60210 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.713+0000 7fcf3fb7c740 1 --2- 172.21.15.59:0/4210497844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5652d3c4b4d0 0x5652d3c5fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.713+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/4210497844 >> 172.21.15.59:0/4210497844 conn(0x5652d3c49300 msgr2=0x5652d3c53310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:59.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.714+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/4210497844 shutdown_connections 2024-09-10T21:18:59.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.714+0000 7fcf3fb7c740 1 -- 172.21.15.59:0/4210497844 wait complete. 2024-09-10T21:18:59.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.714+0000 7fcf3fb7c740 20 client.16302 trim_cache size 0 max 16384 2024-09-10T21:18:59.726 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:18:59.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.714+0000 7fcf3d7a7640 1 -- 172.21.15.59:0/94431890 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcf200b52e0 msgr2=0x7fcf200b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:59.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.714+0000 7fcf3d7a7640 1 --2- 172.21.15.59:0/94431890 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcf200b52e0 0x7fcf200b77a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcf300ccb90 tx=0x7fcf30091550 comp rx=0 tx=0).stop 2024-09-10T21:18:59.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.714+0000 7fcf3d7a7640 1 -- 172.21.15.59:0/94431890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38109170 msgr2=0x7fcf38075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:18:59.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.714+0000 7fcf3d7a7640 1 --2- 172.21.15.59:0/94431890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38109170 0x7fcf38075f20 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fcf30004770 tx=0x7fcf30004270 comp rx=0 tx=0).stop 2024-09-10T21:18:59.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.714+0000 7fcf3d7a7640 1 -- 172.21.15.59:0/94431890 shutdown_connections 2024-09-10T21:18:59.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.714+0000 7fcf3d7a7640 1 --2- 172.21.15.59:0/94431890 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcf200b52e0 0x7fcf200b77a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.714+0000 7fcf3d7a7640 1 --2- 172.21.15.59:0/94431890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38109170 0x7fcf38075f20 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.714+0000 7fcf3d7a7640 1 --2- 172.21.15.59:0/94431890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf381087f0 0x7fcf380759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.714+0000 7fcf3d7a7640 1 --2- 172.21.15.59:0/94431890 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf38102de0 0x7fcf380754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:18:59.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.714+0000 7fcf3d7a7640 1 -- 172.21.15.59:0/94431890 >> 172.21.15.59:0/94431890 conn(0x7fcf380fe830 msgr2=0x7fcf380fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:18:59.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.714+0000 7fcf3d7a7640 1 -- 172.21.15.59:0/94431890 shutdown_connections 2024-09-10T21:18:59.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:18:59.714+0000 7fcf3d7a7640 1 -- 172.21.15.59:0/94431890 wait complete. 2024-09-10T21:19:00.508 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:19:00.772 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:19:01.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:01 smithi059 ceph-mon[30888]: pgmap v452: 97 pgs: 97 active+clean; 2.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:19:01.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.269+0000 7f8b3f520640 1 -- 172.21.15.59:0/948129305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b381087d0 msgr2=0x7f8b38108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:01.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.269+0000 7f8b3f520640 1 --2- 172.21.15.59:0/948129305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b381087d0 0x7f8b38108c10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009900 tx=0x7f8b2802a410 comp rx=0 tx=0).stop 2024-09-10T21:19:01.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.269+0000 7f8b3f520640 1 -- 172.21.15.59:0/948129305 shutdown_connections 2024-09-10T21:19:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.269+0000 7f8b3f520640 1 --2- 172.21.15.59:0/948129305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b38109150 0x7f8b3810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.269+0000 7f8b3f520640 1 --2- 172.21.15.59:0/948129305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b381087d0 0x7f8b38108c10 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.269+0000 7f8b3f520640 1 --2- 172.21.15.59:0/948129305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b38102dc0 0x7f8b381031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.269+0000 7f8b3f520640 1 -- 172.21.15.59:0/948129305 >> 172.21.15.59:0/948129305 conn(0x7f8b380fe830 msgr2=0x7f8b38100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.269+0000 7f8b3f520640 1 -- 172.21.15.59:0/948129305 shutdown_connections 2024-09-10T21:19:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.269+0000 7f8b3f520640 1 -- 172.21.15.59:0/948129305 wait complete. 2024-09-10T21:19:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.270+0000 7f8b3f520640 1 Processor -- start 2024-09-10T21:19:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.270+0000 7f8b3f520640 1 -- start start 2024-09-10T21:19:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.270+0000 7f8b3f520640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b38102dc0 0x7f8b38199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.270+0000 7f8b3f520640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b381087d0 0x7f8b381997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.270+0000 7f8b3f520640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b38109150 0x7f8b3819eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.270+0000 7f8b3f520640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8b38112da0 con 0x7f8b38109150 2024-09-10T21:19:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.270+0000 7f8b3f520640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b38112c20 con 0x7f8b381087d0 2024-09-10T21:19:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.270+0000 7f8b3f520640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8b38112f20 con 0x7f8b38102dc0 2024-09-10T21:19:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.270+0000 7f8b3dabd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b38109150 0x7f8b3819eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.270+0000 7f8b3dabd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b38109150 0x7f8b3819eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35776/0 (socket says 172.21.15.59:35776) 2024-09-10T21:19:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.270+0000 7f8b3dabd640 1 -- 172.21.15.59:0/3073102158 learned_addr learned my addr 172.21.15.59:0/3073102158 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.271+0000 7f8b3d2bc640 1 --2- 172.21.15.59:0/3073102158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b38102dc0 0x7f8b38199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:01.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.271+0000 7f8b3cabb640 1 --2- 172.21.15.59:0/3073102158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b381087d0 0x7f8b381997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:01.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.271+0000 7f8b3dabd640 1 -- 172.21.15.59:0/3073102158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b38102dc0 msgr2=0x7f8b38199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:01.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.271+0000 7f8b3dabd640 1 --2- 172.21.15.59:0/3073102158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b38102dc0 0x7f8b38199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.271+0000 7f8b3dabd640 1 -- 172.21.15.59:0/3073102158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b381087d0 msgr2=0x7f8b381997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:01.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.271+0000 7f8b3dabd640 1 --2- 172.21.15.59:0/3073102158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b381087d0 0x7f8b381997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.271+0000 7f8b3dabd640 1 -- 172.21.15.59:0/3073102158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3819f320 con 0x7f8b38109150 2024-09-10T21:19:01.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.271+0000 7f8b3dabd640 1 --2- 172.21.15.59:0/3073102158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b38109150 0x7f8b3819eb50 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000eaa0 tx=0x7f8b3000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:01.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.271+0000 7f8b2e7fc640 1 -- 172.21.15.59:0/3073102158 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3000cdb0 con 0x7f8b38109150 2024-09-10T21:19:01.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.271+0000 7f8b2e7fc640 1 -- 172.21.15.59:0/3073102158 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b30005020 con 0x7f8b38109150 2024-09-10T21:19:01.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.271+0000 7f8b3f520640 1 -- 172.21.15.59:0/3073102158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b3819f610 con 0x7f8b38109150 2024-09-10T21:19:01.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.271+0000 7f8b2e7fc640 1 -- 172.21.15.59:0/3073102158 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b300116d0 con 0x7f8b38109150 2024-09-10T21:19:01.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.271+0000 7f8b3f520640 1 -- 172.21.15.59:0/3073102158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b381a5cd0 con 0x7f8b38109150 2024-09-10T21:19:01.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.274+0000 7f8b418f5740 1 Processor -- start 2024-09-10T21:19:01.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.274+0000 7f8b2e7fc640 1 -- 172.21.15.59:0/3073102158 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f8b3000f040 con 0x7f8b38109150 2024-09-10T21:19:01.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.275+0000 7f8b418f5740 1 -- start start 2024-09-10T21:19:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.275+0000 7f8b418f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb0018b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.275+0000 7f8b418f5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb001df0 0x55feeb011c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.275+0000 7f8b418f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb012190 0x55feeb014580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.275+0000 7f8b418f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55feeaf77ea0 con 0x55feeb0014d0 2024-09-10T21:19:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.275+0000 7f8b418f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55feeaf672d0 con 0x55feeb012190 2024-09-10T21:19:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.275+0000 7f8b418f5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55feeaf6b0e0 con 0x55feeb001df0 2024-09-10T21:19:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.275+0000 7f8b3cabb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb0018b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.275+0000 7f8b3cabb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb0018b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35778/0 (socket says 172.21.15.59:35778) 2024-09-10T21:19:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.275+0000 7f8b3cabb640 1 -- 172.21.15.59:0/1021751879 learned_addr learned my addr 172.21.15.59:0/1021751879 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.275+0000 7f8b3d2bc640 1 --2- 172.21.15.59:0/1021751879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb001df0 0x55feeb011c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.275+0000 7f8b3cabb640 1 --2- 172.21.15.59:0/1021751879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb012190 0x55feeb014580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.275+0000 7f8b3cabb640 1 -- 172.21.15.59:0/1021751879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb001df0 msgr2=0x55feeb011c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.275+0000 7f8b3cabb640 1 --2- 172.21.15.59:0/1021751879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb001df0 0x55feeb011c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.275+0000 7f8b3cabb640 1 -- 172.21.15.59:0/1021751879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb012190 msgr2=0x55feeb014580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.275+0000 7f8b3cabb640 1 --2- 172.21.15.59:0/1021751879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb012190 0x55feeb014580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.275+0000 7f8b3cabb640 1 -- 172.21.15.59:0/1021751879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55feeacc5650 con 0x55feeb0014d0 2024-09-10T21:19:01.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.275+0000 7f8b2e7fc640 1 --2- 172.21.15.59:0/3073102158 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8b240b5360 0x7f8b240b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.276+0000 7f8b3d2bc640 1 --2- 172.21.15.59:0/3073102158 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8b240b5360 0x7f8b240b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.276+0000 7f8b3cabb640 1 --2- 172.21.15.59:0/1021751879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb0018b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8b28033000 tx=0x7f8b28005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3bfaa22497fa1d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.276+0000 7f8b2e7fc640 1 -- 172.21.15.59:0/3073102158 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8b300e5990 con 0x7f8b38109150 2024-09-10T21:19:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.276+0000 7f8b237fe640 1 -- 172.21.15.59:0/1021751879 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b28035070 con 0x55feeb0014d0 2024-09-10T21:19:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.276+0000 7f8b237fe640 1 -- 172.21.15.59:0/1021751879 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b28044070 con 0x55feeb0014d0 2024-09-10T21:19:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.276+0000 7f8b237fe640 1 -- 172.21.15.59:0/1021751879 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b28003b90 con 0x55feeb0014d0 2024-09-10T21:19:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.277+0000 7f8b418f5740 1 -- 172.21.15.59:0/1021751879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 msgr2=0x55feeb0018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.277+0000 7f8b3d2bc640 1 --2- 172.21.15.59:0/3073102158 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8b240b5360 0x7f8b240b7820 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55feeb000fb0 tx=0x7f8b3400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.277+0000 7f8b418f5740 1 --2- 172.21.15.59:0/1021751879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb0018b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8b28033000 tx=0x7f8b28005d50 comp rx=0 tx=0).stop 2024-09-10T21:19:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.277+0000 7f8b418f5740 1 -- 172.21.15.59:0/1021751879 shutdown_connections 2024-09-10T21:19:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.277+0000 7f8b418f5740 1 --2- 172.21.15.59:0/1021751879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb012190 0x55feeb014580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.277+0000 7f8b418f5740 1 --2- 172.21.15.59:0/1021751879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb001df0 0x55feeb011c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.277+0000 7f8b418f5740 1 --2- 172.21.15.59:0/1021751879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb0018b0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.277+0000 7f8b418f5740 1 -- 172.21.15.59:0/1021751879 >> 172.21.15.59:0/1021751879 conn(0x55feeafff300 msgr2=0x55feeb0004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.277+0000 7f8b418f5740 1 -- 172.21.15.59:0/1021751879 shutdown_connections 2024-09-10T21:19:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.277+0000 7f8b418f5740 1 -- 172.21.15.59:0/1021751879 wait complete. 2024-09-10T21:19:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.277+0000 7f8b418f5740 1 -- start start 2024-09-10T21:19:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.277+0000 7f8b418f5740 1 Processor -- start 2024-09-10T21:19:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.277+0000 7f8b418f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb011a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.277+0000 7f8b418f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb001df0 0x55feeb00eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.277+0000 7f8b418f5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb012190 0x55feeb00f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.277+0000 7f8b418f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55feeadc8700 con 0x55feeb0014d0 2024-09-10T21:19:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.277+0000 7f8b418f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55feeaf02160 con 0x55feeb001df0 2024-09-10T21:19:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.277+0000 7f8b418f5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55feeb014de0 con 0x55feeb012190 2024-09-10T21:19:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.278+0000 7f8b418f5740 10 client.0 _ll_register_callbacks cb 0x55feeaf1b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.278+0000 7f8b3d2bc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb011a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.278+0000 7f8b3d2bc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb011a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35786/0 (socket says 172.21.15.59:35786) 2024-09-10T21:19:01.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.278+0000 7f8b3d2bc640 1 -- 172.21.15.59:0/2628444747 learned_addr learned my addr 172.21.15.59:0/2628444747 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:01.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.278+0000 7f8b3cabb640 1 --2- 172.21.15.59:0/2628444747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb001df0 0x55feeb00eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:01.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.278+0000 7f8b3dabd640 1 --2- 172.21.15.59:0/2628444747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb012190 0x55feeb00f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:01.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.278+0000 7f8b3d2bc640 1 -- 172.21.15.59:0/2628444747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb012190 msgr2=0x55feeb00f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:01.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.278+0000 7f8b3d2bc640 1 --2- 172.21.15.59:0/2628444747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb012190 0x55feeb00f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.278+0000 7f8b3d2bc640 1 -- 172.21.15.59:0/2628444747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb001df0 msgr2=0x55feeb00eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:01.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.278+0000 7f8b3d2bc640 1 --2- 172.21.15.59:0/2628444747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb001df0 0x55feeb00eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.278+0000 7f8b3d2bc640 1 -- 172.21.15.59:0/2628444747 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55feeaf2fc90 con 0x55feeb0014d0 2024-09-10T21:19:01.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.278+0000 7f8b3d2bc640 1 --2- 172.21.15.59:0/2628444747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb011a70 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8b34013fd0 tx=0x7f8b340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf368036c963adc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:01.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.278+0000 7f8b20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:01.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.278+0000 7f8b20ff9640 1 -- 172.21.15.59:0/2628444747 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b34005020 con 0x55feeb0014d0 2024-09-10T21:19:01.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.278+0000 7f8b20ff9640 1 -- 172.21.15.59:0/2628444747 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8b340051c0 con 0x55feeb0014d0 2024-09-10T21:19:01.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.278+0000 7f8b418f5740 1 -- 172.21.15.59:0/2628444747 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b28044070 con 0x55feeb0014d0 2024-09-10T21:19:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.278+0000 7f8b20ff9640 1 -- 172.21.15.59:0/2628444747 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8b340053c0 con 0x55feeb0014d0 2024-09-10T21:19:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.279+0000 7f8b418f5740 10 client.16314 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.279+0000 7f8b418f5740 1 -- 172.21.15.59:0/2628444747 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55feeb020790 con 0x55feeb0014d0 2024-09-10T21:19:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.279+0000 7f8b20ff9640 1 -- 172.21.15.59:0/2628444747 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b28044070 con 0x55feeb0014d0 2024-09-10T21:19:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.279+0000 7f8b20ff9640 1 -- 172.21.15.59:0/2628444747 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8b34027750 con 0x55feeb0014d0 2024-09-10T21:19:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.279+0000 7f8b418f5740 10 client.16314 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.279+0000 7f8b418f5740 10 client.16314 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:19:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.279+0000 7f8b418f5740 20 client.16314 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.279+0000 7f8b418f5740 1 --2- 172.21.15.59:0/2628444747 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55feeb021c50 0x55feeb0240a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.279+0000 7f8b418f5740 4 client.16314 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:19:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.279+0000 7f8b418f5740 1 -- 172.21.15.59:0/2628444747 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55feeaf79df0 con 0x55feeb021c50 2024-09-10T21:19:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.279+0000 7f8b3cabb640 1 --2- 172.21.15.59:0/2628444747 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55feeb021c50 0x55feeb0240a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.280+0000 7f8b3cabb640 1 --2- 172.21.15.59:0/2628444747 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55feeb021c50 0x55feeb0240a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=64834cf03e54bcb8 server_cookie=fe352f7a32af3fcd in_seq=0 out_seq=0 2024-09-10T21:19:01.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.280+0000 7f8b20ff9640 10 client.16314 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:19:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.280+0000 7f8b20ff9640 1 -- 172.21.15.59:0/2628444747 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55feeaf79df0 con 0x55feeb021c50 2024-09-10T21:19:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.280+0000 7f8b20ff9640 10 client.16314 handle_command_reply: tid=0 2024-09-10T21:19:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.280+0000 7f8b418f5740 1 client.16314 shutdown 2024-09-10T21:19:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.281+0000 7f8b418f5740 1 -- 172.21.15.59:0/2628444747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 msgr2=0x55feeb011a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.281+0000 7f8b418f5740 1 --2- 172.21.15.59:0/2628444747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb011a70 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8b34013fd0 tx=0x7f8b340046c0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.281+0000 7f8b418f5740 1 -- 172.21.15.59:0/2628444747 shutdown_connections 2024-09-10T21:19:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.281+0000 7f8b418f5740 1 --2- 172.21.15.59:0/2628444747 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55feeb021c50 0x55feeb0240a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.281+0000 7f8b418f5740 1 --2- 172.21.15.59:0/2628444747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb012190 0x55feeb00f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.281+0000 7f8b418f5740 1 --2- 172.21.15.59:0/2628444747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb001df0 0x55feeb00eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.281+0000 7f8b20ff9640 0 client.16314 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:19:01.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.281+0000 7f8b418f5740 1 --2- 172.21.15.59:0/2628444747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb011a70 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.281+0000 7f8b418f5740 1 -- 172.21.15.59:0/2628444747 >> 172.21.15.59:0/2628444747 conn(0x55feeafff300 msgr2=0x55feeaffe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:01.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.281+0000 7f8b418f5740 1 -- 172.21.15.59:0/2628444747 shutdown_connections 2024-09-10T21:19:01.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.281+0000 7f8b418f5740 1 -- 172.21.15.59:0/2628444747 wait complete. 2024-09-10T21:19:01.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.281+0000 7f8b418f5740 20 client.16314 trim_cache size 0 max 16384 2024-09-10T21:19:01.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.294+0000 7f8b418f5740 1 Processor -- start 2024-09-10T21:19:01.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.294+0000 7f8b418f5740 1 -- start start 2024-09-10T21:19:01.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b418f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb01e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:01.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b418f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb001df0 0x55feeb000350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:01.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b418f5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb012190 0x55feeb000890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:01.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b418f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8b381abfc0 con 0x55feeb0014d0 2024-09-10T21:19:01.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b418f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b381adb00 con 0x55feeb001df0 2024-09-10T21:19:01.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b418f5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8b381ac690 con 0x55feeb012190 2024-09-10T21:19:01.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b3d2bc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb01e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:01.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b3d2bc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb01e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35800/0 (socket says 172.21.15.59:35800) 2024-09-10T21:19:01.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b3d2bc640 1 -- 172.21.15.59:0/3472736732 learned_addr learned my addr 172.21.15.59:0/3472736732 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:01.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b3cabb640 1 --2- 172.21.15.59:0/3472736732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb001df0 0x55feeb000350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:01.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b3dabd640 1 --2- 172.21.15.59:0/3472736732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb012190 0x55feeb000890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:01.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b3d2bc640 1 -- 172.21.15.59:0/3472736732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb012190 msgr2=0x55feeb000890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:01.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b3d2bc640 1 --2- 172.21.15.59:0/3472736732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb012190 0x55feeb000890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b3d2bc640 1 -- 172.21.15.59:0/3472736732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb001df0 msgr2=0x55feeb000350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:01.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b3d2bc640 1 --2- 172.21.15.59:0/3472736732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb001df0 0x55feeb000350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b3d2bc640 1 -- 172.21.15.59:0/3472736732 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55feeb011de0 con 0x55feeb0014d0 2024-09-10T21:19:01.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b3dabd640 1 --2- 172.21.15.59:0/3472736732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb012190 0x55feeb000890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:01.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b3cabb640 1 --2- 172.21.15.59:0/3472736732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb001df0 0x55feeb000350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:01.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b3d2bc640 1 --2- 172.21.15.59:0/3472736732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb01e040 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8b34027b70 tx=0x7f8b3400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f64af91d8f4411f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:01.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.295+0000 7f8b22ffd640 1 -- 172.21.15.59:0/3472736732 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b34005560 con 0x55feeb0014d0 2024-09-10T21:19:01.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.296+0000 7f8b22ffd640 1 -- 172.21.15.59:0/3472736732 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b34027930 con 0x55feeb0014d0 2024-09-10T21:19:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.296+0000 7f8b22ffd640 1 -- 172.21.15.59:0/3472736732 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3403cde0 con 0x55feeb0014d0 2024-09-10T21:19:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.296+0000 7f8b418f5740 1 -- 172.21.15.59:0/3472736732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 msgr2=0x55feeb01e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.296+0000 7f8b418f5740 1 --2- 172.21.15.59:0/3472736732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb01e040 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8b34027b70 tx=0x7f8b3400bf90 comp rx=0 tx=0).stop 2024-09-10T21:19:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.296+0000 7f8b418f5740 1 -- 172.21.15.59:0/3472736732 shutdown_connections 2024-09-10T21:19:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.296+0000 7f8b418f5740 1 --2- 172.21.15.59:0/3472736732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb012190 0x55feeb000890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.296+0000 7f8b418f5740 1 --2- 172.21.15.59:0/3472736732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb001df0 0x55feeb000350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.296+0000 7f8b418f5740 1 --2- 172.21.15.59:0/3472736732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb01e040 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.296+0000 7f8b418f5740 1 -- 172.21.15.59:0/3472736732 >> 172.21.15.59:0/3472736732 conn(0x55feeafff300 msgr2=0x55feeb00d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.296+0000 7f8b418f5740 1 -- 172.21.15.59:0/3472736732 shutdown_connections 2024-09-10T21:19:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.296+0000 7f8b418f5740 1 -- 172.21.15.59:0/3472736732 wait complete. 2024-09-10T21:19:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.296+0000 7f8b418f5740 1 -- start start 2024-09-10T21:19:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.297+0000 7f8b418f5740 1 Processor -- start 2024-09-10T21:19:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.297+0000 7f8b418f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb01a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.297+0000 7f8b418f5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb001df0 0x55feeb01a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:01.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.297+0000 7f8b418f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb012190 0x55feeb017200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.297+0000 7f8b418f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8b381ad430 con 0x55feeb0014d0 2024-09-10T21:19:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.297+0000 7f8b418f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8b381acd60 con 0x55feeb012190 2024-09-10T21:19:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.297+0000 7f8b418f5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8b381a9fa0 con 0x55feeb001df0 2024-09-10T21:19:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.297+0000 7f8b418f5740 10 client.0 _ll_register_callbacks cb 0x7f8b3400b9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.297+0000 7f8b3d2bc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb01a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.297+0000 7f8b3d2bc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb01a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35810/0 (socket says 172.21.15.59:35810) 2024-09-10T21:19:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.297+0000 7f8b3d2bc640 1 -- 172.21.15.59:0/3656976213 learned_addr learned my addr 172.21.15.59:0/3656976213 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.297+0000 7f8b3dabd640 1 --2- 172.21.15.59:0/3656976213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb012190 0x55feeb017200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.297+0000 7f8b3cabb640 1 --2- 172.21.15.59:0/3656976213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb001df0 0x55feeb01a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.297+0000 7f8b3d2bc640 1 -- 172.21.15.59:0/3656976213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb001df0 msgr2=0x55feeb01a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.297+0000 7f8b3d2bc640 1 --2- 172.21.15.59:0/3656976213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb001df0 0x55feeb01a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.297+0000 7f8b3d2bc640 1 -- 172.21.15.59:0/3656976213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb012190 msgr2=0x55feeb017200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:01.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.297+0000 7f8b3d2bc640 1 --2- 172.21.15.59:0/3656976213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb012190 0x55feeb017200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.297+0000 7f8b3d2bc640 1 -- 172.21.15.59:0/3656976213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55feeb017a00 con 0x55feeb0014d0 2024-09-10T21:19:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.297+0000 7f8b3dabd640 1 --2- 172.21.15.59:0/3656976213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb012190 0x55feeb017200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.298+0000 7f8b3d2bc640 1 --2- 172.21.15.59:0/3656976213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb01a470 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8b34013fd0 tx=0x7f8b34010fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396487e20898ab7f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.298+0000 7f8b20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.298+0000 7f8b20ff9640 1 -- 172.21.15.59:0/3656976213 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3403c640 con 0x55feeb0014d0 2024-09-10T21:19:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.298+0000 7f8b20ff9640 1 -- 172.21.15.59:0/3656976213 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8b3403ca20 con 0x55feeb0014d0 2024-09-10T21:19:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.298+0000 7f8b418f5740 1 -- 172.21.15.59:0/3656976213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b34027930 con 0x55feeb0014d0 2024-09-10T21:19:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.298+0000 7f8b20ff9640 1 -- 172.21.15.59:0/3656976213 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8b3403cc40 con 0x55feeb0014d0 2024-09-10T21:19:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.298+0000 7f8b418f5740 10 client.16320 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.298+0000 7f8b418f5740 1 -- 172.21.15.59:0/3656976213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55feeb08f770 con 0x55feeb0014d0 2024-09-10T21:19:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.298+0000 7f8b20ff9640 1 -- 172.21.15.59:0/3656976213 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b34027930 con 0x55feeb0014d0 2024-09-10T21:19:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.298+0000 7f8b20ff9640 1 -- 172.21.15.59:0/3656976213 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8b3403a020 con 0x55feeb0014d0 2024-09-10T21:19:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.298+0000 7f8b418f5740 10 client.16320 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:01.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.298+0000 7f8b418f5740 10 client.16320 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:19:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.298+0000 7f8b418f5740 20 client.16320 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.298+0000 7f8b418f5740 1 --2- 172.21.15.59:0/3656976213 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55feeb08fdf0 0x55feeb092210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.298+0000 7f8b418f5740 4 client.16320 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:19:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.298+0000 7f8b418f5740 1 -- 172.21.15.59:0/3656976213 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55feeaf758a0 con 0x55feeb08fdf0 2024-09-10T21:19:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.299+0000 7f8b3cabb640 1 --2- 172.21.15.59:0/3656976213 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55feeb08fdf0 0x55feeb092210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.299+0000 7f8b3cabb640 1 --2- 172.21.15.59:0/3656976213 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55feeb08fdf0 0x55feeb092210 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e84b5cb0b63adcee server_cookie=ed2a13f91666bb6 in_seq=0 out_seq=0 2024-09-10T21:19:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.299+0000 7f8b20ff9640 10 client.16320 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:19:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.299+0000 7f8b20ff9640 1 -- 172.21.15.59:0/3656976213 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55feeaf758a0 con 0x55feeb08fdf0 2024-09-10T21:19:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.299+0000 7f8b20ff9640 10 client.16320 handle_command_reply: tid=0 2024-09-10T21:19:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.299+0000 7f8b418f5740 1 client.16320 shutdown 2024-09-10T21:19:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b418f5740 1 -- 172.21.15.59:0/3656976213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 msgr2=0x55feeb01a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b418f5740 1 --2- 172.21.15.59:0/3656976213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb01a470 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f8b34013fd0 tx=0x7f8b34010fb0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b418f5740 1 -- 172.21.15.59:0/3656976213 shutdown_connections 2024-09-10T21:19:01.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b418f5740 1 --2- 172.21.15.59:0/3656976213 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55feeb08fdf0 0x55feeb092210 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b418f5740 1 --2- 172.21.15.59:0/3656976213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55feeb012190 0x55feeb017200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b418f5740 1 --2- 172.21.15.59:0/3656976213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55feeb001df0 0x55feeb01a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b418f5740 1 --2- 172.21.15.59:0/3656976213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55feeb0014d0 0x55feeb01a470 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b20ff9640 0 client.16320 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:19:01.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b418f5740 1 -- 172.21.15.59:0/3656976213 >> 172.21.15.59:0/3656976213 conn(0x55feeafff300 msgr2=0x55feeb013f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:01.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b418f5740 1 -- 172.21.15.59:0/3656976213 shutdown_connections 2024-09-10T21:19:01.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b418f5740 1 -- 172.21.15.59:0/3656976213 wait complete. 2024-09-10T21:19:01.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b418f5740 20 client.16320 trim_cache size 0 max 16384 2024-09-10T21:19:01.327 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:19:01.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b3f520640 1 -- 172.21.15.59:0/3073102158 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8b240b5360 msgr2=0x7f8b240b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:01.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b3f520640 1 --2- 172.21.15.59:0/3073102158 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8b240b5360 0x7f8b240b7820 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55feeb000fb0 tx=0x7f8b3400b390 comp rx=0 tx=0).stop 2024-09-10T21:19:01.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b3f520640 1 -- 172.21.15.59:0/3073102158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b38109150 msgr2=0x7f8b3819eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:01.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b3f520640 1 --2- 172.21.15.59:0/3073102158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b38109150 0x7f8b3819eb50 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000eaa0 tx=0x7f8b3000ef60 comp rx=0 tx=0).stop 2024-09-10T21:19:01.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b3f520640 1 -- 172.21.15.59:0/3073102158 shutdown_connections 2024-09-10T21:19:01.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b3f520640 1 --2- 172.21.15.59:0/3073102158 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8b240b5360 0x7f8b240b7820 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b3f520640 1 --2- 172.21.15.59:0/3073102158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b38109150 0x7f8b3819eb50 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b3f520640 1 --2- 172.21.15.59:0/3073102158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b381087d0 0x7f8b381997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b3f520640 1 --2- 172.21.15.59:0/3073102158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b38102dc0 0x7f8b38199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:01.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.300+0000 7f8b3f520640 1 -- 172.21.15.59:0/3073102158 >> 172.21.15.59:0/3073102158 conn(0x7f8b380fe830 msgr2=0x7f8b38100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:01.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.301+0000 7f8b3f520640 1 -- 172.21.15.59:0/3073102158 shutdown_connections 2024-09-10T21:19:01.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:01.301+0000 7f8b3f520640 1 -- 172.21.15.59:0/3073102158 wait complete. 2024-09-10T21:19:01.329 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:01 smithi192 ceph-mon[35363]: pgmap v452: 97 pgs: 97 active+clean; 2.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:19:01.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:01 smithi154 ceph-mon[35041]: pgmap v452: 97 pgs: 97 active+clean; 2.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:19:02.178 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:19:02.441 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:19:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.919+0000 7fd8621ca640 1 -- 172.21.15.59:0/3880980217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd85c10d100 msgr2=0x7fd85c10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.919+0000 7fd8621ca640 1 --2- 172.21.15.59:0/3880980217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd85c10d100 0x7fd85c10f560 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd854009ca0 tx=0x7fd85402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.919+0000 7fd8621ca640 1 -- 172.21.15.59:0/3880980217 shutdown_connections 2024-09-10T21:19:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.919+0000 7fd8621ca640 1 --2- 172.21.15.59:0/3880980217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd85c10d100 0x7fd85c10f560 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.919+0000 7fd8621ca640 1 --2- 172.21.15.59:0/3880980217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd85c1045c0 0x7fd85c10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.919+0000 7fd8621ca640 1 --2- 172.21.15.59:0/3880980217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd85c103ca0 0x7fd85c104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.919+0000 7fd8621ca640 1 -- 172.21.15.59:0/3880980217 >> 172.21.15.59:0/3880980217 conn(0x7fd85c0fd700 msgr2=0x7fd85c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.919+0000 7fd8621ca640 1 -- 172.21.15.59:0/3880980217 shutdown_connections 2024-09-10T21:19:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.919+0000 7fd8621ca640 1 -- 172.21.15.59:0/3880980217 wait complete. 2024-09-10T21:19:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.919+0000 7fd8621ca640 1 Processor -- start 2024-09-10T21:19:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.919+0000 7fd8621ca640 1 -- start start 2024-09-10T21:19:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.920+0000 7fd8621ca640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd85c103ca0 0x7fd85c19b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.920+0000 7fd8621ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd85c1045c0 0x7fd85c19b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.920+0000 7fd8621ca640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd85c10d100 0x7fd85c1a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.920+0000 7fd8621ca640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c112dd0 con 0x7fd85c103ca0 2024-09-10T21:19:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.920+0000 7fd8621ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c112c50 con 0x7fd85c1045c0 2024-09-10T21:19:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.920+0000 7fd8621ca640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c112f50 con 0x7fd85c10d100 2024-09-10T21:19:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.920+0000 7fd85b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd85c103ca0 0x7fd85c19b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.920+0000 7fd85b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd85c103ca0 0x7fd85c19b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35830/0 (socket says 172.21.15.59:35830) 2024-09-10T21:19:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.920+0000 7fd85b7fe640 1 -- 172.21.15.59:0/449145810 learned_addr learned my addr 172.21.15.59:0/449145810 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.920+0000 7fd85bfff640 1 --2- 172.21.15.59:0/449145810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd85c10d100 0x7fd85c1a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.920+0000 7fd85affd640 1 --2- 172.21.15.59:0/449145810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd85c1045c0 0x7fd85c19b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.920+0000 7fd85b7fe640 1 -- 172.21.15.59:0/449145810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd85c10d100 msgr2=0x7fd85c1a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.920+0000 7fd85b7fe640 1 --2- 172.21.15.59:0/449145810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd85c10d100 0x7fd85c1a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.920+0000 7fd85b7fe640 1 -- 172.21.15.59:0/449145810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd85c1045c0 msgr2=0x7fd85c19b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.920+0000 7fd85b7fe640 1 --2- 172.21.15.59:0/449145810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd85c1045c0 0x7fd85c19b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.920+0000 7fd85b7fe640 1 -- 172.21.15.59:0/449145810 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85c1a1550 con 0x7fd85c103ca0 2024-09-10T21:19:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.920+0000 7fd85b7fe640 1 --2- 172.21.15.59:0/449145810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd85c103ca0 0x7fd85c19b4a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c920 tx=0x7fd84c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.921+0000 7fd858ff9640 1 -- 172.21.15.59:0/449145810 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84c007c70 con 0x7fd85c103ca0 2024-09-10T21:19:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.921+0000 7fd858ff9640 1 -- 172.21.15.59:0/449145810 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd84c007e10 con 0x7fd85c103ca0 2024-09-10T21:19:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.921+0000 7fd858ff9640 1 -- 172.21.15.59:0/449145810 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84c018820 con 0x7fd85c103ca0 2024-09-10T21:19:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.921+0000 7fd8621ca640 1 -- 172.21.15.59:0/449145810 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85c1a1840 con 0x7fd85c103ca0 2024-09-10T21:19:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.921+0000 7fd8621ca640 1 -- 172.21.15.59:0/449145810 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd85c1a7f00 con 0x7fd85c103ca0 2024-09-10T21:19:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.923+0000 7fd86459f740 1 Processor -- start 2024-09-10T21:19:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.923+0000 7fd86459f740 1 -- start start 2024-09-10T21:19:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.923+0000 7fd858ff9640 1 -- 172.21.15.59:0/449145810 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd84c00f450 con 0x7fd85c103ca0 2024-09-10T21:19:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.923+0000 7fd86459f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d2f4d0 0x5571d4d2f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.923+0000 7fd86459f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571d4d2fdf0 0x5571d4d3b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.923+0000 7fd86459f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d3bd80 0x5571d4d3e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.923+0000 7fd86459f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5571d4ca5ea0 con 0x5571d4d2f4d0 2024-09-10T21:19:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.923+0000 7fd86459f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5571d4c952d0 con 0x5571d4d3bd80 2024-09-10T21:19:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.923+0000 7fd86459f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5571d4c990e0 con 0x5571d4d2fdf0 2024-09-10T21:19:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.924+0000 7fd85bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d2f4d0 0x5571d4d2f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.924+0000 7fd85bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d2f4d0 0x5571d4d2f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35846/0 (socket says 172.21.15.59:35846) 2024-09-10T21:19:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.924+0000 7fd85bfff640 1 -- 172.21.15.59:0/3199739497 learned_addr learned my addr 172.21.15.59:0/3199739497 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.924+0000 7fd85b7fe640 1 --2- 172.21.15.59:0/3199739497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571d4d2fdf0 0x5571d4d3b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.924+0000 7fd85affd640 1 --2- 172.21.15.59:0/3199739497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d3bd80 0x5571d4d3e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.924+0000 7fd85bfff640 1 -- 172.21.15.59:0/3199739497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571d4d2fdf0 msgr2=0x5571d4d3b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.924+0000 7fd85bfff640 1 --2- 172.21.15.59:0/3199739497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571d4d2fdf0 0x5571d4d3b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.924+0000 7fd85bfff640 1 -- 172.21.15.59:0/3199739497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d3bd80 msgr2=0x5571d4d3e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.924+0000 7fd85bfff640 1 --2- 172.21.15.59:0/3199739497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d3bd80 0x5571d4d3e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.924+0000 7fd85bfff640 1 -- 172.21.15.59:0/3199739497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571d49f3650 con 0x5571d4d2f4d0 2024-09-10T21:19:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.924+0000 7fd858ff9640 1 --2- 172.21.15.59:0/449145810 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd8440b52e0 0x7fd8440b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.924+0000 7fd85bfff640 1 --2- 172.21.15.59:0/3199739497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d2f4d0 0x5571d4d2f8b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd854005cc0 tx=0x7fd854009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293675ed48170b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.924+0000 7fd85b7fe640 1 --2- 172.21.15.59:0/449145810 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd8440b52e0 0x7fd8440b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.924+0000 7fd841ffb640 1 -- 172.21.15.59:0/3199739497 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd854031df0 con 0x5571d4d2f4d0 2024-09-10T21:19:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.925+0000 7fd841ffb640 1 -- 172.21.15.59:0/3199739497 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd854036040 con 0x5571d4d2f4d0 2024-09-10T21:19:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.925+0000 7fd858ff9640 1 -- 172.21.15.59:0/449145810 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd84c0e5e30 con 0x7fd85c103ca0 2024-09-10T21:19:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.925+0000 7fd841ffb640 1 -- 172.21.15.59:0/3199739497 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8540042a0 con 0x5571d4d2f4d0 2024-09-10T21:19:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.925+0000 7fd86459f740 1 -- 172.21.15.59:0/3199739497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d2f4d0 msgr2=0x5571d4d2f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.925+0000 7fd86459f740 1 --2- 172.21.15.59:0/3199739497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d2f4d0 0x5571d4d2f8b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd854005cc0 tx=0x7fd854009930 comp rx=0 tx=0).stop 2024-09-10T21:19:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.925+0000 7fd85b7fe640 1 --2- 172.21.15.59:0/449145810 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd8440b52e0 0x7fd8440b77a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c8f0 tx=0x7fd84c0e9870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.925+0000 7fd86459f740 1 -- 172.21.15.59:0/3199739497 shutdown_connections 2024-09-10T21:19:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.925+0000 7fd86459f740 1 --2- 172.21.15.59:0/3199739497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d3bd80 0x5571d4d3e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.925+0000 7fd86459f740 1 --2- 172.21.15.59:0/3199739497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571d4d2fdf0 0x5571d4d3b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.925+0000 7fd86459f740 1 --2- 172.21.15.59:0/3199739497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d2f4d0 0x5571d4d2f8b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.925+0000 7fd86459f740 1 -- 172.21.15.59:0/3199739497 >> 172.21.15.59:0/3199739497 conn(0x5571d4d2d300 msgr2=0x5571d4d2e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.925+0000 7fd86459f740 1 -- 172.21.15.59:0/3199739497 shutdown_connections 2024-09-10T21:19:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.925+0000 7fd86459f740 1 -- 172.21.15.59:0/3199739497 wait complete. 2024-09-10T21:19:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.926+0000 7fd86459f740 1 -- start start 2024-09-10T21:19:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.926+0000 7fd86459f740 1 Processor -- start 2024-09-10T21:19:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.926+0000 7fd86459f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571d4d2f4d0 0x5571d4d3b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.926+0000 7fd86459f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d2fdf0 0x5571d4d38ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.926+0000 7fd86459f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d3bd80 0x5571d4d390f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.926+0000 7fd86459f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5571d4af6700 con 0x5571d4d3bd80 2024-09-10T21:19:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.926+0000 7fd86459f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5571d4c30160 con 0x5571d4d2fdf0 2024-09-10T21:19:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.926+0000 7fd86459f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5571d4d3e9a0 con 0x5571d4d2f4d0 2024-09-10T21:19:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.926+0000 7fd86459f740 10 client.0 _ll_register_callbacks cb 0x5571d4c499e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.926+0000 7fd85bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d3bd80 0x5571d4d390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.926+0000 7fd85bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d3bd80 0x5571d4d390f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35852/0 (socket says 172.21.15.59:35852) 2024-09-10T21:19:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.926+0000 7fd85bfff640 1 -- 172.21.15.59:0/652926488 learned_addr learned my addr 172.21.15.59:0/652926488 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.927+0000 7fd85bfff640 1 --2- 172.21.15.59:0/652926488 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571d4d2f4d0 0x5571d4d3b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.927+0000 7fd85affd640 1 --2- 172.21.15.59:0/652926488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d2fdf0 0x5571d4d38ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.927+0000 7fd85bfff640 1 -- 172.21.15.59:0/652926488 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571d4d2f4d0 msgr2=0x5571d4d3b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.927+0000 7fd85bfff640 1 --2- 172.21.15.59:0/652926488 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571d4d2f4d0 0x5571d4d3b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.927+0000 7fd85bfff640 1 -- 172.21.15.59:0/652926488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d2fdf0 msgr2=0x5571d4d38ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.927+0000 7fd85bfff640 1 --2- 172.21.15.59:0/652926488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d2fdf0 0x5571d4d38ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.927+0000 7fd85bfff640 1 -- 172.21.15.59:0/652926488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571d4c5dc90 con 0x5571d4d3bd80 2024-09-10T21:19:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.927+0000 7fd85affd640 1 --2- 172.21.15.59:0/652926488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d2fdf0 0x5571d4d38ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.927+0000 7fd85bfff640 1 --2- 172.21.15.59:0/652926488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d3bd80 0x5571d4d390f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd854003f10 tx=0x7fd854003e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0eb601a3660e33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.927+0000 7fd83affd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.927+0000 7fd83affd640 1 -- 172.21.15.59:0/652926488 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd854031e00 con 0x5571d4d3bd80 2024-09-10T21:19:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.927+0000 7fd83affd640 1 -- 172.21.15.59:0/652926488 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd854031450 con 0x5571d4d3bd80 2024-09-10T21:19:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.927+0000 7fd86459f740 1 -- 172.21.15.59:0/652926488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd854036040 con 0x5571d4d3bd80 2024-09-10T21:19:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.927+0000 7fd83affd640 1 -- 172.21.15.59:0/652926488 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd854031650 con 0x5571d4d3bd80 2024-09-10T21:19:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.927+0000 7fd86459f740 10 client.16332 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.927+0000 7fd86459f740 1 -- 172.21.15.59:0/652926488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5571d4d4a300 con 0x5571d4d3bd80 2024-09-10T21:19:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.927+0000 7fd83affd640 1 -- 172.21.15.59:0/652926488 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd854036040 con 0x5571d4d3bd80 2024-09-10T21:19:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.928+0000 7fd83affd640 1 -- 172.21.15.59:0/652926488 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd854050070 con 0x5571d4d3bd80 2024-09-10T21:19:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.928+0000 7fd86459f740 10 client.16332 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.928+0000 7fd86459f740 10 client.16332 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:19:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.928+0000 7fd86459f740 20 client.16332 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.928+0000 7fd86459f740 1 --2- 172.21.15.59:0/652926488 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5571d4d4b650 0x5571d4d4da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.928+0000 7fd86459f740 4 client.16332 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:19:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.928+0000 7fd86459f740 1 -- 172.21.15.59:0/652926488 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571d4ca7df0 con 0x5571d4d4b650 2024-09-10T21:19:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.928+0000 7fd85affd640 1 --2- 172.21.15.59:0/652926488 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5571d4d4b650 0x5571d4d4da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.929+0000 7fd83affd640 10 client.16332 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:19:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.929+0000 7fd85affd640 1 --2- 172.21.15.59:0/652926488 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5571d4d4b650 0x5571d4d4da40 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5f35b26effd5c958 server_cookie=f0aa19829c3cf038 in_seq=0 out_seq=0 2024-09-10T21:19:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.929+0000 7fd83affd640 1 -- 172.21.15.59:0/652926488 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5571d4ca7df0 con 0x5571d4d4b650 2024-09-10T21:19:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.929+0000 7fd83affd640 10 client.16332 handle_command_reply: tid=0 2024-09-10T21:19:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.929+0000 7fd86459f740 1 client.16332 shutdown 2024-09-10T21:19:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.929+0000 7fd86459f740 1 -- 172.21.15.59:0/652926488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d3bd80 msgr2=0x5571d4d390f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.929+0000 7fd86459f740 1 --2- 172.21.15.59:0/652926488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d3bd80 0x5571d4d390f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd854003f10 tx=0x7fd854003e10 comp rx=0 tx=0).stop 2024-09-10T21:19:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.930+0000 7fd86459f740 1 -- 172.21.15.59:0/652926488 shutdown_connections 2024-09-10T21:19:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.930+0000 7fd86459f740 1 --2- 172.21.15.59:0/652926488 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5571d4d4b650 0x5571d4d4da40 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.930+0000 7fd83affd640 0 client.16332 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:19:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.930+0000 7fd86459f740 1 --2- 172.21.15.59:0/652926488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d3bd80 0x5571d4d390f0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.930+0000 7fd86459f740 1 --2- 172.21.15.59:0/652926488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d2fdf0 0x5571d4d38ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.930+0000 7fd86459f740 1 --2- 172.21.15.59:0/652926488 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571d4d2f4d0 0x5571d4d3b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.930+0000 7fd86459f740 1 -- 172.21.15.59:0/652926488 >> 172.21.15.59:0/652926488 conn(0x5571d4d2d300 msgr2=0x5571d4d32e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.930+0000 7fd86459f740 1 -- 172.21.15.59:0/652926488 shutdown_connections 2024-09-10T21:19:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.930+0000 7fd86459f740 1 -- 172.21.15.59:0/652926488 wait complete. 2024-09-10T21:19:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.930+0000 7fd86459f740 20 client.16332 trim_cache size 0 max 16384 2024-09-10T21:19:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.943+0000 7fd86459f740 1 Processor -- start 2024-09-10T21:19:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.943+0000 7fd86459f740 1 -- start start 2024-09-10T21:19:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.943+0000 7fd86459f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d2f4d0 0x5571d4d2cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.943+0000 7fd86459f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571d4d2fdf0 0x5571d4d3a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.943+0000 7fd86459f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d3bd80 0x5571d4d3d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.943+0000 7fd86459f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c1b04b0 con 0x5571d4d3bd80 2024-09-10T21:19:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.943+0000 7fd86459f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c1b1ff0 con 0x5571d4d2f4d0 2024-09-10T21:19:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.943+0000 7fd86459f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c1b0b80 con 0x5571d4d2fdf0 2024-09-10T21:19:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.943+0000 7fd85bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d3bd80 0x5571d4d3d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.943+0000 7fd85bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d3bd80 0x5571d4d3d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35864/0 (socket says 172.21.15.59:35864) 2024-09-10T21:19:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.943+0000 7fd85bfff640 1 -- 172.21.15.59:0/2293717694 learned_addr learned my addr 172.21.15.59:0/2293717694 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.944+0000 7fd85bfff640 1 --2- 172.21.15.59:0/2293717694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d2f4d0 0x5571d4d2cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.944+0000 7fd85affd640 1 --2- 172.21.15.59:0/2293717694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571d4d2fdf0 0x5571d4d3a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.944+0000 7fd85bfff640 1 -- 172.21.15.59:0/2293717694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571d4d2fdf0 msgr2=0x5571d4d3a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.944+0000 7fd85bfff640 1 --2- 172.21.15.59:0/2293717694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571d4d2fdf0 0x5571d4d3a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.944+0000 7fd85bfff640 1 -- 172.21.15.59:0/2293717694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d2f4d0 msgr2=0x5571d4d2cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.944+0000 7fd85bfff640 1 --2- 172.21.15.59:0/2293717694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d2f4d0 0x5571d4d2cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.944+0000 7fd85bfff640 1 -- 172.21.15.59:0/2293717694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571d4d28de0 con 0x5571d4d3bd80 2024-09-10T21:19:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.944+0000 7fd85bfff640 1 --2- 172.21.15.59:0/2293717694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d3bd80 0x5571d4d3d170 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd85402fc40 tx=0x7fd85402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2cb76854c7957ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.944+0000 7fd8417fa640 1 -- 172.21.15.59:0/2293717694 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd854063070 con 0x5571d4d3bd80 2024-09-10T21:19:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.944+0000 7fd8417fa640 1 -- 172.21.15.59:0/2293717694 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd854036070 con 0x5571d4d3bd80 2024-09-10T21:19:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.944+0000 7fd8417fa640 1 -- 172.21.15.59:0/2293717694 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd854003a00 con 0x5571d4d3bd80 2024-09-10T21:19:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.944+0000 7fd86459f740 1 -- 172.21.15.59:0/2293717694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d3bd80 msgr2=0x5571d4d3d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.945+0000 7fd86459f740 1 --2- 172.21.15.59:0/2293717694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d3bd80 0x5571d4d3d170 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd85402fc40 tx=0x7fd85402bfd0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.945+0000 7fd86459f740 1 -- 172.21.15.59:0/2293717694 shutdown_connections 2024-09-10T21:19:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.945+0000 7fd86459f740 1 --2- 172.21.15.59:0/2293717694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d3bd80 0x5571d4d3d170 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.945+0000 7fd86459f740 1 --2- 172.21.15.59:0/2293717694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571d4d2fdf0 0x5571d4d3a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.945+0000 7fd86459f740 1 --2- 172.21.15.59:0/2293717694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d2f4d0 0x5571d4d2cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.945+0000 7fd86459f740 1 -- 172.21.15.59:0/2293717694 >> 172.21.15.59:0/2293717694 conn(0x5571d4d2d300 msgr2=0x5571d4d3a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.945+0000 7fd86459f740 1 -- 172.21.15.59:0/2293717694 shutdown_connections 2024-09-10T21:19:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.945+0000 7fd86459f740 1 -- 172.21.15.59:0/2293717694 wait complete. 2024-09-10T21:19:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.945+0000 7fd86459f740 1 -- start start 2024-09-10T21:19:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.945+0000 7fd86459f740 1 Processor -- start 2024-09-10T21:19:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.945+0000 7fd86459f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d2f4d0 0x5571d4d4d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.945+0000 7fd86459f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d2fdf0 0x5571d4d4d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.945+0000 7fd86459f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571d4d3bd80 0x5571d4db71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.945+0000 7fd86459f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c1b1920 con 0x5571d4d2f4d0 2024-09-10T21:19:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.945+0000 7fd86459f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c1b1250 con 0x5571d4d2fdf0 2024-09-10T21:19:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.945+0000 7fd86459f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c1ae490 con 0x5571d4d3bd80 2024-09-10T21:19:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.946+0000 7fd86459f740 10 client.0 _ll_register_callbacks cb 0x7fd84c0e9740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.946+0000 7fd85bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d2f4d0 0x5571d4d4d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.946+0000 7fd85bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d2f4d0 0x5571d4d4d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35878/0 (socket says 172.21.15.59:35878) 2024-09-10T21:19:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.946+0000 7fd85bfff640 1 -- 172.21.15.59:0/1906235526 learned_addr learned my addr 172.21.15.59:0/1906235526 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.946+0000 7fd85affd640 1 --2- 172.21.15.59:0/1906235526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d2fdf0 0x5571d4d4d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.946+0000 7fd85bfff640 1 -- 172.21.15.59:0/1906235526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571d4d3bd80 msgr2=0x5571d4db71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.946+0000 7fd85bfff640 1 --2- 172.21.15.59:0/1906235526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571d4d3bd80 0x5571d4db71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.946+0000 7fd85bfff640 1 -- 172.21.15.59:0/1906235526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d2fdf0 msgr2=0x5571d4d4d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.946+0000 7fd85bfff640 1 --2- 172.21.15.59:0/1906235526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d2fdf0 0x5571d4d4d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.946+0000 7fd85bfff640 1 -- 172.21.15.59:0/1906235526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571d4db7870 con 0x5571d4d2f4d0 2024-09-10T21:19:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.946+0000 7fd85affd640 1 --2- 172.21.15.59:0/1906235526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d2fdf0 0x5571d4d4d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.946+0000 7fd85bfff640 1 --2- 172.21.15.59:0/1906235526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d2f4d0 0x5571d4d4d200 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd854009620 tx=0x7fd85402fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a44c77a69f70e29 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.946+0000 7fd83affd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.946+0000 7fd83affd640 1 -- 172.21.15.59:0/1906235526 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd854063070 con 0x5571d4d2f4d0 2024-09-10T21:19:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.946+0000 7fd83affd640 1 -- 172.21.15.59:0/1906235526 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd854003e80 con 0x5571d4d2f4d0 2024-09-10T21:19:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.946+0000 7fd86459f740 1 -- 172.21.15.59:0/1906235526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd854036070 con 0x5571d4d2f4d0 2024-09-10T21:19:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.946+0000 7fd83affd640 1 -- 172.21.15.59:0/1906235526 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd854031e00 con 0x5571d4d2f4d0 2024-09-10T21:19:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.946+0000 7fd86459f740 10 client.16338 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.946+0000 7fd86459f740 1 -- 172.21.15.59:0/1906235526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5571d4db8b50 con 0x5571d4d2f4d0 2024-09-10T21:19:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.947+0000 7fd83affd640 1 -- 172.21.15.59:0/1906235526 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd854036070 con 0x5571d4d2f4d0 2024-09-10T21:19:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.947+0000 7fd83affd640 1 -- 172.21.15.59:0/1906235526 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd854050040 con 0x5571d4d2f4d0 2024-09-10T21:19:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.947+0000 7fd86459f740 10 client.16338 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.947+0000 7fd86459f740 10 client.16338 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:19:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.947+0000 7fd86459f740 20 client.16338 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.947+0000 7fd86459f740 1 --2- 172.21.15.59:0/1906235526 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5571d4d4b650 0x5571d4dbb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.947+0000 7fd86459f740 4 client.16338 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:19:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.947+0000 7fd86459f740 1 -- 172.21.15.59:0/1906235526 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5571d4ca38a0 con 0x5571d4d4b650 2024-09-10T21:19:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.947+0000 7fd85affd640 1 --2- 172.21.15.59:0/1906235526 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5571d4d4b650 0x5571d4dbb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.948+0000 7fd83affd640 10 client.16338 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:19:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.948+0000 7fd85affd640 1 --2- 172.21.15.59:0/1906235526 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5571d4d4b650 0x5571d4dbb250 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7f2012f128f8d8f4 server_cookie=7f67ef9883a85829 in_seq=0 out_seq=0 2024-09-10T21:19:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.948+0000 7fd83affd640 1 -- 172.21.15.59:0/1906235526 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5571d4ca38a0 con 0x5571d4d4b650 2024-09-10T21:19:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.948+0000 7fd83affd640 10 client.16338 handle_command_reply: tid=0 2024-09-10T21:19:02.978 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:19:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.948+0000 7fd86459f740 1 client.16338 shutdown 2024-09-10T21:19:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.948+0000 7fd86459f740 1 -- 172.21.15.59:0/1906235526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d2f4d0 msgr2=0x5571d4d4d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.948+0000 7fd86459f740 1 --2- 172.21.15.59:0/1906235526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d2f4d0 0x5571d4d4d200 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd854009620 tx=0x7fd85402fab0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.948+0000 7fd86459f740 1 -- 172.21.15.59:0/1906235526 shutdown_connections 2024-09-10T21:19:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.948+0000 7fd86459f740 1 --2- 172.21.15.59:0/1906235526 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5571d4d4b650 0x5571d4dbb250 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.948+0000 7fd86459f740 1 --2- 172.21.15.59:0/1906235526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5571d4d3bd80 0x5571d4db71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.948+0000 7fd86459f740 1 --2- 172.21.15.59:0/1906235526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571d4d2fdf0 0x5571d4d4d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.948+0000 7fd83affd640 0 client.16338 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:19:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.948+0000 7fd86459f740 1 --2- 172.21.15.59:0/1906235526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5571d4d2f4d0 0x5571d4d4d200 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.948+0000 7fd86459f740 1 -- 172.21.15.59:0/1906235526 >> 172.21.15.59:0/1906235526 conn(0x5571d4d2d300 msgr2=0x5571d4d3a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.948+0000 7fd86459f740 1 -- 172.21.15.59:0/1906235526 shutdown_connections 2024-09-10T21:19:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.948+0000 7fd86459f740 1 -- 172.21.15.59:0/1906235526 wait complete. 2024-09-10T21:19:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.948+0000 7fd86459f740 20 client.16338 trim_cache size 0 max 16384 2024-09-10T21:19:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.949+0000 7fd8621ca640 1 -- 172.21.15.59:0/449145810 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd8440b52e0 msgr2=0x7fd8440b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.949+0000 7fd8621ca640 1 --2- 172.21.15.59:0/449145810 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd8440b52e0 0x7fd8440b77a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c8f0 tx=0x7fd84c0e9870 comp rx=0 tx=0).stop 2024-09-10T21:19:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.949+0000 7fd8621ca640 1 -- 172.21.15.59:0/449145810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd85c103ca0 msgr2=0x7fd85c19b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.949+0000 7fd8621ca640 1 --2- 172.21.15.59:0/449145810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd85c103ca0 0x7fd85c19b4a0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c920 tx=0x7fd84c00cde0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.949+0000 7fd8621ca640 1 -- 172.21.15.59:0/449145810 shutdown_connections 2024-09-10T21:19:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.949+0000 7fd8621ca640 1 --2- 172.21.15.59:0/449145810 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd8440b52e0 0x7fd8440b77a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.949+0000 7fd8621ca640 1 --2- 172.21.15.59:0/449145810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd85c10d100 0x7fd85c1a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.949+0000 7fd8621ca640 1 --2- 172.21.15.59:0/449145810 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd85c1045c0 0x7fd85c19b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.949+0000 7fd8621ca640 1 --2- 172.21.15.59:0/449145810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd85c103ca0 0x7fd85c19b4a0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.949+0000 7fd8621ca640 1 -- 172.21.15.59:0/449145810 >> 172.21.15.59:0/449145810 conn(0x7fd85c0fd700 msgr2=0x7fd85c101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.949+0000 7fd8621ca640 1 -- 172.21.15.59:0/449145810 shutdown_connections 2024-09-10T21:19:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:02.949+0000 7fd8621ca640 1 -- 172.21.15.59:0/449145810 wait complete. 2024-09-10T21:19:03.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:03 smithi059 ceph-mon[30888]: pgmap v453: 97 pgs: 97 active+clean; 2.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:19:03.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:03 smithi192 ceph-mon[35363]: pgmap v453: 97 pgs: 97 active+clean; 2.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:19:03.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:03 smithi154 ceph-mon[35041]: pgmap v453: 97 pgs: 97 active+clean; 2.5 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:19:03.757 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:19:04.017 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:19:04.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.510+0000 7f641d30e640 1 -- 172.21.15.59:0/3324609304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6418108060 msgr2=0x7f641810e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:04.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.510+0000 7f641d30e640 1 --2- 172.21.15.59:0/3324609304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6418108060 0x7f641810e860 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6410009ca0 tx=0x7f641002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.510+0000 7f641d30e640 1 -- 172.21.15.59:0/3324609304 shutdown_connections 2024-09-10T21:19:04.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.510+0000 7f641d30e640 1 --2- 172.21.15.59:0/3324609304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6418108060 0x7f641810e860 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.510+0000 7f641d30e640 1 --2- 172.21.15.59:0/3324609304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64181076e0 0x7f6418107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.510+0000 7f641d30e640 1 --2- 172.21.15.59:0/3324609304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6418101cd0 0x7f64181020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.510+0000 7f641d30e640 1 -- 172.21.15.59:0/3324609304 >> 172.21.15.59:0/3324609304 conn(0x7f64180fd700 msgr2=0x7f64180ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:04.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.510+0000 7f641d30e640 1 -- 172.21.15.59:0/3324609304 shutdown_connections 2024-09-10T21:19:04.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.510+0000 7f641d30e640 1 -- 172.21.15.59:0/3324609304 wait complete. 2024-09-10T21:19:04.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.511+0000 7f641d30e640 1 Processor -- start 2024-09-10T21:19:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.511+0000 7f641d30e640 1 -- start start 2024-09-10T21:19:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.511+0000 7f641d30e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6418101cd0 0x7f641819b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.511+0000 7f641d30e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64181076e0 0x7f641819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.511+0000 7f641d30e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6418108060 0x7f64181a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.511+0000 7f641d30e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6418111d70 con 0x7f6418101cd0 2024-09-10T21:19:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.511+0000 7f641d30e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6418111bf0 con 0x7f6418108060 2024-09-10T21:19:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.511+0000 7f641d30e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6418111ef0 con 0x7f64181076e0 2024-09-10T21:19:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.511+0000 7f6416ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6418101cd0 0x7f641819b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.511+0000 7f6416ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6418101cd0 0x7f641819b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35892/0 (socket says 172.21.15.59:35892) 2024-09-10T21:19:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.511+0000 7f6416ffd640 1 -- 172.21.15.59:0/2231669951 learned_addr learned my addr 172.21.15.59:0/2231669951 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.511+0000 7f64167fc640 1 --2- 172.21.15.59:0/2231669951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64181076e0 0x7f641819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:04.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.512+0000 7f64177fe640 1 --2- 172.21.15.59:0/2231669951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6418108060 0x7f64181a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.512+0000 7f6416ffd640 1 -- 172.21.15.59:0/2231669951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64181076e0 msgr2=0x7f641819b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.512+0000 7f6416ffd640 1 --2- 172.21.15.59:0/2231669951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64181076e0 0x7f641819b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.512+0000 7f6416ffd640 1 -- 172.21.15.59:0/2231669951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6418108060 msgr2=0x7f64181a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.512+0000 7f6416ffd640 1 --2- 172.21.15.59:0/2231669951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6418108060 0x7f64181a0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.512+0000 7f6416ffd640 1 -- 172.21.15.59:0/2231669951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64181a1500 con 0x7f6418101cd0 2024-09-10T21:19:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.512+0000 7f6416ffd640 1 --2- 172.21.15.59:0/2231669951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6418101cd0 0x7f641819b450 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f640000d950 tx=0x7f640000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.512+0000 7f640ffff640 1 -- 172.21.15.59:0/2231669951 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400017070 con 0x7f6418101cd0 2024-09-10T21:19:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.512+0000 7f640ffff640 1 -- 172.21.15.59:0/2231669951 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6400009c30 con 0x7f6418101cd0 2024-09-10T21:19:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.512+0000 7f641d30e640 1 -- 172.21.15.59:0/2231669951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64181a17f0 con 0x7f6418101cd0 2024-09-10T21:19:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.512+0000 7f640ffff640 1 -- 172.21.15.59:0/2231669951 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640000f620 con 0x7f6418101cd0 2024-09-10T21:19:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.512+0000 7f641d30e640 1 -- 172.21.15.59:0/2231669951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64181a7eb0 con 0x7f6418101cd0 2024-09-10T21:19:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.515+0000 7f640ffff640 1 -- 172.21.15.59:0/2231669951 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f6400010460 con 0x7f6418101cd0 2024-09-10T21:19:04.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.515+0000 7f640ffff640 1 --2- 172.21.15.59:0/2231669951 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f64040b52e0 0x7f64040b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.516+0000 7f64167fc640 1 --2- 172.21.15.59:0/2231669951 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f64040b52e0 0x7f64040b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.516+0000 7f641f6e3740 1 Processor -- start 2024-09-10T21:19:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.516+0000 7f640ffff640 1 -- 172.21.15.59:0/2231669951 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f64000e58a0 con 0x7f6418101cd0 2024-09-10T21:19:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.516+0000 7f641f6e3740 1 -- start start 2024-09-10T21:19:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.516+0000 7f641f6e3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff13e98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.516+0000 7f64167fc640 1 --2- 172.21.15.59:0/2231669951 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f64040b52e0 0x7f64040b77a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6418106cd0 tx=0x7f640800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.516+0000 7f641f6e3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13e9df0 0x55cff13f5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.516+0000 7f641f6e3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13f5d80 0x55cff13f8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.516+0000 7f641f6e3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cff135fea0 con 0x55cff13e94d0 2024-09-10T21:19:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.516+0000 7f641f6e3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cff134f2d0 con 0x55cff13f5d80 2024-09-10T21:19:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.516+0000 7f641f6e3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cff13530e0 con 0x55cff13e9df0 2024-09-10T21:19:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.516+0000 7f6416ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff13e98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.516+0000 7f6416ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff13e98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35904/0 (socket says 172.21.15.59:35904) 2024-09-10T21:19:04.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.516+0000 7f6416ffd640 1 -- 172.21.15.59:0/2608093980 learned_addr learned my addr 172.21.15.59:0/2608093980 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.516+0000 7f64167fc640 1 --2- 172.21.15.59:0/2608093980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13e9df0 0x55cff13f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.517+0000 7f6416ffd640 1 -- 172.21.15.59:0/2608093980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13e9df0 msgr2=0x55cff13f5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.517+0000 7f6416ffd640 1 --2- 172.21.15.59:0/2608093980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13e9df0 0x55cff13f5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.517+0000 7f64177fe640 1 --2- 172.21.15.59:0/2608093980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13f5d80 0x55cff13f8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.517+0000 7f6416ffd640 1 -- 172.21.15.59:0/2608093980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13f5d80 msgr2=0x55cff13f8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.517+0000 7f6416ffd640 1 --2- 172.21.15.59:0/2608093980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13f5d80 0x55cff13f8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.517+0000 7f6416ffd640 1 -- 172.21.15.59:0/2608093980 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff10ad650 con 0x55cff13e94d0 2024-09-10T21:19:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.517+0000 7f64177fe640 1 --2- 172.21.15.59:0/2608093980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13f5d80 0x55cff13f8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.517+0000 7f6416ffd640 1 --2- 172.21.15.59:0/2608093980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff13e98b0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f64000a92a0 tx=0x7f64000abb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532164b59e3158d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.517+0000 7f640d7fa640 1 -- 172.21.15.59:0/2608093980 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400020070 con 0x55cff13e94d0 2024-09-10T21:19:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.517+0000 7f640d7fa640 1 -- 172.21.15.59:0/2608093980 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6400091e50 con 0x55cff13e94d0 2024-09-10T21:19:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.517+0000 7f640d7fa640 1 -- 172.21.15.59:0/2608093980 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400010980 con 0x55cff13e94d0 2024-09-10T21:19:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.518+0000 7f641f6e3740 1 -- 172.21.15.59:0/2608093980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 msgr2=0x55cff13e98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:04.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.518+0000 7f641f6e3740 1 --2- 172.21.15.59:0/2608093980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff13e98b0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f64000a92a0 tx=0x7f64000abb40 comp rx=0 tx=0).stop 2024-09-10T21:19:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.518+0000 7f641f6e3740 1 -- 172.21.15.59:0/2608093980 shutdown_connections 2024-09-10T21:19:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.518+0000 7f641f6e3740 1 --2- 172.21.15.59:0/2608093980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13f5d80 0x55cff13f8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.518+0000 7f641f6e3740 1 --2- 172.21.15.59:0/2608093980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13e9df0 0x55cff13f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.518+0000 7f641f6e3740 1 --2- 172.21.15.59:0/2608093980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff13e98b0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.518+0000 7f641f6e3740 1 -- 172.21.15.59:0/2608093980 >> 172.21.15.59:0/2608093980 conn(0x55cff13e7300 msgr2=0x55cff13e84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.518+0000 7f641f6e3740 1 -- 172.21.15.59:0/2608093980 shutdown_connections 2024-09-10T21:19:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.518+0000 7f641f6e3740 1 -- 172.21.15.59:0/2608093980 wait complete. 2024-09-10T21:19:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.518+0000 7f641f6e3740 1 -- start start 2024-09-10T21:19:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.518+0000 7f641f6e3740 1 Processor -- start 2024-09-10T21:19:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.519+0000 7f641f6e3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff13f5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.519+0000 7f641f6e3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13e9df0 0x55cff13f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.519+0000 7f641f6e3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13f5d80 0x55cff13f3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.519+0000 7f641f6e3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cff11b0700 con 0x55cff13e94d0 2024-09-10T21:19:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.519+0000 7f641f6e3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cff12ea160 con 0x55cff13f5d80 2024-09-10T21:19:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.519+0000 7f641f6e3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cff13f89a0 con 0x55cff13e9df0 2024-09-10T21:19:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.519+0000 7f6416ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff13f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.519+0000 7f641f6e3740 10 client.0 _ll_register_callbacks cb 0x55cff13039e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.519+0000 7f6416ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff13f5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35920/0 (socket says 172.21.15.59:35920) 2024-09-10T21:19:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.519+0000 7f6416ffd640 1 -- 172.21.15.59:0/2834241954 learned_addr learned my addr 172.21.15.59:0/2834241954 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.519+0000 7f64177fe640 1 --2- 172.21.15.59:0/2834241954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13f5d80 0x55cff13f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.519+0000 7f64167fc640 1 --2- 172.21.15.59:0/2834241954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13e9df0 0x55cff13f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.519+0000 7f6416ffd640 1 -- 172.21.15.59:0/2834241954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13e9df0 msgr2=0x55cff13f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.519+0000 7f6416ffd640 1 --2- 172.21.15.59:0/2834241954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13e9df0 0x55cff13f2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.519+0000 7f6416ffd640 1 -- 172.21.15.59:0/2834241954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13f5d80 msgr2=0x55cff13f3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.519+0000 7f6416ffd640 1 --2- 172.21.15.59:0/2834241954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13f5d80 0x55cff13f3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.519+0000 7f6416ffd640 1 -- 172.21.15.59:0/2834241954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cff1317c90 con 0x55cff13e94d0 2024-09-10T21:19:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.519+0000 7f6416ffd640 1 --2- 172.21.15.59:0/2834241954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff13f5630 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f6400012040 tx=0x7f64000a84d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225bb40adba41113 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.519+0000 7f63fe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.520+0000 7f63fe7fc640 1 -- 172.21.15.59:0/2834241954 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400020070 con 0x55cff13e94d0 2024-09-10T21:19:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.520+0000 7f63fe7fc640 1 -- 172.21.15.59:0/2834241954 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6400097170 con 0x55cff13e94d0 2024-09-10T21:19:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.520+0000 7f641f6e3740 1 -- 172.21.15.59:0/2834241954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6400091e50 con 0x55cff13e94d0 2024-09-10T21:19:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.520+0000 7f63fe7fc640 1 -- 172.21.15.59:0/2834241954 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6400009de0 con 0x55cff13e94d0 2024-09-10T21:19:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.520+0000 7f641f6e3740 10 client.16350 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.520+0000 7f641f6e3740 1 -- 172.21.15.59:0/2834241954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cff1404230 con 0x55cff13e94d0 2024-09-10T21:19:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.520+0000 7f63fe7fc640 1 -- 172.21.15.59:0/2834241954 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6400091e50 con 0x55cff13e94d0 2024-09-10T21:19:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.520+0000 7f63fe7fc640 1 -- 172.21.15.59:0/2834241954 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f64000aad00 con 0x55cff13e94d0 2024-09-10T21:19:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.520+0000 7f641f6e3740 10 client.16350 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.520+0000 7f641f6e3740 10 client.16350 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:19:04.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.520+0000 7f641f6e3740 20 client.16350 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.520+0000 7f641f6e3740 1 --2- 172.21.15.59:0/2834241954 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55cff1405580 0x55cff1407970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.520+0000 7f641f6e3740 4 client.16350 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:19:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.520+0000 7f641f6e3740 1 -- 172.21.15.59:0/2834241954 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cff1361df0 con 0x55cff1405580 2024-09-10T21:19:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.520+0000 7f64167fc640 1 --2- 172.21.15.59:0/2834241954 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55cff1405580 0x55cff1407970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.521+0000 7f63fe7fc640 10 client.16350 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.521+0000 7f64167fc640 1 --2- 172.21.15.59:0/2834241954 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55cff1405580 0x55cff1407970 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1166ab99117d38ba server_cookie=e1609dad16a0d453 in_seq=0 out_seq=0 2024-09-10T21:19:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.522+0000 7f63fe7fc640 1 -- 172.21.15.59:0/2834241954 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cff1361df0 con 0x55cff1405580 2024-09-10T21:19:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.522+0000 7f63fe7fc640 10 client.16350 handle_command_reply: tid=0 2024-09-10T21:19:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.522+0000 7f641f6e3740 1 client.16350 shutdown 2024-09-10T21:19:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.522+0000 7f641f6e3740 1 -- 172.21.15.59:0/2834241954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 msgr2=0x55cff13f5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.522+0000 7f641f6e3740 1 --2- 172.21.15.59:0/2834241954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff13f5630 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f6400012040 tx=0x7f64000a84d0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.522+0000 7f641f6e3740 1 -- 172.21.15.59:0/2834241954 shutdown_connections 2024-09-10T21:19:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.522+0000 7f641f6e3740 1 --2- 172.21.15.59:0/2834241954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13f5d80 0x55cff13f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.522+0000 7f641f6e3740 1 --2- 172.21.15.59:0/2834241954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13e9df0 0x55cff13f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.522+0000 7f641f6e3740 1 --2- 172.21.15.59:0/2834241954 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55cff1405580 0x55cff1407970 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.522+0000 7f641f6e3740 1 --2- 172.21.15.59:0/2834241954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff13f5630 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.522+0000 7f641f6e3740 1 -- 172.21.15.59:0/2834241954 >> 172.21.15.59:0/2834241954 conn(0x55cff13e7300 msgr2=0x55cff13ece70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.522+0000 7f63fe7fc640 0 client.16350 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.522+0000 7f641f6e3740 1 -- 172.21.15.59:0/2834241954 shutdown_connections 2024-09-10T21:19:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.522+0000 7f641f6e3740 1 -- 172.21.15.59:0/2834241954 wait complete. 2024-09-10T21:19:04.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.522+0000 7f641f6e3740 20 client.16350 trim_cache size 0 max 16384 2024-09-10T21:19:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.536+0000 7f641f6e3740 1 Processor -- start 2024-09-10T21:19:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.536+0000 7f641f6e3740 1 -- start start 2024-09-10T21:19:04.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.536+0000 7f641f6e3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff1401c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.536+0000 7f641f6e3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13e9df0 0x55cff13edcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.536+0000 7f641f6e3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13f5d80 0x55cff13ee230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.536+0000 7f641f6e3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f64181b05b0 con 0x55cff13e94d0 2024-09-10T21:19:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.536+0000 7f641f6e3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f64181b20f0 con 0x55cff13e9df0 2024-09-10T21:19:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.536+0000 7f641f6e3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f64181b0c80 con 0x55cff13f5d80 2024-09-10T21:19:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.536+0000 7f6416ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff1401c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.536+0000 7f6416ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff1401c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35922/0 (socket says 172.21.15.59:35922) 2024-09-10T21:19:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.536+0000 7f6416ffd640 1 -- 172.21.15.59:0/1066806981 learned_addr learned my addr 172.21.15.59:0/1066806981 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.536+0000 7f64177fe640 1 --2- 172.21.15.59:0/1066806981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13f5d80 0x55cff13ee230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.536+0000 7f64167fc640 1 --2- 172.21.15.59:0/1066806981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13e9df0 0x55cff13edcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.537+0000 7f6416ffd640 1 -- 172.21.15.59:0/1066806981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13f5d80 msgr2=0x55cff13ee230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:04.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.537+0000 7f6416ffd640 1 --2- 172.21.15.59:0/1066806981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13f5d80 0x55cff13ee230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.537+0000 7f6416ffd640 1 -- 172.21.15.59:0/1066806981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13e9df0 msgr2=0x55cff13edcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.537+0000 7f6416ffd640 1 --2- 172.21.15.59:0/1066806981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13e9df0 0x55cff13edcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.537+0000 7f6416ffd640 1 -- 172.21.15.59:0/1066806981 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff13e9c20 con 0x55cff13e94d0 2024-09-10T21:19:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.537+0000 7f64167fc640 1 --2- 172.21.15.59:0/1066806981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13e9df0 0x55cff13edcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.537+0000 7f6416ffd640 1 --2- 172.21.15.59:0/1066806981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff1401c00 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f64000a92a0 tx=0x7f64000cf170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c15a618925c096 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.537+0000 7f640cff9640 1 -- 172.21.15.59:0/1066806981 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400020070 con 0x55cff13e94d0 2024-09-10T21:19:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.537+0000 7f640cff9640 1 -- 172.21.15.59:0/1066806981 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6400091e50 con 0x55cff13e94d0 2024-09-10T21:19:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.537+0000 7f640cff9640 1 -- 172.21.15.59:0/1066806981 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64000aaef0 con 0x55cff13e94d0 2024-09-10T21:19:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.538+0000 7f641f6e3740 1 -- 172.21.15.59:0/1066806981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 msgr2=0x55cff1401c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.538+0000 7f641f6e3740 1 --2- 172.21.15.59:0/1066806981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff1401c00 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f64000a92a0 tx=0x7f64000cf170 comp rx=0 tx=0).stop 2024-09-10T21:19:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.538+0000 7f641f6e3740 1 -- 172.21.15.59:0/1066806981 shutdown_connections 2024-09-10T21:19:04.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.538+0000 7f641f6e3740 1 --2- 172.21.15.59:0/1066806981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13f5d80 0x55cff13ee230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.538+0000 7f641f6e3740 1 --2- 172.21.15.59:0/1066806981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13e9df0 0x55cff13edcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.538+0000 7f641f6e3740 1 --2- 172.21.15.59:0/1066806981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff1401c00 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.538+0000 7f641f6e3740 1 -- 172.21.15.59:0/1066806981 >> 172.21.15.59:0/1066806981 conn(0x55cff13e7300 msgr2=0x55cff13f2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:04.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.538+0000 7f641f6e3740 1 -- 172.21.15.59:0/1066806981 shutdown_connections 2024-09-10T21:19:04.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.538+0000 7f641f6e3740 1 -- 172.21.15.59:0/1066806981 wait complete. 2024-09-10T21:19:04.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.538+0000 7f641f6e3740 1 -- start start 2024-09-10T21:19:04.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.538+0000 7f641f6e3740 1 Processor -- start 2024-09-10T21:19:04.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f641f6e3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff13efc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:04.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f641f6e3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13e9df0 0x55cff13f01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:04.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f641f6e3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13f5d80 0x55cff13f0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:04.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f641f6e3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f64181b1a20 con 0x55cff13e94d0 2024-09-10T21:19:04.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f641f6e3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f64181b1350 con 0x55cff13f5d80 2024-09-10T21:19:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f641f6e3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f64181ae590 con 0x55cff13e9df0 2024-09-10T21:19:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f641f6e3740 10 client.0 _ll_register_callbacks cb 0x7f64000abeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f6416ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff13efc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f64177fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13f5d80 0x55cff13f0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f6416ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff13efc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35932/0 (socket says 172.21.15.59:35932) 2024-09-10T21:19:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f6416ffd640 1 -- 172.21.15.59:0/1761772134 learned_addr learned my addr 172.21.15.59:0/1761772134 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f64167fc640 1 --2- 172.21.15.59:0/1761772134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13e9df0 0x55cff13f01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f6416ffd640 1 -- 172.21.15.59:0/1761772134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13e9df0 msgr2=0x55cff13f01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f6416ffd640 1 --2- 172.21.15.59:0/1761772134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13e9df0 0x55cff13f01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f6416ffd640 1 -- 172.21.15.59:0/1761772134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13f5d80 msgr2=0x55cff13f0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f6416ffd640 1 --2- 172.21.15.59:0/1761772134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13f5d80 0x55cff13f0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f6416ffd640 1 -- 172.21.15.59:0/1761772134 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cff14711c0 con 0x55cff13e94d0 2024-09-10T21:19:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f6416ffd640 1 --2- 172.21.15.59:0/1761772134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff13efc90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f64000ac1f0 tx=0x7f6400005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65101bac74d2f546 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f63fe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.539+0000 7f63fe7fc640 1 -- 172.21.15.59:0/1761772134 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400020070 con 0x55cff13e94d0 2024-09-10T21:19:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.540+0000 7f63fe7fc640 1 -- 172.21.15.59:0/1761772134 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6400097370 con 0x55cff13e94d0 2024-09-10T21:19:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.540+0000 7f641f6e3740 1 -- 172.21.15.59:0/1761772134 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6400091e50 con 0x55cff13e94d0 2024-09-10T21:19:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.540+0000 7f63fe7fc640 1 -- 172.21.15.59:0/1761772134 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f64000aaf10 con 0x55cff13e94d0 2024-09-10T21:19:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.540+0000 7f641f6e3740 10 client.16356 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.540+0000 7f641f6e3740 1 -- 172.21.15.59:0/1761772134 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cff14711c0 con 0x55cff13e94d0 2024-09-10T21:19:04.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.540+0000 7f63fe7fc640 1 -- 172.21.15.59:0/1761772134 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6400091e50 con 0x55cff13e94d0 2024-09-10T21:19:04.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.540+0000 7f63fe7fc640 1 -- 172.21.15.59:0/1761772134 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f64000930f0 con 0x55cff13e94d0 2024-09-10T21:19:04.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.540+0000 7f641f6e3740 10 client.16356 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:04.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.540+0000 7f641f6e3740 10 client.16356 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:19:04.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.540+0000 7f641f6e3740 20 client.16356 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.540+0000 7f641f6e3740 1 --2- 172.21.15.59:0/1761772134 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55cff14727b0 0x55cff1474ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.540+0000 7f641f6e3740 4 client.16356 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:19:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.540+0000 7f641f6e3740 1 -- 172.21.15.59:0/1761772134 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cff135d8a0 con 0x55cff14727b0 2024-09-10T21:19:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.540+0000 7f64167fc640 1 --2- 172.21.15.59:0/1761772134 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55cff14727b0 0x55cff1474ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.541+0000 7f64167fc640 1 --2- 172.21.15.59:0/1761772134 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55cff14727b0 0x55cff1474ba0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99bf2afec44553f6 server_cookie=c9bef9088aa6b563 in_seq=0 out_seq=0 2024-09-10T21:19:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.541+0000 7f63fe7fc640 10 client.16356 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.541+0000 7f63fe7fc640 1 -- 172.21.15.59:0/1761772134 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cff135d8a0 con 0x55cff14727b0 2024-09-10T21:19:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.541+0000 7f63fe7fc640 10 client.16356 handle_command_reply: tid=0 2024-09-10T21:19:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.541+0000 7f641f6e3740 1 client.16356 shutdown 2024-09-10T21:19:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.541+0000 7f641f6e3740 1 -- 172.21.15.59:0/1761772134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 msgr2=0x55cff13efc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:04.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.541+0000 7f641f6e3740 1 --2- 172.21.15.59:0/1761772134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff13efc90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f64000ac1f0 tx=0x7f6400005880 comp rx=0 tx=0).stop 2024-09-10T21:19:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.541+0000 7f641f6e3740 1 -- 172.21.15.59:0/1761772134 shutdown_connections 2024-09-10T21:19:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.541+0000 7f641f6e3740 1 --2- 172.21.15.59:0/1761772134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff13f5d80 0x55cff13f0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.541+0000 7f641f6e3740 1 --2- 172.21.15.59:0/1761772134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff13e9df0 0x55cff13f01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.541+0000 7f641f6e3740 1 --2- 172.21.15.59:0/1761772134 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55cff14727b0 0x55cff1474ba0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.541+0000 7f641f6e3740 1 --2- 172.21.15.59:0/1761772134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff13e94d0 0x55cff13efc90 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.541+0000 7f641f6e3740 1 -- 172.21.15.59:0/1761772134 >> 172.21.15.59:0/1761772134 conn(0x55cff13e7300 msgr2=0x55cff13edcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.541+0000 7f63fe7fc640 0 client.16356 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.541+0000 7f641f6e3740 1 -- 172.21.15.59:0/1761772134 shutdown_connections 2024-09-10T21:19:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.541+0000 7f641f6e3740 1 -- 172.21.15.59:0/1761772134 wait complete. 2024-09-10T21:19:04.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.542+0000 7f641f6e3740 20 client.16356 trim_cache size 0 max 16384 2024-09-10T21:19:04.553 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:19:04.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.542+0000 7f641d30e640 1 -- 172.21.15.59:0/2231669951 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f64040b52e0 msgr2=0x7f64040b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:04.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.542+0000 7f641d30e640 1 --2- 172.21.15.59:0/2231669951 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f64040b52e0 0x7f64040b77a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6418106cd0 tx=0x7f640800b390 comp rx=0 tx=0).stop 2024-09-10T21:19:04.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.542+0000 7f641d30e640 1 -- 172.21.15.59:0/2231669951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6418101cd0 msgr2=0x7f641819b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:04.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.542+0000 7f641d30e640 1 --2- 172.21.15.59:0/2231669951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6418101cd0 0x7f641819b450 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f640000d950 tx=0x7f640000de10 comp rx=0 tx=0).stop 2024-09-10T21:19:04.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.542+0000 7f641d30e640 1 -- 172.21.15.59:0/2231669951 shutdown_connections 2024-09-10T21:19:04.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.542+0000 7f641d30e640 1 --2- 172.21.15.59:0/2231669951 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f64040b52e0 0x7f64040b77a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.542+0000 7f641d30e640 1 --2- 172.21.15.59:0/2231669951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6418108060 0x7f64181a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.542+0000 7f641d30e640 1 --2- 172.21.15.59:0/2231669951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64181076e0 0x7f641819b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.542+0000 7f641d30e640 1 --2- 172.21.15.59:0/2231669951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6418101cd0 0x7f641819b450 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:04.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.542+0000 7f641d30e640 1 -- 172.21.15.59:0/2231669951 >> 172.21.15.59:0/2231669951 conn(0x7f64180fd700 msgr2=0x7f641806bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:04.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.542+0000 7f641d30e640 1 -- 172.21.15.59:0/2231669951 shutdown_connections 2024-09-10T21:19:04.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:04.542+0000 7f641d30e640 1 -- 172.21.15.59:0/2231669951 wait complete. 2024-09-10T21:19:05.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:05 smithi059 ceph-mon[30888]: pgmap v454: 97 pgs: 97 active+clean; 2.5 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:05.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:05 smithi192 ceph-mon[35363]: pgmap v454: 97 pgs: 97 active+clean; 2.5 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:05.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:05 smithi154 ceph-mon[35041]: pgmap v454: 97 pgs: 97 active+clean; 2.5 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:06.457 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:19:06.457 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:19:06.733 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:19:07.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:07 smithi059 ceph-mon[30888]: pgmap v455: 97 pgs: 97 active+clean; 2.5 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:19:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.248+0000 7fcb606f9640 1 -- 172.21.15.59:0/1168179714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb581087d0 msgr2=0x7fcb58108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.248+0000 7fcb606f9640 1 --2- 172.21.15.59:0/1168179714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb581087d0 0x7fcb58108c10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009900 tx=0x7fcb4802a410 comp rx=0 tx=0).stop 2024-09-10T21:19:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.248+0000 7fcb606f9640 1 -- 172.21.15.59:0/1168179714 shutdown_connections 2024-09-10T21:19:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.248+0000 7fcb606f9640 1 --2- 172.21.15.59:0/1168179714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb58109150 0x7fcb5810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.248+0000 7fcb606f9640 1 --2- 172.21.15.59:0/1168179714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb581087d0 0x7fcb58108c10 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.248+0000 7fcb606f9640 1 --2- 172.21.15.59:0/1168179714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb58102dc0 0x7fcb581031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.248+0000 7fcb606f9640 1 -- 172.21.15.59:0/1168179714 >> 172.21.15.59:0/1168179714 conn(0x7fcb580fe830 msgr2=0x7fcb58100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.249+0000 7fcb606f9640 1 -- 172.21.15.59:0/1168179714 shutdown_connections 2024-09-10T21:19:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.249+0000 7fcb606f9640 1 -- 172.21.15.59:0/1168179714 wait complete. 2024-09-10T21:19:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.249+0000 7fcb606f9640 1 Processor -- start 2024-09-10T21:19:07.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.249+0000 7fcb606f9640 1 -- start start 2024-09-10T21:19:07.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.249+0000 7fcb606f9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb58102dc0 0x7fcb580754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:07.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.249+0000 7fcb606f9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb581087d0 0x7fcb580759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:07.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.249+0000 7fcb606f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb58109150 0x7fcb58075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:07.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.249+0000 7fcb606f9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcb58112da0 con 0x7fcb58102dc0 2024-09-10T21:19:07.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.249+0000 7fcb606f9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcb58112c20 con 0x7fcb581087d0 2024-09-10T21:19:07.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.249+0000 7fcb606f9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcb58112f20 con 0x7fcb58109150 2024-09-10T21:19:07.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.250+0000 7fcb5e495640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb58102dc0 0x7fcb580754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:07.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.250+0000 7fcb5e495640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb58102dc0 0x7fcb580754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35942/0 (socket says 172.21.15.59:35942) 2024-09-10T21:19:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.250+0000 7fcb5e495640 1 -- 172.21.15.59:0/3532696147 learned_addr learned my addr 172.21.15.59:0/3532696147 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.250+0000 7fcb5ec96640 1 --2- 172.21.15.59:0/3532696147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb58109150 0x7fcb58075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.250+0000 7fcb5dc94640 1 --2- 172.21.15.59:0/3532696147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb581087d0 0x7fcb580759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.250+0000 7fcb5e495640 1 -- 172.21.15.59:0/3532696147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb58109150 msgr2=0x7fcb58075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.250+0000 7fcb5e495640 1 --2- 172.21.15.59:0/3532696147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb58109150 0x7fcb58075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.250+0000 7fcb5e495640 1 -- 172.21.15.59:0/3532696147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb581087d0 msgr2=0x7fcb580759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.250+0000 7fcb5e495640 1 --2- 172.21.15.59:0/3532696147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb581087d0 0x7fcb580759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.250+0000 7fcb5e495640 1 -- 172.21.15.59:0/3532696147 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb581a7630 con 0x7fcb58102dc0 2024-09-10T21:19:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.250+0000 7fcb5dc94640 1 --2- 172.21.15.59:0/3532696147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb581087d0 0x7fcb580759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.250+0000 7fcb5e495640 1 --2- 172.21.15.59:0/3532696147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb58102dc0 0x7fcb580754a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400cce0 tx=0x7fcb5400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.250+0000 7fcb4f7fe640 1 -- 172.21.15.59:0/3532696147 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5400f650 con 0x7fcb58102dc0 2024-09-10T21:19:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.250+0000 7fcb4f7fe640 1 -- 172.21.15.59:0/3532696147 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb5400fca0 con 0x7fcb58102dc0 2024-09-10T21:19:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.250+0000 7fcb606f9640 1 -- 172.21.15.59:0/3532696147 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb581a7920 con 0x7fcb58102dc0 2024-09-10T21:19:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.250+0000 7fcb4f7fe640 1 -- 172.21.15.59:0/3532696147 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb54018b40 con 0x7fcb58102dc0 2024-09-10T21:19:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.251+0000 7fcb606f9640 1 -- 172.21.15.59:0/3532696147 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb581a7e30 con 0x7fcb58102dc0 2024-09-10T21:19:07.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.253+0000 7fcb62ace740 1 Processor -- start 2024-09-10T21:19:07.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.253+0000 7fcb4f7fe640 1 -- 172.21.15.59:0/3532696147 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fcb54004b20 con 0x7fcb58102dc0 2024-09-10T21:19:07.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.253+0000 7fcb62ace740 1 -- start start 2024-09-10T21:19:07.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.254+0000 7fcb62ace740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b309dee0 0x5645b309e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:07.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.254+0000 7fcb62ace740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b309e800 0x5645b30aa250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:07.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.254+0000 7fcb62ace740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b30aa790 0x5645b30acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:07.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.254+0000 7fcb62ace740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5645b3014e60 con 0x5645b30aa790 2024-09-10T21:19:07.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.254+0000 7fcb62ace740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5645b3004290 con 0x5645b309e800 2024-09-10T21:19:07.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.254+0000 7fcb62ace740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5645b30080a0 con 0x5645b309dee0 2024-09-10T21:19:07.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.254+0000 7fcb5dc94640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b30aa790 0x5645b30acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:07.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.254+0000 7fcb5ec96640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b309dee0 0x5645b309e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:07.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.254+0000 7fcb5dc94640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b30aa790 0x5645b30acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35954/0 (socket says 172.21.15.59:35954) 2024-09-10T21:19:07.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.254+0000 7fcb5dc94640 1 -- 172.21.15.59:0/2939746670 learned_addr learned my addr 172.21.15.59:0/2939746670 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:07.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.254+0000 7fcb5e495640 1 --2- 172.21.15.59:0/2939746670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b309e800 0x5645b30aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.254+0000 7fcb5ec96640 1 -- 172.21.15.59:0/2939746670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b309e800 msgr2=0x5645b30aa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.254+0000 7fcb5ec96640 1 --2- 172.21.15.59:0/2939746670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b309e800 0x5645b30aa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.254+0000 7fcb5ec96640 1 -- 172.21.15.59:0/2939746670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b30aa790 msgr2=0x5645b30acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.254+0000 7fcb5ec96640 1 --2- 172.21.15.59:0/2939746670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b30aa790 0x5645b30acb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.254+0000 7fcb5ec96640 1 -- 172.21.15.59:0/2939746670 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645b2d62930 con 0x5645b309dee0 2024-09-10T21:19:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.254+0000 7fcb5e495640 1 --2- 172.21.15.59:0/2939746670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b309e800 0x5645b30aa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.254+0000 7fcb4f7fe640 1 --2- 172.21.15.59:0/3532696147 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcb440b52e0 0x7fcb440b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.254+0000 7fcb5ec96640 1 --2- 172.21.15.59:0/2939746670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b309dee0 0x5645b309e2c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcb5000aab0 tx=0x7fcb5000af70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bede789f840b4d94 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.255+0000 7fcb5e495640 1 --2- 172.21.15.59:0/3532696147 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcb440b52e0 0x7fcb440b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.255+0000 7fcb4f7fe640 1 -- 172.21.15.59:0/3532696147 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcb540e60d0 con 0x7fcb58102dc0 2024-09-10T21:19:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.255+0000 7fcb4cff9640 1 -- 172.21.15.59:0/2939746670 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb50005020 con 0x5645b309dee0 2024-09-10T21:19:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.255+0000 7fcb4cff9640 1 -- 172.21.15.59:0/2939746670 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb50005670 con 0x5645b309dee0 2024-09-10T21:19:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.255+0000 7fcb4cff9640 1 -- 172.21.15.59:0/2939746670 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb500186a0 con 0x5645b309dee0 2024-09-10T21:19:07.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.256+0000 7fcb62ace740 1 -- 172.21.15.59:0/2939746670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b309dee0 msgr2=0x5645b309e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:07.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.256+0000 7fcb5e495640 1 --2- 172.21.15.59:0/3532696147 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcb440b52e0 0x7fcb440b77a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcb540e3f70 tx=0x7fcb54000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:07.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.256+0000 7fcb62ace740 1 --2- 172.21.15.59:0/2939746670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b309dee0 0x5645b309e2c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcb5000aab0 tx=0x7fcb5000af70 comp rx=0 tx=0).stop 2024-09-10T21:19:07.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.256+0000 7fcb62ace740 1 -- 172.21.15.59:0/2939746670 shutdown_connections 2024-09-10T21:19:07.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.256+0000 7fcb62ace740 1 --2- 172.21.15.59:0/2939746670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b30aa790 0x5645b30acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.256+0000 7fcb62ace740 1 --2- 172.21.15.59:0/2939746670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b309e800 0x5645b30aa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.256+0000 7fcb62ace740 1 --2- 172.21.15.59:0/2939746670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b309dee0 0x5645b309e2c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.256+0000 7fcb62ace740 1 -- 172.21.15.59:0/2939746670 >> 172.21.15.59:0/2939746670 conn(0x5645b309bd10 msgr2=0x5645b309ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:07.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.256+0000 7fcb62ace740 1 -- 172.21.15.59:0/2939746670 shutdown_connections 2024-09-10T21:19:07.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.256+0000 7fcb62ace740 1 -- 172.21.15.59:0/2939746670 wait complete. 2024-09-10T21:19:07.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.256+0000 7fcb62ace740 1 -- start start 2024-09-10T21:19:07.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.256+0000 7fcb62ace740 1 Processor -- start 2024-09-10T21:19:07.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.256+0000 7fcb62ace740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309dee0 0x5645b30a7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:07.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.256+0000 7fcb62ace740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b309e800 0x5645b30a7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:07.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.256+0000 7fcb62ace740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b30aa790 0x5645b30a81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:07.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.256+0000 7fcb62ace740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5645b2e65890 con 0x5645b309dee0 2024-09-10T21:19:07.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.256+0000 7fcb62ace740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5645b2f9ed40 con 0x5645b30aa790 2024-09-10T21:19:07.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.256+0000 7fcb62ace740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5645b30ad490 con 0x5645b309e800 2024-09-10T21:19:07.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.257+0000 7fcb5ec96640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309dee0 0x5645b30a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:07.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.257+0000 7fcb62ace740 10 client.0 _ll_register_callbacks cb 0x5645b3002c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:07.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.257+0000 7fcb5ec96640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309dee0 0x5645b30a7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35956/0 (socket says 172.21.15.59:35956) 2024-09-10T21:19:07.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.257+0000 7fcb5ec96640 1 -- 172.21.15.59:0/3104117778 learned_addr learned my addr 172.21.15.59:0/3104117778 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:07.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.257+0000 7fcb5dc94640 1 --2- 172.21.15.59:0/3104117778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b309e800 0x5645b30a7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:07.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.257+0000 7fcb5ec96640 1 --2- 172.21.15.59:0/3104117778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b30aa790 0x5645b30a81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:07.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.257+0000 7fcb5ec96640 1 -- 172.21.15.59:0/3104117778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b309e800 msgr2=0x5645b30a7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:07.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.257+0000 7fcb5ec96640 1 --2- 172.21.15.59:0/3104117778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b309e800 0x5645b30a7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.257+0000 7fcb5ec96640 1 -- 172.21.15.59:0/3104117778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b30aa790 msgr2=0x5645b30a81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:07.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.257+0000 7fcb5ec96640 1 --2- 172.21.15.59:0/3104117778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b30aa790 0x5645b30a81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.257+0000 7fcb5ec96640 1 -- 172.21.15.59:0/3104117778 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645b30b6870 con 0x5645b309dee0 2024-09-10T21:19:07.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.257+0000 7fcb5ec96640 1 --2- 172.21.15.59:0/3104117778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309dee0 0x5645b30a7750 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fcb50000c00 tx=0x7fcb50004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3a312a43fbb8ea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:07.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.257+0000 7fcb41ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:07.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.257+0000 7fcb41ffb640 1 -- 172.21.15.59:0/3104117778 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5002d060 con 0x5645b309dee0 2024-09-10T21:19:07.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.257+0000 7fcb41ffb640 1 -- 172.21.15.59:0/3104117778 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcb50005410 con 0x5645b309dee0 2024-09-10T21:19:07.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.257+0000 7fcb62ace740 1 -- 172.21.15.59:0/3104117778 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb50005670 con 0x5645b309dee0 2024-09-10T21:19:07.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.258+0000 7fcb41ffb640 1 -- 172.21.15.59:0/3104117778 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcb50025450 con 0x5645b309dee0 2024-09-10T21:19:07.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.258+0000 7fcb62ace740 10 client.16368 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:07.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.258+0000 7fcb62ace740 1 -- 172.21.15.59:0/3104117778 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5645b30b9220 con 0x5645b309dee0 2024-09-10T21:19:07.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.258+0000 7fcb41ffb640 1 -- 172.21.15.59:0/3104117778 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb50005670 con 0x5645b309dee0 2024-09-10T21:19:07.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.258+0000 7fcb41ffb640 1 -- 172.21.15.59:0/3104117778 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcb500274e0 con 0x5645b309dee0 2024-09-10T21:19:07.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.258+0000 7fcb62ace740 10 client.16368 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:07.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.258+0000 7fcb62ace740 10 client.16368 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:19:07.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.258+0000 7fcb62ace740 20 client.16368 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:07.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.258+0000 7fcb62ace740 1 --2- 172.21.15.59:0/3104117778 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5645b30ba620 0x5645b30bca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:07.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.258+0000 7fcb62ace740 4 client.16368 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:19:07.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.258+0000 7fcb62ace740 1 -- 172.21.15.59:0/3104117778 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645b3016db0 con 0x5645b30ba620 2024-09-10T21:19:07.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.258+0000 7fcb5dc94640 1 --2- 172.21.15.59:0/3104117778 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5645b30ba620 0x5645b30bca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:07.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.259+0000 7fcb5dc94640 1 --2- 172.21.15.59:0/3104117778 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5645b30ba620 0x5645b30bca10 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9689fe2ca0f6a452 server_cookie=434d68b110f421cc in_seq=0 out_seq=0 2024-09-10T21:19:07.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.259+0000 7fcb41ffb640 10 client.16368 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:07.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.259+0000 7fcb41ffb640 1 -- 172.21.15.59:0/3104117778 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5645b3016db0 con 0x5645b30ba620 2024-09-10T21:19:07.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.259+0000 7fcb41ffb640 10 client.16368 handle_command_reply: tid=0 2024-09-10T21:19:07.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.259+0000 7fcb62ace740 1 client.16368 shutdown 2024-09-10T21:19:07.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.260+0000 7fcb62ace740 1 -- 172.21.15.59:0/3104117778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309dee0 msgr2=0x5645b30a7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:07.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.260+0000 7fcb62ace740 1 --2- 172.21.15.59:0/3104117778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309dee0 0x5645b30a7750 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fcb50000c00 tx=0x7fcb50004e60 comp rx=0 tx=0).stop 2024-09-10T21:19:07.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.260+0000 7fcb62ace740 1 -- 172.21.15.59:0/3104117778 shutdown_connections 2024-09-10T21:19:07.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.260+0000 7fcb62ace740 1 --2- 172.21.15.59:0/3104117778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b30aa790 0x5645b30a81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.260+0000 7fcb62ace740 1 --2- 172.21.15.59:0/3104117778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b309e800 0x5645b30a7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.260+0000 7fcb62ace740 1 --2- 172.21.15.59:0/3104117778 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5645b30ba620 0x5645b30bca10 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.260+0000 7fcb62ace740 1 --2- 172.21.15.59:0/3104117778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309dee0 0x5645b30a7750 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.260+0000 7fcb62ace740 1 -- 172.21.15.59:0/3104117778 >> 172.21.15.59:0/3104117778 conn(0x5645b309bd10 msgr2=0x5645b309af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:07.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.260+0000 7fcb41ffb640 0 client.16368 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:07.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.260+0000 7fcb62ace740 1 -- 172.21.15.59:0/3104117778 shutdown_connections 2024-09-10T21:19:07.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.260+0000 7fcb62ace740 1 -- 172.21.15.59:0/3104117778 wait complete. 2024-09-10T21:19:07.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.260+0000 7fcb62ace740 20 client.16368 trim_cache size 0 max 16384 2024-09-10T21:19:07.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.278+0000 7fcb62ace740 1 Processor -- start 2024-09-10T21:19:07.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.278+0000 7fcb62ace740 1 -- start start 2024-09-10T21:19:07.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.278+0000 7fcb62ace740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b309dee0 0x5645b30a6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:07.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.278+0000 7fcb62ace740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309e800 0x5645b30a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:07.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.278+0000 7fcb62ace740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b30aa790 0x5645b30a4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:07.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.278+0000 7fcb62ace740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcb581b04e0 con 0x5645b309e800 2024-09-10T21:19:07.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.278+0000 7fcb62ace740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcb581b2020 con 0x5645b30aa790 2024-09-10T21:19:07.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.278+0000 7fcb62ace740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcb581b0bb0 con 0x5645b309dee0 2024-09-10T21:19:07.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.278+0000 7fcb5dc94640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309e800 0x5645b30a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:07.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.278+0000 7fcb5dc94640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309e800 0x5645b30a7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35970/0 (socket says 172.21.15.59:35970) 2024-09-10T21:19:07.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.278+0000 7fcb5dc94640 1 -- 172.21.15.59:0/999357462 learned_addr learned my addr 172.21.15.59:0/999357462 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:07.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.278+0000 7fcb5ec96640 1 --2- 172.21.15.59:0/999357462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b309dee0 0x5645b30a6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:07.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.278+0000 7fcb5ec96640 1 --2- 172.21.15.59:0/999357462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b30aa790 0x5645b30a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:07.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.278+0000 7fcb5dc94640 1 -- 172.21.15.59:0/999357462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b309dee0 msgr2=0x5645b30a6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:07.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.278+0000 7fcb5dc94640 1 --2- 172.21.15.59:0/999357462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b309dee0 0x5645b30a6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.278+0000 7fcb5dc94640 1 -- 172.21.15.59:0/999357462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b30aa790 msgr2=0x5645b30a4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:07.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.278+0000 7fcb5dc94640 1 --2- 172.21.15.59:0/999357462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b30aa790 0x5645b30a4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.278+0000 7fcb5dc94640 1 -- 172.21.15.59:0/999357462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645b309c790 con 0x5645b309e800 2024-09-10T21:19:07.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.278+0000 7fcb5ec96640 1 --2- 172.21.15.59:0/999357462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b30aa790 0x5645b30a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:07.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.279+0000 7fcb5dc94640 1 --2- 172.21.15.59:0/999357462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309e800 0x5645b30a7dd0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcb4802a930 tx=0x7fcb480058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7459b4dd897d601e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:07.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.279+0000 7fcb43fff640 1 -- 172.21.15.59:0/999357462 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48035040 con 0x5645b309e800 2024-09-10T21:19:07.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.279+0000 7fcb43fff640 1 -- 172.21.15.59:0/999357462 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb48031950 con 0x5645b309e800 2024-09-10T21:19:07.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.279+0000 7fcb43fff640 1 -- 172.21.15.59:0/999357462 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48004a00 con 0x5645b309e800 2024-09-10T21:19:07.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.279+0000 7fcb62ace740 1 -- 172.21.15.59:0/999357462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309e800 msgr2=0x5645b30a7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:07.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.279+0000 7fcb62ace740 1 --2- 172.21.15.59:0/999357462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309e800 0x5645b30a7dd0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcb4802a930 tx=0x7fcb480058b0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.279+0000 7fcb62ace740 1 -- 172.21.15.59:0/999357462 shutdown_connections 2024-09-10T21:19:07.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.279+0000 7fcb62ace740 1 --2- 172.21.15.59:0/999357462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b30aa790 0x5645b30a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.279+0000 7fcb62ace740 1 --2- 172.21.15.59:0/999357462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309e800 0x5645b30a7dd0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.279+0000 7fcb62ace740 1 --2- 172.21.15.59:0/999357462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b309dee0 0x5645b30a6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.279+0000 7fcb62ace740 1 -- 172.21.15.59:0/999357462 >> 172.21.15.59:0/999357462 conn(0x5645b309bd10 msgr2=0x5645b30a76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:07.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.279+0000 7fcb62ace740 1 -- 172.21.15.59:0/999357462 shutdown_connections 2024-09-10T21:19:07.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.280+0000 7fcb62ace740 1 -- 172.21.15.59:0/999357462 wait complete. 2024-09-10T21:19:07.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.280+0000 7fcb62ace740 1 -- start start 2024-09-10T21:19:07.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.280+0000 7fcb62ace740 1 Processor -- start 2024-09-10T21:19:07.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.280+0000 7fcb62ace740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309dee0 0x5645b30aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:07.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.280+0000 7fcb62ace740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b309e800 0x5645b30af400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:07.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.280+0000 7fcb62ace740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b30aa790 0x5645b3126210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:07.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.280+0000 7fcb62ace740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcb581b1950 con 0x5645b309dee0 2024-09-10T21:19:07.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.280+0000 7fcb62ace740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcb581b1280 con 0x5645b309e800 2024-09-10T21:19:07.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.280+0000 7fcb62ace740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcb581ae4c0 con 0x5645b30aa790 2024-09-10T21:19:07.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.280+0000 7fcb62ace740 10 client.0 _ll_register_callbacks cb 0x7fcb48009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:07.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.280+0000 7fcb5ec96640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309dee0 0x5645b30aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:07.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.280+0000 7fcb5ec96640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309dee0 0x5645b30aeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35984/0 (socket says 172.21.15.59:35984) 2024-09-10T21:19:07.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.280+0000 7fcb5ec96640 1 -- 172.21.15.59:0/1135779931 learned_addr learned my addr 172.21.15.59:0/1135779931 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:07.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.281+0000 7fcb5ec96640 1 -- 172.21.15.59:0/1135779931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b30aa790 msgr2=0x5645b3126210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:07.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.281+0000 7fcb5dc94640 1 --2- 172.21.15.59:0/1135779931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b309e800 0x5645b30af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:07.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.281+0000 7fcb5ec96640 1 --2- 172.21.15.59:0/1135779931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b30aa790 0x5645b3126210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.281+0000 7fcb5ec96640 1 -- 172.21.15.59:0/1135779931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b309e800 msgr2=0x5645b30af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:07.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.281+0000 7fcb5ec96640 1 --2- 172.21.15.59:0/1135779931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b309e800 0x5645b30af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.281+0000 7fcb5ec96640 1 -- 172.21.15.59:0/1135779931 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645b31268b0 con 0x5645b309dee0 2024-09-10T21:19:07.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.281+0000 7fcb5dc94640 1 --2- 172.21.15.59:0/1135779931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b309e800 0x5645b30af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:07.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.281+0000 7fcb5ec96640 1 --2- 172.21.15.59:0/1135779931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309dee0 0x5645b30aeec0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fcb50027980 tx=0x7fcb5000fe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd1ad5df653e76b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:07.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.281+0000 7fcb41ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:07.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.281+0000 7fcb41ffb640 1 -- 172.21.15.59:0/1135779931 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb50038040 con 0x5645b309dee0 2024-09-10T21:19:07.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.281+0000 7fcb41ffb640 1 -- 172.21.15.59:0/1135779931 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcb50027650 con 0x5645b309dee0 2024-09-10T21:19:07.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.281+0000 7fcb62ace740 1 -- 172.21.15.59:0/1135779931 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5645b3012860 con 0x5645b309dee0 2024-09-10T21:19:07.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.281+0000 7fcb41ffb640 1 -- 172.21.15.59:0/1135779931 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcb50046070 con 0x5645b309dee0 2024-09-10T21:19:07.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.281+0000 7fcb62ace740 10 client.16374 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:07.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.281+0000 7fcb62ace740 1 -- 172.21.15.59:0/1135779931 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5645b3127b60 con 0x5645b309dee0 2024-09-10T21:19:07.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.281+0000 7fcb41ffb640 1 -- 172.21.15.59:0/1135779931 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5645b3012860 con 0x5645b309dee0 2024-09-10T21:19:07.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.282+0000 7fcb41ffb640 1 -- 172.21.15.59:0/1135779931 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcb50025710 con 0x5645b309dee0 2024-09-10T21:19:07.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.282+0000 7fcb62ace740 10 client.16374 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:07.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.282+0000 7fcb62ace740 10 client.16374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:19:07.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.282+0000 7fcb62ace740 20 client.16374 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:07.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.282+0000 7fcb62ace740 1 --2- 172.21.15.59:0/1135779931 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5645b3128160 0x5645b312a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:07.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.282+0000 7fcb62ace740 4 client.16374 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:19:07.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.282+0000 7fcb62ace740 1 -- 172.21.15.59:0/1135779931 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5645b300fc90 con 0x5645b3128160 2024-09-10T21:19:07.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.282+0000 7fcb5dc94640 1 --2- 172.21.15.59:0/1135779931 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5645b3128160 0x5645b312a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:07.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.282+0000 7fcb41ffb640 10 client.16374 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:07.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.282+0000 7fcb5dc94640 1 --2- 172.21.15.59:0/1135779931 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5645b3128160 0x5645b312a580 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=899b0ee29f728daa server_cookie=b9c5a5c9d6fb1623 in_seq=0 out_seq=0 2024-09-10T21:19:07.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.284+0000 7fcb41ffb640 1 -- 172.21.15.59:0/1135779931 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5645b300fc90 con 0x5645b3128160 2024-09-10T21:19:07.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.284+0000 7fcb41ffb640 10 client.16374 handle_command_reply: tid=0 2024-09-10T21:19:07.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.284+0000 7fcb62ace740 1 client.16374 shutdown 2024-09-10T21:19:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.284+0000 7fcb62ace740 1 -- 172.21.15.59:0/1135779931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309dee0 msgr2=0x5645b30aeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.284+0000 7fcb62ace740 1 --2- 172.21.15.59:0/1135779931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309dee0 0x5645b30aeec0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fcb50027980 tx=0x7fcb5000fe00 comp rx=0 tx=0).stop 2024-09-10T21:19:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.284+0000 7fcb62ace740 1 -- 172.21.15.59:0/1135779931 shutdown_connections 2024-09-10T21:19:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.284+0000 7fcb62ace740 1 --2- 172.21.15.59:0/1135779931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5645b30aa790 0x5645b3126210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.284+0000 7fcb62ace740 1 --2- 172.21.15.59:0/1135779931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5645b309e800 0x5645b30af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.284+0000 7fcb62ace740 1 --2- 172.21.15.59:0/1135779931 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5645b3128160 0x5645b312a580 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.284+0000 7fcb62ace740 1 --2- 172.21.15.59:0/1135779931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b309dee0 0x5645b30aeec0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.284+0000 7fcb62ace740 1 -- 172.21.15.59:0/1135779931 >> 172.21.15.59:0/1135779931 conn(0x5645b309bd10 msgr2=0x5645b30a18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.284+0000 7fcb41ffb640 0 client.16374 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.284+0000 7fcb62ace740 1 -- 172.21.15.59:0/1135779931 shutdown_connections 2024-09-10T21:19:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.284+0000 7fcb62ace740 1 -- 172.21.15.59:0/1135779931 wait complete. 2024-09-10T21:19:07.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.285+0000 7fcb62ace740 20 client.16374 trim_cache size 0 max 16384 2024-09-10T21:19:07.296 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:19:07.296 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:19:07.296 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "aa7d3145-fc16-4c86-b6cd-995ce03e73a9", 2024-09-10T21:19:07.296 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:19:07.296 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:19:07.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.285+0000 7fcb606f9640 1 -- 172.21.15.59:0/3532696147 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcb440b52e0 msgr2=0x7fcb440b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:07.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.285+0000 7fcb606f9640 1 --2- 172.21.15.59:0/3532696147 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcb440b52e0 0x7fcb440b77a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcb540e3f70 tx=0x7fcb54000f40 comp rx=0 tx=0).stop 2024-09-10T21:19:07.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.285+0000 7fcb606f9640 1 -- 172.21.15.59:0/3532696147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb58102dc0 msgr2=0x7fcb580754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:07.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.285+0000 7fcb606f9640 1 --2- 172.21.15.59:0/3532696147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb58102dc0 0x7fcb580754a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400cce0 tx=0x7fcb5400a620 comp rx=0 tx=0).stop 2024-09-10T21:19:07.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.285+0000 7fcb606f9640 1 -- 172.21.15.59:0/3532696147 shutdown_connections 2024-09-10T21:19:07.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.285+0000 7fcb606f9640 1 --2- 172.21.15.59:0/3532696147 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcb440b52e0 0x7fcb440b77a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.285+0000 7fcb606f9640 1 --2- 172.21.15.59:0/3532696147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb58109150 0x7fcb58075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.285+0000 7fcb606f9640 1 --2- 172.21.15.59:0/3532696147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb581087d0 0x7fcb580759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.285+0000 7fcb606f9640 1 --2- 172.21.15.59:0/3532696147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb58102dc0 0x7fcb580754a0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:07.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.285+0000 7fcb606f9640 1 -- 172.21.15.59:0/3532696147 >> 172.21.15.59:0/3532696147 conn(0x7fcb580fe830 msgr2=0x7fcb58100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:07.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.285+0000 7fcb606f9640 1 -- 172.21.15.59:0/3532696147 shutdown_connections 2024-09-10T21:19:07.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:07.285+0000 7fcb606f9640 1 -- 172.21.15.59:0/3532696147 wait complete. 2024-09-10T21:19:07.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:07 smithi192 ceph-mon[35363]: pgmap v455: 97 pgs: 97 active+clean; 2.5 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:19:07.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:07 smithi154 ceph-mon[35041]: pgmap v455: 97 pgs: 97 active+clean; 2.5 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:19:08.112 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:19:08.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:08 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:19:08.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:08 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:19:08.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:08 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:19:08.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:08 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:19:08.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:08 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:19:08.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:08 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:19:08.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:08 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:19:08.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:08 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:19:08.375 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:19:08.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:08 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:19:08.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:08 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:19:08.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:08 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:19:08.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:08 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:19:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.862+0000 7f7e95cf1640 1 -- 172.21.15.59:0/3286341112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e901076a0 msgr2=0x7f7e90107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.862+0000 7f7e95cf1640 1 --2- 172.21.15.59:0/3286341112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e901076a0 0x7f7e90107ae0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009900 tx=0x7f7e8402a410 comp rx=0 tx=0).stop 2024-09-10T21:19:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.862+0000 7f7e95cf1640 1 -- 172.21.15.59:0/3286341112 shutdown_connections 2024-09-10T21:19:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.862+0000 7f7e95cf1640 1 --2- 172.21.15.59:0/3286341112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e90108020 0x7f7e9010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.862+0000 7f7e95cf1640 1 --2- 172.21.15.59:0/3286341112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e901076a0 0x7f7e90107ae0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.862+0000 7f7e95cf1640 1 --2- 172.21.15.59:0/3286341112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e90101c90 0x7f7e90102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.862+0000 7f7e95cf1640 1 -- 172.21.15.59:0/3286341112 >> 172.21.15.59:0/3286341112 conn(0x7f7e900fd700 msgr2=0x7f7e900ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.862+0000 7f7e95cf1640 1 -- 172.21.15.59:0/3286341112 shutdown_connections 2024-09-10T21:19:08.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.862+0000 7f7e95cf1640 1 -- 172.21.15.59:0/3286341112 wait complete. 2024-09-10T21:19:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.862+0000 7f7e95cf1640 1 Processor -- start 2024-09-10T21:19:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.863+0000 7f7e95cf1640 1 -- start start 2024-09-10T21:19:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.863+0000 7f7e95cf1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e90101c90 0x7f7e90199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.863+0000 7f7e95cf1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e901076a0 0x7f7e90199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.863+0000 7f7e95cf1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e90108020 0x7f7e9019ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.863+0000 7f7e95cf1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7e90111ce0 con 0x7f7e90101c90 2024-09-10T21:19:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.863+0000 7f7e95cf1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e90111b60 con 0x7f7e901076a0 2024-09-10T21:19:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.863+0000 7f7e95cf1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7e90111e60 con 0x7f7e90108020 2024-09-10T21:19:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.863+0000 7f7e8f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e90101c90 0x7f7e90199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.863+0000 7f7e8f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e90101c90 0x7f7e90199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35998/0 (socket says 172.21.15.59:35998) 2024-09-10T21:19:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.863+0000 7f7e8f7fe640 1 -- 172.21.15.59:0/1044335303 learned_addr learned my addr 172.21.15.59:0/1044335303 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.863+0000 7f7e8f7fe640 1 -- 172.21.15.59:0/1044335303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e90108020 msgr2=0x7f7e9019ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.863+0000 7f7e8f7fe640 1 --2- 172.21.15.59:0/1044335303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e90108020 0x7f7e9019ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.863+0000 7f7e8f7fe640 1 -- 172.21.15.59:0/1044335303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e901076a0 msgr2=0x7f7e90199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.863+0000 7f7e8effd640 1 --2- 172.21.15.59:0/1044335303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e901076a0 0x7f7e90199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.863+0000 7f7e8f7fe640 1 --2- 172.21.15.59:0/1044335303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e901076a0 0x7f7e90199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.863+0000 7f7e8f7fe640 1 -- 172.21.15.59:0/1044335303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e9019f400 con 0x7f7e90101c90 2024-09-10T21:19:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.863+0000 7f7e8f7fe640 1 --2- 172.21.15.59:0/1044335303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e90101c90 0x7f7e90199350 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000e9f0 tx=0x7f7e8000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.864+0000 7f7e8cff9640 1 -- 172.21.15.59:0/1044335303 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8000cd80 con 0x7f7e90101c90 2024-09-10T21:19:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.864+0000 7f7e95cf1640 1 -- 172.21.15.59:0/1044335303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e9019f6f0 con 0x7f7e90101c90 2024-09-10T21:19:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.864+0000 7f7e8cff9640 1 -- 172.21.15.59:0/1044335303 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e800054d0 con 0x7f7e90101c90 2024-09-10T21:19:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.864+0000 7f7e8cff9640 1 -- 172.21.15.59:0/1044335303 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e80010690 con 0x7f7e90101c90 2024-09-10T21:19:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.864+0000 7f7e95cf1640 1 -- 172.21.15.59:0/1044335303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e901a5db0 con 0x7f7e90101c90 2024-09-10T21:19:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.866+0000 7f7e8cff9640 1 -- 172.21.15.59:0/1044335303 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f7e80004e90 con 0x7f7e90101c90 2024-09-10T21:19:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.866+0000 7f7e980c6740 1 Processor -- start 2024-09-10T21:19:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.866+0000 7f7e980c6740 1 -- start start 2024-09-10T21:19:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.866+0000 7f7e980c6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60480 0x5647bce60860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.866+0000 7f7e980c6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60da0 0x5647bce70c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.867+0000 7f7e980c6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce71140 0x5647bce73530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.867+0000 7f7e980c6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5647bcdd6e50 con 0x5647bce60da0 2024-09-10T21:19:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.867+0000 7f7e980c6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5647bcdc6280 con 0x5647bce60480 2024-09-10T21:19:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.867+0000 7f7e980c6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5647bcdca090 con 0x5647bce71140 2024-09-10T21:19:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.867+0000 7f7e8f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60da0 0x5647bce70c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.867+0000 7f7e8f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60da0 0x5647bce70c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36004/0 (socket says 172.21.15.59:36004) 2024-09-10T21:19:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.867+0000 7f7e8f7fe640 1 -- 172.21.15.59:0/656900501 learned_addr learned my addr 172.21.15.59:0/656900501 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.867+0000 7f7e8ffff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60480 0x5647bce60860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.867+0000 7f7e8effd640 1 --2- 172.21.15.59:0/656900501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce71140 0x5647bce73530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.867+0000 7f7e8cff9640 1 --2- 172.21.15.59:0/1044335303 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7e780b52e0 0x7f7e780b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.867+0000 7f7e8f7fe640 1 -- 172.21.15.59:0/656900501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce71140 msgr2=0x5647bce73530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.867+0000 7f7e8f7fe640 1 --2- 172.21.15.59:0/656900501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce71140 0x5647bce73530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.867+0000 7f7e8f7fe640 1 -- 172.21.15.59:0/656900501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60480 msgr2=0x5647bce60860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.867+0000 7f7e8f7fe640 1 --2- 172.21.15.59:0/656900501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60480 0x5647bce60860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.867+0000 7f7e8f7fe640 1 -- 172.21.15.59:0/656900501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647bcb24650 con 0x5647bce60da0 2024-09-10T21:19:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.867+0000 7f7e8ffff640 1 --2- 172.21.15.59:0/1044335303 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7e780b52e0 0x7f7e780b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.867+0000 7f7e8cff9640 1 -- 172.21.15.59:0/1044335303 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7e800e6110 con 0x7f7e90101c90 2024-09-10T21:19:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.867+0000 7f7e8f7fe640 1 --2- 172.21.15.59:0/656900501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60da0 0x5647bce70c00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7e800cf540 tx=0x7f7e800dcd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43590d3609a8b9e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.868+0000 7f7e75ffb640 1 -- 172.21.15.59:0/656900501 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e800ac6d0 con 0x5647bce60da0 2024-09-10T21:19:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.868+0000 7f7e8ffff640 1 --2- 172.21.15.59:0/1044335303 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7e780b52e0 0x7f7e780b77a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7e88005fd0 tx=0x7f7e88004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.868+0000 7f7e75ffb640 1 -- 172.21.15.59:0/656900501 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e800cf380 con 0x5647bce60da0 2024-09-10T21:19:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.868+0000 7f7e75ffb640 1 -- 172.21.15.59:0/656900501 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e800c2220 con 0x5647bce60da0 2024-09-10T21:19:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.868+0000 7f7e980c6740 1 -- 172.21.15.59:0/656900501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60da0 msgr2=0x5647bce70c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.868+0000 7f7e980c6740 1 --2- 172.21.15.59:0/656900501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60da0 0x5647bce70c00 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7e800cf540 tx=0x7f7e800dcd70 comp rx=0 tx=0).stop 2024-09-10T21:19:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.868+0000 7f7e980c6740 1 -- 172.21.15.59:0/656900501 shutdown_connections 2024-09-10T21:19:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.868+0000 7f7e980c6740 1 --2- 172.21.15.59:0/656900501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce71140 0x5647bce73530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.868+0000 7f7e980c6740 1 --2- 172.21.15.59:0/656900501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60da0 0x5647bce70c00 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.868+0000 7f7e980c6740 1 --2- 172.21.15.59:0/656900501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60480 0x5647bce60860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.868+0000 7f7e980c6740 1 -- 172.21.15.59:0/656900501 >> 172.21.15.59:0/656900501 conn(0x5647bce5e2b0 msgr2=0x5647bce5f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.869+0000 7f7e980c6740 1 -- 172.21.15.59:0/656900501 shutdown_connections 2024-09-10T21:19:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.869+0000 7f7e980c6740 1 -- 172.21.15.59:0/656900501 wait complete. 2024-09-10T21:19:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.869+0000 7f7e980c6740 1 -- start start 2024-09-10T21:19:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.869+0000 7f7e980c6740 1 Processor -- start 2024-09-10T21:19:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.869+0000 7f7e980c6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce60480 0x5647bce70a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.869+0000 7f7e980c6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60da0 0x5647bce6de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.869+0000 7f7e980c6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce71140 0x5647bce6e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.869+0000 7f7e980c6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5647bcc27700 con 0x5647bce71140 2024-09-10T21:19:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.869+0000 7f7e980c6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5647bcd61110 con 0x5647bce60da0 2024-09-10T21:19:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.869+0000 7f7e980c6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5647bce73d90 con 0x5647bce60480 2024-09-10T21:19:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.870+0000 7f7e980c6740 10 client.0 _ll_register_callbacks cb 0x5647bcd7a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.870+0000 7f7e8ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce71140 0x5647bce6e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.870+0000 7f7e8ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce71140 0x5647bce6e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36020/0 (socket says 172.21.15.59:36020) 2024-09-10T21:19:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.870+0000 7f7e8ffff640 1 -- 172.21.15.59:0/1092218177 learned_addr learned my addr 172.21.15.59:0/1092218177 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.871+0000 7f7e8f7fe640 1 --2- 172.21.15.59:0/1092218177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce60480 0x5647bce70a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.871+0000 7f7e8effd640 1 --2- 172.21.15.59:0/1092218177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60da0 0x5647bce6de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.871+0000 7f7e8ffff640 1 -- 172.21.15.59:0/1092218177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce60480 msgr2=0x5647bce70a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.871+0000 7f7e8ffff640 1 --2- 172.21.15.59:0/1092218177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce60480 0x5647bce70a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.871+0000 7f7e8ffff640 1 -- 172.21.15.59:0/1092218177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60da0 msgr2=0x5647bce6de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.871+0000 7f7e8ffff640 1 --2- 172.21.15.59:0/1092218177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60da0 0x5647bce6de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.871+0000 7f7e8ffff640 1 -- 172.21.15.59:0/1092218177 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647bcd8ec40 con 0x5647bce71140 2024-09-10T21:19:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.871+0000 7f7e8f7fe640 1 --2- 172.21.15.59:0/1092218177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce60480 0x5647bce70a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.871+0000 7f7e8effd640 1 --2- 172.21.15.59:0/1092218177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60da0 0x5647bce6de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.871+0000 7f7e8ffff640 1 --2- 172.21.15.59:0/1092218177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce71140 0x5647bce6e430 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7e88012780 tx=0x7f7e88009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d185cafe0833ab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.871+0000 7f7e6effd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.871+0000 7f7e6effd640 1 -- 172.21.15.59:0/1092218177 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8801db70 con 0x5647bce71140 2024-09-10T21:19:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.871+0000 7f7e6effd640 1 -- 172.21.15.59:0/1092218177 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7e8801dd10 con 0x5647bce71140 2024-09-10T21:19:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.871+0000 7f7e980c6740 1 -- 172.21.15.59:0/1092218177 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5647bcdd8da0 con 0x5647bce71140 2024-09-10T21:19:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.871+0000 7f7e6effd640 1 -- 172.21.15.59:0/1092218177 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7e8801b450 con 0x5647bce71140 2024-09-10T21:19:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.871+0000 7f7e980c6740 10 client.16386 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.871+0000 7f7e980c6740 1 -- 172.21.15.59:0/1092218177 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5647bce7f6f0 con 0x5647bce71140 2024-09-10T21:19:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.872+0000 7f7e6effd640 1 -- 172.21.15.59:0/1092218177 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5647bcdd8da0 con 0x5647bce71140 2024-09-10T21:19:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.872+0000 7f7e6effd640 1 -- 172.21.15.59:0/1092218177 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7e88024070 con 0x5647bce71140 2024-09-10T21:19:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.872+0000 7f7e980c6740 10 client.16386 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.872+0000 7f7e980c6740 10 client.16386 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:19:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.872+0000 7f7e980c6740 20 client.16386 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.872+0000 7f7e980c6740 1 --2- 172.21.15.59:0/1092218177 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5647bce80c50 0x5647bce83040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.872+0000 7f7e980c6740 4 client.16386 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:19:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.872+0000 7f7e980c6740 1 -- 172.21.15.59:0/1092218177 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647bcdd4850 con 0x5647bce80c50 2024-09-10T21:19:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.872+0000 7f7e8f7fe640 1 --2- 172.21.15.59:0/1092218177 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5647bce80c50 0x5647bce83040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.873+0000 7f7e8f7fe640 1 --2- 172.21.15.59:0/1092218177 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5647bce80c50 0x5647bce83040 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=547d0931e7da9bb7 server_cookie=3a7f7e9d26a5f155 in_seq=0 out_seq=0 2024-09-10T21:19:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.873+0000 7f7e6effd640 10 client.16386 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.873+0000 7f7e6effd640 1 -- 172.21.15.59:0/1092218177 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f7e800bdf90 con 0x5647bce80c50 2024-09-10T21:19:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.873+0000 7f7e6effd640 10 client.16386 handle_command_reply: tid=0 2024-09-10T21:19:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.873+0000 7f7e980c6740 1 client.16386 shutdown 2024-09-10T21:19:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.874+0000 7f7e980c6740 1 -- 172.21.15.59:0/1092218177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce71140 msgr2=0x5647bce6e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.874+0000 7f7e980c6740 1 --2- 172.21.15.59:0/1092218177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce71140 0x5647bce6e430 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7e88012780 tx=0x7f7e88009590 comp rx=0 tx=0).stop 2024-09-10T21:19:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.874+0000 7f7e980c6740 1 -- 172.21.15.59:0/1092218177 shutdown_connections 2024-09-10T21:19:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.874+0000 7f7e980c6740 1 --2- 172.21.15.59:0/1092218177 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5647bce80c50 0x5647bce83040 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.874+0000 7f7e6effd640 0 client.16386 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.874+0000 7f7e980c6740 1 --2- 172.21.15.59:0/1092218177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce71140 0x5647bce6e430 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.874+0000 7f7e980c6740 1 --2- 172.21.15.59:0/1092218177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60da0 0x5647bce6de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.874+0000 7f7e980c6740 1 --2- 172.21.15.59:0/1092218177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce60480 0x5647bce70a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.874+0000 7f7e980c6740 1 -- 172.21.15.59:0/1092218177 >> 172.21.15.59:0/1092218177 conn(0x5647bce5e2b0 msgr2=0x5647bce63e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:08.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.874+0000 7f7e980c6740 1 -- 172.21.15.59:0/1092218177 shutdown_connections 2024-09-10T21:19:08.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.874+0000 7f7e980c6740 1 -- 172.21.15.59:0/1092218177 wait complete. 2024-09-10T21:19:08.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.874+0000 7f7e980c6740 20 client.16386 trim_cache size 0 max 16384 2024-09-10T21:19:08.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.891+0000 7f7e980c6740 1 Processor -- start 2024-09-10T21:19:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.891+0000 7f7e980c6740 1 -- start start 2024-09-10T21:19:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.891+0000 7f7e980c6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60480 0x5647bce7cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.891+0000 7f7e980c6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60da0 0x5647bce88930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.891+0000 7f7e980c6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce71140 0x5647bce88e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.891+0000 7f7e980c6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7e901ac190 con 0x5647bce60da0 2024-09-10T21:19:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.892+0000 7f7e980c6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e901adcd0 con 0x5647bce60480 2024-09-10T21:19:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.892+0000 7f7e980c6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7e901ac860 con 0x5647bce71140 2024-09-10T21:19:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.892+0000 7f7e8effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60da0 0x5647bce88930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.892+0000 7f7e8effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60da0 0x5647bce88930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36028/0 (socket says 172.21.15.59:36028) 2024-09-10T21:19:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.892+0000 7f7e8effd640 1 -- 172.21.15.59:0/2636461995 learned_addr learned my addr 172.21.15.59:0/2636461995 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.892+0000 7f7e8ffff640 1 --2- 172.21.15.59:0/2636461995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce71140 0x5647bce88e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.892+0000 7f7e8f7fe640 1 --2- 172.21.15.59:0/2636461995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60480 0x5647bce7cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.892+0000 7f7e8effd640 1 -- 172.21.15.59:0/2636461995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce71140 msgr2=0x5647bce88e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.892+0000 7f7e8effd640 1 --2- 172.21.15.59:0/2636461995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce71140 0x5647bce88e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.892+0000 7f7e8effd640 1 -- 172.21.15.59:0/2636461995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60480 msgr2=0x5647bce7cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.892+0000 7f7e8effd640 1 --2- 172.21.15.59:0/2636461995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60480 0x5647bce7cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.892+0000 7f7e8effd640 1 -- 172.21.15.59:0/2636461995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647bce5e0e0 con 0x5647bce60da0 2024-09-10T21:19:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.892+0000 7f7e8ffff640 1 --2- 172.21.15.59:0/2636461995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce71140 0x5647bce88e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.892+0000 7f7e8effd640 1 --2- 172.21.15.59:0/2636461995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60da0 0x5647bce88930 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f7e84005c40 tx=0x7f7e84032bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59e3167d304f57d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.892+0000 7f7e757fa640 1 -- 172.21.15.59:0/2636461995 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e84035040 con 0x5647bce60da0 2024-09-10T21:19:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.892+0000 7f7e757fa640 1 -- 172.21.15.59:0/2636461995 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e840316a0 con 0x5647bce60da0 2024-09-10T21:19:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.892+0000 7f7e757fa640 1 -- 172.21.15.59:0/2636461995 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e84005620 con 0x5647bce60da0 2024-09-10T21:19:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.893+0000 7f7e980c6740 1 -- 172.21.15.59:0/2636461995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60da0 msgr2=0x5647bce88930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.893+0000 7f7e980c6740 1 --2- 172.21.15.59:0/2636461995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60da0 0x5647bce88930 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f7e84005c40 tx=0x7f7e84032bf0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.893+0000 7f7e980c6740 1 -- 172.21.15.59:0/2636461995 shutdown_connections 2024-09-10T21:19:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.893+0000 7f7e980c6740 1 --2- 172.21.15.59:0/2636461995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce71140 0x5647bce88e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.893+0000 7f7e980c6740 1 --2- 172.21.15.59:0/2636461995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60da0 0x5647bce88930 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.893+0000 7f7e980c6740 1 --2- 172.21.15.59:0/2636461995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60480 0x5647bce7cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.893+0000 7f7e980c6740 1 -- 172.21.15.59:0/2636461995 >> 172.21.15.59:0/2636461995 conn(0x5647bce5e2b0 msgr2=0x5647bce5f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.893+0000 7f7e980c6740 1 -- 172.21.15.59:0/2636461995 shutdown_connections 2024-09-10T21:19:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.893+0000 7f7e980c6740 1 -- 172.21.15.59:0/2636461995 wait complete. 2024-09-10T21:19:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.894+0000 7f7e980c6740 1 -- start start 2024-09-10T21:19:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.894+0000 7f7e980c6740 1 Processor -- start 2024-09-10T21:19:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.894+0000 7f7e980c6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60480 0x5647bce79360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.894+0000 7f7e980c6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60da0 0x5647bce798e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.894+0000 7f7e980c6740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce71140 0x5647bce760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.894+0000 7f7e980c6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7e901ad600 con 0x5647bce60480 2024-09-10T21:19:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.894+0000 7f7e980c6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e901acf30 con 0x5647bce60da0 2024-09-10T21:19:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.894+0000 7f7e980c6740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7e901aa170 con 0x5647bce71140 2024-09-10T21:19:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.894+0000 7f7e980c6740 10 client.0 _ll_register_callbacks cb 0x7f7e88009940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.894+0000 7f7e8f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60480 0x5647bce79360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.894+0000 7f7e8f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60480 0x5647bce79360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36032/0 (socket says 172.21.15.59:36032) 2024-09-10T21:19:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.894+0000 7f7e8f7fe640 1 -- 172.21.15.59:0/1975940759 learned_addr learned my addr 172.21.15.59:0/1975940759 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.894+0000 7f7e8f7fe640 1 -- 172.21.15.59:0/1975940759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce71140 msgr2=0x5647bce760c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.894+0000 7f7e8f7fe640 1 --2- 172.21.15.59:0/1975940759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce71140 0x5647bce760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.894+0000 7f7e8f7fe640 1 -- 172.21.15.59:0/1975940759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60da0 msgr2=0x5647bce798e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.894+0000 7f7e8effd640 1 --2- 172.21.15.59:0/1975940759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60da0 0x5647bce798e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.895+0000 7f7e8f7fe640 1 --2- 172.21.15.59:0/1975940759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60da0 0x5647bce798e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.895+0000 7f7e8f7fe640 1 -- 172.21.15.59:0/1975940759 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647bce768f0 con 0x5647bce60480 2024-09-10T21:19:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.895+0000 7f7e8f7fe640 1 --2- 172.21.15.59:0/1975940759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60480 0x5647bce79360 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f7e800ac890 tx=0x7f7e800e9d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353d58e7483ae354 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.895+0000 7f7e6effd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.895+0000 7f7e6effd640 1 -- 172.21.15.59:0/1975940759 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e800ac070 con 0x5647bce60480 2024-09-10T21:19:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.895+0000 7f7e6effd640 1 -- 172.21.15.59:0/1975940759 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7e800c20e0 con 0x5647bce60480 2024-09-10T21:19:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.895+0000 7f7e980c6740 1 -- 172.21.15.59:0/1975940759 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e840316a0 con 0x5647bce60480 2024-09-10T21:19:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.895+0000 7f7e6effd640 1 -- 172.21.15.59:0/1975940759 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7e800ac250 con 0x5647bce60480 2024-09-10T21:19:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.895+0000 7f7e980c6740 10 client.16392 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.895+0000 7f7e980c6740 1 -- 172.21.15.59:0/1975940759 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5647bceee750 con 0x5647bce60480 2024-09-10T21:19:08.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.895+0000 7f7e6effd640 1 -- 172.21.15.59:0/1975940759 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e840316a0 con 0x5647bce60480 2024-09-10T21:19:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.895+0000 7f7e6effd640 1 -- 172.21.15.59:0/1975940759 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7e800051b0 con 0x5647bce60480 2024-09-10T21:19:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.895+0000 7f7e980c6740 10 client.16392 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.895+0000 7f7e980c6740 10 client.16392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:19:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.895+0000 7f7e980c6740 20 client.16392 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.895+0000 7f7e980c6740 1 --2- 172.21.15.59:0/1975940759 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5647bce80c50 0x5647bcef0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.896+0000 7f7e980c6740 4 client.16392 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:19:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.896+0000 7f7e980c6740 1 -- 172.21.15.59:0/1975940759 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5647bcdd1c80 con 0x5647bce80c50 2024-09-10T21:19:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.896+0000 7f7e8effd640 1 --2- 172.21.15.59:0/1975940759 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5647bce80c50 0x5647bcef0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.896+0000 7f7e6effd640 10 client.16392 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.896+0000 7f7e8effd640 1 --2- 172.21.15.59:0/1975940759 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5647bce80c50 0x5647bcef0ac0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d48eafca7557ef4 server_cookie=8dc28de908dd9d4e in_seq=0 out_seq=0 2024-09-10T21:19:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.896+0000 7f7e6effd640 1 -- 172.21.15.59:0/1975940759 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x5647bcdd1c80 con 0x5647bce80c50 2024-09-10T21:19:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.896+0000 7f7e6effd640 10 client.16392 handle_command_reply: tid=0 2024-09-10T21:19:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.896+0000 7f7e980c6740 1 client.16392 shutdown 2024-09-10T21:19:08.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e980c6740 1 -- 172.21.15.59:0/1975940759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60480 msgr2=0x5647bce79360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:08.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e980c6740 1 --2- 172.21.15.59:0/1975940759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60480 0x5647bce79360 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f7e800ac890 tx=0x7f7e800e9d20 comp rx=0 tx=0).stop 2024-09-10T21:19:08.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e980c6740 1 -- 172.21.15.59:0/1975940759 shutdown_connections 2024-09-10T21:19:08.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e980c6740 1 --2- 172.21.15.59:0/1975940759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5647bce71140 0x5647bce760c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e980c6740 1 --2- 172.21.15.59:0/1975940759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647bce60da0 0x5647bce798e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e980c6740 1 --2- 172.21.15.59:0/1975940759 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5647bce80c50 0x5647bcef0ac0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e980c6740 1 --2- 172.21.15.59:0/1975940759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647bce60480 0x5647bce79360 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e980c6740 1 -- 172.21.15.59:0/1975940759 >> 172.21.15.59:0/1975940759 conn(0x5647bce5e2b0 msgr2=0x5647bce6f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:08.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e6effd640 0 client.16392 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:08.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e980c6740 1 -- 172.21.15.59:0/1975940759 shutdown_connections 2024-09-10T21:19:08.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e980c6740 1 -- 172.21.15.59:0/1975940759 wait complete. 2024-09-10T21:19:08.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e980c6740 20 client.16392 trim_cache size 0 max 16384 2024-09-10T21:19:08.906 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:19:08.906 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:19:08.906 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-09-10T21:19:08.906 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:19:08.906 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:08.906 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "aa7d3145-fc16-4c86-b6cd-995ce03e73a9", 2024-09-10T21:19:08.906 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2024-09-10T21:19:08.906 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:19:08.906 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:08.906 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:19:08.906 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:19:08.906 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:19:08.907 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:08.907 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:08.907 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:08.907 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:08.907 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:08.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:08.907 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:19:08.907 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:19:08.907 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:08.907 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:08.907 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:08.907 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:08.907 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:08.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:08.908 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:19:08.908 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:19:08.908 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:08.908 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:08.908 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:08.908 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:08.908 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:08.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:08.908 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:19:08.908 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:19:08.908 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:08.908 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:08.908 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:08.909 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:08.909 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:08.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:08.909 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:19:08.909 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:19:08.909 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:08.909 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:08.909 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:08.909 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:08.909 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:08.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:08.909 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:19:08.909 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:19:08.909 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:08.910 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:08.910 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:08.910 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:08.910 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:08.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:08.910 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:19:08.910 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:19:08.910 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:08.910 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:08.910 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:08.910 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:08.910 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:08.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:08.910 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:19:08.910 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:19:08.911 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:08.911 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:08.911 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:08.911 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:08.911 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:08.911 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:19:08.911 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:19:08.911 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:19:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e95cf1640 1 -- 172.21.15.59:0/1044335303 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7e780b52e0 msgr2=0x7f7e780b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e95cf1640 1 --2- 172.21.15.59:0/1044335303 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7e780b52e0 0x7f7e780b77a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7e88005fd0 tx=0x7f7e88004a40 comp rx=0 tx=0).stop 2024-09-10T21:19:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e95cf1640 1 -- 172.21.15.59:0/1044335303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e90101c90 msgr2=0x7f7e90199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e95cf1640 1 --2- 172.21.15.59:0/1044335303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e90101c90 0x7f7e90199350 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000e9f0 tx=0x7f7e8000edf0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e95cf1640 1 -- 172.21.15.59:0/1044335303 shutdown_connections 2024-09-10T21:19:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e95cf1640 1 --2- 172.21.15.59:0/1044335303 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7e780b52e0 0x7f7e780b77a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e95cf1640 1 --2- 172.21.15.59:0/1044335303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e90108020 0x7f7e9019ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e95cf1640 1 --2- 172.21.15.59:0/1044335303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e901076a0 0x7f7e90199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.897+0000 7f7e95cf1640 1 --2- 172.21.15.59:0/1044335303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e90101c90 0x7f7e90199350 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.898+0000 7f7e95cf1640 1 -- 172.21.15.59:0/1044335303 >> 172.21.15.59:0/1044335303 conn(0x7f7e900fd700 msgr2=0x7f7e9006adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:08.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.898+0000 7f7e95cf1640 1 -- 172.21.15.59:0/1044335303 shutdown_connections 2024-09-10T21:19:08.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:08.898+0000 7f7e95cf1640 1 -- 172.21.15.59:0/1044335303 wait complete. 2024-09-10T21:19:09.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:09 smithi192 ceph-mon[35363]: pgmap v456: 97 pgs: 97 active+clean; 2.6 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:19:09.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:09 smithi059 ceph-mon[30888]: pgmap v456: 97 pgs: 97 active+clean; 2.6 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:19:09.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:09 smithi154 ceph-mon[35041]: pgmap v456: 97 pgs: 97 active+clean; 2.6 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:19:09.573 INFO:tasks.cephfs.filesystem:scrub status for tag:aa7d3145-fc16-4c86-b6cd-995ce03e73a9 - {'path': '/', 'tag': 'aa7d3145-fc16-4c86-b6cd-995ce03e73a9', 'options': 'recursive,force'} 2024-09-10T21:19:10.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:10 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:19:10.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:10 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:19:10.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:10 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:19:11.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:11 smithi192 ceph-mon[35363]: pgmap v457: 97 pgs: 97 active+clean; 2.6 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:11.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:11 smithi059 ceph-mon[30888]: pgmap v457: 97 pgs: 97 active+clean; 2.6 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:11.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:11 smithi154 ceph-mon[35041]: pgmap v457: 97 pgs: 97 active+clean; 2.6 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:13.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:13 smithi192 ceph-mon[35363]: pgmap v458: 97 pgs: 97 active+clean; 2.7 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:19:13.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:13 smithi059 ceph-mon[30888]: pgmap v458: 97 pgs: 97 active+clean; 2.7 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:19:13.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:13 smithi154 ceph-mon[35041]: pgmap v458: 97 pgs: 97 active+clean; 2.7 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:19:15.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:15 smithi192 ceph-mon[35363]: pgmap v459: 97 pgs: 97 active+clean; 2.7 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:15.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:15 smithi059 ceph-mon[30888]: pgmap v459: 97 pgs: 97 active+clean; 2.7 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:15.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:15 smithi154 ceph-mon[35041]: pgmap v459: 97 pgs: 97 active+clean; 2.7 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:17.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:17 smithi192 ceph-mon[35363]: pgmap v460: 97 pgs: 97 active+clean; 2.7 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:19:17.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:17 smithi059 ceph-mon[30888]: pgmap v460: 97 pgs: 97 active+clean; 2.7 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:19:17.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:17 smithi154 ceph-mon[35041]: pgmap v460: 97 pgs: 97 active+clean; 2.7 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:19:19.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:19 smithi192 ceph-mon[35363]: pgmap v461: 97 pgs: 97 active+clean; 2.7 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:19:19.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:19 smithi059 ceph-mon[30888]: pgmap v461: 97 pgs: 97 active+clean; 2.7 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:19:19.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:19 smithi154 ceph-mon[35041]: pgmap v461: 97 pgs: 97 active+clean; 2.7 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:19:21.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:21 smithi192 ceph-mon[35363]: pgmap v462: 97 pgs: 97 active+clean; 2.7 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:21.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:21 smithi059 ceph-mon[30888]: pgmap v462: 97 pgs: 97 active+clean; 2.7 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:21.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:21 smithi154 ceph-mon[35041]: pgmap v462: 97 pgs: 97 active+clean; 2.7 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:23.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:23 smithi192 ceph-mon[35363]: pgmap v463: 97 pgs: 97 active+clean; 2.8 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:19:23.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:23 smithi059 ceph-mon[30888]: pgmap v463: 97 pgs: 97 active+clean; 2.8 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:19:23.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:23 smithi154 ceph-mon[35041]: pgmap v463: 97 pgs: 97 active+clean; 2.8 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:19:24.921 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.921 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.921 INFO:tasks.workunit.client.0.smithi059.stdout:127/600: open fd = 3 2024-09-10T21:19:24.921 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.921 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.921 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.921 INFO:tasks.workunit.client.0.smithi059.stdout:128/600: open fd = 3 2024-09-10T21:19:24.922 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.922 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.922 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.922 INFO:tasks.workunit.client.0.smithi059.stdout:129/600: open fd = 3 2024-09-10T21:19:24.922 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.922 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.922 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.922 INFO:tasks.workunit.client.0.smithi059.stdout:130/600: open fd = 3 2024-09-10T21:19:24.922 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.922 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.922 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.922 INFO:tasks.workunit.client.0.smithi059.stdout:131/600: open fd = 3 2024-09-10T21:19:24.922 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.923 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.923 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.923 INFO:tasks.workunit.client.0.smithi059.stdout:132/600: open fd = 3 2024-09-10T21:19:24.923 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.923 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.923 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.923 INFO:tasks.workunit.client.0.smithi059.stdout:133/600: open fd = 3 2024-09-10T21:19:24.923 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.923 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.923 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.923 INFO:tasks.workunit.client.0.smithi059.stdout:134/600: open fd = 3 2024-09-10T21:19:24.923 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.923 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.923 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.924 INFO:tasks.workunit.client.0.smithi059.stdout:135/600: open fd = 3 2024-09-10T21:19:24.924 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.924 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.924 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.924 INFO:tasks.workunit.client.0.smithi059.stdout:136/600: open fd = 3 2024-09-10T21:19:24.924 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.924 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.924 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.924 INFO:tasks.workunit.client.0.smithi059.stdout:137/600: open fd = 3 2024-09-10T21:19:24.924 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.924 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.924 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.924 INFO:tasks.workunit.client.0.smithi059.stdout:138/600: open fd = 3 2024-09-10T21:19:24.925 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.925 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.925 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.925 INFO:tasks.workunit.client.0.smithi059.stdout:139/600: open fd = 3 2024-09-10T21:19:24.925 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.925 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.925 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.925 INFO:tasks.workunit.client.0.smithi059.stdout:140/600: open fd = 3 2024-09-10T21:19:24.925 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.925 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.925 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.925 INFO:tasks.workunit.client.0.smithi059.stdout:141/600: open fd = 3 2024-09-10T21:19:24.925 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.925 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.926 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.926 INFO:tasks.workunit.client.0.smithi059.stdout:142/600: open fd = 3 2024-09-10T21:19:24.926 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.926 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.926 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.926 INFO:tasks.workunit.client.0.smithi059.stdout:143/600: open fd = 3 2024-09-10T21:19:24.926 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.926 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.926 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.926 INFO:tasks.workunit.client.0.smithi059.stdout:144/600: open fd = 3 2024-09-10T21:19:24.926 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.926 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.926 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.927 INFO:tasks.workunit.client.0.smithi059.stdout:145/600: open fd = 3 2024-09-10T21:19:24.927 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.927 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.927 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.927 INFO:tasks.workunit.client.0.smithi059.stdout:146/600: open fd = 3 2024-09-10T21:19:24.927 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.927 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.927 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.927 INFO:tasks.workunit.client.0.smithi059.stdout:147/600: open fd = 3 2024-09-10T21:19:24.927 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.927 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.927 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.927 INFO:tasks.workunit.client.0.smithi059.stdout:148/600: open fd = 3 2024-09-10T21:19:24.928 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.928 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.928 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.928 INFO:tasks.workunit.client.0.smithi059.stdout:149/600: open fd = 3 2024-09-10T21:19:24.928 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.928 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.928 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.928 INFO:tasks.workunit.client.0.smithi059.stdout:150/600: open fd = 3 2024-09-10T21:19:24.928 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.928 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.928 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.928 INFO:tasks.workunit.client.0.smithi059.stdout:151/600: open fd = 3 2024-09-10T21:19:24.928 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.928 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.929 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.929 INFO:tasks.workunit.client.0.smithi059.stdout:152/600: open fd = 3 2024-09-10T21:19:24.929 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.929 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.929 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.929 INFO:tasks.workunit.client.0.smithi059.stdout:153/600: open fd = 3 2024-09-10T21:19:24.929 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.929 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.929 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.929 INFO:tasks.workunit.client.0.smithi059.stdout:154/600: open fd = 3 2024-09-10T21:19:24.929 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.929 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.929 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.930 INFO:tasks.workunit.client.0.smithi059.stdout:155/600: open fd = 3 2024-09-10T21:19:24.930 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.930 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.930 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.930 INFO:tasks.workunit.client.0.smithi059.stdout:156/600: open fd = 3 2024-09-10T21:19:24.930 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.930 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.930 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.930 INFO:tasks.workunit.client.0.smithi059.stdout:157/600: open fd = 3 2024-09-10T21:19:24.930 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.930 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.930 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.930 INFO:tasks.workunit.client.0.smithi059.stdout:158/600: open fd = 3 2024-09-10T21:19:24.931 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.931 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.931 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.931 INFO:tasks.workunit.client.0.smithi059.stdout:159/600: open fd = 3 2024-09-10T21:19:24.931 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.931 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.931 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.931 INFO:tasks.workunit.client.0.smithi059.stdout:160/600: open fd = 3 2024-09-10T21:19:24.931 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.931 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.931 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.931 INFO:tasks.workunit.client.0.smithi059.stdout:161/600: open fd = 3 2024-09-10T21:19:24.931 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.932 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.932 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.932 INFO:tasks.workunit.client.0.smithi059.stdout:162/600: open fd = 3 2024-09-10T21:19:24.932 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.932 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.932 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.932 INFO:tasks.workunit.client.0.smithi059.stdout:163/600: open fd = 3 2024-09-10T21:19:24.932 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.932 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.932 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.932 INFO:tasks.workunit.client.0.smithi059.stdout:164/600: open fd = 3 2024-09-10T21:19:24.932 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.932 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.932 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.933 INFO:tasks.workunit.client.0.smithi059.stdout:165/600: open fd = 3 2024-09-10T21:19:24.933 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.933 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.933 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.933 INFO:tasks.workunit.client.0.smithi059.stdout:166/600: open fd = 3 2024-09-10T21:19:24.933 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.933 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.933 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.933 INFO:tasks.workunit.client.0.smithi059.stdout:167/600: open fd = 3 2024-09-10T21:19:24.933 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.933 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.933 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.933 INFO:tasks.workunit.client.0.smithi059.stdout:168/600: open fd = 3 2024-09-10T21:19:24.933 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.934 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.934 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.934 INFO:tasks.workunit.client.0.smithi059.stdout:169/600: open fd = 3 2024-09-10T21:19:24.934 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.934 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.934 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.934 INFO:tasks.workunit.client.0.smithi059.stdout:170/600: open fd = 3 2024-09-10T21:19:24.934 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.934 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.934 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.934 INFO:tasks.workunit.client.0.smithi059.stdout:171/600: open fd = 3 2024-09-10T21:19:24.934 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.934 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.935 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.935 INFO:tasks.workunit.client.0.smithi059.stdout:172/600: open fd = 3 2024-09-10T21:19:24.935 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.935 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.935 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.935 INFO:tasks.workunit.client.0.smithi059.stdout:173/600: open fd = 3 2024-09-10T21:19:24.935 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.935 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.935 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.935 INFO:tasks.workunit.client.0.smithi059.stdout:174/600: open fd = 3 2024-09-10T21:19:24.935 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.935 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.935 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.935 INFO:tasks.workunit.client.0.smithi059.stdout:175/600: open fd = 3 2024-09-10T21:19:24.936 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.936 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.936 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.936 INFO:tasks.workunit.client.0.smithi059.stdout:176/600: open fd = 3 2024-09-10T21:19:24.936 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.936 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.936 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.936 INFO:tasks.workunit.client.0.smithi059.stdout:177/600: open fd = 3 2024-09-10T21:19:24.936 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.936 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.937 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.937 INFO:tasks.workunit.client.0.smithi059.stdout:178/600: open fd = 3 2024-09-10T21:19:24.937 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.937 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.937 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.937 INFO:tasks.workunit.client.0.smithi059.stdout:179/600: open fd = 3 2024-09-10T21:19:24.937 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.937 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.937 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.937 INFO:tasks.workunit.client.0.smithi059.stdout:180/600: open fd = 3 2024-09-10T21:19:24.937 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.938 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.938 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.938 INFO:tasks.workunit.client.0.smithi059.stdout:181/600: open fd = 3 2024-09-10T21:19:24.938 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.938 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.938 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.938 INFO:tasks.workunit.client.0.smithi059.stdout:182/600: open fd = 3 2024-09-10T21:19:24.938 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.938 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.938 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.938 INFO:tasks.workunit.client.0.smithi059.stdout:183/600: open fd = 3 2024-09-10T21:19:24.938 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.938 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.939 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.939 INFO:tasks.workunit.client.0.smithi059.stdout:184/600: open fd = 3 2024-09-10T21:19:24.939 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.939 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.939 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.939 INFO:tasks.workunit.client.0.smithi059.stdout:185/600: open fd = 3 2024-09-10T21:19:24.939 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.939 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.939 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.939 INFO:tasks.workunit.client.0.smithi059.stdout:186/600: open fd = 3 2024-09-10T21:19:24.939 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.939 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.939 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.940 INFO:tasks.workunit.client.0.smithi059.stdout:187/600: open fd = 3 2024-09-10T21:19:24.940 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.940 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.940 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:19:24.940 INFO:tasks.workunit.client.0.smithi059.stdout:188/600: open fd = 3 2024-09-10T21:19:24.940 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:24.940 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:19:25.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:25 smithi192 ceph-mon[35363]: pgmap v464: 97 pgs: 97 active+clean; 2.8 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:19:25.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:25 smithi059 ceph-mon[30888]: pgmap v464: 97 pgs: 97 active+clean; 2.8 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:19:25.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:25 smithi154 ceph-mon[35041]: pgmap v464: 97 pgs: 97 active+clean; 2.8 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:19:27.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:27 smithi192 ceph-mon[35363]: pgmap v465: 97 pgs: 97 active+clean; 2.8 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-10T21:19:27.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:27 smithi059 ceph-mon[30888]: pgmap v465: 97 pgs: 97 active+clean; 2.8 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-10T21:19:27.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:27 smithi154 ceph-mon[35041]: pgmap v465: 97 pgs: 97 active+clean; 2.8 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-10T21:19:29.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:29 smithi059 ceph-mon[30888]: pgmap v466: 97 pgs: 97 active+clean; 2.8 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:19:29.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:29 smithi154 ceph-mon[35041]: pgmap v466: 97 pgs: 97 active+clean; 2.8 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:19:29.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:29 smithi192 ceph-mon[35363]: pgmap v466: 97 pgs: 97 active+clean; 2.8 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:19:30.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:30 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:19:30.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:30 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:19:30.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:30 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:19:30.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:30 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:19:30.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:30 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:19:30.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:30 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:19:30.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:30 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:19:30.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:30 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:19:30.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:30 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:19:30.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:30 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:19:30.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:30 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:19:30.578 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:30 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:19:31.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:31 smithi059 ceph-mon[30888]: pgmap v467: 97 pgs: 97 active+clean; 2.8 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:19:31.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:31 smithi154 ceph-mon[35041]: pgmap v467: 97 pgs: 97 active+clean; 2.8 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:19:31.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:31 smithi192 ceph-mon[35363]: pgmap v467: 97 pgs: 97 active+clean; 2.8 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:19:33.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:33 smithi059 ceph-mon[30888]: pgmap v468: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 16 op/s 2024-09-10T21:19:33.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:33 smithi154 ceph-mon[35041]: pgmap v468: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 16 op/s 2024-09-10T21:19:33.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:33 smithi192 ceph-mon[35363]: pgmap v468: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 16 op/s 2024-09-10T21:19:35.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:35 smithi059 ceph-mon[30888]: pgmap v469: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:35.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:35 smithi154 ceph-mon[35041]: pgmap v469: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:35.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:35 smithi192 ceph-mon[35363]: pgmap v469: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:36.411 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:36 smithi059 ceph-mon[30888]: pgmap v470: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:19:36.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:36 smithi154 ceph-mon[35041]: pgmap v470: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:19:36.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:36 smithi192 ceph-mon[35363]: pgmap v470: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:19:38.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:38 smithi059 ceph-mon[30888]: pgmap v471: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:19:38.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:38 smithi154 ceph-mon[35041]: pgmap v471: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:19:38.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:38 smithi192 ceph-mon[35363]: pgmap v471: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:19:39.575 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:19:39.853 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:19:40.495 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:40 smithi059 ceph-mon[30888]: pgmap v472: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:40.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.490+0000 7fcfd021e640 1 -- 172.21.15.59:0/1101578475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfc8101830 msgr2=0x7fcfc8101c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:40.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.490+0000 7fcfd021e640 1 --2- 172.21.15.59:0/1101578475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfc8101830 0x7fcfc8101c10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4009900 tx=0x7fcfc402a480 comp rx=0 tx=0).stop 2024-09-10T21:19:40.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.490+0000 7fcfd021e640 1 -- 172.21.15.59:0/1101578475 shutdown_connections 2024-09-10T21:19:40.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.490+0000 7fcfd021e640 1 --2- 172.21.15.59:0/1101578475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfc810f3e0 0x7fcfc81117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.490+0000 7fcfd021e640 1 --2- 172.21.15.59:0/1101578475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfc8102150 0x7fcfc810eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.490+0000 7fcfd021e640 1 --2- 172.21.15.59:0/1101578475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfc8101830 0x7fcfc8101c10 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.490+0000 7fcfd021e640 1 -- 172.21.15.59:0/1101578475 >> 172.21.15.59:0/1101578475 conn(0x7fcfc80fd700 msgr2=0x7fcfc80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:40.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.490+0000 7fcfd021e640 1 -- 172.21.15.59:0/1101578475 shutdown_connections 2024-09-10T21:19:40.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.490+0000 7fcfd021e640 1 -- 172.21.15.59:0/1101578475 wait complete. 2024-09-10T21:19:40.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.490+0000 7fcfd021e640 1 Processor -- start 2024-09-10T21:19:40.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.491+0000 7fcfd021e640 1 -- start start 2024-09-10T21:19:40.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.491+0000 7fcfd021e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfc8101830 0x7fcfc819b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:40.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.491+0000 7fcfd021e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfc8102150 0x7fcfc819b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:40.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.491+0000 7fcfd021e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfc810f3e0 0x7fcfc81a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:40.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.491+0000 7fcfd021e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc8114f50 con 0x7fcfc810f3e0 2024-09-10T21:19:40.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.491+0000 7fcfd021e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc8114dd0 con 0x7fcfc8102150 2024-09-10T21:19:40.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.491+0000 7fcfd021e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc81150d0 con 0x7fcfc8101830 2024-09-10T21:19:40.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.491+0000 7fcfce7bb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfc810f3e0 0x7fcfc81a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:40.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.491+0000 7fcfce7bb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfc810f3e0 0x7fcfc81a0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37572/0 (socket says 172.21.15.59:37572) 2024-09-10T21:19:40.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.491+0000 7fcfce7bb640 1 -- 172.21.15.59:0/3656346828 learned_addr learned my addr 172.21.15.59:0/3656346828 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:40.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.491+0000 7fcfcdfba640 1 --2- 172.21.15.59:0/3656346828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfc8101830 0x7fcfc819b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:40.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.491+0000 7fcfcd7b9640 1 --2- 172.21.15.59:0/3656346828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfc8102150 0x7fcfc819b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:40.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.491+0000 7fcfce7bb640 1 -- 172.21.15.59:0/3656346828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfc8101830 msgr2=0x7fcfc819b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:40.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.491+0000 7fcfce7bb640 1 --2- 172.21.15.59:0/3656346828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfc8101830 0x7fcfc819b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.491+0000 7fcfce7bb640 1 -- 172.21.15.59:0/3656346828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfc8102150 msgr2=0x7fcfc819b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:40.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.491+0000 7fcfce7bb640 1 --2- 172.21.15.59:0/3656346828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfc8102150 0x7fcfc819b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.491+0000 7fcfce7bb640 1 -- 172.21.15.59:0/3656346828 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc81a1550 con 0x7fcfc810f3e0 2024-09-10T21:19:40.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.491+0000 7fcfcdfba640 1 --2- 172.21.15.59:0/3656346828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfc8101830 0x7fcfc819b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:40.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.491+0000 7fcfcd7b9640 1 --2- 172.21.15.59:0/3656346828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfc8102150 0x7fcfc819b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:40.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.492+0000 7fcfce7bb640 1 --2- 172.21.15.59:0/3656346828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfc810f3e0 0x7fcfc81a0d80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000eb10 tx=0x7fcfc000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:40.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.492+0000 7fcfbeffd640 1 -- 172.21.15.59:0/3656346828 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0004b20 con 0x7fcfc810f3e0 2024-09-10T21:19:40.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.492+0000 7fcfbeffd640 1 -- 172.21.15.59:0/3656346828 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfc0004cc0 con 0x7fcfc810f3e0 2024-09-10T21:19:40.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.492+0000 7fcfd021e640 1 -- 172.21.15.59:0/3656346828 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc81a1840 con 0x7fcfc810f3e0 2024-09-10T21:19:40.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.492+0000 7fcfbeffd640 1 -- 172.21.15.59:0/3656346828 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0010670 con 0x7fcfc810f3e0 2024-09-10T21:19:40.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.492+0000 7fcfd021e640 1 -- 172.21.15.59:0/3656346828 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc81a7f00 con 0x7fcfc810f3e0 2024-09-10T21:19:40.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.494+0000 7fcfd25f3740 1 Processor -- start 2024-09-10T21:19:40.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.495+0000 7fcfbeffd640 1 -- 172.21.15.59:0/3656346828 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fcfc0005020 con 0x7fcfc810f3e0 2024-09-10T21:19:40.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.495+0000 7fcfd25f3740 1 -- start start 2024-09-10T21:19:40.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.495+0000 7fcfd25f3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f60a0 0x561b3f3f6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:40.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.495+0000 7fcfd25f3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f69c0 0x561b3f402410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:40.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.495+0000 7fcfd25f3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f404d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:40.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.495+0000 7fcfd25f3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561b3f36ce50 con 0x561b3f402950 2024-09-10T21:19:40.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.495+0000 7fcfd25f3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561b3f35c280 con 0x561b3f3f69c0 2024-09-10T21:19:40.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.495+0000 7fcfd25f3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561b3f360090 con 0x561b3f3f60a0 2024-09-10T21:19:40.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.495+0000 7fcfcd7b9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f404d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:40.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.495+0000 7fcfcd7b9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f404d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37586/0 (socket says 172.21.15.59:37586) 2024-09-10T21:19:40.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.495+0000 7fcfcd7b9640 1 -- 172.21.15.59:0/394389224 learned_addr learned my addr 172.21.15.59:0/394389224 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:40.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.495+0000 7fcfcd7b9640 1 --2- 172.21.15.59:0/394389224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f60a0 0x561b3f3f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:40.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.495+0000 7fcfcdfba640 1 --2- 172.21.15.59:0/394389224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f69c0 0x561b3f402410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:40.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.496+0000 7fcfbeffd640 1 --2- 172.21.15.59:0/3656346828 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcfb40b52e0 0x7fcfb40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:40.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.496+0000 7fcfcd7b9640 1 -- 172.21.15.59:0/394389224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f60a0 msgr2=0x561b3f3f6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:40.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.496+0000 7fcfcd7b9640 1 --2- 172.21.15.59:0/394389224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f60a0 0x561b3f3f6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.496+0000 7fcfcd7b9640 1 -- 172.21.15.59:0/394389224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f69c0 msgr2=0x561b3f402410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:40.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.496+0000 7fcfcd7b9640 1 --2- 172.21.15.59:0/394389224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f69c0 0x561b3f402410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.496+0000 7fcfcd7b9640 1 -- 172.21.15.59:0/394389224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b3f0ba650 con 0x561b3f402950 2024-09-10T21:19:40.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.496+0000 7fcfce7bb640 1 --2- 172.21.15.59:0/3656346828 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcfb40b52e0 0x7fcfb40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:40.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.496+0000 7fcfcd7b9640 1 --2- 172.21.15.59:0/394389224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f404d40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009f70 tx=0x7fcfb8009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879fc2f374f34b8c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:40.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.496+0000 7fcfbeffd640 1 -- 172.21.15.59:0/3656346828 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcfc00e62c0 con 0x7fcfc810f3e0 2024-09-10T21:19:40.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.496+0000 7fcfb3fff640 1 -- 172.21.15.59:0/394389224 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8019070 con 0x561b3f402950 2024-09-10T21:19:40.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.496+0000 7fcfb3fff640 1 -- 172.21.15.59:0/394389224 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfb80054d0 con 0x561b3f402950 2024-09-10T21:19:40.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.496+0000 7fcfb3fff640 1 -- 172.21.15.59:0/394389224 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8004b80 con 0x561b3f402950 2024-09-10T21:19:40.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.497+0000 7fcfd25f3740 1 -- 172.21.15.59:0/394389224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 msgr2=0x561b3f404d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:40.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.497+0000 7fcfce7bb640 1 --2- 172.21.15.59:0/3656346828 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcfb40b52e0 0x7fcfb40b77a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00e4160 tx=0x7fcfc001ca20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:40.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.497+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/394389224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f404d40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009f70 tx=0x7fcfb8009720 comp rx=0 tx=0).stop 2024-09-10T21:19:40.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.497+0000 7fcfd25f3740 1 -- 172.21.15.59:0/394389224 shutdown_connections 2024-09-10T21:19:40.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.497+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/394389224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f404d40 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.497+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/394389224 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f69c0 0x561b3f402410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.497+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/394389224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f60a0 0x561b3f3f6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.497+0000 7fcfd25f3740 1 -- 172.21.15.59:0/394389224 >> 172.21.15.59:0/394389224 conn(0x561b3f3f3ed0 msgr2=0x561b3f3f5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:40.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.497+0000 7fcfd25f3740 1 -- 172.21.15.59:0/394389224 shutdown_connections 2024-09-10T21:19:40.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.497+0000 7fcfd25f3740 1 -- 172.21.15.59:0/394389224 wait complete. 2024-09-10T21:19:40.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.497+0000 7fcfd25f3740 1 -- start start 2024-09-10T21:19:40.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.497+0000 7fcfd25f3740 1 Processor -- start 2024-09-10T21:19:40.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.498+0000 7fcfd25f3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f60a0 0x561b3f402260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:40.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.498+0000 7fcfd25f3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f69c0 0x561b3f3ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:40.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.498+0000 7fcfd25f3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f3ffce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:40.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.498+0000 7fcfd25f3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561b3f1bd700 con 0x561b3f402950 2024-09-10T21:19:40.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.498+0000 7fcfd25f3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561b3f2f7110 con 0x561b3f3f60a0 2024-09-10T21:19:40.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.498+0000 7fcfd25f3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561b3f4055d0 con 0x561b3f3f69c0 2024-09-10T21:19:40.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.498+0000 7fcfd25f3740 10 client.0 _ll_register_callbacks cb 0x561b3f310990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:40.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.498+0000 7fcfcd7b9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f3ffce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:40.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.498+0000 7fcfcd7b9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f3ffce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37590/0 (socket says 172.21.15.59:37590) 2024-09-10T21:19:40.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.498+0000 7fcfcd7b9640 1 -- 172.21.15.59:0/4016484270 learned_addr learned my addr 172.21.15.59:0/4016484270 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:40.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.498+0000 7fcfcd7b9640 1 --2- 172.21.15.59:0/4016484270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f60a0 0x561b3f402260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:40.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.498+0000 7fcfcdfba640 1 --2- 172.21.15.59:0/4016484270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f69c0 0x561b3f3ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:40.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.498+0000 7fcfcd7b9640 1 -- 172.21.15.59:0/4016484270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f69c0 msgr2=0x561b3f3ff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:40.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.498+0000 7fcfcd7b9640 1 --2- 172.21.15.59:0/4016484270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f69c0 0x561b3f3ff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.498+0000 7fcfcd7b9640 1 -- 172.21.15.59:0/4016484270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f60a0 msgr2=0x561b3f402260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:40.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.498+0000 7fcfcd7b9640 1 --2- 172.21.15.59:0/4016484270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f60a0 0x561b3f402260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.498+0000 7fcfcd7b9640 1 -- 172.21.15.59:0/4016484270 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b3f324c40 con 0x561b3f402950 2024-09-10T21:19:40.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.499+0000 7fcfcd7b9640 1 --2- 172.21.15.59:0/4016484270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f3ffce0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009610 tx=0x7fcfb8004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3161fb976e199e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:40.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.499+0000 7fcfb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:40.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.499+0000 7fcfb17fa640 1 -- 172.21.15.59:0/4016484270 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8019040 con 0x561b3f402950 2024-09-10T21:19:40.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.499+0000 7fcfb17fa640 1 -- 172.21.15.59:0/4016484270 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcfb8004260 con 0x561b3f402950 2024-09-10T21:19:40.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.499+0000 7fcfd25f3740 1 -- 172.21.15.59:0/4016484270 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfb80054d0 con 0x561b3f402950 2024-09-10T21:19:40.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.499+0000 7fcfb17fa640 1 -- 172.21.15.59:0/4016484270 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcfb8034050 con 0x561b3f402950 2024-09-10T21:19:40.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.499+0000 7fcfd25f3740 10 client.16404 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:40.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.499+0000 7fcfd25f3740 1 -- 172.21.15.59:0/4016484270 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561b3f410f60 con 0x561b3f402950 2024-09-10T21:19:40.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.499+0000 7fcfb17fa640 1 -- 172.21.15.59:0/4016484270 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfb80054d0 con 0x561b3f402950 2024-09-10T21:19:40.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.499+0000 7fcfb17fa640 1 -- 172.21.15.59:0/4016484270 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcfb8003970 con 0x561b3f402950 2024-09-10T21:19:40.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.499+0000 7fcfd25f3740 10 client.16404 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:40.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.499+0000 7fcfd25f3740 10 client.16404 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:19:40.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.500+0000 7fcfd25f3740 20 client.16404 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:40.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.500+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/4016484270 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561b3f4122b0 0x561b3f4146a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:40.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.500+0000 7fcfd25f3740 4 client.16404 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:19:40.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.500+0000 7fcfd25f3740 1 -- 172.21.15.59:0/4016484270 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b3f36eda0 con 0x561b3f4122b0 2024-09-10T21:19:40.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.500+0000 7fcfcdfba640 1 --2- 172.21.15.59:0/4016484270 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561b3f4122b0 0x561b3f4146a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:40.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.500+0000 7fcfcdfba640 1 --2- 172.21.15.59:0/4016484270 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561b3f4122b0 0x561b3f4146a0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a09db58b2185f80 server_cookie=3072097ddbd2ed6a in_seq=0 out_seq=0 2024-09-10T21:19:40.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.500+0000 7fcfb17fa640 10 client.16404 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:40.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.501+0000 7fcfb17fa640 1 -- 172.21.15.59:0/4016484270 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b3f36eda0 con 0x561b3f4122b0 2024-09-10T21:19:40.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.501+0000 7fcfb17fa640 10 client.16404 handle_command_reply: tid=0 2024-09-10T21:19:40.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.501+0000 7fcfd25f3740 1 client.16404 shutdown 2024-09-10T21:19:40.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.501+0000 7fcfd25f3740 1 -- 172.21.15.59:0/4016484270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 msgr2=0x561b3f3ffce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:40.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.501+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/4016484270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f3ffce0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009610 tx=0x7fcfb8004840 comp rx=0 tx=0).stop 2024-09-10T21:19:40.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.501+0000 7fcfd25f3740 1 -- 172.21.15.59:0/4016484270 shutdown_connections 2024-09-10T21:19:40.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.501+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/4016484270 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561b3f4122b0 0x561b3f4146a0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.501+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/4016484270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f3ffce0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.501+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/4016484270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f69c0 0x561b3f3ff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.501+0000 7fcfb17fa640 0 client.16404 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:40.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.501+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/4016484270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f60a0 0x561b3f402260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.501+0000 7fcfd25f3740 1 -- 172.21.15.59:0/4016484270 >> 172.21.15.59:0/4016484270 conn(0x561b3f3f3ed0 msgr2=0x561b3f3f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:40.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.501+0000 7fcfd25f3740 1 -- 172.21.15.59:0/4016484270 shutdown_connections 2024-09-10T21:19:40.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.502+0000 7fcfd25f3740 1 -- 172.21.15.59:0/4016484270 wait complete. 2024-09-10T21:19:40.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.502+0000 7fcfd25f3740 20 client.16404 trim_cache size 0 max 16384 2024-09-10T21:19:40.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.519+0000 7fcfd25f3740 1 Processor -- start 2024-09-10T21:19:40.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.519+0000 7fcfd25f3740 1 -- start start 2024-09-10T21:19:40.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.519+0000 7fcfd25f3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f60a0 0x561b3f3f3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:40.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.519+0000 7fcfd25f3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f69c0 0x561b3f403d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:40.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.519+0000 7fcfd25f3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f404280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:40.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.519+0000 7fcfd25f3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc81b0500 con 0x561b3f402950 2024-09-10T21:19:40.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.519+0000 7fcfd25f3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc81b2040 con 0x561b3f3f69c0 2024-09-10T21:19:40.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.519+0000 7fcfd25f3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc81b0bd0 con 0x561b3f3f60a0 2024-09-10T21:19:40.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.519+0000 7fcfcd7b9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f404280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:40.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.520+0000 7fcfcd7b9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f404280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37604/0 (socket says 172.21.15.59:37604) 2024-09-10T21:19:40.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.520+0000 7fcfcd7b9640 1 -- 172.21.15.59:0/3463835911 learned_addr learned my addr 172.21.15.59:0/3463835911 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:40.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.520+0000 7fcfcd7b9640 1 --2- 172.21.15.59:0/3463835911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f60a0 0x561b3f3f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:40.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.520+0000 7fcfcdfba640 1 --2- 172.21.15.59:0/3463835911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f69c0 0x561b3f403d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:40.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.520+0000 7fcfcd7b9640 1 -- 172.21.15.59:0/3463835911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f60a0 msgr2=0x561b3f3f3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:40.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.520+0000 7fcfcd7b9640 1 --2- 172.21.15.59:0/3463835911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f60a0 0x561b3f3f3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.520+0000 7fcfcd7b9640 1 -- 172.21.15.59:0/3463835911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f69c0 msgr2=0x561b3f403d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:40.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.520+0000 7fcfcd7b9640 1 --2- 172.21.15.59:0/3463835911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f69c0 0x561b3f403d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.520+0000 7fcfcd7b9640 1 -- 172.21.15.59:0/3463835911 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b3f3f67f0 con 0x561b3f402950 2024-09-10T21:19:40.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.520+0000 7fcfcdfba640 1 --2- 172.21.15.59:0/3463835911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f69c0 0x561b3f403d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:40.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.520+0000 7fcfcd7b9640 1 --2- 172.21.15.59:0/3463835911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f404280 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8000c00 tx=0x7fcfb8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30db0b8f363c39bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:40.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.520+0000 7fcfb37fe640 1 -- 172.21.15.59:0/3463835911 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8019070 con 0x561b3f402950 2024-09-10T21:19:40.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.520+0000 7fcfb37fe640 1 -- 172.21.15.59:0/3463835911 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfb8005480 con 0x561b3f402950 2024-09-10T21:19:40.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.520+0000 7fcfb37fe640 1 -- 172.21.15.59:0/3463835911 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8004260 con 0x561b3f402950 2024-09-10T21:19:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.521+0000 7fcfd25f3740 1 -- 172.21.15.59:0/3463835911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 msgr2=0x561b3f404280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.521+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/3463835911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f404280 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8000c00 tx=0x7fcfb8005f90 comp rx=0 tx=0).stop 2024-09-10T21:19:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.521+0000 7fcfd25f3740 1 -- 172.21.15.59:0/3463835911 shutdown_connections 2024-09-10T21:19:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.521+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/3463835911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f404280 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.521+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/3463835911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f69c0 0x561b3f403d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.521+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/3463835911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f60a0 0x561b3f3f3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.521+0000 7fcfd25f3740 1 -- 172.21.15.59:0/3463835911 >> 172.21.15.59:0/3463835911 conn(0x561b3f3f3ed0 msgr2=0x561b3f401500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.521+0000 7fcfd25f3740 1 -- 172.21.15.59:0/3463835911 shutdown_connections 2024-09-10T21:19:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.521+0000 7fcfd25f3740 1 -- 172.21.15.59:0/3463835911 wait complete. 2024-09-10T21:19:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.521+0000 7fcfd25f3740 1 -- start start 2024-09-10T21:19:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.521+0000 7fcfd25f3740 1 Processor -- start 2024-09-10T21:19:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.522+0000 7fcfd25f3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f60a0 0x561b3f40aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.522+0000 7fcfd25f3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f69c0 0x561b3f40afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.522+0000 7fcfd25f3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f405850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.522+0000 7fcfd25f3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc81b1970 con 0x561b3f402950 2024-09-10T21:19:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.522+0000 7fcfd25f3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc81b12a0 con 0x561b3f3f69c0 2024-09-10T21:19:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.522+0000 7fcfd25f3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc81ae4e0 con 0x561b3f3f60a0 2024-09-10T21:19:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.522+0000 7fcfd25f3740 10 client.0 _ll_register_callbacks cb 0x7fcfb8013460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.522+0000 7fcfcd7b9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f405850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.522+0000 7fcfcd7b9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f405850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37616/0 (socket says 172.21.15.59:37616) 2024-09-10T21:19:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.522+0000 7fcfcd7b9640 1 -- 172.21.15.59:0/537349578 learned_addr learned my addr 172.21.15.59:0/537349578 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.522+0000 7fcfcd7b9640 1 --2- 172.21.15.59:0/537349578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f60a0 0x561b3f40aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.522+0000 7fcfcdfba640 1 --2- 172.21.15.59:0/537349578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f69c0 0x561b3f40afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.522+0000 7fcfcd7b9640 1 -- 172.21.15.59:0/537349578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f60a0 msgr2=0x561b3f40aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.522+0000 7fcfcd7b9640 1 --2- 172.21.15.59:0/537349578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f60a0 0x561b3f40aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.522+0000 7fcfcd7b9640 1 -- 172.21.15.59:0/537349578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f69c0 msgr2=0x561b3f40afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.522+0000 7fcfcd7b9640 1 --2- 172.21.15.59:0/537349578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f69c0 0x561b3f40afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.522+0000 7fcfcd7b9640 1 -- 172.21.15.59:0/537349578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b3f405f60 con 0x561b3f402950 2024-09-10T21:19:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.522+0000 7fcfcd7b9640 1 --2- 172.21.15.59:0/537349578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f405850 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8005650 tx=0x7fcfb8030040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b82055dfc66753 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.522+0000 7fcfb17fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.523+0000 7fcfb17fa640 1 -- 172.21.15.59:0/537349578 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8019030 con 0x561b3f402950 2024-09-10T21:19:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.523+0000 7fcfb17fa640 1 -- 172.21.15.59:0/537349578 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcfb8004260 con 0x561b3f402950 2024-09-10T21:19:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.523+0000 7fcfd25f3740 1 -- 172.21.15.59:0/537349578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfb8005480 con 0x561b3f402950 2024-09-10T21:19:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.523+0000 7fcfb17fa640 1 -- 172.21.15.59:0/537349578 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcfb8004ce0 con 0x561b3f402950 2024-09-10T21:19:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.523+0000 7fcfd25f3740 10 client.16410 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.523+0000 7fcfd25f3740 1 -- 172.21.15.59:0/537349578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561b3f47fa40 con 0x561b3f402950 2024-09-10T21:19:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.523+0000 7fcfb17fa640 1 -- 172.21.15.59:0/537349578 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfb8005480 con 0x561b3f402950 2024-09-10T21:19:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.523+0000 7fcfb17fa640 1 -- 172.21.15.59:0/537349578 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcfb8003990 con 0x561b3f402950 2024-09-10T21:19:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.523+0000 7fcfd25f3740 10 client.16410 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.523+0000 7fcfd25f3740 10 client.16410 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:19:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.523+0000 7fcfd25f3740 20 client.16410 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.523+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/537349578 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561b3f480020 0x561b3f482440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.523+0000 7fcfd25f3740 4 client.16410 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:19:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.523+0000 7fcfd25f3740 1 -- 172.21.15.59:0/537349578 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561b3f36a850 con 0x561b3f480020 2024-09-10T21:19:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.524+0000 7fcfcdfba640 1 --2- 172.21.15.59:0/537349578 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561b3f480020 0x561b3f482440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.524+0000 7fcfb17fa640 10 client.16410 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.524+0000 7fcfcdfba640 1 --2- 172.21.15.59:0/537349578 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561b3f480020 0x561b3f482440 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e79483b1f061715 server_cookie=7d6f6c37c697b919 in_seq=0 out_seq=0 2024-09-10T21:19:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.524+0000 7fcfb17fa640 1 -- 172.21.15.59:0/537349578 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x561b3f36a850 con 0x561b3f480020 2024-09-10T21:19:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.524+0000 7fcfb17fa640 10 client.16410 handle_command_reply: tid=0 2024-09-10T21:19:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.524+0000 7fcfd25f3740 1 client.16410 shutdown 2024-09-10T21:19:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.524+0000 7fcfd25f3740 1 -- 172.21.15.59:0/537349578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 msgr2=0x561b3f405850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.524+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/537349578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f405850 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8005650 tx=0x7fcfb8030040 comp rx=0 tx=0).stop 2024-09-10T21:19:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.524+0000 7fcfd25f3740 1 -- 172.21.15.59:0/537349578 shutdown_connections 2024-09-10T21:19:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.524+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/537349578 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x561b3f480020 0x561b3f482440 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.524+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/537349578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b3f402950 0x561b3f405850 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.524+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/537349578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561b3f3f69c0 0x561b3f40afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.524+0000 7fcfd25f3740 1 --2- 172.21.15.59:0/537349578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561b3f3f60a0 0x561b3f40aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.525+0000 7fcfb17fa640 0 client.16410 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.525+0000 7fcfd25f3740 1 -- 172.21.15.59:0/537349578 >> 172.21.15.59:0/537349578 conn(0x561b3f3f3ed0 msgr2=0x561b3f3f9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.525+0000 7fcfd25f3740 1 -- 172.21.15.59:0/537349578 shutdown_connections 2024-09-10T21:19:40.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.525+0000 7fcfd25f3740 1 -- 172.21.15.59:0/537349578 wait complete. 2024-09-10T21:19:40.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.525+0000 7fcfd25f3740 20 client.16410 trim_cache size 0 max 16384 2024-09-10T21:19:40.535 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:19:40.535 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:19:40.535 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:19:40.535 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:19:40.535 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:19:40.535 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:19:40.535 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:40.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:40.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:40.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:40.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:40.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:40.536 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:19:40.536 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:19:40.536 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:40.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:40.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:40.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:40.537 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:40.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:40.537 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:19:40.537 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:19:40.537 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:40.537 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:40.537 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:40.537 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:40.537 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:40.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:40.537 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:19:40.538 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:19:40.538 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:40.538 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:40.538 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:40.538 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:40.538 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:40.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:40.538 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:19:40.538 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:19:40.538 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:40.538 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:40.538 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:40.539 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:40.539 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:40.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:40.539 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:19:40.539 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:19:40.539 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:40.539 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:40.539 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:40.539 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:40.539 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:40.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:40.540 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:19:40.540 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:19:40.540 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:40.540 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:40.540 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:40.540 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:40.540 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:40.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:40.540 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:19:40.540 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:19:40.540 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:40.540 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:40.540 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:40.541 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:40.541 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:40.541 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:19:40.541 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:19:40.541 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:19:40.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.525+0000 7fcfd021e640 1 -- 172.21.15.59:0/3656346828 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcfb40b52e0 msgr2=0x7fcfb40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:40.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.525+0000 7fcfd021e640 1 --2- 172.21.15.59:0/3656346828 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcfb40b52e0 0x7fcfb40b77a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00e4160 tx=0x7fcfc001ca20 comp rx=0 tx=0).stop 2024-09-10T21:19:40.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.525+0000 7fcfd021e640 1 -- 172.21.15.59:0/3656346828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfc810f3e0 msgr2=0x7fcfc81a0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:40.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.525+0000 7fcfd021e640 1 --2- 172.21.15.59:0/3656346828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfc810f3e0 0x7fcfc81a0d80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000eb10 tx=0x7fcfc000c2d0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.525+0000 7fcfd021e640 1 -- 172.21.15.59:0/3656346828 shutdown_connections 2024-09-10T21:19:40.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.525+0000 7fcfd021e640 1 --2- 172.21.15.59:0/3656346828 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcfb40b52e0 0x7fcfb40b77a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.525+0000 7fcfd021e640 1 --2- 172.21.15.59:0/3656346828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfc810f3e0 0x7fcfc81a0d80 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.525+0000 7fcfd021e640 1 --2- 172.21.15.59:0/3656346828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcfc8102150 0x7fcfc819b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.525+0000 7fcfd021e640 1 --2- 172.21.15.59:0/3656346828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfc8101830 0x7fcfc819b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:40.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.525+0000 7fcfd021e640 1 -- 172.21.15.59:0/3656346828 >> 172.21.15.59:0/3656346828 conn(0x7fcfc80fd700 msgr2=0x7fcfc81115e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:40.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.525+0000 7fcfd021e640 1 -- 172.21.15.59:0/3656346828 shutdown_connections 2024-09-10T21:19:40.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:40.525+0000 7fcfd021e640 1 -- 172.21.15.59:0/3656346828 wait complete. 2024-09-10T21:19:40.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:40 smithi154 ceph-mon[35041]: pgmap v472: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:40.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:40 smithi192 ceph-mon[35363]: pgmap v472: 97 pgs: 97 active+clean; 2.9 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:41.566 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:19:41.566 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:19:41.829 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:19:42.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.330+0000 7fd4ed39e640 1 -- 172.21.15.59:0/682772341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e8101cd0 msgr2=0x7fd4e81020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:42.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.330+0000 7fd4ed39e640 1 --2- 172.21.15.59:0/682772341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e8101cd0 0x7fd4e81020b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009900 tx=0x7fd4d802a410 comp rx=0 tx=0).stop 2024-09-10T21:19:42.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.330+0000 7fd4ed39e640 1 -- 172.21.15.59:0/682772341 shutdown_connections 2024-09-10T21:19:42.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.330+0000 7fd4ed39e640 1 --2- 172.21.15.59:0/682772341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4e8108060 0x7fd4e810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:42.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.330+0000 7fd4ed39e640 1 --2- 172.21.15.59:0/682772341 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4e81076e0 0x7fd4e8107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:42.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.330+0000 7fd4ed39e640 1 --2- 172.21.15.59:0/682772341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e8101cd0 0x7fd4e81020b0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:42.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.330+0000 7fd4ed39e640 1 -- 172.21.15.59:0/682772341 >> 172.21.15.59:0/682772341 conn(0x7fd4e80fd700 msgr2=0x7fd4e80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:42.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.331+0000 7fd4ed39e640 1 -- 172.21.15.59:0/682772341 shutdown_connections 2024-09-10T21:19:42.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.331+0000 7fd4ed39e640 1 -- 172.21.15.59:0/682772341 wait complete. 2024-09-10T21:19:42.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.331+0000 7fd4ed39e640 1 Processor -- start 2024-09-10T21:19:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.331+0000 7fd4ed39e640 1 -- start start 2024-09-10T21:19:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.331+0000 7fd4ed39e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e81076e0 0x7fd4e81972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.331+0000 7fd4ed39e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4e8108060 0x7fd4e81977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.331+0000 7fd4ed39e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4e819cb80 0x7fd4e819d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.331+0000 7fd4ed39e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e8110c10 con 0x7fd4e81076e0 2024-09-10T21:19:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.331+0000 7fd4ed39e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e8110a90 con 0x7fd4e819cb80 2024-09-10T21:19:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.331+0000 7fd4ed39e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e8110d90 con 0x7fd4e8108060 2024-09-10T21:19:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.332+0000 7fd4e6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e81076e0 0x7fd4e81972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.332+0000 7fd4e6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e81076e0 0x7fd4e81972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37646/0 (socket says 172.21.15.59:37646) 2024-09-10T21:19:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.332+0000 7fd4e6ffd640 1 -- 172.21.15.59:0/2423838141 learned_addr learned my addr 172.21.15.59:0/2423838141 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.332+0000 7fd4e77fe640 1 --2- 172.21.15.59:0/2423838141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4e819cb80 0x7fd4e819d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.332+0000 7fd4dffff640 1 --2- 172.21.15.59:0/2423838141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4e8108060 0x7fd4e81977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:42.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.332+0000 7fd4e6ffd640 1 -- 172.21.15.59:0/2423838141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4e8108060 msgr2=0x7fd4e81977e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:42.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.332+0000 7fd4e6ffd640 1 --2- 172.21.15.59:0/2423838141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4e8108060 0x7fd4e81977e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:42.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.332+0000 7fd4e6ffd640 1 -- 172.21.15.59:0/2423838141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4e819cb80 msgr2=0x7fd4e819d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:42.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.332+0000 7fd4e6ffd640 1 --2- 172.21.15.59:0/2423838141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4e819cb80 0x7fd4e819d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:42.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.332+0000 7fd4e6ffd640 1 -- 172.21.15.59:0/2423838141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e819d710 con 0x7fd4e81076e0 2024-09-10T21:19:42.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.332+0000 7fd4dffff640 1 --2- 172.21.15.59:0/2423838141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4e8108060 0x7fd4e81977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:42.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.332+0000 7fd4e6ffd640 1 --2- 172.21.15.59:0/2423838141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e81076e0 0x7fd4e81972a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8006010 tx=0x7fd4d80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:42.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.332+0000 7fd4e4ff9640 1 -- 172.21.15.59:0/2423838141 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d803f030 con 0x7fd4e81076e0 2024-09-10T21:19:42.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.332+0000 7fd4ed39e640 1 -- 172.21.15.59:0/2423838141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e819d9a0 con 0x7fd4e81076e0 2024-09-10T21:19:42.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.332+0000 7fd4e4ff9640 1 -- 172.21.15.59:0/2423838141 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4d8003cb0 con 0x7fd4e81076e0 2024-09-10T21:19:42.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.332+0000 7fd4e4ff9640 1 -- 172.21.15.59:0/2423838141 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8035070 con 0x7fd4e81076e0 2024-09-10T21:19:42.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.332+0000 7fd4ed39e640 1 -- 172.21.15.59:0/2423838141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e81a3fc0 con 0x7fd4e81076e0 2024-09-10T21:19:42.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.333+0000 7fd4ed39e640 1 -- 172.21.15.59:0/2423838141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e81020b0 con 0x7fd4e81076e0 2024-09-10T21:19:42.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.335+0000 7fd4e4ff9640 1 -- 172.21.15.59:0/2423838141 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd4d803bbb0 con 0x7fd4e81076e0 2024-09-10T21:19:42.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.335+0000 7fd4e4ff9640 1 --2- 172.21.15.59:0/2423838141 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd4d40b74f0 0x7fd4d40b99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:42.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.336+0000 7fd4dffff640 1 --2- 172.21.15.59:0/2423838141 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd4d40b74f0 0x7fd4d40b99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:42.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.336+0000 7fd4e4ff9640 1 -- 172.21.15.59:0/2423838141 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd4d8106770 con 0x7fd4e81076e0 2024-09-10T21:19:42.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.336+0000 7fd4dffff640 1 --2- 172.21.15.59:0/2423838141 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd4d40b74f0 0x7fd4d40b99b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80feb00 tx=0x7fd4d000b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:42.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.339+0000 7fd4e4ff9640 1 -- 172.21.15.59:0/2423838141 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd4d80cd660 con 0x7fd4e81076e0 2024-09-10T21:19:42.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.565+0000 7fd4ed39e640 1 -- 172.21.15.59:0/2423838141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4e81983d0 con 0x7fd4e81076e0 2024-09-10T21:19:42.569 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:42 smithi059 ceph-mon[30888]: pgmap v473: 97 pgs: 97 active+clean; 3.0 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:19:42.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.565+0000 7fd4e4ff9640 1 -- 172.21.15.59:0/2423838141 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7fd4e81983d0 con 0x7fd4e81076e0 2024-09-10T21:19:42.569 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:19:42.570 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:19:42.570 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:19:42.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.567+0000 7fd4ed39e640 1 -- 172.21.15.59:0/2423838141 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd4d40b74f0 msgr2=0x7fd4d40b99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:42.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.567+0000 7fd4ed39e640 1 --2- 172.21.15.59:0/2423838141 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd4d40b74f0 0x7fd4d40b99b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80feb00 tx=0x7fd4d000b5f0 comp rx=0 tx=0).stop 2024-09-10T21:19:42.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.567+0000 7fd4ed39e640 1 -- 172.21.15.59:0/2423838141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e81076e0 msgr2=0x7fd4e81972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:42.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.567+0000 7fd4ed39e640 1 --2- 172.21.15.59:0/2423838141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e81076e0 0x7fd4e81972a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8006010 tx=0x7fd4d80042f0 comp rx=0 tx=0).stop 2024-09-10T21:19:42.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.567+0000 7fd4ed39e640 1 -- 172.21.15.59:0/2423838141 shutdown_connections 2024-09-10T21:19:42.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.567+0000 7fd4ed39e640 1 --2- 172.21.15.59:0/2423838141 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd4d40b74f0 0x7fd4d40b99b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:42.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.567+0000 7fd4ed39e640 1 --2- 172.21.15.59:0/2423838141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd4e819cb80 0x7fd4e819d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:42.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.567+0000 7fd4ed39e640 1 --2- 172.21.15.59:0/2423838141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4e8108060 0x7fd4e81977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:42.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.567+0000 7fd4ed39e640 1 --2- 172.21.15.59:0/2423838141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e81076e0 0x7fd4e81972a0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:42.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.567+0000 7fd4ed39e640 1 -- 172.21.15.59:0/2423838141 >> 172.21.15.59:0/2423838141 conn(0x7fd4e80fd700 msgr2=0x7fd4e80ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:42.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.567+0000 7fd4ed39e640 1 -- 172.21.15.59:0/2423838141 shutdown_connections 2024-09-10T21:19:42.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:42.567+0000 7fd4ed39e640 1 -- 172.21.15.59:0/2423838141 wait complete. 2024-09-10T21:19:42.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:42 smithi154 ceph-mon[35041]: pgmap v473: 97 pgs: 97 active+clean; 3.0 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:19:42.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:42 smithi192 ceph-mon[35363]: pgmap v473: 97 pgs: 97 active+clean; 3.0 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:19:43.237 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:19:43.499 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:19:43.621 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:43 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2423838141' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:19:43.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:43 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2423838141' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:19:43.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:43 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2423838141' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:19:43.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.974+0000 7f06c4ebd640 1 -- 172.21.15.59:0/1872338606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c0109170 msgr2=0x7f06c010f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:43.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.974+0000 7f06c4ebd640 1 --2- 172.21.15.59:0/1872338606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c0109170 0x7f06c010f970 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009900 tx=0x7f06b802a410 comp rx=0 tx=0).stop 2024-09-10T21:19:43.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.974+0000 7f06c4ebd640 1 -- 172.21.15.59:0/1872338606 shutdown_connections 2024-09-10T21:19:43.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.974+0000 7f06c4ebd640 1 --2- 172.21.15.59:0/1872338606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c0109170 0x7f06c010f970 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:43.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.974+0000 7f06c4ebd640 1 --2- 172.21.15.59:0/1872338606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c01087f0 0x7f06c0108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:43.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.974+0000 7f06c4ebd640 1 --2- 172.21.15.59:0/1872338606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06c0102de0 0x7f06c01031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:43.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.974+0000 7f06c4ebd640 1 -- 172.21.15.59:0/1872338606 >> 172.21.15.59:0/1872338606 conn(0x7f06c00fe830 msgr2=0x7f06c0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:43.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.974+0000 7f06c4ebd640 1 -- 172.21.15.59:0/1872338606 shutdown_connections 2024-09-10T21:19:43.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.975+0000 7f06c4ebd640 1 -- 172.21.15.59:0/1872338606 wait complete. 2024-09-10T21:19:43.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.976+0000 7f06c4ebd640 1 Processor -- start 2024-09-10T21:19:43.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.976+0000 7f06c4ebd640 1 -- start start 2024-09-10T21:19:43.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.976+0000 7f06c4ebd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c0102de0 0x7f06c0199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:43.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.976+0000 7f06c4ebd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06c01087f0 0x7f06c0199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:43.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.976+0000 7f06c4ebd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c0109170 0x7f06c019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:43.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.976+0000 7f06c4ebd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f06c0112df0 con 0x7f06c0109170 2024-09-10T21:19:43.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.976+0000 7f06c4ebd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f06c0112c70 con 0x7f06c0102de0 2024-09-10T21:19:43.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.976+0000 7f06c4ebd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f06c0112f70 con 0x7f06c01087f0 2024-09-10T21:19:43.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.976+0000 7f06bed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c0109170 0x7f06c019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:43.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.976+0000 7f06bed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c0109170 0x7f06c019eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37664/0 (socket says 172.21.15.59:37664) 2024-09-10T21:19:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.976+0000 7f06bed9d640 1 -- 172.21.15.59:0/286944036 learned_addr learned my addr 172.21.15.59:0/286944036 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.976+0000 7f06bdd9b640 1 --2- 172.21.15.59:0/286944036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06c01087f0 0x7f06c0199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.976+0000 7f06be59c640 1 --2- 172.21.15.59:0/286944036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c0102de0 0x7f06c0199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.977+0000 7f06bed9d640 1 -- 172.21.15.59:0/286944036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06c01087f0 msgr2=0x7f06c0199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.977+0000 7f06bed9d640 1 --2- 172.21.15.59:0/286944036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06c01087f0 0x7f06c0199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.977+0000 7f06bed9d640 1 -- 172.21.15.59:0/286944036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c0102de0 msgr2=0x7f06c0199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.977+0000 7f06bed9d640 1 --2- 172.21.15.59:0/286944036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c0102de0 0x7f06c0199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.977+0000 7f06bed9d640 1 -- 172.21.15.59:0/286944036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c019f2d0 con 0x7f06c0109170 2024-09-10T21:19:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.977+0000 7f06bed9d640 1 --2- 172.21.15.59:0/286944036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c0109170 0x7f06c019eb00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f06b8004770 tx=0x7f06b8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.977+0000 7f06af7fe640 1 -- 172.21.15.59:0/286944036 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b803f030 con 0x7f06c0109170 2024-09-10T21:19:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.977+0000 7f06c4ebd640 1 -- 172.21.15.59:0/286944036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c019f560 con 0x7f06c0109170 2024-09-10T21:19:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.977+0000 7f06af7fe640 1 -- 172.21.15.59:0/286944036 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06b8003aa0 con 0x7f06c0109170 2024-09-10T21:19:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.977+0000 7f06af7fe640 1 -- 172.21.15.59:0/286944036 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b8035070 con 0x7f06c0109170 2024-09-10T21:19:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.977+0000 7f06c4ebd640 1 -- 172.21.15.59:0/286944036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c01a5c80 con 0x7f06c0109170 2024-09-10T21:19:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.980+0000 7f06af7fe640 1 -- 172.21.15.59:0/286944036 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f06b80035f0 con 0x7f06c0109170 2024-09-10T21:19:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.980+0000 7f06af7fe640 1 --2- 172.21.15.59:0/286944036 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f06a80b52e0 0x7f06a80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.981+0000 7f06be59c640 1 --2- 172.21.15.59:0/286944036 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f06a80b52e0 0x7f06a80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.981+0000 7f06c7292740 1 Processor -- start 2024-09-10T21:19:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.981+0000 7f06af7fe640 1 -- 172.21.15.59:0/286944036 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f06b8106650 con 0x7f06c0109170 2024-09-10T21:19:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.981+0000 7f06c7292740 1 -- start start 2024-09-10T21:19:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.981+0000 7f06c7292740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a78950f0 0x5597a78954d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.981+0000 7f06c7292740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a7895a10 0x5597a78a1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.981+0000 7f06c7292740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a78a19a0 0x5597a78a3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.981+0000 7f06c7292740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5597a780bea0 con 0x5597a7895a10 2024-09-10T21:19:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.981+0000 7f06c7292740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5597a77fb2d0 con 0x5597a78950f0 2024-09-10T21:19:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.981+0000 7f06c7292740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5597a77ff0e0 con 0x5597a78a19a0 2024-09-10T21:19:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.981+0000 7f06be59c640 1 --2- 172.21.15.59:0/286944036 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f06a80b52e0 0x7f06a80b77a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f06b0005fd0 tx=0x7f06b0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.981+0000 7f06bdd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a7895a10 0x5597a78a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.981+0000 7f06bdd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a7895a10 0x5597a78a1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37670/0 (socket says 172.21.15.59:37670) 2024-09-10T21:19:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.981+0000 7f06bdd9b640 1 -- 172.21.15.59:0/4278824799 learned_addr learned my addr 172.21.15.59:0/4278824799 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.982+0000 7f06bed9d640 1 --2- 172.21.15.59:0/4278824799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a78a19a0 0x5597a78a3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.982+0000 7f06be59c640 1 --2- 172.21.15.59:0/4278824799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a78950f0 0x5597a78954d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.982+0000 7f06bdd9b640 1 -- 172.21.15.59:0/4278824799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a78a19a0 msgr2=0x5597a78a3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.982+0000 7f06bdd9b640 1 --2- 172.21.15.59:0/4278824799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a78a19a0 0x5597a78a3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.982+0000 7f06bdd9b640 1 -- 172.21.15.59:0/4278824799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a78950f0 msgr2=0x5597a78954d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.982+0000 7f06bdd9b640 1 --2- 172.21.15.59:0/4278824799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a78950f0 0x5597a78954d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.982+0000 7f06bdd9b640 1 -- 172.21.15.59:0/4278824799 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597a7559650 con 0x5597a7895a10 2024-09-10T21:19:43.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.982+0000 7f06be59c640 1 --2- 172.21.15.59:0/4278824799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a78950f0 0x5597a78954d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:43.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.982+0000 7f06bdd9b640 1 --2- 172.21.15.59:0/4278824799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a7895a10 0x5597a78a1460 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f06b4003a20 tx=0x7f06b4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db644b59bd9c136 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:43.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.982+0000 7f06acff9640 1 -- 172.21.15.59:0/4278824799 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b4004b20 con 0x5597a7895a10 2024-09-10T21:19:43.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.982+0000 7f06acff9640 1 -- 172.21.15.59:0/4278824799 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06b4004cc0 con 0x5597a7895a10 2024-09-10T21:19:43.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.982+0000 7f06acff9640 1 -- 172.21.15.59:0/4278824799 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b4012780 con 0x5597a7895a10 2024-09-10T21:19:43.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.983+0000 7f06c7292740 1 -- 172.21.15.59:0/4278824799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a7895a10 msgr2=0x5597a78a1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:43.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.983+0000 7f06c7292740 1 --2- 172.21.15.59:0/4278824799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a7895a10 0x5597a78a1460 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f06b4003a20 tx=0x7f06b4009f90 comp rx=0 tx=0).stop 2024-09-10T21:19:43.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.983+0000 7f06c7292740 1 -- 172.21.15.59:0/4278824799 shutdown_connections 2024-09-10T21:19:43.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.983+0000 7f06c7292740 1 --2- 172.21.15.59:0/4278824799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a78a19a0 0x5597a78a3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:43.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.983+0000 7f06c7292740 1 --2- 172.21.15.59:0/4278824799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a7895a10 0x5597a78a1460 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:43.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.983+0000 7f06c7292740 1 --2- 172.21.15.59:0/4278824799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a78950f0 0x5597a78954d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:43.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.983+0000 7f06c7292740 1 -- 172.21.15.59:0/4278824799 >> 172.21.15.59:0/4278824799 conn(0x5597a7892f20 msgr2=0x5597a78940c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:43.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.984+0000 7f06c7292740 1 -- 172.21.15.59:0/4278824799 shutdown_connections 2024-09-10T21:19:43.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.984+0000 7f06c7292740 1 -- 172.21.15.59:0/4278824799 wait complete. 2024-09-10T21:19:44.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.984+0000 7f06c7292740 1 -- start start 2024-09-10T21:19:44.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.984+0000 7f06c7292740 1 Processor -- start 2024-09-10T21:19:44.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.984+0000 7f06c7292740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a78950f0 0x5597a78a1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:44.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.984+0000 7f06c7292740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a7895a10 0x5597a789e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:44.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.984+0000 7f06c7292740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a78a19a0 0x5597a789ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:44.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.984+0000 7f06c7292740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5597a765c700 con 0x5597a78950f0 2024-09-10T21:19:44.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.985+0000 7f06c7292740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5597a7796160 con 0x5597a7895a10 2024-09-10T21:19:44.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.985+0000 7f06c7292740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5597a78a4620 con 0x5597a78a19a0 2024-09-10T21:19:44.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.985+0000 7f06c7292740 10 client.0 _ll_register_callbacks cb 0x5597a77af9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:44.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.985+0000 7f06be59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a78950f0 0x5597a78a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:44.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.985+0000 7f06be59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a78950f0 0x5597a78a1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37686/0 (socket says 172.21.15.59:37686) 2024-09-10T21:19:44.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.985+0000 7f06be59c640 1 -- 172.21.15.59:0/3334687231 learned_addr learned my addr 172.21.15.59:0/3334687231 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:44.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.985+0000 7f06bed9d640 1 --2- 172.21.15.59:0/3334687231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a78a19a0 0x5597a789ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:44.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.985+0000 7f06be59c640 1 -- 172.21.15.59:0/3334687231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a78a19a0 msgr2=0x5597a789ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:44.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.985+0000 7f06be59c640 1 --2- 172.21.15.59:0/3334687231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a78a19a0 0x5597a789ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.985+0000 7f06be59c640 1 -- 172.21.15.59:0/3334687231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a7895a10 msgr2=0x5597a789e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:44.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.985+0000 7f06be59c640 1 --2- 172.21.15.59:0/3334687231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a7895a10 0x5597a789e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.985+0000 7f06be59c640 1 -- 172.21.15.59:0/3334687231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597a77c3c90 con 0x5597a78950f0 2024-09-10T21:19:44.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.985+0000 7f06be59c640 1 --2- 172.21.15.59:0/3334687231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a78950f0 0x5597a78a1290 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f06b0011540 tx=0x7f06b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adbde4c9e4fa3fcc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:44.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.985+0000 7f06a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:44.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.985+0000 7f06a5ffb640 1 -- 172.21.15.59:0/3334687231 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b001f900 con 0x5597a78950f0 2024-09-10T21:19:44.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.985+0000 7f06a5ffb640 1 -- 172.21.15.59:0/3334687231 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f06b001faa0 con 0x5597a78950f0 2024-09-10T21:19:44.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.985+0000 7f06c7292740 1 -- 172.21.15.59:0/3334687231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06b4004cc0 con 0x5597a78950f0 2024-09-10T21:19:44.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.986+0000 7f06a5ffb640 1 -- 172.21.15.59:0/3334687231 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f06b001fca0 con 0x5597a78950f0 2024-09-10T21:19:44.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.986+0000 7f06c7292740 10 client.16428 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.986+0000 7f06c7292740 1 -- 172.21.15.59:0/3334687231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5597a78affe0 con 0x5597a78950f0 2024-09-10T21:19:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.986+0000 7f06a5ffb640 1 -- 172.21.15.59:0/3334687231 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06b4004cc0 con 0x5597a78950f0 2024-09-10T21:19:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.986+0000 7f06a5ffb640 1 -- 172.21.15.59:0/3334687231 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f06b001e3c0 con 0x5597a78950f0 2024-09-10T21:19:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.986+0000 7f06c7292740 10 client.16428 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.986+0000 7f06c7292740 10 client.16428 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:19:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.986+0000 7f06c7292740 20 client.16428 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.986+0000 7f06c7292740 1 --2- 172.21.15.59:0/3334687231 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5597a78b14f0 0x5597a78b3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.986+0000 7f06c7292740 4 client.16428 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:19:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.986+0000 7f06c7292740 1 -- 172.21.15.59:0/3334687231 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597a780ddf0 con 0x5597a78b14f0 2024-09-10T21:19:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.986+0000 7f06bdd9b640 1 --2- 172.21.15.59:0/3334687231 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5597a78b14f0 0x5597a78b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.987+0000 7f06bdd9b640 1 --2- 172.21.15.59:0/3334687231 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5597a78b14f0 0x5597a78b3950 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=731d7490d92ba33d server_cookie=614067e011d675 in_seq=0 out_seq=0 2024-09-10T21:19:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.987+0000 7f06a5ffb640 10 client.16428 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:19:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.988+0000 7f06a5ffb640 1 -- 172.21.15.59:0/3334687231 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5597a780ddf0 con 0x5597a78b14f0 2024-09-10T21:19:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.988+0000 7f06a5ffb640 10 client.16428 handle_command_reply: tid=0 2024-09-10T21:19:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.988+0000 7f06c7292740 1 client.16428 shutdown 2024-09-10T21:19:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.988+0000 7f06c7292740 1 -- 172.21.15.59:0/3334687231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a78950f0 msgr2=0x5597a78a1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.988+0000 7f06c7292740 1 --2- 172.21.15.59:0/3334687231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a78950f0 0x5597a78a1290 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f06b0011540 tx=0x7f06b00046c0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.989+0000 7f06c7292740 1 -- 172.21.15.59:0/3334687231 shutdown_connections 2024-09-10T21:19:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.989+0000 7f06c7292740 1 --2- 172.21.15.59:0/3334687231 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5597a78b14f0 0x5597a78b3950 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.989+0000 7f06c7292740 1 --2- 172.21.15.59:0/3334687231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a78a19a0 0x5597a789ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.989+0000 7f06c7292740 1 --2- 172.21.15.59:0/3334687231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a7895a10 0x5597a789e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.989+0000 7f06a5ffb640 0 client.16428 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:19:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.989+0000 7f06c7292740 1 --2- 172.21.15.59:0/3334687231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a78950f0 0x5597a78a1290 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.989+0000 7f06c7292740 1 -- 172.21.15.59:0/3334687231 >> 172.21.15.59:0/3334687231 conn(0x5597a7892f20 msgr2=0x5597a7898ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:44.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.989+0000 7f06c7292740 1 -- 172.21.15.59:0/3334687231 shutdown_connections 2024-09-10T21:19:44.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.989+0000 7f06c7292740 1 -- 172.21.15.59:0/3334687231 wait complete. 2024-09-10T21:19:44.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:43.989+0000 7f06c7292740 20 client.16428 trim_cache size 0 max 16384 2024-09-10T21:19:44.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.002+0000 7f06c7292740 1 Processor -- start 2024-09-10T21:19:44.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.003+0000 7f06c7292740 1 -- start start 2024-09-10T21:19:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.003+0000 7f06c7292740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a78950f0 0x5597a7892760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.003+0000 7f06c7292740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a7895a10 0x5597a789b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.003+0000 7f06c7292740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a78a19a0 0x5597a789be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.003+0000 7f06c7292740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f06c01ae210 con 0x5597a78950f0 2024-09-10T21:19:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.003+0000 7f06c7292740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f06c01afd50 con 0x5597a78a19a0 2024-09-10T21:19:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.003+0000 7f06c7292740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f06c01ae8e0 con 0x5597a7895a10 2024-09-10T21:19:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.003+0000 7f06be59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a78950f0 0x5597a7892760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.003+0000 7f06be59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a78950f0 0x5597a7892760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37700/0 (socket says 172.21.15.59:37700) 2024-09-10T21:19:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.003+0000 7f06be59c640 1 -- 172.21.15.59:0/44976231 learned_addr learned my addr 172.21.15.59:0/44976231 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.003+0000 7f06bdd9b640 1 --2- 172.21.15.59:0/44976231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a7895a10 0x5597a789b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.003+0000 7f06bed9d640 1 --2- 172.21.15.59:0/44976231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a78a19a0 0x5597a789be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:44.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.003+0000 7f06be59c640 1 -- 172.21.15.59:0/44976231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a7895a10 msgr2=0x5597a789b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:44.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.003+0000 7f06be59c640 1 --2- 172.21.15.59:0/44976231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a7895a10 0x5597a789b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.003+0000 7f06be59c640 1 -- 172.21.15.59:0/44976231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a78a19a0 msgr2=0x5597a789be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:44.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.003+0000 7f06be59c640 1 --2- 172.21.15.59:0/44976231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a78a19a0 0x5597a789be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.003+0000 7f06be59c640 1 -- 172.21.15.59:0/44976231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597a7893c00 con 0x5597a78950f0 2024-09-10T21:19:44.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.003+0000 7f06bdd9b640 1 --2- 172.21.15.59:0/44976231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a7895a10 0x5597a789b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:44.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.004+0000 7f06be59c640 1 --2- 172.21.15.59:0/44976231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a78950f0 0x5597a7892760 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f06b0000c00 tx=0x7f06b000b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1104d71267744d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:44.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.004+0000 7f06a7fff640 1 -- 172.21.15.59:0/44976231 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b001e3c0 con 0x5597a78950f0 2024-09-10T21:19:44.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.004+0000 7f06a7fff640 1 -- 172.21.15.59:0/44976231 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06b001e560 con 0x5597a78950f0 2024-09-10T21:19:44.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.004+0000 7f06a7fff640 1 -- 172.21.15.59:0/44976231 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0005400 con 0x5597a78950f0 2024-09-10T21:19:44.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.005+0000 7f06c7292740 1 -- 172.21.15.59:0/44976231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a78950f0 msgr2=0x5597a7892760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:44.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.005+0000 7f06c7292740 1 --2- 172.21.15.59:0/44976231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a78950f0 0x5597a7892760 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f06b0000c00 tx=0x7f06b000b450 comp rx=0 tx=0).stop 2024-09-10T21:19:44.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.005+0000 7f06c7292740 1 -- 172.21.15.59:0/44976231 shutdown_connections 2024-09-10T21:19:44.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.005+0000 7f06c7292740 1 --2- 172.21.15.59:0/44976231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a78a19a0 0x5597a789be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.005+0000 7f06c7292740 1 --2- 172.21.15.59:0/44976231 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a7895a10 0x5597a789b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.005+0000 7f06c7292740 1 --2- 172.21.15.59:0/44976231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a78950f0 0x5597a7892760 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.005+0000 7f06c7292740 1 -- 172.21.15.59:0/44976231 >> 172.21.15.59:0/44976231 conn(0x5597a7892f20 msgr2=0x5597a789cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:44.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.005+0000 7f06c7292740 1 -- 172.21.15.59:0/44976231 shutdown_connections 2024-09-10T21:19:44.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.005+0000 7f06c7292740 1 -- 172.21.15.59:0/44976231 wait complete. 2024-09-10T21:19:44.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.005+0000 7f06c7292740 1 -- start start 2024-09-10T21:19:44.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.005+0000 7f06c7292740 1 Processor -- start 2024-09-10T21:19:44.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.005+0000 7f06c7292740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a78950f0 0x5597a78a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:44.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.005+0000 7f06c7292740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a7895a10 0x5597a78aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:44.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.006+0000 7f06c7292740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a78a19a0 0x5597a78a6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:44.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.006+0000 7f06c7292740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f06c01af680 con 0x5597a7895a10 2024-09-10T21:19:44.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.006+0000 7f06c7292740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f06c01aefb0 con 0x5597a78950f0 2024-09-10T21:19:44.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.006+0000 7f06c7292740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f06c01ac1f0 con 0x5597a78a19a0 2024-09-10T21:19:44.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.006+0000 7f06c7292740 10 client.0 _ll_register_callbacks cb 0x7f06b0015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:44.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.006+0000 7f06bdd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a7895a10 0x5597a78aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:44.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.006+0000 7f06bdd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a7895a10 0x5597a78aa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37704/0 (socket says 172.21.15.59:37704) 2024-09-10T21:19:44.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.006+0000 7f06be59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a78950f0 0x5597a78a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:44.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.006+0000 7f06bdd9b640 1 -- 172.21.15.59:0/1488214880 learned_addr learned my addr 172.21.15.59:0/1488214880 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:44.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.006+0000 7f06bed9d640 1 --2- 172.21.15.59:0/1488214880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a78a19a0 0x5597a78a6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:44.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.006+0000 7f06bdd9b640 1 -- 172.21.15.59:0/1488214880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a78a19a0 msgr2=0x5597a78a6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:44.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.006+0000 7f06bdd9b640 1 --2- 172.21.15.59:0/1488214880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a78a19a0 0x5597a78a6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.006+0000 7f06bdd9b640 1 -- 172.21.15.59:0/1488214880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a78950f0 msgr2=0x5597a78a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:44.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.006+0000 7f06bdd9b640 1 --2- 172.21.15.59:0/1488214880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a78950f0 0x5597a78a9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.006+0000 7f06bdd9b640 1 -- 172.21.15.59:0/1488214880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597a78a6d50 con 0x5597a7895a10 2024-09-10T21:19:44.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.006+0000 7f06bdd9b640 1 --2- 172.21.15.59:0/1488214880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a7895a10 0x5597a78aa320 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f06b40059b0 tx=0x7f06b40098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45425a84f9bf97 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:44.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.006+0000 7f06a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:44.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.006+0000 7f06a5ffb640 1 -- 172.21.15.59:0/1488214880 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b4005460 con 0x5597a7895a10 2024-09-10T21:19:44.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.007+0000 7f06a5ffb640 1 -- 172.21.15.59:0/1488214880 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f06b4005600 con 0x5597a7895a10 2024-09-10T21:19:44.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.007+0000 7f06c7292740 1 -- 172.21.15.59:0/1488214880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06b001e560 con 0x5597a7895a10 2024-09-10T21:19:44.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.007+0000 7f06a5ffb640 1 -- 172.21.15.59:0/1488214880 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f06b4035050 con 0x5597a7895a10 2024-09-10T21:19:44.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.007+0000 7f06c7292740 10 client.16434 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:44.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.007+0000 7f06c7292740 1 -- 172.21.15.59:0/1488214880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5597a7923680 con 0x5597a7895a10 2024-09-10T21:19:44.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.007+0000 7f06a5ffb640 1 -- 172.21.15.59:0/1488214880 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06b001e560 con 0x5597a7895a10 2024-09-10T21:19:44.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.007+0000 7f06a5ffb640 1 -- 172.21.15.59:0/1488214880 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f06b402c070 con 0x5597a7895a10 2024-09-10T21:19:44.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.007+0000 7f06c7292740 10 client.16434 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:44.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.007+0000 7f06c7292740 10 client.16434 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:19:44.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.007+0000 7f06c7292740 20 client.16434 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:44.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.007+0000 7f06c7292740 1 --2- 172.21.15.59:0/1488214880 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5597a7923cc0 0x5597a79260e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:44.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.007+0000 7f06c7292740 4 client.16434 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:19:44.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.007+0000 7f06c7292740 1 -- 172.21.15.59:0/1488214880 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5597a78098a0 con 0x5597a7923cc0 2024-09-10T21:19:44.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.008+0000 7f06be59c640 1 --2- 172.21.15.59:0/1488214880 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5597a7923cc0 0x5597a79260e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:44.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.008+0000 7f06be59c640 1 --2- 172.21.15.59:0/1488214880 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5597a7923cc0 0x5597a79260e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3bb3cc39437b35a9 server_cookie=4741033fdd75be8a in_seq=0 out_seq=0 2024-09-10T21:19:44.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.008+0000 7f06a5ffb640 10 client.16434 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:19:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.008+0000 7f06a5ffb640 1 -- 172.21.15.59:0/1488214880 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5597a78098a0 con 0x5597a7923cc0 2024-09-10T21:19:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.008+0000 7f06a5ffb640 10 client.16434 handle_command_reply: tid=0 2024-09-10T21:19:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.008+0000 7f06c7292740 1 client.16434 shutdown 2024-09-10T21:19:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.008+0000 7f06c7292740 1 -- 172.21.15.59:0/1488214880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a7895a10 msgr2=0x5597a78aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.008+0000 7f06c7292740 1 --2- 172.21.15.59:0/1488214880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a7895a10 0x5597a78aa320 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f06b40059b0 tx=0x7f06b40098a0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.008+0000 7f06c7292740 1 -- 172.21.15.59:0/1488214880 shutdown_connections 2024-09-10T21:19:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.008+0000 7f06c7292740 1 --2- 172.21.15.59:0/1488214880 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5597a7923cc0 0x5597a79260e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.009+0000 7f06c7292740 1 --2- 172.21.15.59:0/1488214880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5597a78a19a0 0x5597a78a6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.009+0000 7f06c7292740 1 --2- 172.21.15.59:0/1488214880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a7895a10 0x5597a78aa320 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.009+0000 7f06c7292740 1 --2- 172.21.15.59:0/1488214880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597a78950f0 0x5597a78a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.009+0000 7f06c7292740 1 -- 172.21.15.59:0/1488214880 >> 172.21.15.59:0/1488214880 conn(0x5597a7892f20 msgr2=0x5597a789fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.009+0000 7f06a5ffb640 0 client.16434 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:19:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.009+0000 7f06c7292740 1 -- 172.21.15.59:0/1488214880 shutdown_connections 2024-09-10T21:19:44.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.009+0000 7f06c7292740 1 -- 172.21.15.59:0/1488214880 wait complete. 2024-09-10T21:19:44.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.009+0000 7f06c7292740 20 client.16434 trim_cache size 0 max 16384 2024-09-10T21:19:44.020 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:19:44.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.009+0000 7f06c4ebd640 1 -- 172.21.15.59:0/286944036 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f06a80b52e0 msgr2=0x7f06a80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:44.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.009+0000 7f06c4ebd640 1 --2- 172.21.15.59:0/286944036 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f06a80b52e0 0x7f06a80b77a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f06b0005fd0 tx=0x7f06b0005850 comp rx=0 tx=0).stop 2024-09-10T21:19:44.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.009+0000 7f06c4ebd640 1 -- 172.21.15.59:0/286944036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c0109170 msgr2=0x7f06c019eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:44.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.009+0000 7f06c4ebd640 1 --2- 172.21.15.59:0/286944036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c0109170 0x7f06c019eb00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f06b8004770 tx=0x7f06b8004270 comp rx=0 tx=0).stop 2024-09-10T21:19:44.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.010+0000 7f06c4ebd640 1 -- 172.21.15.59:0/286944036 shutdown_connections 2024-09-10T21:19:44.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.010+0000 7f06c4ebd640 1 --2- 172.21.15.59:0/286944036 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f06a80b52e0 0x7f06a80b77a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.010+0000 7f06c4ebd640 1 --2- 172.21.15.59:0/286944036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c0109170 0x7f06c019eb00 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.010+0000 7f06c4ebd640 1 --2- 172.21.15.59:0/286944036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06c01087f0 0x7f06c0199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.010+0000 7f06c4ebd640 1 --2- 172.21.15.59:0/286944036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06c0102de0 0x7f06c0199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:44.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.010+0000 7f06c4ebd640 1 -- 172.21.15.59:0/286944036 >> 172.21.15.59:0/286944036 conn(0x7f06c00fe830 msgr2=0x7f06c00ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:44.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.010+0000 7f06c4ebd640 1 -- 172.21.15.59:0/286944036 shutdown_connections 2024-09-10T21:19:44.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:44.010+0000 7f06c4ebd640 1 -- 172.21.15.59:0/286944036 wait complete. 2024-09-10T21:19:44.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:44 smithi059 ceph-mon[30888]: pgmap v474: 97 pgs: 97 active+clean; 3.0 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:44.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:44 smithi154 ceph-mon[35041]: pgmap v474: 97 pgs: 97 active+clean; 3.0 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:44.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:44 smithi192 ceph-mon[35363]: pgmap v474: 97 pgs: 97 active+clean; 3.0 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:44.965 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:19:45.226 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:19:45.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.748+0000 7fb322b6d640 1 -- 172.21.15.59:0/3008011450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c108020 msgr2=0x7fb31c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:45.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.748+0000 7fb322b6d640 1 --2- 172.21.15.59:0/3008011450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c108020 0x7fb31c10e820 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb304009900 tx=0x7fb30402a410 comp rx=0 tx=0).stop 2024-09-10T21:19:45.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.748+0000 7fb322b6d640 1 -- 172.21.15.59:0/3008011450 shutdown_connections 2024-09-10T21:19:45.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.748+0000 7fb322b6d640 1 --2- 172.21.15.59:0/3008011450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c108020 0x7fb31c10e820 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.748+0000 7fb322b6d640 1 --2- 172.21.15.59:0/3008011450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb31c1076a0 0x7fb31c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.748+0000 7fb322b6d640 1 --2- 172.21.15.59:0/3008011450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb31c101c90 0x7fb31c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.749+0000 7fb322b6d640 1 -- 172.21.15.59:0/3008011450 >> 172.21.15.59:0/3008011450 conn(0x7fb31c0fd700 msgr2=0x7fb31c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:45.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.749+0000 7fb322b6d640 1 -- 172.21.15.59:0/3008011450 shutdown_connections 2024-09-10T21:19:45.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.749+0000 7fb322b6d640 1 -- 172.21.15.59:0/3008011450 wait complete. 2024-09-10T21:19:45.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.749+0000 7fb322b6d640 1 Processor -- start 2024-09-10T21:19:45.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.749+0000 7fb322b6d640 1 -- start start 2024-09-10T21:19:45.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.749+0000 7fb322b6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb31c101c90 0x7fb31c197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:45.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.749+0000 7fb322b6d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb31c1076a0 0x7fb31c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.749+0000 7fb322b6d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c108020 0x7fb31c19d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.749+0000 7fb322b6d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c111d30 con 0x7fb31c108020 2024-09-10T21:19:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.749+0000 7fb322b6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c111bb0 con 0x7fb31c101c90 2024-09-10T21:19:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.749+0000 7fb322b6d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c111eb0 con 0x7fb31c1076a0 2024-09-10T21:19:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.750+0000 7fb32110a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c108020 0x7fb31c19d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.750+0000 7fb32110a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c108020 0x7fb31c19d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37728/0 (socket says 172.21.15.59:37728) 2024-09-10T21:19:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.750+0000 7fb32110a640 1 -- 172.21.15.59:0/3386115968 learned_addr learned my addr 172.21.15.59:0/3386115968 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.750+0000 7fb320909640 1 --2- 172.21.15.59:0/3386115968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb31c101c90 0x7fb31c197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.750+0000 7fb31bfff640 1 --2- 172.21.15.59:0/3386115968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb31c1076a0 0x7fb31c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.750+0000 7fb32110a640 1 -- 172.21.15.59:0/3386115968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb31c1076a0 msgr2=0x7fb31c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.750+0000 7fb32110a640 1 --2- 172.21.15.59:0/3386115968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb31c1076a0 0x7fb31c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.750+0000 7fb32110a640 1 -- 172.21.15.59:0/3386115968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb31c101c90 msgr2=0x7fb31c197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.750+0000 7fb32110a640 1 --2- 172.21.15.59:0/3386115968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb31c101c90 0x7fb31c197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.750+0000 7fb32110a640 1 -- 172.21.15.59:0/3386115968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb31c19dff0 con 0x7fb31c108020 2024-09-10T21:19:45.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.750+0000 7fb32110a640 1 --2- 172.21.15.59:0/3386115968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c108020 0x7fb31c19d820 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb30402a930 tx=0x7fb304030710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:45.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.750+0000 7fb319ffb640 1 -- 172.21.15.59:0/3386115968 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30403f070 con 0x7fb31c108020 2024-09-10T21:19:45.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.750+0000 7fb322b6d640 1 -- 172.21.15.59:0/3386115968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb31c19e280 con 0x7fb31c108020 2024-09-10T21:19:45.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.750+0000 7fb319ffb640 1 -- 172.21.15.59:0/3386115968 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb304004460 con 0x7fb31c108020 2024-09-10T21:19:45.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.750+0000 7fb319ffb640 1 -- 172.21.15.59:0/3386115968 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb304035030 con 0x7fb31c108020 2024-09-10T21:19:45.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.751+0000 7fb322b6d640 1 -- 172.21.15.59:0/3386115968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb31c1a49a0 con 0x7fb31c108020 2024-09-10T21:19:45.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.754+0000 7fb324f42740 1 Processor -- start 2024-09-10T21:19:45.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.754+0000 7fb319ffb640 1 -- 172.21.15.59:0/3386115968 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fb30403b460 con 0x7fb31c108020 2024-09-10T21:19:45.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.754+0000 7fb324f42740 1 -- start start 2024-09-10T21:19:45.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.754+0000 7fb324f42740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae520504d0 0x55ae520508b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:45.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.754+0000 7fb324f42740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae52050df0 0x55ae5205c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:45.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.754+0000 7fb324f42740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae5205cd80 0x55ae5205f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:45.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.754+0000 7fb324f42740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ae51fc6ea0 con 0x55ae520504d0 2024-09-10T21:19:45.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.754+0000 7fb324f42740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ae51fb62d0 con 0x55ae5205cd80 2024-09-10T21:19:45.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.754+0000 7fb324f42740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ae51fba0e0 con 0x55ae52050df0 2024-09-10T21:19:45.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.754+0000 7fb31bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae520504d0 0x55ae520508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:45.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.755+0000 7fb320909640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae52050df0 0x55ae5205c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:45.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.755+0000 7fb31bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae520504d0 0x55ae520508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37730/0 (socket says 172.21.15.59:37730) 2024-09-10T21:19:45.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.755+0000 7fb31bfff640 1 -- 172.21.15.59:0/169400754 learned_addr learned my addr 172.21.15.59:0/169400754 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:45.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.755+0000 7fb31bfff640 1 --2- 172.21.15.59:0/169400754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae5205cd80 0x55ae5205f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:45.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.755+0000 7fb320909640 1 -- 172.21.15.59:0/169400754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae5205cd80 msgr2=0x55ae5205f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:45.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.755+0000 7fb320909640 1 --2- 172.21.15.59:0/169400754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae5205cd80 0x55ae5205f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.755+0000 7fb320909640 1 -- 172.21.15.59:0/169400754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae520504d0 msgr2=0x55ae520508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:45.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.755+0000 7fb320909640 1 --2- 172.21.15.59:0/169400754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae520504d0 0x55ae520508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.755+0000 7fb320909640 1 -- 172.21.15.59:0/169400754 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae51d14650 con 0x55ae52050df0 2024-09-10T21:19:45.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.755+0000 7fb319ffb640 1 --2- 172.21.15.59:0/3386115968 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb3080b52e0 0x7fb3080b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:45.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.755+0000 7fb31bfff640 1 --2- 172.21.15.59:0/169400754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae5205cd80 0x55ae5205f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:45.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.755+0000 7fb31bfff640 1 --2- 172.21.15.59:0/3386115968 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb3080b52e0 0x7fb3080b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:45.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.755+0000 7fb319ffb640 1 -- 172.21.15.59:0/3386115968 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fb304106d10 con 0x7fb31c108020 2024-09-10T21:19:45.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.755+0000 7fb320909640 1 --2- 172.21.15.59:0/169400754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae52050df0 0x55ae5205c840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb31400ab40 tx=0x7fb31400f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9770778853ea45b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:45.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.755+0000 7fb312ffd640 1 -- 172.21.15.59:0/169400754 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314004020 con 0x55ae52050df0 2024-09-10T21:19:45.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.756+0000 7fb312ffd640 1 -- 172.21.15.59:0/169400754 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3140041c0 con 0x55ae52050df0 2024-09-10T21:19:45.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.756+0000 7fb312ffd640 1 -- 172.21.15.59:0/169400754 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314018720 con 0x55ae52050df0 2024-09-10T21:19:45.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.756+0000 7fb324f42740 1 -- 172.21.15.59:0/169400754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae52050df0 msgr2=0x55ae5205c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:45.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.756+0000 7fb324f42740 1 --2- 172.21.15.59:0/169400754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae52050df0 0x55ae5205c840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb31400ab40 tx=0x7fb31400f3c0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.756+0000 7fb31bfff640 1 --2- 172.21.15.59:0/3386115968 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb3080b52e0 0x7fb3080b77a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0126a0 tx=0x7fb30c00aa80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:45.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.756+0000 7fb324f42740 1 -- 172.21.15.59:0/169400754 shutdown_connections 2024-09-10T21:19:45.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.756+0000 7fb324f42740 1 --2- 172.21.15.59:0/169400754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae5205cd80 0x55ae5205f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.756+0000 7fb324f42740 1 --2- 172.21.15.59:0/169400754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae52050df0 0x55ae5205c840 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.756+0000 7fb324f42740 1 --2- 172.21.15.59:0/169400754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae520504d0 0x55ae520508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.756+0000 7fb324f42740 1 -- 172.21.15.59:0/169400754 >> 172.21.15.59:0/169400754 conn(0x55ae5204e300 msgr2=0x55ae5204f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:45.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.756+0000 7fb324f42740 1 -- 172.21.15.59:0/169400754 shutdown_connections 2024-09-10T21:19:45.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.756+0000 7fb324f42740 1 -- 172.21.15.59:0/169400754 wait complete. 2024-09-10T21:19:45.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.757+0000 7fb324f42740 1 -- start start 2024-09-10T21:19:45.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.757+0000 7fb324f42740 1 Processor -- start 2024-09-10T21:19:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.757+0000 7fb324f42740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae520504d0 0x55ae5205bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.757+0000 7fb324f42740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae52050df0 0x55ae5205c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.757+0000 7fb324f42740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae5205cd80 0x55ae52064400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.757+0000 7fb324f42740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ae51e17700 con 0x55ae520504d0 2024-09-10T21:19:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.757+0000 7fb324f42740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ae51f51160 con 0x55ae52050df0 2024-09-10T21:19:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.757+0000 7fb324f42740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ae5205fa00 con 0x55ae5205cd80 2024-09-10T21:19:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.757+0000 7fb320909640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae520504d0 0x55ae5205bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.757+0000 7fb324f42740 10 client.0 _ll_register_callbacks cb 0x55ae51f6a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.757+0000 7fb320909640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae520504d0 0x55ae5205bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37738/0 (socket says 172.21.15.59:37738) 2024-09-10T21:19:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.757+0000 7fb320909640 1 -- 172.21.15.59:0/2717376742 learned_addr learned my addr 172.21.15.59:0/2717376742 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.758+0000 7fb32110a640 1 --2- 172.21.15.59:0/2717376742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae5205cd80 0x55ae52064400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.758+0000 7fb31bfff640 1 --2- 172.21.15.59:0/2717376742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae52050df0 0x55ae5205c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.758+0000 7fb320909640 1 -- 172.21.15.59:0/2717376742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae5205cd80 msgr2=0x55ae52064400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.758+0000 7fb320909640 1 --2- 172.21.15.59:0/2717376742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae5205cd80 0x55ae52064400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.758+0000 7fb320909640 1 -- 172.21.15.59:0/2717376742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae52050df0 msgr2=0x55ae5205c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.758+0000 7fb320909640 1 --2- 172.21.15.59:0/2717376742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae52050df0 0x55ae5205c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.758+0000 7fb320909640 1 -- 172.21.15.59:0/2717376742 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae51f7ec90 con 0x55ae520504d0 2024-09-10T21:19:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.758+0000 7fb32110a640 1 --2- 172.21.15.59:0/2717376742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae5205cd80 0x55ae52064400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.758+0000 7fb31bfff640 1 --2- 172.21.15.59:0/2717376742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae52050df0 0x55ae5205c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.758+0000 7fb320909640 1 --2- 172.21.15.59:0/2717376742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae520504d0 0x55ae5205bdc0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb31400a740 tx=0x7fb314003b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf28c059bc70f46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.758+0000 7fb2fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.758+0000 7fb2fbfff640 1 -- 172.21.15.59:0/2717376742 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314027020 con 0x55ae520504d0 2024-09-10T21:19:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.758+0000 7fb2fbfff640 1 -- 172.21.15.59:0/2717376742 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fb31400fe00 con 0x55ae520504d0 2024-09-10T21:19:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.758+0000 7fb324f42740 1 -- 172.21.15.59:0/2717376742 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3140041c0 con 0x55ae520504d0 2024-09-10T21:19:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.758+0000 7fb2fbfff640 1 -- 172.21.15.59:0/2717376742 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb314005cc0 con 0x55ae520504d0 2024-09-10T21:19:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.758+0000 7fb324f42740 10 client.16446 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.758+0000 7fb324f42740 1 -- 172.21.15.59:0/2717376742 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ae5206d400 con 0x55ae520504d0 2024-09-10T21:19:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.759+0000 7fb2fbfff640 1 -- 172.21.15.59:0/2717376742 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3140041c0 con 0x55ae520504d0 2024-09-10T21:19:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.759+0000 7fb2fbfff640 1 -- 172.21.15.59:0/2717376742 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb314004b80 con 0x55ae520504d0 2024-09-10T21:19:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.759+0000 7fb324f42740 10 client.16446 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.759+0000 7fb324f42740 10 client.16446 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:19:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.759+0000 7fb324f42740 20 client.16446 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:45.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.759+0000 7fb324f42740 1 --2- 172.21.15.59:0/2717376742 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55ae5206e7b0 0x55ae52070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:45.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.759+0000 7fb324f42740 4 client.16446 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:19:45.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.759+0000 7fb324f42740 1 -- 172.21.15.59:0/2717376742 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae51fc8df0 con 0x55ae5206e7b0 2024-09-10T21:19:45.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.759+0000 7fb31bfff640 1 --2- 172.21.15.59:0/2717376742 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55ae5206e7b0 0x55ae52070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:45.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.760+0000 7fb2fbfff640 10 client.16446 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:19:45.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.760+0000 7fb31bfff640 1 --2- 172.21.15.59:0/2717376742 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55ae5206e7b0 0x55ae52070ba0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=55f08b82eeef459 server_cookie=23a36479e9a5df79 in_seq=0 out_seq=0 2024-09-10T21:19:45.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.761+0000 7fb2fbfff640 1 -- 172.21.15.59:0/2717376742 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ae51fc8df0 con 0x55ae5206e7b0 2024-09-10T21:19:45.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.761+0000 7fb2fbfff640 10 client.16446 handle_command_reply: tid=0 2024-09-10T21:19:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.761+0000 7fb324f42740 1 client.16446 shutdown 2024-09-10T21:19:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.761+0000 7fb324f42740 1 -- 172.21.15.59:0/2717376742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae520504d0 msgr2=0x55ae5205bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.761+0000 7fb324f42740 1 --2- 172.21.15.59:0/2717376742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae520504d0 0x55ae5205bdc0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb31400a740 tx=0x7fb314003b70 comp rx=0 tx=0).stop 2024-09-10T21:19:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.761+0000 7fb324f42740 1 -- 172.21.15.59:0/2717376742 shutdown_connections 2024-09-10T21:19:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.761+0000 7fb324f42740 1 --2- 172.21.15.59:0/2717376742 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55ae5206e7b0 0x55ae52070ba0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.761+0000 7fb2fbfff640 0 client.16446 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:19:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.761+0000 7fb324f42740 1 --2- 172.21.15.59:0/2717376742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae5205cd80 0x55ae52064400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.761+0000 7fb324f42740 1 --2- 172.21.15.59:0/2717376742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae52050df0 0x55ae5205c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.761+0000 7fb324f42740 1 --2- 172.21.15.59:0/2717376742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae520504d0 0x55ae5205bdc0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.761+0000 7fb324f42740 1 -- 172.21.15.59:0/2717376742 >> 172.21.15.59:0/2717376742 conn(0x55ae5204e300 msgr2=0x55ae52053e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.761+0000 7fb324f42740 1 -- 172.21.15.59:0/2717376742 shutdown_connections 2024-09-10T21:19:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.761+0000 7fb324f42740 1 -- 172.21.15.59:0/2717376742 wait complete. 2024-09-10T21:19:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.761+0000 7fb324f42740 20 client.16446 trim_cache size 0 max 16384 2024-09-10T21:19:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb324f42740 1 Processor -- start 2024-09-10T21:19:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb324f42740 1 -- start start 2024-09-10T21:19:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb324f42740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae520504d0 0x55ae5205b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb324f42740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae52050df0 0x55ae5204d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb324f42740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae5205cd80 0x55ae52076250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb324f42740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c1abff0 con 0x55ae52050df0 2024-09-10T21:19:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb324f42740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c1adb30 con 0x55ae5205cd80 2024-09-10T21:19:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb324f42740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c1ac6c0 con 0x55ae520504d0 2024-09-10T21:19:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb31bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae52050df0 0x55ae5204d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb31bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae52050df0 0x55ae5204d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37740/0 (socket says 172.21.15.59:37740) 2024-09-10T21:19:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb31bfff640 1 -- 172.21.15.59:0/526389474 learned_addr learned my addr 172.21.15.59:0/526389474 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb320909640 1 --2- 172.21.15.59:0/526389474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae520504d0 0x55ae5205b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb32110a640 1 --2- 172.21.15.59:0/526389474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae5205cd80 0x55ae52076250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb31bfff640 1 -- 172.21.15.59:0/526389474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae520504d0 msgr2=0x55ae5205b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb31bfff640 1 --2- 172.21.15.59:0/526389474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae520504d0 0x55ae5205b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb31bfff640 1 -- 172.21.15.59:0/526389474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae5205cd80 msgr2=0x55ae52076250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb31bfff640 1 --2- 172.21.15.59:0/526389474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae5205cd80 0x55ae52076250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb31bfff640 1 -- 172.21.15.59:0/526389474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae5205b990 con 0x55ae52050df0 2024-09-10T21:19:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb32110a640 1 --2- 172.21.15.59:0/526389474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae5205cd80 0x55ae52076250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.775+0000 7fb31bfff640 1 --2- 172.21.15.59:0/526389474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae52050df0 0x55ae5204d310 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00a960 tx=0x7fb30c015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832c00aaef11c2e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.776+0000 7fb3127fc640 1 -- 172.21.15.59:0/526389474 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30c004b20 con 0x55ae52050df0 2024-09-10T21:19:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.776+0000 7fb3127fc640 1 -- 172.21.15.59:0/526389474 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb30c004cc0 con 0x55ae52050df0 2024-09-10T21:19:45.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.776+0000 7fb3127fc640 1 -- 172.21.15.59:0/526389474 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30c004220 con 0x55ae52050df0 2024-09-10T21:19:45.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.776+0000 7fb324f42740 1 -- 172.21.15.59:0/526389474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae52050df0 msgr2=0x55ae5204d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:45.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.776+0000 7fb324f42740 1 --2- 172.21.15.59:0/526389474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae52050df0 0x55ae5204d310 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00a960 tx=0x7fb30c015040 comp rx=0 tx=0).stop 2024-09-10T21:19:45.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.776+0000 7fb324f42740 1 -- 172.21.15.59:0/526389474 shutdown_connections 2024-09-10T21:19:45.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.776+0000 7fb324f42740 1 --2- 172.21.15.59:0/526389474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae5205cd80 0x55ae52076250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.776+0000 7fb324f42740 1 --2- 172.21.15.59:0/526389474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae52050df0 0x55ae5204d310 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.776+0000 7fb324f42740 1 --2- 172.21.15.59:0/526389474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae520504d0 0x55ae5205b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.776+0000 7fb324f42740 1 -- 172.21.15.59:0/526389474 >> 172.21.15.59:0/526389474 conn(0x55ae5204e300 msgr2=0x55ae5204cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:45.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.776+0000 7fb324f42740 1 -- 172.21.15.59:0/526389474 shutdown_connections 2024-09-10T21:19:45.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.776+0000 7fb324f42740 1 -- 172.21.15.59:0/526389474 wait complete. 2024-09-10T21:19:45.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.777+0000 7fb324f42740 1 -- start start 2024-09-10T21:19:45.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.777+0000 7fb324f42740 1 Processor -- start 2024-09-10T21:19:45.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.777+0000 7fb324f42740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae520504d0 0x55ae52069150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:45.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.777+0000 7fb324f42740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae52050df0 0x55ae52069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:45.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.777+0000 7fb324f42740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae5205cd80 0x55ae520da460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:45.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.777+0000 7fb324f42740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c1ad460 con 0x55ae52050df0 2024-09-10T21:19:45.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.777+0000 7fb324f42740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c1acd90 con 0x55ae520504d0 2024-09-10T21:19:45.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.777+0000 7fb324f42740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c1a9ff0 con 0x55ae5205cd80 2024-09-10T21:19:45.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.777+0000 7fb324f42740 10 client.0 _ll_register_callbacks cb 0x7fb30c00a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:45.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.777+0000 7fb31bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae52050df0 0x55ae52069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:45.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.777+0000 7fb31bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae52050df0 0x55ae52069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37746/0 (socket says 172.21.15.59:37746) 2024-09-10T21:19:45.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.777+0000 7fb31bfff640 1 -- 172.21.15.59:0/3303157357 learned_addr learned my addr 172.21.15.59:0/3303157357 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:45.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.777+0000 7fb320909640 1 --2- 172.21.15.59:0/3303157357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae520504d0 0x55ae52069150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:45.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.777+0000 7fb32110a640 1 --2- 172.21.15.59:0/3303157357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae5205cd80 0x55ae520da460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:45.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.778+0000 7fb31bfff640 1 -- 172.21.15.59:0/3303157357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae5205cd80 msgr2=0x55ae520da460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:45.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.778+0000 7fb31bfff640 1 --2- 172.21.15.59:0/3303157357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae5205cd80 0x55ae520da460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.778+0000 7fb31bfff640 1 -- 172.21.15.59:0/3303157357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae520504d0 msgr2=0x55ae52069150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:45.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.778+0000 7fb31bfff640 1 --2- 172.21.15.59:0/3303157357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae520504d0 0x55ae52069150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.778+0000 7fb31bfff640 1 -- 172.21.15.59:0/3303157357 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae520daa50 con 0x55ae52050df0 2024-09-10T21:19:45.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.778+0000 7fb320909640 1 --2- 172.21.15.59:0/3303157357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae520504d0 0x55ae52069150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:19:45.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.778+0000 7fb31bfff640 1 --2- 172.21.15.59:0/3303157357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae52050df0 0x55ae52069690 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fb30c003c50 tx=0x7fb30c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b051e9bc624bc80a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:45.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.778+0000 7fb2fbfff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:45.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.778+0000 7fb2fbfff640 1 -- 172.21.15.59:0/3303157357 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30c01ecc0 con 0x55ae52050df0 2024-09-10T21:19:45.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.778+0000 7fb2fbfff640 1 -- 172.21.15.59:0/3303157357 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fb30c003f20 con 0x55ae52050df0 2024-09-10T21:19:45.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.778+0000 7fb324f42740 1 -- 172.21.15.59:0/3303157357 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb30c004cc0 con 0x55ae52050df0 2024-09-10T21:19:45.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.778+0000 7fb2fbfff640 1 -- 172.21.15.59:0/3303157357 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb30c004120 con 0x55ae52050df0 2024-09-10T21:19:45.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.778+0000 7fb324f42740 10 client.16452 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:45.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.778+0000 7fb324f42740 1 -- 172.21.15.59:0/3303157357 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ae5205d160 con 0x55ae52050df0 2024-09-10T21:19:45.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.778+0000 7fb2fbfff640 1 -- 172.21.15.59:0/3303157357 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb30c004cc0 con 0x55ae52050df0 2024-09-10T21:19:45.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.779+0000 7fb2fbfff640 1 -- 172.21.15.59:0/3303157357 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb30c01a040 con 0x55ae52050df0 2024-09-10T21:19:45.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.779+0000 7fb324f42740 10 client.16452 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:45.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.779+0000 7fb324f42740 10 client.16452 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:19:45.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.779+0000 7fb324f42740 20 client.16452 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:45.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.779+0000 7fb324f42740 1 --2- 172.21.15.59:0/3303157357 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55ae5205d8b0 0x55ae5205dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:45.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.779+0000 7fb324f42740 4 client.16452 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:19:45.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.779+0000 7fb324f42740 1 -- 172.21.15.59:0/3303157357 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ae51fc48a0 con 0x55ae5205d8b0 2024-09-10T21:19:45.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.779+0000 7fb320909640 1 --2- 172.21.15.59:0/3303157357 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55ae5205d8b0 0x55ae5205dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:45.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.779+0000 7fb2fbfff640 10 client.16452 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:19:45.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.779+0000 7fb320909640 1 --2- 172.21.15.59:0/3303157357 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55ae5205d8b0 0x55ae5205dcc0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d8e285921bd7c129 server_cookie=be3bbcb48ed7fba5 in_seq=0 out_seq=0 2024-09-10T21:19:45.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.780+0000 7fb2fbfff640 1 -- 172.21.15.59:0/3303157357 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ae51fc48a0 con 0x55ae5205d8b0 2024-09-10T21:19:45.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.780+0000 7fb2fbfff640 10 client.16452 handle_command_reply: tid=0 2024-09-10T21:19:45.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.780+0000 7fb324f42740 1 client.16452 shutdown 2024-09-10T21:19:45.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.780+0000 7fb324f42740 1 -- 172.21.15.59:0/3303157357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae52050df0 msgr2=0x55ae52069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:45.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.780+0000 7fb324f42740 1 --2- 172.21.15.59:0/3303157357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae52050df0 0x55ae52069690 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fb30c003c50 tx=0x7fb30c003c80 comp rx=0 tx=0).stop 2024-09-10T21:19:45.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.780+0000 7fb324f42740 1 -- 172.21.15.59:0/3303157357 shutdown_connections 2024-09-10T21:19:45.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.780+0000 7fb324f42740 1 --2- 172.21.15.59:0/3303157357 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55ae5205d8b0 0x55ae5205dcc0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.780+0000 7fb2fbfff640 0 client.16452 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:19:45.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.780+0000 7fb324f42740 1 --2- 172.21.15.59:0/3303157357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ae5205cd80 0x55ae520da460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.780+0000 7fb324f42740 1 --2- 172.21.15.59:0/3303157357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ae52050df0 0x55ae52069690 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.780+0000 7fb324f42740 1 --2- 172.21.15.59:0/3303157357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae520504d0 0x55ae52069150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.780+0000 7fb324f42740 1 -- 172.21.15.59:0/3303157357 >> 172.21.15.59:0/3303157357 conn(0x55ae5204e300 msgr2=0x55ae5204d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.780+0000 7fb324f42740 1 -- 172.21.15.59:0/3303157357 shutdown_connections 2024-09-10T21:19:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.780+0000 7fb324f42740 1 -- 172.21.15.59:0/3303157357 wait complete. 2024-09-10T21:19:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.780+0000 7fb324f42740 20 client.16452 trim_cache size 0 max 16384 2024-09-10T21:19:45.793 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:19:45.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.781+0000 7fb322b6d640 1 -- 172.21.15.59:0/3386115968 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb3080b52e0 msgr2=0x7fb3080b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:45.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.781+0000 7fb322b6d640 1 --2- 172.21.15.59:0/3386115968 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb3080b52e0 0x7fb3080b77a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0126a0 tx=0x7fb30c00aa80 comp rx=0 tx=0).stop 2024-09-10T21:19:45.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.781+0000 7fb322b6d640 1 -- 172.21.15.59:0/3386115968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c108020 msgr2=0x7fb31c19d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:45.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.781+0000 7fb322b6d640 1 --2- 172.21.15.59:0/3386115968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c108020 0x7fb31c19d820 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb30402a930 tx=0x7fb304030710 comp rx=0 tx=0).stop 2024-09-10T21:19:45.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.781+0000 7fb322b6d640 1 -- 172.21.15.59:0/3386115968 shutdown_connections 2024-09-10T21:19:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.781+0000 7fb322b6d640 1 --2- 172.21.15.59:0/3386115968 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb3080b52e0 0x7fb3080b77a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.781+0000 7fb322b6d640 1 --2- 172.21.15.59:0/3386115968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb31c108020 0x7fb31c19d820 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.781+0000 7fb322b6d640 1 --2- 172.21.15.59:0/3386115968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb31c1076a0 0x7fb31c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.781+0000 7fb322b6d640 1 --2- 172.21.15.59:0/3386115968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb31c101c90 0x7fb31c197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.781+0000 7fb322b6d640 1 -- 172.21.15.59:0/3386115968 >> 172.21.15.59:0/3386115968 conn(0x7fb31c0fd700 msgr2=0x7fb31c0fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.781+0000 7fb322b6d640 1 -- 172.21.15.59:0/3386115968 shutdown_connections 2024-09-10T21:19:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:45.781+0000 7fb322b6d640 1 -- 172.21.15.59:0/3386115968 wait complete. 2024-09-10T21:19:46.648 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:46 smithi059 ceph-mon[30888]: pgmap v475: 97 pgs: 97 active+clean; 3.0 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:19:46.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:19:46.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:46 smithi154 ceph-mon[35041]: pgmap v475: 97 pgs: 97 active+clean; 3.0 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:19:46.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:46 smithi192 ceph-mon[35363]: pgmap v475: 97 pgs: 97 active+clean; 3.0 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:19:46.913 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:19:47.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.393+0000 7f189cafc640 1 -- 172.21.15.59:0/2349070828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1898101c90 msgr2=0x7f1898102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:47.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.393+0000 7f189cafc640 1 --2- 172.21.15.59:0/2349070828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1898101c90 0x7f1898102070 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f1888009900 tx=0x7f188802a410 comp rx=0 tx=0).stop 2024-09-10T21:19:47.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.393+0000 7f189cafc640 1 -- 172.21.15.59:0/2349070828 shutdown_connections 2024-09-10T21:19:47.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.393+0000 7f189cafc640 1 --2- 172.21.15.59:0/2349070828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1898108020 0x7f189810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.393+0000 7f189cafc640 1 --2- 172.21.15.59:0/2349070828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18981076a0 0x7f1898107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.393+0000 7f189cafc640 1 --2- 172.21.15.59:0/2349070828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1898101c90 0x7f1898102070 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.393+0000 7f189cafc640 1 -- 172.21.15.59:0/2349070828 >> 172.21.15.59:0/2349070828 conn(0x7f18980fd700 msgr2=0x7f18980ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:47.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.393+0000 7f189cafc640 1 -- 172.21.15.59:0/2349070828 shutdown_connections 2024-09-10T21:19:47.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.393+0000 7f189cafc640 1 -- 172.21.15.59:0/2349070828 wait complete. 2024-09-10T21:19:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.393+0000 7f189cafc640 1 Processor -- start 2024-09-10T21:19:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.394+0000 7f189cafc640 1 -- start start 2024-09-10T21:19:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.394+0000 7f189cafc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1898101c90 0x7f1898199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.394+0000 7f189cafc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18981076a0 0x7f1898199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.394+0000 7f189cafc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1898108020 0x7f189819ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.394+0000 7f189cafc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1898111ce0 con 0x7f18981076a0 2024-09-10T21:19:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.394+0000 7f189cafc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1898111b60 con 0x7f1898101c90 2024-09-10T21:19:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.394+0000 7f189cafc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1898111e60 con 0x7f1898108020 2024-09-10T21:19:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.394+0000 7f188ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18981076a0 0x7f1898199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.394+0000 7f188ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18981076a0 0x7f1898199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37758/0 (socket says 172.21.15.59:37758) 2024-09-10T21:19:47.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.394+0000 7f188ffff640 1 -- 172.21.15.59:0/727315854 learned_addr learned my addr 172.21.15.59:0/727315854 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:47.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.394+0000 7f188ffff640 1 -- 172.21.15.59:0/727315854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1898108020 msgr2=0x7f189819ebf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T21:19:47.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.394+0000 7f188ffff640 1 --2- 172.21.15.59:0/727315854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1898108020 0x7f189819ebf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.394+0000 7f188ffff640 1 -- 172.21.15.59:0/727315854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1898101c90 msgr2=0x7f1898199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:47.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.394+0000 7f189659c640 1 --2- 172.21.15.59:0/727315854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1898101c90 0x7f1898199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:47.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.394+0000 7f188ffff640 1 --2- 172.21.15.59:0/727315854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1898101c90 0x7f1898199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.394+0000 7f188ffff640 1 -- 172.21.15.59:0/727315854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f189819f3c0 con 0x7f18981076a0 2024-09-10T21:19:47.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.394+0000 7f188ffff640 1 --2- 172.21.15.59:0/727315854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18981076a0 0x7f1898199850 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f188000d950 tx=0x7f188000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:47.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.394+0000 7f188f7fe640 1 -- 172.21.15.59:0/727315854 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1880017070 con 0x7f18981076a0 2024-09-10T21:19:47.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.395+0000 7f188f7fe640 1 -- 172.21.15.59:0/727315854 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1880009c30 con 0x7f18981076a0 2024-09-10T21:19:47.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.395+0000 7f189cafc640 1 -- 172.21.15.59:0/727315854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f189819f6b0 con 0x7f18981076a0 2024-09-10T21:19:47.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.395+0000 7f188f7fe640 1 -- 172.21.15.59:0/727315854 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188000f620 con 0x7f18981076a0 2024-09-10T21:19:47.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.395+0000 7f189cafc640 1 -- 172.21.15.59:0/727315854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18981a5df0 con 0x7f18981076a0 2024-09-10T21:19:47.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.397+0000 7f188f7fe640 1 -- 172.21.15.59:0/727315854 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f1880010460 con 0x7f18981076a0 2024-09-10T21:19:47.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.397+0000 7f189eed1740 1 Processor -- start 2024-09-10T21:19:47.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.397+0000 7f189eed1740 1 -- start start 2024-09-10T21:19:47.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.398+0000 7f189eed1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af14d0f0 0x55d0af14d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:47.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.398+0000 7f189eed1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14da10 0x55d0af159460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:47.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.398+0000 7f189eed1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af1599a0 0x55d0af15bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:47.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.398+0000 7f189eed1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d0af0c3ea0 con 0x55d0af14da10 2024-09-10T21:19:47.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.398+0000 7f189eed1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d0af0b32d0 con 0x55d0af14d0f0 2024-09-10T21:19:47.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.398+0000 7f189eed1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d0af0b70e0 con 0x55d0af1599a0 2024-09-10T21:19:47.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.398+0000 7f189659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14da10 0x55d0af159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:47.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.398+0000 7f189659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14da10 0x55d0af159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37768/0 (socket says 172.21.15.59:37768) 2024-09-10T21:19:47.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.398+0000 7f189659c640 1 -- 172.21.15.59:0/4254740796 learned_addr learned my addr 172.21.15.59:0/4254740796 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:47.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.398+0000 7f1896d9d640 1 --2- 172.21.15.59:0/4254740796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af14d0f0 0x55d0af14d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:47.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.398+0000 7f188ffff640 1 --2- 172.21.15.59:0/4254740796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af1599a0 0x55d0af15bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:47.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.398+0000 7f189659c640 1 -- 172.21.15.59:0/4254740796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af1599a0 msgr2=0x55d0af15bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:47.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.398+0000 7f189659c640 1 --2- 172.21.15.59:0/4254740796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af1599a0 0x55d0af15bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.398+0000 7f189659c640 1 -- 172.21.15.59:0/4254740796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af14d0f0 msgr2=0x55d0af14d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:47.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.398+0000 7f189659c640 1 --2- 172.21.15.59:0/4254740796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af14d0f0 0x55d0af14d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.398+0000 7f189659c640 1 -- 172.21.15.59:0/4254740796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0aee11650 con 0x55d0af14da10 2024-09-10T21:19:47.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.398+0000 7f188f7fe640 1 --2- 172.21.15.59:0/727315854 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f18840b52e0 0x7f18840b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:47.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.399+0000 7f1896d9d640 1 --2- 172.21.15.59:0/727315854 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f18840b52e0 0x7f18840b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:47.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.399+0000 7f189659c640 1 --2- 172.21.15.59:0/4254740796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14da10 0x55d0af159460 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f1888006010 tx=0x7f1888032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4b30d0c7b77e80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:47.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.399+0000 7f188f7fe640 1 -- 172.21.15.59:0/727315854 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f18800e5950 con 0x7f18981076a0 2024-09-10T21:19:47.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.399+0000 7f1896d9d640 1 --2- 172.21.15.59:0/727315854 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f18840b52e0 0x7f18840b77a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1890009ee0 tx=0x7f189000d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:47.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.400+0000 7f188cff9640 1 -- 172.21.15.59:0/4254740796 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188803f070 con 0x55d0af14da10 2024-09-10T21:19:47.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.400+0000 7f188cff9640 1 -- 172.21.15.59:0/4254740796 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1888032e40 con 0x55d0af14da10 2024-09-10T21:19:47.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.400+0000 7f188cff9640 1 -- 172.21.15.59:0/4254740796 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888035070 con 0x55d0af14da10 2024-09-10T21:19:47.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.401+0000 7f189eed1740 1 -- 172.21.15.59:0/4254740796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14da10 msgr2=0x55d0af159460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:47.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.401+0000 7f189eed1740 1 --2- 172.21.15.59:0/4254740796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14da10 0x55d0af159460 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f1888006010 tx=0x7f1888032c50 comp rx=0 tx=0).stop 2024-09-10T21:19:47.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.401+0000 7f189eed1740 1 -- 172.21.15.59:0/4254740796 shutdown_connections 2024-09-10T21:19:47.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.401+0000 7f189eed1740 1 --2- 172.21.15.59:0/4254740796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af1599a0 0x55d0af15bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.401+0000 7f189eed1740 1 --2- 172.21.15.59:0/4254740796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14da10 0x55d0af159460 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.401+0000 7f189eed1740 1 --2- 172.21.15.59:0/4254740796 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af14d0f0 0x55d0af14d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.401+0000 7f189eed1740 1 -- 172.21.15.59:0/4254740796 >> 172.21.15.59:0/4254740796 conn(0x55d0af14af20 msgr2=0x55d0af14c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:47.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.401+0000 7f189eed1740 1 -- 172.21.15.59:0/4254740796 shutdown_connections 2024-09-10T21:19:47.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.401+0000 7f189eed1740 1 -- 172.21.15.59:0/4254740796 wait complete. 2024-09-10T21:19:47.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.401+0000 7f189eed1740 1 -- start start 2024-09-10T21:19:47.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.401+0000 7f189eed1740 1 Processor -- start 2024-09-10T21:19:47.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.402+0000 7f189eed1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af14d0f0 0x55d0af1592d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:47.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.402+0000 7f189eed1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14da10 0x55d0af156720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:47.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.402+0000 7f189eed1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af1599a0 0x55d0af156da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:47.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.402+0000 7f189eed1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d0aef14700 con 0x55d0af14da10 2024-09-10T21:19:47.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.402+0000 7f189eed1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d0af04e160 con 0x55d0af14d0f0 2024-09-10T21:19:47.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.402+0000 7f189eed1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d0af15c5c0 con 0x55d0af1599a0 2024-09-10T21:19:47.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.402+0000 7f189eed1740 10 client.0 _ll_register_callbacks cb 0x55d0af0679e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:47.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.402+0000 7f188ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14da10 0x55d0af156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:47.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.402+0000 7f188ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14da10 0x55d0af156720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37784/0 (socket says 172.21.15.59:37784) 2024-09-10T21:19:47.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.402+0000 7f188ffff640 1 -- 172.21.15.59:0/3760493362 learned_addr learned my addr 172.21.15.59:0/3760493362 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:47.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.402+0000 7f1896d9d640 1 --2- 172.21.15.59:0/3760493362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af1599a0 0x55d0af156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:47.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.402+0000 7f189659c640 1 --2- 172.21.15.59:0/3760493362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af14d0f0 0x55d0af1592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:47.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.402+0000 7f188ffff640 1 -- 172.21.15.59:0/3760493362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af1599a0 msgr2=0x55d0af156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:47.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.402+0000 7f188ffff640 1 --2- 172.21.15.59:0/3760493362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af1599a0 0x55d0af156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.402+0000 7f188ffff640 1 -- 172.21.15.59:0/3760493362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af14d0f0 msgr2=0x55d0af1592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:47.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.402+0000 7f188ffff640 1 --2- 172.21.15.59:0/3760493362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af14d0f0 0x55d0af1592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.402+0000 7f188ffff640 1 -- 172.21.15.59:0/3760493362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0af07bc90 con 0x55d0af14da10 2024-09-10T21:19:47.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.402+0000 7f188ffff640 1 --2- 172.21.15.59:0/3760493362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14da10 0x55d0af156720 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f18800a86b0 tx=0x7f18800e9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124c8c1cf5d3abce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:47.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.402+0000 7f187dffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:47.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.403+0000 7f187dffb640 1 -- 172.21.15.59:0/3760493362 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1880020070 con 0x55d0af14da10 2024-09-10T21:19:47.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.403+0000 7f187dffb640 1 -- 172.21.15.59:0/3760493362 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f18800ab540 con 0x55d0af14da10 2024-09-10T21:19:47.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.403+0000 7f189eed1740 1 -- 172.21.15.59:0/3760493362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d0af0c5df0 con 0x55d0af14da10 2024-09-10T21:19:47.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.403+0000 7f187dffb640 1 -- 172.21.15.59:0/3760493362 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f18800abeb0 con 0x55d0af14da10 2024-09-10T21:19:47.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.403+0000 7f189eed1740 10 client.16464 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:47.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.403+0000 7f189eed1740 1 -- 172.21.15.59:0/3760493362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d0af167f60 con 0x55d0af14da10 2024-09-10T21:19:47.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.403+0000 7f187dffb640 1 -- 172.21.15.59:0/3760493362 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d0af0c5df0 con 0x55d0af14da10 2024-09-10T21:19:47.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.403+0000 7f187dffb640 1 -- 172.21.15.59:0/3760493362 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f18800a7a30 con 0x55d0af14da10 2024-09-10T21:19:47.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.403+0000 7f189eed1740 10 client.16464 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:47.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.403+0000 7f189eed1740 10 client.16464 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:19:47.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.403+0000 7f189eed1740 20 client.16464 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:47.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.403+0000 7f189eed1740 1 --2- 172.21.15.59:0/3760493362 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55d0af169420 0x55d0af16b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:47.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.403+0000 7f189eed1740 4 client.16464 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:19:47.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.403+0000 7f189eed1740 1 -- 172.21.15.59:0/3760493362 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0af0c18a0 con 0x55d0af169420 2024-09-10T21:19:47.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.404+0000 7f189659c640 1 --2- 172.21.15.59:0/3760493362 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55d0af169420 0x55d0af16b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:47.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.407+0000 7f189659c640 1 --2- 172.21.15.59:0/3760493362 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55d0af169420 0x55d0af16b850 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e7c3977b9511bc11 server_cookie=7d604a0883b988ce in_seq=0 out_seq=0 2024-09-10T21:19:47.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.407+0000 7f187dffb640 10 client.16464 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:19:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.408+0000 7f187dffb640 1 -- 172.21.15.59:0/3760493362 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d0af0c18a0 con 0x55d0af169420 2024-09-10T21:19:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.408+0000 7f187dffb640 10 client.16464 handle_command_reply: tid=0 2024-09-10T21:19:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.408+0000 7f189eed1740 1 client.16464 shutdown 2024-09-10T21:19:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.408+0000 7f189eed1740 1 -- 172.21.15.59:0/3760493362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14da10 msgr2=0x55d0af156720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.408+0000 7f189eed1740 1 --2- 172.21.15.59:0/3760493362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14da10 0x55d0af156720 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f18800a86b0 tx=0x7f18800e9040 comp rx=0 tx=0).stop 2024-09-10T21:19:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.408+0000 7f189eed1740 1 -- 172.21.15.59:0/3760493362 shutdown_connections 2024-09-10T21:19:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.408+0000 7f189eed1740 1 --2- 172.21.15.59:0/3760493362 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55d0af169420 0x55d0af16b850 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.408+0000 7f189eed1740 1 --2- 172.21.15.59:0/3760493362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af1599a0 0x55d0af156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.408+0000 7f189eed1740 1 --2- 172.21.15.59:0/3760493362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14da10 0x55d0af156720 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.408+0000 7f189eed1740 1 --2- 172.21.15.59:0/3760493362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af14d0f0 0x55d0af1592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.408+0000 7f189eed1740 1 -- 172.21.15.59:0/3760493362 >> 172.21.15.59:0/3760493362 conn(0x55d0af14af20 msgr2=0x55d0af150ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.408+0000 7f187dffb640 0 client.16464 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:19:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.408+0000 7f189eed1740 1 -- 172.21.15.59:0/3760493362 shutdown_connections 2024-09-10T21:19:47.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.408+0000 7f189eed1740 1 -- 172.21.15.59:0/3760493362 wait complete. 2024-09-10T21:19:47.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.408+0000 7f189eed1740 20 client.16464 trim_cache size 0 max 16384 2024-09-10T21:19:47.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f189eed1740 1 Processor -- start 2024-09-10T21:19:47.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f189eed1740 1 -- start start 2024-09-10T21:19:47.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f189eed1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14d0f0 0x55d0af14a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:47.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f189eed1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af14da10 0x55d0af154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:47.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f189eed1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af1599a0 0x55d0af1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:47.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f189eed1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f18981ae350 con 0x55d0af14d0f0 2024-09-10T21:19:47.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f189eed1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f18981afe90 con 0x55d0af1599a0 2024-09-10T21:19:47.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f189eed1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f18981aea20 con 0x55d0af14da10 2024-09-10T21:19:47.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f189659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14d0f0 0x55d0af14a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:47.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f189659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14d0f0 0x55d0af14a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37794/0 (socket says 172.21.15.59:37794) 2024-09-10T21:19:47.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f189659c640 1 -- 172.21.15.59:0/155078148 learned_addr learned my addr 172.21.15.59:0/155078148 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:47.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f189659c640 1 -- 172.21.15.59:0/155078148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af14da10 msgr2=0x55d0af154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:47.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f188ffff640 1 --2- 172.21.15.59:0/155078148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af14da10 0x55d0af154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:47.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f1896d9d640 1 --2- 172.21.15.59:0/155078148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af1599a0 0x55d0af1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:47.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f189659c640 1 --2- 172.21.15.59:0/155078148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af14da10 0x55d0af154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f189659c640 1 -- 172.21.15.59:0/155078148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af1599a0 msgr2=0x55d0af1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:47.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f189659c640 1 --2- 172.21.15.59:0/155078148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af1599a0 0x55d0af1554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f189659c640 1 -- 172.21.15.59:0/155078148 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0af14d840 con 0x55d0af14d0f0 2024-09-10T21:19:47.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f188ffff640 1 --2- 172.21.15.59:0/155078148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af14da10 0x55d0af154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:47.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.422+0000 7f189659c640 1 --2- 172.21.15.59:0/155078148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14d0f0 0x55d0af14a760 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f1888004650 tx=0x7f18880052c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b976939349d978c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:47.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.423+0000 7f187ffff640 1 -- 172.21.15.59:0/155078148 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188803f040 con 0x55d0af14d0f0 2024-09-10T21:19:47.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.423+0000 7f187ffff640 1 -- 172.21.15.59:0/155078148 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f188803b460 con 0x55d0af14d0f0 2024-09-10T21:19:47.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.423+0000 7f187ffff640 1 -- 172.21.15.59:0/155078148 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888035040 con 0x55d0af14d0f0 2024-09-10T21:19:47.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.423+0000 7f189eed1740 1 -- 172.21.15.59:0/155078148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14d0f0 msgr2=0x55d0af14a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:47.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.423+0000 7f189eed1740 1 --2- 172.21.15.59:0/155078148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14d0f0 0x55d0af14a760 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f1888004650 tx=0x7f18880052c0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.423+0000 7f189eed1740 1 -- 172.21.15.59:0/155078148 shutdown_connections 2024-09-10T21:19:47.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.423+0000 7f189eed1740 1 --2- 172.21.15.59:0/155078148 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af1599a0 0x55d0af1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.423+0000 7f189eed1740 1 --2- 172.21.15.59:0/155078148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af14da10 0x55d0af154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.423+0000 7f189eed1740 1 --2- 172.21.15.59:0/155078148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af14d0f0 0x55d0af14a760 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.423+0000 7f189eed1740 1 -- 172.21.15.59:0/155078148 >> 172.21.15.59:0/155078148 conn(0x55d0af14af20 msgr2=0x55d0af14bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:47.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.423+0000 7f189eed1740 1 -- 172.21.15.59:0/155078148 shutdown_connections 2024-09-10T21:19:47.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.423+0000 7f189eed1740 1 -- 172.21.15.59:0/155078148 wait complete. 2024-09-10T21:19:47.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.424+0000 7f189eed1740 1 -- start start 2024-09-10T21:19:47.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.424+0000 7f189eed1740 1 Processor -- start 2024-09-10T21:19:47.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.424+0000 7f189eed1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af14d0f0 0x55d0af1d3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:47.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.424+0000 7f189eed1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af14da10 0x55d0af1d38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:47.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.424+0000 7f189eed1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af1599a0 0x55d0af1d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:47.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.424+0000 7f189eed1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f18981af7c0 con 0x55d0af1599a0 2024-09-10T21:19:47.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.424+0000 7f189eed1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f18981af0f0 con 0x55d0af14d0f0 2024-09-10T21:19:47.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.424+0000 7f189eed1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f18981ac330 con 0x55d0af14da10 2024-09-10T21:19:47.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.424+0000 7f189eed1740 10 client.0 _ll_register_callbacks cb 0x7f188000df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.424+0000 7f1896d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af1599a0 0x55d0af1d3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.424+0000 7f1896d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af1599a0 0x55d0af1d3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37810/0 (socket says 172.21.15.59:37810) 2024-09-10T21:19:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.424+0000 7f1896d9d640 1 -- 172.21.15.59:0/3116679782 learned_addr learned my addr 172.21.15.59:0/3116679782 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.424+0000 7f189659c640 1 --2- 172.21.15.59:0/3116679782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af14d0f0 0x55d0af1d3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.424+0000 7f188ffff640 1 --2- 172.21.15.59:0/3116679782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af14da10 0x55d0af1d38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.425+0000 7f1896d9d640 1 -- 172.21.15.59:0/3116679782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af14da10 msgr2=0x55d0af1d38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.425+0000 7f1896d9d640 1 --2- 172.21.15.59:0/3116679782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af14da10 0x55d0af1d38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.425+0000 7f1896d9d640 1 -- 172.21.15.59:0/3116679782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af14d0f0 msgr2=0x55d0af1d3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.425+0000 7f1896d9d640 1 --2- 172.21.15.59:0/3116679782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af14d0f0 0x55d0af1d3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.425+0000 7f1896d9d640 1 -- 172.21.15.59:0/3116679782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0af1d04a0 con 0x55d0af1599a0 2024-09-10T21:19:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.425+0000 7f188ffff640 1 --2- 172.21.15.59:0/3116679782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af14da10 0x55d0af1d38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.425+0000 7f1896d9d640 1 --2- 172.21.15.59:0/3116679782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af1599a0 0x55d0af1d3df0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1890016f50 tx=0x7f1890004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da14647af9536cbd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:47.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.425+0000 7f187dffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:47.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.425+0000 7f187dffb640 1 -- 172.21.15.59:0/3116679782 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1890022650 con 0x55d0af1599a0 2024-09-10T21:19:47.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.425+0000 7f187dffb640 1 -- 172.21.15.59:0/3116679782 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f18900227f0 con 0x55d0af1599a0 2024-09-10T21:19:47.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.425+0000 7f189eed1740 1 -- 172.21.15.59:0/3116679782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f188803b460 con 0x55d0af1599a0 2024-09-10T21:19:47.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.425+0000 7f187dffb640 1 -- 172.21.15.59:0/3116679782 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f18900229f0 con 0x55d0af1599a0 2024-09-10T21:19:47.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.425+0000 7f189eed1740 10 client.16470 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:47.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.425+0000 7f189eed1740 1 -- 172.21.15.59:0/3116679782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d0af160ce0 con 0x55d0af1599a0 2024-09-10T21:19:47.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.425+0000 7f187dffb640 1 -- 172.21.15.59:0/3116679782 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f188803b460 con 0x55d0af1599a0 2024-09-10T21:19:47.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.426+0000 7f187dffb640 1 -- 172.21.15.59:0/3116679782 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f189002d3c0 con 0x55d0af1599a0 2024-09-10T21:19:47.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.426+0000 7f189eed1740 10 client.16470 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:47.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.426+0000 7f189eed1740 10 client.16470 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:19:47.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.426+0000 7f189eed1740 20 client.16470 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:47.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.426+0000 7f189eed1740 1 --2- 172.21.15.59:0/3116679782 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55d0af161490 0x55d0af1618a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:47.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.426+0000 7f189eed1740 4 client.16470 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:19:47.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.426+0000 7f189eed1740 1 -- 172.21.15.59:0/3116679782 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d0af0becd0 con 0x55d0af161490 2024-09-10T21:19:47.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.426+0000 7f189659c640 1 --2- 172.21.15.59:0/3116679782 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55d0af161490 0x55d0af1618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:47.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.427+0000 7f189659c640 1 --2- 172.21.15.59:0/3116679782 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55d0af161490 0x55d0af1618a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=685156a9c6dd7cbe server_cookie=daba50811110b923 in_seq=0 out_seq=0 2024-09-10T21:19:47.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.427+0000 7f187dffb640 10 client.16470 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:19:47.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.427+0000 7f187dffb640 1 -- 172.21.15.59:0/3116679782 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d0af0becd0 con 0x55d0af161490 2024-09-10T21:19:47.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.427+0000 7f187dffb640 10 client.16470 handle_command_reply: tid=0 2024-09-10T21:19:47.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.427+0000 7f189eed1740 1 client.16470 shutdown 2024-09-10T21:19:47.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.427+0000 7f189eed1740 1 -- 172.21.15.59:0/3116679782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af1599a0 msgr2=0x55d0af1d3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:47.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.427+0000 7f189eed1740 1 --2- 172.21.15.59:0/3116679782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af1599a0 0x55d0af1d3df0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1890016f50 tx=0x7f1890004a40 comp rx=0 tx=0).stop 2024-09-10T21:19:47.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.427+0000 7f189eed1740 1 -- 172.21.15.59:0/3116679782 shutdown_connections 2024-09-10T21:19:47.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.427+0000 7f189eed1740 1 --2- 172.21.15.59:0/3116679782 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55d0af161490 0x55d0af1618a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.427+0000 7f189eed1740 1 --2- 172.21.15.59:0/3116679782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0af1599a0 0x55d0af1d3df0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.427+0000 7f189eed1740 1 --2- 172.21.15.59:0/3116679782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0af14da10 0x55d0af1d38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.427+0000 7f189eed1740 1 --2- 172.21.15.59:0/3116679782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0af14d0f0 0x55d0af1d3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.427+0000 7f189eed1740 1 -- 172.21.15.59:0/3116679782 >> 172.21.15.59:0/3116679782 conn(0x55d0af14af20 msgr2=0x55d0af154f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:47.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.427+0000 7f187dffb640 0 client.16470 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:19:47.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.427+0000 7f189eed1740 1 -- 172.21.15.59:0/3116679782 shutdown_connections 2024-09-10T21:19:47.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.427+0000 7f189eed1740 1 -- 172.21.15.59:0/3116679782 wait complete. 2024-09-10T21:19:47.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.427+0000 7f189eed1740 20 client.16470 trim_cache size 0 max 16384 2024-09-10T21:19:47.439 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:19:47.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.428+0000 7f189cafc640 1 -- 172.21.15.59:0/727315854 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f18840b52e0 msgr2=0x7f18840b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:47.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.428+0000 7f189cafc640 1 --2- 172.21.15.59:0/727315854 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f18840b52e0 0x7f18840b77a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1890009ee0 tx=0x7f189000d040 comp rx=0 tx=0).stop 2024-09-10T21:19:47.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.428+0000 7f189cafc640 1 -- 172.21.15.59:0/727315854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18981076a0 msgr2=0x7f1898199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:47.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.428+0000 7f189cafc640 1 --2- 172.21.15.59:0/727315854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18981076a0 0x7f1898199850 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f188000d950 tx=0x7f188000de10 comp rx=0 tx=0).stop 2024-09-10T21:19:47.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.428+0000 7f189cafc640 1 -- 172.21.15.59:0/727315854 shutdown_connections 2024-09-10T21:19:47.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.428+0000 7f189cafc640 1 --2- 172.21.15.59:0/727315854 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f18840b52e0 0x7f18840b77a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.428+0000 7f189cafc640 1 --2- 172.21.15.59:0/727315854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1898108020 0x7f189819ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.428+0000 7f189cafc640 1 --2- 172.21.15.59:0/727315854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18981076a0 0x7f1898199850 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.428+0000 7f189cafc640 1 --2- 172.21.15.59:0/727315854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1898101c90 0x7f1898199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:47.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.428+0000 7f189cafc640 1 -- 172.21.15.59:0/727315854 >> 172.21.15.59:0/727315854 conn(0x7f18980fd700 msgr2=0x7f189806adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:47.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.428+0000 7f189cafc640 1 -- 172.21.15.59:0/727315854 shutdown_connections 2024-09-10T21:19:47.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:47.428+0000 7f189cafc640 1 -- 172.21.15.59:0/727315854 wait complete. 2024-09-10T21:19:48.163 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:19:48.423 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:19:48.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:48 smithi059 ceph-mon[30888]: pgmap v476: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:19:48.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:48 smithi154 ceph-mon[35041]: pgmap v476: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:19:48.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:48 smithi192 ceph-mon[35363]: pgmap v476: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:19:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.866+0000 7f522374d640 1 -- 172.21.15.59:0/1844606367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c104600 msgr2=0x7f521c10caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.866+0000 7f522374d640 1 --2- 172.21.15.59:0/1844606367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c104600 0x7f521c10caf0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f520c009900 tx=0x7f520c02a410 comp rx=0 tx=0).stop 2024-09-10T21:19:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.866+0000 7f522374d640 1 -- 172.21.15.59:0/1844606367 shutdown_connections 2024-09-10T21:19:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.866+0000 7f522374d640 1 --2- 172.21.15.59:0/1844606367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f521c10d140 0x7f521c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.866+0000 7f522374d640 1 --2- 172.21.15.59:0/1844606367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c104600 0x7f521c10caf0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.866+0000 7f522374d640 1 --2- 172.21.15.59:0/1844606367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521c103ce0 0x7f521c1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.866+0000 7f522374d640 1 -- 172.21.15.59:0/1844606367 >> 172.21.15.59:0/1844606367 conn(0x7f521c0fd700 msgr2=0x7f521c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.866+0000 7f522374d640 1 -- 172.21.15.59:0/1844606367 shutdown_connections 2024-09-10T21:19:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.866+0000 7f522374d640 1 -- 172.21.15.59:0/1844606367 wait complete. 2024-09-10T21:19:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.867+0000 7f522374d640 1 Processor -- start 2024-09-10T21:19:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.867+0000 7f522374d640 1 -- start start 2024-09-10T21:19:48.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.867+0000 7f522374d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c103ce0 0x7f521c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:48.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.867+0000 7f522374d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521c104600 0x7f521c199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:48.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.867+0000 7f522374d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f521c10d140 0x7f521c19ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:48.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.867+0000 7f522374d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f521c112e00 con 0x7f521c103ce0 2024-09-10T21:19:48.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.867+0000 7f522374d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f521c112c80 con 0x7f521c104600 2024-09-10T21:19:48.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.867+0000 7f522374d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f521c112f80 con 0x7f521c10d140 2024-09-10T21:19:48.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.867+0000 7f52214e9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c103ce0 0x7f521c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:48.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.867+0000 7f52214e9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c103ce0 0x7f521c199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37822/0 (socket says 172.21.15.59:37822) 2024-09-10T21:19:48.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.867+0000 7f52214e9640 1 -- 172.21.15.59:0/1035125989 learned_addr learned my addr 172.21.15.59:0/1035125989 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:48.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.867+0000 7f5220ce8640 1 --2- 172.21.15.59:0/1035125989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521c104600 0x7f521c199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:48.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.867+0000 7f5221cea640 1 --2- 172.21.15.59:0/1035125989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f521c10d140 0x7f521c19ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:48.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.868+0000 7f52214e9640 1 -- 172.21.15.59:0/1035125989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f521c10d140 msgr2=0x7f521c19ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:48.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.868+0000 7f52214e9640 1 --2- 172.21.15.59:0/1035125989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f521c10d140 0x7f521c19ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.868+0000 7f52214e9640 1 -- 172.21.15.59:0/1035125989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521c104600 msgr2=0x7f521c199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:48.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.868+0000 7f52214e9640 1 --2- 172.21.15.59:0/1035125989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521c104600 0x7f521c199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.868+0000 7f52214e9640 1 -- 172.21.15.59:0/1035125989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521c19f3e0 con 0x7f521c103ce0 2024-09-10T21:19:48.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.868+0000 7f5221cea640 1 --2- 172.21.15.59:0/1035125989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f521c10d140 0x7f521c19ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:48.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.868+0000 7f52214e9640 1 --2- 172.21.15.59:0/1035125989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c103ce0 0x7f521c199330 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f521800c890 tx=0x7f521800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:48.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.868+0000 7f52127fc640 1 -- 172.21.15.59:0/1035125989 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218004220 con 0x7f521c103ce0 2024-09-10T21:19:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.868+0000 7f52127fc640 1 -- 172.21.15.59:0/1035125989 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52180043c0 con 0x7f521c103ce0 2024-09-10T21:19:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.868+0000 7f522374d640 1 -- 172.21.15.59:0/1035125989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f521c19f6d0 con 0x7f521c103ce0 2024-09-10T21:19:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.868+0000 7f52127fc640 1 -- 172.21.15.59:0/1035125989 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218004a00 con 0x7f521c103ce0 2024-09-10T21:19:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.868+0000 7f522374d640 1 -- 172.21.15.59:0/1035125989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f521c1a5f60 con 0x7f521c103ce0 2024-09-10T21:19:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.872+0000 7f5225b22740 1 Processor -- start 2024-09-10T21:19:48.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.872+0000 7f5225b22740 1 -- start start 2024-09-10T21:19:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.872+0000 7f52127fc640 1 -- 172.21.15.59:0/1035125989 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f52180079b0 con 0x7f521c103ce0 2024-09-10T21:19:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.872+0000 7f5225b22740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b918dc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.872+0000 7f5225b22740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918dcdf0 0x556b918ecc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.872+0000 7f5225b22740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918ed190 0x556b918ef580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.872+0000 7f5225b22740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556b91852ea0 con 0x556b918dc4d0 2024-09-10T21:19:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.872+0000 7f5225b22740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556b918422d0 con 0x556b918dcdf0 2024-09-10T21:19:48.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.872+0000 7f5225b22740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x556b918460e0 con 0x556b918ed190 2024-09-10T21:19:48.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.872+0000 7f5221cea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b918dc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:48.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.872+0000 7f5221cea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b918dc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37836/0 (socket says 172.21.15.59:37836) 2024-09-10T21:19:48.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.872+0000 7f5221cea640 1 -- 172.21.15.59:0/1364208757 learned_addr learned my addr 172.21.15.59:0/1364208757 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:48.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.872+0000 7f52214e9640 1 --2- 172.21.15.59:0/1364208757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918dcdf0 0x556b918ecc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:48.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.872+0000 7f5221cea640 1 -- 172.21.15.59:0/1364208757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918ed190 msgr2=0x556b918ef580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.872+0000 7f5221cea640 1 --2- 172.21.15.59:0/1364208757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918ed190 0x556b918ef580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.872+0000 7f5221cea640 1 -- 172.21.15.59:0/1364208757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918dcdf0 msgr2=0x556b918ecc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.872+0000 7f5221cea640 1 --2- 172.21.15.59:0/1364208757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918dcdf0 0x556b918ecc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.872+0000 7f5221cea640 1 -- 172.21.15.59:0/1364208757 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b915a0650 con 0x556b918dc4d0 2024-09-10T21:19:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.872+0000 7f52214e9640 1 --2- 172.21.15.59:0/1364208757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918dcdf0 0x556b918ecc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.873+0000 7f5221cea640 1 --2- 172.21.15.59:0/1364208757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b918dc8b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f5214009f30 tx=0x7f5214010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abec1e6f85d69845 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.873+0000 7f52127fc640 1 --2- 172.21.15.59:0/1035125989 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f52080b5360 0x7f52080b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:48.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.873+0000 7f52077fe640 1 -- 172.21.15.59:0/1364208757 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214016070 con 0x556b918dc4d0 2024-09-10T21:19:48.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.873+0000 7f52077fe640 1 -- 172.21.15.59:0/1364208757 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f521401bb10 con 0x556b918dc4d0 2024-09-10T21:19:48.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.873+0000 7f52077fe640 1 -- 172.21.15.59:0/1364208757 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214012c30 con 0x556b918dc4d0 2024-09-10T21:19:48.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.873+0000 7f52214e9640 1 --2- 172.21.15.59:0/1035125989 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f52080b5360 0x7f52080b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:48.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.873+0000 7f52127fc640 1 -- 172.21.15.59:0/1035125989 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f52180e58c0 con 0x7f521c103ce0 2024-09-10T21:19:48.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.874+0000 7f5225b22740 1 -- 172.21.15.59:0/1364208757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 msgr2=0x556b918dc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:48.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.874+0000 7f52214e9640 1 --2- 172.21.15.59:0/1035125989 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f52080b5360 0x7f52080b7820 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f52180e3760 tx=0x7f5218000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:48.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.874+0000 7f5225b22740 1 --2- 172.21.15.59:0/1364208757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b918dc8b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f5214009f30 tx=0x7f5214010800 comp rx=0 tx=0).stop 2024-09-10T21:19:48.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.874+0000 7f5225b22740 1 -- 172.21.15.59:0/1364208757 shutdown_connections 2024-09-10T21:19:48.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.874+0000 7f5225b22740 1 --2- 172.21.15.59:0/1364208757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918ed190 0x556b918ef580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.874+0000 7f5225b22740 1 --2- 172.21.15.59:0/1364208757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918dcdf0 0x556b918ecc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.874+0000 7f5225b22740 1 --2- 172.21.15.59:0/1364208757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b918dc8b0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.874+0000 7f5225b22740 1 -- 172.21.15.59:0/1364208757 >> 172.21.15.59:0/1364208757 conn(0x556b918da300 msgr2=0x556b918db4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:48.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.874+0000 7f5225b22740 1 -- 172.21.15.59:0/1364208757 shutdown_connections 2024-09-10T21:19:48.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.874+0000 7f5225b22740 1 -- 172.21.15.59:0/1364208757 wait complete. 2024-09-10T21:19:48.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.874+0000 7f5225b22740 1 -- start start 2024-09-10T21:19:48.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.874+0000 7f5225b22740 1 Processor -- start 2024-09-10T21:19:48.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.875+0000 7f5225b22740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b918eca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:48.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.875+0000 7f5225b22740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918dcdf0 0x556b918e9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:48.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.875+0000 7f5225b22740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918ed190 0x556b918ea400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:48.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.875+0000 7f5225b22740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556b916a3700 con 0x556b918dc4d0 2024-09-10T21:19:48.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.875+0000 7f5225b22740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556b917dd160 con 0x556b918dcdf0 2024-09-10T21:19:48.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.875+0000 7f5225b22740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x556b918efe40 con 0x556b918ed190 2024-09-10T21:19:48.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.875+0000 7f5225b22740 10 client.0 _ll_register_callbacks cb 0x556b917f69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:48.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.875+0000 7f5221cea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b918eca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:48.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.875+0000 7f5221cea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b918eca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37844/0 (socket says 172.21.15.59:37844) 2024-09-10T21:19:48.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.875+0000 7f5221cea640 1 -- 172.21.15.59:0/230757486 learned_addr learned my addr 172.21.15.59:0/230757486 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:48.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.875+0000 7f5220ce8640 1 --2- 172.21.15.59:0/230757486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918dcdf0 0x556b918e9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:48.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.875+0000 7f5221cea640 1 --2- 172.21.15.59:0/230757486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918ed190 0x556b918ea400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:48.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.875+0000 7f5221cea640 1 -- 172.21.15.59:0/230757486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918ed190 msgr2=0x556b918ea400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:48.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.875+0000 7f5221cea640 1 --2- 172.21.15.59:0/230757486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918ed190 0x556b918ea400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.875+0000 7f5221cea640 1 -- 172.21.15.59:0/230757486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918dcdf0 msgr2=0x556b918e9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:48.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.875+0000 7f5221cea640 1 --2- 172.21.15.59:0/230757486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918dcdf0 0x556b918e9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.875+0000 7f5221cea640 1 -- 172.21.15.59:0/230757486 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b9180ac90 con 0x556b918dc4d0 2024-09-10T21:19:48.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.876+0000 7f5221cea640 1 --2- 172.21.15.59:0/230757486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b918eca10 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5214009f00 tx=0x7f5214012530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0600c64821db43f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:48.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.876+0000 7f5204ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:48.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.876+0000 7f5204ff9640 1 -- 172.21.15.59:0/230757486 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214016070 con 0x556b918dc4d0 2024-09-10T21:19:48.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.876+0000 7f5204ff9640 1 -- 172.21.15.59:0/230757486 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5214012bb0 con 0x556b918dc4d0 2024-09-10T21:19:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.876+0000 7f5225b22740 1 -- 172.21.15.59:0/230757486 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f521401bb10 con 0x556b918dc4d0 2024-09-10T21:19:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.876+0000 7f5204ff9640 1 -- 172.21.15.59:0/230757486 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f521401b460 con 0x556b918dc4d0 2024-09-10T21:19:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.876+0000 7f5225b22740 10 client.16482 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.876+0000 7f5225b22740 1 -- 172.21.15.59:0/230757486 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556b918fb6b0 con 0x556b918dc4d0 2024-09-10T21:19:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.876+0000 7f5204ff9640 1 -- 172.21.15.59:0/230757486 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f521401bb10 con 0x556b918dc4d0 2024-09-10T21:19:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.876+0000 7f5204ff9640 1 -- 172.21.15.59:0/230757486 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f521400f040 con 0x556b918dc4d0 2024-09-10T21:19:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.876+0000 7f5225b22740 10 client.16482 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.876+0000 7f5225b22740 10 client.16482 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:19:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.877+0000 7f5225b22740 20 client.16482 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.877+0000 7f5225b22740 1 --2- 172.21.15.59:0/230757486 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x556b918fcab0 0x556b918feea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.877+0000 7f5225b22740 4 client.16482 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:19:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.877+0000 7f5225b22740 1 -- 172.21.15.59:0/230757486 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b91854df0 con 0x556b918fcab0 2024-09-10T21:19:48.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.877+0000 7f5220ce8640 1 --2- 172.21.15.59:0/230757486 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x556b918fcab0 0x556b918feea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.877+0000 7f5220ce8640 1 --2- 172.21.15.59:0/230757486 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x556b918fcab0 0x556b918feea0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=952f946778b440fd server_cookie=4c83db26974361b6 in_seq=0 out_seq=0 2024-09-10T21:19:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.877+0000 7f5204ff9640 10 client.16482 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:19:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.878+0000 7f5204ff9640 1 -- 172.21.15.59:0/230757486 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556b91854df0 con 0x556b918fcab0 2024-09-10T21:19:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.878+0000 7f5204ff9640 10 client.16482 handle_command_reply: tid=0 2024-09-10T21:19:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.878+0000 7f5225b22740 1 client.16482 shutdown 2024-09-10T21:19:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.878+0000 7f5225b22740 1 -- 172.21.15.59:0/230757486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 msgr2=0x556b918eca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.878+0000 7f5225b22740 1 --2- 172.21.15.59:0/230757486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b918eca10 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5214009f00 tx=0x7f5214012530 comp rx=0 tx=0).stop 2024-09-10T21:19:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.878+0000 7f5225b22740 1 -- 172.21.15.59:0/230757486 shutdown_connections 2024-09-10T21:19:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.878+0000 7f5225b22740 1 --2- 172.21.15.59:0/230757486 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x556b918fcab0 0x556b918feea0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.878+0000 7f5225b22740 1 --2- 172.21.15.59:0/230757486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918ed190 0x556b918ea400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.878+0000 7f5225b22740 1 --2- 172.21.15.59:0/230757486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918dcdf0 0x556b918e9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.878+0000 7f5225b22740 1 --2- 172.21.15.59:0/230757486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b918eca10 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.878+0000 7f5225b22740 1 -- 172.21.15.59:0/230757486 >> 172.21.15.59:0/230757486 conn(0x556b918da300 msgr2=0x556b918dfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:48.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.878+0000 7f5204ff9640 0 client.16482 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:19:48.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.879+0000 7f5225b22740 1 -- 172.21.15.59:0/230757486 shutdown_connections 2024-09-10T21:19:48.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.879+0000 7f5225b22740 1 -- 172.21.15.59:0/230757486 wait complete. 2024-09-10T21:19:48.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.879+0000 7f5225b22740 20 client.16482 trim_cache size 0 max 16384 2024-09-10T21:19:48.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.892+0000 7f5225b22740 1 Processor -- start 2024-09-10T21:19:48.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.892+0000 7f5225b22740 1 -- start start 2024-09-10T21:19:48.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.892+0000 7f5225b22740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b918ef620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.892+0000 7f5225b22740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918dcdf0 0x556b918db430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.892+0000 7f5225b22740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918ed190 0x556b918db970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.892+0000 7f5225b22740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f521c1ac200 con 0x556b918dc4d0 2024-09-10T21:19:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.892+0000 7f5225b22740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f521c1add40 con 0x556b918ed190 2024-09-10T21:19:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.892+0000 7f5225b22740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f521c1ac8d0 con 0x556b918dcdf0 2024-09-10T21:19:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.892+0000 7f5221cea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b918ef620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.892+0000 7f5221cea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b918ef620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37858/0 (socket says 172.21.15.59:37858) 2024-09-10T21:19:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.892+0000 7f5221cea640 1 -- 172.21.15.59:0/1626714513 learned_addr learned my addr 172.21.15.59:0/1626714513 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.892+0000 7f5220ce8640 1 --2- 172.21.15.59:0/1626714513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918dcdf0 0x556b918db430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.892+0000 7f5221cea640 1 -- 172.21.15.59:0/1626714513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918dcdf0 msgr2=0x556b918db430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.892+0000 7f5221cea640 1 --2- 172.21.15.59:0/1626714513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918dcdf0 0x556b918db430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.892+0000 7f5221cea640 1 -- 172.21.15.59:0/1626714513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918ed190 msgr2=0x556b918db970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:48.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.892+0000 7f5221cea640 1 --2- 172.21.15.59:0/1626714513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918ed190 0x556b918db970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.892+0000 7f5221cea640 1 -- 172.21.15.59:0/1626714513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b918e9c10 con 0x556b918dc4d0 2024-09-10T21:19:48.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.892+0000 7f5220ce8640 1 --2- 172.21.15.59:0/1626714513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918dcdf0 0x556b918db430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:48.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.893+0000 7f5221cea640 1 --2- 172.21.15.59:0/1626714513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b918ef620 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5214005d50 tx=0x7f5214009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6115fcde50c25e00 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:48.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.893+0000 7f5206ffd640 1 -- 172.21.15.59:0/1626714513 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214016070 con 0x556b918dc4d0 2024-09-10T21:19:48.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.893+0000 7f5206ffd640 1 -- 172.21.15.59:0/1626714513 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5214039070 con 0x556b918dc4d0 2024-09-10T21:19:48.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.893+0000 7f5206ffd640 1 -- 172.21.15.59:0/1626714513 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52140126a0 con 0x556b918dc4d0 2024-09-10T21:19:48.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.893+0000 7f5225b22740 1 -- 172.21.15.59:0/1626714513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 msgr2=0x556b918ef620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:48.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.893+0000 7f5225b22740 1 --2- 172.21.15.59:0/1626714513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b918ef620 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5214005d50 tx=0x7f5214009b80 comp rx=0 tx=0).stop 2024-09-10T21:19:48.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.893+0000 7f5225b22740 1 -- 172.21.15.59:0/1626714513 shutdown_connections 2024-09-10T21:19:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.893+0000 7f5225b22740 1 --2- 172.21.15.59:0/1626714513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918ed190 0x556b918db970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.893+0000 7f5225b22740 1 --2- 172.21.15.59:0/1626714513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918dcdf0 0x556b918db430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.893+0000 7f5225b22740 1 --2- 172.21.15.59:0/1626714513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b918ef620 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.893+0000 7f5225b22740 1 -- 172.21.15.59:0/1626714513 >> 172.21.15.59:0/1626714513 conn(0x556b918da300 msgr2=0x556b918eef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.894+0000 7f5225b22740 1 -- 172.21.15.59:0/1626714513 shutdown_connections 2024-09-10T21:19:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.894+0000 7f5225b22740 1 -- 172.21.15.59:0/1626714513 wait complete. 2024-09-10T21:19:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.894+0000 7f5225b22740 1 -- start start 2024-09-10T21:19:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.894+0000 7f5225b22740 1 Processor -- start 2024-09-10T21:19:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.894+0000 7f5225b22740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b91902270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.894+0000 7f5225b22740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918dcdf0 0x556b918ff760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.894+0000 7f5225b22740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918ed190 0x556b918ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.894+0000 7f5225b22740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f521c1ad670 con 0x556b918dc4d0 2024-09-10T21:19:48.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.894+0000 7f5225b22740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f521c1acfa0 con 0x556b918ed190 2024-09-10T21:19:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.894+0000 7f5225b22740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f521c1aa200 con 0x556b918dcdf0 2024-09-10T21:19:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.894+0000 7f5225b22740 10 client.0 _ll_register_callbacks cb 0x7f5214009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.894+0000 7f5221cea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b91902270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.894+0000 7f5221cea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b91902270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37866/0 (socket says 172.21.15.59:37866) 2024-09-10T21:19:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.894+0000 7f5221cea640 1 -- 172.21.15.59:0/3013011964 learned_addr learned my addr 172.21.15.59:0/3013011964 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.895+0000 7f5221cea640 1 --2- 172.21.15.59:0/3013011964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918ed190 0x556b918ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.895+0000 7f5220ce8640 1 --2- 172.21.15.59:0/3013011964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918dcdf0 0x556b918ff760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.895+0000 7f5221cea640 1 -- 172.21.15.59:0/3013011964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918dcdf0 msgr2=0x556b918ff760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.895+0000 7f5221cea640 1 --2- 172.21.15.59:0/3013011964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918dcdf0 0x556b918ff760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.895+0000 7f5221cea640 1 -- 172.21.15.59:0/3013011964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918ed190 msgr2=0x556b918ffca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.895+0000 7f5221cea640 1 --2- 172.21.15.59:0/3013011964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918ed190 0x556b918ffca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.895+0000 7f5221cea640 1 -- 172.21.15.59:0/3013011964 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b919004a0 con 0x556b918dc4d0 2024-09-10T21:19:48.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.895+0000 7f5220ce8640 1 --2- 172.21.15.59:0/3013011964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918dcdf0 0x556b918ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.895+0000 7f5221cea640 1 --2- 172.21.15.59:0/3013011964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b91902270 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5214009ae0 tx=0x7f5214009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2309bead1d644c3f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.895+0000 7f5204ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.895+0000 7f5204ff9640 1 -- 172.21.15.59:0/3013011964 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214016040 con 0x556b918dc4d0 2024-09-10T21:19:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.895+0000 7f5204ff9640 1 -- 172.21.15.59:0/3013011964 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f52140119c0 con 0x556b918dc4d0 2024-09-10T21:19:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.895+0000 7f5225b22740 1 -- 172.21.15.59:0/3013011964 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5214039070 con 0x556b918dc4d0 2024-09-10T21:19:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.895+0000 7f5204ff9640 1 -- 172.21.15.59:0/3013011964 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5214011bc0 con 0x556b918dc4d0 2024-09-10T21:19:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.895+0000 7f5225b22740 10 client.16488 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.895+0000 7f5225b22740 1 -- 172.21.15.59:0/3013011964 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556b919695c0 con 0x556b918dc4d0 2024-09-10T21:19:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.896+0000 7f5204ff9640 1 -- 172.21.15.59:0/3013011964 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5214039070 con 0x556b918dc4d0 2024-09-10T21:19:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.896+0000 7f5204ff9640 1 -- 172.21.15.59:0/3013011964 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5214004f80 con 0x556b918dc4d0 2024-09-10T21:19:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.896+0000 7f5225b22740 10 client.16488 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.896+0000 7f5225b22740 10 client.16488 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:19:48.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.896+0000 7f5225b22740 20 client.16488 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.896+0000 7f5225b22740 1 --2- 172.21.15.59:0/3013011964 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x556b91969c10 0x556b9196c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.896+0000 7f5225b22740 4 client.16488 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:19:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.896+0000 7f5225b22740 1 -- 172.21.15.59:0/3013011964 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556b918508a0 con 0x556b91969c10 2024-09-10T21:19:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.896+0000 7f5220ce8640 1 --2- 172.21.15.59:0/3013011964 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x556b91969c10 0x556b9196c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.897+0000 7f5220ce8640 1 --2- 172.21.15.59:0/3013011964 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x556b91969c10 0x556b9196c000 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5643757c74a00a92 server_cookie=c6c82b836423f941 in_seq=0 out_seq=0 2024-09-10T21:19:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.897+0000 7f5204ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:19:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.897+0000 7f5204ff9640 1 -- 172.21.15.59:0/3013011964 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556b918508a0 con 0x556b91969c10 2024-09-10T21:19:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.897+0000 7f5204ff9640 10 client.16488 handle_command_reply: tid=0 2024-09-10T21:19:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.897+0000 7f5225b22740 1 client.16488 shutdown 2024-09-10T21:19:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.897+0000 7f5225b22740 1 -- 172.21.15.59:0/3013011964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 msgr2=0x556b91902270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.897+0000 7f5225b22740 1 --2- 172.21.15.59:0/3013011964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b91902270 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5214009ae0 tx=0x7f5214009820 comp rx=0 tx=0).stop 2024-09-10T21:19:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.897+0000 7f5225b22740 1 -- 172.21.15.59:0/3013011964 shutdown_connections 2024-09-10T21:19:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.897+0000 7f5225b22740 1 --2- 172.21.15.59:0/3013011964 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x556b91969c10 0x556b9196c000 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.897+0000 7f5225b22740 1 --2- 172.21.15.59:0/3013011964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556b918ed190 0x556b918ffca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.897+0000 7f5225b22740 1 --2- 172.21.15.59:0/3013011964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556b918dcdf0 0x556b918ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.897+0000 7f5225b22740 1 --2- 172.21.15.59:0/3013011964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b918dc4d0 0x556b91902270 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.897+0000 7f5225b22740 1 -- 172.21.15.59:0/3013011964 >> 172.21.15.59:0/3013011964 conn(0x556b918da300 msgr2=0x556b918db3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:48.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.897+0000 7f5204ff9640 0 client.16488 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:19:48.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.897+0000 7f5225b22740 1 -- 172.21.15.59:0/3013011964 shutdown_connections 2024-09-10T21:19:48.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.897+0000 7f5225b22740 1 -- 172.21.15.59:0/3013011964 wait complete. 2024-09-10T21:19:48.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.897+0000 7f5225b22740 20 client.16488 trim_cache size 0 max 16384 2024-09-10T21:19:48.906 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:19:48.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.898+0000 7f522374d640 1 -- 172.21.15.59:0/1035125989 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f52080b5360 msgr2=0x7f52080b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:48.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.898+0000 7f522374d640 1 --2- 172.21.15.59:0/1035125989 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f52080b5360 0x7f52080b7820 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f52180e3760 tx=0x7f5218000bc0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.898+0000 7f522374d640 1 -- 172.21.15.59:0/1035125989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c103ce0 msgr2=0x7f521c199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:48.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.898+0000 7f522374d640 1 --2- 172.21.15.59:0/1035125989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c103ce0 0x7f521c199330 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f521800c890 tx=0x7f521800cd50 comp rx=0 tx=0).stop 2024-09-10T21:19:48.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.898+0000 7f522374d640 1 -- 172.21.15.59:0/1035125989 shutdown_connections 2024-09-10T21:19:48.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.898+0000 7f522374d640 1 --2- 172.21.15.59:0/1035125989 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f52080b5360 0x7f52080b7820 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.898+0000 7f522374d640 1 --2- 172.21.15.59:0/1035125989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f521c10d140 0x7f521c19ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.898+0000 7f522374d640 1 --2- 172.21.15.59:0/1035125989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f521c104600 0x7f521c199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.898+0000 7f522374d640 1 --2- 172.21.15.59:0/1035125989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c103ce0 0x7f521c199330 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:48.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.898+0000 7f522374d640 1 -- 172.21.15.59:0/1035125989 >> 172.21.15.59:0/1035125989 conn(0x7f521c0fd700 msgr2=0x7f521c0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:48.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.898+0000 7f522374d640 1 -- 172.21.15.59:0/1035125989 shutdown_connections 2024-09-10T21:19:48.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:48.898+0000 7f522374d640 1 -- 172.21.15.59:0/1035125989 wait complete. 2024-09-10T21:19:49.713 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:19:49.972 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:19:50.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.434+0000 7fc66deeb640 1 -- 172.21.15.59:0/1868855239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66810d140 msgr2=0x7fc66810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:50.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.434+0000 7fc66deeb640 1 --2- 172.21.15.59:0/1868855239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66810d140 0x7fc66810f5a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fc660009ca0 tx=0x7fc66002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.435+0000 7fc66deeb640 1 -- 172.21.15.59:0/1868855239 shutdown_connections 2024-09-10T21:19:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.435+0000 7fc66deeb640 1 --2- 172.21.15.59:0/1868855239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc66810d140 0x7fc66810f5a0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.435+0000 7fc66deeb640 1 --2- 172.21.15.59:0/1868855239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc668104600 0x7fc66810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.435+0000 7fc66deeb640 1 --2- 172.21.15.59:0/1868855239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc668103ce0 0x7fc6681040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.435+0000 7fc66deeb640 1 -- 172.21.15.59:0/1868855239 >> 172.21.15.59:0/1868855239 conn(0x7fc6680fd720 msgr2=0x7fc6680ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.435+0000 7fc66deeb640 1 -- 172.21.15.59:0/1868855239 shutdown_connections 2024-09-10T21:19:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.435+0000 7fc66deeb640 1 -- 172.21.15.59:0/1868855239 wait complete. 2024-09-10T21:19:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.435+0000 7fc66deeb640 1 Processor -- start 2024-09-10T21:19:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.435+0000 7fc66deeb640 1 -- start start 2024-09-10T21:19:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.436+0000 7fc66deeb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc668103ce0 0x7fc6681991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.436+0000 7fc66deeb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc668104600 0x7fc668199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.436+0000 7fc66deeb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc66810d140 0x7fc66819eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:50.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.436+0000 7fc66deeb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc668112db0 con 0x7fc668104600 2024-09-10T21:19:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.436+0000 7fc66deeb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc668112c30 con 0x7fc66810d140 2024-09-10T21:19:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.436+0000 7fc66deeb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc668112f30 con 0x7fc668103ce0 2024-09-10T21:19:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.436+0000 7fc666ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc668104600 0x7fc668199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.436+0000 7fc666ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc668104600 0x7fc668199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43838/0 (socket says 172.21.15.59:43838) 2024-09-10T21:19:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.436+0000 7fc666ffd640 1 -- 172.21.15.59:0/1431063776 learned_addr learned my addr 172.21.15.59:0/1431063776 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.436+0000 7fc6677fe640 1 --2- 172.21.15.59:0/1431063776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc668103ce0 0x7fc6681991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.436+0000 7fc667fff640 1 --2- 172.21.15.59:0/1431063776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc66810d140 0x7fc66819eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.436+0000 7fc666ffd640 1 -- 172.21.15.59:0/1431063776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc668103ce0 msgr2=0x7fc6681991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.436+0000 7fc666ffd640 1 --2- 172.21.15.59:0/1431063776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc668103ce0 0x7fc6681991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.436+0000 7fc666ffd640 1 -- 172.21.15.59:0/1431063776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc66810d140 msgr2=0x7fc66819eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.436+0000 7fc666ffd640 1 --2- 172.21.15.59:0/1431063776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc66810d140 0x7fc66819eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.436+0000 7fc666ffd640 1 -- 172.21.15.59:0/1431063776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66819f290 con 0x7fc668104600 2024-09-10T21:19:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.436+0000 7fc666ffd640 1 --2- 172.21.15.59:0/1431063776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc668104600 0x7fc668199720 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00d6b0 tx=0x7fc65c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.436+0000 7fc664ff9640 1 -- 172.21.15.59:0/1431063776 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c017070 con 0x7fc668104600 2024-09-10T21:19:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.437+0000 7fc664ff9640 1 -- 172.21.15.59:0/1431063776 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc65c009e00 con 0x7fc668104600 2024-09-10T21:19:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.437+0000 7fc66deeb640 1 -- 172.21.15.59:0/1431063776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc66819f580 con 0x7fc668104600 2024-09-10T21:19:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.437+0000 7fc664ff9640 1 -- 172.21.15.59:0/1431063776 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c00f3c0 con 0x7fc668104600 2024-09-10T21:19:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.437+0000 7fc66deeb640 1 -- 172.21.15.59:0/1431063776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6681a5c40 con 0x7fc668104600 2024-09-10T21:19:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.439+0000 7fc6702c0740 1 Processor -- start 2024-09-10T21:19:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.439+0000 7fc6702c0740 1 -- start start 2024-09-10T21:19:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.439+0000 7fc664ff9640 1 -- 172.21.15.59:0/1431063776 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fc65c0106f0 con 0x7fc668104600 2024-09-10T21:19:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.439+0000 7fc6702c0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff128b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.439+0000 7fc6702c0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff12df0 0x55fb2ff1e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.439+0000 7fc6702c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb2ff1ed80 0x55fb2ff21170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.439+0000 7fc6702c0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fb2fe88ea0 con 0x55fb2ff124d0 2024-09-10T21:19:50.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.439+0000 7fc6702c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fb2fe782d0 con 0x55fb2ff1ed80 2024-09-10T21:19:50.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.439+0000 7fc6702c0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55fb2fe7c0e0 con 0x55fb2ff12df0 2024-09-10T21:19:50.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.440+0000 7fc667fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff128b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:50.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.440+0000 7fc667fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff128b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43848/0 (socket says 172.21.15.59:43848) 2024-09-10T21:19:50.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.440+0000 7fc667fff640 1 -- 172.21.15.59:0/3314813617 learned_addr learned my addr 172.21.15.59:0/3314813617 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:50.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.440+0000 7fc6677fe640 1 --2- 172.21.15.59:0/3314813617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff12df0 0x55fb2ff1e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:50.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.440+0000 7fc666ffd640 1 --2- 172.21.15.59:0/3314813617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb2ff1ed80 0x55fb2ff21170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:50.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.440+0000 7fc667fff640 1 -- 172.21.15.59:0/3314813617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff12df0 msgr2=0x55fb2ff1e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:50.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.440+0000 7fc667fff640 1 --2- 172.21.15.59:0/3314813617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff12df0 0x55fb2ff1e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.440+0000 7fc667fff640 1 -- 172.21.15.59:0/3314813617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb2ff1ed80 msgr2=0x55fb2ff21170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:50.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.440+0000 7fc667fff640 1 --2- 172.21.15.59:0/3314813617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb2ff1ed80 0x55fb2ff21170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.440+0000 7fc667fff640 1 -- 172.21.15.59:0/3314813617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb2fbd6650 con 0x55fb2ff124d0 2024-09-10T21:19:50.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.440+0000 7fc666ffd640 1 --2- 172.21.15.59:0/3314813617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb2ff1ed80 0x55fb2ff21170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:50.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.440+0000 7fc667fff640 1 --2- 172.21.15.59:0/3314813617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff128b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fc660005cc0 tx=0x7fc6600099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80894400657bf763 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:50.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.440+0000 7fc664ff9640 1 --2- 172.21.15.59:0/1431063776 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc6500b5360 0x7fc6500b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:50.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.440+0000 7fc64dffb640 1 -- 172.21.15.59:0/3314813617 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660031450 con 0x55fb2ff124d0 2024-09-10T21:19:50.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.440+0000 7fc6677fe640 1 --2- 172.21.15.59:0/1431063776 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc6500b5360 0x7fc6500b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:50.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.440+0000 7fc664ff9640 1 -- 172.21.15.59:0/1431063776 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc65c0e57f0 con 0x7fc668104600 2024-09-10T21:19:50.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.440+0000 7fc64dffb640 1 -- 172.21.15.59:0/3314813617 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc660036040 con 0x55fb2ff124d0 2024-09-10T21:19:50.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.440+0000 7fc64dffb640 1 -- 172.21.15.59:0/3314813617 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660004440 con 0x55fb2ff124d0 2024-09-10T21:19:50.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.441+0000 7fc6702c0740 1 -- 172.21.15.59:0/3314813617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 msgr2=0x55fb2ff128b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:50.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.441+0000 7fc6677fe640 1 --2- 172.21.15.59:0/1431063776 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc6500b5360 0x7fc6500b7820 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55fb2ff111e0 tx=0x7fc65800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:50.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.441+0000 7fc6702c0740 1 --2- 172.21.15.59:0/3314813617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff128b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fc660005cc0 tx=0x7fc6600099c0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.441+0000 7fc6702c0740 1 -- 172.21.15.59:0/3314813617 shutdown_connections 2024-09-10T21:19:50.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.441+0000 7fc6702c0740 1 --2- 172.21.15.59:0/3314813617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb2ff1ed80 0x55fb2ff21170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.441+0000 7fc6702c0740 1 --2- 172.21.15.59:0/3314813617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff12df0 0x55fb2ff1e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.441+0000 7fc6702c0740 1 --2- 172.21.15.59:0/3314813617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff128b0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.441+0000 7fc6702c0740 1 -- 172.21.15.59:0/3314813617 >> 172.21.15.59:0/3314813617 conn(0x55fb2ff10300 msgr2=0x55fb2ff114a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.441+0000 7fc6702c0740 1 -- 172.21.15.59:0/3314813617 shutdown_connections 2024-09-10T21:19:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.441+0000 7fc6702c0740 1 -- 172.21.15.59:0/3314813617 wait complete. 2024-09-10T21:19:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.442+0000 7fc6702c0740 1 -- start start 2024-09-10T21:19:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.442+0000 7fc6702c0740 1 Processor -- start 2024-09-10T21:19:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.442+0000 7fc6702c0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff1e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.442+0000 7fc6702c0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff12df0 0x55fb2ff1ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.442+0000 7fc6702c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb2ff1ed80 0x55fb2ff1bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.442+0000 7fc6702c0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fb2fcd9700 con 0x55fb2ff124d0 2024-09-10T21:19:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.442+0000 7fc6702c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fb2fe13160 con 0x55fb2ff1ed80 2024-09-10T21:19:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.442+0000 7fc6702c0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55fb2ff219a0 con 0x55fb2ff12df0 2024-09-10T21:19:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.442+0000 7fc6702c0740 10 client.0 _ll_register_callbacks cb 0x55fb2fe2c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.442+0000 7fc6677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff1e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.442+0000 7fc6677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff1e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43862/0 (socket says 172.21.15.59:43862) 2024-09-10T21:19:50.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.442+0000 7fc6677fe640 1 -- 172.21.15.59:0/588027871 learned_addr learned my addr 172.21.15.59:0/588027871 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:50.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.442+0000 7fc667fff640 1 --2- 172.21.15.59:0/588027871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb2ff1ed80 0x55fb2ff1bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:50.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.443+0000 7fc666ffd640 1 --2- 172.21.15.59:0/588027871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff12df0 0x55fb2ff1ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:50.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.443+0000 7fc6677fe640 1 -- 172.21.15.59:0/588027871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff12df0 msgr2=0x55fb2ff1ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:50.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.443+0000 7fc6677fe640 1 --2- 172.21.15.59:0/588027871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff12df0 0x55fb2ff1ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.443+0000 7fc6677fe640 1 -- 172.21.15.59:0/588027871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb2ff1ed80 msgr2=0x55fb2ff1bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:50.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.443+0000 7fc6677fe640 1 --2- 172.21.15.59:0/588027871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb2ff1ed80 0x55fb2ff1bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.443+0000 7fc6677fe640 1 -- 172.21.15.59:0/588027871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb2fe40c90 con 0x55fb2ff124d0 2024-09-10T21:19:50.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.443+0000 7fc666ffd640 1 --2- 172.21.15.59:0/588027871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff12df0 0x55fb2ff1ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:50.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.443+0000 7fc6677fe640 1 --2- 172.21.15.59:0/588027871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff1e5b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fc65801cbe0 tx=0x7fc658004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64808f0ed69a703 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:50.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.443+0000 7fc646ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:50.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.443+0000 7fc646ffd640 1 -- 172.21.15.59:0/588027871 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65802c060 con 0x55fb2ff124d0 2024-09-10T21:19:50.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.443+0000 7fc646ffd640 1 -- 172.21.15.59:0/588027871 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc658016030 con 0x55fb2ff124d0 2024-09-10T21:19:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.443+0000 7fc6702c0740 1 -- 172.21.15.59:0/588027871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc660036040 con 0x55fb2ff124d0 2024-09-10T21:19:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.443+0000 7fc646ffd640 1 -- 172.21.15.59:0/588027871 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc65800ae10 con 0x55fb2ff124d0 2024-09-10T21:19:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.443+0000 7fc6702c0740 10 client.16500 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.443+0000 7fc6702c0740 1 -- 172.21.15.59:0/588027871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fb2ff2d2a0 con 0x55fb2ff124d0 2024-09-10T21:19:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.444+0000 7fc646ffd640 1 -- 172.21.15.59:0/588027871 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc660036040 con 0x55fb2ff124d0 2024-09-10T21:19:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.444+0000 7fc646ffd640 1 -- 172.21.15.59:0/588027871 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc658032780 con 0x55fb2ff124d0 2024-09-10T21:19:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.444+0000 7fc6702c0740 10 client.16500 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.444+0000 7fc6702c0740 10 client.16500 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:19:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.444+0000 7fc6702c0740 20 client.16500 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.444+0000 7fc6702c0740 1 --2- 172.21.15.59:0/588027871 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55fb2ff2e760 0x55fb2ff30b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.444+0000 7fc6702c0740 4 client.16500 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:19:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.444+0000 7fc6702c0740 1 -- 172.21.15.59:0/588027871 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb2fe8adf0 con 0x55fb2ff2e760 2024-09-10T21:19:50.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.444+0000 7fc666ffd640 1 --2- 172.21.15.59:0/588027871 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55fb2ff2e760 0x55fb2ff30b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:50.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.444+0000 7fc666ffd640 1 --2- 172.21.15.59:0/588027871 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55fb2ff2e760 0x55fb2ff30b90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adaab7250f139f06 server_cookie=1cc31b7127716277 in_seq=0 out_seq=0 2024-09-10T21:19:50.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.444+0000 7fc646ffd640 10 client.16500 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:50.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.445+0000 7fc646ffd640 1 -- 172.21.15.59:0/588027871 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fb2fe8adf0 con 0x55fb2ff2e760 2024-09-10T21:19:50.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.445+0000 7fc646ffd640 10 client.16500 handle_command_reply: tid=0 2024-09-10T21:19:50.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.445+0000 7fc6702c0740 1 client.16500 shutdown 2024-09-10T21:19:50.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.445+0000 7fc6702c0740 1 -- 172.21.15.59:0/588027871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 msgr2=0x55fb2ff1e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:50.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.445+0000 7fc6702c0740 1 --2- 172.21.15.59:0/588027871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff1e5b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fc65801cbe0 tx=0x7fc658004730 comp rx=0 tx=0).stop 2024-09-10T21:19:50.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.445+0000 7fc6702c0740 1 -- 172.21.15.59:0/588027871 shutdown_connections 2024-09-10T21:19:50.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.445+0000 7fc6702c0740 1 --2- 172.21.15.59:0/588027871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb2ff1ed80 0x55fb2ff1bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.445+0000 7fc6702c0740 1 --2- 172.21.15.59:0/588027871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff12df0 0x55fb2ff1ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.445+0000 7fc6702c0740 1 --2- 172.21.15.59:0/588027871 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55fb2ff2e760 0x55fb2ff30b90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.445+0000 7fc6702c0740 1 --2- 172.21.15.59:0/588027871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff1e5b0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.445+0000 7fc6702c0740 1 -- 172.21.15.59:0/588027871 >> 172.21.15.59:0/588027871 conn(0x55fb2ff10300 msgr2=0x55fb2ff15e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:50.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.445+0000 7fc646ffd640 0 client.16500 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:50.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.445+0000 7fc6702c0740 1 -- 172.21.15.59:0/588027871 shutdown_connections 2024-09-10T21:19:50.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.446+0000 7fc6702c0740 1 -- 172.21.15.59:0/588027871 wait complete. 2024-09-10T21:19:50.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.446+0000 7fc6702c0740 20 client.16500 trim_cache size 0 max 16384 2024-09-10T21:19:50.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.459+0000 7fc6702c0740 1 Processor -- start 2024-09-10T21:19:50.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.459+0000 7fc6702c0740 1 -- start start 2024-09-10T21:19:50.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.459+0000 7fc6702c0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff11ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:50.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.459+0000 7fc6702c0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff12df0 0x55fb2ff0fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:50.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.459+0000 7fc6702c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb2ff1ed80 0x55fb2ff18c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:50.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.459+0000 7fc6702c0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc6681ae240 con 0x55fb2ff124d0 2024-09-10T21:19:50.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.459+0000 7fc6702c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc6681afd80 con 0x55fb2ff1ed80 2024-09-10T21:19:50.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.459+0000 7fc6702c0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc6681ae910 con 0x55fb2ff12df0 2024-09-10T21:19:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.459+0000 7fc6677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff11ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.459+0000 7fc6677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff11ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43874/0 (socket says 172.21.15.59:43874) 2024-09-10T21:19:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.459+0000 7fc6677fe640 1 -- 172.21.15.59:0/338069753 learned_addr learned my addr 172.21.15.59:0/338069753 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.459+0000 7fc666ffd640 1 --2- 172.21.15.59:0/338069753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff12df0 0x55fb2ff0fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.459+0000 7fc6677fe640 1 -- 172.21.15.59:0/338069753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff12df0 msgr2=0x55fb2ff0fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.459+0000 7fc6677fe640 1 --2- 172.21.15.59:0/338069753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff12df0 0x55fb2ff0fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.459+0000 7fc6677fe640 1 -- 172.21.15.59:0/338069753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb2ff1ed80 msgr2=0x55fb2ff18c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.459+0000 7fc6677fe640 1 --2- 172.21.15.59:0/338069753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb2ff1ed80 0x55fb2ff18c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.459+0000 7fc6677fe640 1 -- 172.21.15.59:0/338069753 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb2ff10fe0 con 0x55fb2ff124d0 2024-09-10T21:19:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.459+0000 7fc666ffd640 1 --2- 172.21.15.59:0/338069753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff12df0 0x55fb2ff0fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.459+0000 7fc6677fe640 1 --2- 172.21.15.59:0/338069753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff11ad0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fc65800a3f0 tx=0x7fc65801a3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1c0080085c545f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.460+0000 7fc64d7fa640 1 -- 172.21.15.59:0/338069753 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc658037030 con 0x55fb2ff124d0 2024-09-10T21:19:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.460+0000 7fc64d7fa640 1 -- 172.21.15.59:0/338069753 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc658039070 con 0x55fb2ff124d0 2024-09-10T21:19:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.460+0000 7fc64d7fa640 1 -- 172.21.15.59:0/338069753 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc658005020 con 0x55fb2ff124d0 2024-09-10T21:19:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.460+0000 7fc6702c0740 1 -- 172.21.15.59:0/338069753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 msgr2=0x55fb2ff11ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.460+0000 7fc6702c0740 1 --2- 172.21.15.59:0/338069753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff11ad0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fc65800a3f0 tx=0x7fc65801a3a0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.460+0000 7fc6702c0740 1 -- 172.21.15.59:0/338069753 shutdown_connections 2024-09-10T21:19:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.460+0000 7fc6702c0740 1 --2- 172.21.15.59:0/338069753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb2ff1ed80 0x55fb2ff18c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.460+0000 7fc6702c0740 1 --2- 172.21.15.59:0/338069753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff12df0 0x55fb2ff0fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.460+0000 7fc6702c0740 1 --2- 172.21.15.59:0/338069753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff11ad0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.460+0000 7fc6702c0740 1 -- 172.21.15.59:0/338069753 >> 172.21.15.59:0/338069753 conn(0x55fb2ff10300 msgr2=0x55fb2ff113c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.460+0000 7fc6702c0740 1 -- 172.21.15.59:0/338069753 shutdown_connections 2024-09-10T21:19:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.460+0000 7fc6702c0740 1 -- 172.21.15.59:0/338069753 wait complete. 2024-09-10T21:19:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.461+0000 7fc6702c0740 1 -- start start 2024-09-10T21:19:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.461+0000 7fc6702c0740 1 Processor -- start 2024-09-10T21:19:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.461+0000 7fc6702c0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff23050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.461+0000 7fc6702c0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb2ff12df0 0x55fb2ff23590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.461+0000 7fc6702c0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff1ed80 0x55fb2ff9a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.461+0000 7fc6702c0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc6681af6b0 con 0x55fb2ff124d0 2024-09-10T21:19:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.461+0000 7fc6702c0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc6681aefe0 con 0x55fb2ff12df0 2024-09-10T21:19:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.461+0000 7fc6702c0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc6681ac220 con 0x55fb2ff1ed80 2024-09-10T21:19:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.461+0000 7fc6702c0740 10 client.0 _ll_register_callbacks cb 0x7fc65800a6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.461+0000 7fc6677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff23050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.461+0000 7fc6677fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff23050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43890/0 (socket says 172.21.15.59:43890) 2024-09-10T21:19:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.461+0000 7fc6677fe640 1 -- 172.21.15.59:0/672516638 learned_addr learned my addr 172.21.15.59:0/672516638 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.461+0000 7fc6677fe640 1 -- 172.21.15.59:0/672516638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff1ed80 msgr2=0x55fb2ff9a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.461+0000 7fc6677fe640 1 --2- 172.21.15.59:0/672516638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff1ed80 0x55fb2ff9a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.461+0000 7fc6677fe640 1 -- 172.21.15.59:0/672516638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb2ff12df0 msgr2=0x55fb2ff23590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.461+0000 7fc6677fe640 1 --2- 172.21.15.59:0/672516638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb2ff12df0 0x55fb2ff23590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.461+0000 7fc6677fe640 1 -- 172.21.15.59:0/672516638 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb2ff9abf0 con 0x55fb2ff124d0 2024-09-10T21:19:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.462+0000 7fc6677fe640 1 --2- 172.21.15.59:0/672516638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff23050 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc65800b010 tx=0x7fc65801cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5536e1bf37639ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.462+0000 7fc646ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.462+0000 7fc646ffd640 1 -- 172.21.15.59:0/672516638 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc658037030 con 0x55fb2ff124d0 2024-09-10T21:19:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.462+0000 7fc646ffd640 1 -- 172.21.15.59:0/672516638 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc658005230 con 0x55fb2ff124d0 2024-09-10T21:19:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.462+0000 7fc6702c0740 1 -- 172.21.15.59:0/672516638 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc658039070 con 0x55fb2ff124d0 2024-09-10T21:19:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.462+0000 7fc646ffd640 1 -- 172.21.15.59:0/672516638 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc65802c040 con 0x55fb2ff124d0 2024-09-10T21:19:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.462+0000 7fc6702c0740 10 client.16506 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.462+0000 7fc6702c0740 1 -- 172.21.15.59:0/672516638 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fb2ff9bda0 con 0x55fb2ff124d0 2024-09-10T21:19:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.462+0000 7fc646ffd640 1 -- 172.21.15.59:0/672516638 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc658039070 con 0x55fb2ff124d0 2024-09-10T21:19:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.462+0000 7fc646ffd640 1 -- 172.21.15.59:0/672516638 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc658004730 con 0x55fb2ff124d0 2024-09-10T21:19:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.462+0000 7fc6702c0740 10 client.16506 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.462+0000 7fc6702c0740 10 client.16506 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:19:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.462+0000 7fc6702c0740 20 client.16506 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.462+0000 7fc6702c0740 1 --2- 172.21.15.59:0/672516638 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55fb2ff9c410 0x55fb2ff9e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.462+0000 7fc6702c0740 4 client.16506 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:19:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.462+0000 7fc6702c0740 1 -- 172.21.15.59:0/672516638 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fb2fe868a0 con 0x55fb2ff9c410 2024-09-10T21:19:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.463+0000 7fc666ffd640 1 --2- 172.21.15.59:0/672516638 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55fb2ff9c410 0x55fb2ff9e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.463+0000 7fc666ffd640 1 --2- 172.21.15.59:0/672516638 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55fb2ff9c410 0x55fb2ff9e850 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa4d0baec743c078 server_cookie=ac0c75fa9bfc0794 in_seq=0 out_seq=0 2024-09-10T21:19:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.463+0000 7fc646ffd640 10 client.16506 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.463+0000 7fc646ffd640 1 -- 172.21.15.59:0/672516638 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fb2fe868a0 con 0x55fb2ff9c410 2024-09-10T21:19:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.463+0000 7fc646ffd640 10 client.16506 handle_command_reply: tid=0 2024-09-10T21:19:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.463+0000 7fc6702c0740 1 client.16506 shutdown 2024-09-10T21:19:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.463+0000 7fc6702c0740 1 -- 172.21.15.59:0/672516638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 msgr2=0x55fb2ff23050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.463+0000 7fc6702c0740 1 --2- 172.21.15.59:0/672516638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff23050 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc65800b010 tx=0x7fc65801cec0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc6702c0740 1 -- 172.21.15.59:0/672516638 shutdown_connections 2024-09-10T21:19:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc6702c0740 1 --2- 172.21.15.59:0/672516638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55fb2ff1ed80 0x55fb2ff9a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc6702c0740 1 --2- 172.21.15.59:0/672516638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb2ff12df0 0x55fb2ff23590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc6702c0740 1 --2- 172.21.15.59:0/672516638 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55fb2ff9c410 0x55fb2ff9e850 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc6702c0740 1 --2- 172.21.15.59:0/672516638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb2ff124d0 0x55fb2ff23050 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc6702c0740 1 -- 172.21.15.59:0/672516638 >> 172.21.15.59:0/672516638 conn(0x55fb2ff10300 msgr2=0x55fb2ff1d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc646ffd640 0 client.16506 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc6702c0740 1 -- 172.21.15.59:0/672516638 shutdown_connections 2024-09-10T21:19:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc6702c0740 1 -- 172.21.15.59:0/672516638 wait complete. 2024-09-10T21:19:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc6702c0740 20 client.16506 trim_cache size 0 max 16384 2024-09-10T21:19:50.486 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:19:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc66deeb640 1 -- 172.21.15.59:0/1431063776 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc6500b5360 msgr2=0x7fc6500b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc66deeb640 1 --2- 172.21.15.59:0/1431063776 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc6500b5360 0x7fc6500b7820 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55fb2ff111e0 tx=0x7fc65800a2d0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc66deeb640 1 -- 172.21.15.59:0/1431063776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc668104600 msgr2=0x7fc668199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc66deeb640 1 --2- 172.21.15.59:0/1431063776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc668104600 0x7fc668199720 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00d6b0 tx=0x7fc65c00dab0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc66deeb640 1 -- 172.21.15.59:0/1431063776 shutdown_connections 2024-09-10T21:19:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc66deeb640 1 --2- 172.21.15.59:0/1431063776 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc6500b5360 0x7fc6500b7820 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc66deeb640 1 --2- 172.21.15.59:0/1431063776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc66810d140 0x7fc66819eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc66deeb640 1 --2- 172.21.15.59:0/1431063776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc668104600 0x7fc668199720 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc66deeb640 1 --2- 172.21.15.59:0/1431063776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc668103ce0 0x7fc6681991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc66deeb640 1 -- 172.21.15.59:0/1431063776 >> 172.21.15.59:0/1431063776 conn(0x7fc6680fd720 msgr2=0x7fc66810f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc66deeb640 1 -- 172.21.15.59:0/1431063776 shutdown_connections 2024-09-10T21:19:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:50.464+0000 7fc66deeb640 1 -- 172.21.15.59:0/1431063776 wait complete. 2024-09-10T21:19:50.660 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:50 smithi059 ceph-mon[30888]: pgmap v477: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:50.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:50 smithi154 ceph-mon[35041]: pgmap v477: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:50.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:50 smithi192 ceph-mon[35363]: pgmap v477: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:52.147 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:19:52.148 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:19:52.421 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:19:52.542 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:52 smithi059 ceph-mon[30888]: pgmap v478: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:19:52.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:52 smithi154 ceph-mon[35041]: pgmap v478: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:19:52.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:52 smithi192 ceph-mon[35363]: pgmap v478: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:19:52.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.913+0000 7fa454c36640 1 -- 172.21.15.59:0/1304471291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa45010d140 msgr2=0x7fa45010f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:52.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.913+0000 7fa454c36640 1 --2- 172.21.15.59:0/1304471291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa45010d140 0x7fa45010f5a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa448009ca0 tx=0x7fa44802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.913+0000 7fa454c36640 1 -- 172.21.15.59:0/1304471291 shutdown_connections 2024-09-10T21:19:52.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.913+0000 7fa454c36640 1 --2- 172.21.15.59:0/1304471291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa45010d140 0x7fa45010f5a0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.913+0000 7fa454c36640 1 --2- 172.21.15.59:0/1304471291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa450104600 0x7fa45010caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.913+0000 7fa454c36640 1 --2- 172.21.15.59:0/1304471291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa450103ce0 0x7fa4501040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.913+0000 7fa454c36640 1 -- 172.21.15.59:0/1304471291 >> 172.21.15.59:0/1304471291 conn(0x7fa4500fd700 msgr2=0x7fa4500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:52.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.913+0000 7fa454c36640 1 -- 172.21.15.59:0/1304471291 shutdown_connections 2024-09-10T21:19:52.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.913+0000 7fa454c36640 1 -- 172.21.15.59:0/1304471291 wait complete. 2024-09-10T21:19:52.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.914+0000 7fa454c36640 1 Processor -- start 2024-09-10T21:19:52.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.914+0000 7fa454c36640 1 -- start start 2024-09-10T21:19:52.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.914+0000 7fa454c36640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa450103ce0 0x7fa450199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.914+0000 7fa454c36640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa450104600 0x7fa450199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.914+0000 7fa454c36640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa45010d140 0x7fa45019eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.914+0000 7fa454c36640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa450112e00 con 0x7fa450104600 2024-09-10T21:19:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.914+0000 7fa454c36640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa450112c80 con 0x7fa45010d140 2024-09-10T21:19:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.914+0000 7fa454c36640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa450112f80 con 0x7fa450103ce0 2024-09-10T21:19:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.915+0000 7fa44dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa450104600 0x7fa450199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.915+0000 7fa44dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa450104600 0x7fa450199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43912/0 (socket says 172.21.15.59:43912) 2024-09-10T21:19:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.915+0000 7fa44dd9b640 1 -- 172.21.15.59:0/3953493127 learned_addr learned my addr 172.21.15.59:0/3953493127 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.915+0000 7fa44e59c640 1 --2- 172.21.15.59:0/3953493127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa450103ce0 0x7fa450199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.915+0000 7fa44ed9d640 1 --2- 172.21.15.59:0/3953493127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa45010d140 0x7fa45019eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.915+0000 7fa44dd9b640 1 -- 172.21.15.59:0/3953493127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa450103ce0 msgr2=0x7fa450199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.915+0000 7fa44dd9b640 1 --2- 172.21.15.59:0/3953493127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa450103ce0 0x7fa450199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.915+0000 7fa44dd9b640 1 -- 172.21.15.59:0/3953493127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa45010d140 msgr2=0x7fa45019eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:52.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.915+0000 7fa44dd9b640 1 --2- 172.21.15.59:0/3953493127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa45010d140 0x7fa45019eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.915+0000 7fa44dd9b640 1 -- 172.21.15.59:0/3953493127 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45019f300 con 0x7fa450104600 2024-09-10T21:19:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.915+0000 7fa44ed9d640 1 --2- 172.21.15.59:0/3953493127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa45010d140 0x7fa45019eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.915+0000 7fa44dd9b640 1 --2- 172.21.15.59:0/3953493127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa450104600 0x7fa450199790 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa44400d750 tx=0x7fa44400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.915+0000 7fa43f7fe640 1 -- 172.21.15.59:0/3953493127 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa444017070 con 0x7fa450104600 2024-09-10T21:19:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.915+0000 7fa43f7fe640 1 -- 172.21.15.59:0/3953493127 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa444004020 con 0x7fa450104600 2024-09-10T21:19:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.915+0000 7fa454c36640 1 -- 172.21.15.59:0/3953493127 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa45019f5f0 con 0x7fa450104600 2024-09-10T21:19:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.915+0000 7fa43f7fe640 1 -- 172.21.15.59:0/3953493127 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa444003c00 con 0x7fa450104600 2024-09-10T21:19:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.915+0000 7fa454c36640 1 -- 172.21.15.59:0/3953493127 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4501a5e80 con 0x7fa450104600 2024-09-10T21:19:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.918+0000 7fa45700b740 1 Processor -- start 2024-09-10T21:19:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.918+0000 7fa43f7fe640 1 -- 172.21.15.59:0/3953493127 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fa444009a30 con 0x7fa450104600 2024-09-10T21:19:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.918+0000 7fa45700b740 1 -- start start 2024-09-10T21:19:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.918+0000 7fa45700b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0ceee0 0x562e6a0cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:52.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.918+0000 7fa45700b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0cf800 0x562e6a0db250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:52.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.918+0000 7fa45700b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 0x562e6a0ddb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:52.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.918+0000 7fa45700b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562e6a045e60 con 0x562e6a0cf800 2024-09-10T21:19:52.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.918+0000 7fa45700b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562e6a035290 con 0x562e6a0db790 2024-09-10T21:19:52.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.918+0000 7fa45700b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562e6a0390a0 con 0x562e6a0ceee0 2024-09-10T21:19:52.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.918+0000 7fa44e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0cf800 0x562e6a0db250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:52.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.918+0000 7fa44e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0cf800 0x562e6a0db250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43920/0 (socket says 172.21.15.59:43920) 2024-09-10T21:19:52.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.918+0000 7fa44e59c640 1 -- 172.21.15.59:0/1649275974 learned_addr learned my addr 172.21.15.59:0/1649275974 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:52.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.919+0000 7fa44ed9d640 1 --2- 172.21.15.59:0/1649275974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0ceee0 0x562e6a0cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:52.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.919+0000 7fa44dd9b640 1 --2- 172.21.15.59:0/1649275974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 0x562e6a0ddb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:52.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.919+0000 7fa44e59c640 1 -- 172.21.15.59:0/1649275974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0ceee0 msgr2=0x562e6a0cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:52.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.919+0000 7fa44e59c640 1 --2- 172.21.15.59:0/1649275974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0ceee0 0x562e6a0cf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.919+0000 7fa44e59c640 1 -- 172.21.15.59:0/1649275974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 msgr2=0x562e6a0ddb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:52.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.919+0000 7fa44e59c640 1 --2- 172.21.15.59:0/1649275974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 0x562e6a0ddb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.919+0000 7fa44e59c640 1 -- 172.21.15.59:0/1649275974 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e69d93930 con 0x562e6a0cf800 2024-09-10T21:19:52.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.919+0000 7fa44dd9b640 1 --2- 172.21.15.59:0/1649275974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 0x562e6a0ddb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:52.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.919+0000 7fa43f7fe640 1 --2- 172.21.15.59:0/3953493127 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa4380b5360 0x7fa4380b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:52.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.919+0000 7fa44ed9d640 1 --2- 172.21.15.59:0/3953493127 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa4380b5360 0x7fa4380b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:52.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.919+0000 7fa43f7fe640 1 -- 172.21.15.59:0/3953493127 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa4440e5400 con 0x7fa450104600 2024-09-10T21:19:52.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.919+0000 7fa44e59c640 1 --2- 172.21.15.59:0/1649275974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0cf800 0x562e6a0db250 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa44000bd40 tx=0x7fa4400107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1c766f90d7a5fe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:52.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.919+0000 7fa43cff9640 1 -- 172.21.15.59:0/1649275974 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa440004230 con 0x562e6a0cf800 2024-09-10T21:19:52.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.919+0000 7fa43cff9640 1 -- 172.21.15.59:0/1649275974 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa44000be30 con 0x562e6a0cf800 2024-09-10T21:19:52.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.919+0000 7fa43cff9640 1 -- 172.21.15.59:0/1649275974 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44001a740 con 0x562e6a0cf800 2024-09-10T21:19:52.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.920+0000 7fa45700b740 1 -- 172.21.15.59:0/1649275974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0cf800 msgr2=0x562e6a0db250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:52.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.920+0000 7fa44ed9d640 1 --2- 172.21.15.59:0/3953493127 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa4380b5360 0x7fa4380b7820 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa448006010 tx=0x7fa448004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:52.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.920+0000 7fa45700b740 1 --2- 172.21.15.59:0/1649275974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0cf800 0x562e6a0db250 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa44000bd40 tx=0x7fa4400107a0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.920+0000 7fa45700b740 1 -- 172.21.15.59:0/1649275974 shutdown_connections 2024-09-10T21:19:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.920+0000 7fa45700b740 1 --2- 172.21.15.59:0/1649275974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 0x562e6a0ddb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.920+0000 7fa45700b740 1 --2- 172.21.15.59:0/1649275974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0cf800 0x562e6a0db250 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.920+0000 7fa45700b740 1 --2- 172.21.15.59:0/1649275974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0ceee0 0x562e6a0cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.920+0000 7fa45700b740 1 -- 172.21.15.59:0/1649275974 >> 172.21.15.59:0/1649275974 conn(0x562e6a0ccd10 msgr2=0x562e6a0cdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.920+0000 7fa45700b740 1 -- 172.21.15.59:0/1649275974 shutdown_connections 2024-09-10T21:19:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.920+0000 7fa45700b740 1 -- 172.21.15.59:0/1649275974 wait complete. 2024-09-10T21:19:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.921+0000 7fa45700b740 1 -- start start 2024-09-10T21:19:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.921+0000 7fa45700b740 1 Processor -- start 2024-09-10T21:19:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.921+0000 7fa45700b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0ceee0 0x562e6a0d8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.921+0000 7fa45700b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0cf800 0x562e6a0d8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.921+0000 7fa45700b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 0x562e6a0d91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.921+0000 7fa45700b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562e69e96890 con 0x562e6a0cf800 2024-09-10T21:19:52.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.921+0000 7fa45700b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562e69fcfd40 con 0x562e6a0db790 2024-09-10T21:19:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.921+0000 7fa45700b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562e6a0de440 con 0x562e6a0ceee0 2024-09-10T21:19:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.921+0000 7fa45700b740 10 client.0 _ll_register_callbacks cb 0x562e6a033c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.921+0000 7fa44dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0cf800 0x562e6a0d8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.921+0000 7fa44dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0cf800 0x562e6a0d8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43934/0 (socket says 172.21.15.59:43934) 2024-09-10T21:19:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.921+0000 7fa44dd9b640 1 -- 172.21.15.59:0/3126695998 learned_addr learned my addr 172.21.15.59:0/3126695998 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.921+0000 7fa44e59c640 1 --2- 172.21.15.59:0/3126695998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0ceee0 0x562e6a0d8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.921+0000 7fa44ed9d640 1 --2- 172.21.15.59:0/3126695998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 0x562e6a0d91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa44dd9b640 1 -- 172.21.15.59:0/3126695998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0ceee0 msgr2=0x562e6a0d8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa44dd9b640 1 --2- 172.21.15.59:0/3126695998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0ceee0 0x562e6a0d8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa44dd9b640 1 -- 172.21.15.59:0/3126695998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 msgr2=0x562e6a0d91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa44dd9b640 1 --2- 172.21.15.59:0/3126695998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 0x562e6a0d91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa44dd9b640 1 -- 172.21.15.59:0/3126695998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e6a0e7820 con 0x562e6a0cf800 2024-09-10T21:19:52.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa44ed9d640 1 --2- 172.21.15.59:0/3126695998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 0x562e6a0d91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa44dd9b640 1 --2- 172.21.15.59:0/3126695998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0cf800 0x562e6a0d8c60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa44400d720 tx=0x7fa4440a7b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d6c863baa42f9b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa435ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa435ffb640 1 -- 172.21.15.59:0/3126695998 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa444020070 con 0x562e6a0cf800 2024-09-10T21:19:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa435ffb640 1 -- 172.21.15.59:0/3126695998 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa444003da0 con 0x562e6a0cf800 2024-09-10T21:19:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa45700b740 1 -- 172.21.15.59:0/3126695998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa44000be30 con 0x562e6a0cf800 2024-09-10T21:19:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa435ffb640 1 -- 172.21.15.59:0/3126695998 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa4440ab360 con 0x562e6a0cf800 2024-09-10T21:19:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa45700b740 10 client.16518 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa45700b740 1 -- 172.21.15.59:0/3126695998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562e6a0ea1d0 con 0x562e6a0cf800 2024-09-10T21:19:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa435ffb640 1 -- 172.21.15.59:0/3126695998 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa44000be30 con 0x562e6a0cf800 2024-09-10T21:19:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa435ffb640 1 -- 172.21.15.59:0/3126695998 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa4440a7040 con 0x562e6a0cf800 2024-09-10T21:19:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa45700b740 10 client.16518 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa45700b740 10 client.16518 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:19:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa45700b740 20 client.16518 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:52.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa45700b740 1 --2- 172.21.15.59:0/3126695998 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562e6a0eb630 0x562e6a0eda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa45700b740 4 client.16518 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:19:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.922+0000 7fa45700b740 1 -- 172.21.15.59:0/3126695998 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e6a047db0 con 0x562e6a0eb630 2024-09-10T21:19:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.923+0000 7fa44e59c640 1 --2- 172.21.15.59:0/3126695998 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562e6a0eb630 0x562e6a0eda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.923+0000 7fa44e59c640 1 --2- 172.21.15.59:0/3126695998 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562e6a0eb630 0x562e6a0eda60 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c7a3290e33381d6 server_cookie=c0c4bd5965c69cf2 in_seq=0 out_seq=0 2024-09-10T21:19:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.923+0000 7fa435ffb640 10 client.16518 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.924+0000 7fa435ffb640 1 -- 172.21.15.59:0/3126695998 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562e6a047db0 con 0x562e6a0eb630 2024-09-10T21:19:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.924+0000 7fa435ffb640 10 client.16518 handle_command_reply: tid=0 2024-09-10T21:19:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.924+0000 7fa45700b740 1 client.16518 shutdown 2024-09-10T21:19:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.924+0000 7fa45700b740 1 -- 172.21.15.59:0/3126695998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0cf800 msgr2=0x562e6a0d8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.924+0000 7fa45700b740 1 --2- 172.21.15.59:0/3126695998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0cf800 0x562e6a0d8c60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa44400d720 tx=0x7fa4440a7b50 comp rx=0 tx=0).stop 2024-09-10T21:19:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.924+0000 7fa45700b740 1 -- 172.21.15.59:0/3126695998 shutdown_connections 2024-09-10T21:19:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.924+0000 7fa45700b740 1 --2- 172.21.15.59:0/3126695998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 0x562e6a0d91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.924+0000 7fa45700b740 1 --2- 172.21.15.59:0/3126695998 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562e6a0eb630 0x562e6a0eda60 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.924+0000 7fa435ffb640 0 client.16518 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:52.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.924+0000 7fa45700b740 1 --2- 172.21.15.59:0/3126695998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0cf800 0x562e6a0d8c60 secure :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa44400d720 tx=0x7fa4440a7b50 comp rx=0 tx=0).stop 2024-09-10T21:19:52.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.924+0000 7fa45700b740 1 --2- 172.21.15.59:0/3126695998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0ceee0 0x562e6a0d8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.924+0000 7fa45700b740 1 -- 172.21.15.59:0/3126695998 >> 172.21.15.59:0/3126695998 conn(0x562e6a0ccd10 msgr2=0x562e6a0cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:52.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.925+0000 7fa45700b740 1 -- 172.21.15.59:0/3126695998 shutdown_connections 2024-09-10T21:19:52.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.925+0000 7fa45700b740 1 -- 172.21.15.59:0/3126695998 wait complete. 2024-09-10T21:19:52.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.925+0000 7fa45700b740 20 client.16518 trim_cache size 0 max 16384 2024-09-10T21:19:52.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.943+0000 7fa45700b740 1 Processor -- start 2024-09-10T21:19:52.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.943+0000 7fa45700b740 1 -- start start 2024-09-10T21:19:52.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.943+0000 7fa45700b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0ceee0 0x562e6a0d5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:52.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.943+0000 7fa45700b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 0x562e6a0d5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:52.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.943+0000 7fa45700b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0d63d0 0x562e6a0f3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:52.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.943+0000 7fa45700b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa4501ae320 con 0x562e6a0ceee0 2024-09-10T21:19:52.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.943+0000 7fa45700b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4501afe60 con 0x562e6a0db790 2024-09-10T21:19:52.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.943+0000 7fa45700b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa4501ae9f0 con 0x562e6a0d63d0 2024-09-10T21:19:52.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.943+0000 7fa44e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0ceee0 0x562e6a0d5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:52.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.944+0000 7fa44ed9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0d63d0 0x562e6a0f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:52.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.944+0000 7fa44e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0ceee0 0x562e6a0d5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43948/0 (socket says 172.21.15.59:43948) 2024-09-10T21:19:52.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.944+0000 7fa44e59c640 1 -- 172.21.15.59:0/3523228538 learned_addr learned my addr 172.21.15.59:0/3523228538 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:52.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.944+0000 7fa44dd9b640 1 --2- 172.21.15.59:0/3523228538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 0x562e6a0d5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:52.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.944+0000 7fa44e59c640 1 -- 172.21.15.59:0/3523228538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0d63d0 msgr2=0x562e6a0f3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:52.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.944+0000 7fa44e59c640 1 --2- 172.21.15.59:0/3523228538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0d63d0 0x562e6a0f3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.944+0000 7fa44e59c640 1 -- 172.21.15.59:0/3523228538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 msgr2=0x562e6a0d5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:52.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.944+0000 7fa44e59c640 1 --2- 172.21.15.59:0/3523228538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 0x562e6a0d5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.944+0000 7fa44e59c640 1 -- 172.21.15.59:0/3523228538 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e6a0cf630 con 0x562e6a0ceee0 2024-09-10T21:19:52.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.944+0000 7fa44e59c640 1 --2- 172.21.15.59:0/3523228538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0ceee0 0x562e6a0d5950 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa440003ec0 tx=0x7fa440003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623f2fe23bc62a59 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:52.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.944+0000 7fa437fff640 1 -- 172.21.15.59:0/3523228538 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa440032070 con 0x562e6a0ceee0 2024-09-10T21:19:52.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.944+0000 7fa437fff640 1 -- 172.21.15.59:0/3523228538 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4400035f0 con 0x562e6a0ceee0 2024-09-10T21:19:52.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.944+0000 7fa437fff640 1 -- 172.21.15.59:0/3523228538 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44001a6b0 con 0x562e6a0ceee0 2024-09-10T21:19:52.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.945+0000 7fa45700b740 1 -- 172.21.15.59:0/3523228538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0ceee0 msgr2=0x562e6a0d5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:52.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.945+0000 7fa45700b740 1 --2- 172.21.15.59:0/3523228538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0ceee0 0x562e6a0d5950 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa440003ec0 tx=0x7fa440003ef0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.945+0000 7fa45700b740 1 -- 172.21.15.59:0/3523228538 shutdown_connections 2024-09-10T21:19:52.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.945+0000 7fa45700b740 1 --2- 172.21.15.59:0/3523228538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0d63d0 0x562e6a0f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.945+0000 7fa45700b740 1 --2- 172.21.15.59:0/3523228538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 0x562e6a0d5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.945+0000 7fa45700b740 1 --2- 172.21.15.59:0/3523228538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0ceee0 0x562e6a0d5950 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.945+0000 7fa45700b740 1 -- 172.21.15.59:0/3523228538 >> 172.21.15.59:0/3523228538 conn(0x562e6a0ccd10 msgr2=0x562e6a0da570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:52.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.945+0000 7fa45700b740 1 -- 172.21.15.59:0/3523228538 shutdown_connections 2024-09-10T21:19:52.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.945+0000 7fa45700b740 1 -- 172.21.15.59:0/3523228538 wait complete. 2024-09-10T21:19:52.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.945+0000 7fa45700b740 1 -- start start 2024-09-10T21:19:52.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.945+0000 7fa45700b740 1 Processor -- start 2024-09-10T21:19:52.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa45700b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0ceee0 0x562e6a0e3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:52.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa45700b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0d63d0 0x562e6a0e06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:52.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa45700b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 0x562e6a0e0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:52.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa45700b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa4501af790 con 0x562e6a0d63d0 2024-09-10T21:19:52.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa45700b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4501af0c0 con 0x562e6a0db790 2024-09-10T21:19:52.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa45700b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa4501ac300 con 0x562e6a0ceee0 2024-09-10T21:19:52.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa45700b740 10 client.0 _ll_register_callbacks cb 0x7fa4440035f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:52.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa44dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0d63d0 0x562e6a0e06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:52.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa44dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0d63d0 0x562e6a0e06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43958/0 (socket says 172.21.15.59:43958) 2024-09-10T21:19:52.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa44dd9b640 1 -- 172.21.15.59:0/2862571254 learned_addr learned my addr 172.21.15.59:0/2862571254 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:52.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa44e59c640 1 --2- 172.21.15.59:0/2862571254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0ceee0 0x562e6a0e3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:52.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa44ed9d640 1 --2- 172.21.15.59:0/2862571254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 0x562e6a0e0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:52.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa44dd9b640 1 -- 172.21.15.59:0/2862571254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0ceee0 msgr2=0x562e6a0e3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:52.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa44dd9b640 1 --2- 172.21.15.59:0/2862571254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0ceee0 0x562e6a0e3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa44dd9b640 1 -- 172.21.15.59:0/2862571254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 msgr2=0x562e6a0e0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:52.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa44dd9b640 1 --2- 172.21.15.59:0/2862571254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 0x562e6a0e0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa44dd9b640 1 -- 172.21.15.59:0/2862571254 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e6a0e13a0 con 0x562e6a0d63d0 2024-09-10T21:19:52.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa44e59c640 1 --2- 172.21.15.59:0/2862571254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0ceee0 0x562e6a0e3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:52.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa44ed9d640 1 --2- 172.21.15.59:0/2862571254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 0x562e6a0e0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:52.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa44dd9b640 1 --2- 172.21.15.59:0/2862571254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0d63d0 0x562e6a0e06d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa4440a81c0 tx=0x7fa4440e57a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e5f64803836138 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:52.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa435ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:52.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa435ffb640 1 -- 172.21.15.59:0/2862571254 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa444020070 con 0x562e6a0d63d0 2024-09-10T21:19:52.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.946+0000 7fa435ffb640 1 -- 172.21.15.59:0/2862571254 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa4440ab050 con 0x562e6a0d63d0 2024-09-10T21:19:52.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.947+0000 7fa45700b740 1 -- 172.21.15.59:0/2862571254 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4400035f0 con 0x562e6a0d63d0 2024-09-10T21:19:52.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.947+0000 7fa435ffb640 1 -- 172.21.15.59:0/2862571254 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa4440a7360 con 0x562e6a0d63d0 2024-09-10T21:19:52.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.947+0000 7fa45700b740 10 client.16524 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:52.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.947+0000 7fa45700b740 1 -- 172.21.15.59:0/2862571254 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562e6a159550 con 0x562e6a0d63d0 2024-09-10T21:19:52.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.947+0000 7fa435ffb640 1 -- 172.21.15.59:0/2862571254 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4400035f0 con 0x562e6a0d63d0 2024-09-10T21:19:52.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.947+0000 7fa435ffb640 1 -- 172.21.15.59:0/2862571254 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa4440a7040 con 0x562e6a0d63d0 2024-09-10T21:19:52.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.947+0000 7fa45700b740 10 client.16524 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:52.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.947+0000 7fa45700b740 10 client.16524 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:19:52.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.947+0000 7fa45700b740 20 client.16524 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:52.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.947+0000 7fa45700b740 1 --2- 172.21.15.59:0/2862571254 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562e6a159d20 0x562e6a15c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:52.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.947+0000 7fa45700b740 4 client.16524 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:19:52.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.947+0000 7fa45700b740 1 -- 172.21.15.59:0/2862571254 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562e6a043860 con 0x562e6a159d20 2024-09-10T21:19:52.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.947+0000 7fa44e59c640 1 --2- 172.21.15.59:0/2862571254 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562e6a159d20 0x562e6a15c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:52.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.948+0000 7fa44e59c640 1 --2- 172.21.15.59:0/2862571254 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562e6a159d20 0x562e6a15c140 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f250fd96fd315d57 server_cookie=45d9d8492aa72e59 in_seq=0 out_seq=0 2024-09-10T21:19:52.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.948+0000 7fa435ffb640 10 client.16524 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:52.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.950+0000 7fa435ffb640 1 -- 172.21.15.59:0/2862571254 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562e6a043860 con 0x562e6a159d20 2024-09-10T21:19:52.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.950+0000 7fa435ffb640 10 client.16524 handle_command_reply: tid=0 2024-09-10T21:19:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.950+0000 7fa45700b740 1 client.16524 shutdown 2024-09-10T21:19:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.950+0000 7fa45700b740 1 -- 172.21.15.59:0/2862571254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0d63d0 msgr2=0x562e6a0e06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.950+0000 7fa45700b740 1 --2- 172.21.15.59:0/2862571254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0d63d0 0x562e6a0e06d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa4440a81c0 tx=0x7fa4440e57a0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.950+0000 7fa45700b740 1 -- 172.21.15.59:0/2862571254 shutdown_connections 2024-09-10T21:19:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.950+0000 7fa45700b740 1 --2- 172.21.15.59:0/2862571254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e6a0db790 0x562e6a0e0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.950+0000 7fa45700b740 1 --2- 172.21.15.59:0/2862571254 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562e6a159d20 0x562e6a15c140 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.950+0000 7fa45700b740 1 --2- 172.21.15.59:0/2862571254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e6a0d63d0 0x562e6a0e06d0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.950+0000 7fa45700b740 1 --2- 172.21.15.59:0/2862571254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e6a0ceee0 0x562e6a0e3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.950+0000 7fa45700b740 1 -- 172.21.15.59:0/2862571254 >> 172.21.15.59:0/2862571254 conn(0x562e6a0ccd10 msgr2=0x562e6a0d6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.950+0000 7fa435ffb640 0 client.16524 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.950+0000 7fa45700b740 1 -- 172.21.15.59:0/2862571254 shutdown_connections 2024-09-10T21:19:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.950+0000 7fa45700b740 1 -- 172.21.15.59:0/2862571254 wait complete. 2024-09-10T21:19:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.950+0000 7fa45700b740 20 client.16524 trim_cache size 0 max 16384 2024-09-10T21:19:52.962 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:19:52.962 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:19:52.962 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4", 2024-09-10T21:19:52.962 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:19:52.962 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:19:52.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.951+0000 7fa454c36640 1 -- 172.21.15.59:0/3953493127 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa4380b5360 msgr2=0x7fa4380b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:52.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.951+0000 7fa454c36640 1 --2- 172.21.15.59:0/3953493127 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa4380b5360 0x7fa4380b7820 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa448006010 tx=0x7fa448004a60 comp rx=0 tx=0).stop 2024-09-10T21:19:52.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.951+0000 7fa454c36640 1 -- 172.21.15.59:0/3953493127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa450104600 msgr2=0x7fa450199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:52.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.951+0000 7fa454c36640 1 --2- 172.21.15.59:0/3953493127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa450104600 0x7fa450199790 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa44400d750 tx=0x7fa44400dc10 comp rx=0 tx=0).stop 2024-09-10T21:19:52.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.951+0000 7fa454c36640 1 -- 172.21.15.59:0/3953493127 shutdown_connections 2024-09-10T21:19:52.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.951+0000 7fa454c36640 1 --2- 172.21.15.59:0/3953493127 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa4380b5360 0x7fa4380b7820 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.951+0000 7fa454c36640 1 --2- 172.21.15.59:0/3953493127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa45010d140 0x7fa45019eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.951+0000 7fa454c36640 1 --2- 172.21.15.59:0/3953493127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa450104600 0x7fa450199790 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.951+0000 7fa454c36640 1 --2- 172.21.15.59:0/3953493127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa450103ce0 0x7fa450199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:52.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.951+0000 7fa454c36640 1 -- 172.21.15.59:0/3953493127 >> 172.21.15.59:0/3953493127 conn(0x7fa4500fd700 msgr2=0x7fa45010f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:52.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.951+0000 7fa454c36640 1 -- 172.21.15.59:0/3953493127 shutdown_connections 2024-09-10T21:19:52.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:52.951+0000 7fa454c36640 1 -- 172.21.15.59:0/3953493127 wait complete. 2024-09-10T21:19:53.774 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:19:54.033 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:19:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.485+0000 7fcecba0b640 1 -- 172.21.15.59:0/2852229110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4075f40 msgr2=0x7fcec410ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:54.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.485+0000 7fcecba0b640 1 --2- 172.21.15.59:0/2852229110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4075f40 0x7fcec410ee10 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009900 tx=0x7fceb802a410 comp rx=0 tx=0).stop 2024-09-10T21:19:54.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.485+0000 7fcecba0b640 1 -- 172.21.15.59:0/2852229110 shutdown_connections 2024-09-10T21:19:54.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.485+0000 7fcecba0b640 1 --2- 172.21.15.59:0/2852229110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcec410f3e0 0x7fcec41117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.485+0000 7fcecba0b640 1 --2- 172.21.15.59:0/2852229110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4075f40 0x7fcec410ee10 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.485+0000 7fcecba0b640 1 --2- 172.21.15.59:0/2852229110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec4075540 0x7fcec4075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.485+0000 7fcecba0b640 1 -- 172.21.15.59:0/2852229110 >> 172.21.15.59:0/2852229110 conn(0x7fcec40fe830 msgr2=0x7fcec4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:54.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.485+0000 7fcecba0b640 1 -- 172.21.15.59:0/2852229110 shutdown_connections 2024-09-10T21:19:54.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.485+0000 7fcecba0b640 1 -- 172.21.15.59:0/2852229110 wait complete. 2024-09-10T21:19:54.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.486+0000 7fcecba0b640 1 Processor -- start 2024-09-10T21:19:54.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.486+0000 7fcecba0b640 1 -- start start 2024-09-10T21:19:54.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.486+0000 7fcecba0b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcec4075540 0x7fcec419b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.486+0000 7fcecba0b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4075f40 0x7fcec419ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.486+0000 7fcecba0b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec410f3e0 0x7fcec41a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.486+0000 7fcecba0b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcec4114fa0 con 0x7fcec4075f40 2024-09-10T21:19:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.486+0000 7fcecba0b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcec4114e20 con 0x7fcec410f3e0 2024-09-10T21:19:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.486+0000 7fcecba0b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcec4115120 con 0x7fcec4075540 2024-09-10T21:19:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.486+0000 7fcec8fa6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4075f40 0x7fcec419ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.486+0000 7fcec8fa6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4075f40 0x7fcec419ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43980/0 (socket says 172.21.15.59:43980) 2024-09-10T21:19:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.486+0000 7fcec8fa6640 1 -- 172.21.15.59:0/791963854 learned_addr learned my addr 172.21.15.59:0/791963854 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.487+0000 7fcec9fa8640 1 --2- 172.21.15.59:0/791963854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec410f3e0 0x7fcec41a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.487+0000 7fcec97a7640 1 --2- 172.21.15.59:0/791963854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcec4075540 0x7fcec419b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.487+0000 7fcec8fa6640 1 -- 172.21.15.59:0/791963854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcec4075540 msgr2=0x7fcec419b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:54.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.487+0000 7fcec8fa6640 1 --2- 172.21.15.59:0/791963854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcec4075540 0x7fcec419b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.487+0000 7fcec8fa6640 1 -- 172.21.15.59:0/791963854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec410f3e0 msgr2=0x7fcec41a0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:54.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.487+0000 7fcec8fa6640 1 --2- 172.21.15.59:0/791963854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec410f3e0 0x7fcec41a0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.487+0000 7fcec8fa6640 1 -- 172.21.15.59:0/791963854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec41a1600 con 0x7fcec4075f40 2024-09-10T21:19:54.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.487+0000 7fcec8fa6640 1 --2- 172.21.15.59:0/791963854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4075f40 0x7fcec419ba90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fceb8005940 tx=0x7fceb80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:54.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.487+0000 7fceb67fc640 1 -- 172.21.15.59:0/791963854 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb803f030 con 0x7fcec4075f40 2024-09-10T21:19:54.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.487+0000 7fceb67fc640 1 -- 172.21.15.59:0/791963854 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fceb8003cb0 con 0x7fcec4075f40 2024-09-10T21:19:54.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.487+0000 7fcecba0b640 1 -- 172.21.15.59:0/791963854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec41a1890 con 0x7fcec4075f40 2024-09-10T21:19:54.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.487+0000 7fceb67fc640 1 -- 172.21.15.59:0/791963854 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8035070 con 0x7fcec4075f40 2024-09-10T21:19:54.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.487+0000 7fcecba0b640 1 -- 172.21.15.59:0/791963854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec41a7fb0 con 0x7fcec4075f40 2024-09-10T21:19:54.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.490+0000 7fceb67fc640 1 -- 172.21.15.59:0/791963854 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fceb803bbf0 con 0x7fcec4075f40 2024-09-10T21:19:54.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.490+0000 7fcecdde0740 1 Processor -- start 2024-09-10T21:19:54.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.490+0000 7fcecdde0740 1 -- start start 2024-09-10T21:19:54.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.490+0000 7fcecdde0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a55480 0x55d984a55860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:54.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.490+0000 7fcecdde0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a55da0 0x55d984a617f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:54.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.490+0000 7fcecdde0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a61d30 0x55d984a64120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:54.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.490+0000 7fcecdde0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d9849cbe50 con 0x55d984a55480 2024-09-10T21:19:54.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.490+0000 7fcecdde0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d9849bb280 con 0x55d984a61d30 2024-09-10T21:19:54.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.490+0000 7fcecdde0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d9849bf090 con 0x55d984a55da0 2024-09-10T21:19:54.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.490+0000 7fcec9fa8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a55480 0x55d984a55860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:54.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.490+0000 7fcec9fa8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a55480 0x55d984a55860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43986/0 (socket says 172.21.15.59:43986) 2024-09-10T21:19:54.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.490+0000 7fcec9fa8640 1 -- 172.21.15.59:0/3290973284 learned_addr learned my addr 172.21.15.59:0/3290973284 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:54.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.490+0000 7fcec97a7640 1 --2- 172.21.15.59:0/3290973284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a55da0 0x55d984a617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:54.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.490+0000 7fcec8fa6640 1 --2- 172.21.15.59:0/3290973284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a61d30 0x55d984a64120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:54.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.491+0000 7fcec9fa8640 1 -- 172.21.15.59:0/3290973284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a55da0 msgr2=0x55d984a617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:54.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.491+0000 7fcec9fa8640 1 --2- 172.21.15.59:0/3290973284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a55da0 0x55d984a617f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.491+0000 7fcec9fa8640 1 -- 172.21.15.59:0/3290973284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a61d30 msgr2=0x55d984a64120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:54.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.491+0000 7fcec9fa8640 1 --2- 172.21.15.59:0/3290973284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a61d30 0x55d984a64120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.491+0000 7fcec9fa8640 1 -- 172.21.15.59:0/3290973284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d984719650 con 0x55d984a55480 2024-09-10T21:19:54.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.491+0000 7fceb67fc640 1 --2- 172.21.15.59:0/791963854 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fceb00b52e0 0x7fceb00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:54.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.491+0000 7fcec9fa8640 1 --2- 172.21.15.59:0/3290973284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a55480 0x55d984a55860 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009f40 tx=0x7fcebc010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e79f311d6bc4dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:54.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.491+0000 7fcec97a7640 1 --2- 172.21.15.59:0/791963854 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fceb00b52e0 0x7fceb00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:54.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.491+0000 7fceb67fc640 1 -- 172.21.15.59:0/791963854 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fceb8106740 con 0x7fcec4075f40 2024-09-10T21:19:54.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.491+0000 7fceaf7fe640 1 -- 172.21.15.59:0/3290973284 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc016070 con 0x55d984a55480 2024-09-10T21:19:54.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.491+0000 7fceaf7fe640 1 -- 172.21.15.59:0/3290973284 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcebc004d20 con 0x55d984a55480 2024-09-10T21:19:54.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.491+0000 7fceaf7fe640 1 -- 172.21.15.59:0/3290973284 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc0127a0 con 0x55d984a55480 2024-09-10T21:19:54.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.492+0000 7fcecdde0740 1 -- 172.21.15.59:0/3290973284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a55480 msgr2=0x55d984a55860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:54.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.492+0000 7fcec97a7640 1 --2- 172.21.15.59:0/791963854 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fceb00b52e0 0x7fceb00b77a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55d984a54190 tx=0x7fcec000b4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:54.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.492+0000 7fcecdde0740 1 --2- 172.21.15.59:0/3290973284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a55480 0x55d984a55860 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fcebc009f40 tx=0x7fcebc010800 comp rx=0 tx=0).stop 2024-09-10T21:19:54.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.492+0000 7fcecdde0740 1 -- 172.21.15.59:0/3290973284 shutdown_connections 2024-09-10T21:19:54.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.492+0000 7fcecdde0740 1 --2- 172.21.15.59:0/3290973284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a61d30 0x55d984a64120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.492+0000 7fcecdde0740 1 --2- 172.21.15.59:0/3290973284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a55da0 0x55d984a617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.492+0000 7fcecdde0740 1 --2- 172.21.15.59:0/3290973284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a55480 0x55d984a55860 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.492+0000 7fcecdde0740 1 -- 172.21.15.59:0/3290973284 >> 172.21.15.59:0/3290973284 conn(0x55d984a532b0 msgr2=0x55d984a54450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:54.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.492+0000 7fcecdde0740 1 -- 172.21.15.59:0/3290973284 shutdown_connections 2024-09-10T21:19:54.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.492+0000 7fcecdde0740 1 -- 172.21.15.59:0/3290973284 wait complete. 2024-09-10T21:19:54.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.492+0000 7fcecdde0740 1 -- start start 2024-09-10T21:19:54.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.493+0000 7fcecdde0740 1 Processor -- start 2024-09-10T21:19:54.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.493+0000 7fcecdde0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a55480 0x55d984a61580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:54.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.493+0000 7fcecdde0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a55da0 0x55d984a5e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:54.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.493+0000 7fcecdde0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a61d30 0x55d984a5ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:54.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.493+0000 7fcecdde0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d98481c700 con 0x55d984a61d30 2024-09-10T21:19:54.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.493+0000 7fcecdde0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d984956110 con 0x55d984a55480 2024-09-10T21:19:54.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.493+0000 7fcecdde0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d984a649b0 con 0x55d984a55da0 2024-09-10T21:19:54.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.493+0000 7fcecdde0740 10 client.0 _ll_register_callbacks cb 0x55d98496f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:54.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.493+0000 7fcec9fa8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a61d30 0x55d984a5ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:54.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.493+0000 7fcec9fa8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a61d30 0x55d984a5ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43988/0 (socket says 172.21.15.59:43988) 2024-09-10T21:19:54.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.493+0000 7fcec8fa6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a55da0 0x55d984a5e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:54.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.493+0000 7fcec9fa8640 1 -- 172.21.15.59:0/125487476 learned_addr learned my addr 172.21.15.59:0/125487476 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:54.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.493+0000 7fcec97a7640 1 --2- 172.21.15.59:0/125487476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a55480 0x55d984a61580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:54.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.493+0000 7fcec9fa8640 1 -- 172.21.15.59:0/125487476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a55da0 msgr2=0x55d984a5e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:54.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.493+0000 7fcec9fa8640 1 --2- 172.21.15.59:0/125487476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a55da0 0x55d984a5e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.493+0000 7fcec9fa8640 1 -- 172.21.15.59:0/125487476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a55480 msgr2=0x55d984a61580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:54.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.493+0000 7fcec9fa8640 1 --2- 172.21.15.59:0/125487476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a55480 0x55d984a61580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.493+0000 7fcec9fa8640 1 -- 172.21.15.59:0/125487476 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d984983c40 con 0x55d984a61d30 2024-09-10T21:19:54.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.493+0000 7fcec97a7640 1 --2- 172.21.15.59:0/125487476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a55480 0x55d984a61580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:54.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.494+0000 7fcec9fa8640 1 --2- 172.21.15.59:0/125487476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a61d30 0x55d984a5ef30 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00a010 tx=0x7fcebc004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56331f0313e4edd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:54.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.494+0000 7fceacff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:54.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.494+0000 7fceacff9640 1 -- 172.21.15.59:0/125487476 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc016030 con 0x55d984a61d30 2024-09-10T21:19:54.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.494+0000 7fceacff9640 1 -- 172.21.15.59:0/125487476 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcebc003b80 con 0x55d984a61d30 2024-09-10T21:19:54.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.494+0000 7fcecdde0740 1 -- 172.21.15.59:0/125487476 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcebc004d20 con 0x55d984a61d30 2024-09-10T21:19:54.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.494+0000 7fceacff9640 1 -- 172.21.15.59:0/125487476 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcebc003d80 con 0x55d984a61d30 2024-09-10T21:19:54.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.494+0000 7fcecdde0740 10 client.16536 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:54.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.494+0000 7fcecdde0740 1 -- 172.21.15.59:0/125487476 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d984a702a0 con 0x55d984a61d30 2024-09-10T21:19:54.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.494+0000 7fceacff9640 1 -- 172.21.15.59:0/125487476 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcebc004d20 con 0x55d984a61d30 2024-09-10T21:19:54.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.494+0000 7fceacff9640 1 -- 172.21.15.59:0/125487476 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcebc00f040 con 0x55d984a61d30 2024-09-10T21:19:54.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.494+0000 7fcecdde0740 10 client.16536 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:54.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.495+0000 7fcecdde0740 10 client.16536 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:19:54.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.495+0000 7fcecdde0740 20 client.16536 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:54.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.495+0000 7fcecdde0740 1 --2- 172.21.15.59:0/125487476 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d984a716a0 0x55d984a73a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:54.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.495+0000 7fcecdde0740 4 client.16536 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:19:54.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.495+0000 7fcecdde0740 1 -- 172.21.15.59:0/125487476 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9849cdda0 con 0x55d984a716a0 2024-09-10T21:19:54.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.495+0000 7fcec97a7640 1 --2- 172.21.15.59:0/125487476 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d984a716a0 0x55d984a73a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:54.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.495+0000 7fcec97a7640 1 --2- 172.21.15.59:0/125487476 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d984a716a0 0x55d984a73a90 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6d837a19efb15a3 server_cookie=855f598dd8659fc0 in_seq=0 out_seq=0 2024-09-10T21:19:54.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.495+0000 7fceacff9640 10 client.16536 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.496+0000 7fceacff9640 1 -- 172.21.15.59:0/125487476 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d9849cdda0 con 0x55d984a716a0 2024-09-10T21:19:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.496+0000 7fceacff9640 10 client.16536 handle_command_reply: tid=0 2024-09-10T21:19:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.496+0000 7fcecdde0740 1 client.16536 shutdown 2024-09-10T21:19:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.497+0000 7fcecdde0740 1 -- 172.21.15.59:0/125487476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a61d30 msgr2=0x55d984a5ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.497+0000 7fcecdde0740 1 --2- 172.21.15.59:0/125487476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a61d30 0x55d984a5ef30 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00a010 tx=0x7fcebc004c70 comp rx=0 tx=0).stop 2024-09-10T21:19:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.497+0000 7fcecdde0740 1 -- 172.21.15.59:0/125487476 shutdown_connections 2024-09-10T21:19:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.497+0000 7fcecdde0740 1 --2- 172.21.15.59:0/125487476 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d984a716a0 0x55d984a73a90 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.497+0000 7fcecdde0740 1 --2- 172.21.15.59:0/125487476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a61d30 0x55d984a5ef30 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.497+0000 7fcecdde0740 1 --2- 172.21.15.59:0/125487476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a55da0 0x55d984a5e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.497+0000 7fcecdde0740 1 --2- 172.21.15.59:0/125487476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a55480 0x55d984a61580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.497+0000 7fceacff9640 0 client.16536 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.497+0000 7fcecdde0740 1 -- 172.21.15.59:0/125487476 >> 172.21.15.59:0/125487476 conn(0x55d984a532b0 msgr2=0x55d984a58e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.497+0000 7fcecdde0740 1 -- 172.21.15.59:0/125487476 shutdown_connections 2024-09-10T21:19:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.497+0000 7fcecdde0740 1 -- 172.21.15.59:0/125487476 wait complete. 2024-09-10T21:19:54.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.497+0000 7fcecdde0740 20 client.16536 trim_cache size 0 max 16384 2024-09-10T21:19:54.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.515+0000 7fcecdde0740 1 Processor -- start 2024-09-10T21:19:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.515+0000 7fcecdde0740 1 -- start start 2024-09-10T21:19:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.515+0000 7fcecdde0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a55480 0x55d984a54a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.515+0000 7fcecdde0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a55da0 0x55d984a5bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.515+0000 7fcecdde0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a61d30 0x55d984a5c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.515+0000 7fcecdde0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41b0520 con 0x55d984a55480 2024-09-10T21:19:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.515+0000 7fcecdde0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41b2060 con 0x55d984a55da0 2024-09-10T21:19:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.515+0000 7fcecdde0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41b0bf0 con 0x55d984a61d30 2024-09-10T21:19:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.515+0000 7fcec97a7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a55480 0x55d984a54a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.516+0000 7fcec97a7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a55480 0x55d984a54a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43996/0 (socket says 172.21.15.59:43996) 2024-09-10T21:19:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.516+0000 7fcec97a7640 1 -- 172.21.15.59:0/383042962 learned_addr learned my addr 172.21.15.59:0/383042962 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.516+0000 7fcec9fa8640 1 --2- 172.21.15.59:0/383042962 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a61d30 0x55d984a5c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.516+0000 7fcec8fa6640 1 --2- 172.21.15.59:0/383042962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a55da0 0x55d984a5bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.516+0000 7fcec97a7640 1 -- 172.21.15.59:0/383042962 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a61d30 msgr2=0x55d984a5c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.516+0000 7fcec97a7640 1 --2- 172.21.15.59:0/383042962 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a61d30 0x55d984a5c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.516+0000 7fcec97a7640 1 -- 172.21.15.59:0/383042962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a55da0 msgr2=0x55d984a5bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.516+0000 7fcec97a7640 1 --2- 172.21.15.59:0/383042962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a55da0 0x55d984a5bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.516+0000 7fcec97a7640 1 -- 172.21.15.59:0/383042962 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d984a64a00 con 0x55d984a55480 2024-09-10T21:19:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.516+0000 7fcec8fa6640 1 --2- 172.21.15.59:0/383042962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a55da0 0x55d984a5bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.516+0000 7fcec97a7640 1 --2- 172.21.15.59:0/383042962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a55480 0x55d984a54a80 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fcec001f490 tx=0x7fcec0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ed2686f144f2a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.516+0000 7fceaeffd640 1 -- 172.21.15.59:0/383042962 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec001fe10 con 0x55d984a55480 2024-09-10T21:19:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.516+0000 7fceaeffd640 1 -- 172.21.15.59:0/383042962 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec002b030 con 0x55d984a55480 2024-09-10T21:19:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.516+0000 7fceaeffd640 1 -- 172.21.15.59:0/383042962 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec001d710 con 0x55d984a55480 2024-09-10T21:19:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.517+0000 7fcecdde0740 1 -- 172.21.15.59:0/383042962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a55480 msgr2=0x55d984a54a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.517+0000 7fcecdde0740 1 --2- 172.21.15.59:0/383042962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a55480 0x55d984a54a80 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fcec001f490 tx=0x7fcec0018000 comp rx=0 tx=0).stop 2024-09-10T21:19:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.517+0000 7fcecdde0740 1 -- 172.21.15.59:0/383042962 shutdown_connections 2024-09-10T21:19:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.517+0000 7fcecdde0740 1 --2- 172.21.15.59:0/383042962 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a61d30 0x55d984a5c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.517+0000 7fcecdde0740 1 --2- 172.21.15.59:0/383042962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a55da0 0x55d984a5bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.517+0000 7fcecdde0740 1 --2- 172.21.15.59:0/383042962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a55480 0x55d984a54a80 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.517+0000 7fcecdde0740 1 -- 172.21.15.59:0/383042962 >> 172.21.15.59:0/383042962 conn(0x55d984a532b0 msgr2=0x55d984a54370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.517+0000 7fcecdde0740 1 -- 172.21.15.59:0/383042962 shutdown_connections 2024-09-10T21:19:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.517+0000 7fcecdde0740 1 -- 172.21.15.59:0/383042962 wait complete. 2024-09-10T21:19:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.517+0000 7fcecdde0740 1 -- start start 2024-09-10T21:19:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.517+0000 7fcecdde0740 1 Processor -- start 2024-09-10T21:19:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.518+0000 7fcecdde0740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a55480 0x55d984a69ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.518+0000 7fcecdde0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a55da0 0x55d984a6a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.518+0000 7fcecdde0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a61d30 0x55d984a66c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.518+0000 7fcecdde0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41b1990 con 0x55d984a61d30 2024-09-10T21:19:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.518+0000 7fcecdde0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41b12c0 con 0x55d984a55da0 2024-09-10T21:19:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.518+0000 7fcecdde0740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41ae500 con 0x55d984a55480 2024-09-10T21:19:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.518+0000 7fcecdde0740 10 client.0 _ll_register_callbacks cb 0x7fcec000b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.518+0000 7fcec9fa8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a61d30 0x55d984a66c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.518+0000 7fcec9fa8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a61d30 0x55d984a66c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44006/0 (socket says 172.21.15.59:44006) 2024-09-10T21:19:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.518+0000 7fcec9fa8640 1 -- 172.21.15.59:0/3113279852 learned_addr learned my addr 172.21.15.59:0/3113279852 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.518+0000 7fcec97a7640 1 --2- 172.21.15.59:0/3113279852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a55480 0x55d984a69ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.518+0000 7fcec8fa6640 1 --2- 172.21.15.59:0/3113279852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a55da0 0x55d984a6a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.518+0000 7fcec9fa8640 1 -- 172.21.15.59:0/3113279852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a55480 msgr2=0x55d984a69ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.518+0000 7fcec9fa8640 1 --2- 172.21.15.59:0/3113279852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a55480 0x55d984a69ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.518+0000 7fcec9fa8640 1 -- 172.21.15.59:0/3113279852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a55da0 msgr2=0x55d984a6a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.518+0000 7fcec9fa8640 1 --2- 172.21.15.59:0/3113279852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a55da0 0x55d984a6a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.518+0000 7fcec9fa8640 1 -- 172.21.15.59:0/3113279852 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d984a671b0 con 0x55d984a61d30 2024-09-10T21:19:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.519+0000 7fcec97a7640 1 --2- 172.21.15.59:0/3113279852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a55480 0x55d984a69ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.519+0000 7fcec9fa8640 1 --2- 172.21.15.59:0/3113279852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a61d30 0x55d984a66c70 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0098b0 tx=0x7fcebc010e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97cf04c1d1490d57 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.519+0000 7fceacff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.519+0000 7fceacff9640 1 -- 172.21.15.59:0/3113279852 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc016070 con 0x55d984a61d30 2024-09-10T21:19:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.519+0000 7fceacff9640 1 -- 172.21.15.59:0/3113279852 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcebc002030 con 0x55d984a61d30 2024-09-10T21:19:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.519+0000 7fcecdde0740 1 -- 172.21.15.59:0/3113279852 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcec002b030 con 0x55d984a61d30 2024-09-10T21:19:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.519+0000 7fceacff9640 1 -- 172.21.15.59:0/3113279852 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcebc004440 con 0x55d984a61d30 2024-09-10T21:19:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.519+0000 7fcecdde0740 10 client.16542 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.519+0000 7fcecdde0740 1 -- 172.21.15.59:0/3113279852 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d984adeb40 con 0x55d984a61d30 2024-09-10T21:19:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.519+0000 7fceacff9640 1 -- 172.21.15.59:0/3113279852 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcec002b030 con 0x55d984a61d30 2024-09-10T21:19:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.519+0000 7fceacff9640 1 -- 172.21.15.59:0/3113279852 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcebc012450 con 0x55d984a61d30 2024-09-10T21:19:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.519+0000 7fcecdde0740 10 client.16542 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.519+0000 7fcecdde0740 10 client.16542 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:19:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.519+0000 7fcecdde0740 20 client.16542 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.519+0000 7fcecdde0740 1 --2- 172.21.15.59:0/3113279852 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d984adf220 0x55d984ae1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.520+0000 7fcecdde0740 4 client.16542 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:19:54.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.520+0000 7fcecdde0740 1 -- 172.21.15.59:0/3113279852 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d9849c9850 con 0x55d984adf220 2024-09-10T21:19:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.520+0000 7fcec97a7640 1 --2- 172.21.15.59:0/3113279852 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d984adf220 0x55d984ae1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.520+0000 7fcec97a7640 1 --2- 172.21.15.59:0/3113279852 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d984adf220 0x55d984ae1640 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85bbb79cb73a7d75 server_cookie=e96e3d7b6357b9c7 in_seq=0 out_seq=0 2024-09-10T21:19:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.520+0000 7fceacff9640 10 client.16542 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.520+0000 7fceacff9640 1 -- 172.21.15.59:0/3113279852 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x55d9849c9850 con 0x55d984adf220 2024-09-10T21:19:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.520+0000 7fceacff9640 10 client.16542 handle_command_reply: tid=0 2024-09-10T21:19:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.521+0000 7fcecdde0740 1 client.16542 shutdown 2024-09-10T21:19:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.521+0000 7fcecdde0740 1 -- 172.21.15.59:0/3113279852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a61d30 msgr2=0x55d984a66c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.521+0000 7fcecdde0740 1 --2- 172.21.15.59:0/3113279852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a61d30 0x55d984a66c70 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0098b0 tx=0x7fcebc010e30 comp rx=0 tx=0).stop 2024-09-10T21:19:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.521+0000 7fcecdde0740 1 -- 172.21.15.59:0/3113279852 shutdown_connections 2024-09-10T21:19:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.521+0000 7fcecdde0740 1 --2- 172.21.15.59:0/3113279852 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d984adf220 0x55d984ae1640 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.521+0000 7fcecdde0740 1 --2- 172.21.15.59:0/3113279852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d984a61d30 0x55d984a66c70 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.521+0000 7fcecdde0740 1 --2- 172.21.15.59:0/3113279852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d984a55da0 0x55d984a6a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.521+0000 7fcecdde0740 1 --2- 172.21.15.59:0/3113279852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d984a55480 0x55d984a69ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.521+0000 7fcecdde0740 1 -- 172.21.15.59:0/3113279852 >> 172.21.15.59:0/3113279852 conn(0x55d984a532b0 msgr2=0x55d984a51bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.521+0000 7fceacff9640 0 client.16542 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:19:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.521+0000 7fcecdde0740 1 -- 172.21.15.59:0/3113279852 shutdown_connections 2024-09-10T21:19:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.521+0000 7fcecdde0740 1 -- 172.21.15.59:0/3113279852 wait complete. 2024-09-10T21:19:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.521+0000 7fcecdde0740 20 client.16542 trim_cache size 0 max 16384 2024-09-10T21:19:54.532 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:19:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:19:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:19:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:19:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:19:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:19:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:19:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:19:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:19:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:19:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:19:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:19:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:19:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:19:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:19:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:19:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:19:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:19:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:19:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:19:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:19:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:19:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:19:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:19:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:19:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:19:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:19:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:19:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:19:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:19:54.538 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:19:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.521+0000 7fcecba0b640 1 -- 172.21.15.59:0/791963854 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fceb00b52e0 msgr2=0x7fceb00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.521+0000 7fcecba0b640 1 --2- 172.21.15.59:0/791963854 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fceb00b52e0 0x7fceb00b77a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55d984a54190 tx=0x7fcec000b4d0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.521+0000 7fcecba0b640 1 -- 172.21.15.59:0/791963854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4075f40 msgr2=0x7fcec419ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.521+0000 7fcecba0b640 1 --2- 172.21.15.59:0/791963854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4075f40 0x7fcec419ba90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fceb8005940 tx=0x7fceb80042f0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.522+0000 7fcecba0b640 1 -- 172.21.15.59:0/791963854 shutdown_connections 2024-09-10T21:19:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.522+0000 7fcecba0b640 1 --2- 172.21.15.59:0/791963854 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fceb00b52e0 0x7fceb00b77a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.522+0000 7fcecba0b640 1 --2- 172.21.15.59:0/791963854 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcec410f3e0 0x7fcec41a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.522+0000 7fcecba0b640 1 --2- 172.21.15.59:0/791963854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcec4075f40 0x7fcec419ba90 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.522+0000 7fcecba0b640 1 --2- 172.21.15.59:0/791963854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcec4075540 0x7fcec419b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.522+0000 7fcecba0b640 1 -- 172.21.15.59:0/791963854 >> 172.21.15.59:0/791963854 conn(0x7fcec40fe830 msgr2=0x7fcec40ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.522+0000 7fcecba0b640 1 -- 172.21.15.59:0/791963854 shutdown_connections 2024-09-10T21:19:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:54.522+0000 7fcecba0b640 1 -- 172.21.15.59:0/791963854 wait complete. 2024-09-10T21:19:54.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:54 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:19:54.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:54 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:19:54.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:54 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:19:54.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:54 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:19:54.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:54 smithi059 ceph-mon[30888]: pgmap v479: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:54.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:54 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:19:54.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:54 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:19:54.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:54 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:19:54.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:54 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:19:54.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:54 smithi154 ceph-mon[35041]: pgmap v479: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:54.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:54 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:19:54.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:54 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:19:54.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:54 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:19:54.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:54 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:19:54.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:54 smithi192 ceph-mon[35363]: pgmap v479: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:19:55.407 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:19:55.408 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:19:55.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:55 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:19:55.670 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:19:55.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:55 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:19:55.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:55 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:19:56.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.150+0000 7f1240bdb640 1 -- 172.21.15.59:0/3626033136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f123c108020 msgr2=0x7f123c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:56.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.150+0000 7f1240bdb640 1 --2- 172.21.15.59:0/3626033136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f123c108020 0x7f123c10e820 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f1234009ca0 tx=0x7f123402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:19:56.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.150+0000 7f1240bdb640 1 -- 172.21.15.59:0/3626033136 shutdown_connections 2024-09-10T21:19:56.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.150+0000 7f1240bdb640 1 --2- 172.21.15.59:0/3626033136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f123c108020 0x7f123c10e820 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:56.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.150+0000 7f1240bdb640 1 --2- 172.21.15.59:0/3626033136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123c1076a0 0x7f123c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:56.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.150+0000 7f1240bdb640 1 --2- 172.21.15.59:0/3626033136 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f123c101c90 0x7f123c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:56.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.150+0000 7f1240bdb640 1 -- 172.21.15.59:0/3626033136 >> 172.21.15.59:0/3626033136 conn(0x7f123c0fd700 msgr2=0x7f123c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:56.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.150+0000 7f1240bdb640 1 -- 172.21.15.59:0/3626033136 shutdown_connections 2024-09-10T21:19:56.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.150+0000 7f1240bdb640 1 -- 172.21.15.59:0/3626033136 wait complete. 2024-09-10T21:19:56.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.151+0000 7f1240bdb640 1 Processor -- start 2024-09-10T21:19:56.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.151+0000 7f1240bdb640 1 -- start start 2024-09-10T21:19:56.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.151+0000 7f1240bdb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f123c101c90 0x7f123c1980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:56.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.151+0000 7f1240bdb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123c1076a0 0x7f123c1985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:56.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.151+0000 7f1240bdb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f123c108020 0x7f123c19d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:56.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.151+0000 7f1240bdb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f123c111ce0 con 0x7f123c101c90 2024-09-10T21:19:56.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.151+0000 7f1240bdb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f123c111b60 con 0x7f123c1076a0 2024-09-10T21:19:56.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.151+0000 7f1240bdb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f123c111e60 con 0x7f123c108020 2024-09-10T21:19:56.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.151+0000 7f123a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f123c101c90 0x7f123c1980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:56.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.151+0000 7f123a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f123c101c90 0x7f123c1980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44020/0 (socket says 172.21.15.59:44020) 2024-09-10T21:19:56.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.151+0000 7f123a59c640 1 -- 172.21.15.59:0/4139192234 learned_addr learned my addr 172.21.15.59:0/4139192234 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:56.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.151+0000 7f123ad9d640 1 --2- 172.21.15.59:0/4139192234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f123c108020 0x7f123c19d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:56.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.151+0000 7f1239d9b640 1 --2- 172.21.15.59:0/4139192234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123c1076a0 0x7f123c1985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:56.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.151+0000 7f123a59c640 1 -- 172.21.15.59:0/4139192234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f123c108020 msgr2=0x7f123c19d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:56.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.151+0000 7f123a59c640 1 --2- 172.21.15.59:0/4139192234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f123c108020 0x7f123c19d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:56.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.151+0000 7f123a59c640 1 -- 172.21.15.59:0/4139192234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123c1076a0 msgr2=0x7f123c1985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:56.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.151+0000 7f123a59c640 1 --2- 172.21.15.59:0/4139192234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123c1076a0 0x7f123c1985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:56.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.151+0000 7f123a59c640 1 -- 172.21.15.59:0/4139192234 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123c19e160 con 0x7f123c101c90 2024-09-10T21:19:56.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.151+0000 7f1239d9b640 1 --2- 172.21.15.59:0/4139192234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123c1076a0 0x7f123c1985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:56.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.152+0000 7f123a59c640 1 --2- 172.21.15.59:0/4139192234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f123c101c90 0x7f123c1980b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f122c007910 tx=0x7f122c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:56.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.152+0000 7f122b7fe640 1 -- 172.21.15.59:0/4139192234 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c019070 con 0x7f123c101c90 2024-09-10T21:19:56.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.152+0000 7f1240bdb640 1 -- 172.21.15.59:0/4139192234 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f123c19e450 con 0x7f123c101c90 2024-09-10T21:19:56.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.152+0000 7f122b7fe640 1 -- 172.21.15.59:0/4139192234 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f122c005020 con 0x7f123c101c90 2024-09-10T21:19:56.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.152+0000 7f122b7fe640 1 -- 172.21.15.59:0/4139192234 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c004a00 con 0x7f123c101c90 2024-09-10T21:19:56.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.152+0000 7f1240bdb640 1 -- 172.21.15.59:0/4139192234 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f123c06aab0 con 0x7f123c101c90 2024-09-10T21:19:56.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.153+0000 7f1240bdb640 1 -- 172.21.15.59:0/4139192234 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f123c102070 con 0x7f123c101c90 2024-09-10T21:19:56.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.155+0000 7f122b7fe640 1 -- 172.21.15.59:0/4139192234 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f122c014070 con 0x7f123c101c90 2024-09-10T21:19:56.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.156+0000 7f122b7fe640 1 --2- 172.21.15.59:0/4139192234 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f12240b52e0 0x7f12240b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:56.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.156+0000 7f1239d9b640 1 --2- 172.21.15.59:0/4139192234 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f12240b52e0 0x7f12240b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:56.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.156+0000 7f122b7fe640 1 -- 172.21.15.59:0/4139192234 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f122c0e6d50 con 0x7f123c101c90 2024-09-10T21:19:56.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.156+0000 7f1239d9b640 1 --2- 172.21.15.59:0/4139192234 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f12240b52e0 0x7f12240b77a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f123c100f20 tx=0x7f1230005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:56.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.159+0000 7f122b7fe640 1 -- 172.21.15.59:0/4139192234 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f122c0adbe0 con 0x7f123c101c90 2024-09-10T21:19:56.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.383+0000 7f1240bdb640 1 -- 172.21.15.59:0/4139192234 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f123c06aeb0 con 0x7f123c101c90 2024-09-10T21:19:56.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.383+0000 7f122b7fe640 1 -- 172.21.15.59:0/4139192234 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f122c0ad4e0 con 0x7f123c101c90 2024-09-10T21:19:56.387 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:19:56.387 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:19:56.387 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:19:56.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.386+0000 7f1240bdb640 1 -- 172.21.15.59:0/4139192234 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f12240b52e0 msgr2=0x7f12240b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:56.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.386+0000 7f1240bdb640 1 --2- 172.21.15.59:0/4139192234 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f12240b52e0 0x7f12240b77a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f123c100f20 tx=0x7f1230005d90 comp rx=0 tx=0).stop 2024-09-10T21:19:56.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.386+0000 7f1240bdb640 1 -- 172.21.15.59:0/4139192234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f123c101c90 msgr2=0x7f123c1980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:56.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.386+0000 7f1240bdb640 1 --2- 172.21.15.59:0/4139192234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f123c101c90 0x7f123c1980b0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f122c007910 tx=0x7f122c007dd0 comp rx=0 tx=0).stop 2024-09-10T21:19:56.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.386+0000 7f1240bdb640 1 -- 172.21.15.59:0/4139192234 shutdown_connections 2024-09-10T21:19:56.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.386+0000 7f1240bdb640 1 --2- 172.21.15.59:0/4139192234 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f12240b52e0 0x7f12240b77a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:56.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.386+0000 7f1240bdb640 1 --2- 172.21.15.59:0/4139192234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f123c108020 0x7f123c19d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:56.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.386+0000 7f1240bdb640 1 --2- 172.21.15.59:0/4139192234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123c1076a0 0x7f123c1985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:56.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.386+0000 7f1240bdb640 1 --2- 172.21.15.59:0/4139192234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f123c101c90 0x7f123c1980b0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:56.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.386+0000 7f1240bdb640 1 -- 172.21.15.59:0/4139192234 >> 172.21.15.59:0/4139192234 conn(0x7f123c0fd700 msgr2=0x7f123c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:56.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.386+0000 7f1240bdb640 1 -- 172.21.15.59:0/4139192234 shutdown_connections 2024-09-10T21:19:56.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:56.386+0000 7f1240bdb640 1 -- 172.21.15.59:0/4139192234 wait complete. 2024-09-10T21:19:56.660 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:56 smithi059 ceph-mon[30888]: pgmap v480: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:19:56.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:56 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/4139192234' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:19:56.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:56 smithi154 ceph-mon[35041]: pgmap v480: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:19:56.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:56 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/4139192234' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:19:56.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:56 smithi192 ceph-mon[35363]: pgmap v480: 97 pgs: 97 active+clean; 3.1 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:19:56.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:56 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/4139192234' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:19:57.172 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:19:57.439 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:19:57.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.926+0000 7f9c9ff6f640 1 -- 172.21.15.59:0/4109459944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c981087d0 msgr2=0x7f9c98108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:57.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.926+0000 7f9c9ff6f640 1 --2- 172.21.15.59:0/4109459944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c981087d0 0x7f9c98108c10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009900 tx=0x7f9c8802a410 comp rx=0 tx=0).stop 2024-09-10T21:19:57.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.926+0000 7f9c9ff6f640 1 -- 172.21.15.59:0/4109459944 shutdown_connections 2024-09-10T21:19:57.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.926+0000 7f9c9ff6f640 1 --2- 172.21.15.59:0/4109459944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c98109150 0x7f9c9810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.926+0000 7f9c9ff6f640 1 --2- 172.21.15.59:0/4109459944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c981087d0 0x7f9c98108c10 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.926+0000 7f9c9ff6f640 1 --2- 172.21.15.59:0/4109459944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c98102dc0 0x7f9c981031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.926+0000 7f9c9ff6f640 1 -- 172.21.15.59:0/4109459944 >> 172.21.15.59:0/4109459944 conn(0x7f9c980fe830 msgr2=0x7f9c98100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:57.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.926+0000 7f9c9ff6f640 1 -- 172.21.15.59:0/4109459944 shutdown_connections 2024-09-10T21:19:57.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.926+0000 7f9c9ff6f640 1 -- 172.21.15.59:0/4109459944 wait complete. 2024-09-10T21:19:57.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.926+0000 7f9c9ff6f640 1 Processor -- start 2024-09-10T21:19:57.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.926+0000 7f9c9ff6f640 1 -- start start 2024-09-10T21:19:57.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.927+0000 7f9c9ff6f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c98102dc0 0x7f9c98199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:57.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.927+0000 7f9c9ff6f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c981087d0 0x7f9c98199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:57.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.927+0000 7f9c9ff6f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c98109150 0x7f9c9819ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:57.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.927+0000 7f9c9ff6f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9c98112e10 con 0x7f9c981087d0 2024-09-10T21:19:57.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.927+0000 7f9c9ff6f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9c98112c90 con 0x7f9c98102dc0 2024-09-10T21:19:57.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.927+0000 7f9c9ff6f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9c98112f90 con 0x7f9c98109150 2024-09-10T21:19:57.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.927+0000 7f9c9d50a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c981087d0 0x7f9c98199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:57.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.927+0000 7f9c9d50a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c981087d0 0x7f9c98199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44028/0 (socket says 172.21.15.59:44028) 2024-09-10T21:19:57.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.927+0000 7f9c9d50a640 1 -- 172.21.15.59:0/2171711383 learned_addr learned my addr 172.21.15.59:0/2171711383 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:57.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.927+0000 7f9c9dd0b640 1 --2- 172.21.15.59:0/2171711383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c98102dc0 0x7f9c98199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:57.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.927+0000 7f9c9e50c640 1 --2- 172.21.15.59:0/2171711383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c98109150 0x7f9c9819ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:57.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.927+0000 7f9c9d50a640 1 -- 172.21.15.59:0/2171711383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c98109150 msgr2=0x7f9c9819ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:57.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.927+0000 7f9c9d50a640 1 --2- 172.21.15.59:0/2171711383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c98109150 0x7f9c9819ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.927+0000 7f9c9d50a640 1 -- 172.21.15.59:0/2171711383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c98102dc0 msgr2=0x7f9c98199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:57.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.927+0000 7f9c9d50a640 1 --2- 172.21.15.59:0/2171711383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c98102dc0 0x7f9c98199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.927+0000 7f9c9d50a640 1 -- 172.21.15.59:0/2171711383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9819f3f0 con 0x7f9c981087d0 2024-09-10T21:19:57.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.927+0000 7f9c9e50c640 1 --2- 172.21.15.59:0/2171711383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c98109150 0x7f9c9819ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:57.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.927+0000 7f9c9d50a640 1 --2- 172.21.15.59:0/2171711383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c981087d0 0x7f9c98199880 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f9c88005940 tx=0x7f9c880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:57.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.928+0000 7f9c8effd640 1 -- 172.21.15.59:0/2171711383 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8803f030 con 0x7f9c981087d0 2024-09-10T21:19:57.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.928+0000 7f9c8effd640 1 -- 172.21.15.59:0/2171711383 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c88003cb0 con 0x7f9c981087d0 2024-09-10T21:19:57.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.928+0000 7f9c9ff6f640 1 -- 172.21.15.59:0/2171711383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c9819f680 con 0x7f9c981087d0 2024-09-10T21:19:57.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.928+0000 7f9c8effd640 1 -- 172.21.15.59:0/2171711383 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c88035070 con 0x7f9c981087d0 2024-09-10T21:19:57.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.928+0000 7f9c9ff6f640 1 -- 172.21.15.59:0/2171711383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c981a5da0 con 0x7f9c981087d0 2024-09-10T21:19:57.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.930+0000 7f9c8effd640 1 -- 172.21.15.59:0/2171711383 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f9c8803bbf0 con 0x7f9c981087d0 2024-09-10T21:19:57.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.930+0000 7f9ca2344740 1 Processor -- start 2024-09-10T21:19:57.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.930+0000 7f9ca2344740 1 -- start start 2024-09-10T21:19:57.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9ca2344740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc8560c0f0 0x55bc8560c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:57.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9ca2344740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560ca10 0x55bc85618460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:57.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9ca2344740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc856189a0 0x55bc8561ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:57.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9ca2344740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bc85582ea0 con 0x55bc8560ca10 2024-09-10T21:19:57.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9ca2344740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bc855722d0 con 0x55bc856189a0 2024-09-10T21:19:57.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9ca2344740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55bc855760e0 con 0x55bc8560c0f0 2024-09-10T21:19:57.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9c9dd0b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560ca10 0x55bc85618460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:57.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9c9dd0b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560ca10 0x55bc85618460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44034/0 (socket says 172.21.15.59:44034) 2024-09-10T21:19:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9c9dd0b640 1 -- 172.21.15.59:0/1385846809 learned_addr learned my addr 172.21.15.59:0/1385846809 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9c9e50c640 1 --2- 172.21.15.59:0/1385846809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc8560c0f0 0x55bc8560c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9c9d50a640 1 --2- 172.21.15.59:0/1385846809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc856189a0 0x55bc8561ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9c8effd640 1 --2- 172.21.15.59:0/2171711383 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9c840b5360 0x7f9c840b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9c9dd0b640 1 -- 172.21.15.59:0/1385846809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc8560c0f0 msgr2=0x55bc8560c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9c9dd0b640 1 --2- 172.21.15.59:0/1385846809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc8560c0f0 0x55bc8560c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9c9dd0b640 1 -- 172.21.15.59:0/1385846809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc856189a0 msgr2=0x55bc8561ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9c9dd0b640 1 --2- 172.21.15.59:0/1385846809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc856189a0 0x55bc8561ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9c9dd0b640 1 -- 172.21.15.59:0/1385846809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc852d0650 con 0x55bc8560ca10 2024-09-10T21:19:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9c9d50a640 1 --2- 172.21.15.59:0/1385846809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc856189a0 0x55bc8561ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:19:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9c9e50c640 1 --2- 172.21.15.59:0/2171711383 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9c840b5360 0x7f9c840b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9c8effd640 1 -- 172.21.15.59:0/2171711383 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9c881066a0 con 0x7f9c981087d0 2024-09-10T21:19:57.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.931+0000 7f9c9dd0b640 1 --2- 172.21.15.59:0/1385846809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560ca10 0x55bc85618460 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400b760 tx=0x7f9c9400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f543870af3a377e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.932+0000 7f9c83fff640 1 -- 172.21.15.59:0/1385846809 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94003dd0 con 0x55bc8560ca10 2024-09-10T21:19:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.932+0000 7f9c83fff640 1 -- 172.21.15.59:0/1385846809 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c94015070 con 0x55bc8560ca10 2024-09-10T21:19:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.932+0000 7f9c83fff640 1 -- 172.21.15.59:0/1385846809 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94004da0 con 0x55bc8560ca10 2024-09-10T21:19:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.932+0000 7f9ca2344740 1 -- 172.21.15.59:0/1385846809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560ca10 msgr2=0x55bc85618460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.932+0000 7f9ca2344740 1 --2- 172.21.15.59:0/1385846809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560ca10 0x55bc85618460 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400b760 tx=0x7f9c9400bc20 comp rx=0 tx=0).stop 2024-09-10T21:19:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.932+0000 7f9c9e50c640 1 --2- 172.21.15.59:0/2171711383 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9c840b5360 0x7f9c840b7820 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9c90007f70 tx=0x7f9c90004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.932+0000 7f9ca2344740 1 -- 172.21.15.59:0/1385846809 shutdown_connections 2024-09-10T21:19:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.932+0000 7f9ca2344740 1 --2- 172.21.15.59:0/1385846809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc856189a0 0x55bc8561ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.932+0000 7f9ca2344740 1 --2- 172.21.15.59:0/1385846809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560ca10 0x55bc85618460 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.932+0000 7f9ca2344740 1 --2- 172.21.15.59:0/1385846809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc8560c0f0 0x55bc8560c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.932+0000 7f9ca2344740 1 -- 172.21.15.59:0/1385846809 >> 172.21.15.59:0/1385846809 conn(0x55bc85609f20 msgr2=0x55bc8560b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.933+0000 7f9ca2344740 1 -- 172.21.15.59:0/1385846809 shutdown_connections 2024-09-10T21:19:57.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.933+0000 7f9ca2344740 1 -- 172.21.15.59:0/1385846809 wait complete. 2024-09-10T21:19:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.933+0000 7f9ca2344740 1 -- start start 2024-09-10T21:19:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.933+0000 7f9ca2344740 1 Processor -- start 2024-09-10T21:19:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.933+0000 7f9ca2344740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560c0f0 0x55bc856182b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.933+0000 7f9ca2344740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8560ca10 0x55bc85615700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.933+0000 7f9ca2344740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc856189a0 0x55bc85615d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.933+0000 7f9ca2344740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bc853d3700 con 0x55bc8560c0f0 2024-09-10T21:19:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.933+0000 7f9ca2344740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bc8550d160 con 0x55bc8560ca10 2024-09-10T21:19:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.933+0000 7f9ca2344740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55bc8561b620 con 0x55bc856189a0 2024-09-10T21:19:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.933+0000 7f9ca2344740 10 client.0 _ll_register_callbacks cb 0x55bc855269e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.933+0000 7f9c9dd0b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560c0f0 0x55bc856182b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.934+0000 7f9c9dd0b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560c0f0 0x55bc856182b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44050/0 (socket says 172.21.15.59:44050) 2024-09-10T21:19:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.934+0000 7f9c9dd0b640 1 -- 172.21.15.59:0/1807892746 learned_addr learned my addr 172.21.15.59:0/1807892746 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:57.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.934+0000 7f9c9d50a640 1 --2- 172.21.15.59:0/1807892746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8560ca10 0x55bc85615700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.934+0000 7f9c9e50c640 1 --2- 172.21.15.59:0/1807892746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc856189a0 0x55bc85615d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.934+0000 7f9c9dd0b640 1 -- 172.21.15.59:0/1807892746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc856189a0 msgr2=0x55bc85615d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.934+0000 7f9c9dd0b640 1 --2- 172.21.15.59:0/1807892746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc856189a0 0x55bc85615d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.934+0000 7f9c9dd0b640 1 -- 172.21.15.59:0/1807892746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8560ca10 msgr2=0x55bc85615700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.934+0000 7f9c9dd0b640 1 --2- 172.21.15.59:0/1807892746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8560ca10 0x55bc85615700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.934+0000 7f9c9dd0b640 1 -- 172.21.15.59:0/1807892746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc8553ac90 con 0x55bc8560c0f0 2024-09-10T21:19:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.934+0000 7f9c9dd0b640 1 --2- 172.21.15.59:0/1807892746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560c0f0 0x55bc856182b0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f9c940046c0 tx=0x7f9c940046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bdc79ce4010f3f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.934+0000 7f9c817fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.934+0000 7f9c817fa640 1 -- 172.21.15.59:0/1807892746 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94028060 con 0x55bc8560c0f0 2024-09-10T21:19:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.934+0000 7f9c817fa640 1 -- 172.21.15.59:0/1807892746 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9c94011440 con 0x55bc8560c0f0 2024-09-10T21:19:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.934+0000 7f9ca2344740 1 -- 172.21.15.59:0/1807892746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c94015070 con 0x55bc8560c0f0 2024-09-10T21:19:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.934+0000 7f9c817fa640 1 -- 172.21.15.59:0/1807892746 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9c94011640 con 0x55bc8560c0f0 2024-09-10T21:19:57.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.934+0000 7f9ca2344740 10 client.16560 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:57.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.934+0000 7f9ca2344740 1 -- 172.21.15.59:0/1807892746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bc85626fb0 con 0x55bc8560c0f0 2024-09-10T21:19:57.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.935+0000 7f9c817fa640 1 -- 172.21.15.59:0/1807892746 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c94015070 con 0x55bc8560c0f0 2024-09-10T21:19:57.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.935+0000 7f9c817fa640 1 -- 172.21.15.59:0/1807892746 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9c94022070 con 0x55bc8560c0f0 2024-09-10T21:19:57.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.935+0000 7f9ca2344740 10 client.16560 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:57.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.935+0000 7f9ca2344740 10 client.16560 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:19:57.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.935+0000 7f9ca2344740 20 client.16560 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:57.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.935+0000 7f9ca2344740 1 --2- 172.21.15.59:0/1807892746 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55bc856283b0 0x55bc8562a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:57.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.935+0000 7f9ca2344740 4 client.16560 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:19:57.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.935+0000 7f9ca2344740 1 -- 172.21.15.59:0/1807892746 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc85584df0 con 0x55bc856283b0 2024-09-10T21:19:57.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.935+0000 7f9c9d50a640 1 --2- 172.21.15.59:0/1807892746 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55bc856283b0 0x55bc8562a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:57.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.936+0000 7f9c817fa640 10 client.16560 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:19:57.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.936+0000 7f9c9d50a640 1 --2- 172.21.15.59:0/1807892746 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55bc856283b0 0x55bc8562a7a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2a87f95bdfe8d785 server_cookie=edf5461a4bc99962 in_seq=0 out_seq=0 2024-09-10T21:19:57.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.936+0000 7f9c817fa640 1 -- 172.21.15.59:0/1807892746 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f9c880a6e50 con 0x55bc856283b0 2024-09-10T21:19:57.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.936+0000 7f9c817fa640 10 client.16560 handle_command_reply: tid=0 2024-09-10T21:19:57.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.936+0000 7f9ca2344740 1 client.16560 shutdown 2024-09-10T21:19:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.936+0000 7f9ca2344740 1 -- 172.21.15.59:0/1807892746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560c0f0 msgr2=0x55bc856182b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.936+0000 7f9ca2344740 1 --2- 172.21.15.59:0/1807892746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560c0f0 0x55bc856182b0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f9c940046c0 tx=0x7f9c940046f0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.937+0000 7f9ca2344740 1 -- 172.21.15.59:0/1807892746 shutdown_connections 2024-09-10T21:19:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.937+0000 7f9ca2344740 1 --2- 172.21.15.59:0/1807892746 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55bc856283b0 0x55bc8562a7a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.937+0000 7f9ca2344740 1 --2- 172.21.15.59:0/1807892746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc856189a0 0x55bc85615d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.937+0000 7f9ca2344740 1 --2- 172.21.15.59:0/1807892746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8560ca10 0x55bc85615700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.937+0000 7f9c817fa640 0 client.16560 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:19:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.937+0000 7f9ca2344740 1 --2- 172.21.15.59:0/1807892746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560c0f0 0x55bc856182b0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.937+0000 7f9ca2344740 1 -- 172.21.15.59:0/1807892746 >> 172.21.15.59:0/1807892746 conn(0x55bc85609f20 msgr2=0x55bc8560fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.937+0000 7f9ca2344740 1 -- 172.21.15.59:0/1807892746 shutdown_connections 2024-09-10T21:19:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.937+0000 7f9ca2344740 1 -- 172.21.15.59:0/1807892746 wait complete. 2024-09-10T21:19:57.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.937+0000 7f9ca2344740 20 client.16560 trim_cache size 0 max 16384 2024-09-10T21:19:57.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.950+0000 7f9ca2344740 1 Processor -- start 2024-09-10T21:19:57.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.950+0000 7f9ca2344740 1 -- start start 2024-09-10T21:19:57.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.950+0000 7f9ca2344740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560c0f0 0x55bc856248f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:57.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.950+0000 7f9ca2344740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8560ca10 0x55bc8560b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:57.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.950+0000 7f9ca2344740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc856189a0 0x55bc85619d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:57.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.950+0000 7f9ca2344740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9c981ae280 con 0x55bc8560c0f0 2024-09-10T21:19:57.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.950+0000 7f9ca2344740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9c981afdc0 con 0x55bc8560ca10 2024-09-10T21:19:57.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.950+0000 7f9ca2344740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9c981ae950 con 0x55bc856189a0 2024-09-10T21:19:57.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.950+0000 7f9c9dd0b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560c0f0 0x55bc856248f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:57.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.950+0000 7f9c9dd0b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560c0f0 0x55bc856248f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44052/0 (socket says 172.21.15.59:44052) 2024-09-10T21:19:57.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.950+0000 7f9c9dd0b640 1 -- 172.21.15.59:0/551729053 learned_addr learned my addr 172.21.15.59:0/551729053 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:57.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.950+0000 7f9c9dd0b640 1 -- 172.21.15.59:0/551729053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc856189a0 msgr2=0x55bc85619d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:57.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.950+0000 7f9c9dd0b640 1 --2- 172.21.15.59:0/551729053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc856189a0 0x55bc85619d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.950+0000 7f9c9dd0b640 1 -- 172.21.15.59:0/551729053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8560ca10 msgr2=0x55bc8560b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:57.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.950+0000 7f9c9dd0b640 1 --2- 172.21.15.59:0/551729053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8560ca10 0x55bc8560b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.950+0000 7f9c9dd0b640 1 -- 172.21.15.59:0/551729053 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc856160a0 con 0x55bc8560c0f0 2024-09-10T21:19:57.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.951+0000 7f9c9dd0b640 1 --2- 172.21.15.59:0/551729053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560c0f0 0x55bc856248f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9c940199e0 tx=0x7f9c94004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f990c9353ae7562 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:57.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.951+0000 7f9c837fe640 1 -- 172.21.15.59:0/551729053 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94033020 con 0x55bc8560c0f0 2024-09-10T21:19:57.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.951+0000 7f9c837fe640 1 -- 172.21.15.59:0/551729053 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c94015070 con 0x55bc8560c0f0 2024-09-10T21:19:57.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.951+0000 7f9c837fe640 1 -- 172.21.15.59:0/551729053 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94028030 con 0x55bc8560c0f0 2024-09-10T21:19:57.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.951+0000 7f9ca2344740 1 -- 172.21.15.59:0/551729053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560c0f0 msgr2=0x55bc856248f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:57.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.951+0000 7f9ca2344740 1 --2- 172.21.15.59:0/551729053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560c0f0 0x55bc856248f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9c940199e0 tx=0x7f9c94004610 comp rx=0 tx=0).stop 2024-09-10T21:19:57.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.951+0000 7f9ca2344740 1 -- 172.21.15.59:0/551729053 shutdown_connections 2024-09-10T21:19:57.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.951+0000 7f9ca2344740 1 --2- 172.21.15.59:0/551729053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc856189a0 0x55bc85619d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.951+0000 7f9ca2344740 1 --2- 172.21.15.59:0/551729053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8560ca10 0x55bc8560b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.951+0000 7f9ca2344740 1 --2- 172.21.15.59:0/551729053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc8560c0f0 0x55bc856248f0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.952+0000 7f9ca2344740 1 -- 172.21.15.59:0/551729053 >> 172.21.15.59:0/551729053 conn(0x55bc85609f20 msgr2=0x55bc8560af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:57.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.952+0000 7f9ca2344740 1 -- 172.21.15.59:0/551729053 shutdown_connections 2024-09-10T21:19:57.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.952+0000 7f9ca2344740 1 -- 172.21.15.59:0/551729053 wait complete. 2024-09-10T21:19:57.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.952+0000 7f9ca2344740 1 -- start start 2024-09-10T21:19:57.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.952+0000 7f9ca2344740 1 Processor -- start 2024-09-10T21:19:57.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.952+0000 7f9ca2344740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc8560c0f0 0x55bc8562aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:57.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.952+0000 7f9ca2344740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8560ca10 0x55bc8562afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:57.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.952+0000 7f9ca2344740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc856189a0 0x55bc85694f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:57.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.952+0000 7f9ca2344740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9c981af6f0 con 0x55bc856189a0 2024-09-10T21:19:57.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.952+0000 7f9ca2344740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9c981af020 con 0x55bc8560ca10 2024-09-10T21:19:57.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.952+0000 7f9ca2344740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9c981ac260 con 0x55bc8560c0f0 2024-09-10T21:19:57.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.952+0000 7f9ca2344740 10 client.0 _ll_register_callbacks cb 0x7f9c90007540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:57.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.953+0000 7f9c9e50c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc856189a0 0x55bc85694f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:57.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.953+0000 7f9c9e50c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc856189a0 0x55bc85694f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44062/0 (socket says 172.21.15.59:44062) 2024-09-10T21:19:57.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.953+0000 7f9c9e50c640 1 -- 172.21.15.59:0/1218027619 learned_addr learned my addr 172.21.15.59:0/1218027619 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:57.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.953+0000 7f9c9dd0b640 1 --2- 172.21.15.59:0/1218027619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc8560c0f0 0x55bc8562aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:57.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.953+0000 7f9c9d50a640 1 --2- 172.21.15.59:0/1218027619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8560ca10 0x55bc8562afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:57.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.953+0000 7f9c9e50c640 1 -- 172.21.15.59:0/1218027619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc8560c0f0 msgr2=0x55bc8562aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:57.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.953+0000 7f9c9e50c640 1 --2- 172.21.15.59:0/1218027619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc8560c0f0 0x55bc8562aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.953+0000 7f9c9e50c640 1 -- 172.21.15.59:0/1218027619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8560ca10 msgr2=0x55bc8562afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:57.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.953+0000 7f9c9e50c640 1 --2- 172.21.15.59:0/1218027619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8560ca10 0x55bc8562afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.953+0000 7f9c9e50c640 1 -- 172.21.15.59:0/1218027619 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc85695460 con 0x55bc856189a0 2024-09-10T21:19:57.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.953+0000 7f9c9e50c640 1 --2- 172.21.15.59:0/1218027619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc856189a0 0x55bc85694f20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f9c90012010 tx=0x7f9c900076a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd426091cc9e033d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:57.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.953+0000 7f9c817fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:57.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.953+0000 7f9c817fa640 1 -- 172.21.15.59:0/1218027619 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9001b650 con 0x55bc856189a0 2024-09-10T21:19:57.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.953+0000 7f9c817fa640 1 -- 172.21.15.59:0/1218027619 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9c9001b7f0 con 0x55bc856189a0 2024-09-10T21:19:57.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.953+0000 7f9ca2344740 1 -- 172.21.15.59:0/1218027619 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c94015070 con 0x55bc856189a0 2024-09-10T21:19:57.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.953+0000 7f9c817fa640 1 -- 172.21.15.59:0/1218027619 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9c9002f070 con 0x55bc856189a0 2024-09-10T21:19:57.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.954+0000 7f9ca2344740 10 client.16566 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:57.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.954+0000 7f9ca2344740 1 -- 172.21.15.59:0/1218027619 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bc856965b0 con 0x55bc856189a0 2024-09-10T21:19:57.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.954+0000 7f9c817fa640 1 -- 172.21.15.59:0/1218027619 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c94015070 con 0x55bc856189a0 2024-09-10T21:19:57.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.954+0000 7f9c817fa640 1 -- 172.21.15.59:0/1218027619 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9c90026020 con 0x55bc856189a0 2024-09-10T21:19:57.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.954+0000 7f9ca2344740 10 client.16566 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:57.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.954+0000 7f9ca2344740 10 client.16566 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:19:57.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.954+0000 7f9ca2344740 20 client.16566 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:57.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.954+0000 7f9ca2344740 1 --2- 172.21.15.59:0/1218027619 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55bc85696d90 0x55bc856991b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:57.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.954+0000 7f9ca2344740 4 client.16566 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:19:57.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.954+0000 7f9ca2344740 1 -- 172.21.15.59:0/1218027619 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bc855808a0 con 0x55bc85696d90 2024-09-10T21:19:57.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.954+0000 7f9c9dd0b640 1 --2- 172.21.15.59:0/1218027619 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55bc85696d90 0x55bc856991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:57.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.955+0000 7f9c9dd0b640 1 --2- 172.21.15.59:0/1218027619 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55bc85696d90 0x55bc856991b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bb37e1c0b6afd205 server_cookie=54b35bb5c3c80217 in_seq=0 out_seq=0 2024-09-10T21:19:57.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.955+0000 7f9c817fa640 10 client.16566 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:19:57.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.955+0000 7f9c817fa640 1 -- 172.21.15.59:0/1218027619 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bc855808a0 con 0x55bc85696d90 2024-09-10T21:19:57.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.955+0000 7f9c817fa640 10 client.16566 handle_command_reply: tid=0 2024-09-10T21:19:57.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.955+0000 7f9ca2344740 1 client.16566 shutdown 2024-09-10T21:19:57.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.955+0000 7f9ca2344740 1 -- 172.21.15.59:0/1218027619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc856189a0 msgr2=0x55bc85694f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:57.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.955+0000 7f9ca2344740 1 --2- 172.21.15.59:0/1218027619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc856189a0 0x55bc85694f20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f9c90012010 tx=0x7f9c900076a0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.955+0000 7f9ca2344740 1 -- 172.21.15.59:0/1218027619 shutdown_connections 2024-09-10T21:19:57.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.955+0000 7f9ca2344740 1 --2- 172.21.15.59:0/1218027619 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55bc85696d90 0x55bc856991b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.955+0000 7f9ca2344740 1 --2- 172.21.15.59:0/1218027619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc856189a0 0x55bc85694f20 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.955+0000 7f9ca2344740 1 --2- 172.21.15.59:0/1218027619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc8560ca10 0x55bc8562afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.955+0000 7f9ca2344740 1 --2- 172.21.15.59:0/1218027619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc8560c0f0 0x55bc8562aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.955+0000 7f9c817fa640 0 client.16566 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:19:57.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.955+0000 7f9ca2344740 1 -- 172.21.15.59:0/1218027619 >> 172.21.15.59:0/1218027619 conn(0x55bc85609f20 msgr2=0x55bc85608750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:57.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.955+0000 7f9ca2344740 1 -- 172.21.15.59:0/1218027619 shutdown_connections 2024-09-10T21:19:57.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.955+0000 7f9ca2344740 1 -- 172.21.15.59:0/1218027619 wait complete. 2024-09-10T21:19:57.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.955+0000 7f9ca2344740 20 client.16566 trim_cache size 0 max 16384 2024-09-10T21:19:57.965 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:19:57.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.956+0000 7f9c9ff6f640 1 -- 172.21.15.59:0/2171711383 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9c840b5360 msgr2=0x7f9c840b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:57.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.956+0000 7f9c9ff6f640 1 --2- 172.21.15.59:0/2171711383 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9c840b5360 0x7f9c840b7820 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9c90007f70 tx=0x7f9c90004a40 comp rx=0 tx=0).stop 2024-09-10T21:19:57.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.956+0000 7f9c9ff6f640 1 -- 172.21.15.59:0/2171711383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c981087d0 msgr2=0x7f9c98199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:57.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.956+0000 7f9c9ff6f640 1 --2- 172.21.15.59:0/2171711383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c981087d0 0x7f9c98199880 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f9c88005940 tx=0x7f9c880042f0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.956+0000 7f9c9ff6f640 1 -- 172.21.15.59:0/2171711383 shutdown_connections 2024-09-10T21:19:57.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.956+0000 7f9c9ff6f640 1 --2- 172.21.15.59:0/2171711383 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9c840b5360 0x7f9c840b7820 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.956+0000 7f9c9ff6f640 1 --2- 172.21.15.59:0/2171711383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c98109150 0x7f9c9819ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.956+0000 7f9c9ff6f640 1 --2- 172.21.15.59:0/2171711383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c981087d0 0x7f9c98199880 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.956+0000 7f9c9ff6f640 1 --2- 172.21.15.59:0/2171711383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c98102dc0 0x7f9c98199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:57.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.956+0000 7f9c9ff6f640 1 -- 172.21.15.59:0/2171711383 >> 172.21.15.59:0/2171711383 conn(0x7f9c980fe830 msgr2=0x7f9c98100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:57.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.956+0000 7f9c9ff6f640 1 -- 172.21.15.59:0/2171711383 shutdown_connections 2024-09-10T21:19:57.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:57.956+0000 7f9c9ff6f640 1 -- 172.21.15.59:0/2171711383 wait complete. 2024-09-10T21:19:58.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:19:58 smithi059 ceph-mon[30888]: pgmap v481: 97 pgs: 97 active+clean; 3.2 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:19:58.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:19:58 smithi154 ceph-mon[35041]: pgmap v481: 97 pgs: 97 active+clean; 3.2 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:19:58.739 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:19:58.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:19:58 smithi192 ceph-mon[35363]: pgmap v481: 97 pgs: 97 active+clean; 3.2 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:19:58.998 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:19:59.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.468+0000 7fb5910c0640 1 -- 172.21.15.59:0/4215876688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58c102dc0 msgr2=0x7fb58c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:59.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.468+0000 7fb5910c0640 1 --2- 172.21.15.59:0/4215876688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58c102dc0 0x7fb58c1031a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009ca0 tx=0x7fb57c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.468+0000 7fb5910c0640 1 -- 172.21.15.59:0/4215876688 shutdown_connections 2024-09-10T21:19:59.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.468+0000 7fb5910c0640 1 --2- 172.21.15.59:0/4215876688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58c109150 0x7fb58c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.468+0000 7fb5910c0640 1 --2- 172.21.15.59:0/4215876688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb58c1087d0 0x7fb58c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.468+0000 7fb5910c0640 1 --2- 172.21.15.59:0/4215876688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58c102dc0 0x7fb58c1031a0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.468+0000 7fb5910c0640 1 -- 172.21.15.59:0/4215876688 >> 172.21.15.59:0/4215876688 conn(0x7fb58c0fe830 msgr2=0x7fb58c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:59.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.468+0000 7fb5910c0640 1 -- 172.21.15.59:0/4215876688 shutdown_connections 2024-09-10T21:19:59.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.468+0000 7fb5910c0640 1 -- 172.21.15.59:0/4215876688 wait complete. 2024-09-10T21:19:59.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.469+0000 7fb5910c0640 1 Processor -- start 2024-09-10T21:19:59.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.469+0000 7fb5910c0640 1 -- start start 2024-09-10T21:19:59.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.469+0000 7fb5910c0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb58c102dc0 0x7fb58c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:59.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.469+0000 7fb5910c0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58c1087d0 0x7fb58c199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:59.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.469+0000 7fb5910c0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58c109150 0x7fb58c19eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:59.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.469+0000 7fb5910c0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb58c112e10 con 0x7fb58c109150 2024-09-10T21:19:59.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.469+0000 7fb5910c0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb58c112c90 con 0x7fb58c102dc0 2024-09-10T21:19:59.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.469+0000 7fb5910c0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb58c112f90 con 0x7fb58c1087d0 2024-09-10T21:19:59.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.470+0000 7fb58b59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58c109150 0x7fb58c19eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:59.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.470+0000 7fb58b59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58c109150 0x7fb58c19eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50014/0 (socket says 172.21.15.59:50014) 2024-09-10T21:19:59.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.470+0000 7fb58b59e640 1 -- 172.21.15.59:0/1893076248 learned_addr learned my addr 172.21.15.59:0/1893076248 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:59.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.470+0000 7fb58ad9d640 1 --2- 172.21.15.59:0/1893076248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb58c102dc0 0x7fb58c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:59.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.470+0000 7fb58a59c640 1 --2- 172.21.15.59:0/1893076248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58c1087d0 0x7fb58c199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:59.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.470+0000 7fb58b59e640 1 -- 172.21.15.59:0/1893076248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58c1087d0 msgr2=0x7fb58c199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:59.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.470+0000 7fb58b59e640 1 --2- 172.21.15.59:0/1893076248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58c1087d0 0x7fb58c199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.470+0000 7fb58b59e640 1 -- 172.21.15.59:0/1893076248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb58c102dc0 msgr2=0x7fb58c1992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:59.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.470+0000 7fb58b59e640 1 --2- 172.21.15.59:0/1893076248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb58c102dc0 0x7fb58c1992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.470+0000 7fb58b59e640 1 -- 172.21.15.59:0/1893076248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb58c19f370 con 0x7fb58c109150 2024-09-10T21:19:59.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.470+0000 7fb58b59e640 1 --2- 172.21.15.59:0/1893076248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58c109150 0x7fb58c19eba0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb58400c970 tx=0x7fb58400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:59.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.470+0000 7fb573fff640 1 -- 172.21.15.59:0/1893076248 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb584007bb0 con 0x7fb58c109150 2024-09-10T21:19:59.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.470+0000 7fb573fff640 1 -- 172.21.15.59:0/1893076248 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb584007d50 con 0x7fb58c109150 2024-09-10T21:19:59.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.470+0000 7fb5910c0640 1 -- 172.21.15.59:0/1893076248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb58c19f660 con 0x7fb58c109150 2024-09-10T21:19:59.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.470+0000 7fb573fff640 1 -- 172.21.15.59:0/1893076248 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb584004e60 con 0x7fb58c109150 2024-09-10T21:19:59.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.471+0000 7fb5910c0640 1 -- 172.21.15.59:0/1893076248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb58c1a5ef0 con 0x7fb58c109150 2024-09-10T21:19:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.473+0000 7fb593495740 1 Processor -- start 2024-09-10T21:19:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.473+0000 7fb573fff640 1 -- 172.21.15.59:0/1893076248 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fb584005020 con 0x7fb58c109150 2024-09-10T21:19:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.473+0000 7fb593495740 1 -- start start 2024-09-10T21:19:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.473+0000 7fb593495740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 0x55cd148798b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.473+0000 7fb593495740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd14879df0 0x55cd14889c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.473+0000 7fb593495740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd1488a190 0x55cd1488c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.473+0000 7fb593495740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cd147efea0 con 0x55cd148794d0 2024-09-10T21:19:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.473+0000 7fb593495740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cd147df2d0 con 0x55cd1488a190 2024-09-10T21:19:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.473+0000 7fb593495740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cd147e30e0 con 0x55cd14879df0 2024-09-10T21:19:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.473+0000 7fb58a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 0x55cd148798b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.473+0000 7fb58a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 0x55cd148798b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50018/0 (socket says 172.21.15.59:50018) 2024-09-10T21:19:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.473+0000 7fb58a59c640 1 -- 172.21.15.59:0/1622568923 learned_addr learned my addr 172.21.15.59:0/1622568923 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.474+0000 7fb58ad9d640 1 --2- 172.21.15.59:0/1622568923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd14879df0 0x55cd14889c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.474+0000 7fb58a59c640 1 -- 172.21.15.59:0/1622568923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd14879df0 msgr2=0x55cd14889c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.474+0000 7fb58a59c640 1 --2- 172.21.15.59:0/1622568923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd14879df0 0x55cd14889c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.474+0000 7fb58a59c640 1 -- 172.21.15.59:0/1622568923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd1488a190 msgr2=0x55cd1488c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.474+0000 7fb58a59c640 1 --2- 172.21.15.59:0/1622568923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd1488a190 0x55cd1488c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.474+0000 7fb58a59c640 1 -- 172.21.15.59:0/1622568923 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd1453d650 con 0x55cd148794d0 2024-09-10T21:19:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.474+0000 7fb573fff640 1 --2- 172.21.15.59:0/1893076248 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb5740b5360 0x7fb5740b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.474+0000 7fb58a59c640 1 --2- 172.21.15.59:0/1622568923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 0x55cd148798b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb58000acd0 tx=0x7fb5800117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9110de331096b416 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.474+0000 7fb58ad9d640 1 --2- 172.21.15.59:0/1893076248 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb5740b5360 0x7fb5740b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.474+0000 7fb573fff640 1 -- 172.21.15.59:0/1893076248 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fb5840e5a40 con 0x7fb58c109150 2024-09-10T21:19:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.474+0000 7fb5717fa640 1 -- 172.21.15.59:0/1622568923 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb580005020 con 0x55cd148794d0 2024-09-10T21:19:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.474+0000 7fb5717fa640 1 -- 172.21.15.59:0/1622568923 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5800047a0 con 0x55cd148794d0 2024-09-10T21:19:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.474+0000 7fb5717fa640 1 -- 172.21.15.59:0/1622568923 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5800126b0 con 0x55cd148794d0 2024-09-10T21:19:59.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.475+0000 7fb593495740 1 -- 172.21.15.59:0/1622568923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 msgr2=0x55cd148798b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:59.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.475+0000 7fb58ad9d640 1 --2- 172.21.15.59:0/1893076248 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb5740b5360 0x7fb5740b7820 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55cd14878fb0 tx=0x7fb57c009940 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:59.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.475+0000 7fb593495740 1 --2- 172.21.15.59:0/1622568923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 0x55cd148798b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb58000acd0 tx=0x7fb5800117b0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.475+0000 7fb593495740 1 -- 172.21.15.59:0/1622568923 shutdown_connections 2024-09-10T21:19:59.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.475+0000 7fb593495740 1 --2- 172.21.15.59:0/1622568923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd1488a190 0x55cd1488c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.475+0000 7fb593495740 1 --2- 172.21.15.59:0/1622568923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd14879df0 0x55cd14889c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.475+0000 7fb593495740 1 --2- 172.21.15.59:0/1622568923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 0x55cd148798b0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.475+0000 7fb593495740 1 -- 172.21.15.59:0/1622568923 >> 172.21.15.59:0/1622568923 conn(0x55cd14877300 msgr2=0x55cd148784a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:59.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.475+0000 7fb593495740 1 -- 172.21.15.59:0/1622568923 shutdown_connections 2024-09-10T21:19:59.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.475+0000 7fb593495740 1 -- 172.21.15.59:0/1622568923 wait complete. 2024-09-10T21:19:59.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.475+0000 7fb593495740 1 -- start start 2024-09-10T21:19:59.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb593495740 1 Processor -- start 2024-09-10T21:19:59.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb593495740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 0x55cd14889ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:59.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb593495740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd14879df0 0x55cd14886f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:59.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb593495740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd1488a190 0x55cd14887590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:59.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb593495740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cd14640700 con 0x55cd148794d0 2024-09-10T21:19:59.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb593495740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cd1477a160 con 0x55cd14879df0 2024-09-10T21:19:59.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb593495740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cd1488ce40 con 0x55cd1488a190 2024-09-10T21:19:59.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb593495740 10 client.0 _ll_register_callbacks cb 0x55cd147939e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:59.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb58ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 0x55cd14889ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:59.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb58ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 0x55cd14889ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50022/0 (socket says 172.21.15.59:50022) 2024-09-10T21:19:59.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb58ad9d640 1 -- 172.21.15.59:0/721237579 learned_addr learned my addr 172.21.15.59:0/721237579 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:59.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb58a59c640 1 --2- 172.21.15.59:0/721237579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd14879df0 0x55cd14886f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:59.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb58b59e640 1 --2- 172.21.15.59:0/721237579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd1488a190 0x55cd14887590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:59.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb58ad9d640 1 -- 172.21.15.59:0/721237579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd1488a190 msgr2=0x55cd14887590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:59.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb58ad9d640 1 --2- 172.21.15.59:0/721237579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd1488a190 0x55cd14887590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb58ad9d640 1 -- 172.21.15.59:0/721237579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd14879df0 msgr2=0x55cd14886f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:59.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb58ad9d640 1 --2- 172.21.15.59:0/721237579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd14879df0 0x55cd14886f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb58ad9d640 1 -- 172.21.15.59:0/721237579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd147a7c90 con 0x55cd148794d0 2024-09-10T21:19:59.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb58ad9d640 1 --2- 172.21.15.59:0/721237579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 0x55cd14889ac0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009ca0 tx=0x7fb57c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b88da161d29c15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:59.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.476+0000 7fb56eff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:59.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.477+0000 7fb56eff5640 1 -- 172.21.15.59:0/721237579 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57c004040 con 0x55cd148794d0 2024-09-10T21:19:59.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.477+0000 7fb56eff5640 1 -- 172.21.15.59:0/721237579 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fb57c0041e0 con 0x55cd148794d0 2024-09-10T21:19:59.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.477+0000 7fb593495740 1 -- 172.21.15.59:0/721237579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5800047a0 con 0x55cd148794d0 2024-09-10T21:19:59.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.477+0000 7fb56eff5640 1 -- 172.21.15.59:0/721237579 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb57c0043e0 con 0x55cd148794d0 2024-09-10T21:19:59.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.477+0000 7fb593495740 10 client.16578 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:59.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.477+0000 7fb593495740 1 -- 172.21.15.59:0/721237579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cd148987e0 con 0x55cd148794d0 2024-09-10T21:19:59.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.477+0000 7fb56eff5640 1 -- 172.21.15.59:0/721237579 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5800047a0 con 0x55cd148794d0 2024-09-10T21:19:59.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.477+0000 7fb56eff5640 1 -- 172.21.15.59:0/721237579 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb57c051070 con 0x55cd148794d0 2024-09-10T21:19:59.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.477+0000 7fb593495740 10 client.16578 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:59.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.477+0000 7fb593495740 10 client.16578 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:19:59.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.477+0000 7fb593495740 20 client.16578 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:59.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.477+0000 7fb593495740 1 --2- 172.21.15.59:0/721237579 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55cd14899c40 0x55cd1489c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:59.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.477+0000 7fb593495740 4 client.16578 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:19:59.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.477+0000 7fb593495740 1 -- 172.21.15.59:0/721237579 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd147f1df0 con 0x55cd14899c40 2024-09-10T21:19:59.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.478+0000 7fb58a59c640 1 --2- 172.21.15.59:0/721237579 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55cd14899c40 0x55cd1489c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:59.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.478+0000 7fb58a59c640 1 --2- 172.21.15.59:0/721237579 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55cd14899c40 0x55cd1489c090 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3d7278ec56f8bc31 server_cookie=3b6c0ca5f7b55a3c in_seq=0 out_seq=0 2024-09-10T21:19:59.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.478+0000 7fb56eff5640 10 client.16578 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:19:59.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.479+0000 7fb56eff5640 1 -- 172.21.15.59:0/721237579 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cd147f1df0 con 0x55cd14899c40 2024-09-10T21:19:59.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.479+0000 7fb56eff5640 10 client.16578 handle_command_reply: tid=0 2024-09-10T21:19:59.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.479+0000 7fb593495740 1 client.16578 shutdown 2024-09-10T21:19:59.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.479+0000 7fb593495740 1 -- 172.21.15.59:0/721237579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 msgr2=0x55cd14889ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:59.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.479+0000 7fb593495740 1 --2- 172.21.15.59:0/721237579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 0x55cd14889ac0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009ca0 tx=0x7fb57c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.479+0000 7fb593495740 1 -- 172.21.15.59:0/721237579 shutdown_connections 2024-09-10T21:19:59.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.479+0000 7fb593495740 1 --2- 172.21.15.59:0/721237579 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55cd14899c40 0x55cd1489c090 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.479+0000 7fb593495740 1 --2- 172.21.15.59:0/721237579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd1488a190 0x55cd14887590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.479+0000 7fb593495740 1 --2- 172.21.15.59:0/721237579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd14879df0 0x55cd14886f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.479+0000 7fb593495740 1 --2- 172.21.15.59:0/721237579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 0x55cd14889ac0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.479+0000 7fb593495740 1 -- 172.21.15.59:0/721237579 >> 172.21.15.59:0/721237579 conn(0x55cd14877300 msgr2=0x55cd14876420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:59.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.479+0000 7fb56eff5640 0 client.16578 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:19:59.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.479+0000 7fb593495740 1 -- 172.21.15.59:0/721237579 shutdown_connections 2024-09-10T21:19:59.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.479+0000 7fb593495740 1 -- 172.21.15.59:0/721237579 wait complete. 2024-09-10T21:19:59.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.479+0000 7fb593495740 20 client.16578 trim_cache size 0 max 16384 2024-09-10T21:19:59.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.492+0000 7fb593495740 1 Processor -- start 2024-09-10T21:19:59.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.492+0000 7fb593495740 1 -- start start 2024-09-10T21:19:59.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb593495740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 0x55cd14876c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:59.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb593495740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd14879df0 0x55cd148960a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:59.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb593495740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd1488a190 0x55cd1489bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:59.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb593495740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb58c1ac150 con 0x55cd148794d0 2024-09-10T21:19:59.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb593495740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb58c1adc90 con 0x55cd1488a190 2024-09-10T21:19:59.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb593495740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb58c1ac820 con 0x55cd14879df0 2024-09-10T21:19:59.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb58ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 0x55cd14876c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:59.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb58ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 0x55cd14876c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50028/0 (socket says 172.21.15.59:50028) 2024-09-10T21:19:59.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb58ad9d640 1 -- 172.21.15.59:0/1510556132 learned_addr learned my addr 172.21.15.59:0/1510556132 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:59.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb58b59e640 1 --2- 172.21.15.59:0/1510556132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd1488a190 0x55cd1489bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:59.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb58a59c640 1 --2- 172.21.15.59:0/1510556132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd14879df0 0x55cd148960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:59.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb58ad9d640 1 -- 172.21.15.59:0/1510556132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd14879df0 msgr2=0x55cd148960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:59.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb58ad9d640 1 --2- 172.21.15.59:0/1510556132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd14879df0 0x55cd148960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb58ad9d640 1 -- 172.21.15.59:0/1510556132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd1488a190 msgr2=0x55cd1489bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:59.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb58ad9d640 1 --2- 172.21.15.59:0/1510556132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd1488a190 0x55cd1489bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb58ad9d640 1 -- 172.21.15.59:0/1510556132 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd14887e60 con 0x55cd148794d0 2024-09-10T21:19:59.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb58a59c640 1 --2- 172.21.15.59:0/1510556132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd14879df0 0x55cd148960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:19:59.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb58ad9d640 1 --2- 172.21.15.59:0/1510556132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 0x55cd14876c10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb57c043040 tx=0x7fb57c031b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60be845974f6c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:59.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb570ff9640 1 -- 172.21.15.59:0/1510556132 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57c004200 con 0x55cd148794d0 2024-09-10T21:19:59.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb570ff9640 1 -- 172.21.15.59:0/1510556132 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb57c036050 con 0x55cd148794d0 2024-09-10T21:19:59.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.493+0000 7fb570ff9640 1 -- 172.21.15.59:0/1510556132 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57c02fb20 con 0x55cd148794d0 2024-09-10T21:19:59.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.494+0000 7fb593495740 1 -- 172.21.15.59:0/1510556132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 msgr2=0x55cd14876c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:59.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.494+0000 7fb593495740 1 --2- 172.21.15.59:0/1510556132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 0x55cd14876c10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb57c043040 tx=0x7fb57c031b70 comp rx=0 tx=0).stop 2024-09-10T21:19:59.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.494+0000 7fb593495740 1 -- 172.21.15.59:0/1510556132 shutdown_connections 2024-09-10T21:19:59.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.494+0000 7fb593495740 1 --2- 172.21.15.59:0/1510556132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd1488a190 0x55cd1489bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.494+0000 7fb593495740 1 --2- 172.21.15.59:0/1510556132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd14879df0 0x55cd148960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.494+0000 7fb593495740 1 --2- 172.21.15.59:0/1510556132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd148794d0 0x55cd14876c10 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.494+0000 7fb593495740 1 -- 172.21.15.59:0/1510556132 >> 172.21.15.59:0/1510556132 conn(0x55cd14877300 msgr2=0x55cd14885790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:59.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.494+0000 7fb593495740 1 -- 172.21.15.59:0/1510556132 shutdown_connections 2024-09-10T21:19:59.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.494+0000 7fb593495740 1 -- 172.21.15.59:0/1510556132 wait complete. 2024-09-10T21:19:59.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.494+0000 7fb593495740 1 -- start start 2024-09-10T21:19:59.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.494+0000 7fb593495740 1 Processor -- start 2024-09-10T21:19:59.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.495+0000 7fb593495740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd148794d0 0x55cd14892440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:59.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.495+0000 7fb593495740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd14879df0 0x55cd148929a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:59.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.495+0000 7fb593495740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd1488a190 0x55cd1488f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:59.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.495+0000 7fb593495740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb58c1ad5c0 con 0x55cd14879df0 2024-09-10T21:19:59.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.495+0000 7fb593495740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb58c1acef0 con 0x55cd1488a190 2024-09-10T21:19:59.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.495+0000 7fb593495740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb58c1aa130 con 0x55cd148794d0 2024-09-10T21:19:59.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.495+0000 7fb593495740 10 client.0 _ll_register_callbacks cb 0x7fb57c02f430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:19:59.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.495+0000 7fb58a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd14879df0 0x55cd148929a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:59.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.495+0000 7fb58a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd14879df0 0x55cd148929a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50034/0 (socket says 172.21.15.59:50034) 2024-09-10T21:19:59.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.495+0000 7fb58a59c640 1 -- 172.21.15.59:0/552955392 learned_addr learned my addr 172.21.15.59:0/552955392 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:19:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.495+0000 7fb58ad9d640 1 --2- 172.21.15.59:0/552955392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd148794d0 0x55cd14892440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.495+0000 7fb58a59c640 1 -- 172.21.15.59:0/552955392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd148794d0 msgr2=0x55cd14892440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.495+0000 7fb58a59c640 1 --2- 172.21.15.59:0/552955392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd148794d0 0x55cd14892440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.495+0000 7fb58a59c640 1 -- 172.21.15.59:0/552955392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd1488a190 msgr2=0x55cd1488f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:19:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.495+0000 7fb58a59c640 1 --2- 172.21.15.59:0/552955392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd1488a190 0x55cd1488f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.495+0000 7fb58a59c640 1 -- 172.21.15.59:0/552955392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd1488f9f0 con 0x55cd14879df0 2024-09-10T21:19:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.495+0000 7fb58a59c640 1 --2- 172.21.15.59:0/552955392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd14879df0 0x55cd148929a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb58000acd0 tx=0x7fb58000afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cfeb1fc36b407e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:19:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.495+0000 7fb56eff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:19:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.495+0000 7fb56eff5640 1 -- 172.21.15.59:0/552955392 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb580005200 con 0x55cd14879df0 2024-09-10T21:19:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.496+0000 7fb56eff5640 1 -- 172.21.15.59:0/552955392 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fb5800053a0 con 0x55cd14879df0 2024-09-10T21:19:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.496+0000 7fb593495740 1 -- 172.21.15.59:0/552955392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb57c036050 con 0x55cd14879df0 2024-09-10T21:19:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.496+0000 7fb56eff5640 1 -- 172.21.15.59:0/552955392 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb5800055a0 con 0x55cd14879df0 2024-09-10T21:19:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.496+0000 7fb593495740 10 client.16584 fetch_fsmap learned FSMap version 28 2024-09-10T21:19:59.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.496+0000 7fb593495740 1 -- 172.21.15.59:0/552955392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cd149076f0 con 0x55cd14879df0 2024-09-10T21:19:59.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.496+0000 7fb56eff5640 1 -- 172.21.15.59:0/552955392 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb57c036050 con 0x55cd14879df0 2024-09-10T21:19:59.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.496+0000 7fb56eff5640 1 -- 172.21.15.59:0/552955392 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fb580012780 con 0x55cd14879df0 2024-09-10T21:19:59.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.496+0000 7fb593495740 10 client.16584 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:19:59.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.496+0000 7fb593495740 10 client.16584 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:19:59.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.496+0000 7fb593495740 20 client.16584 populate_metadata read hostname 'smithi059' 2024-09-10T21:19:59.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.496+0000 7fb593495740 1 --2- 172.21.15.59:0/552955392 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55cd14907b90 0x55cd14909f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:19:59.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.496+0000 7fb593495740 4 client.16584 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:19:59.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.496+0000 7fb593495740 1 -- 172.21.15.59:0/552955392 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cd1489c420 con 0x55cd14907b90 2024-09-10T21:19:59.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.496+0000 7fb58ad9d640 1 --2- 172.21.15.59:0/552955392 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55cd14907b90 0x55cd14909f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:19:59.520 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:19:59.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.497+0000 7fb58ad9d640 1 --2- 172.21.15.59:0/552955392 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55cd14907b90 0x55cd14909f80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9a2afbc08f42b0d3 server_cookie=3e3df406b1c8e22b in_seq=0 out_seq=0 2024-09-10T21:19:59.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.497+0000 7fb56eff5640 10 client.16584 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:19:59.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.497+0000 7fb56eff5640 1 -- 172.21.15.59:0/552955392 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cd1489c420 con 0x55cd14907b90 2024-09-10T21:19:59.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.497+0000 7fb56eff5640 10 client.16584 handle_command_reply: tid=0 2024-09-10T21:19:59.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.497+0000 7fb593495740 1 client.16584 shutdown 2024-09-10T21:19:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.497+0000 7fb593495740 1 -- 172.21.15.59:0/552955392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd14879df0 msgr2=0x55cd148929a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.497+0000 7fb593495740 1 --2- 172.21.15.59:0/552955392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd14879df0 0x55cd148929a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb58000acd0 tx=0x7fb58000afd0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.497+0000 7fb593495740 1 -- 172.21.15.59:0/552955392 shutdown_connections 2024-09-10T21:19:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.497+0000 7fb593495740 1 --2- 172.21.15.59:0/552955392 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55cd14907b90 0x55cd14909f80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.497+0000 7fb593495740 1 --2- 172.21.15.59:0/552955392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd1488a190 0x55cd1488f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.497+0000 7fb593495740 1 --2- 172.21.15.59:0/552955392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd14879df0 0x55cd148929a0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.497+0000 7fb56eff5640 0 client.16584 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:19:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.497+0000 7fb593495740 1 --2- 172.21.15.59:0/552955392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd148794d0 0x55cd14892440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.497+0000 7fb593495740 1 -- 172.21.15.59:0/552955392 >> 172.21.15.59:0/552955392 conn(0x55cd14877300 msgr2=0x55cd14888540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.497+0000 7fb593495740 1 -- 172.21.15.59:0/552955392 shutdown_connections 2024-09-10T21:19:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.498+0000 7fb593495740 1 -- 172.21.15.59:0/552955392 wait complete. 2024-09-10T21:19:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.498+0000 7fb593495740 20 client.16584 trim_cache size 0 max 16384 2024-09-10T21:19:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.498+0000 7fb5910c0640 1 -- 172.21.15.59:0/1893076248 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb5740b5360 msgr2=0x7fb5740b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.498+0000 7fb5910c0640 1 --2- 172.21.15.59:0/1893076248 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb5740b5360 0x7fb5740b7820 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55cd14878fb0 tx=0x7fb57c009940 comp rx=0 tx=0).stop 2024-09-10T21:19:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.498+0000 7fb5910c0640 1 -- 172.21.15.59:0/1893076248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58c109150 msgr2=0x7fb58c19eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:19:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.498+0000 7fb5910c0640 1 --2- 172.21.15.59:0/1893076248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58c109150 0x7fb58c19eba0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb58400c970 tx=0x7fb58400ce30 comp rx=0 tx=0).stop 2024-09-10T21:19:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.498+0000 7fb5910c0640 1 -- 172.21.15.59:0/1893076248 shutdown_connections 2024-09-10T21:19:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.498+0000 7fb5910c0640 1 --2- 172.21.15.59:0/1893076248 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fb5740b5360 0x7fb5740b7820 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.498+0000 7fb5910c0640 1 --2- 172.21.15.59:0/1893076248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb58c109150 0x7fb58c19eba0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.498+0000 7fb5910c0640 1 --2- 172.21.15.59:0/1893076248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58c1087d0 0x7fb58c199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.498+0000 7fb5910c0640 1 --2- 172.21.15.59:0/1893076248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb58c102dc0 0x7fb58c1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:19:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.498+0000 7fb5910c0640 1 -- 172.21.15.59:0/1893076248 >> 172.21.15.59:0/1893076248 conn(0x7fb58c0fe830 msgr2=0x7fb58c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:19:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.498+0000 7fb5910c0640 1 -- 172.21.15.59:0/1893076248 shutdown_connections 2024-09-10T21:19:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:19:59.498+0000 7fb5910c0640 1 -- 172.21.15.59:0/1893076248 wait complete. 2024-09-10T21:20:00.288 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:20:00.550 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:20:00.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:00 smithi154 ceph-mon[35041]: pgmap v482: 97 pgs: 97 active+clean; 3.2 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:20:00.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:00 smithi154 ceph-mon[35041]: overall HEALTH_OK 2024-09-10T21:20:00.684 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:00 smithi059 ceph-mon[30888]: pgmap v482: 97 pgs: 97 active+clean; 3.2 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:20:00.684 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:00 smithi059 ceph-mon[30888]: overall HEALTH_OK 2024-09-10T21:20:00.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:00 smithi192 ceph-mon[35363]: pgmap v482: 97 pgs: 97 active+clean; 3.2 MiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:20:00.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:00 smithi192 ceph-mon[35363]: overall HEALTH_OK 2024-09-10T21:20:01.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.092+0000 7fcae9f73640 1 -- 172.21.15.59:0/2664439471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae410d140 msgr2=0x7fcae410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.092+0000 7fcae9f73640 1 --2- 172.21.15.59:0/2664439471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae410d140 0x7fcae410f5a0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009ca0 tx=0x7fcadc02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.092+0000 7fcae9f73640 1 -- 172.21.15.59:0/2664439471 shutdown_connections 2024-09-10T21:20:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.092+0000 7fcae9f73640 1 --2- 172.21.15.59:0/2664439471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae410d140 0x7fcae410f5a0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.092+0000 7fcae9f73640 1 --2- 172.21.15.59:0/2664439471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcae4104600 0x7fcae410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.092+0000 7fcae9f73640 1 --2- 172.21.15.59:0/2664439471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcae4103ce0 0x7fcae41040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.092+0000 7fcae9f73640 1 -- 172.21.15.59:0/2664439471 >> 172.21.15.59:0/2664439471 conn(0x7fcae40fd720 msgr2=0x7fcae40ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.092+0000 7fcae9f73640 1 -- 172.21.15.59:0/2664439471 shutdown_connections 2024-09-10T21:20:01.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.092+0000 7fcae9f73640 1 -- 172.21.15.59:0/2664439471 wait complete. 2024-09-10T21:20:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.093+0000 7fcae9f73640 1 Processor -- start 2024-09-10T21:20:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.093+0000 7fcae9f73640 1 -- start start 2024-09-10T21:20:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.093+0000 7fcae9f73640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae4103ce0 0x7fcae4101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.093+0000 7fcae9f73640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcae4104600 0x7fcae4101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.093+0000 7fcae9f73640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcae410d140 0x7fcae4102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.093+0000 7fcae9f73640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcae4112db0 con 0x7fcae4103ce0 2024-09-10T21:20:01.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.093+0000 7fcae9f73640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcae4112c30 con 0x7fcae410d140 2024-09-10T21:20:01.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.093+0000 7fcae9f73640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcae4112f30 con 0x7fcae4104600 2024-09-10T21:20:01.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.093+0000 7fcae37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae4103ce0 0x7fcae4101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:01.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.093+0000 7fcae37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae4103ce0 0x7fcae4101990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50060/0 (socket says 172.21.15.59:50060) 2024-09-10T21:20:01.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.093+0000 7fcae37fe640 1 -- 172.21.15.59:0/3479007398 learned_addr learned my addr 172.21.15.59:0/3479007398 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:01.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.093+0000 7fcae2ffd640 1 --2- 172.21.15.59:0/3479007398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcae4104600 0x7fcae4101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:01.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.094+0000 7fcae37fe640 1 -- 172.21.15.59:0/3479007398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcae4104600 msgr2=0x7fcae4101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:01.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.094+0000 7fcae37fe640 1 --2- 172.21.15.59:0/3479007398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcae4104600 0x7fcae4101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.094+0000 7fcae37fe640 1 -- 172.21.15.59:0/3479007398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcae410d140 msgr2=0x7fcae4102410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:01.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.094+0000 7fcae3fff640 1 --2- 172.21.15.59:0/3479007398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcae410d140 0x7fcae4102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:01.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.094+0000 7fcae37fe640 1 --2- 172.21.15.59:0/3479007398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcae410d140 0x7fcae4102410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.094+0000 7fcae37fe640 1 -- 172.21.15.59:0/3479007398 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae41a7690 con 0x7fcae4103ce0 2024-09-10T21:20:01.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.094+0000 7fcae2ffd640 1 --2- 172.21.15.59:0/3479007398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcae4104600 0x7fcae4101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:01.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.094+0000 7fcae3fff640 1 --2- 172.21.15.59:0/3479007398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcae410d140 0x7fcae4102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:20:01.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.094+0000 7fcae37fe640 1 --2- 172.21.15.59:0/3479007398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae4103ce0 0x7fcae4101990 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fcad400d950 tx=0x7fcad400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:01.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.094+0000 7fcae0ff9640 1 -- 172.21.15.59:0/3479007398 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad4017070 con 0x7fcae4103ce0 2024-09-10T21:20:01.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.094+0000 7fcae9f73640 1 -- 172.21.15.59:0/3479007398 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcae41a7980 con 0x7fcae4103ce0 2024-09-10T21:20:01.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.094+0000 7fcae0ff9640 1 -- 172.21.15.59:0/3479007398 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcad4009c30 con 0x7fcae4103ce0 2024-09-10T21:20:01.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.094+0000 7fcae0ff9640 1 -- 172.21.15.59:0/3479007398 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad400f620 con 0x7fcae4103ce0 2024-09-10T21:20:01.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.094+0000 7fcae9f73640 1 -- 172.21.15.59:0/3479007398 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcae41a7ec0 con 0x7fcae4103ce0 2024-09-10T21:20:01.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.097+0000 7fcaec348740 1 Processor -- start 2024-09-10T21:20:01.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.097+0000 7fcaec348740 1 -- start start 2024-09-10T21:20:01.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.097+0000 7fcaec348740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f494d0 0x55edd2f498b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:01.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.097+0000 7fcaec348740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f49df0 0x55edd2f55840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:01.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.097+0000 7fcae0ff9640 1 -- 172.21.15.59:0/3479007398 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fcad4010460 con 0x7fcae4103ce0 2024-09-10T21:20:01.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.097+0000 7fcaec348740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f55d80 0x55edd2f58170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:01.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.098+0000 7fcaec348740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55edd2ebfea0 con 0x55edd2f55d80 2024-09-10T21:20:01.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.098+0000 7fcaec348740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55edd2eaf2d0 con 0x55edd2f494d0 2024-09-10T21:20:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.098+0000 7fcaec348740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55edd2eb30e0 con 0x55edd2f49df0 2024-09-10T21:20:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.098+0000 7fcae2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f55d80 0x55edd2f58170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.098+0000 7fcae2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f55d80 0x55edd2f58170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50068/0 (socket says 172.21.15.59:50068) 2024-09-10T21:20:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.098+0000 7fcae2ffd640 1 -- 172.21.15.59:0/1514389903 learned_addr learned my addr 172.21.15.59:0/1514389903 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.098+0000 7fcae37fe640 1 --2- 172.21.15.59:0/1514389903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f49df0 0x55edd2f55840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.098+0000 7fcae3fff640 1 --2- 172.21.15.59:0/1514389903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f494d0 0x55edd2f498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.098+0000 7fcae2ffd640 1 -- 172.21.15.59:0/1514389903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f49df0 msgr2=0x55edd2f55840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.098+0000 7fcae2ffd640 1 --2- 172.21.15.59:0/1514389903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f49df0 0x55edd2f55840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.098+0000 7fcae2ffd640 1 -- 172.21.15.59:0/1514389903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f494d0 msgr2=0x55edd2f498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:01.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.098+0000 7fcae2ffd640 1 --2- 172.21.15.59:0/1514389903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f494d0 0x55edd2f498b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.098+0000 7fcae2ffd640 1 -- 172.21.15.59:0/1514389903 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edd2c0d650 con 0x55edd2f55d80 2024-09-10T21:20:01.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.098+0000 7fcae3fff640 1 --2- 172.21.15.59:0/1514389903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f494d0 0x55edd2f498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:01.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.098+0000 7fcae2ffd640 1 --2- 172.21.15.59:0/1514389903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f55d80 0x55edd2f58170 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fcad8008b90 tx=0x7fcad800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa2b67f366fd295 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:01.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.098+0000 7fcae0ff9640 1 --2- 172.21.15.59:0/3479007398 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcacc0b52e0 0x7fcacc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:01.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.098+0000 7fcac9ffb640 1 -- 172.21.15.59:0/1514389903 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8014070 con 0x55edd2f55d80 2024-09-10T21:20:01.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.099+0000 7fcae3fff640 1 --2- 172.21.15.59:0/3479007398 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcacc0b52e0 0x7fcacc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:01.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.099+0000 7fcac9ffb640 1 -- 172.21.15.59:0/1514389903 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcad80047a0 con 0x55edd2f55d80 2024-09-10T21:20:01.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.099+0000 7fcac9ffb640 1 -- 172.21.15.59:0/1514389903 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8010690 con 0x55edd2f55d80 2024-09-10T21:20:01.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.099+0000 7fcae0ff9640 1 -- 172.21.15.59:0/3479007398 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcad40e58c0 con 0x7fcae4103ce0 2024-09-10T21:20:01.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.099+0000 7fcaec348740 1 -- 172.21.15.59:0/1514389903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f55d80 msgr2=0x55edd2f58170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:01.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.099+0000 7fcaec348740 1 --2- 172.21.15.59:0/1514389903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f55d80 0x55edd2f58170 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fcad8008b90 tx=0x7fcad800e720 comp rx=0 tx=0).stop 2024-09-10T21:20:01.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.099+0000 7fcae3fff640 1 --2- 172.21.15.59:0/3479007398 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcacc0b52e0 0x7fcacc0b77a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcadc02f500 tx=0x7fcadc02f310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:01.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.099+0000 7fcaec348740 1 -- 172.21.15.59:0/1514389903 shutdown_connections 2024-09-10T21:20:01.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.099+0000 7fcaec348740 1 --2- 172.21.15.59:0/1514389903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f55d80 0x55edd2f58170 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.099+0000 7fcaec348740 1 --2- 172.21.15.59:0/1514389903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f49df0 0x55edd2f55840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.099+0000 7fcaec348740 1 --2- 172.21.15.59:0/1514389903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f494d0 0x55edd2f498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.099+0000 7fcaec348740 1 -- 172.21.15.59:0/1514389903 >> 172.21.15.59:0/1514389903 conn(0x55edd2f47300 msgr2=0x55edd2f484a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:01.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.099+0000 7fcaec348740 1 -- 172.21.15.59:0/1514389903 shutdown_connections 2024-09-10T21:20:01.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.099+0000 7fcaec348740 1 -- 172.21.15.59:0/1514389903 wait complete. 2024-09-10T21:20:01.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.100+0000 7fcaec348740 1 -- start start 2024-09-10T21:20:01.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.100+0000 7fcaec348740 1 Processor -- start 2024-09-10T21:20:01.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.100+0000 7fcaec348740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f494d0 0x55edd2f55650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:01.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.100+0000 7fcaec348740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f49df0 0x55edd2f52aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:01.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.100+0000 7fcaec348740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f55d80 0x55edd2f53080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:01.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.100+0000 7fcaec348740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55edd2d10700 con 0x55edd2f49df0 2024-09-10T21:20:01.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.100+0000 7fcaec348740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55edd2e4a160 con 0x55edd2f494d0 2024-09-10T21:20:01.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.100+0000 7fcaec348740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55edd2f58a00 con 0x55edd2f55d80 2024-09-10T21:20:01.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.100+0000 7fcaec348740 10 client.0 _ll_register_callbacks cb 0x55edd2e639e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:01.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.100+0000 7fcae2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f49df0 0x55edd2f52aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:01.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.100+0000 7fcae2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f49df0 0x55edd2f52aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50078/0 (socket says 172.21.15.59:50078) 2024-09-10T21:20:01.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.100+0000 7fcae2ffd640 1 -- 172.21.15.59:0/158934131 learned_addr learned my addr 172.21.15.59:0/158934131 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.101+0000 7fcae37fe640 1 --2- 172.21.15.59:0/158934131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f494d0 0x55edd2f55650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.101+0000 7fcae3fff640 1 --2- 172.21.15.59:0/158934131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f55d80 0x55edd2f53080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.101+0000 7fcae2ffd640 1 -- 172.21.15.59:0/158934131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f55d80 msgr2=0x55edd2f53080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.101+0000 7fcae2ffd640 1 --2- 172.21.15.59:0/158934131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f55d80 0x55edd2f53080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.101+0000 7fcae2ffd640 1 -- 172.21.15.59:0/158934131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f494d0 msgr2=0x55edd2f55650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.101+0000 7fcae2ffd640 1 --2- 172.21.15.59:0/158934131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f494d0 0x55edd2f55650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.101+0000 7fcae2ffd640 1 -- 172.21.15.59:0/158934131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edd2e77c90 con 0x55edd2f49df0 2024-09-10T21:20:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.101+0000 7fcae3fff640 1 --2- 172.21.15.59:0/158934131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f55d80 0x55edd2f53080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.101+0000 7fcae2ffd640 1 --2- 172.21.15.59:0/158934131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f49df0 0x55edd2f52aa0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fcad8005230 tx=0x7fcad8005260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88addd5c7ab1a49 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.101+0000 7fcac2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.101+0000 7fcac2ffd640 1 -- 172.21.15.59:0/158934131 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8027060 con 0x55edd2f49df0 2024-09-10T21:20:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.101+0000 7fcac2ffd640 1 -- 172.21.15.59:0/158934131 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcad8022660 con 0x55edd2f49df0 2024-09-10T21:20:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.101+0000 7fcaec348740 1 -- 172.21.15.59:0/158934131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcad80047a0 con 0x55edd2f49df0 2024-09-10T21:20:01.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.101+0000 7fcac2ffd640 1 -- 172.21.15.59:0/158934131 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcad8014070 con 0x55edd2f49df0 2024-09-10T21:20:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.102+0000 7fcaec348740 10 client.16596 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.102+0000 7fcaec348740 1 -- 172.21.15.59:0/158934131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55edd2f64340 con 0x55edd2f49df0 2024-09-10T21:20:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.102+0000 7fcac2ffd640 1 -- 172.21.15.59:0/158934131 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcad80047a0 con 0x55edd2f49df0 2024-09-10T21:20:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.102+0000 7fcac2ffd640 1 -- 172.21.15.59:0/158934131 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcad8010b80 con 0x55edd2f49df0 2024-09-10T21:20:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.102+0000 7fcaec348740 10 client.16596 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.102+0000 7fcaec348740 10 client.16596 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:20:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.102+0000 7fcaec348740 20 client.16596 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.102+0000 7fcaec348740 1 --2- 172.21.15.59:0/158934131 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55edd2f65740 0x55edd2f67b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.102+0000 7fcaec348740 4 client.16596 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:20:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.102+0000 7fcaec348740 1 -- 172.21.15.59:0/158934131 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edd2ec1df0 con 0x55edd2f65740 2024-09-10T21:20:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.102+0000 7fcae37fe640 1 --2- 172.21.15.59:0/158934131 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55edd2f65740 0x55edd2f67b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.103+0000 7fcae37fe640 1 --2- 172.21.15.59:0/158934131 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55edd2f65740 0x55edd2f67b30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c7e6fed27d2ebde3 server_cookie=cb17e3b16e6f069f in_seq=0 out_seq=0 2024-09-10T21:20:01.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.103+0000 7fcac2ffd640 10 client.16596 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:20:01.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.104+0000 7fcac2ffd640 1 -- 172.21.15.59:0/158934131 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55edd2ec1df0 con 0x55edd2f65740 2024-09-10T21:20:01.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.104+0000 7fcac2ffd640 10 client.16596 handle_command_reply: tid=0 2024-09-10T21:20:01.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.104+0000 7fcaec348740 1 client.16596 shutdown 2024-09-10T21:20:01.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.104+0000 7fcaec348740 1 -- 172.21.15.59:0/158934131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f49df0 msgr2=0x55edd2f52aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:01.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.104+0000 7fcaec348740 1 --2- 172.21.15.59:0/158934131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f49df0 0x55edd2f52aa0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fcad8005230 tx=0x7fcad8005260 comp rx=0 tx=0).stop 2024-09-10T21:20:01.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.104+0000 7fcaec348740 1 -- 172.21.15.59:0/158934131 shutdown_connections 2024-09-10T21:20:01.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.104+0000 7fcaec348740 1 --2- 172.21.15.59:0/158934131 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55edd2f65740 0x55edd2f67b30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.104+0000 7fcaec348740 1 --2- 172.21.15.59:0/158934131 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f55d80 0x55edd2f53080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.104+0000 7fcaec348740 1 --2- 172.21.15.59:0/158934131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f49df0 0x55edd2f52aa0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.104+0000 7fcaec348740 1 --2- 172.21.15.59:0/158934131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f494d0 0x55edd2f55650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.104+0000 7fcac2ffd640 0 client.16596 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:20:01.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.104+0000 7fcaec348740 1 -- 172.21.15.59:0/158934131 >> 172.21.15.59:0/158934131 conn(0x55edd2f47300 msgr2=0x55edd2f4ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:01.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.104+0000 7fcaec348740 1 -- 172.21.15.59:0/158934131 shutdown_connections 2024-09-10T21:20:01.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.104+0000 7fcaec348740 1 -- 172.21.15.59:0/158934131 wait complete. 2024-09-10T21:20:01.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.104+0000 7fcaec348740 20 client.16596 trim_cache size 0 max 16384 2024-09-10T21:20:01.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.117+0000 7fcaec348740 1 Processor -- start 2024-09-10T21:20:01.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.117+0000 7fcaec348740 1 -- start start 2024-09-10T21:20:01.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.117+0000 7fcaec348740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f494d0 0x55edd2f48a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:01.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.117+0000 7fcaec348740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f49df0 0x55edd2f46c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:01.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.117+0000 7fcaec348740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f55d80 0x55edd2f547e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:01.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.117+0000 7fcaec348740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcae41b04e0 con 0x55edd2f49df0 2024-09-10T21:20:01.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.117+0000 7fcaec348740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcae41b2020 con 0x55edd2f494d0 2024-09-10T21:20:01.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.117+0000 7fcaec348740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcae41b0bb0 con 0x55edd2f55d80 2024-09-10T21:20:01.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.118+0000 7fcae2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f49df0 0x55edd2f46c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:01.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.118+0000 7fcae2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f49df0 0x55edd2f46c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50088/0 (socket says 172.21.15.59:50088) 2024-09-10T21:20:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.118+0000 7fcae2ffd640 1 -- 172.21.15.59:0/3235049471 learned_addr learned my addr 172.21.15.59:0/3235049471 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.118+0000 7fcae3fff640 1 --2- 172.21.15.59:0/3235049471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f55d80 0x55edd2f547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.118+0000 7fcae37fe640 1 --2- 172.21.15.59:0/3235049471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f494d0 0x55edd2f48a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.118+0000 7fcae2ffd640 1 -- 172.21.15.59:0/3235049471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f55d80 msgr2=0x55edd2f547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.118+0000 7fcae2ffd640 1 --2- 172.21.15.59:0/3235049471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f55d80 0x55edd2f547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.118+0000 7fcae2ffd640 1 -- 172.21.15.59:0/3235049471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f494d0 msgr2=0x55edd2f48a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.118+0000 7fcae2ffd640 1 --2- 172.21.15.59:0/3235049471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f494d0 0x55edd2f48a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.118+0000 7fcae2ffd640 1 -- 172.21.15.59:0/3235049471 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edd2f47d80 con 0x55edd2f49df0 2024-09-10T21:20:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.118+0000 7fcae3fff640 1 --2- 172.21.15.59:0/3235049471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f55d80 0x55edd2f547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.118+0000 7fcae2ffd640 1 --2- 172.21.15.59:0/3235049471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f49df0 0x55edd2f46c10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fcad8000c00 tx=0x7fcad8005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf68f003a72a90c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.118+0000 7fcac97fa640 1 -- 172.21.15.59:0/3235049471 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8032070 con 0x55edd2f49df0 2024-09-10T21:20:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.118+0000 7fcac97fa640 1 -- 172.21.15.59:0/3235049471 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcad80052d0 con 0x55edd2f49df0 2024-09-10T21:20:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.118+0000 7fcac97fa640 1 -- 172.21.15.59:0/3235049471 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8027040 con 0x55edd2f49df0 2024-09-10T21:20:01.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.119+0000 7fcaec348740 1 -- 172.21.15.59:0/3235049471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f49df0 msgr2=0x55edd2f46c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:01.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.119+0000 7fcaec348740 1 --2- 172.21.15.59:0/3235049471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f49df0 0x55edd2f46c10 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fcad8000c00 tx=0x7fcad8005a90 comp rx=0 tx=0).stop 2024-09-10T21:20:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.119+0000 7fcaec348740 1 -- 172.21.15.59:0/3235049471 shutdown_connections 2024-09-10T21:20:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.119+0000 7fcaec348740 1 --2- 172.21.15.59:0/3235049471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f55d80 0x55edd2f547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.119+0000 7fcaec348740 1 --2- 172.21.15.59:0/3235049471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f49df0 0x55edd2f46c10 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.119+0000 7fcaec348740 1 --2- 172.21.15.59:0/3235049471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f494d0 0x55edd2f48a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.119+0000 7fcaec348740 1 -- 172.21.15.59:0/3235049471 >> 172.21.15.59:0/3235049471 conn(0x55edd2f47300 msgr2=0x55edd2f540d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.119+0000 7fcaec348740 1 -- 172.21.15.59:0/3235049471 shutdown_connections 2024-09-10T21:20:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.119+0000 7fcaec348740 1 -- 172.21.15.59:0/3235049471 wait complete. 2024-09-10T21:20:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.119+0000 7fcaec348740 1 -- start start 2024-09-10T21:20:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcaec348740 1 Processor -- start 2024-09-10T21:20:01.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcaec348740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f494d0 0x55edd2f5e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:01.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcaec348740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f49df0 0x55edd2f5e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:01.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcaec348740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f55d80 0x55edd2f58df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:01.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcaec348740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcae41b1950 con 0x55edd2f494d0 2024-09-10T21:20:01.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcaec348740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcae41b1280 con 0x55edd2f49df0 2024-09-10T21:20:01.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcaec348740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcae41ae4c0 con 0x55edd2f55d80 2024-09-10T21:20:01.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcaec348740 10 client.0 _ll_register_callbacks cb 0x7fcad80089e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:01.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcae37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f494d0 0x55edd2f5e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:01.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcae37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f494d0 0x55edd2f5e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50092/0 (socket says 172.21.15.59:50092) 2024-09-10T21:20:01.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcae37fe640 1 -- 172.21.15.59:0/1684836074 learned_addr learned my addr 172.21.15.59:0/1684836074 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:01.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcae3fff640 1 --2- 172.21.15.59:0/1684836074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f55d80 0x55edd2f58df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:01.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcae2ffd640 1 --2- 172.21.15.59:0/1684836074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f49df0 0x55edd2f5e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:01.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcae37fe640 1 -- 172.21.15.59:0/1684836074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f55d80 msgr2=0x55edd2f58df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:01.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcae37fe640 1 --2- 172.21.15.59:0/1684836074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f55d80 0x55edd2f58df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcae37fe640 1 -- 172.21.15.59:0/1684836074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f49df0 msgr2=0x55edd2f5e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:01.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcae37fe640 1 --2- 172.21.15.59:0/1684836074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f49df0 0x55edd2f5e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcae37fe640 1 -- 172.21.15.59:0/1684836074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edd2f59620 con 0x55edd2f494d0 2024-09-10T21:20:01.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcae3fff640 1 --2- 172.21.15.59:0/1684836074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f55d80 0x55edd2f58df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:01.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcae2ffd640 1 --2- 172.21.15.59:0/1684836074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f49df0 0x55edd2f5e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:20:01.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcae37fe640 1 --2- 172.21.15.59:0/1684836074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f494d0 0x55edd2f5e0a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fcad40e3760 tx=0x7fcad4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=584cd79a588bc355 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:01.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.120+0000 7fcac2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:01.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.121+0000 7fcac2ffd640 1 -- 172.21.15.59:0/1684836074 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad4020040 con 0x55edd2f494d0 2024-09-10T21:20:01.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.121+0000 7fcac2ffd640 1 -- 172.21.15.59:0/1684836074 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcad40ab310 con 0x55edd2f494d0 2024-09-10T21:20:01.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.121+0000 7fcaec348740 1 -- 172.21.15.59:0/1684836074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcad80052d0 con 0x55edd2f494d0 2024-09-10T21:20:01.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.121+0000 7fcac2ffd640 1 -- 172.21.15.59:0/1684836074 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcad40ac7b0 con 0x55edd2f494d0 2024-09-10T21:20:01.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.121+0000 7fcaec348740 10 client.16602 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:01.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.121+0000 7fcaec348740 1 -- 172.21.15.59:0/1684836074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55edd2fd3050 con 0x55edd2f494d0 2024-09-10T21:20:01.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.121+0000 7fcac2ffd640 1 -- 172.21.15.59:0/1684836074 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcad80052d0 con 0x55edd2f494d0 2024-09-10T21:20:01.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.121+0000 7fcac2ffd640 1 -- 172.21.15.59:0/1684836074 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcad40971a0 con 0x55edd2f494d0 2024-09-10T21:20:01.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.121+0000 7fcaec348740 10 client.16602 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:01.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.121+0000 7fcaec348740 10 client.16602 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:20:01.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.121+0000 7fcaec348740 20 client.16602 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:01.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.121+0000 7fcaec348740 1 --2- 172.21.15.59:0/1684836074 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55edd2fd37d0 0x55edd2fd5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:01.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.121+0000 7fcaec348740 4 client.16602 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:20:01.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.121+0000 7fcaec348740 1 -- 172.21.15.59:0/1684836074 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55edd2ebd8a0 con 0x55edd2fd37d0 2024-09-10T21:20:01.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.122+0000 7fcae2ffd640 1 --2- 172.21.15.59:0/1684836074 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55edd2fd37d0 0x55edd2fd5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:01.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.122+0000 7fcae2ffd640 1 --2- 172.21.15.59:0/1684836074 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55edd2fd37d0 0x55edd2fd5bf0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7405015499225f2d server_cookie=f20b2b6f2e78257f in_seq=0 out_seq=0 2024-09-10T21:20:01.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.122+0000 7fcac2ffd640 10 client.16602 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:20:01.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.122+0000 7fcac2ffd640 1 -- 172.21.15.59:0/1684836074 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55edd2ebd8a0 con 0x55edd2fd37d0 2024-09-10T21:20:01.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.122+0000 7fcac2ffd640 10 client.16602 handle_command_reply: tid=0 2024-09-10T21:20:01.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.122+0000 7fcaec348740 1 client.16602 shutdown 2024-09-10T21:20:01.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.122+0000 7fcaec348740 1 -- 172.21.15.59:0/1684836074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f494d0 msgr2=0x55edd2f5e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:01.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.122+0000 7fcaec348740 1 --2- 172.21.15.59:0/1684836074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f494d0 0x55edd2f5e0a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fcad40e3760 tx=0x7fcad4000bc0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcaec348740 1 -- 172.21.15.59:0/1684836074 shutdown_connections 2024-09-10T21:20:01.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcaec348740 1 --2- 172.21.15.59:0/1684836074 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55edd2fd37d0 0x55edd2fd5bf0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcac2ffd640 0 client.16602 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:20:01.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcaec348740 1 --2- 172.21.15.59:0/1684836074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55edd2f55d80 0x55edd2f58df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcaec348740 1 --2- 172.21.15.59:0/1684836074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edd2f49df0 0x55edd2f5e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcaec348740 1 --2- 172.21.15.59:0/1684836074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edd2f494d0 0x55edd2f5e0a0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcaec348740 1 -- 172.21.15.59:0/1684836074 >> 172.21.15.59:0/1684836074 conn(0x55edd2f47300 msgr2=0x55edd2f548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:01.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcaec348740 1 -- 172.21.15.59:0/1684836074 shutdown_connections 2024-09-10T21:20:01.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcaec348740 1 -- 172.21.15.59:0/1684836074 wait complete. 2024-09-10T21:20:01.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcaec348740 20 client.16602 trim_cache size 0 max 16384 2024-09-10T21:20:01.133 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:20:01.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcae9f73640 1 -- 172.21.15.59:0/3479007398 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcacc0b52e0 msgr2=0x7fcacc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:01.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcae9f73640 1 --2- 172.21.15.59:0/3479007398 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcacc0b52e0 0x7fcacc0b77a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcadc02f500 tx=0x7fcadc02f310 comp rx=0 tx=0).stop 2024-09-10T21:20:01.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcae9f73640 1 -- 172.21.15.59:0/3479007398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae4103ce0 msgr2=0x7fcae4101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:01.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcae9f73640 1 --2- 172.21.15.59:0/3479007398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae4103ce0 0x7fcae4101990 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fcad400d950 tx=0x7fcad400de10 comp rx=0 tx=0).stop 2024-09-10T21:20:01.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcae9f73640 1 -- 172.21.15.59:0/3479007398 shutdown_connections 2024-09-10T21:20:01.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcae9f73640 1 --2- 172.21.15.59:0/3479007398 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcacc0b52e0 0x7fcacc0b77a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcae9f73640 1 --2- 172.21.15.59:0/3479007398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcae410d140 0x7fcae4102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcae9f73640 1 --2- 172.21.15.59:0/3479007398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcae4104600 0x7fcae4101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcae9f73640 1 --2- 172.21.15.59:0/3479007398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae4103ce0 0x7fcae4101990 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:01.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcae9f73640 1 -- 172.21.15.59:0/3479007398 >> 172.21.15.59:0/3479007398 conn(0x7fcae40fd720 msgr2=0x7fcae40fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:01.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.123+0000 7fcae9f73640 1 -- 172.21.15.59:0/3479007398 shutdown_connections 2024-09-10T21:20:01.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:01.124+0000 7fcae9f73640 1 -- 172.21.15.59:0/3479007398 wait complete. 2024-09-10T21:20:01.969 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:20:02.229 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:20:02.638 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:02 smithi059 ceph-mon[30888]: pgmap v483: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:20:02.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:02 smithi154 ceph-mon[35041]: pgmap v483: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:20:02.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.718+0000 7f29b1b7b640 1 -- 172.21.15.59:0/3188446188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29ac109130 msgr2=0x7f29ac10f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:02.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.718+0000 7f29b1b7b640 1 --2- 172.21.15.59:0/3188446188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29ac109130 0x7f29ac10f930 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f29a4009ca0 tx=0x7f29a402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.719+0000 7f29b1b7b640 1 -- 172.21.15.59:0/3188446188 shutdown_connections 2024-09-10T21:20:02.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.719+0000 7f29b1b7b640 1 --2- 172.21.15.59:0/3188446188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29ac109130 0x7f29ac10f930 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.719+0000 7f29b1b7b640 1 --2- 172.21.15.59:0/3188446188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29ac1087b0 0x7f29ac108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.719+0000 7f29b1b7b640 1 --2- 172.21.15.59:0/3188446188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29ac102da0 0x7f29ac103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.719+0000 7f29b1b7b640 1 -- 172.21.15.59:0/3188446188 >> 172.21.15.59:0/3188446188 conn(0x7f29ac0fe810 msgr2=0x7f29ac100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:02.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.719+0000 7f29b1b7b640 1 -- 172.21.15.59:0/3188446188 shutdown_connections 2024-09-10T21:20:02.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.719+0000 7f29b1b7b640 1 -- 172.21.15.59:0/3188446188 wait complete. 2024-09-10T21:20:02.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.719+0000 7f29b1b7b640 1 Processor -- start 2024-09-10T21:20:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.719+0000 7f29b1b7b640 1 -- start start 2024-09-10T21:20:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.720+0000 7f29b1b7b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29ac102da0 0x7f29ac199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.720+0000 7f29b1b7b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29ac1087b0 0x7f29ac199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.720+0000 7f29b1b7b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29ac109130 0x7f29ac19eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.720+0000 7f29b1b7b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac112df0 con 0x7f29ac109130 2024-09-10T21:20:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.720+0000 7f29b1b7b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac112c70 con 0x7f29ac102da0 2024-09-10T21:20:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.720+0000 7f29b1b7b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac112f70 con 0x7f29ac1087b0 2024-09-10T21:20:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.720+0000 7f29abfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29ac109130 0x7f29ac19eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.720+0000 7f29abfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29ac109130 0x7f29ac19eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50122/0 (socket says 172.21.15.59:50122) 2024-09-10T21:20:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.720+0000 7f29abfff640 1 -- 172.21.15.59:0/253406558 learned_addr learned my addr 172.21.15.59:0/253406558 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:02.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.720+0000 7f29ab7fe640 1 --2- 172.21.15.59:0/253406558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29ac102da0 0x7f29ac199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.720+0000 7f29aaffd640 1 --2- 172.21.15.59:0/253406558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29ac1087b0 0x7f29ac199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.720+0000 7f29abfff640 1 -- 172.21.15.59:0/253406558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29ac1087b0 msgr2=0x7f29ac199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.720+0000 7f29abfff640 1 --2- 172.21.15.59:0/253406558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29ac1087b0 0x7f29ac199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.720+0000 7f29abfff640 1 -- 172.21.15.59:0/253406558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29ac102da0 msgr2=0x7f29ac199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.720+0000 7f29abfff640 1 --2- 172.21.15.59:0/253406558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29ac102da0 0x7f29ac199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.720+0000 7f29abfff640 1 -- 172.21.15.59:0/253406558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ac19f2b0 con 0x7f29ac109130 2024-09-10T21:20:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.720+0000 7f29aaffd640 1 --2- 172.21.15.59:0/253406558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29ac1087b0 0x7f29ac199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.720+0000 7f29abfff640 1 --2- 172.21.15.59:0/253406558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29ac109130 0x7f29ac19eae0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f29a4005cc0 tx=0x7f29a402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.721+0000 7f29a8ff9640 1 -- 172.21.15.59:0/253406558 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a4003bf0 con 0x7f29ac109130 2024-09-10T21:20:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.721+0000 7f29b1b7b640 1 -- 172.21.15.59:0/253406558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29ac19f540 con 0x7f29ac109130 2024-09-10T21:20:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.721+0000 7f29a8ff9640 1 -- 172.21.15.59:0/253406558 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29a4003d90 con 0x7f29ac109130 2024-09-10T21:20:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.721+0000 7f29a8ff9640 1 -- 172.21.15.59:0/253406558 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a402fbc0 con 0x7f29ac109130 2024-09-10T21:20:02.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.721+0000 7f29b1b7b640 1 -- 172.21.15.59:0/253406558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29ac1a5c60 con 0x7f29ac109130 2024-09-10T21:20:02.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.723+0000 7f29a8ff9640 1 -- 172.21.15.59:0/253406558 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f29a4004610 con 0x7f29ac109130 2024-09-10T21:20:02.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.723+0000 7f29b3f50740 1 Processor -- start 2024-09-10T21:20:02.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.723+0000 7f29b3f50740 1 -- start start 2024-09-10T21:20:02.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.724+0000 7f29b3f50740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45e94d0 0x562ea45e98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:02.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.724+0000 7f29b3f50740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e9df0 0x562ea45f5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:02.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.724+0000 7f29b3f50740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45f5d80 0x562ea45f8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:02.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.724+0000 7f29b3f50740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562ea455fea0 con 0x562ea45e9df0 2024-09-10T21:20:02.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.724+0000 7f29b3f50740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562ea454f2d0 con 0x562ea45f5d80 2024-09-10T21:20:02.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.724+0000 7f29b3f50740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562ea45530e0 con 0x562ea45e94d0 2024-09-10T21:20:02.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.724+0000 7f29ab7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e9df0 0x562ea45f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:02.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.724+0000 7f29ab7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e9df0 0x562ea45f5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50124/0 (socket says 172.21.15.59:50124) 2024-09-10T21:20:02.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.724+0000 7f29ab7fe640 1 -- 172.21.15.59:0/1950314730 learned_addr learned my addr 172.21.15.59:0/1950314730 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:02.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.724+0000 7f29aaffd640 1 --2- 172.21.15.59:0/1950314730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45e94d0 0x562ea45e98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:02.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.724+0000 7f29aaffd640 1 --2- 172.21.15.59:0/1950314730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45f5d80 0x562ea45f8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:02.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.724+0000 7f29ab7fe640 1 -- 172.21.15.59:0/1950314730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45e94d0 msgr2=0x562ea45e98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:02.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.724+0000 7f29ab7fe640 1 --2- 172.21.15.59:0/1950314730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45e94d0 0x562ea45e98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.724+0000 7f29ab7fe640 1 -- 172.21.15.59:0/1950314730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45f5d80 msgr2=0x562ea45f8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:02.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.724+0000 7f29ab7fe640 1 --2- 172.21.15.59:0/1950314730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45f5d80 0x562ea45f8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.724+0000 7f29ab7fe640 1 -- 172.21.15.59:0/1950314730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ea42ad650 con 0x562ea45e9df0 2024-09-10T21:20:02.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.724+0000 7f29aaffd640 1 --2- 172.21.15.59:0/1950314730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45f5d80 0x562ea45f8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:20:02.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.724+0000 7f29a8ff9640 1 --2- 172.21.15.59:0/253406558 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f29940b52e0 0x7f29940b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:02.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.725+0000 7f29ab7fe640 1 --2- 172.21.15.59:0/1950314730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e9df0 0x562ea45f5840 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f299c00bd50 tx=0x7f299c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1706948385e691c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:02.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.725+0000 7f29aaffd640 1 --2- 172.21.15.59:0/253406558 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f29940b52e0 0x7f29940b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:02.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.725+0000 7f29a8ff9640 1 -- 172.21.15.59:0/253406558 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f29a4107170 con 0x7f29ac109130 2024-09-10T21:20:02.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.725+0000 7f2991ffb640 1 -- 172.21.15.59:0/1950314730 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c005220 con 0x562ea45e9df0 2024-09-10T21:20:02.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.725+0000 7f2991ffb640 1 -- 172.21.15.59:0/1950314730 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f299c00be40 con 0x562ea45e9df0 2024-09-10T21:20:02.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.725+0000 7f2991ffb640 1 -- 172.21.15.59:0/1950314730 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c0117c0 con 0x562ea45e9df0 2024-09-10T21:20:02.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.726+0000 7f29b3f50740 1 -- 172.21.15.59:0/1950314730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e9df0 msgr2=0x562ea45f5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:02.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.726+0000 7f29aaffd640 1 --2- 172.21.15.59:0/253406558 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f29940b52e0 0x7f29940b77a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f29a00058c0 tx=0x7f29a0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:02.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.726+0000 7f29b3f50740 1 --2- 172.21.15.59:0/1950314730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e9df0 0x562ea45f5840 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f299c00bd50 tx=0x7f299c0107a0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.726+0000 7f29b3f50740 1 -- 172.21.15.59:0/1950314730 shutdown_connections 2024-09-10T21:20:02.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.726+0000 7f29b3f50740 1 --2- 172.21.15.59:0/1950314730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45f5d80 0x562ea45f8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.726+0000 7f29b3f50740 1 --2- 172.21.15.59:0/1950314730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e9df0 0x562ea45f5840 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.726+0000 7f29b3f50740 1 --2- 172.21.15.59:0/1950314730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45e94d0 0x562ea45e98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.726+0000 7f29b3f50740 1 -- 172.21.15.59:0/1950314730 >> 172.21.15.59:0/1950314730 conn(0x562ea45e7300 msgr2=0x562ea45e84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:02.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.726+0000 7f29b3f50740 1 -- 172.21.15.59:0/1950314730 shutdown_connections 2024-09-10T21:20:02.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.726+0000 7f29b3f50740 1 -- 172.21.15.59:0/1950314730 wait complete. 2024-09-10T21:20:02.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.726+0000 7f29b3f50740 1 -- start start 2024-09-10T21:20:02.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.726+0000 7f29b3f50740 1 Processor -- start 2024-09-10T21:20:02.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.727+0000 7f29b3f50740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45e94d0 0x562ea45f5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:02.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.727+0000 7f29b3f50740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45e9df0 0x562ea45f2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:02.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.727+0000 7f29b3f50740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45f5d80 0x562ea45f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:02.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.727+0000 7f29b3f50740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562ea43b0700 con 0x562ea45f5d80 2024-09-10T21:20:02.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.727+0000 7f29b3f50740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562ea44ea160 con 0x562ea45e9df0 2024-09-10T21:20:02.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.727+0000 7f29b3f50740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562ea45f8a00 con 0x562ea45e94d0 2024-09-10T21:20:02.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.727+0000 7f29b3f50740 10 client.0 _ll_register_callbacks cb 0x562ea45039e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:02.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.727+0000 7f29abfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45f5d80 0x562ea45f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:02.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.727+0000 7f29abfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45f5d80 0x562ea45f30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50126/0 (socket says 172.21.15.59:50126) 2024-09-10T21:20:02.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.727+0000 7f29abfff640 1 -- 172.21.15.59:0/3552221390 learned_addr learned my addr 172.21.15.59:0/3552221390 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:02.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.727+0000 7f29ab7fe640 1 --2- 172.21.15.59:0/3552221390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45e94d0 0x562ea45f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:02.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.727+0000 7f29aaffd640 1 --2- 172.21.15.59:0/3552221390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45e9df0 0x562ea45f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:02.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.727+0000 7f29abfff640 1 -- 172.21.15.59:0/3552221390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45e94d0 msgr2=0x562ea45f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:02.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.727+0000 7f29abfff640 1 --2- 172.21.15.59:0/3552221390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45e94d0 0x562ea45f5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.727+0000 7f29abfff640 1 -- 172.21.15.59:0/3552221390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45e9df0 msgr2=0x562ea45f2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:02.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.727+0000 7f29abfff640 1 --2- 172.21.15.59:0/3552221390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45e9df0 0x562ea45f2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.727+0000 7f29abfff640 1 -- 172.21.15.59:0/3552221390 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ea4517c90 con 0x562ea45f5d80 2024-09-10T21:20:02.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.727+0000 7f29abfff640 1 --2- 172.21.15.59:0/3552221390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45f5d80 0x562ea45f30f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f29a40049d0 tx=0x7f29a40cd070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5000f0f11b925153 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:02.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.727+0000 7f298affd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:02.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.728+0000 7f298affd640 1 -- 172.21.15.59:0/3552221390 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a40c9070 con 0x562ea45f5d80 2024-09-10T21:20:02.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.728+0000 7f298affd640 1 -- 172.21.15.59:0/3552221390 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f29a40d6a00 con 0x562ea45f5d80 2024-09-10T21:20:02.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.728+0000 7f29b3f50740 1 -- 172.21.15.59:0/3552221390 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562ea4561df0 con 0x562ea45f5d80 2024-09-10T21:20:02.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.728+0000 7f298affd640 1 -- 172.21.15.59:0/3552221390 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f29a40ce000 con 0x562ea45f5d80 2024-09-10T21:20:02.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.728+0000 7f29b3f50740 10 client.16614 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:02.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.728+0000 7f29b3f50740 1 -- 172.21.15.59:0/3552221390 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562ea46042a0 con 0x562ea45f5d80 2024-09-10T21:20:02.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.728+0000 7f298affd640 1 -- 172.21.15.59:0/3552221390 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562ea4561df0 con 0x562ea45f5d80 2024-09-10T21:20:02.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.728+0000 7f298affd640 1 -- 172.21.15.59:0/3552221390 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f29a40d2020 con 0x562ea45f5d80 2024-09-10T21:20:02.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.728+0000 7f29b3f50740 10 client.16614 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:02.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.728+0000 7f29b3f50740 10 client.16614 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:20:02.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.728+0000 7f29b3f50740 20 client.16614 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:02.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.728+0000 7f29b3f50740 1 --2- 172.21.15.59:0/3552221390 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x562ea4605750 0x562ea4607ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:02.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.728+0000 7f29b3f50740 4 client.16614 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:20:02.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.728+0000 7f29b3f50740 1 -- 172.21.15.59:0/3552221390 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ea455d8a0 con 0x562ea4605750 2024-09-10T21:20:02.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.729+0000 7f29ab7fe640 1 --2- 172.21.15.59:0/3552221390 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x562ea4605750 0x562ea4607ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:02.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.729+0000 7f29ab7fe640 1 --2- 172.21.15.59:0/3552221390 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x562ea4605750 0x562ea4607ba0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c7bf1b4088333f86 server_cookie=e7b3dfc6858502af in_seq=0 out_seq=0 2024-09-10T21:20:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.729+0000 7f298affd640 10 client.16614 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:20:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.730+0000 7f298affd640 1 -- 172.21.15.59:0/3552221390 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ea455d8a0 con 0x562ea4605750 2024-09-10T21:20:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.730+0000 7f298affd640 10 client.16614 handle_command_reply: tid=0 2024-09-10T21:20:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.730+0000 7f29b3f50740 1 client.16614 shutdown 2024-09-10T21:20:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.730+0000 7f29b3f50740 1 -- 172.21.15.59:0/3552221390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45f5d80 msgr2=0x562ea45f30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.730+0000 7f29b3f50740 1 --2- 172.21.15.59:0/3552221390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45f5d80 0x562ea45f30f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f29a40049d0 tx=0x7f29a40cd070 comp rx=0 tx=0).stop 2024-09-10T21:20:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.730+0000 7f29b3f50740 1 -- 172.21.15.59:0/3552221390 shutdown_connections 2024-09-10T21:20:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.730+0000 7f29b3f50740 1 --2- 172.21.15.59:0/3552221390 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x562ea4605750 0x562ea4607ba0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.730+0000 7f29b3f50740 1 --2- 172.21.15.59:0/3552221390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45f5d80 0x562ea45f30f0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.730+0000 7f29b3f50740 1 --2- 172.21.15.59:0/3552221390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45e9df0 0x562ea45f2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.730+0000 7f298affd640 0 client.16614 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:20:02.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.730+0000 7f29b3f50740 1 --2- 172.21.15.59:0/3552221390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45e94d0 0x562ea45f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.730+0000 7f29b3f50740 1 -- 172.21.15.59:0/3552221390 >> 172.21.15.59:0/3552221390 conn(0x562ea45e7300 msgr2=0x562ea45ecea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:02.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.730+0000 7f29b3f50740 1 -- 172.21.15.59:0/3552221390 shutdown_connections 2024-09-10T21:20:02.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.730+0000 7f29b3f50740 1 -- 172.21.15.59:0/3552221390 wait complete. 2024-09-10T21:20:02.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.730+0000 7f29b3f50740 20 client.16614 trim_cache size 0 max 16384 2024-09-10T21:20:02.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.743+0000 7f29b3f50740 1 Processor -- start 2024-09-10T21:20:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.743+0000 7f29b3f50740 1 -- start start 2024-09-10T21:20:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.743+0000 7f29b3f50740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e94d0 0x562ea4601c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.743+0000 7f29b3f50740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45e9df0 0x562ea45e8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.743+0000 7f29b3f50740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45f5d80 0x562ea45e6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.743+0000 7f29b3f50740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac1ae250 con 0x562ea45e94d0 2024-09-10T21:20:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.744+0000 7f29b3f50740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac1afd90 con 0x562ea45f5d80 2024-09-10T21:20:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.744+0000 7f29b3f50740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac1ae920 con 0x562ea45e9df0 2024-09-10T21:20:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.744+0000 7f29ab7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e94d0 0x562ea4601c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.744+0000 7f29ab7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e94d0 0x562ea4601c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50128/0 (socket says 172.21.15.59:50128) 2024-09-10T21:20:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.744+0000 7f29ab7fe640 1 -- 172.21.15.59:0/1786223042 learned_addr learned my addr 172.21.15.59:0/1786223042 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.744+0000 7f29aaffd640 1 --2- 172.21.15.59:0/1786223042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45e9df0 0x562ea45e8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.744+0000 7f29abfff640 1 --2- 172.21.15.59:0/1786223042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45f5d80 0x562ea45e6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.744+0000 7f29ab7fe640 1 -- 172.21.15.59:0/1786223042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45e9df0 msgr2=0x562ea45e8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.744+0000 7f29ab7fe640 1 --2- 172.21.15.59:0/1786223042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45e9df0 0x562ea45e8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.744+0000 7f29ab7fe640 1 -- 172.21.15.59:0/1786223042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45f5d80 msgr2=0x562ea45e6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.744+0000 7f29ab7fe640 1 --2- 172.21.15.59:0/1786223042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45f5d80 0x562ea45e6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.744+0000 7f29ab7fe640 1 -- 172.21.15.59:0/1786223042 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ea45e9c20 con 0x562ea45e94d0 2024-09-10T21:20:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.744+0000 7f29ab7fe640 1 --2- 172.21.15.59:0/1786223042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e94d0 0x562ea4601c30 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f299c010ca0 tx=0x7f299c00b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e3fd9d2ab16c18 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.744+0000 7f29917fa640 1 -- 172.21.15.59:0/1786223042 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c0117c0 con 0x562ea45e94d0 2024-09-10T21:20:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.744+0000 7f29917fa640 1 -- 172.21.15.59:0/1786223042 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f299c02a070 con 0x562ea45e94d0 2024-09-10T21:20:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.744+0000 7f29917fa640 1 -- 172.21.15.59:0/1786223042 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c01bc60 con 0x562ea45e94d0 2024-09-10T21:20:02.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.745+0000 7f29b3f50740 1 -- 172.21.15.59:0/1786223042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e94d0 msgr2=0x562ea4601c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:02.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.745+0000 7f29b3f50740 1 --2- 172.21.15.59:0/1786223042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e94d0 0x562ea4601c30 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f299c010ca0 tx=0x7f299c00b650 comp rx=0 tx=0).stop 2024-09-10T21:20:02.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.745+0000 7f29b3f50740 1 -- 172.21.15.59:0/1786223042 shutdown_connections 2024-09-10T21:20:02.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.745+0000 7f29b3f50740 1 --2- 172.21.15.59:0/1786223042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45f5d80 0x562ea45e6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.745+0000 7f29b3f50740 1 --2- 172.21.15.59:0/1786223042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45e9df0 0x562ea45e8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.745+0000 7f29b3f50740 1 --2- 172.21.15.59:0/1786223042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e94d0 0x562ea4601c30 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.745+0000 7f29b3f50740 1 -- 172.21.15.59:0/1786223042 >> 172.21.15.59:0/1786223042 conn(0x562ea45e7300 msgr2=0x562ea45e5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:02.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.745+0000 7f29b3f50740 1 -- 172.21.15.59:0/1786223042 shutdown_connections 2024-09-10T21:20:02.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.745+0000 7f29b3f50740 1 -- 172.21.15.59:0/1786223042 wait complete. 2024-09-10T21:20:02.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.745+0000 7f29b3f50740 1 -- start start 2024-09-10T21:20:02.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.746+0000 7f29b3f50740 1 Processor -- start 2024-09-10T21:20:02.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.746+0000 7f29b3f50740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45e94d0 0x562ea45fdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:02.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.746+0000 7f29b3f50740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e9df0 0x562ea45fe1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:02.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.746+0000 7f29b3f50740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45f5d80 0x562ea45f8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:02.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.746+0000 7f29b3f50740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac1af6c0 con 0x562ea45e9df0 2024-09-10T21:20:02.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.746+0000 7f29b3f50740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac1aeff0 con 0x562ea45e94d0 2024-09-10T21:20:02.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.746+0000 7f29b3f50740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac1ac230 con 0x562ea45f5d80 2024-09-10T21:20:02.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.746+0000 7f29aaffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e9df0 0x562ea45fe1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:02.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.746+0000 7f29b3f50740 10 client.0 _ll_register_callbacks cb 0x7f29a40095c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:02.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.746+0000 7f29aaffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e9df0 0x562ea45fe1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50132/0 (socket says 172.21.15.59:50132) 2024-09-10T21:20:02.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.746+0000 7f29aaffd640 1 -- 172.21.15.59:0/3401888680 learned_addr learned my addr 172.21.15.59:0/3401888680 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.746+0000 7f29ab7fe640 1 --2- 172.21.15.59:0/3401888680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45e94d0 0x562ea45fdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.746+0000 7f29abfff640 1 --2- 172.21.15.59:0/3401888680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45f5d80 0x562ea45f8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.746+0000 7f29aaffd640 1 -- 172.21.15.59:0/3401888680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45f5d80 msgr2=0x562ea45f8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.746+0000 7f29aaffd640 1 --2- 172.21.15.59:0/3401888680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45f5d80 0x562ea45f8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.746+0000 7f29aaffd640 1 -- 172.21.15.59:0/3401888680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45e94d0 msgr2=0x562ea45fdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.746+0000 7f29aaffd640 1 --2- 172.21.15.59:0/3401888680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45e94d0 0x562ea45fdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.746+0000 7f29aaffd640 1 -- 172.21.15.59:0/3401888680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ea45f59e0 con 0x562ea45e9df0 2024-09-10T21:20:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.746+0000 7f29abfff640 1 --2- 172.21.15.59:0/3401888680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45f5d80 0x562ea45f8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.747+0000 7f29aaffd640 1 --2- 172.21.15.59:0/3401888680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e9df0 0x562ea45fe1e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f29a001e650 tx=0x7f29a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182d0ec68b963354 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.747+0000 7f298affd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.747+0000 7f298affd640 1 -- 172.21.15.59:0/3401888680 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a0004030 con 0x562ea45e9df0 2024-09-10T21:20:02.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.747+0000 7f298affd640 1 -- 172.21.15.59:0/3401888680 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f29a00041d0 con 0x562ea45e9df0 2024-09-10T21:20:02.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.747+0000 7f29b3f50740 1 -- 172.21.15.59:0/3401888680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f299c02a070 con 0x562ea45e9df0 2024-09-10T21:20:02.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.747+0000 7f298affd640 1 -- 172.21.15.59:0/3401888680 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f29a00043d0 con 0x562ea45e9df0 2024-09-10T21:20:02.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.747+0000 7f29b3f50740 10 client.16620 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:02.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.747+0000 7f29b3f50740 1 -- 172.21.15.59:0/3401888680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562ea4672dc0 con 0x562ea45e9df0 2024-09-10T21:20:02.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.747+0000 7f298affd640 1 -- 172.21.15.59:0/3401888680 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f299c02a070 con 0x562ea45e9df0 2024-09-10T21:20:02.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.747+0000 7f298affd640 1 -- 172.21.15.59:0/3401888680 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f29a0039650 con 0x562ea45e9df0 2024-09-10T21:20:02.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.747+0000 7f29b3f50740 10 client.16620 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:02.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.747+0000 7f29b3f50740 10 client.16620 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:20:02.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.747+0000 7f29b3f50740 20 client.16620 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:02.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.747+0000 7f29b3f50740 1 --2- 172.21.15.59:0/3401888680 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x562ea46735f0 0x562ea4675a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:02.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.747+0000 7f29b3f50740 4 client.16620 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:20:02.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.747+0000 7f29b3f50740 1 -- 172.21.15.59:0/3401888680 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562ea455acd0 con 0x562ea46735f0 2024-09-10T21:20:02.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.748+0000 7f29ab7fe640 1 --2- 172.21.15.59:0/3401888680 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x562ea46735f0 0x562ea4675a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:02.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.748+0000 7f29ab7fe640 1 --2- 172.21.15.59:0/3401888680 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x562ea46735f0 0x562ea4675a10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2542c16b6e469518 server_cookie=6bbd27cf700e673d in_seq=0 out_seq=0 2024-09-10T21:20:02.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.748+0000 7f298affd640 10 client.16620 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:20:02.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.748+0000 7f298affd640 1 -- 172.21.15.59:0/3401888680 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562ea455acd0 con 0x562ea46735f0 2024-09-10T21:20:02.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.748+0000 7f298affd640 10 client.16620 handle_command_reply: tid=0 2024-09-10T21:20:02.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.748+0000 7f29b3f50740 1 client.16620 shutdown 2024-09-10T21:20:02.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.749+0000 7f29b3f50740 1 -- 172.21.15.59:0/3401888680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e9df0 msgr2=0x562ea45fe1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:02.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.749+0000 7f29b3f50740 1 --2- 172.21.15.59:0/3401888680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e9df0 0x562ea45fe1e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f29a001e650 tx=0x7f29a00046c0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.749+0000 7f29b3f50740 1 -- 172.21.15.59:0/3401888680 shutdown_connections 2024-09-10T21:20:02.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.749+0000 7f29b3f50740 1 --2- 172.21.15.59:0/3401888680 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x562ea46735f0 0x562ea4675a10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.749+0000 7f29b3f50740 1 --2- 172.21.15.59:0/3401888680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562ea45f5d80 0x562ea45f8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.749+0000 7f29b3f50740 1 --2- 172.21.15.59:0/3401888680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562ea45e9df0 0x562ea45fe1e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.749+0000 7f298affd640 0 client.16620 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:20:02.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.749+0000 7f29b3f50740 1 --2- 172.21.15.59:0/3401888680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562ea45e94d0 0x562ea45fdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.749+0000 7f29b3f50740 1 -- 172.21.15.59:0/3401888680 >> 172.21.15.59:0/3401888680 conn(0x562ea45e7300 msgr2=0x562ea45e8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:02.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.749+0000 7f29b3f50740 1 -- 172.21.15.59:0/3401888680 shutdown_connections 2024-09-10T21:20:02.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.749+0000 7f29b3f50740 1 -- 172.21.15.59:0/3401888680 wait complete. 2024-09-10T21:20:02.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.749+0000 7f29b3f50740 20 client.16620 trim_cache size 0 max 16384 2024-09-10T21:20:02.758 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:20:02.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.749+0000 7f29b1b7b640 1 -- 172.21.15.59:0/253406558 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f29940b52e0 msgr2=0x7f29940b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:02.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.749+0000 7f29b1b7b640 1 --2- 172.21.15.59:0/253406558 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f29940b52e0 0x7f29940b77a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f29a00058c0 tx=0x7f29a0005850 comp rx=0 tx=0).stop 2024-09-10T21:20:02.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.749+0000 7f29b1b7b640 1 -- 172.21.15.59:0/253406558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29ac109130 msgr2=0x7f29ac19eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:02.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.749+0000 7f29b1b7b640 1 --2- 172.21.15.59:0/253406558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29ac109130 0x7f29ac19eae0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f29a4005cc0 tx=0x7f29a402f380 comp rx=0 tx=0).stop 2024-09-10T21:20:02.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.749+0000 7f29b1b7b640 1 -- 172.21.15.59:0/253406558 shutdown_connections 2024-09-10T21:20:02.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.749+0000 7f29b1b7b640 1 --2- 172.21.15.59:0/253406558 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f29940b52e0 0x7f29940b77a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.750+0000 7f29b1b7b640 1 --2- 172.21.15.59:0/253406558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29ac109130 0x7f29ac19eae0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.750+0000 7f29b1b7b640 1 --2- 172.21.15.59:0/253406558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29ac1087b0 0x7f29ac199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.750+0000 7f29b1b7b640 1 --2- 172.21.15.59:0/253406558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29ac102da0 0x7f29ac199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:02.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.750+0000 7f29b1b7b640 1 -- 172.21.15.59:0/253406558 >> 172.21.15.59:0/253406558 conn(0x7f29ac0fe810 msgr2=0x7f29ac100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:02.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.750+0000 7f29b1b7b640 1 -- 172.21.15.59:0/253406558 shutdown_connections 2024-09-10T21:20:02.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:02.750+0000 7f29b1b7b640 1 -- 172.21.15.59:0/253406558 wait complete. 2024-09-10T21:20:02.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:02 smithi192 ceph-mon[35363]: pgmap v483: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:20:03.550 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:20:03.808 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:20:04.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.330+0000 7ff848cc1640 1 -- 172.21.15.59:0/2181153284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff844109170 msgr2=0x7ff84410f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:04.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.330+0000 7ff848cc1640 1 --2- 172.21.15.59:0/2181153284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff844109170 0x7ff84410f970 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009ca0 tx=0x7ff83c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.330+0000 7ff848cc1640 1 -- 172.21.15.59:0/2181153284 shutdown_connections 2024-09-10T21:20:04.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.330+0000 7ff848cc1640 1 --2- 172.21.15.59:0/2181153284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff844109170 0x7ff84410f970 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.330+0000 7ff848cc1640 1 --2- 172.21.15.59:0/2181153284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8441087f0 0x7ff844108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.330+0000 7ff848cc1640 1 --2- 172.21.15.59:0/2181153284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff844102de0 0x7ff8441031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.330+0000 7ff848cc1640 1 -- 172.21.15.59:0/2181153284 >> 172.21.15.59:0/2181153284 conn(0x7ff8440fe830 msgr2=0x7ff844100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:04.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.330+0000 7ff848cc1640 1 -- 172.21.15.59:0/2181153284 shutdown_connections 2024-09-10T21:20:04.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.330+0000 7ff848cc1640 1 -- 172.21.15.59:0/2181153284 wait complete. 2024-09-10T21:20:04.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.331+0000 7ff848cc1640 1 Processor -- start 2024-09-10T21:20:04.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.331+0000 7ff848cc1640 1 -- start start 2024-09-10T21:20:04.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.331+0000 7ff848cc1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff844102de0 0x7ff844199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:04.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.331+0000 7ff848cc1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8441087f0 0x7ff844199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:04.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.331+0000 7ff848cc1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff844109170 0x7ff84419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:04.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.331+0000 7ff848cc1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff844112df0 con 0x7ff844109170 2024-09-10T21:20:04.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.331+0000 7ff848cc1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff844112c70 con 0x7ff844102de0 2024-09-10T21:20:04.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.332+0000 7ff842d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff844109170 0x7ff84419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:04.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.332+0000 7ff848cc1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff844112f70 con 0x7ff8441087f0 2024-09-10T21:20:04.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.332+0000 7ff842d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff844109170 0x7ff84419eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50146/0 (socket says 172.21.15.59:50146) 2024-09-10T21:20:04.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.332+0000 7ff842d9d640 1 -- 172.21.15.59:0/1244456004 learned_addr learned my addr 172.21.15.59:0/1244456004 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:04.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.332+0000 7ff841d9b640 1 --2- 172.21.15.59:0/1244456004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8441087f0 0x7ff844199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:04.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.332+0000 7ff84259c640 1 --2- 172.21.15.59:0/1244456004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff844102de0 0x7ff844199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.332+0000 7ff842d9d640 1 -- 172.21.15.59:0/1244456004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8441087f0 msgr2=0x7ff844199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.332+0000 7ff842d9d640 1 --2- 172.21.15.59:0/1244456004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8441087f0 0x7ff844199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.332+0000 7ff842d9d640 1 -- 172.21.15.59:0/1244456004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff844102de0 msgr2=0x7ff844199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.332+0000 7ff842d9d640 1 --2- 172.21.15.59:0/1244456004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff844102de0 0x7ff844199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.332+0000 7ff842d9d640 1 -- 172.21.15.59:0/1244456004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84419f2f0 con 0x7ff844109170 2024-09-10T21:20:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.332+0000 7ff842d9d640 1 --2- 172.21.15.59:0/1244456004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff844109170 0x7ff84419eb20 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7ff83c005cc0 tx=0x7ff83c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.332+0000 7ff8337fe640 1 -- 172.21.15.59:0/1244456004 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c003bf0 con 0x7ff844109170 2024-09-10T21:20:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.333+0000 7ff848cc1640 1 -- 172.21.15.59:0/1244456004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff84419f580 con 0x7ff844109170 2024-09-10T21:20:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.333+0000 7ff8337fe640 1 -- 172.21.15.59:0/1244456004 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff83c003d90 con 0x7ff844109170 2024-09-10T21:20:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.333+0000 7ff8337fe640 1 -- 172.21.15.59:0/1244456004 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c02fbc0 con 0x7ff844109170 2024-09-10T21:20:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.333+0000 7ff848cc1640 1 -- 172.21.15.59:0/1244456004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8441a5ca0 con 0x7ff844109170 2024-09-10T21:20:04.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.335+0000 7ff84b096740 1 Processor -- start 2024-09-10T21:20:04.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.335+0000 7ff8337fe640 1 -- 172.21.15.59:0/1244456004 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7ff83c0305c0 con 0x7ff844109170 2024-09-10T21:20:04.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.336+0000 7ff84b096740 1 -- start start 2024-09-10T21:20:04.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.336+0000 7ff84b096740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb903b4d0 0x555eb903b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:04.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.336+0000 7ff84b096740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb903bdf0 0x555eb904bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:04.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.336+0000 7ff84b096740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb904c190 0x555eb904e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.336+0000 7ff84b096740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555eb8fb1ea0 con 0x555eb904c190 2024-09-10T21:20:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.336+0000 7ff84b096740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555eb8fa12d0 con 0x555eb903b4d0 2024-09-10T21:20:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.336+0000 7ff84b096740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555eb8fa50e0 con 0x555eb903bdf0 2024-09-10T21:20:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.336+0000 7ff841d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb904c190 0x555eb904e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.336+0000 7ff841d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb904c190 0x555eb904e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50162/0 (socket says 172.21.15.59:50162) 2024-09-10T21:20:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.336+0000 7ff841d9b640 1 -- 172.21.15.59:0/1764511833 learned_addr learned my addr 172.21.15.59:0/1764511833 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.336+0000 7ff84259c640 1 --2- 172.21.15.59:0/1764511833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb903bdf0 0x555eb904bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.336+0000 7ff841d9b640 1 --2- 172.21.15.59:0/1764511833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb903b4d0 0x555eb903b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.337+0000 7ff841d9b640 1 -- 172.21.15.59:0/1764511833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb903bdf0 msgr2=0x555eb904bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.337+0000 7ff841d9b640 1 --2- 172.21.15.59:0/1764511833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb903bdf0 0x555eb904bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.337+0000 7ff841d9b640 1 -- 172.21.15.59:0/1764511833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb903b4d0 msgr2=0x555eb903b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.337+0000 7ff841d9b640 1 --2- 172.21.15.59:0/1764511833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb903b4d0 0x555eb903b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.337+0000 7ff8337fe640 1 --2- 172.21.15.59:0/1244456004 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff82c0b52e0 0x7ff82c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:04.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.337+0000 7ff841d9b640 1 -- 172.21.15.59:0/1764511833 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eb8cff650 con 0x555eb904c190 2024-09-10T21:20:04.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.337+0000 7ff84259c640 1 --2- 172.21.15.59:0/1244456004 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff82c0b52e0 0x7ff82c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:04.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.337+0000 7ff8337fe640 1 -- 172.21.15.59:0/1244456004 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff83c1070e0 con 0x7ff844109170 2024-09-10T21:20:04.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.337+0000 7ff841d9b640 1 --2- 172.21.15.59:0/1764511833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb904c190 0x555eb904e580 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ff8380125d0 tx=0x7ff83800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6083a5f7444e55 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:04.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.337+0000 7ff830ff9640 1 -- 172.21.15.59:0/1764511833 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838004250 con 0x555eb904c190 2024-09-10T21:20:04.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.337+0000 7ff830ff9640 1 -- 172.21.15.59:0/1764511833 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8380043f0 con 0x555eb904c190 2024-09-10T21:20:04.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.337+0000 7ff830ff9640 1 -- 172.21.15.59:0/1764511833 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838004e00 con 0x555eb904c190 2024-09-10T21:20:04.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.338+0000 7ff84259c640 1 --2- 172.21.15.59:0/1244456004 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff82c0b52e0 0x7ff82c0b77a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x555eb903afb0 tx=0x7ff83400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:04.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.338+0000 7ff84b096740 1 -- 172.21.15.59:0/1764511833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb904c190 msgr2=0x555eb904e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.338+0000 7ff84b096740 1 --2- 172.21.15.59:0/1764511833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb904c190 0x555eb904e580 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ff8380125d0 tx=0x7ff83800b870 comp rx=0 tx=0).stop 2024-09-10T21:20:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.338+0000 7ff84b096740 1 -- 172.21.15.59:0/1764511833 shutdown_connections 2024-09-10T21:20:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.338+0000 7ff84b096740 1 --2- 172.21.15.59:0/1764511833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb904c190 0x555eb904e580 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.338+0000 7ff84b096740 1 --2- 172.21.15.59:0/1764511833 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb903bdf0 0x555eb904bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.338+0000 7ff84b096740 1 --2- 172.21.15.59:0/1764511833 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb903b4d0 0x555eb903b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.338+0000 7ff84b096740 1 -- 172.21.15.59:0/1764511833 >> 172.21.15.59:0/1764511833 conn(0x555eb9039300 msgr2=0x555eb903a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.338+0000 7ff84b096740 1 -- 172.21.15.59:0/1764511833 shutdown_connections 2024-09-10T21:20:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.338+0000 7ff84b096740 1 -- 172.21.15.59:0/1764511833 wait complete. 2024-09-10T21:20:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.339+0000 7ff84b096740 1 -- start start 2024-09-10T21:20:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.339+0000 7ff84b096740 1 Processor -- start 2024-09-10T21:20:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.339+0000 7ff84b096740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903b4d0 0x555eb904baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.339+0000 7ff84b096740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb903bdf0 0x555eb9048f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:04.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.339+0000 7ff84b096740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb904c190 0x555eb90495c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.339+0000 7ff84b096740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555eb8e02700 con 0x555eb903b4d0 2024-09-10T21:20:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.339+0000 7ff84b096740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555eb8f3c160 con 0x555eb903bdf0 2024-09-10T21:20:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.339+0000 7ff84b096740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555eb904ee40 con 0x555eb904c190 2024-09-10T21:20:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.339+0000 7ff84b096740 10 client.0 _ll_register_callbacks cb 0x555eb8f559e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.339+0000 7ff84259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903b4d0 0x555eb904baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.339+0000 7ff84259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903b4d0 0x555eb904baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50166/0 (socket says 172.21.15.59:50166) 2024-09-10T21:20:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.339+0000 7ff84259c640 1 -- 172.21.15.59:0/1196753405 learned_addr learned my addr 172.21.15.59:0/1196753405 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.339+0000 7ff842d9d640 1 --2- 172.21.15.59:0/1196753405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb904c190 0x555eb90495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.339+0000 7ff841d9b640 1 --2- 172.21.15.59:0/1196753405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb903bdf0 0x555eb9048f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.340+0000 7ff84259c640 1 -- 172.21.15.59:0/1196753405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb904c190 msgr2=0x555eb90495c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.340+0000 7ff84259c640 1 --2- 172.21.15.59:0/1196753405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb904c190 0x555eb90495c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.340+0000 7ff84259c640 1 -- 172.21.15.59:0/1196753405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb903bdf0 msgr2=0x555eb9048f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.340+0000 7ff84259c640 1 --2- 172.21.15.59:0/1196753405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb903bdf0 0x555eb9048f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.340+0000 7ff84259c640 1 -- 172.21.15.59:0/1196753405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eb8f69c90 con 0x555eb903b4d0 2024-09-10T21:20:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.340+0000 7ff841d9b640 1 --2- 172.21.15.59:0/1196753405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb903bdf0 0x555eb9048f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:20:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.340+0000 7ff84259c640 1 --2- 172.21.15.59:0/1196753405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903b4d0 0x555eb904baf0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ff834003f10 tx=0x7ff8340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc091897024c28c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.340+0000 7ff829ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.340+0000 7ff829ffb640 1 -- 172.21.15.59:0/1196753405 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83401b660 con 0x555eb903b4d0 2024-09-10T21:20:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.340+0000 7ff84b096740 1 -- 172.21.15.59:0/1196753405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8380043f0 con 0x555eb903b4d0 2024-09-10T21:20:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.340+0000 7ff829ffb640 1 -- 172.21.15.59:0/1196753405 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff83401b800 con 0x555eb903b4d0 2024-09-10T21:20:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.340+0000 7ff829ffb640 1 -- 172.21.15.59:0/1196753405 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff83401ba00 con 0x555eb903b4d0 2024-09-10T21:20:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.340+0000 7ff84b096740 10 client.16632 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.340+0000 7ff84b096740 1 -- 172.21.15.59:0/1196753405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555eb905a850 con 0x555eb903b4d0 2024-09-10T21:20:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.340+0000 7ff829ffb640 1 -- 172.21.15.59:0/1196753405 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8380043f0 con 0x555eb903b4d0 2024-09-10T21:20:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.341+0000 7ff829ffb640 1 -- 172.21.15.59:0/1196753405 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff834024070 con 0x555eb903b4d0 2024-09-10T21:20:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.341+0000 7ff84b096740 10 client.16632 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:04.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.341+0000 7ff84b096740 10 client.16632 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:20:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.341+0000 7ff84b096740 20 client.16632 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.341+0000 7ff84b096740 1 --2- 172.21.15.59:0/1196753405 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555eb905bd60 0x555eb905e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.341+0000 7ff84b096740 4 client.16632 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:20:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.341+0000 7ff84b096740 1 -- 172.21.15.59:0/1196753405 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555eb8fb3df0 con 0x555eb905bd60 2024-09-10T21:20:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.341+0000 7ff841d9b640 1 --2- 172.21.15.59:0/1196753405 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555eb905bd60 0x555eb905e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.342+0000 7ff841d9b640 1 --2- 172.21.15.59:0/1196753405 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555eb905bd60 0x555eb905e200 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba9574a8e9e9006e server_cookie=775d734b5304b902 in_seq=0 out_seq=0 2024-09-10T21:20:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.342+0000 7ff829ffb640 10 client.16632 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.342+0000 7ff829ffb640 1 -- 172.21.15.59:0/1196753405 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555eb8fb3df0 con 0x555eb905bd60 2024-09-10T21:20:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.342+0000 7ff829ffb640 10 client.16632 handle_command_reply: tid=0 2024-09-10T21:20:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.342+0000 7ff84b096740 1 client.16632 shutdown 2024-09-10T21:20:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.343+0000 7ff84b096740 1 -- 172.21.15.59:0/1196753405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903b4d0 msgr2=0x555eb904baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.343+0000 7ff84b096740 1 --2- 172.21.15.59:0/1196753405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903b4d0 0x555eb904baf0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ff834003f10 tx=0x7ff8340046c0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.343+0000 7ff84b096740 1 -- 172.21.15.59:0/1196753405 shutdown_connections 2024-09-10T21:20:04.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.343+0000 7ff84b096740 1 --2- 172.21.15.59:0/1196753405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb904c190 0x555eb90495c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.343+0000 7ff84b096740 1 --2- 172.21.15.59:0/1196753405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb903bdf0 0x555eb9048f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.343+0000 7ff84b096740 1 --2- 172.21.15.59:0/1196753405 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555eb905bd60 0x555eb905e200 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.343+0000 7ff84b096740 1 --2- 172.21.15.59:0/1196753405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903b4d0 0x555eb904baf0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.343+0000 7ff84b096740 1 -- 172.21.15.59:0/1196753405 >> 172.21.15.59:0/1196753405 conn(0x555eb9039300 msgr2=0x555eb903ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:04.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.343+0000 7ff829ffb640 0 client.16632 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:04.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.343+0000 7ff84b096740 1 -- 172.21.15.59:0/1196753405 shutdown_connections 2024-09-10T21:20:04.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.343+0000 7ff84b096740 1 -- 172.21.15.59:0/1196753405 wait complete. 2024-09-10T21:20:04.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.343+0000 7ff84b096740 20 client.16632 trim_cache size 0 max 16384 2024-09-10T21:20:04.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.356+0000 7ff84b096740 1 Processor -- start 2024-09-10T21:20:04.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.356+0000 7ff84b096740 1 -- start start 2024-09-10T21:20:04.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.356+0000 7ff84b096740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb903b4d0 0x555eb9058070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:04.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.356+0000 7ff84b096740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903bdf0 0x555eb904d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:04.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.356+0000 7ff84b096740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb904c190 0x555eb904d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:04.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.356+0000 7ff84b096740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff8441ac020 con 0x555eb903bdf0 2024-09-10T21:20:04.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.356+0000 7ff84b096740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8441adb60 con 0x555eb904c190 2024-09-10T21:20:04.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.356+0000 7ff84b096740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff8441ac6f0 con 0x555eb903b4d0 2024-09-10T21:20:04.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.357+0000 7ff841d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903bdf0 0x555eb904d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:04.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.357+0000 7ff841d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903bdf0 0x555eb904d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50176/0 (socket says 172.21.15.59:50176) 2024-09-10T21:20:04.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.357+0000 7ff841d9b640 1 -- 172.21.15.59:0/1946075720 learned_addr learned my addr 172.21.15.59:0/1946075720 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.357+0000 7ff84259c640 1 --2- 172.21.15.59:0/1946075720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb903b4d0 0x555eb9058070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.357+0000 7ff841d9b640 1 -- 172.21.15.59:0/1946075720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb903b4d0 msgr2=0x555eb9058070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.357+0000 7ff841d9b640 1 --2- 172.21.15.59:0/1946075720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb903b4d0 0x555eb9058070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.357+0000 7ff841d9b640 1 -- 172.21.15.59:0/1946075720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb904c190 msgr2=0x555eb904d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.357+0000 7ff841d9b640 1 --2- 172.21.15.59:0/1946075720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb904c190 0x555eb904d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.357+0000 7ff841d9b640 1 -- 172.21.15.59:0/1946075720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eb9049930 con 0x555eb903bdf0 2024-09-10T21:20:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.357+0000 7ff84259c640 1 --2- 172.21.15.59:0/1946075720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb903b4d0 0x555eb9058070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.357+0000 7ff841d9b640 1 --2- 172.21.15.59:0/1946075720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903bdf0 0x555eb904d020 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7ff838004a50 tx=0x7ff8380049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccf20f7d1c1e2ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.357+0000 7ff82bfff640 1 -- 172.21.15.59:0/1946075720 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83802c070 con 0x555eb903bdf0 2024-09-10T21:20:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.357+0000 7ff82bfff640 1 -- 172.21.15.59:0/1946075720 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff838010960 con 0x555eb903bdf0 2024-09-10T21:20:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.357+0000 7ff82bfff640 1 -- 172.21.15.59:0/1946075720 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8380306a0 con 0x555eb903bdf0 2024-09-10T21:20:04.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.358+0000 7ff84b096740 1 -- 172.21.15.59:0/1946075720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903bdf0 msgr2=0x555eb904d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:04.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.358+0000 7ff84b096740 1 --2- 172.21.15.59:0/1946075720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903bdf0 0x555eb904d020 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7ff838004a50 tx=0x7ff8380049e0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.358+0000 7ff84b096740 1 -- 172.21.15.59:0/1946075720 shutdown_connections 2024-09-10T21:20:04.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.358+0000 7ff84b096740 1 --2- 172.21.15.59:0/1946075720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb904c190 0x555eb904d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.358+0000 7ff84b096740 1 --2- 172.21.15.59:0/1946075720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903bdf0 0x555eb904d020 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.358+0000 7ff84b096740 1 --2- 172.21.15.59:0/1946075720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb903b4d0 0x555eb9058070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.358+0000 7ff84b096740 1 -- 172.21.15.59:0/1946075720 >> 172.21.15.59:0/1946075720 conn(0x555eb9039300 msgr2=0x555eb904dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:04.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.358+0000 7ff84b096740 1 -- 172.21.15.59:0/1946075720 shutdown_connections 2024-09-10T21:20:04.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.358+0000 7ff84b096740 1 -- 172.21.15.59:0/1946075720 wait complete. 2024-09-10T21:20:04.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.359+0000 7ff84b096740 1 -- start start 2024-09-10T21:20:04.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.359+0000 7ff84b096740 1 Processor -- start 2024-09-10T21:20:04.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.359+0000 7ff84b096740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb903b4d0 0x555eb9054800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:04.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.359+0000 7ff84b096740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903bdf0 0x555eb9063670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:04.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.359+0000 7ff84b096740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb904c190 0x555eb9063bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:04.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.359+0000 7ff84b096740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff8441ad490 con 0x555eb903bdf0 2024-09-10T21:20:04.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.359+0000 7ff84b096740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8441acdc0 con 0x555eb904c190 2024-09-10T21:20:04.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.359+0000 7ff84b096740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff8441aa000 con 0x555eb903b4d0 2024-09-10T21:20:04.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.359+0000 7ff84b096740 10 client.0 _ll_register_callbacks cb 0x7ff834004320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:04.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.359+0000 7ff841d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903bdf0 0x555eb9063670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.359+0000 7ff841d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903bdf0 0x555eb9063670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50188/0 (socket says 172.21.15.59:50188) 2024-09-10T21:20:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.359+0000 7ff841d9b640 1 -- 172.21.15.59:0/294836653 learned_addr learned my addr 172.21.15.59:0/294836653 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.359+0000 7ff84259c640 1 --2- 172.21.15.59:0/294836653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb903b4d0 0x555eb9054800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.359+0000 7ff842d9d640 1 --2- 172.21.15.59:0/294836653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb904c190 0x555eb9063bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.360+0000 7ff841d9b640 1 -- 172.21.15.59:0/294836653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb903b4d0 msgr2=0x555eb9054800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.360+0000 7ff841d9b640 1 --2- 172.21.15.59:0/294836653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb903b4d0 0x555eb9054800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.360+0000 7ff841d9b640 1 -- 172.21.15.59:0/294836653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb904c190 msgr2=0x555eb9063bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.360+0000 7ff841d9b640 1 --2- 172.21.15.59:0/294836653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb904c190 0x555eb9063bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.360+0000 7ff841d9b640 1 -- 172.21.15.59:0/294836653 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eb90643e0 con 0x555eb903bdf0 2024-09-10T21:20:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.360+0000 7ff84259c640 1 --2- 172.21.15.59:0/294836653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb903b4d0 0x555eb9054800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:20:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.360+0000 7ff841d9b640 1 --2- 172.21.15.59:0/294836653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903bdf0 0x555eb9063670 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7ff83800be90 tx=0x7ff8380048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63059f88807871d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.360+0000 7ff829ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:04.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.360+0000 7ff829ffb640 1 -- 172.21.15.59:0/294836653 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83802c040 con 0x555eb903bdf0 2024-09-10T21:20:04.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.360+0000 7ff829ffb640 1 -- 172.21.15.59:0/294836653 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff838010d10 con 0x555eb903bdf0 2024-09-10T21:20:04.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.360+0000 7ff84b096740 1 -- 172.21.15.59:0/294836653 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff838010960 con 0x555eb903bdf0 2024-09-10T21:20:04.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.360+0000 7ff829ffb640 1 -- 172.21.15.59:0/294836653 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff838010780 con 0x555eb903bdf0 2024-09-10T21:20:04.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.360+0000 7ff84b096740 10 client.16638 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:04.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.360+0000 7ff84b096740 1 -- 172.21.15.59:0/294836653 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555eb90c8cf0 con 0x555eb903bdf0 2024-09-10T21:20:04.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.361+0000 7ff829ffb640 1 -- 172.21.15.59:0/294836653 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff838010960 con 0x555eb903bdf0 2024-09-10T21:20:04.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.361+0000 7ff829ffb640 1 -- 172.21.15.59:0/294836653 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff83801c030 con 0x555eb903bdf0 2024-09-10T21:20:04.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.361+0000 7ff84b096740 10 client.16638 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:04.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.361+0000 7ff84b096740 10 client.16638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:20:04.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.361+0000 7ff84b096740 20 client.16638 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:04.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.361+0000 7ff84b096740 1 --2- 172.21.15.59:0/294836653 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555eb90c9220 0x555eb90cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:04.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.361+0000 7ff84b096740 4 client.16638 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:20:04.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.361+0000 7ff84b096740 1 -- 172.21.15.59:0/294836653 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555eb8faf8a0 con 0x555eb90c9220 2024-09-10T21:20:04.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.361+0000 7ff84259c640 1 --2- 172.21.15.59:0/294836653 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555eb90c9220 0x555eb90cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.362+0000 7ff84259c640 1 --2- 172.21.15.59:0/294836653 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555eb90c9220 0x555eb90cb640 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abfab9fe83a9bcaa server_cookie=bea2845e44b96f8d in_seq=0 out_seq=0 2024-09-10T21:20:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.362+0000 7ff829ffb640 10 client.16638 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.362+0000 7ff829ffb640 1 -- 172.21.15.59:0/294836653 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555eb8faf8a0 con 0x555eb90c9220 2024-09-10T21:20:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.362+0000 7ff829ffb640 10 client.16638 handle_command_reply: tid=0 2024-09-10T21:20:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.362+0000 7ff84b096740 1 client.16638 shutdown 2024-09-10T21:20:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.362+0000 7ff84b096740 1 -- 172.21.15.59:0/294836653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903bdf0 msgr2=0x555eb9063670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.362+0000 7ff84b096740 1 --2- 172.21.15.59:0/294836653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903bdf0 0x555eb9063670 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7ff83800be90 tx=0x7ff8380048a0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.362+0000 7ff84b096740 1 -- 172.21.15.59:0/294836653 shutdown_connections 2024-09-10T21:20:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.362+0000 7ff84b096740 1 --2- 172.21.15.59:0/294836653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555eb904c190 0x555eb9063bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.362+0000 7ff84b096740 1 --2- 172.21.15.59:0/294836653 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555eb90c9220 0x555eb90cb640 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.362+0000 7ff84b096740 1 --2- 172.21.15.59:0/294836653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eb903bdf0 0x555eb9063670 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.362+0000 7ff84b096740 1 --2- 172.21.15.59:0/294836653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555eb903b4d0 0x555eb9054800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.362+0000 7ff84b096740 1 -- 172.21.15.59:0/294836653 >> 172.21.15.59:0/294836653 conn(0x555eb9039300 msgr2=0x555eb904dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:04.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.362+0000 7ff829ffb640 0 client.16638 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:04.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.362+0000 7ff84b096740 1 -- 172.21.15.59:0/294836653 shutdown_connections 2024-09-10T21:20:04.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.362+0000 7ff84b096740 1 -- 172.21.15.59:0/294836653 wait complete. 2024-09-10T21:20:04.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.362+0000 7ff84b096740 20 client.16638 trim_cache size 0 max 16384 2024-09-10T21:20:04.371 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:20:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.363+0000 7ff848cc1640 1 -- 172.21.15.59:0/1244456004 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff82c0b52e0 msgr2=0x7ff82c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.363+0000 7ff848cc1640 1 --2- 172.21.15.59:0/1244456004 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff82c0b52e0 0x7ff82c0b77a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x555eb903afb0 tx=0x7ff83400b390 comp rx=0 tx=0).stop 2024-09-10T21:20:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.363+0000 7ff848cc1640 1 -- 172.21.15.59:0/1244456004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff844109170 msgr2=0x7ff84419eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.363+0000 7ff848cc1640 1 --2- 172.21.15.59:0/1244456004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff844109170 0x7ff84419eb20 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7ff83c005cc0 tx=0x7ff83c02f380 comp rx=0 tx=0).stop 2024-09-10T21:20:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.363+0000 7ff848cc1640 1 -- 172.21.15.59:0/1244456004 shutdown_connections 2024-09-10T21:20:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.363+0000 7ff848cc1640 1 --2- 172.21.15.59:0/1244456004 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff82c0b52e0 0x7ff82c0b77a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.363+0000 7ff848cc1640 1 --2- 172.21.15.59:0/1244456004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff844109170 0x7ff84419eb20 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.363+0000 7ff848cc1640 1 --2- 172.21.15.59:0/1244456004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff8441087f0 0x7ff844199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.363+0000 7ff848cc1640 1 --2- 172.21.15.59:0/1244456004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff844102de0 0x7ff844199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.363+0000 7ff848cc1640 1 -- 172.21.15.59:0/1244456004 >> 172.21.15.59:0/1244456004 conn(0x7ff8440fe830 msgr2=0x7ff844100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.363+0000 7ff848cc1640 1 -- 172.21.15.59:0/1244456004 shutdown_connections 2024-09-10T21:20:04.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:04.363+0000 7ff848cc1640 1 -- 172.21.15.59:0/1244456004 wait complete. 2024-09-10T21:20:04.579 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:04 smithi059 ceph-mon[30888]: pgmap v484: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:20:04.682 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:04 smithi154 ceph-mon[35041]: pgmap v484: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:20:04.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:04 smithi192 ceph-mon[35363]: pgmap v484: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:20:06.265 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:20:06.265 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:20:06.540 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:20:06.660 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:06 smithi059 ceph-mon[30888]: pgmap v485: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-10T21:20:06.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:06 smithi192 ceph-mon[35363]: pgmap v485: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-10T21:20:06.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:06 smithi154 ceph-mon[35041]: pgmap v485: 97 pgs: 97 active+clean; 3.2 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 14 op/s 2024-09-10T21:20:07.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.031+0000 7fa31eeba640 1 -- 172.21.15.59:0/2362153515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3181087e0 msgr2=0x7fa318108c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:07.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.031+0000 7fa31eeba640 1 --2- 172.21.15.59:0/2362153515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3181087e0 0x7fa318108c20 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa308009900 tx=0x7fa30802a410 comp rx=0 tx=0).stop 2024-09-10T21:20:07.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.031+0000 7fa31eeba640 1 -- 172.21.15.59:0/2362153515 shutdown_connections 2024-09-10T21:20:07.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.031+0000 7fa31eeba640 1 --2- 172.21.15.59:0/2362153515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa318109160 0x7fa31810f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.031+0000 7fa31eeba640 1 --2- 172.21.15.59:0/2362153515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3181087e0 0x7fa318108c20 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.031+0000 7fa31eeba640 1 --2- 172.21.15.59:0/2362153515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa318102dd0 0x7fa3181031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.031+0000 7fa31eeba640 1 -- 172.21.15.59:0/2362153515 >> 172.21.15.59:0/2362153515 conn(0x7fa3180fe860 msgr2=0x7fa318100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:07.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.031+0000 7fa31eeba640 1 -- 172.21.15.59:0/2362153515 shutdown_connections 2024-09-10T21:20:07.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.031+0000 7fa31eeba640 1 -- 172.21.15.59:0/2362153515 wait complete. 2024-09-10T21:20:07.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.032+0000 7fa31eeba640 1 Processor -- start 2024-09-10T21:20:07.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.032+0000 7fa31eeba640 1 -- start start 2024-09-10T21:20:07.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.032+0000 7fa31eeba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa318102dd0 0x7fa31819b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:07.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.032+0000 7fa31eeba640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3181087e0 0x7fa31819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:07.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.032+0000 7fa31eeba640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa318109160 0x7fa3181a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:07.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.032+0000 7fa31eeba640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa318112e20 con 0x7fa318109160 2024-09-10T21:20:07.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.032+0000 7fa31eeba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa318112ca0 con 0x7fa318102dd0 2024-09-10T21:20:07.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.032+0000 7fa31eeba640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa318112fa0 con 0x7fa3181087e0 2024-09-10T21:20:07.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.033+0000 7fa31d457640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa318109160 0x7fa3181a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:07.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.033+0000 7fa30ffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3181087e0 0x7fa31819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:07.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.033+0000 7fa30ffff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3181087e0 0x7fa31819b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:57702/0 (socket says 172.21.15.59:57702) 2024-09-10T21:20:07.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.033+0000 7fa30ffff640 1 -- 172.21.15.59:0/519848497 learned_addr learned my addr 172.21.15.59:0/519848497 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:07.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.033+0000 7fa31cc56640 1 --2- 172.21.15.59:0/519848497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa318102dd0 0x7fa31819b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:07.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.033+0000 7fa31d457640 1 -- 172.21.15.59:0/519848497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3181087e0 msgr2=0x7fa31819b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:07.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.033+0000 7fa31d457640 1 --2- 172.21.15.59:0/519848497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3181087e0 0x7fa31819b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.033+0000 7fa31d457640 1 -- 172.21.15.59:0/519848497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa318102dd0 msgr2=0x7fa31819b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:07.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.033+0000 7fa31d457640 1 --2- 172.21.15.59:0/519848497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa318102dd0 0x7fa31819b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.033+0000 7fa31d457640 1 -- 172.21.15.59:0/519848497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3181a1560 con 0x7fa318109160 2024-09-10T21:20:07.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.033+0000 7fa31d457640 1 --2- 172.21.15.59:0/519848497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa318109160 0x7fa3181a0d90 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fa31000e940 tx=0x7fa31000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:07.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.033+0000 7fa30dffb640 1 -- 172.21.15.59:0/519848497 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310004d20 con 0x7fa318109160 2024-09-10T21:20:07.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.033+0000 7fa30dffb640 1 -- 172.21.15.59:0/519848497 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa310005020 con 0x7fa318109160 2024-09-10T21:20:07.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.033+0000 7fa31eeba640 1 -- 172.21.15.59:0/519848497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3181a1850 con 0x7fa318109160 2024-09-10T21:20:07.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.033+0000 7fa30dffb640 1 -- 172.21.15.59:0/519848497 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3100116d0 con 0x7fa318109160 2024-09-10T21:20:07.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.034+0000 7fa31eeba640 1 -- 172.21.15.59:0/519848497 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3181a7f10 con 0x7fa318109160 2024-09-10T21:20:07.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.037+0000 7fa32128f740 1 Processor -- start 2024-09-10T21:20:07.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.037+0000 7fa30dffb640 1 -- 172.21.15.59:0/519848497 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fa31000f040 con 0x7fa318109160 2024-09-10T21:20:07.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.037+0000 7fa32128f740 1 -- start start 2024-09-10T21:20:07.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.037+0000 7fa32128f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d7ee0 0x559f711d82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:07.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.037+0000 7fa32128f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711d8800 0x559f711e4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:07.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.037+0000 7fa32128f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 0x559f711e6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:07.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.037+0000 7fa32128f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559f7114ee60 con 0x559f711e4790 2024-09-10T21:20:07.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.037+0000 7fa32128f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559f7113e290 con 0x559f711d8800 2024-09-10T21:20:07.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.037+0000 7fa32128f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559f711420a0 con 0x559f711d7ee0 2024-09-10T21:20:07.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.037+0000 7fa30ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 0x559f711e6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:07.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.037+0000 7fa30ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 0x559f711e6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50214/0 (socket says 172.21.15.59:50214) 2024-09-10T21:20:07.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.037+0000 7fa30ffff640 1 -- 172.21.15.59:0/911548818 learned_addr learned my addr 172.21.15.59:0/911548818 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:07.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.037+0000 7fa30ffff640 1 --2- 172.21.15.59:0/911548818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d7ee0 0x559f711d82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:07.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.038+0000 7fa31cc56640 1 --2- 172.21.15.59:0/911548818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711d8800 0x559f711e4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:07.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.038+0000 7fa30ffff640 1 -- 172.21.15.59:0/911548818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d7ee0 msgr2=0x559f711d82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:07.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.038+0000 7fa30ffff640 1 --2- 172.21.15.59:0/911548818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d7ee0 0x559f711d82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.038+0000 7fa30ffff640 1 -- 172.21.15.59:0/911548818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711d8800 msgr2=0x559f711e4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:07.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.038+0000 7fa30ffff640 1 --2- 172.21.15.59:0/911548818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711d8800 0x559f711e4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.038+0000 7fa30ffff640 1 -- 172.21.15.59:0/911548818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f70e9c930 con 0x559f711e4790 2024-09-10T21:20:07.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.038+0000 7fa31cc56640 1 --2- 172.21.15.59:0/911548818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711d8800 0x559f711e4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:07.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.038+0000 7fa30dffb640 1 --2- 172.21.15.59:0/519848497 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa3000b5360 0x7fa3000b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:07.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.038+0000 7fa30ffff640 1 --2- 172.21.15.59:0/911548818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 0x559f711e6b80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa308000c00 tx=0x7fa308005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1996852b6bd124c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:07.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.038+0000 7fa31cc56640 1 --2- 172.21.15.59:0/519848497 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa3000b5360 0x7fa3000b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:07.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.038+0000 7fa30dffb640 1 -- 172.21.15.59:0/519848497 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa3100e5830 con 0x7fa318109160 2024-09-10T21:20:07.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.038+0000 7fa2feffd640 1 -- 172.21.15.59:0/911548818 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa308035070 con 0x559f711e4790 2024-09-10T21:20:07.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.038+0000 7fa2feffd640 1 -- 172.21.15.59:0/911548818 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa308005020 con 0x559f711e4790 2024-09-10T21:20:07.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.038+0000 7fa2feffd640 1 -- 172.21.15.59:0/911548818 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3080044e0 con 0x559f711e4790 2024-09-10T21:20:07.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.039+0000 7fa32128f740 1 -- 172.21.15.59:0/911548818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 msgr2=0x559f711e6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:07.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.039+0000 7fa31cc56640 1 --2- 172.21.15.59:0/519848497 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa3000b5360 0x7fa3000b7820 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x559f711db060 tx=0x7fa31400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:07.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.039+0000 7fa32128f740 1 --2- 172.21.15.59:0/911548818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 0x559f711e6b80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa308000c00 tx=0x7fa308005e50 comp rx=0 tx=0).stop 2024-09-10T21:20:07.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.039+0000 7fa32128f740 1 -- 172.21.15.59:0/911548818 shutdown_connections 2024-09-10T21:20:07.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.039+0000 7fa32128f740 1 --2- 172.21.15.59:0/911548818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 0x559f711e6b80 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.039+0000 7fa32128f740 1 --2- 172.21.15.59:0/911548818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711d8800 0x559f711e4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.039+0000 7fa32128f740 1 --2- 172.21.15.59:0/911548818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d7ee0 0x559f711d82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.039+0000 7fa32128f740 1 -- 172.21.15.59:0/911548818 >> 172.21.15.59:0/911548818 conn(0x559f711d5d10 msgr2=0x559f711d6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.039+0000 7fa32128f740 1 -- 172.21.15.59:0/911548818 shutdown_connections 2024-09-10T21:20:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.039+0000 7fa32128f740 1 -- 172.21.15.59:0/911548818 wait complete. 2024-09-10T21:20:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.039+0000 7fa32128f740 1 -- start start 2024-09-10T21:20:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.040+0000 7fa32128f740 1 Processor -- start 2024-09-10T21:20:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.040+0000 7fa32128f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711d7ee0 0x559f711e17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.040+0000 7fa32128f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d8800 0x559f711e1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.040+0000 7fa32128f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 0x559f711e2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.040+0000 7fa32128f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559f70f9f890 con 0x559f711e4790 2024-09-10T21:20:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.040+0000 7fa32128f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559f710d8d40 con 0x559f711d7ee0 2024-09-10T21:20:07.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.040+0000 7fa32128f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559f711e73e0 con 0x559f711d8800 2024-09-10T21:20:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.040+0000 7fa32128f740 10 client.0 _ll_register_callbacks cb 0x559f7113cc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.040+0000 7fa31d457640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 0x559f711e2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.040+0000 7fa31d457640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 0x559f711e2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50216/0 (socket says 172.21.15.59:50216) 2024-09-10T21:20:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.040+0000 7fa31d457640 1 -- 172.21.15.59:0/4012255479 learned_addr learned my addr 172.21.15.59:0/4012255479 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.040+0000 7fa30ffff640 1 --2- 172.21.15.59:0/4012255479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d8800 0x559f711e1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.040+0000 7fa31cc56640 1 --2- 172.21.15.59:0/4012255479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711d7ee0 0x559f711e17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.041+0000 7fa31d457640 1 -- 172.21.15.59:0/4012255479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d8800 msgr2=0x559f711e1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.041+0000 7fa31d457640 1 --2- 172.21.15.59:0/4012255479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d8800 0x559f711e1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.041+0000 7fa31d457640 1 -- 172.21.15.59:0/4012255479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711d7ee0 msgr2=0x559f711e17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.041+0000 7fa31d457640 1 --2- 172.21.15.59:0/4012255479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711d7ee0 0x559f711e17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.041+0000 7fa31d457640 1 -- 172.21.15.59:0/4012255479 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f711f0840 con 0x559f711e4790 2024-09-10T21:20:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.041+0000 7fa30ffff640 1 --2- 172.21.15.59:0/4012255479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d8800 0x559f711e1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:20:07.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.041+0000 7fa31d457640 1 --2- 172.21.15.59:0/4012255479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 0x559f711e2220 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa3100a9340 tx=0x7fa3100ab900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ebfcaf10853dae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:07.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.041+0000 7fa2f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:07.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.041+0000 7fa2f7fff640 1 -- 172.21.15.59:0/4012255479 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31001f040 con 0x559f711e4790 2024-09-10T21:20:07.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.041+0000 7fa2f7fff640 1 -- 172.21.15.59:0/4012255479 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa31000cb20 con 0x559f711e4790 2024-09-10T21:20:07.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.041+0000 7fa32128f740 1 -- 172.21.15.59:0/4012255479 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa308005020 con 0x559f711e4790 2024-09-10T21:20:07.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.041+0000 7fa2f7fff640 1 -- 172.21.15.59:0/4012255479 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa3100b0b00 con 0x559f711e4790 2024-09-10T21:20:07.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.041+0000 7fa32128f740 10 client.16650 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:07.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.041+0000 7fa32128f740 1 -- 172.21.15.59:0/4012255479 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559f711f31f0 con 0x559f711e4790 2024-09-10T21:20:07.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.041+0000 7fa2f7fff640 1 -- 172.21.15.59:0/4012255479 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa308005020 con 0x559f711e4790 2024-09-10T21:20:07.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.042+0000 7fa2f7fff640 1 -- 172.21.15.59:0/4012255479 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa3100a7ab0 con 0x559f711e4790 2024-09-10T21:20:07.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.042+0000 7fa32128f740 10 client.16650 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:07.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.042+0000 7fa32128f740 10 client.16650 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:20:07.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.042+0000 7fa32128f740 20 client.16650 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:07.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.042+0000 7fa32128f740 1 --2- 172.21.15.59:0/4012255479 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559f711f4700 0x559f711f6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:07.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.042+0000 7fa32128f740 4 client.16650 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:20:07.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.042+0000 7fa32128f740 1 -- 172.21.15.59:0/4012255479 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f71150db0 con 0x559f711f4700 2024-09-10T21:20:07.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.042+0000 7fa31cc56640 1 --2- 172.21.15.59:0/4012255479 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559f711f4700 0x559f711f6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:07.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.042+0000 7fa31cc56640 1 --2- 172.21.15.59:0/4012255479 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559f711f4700 0x559f711f6af0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd37418c98873b1a server_cookie=e1948557b52e0b51 in_seq=0 out_seq=0 2024-09-10T21:20:07.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.042+0000 7fa2f7fff640 10 client.16650 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:07.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.043+0000 7fa2f7fff640 1 -- 172.21.15.59:0/4012255479 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559f71150db0 con 0x559f711f4700 2024-09-10T21:20:07.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.043+0000 7fa2f7fff640 10 client.16650 handle_command_reply: tid=0 2024-09-10T21:20:07.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.043+0000 7fa32128f740 1 client.16650 shutdown 2024-09-10T21:20:07.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.043+0000 7fa32128f740 1 -- 172.21.15.59:0/4012255479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 msgr2=0x559f711e2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:07.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.043+0000 7fa32128f740 1 --2- 172.21.15.59:0/4012255479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 0x559f711e2220 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa3100a9340 tx=0x7fa3100ab900 comp rx=0 tx=0).stop 2024-09-10T21:20:07.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.043+0000 7fa32128f740 1 -- 172.21.15.59:0/4012255479 shutdown_connections 2024-09-10T21:20:07.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.043+0000 7fa32128f740 1 --2- 172.21.15.59:0/4012255479 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559f711f4700 0x559f711f6af0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.043+0000 7fa32128f740 1 --2- 172.21.15.59:0/4012255479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 0x559f711e2220 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.043+0000 7fa32128f740 1 --2- 172.21.15.59:0/4012255479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d8800 0x559f711e1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.043+0000 7fa32128f740 1 --2- 172.21.15.59:0/4012255479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711d7ee0 0x559f711e17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.043+0000 7fa2f7fff640 0 client.16650 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:07.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.043+0000 7fa32128f740 1 -- 172.21.15.59:0/4012255479 >> 172.21.15.59:0/4012255479 conn(0x559f711d5d10 msgr2=0x559f711d4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:07.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.044+0000 7fa32128f740 1 -- 172.21.15.59:0/4012255479 shutdown_connections 2024-09-10T21:20:07.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.044+0000 7fa32128f740 1 -- 172.21.15.59:0/4012255479 wait complete. 2024-09-10T21:20:07.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.044+0000 7fa32128f740 20 client.16650 trim_cache size 0 max 16384 2024-09-10T21:20:07.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.061+0000 7fa32128f740 1 Processor -- start 2024-09-10T21:20:07.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.061+0000 7fa32128f740 1 -- start start 2024-09-10T21:20:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.061+0000 7fa32128f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711d7ee0 0x559f711e34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.061+0000 7fa32128f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d8800 0x559f711fc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.061+0000 7fa32128f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711e4790 0x559f711fc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.061+0000 7fa32128f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa3181b04f0 con 0x559f711d7ee0 2024-09-10T21:20:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.061+0000 7fa32128f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa3181b2030 con 0x559f711e4790 2024-09-10T21:20:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.061+0000 7fa32128f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa3181b0bc0 con 0x559f711d8800 2024-09-10T21:20:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.061+0000 7fa31cc56640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711d7ee0 0x559f711e34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.061+0000 7fa31cc56640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711d7ee0 0x559f711e34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50220/0 (socket says 172.21.15.59:50220) 2024-09-10T21:20:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.061+0000 7fa31cc56640 1 -- 172.21.15.59:0/1822992898 learned_addr learned my addr 172.21.15.59:0/1822992898 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.062+0000 7fa31d457640 1 --2- 172.21.15.59:0/1822992898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711e4790 0x559f711fc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.062+0000 7fa31cc56640 1 -- 172.21.15.59:0/1822992898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d8800 msgr2=0x559f711fc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.062+0000 7fa31cc56640 1 --2- 172.21.15.59:0/1822992898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d8800 0x559f711fc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.062+0000 7fa31cc56640 1 -- 172.21.15.59:0/1822992898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711e4790 msgr2=0x559f711fc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.062+0000 7fa31cc56640 1 --2- 172.21.15.59:0/1822992898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711e4790 0x559f711fc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.062+0000 7fa31cc56640 1 -- 172.21.15.59:0/1822992898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f711d8630 con 0x559f711d7ee0 2024-09-10T21:20:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.062+0000 7fa31d457640 1 --2- 172.21.15.59:0/1822992898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711e4790 0x559f711fc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:20:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.062+0000 7fa31cc56640 1 --2- 172.21.15.59:0/1822992898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711d7ee0 0x559f711e34e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x559f711f72f0 tx=0x7fa314015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219900cb01a2c171 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.062+0000 7fa2fe7fc640 1 -- 172.21.15.59:0/1822992898 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa314005020 con 0x559f711d7ee0 2024-09-10T21:20:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.062+0000 7fa2fe7fc640 1 -- 172.21.15.59:0/1822992898 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3140047a0 con 0x559f711d7ee0 2024-09-10T21:20:07.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.062+0000 7fa2fe7fc640 1 -- 172.21.15.59:0/1822992898 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa314028610 con 0x559f711d7ee0 2024-09-10T21:20:07.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.063+0000 7fa32128f740 1 -- 172.21.15.59:0/1822992898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711d7ee0 msgr2=0x559f711e34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:07.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.063+0000 7fa32128f740 1 --2- 172.21.15.59:0/1822992898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711d7ee0 0x559f711e34e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x559f711f72f0 tx=0x7fa314015000 comp rx=0 tx=0).stop 2024-09-10T21:20:07.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.063+0000 7fa32128f740 1 -- 172.21.15.59:0/1822992898 shutdown_connections 2024-09-10T21:20:07.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.063+0000 7fa32128f740 1 --2- 172.21.15.59:0/1822992898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711e4790 0x559f711fc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.063+0000 7fa32128f740 1 --2- 172.21.15.59:0/1822992898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d8800 0x559f711fc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.063+0000 7fa32128f740 1 --2- 172.21.15.59:0/1822992898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711d7ee0 0x559f711e34e0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.063+0000 7fa32128f740 1 -- 172.21.15.59:0/1822992898 >> 172.21.15.59:0/1822992898 conn(0x559f711d5d10 msgr2=0x559f711e2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:07.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.063+0000 7fa32128f740 1 -- 172.21.15.59:0/1822992898 shutdown_connections 2024-09-10T21:20:07.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.063+0000 7fa32128f740 1 -- 172.21.15.59:0/1822992898 wait complete. 2024-09-10T21:20:07.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.063+0000 7fa32128f740 1 -- start start 2024-09-10T21:20:07.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.063+0000 7fa32128f740 1 Processor -- start 2024-09-10T21:20:07.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa32128f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d7ee0 0x559f711ece50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:07.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa32128f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711d8800 0x559f711e9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:07.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa32128f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 0x559f711e9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:07.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa32128f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa3181b1960 con 0x559f711e4790 2024-09-10T21:20:07.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa32128f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa3181b1290 con 0x559f711d8800 2024-09-10T21:20:07.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa32128f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa3181ae4d0 con 0x559f711d7ee0 2024-09-10T21:20:07.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa32128f740 10 client.0 _ll_register_callbacks cb 0x7fa310004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:07.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa31d457640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 0x559f711e9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:07.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa31d457640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 0x559f711e9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50232/0 (socket says 172.21.15.59:50232) 2024-09-10T21:20:07.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa31d457640 1 -- 172.21.15.59:0/1114362360 learned_addr learned my addr 172.21.15.59:0/1114362360 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:07.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa30ffff640 1 --2- 172.21.15.59:0/1114362360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711d8800 0x559f711e9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:07.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa31cc56640 1 --2- 172.21.15.59:0/1114362360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d7ee0 0x559f711ece50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:07.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa31d457640 1 -- 172.21.15.59:0/1114362360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d7ee0 msgr2=0x559f711ece50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:07.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa31d457640 1 --2- 172.21.15.59:0/1114362360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d7ee0 0x559f711ece50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa31d457640 1 -- 172.21.15.59:0/1114362360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711d8800 msgr2=0x559f711e9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:07.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa31d457640 1 --2- 172.21.15.59:0/1114362360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711d8800 0x559f711e9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa31d457640 1 -- 172.21.15.59:0/1114362360 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f711ea0a0 con 0x559f711e4790 2024-09-10T21:20:07.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa31d457640 1 --2- 172.21.15.59:0/1114362360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 0x559f711e9870 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa3100abdd0 tx=0x7fa310005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a918b9cc083bd39c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:07.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa2f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:07.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.064+0000 7fa2f7fff640 1 -- 172.21.15.59:0/1114362360 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31001f070 con 0x559f711e4790 2024-09-10T21:20:07.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.065+0000 7fa32128f740 1 -- 172.21.15.59:0/1114362360 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3140047a0 con 0x559f711e4790 2024-09-10T21:20:07.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.065+0000 7fa2f7fff640 1 -- 172.21.15.59:0/1114362360 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fa3100973d0 con 0x559f711e4790 2024-09-10T21:20:07.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.065+0000 7fa2f7fff640 1 -- 172.21.15.59:0/1114362360 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa3100abea0 con 0x559f711e4790 2024-09-10T21:20:07.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.065+0000 7fa32128f740 10 client.16656 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:07.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.065+0000 7fa32128f740 1 -- 172.21.15.59:0/1114362360 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559f712625a0 con 0x559f711e4790 2024-09-10T21:20:07.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.065+0000 7fa2f7fff640 1 -- 172.21.15.59:0/1114362360 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3140047a0 con 0x559f711e4790 2024-09-10T21:20:07.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.065+0000 7fa2f7fff640 1 -- 172.21.15.59:0/1114362360 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa3100b1c90 con 0x559f711e4790 2024-09-10T21:20:07.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.065+0000 7fa32128f740 10 client.16656 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:07.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.065+0000 7fa32128f740 10 client.16656 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:20:07.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.065+0000 7fa32128f740 20 client.16656 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:07.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.065+0000 7fa32128f740 1 --2- 172.21.15.59:0/1114362360 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559f71262a80 0x559f71264e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:07.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.065+0000 7fa32128f740 4 client.16656 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:20:07.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.065+0000 7fa32128f740 1 -- 172.21.15.59:0/1114362360 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559f7114c860 con 0x559f71262a80 2024-09-10T21:20:07.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.065+0000 7fa31cc56640 1 --2- 172.21.15.59:0/1114362360 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559f71262a80 0x559f71264e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:07.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.066+0000 7fa31cc56640 1 --2- 172.21.15.59:0/1114362360 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559f71262a80 0x559f71264e70 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=183690c0ebd8f547 server_cookie=e06d9ec9f7f4bb16 in_seq=0 out_seq=0 2024-09-10T21:20:07.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.066+0000 7fa2f7fff640 10 client.16656 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:07.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.067+0000 7fa2f7fff640 1 -- 172.21.15.59:0/1114362360 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559f7114c860 con 0x559f71262a80 2024-09-10T21:20:07.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.067+0000 7fa2f7fff640 10 client.16656 handle_command_reply: tid=0 2024-09-10T21:20:07.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.067+0000 7fa32128f740 1 client.16656 shutdown 2024-09-10T21:20:07.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.068+0000 7fa32128f740 1 -- 172.21.15.59:0/1114362360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 msgr2=0x559f711e9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:07.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.068+0000 7fa32128f740 1 --2- 172.21.15.59:0/1114362360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 0x559f711e9870 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa3100abdd0 tx=0x7fa310005690 comp rx=0 tx=0).stop 2024-09-10T21:20:07.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.068+0000 7fa32128f740 1 -- 172.21.15.59:0/1114362360 shutdown_connections 2024-09-10T21:20:07.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.068+0000 7fa32128f740 1 --2- 172.21.15.59:0/1114362360 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559f71262a80 0x559f71264e70 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.068+0000 7fa32128f740 1 --2- 172.21.15.59:0/1114362360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559f711e4790 0x559f711e9870 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.068+0000 7fa32128f740 1 --2- 172.21.15.59:0/1114362360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559f711d8800 0x559f711e9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.068+0000 7fa2f7fff640 0 client.16656 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:07.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.068+0000 7fa32128f740 1 --2- 172.21.15.59:0/1114362360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559f711d7ee0 0x559f711ece50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.068+0000 7fa32128f740 1 -- 172.21.15.59:0/1114362360 >> 172.21.15.59:0/1114362360 conn(0x559f711d5d10 msgr2=0x559f711e35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:07.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.068+0000 7fa32128f740 1 -- 172.21.15.59:0/1114362360 shutdown_connections 2024-09-10T21:20:07.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.068+0000 7fa32128f740 1 -- 172.21.15.59:0/1114362360 wait complete. 2024-09-10T21:20:07.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.068+0000 7fa32128f740 20 client.16656 trim_cache size 0 max 16384 2024-09-10T21:20:07.076 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:20:07.077 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:20:07.077 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "508715bf-5f30-4951-ac58-28c6e503af11", 2024-09-10T21:20:07.077 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:20:07.077 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:20:07.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.069+0000 7fa31eeba640 1 -- 172.21.15.59:0/519848497 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa3000b5360 msgr2=0x7fa3000b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:07.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.069+0000 7fa31eeba640 1 --2- 172.21.15.59:0/519848497 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa3000b5360 0x7fa3000b7820 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x559f711db060 tx=0x7fa31400b390 comp rx=0 tx=0).stop 2024-09-10T21:20:07.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.069+0000 7fa31eeba640 1 -- 172.21.15.59:0/519848497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa318109160 msgr2=0x7fa3181a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:07.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.069+0000 7fa31eeba640 1 --2- 172.21.15.59:0/519848497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa318109160 0x7fa3181a0d90 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fa31000e940 tx=0x7fa31000ee00 comp rx=0 tx=0).stop 2024-09-10T21:20:07.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.069+0000 7fa31eeba640 1 -- 172.21.15.59:0/519848497 shutdown_connections 2024-09-10T21:20:07.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.069+0000 7fa31eeba640 1 --2- 172.21.15.59:0/519848497 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fa3000b5360 0x7fa3000b7820 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.069+0000 7fa31eeba640 1 --2- 172.21.15.59:0/519848497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa318109160 0x7fa3181a0d90 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.069+0000 7fa31eeba640 1 --2- 172.21.15.59:0/519848497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3181087e0 0x7fa31819b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.069+0000 7fa31eeba640 1 --2- 172.21.15.59:0/519848497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa318102dd0 0x7fa31819b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:07.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.069+0000 7fa31eeba640 1 -- 172.21.15.59:0/519848497 >> 172.21.15.59:0/519848497 conn(0x7fa3180fe860 msgr2=0x7fa318075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:07.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.069+0000 7fa31eeba640 1 -- 172.21.15.59:0/519848497 shutdown_connections 2024-09-10T21:20:07.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:07.069+0000 7fa31eeba640 1 -- 172.21.15.59:0/519848497 wait complete. 2024-09-10T21:20:07.875 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:20:08.136 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:20:08.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:08 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:20:08.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:08 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:20:08.514 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:08 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:20:08.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:08 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:20:08.515 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:08 smithi059 ceph-mon[30888]: pgmap v486: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:20:08.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.596+0000 7f64caf3c640 1 -- 172.21.15.59:0/1418290827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c41087d0 msgr2=0x7f64c4108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:08.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.596+0000 7f64caf3c640 1 --2- 172.21.15.59:0/1418290827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c41087d0 0x7f64c4108c10 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f64b0009900 tx=0x7f64b002a410 comp rx=0 tx=0).stop 2024-09-10T21:20:08.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.596+0000 7f64caf3c640 1 -- 172.21.15.59:0/1418290827 shutdown_connections 2024-09-10T21:20:08.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.596+0000 7f64caf3c640 1 --2- 172.21.15.59:0/1418290827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64c4109150 0x7f64c410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.596+0000 7f64caf3c640 1 --2- 172.21.15.59:0/1418290827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c41087d0 0x7f64c4108c10 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.596+0000 7f64caf3c640 1 --2- 172.21.15.59:0/1418290827 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64c4102dc0 0x7f64c41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.596+0000 7f64caf3c640 1 -- 172.21.15.59:0/1418290827 >> 172.21.15.59:0/1418290827 conn(0x7f64c40fe830 msgr2=0x7f64c4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:08.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.596+0000 7f64caf3c640 1 -- 172.21.15.59:0/1418290827 shutdown_connections 2024-09-10T21:20:08.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.596+0000 7f64caf3c640 1 -- 172.21.15.59:0/1418290827 wait complete. 2024-09-10T21:20:08.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.597+0000 7f64caf3c640 1 Processor -- start 2024-09-10T21:20:08.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.597+0000 7f64caf3c640 1 -- start start 2024-09-10T21:20:08.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.597+0000 7f64caf3c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64c4102dc0 0x7f64c41991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:08.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.597+0000 7f64caf3c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64c41087d0 0x7f64c4199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:08.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.597+0000 7f64caf3c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c4109150 0x7f64c419ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:08.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.597+0000 7f64caf3c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f64c4112da0 con 0x7f64c4109150 2024-09-10T21:20:08.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.597+0000 7f64caf3c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f64c4112c20 con 0x7f64c41087d0 2024-09-10T21:20:08.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.597+0000 7f64caf3c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f64c4112f20 con 0x7f64c4102dc0 2024-09-10T21:20:08.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.597+0000 7f64c94d9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c4109150 0x7f64c419ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:08.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.597+0000 7f64c94d9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c4109150 0x7f64c419ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50250/0 (socket says 172.21.15.59:50250) 2024-09-10T21:20:08.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.597+0000 7f64c94d9640 1 -- 172.21.15.59:0/1601039060 learned_addr learned my addr 172.21.15.59:0/1601039060 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:08.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.597+0000 7f64c8cd8640 1 --2- 172.21.15.59:0/1601039060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64c4102dc0 0x7f64c41991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:08.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.598+0000 7f64c3fff640 1 --2- 172.21.15.59:0/1601039060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64c41087d0 0x7f64c4199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:08.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.598+0000 7f64c94d9640 1 -- 172.21.15.59:0/1601039060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64c4102dc0 msgr2=0x7f64c41991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.598+0000 7f64c94d9640 1 --2- 172.21.15.59:0/1601039060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64c4102dc0 0x7f64c41991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.598+0000 7f64c94d9640 1 -- 172.21.15.59:0/1601039060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64c41087d0 msgr2=0x7f64c4199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.598+0000 7f64c94d9640 1 --2- 172.21.15.59:0/1601039060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64c41087d0 0x7f64c4199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.598+0000 7f64c94d9640 1 -- 172.21.15.59:0/1601039060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c419f2a0 con 0x7f64c4109150 2024-09-10T21:20:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.598+0000 7f64c94d9640 1 --2- 172.21.15.59:0/1601039060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c4109150 0x7f64c419ead0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00eaa0 tx=0x7f64bc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.598+0000 7f64c1ffb640 1 -- 172.21.15.59:0/1601039060 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64bc004d20 con 0x7f64c4109150 2024-09-10T21:20:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.598+0000 7f64c1ffb640 1 -- 172.21.15.59:0/1601039060 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64bc005020 con 0x7f64c4109150 2024-09-10T21:20:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.598+0000 7f64caf3c640 1 -- 172.21.15.59:0/1601039060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c419f590 con 0x7f64c4109150 2024-09-10T21:20:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.598+0000 7f64c1ffb640 1 -- 172.21.15.59:0/1601039060 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64bc0116b0 con 0x7f64c4109150 2024-09-10T21:20:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.598+0000 7f64caf3c640 1 -- 172.21.15.59:0/1601039060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c41a5c50 con 0x7f64c4109150 2024-09-10T21:20:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.601+0000 7f64c1ffb640 1 -- 172.21.15.59:0/1601039060 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f64bc00f040 con 0x7f64c4109150 2024-09-10T21:20:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.601+0000 7f64cd311740 1 Processor -- start 2024-09-10T21:20:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.601+0000 7f64cd311740 1 -- start start 2024-09-10T21:20:08.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.601+0000 7f64cd311740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c10930a0 0x55d2c1093480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:08.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.601+0000 7f64cd311740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10939c0 0x55d2c109f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:08.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.601+0000 7f64cd311740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2c109f950 0x55d2c10a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:08.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.601+0000 7f64cd311740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d2c1009e50 con 0x55d2c10930a0 2024-09-10T21:20:08.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.601+0000 7f64cd311740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d2c0ff9280 con 0x55d2c109f950 2024-09-10T21:20:08.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.601+0000 7f64cd311740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d2c0ffd090 con 0x55d2c10939c0 2024-09-10T21:20:08.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.601+0000 7f64c3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c10930a0 0x55d2c1093480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:08.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.601+0000 7f64c3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c10930a0 0x55d2c1093480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50252/0 (socket says 172.21.15.59:50252) 2024-09-10T21:20:08.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.601+0000 7f64c3fff640 1 -- 172.21.15.59:0/3261633987 learned_addr learned my addr 172.21.15.59:0/3261633987 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:08.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.602+0000 7f64c8cd8640 1 --2- 172.21.15.59:0/3261633987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10939c0 0x55d2c109f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:08.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.602+0000 7f64c3fff640 1 --2- 172.21.15.59:0/3261633987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2c109f950 0x55d2c10a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:08.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.602+0000 7f64c1ffb640 1 --2- 172.21.15.59:0/1601039060 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f64b40b52e0 0x7f64b40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:08.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.602+0000 7f64c3fff640 1 -- 172.21.15.59:0/3261633987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10939c0 msgr2=0x55d2c109f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.602+0000 7f64c3fff640 1 --2- 172.21.15.59:0/3261633987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10939c0 0x55d2c109f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.602+0000 7f64c3fff640 1 -- 172.21.15.59:0/3261633987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2c109f950 msgr2=0x55d2c10a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.602+0000 7f64c3fff640 1 --2- 172.21.15.59:0/3261633987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2c109f950 0x55d2c10a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.602+0000 7f64c3fff640 1 -- 172.21.15.59:0/3261633987 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2c0d57650 con 0x55d2c10930a0 2024-09-10T21:20:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.602+0000 7f64c94d9640 1 --2- 172.21.15.59:0/1601039060 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f64b40b52e0 0x7f64b40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.602+0000 7f64c1ffb640 1 -- 172.21.15.59:0/1601039060 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f64bc0e5b20 con 0x7f64c4109150 2024-09-10T21:20:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.602+0000 7f64c3fff640 1 --2- 172.21.15.59:0/3261633987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c10930a0 0x55d2c1093480 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f64b0005940 tx=0x7f64b00058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d600b5803ac08a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.602+0000 7f64aeffd640 1 -- 172.21.15.59:0/3261633987 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b0035050 con 0x55d2c10930a0 2024-09-10T21:20:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.602+0000 7f64aeffd640 1 -- 172.21.15.59:0/3261633987 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64b00316f0 con 0x55d2c10930a0 2024-09-10T21:20:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.602+0000 7f64aeffd640 1 -- 172.21.15.59:0/3261633987 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b00046c0 con 0x55d2c10930a0 2024-09-10T21:20:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.603+0000 7f64cd311740 1 -- 172.21.15.59:0/3261633987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c10930a0 msgr2=0x55d2c1093480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.603+0000 7f64c94d9640 1 --2- 172.21.15.59:0/1601039060 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f64b40b52e0 0x7f64b40b77a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00efd0 tx=0x7f64bc076380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.603+0000 7f64cd311740 1 --2- 172.21.15.59:0/3261633987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c10930a0 0x55d2c1093480 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f64b0005940 tx=0x7f64b00058b0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.603+0000 7f64cd311740 1 -- 172.21.15.59:0/3261633987 shutdown_connections 2024-09-10T21:20:08.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.603+0000 7f64cd311740 1 --2- 172.21.15.59:0/3261633987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2c109f950 0x55d2c10a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.603+0000 7f64cd311740 1 --2- 172.21.15.59:0/3261633987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10939c0 0x55d2c109f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.603+0000 7f64cd311740 1 --2- 172.21.15.59:0/3261633987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c10930a0 0x55d2c1093480 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.603+0000 7f64cd311740 1 -- 172.21.15.59:0/3261633987 >> 172.21.15.59:0/3261633987 conn(0x55d2c1090ed0 msgr2=0x55d2c1092070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:08.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.603+0000 7f64cd311740 1 -- 172.21.15.59:0/3261633987 shutdown_connections 2024-09-10T21:20:08.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.603+0000 7f64cd311740 1 -- 172.21.15.59:0/3261633987 wait complete. 2024-09-10T21:20:08.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.603+0000 7f64cd311740 1 -- start start 2024-09-10T21:20:08.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.604+0000 7f64cd311740 1 Processor -- start 2024-09-10T21:20:08.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.604+0000 7f64cd311740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c10930a0 0x55d2c109f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:08.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.604+0000 7f64cd311740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10939c0 0x55d2c109c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:08.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.604+0000 7f64cd311740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2c109f950 0x55d2c109cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:08.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.604+0000 7f64cd311740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d2c0e5a700 con 0x55d2c10930a0 2024-09-10T21:20:08.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.604+0000 7f64cd311740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d2c0f94110 con 0x55d2c109f950 2024-09-10T21:20:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.604+0000 7f64cd311740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d2c10a2570 con 0x55d2c10939c0 2024-09-10T21:20:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.604+0000 7f64cd311740 10 client.0 _ll_register_callbacks cb 0x55d2c0fad990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.604+0000 7f64c3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c10930a0 0x55d2c109f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.604+0000 7f64c3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c10930a0 0x55d2c109f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50260/0 (socket says 172.21.15.59:50260) 2024-09-10T21:20:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.604+0000 7f64c3fff640 1 -- 172.21.15.59:0/634207722 learned_addr learned my addr 172.21.15.59:0/634207722 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.604+0000 7f64c8cd8640 1 --2- 172.21.15.59:0/634207722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10939c0 0x55d2c109c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.604+0000 7f64c3fff640 1 -- 172.21.15.59:0/634207722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10939c0 msgr2=0x55d2c109c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.604+0000 7f64c3fff640 1 --2- 172.21.15.59:0/634207722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10939c0 0x55d2c109c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.605+0000 7f64c3fff640 1 -- 172.21.15.59:0/634207722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2c109f950 msgr2=0x55d2c109cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.605+0000 7f64c3fff640 1 --2- 172.21.15.59:0/634207722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2c109f950 0x55d2c109cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.605+0000 7f64c3fff640 1 -- 172.21.15.59:0/634207722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2c0fc1c40 con 0x55d2c10930a0 2024-09-10T21:20:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.605+0000 7f64c8cd8640 1 --2- 172.21.15.59:0/634207722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10939c0 0x55d2c109c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:20:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.605+0000 7f64c3fff640 1 --2- 172.21.15.59:0/634207722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c10930a0 0x55d2c109f260 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f64b00092a0 tx=0x7f64b0032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d513f6f0cf4d1a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.605+0000 7f64a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:08.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.605+0000 7f64a3fff640 1 -- 172.21.15.59:0/634207722 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b004c020 con 0x55d2c10930a0 2024-09-10T21:20:08.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.605+0000 7f64a3fff640 1 -- 172.21.15.59:0/634207722 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f64b0004350 con 0x55d2c10930a0 2024-09-10T21:20:08.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.605+0000 7f64cd311740 1 -- 172.21.15.59:0/634207722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64b00316f0 con 0x55d2c10930a0 2024-09-10T21:20:08.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.605+0000 7f64a3fff640 1 -- 172.21.15.59:0/634207722 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f64b0035040 con 0x55d2c10930a0 2024-09-10T21:20:08.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.605+0000 7f64cd311740 10 client.16668 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:08.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.605+0000 7f64cd311740 1 -- 172.21.15.59:0/634207722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d2c10aded0 con 0x55d2c10930a0 2024-09-10T21:20:08.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.605+0000 7f64a3fff640 1 -- 172.21.15.59:0/634207722 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64b00316f0 con 0x55d2c10930a0 2024-09-10T21:20:08.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.606+0000 7f64a3fff640 1 -- 172.21.15.59:0/634207722 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f64b003a720 con 0x55d2c10930a0 2024-09-10T21:20:08.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.606+0000 7f64cd311740 10 client.16668 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:08.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.606+0000 7f64cd311740 10 client.16668 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:20:08.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.606+0000 7f64cd311740 20 client.16668 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:08.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.606+0000 7f64cd311740 1 --2- 172.21.15.59:0/634207722 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d2c10af220 0x55d2c10b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:08.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.606+0000 7f64cd311740 4 client.16668 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:20:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.606+0000 7f64cd311740 1 -- 172.21.15.59:0/634207722 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2c100bda0 con 0x55d2c10af220 2024-09-10T21:20:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.606+0000 7f64c8cd8640 1 --2- 172.21.15.59:0/634207722 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d2c10af220 0x55d2c10b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.606+0000 7f64c8cd8640 1 --2- 172.21.15.59:0/634207722 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d2c10af220 0x55d2c10b1610 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7727defbd8a3f05 server_cookie=f32bf454c8bfeb24 in_seq=0 out_seq=0 2024-09-10T21:20:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.606+0000 7f64a3fff640 10 client.16668 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.607+0000 7f64a3fff640 1 -- 172.21.15.59:0/634207722 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d2c100bda0 con 0x55d2c10af220 2024-09-10T21:20:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.607+0000 7f64a3fff640 10 client.16668 handle_command_reply: tid=0 2024-09-10T21:20:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.607+0000 7f64cd311740 1 client.16668 shutdown 2024-09-10T21:20:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.607+0000 7f64cd311740 1 -- 172.21.15.59:0/634207722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c10930a0 msgr2=0x55d2c109f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.607+0000 7f64cd311740 1 --2- 172.21.15.59:0/634207722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c10930a0 0x55d2c109f260 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f64b00092a0 tx=0x7f64b0032e10 comp rx=0 tx=0).stop 2024-09-10T21:20:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.607+0000 7f64cd311740 1 -- 172.21.15.59:0/634207722 shutdown_connections 2024-09-10T21:20:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.607+0000 7f64cd311740 1 --2- 172.21.15.59:0/634207722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2c109f950 0x55d2c109cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.607+0000 7f64cd311740 1 --2- 172.21.15.59:0/634207722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10939c0 0x55d2c109c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.607+0000 7f64cd311740 1 --2- 172.21.15.59:0/634207722 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d2c10af220 0x55d2c10b1610 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.607+0000 7f64cd311740 1 --2- 172.21.15.59:0/634207722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c10930a0 0x55d2c109f260 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.607+0000 7f64a3fff640 0 client.16668 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:08.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.607+0000 7f64cd311740 1 -- 172.21.15.59:0/634207722 >> 172.21.15.59:0/634207722 conn(0x55d2c1090ed0 msgr2=0x55d2c1096a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:08.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.608+0000 7f64cd311740 1 -- 172.21.15.59:0/634207722 shutdown_connections 2024-09-10T21:20:08.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.608+0000 7f64cd311740 1 -- 172.21.15.59:0/634207722 wait complete. 2024-09-10T21:20:08.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.608+0000 7f64cd311740 20 client.16668 trim_cache size 0 max 16384 2024-09-10T21:20:08.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.625+0000 7f64cd311740 1 Processor -- start 2024-09-10T21:20:08.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.625+0000 7f64cd311740 1 -- start start 2024-09-10T21:20:08.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.626+0000 7f64cd311740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10930a0 0x55d2c10ab810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:08.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.626+0000 7f64cd311740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2c10939c0 0x55d2c109e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:08.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.626+0000 7f64cd311740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c109f950 0x55d2c10a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:08.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.626+0000 7f64cd311740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f64c41ae190 con 0x55d2c109f950 2024-09-10T21:20:08.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.626+0000 7f64cd311740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f64c41afcd0 con 0x55d2c10939c0 2024-09-10T21:20:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.626+0000 7f64cd311740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f64c41ae860 con 0x55d2c10930a0 2024-09-10T21:20:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.626+0000 7f64c3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c109f950 0x55d2c10a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.626+0000 7f64c3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c109f950 0x55d2c10a0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50270/0 (socket says 172.21.15.59:50270) 2024-09-10T21:20:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.626+0000 7f64c3fff640 1 -- 172.21.15.59:0/1996881793 learned_addr learned my addr 172.21.15.59:0/1996881793 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.626+0000 7f64c3fff640 1 --2- 172.21.15.59:0/1996881793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10930a0 0x55d2c10ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.626+0000 7f64c8cd8640 1 --2- 172.21.15.59:0/1996881793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2c10939c0 0x55d2c109e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.626+0000 7f64c3fff640 1 -- 172.21.15.59:0/1996881793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10930a0 msgr2=0x55d2c10ab810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.626+0000 7f64c3fff640 1 --2- 172.21.15.59:0/1996881793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10930a0 0x55d2c10ab810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.626+0000 7f64c3fff640 1 -- 172.21.15.59:0/1996881793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2c10939c0 msgr2=0x55d2c109e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.626+0000 7f64c3fff640 1 --2- 172.21.15.59:0/1996881793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2c10939c0 0x55d2c109e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.626+0000 7f64c3fff640 1 -- 172.21.15.59:0/1996881793 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2c1091bb0 con 0x55d2c109f950 2024-09-10T21:20:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.626+0000 7f64c8cd8640 1 --2- 172.21.15.59:0/1996881793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2c10939c0 0x55d2c109e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.626+0000 7f64c3fff640 1 --2- 172.21.15.59:0/1996881793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c109f950 0x55d2c10a0d40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f64b0055040 tx=0x7f64b0031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1920d4141003e535 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.626+0000 7f64ae7fc640 1 -- 172.21.15.59:0/1996881793 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b004c020 con 0x55d2c109f950 2024-09-10T21:20:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.627+0000 7f64ae7fc640 1 -- 172.21.15.59:0/1996881793 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64b003a930 con 0x55d2c109f950 2024-09-10T21:20:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.627+0000 7f64ae7fc640 1 -- 172.21.15.59:0/1996881793 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b003d8c0 con 0x55d2c109f950 2024-09-10T21:20:08.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.627+0000 7f64cd311740 1 -- 172.21.15.59:0/1996881793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c109f950 msgr2=0x55d2c10a0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:08.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.627+0000 7f64cd311740 1 --2- 172.21.15.59:0/1996881793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c109f950 0x55d2c10a0d40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f64b0055040 tx=0x7f64b0031400 comp rx=0 tx=0).stop 2024-09-10T21:20:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.627+0000 7f64cd311740 1 -- 172.21.15.59:0/1996881793 shutdown_connections 2024-09-10T21:20:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.627+0000 7f64cd311740 1 --2- 172.21.15.59:0/1996881793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c109f950 0x55d2c10a0d40 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.627+0000 7f64cd311740 1 --2- 172.21.15.59:0/1996881793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2c10939c0 0x55d2c109e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.627+0000 7f64cd311740 1 --2- 172.21.15.59:0/1996881793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10930a0 0x55d2c10ab810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.627+0000 7f64cd311740 1 -- 172.21.15.59:0/1996881793 >> 172.21.15.59:0/1996881793 conn(0x55d2c1090ed0 msgr2=0x55d2c109dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.627+0000 7f64cd311740 1 -- 172.21.15.59:0/1996881793 shutdown_connections 2024-09-10T21:20:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.627+0000 7f64cd311740 1 -- 172.21.15.59:0/1996881793 wait complete. 2024-09-10T21:20:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.627+0000 7f64cd311740 1 -- start start 2024-09-10T21:20:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.628+0000 7f64cd311740 1 Processor -- start 2024-09-10T21:20:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.628+0000 7f64cd311740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2c10930a0 0x55d2c10b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.628+0000 7f64cd311740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10939c0 0x55d2c10b1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.628+0000 7f64cd311740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c109f950 0x55d2c111ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:08.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.628+0000 7f64cd311740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f64c41af600 con 0x55d2c109f950 2024-09-10T21:20:08.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.628+0000 7f64cd311740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f64c41aef30 con 0x55d2c10930a0 2024-09-10T21:20:08.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.628+0000 7f64cd311740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f64c41ac170 con 0x55d2c10939c0 2024-09-10T21:20:08.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.628+0000 7f64cd311740 10 client.0 _ll_register_callbacks cb 0x7f64b800a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:08.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.628+0000 7f64c3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c109f950 0x55d2c111ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:08.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.628+0000 7f64c3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c109f950 0x55d2c111ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50282/0 (socket says 172.21.15.59:50282) 2024-09-10T21:20:08.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.628+0000 7f64c3fff640 1 -- 172.21.15.59:0/2734824950 learned_addr learned my addr 172.21.15.59:0/2734824950 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:08.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.628+0000 7f64c3fff640 1 -- 172.21.15.59:0/2734824950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10939c0 msgr2=0x55d2c10b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:08.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.628+0000 7f64c3fff640 1 --2- 172.21.15.59:0/2734824950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10939c0 0x55d2c10b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.628+0000 7f64c3fff640 1 -- 172.21.15.59:0/2734824950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2c10930a0 msgr2=0x55d2c10b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:08.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.628+0000 7f64c3fff640 1 --2- 172.21.15.59:0/2734824950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2c10930a0 0x55d2c10b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.628+0000 7f64c3fff640 1 -- 172.21.15.59:0/2734824950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2c111b2c0 con 0x55d2c109f950 2024-09-10T21:20:08.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.629+0000 7f64c3fff640 1 --2- 172.21.15.59:0/2734824950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c109f950 0x55d2c111ad80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f64b003ac40 tx=0x7f64b0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523aabe2caec3390 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:08.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.629+0000 7f64a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:08.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.629+0000 7f64a3fff640 1 -- 172.21.15.59:0/2734824950 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64b004c070 con 0x55d2c109f950 2024-09-10T21:20:08.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.629+0000 7f64a3fff640 1 -- 172.21.15.59:0/2734824950 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f64b003a540 con 0x55d2c109f950 2024-09-10T21:20:08.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.629+0000 7f64cd311740 1 -- 172.21.15.59:0/2734824950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64b003a930 con 0x55d2c109f950 2024-09-10T21:20:08.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.629+0000 7f64a3fff640 1 -- 172.21.15.59:0/2734824950 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f64b003a740 con 0x55d2c109f950 2024-09-10T21:20:08.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.629+0000 7f64cd311740 10 client.16674 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:08.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.629+0000 7f64cd311740 1 -- 172.21.15.59:0/2734824950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d2c111c5d0 con 0x55d2c109f950 2024-09-10T21:20:08.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.629+0000 7f64a3fff640 1 -- 172.21.15.59:0/2734824950 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64b003a930 con 0x55d2c109f950 2024-09-10T21:20:08.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.629+0000 7f64a3fff640 1 -- 172.21.15.59:0/2734824950 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f64b0003710 con 0x55d2c109f950 2024-09-10T21:20:08.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.629+0000 7f64cd311740 10 client.16674 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:08.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.629+0000 7f64cd311740 10 client.16674 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:20:08.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.629+0000 7f64cd311740 20 client.16674 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:08.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.629+0000 7f64cd311740 1 --2- 172.21.15.59:0/2734824950 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d2c111ca90 0x55d2c111ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:08.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.629+0000 7f64cd311740 4 client.16674 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:20:08.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.629+0000 7f64cd311740 1 -- 172.21.15.59:0/2734824950 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d2c1007850 con 0x55d2c111ca90 2024-09-10T21:20:08.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.631+0000 7f64c8cd8640 1 --2- 172.21.15.59:0/2734824950 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d2c111ca90 0x55d2c111ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.632+0000 7f64a3fff640 10 client.16674 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.632+0000 7f64c8cd8640 1 --2- 172.21.15.59:0/2734824950 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d2c111ca90 0x55d2c111ee80 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f123b470f9b7d2a server_cookie=fcde572adee408f2 in_seq=0 out_seq=0 2024-09-10T21:20:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.633+0000 7f64a3fff640 1 -- 172.21.15.59:0/2734824950 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x55d2c1007850 con 0x55d2c111ca90 2024-09-10T21:20:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.633+0000 7f64a3fff640 10 client.16674 handle_command_reply: tid=0 2024-09-10T21:20:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.633+0000 7f64cd311740 1 client.16674 shutdown 2024-09-10T21:20:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.633+0000 7f64cd311740 1 -- 172.21.15.59:0/2734824950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c109f950 msgr2=0x55d2c111ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.633+0000 7f64cd311740 1 --2- 172.21.15.59:0/2734824950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c109f950 0x55d2c111ad80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f64b003ac40 tx=0x7f64b0009780 comp rx=0 tx=0).stop 2024-09-10T21:20:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.633+0000 7f64cd311740 1 -- 172.21.15.59:0/2734824950 shutdown_connections 2024-09-10T21:20:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.633+0000 7f64cd311740 1 --2- 172.21.15.59:0/2734824950 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d2c111ca90 0x55d2c111ee80 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.633+0000 7f64cd311740 1 --2- 172.21.15.59:0/2734824950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c109f950 0x55d2c111ad80 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.633+0000 7f64cd311740 1 --2- 172.21.15.59:0/2734824950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2c10939c0 0x55d2c10b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.633+0000 7f64a3fff640 0 client.16674 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.633+0000 7f64cd311740 1 --2- 172.21.15.59:0/2734824950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2c10930a0 0x55d2c10b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.633+0000 7f64cd311740 1 -- 172.21.15.59:0/2734824950 >> 172.21.15.59:0/2734824950 conn(0x55d2c1090ed0 msgr2=0x55d2c109e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.633+0000 7f64cd311740 1 -- 172.21.15.59:0/2734824950 shutdown_connections 2024-09-10T21:20:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.633+0000 7f64cd311740 1 -- 172.21.15.59:0/2734824950 wait complete. 2024-09-10T21:20:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.633+0000 7f64cd311740 20 client.16674 trim_cache size 0 max 16384 2024-09-10T21:20:08.640 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:20:08.640 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:20:08.640 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-09-10T21:20:08.640 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:20:08.641 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:08.641 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "508715bf-5f30-4951-ac58-28c6e503af11", 2024-09-10T21:20:08.641 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2024-09-10T21:20:08.641 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:20:08.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:08.641 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:20:08.641 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:20:08.641 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:20:08.641 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:08.641 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:08.641 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:08.641 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:08.641 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:08.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:08.642 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:20:08.642 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:20:08.642 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:08.642 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:08.642 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:08.642 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:08.642 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:08.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:08.642 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:20:08.642 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:20:08.642 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:08.642 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:08.642 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:08.643 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:08.643 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:08.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:08.643 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:20:08.643 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:20:08.643 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:08.643 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:08.643 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:08.643 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:08.643 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:08.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:08.643 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:20:08.643 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:07.066301+0000", 2024-09-10T21:20:08.643 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:08.644 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:08.644 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:08.644 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:08.644 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:08.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:08.644 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:20:08.644 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:20:08.644 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:08.644 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:08.644 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:08.644 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:08.644 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:08.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:08.645 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:20:08.645 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:20:08.645 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:08.645 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:08.645 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:08.645 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:08.645 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:08.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:08.645 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:20:08.645 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:20:08.645 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:08.645 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:08.645 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:08.645 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:08.646 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:08.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:08.646 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:20:08.646 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:20:08.646 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:08.646 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:08.646 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:08.646 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:08.646 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:08.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:08.646 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:20:08.646 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:20:08.646 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:08.646 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:08.647 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:08.647 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:08.647 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:08.647 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:20:08.647 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:20:08.647 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:20:08.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.634+0000 7f64caf3c640 1 -- 172.21.15.59:0/1601039060 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f64b40b52e0 msgr2=0x7f64b40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:08.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.634+0000 7f64caf3c640 1 --2- 172.21.15.59:0/1601039060 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f64b40b52e0 0x7f64b40b77a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00efd0 tx=0x7f64bc076380 comp rx=0 tx=0).stop 2024-09-10T21:20:08.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.634+0000 7f64caf3c640 1 -- 172.21.15.59:0/1601039060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c4109150 msgr2=0x7f64c419ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:08.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.634+0000 7f64caf3c640 1 --2- 172.21.15.59:0/1601039060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c4109150 0x7f64c419ead0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00eaa0 tx=0x7f64bc00eea0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.634+0000 7f64caf3c640 1 -- 172.21.15.59:0/1601039060 shutdown_connections 2024-09-10T21:20:08.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.634+0000 7f64caf3c640 1 --2- 172.21.15.59:0/1601039060 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f64b40b52e0 0x7f64b40b77a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.634+0000 7f64caf3c640 1 --2- 172.21.15.59:0/1601039060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c4109150 0x7f64c419ead0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.634+0000 7f64caf3c640 1 --2- 172.21.15.59:0/1601039060 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f64c41087d0 0x7f64c4199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.634+0000 7f64caf3c640 1 --2- 172.21.15.59:0/1601039060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64c4102dc0 0x7f64c41991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:08.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.634+0000 7f64caf3c640 1 -- 172.21.15.59:0/1601039060 >> 172.21.15.59:0/1601039060 conn(0x7f64c40fe830 msgr2=0x7f64c4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:08.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.634+0000 7f64caf3c640 1 -- 172.21.15.59:0/1601039060 shutdown_connections 2024-09-10T21:20:08.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:08.634+0000 7f64caf3c640 1 -- 172.21.15.59:0/1601039060 wait complete. 2024-09-10T21:20:08.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:08 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:20:08.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:08 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:20:08.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:08 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:20:08.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:08 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:20:08.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:08 smithi192 ceph-mon[35363]: pgmap v486: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:20:08.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:08 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:20:08.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:08 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:20:08.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:08 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:20:08.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:08 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:20:08.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:08 smithi154 ceph-mon[35041]: pgmap v486: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:20:09.475 INFO:tasks.cephfs.filesystem:scrub status for tag:508715bf-5f30-4951-ac58-28c6e503af11 - {'path': '/', 'tag': '508715bf-5f30-4951-ac58-28c6e503af11', 'options': 'recursive,force'} 2024-09-10T21:20:10.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:10 smithi192 ceph-mon[35363]: pgmap v487: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:10.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:10 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:20:10.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:10 smithi059 ceph-mon[30888]: pgmap v487: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:10.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:10 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:20:10.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:10 smithi154 ceph-mon[35041]: pgmap v487: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:10.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:10 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:20:12.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:12 smithi192 ceph-mon[35363]: pgmap v488: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:20:13.162 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:12 smithi154 ceph-mon[35041]: pgmap v488: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:20:13.163 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:12 smithi059 ceph-mon[30888]: pgmap v488: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:20:14.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:14 smithi192 ceph-mon[35363]: pgmap v489: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:14.858 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:14 smithi059 ceph-mon[30888]: pgmap v489: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:14.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:14 smithi154 ceph-mon[35041]: pgmap v489: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:16.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:16 smithi192 ceph-mon[35363]: pgmap v490: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:20:16.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:16 smithi059 ceph-mon[30888]: pgmap v490: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:20:16.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:16 smithi154 ceph-mon[35041]: pgmap v490: 97 pgs: 97 active+clean; 3.3 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:20:18.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:18 smithi192 ceph-mon[35363]: pgmap v491: 97 pgs: 97 active+clean; 3.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:20:18.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:18 smithi059 ceph-mon[30888]: pgmap v491: 97 pgs: 97 active+clean; 3.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:20:18.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:18 smithi154 ceph-mon[35041]: pgmap v491: 97 pgs: 97 active+clean; 3.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:20:20.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:20 smithi192 ceph-mon[35363]: pgmap v492: 97 pgs: 97 active+clean; 3.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:20.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:20 smithi059 ceph-mon[30888]: pgmap v492: 97 pgs: 97 active+clean; 3.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:20.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:20 smithi154 ceph-mon[35041]: pgmap v492: 97 pgs: 97 active+clean; 3.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:22.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:22 smithi192 ceph-mon[35363]: pgmap v493: 97 pgs: 97 active+clean; 3.5 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:20:22.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:22 smithi059 ceph-mon[30888]: pgmap v493: 97 pgs: 97 active+clean; 3.5 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:20:22.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:22 smithi154 ceph-mon[35041]: pgmap v493: 97 pgs: 97 active+clean; 3.5 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:20:24.734 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:24 smithi154 ceph-mon[35041]: pgmap v494: 97 pgs: 97 active+clean; 3.5 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:24.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:24 smithi192 ceph-mon[35363]: pgmap v494: 97 pgs: 97 active+clean; 3.5 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:24.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:24 smithi059 ceph-mon[30888]: pgmap v494: 97 pgs: 97 active+clean; 3.5 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:26.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:26 smithi192 ceph-mon[35363]: pgmap v495: 97 pgs: 97 active+clean; 3.5 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:20:26.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:26 smithi059 ceph-mon[30888]: pgmap v495: 97 pgs: 97 active+clean; 3.5 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:20:26.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:26 smithi154 ceph-mon[35041]: pgmap v495: 97 pgs: 97 active+clean; 3.5 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:20:27.400 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.400 INFO:tasks.workunit.client.0.smithi059.stdout:189/600: open fd = 3 2024-09-10T21:20:27.400 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.400 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.400 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.400 INFO:tasks.workunit.client.0.smithi059.stdout:190/600: open fd = 3 2024-09-10T21:20:27.400 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.400 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.400 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.401 INFO:tasks.workunit.client.0.smithi059.stdout:191/600: open fd = 3 2024-09-10T21:20:27.401 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.401 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.401 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.401 INFO:tasks.workunit.client.0.smithi059.stdout:192/600: open fd = 3 2024-09-10T21:20:27.401 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.401 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.401 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.401 INFO:tasks.workunit.client.0.smithi059.stdout:193/600: open fd = 3 2024-09-10T21:20:27.401 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.401 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.401 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.402 INFO:tasks.workunit.client.0.smithi059.stdout:194/600: open fd = 3 2024-09-10T21:20:27.402 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.402 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.402 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.402 INFO:tasks.workunit.client.0.smithi059.stdout:195/600: open fd = 3 2024-09-10T21:20:27.402 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.402 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.402 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.402 INFO:tasks.workunit.client.0.smithi059.stdout:196/600: open fd = 3 2024-09-10T21:20:27.402 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.402 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.402 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.402 INFO:tasks.workunit.client.0.smithi059.stdout:197/600: open fd = 3 2024-09-10T21:20:27.403 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.403 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.403 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.403 INFO:tasks.workunit.client.0.smithi059.stdout:198/600: open fd = 3 2024-09-10T21:20:27.403 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.403 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.403 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.403 INFO:tasks.workunit.client.0.smithi059.stdout:199/600: open fd = 3 2024-09-10T21:20:27.403 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.403 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.403 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.403 INFO:tasks.workunit.client.0.smithi059.stdout:200/600: open fd = 3 2024-09-10T21:20:27.403 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.403 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.403 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.404 INFO:tasks.workunit.client.0.smithi059.stdout:201/600: open fd = 3 2024-09-10T21:20:27.404 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.404 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.404 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.404 INFO:tasks.workunit.client.0.smithi059.stdout:202/600: open fd = 3 2024-09-10T21:20:27.404 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.404 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.404 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.404 INFO:tasks.workunit.client.0.smithi059.stdout:203/600: open fd = 3 2024-09-10T21:20:27.404 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.404 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.404 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.404 INFO:tasks.workunit.client.0.smithi059.stdout:204/600: open fd = 3 2024-09-10T21:20:27.404 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.405 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.405 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.405 INFO:tasks.workunit.client.0.smithi059.stdout:205/600: open fd = 3 2024-09-10T21:20:27.405 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.405 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.405 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.405 INFO:tasks.workunit.client.0.smithi059.stdout:206/600: open fd = 3 2024-09-10T21:20:27.405 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.405 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.405 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.405 INFO:tasks.workunit.client.0.smithi059.stdout:207/600: open fd = 3 2024-09-10T21:20:27.405 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.405 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.406 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.406 INFO:tasks.workunit.client.0.smithi059.stdout:208/600: open fd = 3 2024-09-10T21:20:27.406 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.406 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.406 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.406 INFO:tasks.workunit.client.0.smithi059.stdout:209/600: open fd = 3 2024-09-10T21:20:27.406 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.406 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.406 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.406 INFO:tasks.workunit.client.0.smithi059.stdout:210/600: open fd = 3 2024-09-10T21:20:27.406 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.406 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.406 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.407 INFO:tasks.workunit.client.0.smithi059.stdout:211/600: open fd = 3 2024-09-10T21:20:27.407 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.407 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.407 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.407 INFO:tasks.workunit.client.0.smithi059.stdout:212/600: open fd = 3 2024-09-10T21:20:27.407 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.407 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.407 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.407 INFO:tasks.workunit.client.0.smithi059.stdout:213/600: open fd = 3 2024-09-10T21:20:27.407 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.407 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.407 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.407 INFO:tasks.workunit.client.0.smithi059.stdout:214/600: open fd = 3 2024-09-10T21:20:27.408 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.408 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.408 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.408 INFO:tasks.workunit.client.0.smithi059.stdout:215/600: open fd = 3 2024-09-10T21:20:27.408 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.408 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.408 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.408 INFO:tasks.workunit.client.0.smithi059.stdout:216/600: open fd = 3 2024-09-10T21:20:27.408 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.408 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.408 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.408 INFO:tasks.workunit.client.0.smithi059.stdout:217/600: open fd = 3 2024-09-10T21:20:27.408 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.409 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.409 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.409 INFO:tasks.workunit.client.0.smithi059.stdout:218/600: open fd = 3 2024-09-10T21:20:27.409 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.409 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.409 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.409 INFO:tasks.workunit.client.0.smithi059.stdout:219/600: open fd = 3 2024-09-10T21:20:27.409 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.409 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.409 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.409 INFO:tasks.workunit.client.0.smithi059.stdout:220/600: open fd = 3 2024-09-10T21:20:27.409 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.409 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.410 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.410 INFO:tasks.workunit.client.0.smithi059.stdout:221/600: open fd = 3 2024-09-10T21:20:27.410 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.410 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.410 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.410 INFO:tasks.workunit.client.0.smithi059.stdout:222/600: open fd = 3 2024-09-10T21:20:27.410 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.410 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.410 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.410 INFO:tasks.workunit.client.0.smithi059.stdout:223/600: open fd = 3 2024-09-10T21:20:27.410 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.410 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.411 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.411 INFO:tasks.workunit.client.0.smithi059.stdout:224/600: open fd = 3 2024-09-10T21:20:27.411 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.411 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.411 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.411 INFO:tasks.workunit.client.0.smithi059.stdout:225/600: open fd = 3 2024-09-10T21:20:27.411 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.411 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.411 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.411 INFO:tasks.workunit.client.0.smithi059.stdout:226/600: open fd = 3 2024-09-10T21:20:27.411 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.411 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.411 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.411 INFO:tasks.workunit.client.0.smithi059.stdout:227/600: open fd = 3 2024-09-10T21:20:27.412 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.412 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.412 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.412 INFO:tasks.workunit.client.0.smithi059.stdout:228/600: open fd = 3 2024-09-10T21:20:27.412 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.412 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.412 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.412 INFO:tasks.workunit.client.0.smithi059.stdout:229/600: open fd = 3 2024-09-10T21:20:27.412 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.412 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.412 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.412 INFO:tasks.workunit.client.0.smithi059.stdout:230/600: open fd = 3 2024-09-10T21:20:27.412 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.412 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.413 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.413 INFO:tasks.workunit.client.0.smithi059.stdout:231/600: open fd = 3 2024-09-10T21:20:27.413 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.413 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.413 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.413 INFO:tasks.workunit.client.0.smithi059.stdout:232/600: open fd = 3 2024-09-10T21:20:27.413 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.413 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.413 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.413 INFO:tasks.workunit.client.0.smithi059.stdout:233/600: open fd = 3 2024-09-10T21:20:27.413 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.413 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.413 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.414 INFO:tasks.workunit.client.0.smithi059.stdout:234/600: open fd = 3 2024-09-10T21:20:27.414 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.414 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.414 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.414 INFO:tasks.workunit.client.0.smithi059.stdout:235/600: open fd = 3 2024-09-10T21:20:27.414 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.414 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.414 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.414 INFO:tasks.workunit.client.0.smithi059.stdout:236/600: open fd = 3 2024-09-10T21:20:27.414 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.414 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.414 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.414 INFO:tasks.workunit.client.0.smithi059.stdout:237/600: open fd = 3 2024-09-10T21:20:27.414 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.415 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.415 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.415 INFO:tasks.workunit.client.0.smithi059.stdout:238/600: open fd = 3 2024-09-10T21:20:27.415 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.415 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.415 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.415 INFO:tasks.workunit.client.0.smithi059.stdout:239/600: open fd = 3 2024-09-10T21:20:27.415 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.415 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.415 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.415 INFO:tasks.workunit.client.0.smithi059.stdout:240/600: open fd = 3 2024-09-10T21:20:27.415 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.415 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.416 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.416 INFO:tasks.workunit.client.0.smithi059.stdout:241/600: open fd = 3 2024-09-10T21:20:27.416 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.416 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.416 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.416 INFO:tasks.workunit.client.0.smithi059.stdout:242/600: open fd = 3 2024-09-10T21:20:27.416 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.416 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.416 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.416 INFO:tasks.workunit.client.0.smithi059.stdout:243/600: open fd = 3 2024-09-10T21:20:27.416 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.416 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.416 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.417 INFO:tasks.workunit.client.0.smithi059.stdout:244/600: open fd = 3 2024-09-10T21:20:27.417 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.417 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.417 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.417 INFO:tasks.workunit.client.0.smithi059.stdout:245/600: open fd = 3 2024-09-10T21:20:27.417 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.417 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.417 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.417 INFO:tasks.workunit.client.0.smithi059.stdout:246/600: open fd = 3 2024-09-10T21:20:27.417 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.417 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.417 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.418 INFO:tasks.workunit.client.0.smithi059.stdout:247/600: open fd = 3 2024-09-10T21:20:27.418 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.418 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.418 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.418 INFO:tasks.workunit.client.0.smithi059.stdout:248/600: open fd = 3 2024-09-10T21:20:27.418 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.418 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.418 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.418 INFO:tasks.workunit.client.0.smithi059.stdout:249/600: open fd = 3 2024-09-10T21:20:27.418 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.418 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.418 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:20:27.418 INFO:tasks.workunit.client.0.smithi059.stdout:250/600: open fd = 3 2024-09-10T21:20:27.418 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:27.419 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:20:28.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:28 smithi192 ceph-mon[35363]: pgmap v496: 97 pgs: 97 active+clean; 3.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:20:28.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:28 smithi059 ceph-mon[30888]: pgmap v496: 97 pgs: 97 active+clean; 3.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:20:28.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:28 smithi154 ceph-mon[35041]: pgmap v496: 97 pgs: 97 active+clean; 3.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:20:30.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:30 smithi192 ceph-mon[35363]: pgmap v497: 97 pgs: 97 active+clean; 3.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:30.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:30 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:20:30.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:30 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:20:30.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:30 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:20:30.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:30 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:20:30.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:30 smithi059 ceph-mon[30888]: pgmap v497: 97 pgs: 97 active+clean; 3.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:30.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:30 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:20:30.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:30 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:20:30.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:30 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:20:30.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:30 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:20:30.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:30 smithi154 ceph-mon[35041]: pgmap v497: 97 pgs: 97 active+clean; 3.5 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:30.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:30 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:20:30.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:30 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:20:30.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:30 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:20:30.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:30 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:20:32.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:32 smithi192 ceph-mon[35363]: pgmap v498: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:20:32.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:32 smithi059 ceph-mon[30888]: pgmap v498: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:20:32.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:32 smithi154 ceph-mon[35041]: pgmap v498: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:20:34.728 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:34 smithi059 ceph-mon[30888]: pgmap v499: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:34.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:34 smithi192 ceph-mon[35363]: pgmap v499: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:34.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:34 smithi154 ceph-mon[35041]: pgmap v499: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:36.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:36 smithi192 ceph-mon[35363]: pgmap v500: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:20:36.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:36 smithi059 ceph-mon[30888]: pgmap v500: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:20:36.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:36 smithi154 ceph-mon[35041]: pgmap v500: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:20:38.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:38 smithi192 ceph-mon[35363]: pgmap v501: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:20:38.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:38 smithi059 ceph-mon[30888]: pgmap v501: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:20:38.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:38 smithi154 ceph-mon[35041]: pgmap v501: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:20:39.476 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:20:39.753 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:20:40.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.298+0000 7fad086c9640 1 -- 172.21.15.59:0/2329455546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad0010d140 msgr2=0x7fad0010f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:40.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.298+0000 7fad086c9640 1 --2- 172.21.15.59:0/2329455546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad0010d140 0x7fad0010f5a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7facf8009ca0 tx=0x7facf802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.298+0000 7fad086c9640 1 -- 172.21.15.59:0/2329455546 shutdown_connections 2024-09-10T21:20:40.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.298+0000 7fad086c9640 1 --2- 172.21.15.59:0/2329455546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad0010d140 0x7fad0010f5a0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.298+0000 7fad086c9640 1 --2- 172.21.15.59:0/2329455546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad00104600 0x7fad0010caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.298+0000 7fad086c9640 1 --2- 172.21.15.59:0/2329455546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad00103ce0 0x7fad001040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.298+0000 7fad086c9640 1 -- 172.21.15.59:0/2329455546 >> 172.21.15.59:0/2329455546 conn(0x7fad000fd700 msgr2=0x7fad000ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:40.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.298+0000 7fad086c9640 1 -- 172.21.15.59:0/2329455546 shutdown_connections 2024-09-10T21:20:40.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.298+0000 7fad086c9640 1 -- 172.21.15.59:0/2329455546 wait complete. 2024-09-10T21:20:40.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.298+0000 7fad086c9640 1 Processor -- start 2024-09-10T21:20:40.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.298+0000 7fad086c9640 1 -- start start 2024-09-10T21:20:40.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.298+0000 7fad086c9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad00103ce0 0x7fad00199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:40.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7fad086c9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad00104600 0x7fad001997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:40.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7fad086c9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0010d140 0x7fad0019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:40.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7fad086c9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fad00112db0 con 0x7fad00103ce0 2024-09-10T21:20:40.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7fad086c9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad00112c30 con 0x7fad0010d140 2024-09-10T21:20:40.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7fad086c9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fad00112f30 con 0x7fad00104600 2024-09-10T21:20:40.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7fad06465640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad00103ce0 0x7fad00199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:40.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7fad06465640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad00103ce0 0x7fad00199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41816/0 (socket says 172.21.15.59:41816) 2024-09-10T21:20:40.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7fad06465640 1 -- 172.21.15.59:0/2233935358 learned_addr learned my addr 172.21.15.59:0/2233935358 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:40.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7fad06c66640 1 --2- 172.21.15.59:0/2233935358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0010d140 0x7fad0019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:40.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7fad05c64640 1 --2- 172.21.15.59:0/2233935358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad00104600 0x7fad001997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:40.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7fad06465640 1 -- 172.21.15.59:0/2233935358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad00104600 msgr2=0x7fad001997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:40.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7fad06465640 1 --2- 172.21.15.59:0/2233935358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad00104600 0x7fad001997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7fad06465640 1 -- 172.21.15.59:0/2233935358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0010d140 msgr2=0x7fad0019eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:40.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7fad06465640 1 --2- 172.21.15.59:0/2233935358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0010d140 0x7fad0019eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7fad06465640 1 -- 172.21.15.59:0/2233935358 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0019f330 con 0x7fad00103ce0 2024-09-10T21:20:40.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7fad05c64640 1 --2- 172.21.15.59:0/2233935358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad00104600 0x7fad001997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:20:40.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7fad06465640 1 --2- 172.21.15.59:0/2233935358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad00103ce0 0x7fad00199280 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7facfc00c890 tx=0x7facfc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:40.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7facf77fe640 1 -- 172.21.15.59:0/2233935358 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc004220 con 0x7fad00103ce0 2024-09-10T21:20:40.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7facf77fe640 1 -- 172.21.15.59:0/2233935358 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facfc0043c0 con 0x7fad00103ce0 2024-09-10T21:20:40.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7fad086c9640 1 -- 172.21.15.59:0/2233935358 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0019f620 con 0x7fad00103ce0 2024-09-10T21:20:40.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.299+0000 7facf77fe640 1 -- 172.21.15.59:0/2233935358 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc004a00 con 0x7fad00103ce0 2024-09-10T21:20:40.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.300+0000 7fad086c9640 1 -- 172.21.15.59:0/2233935358 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad001a5ce0 con 0x7fad00103ce0 2024-09-10T21:20:40.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.302+0000 7facf77fe640 1 -- 172.21.15.59:0/2233935358 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7facfc0079b0 con 0x7fad00103ce0 2024-09-10T21:20:40.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.302+0000 7fad0aa9e740 1 Processor -- start 2024-09-10T21:20:40.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.302+0000 7fad0aa9e740 1 -- start start 2024-09-10T21:20:40.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7fad0aa9e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387480 0x559a29387860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:40.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7fad0aa9e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29387da0 0x559a29397c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7fad0aa9e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29398140 0x559a2939a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7fad0aa9e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559a292fde50 con 0x559a29387480 2024-09-10T21:20:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7fad0aa9e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559a292ed280 con 0x559a29387da0 2024-09-10T21:20:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7fad0aa9e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559a292f1090 con 0x559a29398140 2024-09-10T21:20:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7fad06c66640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387480 0x559a29387860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7fad06c66640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387480 0x559a29387860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41822/0 (socket says 172.21.15.59:41822) 2024-09-10T21:20:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7fad06c66640 1 -- 172.21.15.59:0/1403711746 learned_addr learned my addr 172.21.15.59:0/1403711746 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7facf77fe640 1 --2- 172.21.15.59:0/2233935358 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7facec0b52e0 0x7facec0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7fad05c64640 1 --2- 172.21.15.59:0/1403711746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29398140 0x559a2939a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7fad06465640 1 --2- 172.21.15.59:0/1403711746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29387da0 0x559a29397c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7fad06c66640 1 -- 172.21.15.59:0/1403711746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29398140 msgr2=0x559a2939a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:40.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7fad06c66640 1 --2- 172.21.15.59:0/1403711746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29398140 0x559a2939a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7fad06c66640 1 -- 172.21.15.59:0/1403711746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29387da0 msgr2=0x559a29397c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7fad06c66640 1 --2- 172.21.15.59:0/1403711746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29387da0 0x559a29397c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7fad06c66640 1 -- 172.21.15.59:0/1403711746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a2904b650 con 0x559a29387480 2024-09-10T21:20:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7fad05c64640 1 --2- 172.21.15.59:0/1403711746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29398140 0x559a2939a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7fad06c66640 1 --2- 172.21.15.59:0/2233935358 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7facec0b52e0 0x7facec0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7facf77fe640 1 -- 172.21.15.59:0/2233935358 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7facfc0e59a0 con 0x7fad00103ce0 2024-09-10T21:20:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.303+0000 7fad06c66640 1 --2- 172.21.15.59:0/1403711746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387480 0x559a29387860 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7facf8009990 tx=0x7facf80099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0c093ac4374e42 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.304+0000 7facf4ff9640 1 -- 172.21.15.59:0/1403711746 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf8042040 con 0x559a29387480 2024-09-10T21:20:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.304+0000 7facf4ff9640 1 -- 172.21.15.59:0/1403711746 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facf8036070 con 0x559a29387480 2024-09-10T21:20:40.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.304+0000 7facf4ff9640 1 -- 172.21.15.59:0/1403711746 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf802f660 con 0x559a29387480 2024-09-10T21:20:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.304+0000 7fad06c66640 1 --2- 172.21.15.59:0/2233935358 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7facec0b52e0 0x7facec0b77a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7facf804d000 tx=0x7facf804e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.304+0000 7fad0aa9e740 1 -- 172.21.15.59:0/1403711746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387480 msgr2=0x559a29387860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.304+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/1403711746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387480 0x559a29387860 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7facf8009990 tx=0x7facf80099c0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.304+0000 7fad0aa9e740 1 -- 172.21.15.59:0/1403711746 shutdown_connections 2024-09-10T21:20:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.304+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/1403711746 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29398140 0x559a2939a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.304+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/1403711746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29387da0 0x559a29397c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.304+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/1403711746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387480 0x559a29387860 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.305+0000 7fad0aa9e740 1 -- 172.21.15.59:0/1403711746 >> 172.21.15.59:0/1403711746 conn(0x559a293852b0 msgr2=0x559a29386450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.305+0000 7fad0aa9e740 1 -- 172.21.15.59:0/1403711746 shutdown_connections 2024-09-10T21:20:40.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.305+0000 7fad0aa9e740 1 -- 172.21.15.59:0/1403711746 wait complete. 2024-09-10T21:20:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.305+0000 7fad0aa9e740 1 -- start start 2024-09-10T21:20:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.305+0000 7fad0aa9e740 1 Processor -- start 2024-09-10T21:20:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.305+0000 7fad0aa9e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29387480 0x559a293979c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.305+0000 7fad0aa9e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387da0 0x559a29394e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.305+0000 7fad0aa9e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29398140 0x559a293953b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.305+0000 7fad0aa9e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559a2914e700 con 0x559a29387da0 2024-09-10T21:20:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.305+0000 7fad0aa9e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559a29288110 con 0x559a29398140 2024-09-10T21:20:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.305+0000 7fad0aa9e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559a2939adf0 con 0x559a29387480 2024-09-10T21:20:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.305+0000 7fad0aa9e740 10 client.0 _ll_register_callbacks cb 0x559a292a1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.305+0000 7fad05c64640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387da0 0x559a29394e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:40.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.305+0000 7fad05c64640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387da0 0x559a29394e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41838/0 (socket says 172.21.15.59:41838) 2024-09-10T21:20:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.305+0000 7fad05c64640 1 -- 172.21.15.59:0/1179461216 learned_addr learned my addr 172.21.15.59:0/1179461216 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.306+0000 7fad06465640 1 --2- 172.21.15.59:0/1179461216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29387480 0x559a293979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.306+0000 7fad06c66640 1 --2- 172.21.15.59:0/1179461216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29398140 0x559a293953b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.306+0000 7fad05c64640 1 -- 172.21.15.59:0/1179461216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29387480 msgr2=0x559a293979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.306+0000 7fad05c64640 1 --2- 172.21.15.59:0/1179461216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29387480 0x559a293979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.306+0000 7fad05c64640 1 -- 172.21.15.59:0/1179461216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29398140 msgr2=0x559a293953b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.306+0000 7fad05c64640 1 --2- 172.21.15.59:0/1179461216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29398140 0x559a293953b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.306+0000 7fad05c64640 1 -- 172.21.15.59:0/1179461216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a292b5c40 con 0x559a29387da0 2024-09-10T21:20:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.306+0000 7fad05c64640 1 --2- 172.21.15.59:0/1179461216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387da0 0x559a29394e10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7facf00106a0 tx=0x7facf0010b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e1b8d1e2d542dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:40.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.306+0000 7face9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.306+0000 7face9ffb640 1 -- 172.21.15.59:0/1179461216 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf0010ea0 con 0x559a29387da0 2024-09-10T21:20:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.306+0000 7face9ffb640 1 -- 172.21.15.59:0/1179461216 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7facf000ead0 con 0x559a29387da0 2024-09-10T21:20:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.306+0000 7fad0aa9e740 1 -- 172.21.15.59:0/1179461216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facf8036070 con 0x559a29387da0 2024-09-10T21:20:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.306+0000 7face9ffb640 1 -- 172.21.15.59:0/1179461216 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7facf000ecd0 con 0x559a29387da0 2024-09-10T21:20:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.306+0000 7fad0aa9e740 10 client.16686 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.306+0000 7fad0aa9e740 1 -- 172.21.15.59:0/1179461216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559a293a6750 con 0x559a29387da0 2024-09-10T21:20:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.307+0000 7face9ffb640 1 -- 172.21.15.59:0/1179461216 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facf8036070 con 0x559a29387da0 2024-09-10T21:20:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.307+0000 7face9ffb640 1 -- 172.21.15.59:0/1179461216 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7facf000f040 con 0x559a29387da0 2024-09-10T21:20:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.307+0000 7fad0aa9e740 10 client.16686 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.307+0000 7fad0aa9e740 10 client.16686 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:20:40.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.307+0000 7fad0aa9e740 20 client.16686 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.307+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/1179461216 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559a293a7d00 0x559a293aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.307+0000 7fad0aa9e740 4 client.16686 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:20:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.307+0000 7fad0aa9e740 1 -- 172.21.15.59:0/1179461216 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a292ffda0 con 0x559a293a7d00 2024-09-10T21:20:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.307+0000 7fad06465640 1 --2- 172.21.15.59:0/1179461216 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559a293a7d00 0x559a293aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.307+0000 7fad06465640 1 --2- 172.21.15.59:0/1179461216 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559a293a7d00 0x559a293aa0f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=865cfe956d2a6d15 server_cookie=fa0207374e4b4f20 in_seq=0 out_seq=0 2024-09-10T21:20:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.307+0000 7face9ffb640 10 client.16686 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.308+0000 7face9ffb640 1 -- 172.21.15.59:0/1179461216 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a292ffda0 con 0x559a293a7d00 2024-09-10T21:20:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.308+0000 7face9ffb640 10 client.16686 handle_command_reply: tid=0 2024-09-10T21:20:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.308+0000 7fad0aa9e740 1 client.16686 shutdown 2024-09-10T21:20:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.308+0000 7fad0aa9e740 1 -- 172.21.15.59:0/1179461216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387da0 msgr2=0x559a29394e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.308+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/1179461216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387da0 0x559a29394e10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7facf00106a0 tx=0x7facf0010b60 comp rx=0 tx=0).stop 2024-09-10T21:20:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.308+0000 7fad0aa9e740 1 -- 172.21.15.59:0/1179461216 shutdown_connections 2024-09-10T21:20:40.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.308+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/1179461216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29398140 0x559a293953b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.308+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/1179461216 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559a293a7d00 0x559a293aa0f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.308+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/1179461216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387da0 0x559a29394e10 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.308+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/1179461216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29387480 0x559a293979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.308+0000 7face9ffb640 0 client.16686 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:40.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.308+0000 7fad0aa9e740 1 -- 172.21.15.59:0/1179461216 >> 172.21.15.59:0/1179461216 conn(0x559a293852b0 msgr2=0x559a2938ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:40.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.309+0000 7fad0aa9e740 1 -- 172.21.15.59:0/1179461216 shutdown_connections 2024-09-10T21:20:40.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.309+0000 7fad0aa9e740 1 -- 172.21.15.59:0/1179461216 wait complete. 2024-09-10T21:20:40.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.309+0000 7fad0aa9e740 20 client.16686 trim_cache size 0 max 16384 2024-09-10T21:20:40.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.326+0000 7fad0aa9e740 1 Processor -- start 2024-09-10T21:20:40.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.327+0000 7fad0aa9e740 1 -- start start 2024-09-10T21:20:40.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.327+0000 7fad0aa9e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387480 0x559a29386840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:40.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.327+0000 7fad0aa9e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29387da0 0x559a293a4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:40.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.327+0000 7fad0aa9e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29398140 0x559a2938ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:40.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.327+0000 7fad0aa9e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fad001ac0b0 con 0x559a29387480 2024-09-10T21:20:40.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.327+0000 7fad0aa9e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad001adbf0 con 0x559a29398140 2024-09-10T21:20:40.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.327+0000 7fad0aa9e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fad001ac780 con 0x559a29387da0 2024-09-10T21:20:40.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.327+0000 7fad06465640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387480 0x559a29386840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:40.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.327+0000 7fad06465640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387480 0x559a29386840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41846/0 (socket says 172.21.15.59:41846) 2024-09-10T21:20:40.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.327+0000 7fad06465640 1 -- 172.21.15.59:0/1189171585 learned_addr learned my addr 172.21.15.59:0/1189171585 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:40.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.327+0000 7fad05c64640 1 --2- 172.21.15.59:0/1189171585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29387da0 0x559a293a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:40.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.327+0000 7fad06c66640 1 --2- 172.21.15.59:0/1189171585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29398140 0x559a2938ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:40.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.327+0000 7fad06465640 1 -- 172.21.15.59:0/1189171585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29387da0 msgr2=0x559a293a4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:40.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.327+0000 7fad06465640 1 --2- 172.21.15.59:0/1189171585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29387da0 0x559a293a4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.327+0000 7fad06465640 1 -- 172.21.15.59:0/1189171585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29398140 msgr2=0x559a2938ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:40.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.327+0000 7fad06465640 1 --2- 172.21.15.59:0/1189171585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29398140 0x559a2938ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.327+0000 7fad06465640 1 -- 172.21.15.59:0/1189171585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a29387bd0 con 0x559a29387480 2024-09-10T21:20:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.327+0000 7fad06465640 1 --2- 172.21.15.59:0/1189171585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387480 0x559a29386840 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7facfc0e3410 tx=0x7facfc0b3f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba76bb382822d44a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.328+0000 7facebfff640 1 -- 172.21.15.59:0/1189171585 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc01d040 con 0x559a29387480 2024-09-10T21:20:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.328+0000 7facebfff640 1 -- 172.21.15.59:0/1189171585 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facfc0abc40 con 0x559a29387480 2024-09-10T21:20:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.328+0000 7facebfff640 1 -- 172.21.15.59:0/1189171585 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc007cd0 con 0x559a29387480 2024-09-10T21:20:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.328+0000 7fad0aa9e740 1 -- 172.21.15.59:0/1189171585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387480 msgr2=0x559a29386840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.328+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/1189171585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387480 0x559a29386840 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7facfc0e3410 tx=0x7facfc0b3f90 comp rx=0 tx=0).stop 2024-09-10T21:20:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.328+0000 7fad0aa9e740 1 -- 172.21.15.59:0/1189171585 shutdown_connections 2024-09-10T21:20:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.328+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/1189171585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29398140 0x559a2938ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.328+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/1189171585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29387da0 0x559a293a4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.328+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/1189171585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387480 0x559a29386840 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.328+0000 7fad0aa9e740 1 -- 172.21.15.59:0/1189171585 >> 172.21.15.59:0/1189171585 conn(0x559a293852b0 msgr2=0x559a2938a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.328+0000 7fad0aa9e740 1 -- 172.21.15.59:0/1189171585 shutdown_connections 2024-09-10T21:20:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.329+0000 7fad0aa9e740 1 -- 172.21.15.59:0/1189171585 wait complete. 2024-09-10T21:20:40.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.329+0000 7fad0aa9e740 1 -- start start 2024-09-10T21:20:40.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.329+0000 7fad0aa9e740 1 Processor -- start 2024-09-10T21:20:40.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.329+0000 7fad0aa9e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29387480 0x559a293a0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:40.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.329+0000 7fad0aa9e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387da0 0x559a293a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:40.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.329+0000 7fad0aa9e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29398140 0x559a2939d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:40.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.329+0000 7fad0aa9e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fad001ad520 con 0x559a29387da0 2024-09-10T21:20:40.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.329+0000 7fad0aa9e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fad001ace50 con 0x559a29398140 2024-09-10T21:20:40.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.329+0000 7fad0aa9e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fad001aa090 con 0x559a29387480 2024-09-10T21:20:40.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.329+0000 7fad0aa9e740 10 client.0 _ll_register_callbacks cb 0x7fad0006c4f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:40.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.329+0000 7fad05c64640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387da0 0x559a293a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:40.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.329+0000 7fad05c64640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387da0 0x559a293a07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41858/0 (socket says 172.21.15.59:41858) 2024-09-10T21:20:40.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.329+0000 7fad05c64640 1 -- 172.21.15.59:0/2046331041 learned_addr learned my addr 172.21.15.59:0/2046331041 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:40.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.329+0000 7fad06465640 1 --2- 172.21.15.59:0/2046331041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29387480 0x559a293a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:40.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.330+0000 7fad06c66640 1 --2- 172.21.15.59:0/2046331041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29398140 0x559a2939d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:40.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.330+0000 7fad05c64640 1 -- 172.21.15.59:0/2046331041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29387480 msgr2=0x559a293a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:40.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.330+0000 7fad05c64640 1 --2- 172.21.15.59:0/2046331041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29387480 0x559a293a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.330+0000 7fad05c64640 1 -- 172.21.15.59:0/2046331041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29398140 msgr2=0x559a2939d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:40.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.330+0000 7fad05c64640 1 --2- 172.21.15.59:0/2046331041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29398140 0x559a2939d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.330+0000 7fad05c64640 1 -- 172.21.15.59:0/2046331041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a2939d7c0 con 0x559a29387da0 2024-09-10T21:20:40.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.330+0000 7fad06c66640 1 --2- 172.21.15.59:0/2046331041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29398140 0x559a2939d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:40.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.330+0000 7fad05c64640 1 --2- 172.21.15.59:0/2046331041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387da0 0x559a293a07d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7facf0004ef0 tx=0x7facf000e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61cb4ca64cfec68a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:40.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.330+0000 7face9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:40.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.330+0000 7face9ffb640 1 -- 172.21.15.59:0/2046331041 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf0004680 con 0x559a29387da0 2024-09-10T21:20:40.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.330+0000 7face9ffb640 1 -- 172.21.15.59:0/2046331041 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7facf0004820 con 0x559a29387da0 2024-09-10T21:20:40.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.330+0000 7fad0aa9e740 1 -- 172.21.15.59:0/2046331041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facfc0abc40 con 0x559a29387da0 2024-09-10T21:20:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.330+0000 7face9ffb640 1 -- 172.21.15.59:0/2046331041 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7facf0004a20 con 0x559a29387da0 2024-09-10T21:20:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.330+0000 7fad0aa9e740 10 client.16692 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.330+0000 7fad0aa9e740 1 -- 172.21.15.59:0/2046331041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559a29415660 con 0x559a29387da0 2024-09-10T21:20:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.331+0000 7face9ffb640 1 -- 172.21.15.59:0/2046331041 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facfc0abc40 con 0x559a29387da0 2024-09-10T21:20:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.331+0000 7face9ffb640 1 -- 172.21.15.59:0/2046331041 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7facf0012890 con 0x559a29387da0 2024-09-10T21:20:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.331+0000 7fad0aa9e740 10 client.16692 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.331+0000 7fad0aa9e740 10 client.16692 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:20:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.331+0000 7fad0aa9e740 20 client.16692 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.331+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/2046331041 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559a29415d80 0x559a294181a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.331+0000 7fad0aa9e740 4 client.16692 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:20:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.331+0000 7fad0aa9e740 1 -- 172.21.15.59:0/2046331041 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559a292fb850 con 0x559a29415d80 2024-09-10T21:20:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.331+0000 7fad06465640 1 --2- 172.21.15.59:0/2046331041 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559a29415d80 0x559a294181a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.331+0000 7fad06465640 1 --2- 172.21.15.59:0/2046331041 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559a29415d80 0x559a294181a0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b272c17a4e306125 server_cookie=521864a2b68d9947 in_seq=0 out_seq=0 2024-09-10T21:20:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.331+0000 7face9ffb640 10 client.16692 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.332+0000 7face9ffb640 1 -- 172.21.15.59:0/2046331041 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x559a292fb850 con 0x559a29415d80 2024-09-10T21:20:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.332+0000 7face9ffb640 10 client.16692 handle_command_reply: tid=0 2024-09-10T21:20:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.332+0000 7fad0aa9e740 1 client.16692 shutdown 2024-09-10T21:20:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.332+0000 7fad0aa9e740 1 -- 172.21.15.59:0/2046331041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387da0 msgr2=0x559a293a07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.332+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/2046331041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387da0 0x559a293a07d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7facf0004ef0 tx=0x7facf000e7e0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.332+0000 7fad0aa9e740 1 -- 172.21.15.59:0/2046331041 shutdown_connections 2024-09-10T21:20:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.332+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/2046331041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a29398140 0x559a2939d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.332+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/2046331041 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x559a29415d80 0x559a294181a0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.332+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/2046331041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a29387da0 0x559a293a07d0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.332+0000 7fad0aa9e740 1 --2- 172.21.15.59:0/2046331041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559a29387480 0x559a293a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.332+0000 7fad0aa9e740 1 -- 172.21.15.59:0/2046331041 >> 172.21.15.59:0/2046331041 conn(0x559a293852b0 msgr2=0x559a29396440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:40.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.332+0000 7face9ffb640 0 client.16692 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:40.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.332+0000 7fad0aa9e740 1 -- 172.21.15.59:0/2046331041 shutdown_connections 2024-09-10T21:20:40.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.332+0000 7fad0aa9e740 1 -- 172.21.15.59:0/2046331041 wait complete. 2024-09-10T21:20:40.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.332+0000 7fad0aa9e740 20 client.16692 trim_cache size 0 max 16384 2024-09-10T21:20:40.347 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:20:40.347 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:20:40.347 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:20:40.347 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:20:40.347 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:20:40.347 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:20:40.348 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:40.348 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:40.348 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:40.348 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:40.348 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:40.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:40.348 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:20:40.348 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:20:40.348 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:40.348 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:40.348 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:40.348 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:40.349 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:40.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:40.349 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:20:40.349 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:20:40.349 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:40.349 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:40.349 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:40.349 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:40.349 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:40.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:40.349 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:20:40.349 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:20:40.350 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:40.350 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:40.350 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:40.350 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:40.350 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:40.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:40.350 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:20:40.350 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:07.066301+0000", 2024-09-10T21:20:40.350 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:40.350 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:40.350 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:40.350 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:40.351 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:40.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:40.351 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:20:40.351 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:20:40.351 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:40.351 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:40.351 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:40.351 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:40.351 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:40.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:40.351 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:20:40.351 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:20:40.351 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:40.352 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:40.352 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:40.352 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:40.352 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:40.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:40.352 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:20:40.352 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:20:40.352 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:40.352 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:40.352 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:40.352 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:40.352 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:40.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:40.353 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:20:40.353 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:20:40.353 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:40.353 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:40.353 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:40.353 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:40.353 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:40.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:40.353 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:20:40.353 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:20:40.353 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:40.353 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:40.353 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:40.353 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:40.354 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:40.354 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:20:40.354 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:20:40.354 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:20:40.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.333+0000 7fad086c9640 1 -- 172.21.15.59:0/2233935358 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7facec0b52e0 msgr2=0x7facec0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:40.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.333+0000 7fad086c9640 1 --2- 172.21.15.59:0/2233935358 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7facec0b52e0 0x7facec0b77a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7facf804d000 tx=0x7facf804e000 comp rx=0 tx=0).stop 2024-09-10T21:20:40.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.333+0000 7fad086c9640 1 -- 172.21.15.59:0/2233935358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad00103ce0 msgr2=0x7fad00199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:40.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.333+0000 7fad086c9640 1 --2- 172.21.15.59:0/2233935358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad00103ce0 0x7fad00199280 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7facfc00c890 tx=0x7facfc00cd50 comp rx=0 tx=0).stop 2024-09-10T21:20:40.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.333+0000 7fad086c9640 1 -- 172.21.15.59:0/2233935358 shutdown_connections 2024-09-10T21:20:40.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.333+0000 7fad086c9640 1 --2- 172.21.15.59:0/2233935358 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7facec0b52e0 0x7facec0b77a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.333+0000 7fad086c9640 1 --2- 172.21.15.59:0/2233935358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0010d140 0x7fad0019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.333+0000 7fad086c9640 1 --2- 172.21.15.59:0/2233935358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fad00104600 0x7fad001997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.333+0000 7fad086c9640 1 --2- 172.21.15.59:0/2233935358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad00103ce0 0x7fad00199280 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:40.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.333+0000 7fad086c9640 1 -- 172.21.15.59:0/2233935358 >> 172.21.15.59:0/2233935358 conn(0x7fad000fd700 msgr2=0x7fad000fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:40.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.333+0000 7fad086c9640 1 -- 172.21.15.59:0/2233935358 shutdown_connections 2024-09-10T21:20:40.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:40.333+0000 7fad086c9640 1 -- 172.21.15.59:0/2233935358 wait complete. 2024-09-10T21:20:40.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:40 smithi192 ceph-mon[35363]: pgmap v502: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:40.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:40 smithi059 ceph-mon[30888]: pgmap v502: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:40.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:40 smithi154 ceph-mon[35041]: pgmap v502: 97 pgs: 97 active+clean; 3.6 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:41.303 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:20:41.303 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:20:41.566 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:20:42.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.078+0000 7f50d3c6f640 1 -- 172.21.15.59:0/3161290655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50cc104600 msgr2=0x7f50cc10caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:42.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.078+0000 7f50d3c6f640 1 --2- 172.21.15.59:0/3161290655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50cc104600 0x7f50cc10caf0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009900 tx=0x7f50bc02a410 comp rx=0 tx=0).stop 2024-09-10T21:20:42.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.078+0000 7f50d3c6f640 1 -- 172.21.15.59:0/3161290655 shutdown_connections 2024-09-10T21:20:42.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.078+0000 7f50d3c6f640 1 --2- 172.21.15.59:0/3161290655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50cc10d140 0x7f50cc10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:42.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.078+0000 7f50d3c6f640 1 --2- 172.21.15.59:0/3161290655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50cc104600 0x7f50cc10caf0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:42.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.078+0000 7f50d3c6f640 1 --2- 172.21.15.59:0/3161290655 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc103ce0 0x7f50cc1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:42.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.078+0000 7f50d3c6f640 1 -- 172.21.15.59:0/3161290655 >> 172.21.15.59:0/3161290655 conn(0x7f50cc0fd700 msgr2=0x7f50cc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:42.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.078+0000 7f50d3c6f640 1 -- 172.21.15.59:0/3161290655 shutdown_connections 2024-09-10T21:20:42.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.078+0000 7f50d3c6f640 1 -- 172.21.15.59:0/3161290655 wait complete. 2024-09-10T21:20:42.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.078+0000 7f50d3c6f640 1 Processor -- start 2024-09-10T21:20:42.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.078+0000 7f50d3c6f640 1 -- start start 2024-09-10T21:20:42.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.079+0000 7f50d3c6f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50cc103ce0 0x7f50cc199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:42.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.079+0000 7f50d3c6f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50cc104600 0x7f50cc1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:42.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.079+0000 7f50d3c6f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc10d140 0x7f50cc19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:42.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.079+0000 7f50d3c6f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f50cc112db0 con 0x7f50cc104600 2024-09-10T21:20:42.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.079+0000 7f50d3c6f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f50cc112c30 con 0x7f50cc10d140 2024-09-10T21:20:42.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.079+0000 7f50d3c6f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f50cc112f30 con 0x7f50cc103ce0 2024-09-10T21:20:42.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.079+0000 7f50d120a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50cc104600 0x7f50cc1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:42.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.079+0000 7f50d120a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50cc104600 0x7f50cc1997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41876/0 (socket says 172.21.15.59:41876) 2024-09-10T21:20:42.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.079+0000 7f50d120a640 1 -- 172.21.15.59:0/4082369297 learned_addr learned my addr 172.21.15.59:0/4082369297 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:42.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.079+0000 7f50d1a0b640 1 --2- 172.21.15.59:0/4082369297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50cc103ce0 0x7f50cc199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:42.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.079+0000 7f50d220c640 1 --2- 172.21.15.59:0/4082369297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc10d140 0x7f50cc19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:42.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.079+0000 7f50d120a640 1 -- 172.21.15.59:0/4082369297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50cc103ce0 msgr2=0x7f50cc199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:42.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.079+0000 7f50d120a640 1 --2- 172.21.15.59:0/4082369297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50cc103ce0 0x7f50cc199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:42.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.079+0000 7f50d120a640 1 -- 172.21.15.59:0/4082369297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc10d140 msgr2=0x7f50cc19eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:42.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.079+0000 7f50d120a640 1 --2- 172.21.15.59:0/4082369297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc10d140 0x7f50cc19eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:42.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.079+0000 7f50d120a640 1 -- 172.21.15.59:0/4082369297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50cc19f310 con 0x7f50cc104600 2024-09-10T21:20:42.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.079+0000 7f50d220c640 1 --2- 172.21.15.59:0/4082369297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc10d140 0x7f50cc19eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:20:42.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.079+0000 7f50d120a640 1 --2- 172.21.15.59:0/4082369297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50cc104600 0x7f50cc1997a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f50bc006010 tx=0x7f50bc004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:42.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.080+0000 7f50c2ffd640 1 -- 172.21.15.59:0/4082369297 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc03f030 con 0x7f50cc104600 2024-09-10T21:20:42.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.080+0000 7f50c2ffd640 1 -- 172.21.15.59:0/4082369297 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50bc004490 con 0x7f50cc104600 2024-09-10T21:20:42.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.080+0000 7f50d3c6f640 1 -- 172.21.15.59:0/4082369297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50cc19f5a0 con 0x7f50cc104600 2024-09-10T21:20:42.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.080+0000 7f50c2ffd640 1 -- 172.21.15.59:0/4082369297 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc035070 con 0x7f50cc104600 2024-09-10T21:20:42.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.080+0000 7f50d3c6f640 1 -- 172.21.15.59:0/4082369297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50cc1a5cc0 con 0x7f50cc104600 2024-09-10T21:20:42.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.081+0000 7f50d3c6f640 1 -- 172.21.15.59:0/4082369297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50cc1040c0 con 0x7f50cc104600 2024-09-10T21:20:42.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.082+0000 7f50c2ffd640 1 -- 172.21.15.59:0/4082369297 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f50bc03ba30 con 0x7f50cc104600 2024-09-10T21:20:42.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.083+0000 7f50c2ffd640 1 --2- 172.21.15.59:0/4082369297 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f50b80b52e0 0x7f50b80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:42.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.083+0000 7f50d1a0b640 1 --2- 172.21.15.59:0/4082369297 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f50b80b52e0 0x7f50b80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:42.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.083+0000 7f50c2ffd640 1 -- 172.21.15.59:0/4082369297 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f50bc106270 con 0x7f50cc104600 2024-09-10T21:20:42.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.083+0000 7f50d1a0b640 1 --2- 172.21.15.59:0/4082369297 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f50b80b52e0 0x7f50b80b77a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f50c800abe0 tx=0x7f50c800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:42.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.087+0000 7f50c2ffd640 1 -- 172.21.15.59:0/4082369297 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f50bc0cd160 con 0x7f50cc104600 2024-09-10T21:20:42.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.308+0000 7f50d3c6f640 1 -- 172.21.15.59:0/4082369297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50cc1a5f60 con 0x7f50cc104600 2024-09-10T21:20:42.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.309+0000 7f50c2ffd640 1 -- 172.21.15.59:0/4082369297 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f50bc0cca60 con 0x7f50cc104600 2024-09-10T21:20:42.313 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:20:42.313 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:20:42.313 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:20:42.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.312+0000 7f50d3c6f640 1 -- 172.21.15.59:0/4082369297 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f50b80b52e0 msgr2=0x7f50b80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:42.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.312+0000 7f50d3c6f640 1 --2- 172.21.15.59:0/4082369297 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f50b80b52e0 0x7f50b80b77a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f50c800abe0 tx=0x7f50c800a2d0 comp rx=0 tx=0).stop 2024-09-10T21:20:42.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.312+0000 7f50d3c6f640 1 -- 172.21.15.59:0/4082369297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50cc104600 msgr2=0x7f50cc1997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:42.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.312+0000 7f50d3c6f640 1 --2- 172.21.15.59:0/4082369297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50cc104600 0x7f50cc1997a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f50bc006010 tx=0x7f50bc004060 comp rx=0 tx=0).stop 2024-09-10T21:20:42.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.312+0000 7f50d3c6f640 1 -- 172.21.15.59:0/4082369297 shutdown_connections 2024-09-10T21:20:42.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.312+0000 7f50d3c6f640 1 --2- 172.21.15.59:0/4082369297 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f50b80b52e0 0x7f50b80b77a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:42.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.312+0000 7f50d3c6f640 1 --2- 172.21.15.59:0/4082369297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f50cc10d140 0x7f50cc19eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:42.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.312+0000 7f50d3c6f640 1 --2- 172.21.15.59:0/4082369297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50cc104600 0x7f50cc1997a0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:42.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.312+0000 7f50d3c6f640 1 --2- 172.21.15.59:0/4082369297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50cc103ce0 0x7f50cc199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:42.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.312+0000 7f50d3c6f640 1 -- 172.21.15.59:0/4082369297 >> 172.21.15.59:0/4082369297 conn(0x7f50cc0fd700 msgr2=0x7f50cc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:42.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.312+0000 7f50d3c6f640 1 -- 172.21.15.59:0/4082369297 shutdown_connections 2024-09-10T21:20:42.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:42.312+0000 7f50d3c6f640 1 -- 172.21.15.59:0/4082369297 wait complete. 2024-09-10T21:20:42.660 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:42 smithi059 ceph-mon[30888]: pgmap v503: 97 pgs: 97 active+clean; 3.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:20:42.661 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:42 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/4082369297' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:20:42.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:42 smithi192 ceph-mon[35363]: pgmap v503: 97 pgs: 97 active+clean; 3.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:20:42.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:42 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/4082369297' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:20:42.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:42 smithi154 ceph-mon[35041]: pgmap v503: 97 pgs: 97 active+clean; 3.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:20:42.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:42 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/4082369297' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:20:42.942 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:20:43.203 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:20:43.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.714+0000 7ffa9fb26640 1 -- 172.21.15.59:0/2086281377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa98109150 msgr2=0x7ffa9810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:43.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.714+0000 7ffa9fb26640 1 --2- 172.21.15.59:0/2086281377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa98109150 0x7ffa9810f950 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ffa90009ca0 tx=0x7ffa9002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.714+0000 7ffa9fb26640 1 -- 172.21.15.59:0/2086281377 shutdown_connections 2024-09-10T21:20:43.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.714+0000 7ffa9fb26640 1 --2- 172.21.15.59:0/2086281377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa98109150 0x7ffa9810f950 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.714+0000 7ffa9fb26640 1 --2- 172.21.15.59:0/2086281377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa981087d0 0x7ffa98108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.714+0000 7ffa9fb26640 1 --2- 172.21.15.59:0/2086281377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa98102dc0 0x7ffa981031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.714+0000 7ffa9fb26640 1 -- 172.21.15.59:0/2086281377 >> 172.21.15.59:0/2086281377 conn(0x7ffa980fe830 msgr2=0x7ffa98100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:43.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.714+0000 7ffa9fb26640 1 -- 172.21.15.59:0/2086281377 shutdown_connections 2024-09-10T21:20:43.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.714+0000 7ffa9fb26640 1 -- 172.21.15.59:0/2086281377 wait complete. 2024-09-10T21:20:43.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.715+0000 7ffa9fb26640 1 Processor -- start 2024-09-10T21:20:43.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.715+0000 7ffa9fb26640 1 -- start start 2024-09-10T21:20:43.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.715+0000 7ffa9fb26640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa98102dc0 0x7ffa981993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:43.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.715+0000 7ffa9fb26640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa981087d0 0x7ffa98199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:43.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.715+0000 7ffa9fb26640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa98109150 0x7ffa9819eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:43.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.715+0000 7ffa9fb26640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffa98112e50 con 0x7ffa98109150 2024-09-10T21:20:43.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.715+0000 7ffa9fb26640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffa98112cd0 con 0x7ffa981087d0 2024-09-10T21:20:43.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.715+0000 7ffa9fb26640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ffa98112fd0 con 0x7ffa98102dc0 2024-09-10T21:20:43.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.715+0000 7ffa9e0c3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa98109150 0x7ffa9819eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:43.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.715+0000 7ffa9e0c3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa98109150 0x7ffa9819eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41882/0 (socket says 172.21.15.59:41882) 2024-09-10T21:20:43.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.715+0000 7ffa9e0c3640 1 -- 172.21.15.59:0/1650009042 learned_addr learned my addr 172.21.15.59:0/1650009042 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:43.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.715+0000 7ffa9d8c2640 1 --2- 172.21.15.59:0/1650009042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa98102dc0 0x7ffa981993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:43.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.715+0000 7ffa9d0c1640 1 --2- 172.21.15.59:0/1650009042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa981087d0 0x7ffa98199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.715+0000 7ffa9e0c3640 1 -- 172.21.15.59:0/1650009042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa98102dc0 msgr2=0x7ffa981993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.715+0000 7ffa9e0c3640 1 --2- 172.21.15.59:0/1650009042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa98102dc0 0x7ffa981993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.715+0000 7ffa9e0c3640 1 -- 172.21.15.59:0/1650009042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa981087d0 msgr2=0x7ffa98199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.715+0000 7ffa9e0c3640 1 --2- 172.21.15.59:0/1650009042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa981087d0 0x7ffa98199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.715+0000 7ffa9e0c3640 1 -- 172.21.15.59:0/1650009042 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa9819f470 con 0x7ffa98109150 2024-09-10T21:20:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.716+0000 7ffa9e0c3640 1 --2- 172.21.15.59:0/1650009042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa98109150 0x7ffa9819eca0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ffa90005cc0 tx=0x7ffa9002f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.716+0000 7ffa8effd640 1 -- 172.21.15.59:0/1650009042 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90003cf0 con 0x7ffa98109150 2024-09-10T21:20:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.716+0000 7ffa8effd640 1 -- 172.21.15.59:0/1650009042 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa900044f0 con 0x7ffa98109150 2024-09-10T21:20:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.716+0000 7ffa8effd640 1 -- 172.21.15.59:0/1650009042 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9002fd10 con 0x7ffa98109150 2024-09-10T21:20:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.716+0000 7ffa9fb26640 1 -- 172.21.15.59:0/1650009042 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa9819f700 con 0x7ffa98109150 2024-09-10T21:20:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.716+0000 7ffa9fb26640 1 -- 172.21.15.59:0/1650009042 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa981a5ea0 con 0x7ffa98109150 2024-09-10T21:20:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.718+0000 7ffaa1efb740 1 Processor -- start 2024-09-10T21:20:43.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.718+0000 7ffa8effd640 1 -- 172.21.15.59:0/1650009042 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7ffa90004040 con 0x7ffa98109150 2024-09-10T21:20:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.719+0000 7ffaa1efb740 1 -- start start 2024-09-10T21:20:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.719+0000 7ffaa1efb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7d4d0 0x55a629e7d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.719+0000 7ffaa1efb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e7ddf0 0x55a629e89840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.719+0000 7ffaa1efb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e89d80 0x55a629e8c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.719+0000 7ffaa1efb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a629df3ea0 con 0x55a629e7d4d0 2024-09-10T21:20:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.719+0000 7ffaa1efb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a629de32d0 con 0x55a629e89d80 2024-09-10T21:20:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.719+0000 7ffaa1efb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a629de70e0 con 0x55a629e7ddf0 2024-09-10T21:20:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.719+0000 7ffa9d0c1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7d4d0 0x55a629e7d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.719+0000 7ffa9d0c1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7d4d0 0x55a629e7d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41888/0 (socket says 172.21.15.59:41888) 2024-09-10T21:20:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.719+0000 7ffa9d0c1640 1 -- 172.21.15.59:0/3710293041 learned_addr learned my addr 172.21.15.59:0/3710293041 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.719+0000 7ffa9d8c2640 1 --2- 172.21.15.59:0/3710293041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e7ddf0 0x55a629e89840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.719+0000 7ffa9d0c1640 1 --2- 172.21.15.59:0/3710293041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e89d80 0x55a629e8c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:43.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.719+0000 7ffa9d0c1640 1 -- 172.21.15.59:0/3710293041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e7ddf0 msgr2=0x55a629e89840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.719+0000 7ffa9d0c1640 1 --2- 172.21.15.59:0/3710293041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e7ddf0 0x55a629e89840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.720+0000 7ffa9d0c1640 1 -- 172.21.15.59:0/3710293041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e89d80 msgr2=0x55a629e8c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.720+0000 7ffa9d0c1640 1 --2- 172.21.15.59:0/3710293041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e89d80 0x55a629e8c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.720+0000 7ffa9d0c1640 1 -- 172.21.15.59:0/3710293041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a629b41650 con 0x55a629e7d4d0 2024-09-10T21:20:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.720+0000 7ffa8effd640 1 --2- 172.21.15.59:0/1650009042 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffa840b52e0 0x7ffa840b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.720+0000 7ffa9d8c2640 1 --2- 172.21.15.59:0/1650009042 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffa840b52e0 0x7ffa840b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:43.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.720+0000 7ffa9d0c1640 1 --2- 172.21.15.59:0/3710293041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7d4d0 0x55a629e7d8b0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800aed0 tx=0x7ffa8800a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724c7b1d2d1d2ade server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:43.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.720+0000 7ffa8effd640 1 -- 172.21.15.59:0/1650009042 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ffa901073b0 con 0x7ffa98109150 2024-09-10T21:20:43.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.720+0000 7ffa83fff640 1 -- 172.21.15.59:0/3710293041 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8801b070 con 0x55a629e7d4d0 2024-09-10T21:20:43.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.720+0000 7ffa83fff640 1 -- 172.21.15.59:0/3710293041 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa8800edc0 con 0x55a629e7d4d0 2024-09-10T21:20:43.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.720+0000 7ffa83fff640 1 -- 172.21.15.59:0/3710293041 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8800f040 con 0x55a629e7d4d0 2024-09-10T21:20:43.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.721+0000 7ffaa1efb740 1 -- 172.21.15.59:0/3710293041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7d4d0 msgr2=0x55a629e7d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:43.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.721+0000 7ffa9d8c2640 1 --2- 172.21.15.59:0/1650009042 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffa840b52e0 0x7ffa840b77a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55a629e7c1e0 tx=0x7ffa94008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:43.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.721+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/3710293041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7d4d0 0x55a629e7d8b0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800aed0 tx=0x7ffa8800a320 comp rx=0 tx=0).stop 2024-09-10T21:20:43.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.721+0000 7ffaa1efb740 1 -- 172.21.15.59:0/3710293041 shutdown_connections 2024-09-10T21:20:43.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.721+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/3710293041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e89d80 0x55a629e8c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.721+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/3710293041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e7ddf0 0x55a629e89840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.721+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/3710293041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7d4d0 0x55a629e7d8b0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.721+0000 7ffaa1efb740 1 -- 172.21.15.59:0/3710293041 >> 172.21.15.59:0/3710293041 conn(0x55a629e7b300 msgr2=0x55a629e7c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:43.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.721+0000 7ffaa1efb740 1 -- 172.21.15.59:0/3710293041 shutdown_connections 2024-09-10T21:20:43.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.721+0000 7ffaa1efb740 1 -- 172.21.15.59:0/3710293041 wait complete. 2024-09-10T21:20:43.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.721+0000 7ffaa1efb740 1 -- start start 2024-09-10T21:20:43.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.721+0000 7ffaa1efb740 1 Processor -- start 2024-09-10T21:20:43.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.722+0000 7ffaa1efb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e7d4d0 0x55a629e89690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:43.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.722+0000 7ffaa1efb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7ddf0 0x55a629e86ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:43.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.722+0000 7ffaa1efb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e89d80 0x55a629e87110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:43.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.722+0000 7ffaa1efb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a629c44700 con 0x55a629e7ddf0 2024-09-10T21:20:43.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.722+0000 7ffaa1efb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a629d7e160 con 0x55a629e7d4d0 2024-09-10T21:20:43.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.722+0000 7ffaa1efb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a629e8ca00 con 0x55a629e89d80 2024-09-10T21:20:43.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.722+0000 7ffaa1efb740 10 client.0 _ll_register_callbacks cb 0x55a629d979e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:43.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.722+0000 7ffa9d0c1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7ddf0 0x55a629e86ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:43.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.722+0000 7ffa9d0c1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7ddf0 0x55a629e86ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41894/0 (socket says 172.21.15.59:41894) 2024-09-10T21:20:43.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.722+0000 7ffa9d0c1640 1 -- 172.21.15.59:0/1814332913 learned_addr learned my addr 172.21.15.59:0/1814332913 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:43.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.722+0000 7ffa9d8c2640 1 --2- 172.21.15.59:0/1814332913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e7d4d0 0x55a629e89690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:43.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.722+0000 7ffa9e0c3640 1 --2- 172.21.15.59:0/1814332913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e89d80 0x55a629e87110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:43.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.722+0000 7ffa9d0c1640 1 -- 172.21.15.59:0/1814332913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e89d80 msgr2=0x55a629e87110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:43.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.722+0000 7ffa9d0c1640 1 --2- 172.21.15.59:0/1814332913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e89d80 0x55a629e87110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.722+0000 7ffa9d0c1640 1 -- 172.21.15.59:0/1814332913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e7d4d0 msgr2=0x55a629e89690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:43.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.722+0000 7ffa9d0c1640 1 --2- 172.21.15.59:0/1814332913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e7d4d0 0x55a629e89690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.722+0000 7ffa9d0c1640 1 -- 172.21.15.59:0/1814332913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a629dabc90 con 0x55a629e7ddf0 2024-09-10T21:20:43.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.722+0000 7ffa9d0c1640 1 --2- 172.21.15.59:0/1814332913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7ddf0 0x55a629e86ae0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ffa88016f40 tx=0x7ffa88016860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5cdd78a42f59dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:43.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.722+0000 7ffa817fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:43.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.723+0000 7ffa817fa640 1 -- 172.21.15.59:0/1814332913 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa88023070 con 0x55a629e7ddf0 2024-09-10T21:20:43.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.723+0000 7ffaa1efb740 1 -- 172.21.15.59:0/1814332913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa8800edc0 con 0x55a629e7ddf0 2024-09-10T21:20:43.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.723+0000 7ffa817fa640 1 -- 172.21.15.59:0/1814332913 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ffa88006ba0 con 0x55a629e7ddf0 2024-09-10T21:20:43.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.723+0000 7ffa817fa640 1 -- 172.21.15.59:0/1814332913 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffa8802f050 con 0x55a629e7ddf0 2024-09-10T21:20:43.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.723+0000 7ffaa1efb740 10 client.16710 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:43.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.723+0000 7ffaa1efb740 1 -- 172.21.15.59:0/1814332913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a629e98360 con 0x55a629e7ddf0 2024-09-10T21:20:43.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.723+0000 7ffa817fa640 1 -- 172.21.15.59:0/1814332913 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa8800edc0 con 0x55a629e7ddf0 2024-09-10T21:20:43.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.723+0000 7ffa817fa640 1 -- 172.21.15.59:0/1814332913 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffa8801e050 con 0x55a629e7ddf0 2024-09-10T21:20:43.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.723+0000 7ffaa1efb740 10 client.16710 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:43.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.723+0000 7ffaa1efb740 10 client.16710 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:20:43.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.723+0000 7ffaa1efb740 20 client.16710 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:43.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.723+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/1814332913 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55a629e99710 0x55a629e9bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:43.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.723+0000 7ffaa1efb740 4 client.16710 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:20:43.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.723+0000 7ffaa1efb740 1 -- 172.21.15.59:0/1814332913 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a629df5df0 con 0x55a629e99710 2024-09-10T21:20:43.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.724+0000 7ffa9d8c2640 1 --2- 172.21.15.59:0/1814332913 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55a629e99710 0x55a629e9bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:43.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.724+0000 7ffa9d8c2640 1 --2- 172.21.15.59:0/1814332913 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55a629e99710 0x55a629e9bb00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=124ea0af86f495a9 server_cookie=5e306e8d8293c49d in_seq=0 out_seq=0 2024-09-10T21:20:43.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.724+0000 7ffa817fa640 10 client.16710 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:20:43.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.725+0000 7ffa817fa640 1 -- 172.21.15.59:0/1814332913 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a629df5df0 con 0x55a629e99710 2024-09-10T21:20:43.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.725+0000 7ffa817fa640 10 client.16710 handle_command_reply: tid=0 2024-09-10T21:20:43.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.726+0000 7ffaa1efb740 1 client.16710 shutdown 2024-09-10T21:20:43.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.726+0000 7ffaa1efb740 1 -- 172.21.15.59:0/1814332913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7ddf0 msgr2=0x55a629e86ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:43.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.726+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/1814332913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7ddf0 0x55a629e86ae0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ffa88016f40 tx=0x7ffa88016860 comp rx=0 tx=0).stop 2024-09-10T21:20:43.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.726+0000 7ffaa1efb740 1 -- 172.21.15.59:0/1814332913 shutdown_connections 2024-09-10T21:20:43.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.726+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/1814332913 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55a629e99710 0x55a629e9bb00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.726+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/1814332913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e89d80 0x55a629e87110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.726+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/1814332913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7ddf0 0x55a629e86ae0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.726+0000 7ffa817fa640 0 client.16710 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:20:43.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.726+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/1814332913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e7d4d0 0x55a629e89690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.726+0000 7ffaa1efb740 1 -- 172.21.15.59:0/1814332913 >> 172.21.15.59:0/1814332913 conn(0x55a629e7b300 msgr2=0x55a629e80e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:43.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.726+0000 7ffaa1efb740 1 -- 172.21.15.59:0/1814332913 shutdown_connections 2024-09-10T21:20:43.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.726+0000 7ffaa1efb740 1 -- 172.21.15.59:0/1814332913 wait complete. 2024-09-10T21:20:43.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.726+0000 7ffaa1efb740 20 client.16710 trim_cache size 0 max 16384 2024-09-10T21:20:43.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.739+0000 7ffaa1efb740 1 Processor -- start 2024-09-10T21:20:43.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.739+0000 7ffaa1efb740 1 -- start start 2024-09-10T21:20:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffaa1efb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e7d4d0 0x55a629e76320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffaa1efb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7ddf0 0x55a629e7ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffaa1efb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e89d80 0x55a629e8b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffaa1efb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffa981ae3a0 con 0x55a629e7ddf0 2024-09-10T21:20:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffaa1efb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffa981afee0 con 0x55a629e7d4d0 2024-09-10T21:20:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffaa1efb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ffa981aea70 con 0x55a629e89d80 2024-09-10T21:20:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffa9d0c1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7ddf0 0x55a629e7ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffa9d0c1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7ddf0 0x55a629e7ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41908/0 (socket says 172.21.15.59:41908) 2024-09-10T21:20:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffa9d0c1640 1 -- 172.21.15.59:0/1589921662 learned_addr learned my addr 172.21.15.59:0/1589921662 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffa9d8c2640 1 --2- 172.21.15.59:0/1589921662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e7d4d0 0x55a629e76320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffa9e0c3640 1 --2- 172.21.15.59:0/1589921662 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e89d80 0x55a629e8b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffa9d0c1640 1 -- 172.21.15.59:0/1589921662 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e89d80 msgr2=0x55a629e8b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffa9d0c1640 1 --2- 172.21.15.59:0/1589921662 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e89d80 0x55a629e8b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffa9d0c1640 1 -- 172.21.15.59:0/1589921662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e7d4d0 msgr2=0x55a629e76320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffa9d0c1640 1 --2- 172.21.15.59:0/1589921662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e7d4d0 0x55a629e76320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffa9d0c1640 1 -- 172.21.15.59:0/1589921662 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a629e87480 con 0x55a629e7ddf0 2024-09-10T21:20:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffa9d8c2640 1 --2- 172.21.15.59:0/1589921662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e7d4d0 0x55a629e76320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:20:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffa9e0c3640 1 --2- 172.21.15.59:0/1589921662 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e89d80 0x55a629e8b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:20:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffa9d0c1640 1 --2- 172.21.15.59:0/1589921662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7ddf0 0x55a629e7ac10 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800a250 tx=0x7ffa8800a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de0a2e6164c7106 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffa837fe640 1 -- 172.21.15.59:0/1589921662 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa88023070 con 0x55a629e7ddf0 2024-09-10T21:20:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffa837fe640 1 -- 172.21.15.59:0/1589921662 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa88006ad0 con 0x55a629e7ddf0 2024-09-10T21:20:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.740+0000 7ffa837fe640 1 -- 172.21.15.59:0/1589921662 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8801b040 con 0x55a629e7ddf0 2024-09-10T21:20:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.741+0000 7ffaa1efb740 1 -- 172.21.15.59:0/1589921662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7ddf0 msgr2=0x55a629e7ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.741+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/1589921662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7ddf0 0x55a629e7ac10 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800a250 tx=0x7ffa8800a2f0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.741+0000 7ffaa1efb740 1 -- 172.21.15.59:0/1589921662 shutdown_connections 2024-09-10T21:20:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.741+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/1589921662 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e89d80 0x55a629e8b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.741+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/1589921662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e7ddf0 0x55a629e7ac10 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.741+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/1589921662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e7d4d0 0x55a629e76320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.741+0000 7ffaa1efb740 1 -- 172.21.15.59:0/1589921662 >> 172.21.15.59:0/1589921662 conn(0x55a629e7b300 msgr2=0x55a629e85360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.741+0000 7ffaa1efb740 1 -- 172.21.15.59:0/1589921662 shutdown_connections 2024-09-10T21:20:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.741+0000 7ffaa1efb740 1 -- 172.21.15.59:0/1589921662 wait complete. 2024-09-10T21:20:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.742+0000 7ffaa1efb740 1 -- start start 2024-09-10T21:20:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.742+0000 7ffaa1efb740 1 Processor -- start 2024-09-10T21:20:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.742+0000 7ffaa1efb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e7d4d0 0x55a629e91ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.742+0000 7ffaa1efb740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e7ddf0 0x55a629e921e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.742+0000 7ffaa1efb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e89d80 0x55a629e8cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.742+0000 7ffaa1efb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffa981af810 con 0x55a629e89d80 2024-09-10T21:20:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.742+0000 7ffaa1efb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffa981af140 con 0x55a629e7d4d0 2024-09-10T21:20:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.742+0000 7ffaa1efb740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ffa981ac380 con 0x55a629e7ddf0 2024-09-10T21:20:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.742+0000 7ffaa1efb740 10 client.0 _ll_register_callbacks cb 0x7ffa88019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:43.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.742+0000 7ffa9e0c3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e89d80 0x55a629e8cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.742+0000 7ffa9e0c3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e89d80 0x55a629e8cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41918/0 (socket says 172.21.15.59:41918) 2024-09-10T21:20:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.742+0000 7ffa9e0c3640 1 -- 172.21.15.59:0/2510756442 learned_addr learned my addr 172.21.15.59:0/2510756442 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.742+0000 7ffa9d0c1640 1 --2- 172.21.15.59:0/2510756442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e7ddf0 0x55a629e921e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.742+0000 7ffa9d8c2640 1 --2- 172.21.15.59:0/2510756442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e7d4d0 0x55a629e91ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.743+0000 7ffa9e0c3640 1 -- 172.21.15.59:0/2510756442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e7ddf0 msgr2=0x55a629e921e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.743+0000 7ffa9e0c3640 1 --2- 172.21.15.59:0/2510756442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e7ddf0 0x55a629e921e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.743+0000 7ffa9e0c3640 1 -- 172.21.15.59:0/2510756442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e7d4d0 msgr2=0x55a629e91ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.743+0000 7ffa9e0c3640 1 --2- 172.21.15.59:0/2510756442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e7d4d0 0x55a629e91ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.743+0000 7ffa9e0c3640 1 -- 172.21.15.59:0/2510756442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a629e8d190 con 0x55a629e89d80 2024-09-10T21:20:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.743+0000 7ffa9d8c2640 1 --2- 172.21.15.59:0/2510756442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e7d4d0 0x55a629e91ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.743+0000 7ffa9e0c3640 1 --2- 172.21.15.59:0/2510756442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e89d80 0x55a629e8cc50 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ffa90005fa0 tx=0x7ffa900cd3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120f1b8a737629b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.743+0000 7ffa817fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.743+0000 7ffa817fa640 1 -- 172.21.15.59:0/2510756442 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa900098d0 con 0x55a629e89d80 2024-09-10T21:20:43.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.743+0000 7ffa817fa640 1 -- 172.21.15.59:0/2510756442 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ffa900d6ca0 con 0x55a629e89d80 2024-09-10T21:20:43.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.743+0000 7ffaa1efb740 1 -- 172.21.15.59:0/2510756442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa88006ad0 con 0x55a629e89d80 2024-09-10T21:20:43.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.743+0000 7ffa817fa640 1 -- 172.21.15.59:0/2510756442 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffa9002f660 con 0x55a629e89d80 2024-09-10T21:20:43.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.743+0000 7ffaa1efb740 10 client.16716 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:43.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.743+0000 7ffaa1efb740 1 -- 172.21.15.59:0/2510756442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a629f06a70 con 0x55a629e89d80 2024-09-10T21:20:43.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.743+0000 7ffa817fa640 1 -- 172.21.15.59:0/2510756442 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa88006ad0 con 0x55a629e89d80 2024-09-10T21:20:43.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.743+0000 7ffa817fa640 1 -- 172.21.15.59:0/2510756442 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffa900cce00 con 0x55a629e89d80 2024-09-10T21:20:43.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.744+0000 7ffaa1efb740 10 client.16716 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:43.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.744+0000 7ffaa1efb740 10 client.16716 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:20:43.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.744+0000 7ffaa1efb740 20 client.16716 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:43.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.744+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/2510756442 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55a629f07190 0x55a629f09580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:43.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.744+0000 7ffaa1efb740 4 client.16716 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:20:43.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.744+0000 7ffaa1efb740 1 -- 172.21.15.59:0/2510756442 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a629df18a0 con 0x55a629f07190 2024-09-10T21:20:43.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.744+0000 7ffa9d8c2640 1 --2- 172.21.15.59:0/2510756442 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55a629f07190 0x55a629f09580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:43.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.744+0000 7ffa9d8c2640 1 --2- 172.21.15.59:0/2510756442 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55a629f07190 0x55a629f09580 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8441b2d2598179e8 server_cookie=41161cfc213a9e34 in_seq=0 out_seq=0 2024-09-10T21:20:43.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.744+0000 7ffa817fa640 10 client.16716 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:20:43.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.745+0000 7ffa817fa640 1 -- 172.21.15.59:0/2510756442 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a629df18a0 con 0x55a629f07190 2024-09-10T21:20:43.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.745+0000 7ffa817fa640 10 client.16716 handle_command_reply: tid=0 2024-09-10T21:20:43.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.745+0000 7ffaa1efb740 1 client.16716 shutdown 2024-09-10T21:20:43.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.745+0000 7ffaa1efb740 1 -- 172.21.15.59:0/2510756442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e89d80 msgr2=0x55a629e8cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:43.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.745+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/2510756442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e89d80 0x55a629e8cc50 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ffa90005fa0 tx=0x7ffa900cd3d0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.745+0000 7ffaa1efb740 1 -- 172.21.15.59:0/2510756442 shutdown_connections 2024-09-10T21:20:43.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.745+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/2510756442 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55a629f07190 0x55a629f09580 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.745+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/2510756442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a629e89d80 0x55a629e8cc50 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.745+0000 7ffa817fa640 0 client.16716 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:20:43.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.745+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/2510756442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a629e7ddf0 0x55a629e921e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.745+0000 7ffaa1efb740 1 --2- 172.21.15.59:0/2510756442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a629e7d4d0 0x55a629e91ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.745+0000 7ffaa1efb740 1 -- 172.21.15.59:0/2510756442 >> 172.21.15.59:0/2510756442 conn(0x55a629e7b300 msgr2=0x55a629e88110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:43.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.745+0000 7ffaa1efb740 1 -- 172.21.15.59:0/2510756442 shutdown_connections 2024-09-10T21:20:43.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.745+0000 7ffaa1efb740 1 -- 172.21.15.59:0/2510756442 wait complete. 2024-09-10T21:20:43.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.745+0000 7ffaa1efb740 20 client.16716 trim_cache size 0 max 16384 2024-09-10T21:20:43.766 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:20:43.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.746+0000 7ffa9fb26640 1 -- 172.21.15.59:0/1650009042 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffa840b52e0 msgr2=0x7ffa840b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:43.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.746+0000 7ffa9fb26640 1 --2- 172.21.15.59:0/1650009042 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffa840b52e0 0x7ffa840b77a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55a629e7c1e0 tx=0x7ffa94008040 comp rx=0 tx=0).stop 2024-09-10T21:20:43.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.746+0000 7ffa9fb26640 1 -- 172.21.15.59:0/1650009042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa98109150 msgr2=0x7ffa9819eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:43.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.746+0000 7ffa9fb26640 1 --2- 172.21.15.59:0/1650009042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa98109150 0x7ffa9819eca0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ffa90005cc0 tx=0x7ffa9002f470 comp rx=0 tx=0).stop 2024-09-10T21:20:43.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.746+0000 7ffa9fb26640 1 -- 172.21.15.59:0/1650009042 shutdown_connections 2024-09-10T21:20:43.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.746+0000 7ffa9fb26640 1 --2- 172.21.15.59:0/1650009042 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffa840b52e0 0x7ffa840b77a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.746+0000 7ffa9fb26640 1 --2- 172.21.15.59:0/1650009042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa98109150 0x7ffa9819eca0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.746+0000 7ffa9fb26640 1 --2- 172.21.15.59:0/1650009042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa981087d0 0x7ffa98199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.746+0000 7ffa9fb26640 1 --2- 172.21.15.59:0/1650009042 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa98102dc0 0x7ffa981993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:43.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.746+0000 7ffa9fb26640 1 -- 172.21.15.59:0/1650009042 >> 172.21.15.59:0/1650009042 conn(0x7ffa980fe830 msgr2=0x7ffa98100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:43.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.746+0000 7ffa9fb26640 1 -- 172.21.15.59:0/1650009042 shutdown_connections 2024-09-10T21:20:43.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:43.746+0000 7ffa9fb26640 1 -- 172.21.15.59:0/1650009042 wait complete. 2024-09-10T21:20:44.376 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:20:44.638 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:20:44.660 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:44 smithi059 ceph-mon[30888]: pgmap v504: 97 pgs: 97 active+clean; 3.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:44.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:44 smithi192 ceph-mon[35363]: pgmap v504: 97 pgs: 97 active+clean; 3.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:44.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:44 smithi154 ceph-mon[35041]: pgmap v504: 97 pgs: 97 active+clean; 3.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:45.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.106+0000 7f4eb95fe640 1 -- 172.21.15.59:0/3829032680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4eb4104530 msgr2=0x7f4eb410cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:45.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.106+0000 7f4eb95fe640 1 --2- 172.21.15.59:0/3829032680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4eb4104530 0x7f4eb410cb10 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009900 tx=0x7f4ea802a410 comp rx=0 tx=0).stop 2024-09-10T21:20:45.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.107+0000 7f4eb95fe640 1 -- 172.21.15.59:0/3829032680 shutdown_connections 2024-09-10T21:20:45.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.107+0000 7f4eb95fe640 1 --2- 172.21.15.59:0/3829032680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb410d0e0 0x7f4eb410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.107+0000 7f4eb95fe640 1 --2- 172.21.15.59:0/3829032680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4eb4104530 0x7f4eb410cb10 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.107+0000 7f4eb95fe640 1 --2- 172.21.15.59:0/3829032680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4eb4103b30 0x7f4eb4103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.107+0000 7f4eb95fe640 1 -- 172.21.15.59:0/3829032680 >> 172.21.15.59:0/3829032680 conn(0x7f4eb40fd700 msgr2=0x7f4eb40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:45.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.107+0000 7f4eb95fe640 1 -- 172.21.15.59:0/3829032680 shutdown_connections 2024-09-10T21:20:45.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.107+0000 7f4eb95fe640 1 -- 172.21.15.59:0/3829032680 wait complete. 2024-09-10T21:20:45.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.107+0000 7f4eb95fe640 1 Processor -- start 2024-09-10T21:20:45.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.107+0000 7f4eb95fe640 1 -- start start 2024-09-10T21:20:45.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.108+0000 7f4eb95fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb4103b30 0x7f4eb41019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:45.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.108+0000 7f4eb95fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4eb4104530 0x7f4eb4101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:45.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.108+0000 7f4eb95fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4eb410d0e0 0x7f4eb4102430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:45.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.108+0000 7f4eb95fe640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb4112d60 con 0x7f4eb4104530 2024-09-10T21:20:45.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.108+0000 7f4eb95fe640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb4112be0 con 0x7f4eb4103b30 2024-09-10T21:20:45.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.108+0000 7f4eb95fe640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb4112ee0 con 0x7f4eb410d0e0 2024-09-10T21:20:45.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.108+0000 7f4eb27fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4eb4104530 0x7f4eb4101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:45.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.108+0000 7f4eb2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb4103b30 0x7f4eb41019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:45.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.108+0000 7f4eb2ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb4103b30 0x7f4eb41019b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:36580/0 (socket says 172.21.15.59:36580) 2024-09-10T21:20:45.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.108+0000 7f4eb2ffd640 1 -- 172.21.15.59:0/3339450930 learned_addr learned my addr 172.21.15.59:0/3339450930 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:45.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.108+0000 7f4eb27fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4eb4104530 0x7f4eb4101ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41922/0 (socket says 172.21.15.59:41922) 2024-09-10T21:20:45.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.108+0000 7f4eb37fe640 1 --2- 172.21.15.59:0/3339450930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4eb410d0e0 0x7f4eb4102430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:45.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.108+0000 7f4eb27fc640 1 -- 172.21.15.59:0/3339450930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4eb410d0e0 msgr2=0x7f4eb4102430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:45.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.108+0000 7f4eb27fc640 1 --2- 172.21.15.59:0/3339450930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4eb410d0e0 0x7f4eb4102430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.108+0000 7f4eb27fc640 1 -- 172.21.15.59:0/3339450930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb4103b30 msgr2=0x7f4eb41019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:45.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.108+0000 7f4eb27fc640 1 --2- 172.21.15.59:0/3339450930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb4103b30 0x7f4eb41019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.108+0000 7f4eb27fc640 1 -- 172.21.15.59:0/3339450930 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb41a76f0 con 0x7f4eb4104530 2024-09-10T21:20:45.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.108+0000 7f4eb2ffd640 1 --2- 172.21.15.59:0/3339450930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb4103b30 0x7f4eb41019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:20:45.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.108+0000 7f4eb27fc640 1 --2- 172.21.15.59:0/3339450930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4eb4104530 0x7f4eb4101ef0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8006010 tx=0x7f4ea8004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:45.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.109+0000 7f4e9bfff640 1 -- 172.21.15.59:0/3339450930 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea803f070 con 0x7f4eb4104530 2024-09-10T21:20:45.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.109+0000 7f4e9bfff640 1 -- 172.21.15.59:0/3339450930 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ea8003ca0 con 0x7f4eb4104530 2024-09-10T21:20:45.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.109+0000 7f4e9bfff640 1 -- 172.21.15.59:0/3339450930 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8035070 con 0x7f4eb4104530 2024-09-10T21:20:45.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.109+0000 7f4eb95fe640 1 -- 172.21.15.59:0/3339450930 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb41a7980 con 0x7f4eb4104530 2024-09-10T21:20:45.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.109+0000 7f4eb95fe640 1 -- 172.21.15.59:0/3339450930 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb41a7e60 con 0x7f4eb4104530 2024-09-10T21:20:45.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.112+0000 7f4ebb9d3740 1 Processor -- start 2024-09-10T21:20:45.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.112+0000 7f4ebb9d3740 1 -- start start 2024-09-10T21:20:45.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.112+0000 7f4ebb9d3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efb80f0 0x56242efb84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:45.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.112+0000 7f4ebb9d3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efb8a10 0x56242efc4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:45.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.112+0000 7f4ebb9d3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efc49a0 0x56242efc6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:45.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.112+0000 7f4ebb9d3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56242ef2eea0 con 0x56242efc49a0 2024-09-10T21:20:45.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.112+0000 7f4ebb9d3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56242ef1e2d0 con 0x56242efb8a10 2024-09-10T21:20:45.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.112+0000 7f4ebb9d3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56242ef220e0 con 0x56242efb80f0 2024-09-10T21:20:45.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.112+0000 7f4e9bfff640 1 -- 172.21.15.59:0/3339450930 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f4ea804b060 con 0x7f4eb4104530 2024-09-10T21:20:45.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.112+0000 7f4eb27fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efc49a0 0x56242efc6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:45.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.112+0000 7f4eb27fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efc49a0 0x56242efc6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41928/0 (socket says 172.21.15.59:41928) 2024-09-10T21:20:45.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.112+0000 7f4eb27fc640 1 -- 172.21.15.59:0/1905520119 learned_addr learned my addr 172.21.15.59:0/1905520119 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:45.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.112+0000 7f4eb37fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efb80f0 0x56242efb84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:45.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.113+0000 7f4eb2ffd640 1 --2- 172.21.15.59:0/1905520119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efb8a10 0x56242efc4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:45.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.113+0000 7f4eb27fc640 1 -- 172.21.15.59:0/1905520119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efb80f0 msgr2=0x56242efb84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:45.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.113+0000 7f4eb27fc640 1 --2- 172.21.15.59:0/1905520119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efb80f0 0x56242efb84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.113+0000 7f4eb27fc640 1 -- 172.21.15.59:0/1905520119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efb8a10 msgr2=0x56242efc4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:45.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.113+0000 7f4eb27fc640 1 --2- 172.21.15.59:0/1905520119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efb8a10 0x56242efc4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.113+0000 7f4eb27fc640 1 -- 172.21.15.59:0/1905520119 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56242ec7c650 con 0x56242efc49a0 2024-09-10T21:20:45.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.113+0000 7f4eb2ffd640 1 --2- 172.21.15.59:0/1905520119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efb8a10 0x56242efc4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:45.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.113+0000 7f4eb37fe640 1 --2- 172.21.15.59:0/1905520119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efb80f0 0x56242efb84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:20:45.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.113+0000 7f4eb27fc640 1 --2- 172.21.15.59:0/1905520119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efc49a0 0x56242efc6d90 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8109e30 tx=0x7f4ea8109f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1fd8ee4d39e0aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:45.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.113+0000 7f4e9bfff640 1 --2- 172.21.15.59:0/3339450930 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4e9c0b52e0 0x7f4e9c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:45.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.113+0000 7f4e997fa640 1 -- 172.21.15.59:0/1905520119 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea810eb30 con 0x56242efc49a0 2024-09-10T21:20:45.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.113+0000 7f4e997fa640 1 -- 172.21.15.59:0/1905520119 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ea8113070 con 0x56242efc49a0 2024-09-10T21:20:45.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.113+0000 7f4eb37fe640 1 --2- 172.21.15.59:0/3339450930 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4e9c0b52e0 0x7f4e9c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:45.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.113+0000 7f4e997fa640 1 -- 172.21.15.59:0/1905520119 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8100c90 con 0x56242efc49a0 2024-09-10T21:20:45.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.113+0000 7f4e9bfff640 1 -- 172.21.15.59:0/3339450930 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4ea8105c90 con 0x7f4eb4104530 2024-09-10T21:20:45.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.114+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/1905520119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efc49a0 msgr2=0x56242efc6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:45.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.114+0000 7f4eb37fe640 1 --2- 172.21.15.59:0/3339450930 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4e9c0b52e0 0x7f4e9c0b77a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4103a70 tx=0x7f4eac00b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:45.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.114+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/1905520119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efc49a0 0x56242efc6d90 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8109e30 tx=0x7f4ea8109f20 comp rx=0 tx=0).stop 2024-09-10T21:20:45.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.114+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/1905520119 shutdown_connections 2024-09-10T21:20:45.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.114+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/1905520119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efc49a0 0x56242efc6d90 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.114+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/1905520119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efb8a10 0x56242efc4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.114+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/1905520119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efb80f0 0x56242efb84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.114+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/1905520119 >> 172.21.15.59:0/1905520119 conn(0x56242efb5f20 msgr2=0x56242efb70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.114+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/1905520119 shutdown_connections 2024-09-10T21:20:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.114+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/1905520119 wait complete. 2024-09-10T21:20:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.114+0000 7f4ebb9d3740 1 -- start start 2024-09-10T21:20:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.115+0000 7f4ebb9d3740 1 Processor -- start 2024-09-10T21:20:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.115+0000 7f4ebb9d3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efb80f0 0x56242efc4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.115+0000 7f4ebb9d3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efb8a10 0x56242efc16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.115+0000 7f4ebb9d3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efc49a0 0x56242efc1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.115+0000 7f4ebb9d3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56242ed7f700 con 0x56242efb8a10 2024-09-10T21:20:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.115+0000 7f4ebb9d3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56242eeb9160 con 0x56242efb80f0 2024-09-10T21:20:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.115+0000 7f4ebb9d3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56242efc73e0 con 0x56242efc49a0 2024-09-10T21:20:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.115+0000 7f4ebb9d3740 10 client.0 _ll_register_callbacks cb 0x56242eed29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.115+0000 7f4eb27fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efb8a10 0x56242efc16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:45.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.115+0000 7f4eb27fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efb8a10 0x56242efc16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41940/0 (socket says 172.21.15.59:41940) 2024-09-10T21:20:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.115+0000 7f4eb27fc640 1 -- 172.21.15.59:0/331688548 learned_addr learned my addr 172.21.15.59:0/331688548 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.115+0000 7f4eb2ffd640 1 --2- 172.21.15.59:0/331688548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efb80f0 0x56242efc4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.115+0000 7f4eb37fe640 1 --2- 172.21.15.59:0/331688548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efc49a0 0x56242efc1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.115+0000 7f4eb27fc640 1 -- 172.21.15.59:0/331688548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efc49a0 msgr2=0x56242efc1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.115+0000 7f4eb27fc640 1 --2- 172.21.15.59:0/331688548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efc49a0 0x56242efc1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.115+0000 7f4eb27fc640 1 -- 172.21.15.59:0/331688548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efb80f0 msgr2=0x56242efc4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.115+0000 7f4eb27fc640 1 --2- 172.21.15.59:0/331688548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efb80f0 0x56242efc4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.115+0000 7f4eb27fc640 1 -- 172.21.15.59:0/331688548 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56242eee6c90 con 0x56242efb8a10 2024-09-10T21:20:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.116+0000 7f4eb27fc640 1 --2- 172.21.15.59:0/331688548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efb8a10 0x56242efc16e0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80cc230 tx=0x7f4ea8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0451a9830d1dc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.116+0000 7f4e96ff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.116+0000 7f4e96ff5640 1 -- 172.21.15.59:0/331688548 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea808b1b0 con 0x56242efb8a10 2024-09-10T21:20:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.116+0000 7f4e96ff5640 1 -- 172.21.15.59:0/331688548 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4ea808d610 con 0x56242efb8a10 2024-09-10T21:20:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.116+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/331688548 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ea8113070 con 0x56242efb8a10 2024-09-10T21:20:45.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.116+0000 7f4e96ff5640 1 -- 172.21.15.59:0/331688548 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4ea8048020 con 0x56242efb8a10 2024-09-10T21:20:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.116+0000 7f4ebb9d3740 10 client.16728 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.116+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/331688548 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56242efd2c90 con 0x56242efb8a10 2024-09-10T21:20:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.116+0000 7f4e96ff5640 1 -- 172.21.15.59:0/331688548 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ea8113070 con 0x56242efb8a10 2024-09-10T21:20:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.116+0000 7f4e96ff5640 1 -- 172.21.15.59:0/331688548 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4ea810b050 con 0x56242efb8a10 2024-09-10T21:20:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.116+0000 7f4ebb9d3740 10 client.16728 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.116+0000 7f4ebb9d3740 10 client.16728 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:20:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.116+0000 7f4ebb9d3740 20 client.16728 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.116+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/331688548 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56242efd3e10 0x56242efd6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.116+0000 7f4ebb9d3740 4 client.16728 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:20:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.116+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/331688548 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56242ef30df0 con 0x56242efd3e10 2024-09-10T21:20:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.117+0000 7f4eb2ffd640 1 --2- 172.21.15.59:0/331688548 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56242efd3e10 0x56242efd6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.117+0000 7f4e96ff5640 10 client.16728 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:20:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.117+0000 7f4eb2ffd640 1 --2- 172.21.15.59:0/331688548 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56242efd3e10 0x56242efd6200 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c0eabcbde272dda6 server_cookie=c33902679ab90128 in_seq=0 out_seq=0 2024-09-10T21:20:45.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.118+0000 7f4e96ff5640 1 -- 172.21.15.59:0/331688548 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56242ef30df0 con 0x56242efd3e10 2024-09-10T21:20:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.118+0000 7f4e96ff5640 10 client.16728 handle_command_reply: tid=0 2024-09-10T21:20:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.118+0000 7f4ebb9d3740 1 client.16728 shutdown 2024-09-10T21:20:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.118+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/331688548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efb8a10 msgr2=0x56242efc16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.118+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/331688548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efb8a10 0x56242efc16e0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80cc230 tx=0x7f4ea8000bc0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.118+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/331688548 shutdown_connections 2024-09-10T21:20:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.118+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/331688548 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56242efd3e10 0x56242efd6200 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.118+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/331688548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efc49a0 0x56242efc1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.118+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/331688548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efb8a10 0x56242efc16e0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.118+0000 7f4e96ff5640 0 client.16728 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:20:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.118+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/331688548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efb80f0 0x56242efc4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.118+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/331688548 >> 172.21.15.59:0/331688548 conn(0x56242efb5f20 msgr2=0x56242efbba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.118+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/331688548 shutdown_connections 2024-09-10T21:20:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.118+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/331688548 wait complete. 2024-09-10T21:20:45.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.118+0000 7f4ebb9d3740 20 client.16728 trim_cache size 0 max 16384 2024-09-10T21:20:45.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.132+0000 7f4ebb9d3740 1 Processor -- start 2024-09-10T21:20:45.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.132+0000 7f4ebb9d3740 1 -- start start 2024-09-10T21:20:45.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.132+0000 7f4ebb9d3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efb80f0 0x56242efd05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:45.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.132+0000 7f4ebb9d3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efb8a10 0x56242efb7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:45.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.132+0000 7f4ebb9d3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efc49a0 0x56242efbe8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:45.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.132+0000 7f4ebb9d3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb41b0520 con 0x56242efb80f0 2024-09-10T21:20:45.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.132+0000 7f4ebb9d3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb41b2060 con 0x56242efc49a0 2024-09-10T21:20:45.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.132+0000 7f4ebb9d3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb41b0bf0 con 0x56242efb8a10 2024-09-10T21:20:45.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.132+0000 7f4eb2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efb80f0 0x56242efd05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:45.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.132+0000 7f4eb2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efb80f0 0x56242efd05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41942/0 (socket says 172.21.15.59:41942) 2024-09-10T21:20:45.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.132+0000 7f4eb2ffd640 1 -- 172.21.15.59:0/2962442622 learned_addr learned my addr 172.21.15.59:0/2962442622 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:45.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.132+0000 7f4eb27fc640 1 --2- 172.21.15.59:0/2962442622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efb8a10 0x56242efb7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:45.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.132+0000 7f4eb37fe640 1 --2- 172.21.15.59:0/2962442622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efc49a0 0x56242efbe8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:45.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.132+0000 7f4eb2ffd640 1 -- 172.21.15.59:0/2962442622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efb8a10 msgr2=0x56242efb7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:45.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.132+0000 7f4eb2ffd640 1 --2- 172.21.15.59:0/2962442622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efb8a10 0x56242efb7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.132+0000 7f4eb2ffd640 1 -- 172.21.15.59:0/2962442622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efc49a0 msgr2=0x56242efbe8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:45.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.132+0000 7f4eb2ffd640 1 --2- 172.21.15.59:0/2962442622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efc49a0 0x56242efbe8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.132+0000 7f4eb2ffd640 1 -- 172.21.15.59:0/2962442622 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56242efc2080 con 0x56242efb80f0 2024-09-10T21:20:45.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.132+0000 7f4eb37fe640 1 --2- 172.21.15.59:0/2962442622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efc49a0 0x56242efbe8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:20:45.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.133+0000 7f4eb2ffd640 1 --2- 172.21.15.59:0/2962442622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efb80f0 0x56242efd05d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x56242efd6890 tx=0x7f4ea4009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7d8952c38f8ae5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:45.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.133+0000 7f4e98ff9640 1 -- 172.21.15.59:0/2962442622 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4010e20 con 0x56242efb80f0 2024-09-10T21:20:45.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.133+0000 7f4e98ff9640 1 -- 172.21.15.59:0/2962442622 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ea4005020 con 0x56242efb80f0 2024-09-10T21:20:45.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.133+0000 7f4e98ff9640 1 -- 172.21.15.59:0/2962442622 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea401d670 con 0x56242efb80f0 2024-09-10T21:20:45.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.133+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/2962442622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efb80f0 msgr2=0x56242efd05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:45.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.133+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/2962442622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efb80f0 0x56242efd05d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x56242efd6890 tx=0x7f4ea4009500 comp rx=0 tx=0).stop 2024-09-10T21:20:45.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.133+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/2962442622 shutdown_connections 2024-09-10T21:20:45.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.133+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/2962442622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efc49a0 0x56242efbe8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.133+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/2962442622 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efb8a10 0x56242efb7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.133+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/2962442622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efb80f0 0x56242efd05d0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.133+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/2962442622 >> 172.21.15.59:0/2962442622 conn(0x56242efb5f20 msgr2=0x56242efb6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.133+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/2962442622 shutdown_connections 2024-09-10T21:20:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.133+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/2962442622 wait complete. 2024-09-10T21:20:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.134+0000 7f4ebb9d3740 1 -- start start 2024-09-10T21:20:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.134+0000 7f4ebb9d3740 1 Processor -- start 2024-09-10T21:20:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.134+0000 7f4ebb9d3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efb80f0 0x56242efccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.134+0000 7f4ebb9d3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efb8a10 0x56242efc75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.134+0000 7f4ebb9d3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efc49a0 0x56242efc7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.134+0000 7f4ebb9d3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb41b1990 con 0x56242efc49a0 2024-09-10T21:20:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.134+0000 7f4ebb9d3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb41b12c0 con 0x56242efb8a10 2024-09-10T21:20:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.134+0000 7f4ebb9d3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb41ae500 con 0x56242efb80f0 2024-09-10T21:20:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.134+0000 7f4ebb9d3740 10 client.0 _ll_register_callbacks cb 0x7f4eac004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.134+0000 7f4eb37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efc49a0 0x56242efc7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:45.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.134+0000 7f4eb37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efc49a0 0x56242efc7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41946/0 (socket says 172.21.15.59:41946) 2024-09-10T21:20:45.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.134+0000 7f4eb37fe640 1 -- 172.21.15.59:0/3465594215 learned_addr learned my addr 172.21.15.59:0/3465594215 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:45.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.135+0000 7f4eb2ffd640 1 --2- 172.21.15.59:0/3465594215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efb80f0 0x56242efccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:45.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.135+0000 7f4eb27fc640 1 --2- 172.21.15.59:0/3465594215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efb8a10 0x56242efc75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:45.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.135+0000 7f4eb37fe640 1 -- 172.21.15.59:0/3465594215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efb80f0 msgr2=0x56242efccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:45.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.135+0000 7f4eb37fe640 1 --2- 172.21.15.59:0/3465594215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efb80f0 0x56242efccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.135+0000 7f4eb37fe640 1 -- 172.21.15.59:0/3465594215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efb8a10 msgr2=0x56242efc75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:45.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.135+0000 7f4eb37fe640 1 --2- 172.21.15.59:0/3465594215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efb8a10 0x56242efc75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.135+0000 7f4eb37fe640 1 -- 172.21.15.59:0/3465594215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56242efc82a0 con 0x56242efc49a0 2024-09-10T21:20:45.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.135+0000 7f4eb37fe640 1 --2- 172.21.15.59:0/3465594215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efc49a0 0x56242efc7b30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00bfd0 tx=0x7f4eac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328817cdbf8602ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:45.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.135+0000 7f4e96ff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:45.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.135+0000 7f4e96ff5640 1 -- 172.21.15.59:0/3465594215 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac02c060 con 0x56242efc49a0 2024-09-10T21:20:45.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.135+0000 7f4e96ff5640 1 -- 172.21.15.59:0/3465594215 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4eac01cce0 con 0x56242efc49a0 2024-09-10T21:20:45.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.135+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/3465594215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ea4005020 con 0x56242efc49a0 2024-09-10T21:20:45.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.135+0000 7f4e96ff5640 1 -- 172.21.15.59:0/3465594215 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4eac027400 con 0x56242efc49a0 2024-09-10T21:20:45.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.135+0000 7f4ebb9d3740 10 client.16734 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:45.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.135+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/3465594215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56242f041a40 con 0x56242efc49a0 2024-09-10T21:20:45.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.136+0000 7f4e96ff5640 1 -- 172.21.15.59:0/3465594215 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ea4005020 con 0x56242efc49a0 2024-09-10T21:20:45.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.136+0000 7f4e96ff5640 1 -- 172.21.15.59:0/3465594215 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4eac010550 con 0x56242efc49a0 2024-09-10T21:20:45.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.136+0000 7f4ebb9d3740 10 client.16734 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:45.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.136+0000 7f4ebb9d3740 10 client.16734 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:20:45.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.136+0000 7f4ebb9d3740 20 client.16734 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:45.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.136+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/3465594215 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56242f042220 0x56242f044640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:45.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.136+0000 7f4ebb9d3740 4 client.16734 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:20:45.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.136+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/3465594215 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56242ef2c8a0 con 0x56242f042220 2024-09-10T21:20:45.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.136+0000 7f4eb2ffd640 1 --2- 172.21.15.59:0/3465594215 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56242f042220 0x56242f044640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:45.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.136+0000 7f4e96ff5640 10 client.16734 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:20:45.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.136+0000 7f4eb2ffd640 1 --2- 172.21.15.59:0/3465594215 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56242f042220 0x56242f044640 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3d9c122fac6c945f server_cookie=880658e79156807d in_seq=0 out_seq=0 2024-09-10T21:20:45.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.137+0000 7f4e96ff5640 1 -- 172.21.15.59:0/3465594215 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56242ef2c8a0 con 0x56242f042220 2024-09-10T21:20:45.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.137+0000 7f4e96ff5640 10 client.16734 handle_command_reply: tid=0 2024-09-10T21:20:45.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.137+0000 7f4ebb9d3740 1 client.16734 shutdown 2024-09-10T21:20:45.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.137+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/3465594215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efc49a0 msgr2=0x56242efc7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:45.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.137+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/3465594215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efc49a0 0x56242efc7b30 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00bfd0 tx=0x7f4eac004730 comp rx=0 tx=0).stop 2024-09-10T21:20:45.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.137+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/3465594215 shutdown_connections 2024-09-10T21:20:45.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.137+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/3465594215 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56242f042220 0x56242f044640 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.137+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/3465594215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242efc49a0 0x56242efc7b30 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.137+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/3465594215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56242efb8a10 0x56242efc75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.137+0000 7f4e96ff5640 0 client.16734 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:20:45.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.137+0000 7f4ebb9d3740 1 --2- 172.21.15.59:0/3465594215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56242efb80f0 0x56242efccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.137+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/3465594215 >> 172.21.15.59:0/3465594215 conn(0x56242efb5f20 msgr2=0x56242efc2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:45.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.137+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/3465594215 shutdown_connections 2024-09-10T21:20:45.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.137+0000 7f4ebb9d3740 1 -- 172.21.15.59:0/3465594215 wait complete. 2024-09-10T21:20:45.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.137+0000 7f4ebb9d3740 20 client.16734 trim_cache size 0 max 16384 2024-09-10T21:20:45.147 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:20:45.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.137+0000 7f4eb95fe640 1 -- 172.21.15.59:0/3339450930 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4e9c0b52e0 msgr2=0x7f4e9c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:45.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.137+0000 7f4eb95fe640 1 --2- 172.21.15.59:0/3339450930 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4e9c0b52e0 0x7f4e9c0b77a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4103a70 tx=0x7f4eac00b2e0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.137+0000 7f4eb95fe640 1 -- 172.21.15.59:0/3339450930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4eb4104530 msgr2=0x7f4eb4101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:45.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.137+0000 7f4eb95fe640 1 --2- 172.21.15.59:0/3339450930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4eb4104530 0x7f4eb4101ef0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8006010 tx=0x7f4ea8004060 comp rx=0 tx=0).stop 2024-09-10T21:20:45.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.138+0000 7f4eb95fe640 1 -- 172.21.15.59:0/3339450930 shutdown_connections 2024-09-10T21:20:45.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.138+0000 7f4eb95fe640 1 --2- 172.21.15.59:0/3339450930 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4e9c0b52e0 0x7f4e9c0b77a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.138+0000 7f4eb95fe640 1 --2- 172.21.15.59:0/3339450930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4eb410d0e0 0x7f4eb4102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.138+0000 7f4eb95fe640 1 --2- 172.21.15.59:0/3339450930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4eb4104530 0x7f4eb4101ef0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.138+0000 7f4eb95fe640 1 --2- 172.21.15.59:0/3339450930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4eb4103b30 0x7f4eb41019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:45.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.138+0000 7f4eb95fe640 1 -- 172.21.15.59:0/3339450930 >> 172.21.15.59:0/3339450930 conn(0x7f4eb40fd700 msgr2=0x7f4eb40fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:45.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.138+0000 7f4eb95fe640 1 -- 172.21.15.59:0/3339450930 shutdown_connections 2024-09-10T21:20:45.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:45.138+0000 7f4eb95fe640 1 -- 172.21.15.59:0/3339450930 wait complete. 2024-09-10T21:20:45.839 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:20:46.095 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:20:46.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.594+0000 7f6d40210640 1 -- 172.21.15.59:0/844805755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d38109150 msgr2=0x7f6d3810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:46.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.594+0000 7f6d40210640 1 --2- 172.21.15.59:0/844805755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d38109150 0x7f6d3810f950 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009ca0 tx=0x7f6d3002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.594+0000 7f6d40210640 1 -- 172.21.15.59:0/844805755 shutdown_connections 2024-09-10T21:20:46.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.594+0000 7f6d40210640 1 --2- 172.21.15.59:0/844805755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d38109150 0x7f6d3810f950 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.594+0000 7f6d40210640 1 --2- 172.21.15.59:0/844805755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d381087d0 0x7f6d38108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.594+0000 7f6d40210640 1 --2- 172.21.15.59:0/844805755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d38102dc0 0x7f6d381031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.594+0000 7f6d40210640 1 -- 172.21.15.59:0/844805755 >> 172.21.15.59:0/844805755 conn(0x7f6d380fe830 msgr2=0x7f6d38100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:46.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.594+0000 7f6d40210640 1 -- 172.21.15.59:0/844805755 shutdown_connections 2024-09-10T21:20:46.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.594+0000 7f6d40210640 1 -- 172.21.15.59:0/844805755 wait complete. 2024-09-10T21:20:46.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.595+0000 7f6d40210640 1 Processor -- start 2024-09-10T21:20:46.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.595+0000 7f6d40210640 1 -- start start 2024-09-10T21:20:46.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.595+0000 7f6d40210640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d38102dc0 0x7f6d3810ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:46.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.595+0000 7f6d40210640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d381087d0 0x7f6d3810f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:46.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.596+0000 7f6d40210640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d38109150 0x7f6d381a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:46.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.596+0000 7f6d40210640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6d38112dd0 con 0x7f6d38109150 2024-09-10T21:20:46.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.596+0000 7f6d40210640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d38112c50 con 0x7f6d38102dc0 2024-09-10T21:20:46.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.596+0000 7f6d40210640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6d38112f50 con 0x7f6d381087d0 2024-09-10T21:20:46.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.596+0000 7f6d3e7ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d38109150 0x7f6d381a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:46.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.596+0000 7f6d3e7ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d38109150 0x7f6d381a1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41972/0 (socket says 172.21.15.59:41972) 2024-09-10T21:20:46.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.596+0000 7f6d3e7ad640 1 -- 172.21.15.59:0/1881462219 learned_addr learned my addr 172.21.15.59:0/1881462219 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:46.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.596+0000 7f6d3d7ab640 1 --2- 172.21.15.59:0/1881462219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d381087d0 0x7f6d3810f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:46.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.596+0000 7f6d3dfac640 1 --2- 172.21.15.59:0/1881462219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d38102dc0 0x7f6d3810ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:46.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.596+0000 7f6d3e7ad640 1 -- 172.21.15.59:0/1881462219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d381087d0 msgr2=0x7f6d3810f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:46.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.596+0000 7f6d3e7ad640 1 --2- 172.21.15.59:0/1881462219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d381087d0 0x7f6d3810f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.596+0000 7f6d3e7ad640 1 -- 172.21.15.59:0/1881462219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d38102dc0 msgr2=0x7f6d3810ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:46.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.596+0000 7f6d3e7ad640 1 --2- 172.21.15.59:0/1881462219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d38102dc0 0x7f6d3810ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.596+0000 7f6d3e7ad640 1 -- 172.21.15.59:0/1881462219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d381a25e0 con 0x7f6d38109150 2024-09-10T21:20:46.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.596+0000 7f6d3e7ad640 1 --2- 172.21.15.59:0/1881462219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d38109150 0x7f6d381a1e60 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6d30005cc0 tx=0x7f6d3002f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:46.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.597+0000 7f6d2effd640 1 -- 172.21.15.59:0/1881462219 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d30003cf0 con 0x7f6d38109150 2024-09-10T21:20:46.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.597+0000 7f6d40210640 1 -- 172.21.15.59:0/1881462219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d381a2870 con 0x7f6d38109150 2024-09-10T21:20:46.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.597+0000 7f6d2effd640 1 -- 172.21.15.59:0/1881462219 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d300044f0 con 0x7f6d38109150 2024-09-10T21:20:46.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.597+0000 7f6d2effd640 1 -- 172.21.15.59:0/1881462219 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3002fc30 con 0x7f6d38109150 2024-09-10T21:20:46.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.597+0000 7f6d40210640 1 -- 172.21.15.59:0/1881462219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d381ac240 con 0x7f6d38109150 2024-09-10T21:20:46.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.599+0000 7f6d425e5740 1 Processor -- start 2024-09-10T21:20:46.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.599+0000 7f6d2effd640 1 -- 172.21.15.59:0/1881462219 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f6d30004040 con 0x7f6d38109150 2024-09-10T21:20:46.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.600+0000 7f6d425e5740 1 -- start start 2024-09-10T21:20:46.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.600+0000 7f6d425e5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d82854d0 0x5617d82858b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:46.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.600+0000 7f6d425e5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 0x5617d8291840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:46.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.600+0000 7f6d425e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d8291d80 0x5617d8294170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:46.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.600+0000 7f6d425e5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5617d81fbea0 con 0x5617d8285df0 2024-09-10T21:20:46.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.600+0000 7f6d425e5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5617d81eb2d0 con 0x5617d8291d80 2024-09-10T21:20:46.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.600+0000 7f6d425e5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5617d81ef0e0 con 0x5617d82854d0 2024-09-10T21:20:46.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.600+0000 7f6d3dfac640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 0x5617d8291840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:46.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.600+0000 7f6d3dfac640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 0x5617d8291840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41976/0 (socket says 172.21.15.59:41976) 2024-09-10T21:20:46.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.600+0000 7f6d3dfac640 1 -- 172.21.15.59:0/1222314907 learned_addr learned my addr 172.21.15.59:0/1222314907 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:46.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.600+0000 7f6d3d7ab640 1 --2- 172.21.15.59:0/1222314907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d82854d0 0x5617d82858b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:46.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.600+0000 7f6d3dfac640 1 -- 172.21.15.59:0/1222314907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d82854d0 msgr2=0x5617d82858b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:46.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.600+0000 7f6d3dfac640 1 --2- 172.21.15.59:0/1222314907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d82854d0 0x5617d82858b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.600+0000 7f6d3dfac640 1 -- 172.21.15.59:0/1222314907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d8291d80 msgr2=0x5617d8294170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:46.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.600+0000 7f6d3d7ab640 1 --2- 172.21.15.59:0/1222314907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d8291d80 0x5617d8294170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:46.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.600+0000 7f6d3dfac640 1 --2- 172.21.15.59:0/1222314907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d8291d80 0x5617d8294170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.600+0000 7f6d3dfac640 1 -- 172.21.15.59:0/1222314907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617d7f49650 con 0x5617d8285df0 2024-09-10T21:20:46.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.600+0000 7f6d2effd640 1 --2- 172.21.15.59:0/1881462219 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6d240b52e0 0x7f6d240b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:46.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.601+0000 7f6d3d7ab640 1 --2- 172.21.15.59:0/1881462219 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6d240b52e0 0x7f6d240b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:46.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.601+0000 7f6d3dfac640 1 --2- 172.21.15.59:0/1222314907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 0x5617d8291840 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400ad00 tx=0x7f6d3400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3eb4cd20a67f10 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:46.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.601+0000 7f6d2effd640 1 -- 172.21.15.59:0/1881462219 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6d30106fd0 con 0x7f6d38109150 2024-09-10T21:20:46.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.601+0000 7f6d23fff640 1 -- 172.21.15.59:0/1222314907 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3401d070 con 0x5617d8285df0 2024-09-10T21:20:46.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.601+0000 7f6d23fff640 1 -- 172.21.15.59:0/1222314907 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d34018af0 con 0x5617d8285df0 2024-09-10T21:20:46.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.601+0000 7f6d23fff640 1 -- 172.21.15.59:0/1222314907 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d34010b90 con 0x5617d8285df0 2024-09-10T21:20:46.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.602+0000 7f6d425e5740 1 -- 172.21.15.59:0/1222314907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 msgr2=0x5617d8291840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:46.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.602+0000 7f6d3d7ab640 1 --2- 172.21.15.59:0/1881462219 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6d240b52e0 0x7f6d240b77a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800a5c0 tx=0x7f6d2800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:46.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.602+0000 7f6d425e5740 1 --2- 172.21.15.59:0/1222314907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 0x5617d8291840 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400ad00 tx=0x7f6d3400f790 comp rx=0 tx=0).stop 2024-09-10T21:20:46.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.602+0000 7f6d425e5740 1 -- 172.21.15.59:0/1222314907 shutdown_connections 2024-09-10T21:20:46.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.602+0000 7f6d425e5740 1 --2- 172.21.15.59:0/1222314907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d8291d80 0x5617d8294170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.602+0000 7f6d425e5740 1 --2- 172.21.15.59:0/1222314907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 0x5617d8291840 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.602+0000 7f6d425e5740 1 --2- 172.21.15.59:0/1222314907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d82854d0 0x5617d82858b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.602+0000 7f6d425e5740 1 -- 172.21.15.59:0/1222314907 >> 172.21.15.59:0/1222314907 conn(0x5617d8283300 msgr2=0x5617d82844a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:46.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.602+0000 7f6d425e5740 1 -- 172.21.15.59:0/1222314907 shutdown_connections 2024-09-10T21:20:46.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.602+0000 7f6d425e5740 1 -- 172.21.15.59:0/1222314907 wait complete. 2024-09-10T21:20:46.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.602+0000 7f6d425e5740 1 -- start start 2024-09-10T21:20:46.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.602+0000 7f6d425e5740 1 Processor -- start 2024-09-10T21:20:46.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d425e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d82854d0 0x5617d8291620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:46.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d425e5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 0x5617d828ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:46.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d425e5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d8291d80 0x5617d828f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:46.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d425e5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5617d804c700 con 0x5617d8285df0 2024-09-10T21:20:46.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d425e5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5617d8186160 con 0x5617d82854d0 2024-09-10T21:20:46.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d425e5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5617d8294a00 con 0x5617d8291d80 2024-09-10T21:20:46.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d425e5740 10 client.0 _ll_register_callbacks cb 0x5617d819f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:46.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d3d7ab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 0x5617d828ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:46.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d3d7ab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 0x5617d828ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41986/0 (socket says 172.21.15.59:41986) 2024-09-10T21:20:46.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d3d7ab640 1 -- 172.21.15.59:0/1275380108 learned_addr learned my addr 172.21.15.59:0/1275380108 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:46.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d3e7ad640 1 --2- 172.21.15.59:0/1275380108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d8291d80 0x5617d828f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:46.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d3dfac640 1 --2- 172.21.15.59:0/1275380108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d82854d0 0x5617d8291620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:46.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d3d7ab640 1 -- 172.21.15.59:0/1275380108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d8291d80 msgr2=0x5617d828f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:46.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d3d7ab640 1 --2- 172.21.15.59:0/1275380108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d8291d80 0x5617d828f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d3d7ab640 1 -- 172.21.15.59:0/1275380108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d82854d0 msgr2=0x5617d8291620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:46.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d3d7ab640 1 --2- 172.21.15.59:0/1275380108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d82854d0 0x5617d8291620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d3d7ab640 1 -- 172.21.15.59:0/1275380108 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617d81b3c90 con 0x5617d8285df0 2024-09-10T21:20:46.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d3e7ad640 1 --2- 172.21.15.59:0/1275380108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d8291d80 0x5617d828f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:20:46.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d3d7ab640 1 --2- 172.21.15.59:0/1275380108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 0x5617d828ea70 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6d2801b770 tx=0x7f6d2800a550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21b1ada5a975d23 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:46.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.603+0000 7f6d217fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:46.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.604+0000 7f6d217fa640 1 -- 172.21.15.59:0/1275380108 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2801be20 con 0x5617d8285df0 2024-09-10T21:20:46.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.604+0000 7f6d217fa640 1 -- 172.21.15.59:0/1275380108 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6d28015030 con 0x5617d8285df0 2024-09-10T21:20:46.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.604+0000 7f6d425e5740 1 -- 172.21.15.59:0/1275380108 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d34018af0 con 0x5617d8285df0 2024-09-10T21:20:46.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.604+0000 7f6d217fa640 1 -- 172.21.15.59:0/1275380108 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6d28005020 con 0x5617d8285df0 2024-09-10T21:20:46.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.604+0000 7f6d425e5740 10 client.16746 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:46.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.604+0000 7f6d425e5740 1 -- 172.21.15.59:0/1275380108 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5617d82a0350 con 0x5617d8285df0 2024-09-10T21:20:46.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.604+0000 7f6d217fa640 1 -- 172.21.15.59:0/1275380108 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d34018af0 con 0x5617d8285df0 2024-09-10T21:20:46.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.604+0000 7f6d217fa640 1 -- 172.21.15.59:0/1275380108 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6d28032480 con 0x5617d8285df0 2024-09-10T21:20:46.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.604+0000 7f6d425e5740 10 client.16746 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:46.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.604+0000 7f6d425e5740 10 client.16746 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:20:46.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.604+0000 7f6d425e5740 20 client.16746 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:46.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.604+0000 7f6d425e5740 1 --2- 172.21.15.59:0/1275380108 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5617d82a1820 0x5617d82a3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:46.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.604+0000 7f6d425e5740 4 client.16746 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:20:46.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.604+0000 7f6d425e5740 1 -- 172.21.15.59:0/1275380108 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617d81fddf0 con 0x5617d82a1820 2024-09-10T21:20:46.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.605+0000 7f6d3dfac640 1 --2- 172.21.15.59:0/1275380108 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5617d82a1820 0x5617d82a3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:46.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.605+0000 7f6d3dfac640 1 --2- 172.21.15.59:0/1275380108 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5617d82a1820 0x5617d82a3ce0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9c37c7a9b34e20ed server_cookie=a3d54f25832bc695 in_seq=0 out_seq=0 2024-09-10T21:20:46.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.605+0000 7f6d217fa640 10 client.16746 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:20:46.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.606+0000 7f6d217fa640 1 -- 172.21.15.59:0/1275380108 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5617d81fddf0 con 0x5617d82a1820 2024-09-10T21:20:46.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.606+0000 7f6d217fa640 10 client.16746 handle_command_reply: tid=0 2024-09-10T21:20:46.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.606+0000 7f6d425e5740 1 client.16746 shutdown 2024-09-10T21:20:46.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.606+0000 7f6d425e5740 1 -- 172.21.15.59:0/1275380108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 msgr2=0x5617d828ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:46.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.606+0000 7f6d425e5740 1 --2- 172.21.15.59:0/1275380108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 0x5617d828ea70 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6d2801b770 tx=0x7f6d2800a550 comp rx=0 tx=0).stop 2024-09-10T21:20:46.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.606+0000 7f6d425e5740 1 -- 172.21.15.59:0/1275380108 shutdown_connections 2024-09-10T21:20:46.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.606+0000 7f6d425e5740 1 --2- 172.21.15.59:0/1275380108 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5617d82a1820 0x5617d82a3ce0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.606+0000 7f6d425e5740 1 --2- 172.21.15.59:0/1275380108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d8291d80 0x5617d828f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.606+0000 7f6d425e5740 1 --2- 172.21.15.59:0/1275380108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 0x5617d828ea70 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.606+0000 7f6d217fa640 0 client.16746 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:20:46.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.606+0000 7f6d425e5740 1 --2- 172.21.15.59:0/1275380108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d82854d0 0x5617d8291620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.606+0000 7f6d425e5740 1 -- 172.21.15.59:0/1275380108 >> 172.21.15.59:0/1275380108 conn(0x5617d8283300 msgr2=0x5617d8288ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:46.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.606+0000 7f6d425e5740 1 -- 172.21.15.59:0/1275380108 shutdown_connections 2024-09-10T21:20:46.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.606+0000 7f6d425e5740 1 -- 172.21.15.59:0/1275380108 wait complete. 2024-09-10T21:20:46.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.606+0000 7f6d425e5740 20 client.16746 trim_cache size 0 max 16384 2024-09-10T21:20:46.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.619+0000 7f6d425e5740 1 Processor -- start 2024-09-10T21:20:46.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.620+0000 7f6d425e5740 1 -- start start 2024-09-10T21:20:46.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.620+0000 7f6d425e5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d82854d0 0x5617d829dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:46.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.620+0000 7f6d425e5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 0x5617d8284a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:46.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.620+0000 7f6d425e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d8291d80 0x5617d82907b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:46.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.620+0000 7f6d425e5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6d381b4820 con 0x5617d8285df0 2024-09-10T21:20:46.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.620+0000 7f6d425e5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d381b6360 con 0x5617d8291d80 2024-09-10T21:20:46.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.620+0000 7f6d425e5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6d381b4ef0 con 0x5617d82854d0 2024-09-10T21:20:46.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.620+0000 7f6d3d7ab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 0x5617d8284a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:46.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.620+0000 7f6d3d7ab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 0x5617d8284a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41994/0 (socket says 172.21.15.59:41994) 2024-09-10T21:20:46.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.620+0000 7f6d3d7ab640 1 -- 172.21.15.59:0/2490351557 learned_addr learned my addr 172.21.15.59:0/2490351557 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:46.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.620+0000 7f6d3e7ad640 1 --2- 172.21.15.59:0/2490351557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d8291d80 0x5617d82907b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:46.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.620+0000 7f6d3dfac640 1 --2- 172.21.15.59:0/2490351557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d82854d0 0x5617d829dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:46.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.620+0000 7f6d3d7ab640 1 -- 172.21.15.59:0/2490351557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d82854d0 msgr2=0x5617d829dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:46.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.620+0000 7f6d3d7ab640 1 --2- 172.21.15.59:0/2490351557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d82854d0 0x5617d829dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.620+0000 7f6d3d7ab640 1 -- 172.21.15.59:0/2490351557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d8291d80 msgr2=0x5617d82907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:46.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.620+0000 7f6d3d7ab640 1 --2- 172.21.15.59:0/2490351557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d8291d80 0x5617d82907b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.620+0000 7f6d3d7ab640 1 -- 172.21.15.59:0/2490351557 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617d8283d80 con 0x5617d8285df0 2024-09-10T21:20:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.620+0000 7f6d3dfac640 1 --2- 172.21.15.59:0/2490351557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d82854d0 0x5617d829dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:20:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.620+0000 7f6d3d7ab640 1 --2- 172.21.15.59:0/2490351557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 0x5617d8284a30 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f6d28032920 tx=0x7f6d2800aa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9991f7af95f2d04c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.621+0000 7f6d237fe640 1 -- 172.21.15.59:0/2490351557 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d28040070 con 0x5617d8285df0 2024-09-10T21:20:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.621+0000 7f6d237fe640 1 -- 172.21.15.59:0/2490351557 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d28032480 con 0x5617d8285df0 2024-09-10T21:20:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.621+0000 7f6d237fe640 1 -- 172.21.15.59:0/2490351557 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d280055e0 con 0x5617d8285df0 2024-09-10T21:20:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.621+0000 7f6d425e5740 1 -- 172.21.15.59:0/2490351557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 msgr2=0x5617d8284a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.621+0000 7f6d425e5740 1 --2- 172.21.15.59:0/2490351557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 0x5617d8284a30 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f6d28032920 tx=0x7f6d2800aa10 comp rx=0 tx=0).stop 2024-09-10T21:20:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.621+0000 7f6d425e5740 1 -- 172.21.15.59:0/2490351557 shutdown_connections 2024-09-10T21:20:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.621+0000 7f6d425e5740 1 --2- 172.21.15.59:0/2490351557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d8291d80 0x5617d82907b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.621+0000 7f6d425e5740 1 --2- 172.21.15.59:0/2490351557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8285df0 0x5617d8284a30 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.621+0000 7f6d425e5740 1 --2- 172.21.15.59:0/2490351557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d82854d0 0x5617d829dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.621+0000 7f6d425e5740 1 -- 172.21.15.59:0/2490351557 >> 172.21.15.59:0/2490351557 conn(0x5617d8283300 msgr2=0x5617d82900a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:46.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.621+0000 7f6d425e5740 1 -- 172.21.15.59:0/2490351557 shutdown_connections 2024-09-10T21:20:46.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.621+0000 7f6d425e5740 1 -- 172.21.15.59:0/2490351557 wait complete. 2024-09-10T21:20:46.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.622+0000 7f6d425e5740 1 -- start start 2024-09-10T21:20:46.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.622+0000 7f6d425e5740 1 Processor -- start 2024-09-10T21:20:46.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.622+0000 7f6d425e5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d82854d0 0x5617d82963a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:46.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.622+0000 7f6d425e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d8285df0 0x5617d82968e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:46.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.622+0000 7f6d425e5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8291d80 0x5617d830d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:46.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.622+0000 7f6d425e5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6d381b5c90 con 0x5617d8291d80 2024-09-10T21:20:46.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.622+0000 7f6d425e5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6d381b55c0 con 0x5617d8285df0 2024-09-10T21:20:46.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.622+0000 7f6d425e5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6d381b2800 con 0x5617d82854d0 2024-09-10T21:20:46.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.622+0000 7f6d425e5740 10 client.0 _ll_register_callbacks cb 0x7f6d2800a8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:46.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.622+0000 7f6d3e7ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8291d80 0x5617d830d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:46.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.622+0000 7f6d3e7ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8291d80 0x5617d830d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41998/0 (socket says 172.21.15.59:41998) 2024-09-10T21:20:46.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.622+0000 7f6d3e7ad640 1 -- 172.21.15.59:0/107018644 learned_addr learned my addr 172.21.15.59:0/107018644 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:46.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.623+0000 7f6d3d7ab640 1 --2- 172.21.15.59:0/107018644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d8285df0 0x5617d82968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:46.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.623+0000 7f6d3dfac640 1 --2- 172.21.15.59:0/107018644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d82854d0 0x5617d82963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:46.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.623+0000 7f6d3e7ad640 1 -- 172.21.15.59:0/107018644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d82854d0 msgr2=0x5617d82963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:46.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.623+0000 7f6d3e7ad640 1 --2- 172.21.15.59:0/107018644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d82854d0 0x5617d82963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.623+0000 7f6d3e7ad640 1 -- 172.21.15.59:0/107018644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d8285df0 msgr2=0x5617d82968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.623+0000 7f6d3e7ad640 1 --2- 172.21.15.59:0/107018644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d8285df0 0x5617d82968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.623+0000 7f6d3e7ad640 1 -- 172.21.15.59:0/107018644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617d830ddc0 con 0x5617d8291d80 2024-09-10T21:20:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.623+0000 7f6d3d7ab640 1 --2- 172.21.15.59:0/107018644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d8285df0 0x5617d82968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:20:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.623+0000 7f6d3e7ad640 1 --2- 172.21.15.59:0/107018644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8291d80 0x5617d830d7b0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f6d300cd4c0 tx=0x7f6d300cd650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46763f6960a25e39 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.623+0000 7f6d217fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.623+0000 7f6d217fa640 1 -- 172.21.15.59:0/107018644 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d300cd2d0 con 0x5617d8291d80 2024-09-10T21:20:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.623+0000 7f6d217fa640 1 -- 172.21.15.59:0/107018644 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6d300cda20 con 0x5617d8291d80 2024-09-10T21:20:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.623+0000 7f6d425e5740 1 -- 172.21.15.59:0/107018644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d28032480 con 0x5617d8291d80 2024-09-10T21:20:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.623+0000 7f6d217fa640 1 -- 172.21.15.59:0/107018644 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6d300d2070 con 0x5617d8291d80 2024-09-10T21:20:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.623+0000 7f6d425e5740 10 client.16752 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.623+0000 7f6d425e5740 1 -- 172.21.15.59:0/107018644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5617d830f090 con 0x5617d8291d80 2024-09-10T21:20:46.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.624+0000 7f6d217fa640 1 -- 172.21.15.59:0/107018644 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d28032480 con 0x5617d8291d80 2024-09-10T21:20:46.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.624+0000 7f6d217fa640 1 -- 172.21.15.59:0/107018644 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6d300d68c0 con 0x5617d8291d80 2024-09-10T21:20:46.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.624+0000 7f6d425e5740 10 client.16752 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:46.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.624+0000 7f6d425e5740 10 client.16752 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:20:46.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.624+0000 7f6d425e5740 20 client.16752 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:46.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.624+0000 7f6d425e5740 1 --2- 172.21.15.59:0/107018644 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5617d830f7b0 0x5617d8311ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:46.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.624+0000 7f6d425e5740 4 client.16752 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:20:46.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.624+0000 7f6d425e5740 1 -- 172.21.15.59:0/107018644 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5617d81f98a0 con 0x5617d830f7b0 2024-09-10T21:20:46.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.624+0000 7f6d3dfac640 1 --2- 172.21.15.59:0/107018644 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5617d830f7b0 0x5617d8311ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:46.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.624+0000 7f6d217fa640 10 client.16752 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:20:46.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.624+0000 7f6d3dfac640 1 --2- 172.21.15.59:0/107018644 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5617d830f7b0 0x5617d8311ba0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=55e34fd82591fb22 server_cookie=d3758fba488b64ce in_seq=0 out_seq=0 2024-09-10T21:20:46.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.625+0000 7f6d217fa640 1 -- 172.21.15.59:0/107018644 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5617d81f98a0 con 0x5617d830f7b0 2024-09-10T21:20:46.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.625+0000 7f6d217fa640 10 client.16752 handle_command_reply: tid=0 2024-09-10T21:20:46.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.625+0000 7f6d425e5740 1 client.16752 shutdown 2024-09-10T21:20:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.625+0000 7f6d425e5740 1 -- 172.21.15.59:0/107018644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8291d80 msgr2=0x5617d830d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.625+0000 7f6d425e5740 1 --2- 172.21.15.59:0/107018644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8291d80 0x5617d830d7b0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f6d300cd4c0 tx=0x7f6d300cd650 comp rx=0 tx=0).stop 2024-09-10T21:20:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.625+0000 7f6d425e5740 1 -- 172.21.15.59:0/107018644 shutdown_connections 2024-09-10T21:20:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.625+0000 7f6d425e5740 1 --2- 172.21.15.59:0/107018644 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5617d830f7b0 0x5617d8311ba0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.625+0000 7f6d425e5740 1 --2- 172.21.15.59:0/107018644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5617d8291d80 0x5617d830d7b0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.625+0000 7f6d425e5740 1 --2- 172.21.15.59:0/107018644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617d8285df0 0x5617d82968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.625+0000 7f6d217fa640 0 client.16752 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:20:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.625+0000 7f6d425e5740 1 --2- 172.21.15.59:0/107018644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617d82854d0 0x5617d82963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.625+0000 7f6d425e5740 1 -- 172.21.15.59:0/107018644 >> 172.21.15.59:0/107018644 conn(0x5617d8283300 msgr2=0x5617d82908c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.625+0000 7f6d425e5740 1 -- 172.21.15.59:0/107018644 shutdown_connections 2024-09-10T21:20:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.625+0000 7f6d425e5740 1 -- 172.21.15.59:0/107018644 wait complete. 2024-09-10T21:20:46.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.625+0000 7f6d425e5740 20 client.16752 trim_cache size 0 max 16384 2024-09-10T21:20:46.635 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:20:46.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.626+0000 7f6d40210640 1 -- 172.21.15.59:0/1881462219 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6d240b52e0 msgr2=0x7f6d240b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.626+0000 7f6d40210640 1 --2- 172.21.15.59:0/1881462219 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6d240b52e0 0x7f6d240b77a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800a5c0 tx=0x7f6d2800a2d0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.626+0000 7f6d40210640 1 -- 172.21.15.59:0/1881462219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d38109150 msgr2=0x7f6d381a1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.626+0000 7f6d40210640 1 --2- 172.21.15.59:0/1881462219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d38109150 0x7f6d381a1e60 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6d30005cc0 tx=0x7f6d3002f470 comp rx=0 tx=0).stop 2024-09-10T21:20:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.626+0000 7f6d40210640 1 -- 172.21.15.59:0/1881462219 shutdown_connections 2024-09-10T21:20:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.626+0000 7f6d40210640 1 --2- 172.21.15.59:0/1881462219 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6d240b52e0 0x7f6d240b77a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.626+0000 7f6d40210640 1 --2- 172.21.15.59:0/1881462219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d38109150 0x7f6d381a1e60 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.626+0000 7f6d40210640 1 --2- 172.21.15.59:0/1881462219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d381087d0 0x7f6d3810f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.626+0000 7f6d40210640 1 --2- 172.21.15.59:0/1881462219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6d38102dc0 0x7f6d3810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.626+0000 7f6d40210640 1 -- 172.21.15.59:0/1881462219 >> 172.21.15.59:0/1881462219 conn(0x7f6d380fe830 msgr2=0x7f6d380feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.626+0000 7f6d40210640 1 -- 172.21.15.59:0/1881462219 shutdown_connections 2024-09-10T21:20:46.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:46.626+0000 7f6d40210640 1 -- 172.21.15.59:0/1881462219 wait complete. 2024-09-10T21:20:46.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:46 smithi192 ceph-mon[35363]: pgmap v505: 97 pgs: 97 active+clean; 3.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:20:46.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:46 smithi059 ceph-mon[30888]: pgmap v505: 97 pgs: 97 active+clean; 3.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:20:46.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:46 smithi154 ceph-mon[35041]: pgmap v505: 97 pgs: 97 active+clean; 3.7 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:20:47.386 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:20:47.648 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:20:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.180+0000 7f9f15be3640 1 -- 172.21.15.59:0/628891035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f101087d0 msgr2=0x7f9f10108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.180+0000 7f9f15be3640 1 --2- 172.21.15.59:0/628891035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f101087d0 0x7f9f10108c10 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009900 tx=0x7f9ef802a410 comp rx=0 tx=0).stop 2024-09-10T21:20:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.180+0000 7f9f15be3640 1 -- 172.21.15.59:0/628891035 shutdown_connections 2024-09-10T21:20:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.180+0000 7f9f15be3640 1 --2- 172.21.15.59:0/628891035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f10109150 0x7f9f1010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.180+0000 7f9f15be3640 1 --2- 172.21.15.59:0/628891035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f101087d0 0x7f9f10108c10 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.180+0000 7f9f15be3640 1 --2- 172.21.15.59:0/628891035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f10102dc0 0x7f9f101031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.180+0000 7f9f15be3640 1 -- 172.21.15.59:0/628891035 >> 172.21.15.59:0/628891035 conn(0x7f9f100fe830 msgr2=0x7f9f10100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.180+0000 7f9f15be3640 1 -- 172.21.15.59:0/628891035 shutdown_connections 2024-09-10T21:20:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.180+0000 7f9f15be3640 1 -- 172.21.15.59:0/628891035 wait complete. 2024-09-10T21:20:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.181+0000 7f9f15be3640 1 Processor -- start 2024-09-10T21:20:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.181+0000 7f9f15be3640 1 -- start start 2024-09-10T21:20:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.182+0000 7f9f15be3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f10102dc0 0x7f9f10199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.182+0000 7f9f15be3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f101087d0 0x7f9f10199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.182+0000 7f9f15be3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f10109150 0x7f9f1019eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.182+0000 7f9f15be3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9f10112da0 con 0x7f9f10109150 2024-09-10T21:20:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.182+0000 7f9f15be3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9f10112c20 con 0x7f9f101087d0 2024-09-10T21:20:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.182+0000 7f9f15be3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9f10112f20 con 0x7f9f10102dc0 2024-09-10T21:20:48.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.182+0000 7f9f0ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f10109150 0x7f9f1019eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.182+0000 7f9f0ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f10109150 0x7f9f1019eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42006/0 (socket says 172.21.15.59:42006) 2024-09-10T21:20:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.182+0000 7f9f0ffff640 1 -- 172.21.15.59:0/1273696147 learned_addr learned my addr 172.21.15.59:0/1273696147 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.182+0000 7f9f0effd640 1 --2- 172.21.15.59:0/1273696147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f101087d0 0x7f9f10199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.182+0000 7f9f0f7fe640 1 --2- 172.21.15.59:0/1273696147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f10102dc0 0x7f9f10199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.182+0000 7f9f0ffff640 1 -- 172.21.15.59:0/1273696147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f10102dc0 msgr2=0x7f9f10199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.182+0000 7f9f0ffff640 1 --2- 172.21.15.59:0/1273696147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f10102dc0 0x7f9f10199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.182+0000 7f9f0ffff640 1 -- 172.21.15.59:0/1273696147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f101087d0 msgr2=0x7f9f10199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.182+0000 7f9f0ffff640 1 --2- 172.21.15.59:0/1273696147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f101087d0 0x7f9f10199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.182+0000 7f9f0ffff640 1 -- 172.21.15.59:0/1273696147 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1019f300 con 0x7f9f10109150 2024-09-10T21:20:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.182+0000 7f9f0effd640 1 --2- 172.21.15.59:0/1273696147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f101087d0 0x7f9f10199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.182+0000 7f9f0ffff640 1 --2- 172.21.15.59:0/1273696147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f10109150 0x7f9f1019eb30 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800eaa0 tx=0x7f9f0800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.182+0000 7f9f0cff9640 1 -- 172.21.15.59:0/1273696147 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0800cdb0 con 0x7f9f10109150 2024-09-10T21:20:48.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.183+0000 7f9f0cff9640 1 -- 172.21.15.59:0/1273696147 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f08005020 con 0x7f9f10109150 2024-09-10T21:20:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.183+0000 7f9f15be3640 1 -- 172.21.15.59:0/1273696147 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f1019f5f0 con 0x7f9f10109150 2024-09-10T21:20:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.183+0000 7f9f0cff9640 1 -- 172.21.15.59:0/1273696147 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f080116d0 con 0x7f9f10109150 2024-09-10T21:20:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.183+0000 7f9f15be3640 1 -- 172.21.15.59:0/1273696147 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f101a5cb0 con 0x7f9f10109150 2024-09-10T21:20:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.185+0000 7f9f0cff9640 1 -- 172.21.15.59:0/1273696147 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f9f0800f040 con 0x7f9f10109150 2024-09-10T21:20:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.185+0000 7f9f17fb8740 1 Processor -- start 2024-09-10T21:20:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.185+0000 7f9f17fb8740 1 -- start start 2024-09-10T21:20:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f17fb8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c49644d0 0x5646c49648b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f17fb8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 0x5646c4974c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f17fb8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 0x5646c4977580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f17fb8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5646c48daea0 con 0x5646c4964df0 2024-09-10T21:20:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f17fb8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5646c48ca2d0 con 0x5646c4975190 2024-09-10T21:20:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f17fb8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5646c48ce0e0 con 0x5646c49644d0 2024-09-10T21:20:48.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f0f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 0x5646c4974c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f0f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 0x5646c4974c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42022/0 (socket says 172.21.15.59:42022) 2024-09-10T21:20:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f0f7fe640 1 -- 172.21.15.59:0/1999947249 learned_addr learned my addr 172.21.15.59:0/1999947249 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f0effd640 1 --2- 172.21.15.59:0/1999947249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c49644d0 0x5646c49648b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f0cff9640 1 --2- 172.21.15.59:0/1273696147 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9efc0b5360 0x7f9efc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f0f7fe640 1 -- 172.21.15.59:0/1999947249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c49644d0 msgr2=0x5646c49648b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f0f7fe640 1 --2- 172.21.15.59:0/1999947249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c49644d0 0x5646c49648b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f0effd640 1 --2- 172.21.15.59:0/1999947249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 0x5646c4977580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f0f7fe640 1 -- 172.21.15.59:0/1999947249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 msgr2=0x5646c4977580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f0f7fe640 1 --2- 172.21.15.59:0/1999947249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 0x5646c4977580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f0f7fe640 1 -- 172.21.15.59:0/1999947249 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646c4628650 con 0x5646c4964df0 2024-09-10T21:20:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f0ffff640 1 --2- 172.21.15.59:0/1273696147 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9efc0b5360 0x7f9efc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f0effd640 1 --2- 172.21.15.59:0/1999947249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 0x5646c4977580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:20:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f0cff9640 1 -- 172.21.15.59:0/1273696147 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9f080e5aa0 con 0x7f9f10109150 2024-09-10T21:20:48.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.186+0000 7f9f0f7fe640 1 --2- 172.21.15.59:0/1999947249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 0x5646c4974c50 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000bce0 tx=0x7f9f0000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd388a54a15a251 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.187+0000 7f9f05ffb640 1 -- 172.21.15.59:0/1999947249 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00015070 con 0x5646c4964df0 2024-09-10T21:20:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.187+0000 7f9f05ffb640 1 -- 172.21.15.59:0/1999947249 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f000118f0 con 0x5646c4964df0 2024-09-10T21:20:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.187+0000 7f9f05ffb640 1 -- 172.21.15.59:0/1999947249 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00010930 con 0x5646c4964df0 2024-09-10T21:20:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.187+0000 7f9f0ffff640 1 --2- 172.21.15.59:0/1273696147 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9efc0b5360 0x7f9efc0b7820 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9f080abf30 tx=0x7f9f080a2040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.187+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1999947249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 msgr2=0x5646c4974c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.187+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/1999947249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 0x5646c4974c50 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000bce0 tx=0x7f9f0000f730 comp rx=0 tx=0).stop 2024-09-10T21:20:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.187+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1999947249 shutdown_connections 2024-09-10T21:20:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.187+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/1999947249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 0x5646c4977580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.187+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/1999947249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 0x5646c4974c50 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.187+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/1999947249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c49644d0 0x5646c49648b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.187+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1999947249 >> 172.21.15.59:0/1999947249 conn(0x5646c4962300 msgr2=0x5646c49634a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.187+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1999947249 shutdown_connections 2024-09-10T21:20:48.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.187+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1999947249 wait complete. 2024-09-10T21:20:48.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.188+0000 7f9f17fb8740 1 -- start start 2024-09-10T21:20:48.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.188+0000 7f9f17fb8740 1 Processor -- start 2024-09-10T21:20:48.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.188+0000 7f9f17fb8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c49644d0 0x5646c4974aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:48.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.188+0000 7f9f17fb8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 0x5646c4971ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:48.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.188+0000 7f9f17fb8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 0x5646c4972520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:48.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.188+0000 7f9f17fb8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5646c472b700 con 0x5646c4964df0 2024-09-10T21:20:48.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.188+0000 7f9f17fb8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5646c4865160 con 0x5646c4975190 2024-09-10T21:20:48.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.188+0000 7f9f17fb8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5646c4977e40 con 0x5646c49644d0 2024-09-10T21:20:48.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.188+0000 7f9f17fb8740 10 client.0 _ll_register_callbacks cb 0x5646c487e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:48.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.188+0000 7f9f0f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 0x5646c4971ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:48.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.188+0000 7f9f0f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 0x5646c4971ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42032/0 (socket says 172.21.15.59:42032) 2024-09-10T21:20:48.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.188+0000 7f9f0f7fe640 1 -- 172.21.15.59:0/1879565392 learned_addr learned my addr 172.21.15.59:0/1879565392 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:48.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.189+0000 7f9f0effd640 1 --2- 172.21.15.59:0/1879565392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c49644d0 0x5646c4974aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:48.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.189+0000 7f9f0effd640 1 --2- 172.21.15.59:0/1879565392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 0x5646c4972520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:48.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.189+0000 7f9f0f7fe640 1 -- 172.21.15.59:0/1879565392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c49644d0 msgr2=0x5646c4974aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:48.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.189+0000 7f9f0f7fe640 1 --2- 172.21.15.59:0/1879565392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c49644d0 0x5646c4974aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.189+0000 7f9f0f7fe640 1 -- 172.21.15.59:0/1879565392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 msgr2=0x5646c4972520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:48.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.189+0000 7f9f0f7fe640 1 --2- 172.21.15.59:0/1879565392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 0x5646c4972520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.189+0000 7f9f0f7fe640 1 -- 172.21.15.59:0/1879565392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646c4892c90 con 0x5646c4964df0 2024-09-10T21:20:48.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.189+0000 7f9f0effd640 1 --2- 172.21.15.59:0/1879565392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 0x5646c4972520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:20:48.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.189+0000 7f9f0f7fe640 1 --2- 172.21.15.59:0/1879565392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 0x5646c4971ef0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000bcb0 tx=0x7f9f0000b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286f911947806900 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:48.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.189+0000 7f9eeeffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:48.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.189+0000 7f9eeeffd640 1 -- 172.21.15.59:0/1879565392 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00015070 con 0x5646c4964df0 2024-09-10T21:20:48.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.189+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1879565392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f000118f0 con 0x5646c4964df0 2024-09-10T21:20:48.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.189+0000 7f9eeeffd640 1 -- 172.21.15.59:0/1879565392 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9f000116d0 con 0x5646c4964df0 2024-09-10T21:20:48.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.189+0000 7f9eeeffd640 1 -- 172.21.15.59:0/1879565392 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9f00011aa0 con 0x5646c4964df0 2024-09-10T21:20:48.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.189+0000 7f9f17fb8740 10 client.16764 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:48.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.189+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1879565392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5646c4983710 con 0x5646c4964df0 2024-09-10T21:20:48.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.189+0000 7f9eeeffd640 1 -- 172.21.15.59:0/1879565392 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f000118f0 con 0x5646c4964df0 2024-09-10T21:20:48.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.190+0000 7f9eeeffd640 1 -- 172.21.15.59:0/1879565392 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9f00004990 con 0x5646c4964df0 2024-09-10T21:20:48.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.190+0000 7f9f17fb8740 10 client.16764 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:48.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.190+0000 7f9f17fb8740 10 client.16764 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:20:48.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.190+0000 7f9f17fb8740 20 client.16764 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:48.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.190+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/1879565392 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5646c4984b10 0x5646c4986f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:48.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.190+0000 7f9f17fb8740 4 client.16764 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:20:48.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.190+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1879565392 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646c48dcdf0 con 0x5646c4984b10 2024-09-10T21:20:48.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.190+0000 7f9f0effd640 1 --2- 172.21.15.59:0/1879565392 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5646c4984b10 0x5646c4986f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:48.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.191+0000 7f9eeeffd640 10 client.16764 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:20:48.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.191+0000 7f9f0effd640 1 --2- 172.21.15.59:0/1879565392 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5646c4984b10 0x5646c4986f00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=98f5f62f9415e0ac server_cookie=e56c1988a254ff1 in_seq=0 out_seq=0 2024-09-10T21:20:48.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.191+0000 7f9eeeffd640 1 -- 172.21.15.59:0/1879565392 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5646c48dcdf0 con 0x5646c4984b10 2024-09-10T21:20:48.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.191+0000 7f9eeeffd640 10 client.16764 handle_command_reply: tid=0 2024-09-10T21:20:48.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.191+0000 7f9f17fb8740 1 client.16764 shutdown 2024-09-10T21:20:48.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.192+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1879565392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 msgr2=0x5646c4971ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:48.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.192+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/1879565392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 0x5646c4971ef0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000bcb0 tx=0x7f9f0000b9f0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.192+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1879565392 shutdown_connections 2024-09-10T21:20:48.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.192+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/1879565392 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5646c4984b10 0x5646c4986f00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.192+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/1879565392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 0x5646c4972520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.192+0000 7f9eeeffd640 0 client.16764 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:20:48.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.192+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/1879565392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 0x5646c4971ef0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.192+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/1879565392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c49644d0 0x5646c4974aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.192+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1879565392 >> 172.21.15.59:0/1879565392 conn(0x5646c4962300 msgr2=0x5646c4961420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:48.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.192+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1879565392 shutdown_connections 2024-09-10T21:20:48.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.192+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1879565392 wait complete. 2024-09-10T21:20:48.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.192+0000 7f9f17fb8740 20 client.16764 trim_cache size 0 max 16384 2024-09-10T21:20:48.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.205+0000 7f9f17fb8740 1 Processor -- start 2024-09-10T21:20:48.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.205+0000 7f9f17fb8740 1 -- start start 2024-09-10T21:20:48.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.205+0000 7f9f17fb8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c49644d0 0x5646c4977610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:48.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.205+0000 7f9f17fb8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 0x5646c4961c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:48.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.205+0000 7f9f17fb8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 0x5646c4981070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:48.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.205+0000 7f9f17fb8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9f101ac060 con 0x5646c4964df0 2024-09-10T21:20:48.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.205+0000 7f9f17fb8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9f101adba0 con 0x5646c4975190 2024-09-10T21:20:48.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.205+0000 7f9f17fb8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9f101ac730 con 0x5646c49644d0 2024-09-10T21:20:48.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.205+0000 7f9f0f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 0x5646c4961c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:48.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.205+0000 7f9f0f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 0x5646c4961c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42044/0 (socket says 172.21.15.59:42044) 2024-09-10T21:20:48.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.205+0000 7f9f0f7fe640 1 -- 172.21.15.59:0/589944037 learned_addr learned my addr 172.21.15.59:0/589944037 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:48.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.206+0000 7f9f0effd640 1 --2- 172.21.15.59:0/589944037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c49644d0 0x5646c4977610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:48.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.206+0000 7f9f0f7fe640 1 -- 172.21.15.59:0/589944037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c49644d0 msgr2=0x5646c4977610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:48.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.206+0000 7f9f0f7fe640 1 --2- 172.21.15.59:0/589944037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c49644d0 0x5646c4977610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.206+0000 7f9f0effd640 1 --2- 172.21.15.59:0/589944037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 0x5646c4981070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:48.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.206+0000 7f9f0f7fe640 1 -- 172.21.15.59:0/589944037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 msgr2=0x5646c4981070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:48.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.206+0000 7f9f0f7fe640 1 --2- 172.21.15.59:0/589944037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 0x5646c4981070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.206+0000 7f9f0f7fe640 1 -- 172.21.15.59:0/589944037 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646c4971ca0 con 0x5646c4964df0 2024-09-10T21:20:48.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.206+0000 7f9f0effd640 1 --2- 172.21.15.59:0/589944037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 0x5646c4981070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:20:48.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.206+0000 7f9f0f7fe640 1 --2- 172.21.15.59:0/589944037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 0x5646c4961c10 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000bbd0 tx=0x7f9f00005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60301262e74f62e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:48.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.206+0000 7f9f057fa640 1 -- 172.21.15.59:0/589944037 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00015070 con 0x5646c4964df0 2024-09-10T21:20:48.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.206+0000 7f9f057fa640 1 -- 172.21.15.59:0/589944037 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f00010640 con 0x5646c4964df0 2024-09-10T21:20:48.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.206+0000 7f9f057fa640 1 -- 172.21.15.59:0/589944037 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00004270 con 0x5646c4964df0 2024-09-10T21:20:48.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.207+0000 7f9f17fb8740 1 -- 172.21.15.59:0/589944037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 msgr2=0x5646c4961c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:48.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.207+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/589944037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 0x5646c4961c10 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000bbd0 tx=0x7f9f00005fd0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.207+0000 7f9f17fb8740 1 -- 172.21.15.59:0/589944037 shutdown_connections 2024-09-10T21:20:48.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.207+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/589944037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 0x5646c4981070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.207+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/589944037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c4964df0 0x5646c4961c10 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.207+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/589944037 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c49644d0 0x5646c4977610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.207+0000 7f9f17fb8740 1 -- 172.21.15.59:0/589944037 >> 172.21.15.59:0/589944037 conn(0x5646c4962300 msgr2=0x5646c4973d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:48.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.207+0000 7f9f17fb8740 1 -- 172.21.15.59:0/589944037 shutdown_connections 2024-09-10T21:20:48.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.207+0000 7f9f17fb8740 1 -- 172.21.15.59:0/589944037 wait complete. 2024-09-10T21:20:48.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.207+0000 7f9f17fb8740 1 -- start start 2024-09-10T21:20:48.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.207+0000 7f9f17fb8740 1 Processor -- start 2024-09-10T21:20:48.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.207+0000 7f9f17fb8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c49644d0 0x5646c497d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:48.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.207+0000 7f9f17fb8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c4964df0 0x5646c497da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:48.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.207+0000 7f9f17fb8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 0x5646c497a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:48.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.207+0000 7f9f17fb8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9f101ad4d0 con 0x5646c49644d0 2024-09-10T21:20:48.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.207+0000 7f9f17fb8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9f101ace00 con 0x5646c4975190 2024-09-10T21:20:48.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.207+0000 7f9f17fb8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9f101aa040 con 0x5646c4964df0 2024-09-10T21:20:48.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.208+0000 7f9f17fb8740 10 client.0 _ll_register_callbacks cb 0x7f9f0000bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:48.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.208+0000 7f9f0effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c49644d0 0x5646c497d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:48.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.208+0000 7f9f0effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c49644d0 0x5646c497d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42046/0 (socket says 172.21.15.59:42046) 2024-09-10T21:20:48.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.208+0000 7f9f0effd640 1 -- 172.21.15.59:0/1284990619 learned_addr learned my addr 172.21.15.59:0/1284990619 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:48.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.208+0000 7f9f0f7fe640 1 --2- 172.21.15.59:0/1284990619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c4964df0 0x5646c497da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:48.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.208+0000 7f9f0effd640 1 --2- 172.21.15.59:0/1284990619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 0x5646c497a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:48.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.208+0000 7f9f0effd640 1 -- 172.21.15.59:0/1284990619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c4964df0 msgr2=0x5646c497da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:48.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.208+0000 7f9f0effd640 1 --2- 172.21.15.59:0/1284990619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c4964df0 0x5646c497da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.208+0000 7f9f0effd640 1 -- 172.21.15.59:0/1284990619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 msgr2=0x5646c497a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:48.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.208+0000 7f9f0effd640 1 --2- 172.21.15.59:0/1284990619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 0x5646c497a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.208+0000 7f9f0effd640 1 -- 172.21.15.59:0/1284990619 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646c497aa10 con 0x5646c49644d0 2024-09-10T21:20:48.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.208+0000 7f9f0effd640 1 --2- 172.21.15.59:0/1284990619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c49644d0 0x5646c497d480 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8005de0 tx=0x7f9f00010510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2806ff1d273661 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:48.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.208+0000 7f9eeeffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:48.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.208+0000 7f9eeeffd640 1 -- 172.21.15.59:0/1284990619 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8035040 con 0x5646c49644d0 2024-09-10T21:20:48.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.208+0000 7f9eeeffd640 1 -- 172.21.15.59:0/1284990619 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9ef80318b0 con 0x5646c49644d0 2024-09-10T21:20:48.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.208+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1284990619 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f00010640 con 0x5646c49644d0 2024-09-10T21:20:48.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.208+0000 7f9eeeffd640 1 -- 172.21.15.59:0/1284990619 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9ef8005020 con 0x5646c49644d0 2024-09-10T21:20:48.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.209+0000 7f9f17fb8740 10 client.16770 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:48.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.209+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1284990619 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5646c49f2310 con 0x5646c49644d0 2024-09-10T21:20:48.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.209+0000 7f9eeeffd640 1 -- 172.21.15.59:0/1284990619 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f00010640 con 0x5646c49644d0 2024-09-10T21:20:48.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.209+0000 7f9eeeffd640 1 -- 172.21.15.59:0/1284990619 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9ef803a040 con 0x5646c49644d0 2024-09-10T21:20:48.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.209+0000 7f9f17fb8740 10 client.16770 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:48.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.209+0000 7f9f17fb8740 10 client.16770 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:20:48.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.209+0000 7f9f17fb8740 20 client.16770 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:48.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.209+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/1284990619 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5646c49f2a70 0x5646c49f4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:48.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.209+0000 7f9f17fb8740 4 client.16770 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:20:48.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.209+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1284990619 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5646c48d88a0 con 0x5646c49f2a70 2024-09-10T21:20:48.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.209+0000 7f9f0f7fe640 1 --2- 172.21.15.59:0/1284990619 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5646c49f2a70 0x5646c49f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:48.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.210+0000 7f9eeeffd640 10 client.16770 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:20:48.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.210+0000 7f9f0f7fe640 1 --2- 172.21.15.59:0/1284990619 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5646c49f2a70 0x5646c49f4e90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=24a60b960fedc440 server_cookie=40d18b4776d8e09b in_seq=0 out_seq=0 2024-09-10T21:20:48.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.210+0000 7f9eeeffd640 1 -- 172.21.15.59:0/1284990619 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5646c48d88a0 con 0x5646c49f2a70 2024-09-10T21:20:48.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.210+0000 7f9eeeffd640 10 client.16770 handle_command_reply: tid=0 2024-09-10T21:20:48.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.210+0000 7f9f17fb8740 1 client.16770 shutdown 2024-09-10T21:20:48.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.210+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1284990619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c49644d0 msgr2=0x5646c497d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:48.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.210+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/1284990619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c49644d0 0x5646c497d480 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8005de0 tx=0x7f9f00010510 comp rx=0 tx=0).stop 2024-09-10T21:20:48.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.210+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1284990619 shutdown_connections 2024-09-10T21:20:48.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.210+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/1284990619 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5646c49f2a70 0x5646c49f4e90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.210+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/1284990619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5646c4975190 0x5646c497a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.210+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/1284990619 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5646c4964df0 0x5646c497da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.210+0000 7f9f17fb8740 1 --2- 172.21.15.59:0/1284990619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5646c49644d0 0x5646c497d480 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.210+0000 7f9eeeffd640 0 client.16770 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:20:48.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.210+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1284990619 >> 172.21.15.59:0/1284990619 conn(0x5646c4962300 msgr2=0x5646c4962fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:48.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.210+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1284990619 shutdown_connections 2024-09-10T21:20:48.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.210+0000 7f9f17fb8740 1 -- 172.21.15.59:0/1284990619 wait complete. 2024-09-10T21:20:48.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.210+0000 7f9f17fb8740 20 client.16770 trim_cache size 0 max 16384 2024-09-10T21:20:48.241 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:20:48.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.211+0000 7f9f15be3640 1 -- 172.21.15.59:0/1273696147 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9efc0b5360 msgr2=0x7f9efc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:48.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.211+0000 7f9f15be3640 1 --2- 172.21.15.59:0/1273696147 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9efc0b5360 0x7f9efc0b7820 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9f080abf30 tx=0x7f9f080a2040 comp rx=0 tx=0).stop 2024-09-10T21:20:48.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.211+0000 7f9f15be3640 1 -- 172.21.15.59:0/1273696147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f10109150 msgr2=0x7f9f1019eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:48.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.211+0000 7f9f15be3640 1 --2- 172.21.15.59:0/1273696147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f10109150 0x7f9f1019eb30 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f9f0800eaa0 tx=0x7f9f0800ef60 comp rx=0 tx=0).stop 2024-09-10T21:20:48.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.211+0000 7f9f15be3640 1 -- 172.21.15.59:0/1273696147 shutdown_connections 2024-09-10T21:20:48.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.211+0000 7f9f15be3640 1 --2- 172.21.15.59:0/1273696147 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9efc0b5360 0x7f9efc0b7820 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.211+0000 7f9f15be3640 1 --2- 172.21.15.59:0/1273696147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f10109150 0x7f9f1019eb30 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.211+0000 7f9f15be3640 1 --2- 172.21.15.59:0/1273696147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9f101087d0 0x7f9f10199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.211+0000 7f9f15be3640 1 --2- 172.21.15.59:0/1273696147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f10102dc0 0x7f9f10199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:48.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.211+0000 7f9f15be3640 1 -- 172.21.15.59:0/1273696147 >> 172.21.15.59:0/1273696147 conn(0x7f9f100fe830 msgr2=0x7f9f10100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:48.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.211+0000 7f9f15be3640 1 -- 172.21.15.59:0/1273696147 shutdown_connections 2024-09-10T21:20:48.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:48.211+0000 7f9f15be3640 1 -- 172.21.15.59:0/1273696147 wait complete. 2024-09-10T21:20:48.799 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:48 smithi059 ceph-mon[30888]: pgmap v506: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:20:48.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:48 smithi192 ceph-mon[35363]: pgmap v506: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:20:48.833 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:20:48.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:48 smithi154 ceph-mon[35041]: pgmap v506: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:20:49.092 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:20:49.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.588+0000 7fcce5420640 1 -- 172.21.15.59:0/217764413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce0103ca0 msgr2=0x7fcce0104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:49.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.588+0000 7fcce5420640 1 --2- 172.21.15.59:0/217764413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce0103ca0 0x7fcce0104080 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009900 tx=0x7fccd002a410 comp rx=0 tx=0).stop 2024-09-10T21:20:49.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.589+0000 7fcce5420640 1 -- 172.21.15.59:0/217764413 shutdown_connections 2024-09-10T21:20:49.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.589+0000 7fcce5420640 1 --2- 172.21.15.59:0/217764413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcce010d100 0x7fcce010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.589+0000 7fcce5420640 1 --2- 172.21.15.59:0/217764413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcce01045c0 0x7fcce010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.589+0000 7fcce5420640 1 --2- 172.21.15.59:0/217764413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce0103ca0 0x7fcce0104080 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.589+0000 7fcce5420640 1 -- 172.21.15.59:0/217764413 >> 172.21.15.59:0/217764413 conn(0x7fcce00fd700 msgr2=0x7fcce00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:49.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.589+0000 7fcce5420640 1 -- 172.21.15.59:0/217764413 shutdown_connections 2024-09-10T21:20:49.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.589+0000 7fcce5420640 1 -- 172.21.15.59:0/217764413 wait complete. 2024-09-10T21:20:49.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.589+0000 7fcce5420640 1 Processor -- start 2024-09-10T21:20:49.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.589+0000 7fcce5420640 1 -- start start 2024-09-10T21:20:49.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.589+0000 7fcce5420640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcce0103ca0 0x7fcce019b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:49.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.589+0000 7fcce5420640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce01045c0 0x7fcce019baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:49.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.589+0000 7fcce5420640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcce010d100 0x7fcce01a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:49.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.589+0000 7fcce5420640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcce0112d70 con 0x7fcce01045c0 2024-09-10T21:20:49.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.589+0000 7fcce5420640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcce0112bf0 con 0x7fcce0103ca0 2024-09-10T21:20:49.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.589+0000 7fcce5420640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcce0112ef0 con 0x7fcce010d100 2024-09-10T21:20:49.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.590+0000 7fccd7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce01045c0 0x7fcce019baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:49.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.590+0000 7fccd7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce01045c0 0x7fcce019baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53266/0 (socket says 172.21.15.59:53266) 2024-09-10T21:20:49.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.590+0000 7fccd7fff640 1 -- 172.21.15.59:0/2269582024 learned_addr learned my addr 172.21.15.59:0/2269582024 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:49.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.590+0000 7fccdf7fe640 1 --2- 172.21.15.59:0/2269582024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcce010d100 0x7fcce01a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:49.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.590+0000 7fccdeffd640 1 --2- 172.21.15.59:0/2269582024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcce0103ca0 0x7fcce019b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:49.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.590+0000 7fccd7fff640 1 -- 172.21.15.59:0/2269582024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcce010d100 msgr2=0x7fcce01a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:49.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.590+0000 7fccd7fff640 1 --2- 172.21.15.59:0/2269582024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcce010d100 0x7fcce01a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.590+0000 7fccd7fff640 1 -- 172.21.15.59:0/2269582024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcce0103ca0 msgr2=0x7fcce019b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:49.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.590+0000 7fccd7fff640 1 --2- 172.21.15.59:0/2269582024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcce0103ca0 0x7fcce019b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.590+0000 7fccd7fff640 1 -- 172.21.15.59:0/2269582024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce01a1610 con 0x7fcce01045c0 2024-09-10T21:20:49.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.590+0000 7fccdeffd640 1 --2- 172.21.15.59:0/2269582024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcce0103ca0 0x7fcce019b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:49.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.590+0000 7fccd7fff640 1 --2- 172.21.15.59:0/2269582024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce01045c0 0x7fcce019baa0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fccc800e9c0 tx=0x7fccc800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:49.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.590+0000 7fccdcff9640 1 -- 172.21.15.59:0/2269582024 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc800ccc0 con 0x7fcce01045c0 2024-09-10T21:20:49.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.590+0000 7fcce5420640 1 -- 172.21.15.59:0/2269582024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce01a1900 con 0x7fcce01045c0 2024-09-10T21:20:49.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.590+0000 7fccdcff9640 1 -- 172.21.15.59:0/2269582024 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccc80035f0 con 0x7fcce01045c0 2024-09-10T21:20:49.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.590+0000 7fccdcff9640 1 -- 172.21.15.59:0/2269582024 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc800ce60 con 0x7fcce01045c0 2024-09-10T21:20:49.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.590+0000 7fcce5420640 1 -- 172.21.15.59:0/2269582024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce01a7fc0 con 0x7fcce01045c0 2024-09-10T21:20:49.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.593+0000 7fcce77f5740 1 Processor -- start 2024-09-10T21:20:49.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.593+0000 7fccdcff9640 1 -- 172.21.15.59:0/2269582024 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fccc8004000 con 0x7fcce01045c0 2024-09-10T21:20:49.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.593+0000 7fcce77f5740 1 -- start start 2024-09-10T21:20:49.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.593+0000 7fcce77f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c764d0 0x558d21c768b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:49.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.593+0000 7fcce77f5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c76df0 0x558d21c82840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:49.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.593+0000 7fcce77f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c82d80 0x558d21c85170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:49.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.593+0000 7fcce77f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558d21becea0 con 0x558d21c82d80 2024-09-10T21:20:49.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.593+0000 7fcce77f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558d21bdc2d0 con 0x558d21c764d0 2024-09-10T21:20:49.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.593+0000 7fcce77f5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558d21be00e0 con 0x558d21c76df0 2024-09-10T21:20:49.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.594+0000 7fccd7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c82d80 0x558d21c85170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:49.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.594+0000 7fccd7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c82d80 0x558d21c85170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53268/0 (socket says 172.21.15.59:53268) 2024-09-10T21:20:49.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.594+0000 7fccd7fff640 1 -- 172.21.15.59:0/4193553287 learned_addr learned my addr 172.21.15.59:0/4193553287 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:49.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.594+0000 7fccdf7fe640 1 --2- 172.21.15.59:0/4193553287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c764d0 0x558d21c768b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:49.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.594+0000 7fccdeffd640 1 --2- 172.21.15.59:0/4193553287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c76df0 0x558d21c82840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:49.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.594+0000 7fccd7fff640 1 -- 172.21.15.59:0/4193553287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c76df0 msgr2=0x558d21c82840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:49.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.594+0000 7fccd7fff640 1 --2- 172.21.15.59:0/4193553287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c76df0 0x558d21c82840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.594+0000 7fccd7fff640 1 -- 172.21.15.59:0/4193553287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c764d0 msgr2=0x558d21c768b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:49.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.594+0000 7fccd7fff640 1 --2- 172.21.15.59:0/4193553287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c764d0 0x558d21c768b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.594+0000 7fccd7fff640 1 -- 172.21.15.59:0/4193553287 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d2193a650 con 0x558d21c82d80 2024-09-10T21:20:49.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.594+0000 7fccdcff9640 1 --2- 172.21.15.59:0/2269582024 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcccc0b52e0 0x7fcccc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:49.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.594+0000 7fccdf7fe640 1 --2- 172.21.15.59:0/2269582024 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcccc0b52e0 0x7fcccc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:49.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.594+0000 7fccd7fff640 1 --2- 172.21.15.59:0/4193553287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c82d80 0x558d21c85170 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fccc80e9ea0 tx=0x7fccc80e9f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba266d777956229 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:49.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.595+0000 7fccdcff9640 1 -- 172.21.15.59:0/2269582024 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fccc80e5f20 con 0x7fcce01045c0 2024-09-10T21:20:49.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.595+0000 7fccd57fa640 1 -- 172.21.15.59:0/4193553287 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc80a85b0 con 0x558d21c82d80 2024-09-10T21:20:49.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.595+0000 7fccd57fa640 1 -- 172.21.15.59:0/4193553287 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccc8004320 con 0x558d21c82d80 2024-09-10T21:20:49.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.595+0000 7fccd57fa640 1 -- 172.21.15.59:0/4193553287 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc806b0c0 con 0x558d21c82d80 2024-09-10T21:20:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.595+0000 7fccdf7fe640 1 --2- 172.21.15.59:0/2269582024 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcccc0b52e0 0x7fcccc0b77a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fccd8005fd0 tx=0x7fccd80096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.595+0000 7fcce77f5740 1 -- 172.21.15.59:0/4193553287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c82d80 msgr2=0x558d21c85170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.595+0000 7fcce77f5740 1 --2- 172.21.15.59:0/4193553287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c82d80 0x558d21c85170 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fccc80e9ea0 tx=0x7fccc80e9f90 comp rx=0 tx=0).stop 2024-09-10T21:20:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.596+0000 7fcce77f5740 1 -- 172.21.15.59:0/4193553287 shutdown_connections 2024-09-10T21:20:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.596+0000 7fcce77f5740 1 --2- 172.21.15.59:0/4193553287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c82d80 0x558d21c85170 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.596+0000 7fcce77f5740 1 --2- 172.21.15.59:0/4193553287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c76df0 0x558d21c82840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.596+0000 7fcce77f5740 1 --2- 172.21.15.59:0/4193553287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c764d0 0x558d21c768b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.596+0000 7fcce77f5740 1 -- 172.21.15.59:0/4193553287 >> 172.21.15.59:0/4193553287 conn(0x558d21c74300 msgr2=0x558d21c754a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.596+0000 7fcce77f5740 1 -- 172.21.15.59:0/4193553287 shutdown_connections 2024-09-10T21:20:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.596+0000 7fcce77f5740 1 -- 172.21.15.59:0/4193553287 wait complete. 2024-09-10T21:20:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.596+0000 7fcce77f5740 1 -- start start 2024-09-10T21:20:49.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.596+0000 7fcce77f5740 1 Processor -- start 2024-09-10T21:20:49.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.596+0000 7fcce77f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c764d0 0x558d21c826d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:49.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.596+0000 7fcce77f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c76df0 0x558d21c7fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:49.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.596+0000 7fcce77f5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c82d80 0x558d21c80180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:49.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.596+0000 7fcce77f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558d21a3d700 con 0x558d21c764d0 2024-09-10T21:20:49.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.596+0000 7fcce77f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558d21b77160 con 0x558d21c76df0 2024-09-10T21:20:49.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.596+0000 7fcce77f5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558d21c85a00 con 0x558d21c82d80 2024-09-10T21:20:49.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.597+0000 7fcce77f5740 10 client.0 _ll_register_callbacks cb 0x558d21b909e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:49.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.597+0000 7fccdeffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c764d0 0x558d21c826d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:49.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.597+0000 7fccdeffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c764d0 0x558d21c826d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53270/0 (socket says 172.21.15.59:53270) 2024-09-10T21:20:49.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.597+0000 7fccdeffd640 1 -- 172.21.15.59:0/2270770475 learned_addr learned my addr 172.21.15.59:0/2270770475 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:49.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.597+0000 7fccdf7fe640 1 --2- 172.21.15.59:0/2270770475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c82d80 0x558d21c80180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:49.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.597+0000 7fccd7fff640 1 --2- 172.21.15.59:0/2270770475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c76df0 0x558d21c7fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:49.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.597+0000 7fccdeffd640 1 -- 172.21.15.59:0/2270770475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c82d80 msgr2=0x558d21c80180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:49.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.597+0000 7fccdeffd640 1 --2- 172.21.15.59:0/2270770475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c82d80 0x558d21c80180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.597+0000 7fccdeffd640 1 -- 172.21.15.59:0/2270770475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c76df0 msgr2=0x558d21c7fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:49.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.597+0000 7fccdeffd640 1 --2- 172.21.15.59:0/2270770475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c76df0 0x558d21c7fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.597+0000 7fccdeffd640 1 -- 172.21.15.59:0/2270770475 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d21ba4c90 con 0x558d21c764d0 2024-09-10T21:20:49.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.597+0000 7fccdeffd640 1 --2- 172.21.15.59:0/2270770475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c764d0 0x558d21c826d0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009900 tx=0x7fccd0031750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c56a810890f722d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:49.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.597+0000 7fccc67fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:49.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.597+0000 7fccc67fc640 1 -- 172.21.15.59:0/2270770475 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd0035040 con 0x558d21c764d0 2024-09-10T21:20:49.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.597+0000 7fccc67fc640 1 -- 172.21.15.59:0/2270770475 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fccd0004240 con 0x558d21c764d0 2024-09-10T21:20:49.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.597+0000 7fcce77f5740 1 -- 172.21.15.59:0/2270770475 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558d21beedf0 con 0x558d21c764d0 2024-09-10T21:20:49.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.598+0000 7fccc67fc640 1 -- 172.21.15.59:0/2270770475 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fccd0004440 con 0x558d21c764d0 2024-09-10T21:20:49.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.598+0000 7fcce77f5740 10 client.16782 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:49.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.598+0000 7fcce77f5740 1 -- 172.21.15.59:0/2270770475 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558d21c913e0 con 0x558d21c764d0 2024-09-10T21:20:49.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.598+0000 7fccc67fc640 1 -- 172.21.15.59:0/2270770475 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558d21beedf0 con 0x558d21c764d0 2024-09-10T21:20:49.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.598+0000 7fccc67fc640 1 -- 172.21.15.59:0/2270770475 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fccd00049c0 con 0x558d21c764d0 2024-09-10T21:20:49.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.598+0000 7fcce77f5740 10 client.16782 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:49.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.598+0000 7fcce77f5740 10 client.16782 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:20:49.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.598+0000 7fcce77f5740 20 client.16782 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:49.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.598+0000 7fcce77f5740 1 --2- 172.21.15.59:0/2270770475 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558d21c928f0 0x558d21c94d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:49.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.598+0000 7fcce77f5740 4 client.16782 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:20:49.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.598+0000 7fcce77f5740 1 -- 172.21.15.59:0/2270770475 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d21bea8a0 con 0x558d21c928f0 2024-09-10T21:20:49.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.599+0000 7fccd7fff640 1 --2- 172.21.15.59:0/2270770475 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558d21c928f0 0x558d21c94d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:49.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.599+0000 7fccd7fff640 1 --2- 172.21.15.59:0/2270770475 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558d21c928f0 0x558d21c94d50 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6398f696109dd3a server_cookie=19eb6ea777ae0f28 in_seq=0 out_seq=0 2024-09-10T21:20:49.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.599+0000 7fccc67fc640 10 client.16782 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:49.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.600+0000 7fccc67fc640 1 -- 172.21.15.59:0/2270770475 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558d21bea8a0 con 0x558d21c928f0 2024-09-10T21:20:49.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.600+0000 7fccc67fc640 10 client.16782 handle_command_reply: tid=0 2024-09-10T21:20:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.600+0000 7fcce77f5740 1 client.16782 shutdown 2024-09-10T21:20:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.600+0000 7fcce77f5740 1 -- 172.21.15.59:0/2270770475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c764d0 msgr2=0x558d21c826d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.600+0000 7fcce77f5740 1 --2- 172.21.15.59:0/2270770475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c764d0 0x558d21c826d0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009900 tx=0x7fccd0031750 comp rx=0 tx=0).stop 2024-09-10T21:20:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.600+0000 7fcce77f5740 1 -- 172.21.15.59:0/2270770475 shutdown_connections 2024-09-10T21:20:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.600+0000 7fcce77f5740 1 --2- 172.21.15.59:0/2270770475 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c82d80 0x558d21c80180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.600+0000 7fcce77f5740 1 --2- 172.21.15.59:0/2270770475 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c76df0 0x558d21c7fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.600+0000 7fcce77f5740 1 --2- 172.21.15.59:0/2270770475 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558d21c928f0 0x558d21c94d50 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.600+0000 7fcce77f5740 1 --2- 172.21.15.59:0/2270770475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c764d0 0x558d21c826d0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.600+0000 7fcce77f5740 1 -- 172.21.15.59:0/2270770475 >> 172.21.15.59:0/2270770475 conn(0x558d21c74300 msgr2=0x558d21c79e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.600+0000 7fccc67fc640 0 client.16782 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.600+0000 7fcce77f5740 1 -- 172.21.15.59:0/2270770475 shutdown_connections 2024-09-10T21:20:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.600+0000 7fcce77f5740 1 -- 172.21.15.59:0/2270770475 wait complete. 2024-09-10T21:20:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.600+0000 7fcce77f5740 20 client.16782 trim_cache size 0 max 16384 2024-09-10T21:20:49.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.614+0000 7fcce77f5740 1 Processor -- start 2024-09-10T21:20:49.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.614+0000 7fcce77f5740 1 -- start start 2024-09-10T21:20:49.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.614+0000 7fcce77f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c764d0 0x558d21c8ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:49.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.614+0000 7fcce77f5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c76df0 0x558d21c7f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:49.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.614+0000 7fcce77f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c82d80 0x558d21c84170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:49.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.614+0000 7fcce77f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcce01b05c0 con 0x558d21c82d80 2024-09-10T21:20:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.614+0000 7fcce77f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcce01b2100 con 0x558d21c764d0 2024-09-10T21:20:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.614+0000 7fcce77f5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcce01b0c90 con 0x558d21c76df0 2024-09-10T21:20:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.614+0000 7fccdf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c82d80 0x558d21c84170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.614+0000 7fccdf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c82d80 0x558d21c84170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53282/0 (socket says 172.21.15.59:53282) 2024-09-10T21:20:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.614+0000 7fccdf7fe640 1 -- 172.21.15.59:0/1749918152 learned_addr learned my addr 172.21.15.59:0/1749918152 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.614+0000 7fccd7fff640 1 --2- 172.21.15.59:0/1749918152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c76df0 0x558d21c7f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.614+0000 7fccdeffd640 1 --2- 172.21.15.59:0/1749918152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c764d0 0x558d21c8ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.615+0000 7fccdf7fe640 1 -- 172.21.15.59:0/1749918152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c76df0 msgr2=0x558d21c7f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.615+0000 7fccdf7fe640 1 --2- 172.21.15.59:0/1749918152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c76df0 0x558d21c7f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.615+0000 7fccdf7fe640 1 -- 172.21.15.59:0/1749918152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c764d0 msgr2=0x558d21c8ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.615+0000 7fccdf7fe640 1 --2- 172.21.15.59:0/1749918152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c764d0 0x558d21c8ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.615+0000 7fccdf7fe640 1 -- 172.21.15.59:0/1749918152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d21c7f8d0 con 0x558d21c82d80 2024-09-10T21:20:49.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.615+0000 7fccdeffd640 1 --2- 172.21.15.59:0/1749918152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c764d0 0x558d21c8ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:49.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.615+0000 7fccdf7fe640 1 --2- 172.21.15.59:0/1749918152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c82d80 0x558d21c84170 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fccd8010980 tx=0x7fccd8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be647255ef8ddf58 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:49.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.615+0000 7fccd4ff9640 1 -- 172.21.15.59:0/1749918152 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd801e9a0 con 0x558d21c82d80 2024-09-10T21:20:49.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.615+0000 7fccd4ff9640 1 -- 172.21.15.59:0/1749918152 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccd8029480 con 0x558d21c82d80 2024-09-10T21:20:49.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.615+0000 7fccd4ff9640 1 -- 172.21.15.59:0/1749918152 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd801c650 con 0x558d21c82d80 2024-09-10T21:20:49.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.616+0000 7fcce77f5740 1 -- 172.21.15.59:0/1749918152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c82d80 msgr2=0x558d21c84170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:49.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.616+0000 7fcce77f5740 1 --2- 172.21.15.59:0/1749918152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c82d80 0x558d21c84170 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fccd8010980 tx=0x7fccd8019000 comp rx=0 tx=0).stop 2024-09-10T21:20:49.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.616+0000 7fcce77f5740 1 -- 172.21.15.59:0/1749918152 shutdown_connections 2024-09-10T21:20:49.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.616+0000 7fcce77f5740 1 --2- 172.21.15.59:0/1749918152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c82d80 0x558d21c84170 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.616+0000 7fcce77f5740 1 --2- 172.21.15.59:0/1749918152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c76df0 0x558d21c7f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.616+0000 7fcce77f5740 1 --2- 172.21.15.59:0/1749918152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c764d0 0x558d21c8ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.616+0000 7fcce77f5740 1 -- 172.21.15.59:0/1749918152 >> 172.21.15.59:0/1749918152 conn(0x558d21c74300 msgr2=0x558d21c7e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:49.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.616+0000 7fcce77f5740 1 -- 172.21.15.59:0/1749918152 shutdown_connections 2024-09-10T21:20:49.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.616+0000 7fcce77f5740 1 -- 172.21.15.59:0/1749918152 wait complete. 2024-09-10T21:20:49.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.616+0000 7fcce77f5740 1 -- start start 2024-09-10T21:20:49.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.616+0000 7fcce77f5740 1 Processor -- start 2024-09-10T21:20:49.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.616+0000 7fcce77f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c764d0 0x558d21c8b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:49.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.616+0000 7fcce77f5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c76df0 0x558d21c7bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:49.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.616+0000 7fcce77f5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c82d80 0x558d21c7c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:49.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fcce77f5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcce01b1a30 con 0x558d21c76df0 2024-09-10T21:20:49.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fcce77f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcce01b1360 con 0x558d21c764d0 2024-09-10T21:20:49.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fcce77f5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcce01ae5a0 con 0x558d21c82d80 2024-09-10T21:20:49.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fcce77f5740 10 client.0 _ll_register_callbacks cb 0x7fccd0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:49.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fccd7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c76df0 0x558d21c7bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:49.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fccd7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c76df0 0x558d21c7bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53294/0 (socket says 172.21.15.59:53294) 2024-09-10T21:20:49.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fccd7fff640 1 -- 172.21.15.59:0/1027404755 learned_addr learned my addr 172.21.15.59:0/1027404755 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:49.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fccdeffd640 1 --2- 172.21.15.59:0/1027404755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c764d0 0x558d21c8b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:49.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fccdf7fe640 1 --2- 172.21.15.59:0/1027404755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c82d80 0x558d21c7c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:49.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fccd7fff640 1 -- 172.21.15.59:0/1027404755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c82d80 msgr2=0x558d21c7c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:49.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fccd7fff640 1 --2- 172.21.15.59:0/1027404755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c82d80 0x558d21c7c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fccd7fff640 1 -- 172.21.15.59:0/1027404755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c764d0 msgr2=0x558d21c8b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:49.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fccd7fff640 1 --2- 172.21.15.59:0/1027404755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c764d0 0x558d21c8b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fccd7fff640 1 -- 172.21.15.59:0/1027404755 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d21c7c810 con 0x558d21c76df0 2024-09-10T21:20:49.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fccdeffd640 1 --2- 172.21.15.59:0/1027404755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c764d0 0x558d21c8b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:20:49.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fccd7fff640 1 --2- 172.21.15.59:0/1027404755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c76df0 0x558d21c7bd40 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fccc80a8ce0 tx=0x7fccc8003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78cf0026d8ebc470 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:49.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fccc67fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:49.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fccc67fc640 1 -- 172.21.15.59:0/1027404755 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc80abe80 con 0x558d21c76df0 2024-09-10T21:20:49.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fccc67fc640 1 -- 172.21.15.59:0/1027404755 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fccc80e3ad0 con 0x558d21c76df0 2024-09-10T21:20:49.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fcce77f5740 1 -- 172.21.15.59:0/1027404755 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccd8029480 con 0x558d21c76df0 2024-09-10T21:20:49.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.617+0000 7fccc67fc640 1 -- 172.21.15.59:0/1027404755 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fccc80ac060 con 0x558d21c76df0 2024-09-10T21:20:49.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.618+0000 7fcce77f5740 10 client.16788 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:49.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.618+0000 7fcce77f5740 1 -- 172.21.15.59:0/1027404755 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558d21c7db10 con 0x558d21c76df0 2024-09-10T21:20:49.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.618+0000 7fccc67fc640 1 -- 172.21.15.59:0/1027404755 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccd8029480 con 0x558d21c76df0 2024-09-10T21:20:49.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.618+0000 7fccc67fc640 1 -- 172.21.15.59:0/1027404755 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fccc80ac970 con 0x558d21c76df0 2024-09-10T21:20:49.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.618+0000 7fcce77f5740 10 client.16788 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:49.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.618+0000 7fcce77f5740 10 client.16788 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:20:49.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.618+0000 7fcce77f5740 20 client.16788 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:49.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.618+0000 7fcce77f5740 1 --2- 172.21.15.59:0/1027404755 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558d21d009d0 0x558d21d02dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:49.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.618+0000 7fcce77f5740 4 client.16788 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:20:49.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.618+0000 7fcce77f5740 1 -- 172.21.15.59:0/1027404755 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558d21be7cd0 con 0x558d21d009d0 2024-09-10T21:20:49.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.618+0000 7fccdeffd640 1 --2- 172.21.15.59:0/1027404755 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558d21d009d0 0x558d21d02dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:49.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.619+0000 7fccc67fc640 10 client.16788 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:49.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.619+0000 7fccdeffd640 1 --2- 172.21.15.59:0/1027404755 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558d21d009d0 0x558d21d02dc0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b187aba6be10d691 server_cookie=149770fdf298fa32 in_seq=0 out_seq=0 2024-09-10T21:20:49.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.619+0000 7fccc67fc640 1 -- 172.21.15.59:0/1027404755 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558d21be7cd0 con 0x558d21d009d0 2024-09-10T21:20:49.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.619+0000 7fccc67fc640 10 client.16788 handle_command_reply: tid=0 2024-09-10T21:20:49.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.619+0000 7fcce77f5740 1 client.16788 shutdown 2024-09-10T21:20:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.619+0000 7fcce77f5740 1 -- 172.21.15.59:0/1027404755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c76df0 msgr2=0x558d21c7bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.619+0000 7fcce77f5740 1 --2- 172.21.15.59:0/1027404755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c76df0 0x558d21c7bd40 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fccc80a8ce0 tx=0x7fccc8003e70 comp rx=0 tx=0).stop 2024-09-10T21:20:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.619+0000 7fcce77f5740 1 -- 172.21.15.59:0/1027404755 shutdown_connections 2024-09-10T21:20:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.619+0000 7fcce77f5740 1 --2- 172.21.15.59:0/1027404755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558d21c82d80 0x558d21c7c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.619+0000 7fcce77f5740 1 --2- 172.21.15.59:0/1027404755 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558d21d009d0 0x558d21d02dc0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.619+0000 7fcce77f5740 1 --2- 172.21.15.59:0/1027404755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558d21c76df0 0x558d21c7bd40 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.619+0000 7fcce77f5740 1 --2- 172.21.15.59:0/1027404755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558d21c764d0 0x558d21c8b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.619+0000 7fcce77f5740 1 -- 172.21.15.59:0/1027404755 >> 172.21.15.59:0/1027404755 conn(0x558d21c74300 msgr2=0x558d21c72c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.619+0000 7fccc67fc640 0 client.16788 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.620+0000 7fcce77f5740 1 -- 172.21.15.59:0/1027404755 shutdown_connections 2024-09-10T21:20:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.620+0000 7fcce77f5740 1 -- 172.21.15.59:0/1027404755 wait complete. 2024-09-10T21:20:49.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.620+0000 7fcce77f5740 20 client.16788 trim_cache size 0 max 16384 2024-09-10T21:20:49.630 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:20:49.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.620+0000 7fcce5420640 1 -- 172.21.15.59:0/2269582024 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcccc0b52e0 msgr2=0x7fcccc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:49.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.620+0000 7fcce5420640 1 --2- 172.21.15.59:0/2269582024 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcccc0b52e0 0x7fcccc0b77a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fccd8005fd0 tx=0x7fccd80096a0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.620+0000 7fcce5420640 1 -- 172.21.15.59:0/2269582024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce01045c0 msgr2=0x7fcce019baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:49.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.620+0000 7fcce5420640 1 --2- 172.21.15.59:0/2269582024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce01045c0 0x7fcce019baa0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fccc800e9c0 tx=0x7fccc800ee80 comp rx=0 tx=0).stop 2024-09-10T21:20:49.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.620+0000 7fcce5420640 1 -- 172.21.15.59:0/2269582024 shutdown_connections 2024-09-10T21:20:49.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.620+0000 7fcce5420640 1 --2- 172.21.15.59:0/2269582024 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcccc0b52e0 0x7fcccc0b77a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.620+0000 7fcce5420640 1 --2- 172.21.15.59:0/2269582024 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcce010d100 0x7fcce01a0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.620+0000 7fcce5420640 1 --2- 172.21.15.59:0/2269582024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce01045c0 0x7fcce019baa0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.620+0000 7fcce5420640 1 --2- 172.21.15.59:0/2269582024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcce0103ca0 0x7fcce019b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:49.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.620+0000 7fcce5420640 1 -- 172.21.15.59:0/2269582024 >> 172.21.15.59:0/2269582024 conn(0x7fcce00fd700 msgr2=0x7fcce00fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:49.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.620+0000 7fcce5420640 1 -- 172.21.15.59:0/2269582024 shutdown_connections 2024-09-10T21:20:49.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:49.620+0000 7fcce5420640 1 -- 172.21.15.59:0/2269582024 wait complete. 2024-09-10T21:20:50.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:50 smithi192 ceph-mon[35363]: pgmap v507: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:50.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:50 smithi059 ceph-mon[30888]: pgmap v507: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:50.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:50 smithi154 ceph-mon[35041]: pgmap v507: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:51.348 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:20:51.349 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:20:51.622 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:20:52.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.189+0000 7ff4ec08c640 1 -- 172.21.15.59:0/966454256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4e410d120 msgr2=0x7ff4e410f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:52.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.189+0000 7ff4ec08c640 1 --2- 172.21.15.59:0/966454256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4e410d120 0x7ff4e410f590 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009ca0 tx=0x7ff4dc02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.189+0000 7ff4ec08c640 1 -- 172.21.15.59:0/966454256 shutdown_connections 2024-09-10T21:20:52.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.189+0000 7ff4ec08c640 1 --2- 172.21.15.59:0/966454256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4e410d120 0x7ff4e410f590 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.189+0000 7ff4ec08c640 1 --2- 172.21.15.59:0/966454256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4e4104570 0x7ff4e410cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.189+0000 7ff4ec08c640 1 --2- 172.21.15.59:0/966454256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4e4103b70 0x7ff4e4103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.189+0000 7ff4ec08c640 1 -- 172.21.15.59:0/966454256 >> 172.21.15.59:0/966454256 conn(0x7ff4e40fd700 msgr2=0x7ff4e40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.189+0000 7ff4ec08c640 1 -- 172.21.15.59:0/966454256 shutdown_connections 2024-09-10T21:20:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.189+0000 7ff4ec08c640 1 -- 172.21.15.59:0/966454256 wait complete. 2024-09-10T21:20:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.189+0000 7ff4ec08c640 1 Processor -- start 2024-09-10T21:20:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.189+0000 7ff4ec08c640 1 -- start start 2024-09-10T21:20:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.190+0000 7ff4ec08c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4e4103b70 0x7ff4e4199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.190+0000 7ff4ec08c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4e4104570 0x7ff4e4199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.190+0000 7ff4ec08c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4e410d120 0x7ff4e419ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.190+0000 7ff4ec08c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e4112e60 con 0x7ff4e4104570 2024-09-10T21:20:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.190+0000 7ff4ec08c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e4112ce0 con 0x7ff4e4103b70 2024-09-10T21:20:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.190+0000 7ff4ec08c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e4112fe0 con 0x7ff4e410d120 2024-09-10T21:20:52.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.190+0000 7ff4e9627640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4e4104570 0x7ff4e4199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.190+0000 7ff4e9627640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4e4104570 0x7ff4e4199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53304/0 (socket says 172.21.15.59:53304) 2024-09-10T21:20:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.190+0000 7ff4e9627640 1 -- 172.21.15.59:0/2057309087 learned_addr learned my addr 172.21.15.59:0/2057309087 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.190+0000 7ff4e9e28640 1 --2- 172.21.15.59:0/2057309087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4e4103b70 0x7ff4e4199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.190+0000 7ff4ea629640 1 --2- 172.21.15.59:0/2057309087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4e410d120 0x7ff4e419ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.190+0000 7ff4e9627640 1 -- 172.21.15.59:0/2057309087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4e410d120 msgr2=0x7ff4e419ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.190+0000 7ff4e9627640 1 --2- 172.21.15.59:0/2057309087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4e410d120 0x7ff4e419ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.190+0000 7ff4e9627640 1 -- 172.21.15.59:0/2057309087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4e4103b70 msgr2=0x7ff4e4199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.190+0000 7ff4e9627640 1 --2- 172.21.15.59:0/2057309087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4e4103b70 0x7ff4e4199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.190+0000 7ff4e9627640 1 -- 172.21.15.59:0/2057309087 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e419f400 con 0x7ff4e4104570 2024-09-10T21:20:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.190+0000 7ff4e9627640 1 --2- 172.21.15.59:0/2057309087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4e4104570 0x7ff4e4199890 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff4d400b4a0 tx=0x7ff4d400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.191+0000 7ff4daffd640 1 -- 172.21.15.59:0/2057309087 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4015020 con 0x7ff4e4104570 2024-09-10T21:20:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.191+0000 7ff4daffd640 1 -- 172.21.15.59:0/2057309087 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4d4011ce0 con 0x7ff4e4104570 2024-09-10T21:20:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.191+0000 7ff4daffd640 1 -- 172.21.15.59:0/2057309087 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4010dc0 con 0x7ff4e4104570 2024-09-10T21:20:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.191+0000 7ff4ec08c640 1 -- 172.21.15.59:0/2057309087 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e419f6f0 con 0x7ff4e4104570 2024-09-10T21:20:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.191+0000 7ff4ec08c640 1 -- 172.21.15.59:0/2057309087 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e41a5f80 con 0x7ff4e4104570 2024-09-10T21:20:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.193+0000 7ff4ee461740 1 Processor -- start 2024-09-10T21:20:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.193+0000 7ff4ee461740 1 -- start start 2024-09-10T21:20:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.193+0000 7ff4daffd640 1 -- 172.21.15.59:0/2057309087 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7ff4d4011830 con 0x7ff4e4104570 2024-09-10T21:20:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.194+0000 7ff4ee461740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810deee0 0x5581810df2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.194+0000 7ff4ee461740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810df800 0x5581810eb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.194+0000 7ff4ee461740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810eb790 0x5581810edb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.194+0000 7ff4ee461740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558181055e60 con 0x5581810df800 2024-09-10T21:20:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.194+0000 7ff4ee461740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558181045290 con 0x5581810eb790 2024-09-10T21:20:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.194+0000 7ff4ee461740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5581810490a0 con 0x5581810deee0 2024-09-10T21:20:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.194+0000 7ff4e9e28640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810df800 0x5581810eb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.194+0000 7ff4e9e28640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810df800 0x5581810eb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53310/0 (socket says 172.21.15.59:53310) 2024-09-10T21:20:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.194+0000 7ff4e9e28640 1 -- 172.21.15.59:0/1220984632 learned_addr learned my addr 172.21.15.59:0/1220984632 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.194+0000 7ff4ea629640 1 --2- 172.21.15.59:0/1220984632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810deee0 0x5581810df2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.194+0000 7ff4e9627640 1 --2- 172.21.15.59:0/1220984632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810eb790 0x5581810edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.194+0000 7ff4e9e28640 1 -- 172.21.15.59:0/1220984632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810deee0 msgr2=0x5581810df2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.194+0000 7ff4e9e28640 1 --2- 172.21.15.59:0/1220984632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810deee0 0x5581810df2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.194+0000 7ff4e9e28640 1 -- 172.21.15.59:0/1220984632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810eb790 msgr2=0x5581810edb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.194+0000 7ff4e9e28640 1 --2- 172.21.15.59:0/1220984632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810eb790 0x5581810edb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.194+0000 7ff4e9e28640 1 -- 172.21.15.59:0/1220984632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558180da3930 con 0x5581810df800 2024-09-10T21:20:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.194+0000 7ff4e9e28640 1 --2- 172.21.15.59:0/1220984632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810df800 0x5581810eb250 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009aa0 tx=0x7ff4e0009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c753c4057ba23a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.194+0000 7ff4daffd640 1 --2- 172.21.15.59:0/2057309087 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff4d00b5360 0x7ff4d00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.195+0000 7ff4cffff640 1 -- 172.21.15.59:0/1220984632 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0017070 con 0x5581810df800 2024-09-10T21:20:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.195+0000 7ff4ea629640 1 --2- 172.21.15.59:0/2057309087 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff4d00b5360 0x7ff4d00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.195+0000 7ff4cffff640 1 -- 172.21.15.59:0/1220984632 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4e0013470 con 0x5581810df800 2024-09-10T21:20:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.195+0000 7ff4cffff640 1 -- 172.21.15.59:0/1220984632 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0012610 con 0x5581810df800 2024-09-10T21:20:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.195+0000 7ff4daffd640 1 -- 172.21.15.59:0/2057309087 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff4d40e5600 con 0x7ff4e4104570 2024-09-10T21:20:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.195+0000 7ff4ea629640 1 --2- 172.21.15.59:0/2057309087 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff4d00b5360 0x7ff4d00b7820 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc005fa0 tx=0x7ff4dc005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.195+0000 7ff4ee461740 1 -- 172.21.15.59:0/1220984632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810df800 msgr2=0x5581810eb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.195+0000 7ff4ee461740 1 --2- 172.21.15.59:0/1220984632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810df800 0x5581810eb250 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009aa0 tx=0x7ff4e0009f60 comp rx=0 tx=0).stop 2024-09-10T21:20:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.195+0000 7ff4ee461740 1 -- 172.21.15.59:0/1220984632 shutdown_connections 2024-09-10T21:20:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.195+0000 7ff4ee461740 1 --2- 172.21.15.59:0/1220984632 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810eb790 0x5581810edb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.195+0000 7ff4ee461740 1 --2- 172.21.15.59:0/1220984632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810df800 0x5581810eb250 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.195+0000 7ff4ee461740 1 --2- 172.21.15.59:0/1220984632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810deee0 0x5581810df2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.195+0000 7ff4ee461740 1 -- 172.21.15.59:0/1220984632 >> 172.21.15.59:0/1220984632 conn(0x5581810dcd10 msgr2=0x5581810ddeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.196+0000 7ff4ee461740 1 -- 172.21.15.59:0/1220984632 shutdown_connections 2024-09-10T21:20:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.196+0000 7ff4ee461740 1 -- 172.21.15.59:0/1220984632 wait complete. 2024-09-10T21:20:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.196+0000 7ff4ee461740 1 -- start start 2024-09-10T21:20:52.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.196+0000 7ff4ee461740 1 Processor -- start 2024-09-10T21:20:52.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.196+0000 7ff4ee461740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810deee0 0x5581810e86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:52.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.196+0000 7ff4ee461740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810df800 0x5581810e8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:52.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.196+0000 7ff4ee461740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810eb790 0x5581810e9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:52.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.196+0000 7ff4ee461740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558180ea6890 con 0x5581810deee0 2024-09-10T21:20:52.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.196+0000 7ff4ee461740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558180fdfd40 con 0x5581810eb790 2024-09-10T21:20:52.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.196+0000 7ff4ee461740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5581810ee440 con 0x5581810df800 2024-09-10T21:20:52.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.196+0000 7ff4ee461740 10 client.0 _ll_register_callbacks cb 0x558181043c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:52.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4e9e28640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810deee0 0x5581810e86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:52.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4e9e28640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810deee0 0x5581810e86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53316/0 (socket says 172.21.15.59:53316) 2024-09-10T21:20:52.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4e9e28640 1 -- 172.21.15.59:0/1254094825 learned_addr learned my addr 172.21.15.59:0/1254094825 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:52.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4ea629640 1 --2- 172.21.15.59:0/1254094825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810eb790 0x5581810e9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:52.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4e9627640 1 --2- 172.21.15.59:0/1254094825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810df800 0x5581810e8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:52.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4e9e28640 1 -- 172.21.15.59:0/1254094825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810df800 msgr2=0x5581810e8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:52.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4e9e28640 1 --2- 172.21.15.59:0/1254094825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810df800 0x5581810e8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4e9e28640 1 -- 172.21.15.59:0/1254094825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810eb790 msgr2=0x5581810e9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:52.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4e9e28640 1 --2- 172.21.15.59:0/1254094825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810eb790 0x5581810e9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4e9e28640 1 -- 172.21.15.59:0/1254094825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581810f77d0 con 0x5581810deee0 2024-09-10T21:20:52.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4ea629640 1 --2- 172.21.15.59:0/1254094825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810eb790 0x5581810e9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:52.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4e9627640 1 --2- 172.21.15.59:0/1254094825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810df800 0x5581810e8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:20:52.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4e9e28640 1 --2- 172.21.15.59:0/1254094825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810deee0 0x5581810e86c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0006cd0 tx=0x7ff4e000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e639965f849c1465 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:52.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:52.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4cd7fa640 1 -- 172.21.15.59:0/1254094825 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0017050 con 0x5581810deee0 2024-09-10T21:20:52.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4cd7fa640 1 -- 172.21.15.59:0/1254094825 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff4e001c450 con 0x5581810deee0 2024-09-10T21:20:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4ee461740 1 -- 172.21.15.59:0/1254094825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4e0013470 con 0x5581810deee0 2024-09-10T21:20:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4cd7fa640 1 -- 172.21.15.59:0/1254094825 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff4e002d070 con 0x5581810deee0 2024-09-10T21:20:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4ee461740 10 client.16800 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.197+0000 7ff4ee461740 1 -- 172.21.15.59:0/1254094825 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5581810fa160 con 0x5581810deee0 2024-09-10T21:20:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.198+0000 7ff4cd7fa640 1 -- 172.21.15.59:0/1254094825 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4e0013470 con 0x5581810deee0 2024-09-10T21:20:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.198+0000 7ff4cd7fa640 1 -- 172.21.15.59:0/1254094825 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff4e00266c0 con 0x5581810deee0 2024-09-10T21:20:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.198+0000 7ff4ee461740 10 client.16800 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.198+0000 7ff4ee461740 10 client.16800 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:20:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.198+0000 7ff4ee461740 20 client.16800 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.198+0000 7ff4ee461740 1 --2- 172.21.15.59:0/1254094825 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5581810fb5c0 0x5581810fd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.198+0000 7ff4ee461740 4 client.16800 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:20:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.198+0000 7ff4ee461740 1 -- 172.21.15.59:0/1254094825 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558181057db0 con 0x5581810fb5c0 2024-09-10T21:20:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.198+0000 7ff4e9627640 1 --2- 172.21.15.59:0/1254094825 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5581810fb5c0 0x5581810fd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:52.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.199+0000 7ff4cd7fa640 10 client.16800 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:52.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.199+0000 7ff4e9627640 1 --2- 172.21.15.59:0/1254094825 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5581810fb5c0 0x5581810fd9b0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=350e78b43df3fb66 server_cookie=79c666c7b9f3d2f8 in_seq=0 out_seq=0 2024-09-10T21:20:52.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.199+0000 7ff4cd7fa640 1 -- 172.21.15.59:0/1254094825 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558181057db0 con 0x5581810fb5c0 2024-09-10T21:20:52.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.199+0000 7ff4cd7fa640 10 client.16800 handle_command_reply: tid=0 2024-09-10T21:20:52.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.200+0000 7ff4ee461740 1 client.16800 shutdown 2024-09-10T21:20:52.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.200+0000 7ff4ee461740 1 -- 172.21.15.59:0/1254094825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810deee0 msgr2=0x5581810e86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:52.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.200+0000 7ff4ee461740 1 --2- 172.21.15.59:0/1254094825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810deee0 0x5581810e86c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0006cd0 tx=0x7ff4e000ee20 comp rx=0 tx=0).stop 2024-09-10T21:20:52.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.200+0000 7ff4ee461740 1 -- 172.21.15.59:0/1254094825 shutdown_connections 2024-09-10T21:20:52.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.200+0000 7ff4ee461740 1 --2- 172.21.15.59:0/1254094825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810eb790 0x5581810e9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.200+0000 7ff4ee461740 1 --2- 172.21.15.59:0/1254094825 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810df800 0x5581810e8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.200+0000 7ff4ee461740 1 --2- 172.21.15.59:0/1254094825 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5581810fb5c0 0x5581810fd9b0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.200+0000 7ff4ee461740 1 --2- 172.21.15.59:0/1254094825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810deee0 0x5581810e86c0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.200+0000 7ff4cd7fa640 0 client.16800 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:52.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.200+0000 7ff4ee461740 1 -- 172.21.15.59:0/1254094825 >> 172.21.15.59:0/1254094825 conn(0x5581810dcd10 msgr2=0x5581810dbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:52.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.200+0000 7ff4ee461740 1 -- 172.21.15.59:0/1254094825 shutdown_connections 2024-09-10T21:20:52.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.200+0000 7ff4ee461740 1 -- 172.21.15.59:0/1254094825 wait complete. 2024-09-10T21:20:52.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.200+0000 7ff4ee461740 20 client.16800 trim_cache size 0 max 16384 2024-09-10T21:20:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.218+0000 7ff4ee461740 1 Processor -- start 2024-09-10T21:20:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.218+0000 7ff4ee461740 1 -- start start 2024-09-10T21:20:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.218+0000 7ff4ee461740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810deee0 0x5581810e58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.218+0000 7ff4ee461740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810df800 0x5581810e5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.218+0000 7ff4ee461740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810eb790 0x558181102fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.218+0000 7ff4ee461740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e41b0640 con 0x5581810df800 2024-09-10T21:20:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.218+0000 7ff4ee461740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e41b2180 con 0x5581810eb790 2024-09-10T21:20:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.218+0000 7ff4ee461740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e41b0d10 con 0x5581810deee0 2024-09-10T21:20:52.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.218+0000 7ff4e9627640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810df800 0x5581810e5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.218+0000 7ff4e9627640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810df800 0x5581810e5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53326/0 (socket says 172.21.15.59:53326) 2024-09-10T21:20:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.218+0000 7ff4e9627640 1 -- 172.21.15.59:0/1613180254 learned_addr learned my addr 172.21.15.59:0/1613180254 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.218+0000 7ff4e9e28640 1 --2- 172.21.15.59:0/1613180254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810deee0 0x5581810e58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.218+0000 7ff4e9627640 1 -- 172.21.15.59:0/1613180254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810deee0 msgr2=0x5581810e58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.218+0000 7ff4e9627640 1 --2- 172.21.15.59:0/1613180254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810deee0 0x5581810e58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.218+0000 7ff4e9627640 1 -- 172.21.15.59:0/1613180254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810eb790 msgr2=0x558181102fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.218+0000 7ff4e9627640 1 --2- 172.21.15.59:0/1613180254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810eb790 0x558181102fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.218+0000 7ff4e9627640 1 -- 172.21.15.59:0/1613180254 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581810dd790 con 0x5581810df800 2024-09-10T21:20:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.219+0000 7ff4e9627640 1 --2- 172.21.15.59:0/1613180254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810df800 0x5581810e5e30 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ff4d40abaf0 tx=0x7ff4d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdfa4eb000a2a587 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.219+0000 7ff4cf7fe640 1 -- 172.21.15.59:0/1613180254 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d40ab900 con 0x5581810df800 2024-09-10T21:20:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.219+0000 7ff4cf7fe640 1 -- 172.21.15.59:0/1613180254 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4d40ac4f0 con 0x5581810df800 2024-09-10T21:20:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.219+0000 7ff4cf7fe640 1 -- 172.21.15.59:0/1613180254 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d40a8060 con 0x5581810df800 2024-09-10T21:20:52.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.219+0000 7ff4ee461740 1 -- 172.21.15.59:0/1613180254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810df800 msgr2=0x5581810e5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.219+0000 7ff4ee461740 1 --2- 172.21.15.59:0/1613180254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810df800 0x5581810e5e30 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ff4d40abaf0 tx=0x7ff4d40046c0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.219+0000 7ff4ee461740 1 -- 172.21.15.59:0/1613180254 shutdown_connections 2024-09-10T21:20:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.219+0000 7ff4ee461740 1 --2- 172.21.15.59:0/1613180254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810eb790 0x558181102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.219+0000 7ff4ee461740 1 --2- 172.21.15.59:0/1613180254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810df800 0x5581810e5e30 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.219+0000 7ff4ee461740 1 --2- 172.21.15.59:0/1613180254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810deee0 0x5581810e58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.219+0000 7ff4ee461740 1 -- 172.21.15.59:0/1613180254 >> 172.21.15.59:0/1613180254 conn(0x5581810dcd10 msgr2=0x5581810e6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.220+0000 7ff4ee461740 1 -- 172.21.15.59:0/1613180254 shutdown_connections 2024-09-10T21:20:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.220+0000 7ff4ee461740 1 -- 172.21.15.59:0/1613180254 wait complete. 2024-09-10T21:20:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.220+0000 7ff4ee461740 1 -- start start 2024-09-10T21:20:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.220+0000 7ff4ee461740 1 Processor -- start 2024-09-10T21:20:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.220+0000 7ff4ee461740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810deee0 0x5581810f3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:52.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.220+0000 7ff4ee461740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810df800 0x5581810f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.220+0000 7ff4ee461740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810eb790 0x5581810f06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.220+0000 7ff4ee461740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e41b1ab0 con 0x5581810eb790 2024-09-10T21:20:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.220+0000 7ff4ee461740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e41b13e0 con 0x5581810deee0 2024-09-10T21:20:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.220+0000 7ff4ee461740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e41ae640 con 0x5581810df800 2024-09-10T21:20:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.220+0000 7ff4ee461740 10 client.0 _ll_register_callbacks cb 0x7ff4dc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.221+0000 7ff4ea629640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810eb790 0x5581810f06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.221+0000 7ff4ea629640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810eb790 0x5581810f06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53332/0 (socket says 172.21.15.59:53332) 2024-09-10T21:20:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.221+0000 7ff4ea629640 1 -- 172.21.15.59:0/581274429 learned_addr learned my addr 172.21.15.59:0/581274429 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.221+0000 7ff4e9627640 1 --2- 172.21.15.59:0/581274429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810df800 0x5581810f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.221+0000 7ff4e9e28640 1 --2- 172.21.15.59:0/581274429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810deee0 0x5581810f3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.221+0000 7ff4ea629640 1 -- 172.21.15.59:0/581274429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810df800 msgr2=0x5581810f3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.221+0000 7ff4ea629640 1 --2- 172.21.15.59:0/581274429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810df800 0x5581810f3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.221+0000 7ff4ea629640 1 -- 172.21.15.59:0/581274429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810deee0 msgr2=0x5581810f3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.221+0000 7ff4ea629640 1 --2- 172.21.15.59:0/581274429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810deee0 0x5581810f3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.221+0000 7ff4ea629640 1 -- 172.21.15.59:0/581274429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581810f0ee0 con 0x5581810eb790 2024-09-10T21:20:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.221+0000 7ff4e9e28640 1 --2- 172.21.15.59:0/581274429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810deee0 0x5581810f3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:20:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.221+0000 7ff4ea629640 1 --2- 172.21.15.59:0/581274429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810eb790 0x5581810f06d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc035000 tx=0x7ff4dc031570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e568ab3edfe8464 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.221+0000 7ff4cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.221+0000 7ff4cd7fa640 1 -- 172.21.15.59:0/581274429 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc003e00 con 0x5581810eb790 2024-09-10T21:20:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.221+0000 7ff4cd7fa640 1 -- 172.21.15.59:0/581274429 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff4dc042030 con 0x5581810eb790 2024-09-10T21:20:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.221+0000 7ff4ee461740 1 -- 172.21.15.59:0/581274429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4d40ac4f0 con 0x5581810eb790 2024-09-10T21:20:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.222+0000 7ff4cd7fa640 1 -- 172.21.15.59:0/581274429 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff4dc004040 con 0x5581810eb790 2024-09-10T21:20:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.222+0000 7ff4ee461740 10 client.16806 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.222+0000 7ff4ee461740 1 -- 172.21.15.59:0/581274429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558181168d30 con 0x5581810eb790 2024-09-10T21:20:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.222+0000 7ff4cd7fa640 1 -- 172.21.15.59:0/581274429 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4d40ac4f0 con 0x5581810eb790 2024-09-10T21:20:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.222+0000 7ff4cd7fa640 1 -- 172.21.15.59:0/581274429 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff4dc05f020 con 0x5581810eb790 2024-09-10T21:20:52.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.222+0000 7ff4ee461740 10 client.16806 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.222+0000 7ff4ee461740 10 client.16806 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:20:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.222+0000 7ff4ee461740 20 client.16806 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.222+0000 7ff4ee461740 1 --2- 172.21.15.59:0/581274429 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5581811694d0 0x55818116b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.222+0000 7ff4ee461740 4 client.16806 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:20:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.222+0000 7ff4ee461740 1 -- 172.21.15.59:0/581274429 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558181053860 con 0x5581811694d0 2024-09-10T21:20:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.222+0000 7ff4e9e28640 1 --2- 172.21.15.59:0/581274429 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5581811694d0 0x55818116b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.223+0000 7ff4e9e28640 1 --2- 172.21.15.59:0/581274429 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5581811694d0 0x55818116b8f0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebd66dfbe64782e4 server_cookie=61de2776f86ab862 in_seq=0 out_seq=0 2024-09-10T21:20:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.223+0000 7ff4cd7fa640 10 client.16806 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.224+0000 7ff4cd7fa640 1 -- 172.21.15.59:0/581274429 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558181053860 con 0x5581811694d0 2024-09-10T21:20:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.224+0000 7ff4cd7fa640 10 client.16806 handle_command_reply: tid=0 2024-09-10T21:20:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.225+0000 7ff4ee461740 1 client.16806 shutdown 2024-09-10T21:20:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.225+0000 7ff4ee461740 1 -- 172.21.15.59:0/581274429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810eb790 msgr2=0x5581810f06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.225+0000 7ff4ee461740 1 --2- 172.21.15.59:0/581274429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810eb790 0x5581810f06d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc035000 tx=0x7ff4dc031570 comp rx=0 tx=0).stop 2024-09-10T21:20:52.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.225+0000 7ff4ee461740 1 -- 172.21.15.59:0/581274429 shutdown_connections 2024-09-10T21:20:52.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.225+0000 7ff4ee461740 1 --2- 172.21.15.59:0/581274429 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5581811694d0 0x55818116b8f0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.225+0000 7ff4ee461740 1 --2- 172.21.15.59:0/581274429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581810eb790 0x5581810f06d0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.225+0000 7ff4cd7fa640 0 client.16806 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:52.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.225+0000 7ff4ee461740 1 --2- 172.21.15.59:0/581274429 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581810df800 0x5581810f3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.225+0000 7ff4ee461740 1 --2- 172.21.15.59:0/581274429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581810deee0 0x5581810f3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.225+0000 7ff4ee461740 1 -- 172.21.15.59:0/581274429 >> 172.21.15.59:0/581274429 conn(0x5581810dcd10 msgr2=0x5581810e9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:52.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.225+0000 7ff4ee461740 1 -- 172.21.15.59:0/581274429 shutdown_connections 2024-09-10T21:20:52.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.225+0000 7ff4ee461740 1 -- 172.21.15.59:0/581274429 wait complete. 2024-09-10T21:20:52.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.225+0000 7ff4ee461740 20 client.16806 trim_cache size 0 max 16384 2024-09-10T21:20:52.236 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:20:52.237 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:20:52.237 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "800cdb00-6a99-4c42-8a9e-4b1c599c6af0", 2024-09-10T21:20:52.237 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:20:52.237 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:20:52.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.226+0000 7ff4ec08c640 1 -- 172.21.15.59:0/2057309087 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff4d00b5360 msgr2=0x7ff4d00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:52.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.226+0000 7ff4ec08c640 1 --2- 172.21.15.59:0/2057309087 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff4d00b5360 0x7ff4d00b7820 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc005fa0 tx=0x7ff4dc005c30 comp rx=0 tx=0).stop 2024-09-10T21:20:52.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.226+0000 7ff4ec08c640 1 -- 172.21.15.59:0/2057309087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4e4104570 msgr2=0x7ff4e4199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:52.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.226+0000 7ff4ec08c640 1 --2- 172.21.15.59:0/2057309087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4e4104570 0x7ff4e4199890 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff4d400b4a0 tx=0x7ff4d400b8a0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.226+0000 7ff4ec08c640 1 -- 172.21.15.59:0/2057309087 shutdown_connections 2024-09-10T21:20:52.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.226+0000 7ff4ec08c640 1 --2- 172.21.15.59:0/2057309087 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff4d00b5360 0x7ff4d00b7820 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.226+0000 7ff4ec08c640 1 --2- 172.21.15.59:0/2057309087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4e410d120 0x7ff4e419ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.226+0000 7ff4ec08c640 1 --2- 172.21.15.59:0/2057309087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4e4104570 0x7ff4e4199890 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.226+0000 7ff4ec08c640 1 --2- 172.21.15.59:0/2057309087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff4e4103b70 0x7ff4e4199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:52.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.226+0000 7ff4ec08c640 1 -- 172.21.15.59:0/2057309087 >> 172.21.15.59:0/2057309087 conn(0x7ff4e40fd700 msgr2=0x7ff4e40fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:52.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.226+0000 7ff4ec08c640 1 -- 172.21.15.59:0/2057309087 shutdown_connections 2024-09-10T21:20:52.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:52.226+0000 7ff4ec08c640 1 -- 172.21.15.59:0/2057309087 wait complete. 2024-09-10T21:20:52.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:52 smithi192 ceph-mon[35363]: pgmap v508: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:20:52.853 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:52 smithi059 ceph-mon[30888]: pgmap v508: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:20:52.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:20:52.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:52 smithi154 ceph-mon[35041]: pgmap v508: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:20:53.145 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:20:53.549 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:53 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:20:53.549 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:53 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:20:53.549 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:53 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:20:53.550 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:53 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:20:53.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.629+0000 7f138c814640 1 -- 172.21.15.59:0/3206154083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1388108060 msgr2=0x7f138810e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:53.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.629+0000 7f138c814640 1 --2- 172.21.15.59:0/3206154083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1388108060 0x7f138810e860 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f1380009ca0 tx=0x7f138002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.629+0000 7f138c814640 1 -- 172.21.15.59:0/3206154083 shutdown_connections 2024-09-10T21:20:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.629+0000 7f138c814640 1 --2- 172.21.15.59:0/3206154083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1388108060 0x7f138810e860 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.629+0000 7f138c814640 1 --2- 172.21.15.59:0/3206154083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13881076e0 0x7f1388107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.629+0000 7f138c814640 1 --2- 172.21.15.59:0/3206154083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1388101cd0 0x7f13881020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.629+0000 7f138c814640 1 -- 172.21.15.59:0/3206154083 >> 172.21.15.59:0/3206154083 conn(0x7f13880fd700 msgr2=0x7f13880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.629+0000 7f138c814640 1 -- 172.21.15.59:0/3206154083 shutdown_connections 2024-09-10T21:20:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.629+0000 7f138c814640 1 -- 172.21.15.59:0/3206154083 wait complete. 2024-09-10T21:20:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.630+0000 7f138c814640 1 Processor -- start 2024-09-10T21:20:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.630+0000 7f138c814640 1 -- start start 2024-09-10T21:20:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.630+0000 7f138c814640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1388101cd0 0x7f1388199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.630+0000 7f138c814640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13881076e0 0x7f13881997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.630+0000 7f138c814640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1388108060 0x7f138819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.630+0000 7f138c814640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1388111d20 con 0x7f13881076e0 2024-09-10T21:20:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.630+0000 7f138c814640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1388111ba0 con 0x7f1388108060 2024-09-10T21:20:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.630+0000 7f138c814640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1388111ea0 con 0x7f1388101cd0 2024-09-10T21:20:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.630+0000 7f1385d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13881076e0 0x7f13881997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.630+0000 7f1385d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13881076e0 0x7f13881997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53354/0 (socket says 172.21.15.59:53354) 2024-09-10T21:20:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.630+0000 7f1385d9b640 1 -- 172.21.15.59:0/3442199510 learned_addr learned my addr 172.21.15.59:0/3442199510 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.631+0000 7f138659c640 1 --2- 172.21.15.59:0/3442199510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1388101cd0 0x7f1388199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.631+0000 7f1385d9b640 1 -- 172.21.15.59:0/3442199510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1388101cd0 msgr2=0x7f1388199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.631+0000 7f1385d9b640 1 --2- 172.21.15.59:0/3442199510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1388101cd0 0x7f1388199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.631+0000 7f1385d9b640 1 -- 172.21.15.59:0/3442199510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1388108060 msgr2=0x7f138819eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.631+0000 7f1385d9b640 1 --2- 172.21.15.59:0/3442199510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1388108060 0x7f138819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.631+0000 7f1385d9b640 1 -- 172.21.15.59:0/3442199510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f138819f330 con 0x7f13881076e0 2024-09-10T21:20:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.631+0000 7f1385d9b640 1 --2- 172.21.15.59:0/3442199510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13881076e0 0x7f13881997c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f137c00b4a0 tx=0x7f137c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.631+0000 7f13777fe640 1 -- 172.21.15.59:0/3442199510 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c014070 con 0x7f13881076e0 2024-09-10T21:20:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.631+0000 7f13777fe640 1 -- 172.21.15.59:0/3442199510 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f137c010ac0 con 0x7f13881076e0 2024-09-10T21:20:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.631+0000 7f138c814640 1 -- 172.21.15.59:0/3442199510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f138819f620 con 0x7f13881076e0 2024-09-10T21:20:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.631+0000 7f13777fe640 1 -- 172.21.15.59:0/3442199510 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c017c30 con 0x7f13881076e0 2024-09-10T21:20:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.631+0000 7f138c814640 1 -- 172.21.15.59:0/3442199510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13881a5d60 con 0x7f13881076e0 2024-09-10T21:20:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.634+0000 7f138ebe9740 1 Processor -- start 2024-09-10T21:20:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.634+0000 7f13777fe640 1 -- 172.21.15.59:0/3442199510 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f137c010610 con 0x7f13881076e0 2024-09-10T21:20:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.634+0000 7f138ebe9740 1 -- start start 2024-09-10T21:20:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.634+0000 7f138ebe9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771480 0x55b0e0771860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.634+0000 7f138ebe9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e0771da0 0x55b0e077d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.634+0000 7f138ebe9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e077dd30 0x55b0e0780120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.634+0000 7f138ebe9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b0e06e7e50 con 0x55b0e0771480 2024-09-10T21:20:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.634+0000 7f138ebe9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b0e06d7280 con 0x55b0e077dd30 2024-09-10T21:20:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.634+0000 7f138ebe9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b0e06db090 con 0x55b0e0771da0 2024-09-10T21:20:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.634+0000 7f1386d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771480 0x55b0e0771860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.634+0000 7f1386d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771480 0x55b0e0771860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53356/0 (socket says 172.21.15.59:53356) 2024-09-10T21:20:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.634+0000 7f1386d9d640 1 -- 172.21.15.59:0/2418003941 learned_addr learned my addr 172.21.15.59:0/2418003941 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.635+0000 7f1385d9b640 1 --2- 172.21.15.59:0/2418003941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e077dd30 0x55b0e0780120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.635+0000 7f138659c640 1 --2- 172.21.15.59:0/2418003941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e0771da0 0x55b0e077d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.635+0000 7f1386d9d640 1 -- 172.21.15.59:0/2418003941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e0771da0 msgr2=0x55b0e077d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.635+0000 7f1386d9d640 1 --2- 172.21.15.59:0/2418003941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e0771da0 0x55b0e077d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.635+0000 7f1386d9d640 1 -- 172.21.15.59:0/2418003941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e077dd30 msgr2=0x55b0e0780120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.635+0000 7f13777fe640 1 --2- 172.21.15.59:0/3442199510 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f13700b52e0 0x7f13700b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.635+0000 7f1386d9d640 1 --2- 172.21.15.59:0/2418003941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e077dd30 0x55b0e0780120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.635+0000 7f1386d9d640 1 -- 172.21.15.59:0/2418003941 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0e0435650 con 0x55b0e0771480 2024-09-10T21:20:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.635+0000 7f1385d9b640 1 --2- 172.21.15.59:0/2418003941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e077dd30 0x55b0e0780120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.635+0000 7f13777fe640 1 -- 172.21.15.59:0/3442199510 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f137c0e54f0 con 0x7f13881076e0 2024-09-10T21:20:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.635+0000 7f1386d9d640 1 --2- 172.21.15.59:0/2418003941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771480 0x55b0e0771860 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f13800097b0 tx=0x7f1380005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd5e62f40a09f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:53.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.635+0000 7f1386d9d640 1 --2- 172.21.15.59:0/3442199510 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f13700b52e0 0x7f13700b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:53.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.635+0000 7f1374ff9640 1 -- 172.21.15.59:0/2418003941 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1380031db0 con 0x55b0e0771480 2024-09-10T21:20:53.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.635+0000 7f1374ff9640 1 -- 172.21.15.59:0/2418003941 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f138003f070 con 0x55b0e0771480 2024-09-10T21:20:53.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.635+0000 7f1374ff9640 1 -- 172.21.15.59:0/2418003941 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1380004390 con 0x55b0e0771480 2024-09-10T21:20:53.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.636+0000 7f138ebe9740 1 -- 172.21.15.59:0/2418003941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771480 msgr2=0x55b0e0771860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:53.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.636+0000 7f1386d9d640 1 --2- 172.21.15.59:0/3442199510 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f13700b52e0 0x7f13700b77a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1380043000 tx=0x7f1380004690 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:53.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.636+0000 7f138ebe9740 1 --2- 172.21.15.59:0/2418003941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771480 0x55b0e0771860 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f13800097b0 tx=0x7f1380005fa0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.636+0000 7f138ebe9740 1 -- 172.21.15.59:0/2418003941 shutdown_connections 2024-09-10T21:20:53.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.636+0000 7f138ebe9740 1 --2- 172.21.15.59:0/2418003941 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e077dd30 0x55b0e0780120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.636+0000 7f138ebe9740 1 --2- 172.21.15.59:0/2418003941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e0771da0 0x55b0e077d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.636+0000 7f138ebe9740 1 --2- 172.21.15.59:0/2418003941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771480 0x55b0e0771860 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.636+0000 7f138ebe9740 1 -- 172.21.15.59:0/2418003941 >> 172.21.15.59:0/2418003941 conn(0x55b0e076f2b0 msgr2=0x55b0e0770450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:53.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.636+0000 7f138ebe9740 1 -- 172.21.15.59:0/2418003941 shutdown_connections 2024-09-10T21:20:53.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.636+0000 7f138ebe9740 1 -- 172.21.15.59:0/2418003941 wait complete. 2024-09-10T21:20:53.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.637+0000 7f138ebe9740 1 -- start start 2024-09-10T21:20:53.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.637+0000 7f138ebe9740 1 Processor -- start 2024-09-10T21:20:53.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.637+0000 7f138ebe9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e0771480 0x55b0e077d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:53.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.637+0000 7f138ebe9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e0771da0 0x55b0e077aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:53.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.637+0000 7f138ebe9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e077dd30 0x55b0e077b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:53.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.637+0000 7f138ebe9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b0e0538700 con 0x55b0e077dd30 2024-09-10T21:20:53.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.637+0000 7f138ebe9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b0e0672110 con 0x55b0e0771480 2024-09-10T21:20:53.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.637+0000 7f138ebe9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b0e0780950 con 0x55b0e0771da0 2024-09-10T21:20:53.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.637+0000 7f138ebe9740 10 client.0 _ll_register_callbacks cb 0x55b0e068b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:53.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.637+0000 7f138659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e0771480 0x55b0e077d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:53.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.637+0000 7f138659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e0771480 0x55b0e077d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:42126/0 (socket says 172.21.15.59:42126) 2024-09-10T21:20:53.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.637+0000 7f138659c640 1 -- 172.21.15.59:0/2903638189 learned_addr learned my addr 172.21.15.59:0/2903638189 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:53.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.637+0000 7f1385d9b640 1 --2- 172.21.15.59:0/2903638189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e0771da0 0x55b0e077aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:53.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.637+0000 7f1386d9d640 1 --2- 172.21.15.59:0/2903638189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e077dd30 0x55b0e077b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:53.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.638+0000 7f138659c640 1 -- 172.21.15.59:0/2903638189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e0771da0 msgr2=0x55b0e077aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:53.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.638+0000 7f138659c640 1 --2- 172.21.15.59:0/2903638189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e0771da0 0x55b0e077aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.638+0000 7f138659c640 1 -- 172.21.15.59:0/2903638189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e077dd30 msgr2=0x55b0e077b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:53.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.638+0000 7f138659c640 1 --2- 172.21.15.59:0/2903638189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e077dd30 0x55b0e077b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.638+0000 7f138659c640 1 -- 172.21.15.59:0/2903638189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0e069fc40 con 0x55b0e0771480 2024-09-10T21:20:53.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.638+0000 7f138659c640 1 --2- 172.21.15.59:0/2903638189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e0771480 0x55b0e077d640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f137800baa0 tx=0x7f137800bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=729839858571aee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:53.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.638+0000 7f136dffb640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-09-10T21:20:53.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.638+0000 7f136dffb640 1 -- 172.21.15.59:0/2903638189 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1378003df0 con 0x55b0e0771480 2024-09-10T21:20:53.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.638+0000 7f136dffb640 1 -- 172.21.15.59:0/2903638189 <== mon.2 v2:172.21.15.154:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1378011440 con 0x55b0e0771480 2024-09-10T21:20:53.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.638+0000 7f138ebe9740 1 -- 172.21.15.59:0/2903638189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f138003f070 con 0x55b0e0771480 2024-09-10T21:20:53.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.638+0000 7f136dffb640 1 -- 172.21.15.59:0/2903638189 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1378011680 con 0x55b0e0771480 2024-09-10T21:20:53.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.638+0000 7f138ebe9740 10 client.25895 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:53.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.638+0000 7f138ebe9740 1 -- 172.21.15.59:0/2903638189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b0e078c310 con 0x55b0e0771480 2024-09-10T21:20:53.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.638+0000 7f136dffb640 1 -- 172.21.15.59:0/2903638189 <== mon.2 v2:172.21.15.154:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f138003f070 con 0x55b0e0771480 2024-09-10T21:20:53.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.639+0000 7f136dffb640 1 -- 172.21.15.59:0/2903638189 <== mon.2 v2:172.21.15.154:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1378026910 con 0x55b0e0771480 2024-09-10T21:20:53.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.639+0000 7f138ebe9740 10 client.25895 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:53.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.639+0000 7f138ebe9740 10 client.25895 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:20:53.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.639+0000 7f138ebe9740 20 client.25895 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:53.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.639+0000 7f138ebe9740 1 --2- 172.21.15.59:0/2903638189 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b0e078d870 0x55b0e078fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:53.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.639+0000 7f138ebe9740 4 client.25895 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:20:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.639+0000 7f138ebe9740 1 -- 172.21.15.59:0/2903638189 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0e06e9da0 con 0x55b0e078d870 2024-09-10T21:20:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.639+0000 7f1385d9b640 1 --2- 172.21.15.59:0/2903638189 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b0e078d870 0x55b0e078fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.639+0000 7f136dffb640 10 client.25895 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.639+0000 7f1385d9b640 1 --2- 172.21.15.59:0/2903638189 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b0e078d870 0x55b0e078fcf0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3184ac2134a9d28 server_cookie=5946ceee8a5d3e9d in_seq=0 out_seq=0 2024-09-10T21:20:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.640+0000 7f136dffb640 1 -- 172.21.15.59:0/2903638189 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b0e06e9da0 con 0x55b0e078d870 2024-09-10T21:20:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.640+0000 7f136dffb640 10 client.25895 handle_command_reply: tid=0 2024-09-10T21:20:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.640+0000 7f138ebe9740 1 client.25895 shutdown 2024-09-10T21:20:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.640+0000 7f138ebe9740 1 -- 172.21.15.59:0/2903638189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e0771480 msgr2=0x55b0e077d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.640+0000 7f138ebe9740 1 --2- 172.21.15.59:0/2903638189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e0771480 0x55b0e077d640 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f137800baa0 tx=0x7f137800bf60 comp rx=0 tx=0).stop 2024-09-10T21:20:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.640+0000 7f138ebe9740 1 -- 172.21.15.59:0/2903638189 shutdown_connections 2024-09-10T21:20:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.640+0000 7f138ebe9740 1 --2- 172.21.15.59:0/2903638189 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b0e078d870 0x55b0e078fcf0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.641+0000 7f138ebe9740 1 --2- 172.21.15.59:0/2903638189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e077dd30 0x55b0e077b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.641+0000 7f136dffb640 0 client.25895 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.641+0000 7f138ebe9740 1 --2- 172.21.15.59:0/2903638189 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e0771da0 0x55b0e077aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.641+0000 7f138ebe9740 1 --2- 172.21.15.59:0/2903638189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e0771480 0x55b0e077d640 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.641+0000 7f138ebe9740 1 -- 172.21.15.59:0/2903638189 >> 172.21.15.59:0/2903638189 conn(0x55b0e076f2b0 msgr2=0x55b0e0774e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.641+0000 7f138ebe9740 1 -- 172.21.15.59:0/2903638189 shutdown_connections 2024-09-10T21:20:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.641+0000 7f138ebe9740 1 -- 172.21.15.59:0/2903638189 wait complete. 2024-09-10T21:20:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.641+0000 7f138ebe9740 20 client.25895 trim_cache size 0 max 16384 2024-09-10T21:20:53.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f138ebe9740 1 Processor -- start 2024-09-10T21:20:53.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f138ebe9740 1 -- start start 2024-09-10T21:20:53.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f138ebe9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e0771480 0x55b0e0789b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:53.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f138ebe9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771da0 0x55b0e077f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:53.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f138ebe9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e077dd30 0x55b0e077f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:53.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f138ebe9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f13881ae430 con 0x55b0e0771da0 2024-09-10T21:20:53.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f138ebe9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f13881aff70 con 0x55b0e0771480 2024-09-10T21:20:53.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f138ebe9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f13881aeb00 con 0x55b0e077dd30 2024-09-10T21:20:53.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f1385d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771da0 0x55b0e077f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:53.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f1385d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771da0 0x55b0e077f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53376/0 (socket says 172.21.15.59:53376) 2024-09-10T21:20:53.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f1385d9b640 1 -- 172.21.15.59:0/579571303 learned_addr learned my addr 172.21.15.59:0/579571303 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:53.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f1386d9d640 1 --2- 172.21.15.59:0/579571303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e077dd30 0x55b0e077f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f138659c640 1 --2- 172.21.15.59:0/579571303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e0771480 0x55b0e0789b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f1385d9b640 1 -- 172.21.15.59:0/579571303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e077dd30 msgr2=0x55b0e077f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f1385d9b640 1 --2- 172.21.15.59:0/579571303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e077dd30 0x55b0e077f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f1385d9b640 1 -- 172.21.15.59:0/579571303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e0771480 msgr2=0x55b0e0789b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f1385d9b640 1 --2- 172.21.15.59:0/579571303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e0771480 0x55b0e0789b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f1385d9b640 1 -- 172.21.15.59:0/579571303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0e077a840 con 0x55b0e0771da0 2024-09-10T21:20:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f138659c640 1 --2- 172.21.15.59:0/579571303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e0771480 0x55b0e0789b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:20:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.659+0000 7f1385d9b640 1 --2- 172.21.15.59:0/579571303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771da0 0x55b0e077f120 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f137c0ab980 tx=0x7f137c0e2e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305b62df3e03665c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.660+0000 7f136ffff640 1 -- 172.21.15.59:0/579571303 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c01e040 con 0x55b0e0771da0 2024-09-10T21:20:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.660+0000 7f136ffff640 1 -- 172.21.15.59:0/579571303 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f137c017360 con 0x55b0e0771da0 2024-09-10T21:20:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.660+0000 7f136ffff640 1 -- 172.21.15.59:0/579571303 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c0b5210 con 0x55b0e0771da0 2024-09-10T21:20:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.660+0000 7f138ebe9740 1 -- 172.21.15.59:0/579571303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771da0 msgr2=0x55b0e077f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.660+0000 7f138ebe9740 1 --2- 172.21.15.59:0/579571303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771da0 0x55b0e077f120 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f137c0ab980 tx=0x7f137c0e2e90 comp rx=0 tx=0).stop 2024-09-10T21:20:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.660+0000 7f138ebe9740 1 -- 172.21.15.59:0/579571303 shutdown_connections 2024-09-10T21:20:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.660+0000 7f138ebe9740 1 --2- 172.21.15.59:0/579571303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e077dd30 0x55b0e077f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.660+0000 7f138ebe9740 1 --2- 172.21.15.59:0/579571303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771da0 0x55b0e077f120 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.660+0000 7f138ebe9740 1 --2- 172.21.15.59:0/579571303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e0771480 0x55b0e0789b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.660+0000 7f138ebe9740 1 -- 172.21.15.59:0/579571303 >> 172.21.15.59:0/579571303 conn(0x55b0e076f2b0 msgr2=0x55b0e0775ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.660+0000 7f138ebe9740 1 -- 172.21.15.59:0/579571303 shutdown_connections 2024-09-10T21:20:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.660+0000 7f138ebe9740 1 -- 172.21.15.59:0/579571303 wait complete. 2024-09-10T21:20:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.661+0000 7f138ebe9740 1 -- start start 2024-09-10T21:20:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.661+0000 7f138ebe9740 1 Processor -- start 2024-09-10T21:20:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.661+0000 7f138ebe9740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e0771480 0x55b0e07f7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.661+0000 7f138ebe9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771da0 0x55b0e07f7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.661+0000 7f138ebe9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e077dd30 0x55b0e07f4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.661+0000 7f138ebe9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f13881af8a0 con 0x55b0e0771da0 2024-09-10T21:20:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.661+0000 7f138ebe9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f13881af1d0 con 0x55b0e077dd30 2024-09-10T21:20:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.661+0000 7f138ebe9740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f13881ac410 con 0x55b0e0771480 2024-09-10T21:20:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.661+0000 7f138ebe9740 10 client.0 _ll_register_callbacks cb 0x7f1378005cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:20:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.661+0000 7f1385d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771da0 0x55b0e07f7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.661+0000 7f1385d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771da0 0x55b0e07f7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53382/0 (socket says 172.21.15.59:53382) 2024-09-10T21:20:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.661+0000 7f1385d9b640 1 -- 172.21.15.59:0/1969557736 learned_addr learned my addr 172.21.15.59:0/1969557736 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:20:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.661+0000 7f1386d9d640 1 --2- 172.21.15.59:0/1969557736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e077dd30 0x55b0e07f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.662+0000 7f138659c640 1 --2- 172.21.15.59:0/1969557736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e0771480 0x55b0e07f7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.662+0000 7f1385d9b640 1 -- 172.21.15.59:0/1969557736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e0771480 msgr2=0x55b0e07f7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.662+0000 7f1385d9b640 1 --2- 172.21.15.59:0/1969557736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e0771480 0x55b0e07f7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.662+0000 7f1385d9b640 1 -- 172.21.15.59:0/1969557736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e077dd30 msgr2=0x55b0e07f4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:20:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.662+0000 7f1385d9b640 1 --2- 172.21.15.59:0/1969557736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e077dd30 0x55b0e07f4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.662+0000 7f1385d9b640 1 -- 172.21.15.59:0/1969557736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0e07f4f90 con 0x55b0e0771da0 2024-09-10T21:20:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.662+0000 7f138659c640 1 --2- 172.21.15.59:0/1969557736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e0771480 0x55b0e07f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:20:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.662+0000 7f1385d9b640 1 --2- 172.21.15.59:0/1969557736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771da0 0x55b0e07f7f90 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f137c00b470 tx=0x7f137c00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56e93898779d022 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:20:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.662+0000 7f136dffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:20:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.662+0000 7f136dffb640 1 -- 172.21.15.59:0/1969557736 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c01e070 con 0x55b0e0771da0 2024-09-10T21:20:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.662+0000 7f136dffb640 1 -- 172.21.15.59:0/1969557736 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f137c010c70 con 0x55b0e0771da0 2024-09-10T21:20:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.662+0000 7f138ebe9740 1 -- 172.21.15.59:0/1969557736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b0e06e5850 con 0x55b0e0771da0 2024-09-10T21:20:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.662+0000 7f136dffb640 1 -- 172.21.15.59:0/1969557736 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f137c0b5210 con 0x55b0e0771da0 2024-09-10T21:20:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.662+0000 7f138ebe9740 10 client.16824 fetch_fsmap learned FSMap version 28 2024-09-10T21:20:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.662+0000 7f138ebe9740 1 -- 172.21.15.59:0/1969557736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b0e0785610 con 0x55b0e0771da0 2024-09-10T21:20:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.662+0000 7f136dffb640 1 -- 172.21.15.59:0/1969557736 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b0e06e5850 con 0x55b0e0771da0 2024-09-10T21:20:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.663+0000 7f136dffb640 1 -- 172.21.15.59:0/1969557736 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f137c0b4d80 con 0x55b0e0771da0 2024-09-10T21:20:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.663+0000 7f138ebe9740 10 client.16824 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:20:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.663+0000 7f138ebe9740 10 client.16824 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:20:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.663+0000 7f138ebe9740 20 client.16824 populate_metadata read hostname 'smithi059' 2024-09-10T21:20:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.663+0000 7f138ebe9740 1 --2- 172.21.15.59:0/1969557736 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b0e0785ce0 0x55b0e07860f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:20:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.663+0000 7f138ebe9740 4 client.16824 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:20:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.663+0000 7f138ebe9740 1 -- 172.21.15.59:0/1969557736 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b0e06e2c80 con 0x55b0e0785ce0 2024-09-10T21:20:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.663+0000 7f138659c640 1 --2- 172.21.15.59:0/1969557736 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b0e0785ce0 0x55b0e07860f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:20:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.663+0000 7f138659c640 1 --2- 172.21.15.59:0/1969557736 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b0e0785ce0 0x55b0e07860f0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=207ebfcec0cac1d2 server_cookie=e16fb6d4d4dd504d in_seq=0 out_seq=0 2024-09-10T21:20:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.663+0000 7f136dffb640 10 client.16824 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.664+0000 7f136dffb640 1 -- 172.21.15.59:0/1969557736 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x55b0e06e2c80 con 0x55b0e0785ce0 2024-09-10T21:20:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.664+0000 7f136dffb640 10 client.16824 handle_command_reply: tid=0 2024-09-10T21:20:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.664+0000 7f138ebe9740 1 client.16824 shutdown 2024-09-10T21:20:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.664+0000 7f138ebe9740 1 -- 172.21.15.59:0/1969557736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771da0 msgr2=0x55b0e07f7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.664+0000 7f138ebe9740 1 --2- 172.21.15.59:0/1969557736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771da0 0x55b0e07f7f90 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f137c00b470 tx=0x7f137c00bf90 comp rx=0 tx=0).stop 2024-09-10T21:20:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.664+0000 7f138ebe9740 1 -- 172.21.15.59:0/1969557736 shutdown_connections 2024-09-10T21:20:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.664+0000 7f138ebe9740 1 --2- 172.21.15.59:0/1969557736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0e077dd30 0x55b0e07f4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.664+0000 7f138ebe9740 1 --2- 172.21.15.59:0/1969557736 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b0e0785ce0 0x55b0e07860f0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.664+0000 7f138ebe9740 1 --2- 172.21.15.59:0/1969557736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b0e0771da0 0x55b0e07f7f90 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.664+0000 7f138ebe9740 1 --2- 172.21.15.59:0/1969557736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0e0771480 0x55b0e07f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.664+0000 7f138ebe9740 1 -- 172.21.15.59:0/1969557736 >> 172.21.15.59:0/1969557736 conn(0x55b0e076f2b0 msgr2=0x55b0e077c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.664+0000 7f136dffb640 0 client.16824 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:20:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.664+0000 7f138ebe9740 1 -- 172.21.15.59:0/1969557736 shutdown_connections 2024-09-10T21:20:53.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.664+0000 7f138ebe9740 1 -- 172.21.15.59:0/1969557736 wait complete. 2024-09-10T21:20:53.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.664+0000 7f138ebe9740 20 client.16824 trim_cache size 0 max 16384 2024-09-10T21:20:53.674 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:20:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:20:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-09-10T21:20:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: "800cdb00-6a99-4c42-8a9e-4b1c599c6af0": { 2024-09-10T21:20:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "800cdb00-6a99-4c42-8a9e-4b1c599c6af0", 2024-09-10T21:20:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2024-09-10T21:20:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:20:53.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:20:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: "800cdb00-6a99-4c42-8a9e-4b1c599c6af0": { 2024-09-10T21:20:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:52.224081+0000", 2024-09-10T21:20:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:20:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:20:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:53.675 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:20:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:20:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:20:53.676 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:20:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:20:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:20:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:20:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:07.066301+0000", 2024-09-10T21:20:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:20:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:20:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:53.678 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:20:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:20:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:20:53.679 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:20:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:20:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:20:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:53.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:20:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:20:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:20:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:20:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:20:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:20:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:20:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:20:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:20:53.681 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:20:53.681 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:20:53.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.665+0000 7f138c814640 1 -- 172.21.15.59:0/3442199510 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f13700b52e0 msgr2=0x7f13700b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:53.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.665+0000 7f138c814640 1 --2- 172.21.15.59:0/3442199510 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f13700b52e0 0x7f13700b77a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1380043000 tx=0x7f1380004690 comp rx=0 tx=0).stop 2024-09-10T21:20:53.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.665+0000 7f138c814640 1 -- 172.21.15.59:0/3442199510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13881076e0 msgr2=0x7f13881997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:20:53.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.665+0000 7f138c814640 1 --2- 172.21.15.59:0/3442199510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13881076e0 0x7f13881997c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f137c00b4a0 tx=0x7f137c00b960 comp rx=0 tx=0).stop 2024-09-10T21:20:53.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.665+0000 7f138c814640 1 -- 172.21.15.59:0/3442199510 shutdown_connections 2024-09-10T21:20:53.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.665+0000 7f138c814640 1 --2- 172.21.15.59:0/3442199510 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f13700b52e0 0x7f13700b77a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.665+0000 7f138c814640 1 --2- 172.21.15.59:0/3442199510 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1388108060 0x7f138819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.665+0000 7f138c814640 1 --2- 172.21.15.59:0/3442199510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13881076e0 0x7f13881997c0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.665+0000 7f138c814640 1 --2- 172.21.15.59:0/3442199510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1388101cd0 0x7f1388199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:20:53.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.665+0000 7f138c814640 1 -- 172.21.15.59:0/3442199510 >> 172.21.15.59:0/3442199510 conn(0x7f13880fd700 msgr2=0x7f1388104cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:20:53.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.665+0000 7f138c814640 1 -- 172.21.15.59:0/3442199510 shutdown_connections 2024-09-10T21:20:53.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:20:53.665+0000 7f138c814640 1 -- 172.21.15.59:0/3442199510 wait complete. 2024-09-10T21:20:53.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:53 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:20:53.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:53 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:20:53.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:53 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:20:53.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:53 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:20:53.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:53 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:20:53.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:53 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:20:53.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:53 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:20:53.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:53 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:20:54.476 INFO:tasks.cephfs.filesystem:scrub status for tag:800cdb00-6a99-4c42-8a9e-4b1c599c6af0 - {'path': '/', 'tag': '800cdb00-6a99-4c42-8a9e-4b1c599c6af0', 'options': 'recursive,force'} 2024-09-10T21:20:54.660 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:54 smithi059 ceph-mon[30888]: pgmap v509: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:54.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:54 smithi192 ceph-mon[35363]: pgmap v509: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:54.833 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:54 smithi154 ceph-mon[35041]: pgmap v509: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:20:55.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:55 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:20:55.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:55 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:20:55.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:55 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:20:56.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:56 smithi192 ceph-mon[35363]: pgmap v510: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:20:56.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:56 smithi059 ceph-mon[30888]: pgmap v510: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:20:56.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:56 smithi154 ceph-mon[35041]: pgmap v510: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:20:58.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:20:58 smithi192 ceph-mon[35363]: pgmap v511: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:20:58.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:20:58 smithi059 ceph-mon[30888]: pgmap v511: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:20:58.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:20:58 smithi154 ceph-mon[35041]: pgmap v511: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:21:00.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:00 smithi192 ceph-mon[35363]: pgmap v512: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:21:00.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:00 smithi059 ceph-mon[30888]: pgmap v512: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:21:00.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:00 smithi154 ceph-mon[35041]: pgmap v512: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:21:02.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:02 smithi192 ceph-mon[35363]: pgmap v513: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:21:02.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:02 smithi059 ceph-mon[30888]: pgmap v513: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:21:02.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:02 smithi154 ceph-mon[35041]: pgmap v513: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:21:04.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:04 smithi192 ceph-mon[35363]: pgmap v514: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:21:04.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:04 smithi059 ceph-mon[30888]: pgmap v514: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:21:04.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:04 smithi154 ceph-mon[35041]: pgmap v514: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:21:06.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:06 smithi192 ceph-mon[35363]: pgmap v515: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-10T21:21:06.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:06 smithi059 ceph-mon[30888]: pgmap v515: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-10T21:21:06.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:06 smithi154 ceph-mon[35041]: pgmap v515: 97 pgs: 97 active+clean; 3.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-10T21:21:08.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:08 smithi192 ceph-mon[35363]: pgmap v516: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:21:08.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:08 smithi059 ceph-mon[30888]: pgmap v516: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:21:08.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:08 smithi154 ceph-mon[35041]: pgmap v516: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:21:10.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:10 smithi192 ceph-mon[35363]: pgmap v517: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:10.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:10 smithi059 ceph-mon[30888]: pgmap v517: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:10.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:10 smithi154 ceph-mon[35041]: pgmap v517: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:12.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:12 smithi192 ceph-mon[35363]: pgmap v518: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:21:12.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:12 smithi059 ceph-mon[30888]: pgmap v518: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:21:12.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:12 smithi154 ceph-mon[35041]: pgmap v518: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:21:14.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:14 smithi192 ceph-mon[35363]: pgmap v519: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:14.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:14 smithi059 ceph-mon[30888]: pgmap v519: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:14.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:14 smithi154 ceph-mon[35041]: pgmap v519: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:16.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:16 smithi192 ceph-mon[35363]: pgmap v520: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:21:16.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:16 smithi059 ceph-mon[30888]: pgmap v520: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:21:16.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:16 smithi154 ceph-mon[35041]: pgmap v520: 97 pgs: 97 active+clean; 4.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:21:18.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:18 smithi192 ceph-mon[35363]: pgmap v521: 97 pgs: 97 active+clean; 4.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:21:18.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:18 smithi059 ceph-mon[30888]: pgmap v521: 97 pgs: 97 active+clean; 4.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:21:18.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:18 smithi154 ceph-mon[35041]: pgmap v521: 97 pgs: 97 active+clean; 4.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:21:20.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:20 smithi192 ceph-mon[35363]: pgmap v522: 97 pgs: 97 active+clean; 4.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:20.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:20 smithi059 ceph-mon[30888]: pgmap v522: 97 pgs: 97 active+clean; 4.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:20.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:20 smithi154 ceph-mon[35041]: pgmap v522: 97 pgs: 97 active+clean; 4.1 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:22.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:22 smithi192 ceph-mon[35363]: pgmap v523: 97 pgs: 97 active+clean; 4.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:21:22.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:22 smithi059 ceph-mon[30888]: pgmap v523: 97 pgs: 97 active+clean; 4.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:21:22.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:22 smithi154 ceph-mon[35041]: pgmap v523: 97 pgs: 97 active+clean; 4.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:21:24.477 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:21:24.756 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:21:25.157 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:25 smithi059 ceph-mon[30888]: pgmap v524: 97 pgs: 97 active+clean; 4.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:25.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:25 smithi192 ceph-mon[35363]: pgmap v524: 97 pgs: 97 active+clean; 4.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:25.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:25 smithi154 ceph-mon[35041]: pgmap v524: 97 pgs: 97 active+clean; 4.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:25.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.426+0000 7f1ec654a640 1 -- 172.21.15.59:0/1329768684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ec010d140 msgr2=0x7f1ec010f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:25.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.426+0000 7f1ec654a640 1 --2- 172.21.15.59:0/1329768684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ec010d140 0x7f1ec010f570 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009ca0 tx=0x7f1eb802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.426+0000 7f1ec654a640 1 -- 172.21.15.59:0/1329768684 shutdown_connections 2024-09-10T21:21:25.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.426+0000 7f1ec654a640 1 --2- 172.21.15.59:0/1329768684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ec010d140 0x7f1ec010f570 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.426+0000 7f1ec654a640 1 --2- 172.21.15.59:0/1329768684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ec0104590 0x7f1ec010cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.426+0000 7f1ec654a640 1 --2- 172.21.15.59:0/1329768684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ec0103b90 0x7f1ec0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.426+0000 7f1ec654a640 1 -- 172.21.15.59:0/1329768684 >> 172.21.15.59:0/1329768684 conn(0x7f1ec00fd700 msgr2=0x7f1ec00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:25.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.426+0000 7f1ec654a640 1 -- 172.21.15.59:0/1329768684 shutdown_connections 2024-09-10T21:21:25.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.426+0000 7f1ec654a640 1 -- 172.21.15.59:0/1329768684 wait complete. 2024-09-10T21:21:25.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.426+0000 7f1ec654a640 1 Processor -- start 2024-09-10T21:21:25.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.426+0000 7f1ec654a640 1 -- start start 2024-09-10T21:21:25.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.427+0000 7f1ec654a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ec0103b90 0x7f1ec0199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:25.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.427+0000 7f1ec654a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ec0104590 0x7f1ec0199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:25.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.427+0000 7f1ec654a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ec010d140 0x7f1ec019eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:25.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.427+0000 7f1ec654a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec0112d40 con 0x7f1ec0103b90 2024-09-10T21:21:25.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.427+0000 7f1ec654a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec0112bc0 con 0x7f1ec0104590 2024-09-10T21:21:25.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.427+0000 7f1ec654a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec0112ec0 con 0x7f1ec010d140 2024-09-10T21:21:25.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.427+0000 7f1ebffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ec0103b90 0x7f1ec0199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:25.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.427+0000 7f1ebffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ec0103b90 0x7f1ec0199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58582/0 (socket says 172.21.15.59:58582) 2024-09-10T21:21:25.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.427+0000 7f1ebffff640 1 -- 172.21.15.59:0/3678971295 learned_addr learned my addr 172.21.15.59:0/3678971295 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:25.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.427+0000 7f1ebf7fe640 1 --2- 172.21.15.59:0/3678971295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ec0104590 0x7f1ec0199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:25.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.427+0000 7f1ec4ae7640 1 --2- 172.21.15.59:0/3678971295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ec010d140 0x7f1ec019eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:25.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.427+0000 7f1ebffff640 1 -- 172.21.15.59:0/3678971295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ec010d140 msgr2=0x7f1ec019eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:25.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.427+0000 7f1ebffff640 1 --2- 172.21.15.59:0/3678971295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ec010d140 0x7f1ec019eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.427+0000 7f1ebffff640 1 -- 172.21.15.59:0/3678971295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ec0104590 msgr2=0x7f1ec0199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:25.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.427+0000 7f1ebffff640 1 --2- 172.21.15.59:0/3678971295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ec0104590 0x7f1ec0199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.427+0000 7f1ebffff640 1 -- 172.21.15.59:0/3678971295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec019f2c0 con 0x7f1ec0103b90 2024-09-10T21:21:25.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.427+0000 7f1ebffff640 1 --2- 172.21.15.59:0/3678971295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ec0103b90 0x7f1ec0199210 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000c890 tx=0x7f1eb000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:25.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.428+0000 7f1ebd7fa640 1 -- 172.21.15.59:0/3678971295 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0004220 con 0x7f1ec0103b90 2024-09-10T21:21:25.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.428+0000 7f1ec654a640 1 -- 172.21.15.59:0/3678971295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec019f5b0 con 0x7f1ec0103b90 2024-09-10T21:21:25.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.428+0000 7f1ebd7fa640 1 -- 172.21.15.59:0/3678971295 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb00043c0 con 0x7f1ec0103b90 2024-09-10T21:21:25.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.428+0000 7f1ebd7fa640 1 -- 172.21.15.59:0/3678971295 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0004a00 con 0x7f1ec0103b90 2024-09-10T21:21:25.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.428+0000 7f1ec654a640 1 -- 172.21.15.59:0/3678971295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec01a5c70 con 0x7f1ec0103b90 2024-09-10T21:21:25.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.430+0000 7f1ec891f740 1 Processor -- start 2024-09-10T21:21:25.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.430+0000 7f1ec891f740 1 -- start start 2024-09-10T21:21:25.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.430+0000 7f1ec891f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a767e480 0x55d4a767e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:25.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.430+0000 7f1ec891f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767eda0 0x55d4a768a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:25.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.430+0000 7f1ec891f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a768ad30 0x55d4a768d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:25.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.430+0000 7f1ec891f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d4a75f4e50 con 0x55d4a767e480 2024-09-10T21:21:25.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.430+0000 7f1ec891f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d4a75e4280 con 0x55d4a767eda0 2024-09-10T21:21:25.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.430+0000 7f1ec891f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d4a75e8090 con 0x55d4a768ad30 2024-09-10T21:21:25.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.431+0000 7f1ec4ae7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a767e480 0x55d4a767e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:25.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.431+0000 7f1ec4ae7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a767e480 0x55d4a767e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58598/0 (socket says 172.21.15.59:58598) 2024-09-10T21:21:25.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.431+0000 7f1ec4ae7640 1 -- 172.21.15.59:0/4002504007 learned_addr learned my addr 172.21.15.59:0/4002504007 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:25.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.431+0000 7f1ebf7fe640 1 --2- 172.21.15.59:0/4002504007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a768ad30 0x55d4a768d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:25.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.431+0000 7f1ec4ae7640 1 -- 172.21.15.59:0/4002504007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a768ad30 msgr2=0x55d4a768d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:25.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.431+0000 7f1ec4ae7640 1 --2- 172.21.15.59:0/4002504007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a768ad30 0x55d4a768d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.431+0000 7f1ec4ae7640 1 -- 172.21.15.59:0/4002504007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767eda0 msgr2=0x55d4a768a7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:21:25.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.431+0000 7f1ec4ae7640 1 --2- 172.21.15.59:0/4002504007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767eda0 0x55d4a768a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.431+0000 7f1ec4ae7640 1 -- 172.21.15.59:0/4002504007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4a7342650 con 0x55d4a767e480 2024-09-10T21:21:25.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.431+0000 7f1ebf7fe640 1 --2- 172.21.15.59:0/4002504007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a768ad30 0x55d4a768d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:21:25.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.431+0000 7f1ebd7fa640 1 -- 172.21.15.59:0/3678971295 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f1eb0004ba0 con 0x7f1ec0103b90 2024-09-10T21:21:25.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.431+0000 7f1ec4ae7640 1 --2- 172.21.15.59:0/4002504007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a767e480 0x55d4a767e860 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8005cc0 tx=0x7f1eb80099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2cb90a099dd589b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:25.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.431+0000 7f1ea67fc640 1 -- 172.21.15.59:0/4002504007 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8031450 con 0x55d4a767e480 2024-09-10T21:21:25.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.431+0000 7f1ea67fc640 1 -- 172.21.15.59:0/4002504007 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb8036040 con 0x55d4a767e480 2024-09-10T21:21:25.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.431+0000 7f1ea67fc640 1 -- 172.21.15.59:0/4002504007 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8004440 con 0x55d4a767e480 2024-09-10T21:21:25.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.432+0000 7f1ebd7fa640 1 --2- 172.21.15.59:0/3678971295 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1ea80b52e0 0x7f1ea80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:25.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.432+0000 7f1ebffff640 1 --2- 172.21.15.59:0/3678971295 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1ea80b52e0 0x7f1ea80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:25.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.432+0000 7f1ec891f740 1 -- 172.21.15.59:0/4002504007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a767e480 msgr2=0x55d4a767e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:25.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.432+0000 7f1ec891f740 1 --2- 172.21.15.59:0/4002504007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a767e480 0x55d4a767e860 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8005cc0 tx=0x7f1eb80099c0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.432+0000 7f1ebd7fa640 1 -- 172.21.15.59:0/3678971295 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1eb00e5950 con 0x7f1ec0103b90 2024-09-10T21:21:25.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.432+0000 7f1ec891f740 1 -- 172.21.15.59:0/4002504007 shutdown_connections 2024-09-10T21:21:25.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.432+0000 7f1ec891f740 1 --2- 172.21.15.59:0/4002504007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a768ad30 0x55d4a768d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.432+0000 7f1ec891f740 1 --2- 172.21.15.59:0/4002504007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767eda0 0x55d4a768a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.432+0000 7f1ec891f740 1 --2- 172.21.15.59:0/4002504007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a767e480 0x55d4a767e860 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.432+0000 7f1ec891f740 1 -- 172.21.15.59:0/4002504007 >> 172.21.15.59:0/4002504007 conn(0x55d4a767c2b0 msgr2=0x55d4a767d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:25.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.432+0000 7f1ec891f740 1 -- 172.21.15.59:0/4002504007 shutdown_connections 2024-09-10T21:21:25.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.432+0000 7f1ec891f740 1 -- 172.21.15.59:0/4002504007 wait complete. 2024-09-10T21:21:25.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.433+0000 7f1ebffff640 1 --2- 172.21.15.59:0/3678971295 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1ea80b52e0 0x7f1ea80b77a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00ac0d0 tx=0x7f1eb00046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:25.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.433+0000 7f1ec891f740 1 -- start start 2024-09-10T21:21:25.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.433+0000 7f1ec891f740 1 Processor -- start 2024-09-10T21:21:25.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.433+0000 7f1ec891f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767e480 0x55d4a768a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:25.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.433+0000 7f1ec891f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a767eda0 0x55d4a7687a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:25.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.433+0000 7f1ec891f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a768ad30 0x55d4a7687ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:25.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.433+0000 7f1ec891f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d4a7445700 con 0x55d4a767eda0 2024-09-10T21:21:25.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.433+0000 7f1ec891f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d4a757f110 con 0x55d4a767e480 2024-09-10T21:21:25.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.433+0000 7f1ec891f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d4a768d950 con 0x55d4a768ad30 2024-09-10T21:21:25.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.433+0000 7f1ec891f740 10 client.0 _ll_register_callbacks cb 0x55d4a7598990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:21:25.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.433+0000 7f1ebf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a767eda0 0x55d4a7687a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:25.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.433+0000 7f1ebf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a767eda0 0x55d4a7687a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58614/0 (socket says 172.21.15.59:58614) 2024-09-10T21:21:25.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.433+0000 7f1ebf7fe640 1 -- 172.21.15.59:0/3026789447 learned_addr learned my addr 172.21.15.59:0/3026789447 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:25.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.434+0000 7f1ec4ae7640 1 --2- 172.21.15.59:0/3026789447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a768ad30 0x55d4a7687ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:25.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.434+0000 7f1ec4ae7640 1 --2- 172.21.15.59:0/3026789447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767e480 0x55d4a768a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:25.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.434+0000 7f1ebf7fe640 1 -- 172.21.15.59:0/3026789447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a768ad30 msgr2=0x55d4a7687ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:25.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.434+0000 7f1ebf7fe640 1 --2- 172.21.15.59:0/3026789447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a768ad30 0x55d4a7687ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.434+0000 7f1ebf7fe640 1 -- 172.21.15.59:0/3026789447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767e480 msgr2=0x55d4a768a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:25.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.434+0000 7f1ebf7fe640 1 --2- 172.21.15.59:0/3026789447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767e480 0x55d4a768a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.434+0000 7f1ebf7fe640 1 -- 172.21.15.59:0/3026789447 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4a75acc40 con 0x55d4a767eda0 2024-09-10T21:21:25.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.434+0000 7f1ec4ae7640 1 --2- 172.21.15.59:0/3026789447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a768ad30 0x55d4a7687ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:21:25.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.434+0000 7f1ebf7fe640 1 --2- 172.21.15.59:0/3026789447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a767eda0 0x55d4a7687a30 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400ba70 tx=0x7f1eb400bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c52723e204bc2be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:25.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.434+0000 7f1e9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:21:25.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.434+0000 7f1e9f7fe640 1 -- 172.21.15.59:0/3026789447 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb401b640 con 0x55d4a767eda0 2024-09-10T21:21:25.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.434+0000 7f1e9f7fe640 1 -- 172.21.15.59:0/3026789447 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1eb401b7e0 con 0x55d4a767eda0 2024-09-10T21:21:25.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.434+0000 7f1ec891f740 1 -- 172.21.15.59:0/3026789447 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1eb8036040 con 0x55d4a767eda0 2024-09-10T21:21:25.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.434+0000 7f1e9f7fe640 1 -- 172.21.15.59:0/3026789447 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1eb4003e40 con 0x55d4a767eda0 2024-09-10T21:21:25.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.434+0000 7f1ec891f740 10 client.16836 fetch_fsmap learned FSMap version 28 2024-09-10T21:21:25.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.434+0000 7f1ec891f740 1 -- 172.21.15.59:0/3026789447 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d4a76992d0 con 0x55d4a767eda0 2024-09-10T21:21:25.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.435+0000 7f1e9f7fe640 1 -- 172.21.15.59:0/3026789447 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb8036040 con 0x55d4a767eda0 2024-09-10T21:21:25.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.435+0000 7f1e9f7fe640 1 -- 172.21.15.59:0/3026789447 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1eb4019020 con 0x55d4a767eda0 2024-09-10T21:21:25.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.435+0000 7f1ec891f740 10 client.16836 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:21:25.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.435+0000 7f1ec891f740 10 client.16836 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:21:25.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.435+0000 7f1ec891f740 20 client.16836 populate_metadata read hostname 'smithi059' 2024-09-10T21:21:25.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.435+0000 7f1ec891f740 1 --2- 172.21.15.59:0/3026789447 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d4a769a790 0x55d4a769cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:25.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.435+0000 7f1ec891f740 4 client.16836 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:21:25.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.435+0000 7f1ec891f740 1 -- 172.21.15.59:0/3026789447 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4a75f6da0 con 0x55d4a769a790 2024-09-10T21:21:25.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.435+0000 7f1ec4ae7640 1 --2- 172.21.15.59:0/3026789447 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d4a769a790 0x55d4a769cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:25.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.436+0000 7f1ec4ae7640 1 --2- 172.21.15.59:0/3026789447 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d4a769a790 0x55d4a769cbb0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c952766fe474eb5f server_cookie=86b9be0dfdf46fc9 in_seq=0 out_seq=0 2024-09-10T21:21:25.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.436+0000 7f1e9f7fe640 10 client.16836 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:21:25.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.436+0000 7f1e9f7fe640 1 -- 172.21.15.59:0/3026789447 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d4a75f6da0 con 0x55d4a769a790 2024-09-10T21:21:25.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.436+0000 7f1e9f7fe640 10 client.16836 handle_command_reply: tid=0 2024-09-10T21:21:25.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.436+0000 7f1ec891f740 1 client.16836 shutdown 2024-09-10T21:21:25.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.437+0000 7f1ec891f740 1 -- 172.21.15.59:0/3026789447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a767eda0 msgr2=0x55d4a7687a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:25.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.437+0000 7f1ec891f740 1 --2- 172.21.15.59:0/3026789447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a767eda0 0x55d4a7687a30 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400ba70 tx=0x7f1eb400bf30 comp rx=0 tx=0).stop 2024-09-10T21:21:25.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.437+0000 7f1ec891f740 1 -- 172.21.15.59:0/3026789447 shutdown_connections 2024-09-10T21:21:25.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.437+0000 7f1ec891f740 1 --2- 172.21.15.59:0/3026789447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a768ad30 0x55d4a7687ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.437+0000 7f1ec891f740 1 --2- 172.21.15.59:0/3026789447 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d4a769a790 0x55d4a769cbb0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.437+0000 7f1ec891f740 1 --2- 172.21.15.59:0/3026789447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a767eda0 0x55d4a7687a30 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.437+0000 7f1ec891f740 1 --2- 172.21.15.59:0/3026789447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767e480 0x55d4a768a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.437+0000 7f1ec891f740 1 -- 172.21.15.59:0/3026789447 >> 172.21.15.59:0/3026789447 conn(0x55d4a767c2b0 msgr2=0x55d4a7681e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:25.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.437+0000 7f1e9f7fe640 0 client.16836 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:21:25.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.437+0000 7f1ec891f740 1 -- 172.21.15.59:0/3026789447 shutdown_connections 2024-09-10T21:21:25.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.437+0000 7f1ec891f740 1 -- 172.21.15.59:0/3026789447 wait complete. 2024-09-10T21:21:25.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.437+0000 7f1ec891f740 20 client.16836 trim_cache size 0 max 16384 2024-09-10T21:21:25.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.455+0000 7f1ec891f740 1 Processor -- start 2024-09-10T21:21:25.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.455+0000 7f1ec891f740 1 -- start start 2024-09-10T21:21:25.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.455+0000 7f1ec891f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a767e480 0x55d4a76862b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:25.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.455+0000 7f1ec891f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767eda0 0x55d4a76867f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:25.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.455+0000 7f1ec891f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a768ad30 0x55d4a768c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:25.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.455+0000 7f1ec891f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec01ae3a0 con 0x55d4a768ad30 2024-09-10T21:21:25.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.455+0000 7f1ec891f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec01afee0 con 0x55d4a767eda0 2024-09-10T21:21:25.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.455+0000 7f1ec891f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec01aea70 con 0x55d4a767e480 2024-09-10T21:21:25.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.456+0000 7f1ec4ae7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a768ad30 0x55d4a768c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:25.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.456+0000 7f1ec4ae7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a768ad30 0x55d4a768c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58630/0 (socket says 172.21.15.59:58630) 2024-09-10T21:21:25.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.456+0000 7f1ec4ae7640 1 -- 172.21.15.59:0/3781521623 learned_addr learned my addr 172.21.15.59:0/3781521623 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:25.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.456+0000 7f1ebf7fe640 1 --2- 172.21.15.59:0/3781521623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767eda0 0x55d4a76867f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:25.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.456+0000 7f1ec4ae7640 1 --2- 172.21.15.59:0/3781521623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a767e480 0x55d4a76862b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:25.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.456+0000 7f1ec4ae7640 1 -- 172.21.15.59:0/3781521623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a767e480 msgr2=0x55d4a76862b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:25.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.456+0000 7f1ec4ae7640 1 --2- 172.21.15.59:0/3781521623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a767e480 0x55d4a76862b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.456+0000 7f1ec4ae7640 1 -- 172.21.15.59:0/3781521623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767eda0 msgr2=0x55d4a76867f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:25.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.456+0000 7f1ec4ae7640 1 --2- 172.21.15.59:0/3781521623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767eda0 0x55d4a76867f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.456+0000 7f1ec4ae7640 1 -- 172.21.15.59:0/3781521623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4a767d9e0 con 0x55d4a768ad30 2024-09-10T21:21:25.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.456+0000 7f1ebf7fe640 1 --2- 172.21.15.59:0/3781521623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767eda0 0x55d4a76867f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:21:25.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.456+0000 7f1ec4ae7640 1 --2- 172.21.15.59:0/3781521623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a768ad30 0x55d4a768c120 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009430 tx=0x7f1eb8005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801eff466598eb32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:25.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.456+0000 7f1ea5ffb640 1 -- 172.21.15.59:0/3781521623 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb804a040 con 0x55d4a768ad30 2024-09-10T21:21:25.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.456+0000 7f1ea5ffb640 1 -- 172.21.15.59:0/3781521623 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb8036040 con 0x55d4a768ad30 2024-09-10T21:21:25.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.456+0000 7f1ea5ffb640 1 -- 172.21.15.59:0/3781521623 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8004850 con 0x55d4a768ad30 2024-09-10T21:21:25.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.457+0000 7f1ec891f740 1 -- 172.21.15.59:0/3781521623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a768ad30 msgr2=0x55d4a768c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:25.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.457+0000 7f1ec891f740 1 --2- 172.21.15.59:0/3781521623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a768ad30 0x55d4a768c120 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009430 tx=0x7f1eb8005c30 comp rx=0 tx=0).stop 2024-09-10T21:21:25.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.457+0000 7f1ec891f740 1 -- 172.21.15.59:0/3781521623 shutdown_connections 2024-09-10T21:21:25.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.457+0000 7f1ec891f740 1 --2- 172.21.15.59:0/3781521623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a768ad30 0x55d4a768c120 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.457+0000 7f1ec891f740 1 --2- 172.21.15.59:0/3781521623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767eda0 0x55d4a76867f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.457+0000 7f1ec891f740 1 --2- 172.21.15.59:0/3781521623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a767e480 0x55d4a76862b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.457+0000 7f1ec891f740 1 -- 172.21.15.59:0/3781521623 >> 172.21.15.59:0/3781521623 conn(0x55d4a767c2b0 msgr2=0x55d4a7682ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:25.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.457+0000 7f1ec891f740 1 -- 172.21.15.59:0/3781521623 shutdown_connections 2024-09-10T21:21:25.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.457+0000 7f1ec891f740 1 -- 172.21.15.59:0/3781521623 wait complete. 2024-09-10T21:21:25.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.457+0000 7f1ec891f740 1 -- start start 2024-09-10T21:21:25.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.458+0000 7f1ec891f740 1 Processor -- start 2024-09-10T21:21:25.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.458+0000 7f1ec891f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a767e480 0x55d4a7692e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:25.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.458+0000 7f1ec891f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767eda0 0x55d4a7693340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:25.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.458+0000 7f1ec891f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a768ad30 0x55d4a768dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:25.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.458+0000 7f1ec891f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec01af810 con 0x55d4a768ad30 2024-09-10T21:21:25.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.458+0000 7f1ec891f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec01af140 con 0x55d4a767eda0 2024-09-10T21:21:25.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.458+0000 7f1ec891f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec01ac380 con 0x55d4a767e480 2024-09-10T21:21:25.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.458+0000 7f1ec891f740 10 client.0 _ll_register_callbacks cb 0x7f1eb4005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:21:25.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.458+0000 7f1ec4ae7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a768ad30 0x55d4a768dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:25.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.458+0000 7f1ec4ae7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a768ad30 0x55d4a768dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58632/0 (socket says 172.21.15.59:58632) 2024-09-10T21:21:25.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.458+0000 7f1ec4ae7640 1 -- 172.21.15.59:0/669969122 learned_addr learned my addr 172.21.15.59:0/669969122 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:25.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.458+0000 7f1ec4ae7640 1 --2- 172.21.15.59:0/669969122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a767e480 0x55d4a7692e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.458+0000 7f1ebf7fe640 1 --2- 172.21.15.59:0/669969122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767eda0 0x55d4a7693340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.459+0000 7f1ec4ae7640 1 -- 172.21.15.59:0/669969122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a767e480 msgr2=0x55d4a7692e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.459+0000 7f1ec4ae7640 1 --2- 172.21.15.59:0/669969122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a767e480 0x55d4a7692e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.459+0000 7f1ec4ae7640 1 -- 172.21.15.59:0/669969122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767eda0 msgr2=0x55d4a7693340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.459+0000 7f1ec4ae7640 1 --2- 172.21.15.59:0/669969122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767eda0 0x55d4a7693340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.459+0000 7f1ec4ae7640 1 -- 172.21.15.59:0/669969122 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4a768e210 con 0x55d4a768ad30 2024-09-10T21:21:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.459+0000 7f1ec4ae7640 1 --2- 172.21.15.59:0/669969122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a768ad30 0x55d4a768dbd0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009bf0 tx=0x7f1eb8047040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eceeb36822d1d93b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.459+0000 7f1e9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:21:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.459+0000 7f1e9f7fe640 1 -- 172.21.15.59:0/669969122 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8003a50 con 0x55d4a768ad30 2024-09-10T21:21:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.459+0000 7f1e9f7fe640 1 -- 172.21.15.59:0/669969122 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1eb8003bf0 con 0x55d4a768ad30 2024-09-10T21:21:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.459+0000 7f1ec891f740 1 -- 172.21.15.59:0/669969122 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1eb8036040 con 0x55d4a768ad30 2024-09-10T21:21:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.459+0000 7f1e9f7fe640 1 -- 172.21.15.59:0/669969122 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1eb80045d0 con 0x55d4a768ad30 2024-09-10T21:21:25.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.459+0000 7f1ec891f740 10 client.16842 fetch_fsmap learned FSMap version 28 2024-09-10T21:21:25.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.459+0000 7f1ec891f740 1 -- 172.21.15.59:0/669969122 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d4a770c420 con 0x55d4a768ad30 2024-09-10T21:21:25.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.460+0000 7f1e9f7fe640 1 -- 172.21.15.59:0/669969122 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1eb8036040 con 0x55d4a768ad30 2024-09-10T21:21:25.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.460+0000 7f1e9f7fe640 1 -- 172.21.15.59:0/669969122 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1eb8050040 con 0x55d4a768ad30 2024-09-10T21:21:25.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.460+0000 7f1ec891f740 10 client.16842 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:21:25.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.460+0000 7f1ec891f740 10 client.16842 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:21:25.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.460+0000 7f1ec891f740 20 client.16842 populate_metadata read hostname 'smithi059' 2024-09-10T21:21:25.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.460+0000 7f1ec891f740 1 --2- 172.21.15.59:0/669969122 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d4a770c640 0x55d4a770ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:25.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.460+0000 7f1ec891f740 4 client.16842 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:21:25.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.460+0000 7f1ec891f740 1 -- 172.21.15.59:0/669969122 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d4a75f2850 con 0x55d4a770c640 2024-09-10T21:21:25.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.460+0000 7f1ebf7fe640 1 --2- 172.21.15.59:0/669969122 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d4a770c640 0x55d4a770ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:25.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.461+0000 7f1e9f7fe640 10 client.16842 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:21:25.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.461+0000 7f1ebf7fe640 1 --2- 172.21.15.59:0/669969122 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d4a770c640 0x55d4a770ea30 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0926b7477526f7c server_cookie=c0518897d07a580d in_seq=0 out_seq=0 2024-09-10T21:21:25.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.461+0000 7f1e9f7fe640 1 -- 172.21.15.59:0/669969122 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x55d4a75f2850 con 0x55d4a770c640 2024-09-10T21:21:25.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.461+0000 7f1e9f7fe640 10 client.16842 handle_command_reply: tid=0 2024-09-10T21:21:25.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.461+0000 7f1ec891f740 1 client.16842 shutdown 2024-09-10T21:21:25.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.461+0000 7f1ec891f740 1 -- 172.21.15.59:0/669969122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a768ad30 msgr2=0x55d4a768dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:25.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.461+0000 7f1ec891f740 1 --2- 172.21.15.59:0/669969122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a768ad30 0x55d4a768dbd0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009bf0 tx=0x7f1eb8047040 comp rx=0 tx=0).stop 2024-09-10T21:21:25.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.461+0000 7f1ec891f740 1 -- 172.21.15.59:0/669969122 shutdown_connections 2024-09-10T21:21:25.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.461+0000 7f1ec891f740 1 --2- 172.21.15.59:0/669969122 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d4a770c640 0x55d4a770ea30 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.461+0000 7f1e9f7fe640 0 client.16842 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:21:25.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.461+0000 7f1ec891f740 1 --2- 172.21.15.59:0/669969122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d4a768ad30 0x55d4a768dbd0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.461+0000 7f1ec891f740 1 --2- 172.21.15.59:0/669969122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d4a767eda0 0x55d4a7693340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.461+0000 7f1ec891f740 1 --2- 172.21.15.59:0/669969122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d4a767e480 0x55d4a7692e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.461+0000 7f1ec891f740 1 -- 172.21.15.59:0/669969122 >> 172.21.15.59:0/669969122 conn(0x55d4a767c2b0 msgr2=0x55d4a7686270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:25.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.462+0000 7f1ec891f740 1 -- 172.21.15.59:0/669969122 shutdown_connections 2024-09-10T21:21:25.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.462+0000 7f1ec891f740 1 -- 172.21.15.59:0/669969122 wait complete. 2024-09-10T21:21:25.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.462+0000 7f1ec891f740 20 client.16842 trim_cache size 0 max 16384 2024-09-10T21:21:25.472 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:21:25.472 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:21:25.472 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:21:25.472 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:21:25.472 INFO:teuthology.orchestra.run.smithi059.stdout: "800cdb00-6a99-4c42-8a9e-4b1c599c6af0": { 2024-09-10T21:21:25.472 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:52.224081+0000", 2024-09-10T21:21:25.472 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:25.472 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:25.472 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:25.472 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:25.473 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:25.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:25.473 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:21:25.473 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:21:25.473 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:25.473 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:25.473 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:25.473 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:25.473 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:25.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:25.473 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:21:25.473 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:21:25.473 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:25.474 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:25.474 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:25.474 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:25.474 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:25.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:25.474 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:21:25.474 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:21:25.474 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:25.474 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:25.474 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:25.474 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:25.474 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:25.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:25.474 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:21:25.475 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:21:25.475 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:25.475 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:25.475 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:25.475 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:25.475 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:25.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:25.475 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:21:25.475 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:07.066301+0000", 2024-09-10T21:21:25.476 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:25.476 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:25.476 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:25.476 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:25.476 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:25.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:25.476 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:21:25.476 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:21:25.476 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:25.476 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:25.476 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:25.476 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:25.476 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:25.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:25.477 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:21:25.477 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:21:25.477 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:25.477 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:25.477 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:25.477 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:25.477 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:25.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:25.477 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:21:25.477 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:21:25.477 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:25.478 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:25.478 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:25.478 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:25.478 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:25.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:25.478 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:21:25.478 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:21:25.478 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:25.478 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:25.478 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:25.478 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:25.478 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:25.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:25.478 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:21:25.478 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:21:25.479 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:25.479 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:25.479 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:25.479 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:25.479 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:25.479 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:21:25.479 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:21:25.479 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:21:25.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.463+0000 7f1ec654a640 1 -- 172.21.15.59:0/3678971295 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1ea80b52e0 msgr2=0x7f1ea80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:25.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.463+0000 7f1ec654a640 1 --2- 172.21.15.59:0/3678971295 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1ea80b52e0 0x7f1ea80b77a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00ac0d0 tx=0x7f1eb00046c0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.463+0000 7f1ec654a640 1 -- 172.21.15.59:0/3678971295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ec0103b90 msgr2=0x7f1ec0199210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:25.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.463+0000 7f1ec654a640 1 --2- 172.21.15.59:0/3678971295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ec0103b90 0x7f1ec0199210 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000c890 tx=0x7f1eb000cd50 comp rx=0 tx=0).stop 2024-09-10T21:21:25.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.463+0000 7f1ec654a640 1 -- 172.21.15.59:0/3678971295 shutdown_connections 2024-09-10T21:21:25.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.463+0000 7f1ec654a640 1 --2- 172.21.15.59:0/3678971295 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1ea80b52e0 0x7f1ea80b77a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.463+0000 7f1ec654a640 1 --2- 172.21.15.59:0/3678971295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ec010d140 0x7f1ec019eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.463+0000 7f1ec654a640 1 --2- 172.21.15.59:0/3678971295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ec0104590 0x7f1ec0199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.463+0000 7f1ec654a640 1 --2- 172.21.15.59:0/3678971295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ec0103b90 0x7f1ec0199210 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:25.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.463+0000 7f1ec654a640 1 -- 172.21.15.59:0/3678971295 >> 172.21.15.59:0/3678971295 conn(0x7f1ec00fd700 msgr2=0x7f1ec00fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:25.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.463+0000 7f1ec654a640 1 -- 172.21.15.59:0/3678971295 shutdown_connections 2024-09-10T21:21:25.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:25.463+0000 7f1ec654a640 1 -- 172.21.15.59:0/3678971295 wait complete. 2024-09-10T21:21:26.353 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:21:26.353 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:21:26.616 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:21:27.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.088+0000 7fea6c416640 1 -- 172.21.15.59:0/4058917681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea64101cd0 msgr2=0x7fea641020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:27.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.088+0000 7fea6c416640 1 --2- 172.21.15.59:0/4058917681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea64101cd0 0x7fea641020b0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fea60009900 tx=0x7fea6002a410 comp rx=0 tx=0).stop 2024-09-10T21:21:27.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.088+0000 7fea6c416640 1 -- 172.21.15.59:0/4058917681 shutdown_connections 2024-09-10T21:21:27.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.088+0000 7fea6c416640 1 --2- 172.21.15.59:0/4058917681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea64108060 0x7fea6410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:27.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.088+0000 7fea6c416640 1 --2- 172.21.15.59:0/4058917681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea641076e0 0x7fea64107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:27.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.088+0000 7fea6c416640 1 --2- 172.21.15.59:0/4058917681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea64101cd0 0x7fea641020b0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:27.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.088+0000 7fea6c416640 1 -- 172.21.15.59:0/4058917681 >> 172.21.15.59:0/4058917681 conn(0x7fea640fd700 msgr2=0x7fea640ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:27.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.088+0000 7fea6c416640 1 -- 172.21.15.59:0/4058917681 shutdown_connections 2024-09-10T21:21:27.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.088+0000 7fea6c416640 1 -- 172.21.15.59:0/4058917681 wait complete. 2024-09-10T21:21:27.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.089+0000 7fea6c416640 1 Processor -- start 2024-09-10T21:21:27.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.089+0000 7fea6c416640 1 -- start start 2024-09-10T21:21:27.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.089+0000 7fea6c416640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea64101cd0 0x7fea640fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:27.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.089+0000 7fea6c416640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea641076e0 0x7fea640fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:27.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.089+0000 7fea6c416640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea64108060 0x7fea640fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:27.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.089+0000 7fea6c416640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fea64111d60 con 0x7fea64108060 2024-09-10T21:21:27.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.089+0000 7fea6c416640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fea64111be0 con 0x7fea641076e0 2024-09-10T21:21:27.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.089+0000 7fea6c416640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fea64111ee0 con 0x7fea64101cd0 2024-09-10T21:21:27.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.089+0000 7fea6a9b3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea64108060 0x7fea640fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:27.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.089+0000 7fea6a9b3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea64108060 0x7fea640fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58642/0 (socket says 172.21.15.59:58642) 2024-09-10T21:21:27.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.089+0000 7fea6a9b3640 1 -- 172.21.15.59:0/1773574197 learned_addr learned my addr 172.21.15.59:0/1773574197 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:27.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.090+0000 7fea6a1b2640 1 --2- 172.21.15.59:0/1773574197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea64101cd0 0x7fea640fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:27.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.090+0000 7fea699b1640 1 --2- 172.21.15.59:0/1773574197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea641076e0 0x7fea640fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:27.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.090+0000 7fea6a9b3640 1 -- 172.21.15.59:0/1773574197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea64101cd0 msgr2=0x7fea640fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:27.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.090+0000 7fea6a9b3640 1 --2- 172.21.15.59:0/1773574197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea64101cd0 0x7fea640fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:27.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.090+0000 7fea6a9b3640 1 -- 172.21.15.59:0/1773574197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea641076e0 msgr2=0x7fea640fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:27.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.090+0000 7fea6a9b3640 1 --2- 172.21.15.59:0/1773574197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea641076e0 0x7fea640fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.090+0000 7fea6a9b3640 1 -- 172.21.15.59:0/1773574197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea641a77d0 con 0x7fea64108060 2024-09-10T21:21:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.090+0000 7fea6a9b3640 1 --2- 172.21.15.59:0/1773574197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea64108060 0x7fea640fe680 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00b970 tx=0x7fea5c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.090+0000 7fea5b7fe640 1 -- 172.21.15.59:0/1773574197 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c019070 con 0x7fea64108060 2024-09-10T21:21:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.090+0000 7fea6c416640 1 -- 172.21.15.59:0/1773574197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea641a7ac0 con 0x7fea64108060 2024-09-10T21:21:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.090+0000 7fea5b7fe640 1 -- 172.21.15.59:0/1773574197 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea5c014440 con 0x7fea64108060 2024-09-10T21:21:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.090+0000 7fea5b7fe640 1 -- 172.21.15.59:0/1773574197 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c0075d0 con 0x7fea64108060 2024-09-10T21:21:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.090+0000 7fea6c416640 1 -- 172.21.15.59:0/1773574197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea641a8000 con 0x7fea64108060 2024-09-10T21:21:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.091+0000 7fea6c416640 1 -- 172.21.15.59:0/1773574197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea64102130 con 0x7fea64108060 2024-09-10T21:21:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.093+0000 7fea5b7fe640 1 -- 172.21.15.59:0/1773574197 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fea5c00cb40 con 0x7fea64108060 2024-09-10T21:21:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.094+0000 7fea5b7fe640 1 --2- 172.21.15.59:0/1773574197 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fea500b52e0 0x7fea500b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.094+0000 7fea6a1b2640 1 --2- 172.21.15.59:0/1773574197 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fea500b52e0 0x7fea500b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:27.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.094+0000 7fea5b7fe640 1 -- 172.21.15.59:0/1773574197 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fea5c0e58b0 con 0x7fea64108060 2024-09-10T21:21:27.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.094+0000 7fea6a1b2640 1 --2- 172.21.15.59:0/1773574197 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fea500b52e0 0x7fea500b77a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fea60031440 tx=0x7fea600095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:27.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.097+0000 7fea5b7fe640 1 -- 172.21.15.59:0/1773574197 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fea5c0ac740 con 0x7fea64108060 2024-09-10T21:21:27.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.318+0000 7fea6c416640 1 -- 172.21.15.59:0/1773574197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea640fef00 con 0x7fea64108060 2024-09-10T21:21:27.322 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:27 smithi059 ceph-mon[30888]: pgmap v525: 97 pgs: 97 active+clean; 4.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:21:27.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.319+0000 7fea5b7fe640 1 -- 172.21.15.59:0/1773574197 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7fea640fef00 con 0x7fea64108060 2024-09-10T21:21:27.322 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:21:27.323 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:21:27.323 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:21:27.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.321+0000 7fea6c416640 1 -- 172.21.15.59:0/1773574197 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fea500b52e0 msgr2=0x7fea500b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.321+0000 7fea6c416640 1 --2- 172.21.15.59:0/1773574197 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fea500b52e0 0x7fea500b77a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fea60031440 tx=0x7fea600095f0 comp rx=0 tx=0).stop 2024-09-10T21:21:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.321+0000 7fea6c416640 1 -- 172.21.15.59:0/1773574197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea64108060 msgr2=0x7fea640fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.321+0000 7fea6c416640 1 --2- 172.21.15.59:0/1773574197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea64108060 0x7fea640fe680 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00b970 tx=0x7fea5c00be30 comp rx=0 tx=0).stop 2024-09-10T21:21:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.321+0000 7fea6c416640 1 -- 172.21.15.59:0/1773574197 shutdown_connections 2024-09-10T21:21:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.321+0000 7fea6c416640 1 --2- 172.21.15.59:0/1773574197 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fea500b52e0 0x7fea500b77a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.321+0000 7fea6c416640 1 --2- 172.21.15.59:0/1773574197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea64108060 0x7fea640fe680 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.321+0000 7fea6c416640 1 --2- 172.21.15.59:0/1773574197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fea641076e0 0x7fea640fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.321+0000 7fea6c416640 1 --2- 172.21.15.59:0/1773574197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea64101cd0 0x7fea640fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.321+0000 7fea6c416640 1 -- 172.21.15.59:0/1773574197 >> 172.21.15.59:0/1773574197 conn(0x7fea640fd700 msgr2=0x7fea6406b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.321+0000 7fea6c416640 1 -- 172.21.15.59:0/1773574197 shutdown_connections 2024-09-10T21:21:27.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:27.321+0000 7fea6c416640 1 -- 172.21.15.59:0/1773574197 wait complete. 2024-09-10T21:21:27.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:27 smithi192 ceph-mon[35363]: pgmap v525: 97 pgs: 97 active+clean; 4.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:21:27.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:27 smithi154 ceph-mon[35041]: pgmap v525: 97 pgs: 97 active+clean; 4.2 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:21:28.046 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:21:28.309 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:21:28.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:28 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1773574197' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:21:28.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:28 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1773574197' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:21:28.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:28 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1773574197' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:21:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.746+0000 7f5e9d5f0640 1 -- 172.21.15.59:0/3693381065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98109150 msgr2=0x7f5e9810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.746+0000 7f5e9d5f0640 1 --2- 172.21.15.59:0/3693381065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98109150 0x7f5e9810f950 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5e90009ca0 tx=0x7f5e9002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.746+0000 7f5e9d5f0640 1 -- 172.21.15.59:0/3693381065 shutdown_connections 2024-09-10T21:21:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.746+0000 7f5e9d5f0640 1 --2- 172.21.15.59:0/3693381065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98109150 0x7f5e9810f950 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.746+0000 7f5e9d5f0640 1 --2- 172.21.15.59:0/3693381065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e981087d0 0x7f5e98108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.746+0000 7f5e9d5f0640 1 --2- 172.21.15.59:0/3693381065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e98102dc0 0x7f5e981031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.746+0000 7f5e9d5f0640 1 -- 172.21.15.59:0/3693381065 >> 172.21.15.59:0/3693381065 conn(0x7f5e980fe830 msgr2=0x7f5e98100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.746+0000 7f5e9d5f0640 1 -- 172.21.15.59:0/3693381065 shutdown_connections 2024-09-10T21:21:28.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.746+0000 7f5e9d5f0640 1 -- 172.21.15.59:0/3693381065 wait complete. 2024-09-10T21:21:28.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.747+0000 7f5e9d5f0640 1 Processor -- start 2024-09-10T21:21:28.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.747+0000 7f5e9d5f0640 1 -- start start 2024-09-10T21:21:28.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.747+0000 7f5e9d5f0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98102dc0 0x7f5e98199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:28.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.748+0000 7f5e9d5f0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e981087d0 0x7f5e981997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:28.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.748+0000 7f5e9d5f0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e98109150 0x7f5e9819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:28.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.748+0000 7f5e9d5f0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5e98112e10 con 0x7f5e98102dc0 2024-09-10T21:21:28.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.748+0000 7f5e9d5f0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5e98112c90 con 0x7f5e981087d0 2024-09-10T21:21:28.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.748+0000 7f5e9d5f0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5e98112f90 con 0x7f5e98109150 2024-09-10T21:21:28.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.748+0000 7f5e96ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98102dc0 0x7f5e98199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:28.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.748+0000 7f5e96ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98102dc0 0x7f5e98199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58666/0 (socket says 172.21.15.59:58666) 2024-09-10T21:21:28.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.748+0000 7f5e96ffd640 1 -- 172.21.15.59:0/1825416486 learned_addr learned my addr 172.21.15.59:0/1825416486 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:28.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.748+0000 7f5e8e7fc640 1 --2- 172.21.15.59:0/1825416486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e981087d0 0x7f5e981997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:28.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.748+0000 7f5e977fe640 1 --2- 172.21.15.59:0/1825416486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e98109150 0x7f5e9819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:28.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.748+0000 7f5e96ffd640 1 -- 172.21.15.59:0/1825416486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e98109150 msgr2=0x7f5e9819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:28.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.748+0000 7f5e96ffd640 1 --2- 172.21.15.59:0/1825416486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e98109150 0x7f5e9819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.748+0000 7f5e96ffd640 1 -- 172.21.15.59:0/1825416486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e981087d0 msgr2=0x7f5e981997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:28.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.748+0000 7f5e96ffd640 1 --2- 172.21.15.59:0/1825416486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e981087d0 0x7f5e981997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.748+0000 7f5e96ffd640 1 -- 172.21.15.59:0/1825416486 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9819f310 con 0x7f5e98102dc0 2024-09-10T21:21:28.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.748+0000 7f5e8e7fc640 1 --2- 172.21.15.59:0/1825416486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e981087d0 0x7f5e981997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:21:28.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.748+0000 7f5e96ffd640 1 --2- 172.21.15.59:0/1825416486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98102dc0 0x7f5e98199260 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800e9f0 tx=0x7f5e8800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:28.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.748+0000 7f5e94ff9640 1 -- 172.21.15.59:0/1825416486 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8800cd80 con 0x7f5e98102dc0 2024-09-10T21:21:28.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.749+0000 7f5e9d5f0640 1 -- 172.21.15.59:0/1825416486 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e9819f600 con 0x7f5e98102dc0 2024-09-10T21:21:28.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.749+0000 7f5e94ff9640 1 -- 172.21.15.59:0/1825416486 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e880108e0 con 0x7f5e98102dc0 2024-09-10T21:21:28.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.749+0000 7f5e94ff9640 1 -- 172.21.15.59:0/1825416486 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e88018980 con 0x7f5e98102dc0 2024-09-10T21:21:28.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.749+0000 7f5e9d5f0640 1 -- 172.21.15.59:0/1825416486 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e981a5cc0 con 0x7f5e98102dc0 2024-09-10T21:21:28.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.751+0000 7f5e94ff9640 1 -- 172.21.15.59:0/1825416486 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f5e88010430 con 0x7f5e98102dc0 2024-09-10T21:21:28.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.751+0000 7f5e9f9c5740 1 Processor -- start 2024-09-10T21:21:28.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.751+0000 7f5e9f9c5740 1 -- start start 2024-09-10T21:21:28.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.752+0000 7f5e9f9c5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d6434d0 0x56391d6438b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:28.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.752+0000 7f5e9f9c5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d643df0 0x56391d64f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:28.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.752+0000 7f5e9f9c5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 0x56391d652170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:28.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.752+0000 7f5e9f9c5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56391d5b9ea0 con 0x56391d6434d0 2024-09-10T21:21:28.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.752+0000 7f5e9f9c5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56391d5a92d0 con 0x56391d64fd80 2024-09-10T21:21:28.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.752+0000 7f5e9f9c5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56391d5ad0e0 con 0x56391d643df0 2024-09-10T21:21:28.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.752+0000 7f5e977fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d6434d0 0x56391d6438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:28.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.752+0000 7f5e977fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d6434d0 0x56391d6438b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58678/0 (socket says 172.21.15.59:58678) 2024-09-10T21:21:28.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.752+0000 7f5e977fe640 1 -- 172.21.15.59:0/87302363 learned_addr learned my addr 172.21.15.59:0/87302363 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:28.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.752+0000 7f5e96ffd640 1 --2- 172.21.15.59:0/87302363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d643df0 0x56391d64f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:28.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.752+0000 7f5e8e7fc640 1 --2- 172.21.15.59:0/87302363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 0x56391d652170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:28.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.752+0000 7f5e977fe640 1 -- 172.21.15.59:0/87302363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d643df0 msgr2=0x56391d64f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:28.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.752+0000 7f5e977fe640 1 --2- 172.21.15.59:0/87302363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d643df0 0x56391d64f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.752+0000 7f5e977fe640 1 -- 172.21.15.59:0/87302363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 msgr2=0x56391d652170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:28.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.752+0000 7f5e977fe640 1 --2- 172.21.15.59:0/87302363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 0x56391d652170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.752+0000 7f5e977fe640 1 -- 172.21.15.59:0/87302363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391d307650 con 0x56391d6434d0 2024-09-10T21:21:28.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.752+0000 7f5e8e7fc640 1 --2- 172.21.15.59:0/87302363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 0x56391d652170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:21:28.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.753+0000 7f5e977fe640 1 --2- 172.21.15.59:0/87302363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d6434d0 0x56391d6438b0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f5e90005cc0 tx=0x7f5e90009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390ab5fff83b59cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:28.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.753+0000 7f5e94ff9640 1 --2- 172.21.15.59:0/1825416486 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5e840b52e0 0x7f5e840b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:28.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.753+0000 7f5e8d7fa640 1 -- 172.21.15.59:0/87302363 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90031cf0 con 0x56391d6434d0 2024-09-10T21:21:28.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.753+0000 7f5e8d7fa640 1 -- 172.21.15.59:0/87302363 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e90036040 con 0x56391d6434d0 2024-09-10T21:21:28.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.753+0000 7f5e8d7fa640 1 -- 172.21.15.59:0/87302363 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90004040 con 0x56391d6434d0 2024-09-10T21:21:28.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.753+0000 7f5e96ffd640 1 --2- 172.21.15.59:0/1825416486 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5e840b52e0 0x7f5e840b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:28.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.753+0000 7f5e94ff9640 1 -- 172.21.15.59:0/1825416486 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5e880e5ff0 con 0x7f5e98102dc0 2024-09-10T21:21:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.754+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/87302363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d6434d0 msgr2=0x56391d6438b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.754+0000 7f5e96ffd640 1 --2- 172.21.15.59:0/1825416486 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5e840b52e0 0x7f5e840b77a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5e880e3e90 tx=0x7f5e88000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.754+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/87302363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d6434d0 0x56391d6438b0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f5e90005cc0 tx=0x7f5e90009360 comp rx=0 tx=0).stop 2024-09-10T21:21:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.754+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/87302363 shutdown_connections 2024-09-10T21:21:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.754+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/87302363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 0x56391d652170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.754+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/87302363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d643df0 0x56391d64f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.754+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/87302363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d6434d0 0x56391d6438b0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.754+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/87302363 >> 172.21.15.59:0/87302363 conn(0x56391d641300 msgr2=0x56391d6424a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.754+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/87302363 shutdown_connections 2024-09-10T21:21:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.754+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/87302363 wait complete. 2024-09-10T21:21:28.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.754+0000 7f5e9f9c5740 1 -- start start 2024-09-10T21:21:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.754+0000 7f5e9f9c5740 1 Processor -- start 2024-09-10T21:21:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e9f9c5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d6434d0 0x56391d64f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e9f9c5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d643df0 0x56391d64ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e9f9c5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 0x56391d64cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e9f9c5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56391d40a700 con 0x56391d643df0 2024-09-10T21:21:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e9f9c5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56391d544160 con 0x56391d64fd80 2024-09-10T21:21:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e9f9c5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56391d6529a0 con 0x56391d6434d0 2024-09-10T21:21:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e8e7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d643df0 0x56391d64ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e9f9c5740 10 client.0 _ll_register_callbacks cb 0x56391d55d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:21:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e8e7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d643df0 0x56391d64ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58688/0 (socket says 172.21.15.59:58688) 2024-09-10T21:21:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e8e7fc640 1 -- 172.21.15.59:0/1169365495 learned_addr learned my addr 172.21.15.59:0/1169365495 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e977fe640 1 --2- 172.21.15.59:0/1169365495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d6434d0 0x56391d64f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e977fe640 1 --2- 172.21.15.59:0/1169365495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 0x56391d64cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e8e7fc640 1 -- 172.21.15.59:0/1169365495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d6434d0 msgr2=0x56391d64f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e8e7fc640 1 --2- 172.21.15.59:0/1169365495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d6434d0 0x56391d64f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e8e7fc640 1 -- 172.21.15.59:0/1169365495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 msgr2=0x56391d64cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e8e7fc640 1 --2- 172.21.15.59:0/1169365495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 0x56391d64cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e8e7fc640 1 -- 172.21.15.59:0/1169365495 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56391d571c90 con 0x56391d643df0 2024-09-10T21:21:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e977fe640 1 --2- 172.21.15.59:0/1169365495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 0x56391d64cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:21:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e8e7fc640 1 --2- 172.21.15.59:0/1169365495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d643df0 0x56391d64ca00 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f5e80010670 tx=0x7f5e80010b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a62b31d825725f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e7e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:21:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e7e7fc640 1 -- 172.21.15.59:0/1169365495 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8000baa0 con 0x56391d643df0 2024-09-10T21:21:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e7e7fc640 1 -- 172.21.15.59:0/1169365495 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5e8000bc40 con 0x56391d643df0 2024-09-10T21:21:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.755+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/1169365495 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e90036040 con 0x56391d643df0 2024-09-10T21:21:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.756+0000 7f5e7e7fc640 1 -- 172.21.15.59:0/1169365495 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5e8000be40 con 0x56391d643df0 2024-09-10T21:21:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.756+0000 7f5e9f9c5740 10 client.16860 fetch_fsmap learned FSMap version 28 2024-09-10T21:21:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.756+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/1169365495 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56391d65e1f0 con 0x56391d643df0 2024-09-10T21:21:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.756+0000 7f5e7e7fc640 1 -- 172.21.15.59:0/1169365495 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e90036040 con 0x56391d643df0 2024-09-10T21:21:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.756+0000 7f5e7e7fc640 1 -- 172.21.15.59:0/1169365495 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5e8000f040 con 0x56391d643df0 2024-09-10T21:21:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.756+0000 7f5e9f9c5740 10 client.16860 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:21:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.756+0000 7f5e9f9c5740 10 client.16860 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:21:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.756+0000 7f5e9f9c5740 20 client.16860 populate_metadata read hostname 'smithi059' 2024-09-10T21:21:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.756+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/1169365495 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56391d65f6c0 0x56391d661ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.756+0000 7f5e9f9c5740 4 client.16860 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:21:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.756+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/1169365495 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56391d5bbdf0 con 0x56391d65f6c0 2024-09-10T21:21:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.756+0000 7f5e977fe640 1 --2- 172.21.15.59:0/1169365495 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56391d65f6c0 0x56391d661ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.757+0000 7f5e977fe640 1 --2- 172.21.15.59:0/1169365495 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56391d65f6c0 0x56391d661ab0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5bde709561ea708c server_cookie=f1f93686f8f4a25d in_seq=0 out_seq=0 2024-09-10T21:21:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.757+0000 7f5e7e7fc640 10 client.16860 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:21:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.758+0000 7f5e7e7fc640 1 -- 172.21.15.59:0/1169365495 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56391d5bbdf0 con 0x56391d65f6c0 2024-09-10T21:21:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.758+0000 7f5e7e7fc640 10 client.16860 handle_command_reply: tid=0 2024-09-10T21:21:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.758+0000 7f5e9f9c5740 1 client.16860 shutdown 2024-09-10T21:21:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.758+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/1169365495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d643df0 msgr2=0x56391d64ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.758+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/1169365495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d643df0 0x56391d64ca00 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f5e80010670 tx=0x7f5e80010b30 comp rx=0 tx=0).stop 2024-09-10T21:21:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.758+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/1169365495 shutdown_connections 2024-09-10T21:21:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.758+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/1169365495 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56391d65f6c0 0x56391d661ab0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.758+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/1169365495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 0x56391d64cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.758+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/1169365495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d643df0 0x56391d64ca00 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.758+0000 7f5e7e7fc640 0 client.16860 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:21:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.758+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/1169365495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d6434d0 0x56391d64f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.758+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/1169365495 >> 172.21.15.59:0/1169365495 conn(0x56391d641300 msgr2=0x56391d646e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:28.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.758+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/1169365495 shutdown_connections 2024-09-10T21:21:28.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.758+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/1169365495 wait complete. 2024-09-10T21:21:28.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.758+0000 7f5e9f9c5740 20 client.16860 trim_cache size 0 max 16384 2024-09-10T21:21:28.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.771+0000 7f5e9f9c5740 1 Processor -- start 2024-09-10T21:21:28.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.771+0000 7f5e9f9c5740 1 -- start start 2024-09-10T21:21:28.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.772+0000 7f5e9f9c5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d6434d0 0x56391d642ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:28.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.772+0000 7f5e9f9c5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d643df0 0x56391d64c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:28.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.772+0000 7f5e9f9c5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 0x56391d64ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:28.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.772+0000 7f5e9f9c5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5e981ae360 con 0x56391d643df0 2024-09-10T21:21:28.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.772+0000 7f5e9f9c5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5e981afea0 con 0x56391d64fd80 2024-09-10T21:21:28.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.772+0000 7f5e9f9c5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5e981aea30 con 0x56391d6434d0 2024-09-10T21:21:28.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.772+0000 7f5e8e7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d643df0 0x56391d64c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:28.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.772+0000 7f5e8e7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d643df0 0x56391d64c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58698/0 (socket says 172.21.15.59:58698) 2024-09-10T21:21:28.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.772+0000 7f5e8e7fc640 1 -- 172.21.15.59:0/935925280 learned_addr learned my addr 172.21.15.59:0/935925280 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:28.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.772+0000 7f5e977fe640 1 --2- 172.21.15.59:0/935925280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d6434d0 0x56391d642ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:28.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.772+0000 7f5e977fe640 1 --2- 172.21.15.59:0/935925280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 0x56391d64ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:28.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.772+0000 7f5e8e7fc640 1 -- 172.21.15.59:0/935925280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d6434d0 msgr2=0x56391d642ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:28.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.772+0000 7f5e8e7fc640 1 --2- 172.21.15.59:0/935925280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d6434d0 0x56391d642ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.772+0000 7f5e8e7fc640 1 -- 172.21.15.59:0/935925280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 msgr2=0x56391d64ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:28.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.772+0000 7f5e8e7fc640 1 --2- 172.21.15.59:0/935925280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 0x56391d64ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.772+0000 7f5e8e7fc640 1 -- 172.21.15.59:0/935925280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391d6620e0 con 0x56391d643df0 2024-09-10T21:21:28.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.772+0000 7f5e977fe640 1 --2- 172.21.15.59:0/935925280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 0x56391d64ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:21:28.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.772+0000 7f5e8e7fc640 1 --2- 172.21.15.59:0/935925280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d643df0 0x56391d64c7b0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f5e80000c00 tx=0x7f5e80010600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8a694531e1c311 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:28.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.773+0000 7f5e8cff9640 1 -- 172.21.15.59:0/935925280 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e80034070 con 0x56391d643df0 2024-09-10T21:21:28.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.773+0000 7f5e8cff9640 1 -- 172.21.15.59:0/935925280 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e8000ed50 con 0x56391d643df0 2024-09-10T21:21:28.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.773+0000 7f5e8cff9640 1 -- 172.21.15.59:0/935925280 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e80012e40 con 0x56391d643df0 2024-09-10T21:21:28.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.773+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/935925280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d643df0 msgr2=0x56391d64c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:28.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.773+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/935925280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d643df0 0x56391d64c7b0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f5e80000c00 tx=0x7f5e80010600 comp rx=0 tx=0).stop 2024-09-10T21:21:28.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.773+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/935925280 shutdown_connections 2024-09-10T21:21:28.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.773+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/935925280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 0x56391d64ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.773+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/935925280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d643df0 0x56391d64c7b0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.773+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/935925280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d6434d0 0x56391d642ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.773+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/935925280 >> 172.21.15.59:0/935925280 conn(0x56391d641300 msgr2=0x56391d6423c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:28.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.773+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/935925280 shutdown_connections 2024-09-10T21:21:28.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.773+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/935925280 wait complete. 2024-09-10T21:21:28.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.774+0000 7f5e9f9c5740 1 -- start start 2024-09-10T21:21:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.774+0000 7f5e9f9c5740 1 Processor -- start 2024-09-10T21:21:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.774+0000 7f5e9f9c5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d6434d0 0x56391d654580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.774+0000 7f5e9f9c5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d643df0 0x56391d654b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.774+0000 7f5e9f9c5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 0x56391d6c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.774+0000 7f5e9f9c5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5e981af7d0 con 0x56391d6434d0 2024-09-10T21:21:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.774+0000 7f5e9f9c5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5e981af100 con 0x56391d64fd80 2024-09-10T21:21:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.774+0000 7f5e9f9c5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5e981ac340 con 0x56391d643df0 2024-09-10T21:21:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.774+0000 7f5e9f9c5740 10 client.0 _ll_register_callbacks cb 0x7f5e8000e3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:21:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.774+0000 7f5e977fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d6434d0 0x56391d654580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.774+0000 7f5e977fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d6434d0 0x56391d654580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58704/0 (socket says 172.21.15.59:58704) 2024-09-10T21:21:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.774+0000 7f5e977fe640 1 -- 172.21.15.59:0/1402752501 learned_addr learned my addr 172.21.15.59:0/1402752501 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.774+0000 7f5e8e7fc640 1 --2- 172.21.15.59:0/1402752501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d643df0 0x56391d654b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.775+0000 7f5e977fe640 1 -- 172.21.15.59:0/1402752501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d643df0 msgr2=0x56391d654b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.775+0000 7f5e977fe640 1 --2- 172.21.15.59:0/1402752501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d643df0 0x56391d654b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.775+0000 7f5e977fe640 1 -- 172.21.15.59:0/1402752501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 msgr2=0x56391d6c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.775+0000 7f5e977fe640 1 --2- 172.21.15.59:0/1402752501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 0x56391d6c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.775+0000 7f5e977fe640 1 -- 172.21.15.59:0/1402752501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56391d6ca0b0 con 0x56391d6434d0 2024-09-10T21:21:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.775+0000 7f5e977fe640 1 --2- 172.21.15.59:0/1402752501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d6434d0 0x56391d654580 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f5e90009a60 tx=0x7f5e90005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6519c5ff69c668a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.775+0000 7f5e7e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:21:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.775+0000 7f5e7e7fc640 1 -- 172.21.15.59:0/1402752501 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90004c40 con 0x56391d6434d0 2024-09-10T21:21:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.775+0000 7f5e7e7fc640 1 -- 172.21.15.59:0/1402752501 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5e90004de0 con 0x56391d6434d0 2024-09-10T21:21:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.775+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/1402752501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56391d641060 con 0x56391d6434d0 2024-09-10T21:21:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.775+0000 7f5e7e7fc640 1 -- 172.21.15.59:0/1402752501 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5e90031af0 con 0x56391d6434d0 2024-09-10T21:21:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.775+0000 7f5e9f9c5740 10 client.16866 fetch_fsmap learned FSMap version 28 2024-09-10T21:21:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.775+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/1402752501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56391d6d1490 con 0x56391d6434d0 2024-09-10T21:21:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.775+0000 7f5e7e7fc640 1 -- 172.21.15.59:0/1402752501 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56391d641060 con 0x56391d6434d0 2024-09-10T21:21:28.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.775+0000 7f5e7e7fc640 1 -- 172.21.15.59:0/1402752501 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5e90004490 con 0x56391d6434d0 2024-09-10T21:21:28.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.776+0000 7f5e9f9c5740 10 client.16866 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:21:28.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.776+0000 7f5e9f9c5740 10 client.16866 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:21:28.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.776+0000 7f5e9f9c5740 20 client.16866 populate_metadata read hostname 'smithi059' 2024-09-10T21:21:28.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.776+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/1402752501 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56391d6d1770 0x56391d6d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:28.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.776+0000 7f5e9f9c5740 4 client.16866 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:21:28.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.776+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/1402752501 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56391d5b78a0 con 0x56391d6d1770 2024-09-10T21:21:28.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.776+0000 7f5e8e7fc640 1 --2- 172.21.15.59:0/1402752501 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56391d6d1770 0x56391d6d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:28.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.776+0000 7f5e8e7fc640 1 --2- 172.21.15.59:0/1402752501 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56391d6d1770 0x56391d6d3b60 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bc7717626b66f87b server_cookie=322b450f24d95a18 in_seq=0 out_seq=0 2024-09-10T21:21:28.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.776+0000 7f5e7e7fc640 10 client.16866 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:21:28.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.776+0000 7f5e7e7fc640 1 -- 172.21.15.59:0/1402752501 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56391d5b78a0 con 0x56391d6d1770 2024-09-10T21:21:28.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.776+0000 7f5e7e7fc640 10 client.16866 handle_command_reply: tid=0 2024-09-10T21:21:28.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.776+0000 7f5e9f9c5740 1 client.16866 shutdown 2024-09-10T21:21:28.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/1402752501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d6434d0 msgr2=0x56391d654580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/1402752501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d6434d0 0x56391d654580 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f5e90009a60 tx=0x7f5e90005ef0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/1402752501 shutdown_connections 2024-09-10T21:21:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/1402752501 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x56391d6d1770 0x56391d6d3b60 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/1402752501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56391d64fd80 0x56391d6c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/1402752501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56391d643df0 0x56391d654b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e7e7fc640 0 client.16866 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:21:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9f9c5740 1 --2- 172.21.15.59:0/1402752501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56391d6434d0 0x56391d654580 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/1402752501 >> 172.21.15.59:0/1402752501 conn(0x56391d641300 msgr2=0x56391d642350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/1402752501 shutdown_connections 2024-09-10T21:21:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9f9c5740 1 -- 172.21.15.59:0/1402752501 wait complete. 2024-09-10T21:21:28.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9f9c5740 20 client.16866 trim_cache size 0 max 16384 2024-09-10T21:21:28.785 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:21:28.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9d5f0640 1 -- 172.21.15.59:0/1825416486 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5e840b52e0 msgr2=0x7f5e840b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:28.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9d5f0640 1 --2- 172.21.15.59:0/1825416486 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5e840b52e0 0x7f5e840b77a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5e880e3e90 tx=0x7f5e88000bc0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9d5f0640 1 -- 172.21.15.59:0/1825416486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98102dc0 msgr2=0x7f5e98199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:28.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9d5f0640 1 --2- 172.21.15.59:0/1825416486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98102dc0 0x7f5e98199260 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800e9f0 tx=0x7f5e8800eeb0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9d5f0640 1 -- 172.21.15.59:0/1825416486 shutdown_connections 2024-09-10T21:21:28.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9d5f0640 1 --2- 172.21.15.59:0/1825416486 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5e840b52e0 0x7f5e840b77a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9d5f0640 1 --2- 172.21.15.59:0/1825416486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e98109150 0x7f5e9819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9d5f0640 1 --2- 172.21.15.59:0/1825416486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5e981087d0 0x7f5e981997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9d5f0640 1 --2- 172.21.15.59:0/1825416486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98102dc0 0x7f5e98199260 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:28.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.777+0000 7f5e9d5f0640 1 -- 172.21.15.59:0/1825416486 >> 172.21.15.59:0/1825416486 conn(0x7f5e980fe830 msgr2=0x7f5e98100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:28.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.778+0000 7f5e9d5f0640 1 -- 172.21.15.59:0/1825416486 shutdown_connections 2024-09-10T21:21:28.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:28.778+0000 7f5e9d5f0640 1 -- 172.21.15.59:0/1825416486 wait complete. 2024-09-10T21:21:29.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:29 smithi192 ceph-mon[35363]: pgmap v526: 97 pgs: 97 active+clean; 4.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:21:29.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:29 smithi059 ceph-mon[30888]: pgmap v526: 97 pgs: 97 active+clean; 4.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:21:29.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:29 smithi154 ceph-mon[35041]: pgmap v526: 97 pgs: 97 active+clean; 4.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:21:29.442 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:21:29.702 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:21:29.883 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.883 INFO:tasks.workunit.client.0.smithi059.stdout:251/600: open fd = 3 2024-09-10T21:21:29.883 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.883 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.883 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.884 INFO:tasks.workunit.client.0.smithi059.stdout:252/600: open fd = 3 2024-09-10T21:21:29.884 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.884 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.884 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.884 INFO:tasks.workunit.client.0.smithi059.stdout:253/600: open fd = 3 2024-09-10T21:21:29.884 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.884 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.884 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.884 INFO:tasks.workunit.client.0.smithi059.stdout:254/600: open fd = 3 2024-09-10T21:21:29.884 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.884 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.884 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.884 INFO:tasks.workunit.client.0.smithi059.stdout:255/600: open fd = 3 2024-09-10T21:21:29.885 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.885 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.885 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.885 INFO:tasks.workunit.client.0.smithi059.stdout:256/600: open fd = 3 2024-09-10T21:21:29.885 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.885 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.885 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.885 INFO:tasks.workunit.client.0.smithi059.stdout:257/600: open fd = 3 2024-09-10T21:21:29.885 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.885 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.885 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.885 INFO:tasks.workunit.client.0.smithi059.stdout:258/600: open fd = 3 2024-09-10T21:21:29.885 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.885 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.886 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.886 INFO:tasks.workunit.client.0.smithi059.stdout:259/600: open fd = 3 2024-09-10T21:21:29.886 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.886 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.886 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.886 INFO:tasks.workunit.client.0.smithi059.stdout:260/600: open fd = 3 2024-09-10T21:21:29.886 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.886 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.886 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.886 INFO:tasks.workunit.client.0.smithi059.stdout:261/600: open fd = 3 2024-09-10T21:21:29.886 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.886 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.887 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.887 INFO:tasks.workunit.client.0.smithi059.stdout:262/600: open fd = 3 2024-09-10T21:21:29.887 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.887 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.887 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.887 INFO:tasks.workunit.client.0.smithi059.stdout:263/600: open fd = 3 2024-09-10T21:21:29.887 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.887 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.887 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.887 INFO:tasks.workunit.client.0.smithi059.stdout:264/600: open fd = 3 2024-09-10T21:21:29.887 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.887 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.887 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.887 INFO:tasks.workunit.client.0.smithi059.stdout:265/600: open fd = 3 2024-09-10T21:21:29.888 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.888 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.888 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.888 INFO:tasks.workunit.client.0.smithi059.stdout:266/600: open fd = 3 2024-09-10T21:21:29.888 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.888 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.888 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.888 INFO:tasks.workunit.client.0.smithi059.stdout:267/600: open fd = 3 2024-09-10T21:21:29.888 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.888 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.888 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.888 INFO:tasks.workunit.client.0.smithi059.stdout:268/600: open fd = 3 2024-09-10T21:21:29.888 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.889 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.889 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.889 INFO:tasks.workunit.client.0.smithi059.stdout:269/600: open fd = 3 2024-09-10T21:21:29.889 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.889 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.889 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.889 INFO:tasks.workunit.client.0.smithi059.stdout:270/600: open fd = 3 2024-09-10T21:21:29.889 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.889 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.889 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.889 INFO:tasks.workunit.client.0.smithi059.stdout:271/600: open fd = 3 2024-09-10T21:21:29.889 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.889 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.889 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.890 INFO:tasks.workunit.client.0.smithi059.stdout:272/600: open fd = 3 2024-09-10T21:21:29.890 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.890 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.890 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.890 INFO:tasks.workunit.client.0.smithi059.stdout:273/600: open fd = 3 2024-09-10T21:21:29.890 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.890 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.890 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.890 INFO:tasks.workunit.client.0.smithi059.stdout:274/600: open fd = 3 2024-09-10T21:21:29.890 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.890 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.890 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.890 INFO:tasks.workunit.client.0.smithi059.stdout:275/600: open fd = 3 2024-09-10T21:21:29.890 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.891 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.891 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.891 INFO:tasks.workunit.client.0.smithi059.stdout:276/600: open fd = 3 2024-09-10T21:21:29.891 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.891 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.891 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.891 INFO:tasks.workunit.client.0.smithi059.stdout:277/600: open fd = 3 2024-09-10T21:21:29.891 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.891 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.891 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.891 INFO:tasks.workunit.client.0.smithi059.stdout:278/600: open fd = 3 2024-09-10T21:21:29.891 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.891 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.891 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.892 INFO:tasks.workunit.client.0.smithi059.stdout:279/600: open fd = 3 2024-09-10T21:21:29.892 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.892 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.892 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.892 INFO:tasks.workunit.client.0.smithi059.stdout:280/600: open fd = 3 2024-09-10T21:21:29.892 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.892 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.892 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.892 INFO:tasks.workunit.client.0.smithi059.stdout:281/600: open fd = 3 2024-09-10T21:21:29.892 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.892 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.892 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.892 INFO:tasks.workunit.client.0.smithi059.stdout:282/600: open fd = 3 2024-09-10T21:21:29.892 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.893 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.893 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.893 INFO:tasks.workunit.client.0.smithi059.stdout:283/600: open fd = 3 2024-09-10T21:21:29.893 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.893 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.893 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.893 INFO:tasks.workunit.client.0.smithi059.stdout:284/600: open fd = 3 2024-09-10T21:21:29.893 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.893 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.893 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.893 INFO:tasks.workunit.client.0.smithi059.stdout:285/600: open fd = 3 2024-09-10T21:21:29.894 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.894 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.894 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.894 INFO:tasks.workunit.client.0.smithi059.stdout:286/600: open fd = 3 2024-09-10T21:21:29.894 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.894 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.894 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.894 INFO:tasks.workunit.client.0.smithi059.stdout:287/600: open fd = 3 2024-09-10T21:21:29.894 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.894 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.894 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.894 INFO:tasks.workunit.client.0.smithi059.stdout:288/600: open fd = 3 2024-09-10T21:21:29.894 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.895 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.895 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.895 INFO:tasks.workunit.client.0.smithi059.stdout:289/600: open fd = 3 2024-09-10T21:21:29.895 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.895 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.895 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.895 INFO:tasks.workunit.client.0.smithi059.stdout:290/600: open fd = 3 2024-09-10T21:21:29.895 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.895 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.895 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.895 INFO:tasks.workunit.client.0.smithi059.stdout:291/600: open fd = 3 2024-09-10T21:21:29.895 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.895 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.895 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.896 INFO:tasks.workunit.client.0.smithi059.stdout:292/600: open fd = 3 2024-09-10T21:21:29.896 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.896 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.896 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.896 INFO:tasks.workunit.client.0.smithi059.stdout:293/600: open fd = 3 2024-09-10T21:21:29.896 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.896 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.896 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.896 INFO:tasks.workunit.client.0.smithi059.stdout:294/600: open fd = 3 2024-09-10T21:21:29.896 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.896 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.896 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.897 INFO:tasks.workunit.client.0.smithi059.stdout:295/600: open fd = 3 2024-09-10T21:21:29.897 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.897 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.897 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.897 INFO:tasks.workunit.client.0.smithi059.stdout:296/600: open fd = 3 2024-09-10T21:21:29.897 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.897 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.897 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.897 INFO:tasks.workunit.client.0.smithi059.stdout:297/600: open fd = 3 2024-09-10T21:21:29.897 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.897 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.897 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.898 INFO:tasks.workunit.client.0.smithi059.stdout:298/600: open fd = 3 2024-09-10T21:21:29.898 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.898 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.898 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.898 INFO:tasks.workunit.client.0.smithi059.stdout:299/600: open fd = 3 2024-09-10T21:21:29.898 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.898 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.898 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.898 INFO:tasks.workunit.client.0.smithi059.stdout:300/600: open fd = 3 2024-09-10T21:21:29.898 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.898 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.898 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.898 INFO:tasks.workunit.client.0.smithi059.stdout:301/600: open fd = 3 2024-09-10T21:21:29.899 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.899 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.899 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.899 INFO:tasks.workunit.client.0.smithi059.stdout:302/600: open fd = 3 2024-09-10T21:21:29.899 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.899 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.899 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.899 INFO:tasks.workunit.client.0.smithi059.stdout:303/600: open fd = 3 2024-09-10T21:21:29.899 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.899 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.899 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.899 INFO:tasks.workunit.client.0.smithi059.stdout:304/600: open fd = 3 2024-09-10T21:21:29.899 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.899 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.900 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.900 INFO:tasks.workunit.client.0.smithi059.stdout:305/600: open fd = 3 2024-09-10T21:21:29.900 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.900 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.900 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.900 INFO:tasks.workunit.client.0.smithi059.stdout:306/600: open fd = 3 2024-09-10T21:21:29.900 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.900 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.900 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.900 INFO:tasks.workunit.client.0.smithi059.stdout:307/600: open fd = 3 2024-09-10T21:21:29.900 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.900 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.900 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.900 INFO:tasks.workunit.client.0.smithi059.stdout:308/600: open fd = 3 2024-09-10T21:21:29.901 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.901 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.901 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.901 INFO:tasks.workunit.client.0.smithi059.stdout:309/600: open fd = 3 2024-09-10T21:21:29.901 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.901 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.901 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.901 INFO:tasks.workunit.client.0.smithi059.stdout:310/600: open fd = 3 2024-09-10T21:21:29.901 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.901 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.901 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.901 INFO:tasks.workunit.client.0.smithi059.stdout:311/600: open fd = 3 2024-09-10T21:21:29.901 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.902 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.902 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:21:29.902 INFO:tasks.workunit.client.0.smithi059.stdout:312/600: open fd = 3 2024-09-10T21:21:29.902 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:29.902 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:21:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.182+0000 7eff660c3640 1 -- 172.21.15.59:0/383837976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff601045c0 msgr2=0x7eff6010cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.183+0000 7eff660c3640 1 --2- 172.21.15.59:0/383837976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff601045c0 0x7eff6010cab0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7eff54009900 tx=0x7eff5402a410 comp rx=0 tx=0).stop 2024-09-10T21:21:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.183+0000 7eff660c3640 1 -- 172.21.15.59:0/383837976 shutdown_connections 2024-09-10T21:21:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.183+0000 7eff660c3640 1 --2- 172.21.15.59:0/383837976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff6010d100 0x7eff6010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.183+0000 7eff660c3640 1 --2- 172.21.15.59:0/383837976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff601045c0 0x7eff6010cab0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.183+0000 7eff660c3640 1 --2- 172.21.15.59:0/383837976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff60103ca0 0x7eff60104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.183+0000 7eff660c3640 1 -- 172.21.15.59:0/383837976 >> 172.21.15.59:0/383837976 conn(0x7eff600fd700 msgr2=0x7eff600ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.183+0000 7eff660c3640 1 -- 172.21.15.59:0/383837976 shutdown_connections 2024-09-10T21:21:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.183+0000 7eff660c3640 1 -- 172.21.15.59:0/383837976 wait complete. 2024-09-10T21:21:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.183+0000 7eff660c3640 1 Processor -- start 2024-09-10T21:21:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.183+0000 7eff660c3640 1 -- start start 2024-09-10T21:21:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff660c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff60103ca0 0x7eff601992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff660c3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff601045c0 0x7eff60199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff660c3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff6010d100 0x7eff6019eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff660c3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7eff60112db0 con 0x7eff6010d100 2024-09-10T21:21:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff660c3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7eff60112c30 con 0x7eff601045c0 2024-09-10T21:21:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff660c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7eff60112f30 con 0x7eff60103ca0 2024-09-10T21:21:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff5ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff6010d100 0x7eff6019eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff5ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff6010d100 0x7eff6019eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54878/0 (socket says 172.21.15.59:54878) 2024-09-10T21:21:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff5ffff640 1 -- 172.21.15.59:0/508807978 learned_addr learned my addr 172.21.15.59:0/508807978 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:30.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff5f7fe640 1 --2- 172.21.15.59:0/508807978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff60103ca0 0x7eff601992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:30.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff5effd640 1 --2- 172.21.15.59:0/508807978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff601045c0 0x7eff60199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:30.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff5ffff640 1 -- 172.21.15.59:0/508807978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff60103ca0 msgr2=0x7eff601992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:30.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff5ffff640 1 --2- 172.21.15.59:0/508807978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff60103ca0 0x7eff601992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff5ffff640 1 -- 172.21.15.59:0/508807978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff601045c0 msgr2=0x7eff60199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:30.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff5ffff640 1 --2- 172.21.15.59:0/508807978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff601045c0 0x7eff60199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff5ffff640 1 -- 172.21.15.59:0/508807978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff6019f370 con 0x7eff6010d100 2024-09-10T21:21:30.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff5effd640 1 --2- 172.21.15.59:0/508807978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff601045c0 0x7eff60199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:21:30.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff5f7fe640 1 --2- 172.21.15.59:0/508807978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff60103ca0 0x7eff601992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:21:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff5ffff640 1 --2- 172.21.15.59:0/508807978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff6010d100 0x7eff6019eba0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7eff5800c970 tx=0x7eff5800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.184+0000 7eff5cff9640 1 -- 172.21.15.59:0/508807978 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff58007bb0 con 0x7eff6010d100 2024-09-10T21:21:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.185+0000 7eff660c3640 1 -- 172.21.15.59:0/508807978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff6019f660 con 0x7eff6010d100 2024-09-10T21:21:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.185+0000 7eff5cff9640 1 -- 172.21.15.59:0/508807978 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff58007d50 con 0x7eff6010d100 2024-09-10T21:21:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.185+0000 7eff660c3640 1 -- 172.21.15.59:0/508807978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff601a5da0 con 0x7eff6010d100 2024-09-10T21:21:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.185+0000 7eff5cff9640 1 -- 172.21.15.59:0/508807978 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff58018730 con 0x7eff6010d100 2024-09-10T21:21:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.188+0000 7eff68498740 1 Processor -- start 2024-09-10T21:21:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.188+0000 7eff5cff9640 1 -- 172.21.15.59:0/508807978 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7eff58020030 con 0x7eff6010d100 2024-09-10T21:21:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.188+0000 7eff68498740 1 -- start start 2024-09-10T21:21:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.188+0000 7eff68498740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e276694d0 0x559e276698b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.188+0000 7eff68498740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e27669df0 0x559e27679c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.188+0000 7eff68498740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e2767a190 0x559e2767c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.188+0000 7eff68498740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559e275dfea0 con 0x559e276694d0 2024-09-10T21:21:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.188+0000 7eff68498740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e275cf2d0 con 0x559e27669df0 2024-09-10T21:21:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.188+0000 7eff68498740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559e275d30e0 con 0x559e2767a190 2024-09-10T21:21:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.188+0000 7eff5effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e276694d0 0x559e276698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.188+0000 7eff5effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e276694d0 0x559e276698b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54894/0 (socket says 172.21.15.59:54894) 2024-09-10T21:21:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.188+0000 7eff5effd640 1 -- 172.21.15.59:0/2471594461 learned_addr learned my addr 172.21.15.59:0/2471594461 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.189+0000 7eff5f7fe640 1 --2- 172.21.15.59:0/2471594461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e27669df0 0x559e27679c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.189+0000 7eff5effd640 1 -- 172.21.15.59:0/2471594461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e2767a190 msgr2=0x559e2767c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.189+0000 7eff5effd640 1 --2- 172.21.15.59:0/2471594461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e2767a190 0x559e2767c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.189+0000 7eff5effd640 1 -- 172.21.15.59:0/2471594461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e27669df0 msgr2=0x559e27679c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.189+0000 7eff5effd640 1 --2- 172.21.15.59:0/2471594461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e27669df0 0x559e27679c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.189+0000 7eff5cff9640 1 --2- 172.21.15.59:0/508807978 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7eff480b52e0 0x7eff480b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.189+0000 7eff5effd640 1 -- 172.21.15.59:0/2471594461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e2732d650 con 0x559e276694d0 2024-09-10T21:21:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.189+0000 7eff5f7fe640 1 --2- 172.21.15.59:0/2471594461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e27669df0 0x559e27679c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:21:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.189+0000 7eff5cff9640 1 -- 172.21.15.59:0/508807978 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7eff580e5980 con 0x7eff6010d100 2024-09-10T21:21:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.189+0000 7eff5effd640 1 --2- 172.21.15.59:0/508807978 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7eff480b52e0 0x7eff480b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.189+0000 7eff5effd640 1 --2- 172.21.15.59:0/2471594461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e276694d0 0x559e276698b0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7eff54005ab0 tx=0x7eff54031d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b60b96d09169bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.189+0000 7eff45ffb640 1 -- 172.21.15.59:0/2471594461 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff54035050 con 0x559e276694d0 2024-09-10T21:21:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.189+0000 7eff45ffb640 1 -- 172.21.15.59:0/2471594461 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff54041050 con 0x559e276694d0 2024-09-10T21:21:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.189+0000 7eff45ffb640 1 -- 172.21.15.59:0/2471594461 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5404f070 con 0x559e276694d0 2024-09-10T21:21:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.190+0000 7eff68498740 1 -- 172.21.15.59:0/2471594461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e276694d0 msgr2=0x559e276698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.190+0000 7eff5effd640 1 --2- 172.21.15.59:0/508807978 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7eff480b52e0 0x7eff480b77a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7eff54005ec0 tx=0x7eff5404b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.190+0000 7eff68498740 1 --2- 172.21.15.59:0/2471594461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e276694d0 0x559e276698b0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7eff54005ab0 tx=0x7eff54031d70 comp rx=0 tx=0).stop 2024-09-10T21:21:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.190+0000 7eff68498740 1 -- 172.21.15.59:0/2471594461 shutdown_connections 2024-09-10T21:21:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.190+0000 7eff68498740 1 --2- 172.21.15.59:0/2471594461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e2767a190 0x559e2767c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.190+0000 7eff68498740 1 --2- 172.21.15.59:0/2471594461 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e27669df0 0x559e27679c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.190+0000 7eff68498740 1 --2- 172.21.15.59:0/2471594461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e276694d0 0x559e276698b0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.190+0000 7eff68498740 1 -- 172.21.15.59:0/2471594461 >> 172.21.15.59:0/2471594461 conn(0x559e27667300 msgr2=0x559e276684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.190+0000 7eff68498740 1 -- 172.21.15.59:0/2471594461 shutdown_connections 2024-09-10T21:21:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.190+0000 7eff68498740 1 -- 172.21.15.59:0/2471594461 wait complete. 2024-09-10T21:21:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.191+0000 7eff68498740 1 -- start start 2024-09-10T21:21:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.191+0000 7eff68498740 1 Processor -- start 2024-09-10T21:21:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.191+0000 7eff68498740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e276694d0 0x559e27679a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.191+0000 7eff68498740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e27669df0 0x559e27676ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.191+0000 7eff68498740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e2767a190 0x559e27677480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.191+0000 7eff68498740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559e27430700 con 0x559e2767a190 2024-09-10T21:21:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.191+0000 7eff68498740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e2756a160 con 0x559e276694d0 2024-09-10T21:21:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.191+0000 7eff68498740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x559e2767ce40 con 0x559e27669df0 2024-09-10T21:21:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.191+0000 7eff68498740 10 client.0 _ll_register_callbacks cb 0x559e275839e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:21:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.191+0000 7eff5ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e2767a190 0x559e27677480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.191+0000 7eff5ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e2767a190 0x559e27677480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54898/0 (socket says 172.21.15.59:54898) 2024-09-10T21:21:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.191+0000 7eff5ffff640 1 -- 172.21.15.59:0/3662070913 learned_addr learned my addr 172.21.15.59:0/3662070913 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.192+0000 7eff5effd640 1 --2- 172.21.15.59:0/3662070913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e27669df0 0x559e27676ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.192+0000 7eff5f7fe640 1 --2- 172.21.15.59:0/3662070913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e276694d0 0x559e27679a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.192+0000 7eff5ffff640 1 -- 172.21.15.59:0/3662070913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e27669df0 msgr2=0x559e27676ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.192+0000 7eff5ffff640 1 --2- 172.21.15.59:0/3662070913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e27669df0 0x559e27676ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.192+0000 7eff5ffff640 1 -- 172.21.15.59:0/3662070913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e276694d0 msgr2=0x559e27679a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.192+0000 7eff5ffff640 1 --2- 172.21.15.59:0/3662070913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e276694d0 0x559e27679a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.192+0000 7eff5ffff640 1 -- 172.21.15.59:0/3662070913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e27597c90 con 0x559e2767a190 2024-09-10T21:21:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.192+0000 7eff5ffff640 1 --2- 172.21.15.59:0/3662070913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e2767a190 0x559e27677480 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7eff580a8740 tx=0x7eff580abc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2f2d3835cb312 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.192+0000 7eff3effd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:21:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.192+0000 7eff3effd640 1 -- 172.21.15.59:0/3662070913 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff580ac170 con 0x559e2767a190 2024-09-10T21:21:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.192+0000 7eff3effd640 1 -- 172.21.15.59:0/3662070913 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7eff580cdb50 con 0x559e2767a190 2024-09-10T21:21:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.192+0000 7eff68498740 1 -- 172.21.15.59:0/3662070913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff54041050 con 0x559e2767a190 2024-09-10T21:21:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.192+0000 7eff3effd640 1 -- 172.21.15.59:0/3662070913 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff580b0c50 con 0x559e2767a190 2024-09-10T21:21:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.192+0000 7eff68498740 10 client.16878 fetch_fsmap learned FSMap version 28 2024-09-10T21:21:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.192+0000 7eff68498740 1 -- 172.21.15.59:0/3662070913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559e27688760 con 0x559e2767a190 2024-09-10T21:21:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.192+0000 7eff3effd640 1 -- 172.21.15.59:0/3662070913 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff54041050 con 0x559e2767a190 2024-09-10T21:21:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.193+0000 7eff3effd640 1 -- 172.21.15.59:0/3662070913 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7eff580a7cc0 con 0x559e2767a190 2024-09-10T21:21:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.193+0000 7eff68498740 10 client.16878 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:21:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.193+0000 7eff68498740 10 client.16878 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:21:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.193+0000 7eff68498740 20 client.16878 populate_metadata read hostname 'smithi059' 2024-09-10T21:21:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.193+0000 7eff68498740 1 --2- 172.21.15.59:0/3662070913 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x559e27689c20 0x559e2768c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.193+0000 7eff68498740 4 client.16878 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:21:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.193+0000 7eff68498740 1 -- 172.21.15.59:0/3662070913 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e275e1df0 con 0x559e27689c20 2024-09-10T21:21:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.193+0000 7eff5f7fe640 1 --2- 172.21.15.59:0/3662070913 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x559e27689c20 0x559e2768c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.194+0000 7eff5f7fe640 1 --2- 172.21.15.59:0/3662070913 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x559e27689c20 0x559e2768c010 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6547199e28aaf1cd server_cookie=67e436a34feee6ed in_seq=0 out_seq=0 2024-09-10T21:21:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.194+0000 7eff3effd640 10 client.16878 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:21:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.194+0000 7eff3effd640 1 -- 172.21.15.59:0/3662070913 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559e275e1df0 con 0x559e27689c20 2024-09-10T21:21:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.194+0000 7eff3effd640 10 client.16878 handle_command_reply: tid=0 2024-09-10T21:21:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.194+0000 7eff68498740 1 client.16878 shutdown 2024-09-10T21:21:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.195+0000 7eff68498740 1 -- 172.21.15.59:0/3662070913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e2767a190 msgr2=0x559e27677480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.195+0000 7eff68498740 1 --2- 172.21.15.59:0/3662070913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e2767a190 0x559e27677480 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7eff580a8740 tx=0x7eff580abc80 comp rx=0 tx=0).stop 2024-09-10T21:21:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.195+0000 7eff68498740 1 -- 172.21.15.59:0/3662070913 shutdown_connections 2024-09-10T21:21:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.195+0000 7eff68498740 1 --2- 172.21.15.59:0/3662070913 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x559e27689c20 0x559e2768c010 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.195+0000 7eff3effd640 0 client.16878 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:21:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.195+0000 7eff68498740 1 --2- 172.21.15.59:0/3662070913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e2767a190 0x559e27677480 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.195+0000 7eff68498740 1 --2- 172.21.15.59:0/3662070913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e27669df0 0x559e27676ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.195+0000 7eff68498740 1 --2- 172.21.15.59:0/3662070913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e276694d0 0x559e27679a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.195+0000 7eff68498740 1 -- 172.21.15.59:0/3662070913 >> 172.21.15.59:0/3662070913 conn(0x559e27667300 msgr2=0x559e2766ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:30.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.195+0000 7eff68498740 1 -- 172.21.15.59:0/3662070913 shutdown_connections 2024-09-10T21:21:30.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.195+0000 7eff68498740 1 -- 172.21.15.59:0/3662070913 wait complete. 2024-09-10T21:21:30.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.195+0000 7eff68498740 20 client.16878 trim_cache size 0 max 16384 2024-09-10T21:21:30.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.213+0000 7eff68498740 1 Processor -- start 2024-09-10T21:21:30.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.213+0000 7eff68498740 1 -- start start 2024-09-10T21:21:30.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.213+0000 7eff68498740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e276694d0 0x559e276860d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:30.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.214+0000 7eff68498740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e27669df0 0x559e27691890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:30.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.214+0000 7eff68498740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e2767a190 0x559e27691dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:30.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.214+0000 7eff68498740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7eff601abf90 con 0x559e276694d0 2024-09-10T21:21:30.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.214+0000 7eff68498740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7eff601adad0 con 0x559e2767a190 2024-09-10T21:21:30.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.214+0000 7eff68498740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7eff601ac660 con 0x559e27669df0 2024-09-10T21:21:30.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.214+0000 7eff5f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e276694d0 0x559e276860d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:30.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.214+0000 7eff5f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e276694d0 0x559e276860d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54908/0 (socket says 172.21.15.59:54908) 2024-09-10T21:21:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.214+0000 7eff5f7fe640 1 -- 172.21.15.59:0/1780666046 learned_addr learned my addr 172.21.15.59:0/1780666046 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.214+0000 7eff5ffff640 1 --2- 172.21.15.59:0/1780666046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e2767a190 0x559e27691dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.214+0000 7eff5effd640 1 --2- 172.21.15.59:0/1780666046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e27669df0 0x559e27691890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.214+0000 7eff5f7fe640 1 -- 172.21.15.59:0/1780666046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e27669df0 msgr2=0x559e27691890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.214+0000 7eff5f7fe640 1 --2- 172.21.15.59:0/1780666046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e27669df0 0x559e27691890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.214+0000 7eff5f7fe640 1 -- 172.21.15.59:0/1780666046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e2767a190 msgr2=0x559e27691dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.214+0000 7eff5f7fe640 1 --2- 172.21.15.59:0/1780666046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e2767a190 0x559e27691dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.214+0000 7eff5f7fe640 1 -- 172.21.15.59:0/1780666046 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e27668f10 con 0x559e276694d0 2024-09-10T21:21:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.214+0000 7eff5f7fe640 1 --2- 172.21.15.59:0/1780666046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e276694d0 0x559e276860d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7eff5000a4e0 tx=0x7eff5000a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c5900c41d577f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:30.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.215+0000 7eff457fa640 1 -- 172.21.15.59:0/1780666046 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff50022020 con 0x559e276694d0 2024-09-10T21:21:30.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.215+0000 7eff457fa640 1 -- 172.21.15.59:0/1780666046 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff50019a50 con 0x559e276694d0 2024-09-10T21:21:30.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.215+0000 7eff457fa640 1 -- 172.21.15.59:0/1780666046 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5001e9c0 con 0x559e276694d0 2024-09-10T21:21:30.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.216+0000 7eff68498740 1 -- 172.21.15.59:0/1780666046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e276694d0 msgr2=0x559e276860d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:30.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.216+0000 7eff68498740 1 --2- 172.21.15.59:0/1780666046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e276694d0 0x559e276860d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7eff5000a4e0 tx=0x7eff5000a8e0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.216+0000 7eff68498740 1 -- 172.21.15.59:0/1780666046 shutdown_connections 2024-09-10T21:21:30.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.216+0000 7eff68498740 1 --2- 172.21.15.59:0/1780666046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e2767a190 0x559e27691dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.216+0000 7eff68498740 1 --2- 172.21.15.59:0/1780666046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e27669df0 0x559e27691890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.216+0000 7eff68498740 1 --2- 172.21.15.59:0/1780666046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e276694d0 0x559e276860d0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.216+0000 7eff68498740 1 -- 172.21.15.59:0/1780666046 >> 172.21.15.59:0/1780666046 conn(0x559e27667300 msgr2=0x559e2767bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:30.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.216+0000 7eff68498740 1 -- 172.21.15.59:0/1780666046 shutdown_connections 2024-09-10T21:21:30.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.216+0000 7eff68498740 1 -- 172.21.15.59:0/1780666046 wait complete. 2024-09-10T21:21:30.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.216+0000 7eff68498740 1 -- start start 2024-09-10T21:21:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.216+0000 7eff68498740 1 Processor -- start 2024-09-10T21:21:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.217+0000 7eff68498740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e276694d0 0x559e27682660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.217+0000 7eff68498740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e27669df0 0x559e2767f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.217+0000 7eff68498740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e2767a190 0x559e2767f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.217+0000 7eff68498740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7eff601ad400 con 0x559e27669df0 2024-09-10T21:21:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.217+0000 7eff68498740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7eff601acd30 con 0x559e2767a190 2024-09-10T21:21:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.217+0000 7eff68498740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7eff601a9f90 con 0x559e276694d0 2024-09-10T21:21:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.217+0000 7eff68498740 10 client.0 _ll_register_callbacks cb 0x7eff58007f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:21:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.217+0000 7eff5effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e27669df0 0x559e2767f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.217+0000 7eff5effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e27669df0 0x559e2767f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54918/0 (socket says 172.21.15.59:54918) 2024-09-10T21:21:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.217+0000 7eff5effd640 1 -- 172.21.15.59:0/1832947383 learned_addr learned my addr 172.21.15.59:0/1832947383 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.217+0000 7eff5f7fe640 1 --2- 172.21.15.59:0/1832947383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e276694d0 0x559e27682660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.217+0000 7eff5ffff640 1 --2- 172.21.15.59:0/1832947383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e2767a190 0x559e2767f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.217+0000 7eff5effd640 1 -- 172.21.15.59:0/1832947383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e276694d0 msgr2=0x559e27682660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.217+0000 7eff5effd640 1 --2- 172.21.15.59:0/1832947383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e276694d0 0x559e27682660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.217+0000 7eff5effd640 1 -- 172.21.15.59:0/1832947383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e2767a190 msgr2=0x559e2767f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.217+0000 7eff5effd640 1 --2- 172.21.15.59:0/1832947383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e2767a190 0x559e2767f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.217+0000 7eff5effd640 1 -- 172.21.15.59:0/1832947383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e2767fbd0 con 0x559e27669df0 2024-09-10T21:21:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.217+0000 7eff5ffff640 1 --2- 172.21.15.59:0/1832947383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e2767a190 0x559e2767f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:21:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.218+0000 7eff5effd640 1 --2- 172.21.15.59:0/1832947383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e27669df0 0x559e2767f100 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7eff54009900 tx=0x7eff540045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3809f9b44daa4875 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.218+0000 7eff3effd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:21:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.218+0000 7eff3effd640 1 -- 172.21.15.59:0/1832947383 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff54035030 con 0x559e27669df0 2024-09-10T21:21:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.218+0000 7eff68498740 1 -- 172.21.15.59:0/1832947383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff50019a50 con 0x559e27669df0 2024-09-10T21:21:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.218+0000 7eff3effd640 1 -- 172.21.15.59:0/1832947383 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7eff54003a00 con 0x559e27669df0 2024-09-10T21:21:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.218+0000 7eff3effd640 1 -- 172.21.15.59:0/1832947383 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7eff54003c00 con 0x559e27669df0 2024-09-10T21:21:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.218+0000 7eff68498740 10 client.16884 fetch_fsmap learned FSMap version 28 2024-09-10T21:21:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.218+0000 7eff68498740 1 -- 172.21.15.59:0/1832947383 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559e276f7860 con 0x559e27669df0 2024-09-10T21:21:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.218+0000 7eff3effd640 1 -- 172.21.15.59:0/1832947383 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff50019a50 con 0x559e27669df0 2024-09-10T21:21:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.219+0000 7eff3effd640 1 -- 172.21.15.59:0/1832947383 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7eff54049500 con 0x559e27669df0 2024-09-10T21:21:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.219+0000 7eff68498740 10 client.16884 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:21:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.219+0000 7eff68498740 10 client.16884 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:21:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.219+0000 7eff68498740 20 client.16884 populate_metadata read hostname 'smithi059' 2024-09-10T21:21:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.219+0000 7eff68498740 1 --2- 172.21.15.59:0/1832947383 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x559e27689c20 0x559e276f9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.219+0000 7eff68498740 4 client.16884 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:21:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.219+0000 7eff68498740 1 -- 172.21.15.59:0/1832947383 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559e275dd8a0 con 0x559e27689c20 2024-09-10T21:21:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.219+0000 7eff5f7fe640 1 --2- 172.21.15.59:0/1832947383 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x559e27689c20 0x559e276f9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.219+0000 7eff5f7fe640 1 --2- 172.21.15.59:0/1832947383 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x559e27689c20 0x559e276f9be0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=19e5ae09047345d1 server_cookie=53f841d44f7421a8 in_seq=0 out_seq=0 2024-09-10T21:21:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.219+0000 7eff3effd640 10 client.16884 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:21:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.220+0000 7eff3effd640 1 -- 172.21.15.59:0/1832947383 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559e275dd8a0 con 0x559e27689c20 2024-09-10T21:21:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.220+0000 7eff3effd640 10 client.16884 handle_command_reply: tid=0 2024-09-10T21:21:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.220+0000 7eff68498740 1 client.16884 shutdown 2024-09-10T21:21:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.220+0000 7eff68498740 1 -- 172.21.15.59:0/1832947383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e27669df0 msgr2=0x559e2767f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.220+0000 7eff68498740 1 --2- 172.21.15.59:0/1832947383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e27669df0 0x559e2767f100 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7eff54009900 tx=0x7eff540045d0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.220+0000 7eff68498740 1 -- 172.21.15.59:0/1832947383 shutdown_connections 2024-09-10T21:21:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.220+0000 7eff68498740 1 --2- 172.21.15.59:0/1832947383 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x559e27689c20 0x559e276f9be0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.220+0000 7eff68498740 1 --2- 172.21.15.59:0/1832947383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e2767a190 0x559e2767f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.220+0000 7eff3effd640 0 client.16884 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:21:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.220+0000 7eff68498740 1 --2- 172.21.15.59:0/1832947383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559e27669df0 0x559e2767f100 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.220+0000 7eff68498740 1 --2- 172.21.15.59:0/1832947383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x559e276694d0 0x559e27682660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.220+0000 7eff68498740 1 -- 172.21.15.59:0/1832947383 >> 172.21.15.59:0/1832947383 conn(0x559e27667300 msgr2=0x559e27665c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.220+0000 7eff68498740 1 -- 172.21.15.59:0/1832947383 shutdown_connections 2024-09-10T21:21:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.220+0000 7eff68498740 1 -- 172.21.15.59:0/1832947383 wait complete. 2024-09-10T21:21:30.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.220+0000 7eff68498740 20 client.16884 trim_cache size 0 max 16384 2024-09-10T21:21:30.229 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:21:30.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.221+0000 7eff660c3640 1 -- 172.21.15.59:0/508807978 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7eff480b52e0 msgr2=0x7eff480b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:30.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.221+0000 7eff660c3640 1 --2- 172.21.15.59:0/508807978 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7eff480b52e0 0x7eff480b77a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7eff54005ec0 tx=0x7eff5404b000 comp rx=0 tx=0).stop 2024-09-10T21:21:30.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.221+0000 7eff660c3640 1 -- 172.21.15.59:0/508807978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff6010d100 msgr2=0x7eff6019eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:30.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.221+0000 7eff660c3640 1 --2- 172.21.15.59:0/508807978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff6010d100 0x7eff6019eba0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7eff5800c970 tx=0x7eff5800ce30 comp rx=0 tx=0).stop 2024-09-10T21:21:30.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.221+0000 7eff660c3640 1 -- 172.21.15.59:0/508807978 shutdown_connections 2024-09-10T21:21:30.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.221+0000 7eff660c3640 1 --2- 172.21.15.59:0/508807978 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7eff480b52e0 0x7eff480b77a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.221+0000 7eff660c3640 1 --2- 172.21.15.59:0/508807978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff6010d100 0x7eff6019eba0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.221+0000 7eff660c3640 1 --2- 172.21.15.59:0/508807978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7eff601045c0 0x7eff60199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.221+0000 7eff660c3640 1 --2- 172.21.15.59:0/508807978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7eff60103ca0 0x7eff601992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:30.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.221+0000 7eff660c3640 1 -- 172.21.15.59:0/508807978 >> 172.21.15.59:0/508807978 conn(0x7eff600fd700 msgr2=0x7eff600fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:30.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.221+0000 7eff660c3640 1 -- 172.21.15.59:0/508807978 shutdown_connections 2024-09-10T21:21:30.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:30.221+0000 7eff660c3640 1 -- 172.21.15.59:0/508807978 wait complete. 2024-09-10T21:21:30.882 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:21:31.141 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:21:31.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:31 smithi059 ceph-mon[30888]: pgmap v527: 97 pgs: 97 active+clean; 4.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:31.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:21:31.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:21:31.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:21:31.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:21:31.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:31 smithi192 ceph-mon[35363]: pgmap v527: 97 pgs: 97 active+clean; 4.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:31.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:21:31.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:21:31.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:21:31.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:21:31.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:31 smithi154 ceph-mon[35041]: pgmap v527: 97 pgs: 97 active+clean; 4.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:31.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:21:31.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:21:31.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:21:31.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:21:31.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.615+0000 7f177e7f8640 1 -- 172.21.15.59:0/3892168660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1778103ce0 msgr2=0x7f17781040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:31.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.615+0000 7f177e7f8640 1 --2- 172.21.15.59:0/3892168660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1778103ce0 0x7f17781040c0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f1768009900 tx=0x7f176802a410 comp rx=0 tx=0).stop 2024-09-10T21:21:31.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.615+0000 7f177e7f8640 1 -- 172.21.15.59:0/3892168660 shutdown_connections 2024-09-10T21:21:31.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.615+0000 7f177e7f8640 1 --2- 172.21.15.59:0/3892168660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f177810d140 0x7f177810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.615+0000 7f177e7f8640 1 --2- 172.21.15.59:0/3892168660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1778104600 0x7f177810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.615+0000 7f177e7f8640 1 --2- 172.21.15.59:0/3892168660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1778103ce0 0x7f17781040c0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.615+0000 7f177e7f8640 1 -- 172.21.15.59:0/3892168660 >> 172.21.15.59:0/3892168660 conn(0x7f17780fd700 msgr2=0x7f17780ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:31.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.615+0000 7f177e7f8640 1 -- 172.21.15.59:0/3892168660 shutdown_connections 2024-09-10T21:21:31.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.615+0000 7f177e7f8640 1 -- 172.21.15.59:0/3892168660 wait complete. 2024-09-10T21:21:31.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.615+0000 7f177e7f8640 1 Processor -- start 2024-09-10T21:21:31.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.615+0000 7f177e7f8640 1 -- start start 2024-09-10T21:21:31.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.616+0000 7f177e7f8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1778103ce0 0x7f1778199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:31.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.616+0000 7f177e7f8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1778104600 0x7f1778199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:31.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.616+0000 7f177e7f8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f177810d140 0x7f177819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:31.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.616+0000 7f177e7f8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1778112db0 con 0x7f177810d140 2024-09-10T21:21:31.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.616+0000 7f177e7f8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1778112c30 con 0x7f1778103ce0 2024-09-10T21:21:31.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.616+0000 7f177e7f8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1778112f30 con 0x7f1778104600 2024-09-10T21:21:31.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.616+0000 7f177cd95640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f177810d140 0x7f177819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:31.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.616+0000 7f177cd95640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f177810d140 0x7f177819ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54940/0 (socket says 172.21.15.59:54940) 2024-09-10T21:21:31.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.616+0000 7f177cd95640 1 -- 172.21.15.59:0/664532100 learned_addr learned my addr 172.21.15.59:0/664532100 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:31.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.616+0000 7f1777fff640 1 --2- 172.21.15.59:0/664532100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1778103ce0 0x7f1778199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:31.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.616+0000 7f17777fe640 1 --2- 172.21.15.59:0/664532100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1778104600 0x7f1778199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:31.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.616+0000 7f177cd95640 1 -- 172.21.15.59:0/664532100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1778104600 msgr2=0x7f1778199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:31.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.616+0000 7f177cd95640 1 --2- 172.21.15.59:0/664532100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1778104600 0x7f1778199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.616+0000 7f177cd95640 1 -- 172.21.15.59:0/664532100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1778103ce0 msgr2=0x7f1778199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:31.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.616+0000 7f177cd95640 1 --2- 172.21.15.59:0/664532100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1778103ce0 0x7f1778199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.616+0000 7f177cd95640 1 -- 172.21.15.59:0/664532100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177819f3b0 con 0x7f177810d140 2024-09-10T21:21:31.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.616+0000 7f17777fe640 1 --2- 172.21.15.59:0/664532100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1778104600 0x7f1778199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:21:31.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.616+0000 7f177cd95640 1 --2- 172.21.15.59:0/664532100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f177810d140 0x7f177819ebe0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f177000cad0 tx=0x7f177000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:31.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.616+0000 7f17757fa640 1 -- 172.21.15.59:0/664532100 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177000ae20 con 0x7f177810d140 2024-09-10T21:21:31.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.617+0000 7f177e7f8640 1 -- 172.21.15.59:0/664532100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f177819f6a0 con 0x7f177810d140 2024-09-10T21:21:31.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.617+0000 7f17757fa640 1 -- 172.21.15.59:0/664532100 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1770005020 con 0x7f177810d140 2024-09-10T21:21:31.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.617+0000 7f17757fa640 1 -- 172.21.15.59:0/664532100 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177000f6b0 con 0x7f177810d140 2024-09-10T21:21:31.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.617+0000 7f177e7f8640 1 -- 172.21.15.59:0/664532100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17781a5d60 con 0x7f177810d140 2024-09-10T21:21:31.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.619+0000 7f17757fa640 1 -- 172.21.15.59:0/664532100 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f17700054f0 con 0x7f177810d140 2024-09-10T21:21:31.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.619+0000 7f1780bcd740 1 Processor -- start 2024-09-10T21:21:31.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.620+0000 7f1780bcd740 1 -- start start 2024-09-10T21:21:31.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.620+0000 7f1780bcd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f24d0 0x562cba8f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:31.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.620+0000 7f1780bcd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f2df0 0x562cba902c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:31.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.620+0000 7f1780bcd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba905580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:31.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.620+0000 7f1780bcd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562cba868ea0 con 0x562cba903190 2024-09-10T21:21:31.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.620+0000 7f1780bcd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562cba8582d0 con 0x562cba8f2df0 2024-09-10T21:21:31.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.620+0000 7f1780bcd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562cba85c0e0 con 0x562cba8f24d0 2024-09-10T21:21:31.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.620+0000 7f17777fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba905580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:31.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.620+0000 7f17777fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba905580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54952/0 (socket says 172.21.15.59:54952) 2024-09-10T21:21:31.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.620+0000 7f17777fe640 1 -- 172.21.15.59:0/2676069136 learned_addr learned my addr 172.21.15.59:0/2676069136 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:31.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.620+0000 7f1777fff640 1 --2- 172.21.15.59:0/2676069136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f2df0 0x562cba902c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:31.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.620+0000 7f17777fe640 1 --2- 172.21.15.59:0/2676069136 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f24d0 0x562cba8f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.620+0000 7f17777fe640 1 -- 172.21.15.59:0/2676069136 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f24d0 msgr2=0x562cba8f28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.620+0000 7f17777fe640 1 --2- 172.21.15.59:0/2676069136 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f24d0 0x562cba8f28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.620+0000 7f17777fe640 1 -- 172.21.15.59:0/2676069136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f2df0 msgr2=0x562cba902c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.620+0000 7f17777fe640 1 --2- 172.21.15.59:0/2676069136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f2df0 0x562cba902c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.620+0000 7f17757fa640 1 --2- 172.21.15.59:0/664532100 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f17600b52e0 0x7f17600b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.620+0000 7f17777fe640 1 -- 172.21.15.59:0/2676069136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cba5b6650 con 0x562cba903190 2024-09-10T21:21:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.620+0000 7f1777fff640 1 --2- 172.21.15.59:0/2676069136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f2df0 0x562cba902c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:21:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.621+0000 7f177cd95640 1 --2- 172.21.15.59:0/664532100 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f17600b52e0 0x7f17600b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.621+0000 7f17777fe640 1 --2- 172.21.15.59:0/2676069136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba905580 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f176c013930 tx=0x7f176c00b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353e26303182956f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.621+0000 7f17757fa640 1 -- 172.21.15.59:0/664532100 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f17700e5c50 con 0x7f177810d140 2024-09-10T21:21:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.621+0000 7f175e7fc640 1 -- 172.21.15.59:0/2676069136 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c00e8f0 con 0x562cba903190 2024-09-10T21:21:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.621+0000 7f175e7fc640 1 -- 172.21.15.59:0/2676069136 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f176c0113e0 con 0x562cba903190 2024-09-10T21:21:31.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.621+0000 7f175e7fc640 1 -- 172.21.15.59:0/2676069136 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c010630 con 0x562cba903190 2024-09-10T21:21:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.622+0000 7f1780bcd740 1 -- 172.21.15.59:0/2676069136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 msgr2=0x562cba905580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.622+0000 7f1780bcd740 1 --2- 172.21.15.59:0/2676069136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba905580 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f176c013930 tx=0x7f176c00b540 comp rx=0 tx=0).stop 2024-09-10T21:21:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.622+0000 7f177cd95640 1 --2- 172.21.15.59:0/664532100 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f17600b52e0 0x7f17600b77a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f17700a9650 tx=0x7f17700798b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.622+0000 7f1780bcd740 1 -- 172.21.15.59:0/2676069136 shutdown_connections 2024-09-10T21:21:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.622+0000 7f1780bcd740 1 --2- 172.21.15.59:0/2676069136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba905580 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.622+0000 7f1780bcd740 1 --2- 172.21.15.59:0/2676069136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f2df0 0x562cba902c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.622+0000 7f1780bcd740 1 --2- 172.21.15.59:0/2676069136 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f24d0 0x562cba8f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.622+0000 7f1780bcd740 1 -- 172.21.15.59:0/2676069136 >> 172.21.15.59:0/2676069136 conn(0x562cba8f0300 msgr2=0x562cba8f14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.622+0000 7f1780bcd740 1 -- 172.21.15.59:0/2676069136 shutdown_connections 2024-09-10T21:21:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.622+0000 7f1780bcd740 1 -- 172.21.15.59:0/2676069136 wait complete. 2024-09-10T21:21:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.622+0000 7f1780bcd740 1 -- start start 2024-09-10T21:21:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.622+0000 7f1780bcd740 1 Processor -- start 2024-09-10T21:21:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f1780bcd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f24d0 0x562cba902b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:31.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f1780bcd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f2df0 0x562cba8fffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f1780bcd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba9006b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f1780bcd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562cba6b9700 con 0x562cba903190 2024-09-10T21:21:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f1780bcd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562cba7f3160 con 0x562cba8f24d0 2024-09-10T21:21:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f1780bcd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562cba905e40 con 0x562cba8f2df0 2024-09-10T21:21:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f1780bcd740 10 client.0 _ll_register_callbacks cb 0x562cba80c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:21:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f17777fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba9006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f17777fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba9006b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54960/0 (socket says 172.21.15.59:54960) 2024-09-10T21:21:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f17777fe640 1 -- 172.21.15.59:0/359512330 learned_addr learned my addr 172.21.15.59:0/359512330 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f17777fe640 1 --2- 172.21.15.59:0/359512330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f24d0 0x562cba902b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f1777fff640 1 --2- 172.21.15.59:0/359512330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f2df0 0x562cba8fffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f17777fe640 1 -- 172.21.15.59:0/359512330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f2df0 msgr2=0x562cba8fffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f17777fe640 1 --2- 172.21.15.59:0/359512330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f2df0 0x562cba8fffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f17777fe640 1 -- 172.21.15.59:0/359512330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f24d0 msgr2=0x562cba902b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f17777fe640 1 --2- 172.21.15.59:0/359512330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f24d0 0x562cba902b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f17777fe640 1 -- 172.21.15.59:0/359512330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cba820c90 con 0x562cba903190 2024-09-10T21:21:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f1777fff640 1 --2- 172.21.15.59:0/359512330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f2df0 0x562cba8fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:21:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f17777fe640 1 --2- 172.21.15.59:0/359512330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba9006b0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f176c001eb0 tx=0x7f176c015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe56ff0a09b1109 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f17577fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:21:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f17577fe640 1 -- 172.21.15.59:0/359512330 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c00bc00 con 0x562cba903190 2024-09-10T21:21:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f17577fe640 1 -- 172.21.15.59:0/359512330 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f176c00b2c0 con 0x562cba903190 2024-09-10T21:21:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.623+0000 7f1780bcd740 1 -- 172.21.15.59:0/359512330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f176c0113e0 con 0x562cba903190 2024-09-10T21:21:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.624+0000 7f17577fe640 1 -- 172.21.15.59:0/359512330 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f176c011590 con 0x562cba903190 2024-09-10T21:21:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.624+0000 7f1780bcd740 10 client.16896 fetch_fsmap learned FSMap version 28 2024-09-10T21:21:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.624+0000 7f1780bcd740 1 -- 172.21.15.59:0/359512330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562cba911860 con 0x562cba903190 2024-09-10T21:21:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.624+0000 7f17577fe640 1 -- 172.21.15.59:0/359512330 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f176c0113e0 con 0x562cba903190 2024-09-10T21:21:31.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.624+0000 7f17577fe640 1 -- 172.21.15.59:0/359512330 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f176c00f040 con 0x562cba903190 2024-09-10T21:21:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.624+0000 7f1780bcd740 10 client.16896 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:21:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.624+0000 7f1780bcd740 10 client.16896 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:21:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.624+0000 7f1780bcd740 20 client.16896 populate_metadata read hostname 'smithi059' 2024-09-10T21:21:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.624+0000 7f1780bcd740 1 --2- 172.21.15.59:0/359512330 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x562cba912bb0 0x562cba914fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.624+0000 7f1780bcd740 4 client.16896 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:21:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.624+0000 7f1780bcd740 1 -- 172.21.15.59:0/359512330 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cba86adf0 con 0x562cba912bb0 2024-09-10T21:21:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.624+0000 7f1777fff640 1 --2- 172.21.15.59:0/359512330 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x562cba912bb0 0x562cba914fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.625+0000 7f1777fff640 1 --2- 172.21.15.59:0/359512330 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x562cba912bb0 0x562cba914fa0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1600657c900c63b5 server_cookie=ece79ebd01325ec6 in_seq=0 out_seq=0 2024-09-10T21:21:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.625+0000 7f17577fe640 10 client.16896 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:21:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.625+0000 7f17577fe640 1 -- 172.21.15.59:0/359512330 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562cba86adf0 con 0x562cba912bb0 2024-09-10T21:21:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.625+0000 7f17577fe640 10 client.16896 handle_command_reply: tid=0 2024-09-10T21:21:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.625+0000 7f1780bcd740 1 client.16896 shutdown 2024-09-10T21:21:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.626+0000 7f1780bcd740 1 -- 172.21.15.59:0/359512330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 msgr2=0x562cba9006b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:31.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.626+0000 7f1780bcd740 1 --2- 172.21.15.59:0/359512330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba9006b0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f176c001eb0 tx=0x7f176c015040 comp rx=0 tx=0).stop 2024-09-10T21:21:31.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.626+0000 7f1780bcd740 1 -- 172.21.15.59:0/359512330 shutdown_connections 2024-09-10T21:21:31.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.626+0000 7f1780bcd740 1 --2- 172.21.15.59:0/359512330 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x562cba912bb0 0x562cba914fa0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.626+0000 7f1780bcd740 1 --2- 172.21.15.59:0/359512330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba9006b0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.626+0000 7f1780bcd740 1 --2- 172.21.15.59:0/359512330 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f2df0 0x562cba8fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.626+0000 7f17577fe640 0 client.16896 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:21:31.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.626+0000 7f1780bcd740 1 --2- 172.21.15.59:0/359512330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f24d0 0x562cba902b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.626+0000 7f1780bcd740 1 -- 172.21.15.59:0/359512330 >> 172.21.15.59:0/359512330 conn(0x562cba8f0300 msgr2=0x562cba8f5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:31.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.626+0000 7f1780bcd740 1 -- 172.21.15.59:0/359512330 shutdown_connections 2024-09-10T21:21:31.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.626+0000 7f1780bcd740 1 -- 172.21.15.59:0/359512330 wait complete. 2024-09-10T21:21:31.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.626+0000 7f1780bcd740 20 client.16896 trim_cache size 0 max 16384 2024-09-10T21:21:31.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.639+0000 7f1780bcd740 1 Processor -- start 2024-09-10T21:21:31.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.639+0000 7f1780bcd740 1 -- start start 2024-09-10T21:21:31.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.639+0000 7f1780bcd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f24d0 0x562cba8fdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:31.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.639+0000 7f1780bcd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f2df0 0x562cba8efc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:31.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.639+0000 7f1780bcd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba90f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:31.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.639+0000 7f1780bcd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f17781ac120 con 0x562cba903190 2024-09-10T21:21:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.639+0000 7f1780bcd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f17781adc60 con 0x562cba8f2df0 2024-09-10T21:21:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.639+0000 7f1780bcd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f17781ac7f0 con 0x562cba8f24d0 2024-09-10T21:21:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.640+0000 7f17777fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba90f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.640+0000 7f17777fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f24d0 0x562cba8fdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.640+0000 7f17777fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba90f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54968/0 (socket says 172.21.15.59:54968) 2024-09-10T21:21:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.640+0000 7f17777fe640 1 -- 172.21.15.59:0/830397340 learned_addr learned my addr 172.21.15.59:0/830397340 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.640+0000 7f1777fff640 1 --2- 172.21.15.59:0/830397340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f2df0 0x562cba8efc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.640+0000 7f17777fe640 1 -- 172.21.15.59:0/830397340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f24d0 msgr2=0x562cba8fdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.640+0000 7f17777fe640 1 --2- 172.21.15.59:0/830397340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f24d0 0x562cba8fdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.640+0000 7f17777fe640 1 -- 172.21.15.59:0/830397340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f2df0 msgr2=0x562cba8efc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.640+0000 7f17777fe640 1 --2- 172.21.15.59:0/830397340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f2df0 0x562cba8efc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.640+0000 7f17777fe640 1 -- 172.21.15.59:0/830397340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cba8eb990 con 0x562cba903190 2024-09-10T21:21:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.640+0000 7f1777fff640 1 --2- 172.21.15.59:0/830397340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f2df0 0x562cba8efc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:21:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.640+0000 7f17777fe640 1 --2- 172.21.15.59:0/830397340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba90f070 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f176c02a4a0 tx=0x7f176c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7180e340c38db076 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.640+0000 7f175dffb640 1 -- 172.21.15.59:0/830397340 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c039070 con 0x562cba903190 2024-09-10T21:21:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.640+0000 7f175dffb640 1 -- 172.21.15.59:0/830397340 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f176c00bb90 con 0x562cba903190 2024-09-10T21:21:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.640+0000 7f175dffb640 1 -- 172.21.15.59:0/830397340 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c011040 con 0x562cba903190 2024-09-10T21:21:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.641+0000 7f1780bcd740 1 -- 172.21.15.59:0/830397340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 msgr2=0x562cba90f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.641+0000 7f1780bcd740 1 --2- 172.21.15.59:0/830397340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba90f070 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f176c02a4a0 tx=0x7f176c011da0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.641+0000 7f1780bcd740 1 -- 172.21.15.59:0/830397340 shutdown_connections 2024-09-10T21:21:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.641+0000 7f1780bcd740 1 --2- 172.21.15.59:0/830397340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba90f070 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.641+0000 7f1780bcd740 1 --2- 172.21.15.59:0/830397340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f2df0 0x562cba8efc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.641+0000 7f1780bcd740 1 --2- 172.21.15.59:0/830397340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f24d0 0x562cba8fdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.641+0000 7f1780bcd740 1 -- 172.21.15.59:0/830397340 >> 172.21.15.59:0/830397340 conn(0x562cba8f0300 msgr2=0x562cba8f11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.641+0000 7f1780bcd740 1 -- 172.21.15.59:0/830397340 shutdown_connections 2024-09-10T21:21:31.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.641+0000 7f1780bcd740 1 -- 172.21.15.59:0/830397340 wait complete. 2024-09-10T21:21:31.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.641+0000 7f1780bcd740 1 -- start start 2024-09-10T21:21:31.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.642+0000 7f1780bcd740 1 Processor -- start 2024-09-10T21:21:31.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.642+0000 7f1780bcd740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f24d0 0x562cba90b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:31.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.642+0000 7f1780bcd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f2df0 0x562cba90bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:31.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.642+0000 7f1780bcd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba91a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:31.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.642+0000 7f1780bcd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f17781ad590 con 0x562cba903190 2024-09-10T21:21:31.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.642+0000 7f1780bcd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f17781acec0 con 0x562cba8f2df0 2024-09-10T21:21:31.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.642+0000 7f1780bcd740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f17781aa100 con 0x562cba8f24d0 2024-09-10T21:21:31.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.642+0000 7f1780bcd740 10 client.0 _ll_register_callbacks cb 0x7f1768005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:21:31.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.642+0000 7f17777fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba91a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:31.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.642+0000 7f17777fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba91a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54978/0 (socket says 172.21.15.59:54978) 2024-09-10T21:21:31.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.642+0000 7f17777fe640 1 -- 172.21.15.59:0/2280894015 learned_addr learned my addr 172.21.15.59:0/2280894015 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:31.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.642+0000 7f17777fe640 1 --2- 172.21.15.59:0/2280894015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f24d0 0x562cba90b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:31.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.642+0000 7f1777fff640 1 --2- 172.21.15.59:0/2280894015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f2df0 0x562cba90bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:31.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.643+0000 7f17777fe640 1 -- 172.21.15.59:0/2280894015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f24d0 msgr2=0x562cba90b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:31.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.643+0000 7f17777fe640 1 --2- 172.21.15.59:0/2280894015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f24d0 0x562cba90b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.643+0000 7f17777fe640 1 -- 172.21.15.59:0/2280894015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f2df0 msgr2=0x562cba90bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:31.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.643+0000 7f17777fe640 1 --2- 172.21.15.59:0/2280894015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f2df0 0x562cba90bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.643+0000 7f17777fe640 1 -- 172.21.15.59:0/2280894015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cba91aa20 con 0x562cba903190 2024-09-10T21:21:31.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.643+0000 7f17777fe640 1 --2- 172.21.15.59:0/2280894015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba91a1f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f176c02a640 tx=0x7f176c02d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a19c6dcbc6e951 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:31.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.643+0000 7f17577fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:21:31.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.643+0000 7f17577fe640 1 -- 172.21.15.59:0/2280894015 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176c039030 con 0x562cba903190 2024-09-10T21:21:31.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.643+0000 7f17577fe640 1 -- 172.21.15.59:0/2280894015 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f176c011040 con 0x562cba903190 2024-09-10T21:21:31.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.643+0000 7f1780bcd740 1 -- 172.21.15.59:0/2280894015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f176c00bb90 con 0x562cba903190 2024-09-10T21:21:31.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.643+0000 7f17577fe640 1 -- 172.21.15.59:0/2280894015 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f176c04c070 con 0x562cba903190 2024-09-10T21:21:31.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.643+0000 7f1780bcd740 10 client.16902 fetch_fsmap learned FSMap version 28 2024-09-10T21:21:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.643+0000 7f1780bcd740 1 -- 172.21.15.59:0/2280894015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562cba97f5c0 con 0x562cba903190 2024-09-10T21:21:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.643+0000 7f17577fe640 1 -- 172.21.15.59:0/2280894015 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f176c00bb90 con 0x562cba903190 2024-09-10T21:21:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.644+0000 7f17577fe640 1 -- 172.21.15.59:0/2280894015 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f176c043040 con 0x562cba903190 2024-09-10T21:21:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.644+0000 7f1780bcd740 10 client.16902 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:21:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.644+0000 7f1780bcd740 10 client.16902 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:21:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.644+0000 7f1780bcd740 20 client.16902 populate_metadata read hostname 'smithi059' 2024-09-10T21:21:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.644+0000 7f1780bcd740 1 --2- 172.21.15.59:0/2280894015 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x562cba97fb70 0x562cba981f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.644+0000 7f1780bcd740 4 client.16902 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:21:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.644+0000 7f1780bcd740 1 -- 172.21.15.59:0/2280894015 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562cba8668a0 con 0x562cba97fb70 2024-09-10T21:21:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.644+0000 7f1777fff640 1 --2- 172.21.15.59:0/2280894015 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x562cba97fb70 0x562cba981f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.644+0000 7f1777fff640 1 --2- 172.21.15.59:0/2280894015 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x562cba97fb70 0x562cba981f60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8aa40a6a04c2e2b server_cookie=116f7bf996aad628 in_seq=0 out_seq=0 2024-09-10T21:21:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.644+0000 7f17577fe640 10 client.16902 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:21:31.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.644+0000 7f17577fe640 1 -- 172.21.15.59:0/2280894015 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562cba8668a0 con 0x562cba97fb70 2024-09-10T21:21:31.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.644+0000 7f17577fe640 10 client.16902 handle_command_reply: tid=0 2024-09-10T21:21:31.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.644+0000 7f1780bcd740 1 client.16902 shutdown 2024-09-10T21:21:31.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.645+0000 7f1780bcd740 1 -- 172.21.15.59:0/2280894015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 msgr2=0x562cba91a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:31.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.645+0000 7f1780bcd740 1 --2- 172.21.15.59:0/2280894015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba91a1f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f176c02a640 tx=0x7f176c02d040 comp rx=0 tx=0).stop 2024-09-10T21:21:31.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.645+0000 7f1780bcd740 1 -- 172.21.15.59:0/2280894015 shutdown_connections 2024-09-10T21:21:31.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.645+0000 7f1780bcd740 1 --2- 172.21.15.59:0/2280894015 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x562cba97fb70 0x562cba981f60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.645+0000 7f1780bcd740 1 --2- 172.21.15.59:0/2280894015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562cba903190 0x562cba91a1f0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.645+0000 7f1780bcd740 1 --2- 172.21.15.59:0/2280894015 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562cba8f2df0 0x562cba90bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.645+0000 7f17577fe640 0 client.16902 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:21:31.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.645+0000 7f1780bcd740 1 --2- 172.21.15.59:0/2280894015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562cba8f24d0 0x562cba90b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.645+0000 7f1780bcd740 1 -- 172.21.15.59:0/2280894015 >> 172.21.15.59:0/2280894015 conn(0x562cba8f0300 msgr2=0x562cba8f0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:31.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.645+0000 7f1780bcd740 1 -- 172.21.15.59:0/2280894015 shutdown_connections 2024-09-10T21:21:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.645+0000 7f1780bcd740 1 -- 172.21.15.59:0/2280894015 wait complete. 2024-09-10T21:21:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.645+0000 7f1780bcd740 20 client.16902 trim_cache size 0 max 16384 2024-09-10T21:21:31.655 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:21:31.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.645+0000 7f177e7f8640 1 -- 172.21.15.59:0/664532100 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f17600b52e0 msgr2=0x7f17600b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.645+0000 7f177e7f8640 1 --2- 172.21.15.59:0/664532100 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f17600b52e0 0x7f17600b77a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f17700a9650 tx=0x7f17700798b0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.645+0000 7f177e7f8640 1 -- 172.21.15.59:0/664532100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f177810d140 msgr2=0x7f177819ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.645+0000 7f177e7f8640 1 --2- 172.21.15.59:0/664532100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f177810d140 0x7f177819ebe0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f177000cad0 tx=0x7f177000cf90 comp rx=0 tx=0).stop 2024-09-10T21:21:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.646+0000 7f177e7f8640 1 -- 172.21.15.59:0/664532100 shutdown_connections 2024-09-10T21:21:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.646+0000 7f177e7f8640 1 --2- 172.21.15.59:0/664532100 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f17600b52e0 0x7f17600b77a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.646+0000 7f177e7f8640 1 --2- 172.21.15.59:0/664532100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f177810d140 0x7f177819ebe0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.646+0000 7f177e7f8640 1 --2- 172.21.15.59:0/664532100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1778104600 0x7f1778199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.646+0000 7f177e7f8640 1 --2- 172.21.15.59:0/664532100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1778103ce0 0x7f1778199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.646+0000 7f177e7f8640 1 -- 172.21.15.59:0/664532100 >> 172.21.15.59:0/664532100 conn(0x7f17780fd700 msgr2=0x7f17780fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.646+0000 7f177e7f8640 1 -- 172.21.15.59:0/664532100 shutdown_connections 2024-09-10T21:21:31.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:31.646+0000 7f177e7f8640 1 -- 172.21.15.59:0/664532100 wait complete. 2024-09-10T21:21:32.376 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:21:32.633 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:21:33.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.124+0000 7f5fdefbb640 1 -- 172.21.15.59:0/1617085674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fd8101c90 msgr2=0x7f5fd8102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:33.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.124+0000 7f5fdefbb640 1 --2- 172.21.15.59:0/1617085674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fd8101c90 0x7f5fd8102070 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009900 tx=0x7f5fc802a410 comp rx=0 tx=0).stop 2024-09-10T21:21:33.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.124+0000 7f5fdefbb640 1 -- 172.21.15.59:0/1617085674 shutdown_connections 2024-09-10T21:21:33.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.124+0000 7f5fdefbb640 1 --2- 172.21.15.59:0/1617085674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fd8108020 0x7f5fd810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.124+0000 7f5fdefbb640 1 --2- 172.21.15.59:0/1617085674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fd81076a0 0x7f5fd8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.124+0000 7f5fdefbb640 1 --2- 172.21.15.59:0/1617085674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fd8101c90 0x7f5fd8102070 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.124+0000 7f5fdefbb640 1 -- 172.21.15.59:0/1617085674 >> 172.21.15.59:0/1617085674 conn(0x7f5fd80fd700 msgr2=0x7f5fd80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:33.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.124+0000 7f5fdefbb640 1 -- 172.21.15.59:0/1617085674 shutdown_connections 2024-09-10T21:21:33.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.124+0000 7f5fdefbb640 1 -- 172.21.15.59:0/1617085674 wait complete. 2024-09-10T21:21:33.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.125+0000 7f5fdefbb640 1 Processor -- start 2024-09-10T21:21:33.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.125+0000 7f5fdefbb640 1 -- start start 2024-09-10T21:21:33.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.125+0000 7f5fdefbb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fd8101c90 0x7f5fd819a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:33.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.125+0000 7f5fdefbb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fd81076a0 0x7f5fd819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:33.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.125+0000 7f5fdefbb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fd8108020 0x7f5fd819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:33.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.125+0000 7f5fdefbb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd8111ce0 con 0x7f5fd81076a0 2024-09-10T21:21:33.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.125+0000 7f5fdefbb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd8111b60 con 0x7f5fd8101c90 2024-09-10T21:21:33.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.125+0000 7f5fdefbb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd8111e60 con 0x7f5fd8108020 2024-09-10T21:21:33.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.125+0000 7f5fd7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fd81076a0 0x7f5fd819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:33.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.125+0000 7f5fd7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fd81076a0 0x7f5fd819a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55000/0 (socket says 172.21.15.59:55000) 2024-09-10T21:21:33.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.125+0000 7f5fd7fff640 1 -- 172.21.15.59:0/1974170062 learned_addr learned my addr 172.21.15.59:0/1974170062 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:33.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.125+0000 7f5fdd558640 1 --2- 172.21.15.59:0/1974170062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fd8108020 0x7f5fd819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:33.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.125+0000 7f5fdcd57640 1 --2- 172.21.15.59:0/1974170062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fd8101c90 0x7f5fd819a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:33.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.126+0000 7f5fd7fff640 1 -- 172.21.15.59:0/1974170062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fd8108020 msgr2=0x7f5fd819abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:33.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.126+0000 7f5fd7fff640 1 --2- 172.21.15.59:0/1974170062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fd8108020 0x7f5fd819abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.126+0000 7f5fd7fff640 1 -- 172.21.15.59:0/1974170062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fd8101c90 msgr2=0x7f5fd819a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:33.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.126+0000 7f5fd7fff640 1 --2- 172.21.15.59:0/1974170062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fd8101c90 0x7f5fd819a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.126+0000 7f5fd7fff640 1 -- 172.21.15.59:0/1974170062 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd81a5510 con 0x7f5fd81076a0 2024-09-10T21:21:33.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.126+0000 7f5fdd558640 1 --2- 172.21.15.59:0/1974170062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fd8108020 0x7f5fd819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:21:33.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.126+0000 7f5fd7fff640 1 --2- 172.21.15.59:0/1974170062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fd81076a0 0x7f5fd819a650 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00b4a0 tx=0x7f5fcc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:33.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.126+0000 7f5fd5ffb640 1 -- 172.21.15.59:0/1974170062 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc014070 con 0x7f5fd81076a0 2024-09-10T21:21:33.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.126+0000 7f5fd5ffb640 1 -- 172.21.15.59:0/1974170062 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fcc010ac0 con 0x7f5fd81076a0 2024-09-10T21:21:33.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.126+0000 7f5fd5ffb640 1 -- 172.21.15.59:0/1974170062 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc017c30 con 0x7f5fd81076a0 2024-09-10T21:21:33.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.126+0000 7f5fdefbb640 1 -- 172.21.15.59:0/1974170062 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd81a5800 con 0x7f5fd81076a0 2024-09-10T21:21:33.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.126+0000 7f5fdefbb640 1 -- 172.21.15.59:0/1974170062 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd81a5d70 con 0x7f5fd81076a0 2024-09-10T21:21:33.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.128+0000 7f5fd5ffb640 1 -- 172.21.15.59:0/1974170062 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f5fcc010610 con 0x7f5fd81076a0 2024-09-10T21:21:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.129+0000 7f5fe1390740 1 Processor -- start 2024-09-10T21:21:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.129+0000 7f5fe1390740 1 -- start start 2024-09-10T21:21:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.129+0000 7f5fe1390740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x56438251b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.129+0000 7f5fe1390740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438251bdf0 0x56438252bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.129+0000 7f5fe1390740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438252c190 0x56438252e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.129+0000 7f5fe1390740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564382491ea0 con 0x56438251b4d0 2024-09-10T21:21:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.129+0000 7f5fe1390740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5643824812d0 con 0x56438251bdf0 2024-09-10T21:21:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.129+0000 7f5fe1390740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5643824850e0 con 0x56438252c190 2024-09-10T21:21:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.129+0000 7f5fdd558640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x56438251b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.129+0000 7f5fdd558640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x56438251b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55006/0 (socket says 172.21.15.59:55006) 2024-09-10T21:21:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.129+0000 7f5fdd558640 1 -- 172.21.15.59:0/4189682219 learned_addr learned my addr 172.21.15.59:0/4189682219 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:33.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.129+0000 7f5fdcd57640 1 --2- 172.21.15.59:0/4189682219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438251bdf0 0x56438252bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:33.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.129+0000 7f5fd7fff640 1 --2- 172.21.15.59:0/4189682219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438252c190 0x56438252e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:33.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.129+0000 7f5fd5ffb640 1 --2- 172.21.15.59:0/1974170062 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5fc00b52e0 0x7f5fc00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:33.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.130+0000 7f5fdd558640 1 -- 172.21.15.59:0/4189682219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438252c190 msgr2=0x56438252e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:33.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.130+0000 7f5fdd558640 1 --2- 172.21.15.59:0/4189682219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438252c190 0x56438252e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.130+0000 7f5fdd558640 1 -- 172.21.15.59:0/4189682219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438251bdf0 msgr2=0x56438252bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:33.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.130+0000 7f5fdd558640 1 --2- 172.21.15.59:0/4189682219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438251bdf0 0x56438252bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.130+0000 7f5fdd558640 1 -- 172.21.15.59:0/4189682219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643821df650 con 0x56438251b4d0 2024-09-10T21:21:33.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.130+0000 7f5fdd558640 1 --2- 172.21.15.59:0/1974170062 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5fc00b52e0 0x7f5fc00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:33.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.130+0000 7f5fd5ffb640 1 -- 172.21.15.59:0/1974170062 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5fcc0e55a0 con 0x7f5fd81076a0 2024-09-10T21:21:33.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.130+0000 7f5fdd558640 1 --2- 172.21.15.59:0/4189682219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x56438251b8b0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5fd000e480 tx=0x7f5fd000e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30706b58076dc46c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:33.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.130+0000 7f5fbeffd640 1 -- 172.21.15.59:0/4189682219 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0012e60 con 0x56438251b4d0 2024-09-10T21:21:33.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.130+0000 7f5fbeffd640 1 -- 172.21.15.59:0/4189682219 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fd001ce30 con 0x56438251b4d0 2024-09-10T21:21:33.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.130+0000 7f5fbeffd640 1 -- 172.21.15.59:0/4189682219 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00245c0 con 0x56438251b4d0 2024-09-10T21:21:33.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.131+0000 7f5fe1390740 1 -- 172.21.15.59:0/4189682219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 msgr2=0x56438251b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:33.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.131+0000 7f5fe1390740 1 --2- 172.21.15.59:0/4189682219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x56438251b8b0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5fd000e480 tx=0x7f5fd000e940 comp rx=0 tx=0).stop 2024-09-10T21:21:33.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.131+0000 7f5fdd558640 1 --2- 172.21.15.59:0/1974170062 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5fc00b52e0 0x7f5fc00b77a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5fd001f000 tx=0x7f5fd0020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:33.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.131+0000 7f5fe1390740 1 -- 172.21.15.59:0/4189682219 shutdown_connections 2024-09-10T21:21:33.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.131+0000 7f5fe1390740 1 --2- 172.21.15.59:0/4189682219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438252c190 0x56438252e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.131+0000 7f5fe1390740 1 --2- 172.21.15.59:0/4189682219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438251bdf0 0x56438252bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.131+0000 7f5fe1390740 1 --2- 172.21.15.59:0/4189682219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x56438251b8b0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.131+0000 7f5fe1390740 1 -- 172.21.15.59:0/4189682219 >> 172.21.15.59:0/4189682219 conn(0x564382519300 msgr2=0x56438251a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:33.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.131+0000 7f5fe1390740 1 -- 172.21.15.59:0/4189682219 shutdown_connections 2024-09-10T21:21:33.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.131+0000 7f5fe1390740 1 -- 172.21.15.59:0/4189682219 wait complete. 2024-09-10T21:21:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.131+0000 7f5fe1390740 1 -- start start 2024-09-10T21:21:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.131+0000 7f5fe1390740 1 Processor -- start 2024-09-10T21:21:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.132+0000 7f5fe1390740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x56438252ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.132+0000 7f5fe1390740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438251bdf0 0x564382528ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.132+0000 7f5fe1390740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438252c190 0x564382529480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.132+0000 7f5fe1390740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5643822e2700 con 0x56438251b4d0 2024-09-10T21:21:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.132+0000 7f5fe1390740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56438241c160 con 0x56438252c190 2024-09-10T21:21:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.132+0000 7f5fe1390740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56438252ee40 con 0x56438251bdf0 2024-09-10T21:21:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.132+0000 7f5fe1390740 10 client.0 _ll_register_callbacks cb 0x5643824359e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:21:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.132+0000 7f5fdcd57640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x56438252ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.132+0000 7f5fdcd57640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x56438252ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55020/0 (socket says 172.21.15.59:55020) 2024-09-10T21:21:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.132+0000 7f5fdcd57640 1 -- 172.21.15.59:0/2013167537 learned_addr learned my addr 172.21.15.59:0/2013167537 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:33.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.132+0000 7f5fd7fff640 1 --2- 172.21.15.59:0/2013167537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438251bdf0 0x564382528ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.132+0000 7f5fdd558640 1 --2- 172.21.15.59:0/2013167537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438252c190 0x564382529480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.132+0000 7f5fdcd57640 1 -- 172.21.15.59:0/2013167537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438251bdf0 msgr2=0x564382528ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.132+0000 7f5fdcd57640 1 --2- 172.21.15.59:0/2013167537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438251bdf0 0x564382528ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.132+0000 7f5fdcd57640 1 -- 172.21.15.59:0/2013167537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438252c190 msgr2=0x564382529480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.132+0000 7f5fdcd57640 1 --2- 172.21.15.59:0/2013167537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438252c190 0x564382529480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.132+0000 7f5fdcd57640 1 -- 172.21.15.59:0/2013167537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564382449c90 con 0x56438251b4d0 2024-09-10T21:21:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.132+0000 7f5fd7fff640 1 --2- 172.21.15.59:0/2013167537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438251bdf0 0x564382528ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:21:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.133+0000 7f5fdcd57640 1 --2- 172.21.15.59:0/2013167537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x56438252ba50 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f5fc802a930 tx=0x7f5fc8031810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8456abc29b2cebb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.133+0000 7f5fb7fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:21:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.133+0000 7f5fb7fff640 1 -- 172.21.15.59:0/2013167537 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8035040 con 0x56438251b4d0 2024-09-10T21:21:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.133+0000 7f5fe1390740 1 -- 172.21.15.59:0/2013167537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fd001ce30 con 0x56438251b4d0 2024-09-10T21:21:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.133+0000 7f5fb7fff640 1 -- 172.21.15.59:0/2013167537 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5fc8004240 con 0x56438251b4d0 2024-09-10T21:21:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.133+0000 7f5fb7fff640 1 -- 172.21.15.59:0/2013167537 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5fc804c070 con 0x56438251b4d0 2024-09-10T21:21:33.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.133+0000 7f5fe1390740 10 client.16914 fetch_fsmap learned FSMap version 28 2024-09-10T21:21:33.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.133+0000 7f5fe1390740 1 -- 172.21.15.59:0/2013167537 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56438253a740 con 0x56438251b4d0 2024-09-10T21:21:33.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.133+0000 7f5fb7fff640 1 -- 172.21.15.59:0/2013167537 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fd001ce30 con 0x56438251b4d0 2024-09-10T21:21:33.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.133+0000 7f5fb7fff640 1 -- 172.21.15.59:0/2013167537 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5fc80455a0 con 0x56438251b4d0 2024-09-10T21:21:33.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.134+0000 7f5fe1390740 10 client.16914 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:21:33.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.134+0000 7f5fe1390740 10 client.16914 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:21:33.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.134+0000 7f5fe1390740 20 client.16914 populate_metadata read hostname 'smithi059' 2024-09-10T21:21:33.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.134+0000 7f5fe1390740 1 --2- 172.21.15.59:0/2013167537 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x56438253bc00 0x56438253e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:33.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.134+0000 7f5fe1390740 4 client.16914 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:21:33.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.134+0000 7f5fe1390740 1 -- 172.21.15.59:0/2013167537 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564382493df0 con 0x56438253bc00 2024-09-10T21:21:33.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.134+0000 7f5fd7fff640 1 --2- 172.21.15.59:0/2013167537 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x56438253bc00 0x56438253e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:33.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.134+0000 7f5fd7fff640 1 --2- 172.21.15.59:0/2013167537 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x56438253bc00 0x56438253e030 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2545c040f78b7f52 server_cookie=1d5d4873b90aad4e in_seq=0 out_seq=0 2024-09-10T21:21:33.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.134+0000 7f5fb7fff640 10 client.16914 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:21:33.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.135+0000 7f5fb7fff640 1 -- 172.21.15.59:0/2013167537 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564382493df0 con 0x56438253bc00 2024-09-10T21:21:33.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.135+0000 7f5fb7fff640 10 client.16914 handle_command_reply: tid=0 2024-09-10T21:21:33.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.135+0000 7f5fe1390740 1 client.16914 shutdown 2024-09-10T21:21:33.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.135+0000 7f5fe1390740 1 -- 172.21.15.59:0/2013167537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 msgr2=0x56438252ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:33.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.135+0000 7f5fe1390740 1 --2- 172.21.15.59:0/2013167537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x56438252ba50 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f5fc802a930 tx=0x7f5fc8031810 comp rx=0 tx=0).stop 2024-09-10T21:21:33.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.135+0000 7f5fe1390740 1 -- 172.21.15.59:0/2013167537 shutdown_connections 2024-09-10T21:21:33.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.135+0000 7f5fe1390740 1 --2- 172.21.15.59:0/2013167537 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x56438253bc00 0x56438253e030 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.135+0000 7f5fe1390740 1 --2- 172.21.15.59:0/2013167537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438252c190 0x564382529480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.135+0000 7f5fe1390740 1 --2- 172.21.15.59:0/2013167537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438251bdf0 0x564382528ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.135+0000 7f5fe1390740 1 --2- 172.21.15.59:0/2013167537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x56438252ba50 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.135+0000 7f5fb7fff640 0 client.16914 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:21:33.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.135+0000 7f5fe1390740 1 -- 172.21.15.59:0/2013167537 >> 172.21.15.59:0/2013167537 conn(0x564382519300 msgr2=0x564382518420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:33.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.136+0000 7f5fe1390740 1 -- 172.21.15.59:0/2013167537 shutdown_connections 2024-09-10T21:21:33.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.136+0000 7f5fe1390740 1 -- 172.21.15.59:0/2013167537 wait complete. 2024-09-10T21:21:33.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.136+0000 7f5fe1390740 20 client.16914 trim_cache size 0 max 16384 2024-09-10T21:21:33.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.149+0000 7f5fe1390740 1 Processor -- start 2024-09-10T21:21:33.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.149+0000 7f5fe1390740 1 -- start start 2024-09-10T21:21:33.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.149+0000 7f5fe1390740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x564382538070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:33.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.149+0000 7f5fe1390740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438251bdf0 0x564382527720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:33.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.149+0000 7f5fe1390740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438252c190 0x564382527c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:33.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.149+0000 7f5fe1390740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd81ac1a0 con 0x56438251b4d0 2024-09-10T21:21:33.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.149+0000 7f5fe1390740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd81adce0 con 0x56438252c190 2024-09-10T21:21:33.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.149+0000 7f5fe1390740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd81ac870 con 0x56438251bdf0 2024-09-10T21:21:33.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.149+0000 7f5fdcd57640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x564382538070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:33.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.149+0000 7f5fdcd57640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x564382538070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55022/0 (socket says 172.21.15.59:55022) 2024-09-10T21:21:33.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.149+0000 7f5fdcd57640 1 -- 172.21.15.59:0/1919495073 learned_addr learned my addr 172.21.15.59:0/1919495073 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:33.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.149+0000 7f5fd7fff640 1 --2- 172.21.15.59:0/1919495073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438251bdf0 0x564382527720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:33.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.149+0000 7f5fdd558640 1 --2- 172.21.15.59:0/1919495073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438252c190 0x564382527c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:33.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.149+0000 7f5fdcd57640 1 -- 172.21.15.59:0/1919495073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438251bdf0 msgr2=0x564382527720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:33.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.149+0000 7f5fdcd57640 1 --2- 172.21.15.59:0/1919495073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438251bdf0 0x564382527720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.150+0000 7f5fdcd57640 1 -- 172.21.15.59:0/1919495073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438252c190 msgr2=0x564382527c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:33.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.150+0000 7f5fdcd57640 1 --2- 172.21.15.59:0/1919495073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438252c190 0x564382527c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.150+0000 7f5fdcd57640 1 -- 172.21.15.59:0/1919495073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564382519130 con 0x56438251b4d0 2024-09-10T21:21:33.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.150+0000 7f5fdd558640 1 --2- 172.21.15.59:0/1919495073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438252c190 0x564382527c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:21:33.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.150+0000 7f5fd7fff640 1 --2- 172.21.15.59:0/1919495073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438251bdf0 0x564382527720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:21:33.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.150+0000 7f5fdcd57640 1 --2- 172.21.15.59:0/1919495073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x564382538070 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8045970 tx=0x7f5fc802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b088cdc388d94748 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:33.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.150+0000 7f5fbe7fc640 1 -- 172.21.15.59:0/1919495073 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8035040 con 0x56438251b4d0 2024-09-10T21:21:33.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.150+0000 7f5fbe7fc640 1 -- 172.21.15.59:0/1919495073 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fc8045680 con 0x56438251b4d0 2024-09-10T21:21:33.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.150+0000 7f5fbe7fc640 1 -- 172.21.15.59:0/1919495073 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc803c6a0 con 0x56438251b4d0 2024-09-10T21:21:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.150+0000 7f5fe1390740 1 -- 172.21.15.59:0/1919495073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 msgr2=0x564382538070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.150+0000 7f5fe1390740 1 --2- 172.21.15.59:0/1919495073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x564382538070 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8045970 tx=0x7f5fc802a410 comp rx=0 tx=0).stop 2024-09-10T21:21:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.151+0000 7f5fe1390740 1 -- 172.21.15.59:0/1919495073 shutdown_connections 2024-09-10T21:21:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.151+0000 7f5fe1390740 1 --2- 172.21.15.59:0/1919495073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438252c190 0x564382527c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.151+0000 7f5fe1390740 1 --2- 172.21.15.59:0/1919495073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438251bdf0 0x564382527720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.151+0000 7f5fe1390740 1 --2- 172.21.15.59:0/1919495073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x564382538070 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.151+0000 7f5fe1390740 1 -- 172.21.15.59:0/1919495073 >> 172.21.15.59:0/1919495073 conn(0x564382519300 msgr2=0x56438252cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:33.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.151+0000 7f5fe1390740 1 -- 172.21.15.59:0/1919495073 shutdown_connections 2024-09-10T21:21:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.151+0000 7f5fe1390740 1 -- 172.21.15.59:0/1919495073 wait complete. 2024-09-10T21:21:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.151+0000 7f5fe1390740 1 -- start start 2024-09-10T21:21:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.151+0000 7f5fe1390740 1 Processor -- start 2024-09-10T21:21:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.151+0000 7f5fe1390740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x5643825340d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.151+0000 7f5fe1390740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438251bdf0 0x564382534610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.151+0000 7f5fe1390740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438252c190 0x5643825310a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.151+0000 7f5fe1390740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd81ad610 con 0x56438251b4d0 2024-09-10T21:21:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.151+0000 7f5fe1390740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd81acf40 con 0x56438251bdf0 2024-09-10T21:21:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.152+0000 7f5fe1390740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd81aa180 con 0x56438252c190 2024-09-10T21:21:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.152+0000 7f5fe1390740 10 client.0 _ll_register_callbacks cb 0x7f5fc80314a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:21:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.152+0000 7f5fdcd57640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x5643825340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.152+0000 7f5fdcd57640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x5643825340d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55032/0 (socket says 172.21.15.59:55032) 2024-09-10T21:21:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.152+0000 7f5fdcd57640 1 -- 172.21.15.59:0/3285415063 learned_addr learned my addr 172.21.15.59:0/3285415063 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.152+0000 7f5fd7fff640 1 --2- 172.21.15.59:0/3285415063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438251bdf0 0x564382534610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.152+0000 7f5fdd558640 1 --2- 172.21.15.59:0/3285415063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438252c190 0x5643825310a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.152+0000 7f5fdcd57640 1 -- 172.21.15.59:0/3285415063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438252c190 msgr2=0x5643825310a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.152+0000 7f5fdcd57640 1 --2- 172.21.15.59:0/3285415063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438252c190 0x5643825310a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.152+0000 7f5fdcd57640 1 -- 172.21.15.59:0/3285415063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438251bdf0 msgr2=0x564382534610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.152+0000 7f5fdcd57640 1 --2- 172.21.15.59:0/3285415063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438251bdf0 0x564382534610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.152+0000 7f5fdcd57640 1 -- 172.21.15.59:0/3285415063 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564382534e40 con 0x56438251b4d0 2024-09-10T21:21:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.152+0000 7f5fd7fff640 1 --2- 172.21.15.59:0/3285415063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438251bdf0 0x564382534610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:21:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.152+0000 7f5fdd558640 1 --2- 172.21.15.59:0/3285415063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438252c190 0x5643825310a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:21:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.152+0000 7f5fdcd57640 1 --2- 172.21.15.59:0/3285415063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x5643825340d0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80059d0 tx=0x7f5fc8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57107fec9c79a9c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.152+0000 7f5fb7fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:21:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.152+0000 7f5fb7fff640 1 -- 172.21.15.59:0/3285415063 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc8035070 con 0x56438251b4d0 2024-09-10T21:21:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.152+0000 7f5fb7fff640 1 -- 172.21.15.59:0/3285415063 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5fc80037f0 con 0x56438251b4d0 2024-09-10T21:21:33.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.152+0000 7f5fe1390740 1 -- 172.21.15.59:0/3285415063 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fc8045680 con 0x56438251b4d0 2024-09-10T21:21:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.153+0000 7f5fb7fff640 1 -- 172.21.15.59:0/3285415063 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5fc80039f0 con 0x56438251b4d0 2024-09-10T21:21:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.153+0000 7f5fe1390740 10 client.16920 fetch_fsmap learned FSMap version 28 2024-09-10T21:21:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.153+0000 7f5fe1390740 1 -- 172.21.15.59:0/3285415063 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5643825a9030 con 0x56438251b4d0 2024-09-10T21:21:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.153+0000 7f5fb7fff640 1 -- 172.21.15.59:0/3285415063 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fc8045680 con 0x56438251b4d0 2024-09-10T21:21:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.153+0000 7f5fb7fff640 1 -- 172.21.15.59:0/3285415063 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5fc8059950 con 0x56438251b4d0 2024-09-10T21:21:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.153+0000 7f5fe1390740 10 client.16920 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:21:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.153+0000 7f5fe1390740 10 client.16920 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:21:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.153+0000 7f5fe1390740 20 client.16920 populate_metadata read hostname 'smithi059' 2024-09-10T21:21:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.153+0000 7f5fe1390740 1 --2- 172.21.15.59:0/3285415063 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5643825a9630 0x5643825aba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.153+0000 7f5fe1390740 4 client.16920 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:21:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.153+0000 7f5fe1390740 1 -- 172.21.15.59:0/3285415063 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56438248f8a0 con 0x5643825a9630 2024-09-10T21:21:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.153+0000 7f5fd7fff640 1 --2- 172.21.15.59:0/3285415063 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5643825a9630 0x5643825aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.154+0000 7f5fd7fff640 1 --2- 172.21.15.59:0/3285415063 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5643825a9630 0x5643825aba50 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a41c3129dd7b79 server_cookie=a2384a17b23224e1 in_seq=0 out_seq=0 2024-09-10T21:21:33.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.154+0000 7f5fb7fff640 10 client.16920 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:21:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.154+0000 7f5fb7fff640 1 -- 172.21.15.59:0/3285415063 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56438248f8a0 con 0x5643825a9630 2024-09-10T21:21:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.154+0000 7f5fb7fff640 10 client.16920 handle_command_reply: tid=0 2024-09-10T21:21:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.154+0000 7f5fe1390740 1 client.16920 shutdown 2024-09-10T21:21:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.154+0000 7f5fe1390740 1 -- 172.21.15.59:0/3285415063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 msgr2=0x5643825340d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.154+0000 7f5fe1390740 1 --2- 172.21.15.59:0/3285415063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x5643825340d0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80059d0 tx=0x7f5fc8004270 comp rx=0 tx=0).stop 2024-09-10T21:21:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.154+0000 7f5fe1390740 1 -- 172.21.15.59:0/3285415063 shutdown_connections 2024-09-10T21:21:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.154+0000 7f5fe1390740 1 --2- 172.21.15.59:0/3285415063 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5643825a9630 0x5643825aba50 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.154+0000 7f5fe1390740 1 --2- 172.21.15.59:0/3285415063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56438252c190 0x5643825310a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.154+0000 7f5fe1390740 1 --2- 172.21.15.59:0/3285415063 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56438251bdf0 0x564382534610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.154+0000 7f5fe1390740 1 --2- 172.21.15.59:0/3285415063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56438251b4d0 0x5643825340d0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.154+0000 7f5fe1390740 1 -- 172.21.15.59:0/3285415063 >> 172.21.15.59:0/3285415063 conn(0x564382519300 msgr2=0x5643825276e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.154+0000 7f5fb7fff640 0 client.16920 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:21:33.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.154+0000 7f5fe1390740 1 -- 172.21.15.59:0/3285415063 shutdown_connections 2024-09-10T21:21:33.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.154+0000 7f5fe1390740 1 -- 172.21.15.59:0/3285415063 wait complete. 2024-09-10T21:21:33.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.155+0000 7f5fe1390740 20 client.16920 trim_cache size 0 max 16384 2024-09-10T21:21:33.163 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:21:33.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.155+0000 7f5fdefbb640 1 -- 172.21.15.59:0/1974170062 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5fc00b52e0 msgr2=0x7f5fc00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.155+0000 7f5fdefbb640 1 --2- 172.21.15.59:0/1974170062 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5fc00b52e0 0x7f5fc00b77a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5fd001f000 tx=0x7f5fd0020000 comp rx=0 tx=0).stop 2024-09-10T21:21:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.155+0000 7f5fdefbb640 1 -- 172.21.15.59:0/1974170062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fd81076a0 msgr2=0x7f5fd819a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.155+0000 7f5fdefbb640 1 --2- 172.21.15.59:0/1974170062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fd81076a0 0x7f5fd819a650 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00b4a0 tx=0x7f5fcc00b960 comp rx=0 tx=0).stop 2024-09-10T21:21:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.155+0000 7f5fdefbb640 1 -- 172.21.15.59:0/1974170062 shutdown_connections 2024-09-10T21:21:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.155+0000 7f5fdefbb640 1 --2- 172.21.15.59:0/1974170062 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5fc00b52e0 0x7f5fc00b77a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.155+0000 7f5fdefbb640 1 --2- 172.21.15.59:0/1974170062 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5fd8108020 0x7f5fd819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.155+0000 7f5fdefbb640 1 --2- 172.21.15.59:0/1974170062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fd81076a0 0x7f5fd819a650 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.155+0000 7f5fdefbb640 1 --2- 172.21.15.59:0/1974170062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5fd8101c90 0x7f5fd819a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.155+0000 7f5fdefbb640 1 -- 172.21.15.59:0/1974170062 >> 172.21.15.59:0/1974170062 conn(0x7f5fd80fd700 msgr2=0x7f5fd80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.155+0000 7f5fdefbb640 1 -- 172.21.15.59:0/1974170062 shutdown_connections 2024-09-10T21:21:33.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:33.155+0000 7f5fdefbb640 1 -- 172.21.15.59:0/1974170062 wait complete. 2024-09-10T21:21:33.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:33 smithi192 ceph-mon[35363]: pgmap v528: 97 pgs: 97 active+clean; 4.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:21:33.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:33 smithi059 ceph-mon[30888]: pgmap v528: 97 pgs: 97 active+clean; 4.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:21:33.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:33 smithi154 ceph-mon[35041]: pgmap v528: 97 pgs: 97 active+clean; 4.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:21:33.867 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:21:34.129 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:21:34.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.649+0000 7fd4a17f0640 1 -- 172.21.15.59:0/2691503378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd49c109150 msgr2=0x7fd49c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:34.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.649+0000 7fd4a17f0640 1 --2- 172.21.15.59:0/2691503378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd49c109150 0x7fd49c10f950 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fd494009ca0 tx=0x7fd49402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.649+0000 7fd4a17f0640 1 -- 172.21.15.59:0/2691503378 shutdown_connections 2024-09-10T21:21:34.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.649+0000 7fd4a17f0640 1 --2- 172.21.15.59:0/2691503378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd49c109150 0x7fd49c10f950 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.649+0000 7fd4a17f0640 1 --2- 172.21.15.59:0/2691503378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd49c1087d0 0x7fd49c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.649+0000 7fd4a17f0640 1 --2- 172.21.15.59:0/2691503378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd49c102dc0 0x7fd49c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.649+0000 7fd4a17f0640 1 -- 172.21.15.59:0/2691503378 >> 172.21.15.59:0/2691503378 conn(0x7fd49c0fe830 msgr2=0x7fd49c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:34.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.649+0000 7fd4a17f0640 1 -- 172.21.15.59:0/2691503378 shutdown_connections 2024-09-10T21:21:34.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.649+0000 7fd4a17f0640 1 -- 172.21.15.59:0/2691503378 wait complete. 2024-09-10T21:21:34.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.650+0000 7fd4a17f0640 1 Processor -- start 2024-09-10T21:21:34.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.650+0000 7fd4a17f0640 1 -- start start 2024-09-10T21:21:34.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.650+0000 7fd4a17f0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd49c102dc0 0x7fd49c199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:34.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.650+0000 7fd4a17f0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd49c1087d0 0x7fd49c1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:34.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.650+0000 7fd4a17f0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd49c109150 0x7fd49c19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:34.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.650+0000 7fd4a17f0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd49c112dd0 con 0x7fd49c109150 2024-09-10T21:21:34.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.650+0000 7fd4a17f0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd49c112c50 con 0x7fd49c102dc0 2024-09-10T21:21:34.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.650+0000 7fd4a17f0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd49c112f50 con 0x7fd49c1087d0 2024-09-10T21:21:34.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.650+0000 7fd49b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd49c109150 0x7fd49c19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:34.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.650+0000 7fd49b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd49c109150 0x7fd49c19eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55042/0 (socket says 172.21.15.59:55042) 2024-09-10T21:21:34.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.650+0000 7fd49b7fe640 1 -- 172.21.15.59:0/3889204053 learned_addr learned my addr 172.21.15.59:0/3889204053 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:34.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.650+0000 7fd49affd640 1 --2- 172.21.15.59:0/3889204053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd49c102dc0 0x7fd49c199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:34.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.650+0000 7fd493fff640 1 --2- 172.21.15.59:0/3889204053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd49c1087d0 0x7fd49c1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:34.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.651+0000 7fd49b7fe640 1 -- 172.21.15.59:0/3889204053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd49c1087d0 msgr2=0x7fd49c1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:34.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.651+0000 7fd49b7fe640 1 --2- 172.21.15.59:0/3889204053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd49c1087d0 0x7fd49c1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.651+0000 7fd49b7fe640 1 -- 172.21.15.59:0/3889204053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd49c102dc0 msgr2=0x7fd49c199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:34.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.651+0000 7fd49b7fe640 1 --2- 172.21.15.59:0/3889204053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd49c102dc0 0x7fd49c199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.651+0000 7fd49b7fe640 1 -- 172.21.15.59:0/3889204053 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49c19f310 con 0x7fd49c109150 2024-09-10T21:21:34.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.651+0000 7fd49b7fe640 1 --2- 172.21.15.59:0/3889204053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd49c109150 0x7fd49c19eb40 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd494005cc0 tx=0x7fd49402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.651+0000 7fd498ff9640 1 -- 172.21.15.59:0/3889204053 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd494003bf0 con 0x7fd49c109150 2024-09-10T21:21:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.651+0000 7fd498ff9640 1 -- 172.21.15.59:0/3889204053 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd494003d90 con 0x7fd49c109150 2024-09-10T21:21:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.651+0000 7fd4a17f0640 1 -- 172.21.15.59:0/3889204053 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd49c19f5a0 con 0x7fd49c109150 2024-09-10T21:21:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.651+0000 7fd498ff9640 1 -- 172.21.15.59:0/3889204053 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49402fbc0 con 0x7fd49c109150 2024-09-10T21:21:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.651+0000 7fd4a17f0640 1 -- 172.21.15.59:0/3889204053 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd49c1a5cc0 con 0x7fd49c109150 2024-09-10T21:21:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.654+0000 7fd498ff9640 1 -- 172.21.15.59:0/3889204053 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd494004610 con 0x7fd49c109150 2024-09-10T21:21:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.654+0000 7fd4a3bc5740 1 Processor -- start 2024-09-10T21:21:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.654+0000 7fd4a3bc5740 1 -- start start 2024-09-10T21:21:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.654+0000 7fd4a3bc5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde1984d0 0x55cdde1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.654+0000 7fd4a3bc5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde198df0 0x55cdde1a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.654+0000 7fd4a3bc5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1a4d80 0x55cdde1a7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.654+0000 7fd4a3bc5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cdde10eea0 con 0x55cdde1984d0 2024-09-10T21:21:34.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.654+0000 7fd4a3bc5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cdde0fe2d0 con 0x55cdde198df0 2024-09-10T21:21:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.654+0000 7fd4a3bc5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cdde1020e0 con 0x55cdde1a4d80 2024-09-10T21:21:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.655+0000 7fd493fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde1984d0 0x55cdde1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.655+0000 7fd493fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde1984d0 0x55cdde1988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55054/0 (socket says 172.21.15.59:55054) 2024-09-10T21:21:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.655+0000 7fd493fff640 1 -- 172.21.15.59:0/1438835532 learned_addr learned my addr 172.21.15.59:0/1438835532 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.655+0000 7fd49affd640 1 --2- 172.21.15.59:0/1438835532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde198df0 0x55cdde1a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.655+0000 7fd493fff640 1 --2- 172.21.15.59:0/1438835532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1a4d80 0x55cdde1a7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.655+0000 7fd493fff640 1 -- 172.21.15.59:0/1438835532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1a4d80 msgr2=0x55cdde1a7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.655+0000 7fd493fff640 1 --2- 172.21.15.59:0/1438835532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1a4d80 0x55cdde1a7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.655+0000 7fd493fff640 1 -- 172.21.15.59:0/1438835532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde198df0 msgr2=0x55cdde1a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.655+0000 7fd493fff640 1 --2- 172.21.15.59:0/1438835532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde198df0 0x55cdde1a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.655+0000 7fd493fff640 1 -- 172.21.15.59:0/1438835532 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cddde5c650 con 0x55cdde1984d0 2024-09-10T21:21:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.655+0000 7fd498ff9640 1 --2- 172.21.15.59:0/3889204053 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd4880b5360 0x7fd4880b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.655+0000 7fd493fff640 1 --2- 172.21.15.59:0/1438835532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde1984d0 0x55cdde1988b0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fd4840134b0 tx=0x7fd48400a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ca317cbbc8bd3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:34.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.655+0000 7fd49affd640 1 --2- 172.21.15.59:0/3889204053 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd4880b5360 0x7fd4880b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:34.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.655+0000 7fd498ff9640 1 -- 172.21.15.59:0/3889204053 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd494106fe0 con 0x7fd49c109150 2024-09-10T21:21:34.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.655+0000 7fd4917fa640 1 -- 172.21.15.59:0/1438835532 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484019070 con 0x55cdde1984d0 2024-09-10T21:21:34.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.655+0000 7fd4917fa640 1 -- 172.21.15.59:0/1438835532 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4840054d0 con 0x55cdde1984d0 2024-09-10T21:21:34.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.655+0000 7fd4917fa640 1 -- 172.21.15.59:0/1438835532 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484004c40 con 0x55cdde1984d0 2024-09-10T21:21:34.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.656+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/1438835532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde1984d0 msgr2=0x55cdde1988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:34.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.656+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/1438835532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde1984d0 0x55cdde1988b0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fd4840134b0 tx=0x7fd48400a760 comp rx=0 tx=0).stop 2024-09-10T21:21:34.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.656+0000 7fd49affd640 1 --2- 172.21.15.59:0/3889204053 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd4880b5360 0x7fd4880b7820 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x55cdde1971e0 tx=0x7fd48c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:34.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.656+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/1438835532 shutdown_connections 2024-09-10T21:21:34.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.656+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/1438835532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1a4d80 0x55cdde1a7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.656+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/1438835532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde198df0 0x55cdde1a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.656+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/1438835532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde1984d0 0x55cdde1988b0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.656+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/1438835532 >> 172.21.15.59:0/1438835532 conn(0x55cdde196300 msgr2=0x55cdde1974a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:34.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.656+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/1438835532 shutdown_connections 2024-09-10T21:21:34.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.656+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/1438835532 wait complete. 2024-09-10T21:21:34.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.657+0000 7fd4a3bc5740 1 -- start start 2024-09-10T21:21:34.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.657+0000 7fd4a3bc5740 1 Processor -- start 2024-09-10T21:21:34.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.657+0000 7fd4a3bc5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde1984d0 0x55cdde1a4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:34.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.657+0000 7fd4a3bc5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde198df0 0x55cdde1a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:34.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.657+0000 7fd4a3bc5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1a4d80 0x55cdde1a2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:34.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.657+0000 7fd4a3bc5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cdddf5f700 con 0x55cdde198df0 2024-09-10T21:21:34.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.657+0000 7fd4a3bc5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cdde099160 con 0x55cdde1984d0 2024-09-10T21:21:34.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.657+0000 7fd4a3bc5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cdde1a7a00 con 0x55cdde1a4d80 2024-09-10T21:21:34.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.657+0000 7fd4a3bc5740 10 client.0 _ll_register_callbacks cb 0x55cdde0b29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:21:34.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.657+0000 7fd493fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde198df0 0x55cdde1a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:34.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.657+0000 7fd493fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde198df0 0x55cdde1a1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55070/0 (socket says 172.21.15.59:55070) 2024-09-10T21:21:34.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.657+0000 7fd493fff640 1 -- 172.21.15.59:0/448588096 learned_addr learned my addr 172.21.15.59:0/448588096 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:34.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.657+0000 7fd49affd640 1 --2- 172.21.15.59:0/448588096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde1984d0 0x55cdde1a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:34.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.657+0000 7fd49b7fe640 1 --2- 172.21.15.59:0/448588096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1a4d80 0x55cdde1a2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:34.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.658+0000 7fd493fff640 1 -- 172.21.15.59:0/448588096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1a4d80 msgr2=0x55cdde1a2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:34.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.658+0000 7fd493fff640 1 --2- 172.21.15.59:0/448588096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1a4d80 0x55cdde1a2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.658+0000 7fd493fff640 1 -- 172.21.15.59:0/448588096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde1984d0 msgr2=0x55cdde1a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:34.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.658+0000 7fd493fff640 1 --2- 172.21.15.59:0/448588096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde1984d0 0x55cdde1a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.658+0000 7fd493fff640 1 -- 172.21.15.59:0/448588096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdde0c6c90 con 0x55cdde198df0 2024-09-10T21:21:34.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.658+0000 7fd493fff640 1 --2- 172.21.15.59:0/448588096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde198df0 0x55cdde1a1b80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fd48400b010 tx=0x7fd4840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffc4ffc3bde6b7c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:34.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.658+0000 7fd4827fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:21:34.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.658+0000 7fd4827fc640 1 -- 172.21.15.59:0/448588096 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48402b060 con 0x55cdde198df0 2024-09-10T21:21:34.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.658+0000 7fd4827fc640 1 -- 172.21.15.59:0/448588096 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd484004bc0 con 0x55cdde198df0 2024-09-10T21:21:34.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.658+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/448588096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4840054d0 con 0x55cdde198df0 2024-09-10T21:21:34.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.658+0000 7fd4827fc640 1 -- 172.21.15.59:0/448588096 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd484019040 con 0x55cdde198df0 2024-09-10T21:21:34.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.658+0000 7fd4a3bc5740 10 client.16932 fetch_fsmap learned FSMap version 28 2024-09-10T21:21:34.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.658+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/448588096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cdde1b3410 con 0x55cdde198df0 2024-09-10T21:21:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.658+0000 7fd4827fc640 1 -- 172.21.15.59:0/448588096 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4840054d0 con 0x55cdde198df0 2024-09-10T21:21:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.659+0000 7fd4827fc640 1 -- 172.21.15.59:0/448588096 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd48401d530 con 0x55cdde198df0 2024-09-10T21:21:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.659+0000 7fd4a3bc5740 10 client.16932 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:21:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.659+0000 7fd4a3bc5740 10 client.16932 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:21:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.659+0000 7fd4a3bc5740 20 client.16932 populate_metadata read hostname 'smithi059' 2024-09-10T21:21:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.659+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/448588096 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55cdde1b4810 0x55cdde1b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.659+0000 7fd4a3bc5740 4 client.16932 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:21:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.659+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/448588096 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cdde110df0 con 0x55cdde1b4810 2024-09-10T21:21:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.659+0000 7fd49affd640 1 --2- 172.21.15.59:0/448588096 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55cdde1b4810 0x55cdde1b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.660+0000 7fd4827fc640 10 client.16932 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:21:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.660+0000 7fd49affd640 1 --2- 172.21.15.59:0/448588096 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55cdde1b4810 0x55cdde1b6c00 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a842255cfc401daa server_cookie=b616915e2eec28c9 in_seq=0 out_seq=0 2024-09-10T21:21:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.660+0000 7fd4827fc640 1 -- 172.21.15.59:0/448588096 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cdde110df0 con 0x55cdde1b4810 2024-09-10T21:21:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.660+0000 7fd4827fc640 10 client.16932 handle_command_reply: tid=0 2024-09-10T21:21:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.660+0000 7fd4a3bc5740 1 client.16932 shutdown 2024-09-10T21:21:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.661+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/448588096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde198df0 msgr2=0x55cdde1a1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.661+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/448588096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde198df0 0x55cdde1a1b80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fd48400b010 tx=0x7fd4840046c0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.661+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/448588096 shutdown_connections 2024-09-10T21:21:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.661+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/448588096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1a4d80 0x55cdde1a2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.661+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/448588096 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55cdde1b4810 0x55cdde1b6c00 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.661+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/448588096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde198df0 0x55cdde1a1b80 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.661+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/448588096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde1984d0 0x55cdde1a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.661+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/448588096 >> 172.21.15.59:0/448588096 conn(0x55cdde196300 msgr2=0x55cdde19bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.661+0000 7fd4827fc640 0 client.16932 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:21:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.661+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/448588096 shutdown_connections 2024-09-10T21:21:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.661+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/448588096 wait complete. 2024-09-10T21:21:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.661+0000 7fd4a3bc5740 20 client.16932 trim_cache size 0 max 16384 2024-09-10T21:21:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.677+0000 7fd4a3bc5740 1 Processor -- start 2024-09-10T21:21:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.677+0000 7fd4a3bc5740 1 -- start start 2024-09-10T21:21:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.677+0000 7fd4a3bc5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde1984d0 0x55cdde197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.677+0000 7fd4a3bc5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde198df0 0x55cdde1b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.677+0000 7fd4a3bc5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1a4d80 0x55cdde1a6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.677+0000 7fd4a3bc5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd49c1ae310 con 0x55cdde1984d0 2024-09-10T21:21:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.677+0000 7fd4a3bc5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd49c1afe50 con 0x55cdde198df0 2024-09-10T21:21:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.677+0000 7fd4a3bc5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd49c1ae9e0 con 0x55cdde1a4d80 2024-09-10T21:21:34.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.678+0000 7fd49affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde1984d0 0x55cdde197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:34.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.678+0000 7fd49affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde1984d0 0x55cdde197ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55074/0 (socket says 172.21.15.59:55074) 2024-09-10T21:21:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.678+0000 7fd49affd640 1 -- 172.21.15.59:0/2218157102 learned_addr learned my addr 172.21.15.59:0/2218157102 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.678+0000 7fd49b7fe640 1 --2- 172.21.15.59:0/2218157102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1a4d80 0x55cdde1a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.678+0000 7fd493fff640 1 --2- 172.21.15.59:0/2218157102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde198df0 0x55cdde1b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.678+0000 7fd49affd640 1 -- 172.21.15.59:0/2218157102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1a4d80 msgr2=0x55cdde1a6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.678+0000 7fd49affd640 1 --2- 172.21.15.59:0/2218157102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1a4d80 0x55cdde1a6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.678+0000 7fd49affd640 1 -- 172.21.15.59:0/2218157102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde198df0 msgr2=0x55cdde1b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.678+0000 7fd49affd640 1 --2- 172.21.15.59:0/2218157102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde198df0 0x55cdde1b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.678+0000 7fd49affd640 1 -- 172.21.15.59:0/2218157102 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdde196d80 con 0x55cdde1984d0 2024-09-10T21:21:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.678+0000 7fd493fff640 1 --2- 172.21.15.59:0/2218157102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde198df0 0x55cdde1b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:21:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.678+0000 7fd49affd640 1 --2- 172.21.15.59:0/2218157102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde1984d0 0x55cdde197ad0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0039c0 tx=0x7fd48c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf003cdef575922 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.678+0000 7fd490ff9640 1 -- 172.21.15.59:0/2218157102 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48c01ea00 con 0x55cdde1984d0 2024-09-10T21:21:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.678+0000 7fd490ff9640 1 -- 172.21.15.59:0/2218157102 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd48c0054d0 con 0x55cdde1984d0 2024-09-10T21:21:34.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.678+0000 7fd490ff9640 1 -- 172.21.15.59:0/2218157102 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd48c004ce0 con 0x55cdde1984d0 2024-09-10T21:21:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.679+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/2218157102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde1984d0 msgr2=0x55cdde197ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.679+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/2218157102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde1984d0 0x55cdde197ad0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd48c0039c0 tx=0x7fd48c004610 comp rx=0 tx=0).stop 2024-09-10T21:21:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.679+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/2218157102 shutdown_connections 2024-09-10T21:21:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.679+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/2218157102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1a4d80 0x55cdde1a6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.679+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/2218157102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde198df0 0x55cdde1b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.679+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/2218157102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde1984d0 0x55cdde197ad0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.679+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/2218157102 >> 172.21.15.59:0/2218157102 conn(0x55cdde196300 msgr2=0x55cdde1973c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.679+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/2218157102 shutdown_connections 2024-09-10T21:21:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.679+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/2218157102 wait complete. 2024-09-10T21:21:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.680+0000 7fd4a3bc5740 1 -- start start 2024-09-10T21:21:34.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.680+0000 7fd4a3bc5740 1 Processor -- start 2024-09-10T21:21:34.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.680+0000 7fd4a3bc5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1984d0 0x55cdde1ba0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:34.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.680+0000 7fd4a3bc5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde198df0 0x55cdde1b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:34.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.680+0000 7fd4a3bc5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde1a4d80 0x55cdde1b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:34.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.680+0000 7fd4a3bc5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd49c1af780 con 0x55cdde198df0 2024-09-10T21:21:34.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.680+0000 7fd4a3bc5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd49c1af0b0 con 0x55cdde1a4d80 2024-09-10T21:21:34.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.680+0000 7fd4a3bc5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd49c1ac2f0 con 0x55cdde1984d0 2024-09-10T21:21:34.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.680+0000 7fd493fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde198df0 0x55cdde1b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:34.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.680+0000 7fd4a3bc5740 10 client.0 _ll_register_callbacks cb 0x7fd48c00b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:21:34.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.680+0000 7fd493fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde198df0 0x55cdde1b55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55090/0 (socket says 172.21.15.59:55090) 2024-09-10T21:21:34.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.680+0000 7fd493fff640 1 -- 172.21.15.59:0/862926257 learned_addr learned my addr 172.21.15.59:0/862926257 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:34.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.680+0000 7fd49b7fe640 1 --2- 172.21.15.59:0/862926257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde1a4d80 0x55cdde1b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:34.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.680+0000 7fd49affd640 1 --2- 172.21.15.59:0/862926257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1984d0 0x55cdde1ba0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:34.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.680+0000 7fd493fff640 1 -- 172.21.15.59:0/862926257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1984d0 msgr2=0x55cdde1ba0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:34.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.681+0000 7fd493fff640 1 --2- 172.21.15.59:0/862926257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1984d0 0x55cdde1ba0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.681+0000 7fd493fff640 1 -- 172.21.15.59:0/862926257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde1a4d80 msgr2=0x55cdde1b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:34.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.681+0000 7fd493fff640 1 --2- 172.21.15.59:0/862926257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde1a4d80 0x55cdde1b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.681+0000 7fd493fff640 1 -- 172.21.15.59:0/862926257 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdde220370 con 0x55cdde198df0 2024-09-10T21:21:34.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.681+0000 7fd49affd640 1 --2- 172.21.15.59:0/862926257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1984d0 0x55cdde1ba0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:21:34.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.681+0000 7fd493fff640 1 --2- 172.21.15.59:0/862926257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde198df0 0x55cdde1b55c0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd4840058c0 tx=0x7fd484005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c642f90b94d03bae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:34.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.681+0000 7fd4827fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:21:34.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.681+0000 7fd4827fc640 1 -- 172.21.15.59:0/862926257 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd484036070 con 0x55cdde198df0 2024-09-10T21:21:34.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.681+0000 7fd4827fc640 1 -- 172.21.15.59:0/862926257 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd48401d3e0 con 0x55cdde198df0 2024-09-10T21:21:34.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.681+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/862926257 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd48c0054d0 con 0x55cdde198df0 2024-09-10T21:21:34.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.681+0000 7fd4827fc640 1 -- 172.21.15.59:0/862926257 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd48402b040 con 0x55cdde198df0 2024-09-10T21:21:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.681+0000 7fd4a3bc5740 10 client.16938 fetch_fsmap learned FSMap version 28 2024-09-10T21:21:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.681+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/862926257 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cdde2214c0 con 0x55cdde198df0 2024-09-10T21:21:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.681+0000 7fd4827fc640 1 -- 172.21.15.59:0/862926257 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd48c0054d0 con 0x55cdde198df0 2024-09-10T21:21:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.682+0000 7fd4827fc640 1 -- 172.21.15.59:0/862926257 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd4840116b0 con 0x55cdde198df0 2024-09-10T21:21:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.682+0000 7fd4a3bc5740 10 client.16938 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:21:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.682+0000 7fd4a3bc5740 10 client.16938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:21:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.682+0000 7fd4a3bc5740 20 client.16938 populate_metadata read hostname 'smithi059' 2024-09-10T21:21:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.682+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/862926257 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55cdde221c30 0x55cdde224050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.682+0000 7fd4a3bc5740 4 client.16938 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:21:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.682+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/862926257 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cdde10c8a0 con 0x55cdde221c30 2024-09-10T21:21:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.682+0000 7fd49affd640 1 --2- 172.21.15.59:0/862926257 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55cdde221c30 0x55cdde224050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.682+0000 7fd49affd640 1 --2- 172.21.15.59:0/862926257 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55cdde221c30 0x55cdde224050 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3554cfdad0e1e04f server_cookie=69cf21ad141cf7c9 in_seq=0 out_seq=0 2024-09-10T21:21:34.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.682+0000 7fd4827fc640 10 client.16938 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:21:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.682+0000 7fd4827fc640 1 -- 172.21.15.59:0/862926257 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cdde10c8a0 con 0x55cdde221c30 2024-09-10T21:21:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.682+0000 7fd4827fc640 10 client.16938 handle_command_reply: tid=0 2024-09-10T21:21:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.682+0000 7fd4a3bc5740 1 client.16938 shutdown 2024-09-10T21:21:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.683+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/862926257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde198df0 msgr2=0x55cdde1b55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.683+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/862926257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde198df0 0x55cdde1b55c0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd4840058c0 tx=0x7fd484005700 comp rx=0 tx=0).stop 2024-09-10T21:21:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.683+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/862926257 shutdown_connections 2024-09-10T21:21:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.683+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/862926257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cdde1a4d80 0x55cdde1b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.683+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/862926257 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55cdde221c30 0x55cdde224050 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.683+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/862926257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cdde198df0 0x55cdde1b55c0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.683+0000 7fd4a3bc5740 1 --2- 172.21.15.59:0/862926257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cdde1984d0 0x55cdde1ba0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.683+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/862926257 >> 172.21.15.59:0/862926257 conn(0x55cdde196300 msgr2=0x55cdde1a31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.683+0000 7fd4827fc640 0 client.16938 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:21:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.683+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/862926257 shutdown_connections 2024-09-10T21:21:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.683+0000 7fd4a3bc5740 1 -- 172.21.15.59:0/862926257 wait complete. 2024-09-10T21:21:34.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.683+0000 7fd4a3bc5740 20 client.16938 trim_cache size 0 max 16384 2024-09-10T21:21:34.692 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:21:34.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.683+0000 7fd4a17f0640 1 -- 172.21.15.59:0/3889204053 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd4880b5360 msgr2=0x7fd4880b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:34.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.683+0000 7fd4a17f0640 1 --2- 172.21.15.59:0/3889204053 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd4880b5360 0x7fd4880b7820 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x55cdde1971e0 tx=0x7fd48c00b390 comp rx=0 tx=0).stop 2024-09-10T21:21:34.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.683+0000 7fd4a17f0640 1 -- 172.21.15.59:0/3889204053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd49c109150 msgr2=0x7fd49c19eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:34.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.683+0000 7fd4a17f0640 1 --2- 172.21.15.59:0/3889204053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd49c109150 0x7fd49c19eb40 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd494005cc0 tx=0x7fd49402f380 comp rx=0 tx=0).stop 2024-09-10T21:21:34.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.683+0000 7fd4a17f0640 1 -- 172.21.15.59:0/3889204053 shutdown_connections 2024-09-10T21:21:34.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.683+0000 7fd4a17f0640 1 --2- 172.21.15.59:0/3889204053 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd4880b5360 0x7fd4880b7820 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.683+0000 7fd4a17f0640 1 --2- 172.21.15.59:0/3889204053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd49c109150 0x7fd49c19eb40 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.684+0000 7fd4a17f0640 1 --2- 172.21.15.59:0/3889204053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd49c1087d0 0x7fd49c1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.684+0000 7fd4a17f0640 1 --2- 172.21.15.59:0/3889204053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd49c102dc0 0x7fd49c199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:34.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.684+0000 7fd4a17f0640 1 -- 172.21.15.59:0/3889204053 >> 172.21.15.59:0/3889204053 conn(0x7fd49c0fe830 msgr2=0x7fd49c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:34.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.684+0000 7fd4a17f0640 1 -- 172.21.15.59:0/3889204053 shutdown_connections 2024-09-10T21:21:34.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:34.684+0000 7fd4a17f0640 1 -- 172.21.15.59:0/3889204053 wait complete. 2024-09-10T21:21:35.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:35 smithi192 ceph-mon[35363]: pgmap v529: 97 pgs: 97 active+clean; 4.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:35.373 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:35 smithi059 ceph-mon[30888]: pgmap v529: 97 pgs: 97 active+clean; 4.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:35.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:35 smithi154 ceph-mon[35041]: pgmap v529: 97 pgs: 97 active+clean; 4.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:36.405 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:21:36.405 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:21:36.677 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:21:37.085 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:37 smithi059 ceph-mon[30888]: pgmap v530: 97 pgs: 97 active+clean; 4.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:21:37.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.169+0000 7ff268b65640 1 -- 172.21.15.59:0/896372828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26410d100 msgr2=0x7ff26410f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:37.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.169+0000 7ff268b65640 1 --2- 172.21.15.59:0/896372828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26410d100 0x7ff26410f560 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7ff254009ca0 tx=0x7ff25402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.169+0000 7ff268b65640 1 -- 172.21.15.59:0/896372828 shutdown_connections 2024-09-10T21:21:37.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.169+0000 7ff268b65640 1 --2- 172.21.15.59:0/896372828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26410d100 0x7ff26410f560 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.169+0000 7ff268b65640 1 --2- 172.21.15.59:0/896372828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2641045c0 0x7ff26410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.169+0000 7ff268b65640 1 --2- 172.21.15.59:0/896372828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff264103ca0 0x7ff264104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.169+0000 7ff268b65640 1 -- 172.21.15.59:0/896372828 >> 172.21.15.59:0/896372828 conn(0x7ff2640fd700 msgr2=0x7ff2640ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:37.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.169+0000 7ff268b65640 1 -- 172.21.15.59:0/896372828 shutdown_connections 2024-09-10T21:21:37.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.169+0000 7ff268b65640 1 -- 172.21.15.59:0/896372828 wait complete. 2024-09-10T21:21:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.170+0000 7ff268b65640 1 Processor -- start 2024-09-10T21:21:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.170+0000 7ff268b65640 1 -- start start 2024-09-10T21:21:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.170+0000 7ff268b65640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff264103ca0 0x7ff264199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.170+0000 7ff268b65640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2641045c0 0x7ff264199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.170+0000 7ff268b65640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff26410d100 0x7ff26419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.170+0000 7ff268b65640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff264112d70 con 0x7ff264103ca0 2024-09-10T21:21:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.170+0000 7ff268b65640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff264112bf0 con 0x7ff26410d100 2024-09-10T21:21:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.170+0000 7ff268b65640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff264112ef0 con 0x7ff2641045c0 2024-09-10T21:21:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.170+0000 7ff26259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff264103ca0 0x7ff264199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.170+0000 7ff26259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff264103ca0 0x7ff264199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55100/0 (socket says 172.21.15.59:55100) 2024-09-10T21:21:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.170+0000 7ff26259c640 1 -- 172.21.15.59:0/3343708726 learned_addr learned my addr 172.21.15.59:0/3343708726 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.170+0000 7ff261d9b640 1 --2- 172.21.15.59:0/3343708726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2641045c0 0x7ff264199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:37.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.171+0000 7ff26259c640 1 -- 172.21.15.59:0/3343708726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2641045c0 msgr2=0x7ff264199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:37.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.171+0000 7ff262d9d640 1 --2- 172.21.15.59:0/3343708726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff26410d100 0x7ff26419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:37.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.171+0000 7ff26259c640 1 --2- 172.21.15.59:0/3343708726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2641045c0 0x7ff264199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.171+0000 7ff26259c640 1 -- 172.21.15.59:0/3343708726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff26410d100 msgr2=0x7ff26419eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:37.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.171+0000 7ff26259c640 1 --2- 172.21.15.59:0/3343708726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff26410d100 0x7ff26419eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.171+0000 7ff26259c640 1 -- 172.21.15.59:0/3343708726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26419f2f0 con 0x7ff264103ca0 2024-09-10T21:21:37.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.171+0000 7ff26259c640 1 --2- 172.21.15.59:0/3343708726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff264103ca0 0x7ff264199240 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00d950 tx=0x7ff25c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:37.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.171+0000 7ff25b7fe640 1 -- 172.21.15.59:0/3343708726 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c017070 con 0x7ff264103ca0 2024-09-10T21:21:37.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.171+0000 7ff25b7fe640 1 -- 172.21.15.59:0/3343708726 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff25c009c30 con 0x7ff264103ca0 2024-09-10T21:21:37.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.171+0000 7ff25b7fe640 1 -- 172.21.15.59:0/3343708726 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c00f620 con 0x7ff264103ca0 2024-09-10T21:21:37.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.171+0000 7ff268b65640 1 -- 172.21.15.59:0/3343708726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff26419f5e0 con 0x7ff264103ca0 2024-09-10T21:21:37.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.171+0000 7ff268b65640 1 -- 172.21.15.59:0/3343708726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2641a5e70 con 0x7ff264103ca0 2024-09-10T21:21:37.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.173+0000 7ff25b7fe640 1 -- 172.21.15.59:0/3343708726 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7ff25c010460 con 0x7ff264103ca0 2024-09-10T21:21:37.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.174+0000 7ff26af3a740 1 Processor -- start 2024-09-10T21:21:37.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.174+0000 7ff26af3a740 1 -- start start 2024-09-10T21:21:37.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.174+0000 7ff26af3a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba41099ee0 0x55ba4109a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:37.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.174+0000 7ff26af3a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba4109a800 0x55ba410a6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:37.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.174+0000 7ff26af3a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba410a6790 0x55ba410a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:37.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.174+0000 7ff26af3a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ba41010e60 con 0x55ba410a6790 2024-09-10T21:21:37.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.174+0000 7ff26af3a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ba41000290 con 0x55ba4109a800 2024-09-10T21:21:37.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.174+0000 7ff26af3a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ba410040a0 con 0x55ba41099ee0 2024-09-10T21:21:37.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.174+0000 7ff261d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba410a6790 0x55ba410a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:37.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.174+0000 7ff261d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba410a6790 0x55ba410a8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55104/0 (socket says 172.21.15.59:55104) 2024-09-10T21:21:37.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.174+0000 7ff25b7fe640 1 --2- 172.21.15.59:0/3343708726 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff2500b5360 0x7ff2500b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:37.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.174+0000 7ff261d9b640 1 -- 172.21.15.59:0/2281218290 learned_addr learned my addr 172.21.15.59:0/2281218290 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:37.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.175+0000 7ff262d9d640 1 --2- 172.21.15.59:0/2281218290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba41099ee0 0x55ba4109a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:37.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.175+0000 7ff26259c640 1 --2- 172.21.15.59:0/2281218290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba4109a800 0x55ba410a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:37.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.175+0000 7ff262d9d640 1 --2- 172.21.15.59:0/3343708726 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff2500b5360 0x7ff2500b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.175+0000 7ff261d9b640 1 -- 172.21.15.59:0/2281218290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba41099ee0 msgr2=0x55ba4109a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.175+0000 7ff261d9b640 1 --2- 172.21.15.59:0/2281218290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba41099ee0 0x55ba4109a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.175+0000 7ff261d9b640 1 -- 172.21.15.59:0/2281218290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba4109a800 msgr2=0x55ba410a6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.175+0000 7ff261d9b640 1 --2- 172.21.15.59:0/2281218290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba4109a800 0x55ba410a6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.175+0000 7ff261d9b640 1 -- 172.21.15.59:0/2281218290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba40d5e930 con 0x55ba410a6790 2024-09-10T21:21:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.175+0000 7ff262d9d640 1 --2- 172.21.15.59:0/2281218290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba41099ee0 0x55ba4109a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:21:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.175+0000 7ff25b7fe640 1 -- 172.21.15.59:0/3343708726 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff25c0e5820 con 0x7ff264103ca0 2024-09-10T21:21:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.175+0000 7ff261d9b640 1 --2- 172.21.15.59:0/2281218290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba410a6790 0x55ba410a8b80 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00bc90 tx=0x7ff24c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6b1b3725e3b3c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.175+0000 7ff262d9d640 1 --2- 172.21.15.59:0/3343708726 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff2500b5360 0x7ff2500b7820 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff254009a60 tx=0x7ff2540095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.175+0000 7ff258ff9640 1 -- 172.21.15.59:0/2281218290 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c004220 con 0x55ba410a6790 2024-09-10T21:21:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.175+0000 7ff258ff9640 1 -- 172.21.15.59:0/2281218290 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff24c00be40 con 0x55ba410a6790 2024-09-10T21:21:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.175+0000 7ff258ff9640 1 -- 172.21.15.59:0/2281218290 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c004cc0 con 0x55ba410a6790 2024-09-10T21:21:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.176+0000 7ff26af3a740 1 -- 172.21.15.59:0/2281218290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba410a6790 msgr2=0x55ba410a8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.176+0000 7ff26af3a740 1 --2- 172.21.15.59:0/2281218290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba410a6790 0x55ba410a8b80 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00bc90 tx=0x7ff24c0107a0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.176+0000 7ff26af3a740 1 -- 172.21.15.59:0/2281218290 shutdown_connections 2024-09-10T21:21:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.176+0000 7ff26af3a740 1 --2- 172.21.15.59:0/2281218290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba410a6790 0x55ba410a8b80 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.176+0000 7ff26af3a740 1 --2- 172.21.15.59:0/2281218290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba4109a800 0x55ba410a6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.176+0000 7ff26af3a740 1 --2- 172.21.15.59:0/2281218290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba41099ee0 0x55ba4109a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.176+0000 7ff26af3a740 1 -- 172.21.15.59:0/2281218290 >> 172.21.15.59:0/2281218290 conn(0x55ba41097d10 msgr2=0x55ba41098eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.176+0000 7ff26af3a740 1 -- 172.21.15.59:0/2281218290 shutdown_connections 2024-09-10T21:21:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.176+0000 7ff26af3a740 1 -- 172.21.15.59:0/2281218290 wait complete. 2024-09-10T21:21:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.176+0000 7ff26af3a740 1 -- start start 2024-09-10T21:21:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.177+0000 7ff26af3a740 1 Processor -- start 2024-09-10T21:21:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.177+0000 7ff26af3a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba41099ee0 0x55ba410a3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.177+0000 7ff26af3a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba4109a800 0x55ba410a3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.177+0000 7ff26af3a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba410a6790 0x55ba410a41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.177+0000 7ff26af3a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ba40e61890 con 0x55ba4109a800 2024-09-10T21:21:37.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.177+0000 7ff26af3a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ba40f9ad40 con 0x55ba41099ee0 2024-09-10T21:21:37.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.177+0000 7ff26af3a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ba410a9440 con 0x55ba410a6790 2024-09-10T21:21:37.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.177+0000 7ff26af3a740 10 client.0 _ll_register_callbacks cb 0x55ba40ffec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:21:37.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.177+0000 7ff261d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba4109a800 0x55ba410a3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:37.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.177+0000 7ff261d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba4109a800 0x55ba410a3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55106/0 (socket says 172.21.15.59:55106) 2024-09-10T21:21:37.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.177+0000 7ff261d9b640 1 -- 172.21.15.59:0/1457224242 learned_addr learned my addr 172.21.15.59:0/1457224242 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:37.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.177+0000 7ff26259c640 1 --2- 172.21.15.59:0/1457224242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba41099ee0 0x55ba410a3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:37.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.177+0000 7ff262d9d640 1 --2- 172.21.15.59:0/1457224242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba410a6790 0x55ba410a41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:37.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.177+0000 7ff261d9b640 1 -- 172.21.15.59:0/1457224242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba410a6790 msgr2=0x55ba410a41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:37.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.177+0000 7ff261d9b640 1 --2- 172.21.15.59:0/1457224242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba410a6790 0x55ba410a41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.177+0000 7ff261d9b640 1 -- 172.21.15.59:0/1457224242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba41099ee0 msgr2=0x55ba410a3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:37.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.177+0000 7ff261d9b640 1 --2- 172.21.15.59:0/1457224242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba41099ee0 0x55ba410a3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.177+0000 7ff261d9b640 1 -- 172.21.15.59:0/1457224242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba410b2850 con 0x55ba4109a800 2024-09-10T21:21:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.177+0000 7ff26259c640 1 --2- 172.21.15.59:0/1457224242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba41099ee0 0x55ba410a3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:21:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.178+0000 7ff261d9b640 1 --2- 172.21.15.59:0/1457224242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba4109a800 0x55ba410a3ca0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00b4f0 tx=0x7ff24c01c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e4c2a423bae9fc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.178+0000 7ff249ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:21:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.178+0000 7ff249ffb640 1 -- 172.21.15.59:0/1457224242 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c02b060 con 0x55ba4109a800 2024-09-10T21:21:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.178+0000 7ff249ffb640 1 -- 172.21.15.59:0/1457224242 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff24c01c9a0 con 0x55ba4109a800 2024-09-10T21:21:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.178+0000 7ff26af3a740 1 -- 172.21.15.59:0/1457224242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ba41012db0 con 0x55ba4109a800 2024-09-10T21:21:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.178+0000 7ff249ffb640 1 -- 172.21.15.59:0/1457224242 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff24c01cba0 con 0x55ba4109a800 2024-09-10T21:21:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.178+0000 7ff26af3a740 10 client.16950 fetch_fsmap learned FSMap version 28 2024-09-10T21:21:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.178+0000 7ff26af3a740 1 -- 172.21.15.59:0/1457224242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ba410b5200 con 0x55ba4109a800 2024-09-10T21:21:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.178+0000 7ff249ffb640 1 -- 172.21.15.59:0/1457224242 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ba41012db0 con 0x55ba4109a800 2024-09-10T21:21:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.178+0000 7ff249ffb640 1 -- 172.21.15.59:0/1457224242 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff24c0049c0 con 0x55ba4109a800 2024-09-10T21:21:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.178+0000 7ff26af3a740 10 client.16950 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:21:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.178+0000 7ff26af3a740 10 client.16950 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:21:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.178+0000 7ff26af3a740 20 client.16950 populate_metadata read hostname 'smithi059' 2024-09-10T21:21:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.179+0000 7ff26af3a740 1 --2- 172.21.15.59:0/1457224242 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55ba410b65b0 0x55ba410b89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.179+0000 7ff26af3a740 4 client.16950 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:21:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.179+0000 7ff26af3a740 1 -- 172.21.15.59:0/1457224242 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba4100e860 con 0x55ba410b65b0 2024-09-10T21:21:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.179+0000 7ff26259c640 1 --2- 172.21.15.59:0/1457224242 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55ba410b65b0 0x55ba410b89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.179+0000 7ff26259c640 1 --2- 172.21.15.59:0/1457224242 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55ba410b65b0 0x55ba410b89a0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6f7430ecacd8cbd server_cookie=553a327e6aaab216 in_seq=0 out_seq=0 2024-09-10T21:21:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.179+0000 7ff249ffb640 10 client.16950 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:21:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.180+0000 7ff249ffb640 1 -- 172.21.15.59:0/1457224242 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ba4100e860 con 0x55ba410b65b0 2024-09-10T21:21:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.180+0000 7ff249ffb640 10 client.16950 handle_command_reply: tid=0 2024-09-10T21:21:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.180+0000 7ff26af3a740 1 client.16950 shutdown 2024-09-10T21:21:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.180+0000 7ff26af3a740 1 -- 172.21.15.59:0/1457224242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba4109a800 msgr2=0x55ba410a3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.180+0000 7ff26af3a740 1 --2- 172.21.15.59:0/1457224242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba4109a800 0x55ba410a3ca0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00b4f0 tx=0x7ff24c01c670 comp rx=0 tx=0).stop 2024-09-10T21:21:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.180+0000 7ff26af3a740 1 -- 172.21.15.59:0/1457224242 shutdown_connections 2024-09-10T21:21:37.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.180+0000 7ff26af3a740 1 --2- 172.21.15.59:0/1457224242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba410a6790 0x55ba410a41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.180+0000 7ff26af3a740 1 --2- 172.21.15.59:0/1457224242 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55ba410b65b0 0x55ba410b89a0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.180+0000 7ff249ffb640 0 client.16950 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:21:37.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.180+0000 7ff26af3a740 1 --2- 172.21.15.59:0/1457224242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba4109a800 0x55ba410a3ca0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.180+0000 7ff26af3a740 1 --2- 172.21.15.59:0/1457224242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba41099ee0 0x55ba410a3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.180+0000 7ff26af3a740 1 -- 172.21.15.59:0/1457224242 >> 172.21.15.59:0/1457224242 conn(0x55ba41097d10 msgr2=0x55ba41096f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:37.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.180+0000 7ff26af3a740 1 -- 172.21.15.59:0/1457224242 shutdown_connections 2024-09-10T21:21:37.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.180+0000 7ff26af3a740 1 -- 172.21.15.59:0/1457224242 wait complete. 2024-09-10T21:21:37.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.180+0000 7ff26af3a740 20 client.16950 trim_cache size 0 max 16384 2024-09-10T21:21:37.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.198+0000 7ff26af3a740 1 Processor -- start 2024-09-10T21:21:37.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.198+0000 7ff26af3a740 1 -- start start 2024-09-10T21:21:37.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.198+0000 7ff26af3a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba41099ee0 0x55ba410a11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:37.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.198+0000 7ff26af3a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba4109a800 0x55ba41099310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:37.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.198+0000 7ff26af3a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba410a6790 0x55ba410bdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:37.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.198+0000 7ff26af3a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff2641ae290 con 0x55ba410a6790 2024-09-10T21:21:37.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.198+0000 7ff26af3a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff2641afdd0 con 0x55ba41099ee0 2024-09-10T21:21:37.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.198+0000 7ff26af3a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff2641ae960 con 0x55ba4109a800 2024-09-10T21:21:37.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.198+0000 7ff262d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba410a6790 0x55ba410bdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:37.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.198+0000 7ff262d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba410a6790 0x55ba410bdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55118/0 (socket says 172.21.15.59:55118) 2024-09-10T21:21:37.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.198+0000 7ff262d9d640 1 -- 172.21.15.59:0/710322850 learned_addr learned my addr 172.21.15.59:0/710322850 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:37.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.199+0000 7ff26259c640 1 --2- 172.21.15.59:0/710322850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba41099ee0 0x55ba410a11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:37.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.199+0000 7ff261d9b640 1 --2- 172.21.15.59:0/710322850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba4109a800 0x55ba41099310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:37.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.199+0000 7ff262d9d640 1 -- 172.21.15.59:0/710322850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba4109a800 msgr2=0x55ba41099310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:37.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.199+0000 7ff262d9d640 1 --2- 172.21.15.59:0/710322850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba4109a800 0x55ba41099310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.199+0000 7ff262d9d640 1 -- 172.21.15.59:0/710322850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba41099ee0 msgr2=0x55ba410a11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:37.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.199+0000 7ff262d9d640 1 --2- 172.21.15.59:0/710322850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba41099ee0 0x55ba410a11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.199+0000 7ff262d9d640 1 -- 172.21.15.59:0/710322850 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba41097b40 con 0x55ba410a6790 2024-09-10T21:21:37.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.199+0000 7ff26259c640 1 --2- 172.21.15.59:0/710322850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba41099ee0 0x55ba410a11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:21:37.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.199+0000 7ff261d9b640 1 --2- 172.21.15.59:0/710322850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba4109a800 0x55ba41099310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:21:37.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.199+0000 7ff262d9d640 1 --2- 172.21.15.59:0/710322850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba410a6790 0x55ba410bdf70 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ff254009ca0 tx=0x7ff25403b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b908a952eb2935fb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:37.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.199+0000 7ff24bfff640 1 -- 172.21.15.59:0/710322850 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff254043070 con 0x55ba410a6790 2024-09-10T21:21:37.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.199+0000 7ff24bfff640 1 -- 172.21.15.59:0/710322850 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff254036040 con 0x55ba410a6790 2024-09-10T21:21:37.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.199+0000 7ff24bfff640 1 -- 172.21.15.59:0/710322850 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25402f950 con 0x55ba410a6790 2024-09-10T21:21:37.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.200+0000 7ff26af3a740 1 -- 172.21.15.59:0/710322850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba410a6790 msgr2=0x55ba410bdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:37.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.200+0000 7ff26af3a740 1 --2- 172.21.15.59:0/710322850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba410a6790 0x55ba410bdf70 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ff254009ca0 tx=0x7ff25403b000 comp rx=0 tx=0).stop 2024-09-10T21:21:37.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.200+0000 7ff26af3a740 1 -- 172.21.15.59:0/710322850 shutdown_connections 2024-09-10T21:21:37.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.200+0000 7ff26af3a740 1 --2- 172.21.15.59:0/710322850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba410a6790 0x55ba410bdf70 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.200+0000 7ff26af3a740 1 --2- 172.21.15.59:0/710322850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba4109a800 0x55ba41099310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.200+0000 7ff26af3a740 1 --2- 172.21.15.59:0/710322850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba41099ee0 0x55ba410a11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.200+0000 7ff26af3a740 1 -- 172.21.15.59:0/710322850 >> 172.21.15.59:0/710322850 conn(0x55ba41097d10 msgr2=0x55ba41098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:37.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.200+0000 7ff26af3a740 1 -- 172.21.15.59:0/710322850 shutdown_connections 2024-09-10T21:21:37.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.200+0000 7ff26af3a740 1 -- 172.21.15.59:0/710322850 wait complete. 2024-09-10T21:21:37.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.200+0000 7ff26af3a740 1 -- start start 2024-09-10T21:21:37.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.200+0000 7ff26af3a740 1 Processor -- start 2024-09-10T21:21:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.200+0000 7ff26af3a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba41099ee0 0x55ba410aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.200+0000 7ff26af3a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba4109a800 0x55ba410a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.200+0000 7ff26af3a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba410a6790 0x55ba410a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.200+0000 7ff26af3a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff2641af700 con 0x55ba4109a800 2024-09-10T21:21:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.200+0000 7ff26af3a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff2641af030 con 0x55ba410a6790 2024-09-10T21:21:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.200+0000 7ff26af3a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff2641ac270 con 0x55ba41099ee0 2024-09-10T21:21:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.200+0000 7ff26af3a740 10 client.0 _ll_register_callbacks cb 0x7ff24c00bab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:21:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.201+0000 7ff261d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba4109a800 0x55ba410a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.201+0000 7ff261d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba4109a800 0x55ba410a96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55132/0 (socket says 172.21.15.59:55132) 2024-09-10T21:21:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.201+0000 7ff261d9b640 1 -- 172.21.15.59:0/292694206 learned_addr learned my addr 172.21.15.59:0/292694206 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.201+0000 7ff26259c640 1 --2- 172.21.15.59:0/292694206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba41099ee0 0x55ba410aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:37.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.201+0000 7ff262d9d640 1 --2- 172.21.15.59:0/292694206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba410a6790 0x55ba410a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.201+0000 7ff261d9b640 1 -- 172.21.15.59:0/292694206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba41099ee0 msgr2=0x55ba410aebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.201+0000 7ff261d9b640 1 --2- 172.21.15.59:0/292694206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba41099ee0 0x55ba410aebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.201+0000 7ff261d9b640 1 -- 172.21.15.59:0/292694206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba410a6790 msgr2=0x55ba410a9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.201+0000 7ff261d9b640 1 --2- 172.21.15.59:0/292694206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba410a6790 0x55ba410a9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.201+0000 7ff261d9b640 1 -- 172.21.15.59:0/292694206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba41098790 con 0x55ba4109a800 2024-09-10T21:21:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.201+0000 7ff262d9d640 1 --2- 172.21.15.59:0/292694206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba410a6790 0x55ba410a9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:21:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.201+0000 7ff261d9b640 1 --2- 172.21.15.59:0/292694206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba4109a800 0x55ba410a96c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7ff24c004f80 tx=0x7ff24c0056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5023805054eda192 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.201+0000 7ff249ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:21:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.201+0000 7ff249ffb640 1 -- 172.21.15.59:0/292694206 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c036030 con 0x55ba4109a800 2024-09-10T21:21:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.201+0000 7ff249ffb640 1 -- 172.21.15.59:0/292694206 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff24c022040 con 0x55ba4109a800 2024-09-10T21:21:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.201+0000 7ff26af3a740 1 -- 172.21.15.59:0/292694206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff254036040 con 0x55ba4109a800 2024-09-10T21:21:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.201+0000 7ff249ffb640 1 -- 172.21.15.59:0/292694206 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff24c02b070 con 0x55ba4109a800 2024-09-10T21:21:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.201+0000 7ff26af3a740 10 client.16956 fetch_fsmap learned FSMap version 28 2024-09-10T21:21:37.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.201+0000 7ff26af3a740 1 -- 172.21.15.59:0/292694206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ba41123d00 con 0x55ba4109a800 2024-09-10T21:21:37.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.202+0000 7ff249ffb640 1 -- 172.21.15.59:0/292694206 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff254036040 con 0x55ba4109a800 2024-09-10T21:21:37.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.202+0000 7ff249ffb640 1 -- 172.21.15.59:0/292694206 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff24c0044f0 con 0x55ba4109a800 2024-09-10T21:21:37.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.202+0000 7ff26af3a740 10 client.16956 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:21:37.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.202+0000 7ff26af3a740 10 client.16956 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:21:37.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.202+0000 7ff26af3a740 20 client.16956 populate_metadata read hostname 'smithi059' 2024-09-10T21:21:37.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.202+0000 7ff26af3a740 1 --2- 172.21.15.59:0/292694206 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55ba41124520 0x55ba41126940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:37.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.202+0000 7ff26af3a740 4 client.16956 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:21:37.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.202+0000 7ff26af3a740 1 -- 172.21.15.59:0/292694206 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ba4100bc90 con 0x55ba41124520 2024-09-10T21:21:37.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.202+0000 7ff26259c640 1 --2- 172.21.15.59:0/292694206 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55ba41124520 0x55ba41126940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:37.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.203+0000 7ff26259c640 1 --2- 172.21.15.59:0/292694206 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55ba41124520 0x55ba41126940 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f555e4a25ed70c43 server_cookie=dba80605f9aa4189 in_seq=0 out_seq=0 2024-09-10T21:21:37.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.203+0000 7ff249ffb640 10 client.16956 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:21:37.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.205+0000 7ff249ffb640 1 -- 172.21.15.59:0/292694206 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ba4100bc90 con 0x55ba41124520 2024-09-10T21:21:37.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.205+0000 7ff249ffb640 10 client.16956 handle_command_reply: tid=0 2024-09-10T21:21:37.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.205+0000 7ff26af3a740 1 client.16956 shutdown 2024-09-10T21:21:37.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.205+0000 7ff26af3a740 1 -- 172.21.15.59:0/292694206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba4109a800 msgr2=0x55ba410a96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:37.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.205+0000 7ff26af3a740 1 --2- 172.21.15.59:0/292694206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba4109a800 0x55ba410a96c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7ff24c004f80 tx=0x7ff24c0056b0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.205+0000 7ff26af3a740 1 -- 172.21.15.59:0/292694206 shutdown_connections 2024-09-10T21:21:37.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.205+0000 7ff26af3a740 1 --2- 172.21.15.59:0/292694206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ba410a6790 0x55ba410a9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.205+0000 7ff26af3a740 1 --2- 172.21.15.59:0/292694206 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55ba41124520 0x55ba41126940 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.205+0000 7ff26af3a740 1 --2- 172.21.15.59:0/292694206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba4109a800 0x55ba410a96c0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.205+0000 7ff26af3a740 1 --2- 172.21.15.59:0/292694206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ba41099ee0 0x55ba410aebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.205+0000 7ff249ffb640 0 client.16956 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:21:37.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.205+0000 7ff26af3a740 1 -- 172.21.15.59:0/292694206 >> 172.21.15.59:0/292694206 conn(0x55ba41097d10 msgr2=0x55ba410b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:37.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.205+0000 7ff26af3a740 1 -- 172.21.15.59:0/292694206 shutdown_connections 2024-09-10T21:21:37.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.205+0000 7ff26af3a740 1 -- 172.21.15.59:0/292694206 wait complete. 2024-09-10T21:21:37.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.205+0000 7ff26af3a740 20 client.16956 trim_cache size 0 max 16384 2024-09-10T21:21:37.218 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:21:37.218 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:21:37.218 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "d82f24b1-930e-4f83-a379-3084f22918d0", 2024-09-10T21:21:37.218 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:21:37.218 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:21:37.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.206+0000 7ff268b65640 1 -- 172.21.15.59:0/3343708726 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff2500b5360 msgr2=0x7ff2500b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:37.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.206+0000 7ff268b65640 1 --2- 172.21.15.59:0/3343708726 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff2500b5360 0x7ff2500b7820 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff254009a60 tx=0x7ff2540095c0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.206+0000 7ff268b65640 1 -- 172.21.15.59:0/3343708726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff264103ca0 msgr2=0x7ff264199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:37.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.206+0000 7ff268b65640 1 --2- 172.21.15.59:0/3343708726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff264103ca0 0x7ff264199240 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00d950 tx=0x7ff25c00de10 comp rx=0 tx=0).stop 2024-09-10T21:21:37.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.206+0000 7ff268b65640 1 -- 172.21.15.59:0/3343708726 shutdown_connections 2024-09-10T21:21:37.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.206+0000 7ff268b65640 1 --2- 172.21.15.59:0/3343708726 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff2500b5360 0x7ff2500b7820 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.206+0000 7ff268b65640 1 --2- 172.21.15.59:0/3343708726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff26410d100 0x7ff26419eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.206+0000 7ff268b65640 1 --2- 172.21.15.59:0/3343708726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2641045c0 0x7ff264199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.206+0000 7ff268b65640 1 --2- 172.21.15.59:0/3343708726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff264103ca0 0x7ff264199240 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:37.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.206+0000 7ff268b65640 1 -- 172.21.15.59:0/3343708726 >> 172.21.15.59:0/3343708726 conn(0x7ff2640fd700 msgr2=0x7ff2640fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:37.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.206+0000 7ff268b65640 1 -- 172.21.15.59:0/3343708726 shutdown_connections 2024-09-10T21:21:37.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:37.206+0000 7ff268b65640 1 -- 172.21.15.59:0/3343708726 wait complete. 2024-09-10T21:21:37.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:37 smithi192 ceph-mon[35363]: pgmap v530: 97 pgs: 97 active+clean; 4.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:21:37.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:37 smithi154 ceph-mon[35041]: pgmap v530: 97 pgs: 97 active+clean; 4.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:21:37.912 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:21:38.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:38 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:21:38.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:38 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:21:38.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:38 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:21:38.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:38 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:21:38.174 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:21:38.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:38 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:21:38.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:38 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:21:38.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:38 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:21:38.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:38 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:21:38.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:38 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:21:38.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:38 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:21:38.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:38 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:21:38.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:38 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:21:38.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.616+0000 7f97a96b5640 1 -- 172.21.15.59:0/2937215713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97a410d120 msgr2=0x7f97a410f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:38.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.616+0000 7f97a96b5640 1 --2- 172.21.15.59:0/2937215713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97a410d120 0x7f97a410f570 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f979c009ca0 tx=0x7f979c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.616+0000 7f97a96b5640 1 -- 172.21.15.59:0/2937215713 shutdown_connections 2024-09-10T21:21:38.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.616+0000 7f97a96b5640 1 --2- 172.21.15.59:0/2937215713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97a410d120 0x7f97a410f570 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.616+0000 7f97a96b5640 1 --2- 172.21.15.59:0/2937215713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97a4104570 0x7f97a410cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.616+0000 7f97a96b5640 1 --2- 172.21.15.59:0/2937215713 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97a4103b70 0x7f97a4103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.616+0000 7f97a96b5640 1 -- 172.21.15.59:0/2937215713 >> 172.21.15.59:0/2937215713 conn(0x7f97a40fd700 msgr2=0x7f97a40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:38.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.616+0000 7f97a96b5640 1 -- 172.21.15.59:0/2937215713 shutdown_connections 2024-09-10T21:21:38.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.616+0000 7f97a96b5640 1 -- 172.21.15.59:0/2937215713 wait complete. 2024-09-10T21:21:38.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.616+0000 7f97a96b5640 1 Processor -- start 2024-09-10T21:21:38.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.617+0000 7f97a96b5640 1 -- start start 2024-09-10T21:21:38.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.617+0000 7f97a96b5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97a4103b70 0x7f97a41019f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:38.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.617+0000 7f97a96b5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97a4104570 0x7f97a4101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:38.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.617+0000 7f97a96b5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97a410d120 0x7f97a4102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:38.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.617+0000 7f97a96b5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4112d80 con 0x7f97a4103b70 2024-09-10T21:21:38.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.617+0000 7f97a96b5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4112c00 con 0x7f97a4104570 2024-09-10T21:21:38.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.617+0000 7f97a96b5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f97a4112f00 con 0x7f97a410d120 2024-09-10T21:21:38.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.617+0000 7f97a2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97a4103b70 0x7f97a41019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.617+0000 7f97a2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97a4103b70 0x7f97a41019f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55136/0 (socket says 172.21.15.59:55136) 2024-09-10T21:21:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.617+0000 7f97a2ffd640 1 -- 172.21.15.59:0/3803091578 learned_addr learned my addr 172.21.15.59:0/3803091578 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.617+0000 7f97a27fc640 1 --2- 172.21.15.59:0/3803091578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97a4104570 0x7f97a4101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.617+0000 7f97a37fe640 1 --2- 172.21.15.59:0/3803091578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97a410d120 0x7f97a4102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.617+0000 7f97a2ffd640 1 -- 172.21.15.59:0/3803091578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97a410d120 msgr2=0x7f97a4102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.617+0000 7f97a2ffd640 1 --2- 172.21.15.59:0/3803091578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97a410d120 0x7f97a4102470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.617+0000 7f97a2ffd640 1 -- 172.21.15.59:0/3803091578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97a4104570 msgr2=0x7f97a4101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.617+0000 7f97a2ffd640 1 --2- 172.21.15.59:0/3803091578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97a4104570 0x7f97a4101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.617+0000 7f97a2ffd640 1 -- 172.21.15.59:0/3803091578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a41a7650 con 0x7f97a4103b70 2024-09-10T21:21:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.617+0000 7f97a27fc640 1 --2- 172.21.15.59:0/3803091578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97a4104570 0x7f97a4101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:21:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.617+0000 7f97a2ffd640 1 --2- 172.21.15.59:0/3803091578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97a4103b70 0x7f97a41019f0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f979400d950 tx=0x7f979400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.618+0000 7f978bfff640 1 -- 172.21.15.59:0/3803091578 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794017070 con 0x7f97a4103b70 2024-09-10T21:21:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.618+0000 7f97a96b5640 1 -- 172.21.15.59:0/3803091578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a41a7940 con 0x7f97a4103b70 2024-09-10T21:21:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.618+0000 7f978bfff640 1 -- 172.21.15.59:0/3803091578 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9794009c30 con 0x7f97a4103b70 2024-09-10T21:21:38.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.618+0000 7f978bfff640 1 -- 172.21.15.59:0/3803091578 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979400f620 con 0x7f97a4103b70 2024-09-10T21:21:38.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.618+0000 7f97a96b5640 1 -- 172.21.15.59:0/3803091578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a41a7ed0 con 0x7f97a4103b70 2024-09-10T21:21:38.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.621+0000 7f978bfff640 1 -- 172.21.15.59:0/3803091578 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f9794010460 con 0x7f97a4103b70 2024-09-10T21:21:38.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.621+0000 7f97aba8a740 1 Processor -- start 2024-09-10T21:21:38.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f97aba8a740 1 -- start start 2024-09-10T21:21:38.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f97aba8a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a027f9480 0x558a027f9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:38.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f97aba8a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a027f9da0 0x558a028057f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:38.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f97aba8a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a02805d30 0x558a02808120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:38.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f97aba8a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558a0276fe50 con 0x558a027f9480 2024-09-10T21:21:38.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f97aba8a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558a0275f280 con 0x558a02805d30 2024-09-10T21:21:38.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f97aba8a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558a02763090 con 0x558a027f9da0 2024-09-10T21:21:38.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f97a37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a027f9480 0x558a027f9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:38.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f97a37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a027f9480 0x558a027f9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55146/0 (socket says 172.21.15.59:55146) 2024-09-10T21:21:38.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f97a37fe640 1 -- 172.21.15.59:0/1657721394 learned_addr learned my addr 172.21.15.59:0/1657721394 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:38.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f978bfff640 1 --2- 172.21.15.59:0/3803091578 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f978c0b52e0 0x7f978c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:38.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f97a2ffd640 1 --2- 172.21.15.59:0/1657721394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a027f9da0 0x558a028057f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:38.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f97a27fc640 1 --2- 172.21.15.59:0/1657721394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a02805d30 0x558a02808120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:38.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f97a37fe640 1 --2- 172.21.15.59:0/3803091578 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f978c0b52e0 0x7f978c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:38.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f97a37fe640 1 -- 172.21.15.59:0/1657721394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a027f9da0 msgr2=0x558a028057f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:38.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f97a37fe640 1 --2- 172.21.15.59:0/1657721394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a027f9da0 0x558a028057f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f97a37fe640 1 -- 172.21.15.59:0/1657721394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a02805d30 msgr2=0x558a02808120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:38.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f97a37fe640 1 --2- 172.21.15.59:0/1657721394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a02805d30 0x558a02808120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f978bfff640 1 -- 172.21.15.59:0/3803091578 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f97940e5920 con 0x7f97a4103b70 2024-09-10T21:21:38.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f97a37fe640 1 -- 172.21.15.59:0/1657721394 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a024bd650 con 0x558a027f9480 2024-09-10T21:21:38.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.622+0000 7f97a27fc640 1 --2- 172.21.15.59:0/1657721394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a02805d30 0x558a02808120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:21:38.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.623+0000 7f97a37fe640 1 --2- 172.21.15.59:0/1657721394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a027f9480 0x558a027f9860 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f979c005e30 tx=0x7f979c031e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349f86d4d81cb1d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:38.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.623+0000 7f97a37fe640 1 --2- 172.21.15.59:0/3803091578 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f978c0b52e0 0x7f978c0b77a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f979c046000 tx=0x7f979c048000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:38.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.623+0000 7f97897fa640 1 -- 172.21.15.59:0/1657721394 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c003e00 con 0x558a027f9480 2024-09-10T21:21:38.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.623+0000 7f97897fa640 1 -- 172.21.15.59:0/1657721394 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f979c04c020 con 0x558a027f9480 2024-09-10T21:21:38.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.623+0000 7f97897fa640 1 -- 172.21.15.59:0/1657721394 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c02f660 con 0x558a027f9480 2024-09-10T21:21:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.624+0000 7f97aba8a740 1 -- 172.21.15.59:0/1657721394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a027f9480 msgr2=0x558a027f9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.624+0000 7f97aba8a740 1 --2- 172.21.15.59:0/1657721394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a027f9480 0x558a027f9860 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f979c005e30 tx=0x7f979c031e70 comp rx=0 tx=0).stop 2024-09-10T21:21:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.624+0000 7f97aba8a740 1 -- 172.21.15.59:0/1657721394 shutdown_connections 2024-09-10T21:21:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.624+0000 7f97aba8a740 1 --2- 172.21.15.59:0/1657721394 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a02805d30 0x558a02808120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.624+0000 7f97aba8a740 1 --2- 172.21.15.59:0/1657721394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a027f9da0 0x558a028057f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.624+0000 7f97aba8a740 1 --2- 172.21.15.59:0/1657721394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a027f9480 0x558a027f9860 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.624+0000 7f97aba8a740 1 -- 172.21.15.59:0/1657721394 >> 172.21.15.59:0/1657721394 conn(0x558a027f72b0 msgr2=0x558a027f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.624+0000 7f97aba8a740 1 -- 172.21.15.59:0/1657721394 shutdown_connections 2024-09-10T21:21:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.624+0000 7f97aba8a740 1 -- 172.21.15.59:0/1657721394 wait complete. 2024-09-10T21:21:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.624+0000 7f97aba8a740 1 -- start start 2024-09-10T21:21:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.624+0000 7f97aba8a740 1 Processor -- start 2024-09-10T21:21:38.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.624+0000 7f97aba8a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a027f9480 0x558a02805660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:38.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f97aba8a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a027f9da0 0x558a02802ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:38.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f97aba8a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a02805d30 0x558a02803130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:38.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f97aba8a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558a025c0700 con 0x558a02805d30 2024-09-10T21:21:38.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f97aba8a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558a026fa110 con 0x558a027f9480 2024-09-10T21:21:38.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f97aba8a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558a02808950 con 0x558a027f9da0 2024-09-10T21:21:38.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f97a37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a02805d30 0x558a02803130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:38.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f97a37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a02805d30 0x558a02803130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55148/0 (socket says 172.21.15.59:55148) 2024-09-10T21:21:38.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f97a37fe640 1 -- 172.21.15.59:0/477861772 learned_addr learned my addr 172.21.15.59:0/477861772 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:38.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f97aba8a740 10 client.0 _ll_register_callbacks cb 0x558a02713990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:21:38.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f97a2ffd640 1 --2- 172.21.15.59:0/477861772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a027f9480 0x558a02805660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:38.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f97a27fc640 1 --2- 172.21.15.59:0/477861772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a027f9da0 0x558a02802ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:38.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f97a37fe640 1 -- 172.21.15.59:0/477861772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a027f9da0 msgr2=0x558a02802ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:38.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f97a37fe640 1 --2- 172.21.15.59:0/477861772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a027f9da0 0x558a02802ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f97a37fe640 1 -- 172.21.15.59:0/477861772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a027f9480 msgr2=0x558a02805660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:38.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f97a37fe640 1 --2- 172.21.15.59:0/477861772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a027f9480 0x558a02805660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f97a37fe640 1 -- 172.21.15.59:0/477861772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a02727c40 con 0x558a02805d30 2024-09-10T21:21:38.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f97a37fe640 1 --2- 172.21.15.59:0/477861772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a02805d30 0x558a02803130 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f979c004670 tx=0x7f979c02f6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fd4a1a50234f44 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:38.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f9786ff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:21:38.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f9786ff5640 1 -- 172.21.15.59:0/477861772 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c057070 con 0x558a02805d30 2024-09-10T21:21:38.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f9786ff5640 1 -- 172.21.15.59:0/477861772 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f979c003e00 con 0x558a02805d30 2024-09-10T21:21:38.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.625+0000 7f97aba8a740 1 -- 172.21.15.59:0/477861772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f979c04c020 con 0x558a02805d30 2024-09-10T21:21:38.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.626+0000 7f9786ff5640 1 -- 172.21.15.59:0/477861772 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f979c063050 con 0x558a02805d30 2024-09-10T21:21:38.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.626+0000 7f97aba8a740 10 client.16968 fetch_fsmap learned FSMap version 28 2024-09-10T21:21:38.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.626+0000 7f97aba8a740 1 -- 172.21.15.59:0/477861772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558a02814320 con 0x558a02805d30 2024-09-10T21:21:38.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.626+0000 7f9786ff5640 1 -- 172.21.15.59:0/477861772 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f979c04c020 con 0x558a02805d30 2024-09-10T21:21:38.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.626+0000 7f9786ff5640 1 -- 172.21.15.59:0/477861772 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f979c0305c0 con 0x558a02805d30 2024-09-10T21:21:38.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.626+0000 7f97aba8a740 10 client.16968 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:21:38.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.626+0000 7f97aba8a740 10 client.16968 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:21:38.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.626+0000 7f97aba8a740 20 client.16968 populate_metadata read hostname 'smithi059' 2024-09-10T21:21:38.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.626+0000 7f97aba8a740 1 --2- 172.21.15.59:0/477861772 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558a02815670 0x558a02817a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:38.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.626+0000 7f97aba8a740 4 client.16968 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:21:38.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.626+0000 7f97aba8a740 1 -- 172.21.15.59:0/477861772 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a02771da0 con 0x558a02815670 2024-09-10T21:21:38.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.626+0000 7f97a2ffd640 1 --2- 172.21.15.59:0/477861772 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558a02815670 0x558a02817a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:38.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.627+0000 7f97a2ffd640 1 --2- 172.21.15.59:0/477861772 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558a02815670 0x558a02817a60 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62e5f10e40d385bc server_cookie=70c683052e6f2a5e in_seq=0 out_seq=0 2024-09-10T21:21:38.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.627+0000 7f9786ff5640 10 client.16968 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:21:38.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.628+0000 7f9786ff5640 1 -- 172.21.15.59:0/477861772 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558a02771da0 con 0x558a02815670 2024-09-10T21:21:38.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.628+0000 7f9786ff5640 10 client.16968 handle_command_reply: tid=0 2024-09-10T21:21:38.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.628+0000 7f97aba8a740 1 client.16968 shutdown 2024-09-10T21:21:38.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.628+0000 7f97aba8a740 1 -- 172.21.15.59:0/477861772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a02805d30 msgr2=0x558a02803130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:38.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.628+0000 7f97aba8a740 1 --2- 172.21.15.59:0/477861772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a02805d30 0x558a02803130 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f979c004670 tx=0x7f979c02f6e0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.628+0000 7f97aba8a740 1 -- 172.21.15.59:0/477861772 shutdown_connections 2024-09-10T21:21:38.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.628+0000 7f97aba8a740 1 --2- 172.21.15.59:0/477861772 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558a02815670 0x558a02817a60 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.628+0000 7f97aba8a740 1 --2- 172.21.15.59:0/477861772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a02805d30 0x558a02803130 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.628+0000 7f97aba8a740 1 --2- 172.21.15.59:0/477861772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a027f9da0 0x558a02802ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.628+0000 7f97aba8a740 1 --2- 172.21.15.59:0/477861772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a027f9480 0x558a02805660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.628+0000 7f9786ff5640 0 client.16968 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:21:38.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.628+0000 7f97aba8a740 1 -- 172.21.15.59:0/477861772 >> 172.21.15.59:0/477861772 conn(0x558a027f72b0 msgr2=0x558a027fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:38.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.628+0000 7f97aba8a740 1 -- 172.21.15.59:0/477861772 shutdown_connections 2024-09-10T21:21:38.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.628+0000 7f97aba8a740 1 -- 172.21.15.59:0/477861772 wait complete. 2024-09-10T21:21:38.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.628+0000 7f97aba8a740 20 client.16968 trim_cache size 0 max 16384 2024-09-10T21:21:38.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.646+0000 7f97aba8a740 1 Processor -- start 2024-09-10T21:21:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.646+0000 7f97aba8a740 1 -- start start 2024-09-10T21:21:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.646+0000 7f97aba8a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a027f9480 0x558a02811be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.646+0000 7f97aba8a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a027f9da0 0x558a027f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.646+0000 7f97aba8a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a02805d30 0x558a02802a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.646+0000 7f97aba8a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f97a41b0420 con 0x558a02805d30 2024-09-10T21:21:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.646+0000 7f97aba8a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f97a41b1f60 con 0x558a027f9da0 2024-09-10T21:21:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.646+0000 7f97aba8a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f97a41b0af0 con 0x558a027f9480 2024-09-10T21:21:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.646+0000 7f97a37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a02805d30 0x558a02802a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.646+0000 7f97a37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a02805d30 0x558a02802a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55154/0 (socket says 172.21.15.59:55154) 2024-09-10T21:21:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.646+0000 7f97a37fe640 1 -- 172.21.15.59:0/1448655019 learned_addr learned my addr 172.21.15.59:0/1448655019 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.646+0000 7f97a2ffd640 1 --2- 172.21.15.59:0/1448655019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a027f9480 0x558a02811be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:38.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.646+0000 7f97a27fc640 1 --2- 172.21.15.59:0/1448655019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a027f9da0 0x558a027f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.646+0000 7f97a37fe640 1 -- 172.21.15.59:0/1448655019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a027f9480 msgr2=0x558a02811be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.646+0000 7f97a37fe640 1 --2- 172.21.15.59:0/1448655019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a027f9480 0x558a02811be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.646+0000 7f97a37fe640 1 -- 172.21.15.59:0/1448655019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a027f9da0 msgr2=0x558a027f22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.646+0000 7f97a37fe640 1 --2- 172.21.15.59:0/1448655019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a027f9da0 0x558a027f22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.646+0000 7f97a37fe640 1 -- 172.21.15.59:0/1448655019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a02800fb0 con 0x558a02805d30 2024-09-10T21:21:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.646+0000 7f97a27fc640 1 --2- 172.21.15.59:0/1448655019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a027f9da0 0x558a027f22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:21:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.647+0000 7f97a37fe640 1 --2- 172.21.15.59:0/1448655019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a02805d30 0x558a02802a20 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f979c002230 tx=0x7f979c02f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2947d821325e0a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.647+0000 7f9788ff9640 1 -- 172.21.15.59:0/1448655019 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c057070 con 0x558a02805d30 2024-09-10T21:21:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.647+0000 7f9788ff9640 1 -- 172.21.15.59:0/1448655019 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f979c04c070 con 0x558a02805d30 2024-09-10T21:21:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.647+0000 7f9788ff9640 1 -- 172.21.15.59:0/1448655019 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c02f750 con 0x558a02805d30 2024-09-10T21:21:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.647+0000 7f97aba8a740 1 -- 172.21.15.59:0/1448655019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a02805d30 msgr2=0x558a02802a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.647+0000 7f97aba8a740 1 --2- 172.21.15.59:0/1448655019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a02805d30 0x558a02802a20 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f979c002230 tx=0x7f979c02f460 comp rx=0 tx=0).stop 2024-09-10T21:21:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.647+0000 7f97aba8a740 1 -- 172.21.15.59:0/1448655019 shutdown_connections 2024-09-10T21:21:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.647+0000 7f97aba8a740 1 --2- 172.21.15.59:0/1448655019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a02805d30 0x558a02802a20 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.647+0000 7f97aba8a740 1 --2- 172.21.15.59:0/1448655019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a027f9da0 0x558a027f22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.647+0000 7f97aba8a740 1 --2- 172.21.15.59:0/1448655019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a027f9480 0x558a02811be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.647+0000 7f97aba8a740 1 -- 172.21.15.59:0/1448655019 >> 172.21.15.59:0/1448655019 conn(0x558a027f72b0 msgr2=0x558a02801330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.647+0000 7f97aba8a740 1 -- 172.21.15.59:0/1448655019 shutdown_connections 2024-09-10T21:21:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.647+0000 7f97aba8a740 1 -- 172.21.15.59:0/1448655019 wait complete. 2024-09-10T21:21:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.648+0000 7f97aba8a740 1 -- start start 2024-09-10T21:21:38.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.648+0000 7f97aba8a740 1 Processor -- start 2024-09-10T21:21:38.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.648+0000 7f97aba8a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a027f9480 0x558a0280dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:38.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.648+0000 7f97aba8a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a027f9da0 0x558a0280e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:38.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.648+0000 7f97aba8a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a02805d30 0x558a02808c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:38.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.648+0000 7f97aba8a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f97a41b1890 con 0x558a027f9da0 2024-09-10T21:21:38.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.648+0000 7f97a27fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a027f9da0 0x558a0280e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:38.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.648+0000 7f97aba8a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f97a41b11c0 con 0x558a027f9480 2024-09-10T21:21:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.648+0000 7f97aba8a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f97a41ae400 con 0x558a02805d30 2024-09-10T21:21:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.648+0000 7f97a27fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a027f9da0 0x558a0280e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55160/0 (socket says 172.21.15.59:55160) 2024-09-10T21:21:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.648+0000 7f97aba8a740 10 client.0 _ll_register_callbacks cb 0x7f97940a8770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:21:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.648+0000 7f97a27fc640 1 -- 172.21.15.59:0/3101814546 learned_addr learned my addr 172.21.15.59:0/3101814546 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:21:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.648+0000 7f97a37fe640 1 --2- 172.21.15.59:0/3101814546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a02805d30 0x558a02808c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.648+0000 7f97a2ffd640 1 --2- 172.21.15.59:0/3101814546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a027f9480 0x558a0280dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.648+0000 7f97a27fc640 1 -- 172.21.15.59:0/3101814546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a02805d30 msgr2=0x558a02808c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.648+0000 7f97a27fc640 1 --2- 172.21.15.59:0/3101814546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a02805d30 0x558a02808c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.649+0000 7f97a27fc640 1 -- 172.21.15.59:0/3101814546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a027f9480 msgr2=0x558a0280dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:21:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.649+0000 7f97a27fc640 1 --2- 172.21.15.59:0/3101814546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a027f9480 0x558a0280dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.649+0000 7f97a27fc640 1 -- 172.21.15.59:0/3101814546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a02809140 con 0x558a027f9da0 2024-09-10T21:21:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.649+0000 7f97a2ffd640 1 --2- 172.21.15.59:0/3101814546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a027f9480 0x558a0280dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:21:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.649+0000 7f97a27fc640 1 --2- 172.21.15.59:0/3101814546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a027f9da0 0x558a0280e190 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f979800bf40 tx=0x7f97980138f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97cbcd11aadbe474 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:21:38.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.649+0000 7f9786ff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:21:38.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.649+0000 7f9786ff5640 1 -- 172.21.15.59:0/3101814546 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9798005020 con 0x558a027f9da0 2024-09-10T21:21:38.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.649+0000 7f9786ff5640 1 -- 172.21.15.59:0/3101814546 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f97980051c0 con 0x558a027f9da0 2024-09-10T21:21:38.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.649+0000 7f97aba8a740 1 -- 172.21.15.59:0/3101814546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f979c04c070 con 0x558a027f9da0 2024-09-10T21:21:38.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.649+0000 7f9786ff5640 1 -- 172.21.15.59:0/3101814546 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f97980053c0 con 0x558a027f9da0 2024-09-10T21:21:38.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.649+0000 7f97aba8a740 10 client.16974 fetch_fsmap learned FSMap version 28 2024-09-10T21:21:38.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.649+0000 7f97aba8a740 1 -- 172.21.15.59:0/3101814546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558a028829c0 con 0x558a027f9da0 2024-09-10T21:21:38.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.649+0000 7f9786ff5640 1 -- 172.21.15.59:0/3101814546 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f979c04c070 con 0x558a027f9da0 2024-09-10T21:21:38.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.650+0000 7f9786ff5640 1 -- 172.21.15.59:0/3101814546 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f97980119e0 con 0x558a027f9da0 2024-09-10T21:21:38.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.650+0000 7f97aba8a740 10 client.16974 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:21:38.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.650+0000 7f97aba8a740 10 client.16974 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:21:38.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.650+0000 7f97aba8a740 20 client.16974 populate_metadata read hostname 'smithi059' 2024-09-10T21:21:38.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.650+0000 7f97aba8a740 1 --2- 172.21.15.59:0/3101814546 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558a028831a0 0x558a028855c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:21:38.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.650+0000 7f97aba8a740 4 client.16974 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:21:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.650+0000 7f97aba8a740 1 -- 172.21.15.59:0/3101814546 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558a0276d850 con 0x558a028831a0 2024-09-10T21:21:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.650+0000 7f97a2ffd640 1 --2- 172.21.15.59:0/3101814546 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558a028831a0 0x558a028855c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:21:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.650+0000 7f97a2ffd640 1 --2- 172.21.15.59:0/3101814546 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558a028831a0 0x558a028855c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20664c13b6809cab server_cookie=bafda9925b1bc8d8 in_seq=0 out_seq=0 2024-09-10T21:21:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.650+0000 7f9786ff5640 10 client.16974 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:21:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.651+0000 7f9786ff5640 1 -- 172.21.15.59:0/3101814546 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3694 (crc 0 0 0) 0x558a0276d850 con 0x558a028831a0 2024-09-10T21:21:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.651+0000 7f9786ff5640 10 client.16974 handle_command_reply: tid=0 2024-09-10T21:21:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.651+0000 7f97aba8a740 1 client.16974 shutdown 2024-09-10T21:21:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.651+0000 7f97aba8a740 1 -- 172.21.15.59:0/3101814546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a027f9da0 msgr2=0x558a0280e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.651+0000 7f97aba8a740 1 --2- 172.21.15.59:0/3101814546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a027f9da0 0x558a0280e190 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f979800bf40 tx=0x7f97980138f0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.651+0000 7f97aba8a740 1 -- 172.21.15.59:0/3101814546 shutdown_connections 2024-09-10T21:21:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.651+0000 7f97aba8a740 1 --2- 172.21.15.59:0/3101814546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a02805d30 0x558a02808c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.651+0000 7f97aba8a740 1 --2- 172.21.15.59:0/3101814546 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558a028831a0 0x558a028855c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.651+0000 7f97aba8a740 1 --2- 172.21.15.59:0/3101814546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a027f9da0 0x558a0280e190 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.651+0000 7f9786ff5640 0 client.16974 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:21:38.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.651+0000 7f97aba8a740 1 --2- 172.21.15.59:0/3101814546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a027f9480 0x558a0280dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.651+0000 7f97aba8a740 1 -- 172.21.15.59:0/3101814546 >> 172.21.15.59:0/3101814546 conn(0x558a027f72b0 msgr2=0x558a028011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:38.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.651+0000 7f97aba8a740 1 -- 172.21.15.59:0/3101814546 shutdown_connections 2024-09-10T21:21:38.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.651+0000 7f97aba8a740 1 -- 172.21.15.59:0/3101814546 wait complete. 2024-09-10T21:21:38.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.651+0000 7f97aba8a740 20 client.16974 trim_cache size 0 max 16384 2024-09-10T21:21:38.660 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:21:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:21:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-09-10T21:21:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "d82f24b1-930e-4f83-a379-3084f22918d0": { 2024-09-10T21:21:38.660 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "d82f24b1-930e-4f83-a379-3084f22918d0", 2024-09-10T21:21:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2024-09-10T21:21:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:21:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:21:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "d82f24b1-930e-4f83-a379-3084f22918d0": { 2024-09-10T21:21:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:21:37.203865+0000", 2024-09-10T21:21:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:38.661 INFO:teuthology.orchestra.run.smithi059.stdout: "800cdb00-6a99-4c42-8a9e-4b1c599c6af0": { 2024-09-10T21:21:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:52.224081+0000", 2024-09-10T21:21:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:21:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:21:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:21:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:21:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:21:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:21:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:21:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:21:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:21:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:07.066301+0000", 2024-09-10T21:21:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:38.664 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:21:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:21:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:21:38.665 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:21:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:21:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:21:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:38.666 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:21:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:21:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:21:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:21:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:21:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:21:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:21:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:21:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:21:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:21:38.667 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:21:38.668 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:21:38.668 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:21:38.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.652+0000 7f97a96b5640 1 -- 172.21.15.59:0/3803091578 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f978c0b52e0 msgr2=0x7f978c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:38.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.652+0000 7f97a96b5640 1 --2- 172.21.15.59:0/3803091578 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f978c0b52e0 0x7f978c0b77a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f979c046000 tx=0x7f979c048000 comp rx=0 tx=0).stop 2024-09-10T21:21:38.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.652+0000 7f97a96b5640 1 -- 172.21.15.59:0/3803091578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97a4103b70 msgr2=0x7f97a41019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:21:38.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.652+0000 7f97a96b5640 1 --2- 172.21.15.59:0/3803091578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97a4103b70 0x7f97a41019f0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f979400d950 tx=0x7f979400de10 comp rx=0 tx=0).stop 2024-09-10T21:21:38.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.652+0000 7f97a96b5640 1 -- 172.21.15.59:0/3803091578 shutdown_connections 2024-09-10T21:21:38.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.652+0000 7f97a96b5640 1 --2- 172.21.15.59:0/3803091578 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f978c0b52e0 0x7f978c0b77a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.652+0000 7f97a96b5640 1 --2- 172.21.15.59:0/3803091578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f97a410d120 0x7f97a4102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.652+0000 7f97a96b5640 1 --2- 172.21.15.59:0/3803091578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97a4104570 0x7f97a4101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.652+0000 7f97a96b5640 1 --2- 172.21.15.59:0/3803091578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97a4103b70 0x7f97a41019f0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:21:38.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.652+0000 7f97a96b5640 1 -- 172.21.15.59:0/3803091578 >> 172.21.15.59:0/3803091578 conn(0x7f97a40fd700 msgr2=0x7f97a40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:21:38.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.652+0000 7f97a96b5640 1 -- 172.21.15.59:0/3803091578 shutdown_connections 2024-09-10T21:21:38.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:21:38.652+0000 7f97a96b5640 1 -- 172.21.15.59:0/3803091578 wait complete. 2024-09-10T21:21:39.310 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:39 smithi059 ceph-mon[30888]: pgmap v531: 97 pgs: 97 active+clean; 4.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:21:39.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:39 smithi192 ceph-mon[35363]: pgmap v531: 97 pgs: 97 active+clean; 4.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:21:39.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:39 smithi154 ceph-mon[35041]: pgmap v531: 97 pgs: 97 active+clean; 4.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:21:39.464 INFO:tasks.cephfs.filesystem:scrub status for tag:d82f24b1-930e-4f83-a379-3084f22918d0 - {'path': '/', 'tag': 'd82f24b1-930e-4f83-a379-3084f22918d0', 'options': 'recursive,force'} 2024-09-10T21:21:40.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:40 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:21:40.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:40 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:21:40.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:40 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:21:41.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:41 smithi192 ceph-mon[35363]: pgmap v532: 97 pgs: 97 active+clean; 4.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:21:41.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:41 smithi059 ceph-mon[30888]: pgmap v532: 97 pgs: 97 active+clean; 4.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:21:41.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:41 smithi154 ceph-mon[35041]: pgmap v532: 97 pgs: 97 active+clean; 4.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:21:43.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:43 smithi192 ceph-mon[35363]: pgmap v533: 97 pgs: 97 active+clean; 4.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:21:43.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:43 smithi059 ceph-mon[30888]: pgmap v533: 97 pgs: 97 active+clean; 4.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:21:43.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:43 smithi154 ceph-mon[35041]: pgmap v533: 97 pgs: 97 active+clean; 4.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 16 op/s 2024-09-10T21:21:45.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:45 smithi192 ceph-mon[35363]: pgmap v534: 97 pgs: 97 active+clean; 4.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:45.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:45 smithi059 ceph-mon[30888]: pgmap v534: 97 pgs: 97 active+clean; 4.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:45.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:45 smithi154 ceph-mon[35041]: pgmap v534: 97 pgs: 97 active+clean; 4.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:47.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:47 smithi192 ceph-mon[35363]: pgmap v535: 97 pgs: 97 active+clean; 4.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-10T21:21:47.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:47 smithi059 ceph-mon[30888]: pgmap v535: 97 pgs: 97 active+clean; 4.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-10T21:21:47.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:47 smithi154 ceph-mon[35041]: pgmap v535: 97 pgs: 97 active+clean; 4.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-10T21:21:49.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:49 smithi192 ceph-mon[35363]: pgmap v536: 97 pgs: 97 active+clean; 4.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:21:49.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:49 smithi059 ceph-mon[30888]: pgmap v536: 97 pgs: 97 active+clean; 4.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:21:49.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:49 smithi154 ceph-mon[35041]: pgmap v536: 97 pgs: 97 active+clean; 4.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:21:51.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:51 smithi192 ceph-mon[35363]: pgmap v537: 97 pgs: 97 active+clean; 4.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:51.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:51 smithi059 ceph-mon[30888]: pgmap v537: 97 pgs: 97 active+clean; 4.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:51.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:51 smithi154 ceph-mon[35041]: pgmap v537: 97 pgs: 97 active+clean; 4.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:53.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:53 smithi192 ceph-mon[35363]: pgmap v538: 97 pgs: 97 active+clean; 4.5 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:21:53.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:53 smithi059 ceph-mon[30888]: pgmap v538: 97 pgs: 97 active+clean; 4.5 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:21:53.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:53 smithi154 ceph-mon[35041]: pgmap v538: 97 pgs: 97 active+clean; 4.5 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T21:21:55.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:55 smithi192 ceph-mon[35363]: pgmap v539: 97 pgs: 97 active+clean; 4.5 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:55.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:55 smithi059 ceph-mon[30888]: pgmap v539: 97 pgs: 97 active+clean; 4.5 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:55.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:55 smithi154 ceph-mon[35041]: pgmap v539: 97 pgs: 97 active+clean; 4.5 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:21:57.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:57 smithi192 ceph-mon[35363]: pgmap v540: 97 pgs: 97 active+clean; 4.5 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:21:57.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:57 smithi059 ceph-mon[30888]: pgmap v540: 97 pgs: 97 active+clean; 4.5 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:21:57.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:57 smithi154 ceph-mon[35041]: pgmap v540: 97 pgs: 97 active+clean; 4.5 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:21:59.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:21:59 smithi192 ceph-mon[35363]: pgmap v541: 97 pgs: 97 active+clean; 4.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:21:59.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:21:59 smithi059 ceph-mon[30888]: pgmap v541: 97 pgs: 97 active+clean; 4.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:21:59.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:21:59 smithi154 ceph-mon[35041]: pgmap v541: 97 pgs: 97 active+clean; 4.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:22:01.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:01 smithi192 ceph-mon[35363]: pgmap v542: 97 pgs: 97 active+clean; 4.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T21:22:01.412 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:01 smithi059 ceph-mon[30888]: pgmap v542: 97 pgs: 97 active+clean; 4.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T21:22:01.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:01 smithi154 ceph-mon[35041]: pgmap v542: 97 pgs: 97 active+clean; 4.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 16 op/s 2024-09-10T21:22:03.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:03 smithi192 ceph-mon[35363]: pgmap v543: 97 pgs: 97 active+clean; 4.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-10T21:22:03.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:03 smithi059 ceph-mon[30888]: pgmap v543: 97 pgs: 97 active+clean; 4.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-10T21:22:03.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:03 smithi154 ceph-mon[35041]: pgmap v543: 97 pgs: 97 active+clean; 4.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-10T21:22:05.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:05 smithi059 ceph-mon[30888]: pgmap v544: 97 pgs: 97 active+clean; 4.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T21:22:05.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:05 smithi154 ceph-mon[35041]: pgmap v544: 97 pgs: 97 active+clean; 4.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T21:22:05.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:05 smithi192 ceph-mon[35363]: pgmap v544: 97 pgs: 97 active+clean; 4.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T21:22:07.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:07 smithi059 ceph-mon[30888]: pgmap v545: 97 pgs: 97 active+clean; 4.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-10T21:22:07.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:07 smithi154 ceph-mon[35041]: pgmap v545: 97 pgs: 97 active+clean; 4.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-10T21:22:07.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:07 smithi192 ceph-mon[35363]: pgmap v545: 97 pgs: 97 active+clean; 4.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-09-10T21:22:09.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:09 smithi059 ceph-mon[30888]: pgmap v546: 97 pgs: 97 active+clean; 4.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T21:22:09.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:09 smithi154 ceph-mon[35041]: pgmap v546: 97 pgs: 97 active+clean; 4.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T21:22:09.465 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:22:09.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:09 smithi192 ceph-mon[35363]: pgmap v546: 97 pgs: 97 active+clean; 4.6 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-10T21:22:09.742 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:22:10.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.209+0000 7fc825709640 1 -- 172.21.15.59:0/3781417324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8201076a0 msgr2=0x7fc820107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:10.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.209+0000 7fc825709640 1 --2- 172.21.15.59:0/3781417324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8201076a0 0x7fc820107ae0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc808009900 tx=0x7fc80802a410 comp rx=0 tx=0).stop 2024-09-10T21:22:10.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.209+0000 7fc825709640 1 -- 172.21.15.59:0/3781417324 shutdown_connections 2024-09-10T21:22:10.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.209+0000 7fc825709640 1 --2- 172.21.15.59:0/3781417324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc820108020 0x7fc82010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.209+0000 7fc825709640 1 --2- 172.21.15.59:0/3781417324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8201076a0 0x7fc820107ae0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.209+0000 7fc825709640 1 --2- 172.21.15.59:0/3781417324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc820101c90 0x7fc820102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.209+0000 7fc825709640 1 -- 172.21.15.59:0/3781417324 >> 172.21.15.59:0/3781417324 conn(0x7fc8200fd700 msgr2=0x7fc8200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:10.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.209+0000 7fc825709640 1 -- 172.21.15.59:0/3781417324 shutdown_connections 2024-09-10T21:22:10.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.209+0000 7fc825709640 1 -- 172.21.15.59:0/3781417324 wait complete. 2024-09-10T21:22:10.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.210+0000 7fc825709640 1 Processor -- start 2024-09-10T21:22:10.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.210+0000 7fc825709640 1 -- start start 2024-09-10T21:22:10.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.210+0000 7fc825709640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc820101c90 0x7fc82019a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:10.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.210+0000 7fc825709640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8201076a0 0x7fc82019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:10.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.210+0000 7fc825709640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc820108020 0x7fc82019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:10.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.210+0000 7fc825709640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc820111ca0 con 0x7fc820108020 2024-09-10T21:22:10.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.210+0000 7fc825709640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc820111b20 con 0x7fc820101c90 2024-09-10T21:22:10.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.210+0000 7fc825709640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc820111e20 con 0x7fc8201076a0 2024-09-10T21:22:10.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.210+0000 7fc81f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc820108020 0x7fc82019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:10.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.210+0000 7fc81f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc820108020 0x7fc82019ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47026/0 (socket says 172.21.15.59:47026) 2024-09-10T21:22:10.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.210+0000 7fc81f7fe640 1 -- 172.21.15.59:0/3076225371 learned_addr learned my addr 172.21.15.59:0/3076225371 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:10.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.210+0000 7fc81effd640 1 --2- 172.21.15.59:0/3076225371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc820101c90 0x7fc82019a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:10.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.210+0000 7fc81e7fc640 1 --2- 172.21.15.59:0/3076225371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8201076a0 0x7fc82019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:10.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.211+0000 7fc81f7fe640 1 -- 172.21.15.59:0/3076225371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8201076a0 msgr2=0x7fc82019a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:10.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.211+0000 7fc81f7fe640 1 --2- 172.21.15.59:0/3076225371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8201076a0 0x7fc82019a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.211+0000 7fc81f7fe640 1 -- 172.21.15.59:0/3076225371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc820101c90 msgr2=0x7fc82019a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:10.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.211+0000 7fc81f7fe640 1 --2- 172.21.15.59:0/3076225371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc820101c90 0x7fc82019a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.211+0000 7fc81f7fe640 1 -- 172.21.15.59:0/3076225371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8201a54b0 con 0x7fc820108020 2024-09-10T21:22:10.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.211+0000 7fc81f7fe640 1 --2- 172.21.15.59:0/3076225371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc820108020 0x7fc82019ab70 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fc81800e970 tx=0x7fc81800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:10.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.211+0000 7fc817fff640 1 -- 172.21.15.59:0/3076225371 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81800ccc0 con 0x7fc820108020 2024-09-10T21:22:10.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.211+0000 7fc817fff640 1 -- 172.21.15.59:0/3076225371 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc81800ce60 con 0x7fc820108020 2024-09-10T21:22:10.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.211+0000 7fc825709640 1 -- 172.21.15.59:0/3076225371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8201a57a0 con 0x7fc820108020 2024-09-10T21:22:10.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.211+0000 7fc817fff640 1 -- 172.21.15.59:0/3076225371 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818010430 con 0x7fc820108020 2024-09-10T21:22:10.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.211+0000 7fc825709640 1 -- 172.21.15.59:0/3076225371 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8201a5cb0 con 0x7fc820108020 2024-09-10T21:22:10.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.213+0000 7fc817fff640 1 -- 172.21.15.59:0/3076225371 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fc818004f90 con 0x7fc820108020 2024-09-10T21:22:10.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.214+0000 7fc827ade740 1 Processor -- start 2024-09-10T21:22:10.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.214+0000 7fc827ade740 1 -- start start 2024-09-10T21:22:10.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.214+0000 7fc827ade740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082480 0x555781082860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:10.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.214+0000 7fc827ade740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555781082da0 0x55578108e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:10.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.214+0000 7fc827ade740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55578108ed30 0x555781091120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:10.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.214+0000 7fc827ade740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555780ff8e50 con 0x555781082480 2024-09-10T21:22:10.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.214+0000 7fc827ade740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555780fe8280 con 0x55578108ed30 2024-09-10T21:22:10.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.214+0000 7fc827ade740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555780fec090 con 0x555781082da0 2024-09-10T21:22:10.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.214+0000 7fc81e7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082480 0x555781082860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:10.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.214+0000 7fc81e7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082480 0x555781082860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47028/0 (socket says 172.21.15.59:47028) 2024-09-10T21:22:10.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.214+0000 7fc81e7fc640 1 -- 172.21.15.59:0/2972435777 learned_addr learned my addr 172.21.15.59:0/2972435777 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:10.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.214+0000 7fc81effd640 1 --2- 172.21.15.59:0/2972435777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555781082da0 0x55578108e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:10.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.215+0000 7fc81e7fc640 1 --2- 172.21.15.59:0/2972435777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55578108ed30 0x555781091120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:10.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.215+0000 7fc81e7fc640 1 -- 172.21.15.59:0/2972435777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555781082da0 msgr2=0x55578108e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:10.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.215+0000 7fc81e7fc640 1 --2- 172.21.15.59:0/2972435777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555781082da0 0x55578108e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.215+0000 7fc81e7fc640 1 -- 172.21.15.59:0/2972435777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55578108ed30 msgr2=0x555781091120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:10.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.215+0000 7fc81e7fc640 1 --2- 172.21.15.59:0/2972435777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55578108ed30 0x555781091120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.215+0000 7fc81e7fc640 1 -- 172.21.15.59:0/2972435777 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555780d46650 con 0x555781082480 2024-09-10T21:22:10.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.215+0000 7fc817fff640 1 --2- 172.21.15.59:0/3076225371 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc80c0b52e0 0x7fc80c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:10.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.215+0000 7fc81e7fc640 1 --2- 172.21.15.59:0/2972435777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082480 0x555781082860 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fc80802a930 tx=0x7fc808005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95f0325b4162652 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:10.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.215+0000 7fc81effd640 1 --2- 172.21.15.59:0/3076225371 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc80c0b52e0 0x7fc80c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:10.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.215+0000 7fc817fff640 1 -- 172.21.15.59:0/3076225371 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc8180e5fe0 con 0x7fc820108020 2024-09-10T21:22:10.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.215+0000 7fc8157fa640 1 -- 172.21.15.59:0/2972435777 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc808044020 con 0x555781082480 2024-09-10T21:22:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.215+0000 7fc8157fa640 1 -- 172.21.15.59:0/2972435777 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8080316a0 con 0x555781082480 2024-09-10T21:22:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.215+0000 7fc8157fa640 1 -- 172.21.15.59:0/2972435777 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc808035040 con 0x555781082480 2024-09-10T21:22:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.216+0000 7fc81effd640 1 --2- 172.21.15.59:0/3076225371 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc80c0b52e0 0x7fc80c0b77a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x555781081190 tx=0x7fc810009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.216+0000 7fc827ade740 1 -- 172.21.15.59:0/2972435777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082480 msgr2=0x555781082860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.216+0000 7fc827ade740 1 --2- 172.21.15.59:0/2972435777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082480 0x555781082860 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fc80802a930 tx=0x7fc808005b50 comp rx=0 tx=0).stop 2024-09-10T21:22:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.216+0000 7fc827ade740 1 -- 172.21.15.59:0/2972435777 shutdown_connections 2024-09-10T21:22:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.216+0000 7fc827ade740 1 --2- 172.21.15.59:0/2972435777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55578108ed30 0x555781091120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.216+0000 7fc827ade740 1 --2- 172.21.15.59:0/2972435777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555781082da0 0x55578108e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.216+0000 7fc827ade740 1 --2- 172.21.15.59:0/2972435777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082480 0x555781082860 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.216+0000 7fc827ade740 1 -- 172.21.15.59:0/2972435777 >> 172.21.15.59:0/2972435777 conn(0x5557810802b0 msgr2=0x555781081450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.216+0000 7fc827ade740 1 -- 172.21.15.59:0/2972435777 shutdown_connections 2024-09-10T21:22:10.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.216+0000 7fc827ade740 1 -- 172.21.15.59:0/2972435777 wait complete. 2024-09-10T21:22:10.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.216+0000 7fc827ade740 1 -- start start 2024-09-10T21:22:10.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc827ade740 1 Processor -- start 2024-09-10T21:22:10.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc827ade740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555781082480 0x55578108e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:10.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc827ade740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082da0 0x55578108ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:10.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc827ade740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55578108ed30 0x55578108c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:10.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc827ade740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555780e49700 con 0x555781082da0 2024-09-10T21:22:10.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc827ade740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555780f83110 con 0x555781082480 2024-09-10T21:22:10.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc827ade740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555781091950 con 0x55578108ed30 2024-09-10T21:22:10.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc827ade740 10 client.0 _ll_register_callbacks cb 0x555780f9c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:10.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc81e7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082da0 0x55578108ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:10.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc81e7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082da0 0x55578108ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47038/0 (socket says 172.21.15.59:47038) 2024-09-10T21:22:10.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc81e7fc640 1 -- 172.21.15.59:0/3639752172 learned_addr learned my addr 172.21.15.59:0/3639752172 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:10.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc81effd640 1 --2- 172.21.15.59:0/3639752172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555781082480 0x55578108e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:10.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc81f7fe640 1 --2- 172.21.15.59:0/3639752172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55578108ed30 0x55578108c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:10.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc81e7fc640 1 -- 172.21.15.59:0/3639752172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55578108ed30 msgr2=0x55578108c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:10.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc81e7fc640 1 --2- 172.21.15.59:0/3639752172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55578108ed30 0x55578108c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc81e7fc640 1 -- 172.21.15.59:0/3639752172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555781082480 msgr2=0x55578108e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:10.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc81e7fc640 1 --2- 172.21.15.59:0/3639752172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555781082480 0x55578108e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc81e7fc640 1 -- 172.21.15.59:0/3639752172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555780fb0c40 con 0x555781082da0 2024-09-10T21:22:10.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc81effd640 1 --2- 172.21.15.59:0/3639752172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555781082480 0x55578108e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:22:10.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.217+0000 7fc81f7fe640 1 --2- 172.21.15.59:0/3639752172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55578108ed30 0x55578108c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:22:10.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.218+0000 7fc81e7fc640 1 --2- 172.21.15.59:0/3639752172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082da0 0x55578108ba90 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fc808032fd0 tx=0x7fc80802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1cb2639d94c84ec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.218+0000 7fc8067fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:22:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.218+0000 7fc8067fc640 1 -- 172.21.15.59:0/3639752172 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc808044070 con 0x555781082da0 2024-09-10T21:22:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.218+0000 7fc8067fc640 1 -- 172.21.15.59:0/3639752172 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc808004030 con 0x555781082da0 2024-09-10T21:22:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.218+0000 7fc827ade740 1 -- 172.21.15.59:0/3639752172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8080316a0 con 0x555781082da0 2024-09-10T21:22:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.218+0000 7fc8067fc640 1 -- 172.21.15.59:0/3639752172 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc808035040 con 0x555781082da0 2024-09-10T21:22:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.218+0000 7fc827ade740 10 client.16986 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.218+0000 7fc827ade740 1 -- 172.21.15.59:0/3639752172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55578109d2b0 con 0x555781082da0 2024-09-10T21:22:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.218+0000 7fc8067fc640 1 -- 172.21.15.59:0/3639752172 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8080316a0 con 0x555781082da0 2024-09-10T21:22:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.218+0000 7fc8067fc640 1 -- 172.21.15.59:0/3639752172 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc8080046c0 con 0x555781082da0 2024-09-10T21:22:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.218+0000 7fc827ade740 10 client.16986 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.218+0000 7fc827ade740 10 client.16986 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:22:10.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.218+0000 7fc827ade740 20 client.16986 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.218+0000 7fc827ade740 1 --2- 172.21.15.59:0/3639752172 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55578109e600 0x5557810a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.218+0000 7fc827ade740 4 client.16986 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:22:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.218+0000 7fc827ade740 1 -- 172.21.15.59:0/3639752172 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555780ffada0 con 0x55578109e600 2024-09-10T21:22:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.219+0000 7fc81effd640 1 --2- 172.21.15.59:0/3639752172 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55578109e600 0x5557810a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.219+0000 7fc81effd640 1 --2- 172.21.15.59:0/3639752172 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55578109e600 0x5557810a09f0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7b12742a0502084 server_cookie=26d5f0edb421d849 in_seq=0 out_seq=0 2024-09-10T21:22:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.219+0000 7fc8067fc640 10 client.16986 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.220+0000 7fc8067fc640 1 -- 172.21.15.59:0/3639752172 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555780ffada0 con 0x55578109e600 2024-09-10T21:22:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.220+0000 7fc8067fc640 10 client.16986 handle_command_reply: tid=0 2024-09-10T21:22:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.220+0000 7fc827ade740 1 client.16986 shutdown 2024-09-10T21:22:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.220+0000 7fc827ade740 1 -- 172.21.15.59:0/3639752172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082da0 msgr2=0x55578108ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.220+0000 7fc827ade740 1 --2- 172.21.15.59:0/3639752172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082da0 0x55578108ba90 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fc808032fd0 tx=0x7fc80802a410 comp rx=0 tx=0).stop 2024-09-10T21:22:10.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.220+0000 7fc827ade740 1 -- 172.21.15.59:0/3639752172 shutdown_connections 2024-09-10T21:22:10.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.220+0000 7fc827ade740 1 --2- 172.21.15.59:0/3639752172 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55578108ed30 0x55578108c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.220+0000 7fc827ade740 1 --2- 172.21.15.59:0/3639752172 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55578109e600 0x5557810a09f0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.220+0000 7fc827ade740 1 --2- 172.21.15.59:0/3639752172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082da0 0x55578108ba90 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.220+0000 7fc8067fc640 0 client.16986 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:10.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.220+0000 7fc827ade740 1 --2- 172.21.15.59:0/3639752172 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555781082480 0x55578108e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.220+0000 7fc827ade740 1 -- 172.21.15.59:0/3639752172 >> 172.21.15.59:0/3639752172 conn(0x5557810802b0 msgr2=0x555781085e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:10.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.220+0000 7fc827ade740 1 -- 172.21.15.59:0/3639752172 shutdown_connections 2024-09-10T21:22:10.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.220+0000 7fc827ade740 1 -- 172.21.15.59:0/3639752172 wait complete. 2024-09-10T21:22:10.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.220+0000 7fc827ade740 20 client.16986 trim_cache size 0 max 16384 2024-09-10T21:22:10.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.238+0000 7fc827ade740 1 Processor -- start 2024-09-10T21:22:10.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.238+0000 7fc827ade740 1 -- start start 2024-09-10T21:22:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.239+0000 7fc827ade740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082480 0x55578107b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.239+0000 7fc827ade740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555781082da0 0x55578107fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.239+0000 7fc827ade740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55578108ed30 0x55578108d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.239+0000 7fc827ade740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc8201ae220 con 0x555781082480 2024-09-10T21:22:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.239+0000 7fc827ade740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc8201afd60 con 0x55578108ed30 2024-09-10T21:22:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.239+0000 7fc827ade740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc8201ae8f0 con 0x555781082da0 2024-09-10T21:22:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.239+0000 7fc81effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082480 0x55578107b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.239+0000 7fc81effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082480 0x55578107b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47042/0 (socket says 172.21.15.59:47042) 2024-09-10T21:22:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.239+0000 7fc81effd640 1 -- 172.21.15.59:0/1313638754 learned_addr learned my addr 172.21.15.59:0/1313638754 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.239+0000 7fc81f7fe640 1 --2- 172.21.15.59:0/1313638754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55578108ed30 0x55578108d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.239+0000 7fc81e7fc640 1 --2- 172.21.15.59:0/1313638754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555781082da0 0x55578107fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:10.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.239+0000 7fc81effd640 1 -- 172.21.15.59:0/1313638754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555781082da0 msgr2=0x55578107fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.239+0000 7fc81effd640 1 --2- 172.21.15.59:0/1313638754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555781082da0 0x55578107fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.239+0000 7fc81effd640 1 -- 172.21.15.59:0/1313638754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55578108ed30 msgr2=0x55578108d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.239+0000 7fc81effd640 1 --2- 172.21.15.59:0/1313638754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55578108ed30 0x55578108d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.239+0000 7fc81effd640 1 -- 172.21.15.59:0/1313638754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555781089f90 con 0x555781082480 2024-09-10T21:22:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.239+0000 7fc81f7fe640 1 --2- 172.21.15.59:0/1313638754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55578108ed30 0x55578108d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:22:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.239+0000 7fc81effd640 1 --2- 172.21.15.59:0/1313638754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082480 0x55578107b2d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc810005fd0 tx=0x7fc810016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd81cdb4d3cf8c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.240+0000 7fc814ff9640 1 -- 172.21.15.59:0/1313638754 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810004690 con 0x555781082480 2024-09-10T21:22:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.240+0000 7fc814ff9640 1 -- 172.21.15.59:0/1313638754 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc810004830 con 0x555781082480 2024-09-10T21:22:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.240+0000 7fc814ff9640 1 -- 172.21.15.59:0/1313638754 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81000fe50 con 0x555781082480 2024-09-10T21:22:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.240+0000 7fc827ade740 1 -- 172.21.15.59:0/1313638754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082480 msgr2=0x55578107b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.240+0000 7fc827ade740 1 --2- 172.21.15.59:0/1313638754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082480 0x55578107b2d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc810005fd0 tx=0x7fc810016000 comp rx=0 tx=0).stop 2024-09-10T21:22:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc827ade740 1 -- 172.21.15.59:0/1313638754 shutdown_connections 2024-09-10T21:22:10.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc827ade740 1 --2- 172.21.15.59:0/1313638754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55578108ed30 0x55578108d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc827ade740 1 --2- 172.21.15.59:0/1313638754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555781082da0 0x55578107fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc827ade740 1 --2- 172.21.15.59:0/1313638754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082480 0x55578107b2d0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc827ade740 1 -- 172.21.15.59:0/1313638754 >> 172.21.15.59:0/1313638754 conn(0x5557810802b0 msgr2=0x55578108d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc827ade740 1 -- 172.21.15.59:0/1313638754 shutdown_connections 2024-09-10T21:22:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc827ade740 1 -- 172.21.15.59:0/1313638754 wait complete. 2024-09-10T21:22:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc827ade740 1 -- start start 2024-09-10T21:22:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc827ade740 1 Processor -- start 2024-09-10T21:22:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc827ade740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555781082480 0x555781096bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc827ade740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082da0 0x555781097130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc827ade740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55578108ed30 0x555781091ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc827ade740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc8201af690 con 0x555781082da0 2024-09-10T21:22:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc827ade740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc8201aefc0 con 0x55578108ed30 2024-09-10T21:22:10.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc827ade740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc8201ac200 con 0x555781082480 2024-09-10T21:22:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc827ade740 10 client.0 _ll_register_callbacks cb 0x7fc810009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc81e7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082da0 0x555781097130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc81e7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082da0 0x555781097130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47052/0 (socket says 172.21.15.59:47052) 2024-09-10T21:22:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc81e7fc640 1 -- 172.21.15.59:0/2147848882 learned_addr learned my addr 172.21.15.59:0/2147848882 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.241+0000 7fc81effd640 1 --2- 172.21.15.59:0/2147848882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555781082480 0x555781096bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.242+0000 7fc81f7fe640 1 --2- 172.21.15.59:0/2147848882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55578108ed30 0x555781091ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.242+0000 7fc81e7fc640 1 -- 172.21.15.59:0/2147848882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555781082480 msgr2=0x555781096bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.242+0000 7fc81e7fc640 1 --2- 172.21.15.59:0/2147848882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555781082480 0x555781096bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.242+0000 7fc81e7fc640 1 -- 172.21.15.59:0/2147848882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55578108ed30 msgr2=0x555781091ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.242+0000 7fc81e7fc640 1 --2- 172.21.15.59:0/2147848882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55578108ed30 0x555781091ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.242+0000 7fc81e7fc640 1 -- 172.21.15.59:0/2147848882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555781092130 con 0x555781082da0 2024-09-10T21:22:10.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.242+0000 7fc81e7fc640 1 --2- 172.21.15.59:0/2147848882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082da0 0x555781097130 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fc808001eb0 tx=0x7fc8080316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc6ee095d506ce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.242+0000 7fc8067fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:22:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.242+0000 7fc8067fc640 1 -- 172.21.15.59:0/2147848882 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc808044040 con 0x555781082da0 2024-09-10T21:22:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.242+0000 7fc8067fc640 1 -- 172.21.15.59:0/2147848882 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc808031c60 con 0x555781082da0 2024-09-10T21:22:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.242+0000 7fc827ade740 1 -- 172.21.15.59:0/2147848882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc810004830 con 0x555781082da0 2024-09-10T21:22:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.242+0000 7fc8067fc640 1 -- 172.21.15.59:0/2147848882 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc808065050 con 0x555781082da0 2024-09-10T21:22:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.242+0000 7fc827ade740 10 client.16992 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.242+0000 7fc827ade740 1 -- 172.21.15.59:0/2147848882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55578110fdf0 con 0x555781082da0 2024-09-10T21:22:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.243+0000 7fc8067fc640 1 -- 172.21.15.59:0/2147848882 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc810004830 con 0x555781082da0 2024-09-10T21:22:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.243+0000 7fc8067fc640 1 -- 172.21.15.59:0/2147848882 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc80805c070 con 0x555781082da0 2024-09-10T21:22:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.243+0000 7fc827ade740 10 client.16992 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.243+0000 7fc827ade740 10 client.16992 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:22:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.243+0000 7fc827ade740 20 client.16992 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.243+0000 7fc827ade740 1 --2- 172.21.15.59:0/2147848882 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555781110510 0x555781112930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:10.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.243+0000 7fc827ade740 4 client.16992 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:22:10.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.243+0000 7fc827ade740 1 -- 172.21.15.59:0/2147848882 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555780ff6850 con 0x555781110510 2024-09-10T21:22:10.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.243+0000 7fc81effd640 1 --2- 172.21.15.59:0/2147848882 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555781110510 0x555781112930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:10.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.243+0000 7fc81effd640 1 --2- 172.21.15.59:0/2147848882 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555781110510 0x555781112930 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8f48d495b00e2c7 server_cookie=b10f2727ef6d8c5f in_seq=0 out_seq=0 2024-09-10T21:22:10.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.243+0000 7fc8067fc640 10 client.16992 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:10.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.244+0000 7fc8067fc640 1 -- 172.21.15.59:0/2147848882 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x555780ff6850 con 0x555781110510 2024-09-10T21:22:10.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.244+0000 7fc8067fc640 10 client.16992 handle_command_reply: tid=0 2024-09-10T21:22:10.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.244+0000 7fc827ade740 1 client.16992 shutdown 2024-09-10T21:22:10.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.244+0000 7fc827ade740 1 -- 172.21.15.59:0/2147848882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082da0 msgr2=0x555781097130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:10.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.244+0000 7fc827ade740 1 --2- 172.21.15.59:0/2147848882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082da0 0x555781097130 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fc808001eb0 tx=0x7fc8080316d0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.244+0000 7fc827ade740 1 -- 172.21.15.59:0/2147848882 shutdown_connections 2024-09-10T21:22:10.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.244+0000 7fc827ade740 1 --2- 172.21.15.59:0/2147848882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55578108ed30 0x555781091ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.244+0000 7fc827ade740 1 --2- 172.21.15.59:0/2147848882 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555781110510 0x555781112930 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.244+0000 7fc827ade740 1 --2- 172.21.15.59:0/2147848882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555781082da0 0x555781097130 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.244+0000 7fc827ade740 1 --2- 172.21.15.59:0/2147848882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555781082480 0x555781096bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.244+0000 7fc8067fc640 0 client.16992 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:10.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.244+0000 7fc827ade740 1 -- 172.21.15.59:0/2147848882 >> 172.21.15.59:0/2147848882 conn(0x5557810802b0 msgr2=0x55578108d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:10.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.244+0000 7fc827ade740 1 -- 172.21.15.59:0/2147848882 shutdown_connections 2024-09-10T21:22:10.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.244+0000 7fc827ade740 1 -- 172.21.15.59:0/2147848882 wait complete. 2024-09-10T21:22:10.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.244+0000 7fc827ade740 20 client.16992 trim_cache size 0 max 16384 2024-09-10T21:22:10.263 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:22:10.264 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:22:10.264 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:22:10.264 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:22:10.264 INFO:teuthology.orchestra.run.smithi059.stdout: "d82f24b1-930e-4f83-a379-3084f22918d0": { 2024-09-10T21:22:10.264 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:21:37.203865+0000", 2024-09-10T21:22:10.264 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:10.264 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:10.264 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:10.264 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:10.264 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:10.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:10.264 INFO:teuthology.orchestra.run.smithi059.stdout: "800cdb00-6a99-4c42-8a9e-4b1c599c6af0": { 2024-09-10T21:22:10.265 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:52.224081+0000", 2024-09-10T21:22:10.265 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:10.265 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:10.265 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:10.265 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:10.265 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:10.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:10.265 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:22:10.265 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:22:10.265 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:10.265 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:10.265 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:10.265 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:10.266 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:10.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:10.266 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:22:10.266 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:22:10.266 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:10.266 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:10.266 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:10.266 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:10.266 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:10.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:10.266 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:22:10.266 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:22:10.266 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:10.266 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:10.267 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:10.267 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:10.267 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:10.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:10.267 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:22:10.267 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:22:10.267 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:10.267 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:10.267 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:10.267 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:10.267 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:10.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:10.267 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:22:10.267 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:07.066301+0000", 2024-09-10T21:22:10.268 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:10.268 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:10.268 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:10.268 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:10.268 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:10.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:10.268 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:22:10.268 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:22:10.268 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:10.268 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:10.268 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:10.268 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:10.268 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:10.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:10.269 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:22:10.269 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:22:10.269 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:10.269 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:10.269 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:10.269 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:10.269 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:10.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:10.269 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:22:10.269 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:22:10.269 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:10.270 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:10.270 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:10.270 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:10.270 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:10.270 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:10.270 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:22:10.270 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:22:10.270 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:10.270 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:10.270 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:10.270 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:10.271 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:10.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:10.271 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:22:10.271 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:22:10.271 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:10.271 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:10.271 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:10.271 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:10.271 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:10.271 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:22:10.271 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:22:10.271 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:22:10.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.245+0000 7fc825709640 1 -- 172.21.15.59:0/3076225371 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc80c0b52e0 msgr2=0x7fc80c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:10.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.245+0000 7fc825709640 1 --2- 172.21.15.59:0/3076225371 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc80c0b52e0 0x7fc80c0b77a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x555781081190 tx=0x7fc810009500 comp rx=0 tx=0).stop 2024-09-10T21:22:10.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.245+0000 7fc825709640 1 -- 172.21.15.59:0/3076225371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc820108020 msgr2=0x7fc82019ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:10.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.245+0000 7fc825709640 1 --2- 172.21.15.59:0/3076225371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc820108020 0x7fc82019ab70 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fc81800e970 tx=0x7fc81800ed70 comp rx=0 tx=0).stop 2024-09-10T21:22:10.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.245+0000 7fc825709640 1 -- 172.21.15.59:0/3076225371 shutdown_connections 2024-09-10T21:22:10.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.245+0000 7fc825709640 1 --2- 172.21.15.59:0/3076225371 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc80c0b52e0 0x7fc80c0b77a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.245+0000 7fc825709640 1 --2- 172.21.15.59:0/3076225371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc820108020 0x7fc82019ab70 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.245+0000 7fc825709640 1 --2- 172.21.15.59:0/3076225371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8201076a0 0x7fc82019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.245+0000 7fc825709640 1 --2- 172.21.15.59:0/3076225371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc820101c90 0x7fc82019a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:10.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.245+0000 7fc825709640 1 -- 172.21.15.59:0/3076225371 >> 172.21.15.59:0/3076225371 conn(0x7fc8200fd700 msgr2=0x7fc8200ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:10.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.245+0000 7fc825709640 1 -- 172.21.15.59:0/3076225371 shutdown_connections 2024-09-10T21:22:10.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:10.245+0000 7fc825709640 1 -- 172.21.15.59:0/3076225371 wait complete. 2024-09-10T21:22:11.112 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:22:11.112 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:22:11.139 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:11 smithi059 ceph-mon[30888]: pgmap v547: 97 pgs: 97 active+clean; 4.7 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T21:22:11.379 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:22:11.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:11 smithi154 ceph-mon[35041]: pgmap v547: 97 pgs: 97 active+clean; 4.7 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T21:22:11.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:11 smithi192 ceph-mon[35363]: pgmap v547: 97 pgs: 97 active+clean; 4.7 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 17 op/s 2024-09-10T21:22:11.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.806+0000 7f9ae83b4640 1 -- 172.21.15.59:0/175581489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae010d100 msgr2=0x7f9ae010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:11.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.806+0000 7f9ae83b4640 1 --2- 172.21.15.59:0/175581489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae010d100 0x7f9ae010f560 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009ca0 tx=0x7f9ad802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:22:11.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.806+0000 7f9ae83b4640 1 -- 172.21.15.59:0/175581489 shutdown_connections 2024-09-10T21:22:11.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.806+0000 7f9ae83b4640 1 --2- 172.21.15.59:0/175581489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae010d100 0x7f9ae010f560 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:11.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.806+0000 7f9ae83b4640 1 --2- 172.21.15.59:0/175581489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ae01045c0 0x7f9ae010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:11.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.806+0000 7f9ae83b4640 1 --2- 172.21.15.59:0/175581489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ae0103ca0 0x7f9ae0104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:11.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.806+0000 7f9ae83b4640 1 -- 172.21.15.59:0/175581489 >> 172.21.15.59:0/175581489 conn(0x7f9ae00fd700 msgr2=0x7f9ae00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:11.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.806+0000 7f9ae83b4640 1 -- 172.21.15.59:0/175581489 shutdown_connections 2024-09-10T21:22:11.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.806+0000 7f9ae83b4640 1 -- 172.21.15.59:0/175581489 wait complete. 2024-09-10T21:22:11.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.807+0000 7f9ae83b4640 1 Processor -- start 2024-09-10T21:22:11.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.807+0000 7f9ae83b4640 1 -- start start 2024-09-10T21:22:11.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.807+0000 7f9ae83b4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae0103ca0 0x7f9ae0199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:11.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.807+0000 7f9ae83b4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ae01045c0 0x7f9ae01997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:11.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.807+0000 7f9ae83b4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ae010d100 0x7f9ae019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:11.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.807+0000 7f9ae83b4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae0112d70 con 0x7f9ae0103ca0 2024-09-10T21:22:11.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.807+0000 7f9ae83b4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae0112bf0 con 0x7f9ae010d100 2024-09-10T21:22:11.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.807+0000 7f9ae83b4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae0112ef0 con 0x7f9ae01045c0 2024-09-10T21:22:11.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.807+0000 7f9ae6150640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae0103ca0 0x7f9ae0199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:11.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.807+0000 7f9ae6150640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae0103ca0 0x7f9ae0199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47058/0 (socket says 172.21.15.59:47058) 2024-09-10T21:22:11.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.807+0000 7f9ae6150640 1 -- 172.21.15.59:0/2171697529 learned_addr learned my addr 172.21.15.59:0/2171697529 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:11.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.807+0000 7f9ae6951640 1 --2- 172.21.15.59:0/2171697529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ae010d100 0x7f9ae019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:11.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.807+0000 7f9ae594f640 1 --2- 172.21.15.59:0/2171697529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ae01045c0 0x7f9ae01997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:11.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.808+0000 7f9ae6150640 1 -- 172.21.15.59:0/2171697529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ae01045c0 msgr2=0x7f9ae01997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:11.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.808+0000 7f9ae6150640 1 --2- 172.21.15.59:0/2171697529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ae01045c0 0x7f9ae01997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:11.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.808+0000 7f9ae6150640 1 -- 172.21.15.59:0/2171697529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ae010d100 msgr2=0x7f9ae019eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:11.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.808+0000 7f9ae6150640 1 --2- 172.21.15.59:0/2171697529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ae010d100 0x7f9ae019eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:11.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.808+0000 7f9ae6150640 1 -- 172.21.15.59:0/2171697529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae019f330 con 0x7f9ae0103ca0 2024-09-10T21:22:11.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.808+0000 7f9ae6150640 1 --2- 172.21.15.59:0/2171697529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae0103ca0 0x7f9ae0199280 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00e9f0 tx=0x7f9adc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:11.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.808+0000 7f9ad77fe640 1 -- 172.21.15.59:0/2171697529 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc00cd80 con 0x7f9ae0103ca0 2024-09-10T21:22:11.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.808+0000 7f9ad77fe640 1 -- 172.21.15.59:0/2171697529 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9adc0108e0 con 0x7f9ae0103ca0 2024-09-10T21:22:11.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.808+0000 7f9ae83b4640 1 -- 172.21.15.59:0/2171697529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae019f620 con 0x7f9ae0103ca0 2024-09-10T21:22:11.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.808+0000 7f9ad77fe640 1 -- 172.21.15.59:0/2171697529 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc018980 con 0x7f9ae0103ca0 2024-09-10T21:22:11.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.808+0000 7f9ae83b4640 1 -- 172.21.15.59:0/2171697529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae01a5eb0 con 0x7f9ae0103ca0 2024-09-10T21:22:11.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.809+0000 7f9ae83b4640 1 -- 172.21.15.59:0/2171697529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ae0104080 con 0x7f9ae0103ca0 2024-09-10T21:22:11.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.812+0000 7f9ad77fe640 1 -- 172.21.15.59:0/2171697529 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f9adc010430 con 0x7f9ae0103ca0 2024-09-10T21:22:11.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.812+0000 7f9ad77fe640 1 --2- 172.21.15.59:0/2171697529 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9acc0b5360 0x7f9acc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:11.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.812+0000 7f9ae594f640 1 --2- 172.21.15.59:0/2171697529 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9acc0b5360 0x7f9acc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:11.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.813+0000 7f9ad77fe640 1 -- 172.21.15.59:0/2171697529 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9adc0e63d0 con 0x7f9ae0103ca0 2024-09-10T21:22:11.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.813+0000 7f9ae594f640 1 --2- 172.21.15.59:0/2171697529 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9acc0b5360 0x7f9acc0b7820 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9ae010f670 tx=0x7f9ad000b360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:11.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:11.816+0000 7f9ad77fe640 1 -- 172.21.15.59:0/2171697529 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9adc0ad2c0 con 0x7f9ae0103ca0 2024-09-10T21:22:12.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:12.038+0000 7f9ae83b4640 1 -- 172.21.15.59:0/2171697529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ae019a3b0 con 0x7f9ae0103ca0 2024-09-10T21:22:12.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:12.039+0000 7f9ad77fe640 1 -- 172.21.15.59:0/2171697529 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f9adc0acbc0 con 0x7f9ae0103ca0 2024-09-10T21:22:12.043 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:22:12.044 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:22:12.044 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:22:12.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:12.041+0000 7f9ae83b4640 1 -- 172.21.15.59:0/2171697529 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9acc0b5360 msgr2=0x7f9acc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:12.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:12.041+0000 7f9ae83b4640 1 --2- 172.21.15.59:0/2171697529 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9acc0b5360 0x7f9acc0b7820 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9ae010f670 tx=0x7f9ad000b360 comp rx=0 tx=0).stop 2024-09-10T21:22:12.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:12.041+0000 7f9ae83b4640 1 -- 172.21.15.59:0/2171697529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae0103ca0 msgr2=0x7f9ae0199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:12.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:12.041+0000 7f9ae83b4640 1 --2- 172.21.15.59:0/2171697529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae0103ca0 0x7f9ae0199280 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00e9f0 tx=0x7f9adc00eeb0 comp rx=0 tx=0).stop 2024-09-10T21:22:12.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:12.041+0000 7f9ae83b4640 1 -- 172.21.15.59:0/2171697529 shutdown_connections 2024-09-10T21:22:12.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:12.041+0000 7f9ae83b4640 1 --2- 172.21.15.59:0/2171697529 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9acc0b5360 0x7f9acc0b7820 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:12.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:12.041+0000 7f9ae83b4640 1 --2- 172.21.15.59:0/2171697529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ae010d100 0x7f9ae019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:12.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:12.041+0000 7f9ae83b4640 1 --2- 172.21.15.59:0/2171697529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ae01045c0 0x7f9ae01997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:12.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:12.041+0000 7f9ae83b4640 1 --2- 172.21.15.59:0/2171697529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae0103ca0 0x7f9ae0199280 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:12.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:12.041+0000 7f9ae83b4640 1 -- 172.21.15.59:0/2171697529 >> 172.21.15.59:0/2171697529 conn(0x7f9ae00fd700 msgr2=0x7f9ae00fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:12.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:12.041+0000 7f9ae83b4640 1 -- 172.21.15.59:0/2171697529 shutdown_connections 2024-09-10T21:22:12.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:12.041+0000 7f9ae83b4640 1 -- 172.21.15.59:0/2171697529 wait complete. 2024-09-10T21:22:12.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:12 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2171697529' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:22:12.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:12 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2171697529' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:22:12.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:12 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2171697529' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:22:12.741 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:22:13.039 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:22:13.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:13 smithi059 ceph-mon[30888]: pgmap v548: 97 pgs: 97 active+clean; 4.7 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:22:13.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:13 smithi154 ceph-mon[35041]: pgmap v548: 97 pgs: 97 active+clean; 4.7 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:22:13.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.557+0000 7f8c51f3c640 1 -- 172.21.15.59:0/2668650450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4c109150 msgr2=0x7f8c4c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:13.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.557+0000 7f8c51f3c640 1 --2- 172.21.15.59:0/2668650450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4c109150 0x7f8c4c10f950 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f8c44009ca0 tx=0x7f8c4402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.557+0000 7f8c51f3c640 1 -- 172.21.15.59:0/2668650450 shutdown_connections 2024-09-10T21:22:13.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.557+0000 7f8c51f3c640 1 --2- 172.21.15.59:0/2668650450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4c109150 0x7f8c4c10f950 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.557+0000 7f8c51f3c640 1 --2- 172.21.15.59:0/2668650450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c4c1087d0 0x7f8c4c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.557+0000 7f8c51f3c640 1 --2- 172.21.15.59:0/2668650450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c102dc0 0x7f8c4c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.557+0000 7f8c51f3c640 1 -- 172.21.15.59:0/2668650450 >> 172.21.15.59:0/2668650450 conn(0x7f8c4c0fe830 msgr2=0x7f8c4c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:13.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.558+0000 7f8c51f3c640 1 -- 172.21.15.59:0/2668650450 shutdown_connections 2024-09-10T21:22:13.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.558+0000 7f8c51f3c640 1 -- 172.21.15.59:0/2668650450 wait complete. 2024-09-10T21:22:13.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.558+0000 7f8c51f3c640 1 Processor -- start 2024-09-10T21:22:13.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.558+0000 7f8c51f3c640 1 -- start start 2024-09-10T21:22:13.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.559+0000 7f8c51f3c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c102dc0 0x7f8c4c199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:13.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.559+0000 7f8c51f3c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c4c1087d0 0x7f8c4c1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:13.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.559+0000 7f8c51f3c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4c109150 0x7f8c4c19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:13.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.559+0000 7f8c51f3c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c112dd0 con 0x7f8c4c109150 2024-09-10T21:22:13.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.559+0000 7f8c51f3c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c112c50 con 0x7f8c4c102dc0 2024-09-10T21:22:13.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.559+0000 7f8c51f3c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c112f50 con 0x7f8c4c1087d0 2024-09-10T21:22:13.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.559+0000 7f8c4bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4c109150 0x7f8c4c19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:13.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.559+0000 7f8c4bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4c109150 0x7f8c4c19eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47062/0 (socket says 172.21.15.59:47062) 2024-09-10T21:22:13.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.559+0000 7f8c4bfff640 1 -- 172.21.15.59:0/3836505019 learned_addr learned my addr 172.21.15.59:0/3836505019 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:13.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.559+0000 7f8c43fff640 1 --2- 172.21.15.59:0/3836505019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c4c1087d0 0x7f8c4c1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:13.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.559+0000 7f8c4b7fe640 1 --2- 172.21.15.59:0/3836505019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c102dc0 0x7f8c4c199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:13.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.559+0000 7f8c4bfff640 1 -- 172.21.15.59:0/3836505019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c4c1087d0 msgr2=0x7f8c4c1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:13.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.559+0000 7f8c4bfff640 1 --2- 172.21.15.59:0/3836505019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c4c1087d0 0x7f8c4c1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.559+0000 7f8c4bfff640 1 -- 172.21.15.59:0/3836505019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c102dc0 msgr2=0x7f8c4c199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:13.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.559+0000 7f8c4bfff640 1 --2- 172.21.15.59:0/3836505019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c102dc0 0x7f8c4c199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.559+0000 7f8c4bfff640 1 -- 172.21.15.59:0/3836505019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4c19f310 con 0x7f8c4c109150 2024-09-10T21:22:13.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.559+0000 7f8c4b7fe640 1 --2- 172.21.15.59:0/3836505019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c102dc0 0x7f8c4c199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:22:13.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.559+0000 7f8c4bfff640 1 --2- 172.21.15.59:0/3836505019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4c109150 0x7f8c4c19eb40 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f8c44005cc0 tx=0x7f8c4402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:13.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.560+0000 7f8c497fa640 1 -- 172.21.15.59:0/3836505019 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44003bf0 con 0x7f8c4c109150 2024-09-10T21:22:13.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.560+0000 7f8c497fa640 1 -- 172.21.15.59:0/3836505019 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c44003d90 con 0x7f8c4c109150 2024-09-10T21:22:13.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.560+0000 7f8c51f3c640 1 -- 172.21.15.59:0/3836505019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c4c19f5a0 con 0x7f8c4c109150 2024-09-10T21:22:13.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.560+0000 7f8c497fa640 1 -- 172.21.15.59:0/3836505019 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4402fbc0 con 0x7f8c4c109150 2024-09-10T21:22:13.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.560+0000 7f8c51f3c640 1 -- 172.21.15.59:0/3836505019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c4c1a5cc0 con 0x7f8c4c109150 2024-09-10T21:22:13.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.562+0000 7f8c497fa640 1 -- 172.21.15.59:0/3836505019 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f8c44004610 con 0x7f8c4c109150 2024-09-10T21:22:13.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.562+0000 7f8c54311740 1 Processor -- start 2024-09-10T21:22:13.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.562+0000 7f8c54311740 1 -- start start 2024-09-10T21:22:13.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.562+0000 7f8c54311740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698c4d0 0x55cff698c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.563+0000 7f8c54311740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff698cdf0 0x55cff699cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.563+0000 7f8c54311740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff699d190 0x55cff699f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.563+0000 7f8c54311740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cff6902ea0 con 0x55cff698c4d0 2024-09-10T21:22:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.563+0000 7f8c54311740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cff68f22d0 con 0x55cff699d190 2024-09-10T21:22:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.563+0000 7f8c54311740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cff68f60e0 con 0x55cff698cdf0 2024-09-10T21:22:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.563+0000 7f8c43fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698c4d0 0x55cff698c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.563+0000 7f8c43fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698c4d0 0x55cff698c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47070/0 (socket says 172.21.15.59:47070) 2024-09-10T21:22:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.563+0000 7f8c43fff640 1 -- 172.21.15.59:0/3813979966 learned_addr learned my addr 172.21.15.59:0/3813979966 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.563+0000 7f8c4b7fe640 1 --2- 172.21.15.59:0/3813979966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff698cdf0 0x55cff699cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.563+0000 7f8c43fff640 1 --2- 172.21.15.59:0/3813979966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff699d190 0x55cff699f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.563+0000 7f8c43fff640 1 -- 172.21.15.59:0/3813979966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff698cdf0 msgr2=0x55cff699cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.563+0000 7f8c43fff640 1 --2- 172.21.15.59:0/3813979966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff698cdf0 0x55cff699cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.563+0000 7f8c43fff640 1 -- 172.21.15.59:0/3813979966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff699d190 msgr2=0x55cff699f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.563+0000 7f8c43fff640 1 --2- 172.21.15.59:0/3813979966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff699d190 0x55cff699f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.563+0000 7f8c497fa640 1 --2- 172.21.15.59:0/3836505019 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8c380b52e0 0x7f8c380b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.563+0000 7f8c43fff640 1 -- 172.21.15.59:0/3813979966 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff6650650 con 0x55cff698c4d0 2024-09-10T21:22:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.563+0000 7f8c4b7fe640 1 --2- 172.21.15.59:0/3836505019 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8c380b52e0 0x7f8c380b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.563+0000 7f8c497fa640 1 -- 172.21.15.59:0/3836505019 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8c44107110 con 0x7f8c4c109150 2024-09-10T21:22:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.563+0000 7f8c43fff640 1 --2- 172.21.15.59:0/3813979966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698c4d0 0x55cff698c8b0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400bc20 tx=0x7f8c34004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c451b16e8edbaa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.564+0000 7f8c41ffb640 1 -- 172.21.15.59:0/3813979966 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c34005020 con 0x55cff698c4d0 2024-09-10T21:22:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.564+0000 7f8c41ffb640 1 -- 172.21.15.59:0/3813979966 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c34005670 con 0x55cff698c4d0 2024-09-10T21:22:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.564+0000 7f8c41ffb640 1 -- 172.21.15.59:0/3813979966 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c340106c0 con 0x55cff698c4d0 2024-09-10T21:22:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.564+0000 7f8c54311740 1 -- 172.21.15.59:0/3813979966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698c4d0 msgr2=0x55cff698c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.564+0000 7f8c4b7fe640 1 --2- 172.21.15.59:0/3836505019 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8c380b52e0 0x7f8c380b77a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x55cff6990710 tx=0x7f8c3c00b5a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.564+0000 7f8c54311740 1 --2- 172.21.15.59:0/3813979966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698c4d0 0x55cff698c8b0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400bc20 tx=0x7f8c34004250 comp rx=0 tx=0).stop 2024-09-10T21:22:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.565+0000 7f8c54311740 1 -- 172.21.15.59:0/3813979966 shutdown_connections 2024-09-10T21:22:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.565+0000 7f8c54311740 1 --2- 172.21.15.59:0/3813979966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff699d190 0x55cff699f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.565+0000 7f8c54311740 1 --2- 172.21.15.59:0/3813979966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff698cdf0 0x55cff699cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.565+0000 7f8c54311740 1 --2- 172.21.15.59:0/3813979966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698c4d0 0x55cff698c8b0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.565+0000 7f8c54311740 1 -- 172.21.15.59:0/3813979966 >> 172.21.15.59:0/3813979966 conn(0x55cff698a300 msgr2=0x55cff698b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.565+0000 7f8c54311740 1 -- 172.21.15.59:0/3813979966 shutdown_connections 2024-09-10T21:22:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.565+0000 7f8c54311740 1 -- 172.21.15.59:0/3813979966 wait complete. 2024-09-10T21:22:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.565+0000 7f8c54311740 1 -- start start 2024-09-10T21:22:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.565+0000 7f8c54311740 1 Processor -- start 2024-09-10T21:22:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.565+0000 7f8c54311740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff698c4d0 0x55cff699c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.565+0000 7f8c54311740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 0x55cff6999e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.566+0000 7f8c54311740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff699d190 0x55cff699a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.566+0000 7f8c54311740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cff6753700 con 0x55cff698cdf0 2024-09-10T21:22:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.566+0000 7f8c54311740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cff688d160 con 0x55cff699d190 2024-09-10T21:22:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.566+0000 7f8c54311740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cff699fde0 con 0x55cff698c4d0 2024-09-10T21:22:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.566+0000 7f8c54311740 10 client.0 _ll_register_callbacks cb 0x55cff68a69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.566+0000 7f8c43fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 0x55cff6999e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.566+0000 7f8c43fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 0x55cff6999e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47086/0 (socket says 172.21.15.59:47086) 2024-09-10T21:22:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.566+0000 7f8c43fff640 1 -- 172.21.15.59:0/69601213 learned_addr learned my addr 172.21.15.59:0/69601213 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.566+0000 7f8c4b7fe640 1 --2- 172.21.15.59:0/69601213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff698c4d0 0x55cff699c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.566+0000 7f8c4bfff640 1 --2- 172.21.15.59:0/69601213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff699d190 0x55cff699a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.566+0000 7f8c43fff640 1 -- 172.21.15.59:0/69601213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff698c4d0 msgr2=0x55cff699c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.566+0000 7f8c43fff640 1 --2- 172.21.15.59:0/69601213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff698c4d0 0x55cff699c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.566+0000 7f8c43fff640 1 -- 172.21.15.59:0/69601213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff699d190 msgr2=0x55cff699a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.566+0000 7f8c43fff640 1 --2- 172.21.15.59:0/69601213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff699d190 0x55cff699a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.566+0000 7f8c43fff640 1 -- 172.21.15.59:0/69601213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cff68bac90 con 0x55cff698cdf0 2024-09-10T21:22:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.566+0000 7f8c43fff640 1 --2- 172.21.15.59:0/69601213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 0x55cff6999e10 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8c34006010 tx=0x7f8c3400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8deaed41bd53768c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.566+0000 7f8c2affd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:22:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.567+0000 7f8c2affd640 1 -- 172.21.15.59:0/69601213 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c34004e20 con 0x55cff698cdf0 2024-09-10T21:22:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.567+0000 7f8c54311740 1 -- 172.21.15.59:0/69601213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c34005670 con 0x55cff698cdf0 2024-09-10T21:22:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.567+0000 7f8c2affd640 1 -- 172.21.15.59:0/69601213 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8c34005020 con 0x55cff698cdf0 2024-09-10T21:22:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.567+0000 7f8c2affd640 1 -- 172.21.15.59:0/69601213 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8c3402f020 con 0x55cff698cdf0 2024-09-10T21:22:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.567+0000 7f8c54311740 10 client.17010 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.567+0000 7f8c54311740 1 -- 172.21.15.59:0/69601213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cff69ab680 con 0x55cff698cdf0 2024-09-10T21:22:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.567+0000 7f8c2affd640 1 -- 172.21.15.59:0/69601213 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c34005670 con 0x55cff698cdf0 2024-09-10T21:22:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.567+0000 7f8c2affd640 1 -- 172.21.15.59:0/69601213 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8c34020c40 con 0x55cff698cdf0 2024-09-10T21:22:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.567+0000 7f8c54311740 10 client.17010 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.567+0000 7f8c54311740 10 client.17010 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:22:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.567+0000 7f8c54311740 20 client.17010 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.567+0000 7f8c54311740 1 --2- 172.21.15.59:0/69601213 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55cff69ac9d0 0x55cff69aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.567+0000 7f8c54311740 4 client.17010 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:22:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.567+0000 7f8c54311740 1 -- 172.21.15.59:0/69601213 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cff6904df0 con 0x55cff69ac9d0 2024-09-10T21:22:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.568+0000 7f8c4b7fe640 1 --2- 172.21.15.59:0/69601213 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55cff69ac9d0 0x55cff69aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.568+0000 7f8c4b7fe640 1 --2- 172.21.15.59:0/69601213 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55cff69ac9d0 0x55cff69aedc0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=76d4354ff0a11b42 server_cookie=1d6cbbf7259e5be1 in_seq=0 out_seq=0 2024-09-10T21:22:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.568+0000 7f8c2affd640 10 client.17010 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:22:13.579 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:13 smithi192 ceph-mon[35363]: pgmap v548: 97 pgs: 97 active+clean; 4.7 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:22:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.569+0000 7f8c2affd640 1 -- 172.21.15.59:0/69601213 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cff6904df0 con 0x55cff69ac9d0 2024-09-10T21:22:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.569+0000 7f8c2affd640 10 client.17010 handle_command_reply: tid=0 2024-09-10T21:22:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.569+0000 7f8c54311740 1 client.17010 shutdown 2024-09-10T21:22:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.569+0000 7f8c54311740 1 -- 172.21.15.59:0/69601213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 msgr2=0x55cff6999e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.569+0000 7f8c54311740 1 --2- 172.21.15.59:0/69601213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 0x55cff6999e10 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8c34006010 tx=0x7f8c3400bf40 comp rx=0 tx=0).stop 2024-09-10T21:22:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.569+0000 7f8c54311740 1 -- 172.21.15.59:0/69601213 shutdown_connections 2024-09-10T21:22:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.569+0000 7f8c54311740 1 --2- 172.21.15.59:0/69601213 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55cff69ac9d0 0x55cff69aedc0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.569+0000 7f8c54311740 1 --2- 172.21.15.59:0/69601213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff699d190 0x55cff699a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.569+0000 7f8c54311740 1 --2- 172.21.15.59:0/69601213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 0x55cff6999e10 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.569+0000 7f8c2affd640 0 client.17010 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:22:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.569+0000 7f8c54311740 1 --2- 172.21.15.59:0/69601213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff698c4d0 0x55cff699c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.569+0000 7f8c54311740 1 -- 172.21.15.59:0/69601213 >> 172.21.15.59:0/69601213 conn(0x55cff698a300 msgr2=0x55cff698fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.569+0000 7f8c54311740 1 -- 172.21.15.59:0/69601213 shutdown_connections 2024-09-10T21:22:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.569+0000 7f8c54311740 1 -- 172.21.15.59:0/69601213 wait complete. 2024-09-10T21:22:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.569+0000 7f8c54311740 20 client.17010 trim_cache size 0 max 16384 2024-09-10T21:22:13.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.583+0000 7f8c54311740 1 Processor -- start 2024-09-10T21:22:13.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.583+0000 7f8c54311740 1 -- start start 2024-09-10T21:22:13.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.583+0000 7f8c54311740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff698c4d0 0x55cff699a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:13.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.583+0000 7f8c54311740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 0x55cff69b4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:13.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.583+0000 7f8c54311740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff699d190 0x55cff69b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:13.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.583+0000 7f8c54311740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c1ac070 con 0x55cff698cdf0 2024-09-10T21:22:13.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.583+0000 7f8c54311740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c1adbb0 con 0x55cff698c4d0 2024-09-10T21:22:13.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.583+0000 7f8c54311740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c1ac740 con 0x55cff699d190 2024-09-10T21:22:13.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.583+0000 7f8c43fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 0x55cff69b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:13.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.583+0000 7f8c43fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 0x55cff69b4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47096/0 (socket says 172.21.15.59:47096) 2024-09-10T21:22:13.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.583+0000 7f8c43fff640 1 -- 172.21.15.59:0/324615674 learned_addr learned my addr 172.21.15.59:0/324615674 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:13.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.583+0000 7f8c4b7fe640 1 --2- 172.21.15.59:0/324615674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff698c4d0 0x55cff699a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:13.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.583+0000 7f8c4bfff640 1 --2- 172.21.15.59:0/324615674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff699d190 0x55cff69b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:13.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.583+0000 7f8c43fff640 1 -- 172.21.15.59:0/324615674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff699d190 msgr2=0x55cff69b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:13.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.583+0000 7f8c43fff640 1 --2- 172.21.15.59:0/324615674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff699d190 0x55cff69b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.583+0000 7f8c43fff640 1 -- 172.21.15.59:0/324615674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff698c4d0 msgr2=0x55cff699a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:13.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.583+0000 7f8c43fff640 1 --2- 172.21.15.59:0/324615674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff698c4d0 0x55cff699a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.583+0000 7f8c43fff640 1 -- 172.21.15.59:0/324615674 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff699fc90 con 0x55cff698cdf0 2024-09-10T21:22:13.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.583+0000 7f8c4b7fe640 1 --2- 172.21.15.59:0/324615674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff698c4d0 0x55cff699a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:22:13.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.584+0000 7f8c43fff640 1 --2- 172.21.15.59:0/324615674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 0x55cff69b4550 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f8c34004410 tx=0x7f8c340107d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28471d630898d43b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:13.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.584+0000 7f8c417fa640 1 -- 172.21.15.59:0/324615674 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c34004000 con 0x55cff698cdf0 2024-09-10T21:22:13.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.584+0000 7f8c417fa640 1 -- 172.21.15.59:0/324615674 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c340041a0 con 0x55cff698cdf0 2024-09-10T21:22:13.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.584+0000 7f8c417fa640 1 -- 172.21.15.59:0/324615674 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c34005420 con 0x55cff698cdf0 2024-09-10T21:22:13.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.584+0000 7f8c54311740 1 -- 172.21.15.59:0/324615674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 msgr2=0x55cff69b4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:13.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.584+0000 7f8c54311740 1 --2- 172.21.15.59:0/324615674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 0x55cff69b4550 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f8c34004410 tx=0x7f8c340107d0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.584+0000 7f8c54311740 1 -- 172.21.15.59:0/324615674 shutdown_connections 2024-09-10T21:22:13.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.584+0000 7f8c54311740 1 --2- 172.21.15.59:0/324615674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff699d190 0x55cff69b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.584+0000 7f8c54311740 1 --2- 172.21.15.59:0/324615674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 0x55cff69b4550 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.584+0000 7f8c54311740 1 --2- 172.21.15.59:0/324615674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff698c4d0 0x55cff699a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.584+0000 7f8c54311740 1 -- 172.21.15.59:0/324615674 >> 172.21.15.59:0/324615674 conn(0x55cff698a300 msgr2=0x55cff6999bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:13.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.584+0000 7f8c54311740 1 -- 172.21.15.59:0/324615674 shutdown_connections 2024-09-10T21:22:13.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.584+0000 7f8c54311740 1 -- 172.21.15.59:0/324615674 wait complete. 2024-09-10T21:22:13.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.585+0000 7f8c54311740 1 -- start start 2024-09-10T21:22:13.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.585+0000 7f8c54311740 1 Processor -- start 2024-09-10T21:22:13.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.585+0000 7f8c54311740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff698c4d0 0x55cff69a5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:13.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.585+0000 7f8c54311740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 0x55cff69b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:13.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.585+0000 7f8c54311740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff699d190 0x55cff69b4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:13.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.585+0000 7f8c54311740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c1ad4e0 con 0x55cff698cdf0 2024-09-10T21:22:13.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.585+0000 7f8c54311740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c1ace10 con 0x55cff698c4d0 2024-09-10T21:22:13.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.585+0000 7f8c54311740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8c4c1aa050 con 0x55cff699d190 2024-09-10T21:22:13.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.585+0000 7f8c54311740 10 client.0 _ll_register_callbacks cb 0x7f8c3c00b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:13.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.585+0000 7f8c43fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 0x55cff69b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:13.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.585+0000 7f8c43fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 0x55cff69b42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47106/0 (socket says 172.21.15.59:47106) 2024-09-10T21:22:13.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.585+0000 7f8c43fff640 1 -- 172.21.15.59:0/2000800297 learned_addr learned my addr 172.21.15.59:0/2000800297 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:13.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.586+0000 7f8c4bfff640 1 --2- 172.21.15.59:0/2000800297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff699d190 0x55cff69b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:13.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.586+0000 7f8c4b7fe640 1 --2- 172.21.15.59:0/2000800297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff698c4d0 0x55cff69a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:13.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.586+0000 7f8c43fff640 1 -- 172.21.15.59:0/2000800297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff699d190 msgr2=0x55cff69b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:13.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.586+0000 7f8c43fff640 1 --2- 172.21.15.59:0/2000800297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff699d190 0x55cff69b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.586+0000 7f8c43fff640 1 -- 172.21.15.59:0/2000800297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff698c4d0 msgr2=0x55cff69a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:13.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.586+0000 7f8c43fff640 1 --2- 172.21.15.59:0/2000800297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff698c4d0 0x55cff69a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.586+0000 7f8c43fff640 1 -- 172.21.15.59:0/2000800297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cff6a18750 con 0x55cff698cdf0 2024-09-10T21:22:13.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.586+0000 7f8c43fff640 1 --2- 172.21.15.59:0/2000800297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 0x55cff69b42f0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f8c34005080 tx=0x7f8c3400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fbfd4b7f74f600f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:13.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.586+0000 7f8c2affd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:22:13.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.586+0000 7f8c2affd640 1 -- 172.21.15.59:0/2000800297 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c34010a50 con 0x55cff698cdf0 2024-09-10T21:22:13.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.586+0000 7f8c2affd640 1 -- 172.21.15.59:0/2000800297 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8c34010bf0 con 0x55cff698cdf0 2024-09-10T21:22:13.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.586+0000 7f8c54311740 1 -- 172.21.15.59:0/2000800297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c340041a0 con 0x55cff698cdf0 2024-09-10T21:22:13.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.586+0000 7f8c2affd640 1 -- 172.21.15.59:0/2000800297 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8c34010e10 con 0x55cff698cdf0 2024-09-10T21:22:13.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.586+0000 7f8c54311740 10 client.17016 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:13.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.586+0000 7f8c54311740 1 -- 172.21.15.59:0/2000800297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cff6a198f0 con 0x55cff698cdf0 2024-09-10T21:22:13.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.587+0000 7f8c2affd640 1 -- 172.21.15.59:0/2000800297 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c340041a0 con 0x55cff698cdf0 2024-09-10T21:22:13.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.587+0000 7f8c2affd640 1 -- 172.21.15.59:0/2000800297 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8c34020820 con 0x55cff698cdf0 2024-09-10T21:22:13.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.587+0000 7f8c54311740 10 client.17016 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:13.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.587+0000 7f8c54311740 10 client.17016 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:22:13.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.587+0000 7f8c54311740 20 client.17016 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:13.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.587+0000 7f8c54311740 1 --2- 172.21.15.59:0/2000800297 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55cff6a19f70 0x55cff6a1c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:13.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.587+0000 7f8c54311740 4 client.17016 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:22:13.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.587+0000 7f8c54311740 1 -- 172.21.15.59:0/2000800297 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cff69008a0 con 0x55cff6a19f70 2024-09-10T21:22:13.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.587+0000 7f8c4b7fe640 1 --2- 172.21.15.59:0/2000800297 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55cff6a19f70 0x55cff6a1c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:13.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.588+0000 7f8c2affd640 10 client.17016 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:22:13.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.588+0000 7f8c4b7fe640 1 --2- 172.21.15.59:0/2000800297 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55cff6a19f70 0x55cff6a1c390 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=87a3cb750678057f server_cookie=55baed986f9f161e in_seq=0 out_seq=0 2024-09-10T21:22:13.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.588+0000 7f8c2affd640 1 -- 172.21.15.59:0/2000800297 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cff69008a0 con 0x55cff6a19f70 2024-09-10T21:22:13.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.588+0000 7f8c2affd640 10 client.17016 handle_command_reply: tid=0 2024-09-10T21:22:13.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.588+0000 7f8c54311740 1 client.17016 shutdown 2024-09-10T21:22:13.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.588+0000 7f8c54311740 1 -- 172.21.15.59:0/2000800297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 msgr2=0x55cff69b42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:13.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.588+0000 7f8c54311740 1 --2- 172.21.15.59:0/2000800297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 0x55cff69b42f0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f8c34005080 tx=0x7f8c3400b390 comp rx=0 tx=0).stop 2024-09-10T21:22:13.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.588+0000 7f8c54311740 1 -- 172.21.15.59:0/2000800297 shutdown_connections 2024-09-10T21:22:13.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.588+0000 7f8c54311740 1 --2- 172.21.15.59:0/2000800297 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55cff6a19f70 0x55cff6a1c390 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.588+0000 7f8c54311740 1 --2- 172.21.15.59:0/2000800297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cff699d190 0x55cff69b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.588+0000 7f8c54311740 1 --2- 172.21.15.59:0/2000800297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff698cdf0 0x55cff69b42f0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.588+0000 7f8c54311740 1 --2- 172.21.15.59:0/2000800297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cff698c4d0 0x55cff69a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.588+0000 7f8c2affd640 0 client.17016 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:22:13.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.588+0000 7f8c54311740 1 -- 172.21.15.59:0/2000800297 >> 172.21.15.59:0/2000800297 conn(0x55cff698a300 msgr2=0x55cff698f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:13.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.588+0000 7f8c54311740 1 -- 172.21.15.59:0/2000800297 shutdown_connections 2024-09-10T21:22:13.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.588+0000 7f8c54311740 1 -- 172.21.15.59:0/2000800297 wait complete. 2024-09-10T21:22:13.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.588+0000 7f8c54311740 20 client.17016 trim_cache size 0 max 16384 2024-09-10T21:22:13.597 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:22:13.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.589+0000 7f8c51f3c640 1 -- 172.21.15.59:0/3836505019 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8c380b52e0 msgr2=0x7f8c380b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:13.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.589+0000 7f8c51f3c640 1 --2- 172.21.15.59:0/3836505019 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8c380b52e0 0x7f8c380b77a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x55cff6990710 tx=0x7f8c3c00b5a0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.589+0000 7f8c51f3c640 1 -- 172.21.15.59:0/3836505019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4c109150 msgr2=0x7f8c4c19eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:13.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.589+0000 7f8c51f3c640 1 --2- 172.21.15.59:0/3836505019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4c109150 0x7f8c4c19eb40 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f8c44005cc0 tx=0x7f8c4402f380 comp rx=0 tx=0).stop 2024-09-10T21:22:13.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.589+0000 7f8c51f3c640 1 -- 172.21.15.59:0/3836505019 shutdown_connections 2024-09-10T21:22:13.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.589+0000 7f8c51f3c640 1 --2- 172.21.15.59:0/3836505019 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8c380b52e0 0x7f8c380b77a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.589+0000 7f8c51f3c640 1 --2- 172.21.15.59:0/3836505019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4c109150 0x7f8c4c19eb40 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.589+0000 7f8c51f3c640 1 --2- 172.21.15.59:0/3836505019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c4c1087d0 0x7f8c4c1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.589+0000 7f8c51f3c640 1 --2- 172.21.15.59:0/3836505019 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8c4c102dc0 0x7f8c4c199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:13.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.589+0000 7f8c51f3c640 1 -- 172.21.15.59:0/3836505019 >> 172.21.15.59:0/3836505019 conn(0x7f8c4c0fe830 msgr2=0x7f8c4c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:13.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.589+0000 7f8c51f3c640 1 -- 172.21.15.59:0/3836505019 shutdown_connections 2024-09-10T21:22:13.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:13.589+0000 7f8c51f3c640 1 -- 172.21.15.59:0/3836505019 wait complete. 2024-09-10T21:22:14.358 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:22:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:22:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.075+0000 7f4f49180640 1 -- 172.21.15.59:0/1634856198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f44101cd0 msgr2=0x7f4f441020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.075+0000 7f4f49180640 1 --2- 172.21.15.59:0/1634856198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f44101cd0 0x7f4f441020b0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f4f34009900 tx=0x7f4f3402a3f0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.075+0000 7f4f49180640 1 -- 172.21.15.59:0/1634856198 shutdown_connections 2024-09-10T21:22:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.075+0000 7f4f49180640 1 --2- 172.21.15.59:0/1634856198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f44108060 0x7f4f4410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.075+0000 7f4f49180640 1 --2- 172.21.15.59:0/1634856198 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f441076e0 0x7f4f44107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.075+0000 7f4f49180640 1 --2- 172.21.15.59:0/1634856198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f44101cd0 0x7f4f441020b0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.075+0000 7f4f49180640 1 -- 172.21.15.59:0/1634856198 >> 172.21.15.59:0/1634856198 conn(0x7f4f440fd700 msgr2=0x7f4f440ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.075+0000 7f4f49180640 1 -- 172.21.15.59:0/1634856198 shutdown_connections 2024-09-10T21:22:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.075+0000 7f4f49180640 1 -- 172.21.15.59:0/1634856198 wait complete. 2024-09-10T21:22:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.076+0000 7f4f49180640 1 Processor -- start 2024-09-10T21:22:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.076+0000 7f4f49180640 1 -- start start 2024-09-10T21:22:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.076+0000 7f4f49180640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f44101cd0 0x7f4f4419b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.076+0000 7f4f49180640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f441076e0 0x7f4f4419bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.076+0000 7f4f49180640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f44108060 0x7f4f441a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.076+0000 7f4f49180640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4f44111d60 con 0x7f4f44108060 2024-09-10T21:22:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.076+0000 7f4f49180640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4f44111be0 con 0x7f4f441076e0 2024-09-10T21:22:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.076+0000 7f4f49180640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4f44111ee0 con 0x7f4f44101cd0 2024-09-10T21:22:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.076+0000 7f4f4359e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f44108060 0x7f4f441a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.076+0000 7f4f4359e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f44108060 0x7f4f441a0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47118/0 (socket says 172.21.15.59:47118) 2024-09-10T21:22:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.076+0000 7f4f4359e640 1 -- 172.21.15.59:0/4076476305 learned_addr learned my addr 172.21.15.59:0/4076476305 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.076+0000 7f4f4259c640 1 --2- 172.21.15.59:0/4076476305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f441076e0 0x7f4f4419bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.076+0000 7f4f42d9d640 1 --2- 172.21.15.59:0/4076476305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f44101cd0 0x7f4f4419b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.077+0000 7f4f4359e640 1 -- 172.21.15.59:0/4076476305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f44101cd0 msgr2=0x7f4f4419b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.077+0000 7f4f4359e640 1 --2- 172.21.15.59:0/4076476305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f44101cd0 0x7f4f4419b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.077+0000 7f4f4359e640 1 -- 172.21.15.59:0/4076476305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f441076e0 msgr2=0x7f4f4419bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.077+0000 7f4f4359e640 1 --2- 172.21.15.59:0/4076476305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f441076e0 0x7f4f4419bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.077+0000 7f4f4359e640 1 -- 172.21.15.59:0/4076476305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f441a16a0 con 0x7f4f44108060 2024-09-10T21:22:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.077+0000 7f4f42d9d640 1 --2- 172.21.15.59:0/4076476305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f44101cd0 0x7f4f4419b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:22:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.077+0000 7f4f4359e640 1 --2- 172.21.15.59:0/4076476305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f44108060 0x7f4f441a0ed0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009fd0 tx=0x7f4f3c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.077+0000 7f4f2bfff640 1 -- 172.21.15.59:0/4076476305 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c011830 con 0x7f4f44108060 2024-09-10T21:22:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.077+0000 7f4f49180640 1 -- 172.21.15.59:0/4076476305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f441a1990 con 0x7f4f44108060 2024-09-10T21:22:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.077+0000 7f4f2bfff640 1 -- 172.21.15.59:0/4076476305 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f3c016070 con 0x7f4f44108060 2024-09-10T21:22:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.077+0000 7f4f2bfff640 1 -- 172.21.15.59:0/4076476305 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c010de0 con 0x7f4f44108060 2024-09-10T21:22:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.077+0000 7f4f49180640 1 -- 172.21.15.59:0/4076476305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f441a80d0 con 0x7f4f44108060 2024-09-10T21:22:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.079+0000 7f4f4b555740 1 Processor -- start 2024-09-10T21:22:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.080+0000 7f4f2bfff640 1 -- 172.21.15.59:0/4076476305 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f4f3c01b460 con 0x7f4f44108060 2024-09-10T21:22:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.080+0000 7f4f4b555740 1 -- start start 2024-09-10T21:22:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.080+0000 7f4f4b555740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c844d0 0x562e38c848b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.080+0000 7f4f4b555740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c84df0 0x562e38c90840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.080+0000 7f4f4b555740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c90d80 0x562e38c93170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.080+0000 7f4f4b555740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562e38bfaea0 con 0x562e38c844d0 2024-09-10T21:22:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.080+0000 7f4f4b555740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562e38bea2d0 con 0x562e38c84df0 2024-09-10T21:22:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.080+0000 7f4f4b555740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562e38bee0e0 con 0x562e38c90d80 2024-09-10T21:22:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.080+0000 7f4f4259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c844d0 0x562e38c848b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.080+0000 7f4f4259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c844d0 0x562e38c848b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47130/0 (socket says 172.21.15.59:47130) 2024-09-10T21:22:15.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.080+0000 7f4f4259c640 1 -- 172.21.15.59:0/2415682513 learned_addr learned my addr 172.21.15.59:0/2415682513 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:15.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.081+0000 7f4f42d9d640 1 --2- 172.21.15.59:0/2415682513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c84df0 0x562e38c90840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:15.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.081+0000 7f4f4259c640 1 -- 172.21.15.59:0/2415682513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c90d80 msgr2=0x562e38c93170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:15.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.081+0000 7f4f4259c640 1 --2- 172.21.15.59:0/2415682513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c90d80 0x562e38c93170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.081+0000 7f4f4259c640 1 -- 172.21.15.59:0/2415682513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c84df0 msgr2=0x562e38c90840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:15.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.081+0000 7f4f4259c640 1 --2- 172.21.15.59:0/2415682513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c84df0 0x562e38c90840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.081+0000 7f4f2bfff640 1 --2- 172.21.15.59:0/4076476305 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4f2c0b52e0 0x7f4f2c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:15.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.081+0000 7f4f4259c640 1 -- 172.21.15.59:0/2415682513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e38948650 con 0x562e38c844d0 2024-09-10T21:22:15.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.081+0000 7f4f42d9d640 1 --2- 172.21.15.59:0/2415682513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c84df0 0x562e38c90840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:22:15.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.081+0000 7f4f2bfff640 1 -- 172.21.15.59:0/4076476305 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4f3c0e5210 con 0x7f4f44108060 2024-09-10T21:22:15.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.081+0000 7f4f4259c640 1 --2- 172.21.15.59:0/4076476305 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4f2c0b52e0 0x7f4f2c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:15.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.081+0000 7f4f4259c640 1 --2- 172.21.15.59:0/2415682513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c844d0 0x562e38c848b0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009fc0 tx=0x7f4f3800a990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5227c064195ba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:15.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.081+0000 7f4f297fa640 1 -- 172.21.15.59:0/2415682513 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f38010bd0 con 0x562e38c844d0 2024-09-10T21:22:15.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.081+0000 7f4f297fa640 1 -- 172.21.15.59:0/2415682513 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f38010d70 con 0x562e38c844d0 2024-09-10T21:22:15.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.081+0000 7f4f297fa640 1 -- 172.21.15.59:0/2415682513 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f380223a0 con 0x562e38c844d0 2024-09-10T21:22:15.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.082+0000 7f4f4b555740 1 -- 172.21.15.59:0/2415682513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c844d0 msgr2=0x562e38c848b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:15.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.082+0000 7f4f4259c640 1 --2- 172.21.15.59:0/4076476305 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4f2c0b52e0 0x7f4f2c0b77a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4f3801f000 tx=0x7f4f38022000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:15.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.082+0000 7f4f4b555740 1 --2- 172.21.15.59:0/2415682513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c844d0 0x562e38c848b0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009fc0 tx=0x7f4f3800a990 comp rx=0 tx=0).stop 2024-09-10T21:22:15.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.082+0000 7f4f4b555740 1 -- 172.21.15.59:0/2415682513 shutdown_connections 2024-09-10T21:22:15.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.082+0000 7f4f4b555740 1 --2- 172.21.15.59:0/2415682513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c90d80 0x562e38c93170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.082+0000 7f4f4b555740 1 --2- 172.21.15.59:0/2415682513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c84df0 0x562e38c90840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.082+0000 7f4f4b555740 1 --2- 172.21.15.59:0/2415682513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c844d0 0x562e38c848b0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.082+0000 7f4f4b555740 1 -- 172.21.15.59:0/2415682513 >> 172.21.15.59:0/2415682513 conn(0x562e38c82300 msgr2=0x562e38c834a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:15.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.082+0000 7f4f4b555740 1 -- 172.21.15.59:0/2415682513 shutdown_connections 2024-09-10T21:22:15.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.082+0000 7f4f4b555740 1 -- 172.21.15.59:0/2415682513 wait complete. 2024-09-10T21:22:15.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.082+0000 7f4f4b555740 1 -- start start 2024-09-10T21:22:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.082+0000 7f4f4b555740 1 Processor -- start 2024-09-10T21:22:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.083+0000 7f4f4b555740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c844d0 0x562e38c90700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.083+0000 7f4f4b555740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c84df0 0x562e38c8db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.083+0000 7f4f4b555740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c90d80 0x562e38c8e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.083+0000 7f4f4b555740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562e38a4b700 con 0x562e38c90d80 2024-09-10T21:22:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.083+0000 7f4f4b555740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562e38b85160 con 0x562e38c844d0 2024-09-10T21:22:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.083+0000 7f4f4b555740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562e38c93a00 con 0x562e38c84df0 2024-09-10T21:22:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.083+0000 7f4f4b555740 10 client.0 _ll_register_callbacks cb 0x562e38b9e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.083+0000 7f4f4359e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c90d80 0x562e38c8e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.083+0000 7f4f42d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c844d0 0x562e38c90700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.083+0000 7f4f4359e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c90d80 0x562e38c8e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47144/0 (socket says 172.21.15.59:47144) 2024-09-10T21:22:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.083+0000 7f4f4359e640 1 -- 172.21.15.59:0/477155212 learned_addr learned my addr 172.21.15.59:0/477155212 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:15.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.083+0000 7f4f4259c640 1 --2- 172.21.15.59:0/477155212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c84df0 0x562e38c8db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.083+0000 7f4f4359e640 1 -- 172.21.15.59:0/477155212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c84df0 msgr2=0x562e38c8db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.083+0000 7f4f4359e640 1 --2- 172.21.15.59:0/477155212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c84df0 0x562e38c8db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.083+0000 7f4f4359e640 1 -- 172.21.15.59:0/477155212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c844d0 msgr2=0x562e38c90700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.083+0000 7f4f4359e640 1 --2- 172.21.15.59:0/477155212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c844d0 0x562e38c90700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.083+0000 7f4f4359e640 1 -- 172.21.15.59:0/477155212 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e38bb2c90 con 0x562e38c90d80 2024-09-10T21:22:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.083+0000 7f4f4359e640 1 --2- 172.21.15.59:0/477155212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c90d80 0x562e38c8e220 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c004810 tx=0x7f4f3c0ab400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5c9d762d5c4732 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.083+0000 7f4f26ff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:22:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.084+0000 7f4f26ff5640 1 -- 172.21.15.59:0/477155212 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c0ab9a0 con 0x562e38c90d80 2024-09-10T21:22:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.084+0000 7f4f26ff5640 1 -- 172.21.15.59:0/477155212 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4f3c0aac00 con 0x562e38c90d80 2024-09-10T21:22:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.084+0000 7f4f4b555740 1 -- 172.21.15.59:0/477155212 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f38010d70 con 0x562e38c90d80 2024-09-10T21:22:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.084+0000 7f4f26ff5640 1 -- 172.21.15.59:0/477155212 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4f3c0b0480 con 0x562e38c90d80 2024-09-10T21:22:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.084+0000 7f4f4b555740 10 client.17028 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:15.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.084+0000 7f4f4b555740 1 -- 172.21.15.59:0/477155212 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562e38c9f3a0 con 0x562e38c90d80 2024-09-10T21:22:15.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.084+0000 7f4f26ff5640 1 -- 172.21.15.59:0/477155212 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f38010d70 con 0x562e38c90d80 2024-09-10T21:22:15.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.084+0000 7f4f26ff5640 1 -- 172.21.15.59:0/477155212 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4f3c0aa700 con 0x562e38c90d80 2024-09-10T21:22:15.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.084+0000 7f4f4b555740 10 client.17028 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:15.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.084+0000 7f4f4b555740 10 client.17028 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:22:15.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.084+0000 7f4f4b555740 20 client.17028 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:15.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.084+0000 7f4f4b555740 1 --2- 172.21.15.59:0/477155212 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x562e38ca08b0 0x562e38ca2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:15.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.084+0000 7f4f4b555740 4 client.17028 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:22:15.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.084+0000 7f4f4b555740 1 -- 172.21.15.59:0/477155212 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e38bfcdf0 con 0x562e38ca08b0 2024-09-10T21:22:15.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.085+0000 7f4f42d9d640 1 --2- 172.21.15.59:0/477155212 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x562e38ca08b0 0x562e38ca2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:15.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.085+0000 7f4f26ff5640 10 client.17028 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:22:15.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.085+0000 7f4f42d9d640 1 --2- 172.21.15.59:0/477155212 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x562e38ca08b0 0x562e38ca2ca0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=317af2a837b6d29d server_cookie=39741c848628ca08 in_seq=0 out_seq=0 2024-09-10T21:22:15.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.086+0000 7f4f26ff5640 1 -- 172.21.15.59:0/477155212 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562e38bfcdf0 con 0x562e38ca08b0 2024-09-10T21:22:15.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.086+0000 7f4f26ff5640 10 client.17028 handle_command_reply: tid=0 2024-09-10T21:22:15.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.086+0000 7f4f4b555740 1 client.17028 shutdown 2024-09-10T21:22:15.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.086+0000 7f4f4b555740 1 -- 172.21.15.59:0/477155212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c90d80 msgr2=0x562e38c8e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:15.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.086+0000 7f4f4b555740 1 --2- 172.21.15.59:0/477155212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c90d80 0x562e38c8e220 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c004810 tx=0x7f4f3c0ab400 comp rx=0 tx=0).stop 2024-09-10T21:22:15.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.086+0000 7f4f4b555740 1 -- 172.21.15.59:0/477155212 shutdown_connections 2024-09-10T21:22:15.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.086+0000 7f4f4b555740 1 --2- 172.21.15.59:0/477155212 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x562e38ca08b0 0x562e38ca2ca0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.086+0000 7f4f4b555740 1 --2- 172.21.15.59:0/477155212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c90d80 0x562e38c8e220 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.086+0000 7f4f4b555740 1 --2- 172.21.15.59:0/477155212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c84df0 0x562e38c8db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.086+0000 7f4f4b555740 1 --2- 172.21.15.59:0/477155212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c844d0 0x562e38c90700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.086+0000 7f4f26ff5640 0 client.17028 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:22:15.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.086+0000 7f4f4b555740 1 -- 172.21.15.59:0/477155212 >> 172.21.15.59:0/477155212 conn(0x562e38c82300 msgr2=0x562e38c87ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:15.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.086+0000 7f4f4b555740 1 -- 172.21.15.59:0/477155212 shutdown_connections 2024-09-10T21:22:15.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.086+0000 7f4f4b555740 1 -- 172.21.15.59:0/477155212 wait complete. 2024-09-10T21:22:15.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.086+0000 7f4f4b555740 20 client.17028 trim_cache size 0 max 16384 2024-09-10T21:22:15.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.099+0000 7f4f4b555740 1 Processor -- start 2024-09-10T21:22:15.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.099+0000 7f4f4b555740 1 -- start start 2024-09-10T21:22:15.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.100+0000 7f4f4b555740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c844d0 0x562e38c9cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:15.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.100+0000 7f4f4b555740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c84df0 0x562e38c8f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:15.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.100+0000 7f4f4b555740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c90d80 0x562e38c92170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:15.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.100+0000 7f4f4b555740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4f441b0640 con 0x562e38c84df0 2024-09-10T21:22:15.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.100+0000 7f4f4b555740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4f441b2180 con 0x562e38c844d0 2024-09-10T21:22:15.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.100+0000 7f4f4b555740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4f441b0d10 con 0x562e38c90d80 2024-09-10T21:22:15.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.100+0000 7f4f4259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c84df0 0x562e38c8f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:15.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.100+0000 7f4f4359e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c90d80 0x562e38c92170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:15.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.100+0000 7f4f42d9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c844d0 0x562e38c9cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:15.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.100+0000 7f4f4359e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c90d80 0x562e38c92170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:58660/0 (socket says 172.21.15.59:58660) 2024-09-10T21:22:15.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.100+0000 7f4f4359e640 1 -- 172.21.15.59:0/2553548636 learned_addr learned my addr 172.21.15.59:0/2553548636 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:15.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.101+0000 7f4f42d9d640 1 -- 172.21.15.59:0/2553548636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c90d80 msgr2=0x562e38c92170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:15.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.101+0000 7f4f42d9d640 1 --2- 172.21.15.59:0/2553548636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c90d80 0x562e38c92170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.101+0000 7f4f42d9d640 1 -- 172.21.15.59:0/2553548636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c84df0 msgr2=0x562e38c8f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:15.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.101+0000 7f4f42d9d640 1 --2- 172.21.15.59:0/2553548636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c84df0 0x562e38c8f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.101+0000 7f4f42d9d640 1 -- 172.21.15.59:0/2553548636 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e38c8c050 con 0x562e38c844d0 2024-09-10T21:22:15.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.101+0000 7f4f4359e640 1 --2- 172.21.15.59:0/2553548636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c90d80 0x562e38c92170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:22:15.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.101+0000 7f4f4259c640 1 --2- 172.21.15.59:0/2553548636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c84df0 0x562e38c8f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:22:15.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.101+0000 7f4f42d9d640 1 --2- 172.21.15.59:0/2553548636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c844d0 0x562e38c9cc30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4f34006010 tx=0x7f4f34009610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e348d9837a60e5c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:15.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.101+0000 7f4f28ff9640 1 -- 172.21.15.59:0/2553548636 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34035040 con 0x562e38c844d0 2024-09-10T21:22:15.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.101+0000 7f4f28ff9640 1 -- 172.21.15.59:0/2553548636 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f34031950 con 0x562e38c844d0 2024-09-10T21:22:15.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.101+0000 7f4f28ff9640 1 -- 172.21.15.59:0/2553548636 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f340047a0 con 0x562e38c844d0 2024-09-10T21:22:15.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.102+0000 7f4f4b555740 1 -- 172.21.15.59:0/2553548636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c844d0 msgr2=0x562e38c9cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:15.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.102+0000 7f4f4b555740 1 --2- 172.21.15.59:0/2553548636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c844d0 0x562e38c9cc30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4f34006010 tx=0x7f4f34009610 comp rx=0 tx=0).stop 2024-09-10T21:22:15.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.102+0000 7f4f4b555740 1 -- 172.21.15.59:0/2553548636 shutdown_connections 2024-09-10T21:22:15.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.102+0000 7f4f4b555740 1 --2- 172.21.15.59:0/2553548636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c90d80 0x562e38c92170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.102+0000 7f4f4b555740 1 --2- 172.21.15.59:0/2553548636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c84df0 0x562e38c8f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.102+0000 7f4f4b555740 1 --2- 172.21.15.59:0/2553548636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c844d0 0x562e38c9cc30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.102+0000 7f4f4b555740 1 -- 172.21.15.59:0/2553548636 >> 172.21.15.59:0/2553548636 conn(0x562e38c82300 msgr2=0x562e38c8f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:15.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.102+0000 7f4f4b555740 1 -- 172.21.15.59:0/2553548636 shutdown_connections 2024-09-10T21:22:15.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.102+0000 7f4f4b555740 1 -- 172.21.15.59:0/2553548636 wait complete. 2024-09-10T21:22:15.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.102+0000 7f4f4b555740 1 -- start start 2024-09-10T21:22:15.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.102+0000 7f4f4b555740 1 Processor -- start 2024-09-10T21:22:15.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.103+0000 7f4f4b555740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c844d0 0x562e38c98f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:15.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.103+0000 7f4f4b555740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c84df0 0x562e38c99490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:15.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.103+0000 7f4f4b555740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c90d80 0x562e38c93c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:15.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.103+0000 7f4f4b555740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4f441b1ab0 con 0x562e38c90d80 2024-09-10T21:22:15.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.103+0000 7f4f4b555740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4f441b13e0 con 0x562e38c84df0 2024-09-10T21:22:15.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.103+0000 7f4f4b555740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4f441ae620 con 0x562e38c844d0 2024-09-10T21:22:15.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.103+0000 7f4f4b555740 10 client.0 _ll_register_callbacks cb 0x7f4f3c010700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:15.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.103+0000 7f4f4359e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c90d80 0x562e38c93c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:15.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.103+0000 7f4f4359e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c90d80 0x562e38c93c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47162/0 (socket says 172.21.15.59:47162) 2024-09-10T21:22:15.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.103+0000 7f4f4359e640 1 -- 172.21.15.59:0/1146346282 learned_addr learned my addr 172.21.15.59:0/1146346282 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:15.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.103+0000 7f4f42d9d640 1 --2- 172.21.15.59:0/1146346282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c844d0 0x562e38c98f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:15.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.103+0000 7f4f4259c640 1 --2- 172.21.15.59:0/1146346282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c84df0 0x562e38c99490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:15.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.103+0000 7f4f4359e640 1 -- 172.21.15.59:0/1146346282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c844d0 msgr2=0x562e38c98f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:15.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.103+0000 7f4f4359e640 1 --2- 172.21.15.59:0/1146346282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c844d0 0x562e38c98f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.103+0000 7f4f4359e640 1 -- 172.21.15.59:0/1146346282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c84df0 msgr2=0x562e38c99490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:15.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.103+0000 7f4f4359e640 1 --2- 172.21.15.59:0/1146346282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c84df0 0x562e38c99490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.103+0000 7f4f4359e640 1 -- 172.21.15.59:0/1146346282 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e38c944a0 con 0x562e38c90d80 2024-09-10T21:22:15.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.103+0000 7f4f4359e640 1 --2- 172.21.15.59:0/1146346282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c90d80 0x562e38c93c70 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0b1660 tx=0x7f4f3c0092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8664566cb13cd642 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:15.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.103+0000 7f4f26ff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:22:15.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.104+0000 7f4f26ff5640 1 -- 172.21.15.59:0/1146346282 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c06f060 con 0x562e38c90d80 2024-09-10T21:22:15.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.104+0000 7f4f26ff5640 1 -- 172.21.15.59:0/1146346282 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4f3c0aa670 con 0x562e38c90d80 2024-09-10T21:22:15.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.104+0000 7f4f4b555740 1 -- 172.21.15.59:0/1146346282 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562e38bf88a0 con 0x562e38c90d80 2024-09-10T21:22:15.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.104+0000 7f4f26ff5640 1 -- 172.21.15.59:0/1146346282 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4f3c0ab770 con 0x562e38c90d80 2024-09-10T21:22:15.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.104+0000 7f4f4b555740 10 client.17034 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:15.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.104+0000 7f4f4b555740 1 -- 172.21.15.59:0/1146346282 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562e38d16b00 con 0x562e38c90d80 2024-09-10T21:22:15.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.104+0000 7f4f26ff5640 1 -- 172.21.15.59:0/1146346282 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562e38bf88a0 con 0x562e38c90d80 2024-09-10T21:22:15.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.104+0000 7f4f26ff5640 1 -- 172.21.15.59:0/1146346282 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4f3c0a72f0 con 0x562e38c90d80 2024-09-10T21:22:15.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.104+0000 7f4f4b555740 10 client.17034 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:15.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.104+0000 7f4f4b555740 10 client.17034 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:22:15.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.104+0000 7f4f4b555740 20 client.17034 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:15.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.104+0000 7f4f4b555740 1 --2- 172.21.15.59:0/1146346282 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x562e38d170f0 0x562e38d19510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:15.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.104+0000 7f4f4b555740 4 client.17034 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:22:15.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.104+0000 7f4f4b555740 1 -- 172.21.15.59:0/1146346282 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562e38bf5cd0 con 0x562e38d170f0 2024-09-10T21:22:15.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.104+0000 7f4f42d9d640 1 --2- 172.21.15.59:0/1146346282 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x562e38d170f0 0x562e38d19510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:15.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.105+0000 7f4f42d9d640 1 --2- 172.21.15.59:0/1146346282 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x562e38d170f0 0x562e38d19510 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ea0fd09ec0572b8a server_cookie=956de61f6e89086d in_seq=0 out_seq=0 2024-09-10T21:22:15.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.105+0000 7f4f26ff5640 10 client.17034 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:22:15.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.105+0000 7f4f26ff5640 1 -- 172.21.15.59:0/1146346282 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562e38bf5cd0 con 0x562e38d170f0 2024-09-10T21:22:15.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.105+0000 7f4f26ff5640 10 client.17034 handle_command_reply: tid=0 2024-09-10T21:22:15.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.105+0000 7f4f4b555740 1 client.17034 shutdown 2024-09-10T21:22:15.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.105+0000 7f4f4b555740 1 -- 172.21.15.59:0/1146346282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c90d80 msgr2=0x562e38c93c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:15.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.105+0000 7f4f4b555740 1 --2- 172.21.15.59:0/1146346282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c90d80 0x562e38c93c70 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0b1660 tx=0x7f4f3c0092a0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.105+0000 7f4f4b555740 1 -- 172.21.15.59:0/1146346282 shutdown_connections 2024-09-10T21:22:15.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.105+0000 7f4f4b555740 1 --2- 172.21.15.59:0/1146346282 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x562e38d170f0 0x562e38d19510 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.105+0000 7f4f4b555740 1 --2- 172.21.15.59:0/1146346282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e38c90d80 0x562e38c93c70 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.105+0000 7f4f26ff5640 0 client.17034 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:22:15.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.105+0000 7f4f4b555740 1 --2- 172.21.15.59:0/1146346282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e38c84df0 0x562e38c99490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.105+0000 7f4f4b555740 1 --2- 172.21.15.59:0/1146346282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e38c844d0 0x562e38c98f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.105+0000 7f4f4b555740 1 -- 172.21.15.59:0/1146346282 >> 172.21.15.59:0/1146346282 conn(0x562e38c82300 msgr2=0x562e38c8f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:15.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.105+0000 7f4f4b555740 1 -- 172.21.15.59:0/1146346282 shutdown_connections 2024-09-10T21:22:15.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.105+0000 7f4f4b555740 1 -- 172.21.15.59:0/1146346282 wait complete. 2024-09-10T21:22:15.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.105+0000 7f4f4b555740 20 client.17034 trim_cache size 0 max 16384 2024-09-10T21:22:15.125 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:22:15.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.106+0000 7f4f49180640 1 -- 172.21.15.59:0/4076476305 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4f2c0b52e0 msgr2=0x7f4f2c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:15.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.106+0000 7f4f49180640 1 --2- 172.21.15.59:0/4076476305 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4f2c0b52e0 0x7f4f2c0b77a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4f3801f000 tx=0x7f4f38022000 comp rx=0 tx=0).stop 2024-09-10T21:22:15.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.106+0000 7f4f49180640 1 -- 172.21.15.59:0/4076476305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f44108060 msgr2=0x7f4f441a0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:15.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.106+0000 7f4f49180640 1 --2- 172.21.15.59:0/4076476305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f44108060 0x7f4f441a0ed0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009fd0 tx=0x7f4f3c00b8e0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.106+0000 7f4f49180640 1 -- 172.21.15.59:0/4076476305 shutdown_connections 2024-09-10T21:22:15.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.106+0000 7f4f49180640 1 --2- 172.21.15.59:0/4076476305 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4f2c0b52e0 0x7f4f2c0b77a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.106+0000 7f4f49180640 1 --2- 172.21.15.59:0/4076476305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f44108060 0x7f4f441a0ed0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.106+0000 7f4f49180640 1 --2- 172.21.15.59:0/4076476305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f441076e0 0x7f4f4419bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.106+0000 7f4f49180640 1 --2- 172.21.15.59:0/4076476305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f44101cd0 0x7f4f4419b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:15.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.106+0000 7f4f49180640 1 -- 172.21.15.59:0/4076476305 >> 172.21.15.59:0/4076476305 conn(0x7f4f440fd700 msgr2=0x7f4f4406b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:15.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.106+0000 7f4f49180640 1 -- 172.21.15.59:0/4076476305 shutdown_connections 2024-09-10T21:22:15.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:15.106+0000 7f4f49180640 1 -- 172.21.15.59:0/4076476305 wait complete. 2024-09-10T21:22:15.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:15 smithi059 ceph-mon[30888]: pgmap v549: 97 pgs: 97 active+clean; 4.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:22:15.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:15 smithi154 ceph-mon[35041]: pgmap v549: 97 pgs: 97 active+clean; 4.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:22:15.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:15 smithi192 ceph-mon[35363]: pgmap v549: 97 pgs: 97 active+clean; 4.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:22:15.813 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:22:16.072 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:22:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.577+0000 7fd539a96640 1 -- 172.21.15.59:0/2365421204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd534104530 msgr2=0x7fd53410cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.577+0000 7fd539a96640 1 --2- 172.21.15.59:0/2365421204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd534104530 0x7fd53410cb10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009900 tx=0x7fd51c02a410 comp rx=0 tx=0).stop 2024-09-10T21:22:16.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.577+0000 7fd539a96640 1 -- 172.21.15.59:0/2365421204 shutdown_connections 2024-09-10T21:22:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.577+0000 7fd539a96640 1 --2- 172.21.15.59:0/2365421204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd53410d0e0 0x7fd53410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.577+0000 7fd539a96640 1 --2- 172.21.15.59:0/2365421204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd534104530 0x7fd53410cb10 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.577+0000 7fd539a96640 1 --2- 172.21.15.59:0/2365421204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd534103b30 0x7fd534103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.577+0000 7fd539a96640 1 -- 172.21.15.59:0/2365421204 >> 172.21.15.59:0/2365421204 conn(0x7fd5340fd700 msgr2=0x7fd5340ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.577+0000 7fd539a96640 1 -- 172.21.15.59:0/2365421204 shutdown_connections 2024-09-10T21:22:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.577+0000 7fd539a96640 1 -- 172.21.15.59:0/2365421204 wait complete. 2024-09-10T21:22:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.577+0000 7fd539a96640 1 Processor -- start 2024-09-10T21:22:16.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.578+0000 7fd539a96640 1 -- start start 2024-09-10T21:22:16.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.578+0000 7fd539a96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd534103b30 0x7fd5341019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:16.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.578+0000 7fd539a96640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd534104530 0x7fd534101ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:16.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.578+0000 7fd539a96640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd53410d0e0 0x7fd534102430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:16.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.578+0000 7fd539a96640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd534112db0 con 0x7fd53410d0e0 2024-09-10T21:22:16.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.578+0000 7fd539a96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd534112c30 con 0x7fd534103b30 2024-09-10T21:22:16.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.578+0000 7fd539a96640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd534112f30 con 0x7fd534104530 2024-09-10T21:22:16.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.578+0000 7fd533fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd53410d0e0 0x7fd534102430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:16.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.578+0000 7fd533fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd53410d0e0 0x7fd534102430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47182/0 (socket says 172.21.15.59:47182) 2024-09-10T21:22:16.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.578+0000 7fd533fff640 1 -- 172.21.15.59:0/1230390990 learned_addr learned my addr 172.21.15.59:0/1230390990 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:16.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.578+0000 7fd5337fe640 1 --2- 172.21.15.59:0/1230390990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd534103b30 0x7fd5341019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:16.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.578+0000 7fd52affd640 1 --2- 172.21.15.59:0/1230390990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd534104530 0x7fd534101ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:16.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.578+0000 7fd533fff640 1 -- 172.21.15.59:0/1230390990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd534104530 msgr2=0x7fd534101ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.578+0000 7fd533fff640 1 --2- 172.21.15.59:0/1230390990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd534104530 0x7fd534101ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.578+0000 7fd533fff640 1 -- 172.21.15.59:0/1230390990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd534103b30 msgr2=0x7fd5341019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.578+0000 7fd533fff640 1 --2- 172.21.15.59:0/1230390990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd534103b30 0x7fd5341019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.579+0000 7fd533fff640 1 -- 172.21.15.59:0/1230390990 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5341a7610 con 0x7fd53410d0e0 2024-09-10T21:22:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.579+0000 7fd533fff640 1 --2- 172.21.15.59:0/1230390990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd53410d0e0 0x7fd534102430 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00eaa0 tx=0x7fd52c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.579+0000 7fd5317fa640 1 -- 172.21.15.59:0/1230390990 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52c004d20 con 0x7fd53410d0e0 2024-09-10T21:22:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.579+0000 7fd5317fa640 1 -- 172.21.15.59:0/1230390990 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd52c005020 con 0x7fd53410d0e0 2024-09-10T21:22:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.579+0000 7fd539a96640 1 -- 172.21.15.59:0/1230390990 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5341a7900 con 0x7fd53410d0e0 2024-09-10T21:22:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.579+0000 7fd5317fa640 1 -- 172.21.15.59:0/1230390990 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0116b0 con 0x7fd53410d0e0 2024-09-10T21:22:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.579+0000 7fd539a96640 1 -- 172.21.15.59:0/1230390990 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5341a7e60 con 0x7fd53410d0e0 2024-09-10T21:22:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.581+0000 7fd53be6b740 1 Processor -- start 2024-09-10T21:22:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.581+0000 7fd5317fa640 1 -- 172.21.15.59:0/1230390990 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd52c00f040 con 0x7fd53410d0e0 2024-09-10T21:22:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.582+0000 7fd53be6b740 1 -- start start 2024-09-10T21:22:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.582+0000 7fd53be6b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564d0f0 0x56430564d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.582+0000 7fd53be6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56430564da10 0x564305659460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.582+0000 7fd53be6b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5643056599a0 0x56430565bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.582+0000 7fd53be6b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5643055c3ea0 con 0x56430564da10 2024-09-10T21:22:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.582+0000 7fd53be6b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5643055b32d0 con 0x56430564d0f0 2024-09-10T21:22:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.582+0000 7fd53be6b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5643055b70e0 con 0x5643056599a0 2024-09-10T21:22:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.582+0000 7fd5337fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56430564da10 0x564305659460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.582+0000 7fd5337fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56430564da10 0x564305659460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47184/0 (socket says 172.21.15.59:47184) 2024-09-10T21:22:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.582+0000 7fd5337fe640 1 -- 172.21.15.59:0/109595254 learned_addr learned my addr 172.21.15.59:0/109595254 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.582+0000 7fd52affd640 1 --2- 172.21.15.59:0/109595254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564d0f0 0x56430564d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.582+0000 7fd52affd640 1 --2- 172.21.15.59:0/109595254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5643056599a0 0x56430565bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.582+0000 7fd5337fe640 1 -- 172.21.15.59:0/109595254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5643056599a0 msgr2=0x56430565bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.582+0000 7fd5337fe640 1 --2- 172.21.15.59:0/109595254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5643056599a0 0x56430565bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.582+0000 7fd5337fe640 1 -- 172.21.15.59:0/109595254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564d0f0 msgr2=0x56430564d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.582+0000 7fd5337fe640 1 --2- 172.21.15.59:0/109595254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564d0f0 0x56430564d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.582+0000 7fd5337fe640 1 -- 172.21.15.59:0/109595254 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564305311650 con 0x56430564da10 2024-09-10T21:22:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.582+0000 7fd52affd640 1 --2- 172.21.15.59:0/109595254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564d0f0 0x56430564d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:22:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.583+0000 7fd5337fe640 1 --2- 172.21.15.59:0/109595254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56430564da10 0x564305659460 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fd52400ad00 tx=0x7fd52400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16915f88ea14680 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.583+0000 7fd5317fa640 1 --2- 172.21.15.59:0/1230390990 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd5200b5360 0x7fd5200b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.583+0000 7fd529ffb640 1 -- 172.21.15.59:0/109595254 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52401d070 con 0x56430564da10 2024-09-10T21:22:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.583+0000 7fd52affd640 1 --2- 172.21.15.59:0/1230390990 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd5200b5360 0x7fd5200b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.583+0000 7fd529ffb640 1 -- 172.21.15.59:0/109595254 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd524018af0 con 0x56430564da10 2024-09-10T21:22:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.583+0000 7fd529ffb640 1 -- 172.21.15.59:0/109595254 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524010b90 con 0x56430564da10 2024-09-10T21:22:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.583+0000 7fd5317fa640 1 -- 172.21.15.59:0/1230390990 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd52c0e5910 con 0x7fd53410d0e0 2024-09-10T21:22:16.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.584+0000 7fd53be6b740 1 -- 172.21.15.59:0/109595254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56430564da10 msgr2=0x564305659460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:16.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.584+0000 7fd52affd640 1 --2- 172.21.15.59:0/1230390990 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd5200b5360 0x7fd5200b7820 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd51c005ab0 tx=0x7fd51c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.584+0000 7fd53be6b740 1 --2- 172.21.15.59:0/109595254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56430564da10 0x564305659460 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fd52400ad00 tx=0x7fd52400f790 comp rx=0 tx=0).stop 2024-09-10T21:22:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.584+0000 7fd53be6b740 1 -- 172.21.15.59:0/109595254 shutdown_connections 2024-09-10T21:22:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.584+0000 7fd53be6b740 1 --2- 172.21.15.59:0/109595254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5643056599a0 0x56430565bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.584+0000 7fd53be6b740 1 --2- 172.21.15.59:0/109595254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56430564da10 0x564305659460 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.584+0000 7fd53be6b740 1 --2- 172.21.15.59:0/109595254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564d0f0 0x56430564d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.584+0000 7fd53be6b740 1 -- 172.21.15.59:0/109595254 >> 172.21.15.59:0/109595254 conn(0x56430564af20 msgr2=0x56430564c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.584+0000 7fd53be6b740 1 -- 172.21.15.59:0/109595254 shutdown_connections 2024-09-10T21:22:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.584+0000 7fd53be6b740 1 -- 172.21.15.59:0/109595254 wait complete. 2024-09-10T21:22:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.584+0000 7fd53be6b740 1 -- start start 2024-09-10T21:22:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.585+0000 7fd53be6b740 1 Processor -- start 2024-09-10T21:22:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.585+0000 7fd53be6b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564d0f0 0x564305659330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.585+0000 7fd53be6b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56430564da10 0x564305656780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:16.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.585+0000 7fd53be6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643056599a0 0x564305656e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.585+0000 7fd53be6b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564305414700 con 0x5643056599a0 2024-09-10T21:22:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.585+0000 7fd53be6b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56430554e160 con 0x56430564d0f0 2024-09-10T21:22:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.585+0000 7fd53be6b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56430565c620 con 0x56430564da10 2024-09-10T21:22:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.585+0000 7fd53be6b740 10 client.0 _ll_register_callbacks cb 0x5643055679e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.585+0000 7fd533fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643056599a0 0x564305656e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.585+0000 7fd533fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643056599a0 0x564305656e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47198/0 (socket says 172.21.15.59:47198) 2024-09-10T21:22:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.585+0000 7fd533fff640 1 -- 172.21.15.59:0/3647513561 learned_addr learned my addr 172.21.15.59:0/3647513561 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.585+0000 7fd5337fe640 1 --2- 172.21.15.59:0/3647513561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564d0f0 0x564305659330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.585+0000 7fd52affd640 1 --2- 172.21.15.59:0/3647513561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56430564da10 0x564305656780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.585+0000 7fd533fff640 1 -- 172.21.15.59:0/3647513561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56430564da10 msgr2=0x564305656780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.585+0000 7fd533fff640 1 --2- 172.21.15.59:0/3647513561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56430564da10 0x564305656780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.585+0000 7fd533fff640 1 -- 172.21.15.59:0/3647513561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564d0f0 msgr2=0x564305659330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.585+0000 7fd533fff640 1 --2- 172.21.15.59:0/3647513561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564d0f0 0x564305659330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.585+0000 7fd533fff640 1 -- 172.21.15.59:0/3647513561 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56430557bc90 con 0x5643056599a0 2024-09-10T21:22:16.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.586+0000 7fd533fff640 1 --2- 172.21.15.59:0/3647513561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643056599a0 0x564305656e50 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fd52c0a9370 tx=0x7fd52c0ab930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4cbb8332265372 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:16.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.586+0000 7fd512ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:22:16.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.586+0000 7fd512ffd640 1 -- 172.21.15.59:0/3647513561 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52c01f040 con 0x5643056599a0 2024-09-10T21:22:16.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.586+0000 7fd512ffd640 1 -- 172.21.15.59:0/3647513561 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd52c0051d0 con 0x5643056599a0 2024-09-10T21:22:16.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.586+0000 7fd53be6b740 1 -- 172.21.15.59:0/3647513561 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd524018af0 con 0x5643056599a0 2024-09-10T21:22:16.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.586+0000 7fd512ffd640 1 -- 172.21.15.59:0/3647513561 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd52c0b0be0 con 0x5643056599a0 2024-09-10T21:22:16.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.586+0000 7fd53be6b740 10 client.17046 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:16.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.586+0000 7fd53be6b740 1 -- 172.21.15.59:0/3647513561 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564305667f60 con 0x5643056599a0 2024-09-10T21:22:16.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.586+0000 7fd512ffd640 1 -- 172.21.15.59:0/3647513561 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd524018af0 con 0x5643056599a0 2024-09-10T21:22:16.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.586+0000 7fd512ffd640 1 -- 172.21.15.59:0/3647513561 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd52c0cdae0 con 0x5643056599a0 2024-09-10T21:22:16.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.586+0000 7fd53be6b740 10 client.17046 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:16.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.586+0000 7fd53be6b740 10 client.17046 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:22:16.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.586+0000 7fd53be6b740 20 client.17046 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.586+0000 7fd53be6b740 1 --2- 172.21.15.59:0/3647513561 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5643056693c0 0x56430566b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.586+0000 7fd53be6b740 4 client.17046 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:22:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.586+0000 7fd53be6b740 1 -- 172.21.15.59:0/3647513561 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643055c5df0 con 0x5643056693c0 2024-09-10T21:22:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.587+0000 7fd5337fe640 1 --2- 172.21.15.59:0/3647513561 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5643056693c0 0x56430566b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.587+0000 7fd5337fe640 1 --2- 172.21.15.59:0/3647513561 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5643056693c0 0x56430566b820 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9f95af37b9f0bd6d server_cookie=dbaeb0cd64fbb5bb in_seq=0 out_seq=0 2024-09-10T21:22:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.587+0000 7fd512ffd640 10 client.17046 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:22:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.588+0000 7fd512ffd640 1 -- 172.21.15.59:0/3647513561 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5643055c5df0 con 0x5643056693c0 2024-09-10T21:22:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.588+0000 7fd512ffd640 10 client.17046 handle_command_reply: tid=0 2024-09-10T21:22:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.588+0000 7fd53be6b740 1 client.17046 shutdown 2024-09-10T21:22:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.588+0000 7fd53be6b740 1 -- 172.21.15.59:0/3647513561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643056599a0 msgr2=0x564305656e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.588+0000 7fd53be6b740 1 --2- 172.21.15.59:0/3647513561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643056599a0 0x564305656e50 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fd52c0a9370 tx=0x7fd52c0ab930 comp rx=0 tx=0).stop 2024-09-10T21:22:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.588+0000 7fd53be6b740 1 -- 172.21.15.59:0/3647513561 shutdown_connections 2024-09-10T21:22:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.588+0000 7fd53be6b740 1 --2- 172.21.15.59:0/3647513561 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5643056693c0 0x56430566b820 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.588+0000 7fd53be6b740 1 --2- 172.21.15.59:0/3647513561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643056599a0 0x564305656e50 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.588+0000 7fd53be6b740 1 --2- 172.21.15.59:0/3647513561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56430564da10 0x564305656780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.588+0000 7fd512ffd640 0 client.17046 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:22:16.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.588+0000 7fd53be6b740 1 --2- 172.21.15.59:0/3647513561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564d0f0 0x564305659330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.588+0000 7fd53be6b740 1 -- 172.21.15.59:0/3647513561 >> 172.21.15.59:0/3647513561 conn(0x56430564af20 msgr2=0x564305650ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:16.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.588+0000 7fd53be6b740 1 -- 172.21.15.59:0/3647513561 shutdown_connections 2024-09-10T21:22:16.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.588+0000 7fd53be6b740 1 -- 172.21.15.59:0/3647513561 wait complete. 2024-09-10T21:22:16.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.588+0000 7fd53be6b740 20 client.17046 trim_cache size 0 max 16384 2024-09-10T21:22:16.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.602+0000 7fd53be6b740 1 Processor -- start 2024-09-10T21:22:16.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.602+0000 7fd53be6b740 1 -- start start 2024-09-10T21:22:16.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.602+0000 7fd53be6b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56430564d0f0 0x564305655c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:16.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.602+0000 7fd53be6b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564da10 0x564305665850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:16.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.602+0000 7fd53be6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643056599a0 0x56430565ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:16.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.602+0000 7fd53be6b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd5341b0440 con 0x5643056599a0 2024-09-10T21:22:16.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.602+0000 7fd53be6b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd5341b1f80 con 0x56430564da10 2024-09-10T21:22:16.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.602+0000 7fd53be6b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd5341b0b10 con 0x56430564d0f0 2024-09-10T21:22:16.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.602+0000 7fd533fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643056599a0 0x56430565ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:16.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.602+0000 7fd5337fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56430564d0f0 0x564305655c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:16.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.602+0000 7fd533fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643056599a0 0x56430565ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47200/0 (socket says 172.21.15.59:47200) 2024-09-10T21:22:16.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.602+0000 7fd533fff640 1 -- 172.21.15.59:0/2584157305 learned_addr learned my addr 172.21.15.59:0/2584157305 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:16.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.602+0000 7fd52affd640 1 --2- 172.21.15.59:0/2584157305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564da10 0x564305665850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:16.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.602+0000 7fd533fff640 1 -- 172.21.15.59:0/2584157305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56430564d0f0 msgr2=0x564305655c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:16.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.602+0000 7fd533fff640 1 --2- 172.21.15.59:0/2584157305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56430564d0f0 0x564305655c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.602+0000 7fd533fff640 1 -- 172.21.15.59:0/2584157305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564da10 msgr2=0x564305665850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:16.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.602+0000 7fd533fff640 1 --2- 172.21.15.59:0/2584157305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564da10 0x564305665850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.602+0000 7fd533fff640 1 -- 172.21.15.59:0/2584157305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564305654c80 con 0x5643056599a0 2024-09-10T21:22:16.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.602+0000 7fd52affd640 1 --2- 172.21.15.59:0/2584157305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564da10 0x564305665850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:22:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.603+0000 7fd533fff640 1 --2- 172.21.15.59:0/2584157305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643056599a0 0x56430565ad90 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fd52c0abe00 tx=0x7fd52c004fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1978e38839aa53 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.603+0000 7fd5297fa640 1 -- 172.21.15.59:0/2584157305 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52c01f070 con 0x5643056599a0 2024-09-10T21:22:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.603+0000 7fd5297fa640 1 -- 172.21.15.59:0/2584157305 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd52c0b5690 con 0x5643056599a0 2024-09-10T21:22:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.603+0000 7fd5297fa640 1 -- 172.21.15.59:0/2584157305 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0cdae0 con 0x5643056599a0 2024-09-10T21:22:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.603+0000 7fd53be6b740 1 -- 172.21.15.59:0/2584157305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643056599a0 msgr2=0x56430565ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.603+0000 7fd53be6b740 1 --2- 172.21.15.59:0/2584157305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643056599a0 0x56430565ad90 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fd52c0abe00 tx=0x7fd52c004fb0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.603+0000 7fd53be6b740 1 -- 172.21.15.59:0/2584157305 shutdown_connections 2024-09-10T21:22:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.603+0000 7fd53be6b740 1 --2- 172.21.15.59:0/2584157305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643056599a0 0x56430565ad90 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.603+0000 7fd53be6b740 1 --2- 172.21.15.59:0/2584157305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564da10 0x564305665850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.603+0000 7fd53be6b740 1 --2- 172.21.15.59:0/2584157305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56430564d0f0 0x564305655c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.603+0000 7fd53be6b740 1 -- 172.21.15.59:0/2584157305 >> 172.21.15.59:0/2584157305 conn(0x56430564af20 msgr2=0x564305655000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.603+0000 7fd53be6b740 1 -- 172.21.15.59:0/2584157305 shutdown_connections 2024-09-10T21:22:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.603+0000 7fd53be6b740 1 -- 172.21.15.59:0/2584157305 wait complete. 2024-09-10T21:22:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.604+0000 7fd53be6b740 1 -- start start 2024-09-10T21:22:16.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.604+0000 7fd53be6b740 1 Processor -- start 2024-09-10T21:22:16.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.604+0000 7fd53be6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56430564d0f0 0x564305662040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:16.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.604+0000 7fd53be6b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564da10 0x56430565fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:16.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.604+0000 7fd53be6b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5643056599a0 0x564305660050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:16.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.604+0000 7fd53be6b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd5341b18b0 con 0x56430564d0f0 2024-09-10T21:22:16.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.604+0000 7fd53be6b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd5341b11e0 con 0x56430564da10 2024-09-10T21:22:16.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.604+0000 7fd53be6b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd5341ae420 con 0x5643056599a0 2024-09-10T21:22:16.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.604+0000 7fd5337fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56430564d0f0 0x564305662040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:16.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.604+0000 7fd5337fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56430564d0f0 0x564305662040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47210/0 (socket says 172.21.15.59:47210) 2024-09-10T21:22:16.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.604+0000 7fd5337fe640 1 -- 172.21.15.59:0/3823289238 learned_addr learned my addr 172.21.15.59:0/3823289238 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:16.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.604+0000 7fd53be6b740 10 client.0 _ll_register_callbacks cb 0x7fd52c0057c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:16.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.605+0000 7fd52affd640 1 --2- 172.21.15.59:0/3823289238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564da10 0x56430565fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:16.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.605+0000 7fd533fff640 1 --2- 172.21.15.59:0/3823289238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5643056599a0 0x564305660050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:16.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.605+0000 7fd5337fe640 1 -- 172.21.15.59:0/3823289238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5643056599a0 msgr2=0x564305660050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:16.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.605+0000 7fd5337fe640 1 --2- 172.21.15.59:0/3823289238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5643056599a0 0x564305660050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.605+0000 7fd5337fe640 1 -- 172.21.15.59:0/3823289238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564da10 msgr2=0x56430565fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:16.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.605+0000 7fd5337fe640 1 --2- 172.21.15.59:0/3823289238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564da10 0x56430565fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.605+0000 7fd5337fe640 1 -- 172.21.15.59:0/3823289238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564305660860 con 0x56430564d0f0 2024-09-10T21:22:16.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.605+0000 7fd52affd640 1 --2- 172.21.15.59:0/3823289238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564da10 0x56430565fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:22:16.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.605+0000 7fd5337fe640 1 --2- 172.21.15.59:0/3823289238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56430564d0f0 0x564305662040 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fd52400ac50 tx=0x7fd524010650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50bbd85ff6070529 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:16.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.605+0000 7fd512ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:22:16.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.605+0000 7fd512ffd640 1 -- 172.21.15.59:0/3823289238 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52401d040 con 0x56430564d0f0 2024-09-10T21:22:16.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.605+0000 7fd512ffd640 1 -- 172.21.15.59:0/3823289238 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd5240188d0 con 0x56430564d0f0 2024-09-10T21:22:16.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.605+0000 7fd53be6b740 1 -- 172.21.15.59:0/3823289238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd52c0b5690 con 0x56430564d0f0 2024-09-10T21:22:16.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.605+0000 7fd512ffd640 1 -- 172.21.15.59:0/3823289238 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd52403a070 con 0x56430564d0f0 2024-09-10T21:22:16.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.605+0000 7fd53be6b740 10 client.17052 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:16.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.605+0000 7fd53be6b740 1 -- 172.21.15.59:0/3823289238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5643056d7330 con 0x56430564d0f0 2024-09-10T21:22:16.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.606+0000 7fd512ffd640 1 -- 172.21.15.59:0/3823289238 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd52c0b5690 con 0x56430564d0f0 2024-09-10T21:22:16.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.606+0000 7fd512ffd640 1 -- 172.21.15.59:0/3823289238 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd524010ba0 con 0x56430564d0f0 2024-09-10T21:22:16.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.606+0000 7fd53be6b740 10 client.17052 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:16.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.606+0000 7fd53be6b740 10 client.17052 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:22:16.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.606+0000 7fd53be6b740 20 client.17052 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:16.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.606+0000 7fd53be6b740 1 --2- 172.21.15.59:0/3823289238 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5643056d77e0 0x5643056d9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:16.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.606+0000 7fd53be6b740 4 client.17052 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:22:16.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.606+0000 7fd53be6b740 1 -- 172.21.15.59:0/3823289238 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5643055c18a0 con 0x5643056d77e0 2024-09-10T21:22:16.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.606+0000 7fd52affd640 1 --2- 172.21.15.59:0/3823289238 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5643056d77e0 0x5643056d9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:16.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.606+0000 7fd52affd640 1 --2- 172.21.15.59:0/3823289238 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5643056d77e0 0x5643056d9c00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=daf9e21eaaf4ab11 server_cookie=6670e62562692704 in_seq=0 out_seq=0 2024-09-10T21:22:16.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.606+0000 7fd512ffd640 10 client.17052 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:22:16.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.607+0000 7fd512ffd640 1 -- 172.21.15.59:0/3823289238 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5643055c18a0 con 0x5643056d77e0 2024-09-10T21:22:16.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.607+0000 7fd512ffd640 10 client.17052 handle_command_reply: tid=0 2024-09-10T21:22:16.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.607+0000 7fd53be6b740 1 client.17052 shutdown 2024-09-10T21:22:16.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.607+0000 7fd53be6b740 1 -- 172.21.15.59:0/3823289238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56430564d0f0 msgr2=0x564305662040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.607+0000 7fd53be6b740 1 --2- 172.21.15.59:0/3823289238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56430564d0f0 0x564305662040 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fd52400ac50 tx=0x7fd524010650 comp rx=0 tx=0).stop 2024-09-10T21:22:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.607+0000 7fd53be6b740 1 -- 172.21.15.59:0/3823289238 shutdown_connections 2024-09-10T21:22:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.607+0000 7fd53be6b740 1 --2- 172.21.15.59:0/3823289238 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5643056d77e0 0x5643056d9c00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.607+0000 7fd53be6b740 1 --2- 172.21.15.59:0/3823289238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5643056599a0 0x564305660050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.607+0000 7fd53be6b740 1 --2- 172.21.15.59:0/3823289238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56430564da10 0x56430565fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.607+0000 7fd53be6b740 1 --2- 172.21.15.59:0/3823289238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56430564d0f0 0x564305662040 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.607+0000 7fd53be6b740 1 -- 172.21.15.59:0/3823289238 >> 172.21.15.59:0/3823289238 conn(0x56430564af20 msgr2=0x564305649750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.607+0000 7fd512ffd640 0 client.17052 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:22:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.607+0000 7fd53be6b740 1 -- 172.21.15.59:0/3823289238 shutdown_connections 2024-09-10T21:22:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.607+0000 7fd53be6b740 1 -- 172.21.15.59:0/3823289238 wait complete. 2024-09-10T21:22:16.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.607+0000 7fd53be6b740 20 client.17052 trim_cache size 0 max 16384 2024-09-10T21:22:16.618 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:22:16.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.608+0000 7fd539a96640 1 -- 172.21.15.59:0/1230390990 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd5200b5360 msgr2=0x7fd5200b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:16.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.608+0000 7fd539a96640 1 --2- 172.21.15.59:0/1230390990 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd5200b5360 0x7fd5200b7820 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd51c005ab0 tx=0x7fd51c000bc0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.608+0000 7fd539a96640 1 -- 172.21.15.59:0/1230390990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd53410d0e0 msgr2=0x7fd534102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:16.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.608+0000 7fd539a96640 1 --2- 172.21.15.59:0/1230390990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd53410d0e0 0x7fd534102430 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00eaa0 tx=0x7fd52c00eea0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.608+0000 7fd539a96640 1 -- 172.21.15.59:0/1230390990 shutdown_connections 2024-09-10T21:22:16.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.608+0000 7fd539a96640 1 --2- 172.21.15.59:0/1230390990 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd5200b5360 0x7fd5200b7820 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.608+0000 7fd539a96640 1 --2- 172.21.15.59:0/1230390990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd53410d0e0 0x7fd534102430 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.608+0000 7fd539a96640 1 --2- 172.21.15.59:0/1230390990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd534104530 0x7fd534101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.608+0000 7fd539a96640 1 --2- 172.21.15.59:0/1230390990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd534103b30 0x7fd5341019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:16.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.608+0000 7fd539a96640 1 -- 172.21.15.59:0/1230390990 >> 172.21.15.59:0/1230390990 conn(0x7fd5340fd700 msgr2=0x7fd5340fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:16.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.608+0000 7fd539a96640 1 -- 172.21.15.59:0/1230390990 shutdown_connections 2024-09-10T21:22:16.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:16.608+0000 7fd539a96640 1 -- 172.21.15.59:0/1230390990 wait complete. 2024-09-10T21:22:17.318 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:17 smithi059 ceph-mon[30888]: pgmap v550: 97 pgs: 97 active+clean; 4.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:22:17.345 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:22:17.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:17 smithi154 ceph-mon[35041]: pgmap v550: 97 pgs: 97 active+clean; 4.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:22:17.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:17 smithi192 ceph-mon[35363]: pgmap v550: 97 pgs: 97 active+clean; 4.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:22:17.605 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:22:18.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.085+0000 7f10a0d94640 1 -- 172.21.15.59:0/4190422210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c1087d0 msgr2=0x7f109c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.085+0000 7f10a0d94640 1 --2- 172.21.15.59:0/4190422210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c1087d0 0x7f109c108c10 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f1084009900 tx=0x7f108402a410 comp rx=0 tx=0).stop 2024-09-10T21:22:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.085+0000 7f10a0d94640 1 -- 172.21.15.59:0/4190422210 shutdown_connections 2024-09-10T21:22:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.085+0000 7f10a0d94640 1 --2- 172.21.15.59:0/4190422210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f109c109150 0x7f109c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.085+0000 7f10a0d94640 1 --2- 172.21.15.59:0/4190422210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c1087d0 0x7f109c108c10 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.085+0000 7f10a0d94640 1 --2- 172.21.15.59:0/4190422210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f109c102dc0 0x7f109c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.085+0000 7f10a0d94640 1 -- 172.21.15.59:0/4190422210 >> 172.21.15.59:0/4190422210 conn(0x7f109c0fe830 msgr2=0x7f109c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.085+0000 7f10a0d94640 1 -- 172.21.15.59:0/4190422210 shutdown_connections 2024-09-10T21:22:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.085+0000 7f10a0d94640 1 -- 172.21.15.59:0/4190422210 wait complete. 2024-09-10T21:22:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.086+0000 7f10a0d94640 1 Processor -- start 2024-09-10T21:22:18.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.086+0000 7f10a0d94640 1 -- start start 2024-09-10T21:22:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.086+0000 7f10a0d94640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f109c102dc0 0x7f109c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.086+0000 7f10a0d94640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f109c1087d0 0x7f109c199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.086+0000 7f10a0d94640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c109150 0x7f109c19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.086+0000 7f10a0d94640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f109c112e10 con 0x7f109c109150 2024-09-10T21:22:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.086+0000 7f10a0d94640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f109c112c90 con 0x7f109c1087d0 2024-09-10T21:22:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.086+0000 7f10a0d94640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f109c112f90 con 0x7f109c102dc0 2024-09-10T21:22:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.087+0000 7f109ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c109150 0x7f109c19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.087+0000 7f109ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c109150 0x7f109c19ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47232/0 (socket says 172.21.15.59:47232) 2024-09-10T21:22:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.087+0000 7f109ad9d640 1 -- 172.21.15.59:0/2261320303 learned_addr learned my addr 172.21.15.59:0/2261320303 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.087+0000 7f109a59c640 1 --2- 172.21.15.59:0/2261320303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f109c102dc0 0x7f109c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.087+0000 7f1093fff640 1 --2- 172.21.15.59:0/2261320303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f109c1087d0 0x7f109c199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.087+0000 7f109ad9d640 1 -- 172.21.15.59:0/2261320303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f109c102dc0 msgr2=0x7f109c199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:18.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.087+0000 7f109ad9d640 1 --2- 172.21.15.59:0/2261320303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f109c102dc0 0x7f109c199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.087+0000 7f109ad9d640 1 -- 172.21.15.59:0/2261320303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f109c1087d0 msgr2=0x7f109c199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.087+0000 7f109ad9d640 1 --2- 172.21.15.59:0/2261320303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f109c1087d0 0x7f109c199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.087+0000 7f109ad9d640 1 -- 172.21.15.59:0/2261320303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109c19f3b0 con 0x7f109c109150 2024-09-10T21:22:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.087+0000 7f109ad9d640 1 --2- 172.21.15.59:0/2261320303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c109150 0x7f109c19ebe0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f109400eaa0 tx=0x7f109400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.087+0000 7f10937fe640 1 -- 172.21.15.59:0/2261320303 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109400cdb0 con 0x7f109c109150 2024-09-10T21:22:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.087+0000 7f10a0d94640 1 -- 172.21.15.59:0/2261320303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f109c19f6a0 con 0x7f109c109150 2024-09-10T21:22:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.087+0000 7f10937fe640 1 -- 172.21.15.59:0/2261320303 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1094005020 con 0x7f109c109150 2024-09-10T21:22:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.087+0000 7f10937fe640 1 -- 172.21.15.59:0/2261320303 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10940116d0 con 0x7f109c109150 2024-09-10T21:22:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.087+0000 7f10a0d94640 1 -- 172.21.15.59:0/2261320303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f109c1a5d60 con 0x7f109c109150 2024-09-10T21:22:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.090+0000 7f10a3169740 1 Processor -- start 2024-09-10T21:22:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.090+0000 7f10937fe640 1 -- 172.21.15.59:0/2261320303 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f109400f040 con 0x7f109c109150 2024-09-10T21:22:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.090+0000 7f10a3169740 1 -- start start 2024-09-10T21:22:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.090+0000 7f10a3169740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc10f0 0x564b19fc14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.090+0000 7f10a3169740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc1a10 0x564b19fcd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f10a3169740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fcd9a0 0x564b19fcfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f10a3169740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564b19f37ea0 con 0x564b19fc1a10 2024-09-10T21:22:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f10a3169740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564b19f272d0 con 0x564b19fc10f0 2024-09-10T21:22:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f10a3169740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564b19f2b0e0 con 0x564b19fcd9a0 2024-09-10T21:22:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f109a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc1a10 0x564b19fcd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f109a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc1a10 0x564b19fcd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47234/0 (socket says 172.21.15.59:47234) 2024-09-10T21:22:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f109a59c640 1 -- 172.21.15.59:0/3298307919 learned_addr learned my addr 172.21.15.59:0/3298307919 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f1093fff640 1 --2- 172.21.15.59:0/3298307919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc10f0 0x564b19fc14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f1093fff640 1 --2- 172.21.15.59:0/3298307919 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fcd9a0 0x564b19fcfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f109a59c640 1 -- 172.21.15.59:0/3298307919 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fcd9a0 msgr2=0x564b19fcfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f109a59c640 1 --2- 172.21.15.59:0/3298307919 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fcd9a0 0x564b19fcfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f109a59c640 1 -- 172.21.15.59:0/3298307919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc10f0 msgr2=0x564b19fc14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f109a59c640 1 --2- 172.21.15.59:0/3298307919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc10f0 0x564b19fc14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f109a59c640 1 -- 172.21.15.59:0/3298307919 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b19c85650 con 0x564b19fc1a10 2024-09-10T21:22:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f1093fff640 1 --2- 172.21.15.59:0/3298307919 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fcd9a0 0x564b19fcfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:22:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f109a59c640 1 --2- 172.21.15.59:0/3298307919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc1a10 0x564b19fcd460 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f108c00bd10 tx=0x7f108c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8612e5ea6d1fca5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f10937fe640 1 --2- 172.21.15.59:0/2261320303 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f10880b52e0 0x7f10880b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f1090ff9640 1 -- 172.21.15.59:0/3298307919 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c004030 con 0x564b19fc1a10 2024-09-10T21:22:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f1093fff640 1 --2- 172.21.15.59:0/2261320303 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f10880b52e0 0x7f10880b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f1090ff9640 1 -- 172.21.15.59:0/3298307919 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f108c0035f0 con 0x564b19fc1a10 2024-09-10T21:22:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f1090ff9640 1 -- 172.21.15.59:0/3298307919 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c011770 con 0x564b19fc1a10 2024-09-10T21:22:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.091+0000 7f10937fe640 1 -- 172.21.15.59:0/2261320303 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f10940e5960 con 0x7f109c109150 2024-09-10T21:22:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.092+0000 7f1093fff640 1 --2- 172.21.15.59:0/2261320303 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f10880b52e0 0x7f10880b77a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1084031440 tx=0x7f1084005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.092+0000 7f10a3169740 1 -- 172.21.15.59:0/3298307919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc1a10 msgr2=0x564b19fcd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.092+0000 7f10a3169740 1 --2- 172.21.15.59:0/3298307919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc1a10 0x564b19fcd460 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f108c00bd10 tx=0x7f108c0107a0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.092+0000 7f10a3169740 1 -- 172.21.15.59:0/3298307919 shutdown_connections 2024-09-10T21:22:18.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.092+0000 7f10a3169740 1 --2- 172.21.15.59:0/3298307919 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fcd9a0 0x564b19fcfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.092+0000 7f10a3169740 1 --2- 172.21.15.59:0/3298307919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc1a10 0x564b19fcd460 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.092+0000 7f10a3169740 1 --2- 172.21.15.59:0/3298307919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc10f0 0x564b19fc14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.092+0000 7f10a3169740 1 -- 172.21.15.59:0/3298307919 >> 172.21.15.59:0/3298307919 conn(0x564b19fbef20 msgr2=0x564b19fc00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:18.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.092+0000 7f10a3169740 1 -- 172.21.15.59:0/3298307919 shutdown_connections 2024-09-10T21:22:18.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.092+0000 7f10a3169740 1 -- 172.21.15.59:0/3298307919 wait complete. 2024-09-10T21:22:18.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.093+0000 7f10a3169740 1 -- start start 2024-09-10T21:22:18.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.093+0000 7f10a3169740 1 Processor -- start 2024-09-10T21:22:18.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.093+0000 7f10a3169740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc10f0 0x564b19fcd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:18.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.093+0000 7f10a3169740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc1a10 0x564b19fca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:18.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.093+0000 7f10a3169740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fcd9a0 0x564b19fcaca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:18.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.093+0000 7f10a3169740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564b19d88700 con 0x564b19fc10f0 2024-09-10T21:22:18.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.093+0000 7f10a3169740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564b19ec2160 con 0x564b19fc1a10 2024-09-10T21:22:18.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.093+0000 7f10a3169740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564b19fd0620 con 0x564b19fcd9a0 2024-09-10T21:22:18.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.093+0000 7f10a3169740 10 client.0 _ll_register_callbacks cb 0x564b19edb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:18.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.093+0000 7f109a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc10f0 0x564b19fcd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:18.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.093+0000 7f109a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc10f0 0x564b19fcd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47236/0 (socket says 172.21.15.59:47236) 2024-09-10T21:22:18.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.093+0000 7f109a59c640 1 -- 172.21.15.59:0/3318264465 learned_addr learned my addr 172.21.15.59:0/3318264465 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:18.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.094+0000 7f109ad9d640 1 --2- 172.21.15.59:0/3318264465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fcd9a0 0x564b19fcaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:18.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.094+0000 7f1093fff640 1 --2- 172.21.15.59:0/3318264465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc1a10 0x564b19fca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:18.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.094+0000 7f109ad9d640 1 -- 172.21.15.59:0/3318264465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc1a10 msgr2=0x564b19fca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:18.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.094+0000 7f109ad9d640 1 --2- 172.21.15.59:0/3318264465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc1a10 0x564b19fca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.094+0000 7f109ad9d640 1 -- 172.21.15.59:0/3318264465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc10f0 msgr2=0x564b19fcd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:18.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.094+0000 7f109ad9d640 1 --2- 172.21.15.59:0/3318264465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc10f0 0x564b19fcd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.094+0000 7f109ad9d640 1 -- 172.21.15.59:0/3318264465 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b19eefc90 con 0x564b19fcd9a0 2024-09-10T21:22:18.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.094+0000 7f109ad9d640 1 --2- 172.21.15.59:0/3318264465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fcd9a0 0x564b19fcaca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f10940a9470 tx=0x7f10940abd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e691b966b802c9c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:18.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.094+0000 7f1081ffb640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-10T21:22:18.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.095+0000 7f1081ffb640 1 -- 172.21.15.59:0/3318264465 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109401f030 con 0x564b19fcd9a0 2024-09-10T21:22:18.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.095+0000 7f10a3169740 1 -- 172.21.15.59:0/3318264465 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f108c0035f0 con 0x564b19fcd9a0 2024-09-10T21:22:18.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.095+0000 7f1081ffb640 1 -- 172.21.15.59:0/3318264465 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f10940054f0 con 0x564b19fcd9a0 2024-09-10T21:22:18.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.095+0000 7f1081ffb640 1 -- 172.21.15.59:0/3318264465 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f10940b56e0 con 0x564b19fcd9a0 2024-09-10T21:22:18.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.095+0000 7f10a3169740 10 client.26305 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:18.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.095+0000 7f10a3169740 1 -- 172.21.15.59:0/3318264465 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564b19fe0390 con 0x564b19fcd9a0 2024-09-10T21:22:18.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.095+0000 7f1081ffb640 1 -- 172.21.15.59:0/3318264465 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f108c0035f0 con 0x564b19fcd9a0 2024-09-10T21:22:18.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.096+0000 7f1081ffb640 1 -- 172.21.15.59:0/3318264465 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f10940a7b50 con 0x564b19fcd9a0 2024-09-10T21:22:18.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.096+0000 7f10a3169740 10 client.26305 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:18.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.096+0000 7f10a3169740 10 client.26305 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:22:18.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.096+0000 7f10a3169740 20 client.26305 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:18.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.096+0000 7f10a3169740 1 --2- 172.21.15.59:0/3318264465 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564b19fe1810 0x564b19fe3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.096+0000 7f10a3169740 4 client.26305 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:22:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.096+0000 7f10a3169740 1 -- 172.21.15.59:0/3318264465 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b19f39df0 con 0x564b19fe1810 2024-09-10T21:22:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.096+0000 7f109a59c640 1 --2- 172.21.15.59:0/3318264465 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564b19fe1810 0x564b19fe3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.097+0000 7f109a59c640 1 --2- 172.21.15.59:0/3318264465 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564b19fe1810 0x564b19fe3c60 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=daf15f3bcd84ac6a server_cookie=f13fb3ec557fd176 in_seq=0 out_seq=0 2024-09-10T21:22:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.097+0000 7f1081ffb640 10 client.26305 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:22:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.097+0000 7f1081ffb640 1 -- 172.21.15.59:0/3318264465 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b19f39df0 con 0x564b19fe1810 2024-09-10T21:22:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.097+0000 7f1081ffb640 10 client.26305 handle_command_reply: tid=0 2024-09-10T21:22:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.097+0000 7f10a3169740 1 client.26305 shutdown 2024-09-10T21:22:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.098+0000 7f10a3169740 1 -- 172.21.15.59:0/3318264465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fcd9a0 msgr2=0x564b19fcaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.098+0000 7f10a3169740 1 --2- 172.21.15.59:0/3318264465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fcd9a0 0x564b19fcaca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f10940a9470 tx=0x7f10940abd10 comp rx=0 tx=0).stop 2024-09-10T21:22:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.098+0000 7f10a3169740 1 -- 172.21.15.59:0/3318264465 shutdown_connections 2024-09-10T21:22:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.098+0000 7f10a3169740 1 --2- 172.21.15.59:0/3318264465 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564b19fe1810 0x564b19fe3c60 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.098+0000 7f1081ffb640 0 client.26305 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:22:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.098+0000 7f10a3169740 1 --2- 172.21.15.59:0/3318264465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fcd9a0 0x564b19fcaca0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.098+0000 7f10a3169740 1 --2- 172.21.15.59:0/3318264465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc1a10 0x564b19fca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.098+0000 7f10a3169740 1 --2- 172.21.15.59:0/3318264465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc10f0 0x564b19fcd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.098+0000 7f10a3169740 1 -- 172.21.15.59:0/3318264465 >> 172.21.15.59:0/3318264465 conn(0x564b19fbef20 msgr2=0x564b19fc4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:18.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.098+0000 7f10a3169740 1 -- 172.21.15.59:0/3318264465 shutdown_connections 2024-09-10T21:22:18.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.098+0000 7f10a3169740 1 -- 172.21.15.59:0/3318264465 wait complete. 2024-09-10T21:22:18.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.098+0000 7f10a3169740 20 client.26305 trim_cache size 0 max 16384 2024-09-10T21:22:18.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.111+0000 7f10a3169740 1 Processor -- start 2024-09-10T21:22:18.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.111+0000 7f10a3169740 1 -- start start 2024-09-10T21:22:18.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.112+0000 7f10a3169740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc10f0 0x564b19fced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:18.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.112+0000 7f10a3169740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fc1a10 0x564b19fcf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:18.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.112+0000 7f10a3169740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fcd9a0 0x564b19fc78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:18.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.112+0000 7f10a3169740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f109c1ac150 con 0x564b19fcd9a0 2024-09-10T21:22:18.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.112+0000 7f10a3169740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f109c1adc90 con 0x564b19fc10f0 2024-09-10T21:22:18.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.112+0000 7f10a3169740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f109c1ac820 con 0x564b19fc1a10 2024-09-10T21:22:18.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.112+0000 7f109ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fcd9a0 0x564b19fc78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:18.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.112+0000 7f109a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc10f0 0x564b19fced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:18.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.112+0000 7f109ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fcd9a0 0x564b19fc78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47242/0 (socket says 172.21.15.59:47242) 2024-09-10T21:22:18.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.112+0000 7f109ad9d640 1 -- 172.21.15.59:0/3588493763 learned_addr learned my addr 172.21.15.59:0/3588493763 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:18.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.112+0000 7f1093fff640 1 --2- 172.21.15.59:0/3588493763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fc1a10 0x564b19fcf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:18.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.112+0000 7f109ad9d640 1 -- 172.21.15.59:0/3588493763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fc1a10 msgr2=0x564b19fcf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:18.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.112+0000 7f109ad9d640 1 --2- 172.21.15.59:0/3588493763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fc1a10 0x564b19fcf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.112+0000 7f109ad9d640 1 -- 172.21.15.59:0/3588493763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc10f0 msgr2=0x564b19fced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:18.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.112+0000 7f109ad9d640 1 --2- 172.21.15.59:0/3588493763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc10f0 0x564b19fced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.112+0000 7f109ad9d640 1 -- 172.21.15.59:0/3588493763 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b19fcd5e0 con 0x564b19fcd9a0 2024-09-10T21:22:18.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.112+0000 7f109a59c640 1 --2- 172.21.15.59:0/3588493763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc10f0 0x564b19fced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:22:18.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.113+0000 7f109ad9d640 1 --2- 172.21.15.59:0/3588493763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fcd9a0 0x564b19fc78d0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f10940ac190 tx=0x7f10940053e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c30dd6507a2e3c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:18.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.113+0000 7f1083fff640 1 -- 172.21.15.59:0/3588493763 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109401f070 con 0x564b19fcd9a0 2024-09-10T21:22:18.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.113+0000 7f1083fff640 1 -- 172.21.15.59:0/3588493763 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10940ab460 con 0x564b19fcd9a0 2024-09-10T21:22:18.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.113+0000 7f1083fff640 1 -- 172.21.15.59:0/3588493763 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10940aafa0 con 0x564b19fcd9a0 2024-09-10T21:22:18.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.114+0000 7f10a3169740 1 -- 172.21.15.59:0/3588493763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fcd9a0 msgr2=0x564b19fc78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:18.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.114+0000 7f10a3169740 1 --2- 172.21.15.59:0/3588493763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fcd9a0 0x564b19fc78d0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f10940ac190 tx=0x7f10940053e0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.114+0000 7f10a3169740 1 -- 172.21.15.59:0/3588493763 shutdown_connections 2024-09-10T21:22:18.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.114+0000 7f10a3169740 1 --2- 172.21.15.59:0/3588493763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fcd9a0 0x564b19fc78d0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.114+0000 7f10a3169740 1 --2- 172.21.15.59:0/3588493763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fc1a10 0x564b19fcf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.114+0000 7f10a3169740 1 --2- 172.21.15.59:0/3588493763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc10f0 0x564b19fced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.114+0000 7f10a3169740 1 -- 172.21.15.59:0/3588493763 >> 172.21.15.59:0/3588493763 conn(0x564b19fbef20 msgr2=0x564b19fc5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:18.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.114+0000 7f10a3169740 1 -- 172.21.15.59:0/3588493763 shutdown_connections 2024-09-10T21:22:18.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.114+0000 7f10a3169740 1 -- 172.21.15.59:0/3588493763 wait complete. 2024-09-10T21:22:18.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.114+0000 7f10a3169740 1 -- start start 2024-09-10T21:22:18.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.114+0000 7f10a3169740 1 Processor -- start 2024-09-10T21:22:18.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.115+0000 7f10a3169740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc10f0 0x564b19fd9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:18.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.115+0000 7f10a3169740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc1a10 0x564b19fda2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:18.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.115+0000 7f10a3169740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fcd9a0 0x564b19fd4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:18.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.115+0000 7f10a3169740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f109c1ad5c0 con 0x564b19fc10f0 2024-09-10T21:22:18.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.115+0000 7f10a3169740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f109c1acef0 con 0x564b19fc1a10 2024-09-10T21:22:18.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.115+0000 7f10a3169740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f109c1aa150 con 0x564b19fcd9a0 2024-09-10T21:22:18.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.115+0000 7f10a3169740 10 client.0 _ll_register_callbacks cb 0x7f1094009270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:18.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.115+0000 7f109a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc10f0 0x564b19fd9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:18.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.115+0000 7f109a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc10f0 0x564b19fd9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47250/0 (socket says 172.21.15.59:47250) 2024-09-10T21:22:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.115+0000 7f109a59c640 1 -- 172.21.15.59:0/4217788707 learned_addr learned my addr 172.21.15.59:0/4217788707 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.115+0000 7f1093fff640 1 --2- 172.21.15.59:0/4217788707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc1a10 0x564b19fda2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.115+0000 7f109ad9d640 1 --2- 172.21.15.59:0/4217788707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fcd9a0 0x564b19fd4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.115+0000 7f109a59c640 1 -- 172.21.15.59:0/4217788707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fcd9a0 msgr2=0x564b19fd4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.115+0000 7f109a59c640 1 --2- 172.21.15.59:0/4217788707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fcd9a0 0x564b19fd4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.115+0000 7f109a59c640 1 -- 172.21.15.59:0/4217788707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc1a10 msgr2=0x564b19fda2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.115+0000 7f109a59c640 1 --2- 172.21.15.59:0/4217788707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc1a10 0x564b19fda2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.115+0000 7f109a59c640 1 -- 172.21.15.59:0/4217788707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b19fd5270 con 0x564b19fc10f0 2024-09-10T21:22:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.115+0000 7f109a59c640 1 --2- 172.21.15.59:0/4217788707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc10f0 0x564b19fd9d80 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f108c000c00 tx=0x7f108c005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7316001286673b24 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.116+0000 7f1081ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:22:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.116+0000 7f1081ffb640 1 -- 172.21.15.59:0/4217788707 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108c005450 con 0x564b19fc10f0 2024-09-10T21:22:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.116+0000 7f1081ffb640 1 -- 172.21.15.59:0/4217788707 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f108c0055f0 con 0x564b19fc10f0 2024-09-10T21:22:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.116+0000 7f10a3169740 1 -- 172.21.15.59:0/4217788707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10940ab460 con 0x564b19fc10f0 2024-09-10T21:22:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.116+0000 7f1081ffb640 1 -- 172.21.15.59:0/4217788707 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f108c0035f0 con 0x564b19fc10f0 2024-09-10T21:22:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.116+0000 7f10a3169740 10 client.17070 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.116+0000 7f10a3169740 1 -- 172.21.15.59:0/4217788707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564b1a04eef0 con 0x564b19fc10f0 2024-09-10T21:22:18.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.116+0000 7f1081ffb640 1 -- 172.21.15.59:0/4217788707 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10940ab460 con 0x564b19fc10f0 2024-09-10T21:22:18.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.116+0000 7f1081ffb640 1 -- 172.21.15.59:0/4217788707 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f108c011960 con 0x564b19fc10f0 2024-09-10T21:22:18.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.116+0000 7f10a3169740 10 client.17070 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:18.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.116+0000 7f10a3169740 10 client.17070 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:22:18.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.116+0000 7f10a3169740 20 client.17070 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:18.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.116+0000 7f10a3169740 1 --2- 172.21.15.59:0/4217788707 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564b19fe1810 0x564b1a051540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:18.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.117+0000 7f10a3169740 4 client.17070 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:22:18.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.117+0000 7f10a3169740 1 -- 172.21.15.59:0/4217788707 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564b19f358a0 con 0x564b19fe1810 2024-09-10T21:22:18.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.117+0000 7f1093fff640 1 --2- 172.21.15.59:0/4217788707 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564b19fe1810 0x564b1a051540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:18.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.117+0000 7f1081ffb640 10 client.17070 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:22:18.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.117+0000 7f1093fff640 1 --2- 172.21.15.59:0/4217788707 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564b19fe1810 0x564b1a051540 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7c0f5276b3a282e6 server_cookie=45d4eabc23ab5c92 in_seq=0 out_seq=0 2024-09-10T21:22:18.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.118+0000 7f1081ffb640 1 -- 172.21.15.59:0/4217788707 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564b19f358a0 con 0x564b19fe1810 2024-09-10T21:22:18.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.118+0000 7f1081ffb640 10 client.17070 handle_command_reply: tid=0 2024-09-10T21:22:18.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.118+0000 7f10a3169740 1 client.17070 shutdown 2024-09-10T21:22:18.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.118+0000 7f10a3169740 1 -- 172.21.15.59:0/4217788707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc10f0 msgr2=0x564b19fd9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:18.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.118+0000 7f10a3169740 1 --2- 172.21.15.59:0/4217788707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc10f0 0x564b19fd9d80 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f108c000c00 tx=0x7f108c005c90 comp rx=0 tx=0).stop 2024-09-10T21:22:18.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.118+0000 7f10a3169740 1 -- 172.21.15.59:0/4217788707 shutdown_connections 2024-09-10T21:22:18.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.118+0000 7f10a3169740 1 --2- 172.21.15.59:0/4217788707 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x564b19fe1810 0x564b1a051540 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.118+0000 7f10a3169740 1 --2- 172.21.15.59:0/4217788707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564b19fcd9a0 0x564b19fd4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.118+0000 7f10a3169740 1 --2- 172.21.15.59:0/4217788707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564b19fc1a10 0x564b19fda2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.118+0000 7f1081ffb640 0 client.17070 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:22:18.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.118+0000 7f10a3169740 1 --2- 172.21.15.59:0/4217788707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b19fc10f0 0x564b19fd9d80 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.118+0000 7f10a3169740 1 -- 172.21.15.59:0/4217788707 >> 172.21.15.59:0/4217788707 conn(0x564b19fbef20 msgr2=0x564b19fbd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:18.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.118+0000 7f10a3169740 1 -- 172.21.15.59:0/4217788707 shutdown_connections 2024-09-10T21:22:18.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.118+0000 7f10a3169740 1 -- 172.21.15.59:0/4217788707 wait complete. 2024-09-10T21:22:18.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.118+0000 7f10a3169740 20 client.17070 trim_cache size 0 max 16384 2024-09-10T21:22:18.126 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:22:18.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.119+0000 7f10a0d94640 1 -- 172.21.15.59:0/2261320303 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f10880b52e0 msgr2=0x7f10880b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:18.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.119+0000 7f10a0d94640 1 --2- 172.21.15.59:0/2261320303 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f10880b52e0 0x7f10880b77a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1084031440 tx=0x7f1084005c00 comp rx=0 tx=0).stop 2024-09-10T21:22:18.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.119+0000 7f10a0d94640 1 -- 172.21.15.59:0/2261320303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c109150 msgr2=0x7f109c19ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:18.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.119+0000 7f10a0d94640 1 --2- 172.21.15.59:0/2261320303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c109150 0x7f109c19ebe0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f109400eaa0 tx=0x7f109400ef60 comp rx=0 tx=0).stop 2024-09-10T21:22:18.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.119+0000 7f10a0d94640 1 -- 172.21.15.59:0/2261320303 shutdown_connections 2024-09-10T21:22:18.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.119+0000 7f10a0d94640 1 --2- 172.21.15.59:0/2261320303 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f10880b52e0 0x7f10880b77a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.119+0000 7f10a0d94640 1 --2- 172.21.15.59:0/2261320303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f109c109150 0x7f109c19ebe0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.119+0000 7f10a0d94640 1 --2- 172.21.15.59:0/2261320303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f109c1087d0 0x7f109c199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.119+0000 7f10a0d94640 1 --2- 172.21.15.59:0/2261320303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f109c102dc0 0x7f109c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:18.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.119+0000 7f10a0d94640 1 -- 172.21.15.59:0/2261320303 >> 172.21.15.59:0/2261320303 conn(0x7f109c0fe830 msgr2=0x7f109c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:18.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.119+0000 7f10a0d94640 1 -- 172.21.15.59:0/2261320303 shutdown_connections 2024-09-10T21:22:18.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:18.119+0000 7f10a0d94640 1 -- 172.21.15.59:0/2261320303 wait complete. 2024-09-10T21:22:18.766 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:22:19.026 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:22:19.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:19 smithi059 ceph-mon[30888]: pgmap v551: 97 pgs: 97 active+clean; 4.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:22:19.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:19 smithi154 ceph-mon[35041]: pgmap v551: 97 pgs: 97 active+clean; 4.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:22:19.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.569+0000 7f841eae3640 1 -- 172.21.15.59:0/4201736801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84181076a0 msgr2=0x7f8418107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:19.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.569+0000 7f841eae3640 1 --2- 172.21.15.59:0/4201736801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84181076a0 0x7f8418107ae0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f840c009900 tx=0x7f840c02a410 comp rx=0 tx=0).stop 2024-09-10T21:22:19.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.569+0000 7f841eae3640 1 -- 172.21.15.59:0/4201736801 shutdown_connections 2024-09-10T21:22:19.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.569+0000 7f841eae3640 1 --2- 172.21.15.59:0/4201736801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8418108020 0x7f841810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.569+0000 7f841eae3640 1 --2- 172.21.15.59:0/4201736801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84181076a0 0x7f8418107ae0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.569+0000 7f841eae3640 1 --2- 172.21.15.59:0/4201736801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8418101c90 0x7f8418102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.569+0000 7f841eae3640 1 -- 172.21.15.59:0/4201736801 >> 172.21.15.59:0/4201736801 conn(0x7f84180fd700 msgr2=0x7f84180ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:19.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.569+0000 7f841eae3640 1 -- 172.21.15.59:0/4201736801 shutdown_connections 2024-09-10T21:22:19.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.569+0000 7f841eae3640 1 -- 172.21.15.59:0/4201736801 wait complete. 2024-09-10T21:22:19.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.569+0000 7f841eae3640 1 Processor -- start 2024-09-10T21:22:19.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.569+0000 7f841eae3640 1 -- start start 2024-09-10T21:22:19.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.570+0000 7f841eae3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8418101c90 0x7f84180fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:19.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.570+0000 7f841eae3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84181076a0 0x7f84180fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:19.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.570+0000 7f841eae3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8418108020 0x7f84180fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:19.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.570+0000 7f841eae3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8418111ce0 con 0x7f8418101c90 2024-09-10T21:22:19.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.570+0000 7f841eae3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8418111b60 con 0x7f84181076a0 2024-09-10T21:22:19.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.570+0000 7f841eae3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8418111e60 con 0x7f8418108020 2024-09-10T21:22:19.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.570+0000 7f841c87f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8418101c90 0x7f84180fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:19.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.570+0000 7f841c87f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8418101c90 0x7f84180fdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34482/0 (socket says 172.21.15.59:34482) 2024-09-10T21:22:19.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.570+0000 7f841c87f640 1 -- 172.21.15.59:0/3887604377 learned_addr learned my addr 172.21.15.59:0/3887604377 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:19.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.570+0000 7f8417fff640 1 --2- 172.21.15.59:0/3887604377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84181076a0 0x7f84180fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:19.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.570+0000 7f841d080640 1 --2- 172.21.15.59:0/3887604377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8418108020 0x7f84180fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:19.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.570+0000 7f841c87f640 1 -- 172.21.15.59:0/3887604377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8418108020 msgr2=0x7f84180fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:19.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.570+0000 7f841c87f640 1 --2- 172.21.15.59:0/3887604377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8418108020 0x7f84180fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.570+0000 7f841c87f640 1 -- 172.21.15.59:0/3887604377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84181076a0 msgr2=0x7f84180fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:19.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.570+0000 7f841c87f640 1 --2- 172.21.15.59:0/3887604377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84181076a0 0x7f84180fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.570+0000 7f841c87f640 1 -- 172.21.15.59:0/3887604377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84181a7760 con 0x7f8418101c90 2024-09-10T21:22:19.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.570+0000 7f841c87f640 1 --2- 172.21.15.59:0/3887604377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8418101c90 0x7f84180fdc00 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f840800b4a0 tx=0x7f840800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:19.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.571+0000 7f8415ffb640 1 -- 172.21.15.59:0/3887604377 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8408014070 con 0x7f8418101c90 2024-09-10T21:22:19.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.571+0000 7f8415ffb640 1 -- 172.21.15.59:0/3887604377 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8408010ac0 con 0x7f8418101c90 2024-09-10T21:22:19.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.571+0000 7f841eae3640 1 -- 172.21.15.59:0/3887604377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84181a7a50 con 0x7f8418101c90 2024-09-10T21:22:19.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.571+0000 7f8415ffb640 1 -- 172.21.15.59:0/3887604377 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8408017c30 con 0x7f8418101c90 2024-09-10T21:22:19.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.571+0000 7f841eae3640 1 -- 172.21.15.59:0/3887604377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84181a7fe0 con 0x7f8418101c90 2024-09-10T21:22:19.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.573+0000 7f8420eb8740 1 Processor -- start 2024-09-10T21:22:19.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.573+0000 7f8415ffb640 1 -- 172.21.15.59:0/3887604377 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f8408010610 con 0x7f8418101c90 2024-09-10T21:22:19.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.574+0000 7f8420eb8740 1 -- start start 2024-09-10T21:22:19.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.574+0000 7f8420eb8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d94d0 0x55737f9d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:19.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.574+0000 7f8420eb8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d9df0 0x55737f9e5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:19.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.574+0000 7f8420eb8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55737f9e5d80 0x55737f9e8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:19.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.574+0000 7f8420eb8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55737f94fea0 con 0x55737f9d94d0 2024-09-10T21:22:19.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.574+0000 7f8420eb8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55737f93f2d0 con 0x55737f9e5d80 2024-09-10T21:22:19.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.574+0000 7f8420eb8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55737f9430e0 con 0x55737f9d9df0 2024-09-10T21:22:19.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.574+0000 7f841d080640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d94d0 0x55737f9d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:19.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.574+0000 7f841d080640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d94d0 0x55737f9d98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34498/0 (socket says 172.21.15.59:34498) 2024-09-10T21:22:19.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.574+0000 7f841d080640 1 -- 172.21.15.59:0/2751949560 learned_addr learned my addr 172.21.15.59:0/2751949560 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:19.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.574+0000 7f841c87f640 1 --2- 172.21.15.59:0/2751949560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d9df0 0x55737f9e5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:19.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.574+0000 7f8417fff640 1 --2- 172.21.15.59:0/2751949560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55737f9e5d80 0x55737f9e8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:19.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.574+0000 7f841d080640 1 -- 172.21.15.59:0/2751949560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d9df0 msgr2=0x55737f9e5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:19.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.574+0000 7f841d080640 1 --2- 172.21.15.59:0/2751949560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d9df0 0x55737f9e5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.574+0000 7f841d080640 1 -- 172.21.15.59:0/2751949560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55737f9e5d80 msgr2=0x55737f9e8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:19.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.574+0000 7f841d080640 1 --2- 172.21.15.59:0/2751949560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55737f9e5d80 0x55737f9e8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.574+0000 7f841d080640 1 -- 172.21.15.59:0/2751949560 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55737f69d650 con 0x55737f9d94d0 2024-09-10T21:22:19.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.574+0000 7f8417fff640 1 --2- 172.21.15.59:0/2751949560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55737f9e5d80 0x55737f9e8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:22:19.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.575+0000 7f8415ffb640 1 --2- 172.21.15.59:0/3887604377 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f84000b52e0 0x7f84000b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:19.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.575+0000 7f841d080640 1 --2- 172.21.15.59:0/2751949560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d94d0 0x55737f9d98b0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f8410009fd0 tx=0x7f8410010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48de0be4b083f8e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:19.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.575+0000 7f841c87f640 1 --2- 172.21.15.59:0/3887604377 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f84000b52e0 0x7f84000b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:19.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.575+0000 7f8415ffb640 1 -- 172.21.15.59:0/3887604377 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f84080e53e0 con 0x7f8418101c90 2024-09-10T21:22:19.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.575+0000 7f83feffd640 1 -- 172.21.15.59:0/2751949560 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410016070 con 0x55737f9d94d0 2024-09-10T21:22:19.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.575+0000 7f83feffd640 1 -- 172.21.15.59:0/2751949560 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8410012bc0 con 0x55737f9d94d0 2024-09-10T21:22:19.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.575+0000 7f83feffd640 1 -- 172.21.15.59:0/2751949560 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841001bc80 con 0x55737f9d94d0 2024-09-10T21:22:19.580 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:19 smithi192 ceph-mon[35363]: pgmap v551: 97 pgs: 97 active+clean; 4.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:22:19.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.576+0000 7f8420eb8740 1 -- 172.21.15.59:0/2751949560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d94d0 msgr2=0x55737f9d98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:19.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.576+0000 7f841c87f640 1 --2- 172.21.15.59:0/3887604377 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f84000b52e0 0x7f84000b77a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f84080e3280 tx=0x7f8408010f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:19.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.576+0000 7f8420eb8740 1 --2- 172.21.15.59:0/2751949560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d94d0 0x55737f9d98b0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f8410009fd0 tx=0x7f8410010800 comp rx=0 tx=0).stop 2024-09-10T21:22:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.576+0000 7f8420eb8740 1 -- 172.21.15.59:0/2751949560 shutdown_connections 2024-09-10T21:22:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.576+0000 7f8420eb8740 1 --2- 172.21.15.59:0/2751949560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55737f9e5d80 0x55737f9e8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.576+0000 7f8420eb8740 1 --2- 172.21.15.59:0/2751949560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d9df0 0x55737f9e5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.576+0000 7f8420eb8740 1 --2- 172.21.15.59:0/2751949560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d94d0 0x55737f9d98b0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.576+0000 7f8420eb8740 1 -- 172.21.15.59:0/2751949560 >> 172.21.15.59:0/2751949560 conn(0x55737f9d7300 msgr2=0x55737f9d84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.576+0000 7f8420eb8740 1 -- 172.21.15.59:0/2751949560 shutdown_connections 2024-09-10T21:22:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.576+0000 7f8420eb8740 1 -- 172.21.15.59:0/2751949560 wait complete. 2024-09-10T21:22:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.576+0000 7f8420eb8740 1 -- start start 2024-09-10T21:22:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.576+0000 7f8420eb8740 1 Processor -- start 2024-09-10T21:22:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.577+0000 7f8420eb8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55737f9d94d0 0x55737f9e5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.577+0000 7f8420eb8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d9df0 0x55737f9e2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.577+0000 7f8420eb8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9e5d80 0x55737f9e3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.577+0000 7f8420eb8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55737f7a0700 con 0x55737f9e5d80 2024-09-10T21:22:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.577+0000 7f8420eb8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55737f8da160 con 0x55737f9d94d0 2024-09-10T21:22:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.577+0000 7f8420eb8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55737f9e8a00 con 0x55737f9d9df0 2024-09-10T21:22:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.577+0000 7f8420eb8740 10 client.0 _ll_register_callbacks cb 0x55737f8f39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.577+0000 7f841d080640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9e5d80 0x55737f9e3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.577+0000 7f841d080640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9e5d80 0x55737f9e3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34508/0 (socket says 172.21.15.59:34508) 2024-09-10T21:22:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.577+0000 7f841d080640 1 -- 172.21.15.59:0/1367134012 learned_addr learned my addr 172.21.15.59:0/1367134012 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.577+0000 7f8417fff640 1 --2- 172.21.15.59:0/1367134012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d9df0 0x55737f9e2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.577+0000 7f841d080640 1 --2- 172.21.15.59:0/1367134012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55737f9d94d0 0x55737f9e5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.577+0000 7f841d080640 1 -- 172.21.15.59:0/1367134012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d9df0 msgr2=0x55737f9e2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.577+0000 7f841d080640 1 --2- 172.21.15.59:0/1367134012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d9df0 0x55737f9e2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.577+0000 7f841d080640 1 -- 172.21.15.59:0/1367134012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55737f9d94d0 msgr2=0x55737f9e5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.577+0000 7f841d080640 1 --2- 172.21.15.59:0/1367134012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55737f9d94d0 0x55737f9e5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.577+0000 7f841d080640 1 -- 172.21.15.59:0/1367134012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55737f907c90 con 0x55737f9e5d80 2024-09-10T21:22:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.577+0000 7f841d080640 1 --2- 172.21.15.59:0/1367134012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9e5d80 0x55737f9e3110 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f841001b650 tx=0x7f841001b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f04d2650f103a51 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.577+0000 7f83f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:22:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.578+0000 7f83f7fff640 1 -- 172.21.15.59:0/1367134012 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410016070 con 0x55737f9e5d80 2024-09-10T21:22:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.578+0000 7f83f7fff640 1 -- 172.21.15.59:0/1367134012 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8410003970 con 0x55737f9e5d80 2024-09-10T21:22:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.578+0000 7f8420eb8740 1 -- 172.21.15.59:0/1367134012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8410012bc0 con 0x55737f9e5d80 2024-09-10T21:22:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.578+0000 7f83f7fff640 1 -- 172.21.15.59:0/1367134012 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f841001be30 con 0x55737f9e5d80 2024-09-10T21:22:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.578+0000 7f8420eb8740 10 client.17082 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.578+0000 7f8420eb8740 1 -- 172.21.15.59:0/1367134012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55737f9f4360 con 0x55737f9e5d80 2024-09-10T21:22:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.578+0000 7f83f7fff640 1 -- 172.21.15.59:0/1367134012 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8410012bc0 con 0x55737f9e5d80 2024-09-10T21:22:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.578+0000 7f83f7fff640 1 -- 172.21.15.59:0/1367134012 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f841000f040 con 0x55737f9e5d80 2024-09-10T21:22:19.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.578+0000 7f8420eb8740 10 client.17082 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.578+0000 7f8420eb8740 10 client.17082 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:22:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.578+0000 7f8420eb8740 20 client.17082 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.578+0000 7f8420eb8740 1 --2- 172.21.15.59:0/1367134012 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55737f9f56b0 0x55737f9f7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.578+0000 7f8420eb8740 4 client.17082 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:22:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.578+0000 7f8420eb8740 1 -- 172.21.15.59:0/1367134012 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55737f951df0 con 0x55737f9f56b0 2024-09-10T21:22:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.579+0000 7f8417fff640 1 --2- 172.21.15.59:0/1367134012 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55737f9f56b0 0x55737f9f7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.579+0000 7f8417fff640 1 --2- 172.21.15.59:0/1367134012 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55737f9f56b0 0x55737f9f7aa0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd0bf8ed05daaebc server_cookie=a0b3db207d216947 in_seq=0 out_seq=0 2024-09-10T21:22:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.579+0000 7f83f7fff640 10 client.17082 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.580+0000 7f83f7fff640 1 -- 172.21.15.59:0/1367134012 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55737f951df0 con 0x55737f9f56b0 2024-09-10T21:22:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.580+0000 7f83f7fff640 10 client.17082 handle_command_reply: tid=0 2024-09-10T21:22:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.580+0000 7f8420eb8740 1 client.17082 shutdown 2024-09-10T21:22:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.580+0000 7f8420eb8740 1 -- 172.21.15.59:0/1367134012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9e5d80 msgr2=0x55737f9e3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.580+0000 7f8420eb8740 1 --2- 172.21.15.59:0/1367134012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9e5d80 0x55737f9e3110 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f841001b650 tx=0x7f841001b820 comp rx=0 tx=0).stop 2024-09-10T21:22:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.580+0000 7f8420eb8740 1 -- 172.21.15.59:0/1367134012 shutdown_connections 2024-09-10T21:22:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.580+0000 7f8420eb8740 1 --2- 172.21.15.59:0/1367134012 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55737f9f56b0 0x55737f9f7aa0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.580+0000 7f8420eb8740 1 --2- 172.21.15.59:0/1367134012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9e5d80 0x55737f9e3110 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.580+0000 7f8420eb8740 1 --2- 172.21.15.59:0/1367134012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d9df0 0x55737f9e2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.580+0000 7f8420eb8740 1 --2- 172.21.15.59:0/1367134012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55737f9d94d0 0x55737f9e5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.580+0000 7f8420eb8740 1 -- 172.21.15.59:0/1367134012 >> 172.21.15.59:0/1367134012 conn(0x55737f9d7300 msgr2=0x55737f9dce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.580+0000 7f83f7fff640 0 client.17082 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.580+0000 7f8420eb8740 1 -- 172.21.15.59:0/1367134012 shutdown_connections 2024-09-10T21:22:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.580+0000 7f8420eb8740 1 -- 172.21.15.59:0/1367134012 wait complete. 2024-09-10T21:22:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.581+0000 7f8420eb8740 20 client.17082 trim_cache size 0 max 16384 2024-09-10T21:22:19.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.594+0000 7f8420eb8740 1 Processor -- start 2024-09-10T21:22:19.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.594+0000 7f8420eb8740 1 -- start start 2024-09-10T21:22:19.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.594+0000 7f8420eb8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d94d0 0x55737f9d6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:19.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.594+0000 7f8420eb8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d9df0 0x55737f9e7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:19.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.594+0000 7f8420eb8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55737f9e5d80 0x55737f9e76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:19.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.594+0000 7f8420eb8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f84181b0650 con 0x55737f9d9df0 2024-09-10T21:22:19.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.594+0000 7f8420eb8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f84181b2190 con 0x55737f9e5d80 2024-09-10T21:22:19.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.594+0000 7f8420eb8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f84181b0d20 con 0x55737f9d94d0 2024-09-10T21:22:19.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.594+0000 7f8417fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d9df0 0x55737f9e7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:19.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.594+0000 7f8417fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d9df0 0x55737f9e7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34520/0 (socket says 172.21.15.59:34520) 2024-09-10T21:22:19.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.594+0000 7f8417fff640 1 -- 172.21.15.59:0/2287059791 learned_addr learned my addr 172.21.15.59:0/2287059791 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:19.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.594+0000 7f841d080640 1 --2- 172.21.15.59:0/2287059791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d94d0 0x55737f9d6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:19.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.594+0000 7f8417fff640 1 -- 172.21.15.59:0/2287059791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d94d0 msgr2=0x55737f9d6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:19.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.594+0000 7f8417fff640 1 --2- 172.21.15.59:0/2287059791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d94d0 0x55737f9d6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.594+0000 7f8417fff640 1 -- 172.21.15.59:0/2287059791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55737f9e5d80 msgr2=0x55737f9e76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:19.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.594+0000 7f8417fff640 1 --2- 172.21.15.59:0/2287059791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55737f9e5d80 0x55737f9e76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.594+0000 7f8417fff640 1 -- 172.21.15.59:0/2287059791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55737f9d7fe0 con 0x55737f9d9df0 2024-09-10T21:22:19.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.594+0000 7f841d080640 1 --2- 172.21.15.59:0/2287059791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d94d0 0x55737f9d6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:22:19.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.595+0000 7f8417fff640 1 --2- 172.21.15.59:0/2287059791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d9df0 0x55737f9e7170 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f840c02a930 tx=0x7f840c0095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16b05dfecf4ca76 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:19.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.595+0000 7f83fe7fc640 1 -- 172.21.15.59:0/2287059791 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c035040 con 0x55737f9d9df0 2024-09-10T21:22:19.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.595+0000 7f83fe7fc640 1 -- 172.21.15.59:0/2287059791 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f840c0054f0 con 0x55737f9d9df0 2024-09-10T21:22:19.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.595+0000 7f83fe7fc640 1 -- 172.21.15.59:0/2287059791 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c004d00 con 0x55737f9d9df0 2024-09-10T21:22:19.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.595+0000 7f8420eb8740 1 -- 172.21.15.59:0/2287059791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d9df0 msgr2=0x55737f9e7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:19.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.595+0000 7f8420eb8740 1 --2- 172.21.15.59:0/2287059791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d9df0 0x55737f9e7170 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f840c02a930 tx=0x7f840c0095e0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.595+0000 7f8420eb8740 1 -- 172.21.15.59:0/2287059791 shutdown_connections 2024-09-10T21:22:19.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.595+0000 7f8420eb8740 1 --2- 172.21.15.59:0/2287059791 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55737f9e5d80 0x55737f9e76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.595+0000 7f8420eb8740 1 --2- 172.21.15.59:0/2287059791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d9df0 0x55737f9e7170 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.595+0000 7f8420eb8740 1 --2- 172.21.15.59:0/2287059791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d94d0 0x55737f9d6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.595+0000 7f8420eb8740 1 -- 172.21.15.59:0/2287059791 >> 172.21.15.59:0/2287059791 conn(0x55737f9d7300 msgr2=0x55737f9e4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.595+0000 7f8420eb8740 1 -- 172.21.15.59:0/2287059791 shutdown_connections 2024-09-10T21:22:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.595+0000 7f8420eb8740 1 -- 172.21.15.59:0/2287059791 wait complete. 2024-09-10T21:22:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.596+0000 7f8420eb8740 1 -- start start 2024-09-10T21:22:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.596+0000 7f8420eb8740 1 Processor -- start 2024-09-10T21:22:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.596+0000 7f8420eb8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d94d0 0x55737f9f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.596+0000 7f8420eb8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d9df0 0x55737f9f7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.596+0000 7f8420eb8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55737f9e5d80 0x55737fa5b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.596+0000 7f8420eb8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f84181b1ac0 con 0x55737f9d94d0 2024-09-10T21:22:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.596+0000 7f8420eb8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f84181b13f0 con 0x55737f9e5d80 2024-09-10T21:22:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.596+0000 7f8420eb8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f84181ae630 con 0x55737f9d9df0 2024-09-10T21:22:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.596+0000 7f8420eb8740 10 client.0 _ll_register_callbacks cb 0x7f84080e8d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.596+0000 7f841d080640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d94d0 0x55737f9f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:19.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.596+0000 7f841d080640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d94d0 0x55737f9f74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34530/0 (socket says 172.21.15.59:34530) 2024-09-10T21:22:19.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.596+0000 7f841d080640 1 -- 172.21.15.59:0/1458969998 learned_addr learned my addr 172.21.15.59:0/1458969998 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:19.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.597+0000 7f8417fff640 1 --2- 172.21.15.59:0/1458969998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d9df0 0x55737f9f7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:19.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.597+0000 7f841d080640 1 -- 172.21.15.59:0/1458969998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d9df0 msgr2=0x55737f9f7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:19.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.597+0000 7f841d080640 1 --2- 172.21.15.59:0/1458969998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d9df0 0x55737f9f7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.597+0000 7f841d080640 1 -- 172.21.15.59:0/1458969998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55737f9e5d80 msgr2=0x55737fa5b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:19.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.597+0000 7f841d080640 1 --2- 172.21.15.59:0/1458969998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55737f9e5d80 0x55737fa5b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.597+0000 7f841d080640 1 -- 172.21.15.59:0/1458969998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55737fa5b9b0 con 0x55737f9d94d0 2024-09-10T21:22:19.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.597+0000 7f8417fff640 1 --2- 172.21.15.59:0/1458969998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d9df0 0x55737f9f7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:22:19.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.597+0000 7f841d080640 1 --2- 172.21.15.59:0/1458969998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d94d0 0x55737f9f74d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f841001b7f0 tx=0x7f841001b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fac83db0f58e919 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:19.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.597+0000 7f83f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:22:19.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.597+0000 7f83f7fff640 1 -- 172.21.15.59:0/1458969998 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410016070 con 0x55737f9d94d0 2024-09-10T21:22:19.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.597+0000 7f83f7fff640 1 -- 172.21.15.59:0/1458969998 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8410005600 con 0x55737f9d94d0 2024-09-10T21:22:19.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.597+0000 7f8420eb8740 1 -- 172.21.15.59:0/1458969998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f840c0054f0 con 0x55737f9d94d0 2024-09-10T21:22:19.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.597+0000 7f83f7fff640 1 -- 172.21.15.59:0/1458969998 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8410045070 con 0x55737f9d94d0 2024-09-10T21:22:19.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.597+0000 7f8420eb8740 10 client.17088 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:19.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.597+0000 7f8420eb8740 1 -- 172.21.15.59:0/1458969998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55737fa62da0 con 0x55737f9d94d0 2024-09-10T21:22:19.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.597+0000 7f83f7fff640 1 -- 172.21.15.59:0/1458969998 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f840c0054f0 con 0x55737f9d94d0 2024-09-10T21:22:19.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.598+0000 7f83f7fff640 1 -- 172.21.15.59:0/1458969998 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f8410034860 con 0x55737f9d94d0 2024-09-10T21:22:19.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.598+0000 7f8420eb8740 10 client.17088 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:19.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.598+0000 7f8420eb8740 10 client.17088 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:22:19.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.598+0000 7f8420eb8740 20 client.17088 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:19.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.598+0000 7f8420eb8740 1 --2- 172.21.15.59:0/1458969998 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55737fa63550 0x55737fa65970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:19.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.598+0000 7f8420eb8740 4 client.17088 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:22:19.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.598+0000 7f8420eb8740 1 -- 172.21.15.59:0/1458969998 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55737f94d8a0 con 0x55737fa63550 2024-09-10T21:22:19.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.598+0000 7f8417fff640 1 --2- 172.21.15.59:0/1458969998 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55737fa63550 0x55737fa65970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:19.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.599+0000 7f83f7fff640 10 client.17088 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:19.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.599+0000 7f8417fff640 1 --2- 172.21.15.59:0/1458969998 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55737fa63550 0x55737fa65970 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cb496eef571b63f server_cookie=6fda70021c77218e in_seq=0 out_seq=0 2024-09-10T21:22:19.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.599+0000 7f83f7fff640 1 -- 172.21.15.59:0/1458969998 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55737f94d8a0 con 0x55737fa63550 2024-09-10T21:22:19.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.599+0000 7f83f7fff640 10 client.17088 handle_command_reply: tid=0 2024-09-10T21:22:19.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.599+0000 7f8420eb8740 1 client.17088 shutdown 2024-09-10T21:22:19.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.599+0000 7f8420eb8740 1 -- 172.21.15.59:0/1458969998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d94d0 msgr2=0x55737f9f74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:19.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.599+0000 7f8420eb8740 1 --2- 172.21.15.59:0/1458969998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d94d0 0x55737f9f74d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f841001b7f0 tx=0x7f841001b980 comp rx=0 tx=0).stop 2024-09-10T21:22:19.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.599+0000 7f8420eb8740 1 -- 172.21.15.59:0/1458969998 shutdown_connections 2024-09-10T21:22:19.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.599+0000 7f8420eb8740 1 --2- 172.21.15.59:0/1458969998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55737f9e5d80 0x55737fa5b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.599+0000 7f8420eb8740 1 --2- 172.21.15.59:0/1458969998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55737f9d9df0 0x55737f9f7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.599+0000 7f8420eb8740 1 --2- 172.21.15.59:0/1458969998 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55737fa63550 0x55737fa65970 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.599+0000 7f8420eb8740 1 --2- 172.21.15.59:0/1458969998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55737f9d94d0 0x55737f9f74d0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.599+0000 7f8420eb8740 1 -- 172.21.15.59:0/1458969998 >> 172.21.15.59:0/1458969998 conn(0x55737f9d7300 msgr2=0x55737f9dc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:19.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.599+0000 7f83f7fff640 0 client.17088 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:19.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.599+0000 7f8420eb8740 1 -- 172.21.15.59:0/1458969998 shutdown_connections 2024-09-10T21:22:19.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.599+0000 7f8420eb8740 1 -- 172.21.15.59:0/1458969998 wait complete. 2024-09-10T21:22:19.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.599+0000 7f8420eb8740 20 client.17088 trim_cache size 0 max 16384 2024-09-10T21:22:19.607 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:22:19.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.600+0000 7f841eae3640 1 -- 172.21.15.59:0/3887604377 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f84000b52e0 msgr2=0x7f84000b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:19.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.600+0000 7f841eae3640 1 --2- 172.21.15.59:0/3887604377 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f84000b52e0 0x7f84000b77a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f84080e3280 tx=0x7f8408010f90 comp rx=0 tx=0).stop 2024-09-10T21:22:19.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.600+0000 7f841eae3640 1 -- 172.21.15.59:0/3887604377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8418101c90 msgr2=0x7f84180fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:19.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.600+0000 7f841eae3640 1 --2- 172.21.15.59:0/3887604377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8418101c90 0x7f84180fdc00 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f840800b4a0 tx=0x7f840800b960 comp rx=0 tx=0).stop 2024-09-10T21:22:19.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.600+0000 7f841eae3640 1 -- 172.21.15.59:0/3887604377 shutdown_connections 2024-09-10T21:22:19.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.600+0000 7f841eae3640 1 --2- 172.21.15.59:0/3887604377 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f84000b52e0 0x7f84000b77a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.600+0000 7f841eae3640 1 --2- 172.21.15.59:0/3887604377 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8418108020 0x7f84180fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.600+0000 7f841eae3640 1 --2- 172.21.15.59:0/3887604377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f84181076a0 0x7f84180fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.600+0000 7f841eae3640 1 --2- 172.21.15.59:0/3887604377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8418101c90 0x7f84180fdc00 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:19.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.600+0000 7f841eae3640 1 -- 172.21.15.59:0/3887604377 >> 172.21.15.59:0/3887604377 conn(0x7f84180fd700 msgr2=0x7f841806ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:19.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.600+0000 7f841eae3640 1 -- 172.21.15.59:0/3887604377 shutdown_connections 2024-09-10T21:22:19.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:19.600+0000 7f841eae3640 1 -- 172.21.15.59:0/3887604377 wait complete. 2024-09-10T21:22:21.308 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:22:21.308 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:22:21.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:21 smithi059 ceph-mon[30888]: pgmap v552: 97 pgs: 97 active+clean; 4.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:22:21.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:21 smithi154 ceph-mon[35041]: pgmap v552: 97 pgs: 97 active+clean; 4.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:22:21.575 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:22:21.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:21 smithi192 ceph-mon[35363]: pgmap v552: 97 pgs: 97 active+clean; 4.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:22:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.064+0000 7ff335faa640 1 -- 172.21.15.59:0/1938683011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff330109150 msgr2=0x7ff33010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.064+0000 7ff335faa640 1 --2- 172.21.15.59:0/1938683011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff330109150 0x7ff33010f950 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7ff328009ca0 tx=0x7ff32802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.064+0000 7ff335faa640 1 -- 172.21.15.59:0/1938683011 shutdown_connections 2024-09-10T21:22:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.064+0000 7ff335faa640 1 --2- 172.21.15.59:0/1938683011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff330109150 0x7ff33010f950 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.064+0000 7ff335faa640 1 --2- 172.21.15.59:0/1938683011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3301087d0 0x7ff330108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.064+0000 7ff335faa640 1 --2- 172.21.15.59:0/1938683011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff330102dc0 0x7ff3301031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.064+0000 7ff335faa640 1 -- 172.21.15.59:0/1938683011 >> 172.21.15.59:0/1938683011 conn(0x7ff3300fe830 msgr2=0x7ff330100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.064+0000 7ff335faa640 1 -- 172.21.15.59:0/1938683011 shutdown_connections 2024-09-10T21:22:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.064+0000 7ff335faa640 1 -- 172.21.15.59:0/1938683011 wait complete. 2024-09-10T21:22:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.064+0000 7ff335faa640 1 Processor -- start 2024-09-10T21:22:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff335faa640 1 -- start start 2024-09-10T21:22:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff335faa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff330102dc0 0x7ff3301991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff335faa640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3301087d0 0x7ff330199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:22.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff335faa640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff330109150 0x7ff33019eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:22.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff335faa640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff330112dd0 con 0x7ff3301087d0 2024-09-10T21:22:22.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff335faa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff330112c50 con 0x7ff330102dc0 2024-09-10T21:22:22.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff335faa640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff330112f50 con 0x7ff330109150 2024-09-10T21:22:22.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff32effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3301087d0 0x7ff330199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:22.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff32effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3301087d0 0x7ff330199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34558/0 (socket says 172.21.15.59:34558) 2024-09-10T21:22:22.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff32effd640 1 -- 172.21.15.59:0/1250302856 learned_addr learned my addr 172.21.15.59:0/1250302856 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:22.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff32f7fe640 1 --2- 172.21.15.59:0/1250302856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff330102dc0 0x7ff3301991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:22.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff32ffff640 1 --2- 172.21.15.59:0/1250302856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff330109150 0x7ff33019eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:22.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff32effd640 1 -- 172.21.15.59:0/1250302856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff330109150 msgr2=0x7ff33019eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:22.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff32effd640 1 --2- 172.21.15.59:0/1250302856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff330109150 0x7ff33019eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff32effd640 1 -- 172.21.15.59:0/1250302856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff330102dc0 msgr2=0x7ff3301991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:22.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff32effd640 1 --2- 172.21.15.59:0/1250302856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff330102dc0 0x7ff3301991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff32effd640 1 -- 172.21.15.59:0/1250302856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33019f270 con 0x7ff3301087d0 2024-09-10T21:22:22.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff32f7fe640 1 --2- 172.21.15.59:0/1250302856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff330102dc0 0x7ff3301991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:22:22.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff32effd640 1 --2- 172.21.15.59:0/1250302856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3301087d0 0x7ff330199700 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ff32400d950 tx=0x7ff32400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:22.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.065+0000 7ff32cff9640 1 -- 172.21.15.59:0/1250302856 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff324017070 con 0x7ff3301087d0 2024-09-10T21:22:22.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.066+0000 7ff335faa640 1 -- 172.21.15.59:0/1250302856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33019f560 con 0x7ff3301087d0 2024-09-10T21:22:22.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.066+0000 7ff32cff9640 1 -- 172.21.15.59:0/1250302856 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff324009c30 con 0x7ff3301087d0 2024-09-10T21:22:22.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.066+0000 7ff32cff9640 1 -- 172.21.15.59:0/1250302856 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32400f620 con 0x7ff3301087d0 2024-09-10T21:22:22.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.066+0000 7ff335faa640 1 -- 172.21.15.59:0/1250302856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3301a5c20 con 0x7ff3301087d0 2024-09-10T21:22:22.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.068+0000 7ff32cff9640 1 -- 172.21.15.59:0/1250302856 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7ff324010460 con 0x7ff3301087d0 2024-09-10T21:22:22.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.068+0000 7ff33837f740 1 Processor -- start 2024-09-10T21:22:22.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.068+0000 7ff33837f740 1 -- start start 2024-09-10T21:22:22.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.068+0000 7ff33837f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 0x564f3818b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:22.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.068+0000 7ff33837f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3818b800 0x564f3819b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:22.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.068+0000 7ff33837f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3819bba0 0x564f3819df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:22.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.068+0000 7ff33837f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564f38101e60 con 0x564f3818aee0 2024-09-10T21:22:22.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.068+0000 7ff33837f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564f380f1290 con 0x564f3818b800 2024-09-10T21:22:22.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.068+0000 7ff33837f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564f380f50a0 con 0x564f3819bba0 2024-09-10T21:22:22.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.069+0000 7ff32ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 0x564f3818b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:22.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.069+0000 7ff32ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 0x564f3818b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34568/0 (socket says 172.21.15.59:34568) 2024-09-10T21:22:22.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.069+0000 7ff32ffff640 1 -- 172.21.15.59:0/2479837758 learned_addr learned my addr 172.21.15.59:0/2479837758 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:22.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.069+0000 7ff32effd640 1 --2- 172.21.15.59:0/2479837758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3819bba0 0x564f3819df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:22.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.069+0000 7ff32f7fe640 1 --2- 172.21.15.59:0/2479837758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3818b800 0x564f3819b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:22.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.069+0000 7ff32ffff640 1 -- 172.21.15.59:0/2479837758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3819bba0 msgr2=0x564f3819df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:22.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.069+0000 7ff32ffff640 1 --2- 172.21.15.59:0/2479837758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3819bba0 0x564f3819df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.069+0000 7ff32ffff640 1 -- 172.21.15.59:0/2479837758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3818b800 msgr2=0x564f3819b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:22.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.069+0000 7ff32ffff640 1 --2- 172.21.15.59:0/2479837758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3818b800 0x564f3819b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.069+0000 7ff32ffff640 1 -- 172.21.15.59:0/2479837758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f37e4f930 con 0x564f3818aee0 2024-09-10T21:22:22.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.069+0000 7ff32effd640 1 --2- 172.21.15.59:0/2479837758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3819bba0 0x564f3819df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:22:22.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.069+0000 7ff32f7fe640 1 --2- 172.21.15.59:0/2479837758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3818b800 0x564f3819b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:22:22.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.069+0000 7ff32cff9640 1 --2- 172.21.15.59:0/1250302856 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff3180b52e0 0x7ff3180b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:22.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.069+0000 7ff32ffff640 1 --2- 172.21.15.59:0/2479837758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 0x564f3818b2c0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ff328005fa0 tx=0x7ff328005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d6dadc2a1bde76 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:22.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.069+0000 7ff32f7fe640 1 --2- 172.21.15.59:0/1250302856 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff3180b52e0 0x7ff3180b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:22.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.069+0000 7ff32cff9640 1 -- 172.21.15.59:0/1250302856 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff3240e5950 con 0x7ff3301087d0 2024-09-10T21:22:22.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.069+0000 7ff315ffb640 1 -- 172.21.15.59:0/2479837758 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328031cf0 con 0x564f3818aee0 2024-09-10T21:22:22.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.069+0000 7ff315ffb640 1 -- 172.21.15.59:0/2479837758 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff32803f070 con 0x564f3818aee0 2024-09-10T21:22:22.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.069+0000 7ff315ffb640 1 -- 172.21.15.59:0/2479837758 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3280042a0 con 0x564f3818aee0 2024-09-10T21:22:22.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.070+0000 7ff33837f740 1 -- 172.21.15.59:0/2479837758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 msgr2=0x564f3818b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:22.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.070+0000 7ff32f7fe640 1 --2- 172.21.15.59:0/1250302856 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff3180b52e0 0x7ff3180b77a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x564f3818e060 tx=0x7ff32000b710 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:22.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.070+0000 7ff33837f740 1 --2- 172.21.15.59:0/2479837758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 0x564f3818b2c0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ff328005fa0 tx=0x7ff328005fd0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.070+0000 7ff33837f740 1 -- 172.21.15.59:0/2479837758 shutdown_connections 2024-09-10T21:22:22.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.070+0000 7ff33837f740 1 --2- 172.21.15.59:0/2479837758 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3819bba0 0x564f3819df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.070+0000 7ff33837f740 1 --2- 172.21.15.59:0/2479837758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3818b800 0x564f3819b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.070+0000 7ff33837f740 1 --2- 172.21.15.59:0/2479837758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 0x564f3818b2c0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.070+0000 7ff33837f740 1 -- 172.21.15.59:0/2479837758 >> 172.21.15.59:0/2479837758 conn(0x564f38188d10 msgr2=0x564f38189eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:22.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.070+0000 7ff33837f740 1 -- 172.21.15.59:0/2479837758 shutdown_connections 2024-09-10T21:22:22.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.070+0000 7ff33837f740 1 -- 172.21.15.59:0/2479837758 wait complete. 2024-09-10T21:22:22.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.071+0000 7ff33837f740 1 -- start start 2024-09-10T21:22:22.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.071+0000 7ff33837f740 1 Processor -- start 2024-09-10T21:22:22.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.071+0000 7ff33837f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3818aee0 0x564f38198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:22.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.071+0000 7ff33837f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3818b800 0x564f38199100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:22.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.071+0000 7ff33837f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3819bba0 0x564f38199640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:22.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.071+0000 7ff33837f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564f37f52890 con 0x564f3819bba0 2024-09-10T21:22:22.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.071+0000 7ff33837f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564f3808bd40 con 0x564f3818b800 2024-09-10T21:22:22.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.071+0000 7ff33837f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564f3819e7f0 con 0x564f3818aee0 2024-09-10T21:22:22.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.071+0000 7ff33837f740 10 client.0 _ll_register_callbacks cb 0x564f380efc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:22.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.071+0000 7ff32ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3819bba0 0x564f38199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:22.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.071+0000 7ff32ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3819bba0 0x564f38199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34584/0 (socket says 172.21.15.59:34584) 2024-09-10T21:22:22.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.071+0000 7ff32ffff640 1 -- 172.21.15.59:0/3990417335 learned_addr learned my addr 172.21.15.59:0/3990417335 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:22.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.071+0000 7ff32f7fe640 1 --2- 172.21.15.59:0/3990417335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3818aee0 0x564f38198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:22.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.071+0000 7ff32effd640 1 --2- 172.21.15.59:0/3990417335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3818b800 0x564f38199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:22.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.072+0000 7ff32ffff640 1 -- 172.21.15.59:0/3990417335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3818aee0 msgr2=0x564f38198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:22.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.072+0000 7ff32ffff640 1 --2- 172.21.15.59:0/3990417335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3818aee0 0x564f38198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.072+0000 7ff32ffff640 1 -- 172.21.15.59:0/3990417335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3818b800 msgr2=0x564f38199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:22.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.072+0000 7ff32ffff640 1 --2- 172.21.15.59:0/3990417335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3818b800 0x564f38199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.072+0000 7ff32ffff640 1 -- 172.21.15.59:0/3990417335 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f381a7c20 con 0x564f3819bba0 2024-09-10T21:22:22.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.072+0000 7ff32effd640 1 --2- 172.21.15.59:0/3990417335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3818b800 0x564f38199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:22:22.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.072+0000 7ff32ffff640 1 --2- 172.21.15.59:0/3990417335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3819bba0 0x564f38199640 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7ff328003d60 tx=0x7ff328031d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46246a68e8fbcbe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:22.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.072+0000 7ff30effd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:22:22.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.072+0000 7ff30effd640 1 -- 172.21.15.59:0/3990417335 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328031660 con 0x564f3819bba0 2024-09-10T21:22:22.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.072+0000 7ff30effd640 1 -- 172.21.15.59:0/3990417335 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff328031800 con 0x564f3819bba0 2024-09-10T21:22:22.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.072+0000 7ff33837f740 1 -- 172.21.15.59:0/3990417335 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff32803f070 con 0x564f3819bba0 2024-09-10T21:22:22.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.072+0000 7ff30effd640 1 -- 172.21.15.59:0/3990417335 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff32802f660 con 0x564f3819bba0 2024-09-10T21:22:22.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.072+0000 7ff33837f740 10 client.17100 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:22.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.072+0000 7ff33837f740 1 -- 172.21.15.59:0/3990417335 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564f381aa5d0 con 0x564f3819bba0 2024-09-10T21:22:22.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.072+0000 7ff30effd640 1 -- 172.21.15.59:0/3990417335 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff32803f070 con 0x564f3819bba0 2024-09-10T21:22:22.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.073+0000 7ff30effd640 1 -- 172.21.15.59:0/3990417335 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff328030a70 con 0x564f3819bba0 2024-09-10T21:22:22.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.073+0000 7ff33837f740 10 client.17100 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:22.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.073+0000 7ff33837f740 10 client.17100 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:22:22.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.073+0000 7ff33837f740 20 client.17100 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:22.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.073+0000 7ff33837f740 1 --2- 172.21.15.59:0/3990417335 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x564f381ab920 0x564f381add10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:22.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.073+0000 7ff33837f740 4 client.17100 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:22:22.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.073+0000 7ff33837f740 1 -- 172.21.15.59:0/3990417335 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f38103db0 con 0x564f381ab920 2024-09-10T21:22:22.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.073+0000 7ff32f7fe640 1 --2- 172.21.15.59:0/3990417335 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x564f381ab920 0x564f381add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:22.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.073+0000 7ff32f7fe640 1 --2- 172.21.15.59:0/3990417335 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x564f381ab920 0x564f381add10 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5b623abdaea6d5d server_cookie=2b27cf2a5885515a in_seq=0 out_seq=0 2024-09-10T21:22:22.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.073+0000 7ff30effd640 10 client.17100 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:22.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.074+0000 7ff30effd640 1 -- 172.21.15.59:0/3990417335 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564f38103db0 con 0x564f381ab920 2024-09-10T21:22:22.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.074+0000 7ff30effd640 10 client.17100 handle_command_reply: tid=0 2024-09-10T21:22:22.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.074+0000 7ff33837f740 1 client.17100 shutdown 2024-09-10T21:22:22.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.074+0000 7ff33837f740 1 -- 172.21.15.59:0/3990417335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3819bba0 msgr2=0x564f38199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:22.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.074+0000 7ff33837f740 1 --2- 172.21.15.59:0/3990417335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3819bba0 0x564f38199640 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7ff328003d60 tx=0x7ff328031d90 comp rx=0 tx=0).stop 2024-09-10T21:22:22.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.074+0000 7ff33837f740 1 -- 172.21.15.59:0/3990417335 shutdown_connections 2024-09-10T21:22:22.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.074+0000 7ff33837f740 1 --2- 172.21.15.59:0/3990417335 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x564f381ab920 0x564f381add10 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.074+0000 7ff33837f740 1 --2- 172.21.15.59:0/3990417335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3819bba0 0x564f38199640 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.074+0000 7ff33837f740 1 --2- 172.21.15.59:0/3990417335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3818b800 0x564f38199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.074+0000 7ff33837f740 1 --2- 172.21.15.59:0/3990417335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3818aee0 0x564f38198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.074+0000 7ff33837f740 1 -- 172.21.15.59:0/3990417335 >> 172.21.15.59:0/3990417335 conn(0x564f38188d10 msgr2=0x564f38187f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:22.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.074+0000 7ff30effd640 0 client.17100 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:22.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.075+0000 7ff33837f740 1 -- 172.21.15.59:0/3990417335 shutdown_connections 2024-09-10T21:22:22.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.075+0000 7ff33837f740 1 -- 172.21.15.59:0/3990417335 wait complete. 2024-09-10T21:22:22.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.075+0000 7ff33837f740 20 client.17100 trim_cache size 0 max 16384 2024-09-10T21:22:22.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.092+0000 7ff33837f740 1 Processor -- start 2024-09-10T21:22:22.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.092+0000 7ff33837f740 1 -- start start 2024-09-10T21:22:22.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.092+0000 7ff33837f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 0x564f381a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:22.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.092+0000 7ff33837f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3818b800 0x564f381a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:22.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.092+0000 7ff33837f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3819bba0 0x564f381a7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:22.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.092+0000 7ff33837f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff3301ac020 con 0x564f3818aee0 2024-09-10T21:22:22.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.092+0000 7ff33837f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff3301adb60 con 0x564f3819bba0 2024-09-10T21:22:22.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.092+0000 7ff33837f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff3301ac6f0 con 0x564f3818b800 2024-09-10T21:22:22.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.093+0000 7ff32f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 0x564f381a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:22.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.093+0000 7ff32f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 0x564f381a6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34592/0 (socket says 172.21.15.59:34592) 2024-09-10T21:22:22.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.093+0000 7ff32f7fe640 1 -- 172.21.15.59:0/917926215 learned_addr learned my addr 172.21.15.59:0/917926215 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:22.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.093+0000 7ff32effd640 1 --2- 172.21.15.59:0/917926215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3818b800 0x564f381a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:22.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.093+0000 7ff32ffff640 1 --2- 172.21.15.59:0/917926215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3819bba0 0x564f381a7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:22.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.093+0000 7ff32f7fe640 1 -- 172.21.15.59:0/917926215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3818b800 msgr2=0x564f381a6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:22.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.093+0000 7ff32f7fe640 1 --2- 172.21.15.59:0/917926215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3818b800 0x564f381a6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.093+0000 7ff32f7fe640 1 -- 172.21.15.59:0/917926215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3819bba0 msgr2=0x564f381a7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:22.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.093+0000 7ff32f7fe640 1 --2- 172.21.15.59:0/917926215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3819bba0 0x564f381a7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.093+0000 7ff32f7fe640 1 -- 172.21.15.59:0/917926215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f3818b630 con 0x564f3818aee0 2024-09-10T21:22:22.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.093+0000 7ff32f7fe640 1 --2- 172.21.15.59:0/917926215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 0x564f381a6a80 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff320010c30 tx=0x7ff320013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b62b4316ce8dd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:22.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.093+0000 7ff3157fa640 1 -- 172.21.15.59:0/917926215 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff320005220 con 0x564f3818aee0 2024-09-10T21:22:22.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.093+0000 7ff3157fa640 1 -- 172.21.15.59:0/917926215 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff320004c50 con 0x564f3818aee0 2024-09-10T21:22:22.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.093+0000 7ff3157fa640 1 -- 172.21.15.59:0/917926215 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32001f920 con 0x564f3818aee0 2024-09-10T21:22:22.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.094+0000 7ff33837f740 1 -- 172.21.15.59:0/917926215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 msgr2=0x564f381a6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:22.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.094+0000 7ff33837f740 1 --2- 172.21.15.59:0/917926215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 0x564f381a6a80 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff320010c30 tx=0x7ff320013000 comp rx=0 tx=0).stop 2024-09-10T21:22:22.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.094+0000 7ff33837f740 1 -- 172.21.15.59:0/917926215 shutdown_connections 2024-09-10T21:22:22.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.094+0000 7ff33837f740 1 --2- 172.21.15.59:0/917926215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3819bba0 0x564f381a7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.094+0000 7ff33837f740 1 --2- 172.21.15.59:0/917926215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3818b800 0x564f381a6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.094+0000 7ff33837f740 1 --2- 172.21.15.59:0/917926215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 0x564f381a6a80 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.094+0000 7ff33837f740 1 -- 172.21.15.59:0/917926215 >> 172.21.15.59:0/917926215 conn(0x564f38188d10 msgr2=0x564f3819cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:22.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.094+0000 7ff33837f740 1 -- 172.21.15.59:0/917926215 shutdown_connections 2024-09-10T21:22:22.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.094+0000 7ff33837f740 1 -- 172.21.15.59:0/917926215 wait complete. 2024-09-10T21:22:22.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.094+0000 7ff33837f740 1 -- start start 2024-09-10T21:22:22.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.095+0000 7ff33837f740 1 Processor -- start 2024-09-10T21:22:22.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.095+0000 7ff33837f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 0x564f381aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:22.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.095+0000 7ff33837f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3818b800 0x564f381af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:22.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.095+0000 7ff33837f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3819bba0 0x564f38217490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:22.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.095+0000 7ff33837f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff3301ad490 con 0x564f3818aee0 2024-09-10T21:22:22.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.095+0000 7ff33837f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff3301acdc0 con 0x564f3818b800 2024-09-10T21:22:22.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.095+0000 7ff33837f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff3301aa000 con 0x564f3819bba0 2024-09-10T21:22:22.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.095+0000 7ff33837f740 10 client.0 _ll_register_callbacks cb 0x7ff328005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:22.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.095+0000 7ff32f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 0x564f381aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:22.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.095+0000 7ff32f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 0x564f381aed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34598/0 (socket says 172.21.15.59:34598) 2024-09-10T21:22:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.095+0000 7ff32f7fe640 1 -- 172.21.15.59:0/4037890139 learned_addr learned my addr 172.21.15.59:0/4037890139 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.095+0000 7ff32ffff640 1 --2- 172.21.15.59:0/4037890139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3819bba0 0x564f38217490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.095+0000 7ff32effd640 1 --2- 172.21.15.59:0/4037890139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3818b800 0x564f381af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.095+0000 7ff32f7fe640 1 -- 172.21.15.59:0/4037890139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3819bba0 msgr2=0x564f38217490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.095+0000 7ff32f7fe640 1 --2- 172.21.15.59:0/4037890139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3819bba0 0x564f38217490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.095+0000 7ff32f7fe640 1 -- 172.21.15.59:0/4037890139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3818b800 msgr2=0x564f381af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.095+0000 7ff32f7fe640 1 --2- 172.21.15.59:0/4037890139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3818b800 0x564f381af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.096+0000 7ff32f7fe640 1 -- 172.21.15.59:0/4037890139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f382179d0 con 0x564f3818aee0 2024-09-10T21:22:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.096+0000 7ff32f7fe640 1 --2- 172.21.15.59:0/4037890139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 0x564f381aed30 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ff320005760 tx=0x7ff320004960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36bd24f29c97cff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.096+0000 7ff30effd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:22:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.096+0000 7ff30effd640 1 -- 172.21.15.59:0/4037890139 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32003cce0 con 0x564f3818aee0 2024-09-10T21:22:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.096+0000 7ff30effd640 1 -- 172.21.15.59:0/4037890139 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff320004e00 con 0x564f3818aee0 2024-09-10T21:22:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.096+0000 7ff33837f740 1 -- 172.21.15.59:0/4037890139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff320004c50 con 0x564f3818aee0 2024-09-10T21:22:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.096+0000 7ff30effd640 1 -- 172.21.15.59:0/4037890139 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff32004c050 con 0x564f3818aee0 2024-09-10T21:22:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.096+0000 7ff33837f740 10 client.17106 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.096+0000 7ff33837f740 1 -- 172.21.15.59:0/4037890139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564f38191210 con 0x564f3818aee0 2024-09-10T21:22:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.096+0000 7ff30effd640 1 -- 172.21.15.59:0/4037890139 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff320004c50 con 0x564f3818aee0 2024-09-10T21:22:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.096+0000 7ff30effd640 1 -- 172.21.15.59:0/4037890139 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff32002e030 con 0x564f3818aee0 2024-09-10T21:22:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.097+0000 7ff33837f740 10 client.17106 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.097+0000 7ff33837f740 10 client.17106 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:22:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.097+0000 7ff33837f740 20 client.17106 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.097+0000 7ff33837f740 1 --2- 172.21.15.59:0/4037890139 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x564f38191940 0x564f38193d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.097+0000 7ff33837f740 4 client.17106 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:22:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.097+0000 7ff33837f740 1 -- 172.21.15.59:0/4037890139 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564f380ff860 con 0x564f38191940 2024-09-10T21:22:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.097+0000 7ff32effd640 1 --2- 172.21.15.59:0/4037890139 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x564f38191940 0x564f38193d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.097+0000 7ff32effd640 1 --2- 172.21.15.59:0/4037890139 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x564f38191940 0x564f38193d60 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6002997415486242 server_cookie=5ca41e6e4304bd11 in_seq=0 out_seq=0 2024-09-10T21:22:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.097+0000 7ff30effd640 10 client.17106 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.099+0000 7ff30effd640 1 -- 172.21.15.59:0/4037890139 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564f380ff860 con 0x564f38191940 2024-09-10T21:22:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.099+0000 7ff30effd640 10 client.17106 handle_command_reply: tid=0 2024-09-10T21:22:22.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.099+0000 7ff33837f740 1 client.17106 shutdown 2024-09-10T21:22:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.099+0000 7ff33837f740 1 -- 172.21.15.59:0/4037890139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 msgr2=0x564f381aed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.099+0000 7ff33837f740 1 --2- 172.21.15.59:0/4037890139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 0x564f381aed30 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ff320005760 tx=0x7ff320004960 comp rx=0 tx=0).stop 2024-09-10T21:22:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.099+0000 7ff33837f740 1 -- 172.21.15.59:0/4037890139 shutdown_connections 2024-09-10T21:22:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.099+0000 7ff33837f740 1 --2- 172.21.15.59:0/4037890139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564f3819bba0 0x564f38217490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.099+0000 7ff33837f740 1 --2- 172.21.15.59:0/4037890139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564f3818b800 0x564f381af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.099+0000 7ff33837f740 1 --2- 172.21.15.59:0/4037890139 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x564f38191940 0x564f38193d60 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.099+0000 7ff33837f740 1 --2- 172.21.15.59:0/4037890139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564f3818aee0 0x564f381aed30 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.099+0000 7ff33837f740 1 -- 172.21.15.59:0/4037890139 >> 172.21.15.59:0/4037890139 conn(0x564f38188d10 msgr2=0x564f381a6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.099+0000 7ff30effd640 0 client.17106 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.100+0000 7ff33837f740 1 -- 172.21.15.59:0/4037890139 shutdown_connections 2024-09-10T21:22:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.100+0000 7ff33837f740 1 -- 172.21.15.59:0/4037890139 wait complete. 2024-09-10T21:22:22.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.100+0000 7ff33837f740 20 client.17106 trim_cache size 0 max 16384 2024-09-10T21:22:22.107 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:22:22.107 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:22:22.107 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "7de1e6cf-02c2-41f2-b957-563f88bae8ef", 2024-09-10T21:22:22.107 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:22:22.107 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:22:22.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.100+0000 7ff335faa640 1 -- 172.21.15.59:0/1250302856 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff3180b52e0 msgr2=0x7ff3180b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:22.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.100+0000 7ff335faa640 1 --2- 172.21.15.59:0/1250302856 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff3180b52e0 0x7ff3180b77a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x564f3818e060 tx=0x7ff32000b710 comp rx=0 tx=0).stop 2024-09-10T21:22:22.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.100+0000 7ff335faa640 1 -- 172.21.15.59:0/1250302856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3301087d0 msgr2=0x7ff330199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:22.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.100+0000 7ff335faa640 1 --2- 172.21.15.59:0/1250302856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3301087d0 0x7ff330199700 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ff32400d950 tx=0x7ff32400de10 comp rx=0 tx=0).stop 2024-09-10T21:22:22.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.100+0000 7ff335faa640 1 -- 172.21.15.59:0/1250302856 shutdown_connections 2024-09-10T21:22:22.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.100+0000 7ff335faa640 1 --2- 172.21.15.59:0/1250302856 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff3180b52e0 0x7ff3180b77a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.100+0000 7ff335faa640 1 --2- 172.21.15.59:0/1250302856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff330109150 0x7ff33019eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.100+0000 7ff335faa640 1 --2- 172.21.15.59:0/1250302856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3301087d0 0x7ff330199700 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.100+0000 7ff335faa640 1 --2- 172.21.15.59:0/1250302856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff330102dc0 0x7ff3301991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:22.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.100+0000 7ff335faa640 1 -- 172.21.15.59:0/1250302856 >> 172.21.15.59:0/1250302856 conn(0x7ff3300fe830 msgr2=0x7ff3300ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:22.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.100+0000 7ff335faa640 1 -- 172.21.15.59:0/1250302856 shutdown_connections 2024-09-10T21:22:22.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:22.100+0000 7ff335faa640 1 -- 172.21.15.59:0/1250302856 wait complete. 2024-09-10T21:22:22.864 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:22:23.124 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:22:23.369 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:23 smithi059 ceph-mon[30888]: pgmap v553: 97 pgs: 97 active+clean; 4.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:22:23.369 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:23 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:22:23.369 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:23 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:22:23.369 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:23 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:22:23.369 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:23 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:22:23.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:23 smithi154 ceph-mon[35041]: pgmap v553: 97 pgs: 97 active+clean; 4.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:22:23.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:23 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:22:23.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:23 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:22:23.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:23 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:22:23.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:23 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:22:23.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:23 smithi192 ceph-mon[35363]: pgmap v553: 97 pgs: 97 active+clean; 4.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:22:23.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:23 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:22:23.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:23 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:22:23.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:23 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:22:23.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:23 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:22:23.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.595+0000 7fd13b232640 1 -- 172.21.15.59:0/3091658554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd134108060 msgr2=0x7fd13410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:23.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.595+0000 7fd13b232640 1 --2- 172.21.15.59:0/3091658554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd134108060 0x7fd13410e860 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009ca0 tx=0x7fd12c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.595+0000 7fd13b232640 1 -- 172.21.15.59:0/3091658554 shutdown_connections 2024-09-10T21:22:23.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.595+0000 7fd13b232640 1 --2- 172.21.15.59:0/3091658554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd134108060 0x7fd13410e860 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.595+0000 7fd13b232640 1 --2- 172.21.15.59:0/3091658554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1341076e0 0x7fd134107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.595+0000 7fd13b232640 1 --2- 172.21.15.59:0/3091658554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd134101cd0 0x7fd1341020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.595+0000 7fd13b232640 1 -- 172.21.15.59:0/3091658554 >> 172.21.15.59:0/3091658554 conn(0x7fd1340fd720 msgr2=0x7fd1340ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:23.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.595+0000 7fd13b232640 1 -- 172.21.15.59:0/3091658554 shutdown_connections 2024-09-10T21:22:23.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.595+0000 7fd13b232640 1 -- 172.21.15.59:0/3091658554 wait complete. 2024-09-10T21:22:23.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.596+0000 7fd13b232640 1 Processor -- start 2024-09-10T21:22:23.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.596+0000 7fd13b232640 1 -- start start 2024-09-10T21:22:23.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.596+0000 7fd13b232640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd134101cd0 0x7fd13419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.596+0000 7fd13b232640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1341076e0 0x7fd13419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.596+0000 7fd13b232640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd134108060 0x7fd13419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.596+0000 7fd13b232640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd134111d20 con 0x7fd134101cd0 2024-09-10T21:22:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.596+0000 7fd13b232640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd134111ba0 con 0x7fd1341076e0 2024-09-10T21:22:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.596+0000 7fd13b232640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd134111ea0 con 0x7fd134108060 2024-09-10T21:22:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.597+0000 7fd138fce640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd134101cd0 0x7fd13419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.597+0000 7fd1397cf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd134108060 0x7fd13419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.597+0000 7fd138fce640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd134101cd0 0x7fd13419a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34620/0 (socket says 172.21.15.59:34620) 2024-09-10T21:22:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.597+0000 7fd138fce640 1 -- 172.21.15.59:0/3795372312 learned_addr learned my addr 172.21.15.59:0/3795372312 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.597+0000 7fd133fff640 1 --2- 172.21.15.59:0/3795372312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1341076e0 0x7fd13419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.597+0000 7fd138fce640 1 -- 172.21.15.59:0/3795372312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd134108060 msgr2=0x7fd13419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.597+0000 7fd138fce640 1 --2- 172.21.15.59:0/3795372312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd134108060 0x7fd13419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.597+0000 7fd138fce640 1 -- 172.21.15.59:0/3795372312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1341076e0 msgr2=0x7fd13419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:23.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.597+0000 7fd138fce640 1 --2- 172.21.15.59:0/3795372312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1341076e0 0x7fd13419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.597+0000 7fd138fce640 1 -- 172.21.15.59:0/3795372312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1341a5460 con 0x7fd134101cd0 2024-09-10T21:22:23.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.597+0000 7fd138fce640 1 --2- 172.21.15.59:0/3795372312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd134101cd0 0x7fd13419a080 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd12800c920 tx=0x7fd12800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:23.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.597+0000 7fd131ffb640 1 -- 172.21.15.59:0/3795372312 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd128007bb0 con 0x7fd134101cd0 2024-09-10T21:22:23.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.597+0000 7fd13b232640 1 -- 172.21.15.59:0/3795372312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1341a5750 con 0x7fd134101cd0 2024-09-10T21:22:23.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.597+0000 7fd131ffb640 1 -- 172.21.15.59:0/3795372312 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd128007d50 con 0x7fd134101cd0 2024-09-10T21:22:23.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.597+0000 7fd131ffb640 1 -- 172.21.15.59:0/3795372312 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd128018730 con 0x7fd134101cd0 2024-09-10T21:22:23.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.598+0000 7fd13b232640 1 -- 172.21.15.59:0/3795372312 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1341a5d60 con 0x7fd134101cd0 2024-09-10T21:22:23.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.600+0000 7fd131ffb640 1 -- 172.21.15.59:0/3795372312 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd12800f450 con 0x7fd134101cd0 2024-09-10T21:22:23.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.600+0000 7fd13d607740 1 Processor -- start 2024-09-10T21:22:23.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.600+0000 7fd13d607740 1 -- start start 2024-09-10T21:22:23.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.601+0000 7fd13d607740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a0a0 0x5638f543a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:23.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.601+0000 7fd13d607740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f543a9c0 0x5638f5446410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:23.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.601+0000 7fd13d607740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f5446950 0x5638f5448d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:23.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.601+0000 7fd13d607740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5638f53b0e50 con 0x5638f543a0a0 2024-09-10T21:22:23.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.601+0000 7fd13d607740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5638f53a0280 con 0x5638f5446950 2024-09-10T21:22:23.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.601+0000 7fd13d607740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5638f53a4090 con 0x5638f543a9c0 2024-09-10T21:22:23.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.601+0000 7fd1397cf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a0a0 0x5638f543a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:23.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.601+0000 7fd1397cf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a0a0 0x5638f543a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34634/0 (socket says 172.21.15.59:34634) 2024-09-10T21:22:23.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.601+0000 7fd1397cf640 1 -- 172.21.15.59:0/3409228795 learned_addr learned my addr 172.21.15.59:0/3409228795 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:23.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.601+0000 7fd138fce640 1 --2- 172.21.15.59:0/3409228795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f543a9c0 0x5638f5446410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:23.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.601+0000 7fd133fff640 1 --2- 172.21.15.59:0/3409228795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f5446950 0x5638f5448d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:23.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.601+0000 7fd1397cf640 1 -- 172.21.15.59:0/3409228795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f543a9c0 msgr2=0x5638f5446410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:23.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.601+0000 7fd131ffb640 1 --2- 172.21.15.59:0/3795372312 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd1240b52e0 0x7fd1240b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:23.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.601+0000 7fd1397cf640 1 --2- 172.21.15.59:0/3409228795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f543a9c0 0x5638f5446410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.601+0000 7fd1397cf640 1 -- 172.21.15.59:0/3409228795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f5446950 msgr2=0x5638f5448d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:23.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.601+0000 7fd1397cf640 1 --2- 172.21.15.59:0/3409228795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f5446950 0x5638f5448d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.601+0000 7fd1397cf640 1 -- 172.21.15.59:0/3409228795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638f50fe650 con 0x5638f543a0a0 2024-09-10T21:22:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.601+0000 7fd131ffb640 1 -- 172.21.15.59:0/3795372312 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd1280e5c30 con 0x7fd134101cd0 2024-09-10T21:22:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.601+0000 7fd1397cf640 1 --2- 172.21.15.59:0/3795372312 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd1240b52e0 0x7fd1240b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.602+0000 7fd1397cf640 1 --2- 172.21.15.59:0/3409228795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a0a0 0x5638f543a480 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fd12c035000 tx=0x7fd12c02f4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3c2cfc006baa0f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.602+0000 7fd11effd640 1 -- 172.21.15.59:0/3409228795 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0317f0 con 0x5638f543a0a0 2024-09-10T21:22:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.602+0000 7fd11effd640 1 -- 172.21.15.59:0/3409228795 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd12c036070 con 0x5638f543a0a0 2024-09-10T21:22:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.602+0000 7fd11effd640 1 -- 172.21.15.59:0/3409228795 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c02f780 con 0x5638f543a0a0 2024-09-10T21:22:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.603+0000 7fd13d607740 1 -- 172.21.15.59:0/3409228795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a0a0 msgr2=0x5638f543a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.603+0000 7fd13d607740 1 --2- 172.21.15.59:0/3409228795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a0a0 0x5638f543a480 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fd12c035000 tx=0x7fd12c02f4c0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.603+0000 7fd1397cf640 1 --2- 172.21.15.59:0/3795372312 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd1240b52e0 0x7fd1240b77a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd12c047000 tx=0x7fd12c02fa80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:23.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.603+0000 7fd13d607740 1 -- 172.21.15.59:0/3409228795 shutdown_connections 2024-09-10T21:22:23.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.603+0000 7fd13d607740 1 --2- 172.21.15.59:0/3409228795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f5446950 0x5638f5448d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.603+0000 7fd13d607740 1 --2- 172.21.15.59:0/3409228795 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f543a9c0 0x5638f5446410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.603+0000 7fd13d607740 1 --2- 172.21.15.59:0/3409228795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a0a0 0x5638f543a480 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.603+0000 7fd13d607740 1 -- 172.21.15.59:0/3409228795 >> 172.21.15.59:0/3409228795 conn(0x5638f5437ed0 msgr2=0x5638f5439070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:23.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.603+0000 7fd13d607740 1 -- 172.21.15.59:0/3409228795 shutdown_connections 2024-09-10T21:22:23.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.603+0000 7fd13d607740 1 -- 172.21.15.59:0/3409228795 wait complete. 2024-09-10T21:22:23.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.603+0000 7fd13d607740 1 -- start start 2024-09-10T21:22:23.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.603+0000 7fd13d607740 1 Processor -- start 2024-09-10T21:22:23.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.604+0000 7fd13d607740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f543a0a0 0x5638f5446040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:23.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.604+0000 7fd13d607740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a9c0 0x5638f5443490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:23.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.604+0000 7fd13d607740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f5446950 0x5638f54439d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:23.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.604+0000 7fd13d607740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5638f5201700 con 0x5638f543a9c0 2024-09-10T21:22:23.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.604+0000 7fd13d607740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5638f533b110 con 0x5638f543a0a0 2024-09-10T21:22:23.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.604+0000 7fd13d607740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5638f5449450 con 0x5638f5446950 2024-09-10T21:22:23.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.604+0000 7fd13d607740 10 client.0 _ll_register_callbacks cb 0x5638f5354990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:23.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.604+0000 7fd133fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a9c0 0x5638f5443490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:23.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.604+0000 7fd133fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a9c0 0x5638f5443490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34638/0 (socket says 172.21.15.59:34638) 2024-09-10T21:22:23.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.604+0000 7fd133fff640 1 -- 172.21.15.59:0/631129974 learned_addr learned my addr 172.21.15.59:0/631129974 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:23.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.604+0000 7fd138fce640 1 --2- 172.21.15.59:0/631129974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f543a0a0 0x5638f5446040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:23.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.604+0000 7fd1397cf640 1 --2- 172.21.15.59:0/631129974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f5446950 0x5638f54439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:23.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.604+0000 7fd133fff640 1 -- 172.21.15.59:0/631129974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f5446950 msgr2=0x5638f54439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:23.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.604+0000 7fd133fff640 1 --2- 172.21.15.59:0/631129974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f5446950 0x5638f54439d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.604+0000 7fd133fff640 1 -- 172.21.15.59:0/631129974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f543a0a0 msgr2=0x5638f5446040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:23.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.604+0000 7fd133fff640 1 --2- 172.21.15.59:0/631129974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f543a0a0 0x5638f5446040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.604+0000 7fd133fff640 1 -- 172.21.15.59:0/631129974 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638f5368c40 con 0x5638f543a9c0 2024-09-10T21:22:23.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.604+0000 7fd133fff640 1 --2- 172.21.15.59:0/631129974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a9c0 0x5638f5443490 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd120011540 tx=0x7fd120011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fceebab746b4121 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:23.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.604+0000 7fd113fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:22:23.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.605+0000 7fd113fff640 1 -- 172.21.15.59:0/631129974 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12000f6d0 con 0x5638f543a9c0 2024-09-10T21:22:23.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.605+0000 7fd113fff640 1 -- 172.21.15.59:0/631129974 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd12000f870 con 0x5638f543a9c0 2024-09-10T21:22:23.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.605+0000 7fd13d607740 1 -- 172.21.15.59:0/631129974 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd12c036070 con 0x5638f543a9c0 2024-09-10T21:22:23.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.605+0000 7fd113fff640 1 -- 172.21.15.59:0/631129974 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd120024070 con 0x5638f543a9c0 2024-09-10T21:22:23.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.605+0000 7fd13d607740 10 client.17118 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:23.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.605+0000 7fd13d607740 1 -- 172.21.15.59:0/631129974 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5638f5454be0 con 0x5638f543a9c0 2024-09-10T21:22:23.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.605+0000 7fd113fff640 1 -- 172.21.15.59:0/631129974 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd12c036070 con 0x5638f543a9c0 2024-09-10T21:22:23.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.605+0000 7fd113fff640 1 -- 172.21.15.59:0/631129974 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd120014c00 con 0x5638f543a9c0 2024-09-10T21:22:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.605+0000 7fd13d607740 10 client.17118 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.605+0000 7fd13d607740 10 client.17118 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:22:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.605+0000 7fd13d607740 20 client.17118 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.605+0000 7fd13d607740 1 --2- 172.21.15.59:0/631129974 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5638f54560f0 0x5638f5458520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.605+0000 7fd13d607740 4 client.17118 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:22:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.605+0000 7fd13d607740 1 -- 172.21.15.59:0/631129974 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638f53b2da0 con 0x5638f54560f0 2024-09-10T21:22:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.606+0000 7fd138fce640 1 --2- 172.21.15.59:0/631129974 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5638f54560f0 0x5638f5458520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.606+0000 7fd138fce640 1 --2- 172.21.15.59:0/631129974 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5638f54560f0 0x5638f5458520 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d450fb7cd01d1368 server_cookie=c3fce9e812d0ae96 in_seq=0 out_seq=0 2024-09-10T21:22:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.606+0000 7fd113fff640 10 client.17118 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.607+0000 7fd113fff640 1 -- 172.21.15.59:0/631129974 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5638f53b2da0 con 0x5638f54560f0 2024-09-10T21:22:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.607+0000 7fd113fff640 10 client.17118 handle_command_reply: tid=0 2024-09-10T21:22:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.607+0000 7fd13d607740 1 client.17118 shutdown 2024-09-10T21:22:23.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.607+0000 7fd13d607740 1 -- 172.21.15.59:0/631129974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a9c0 msgr2=0x5638f5443490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:23.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.607+0000 7fd13d607740 1 --2- 172.21.15.59:0/631129974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a9c0 0x5638f5443490 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd120011540 tx=0x7fd120011a00 comp rx=0 tx=0).stop 2024-09-10T21:22:23.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.607+0000 7fd13d607740 1 -- 172.21.15.59:0/631129974 shutdown_connections 2024-09-10T21:22:23.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.607+0000 7fd13d607740 1 --2- 172.21.15.59:0/631129974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f5446950 0x5638f54439d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.607+0000 7fd13d607740 1 --2- 172.21.15.59:0/631129974 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5638f54560f0 0x5638f5458520 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.607+0000 7fd13d607740 1 --2- 172.21.15.59:0/631129974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a9c0 0x5638f5443490 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.607+0000 7fd13d607740 1 --2- 172.21.15.59:0/631129974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f543a0a0 0x5638f5446040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.607+0000 7fd113fff640 0 client.17118 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:23.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.607+0000 7fd13d607740 1 -- 172.21.15.59:0/631129974 >> 172.21.15.59:0/631129974 conn(0x5638f5437ed0 msgr2=0x5638f543da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:23.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.607+0000 7fd13d607740 1 -- 172.21.15.59:0/631129974 shutdown_connections 2024-09-10T21:22:23.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.607+0000 7fd13d607740 1 -- 172.21.15.59:0/631129974 wait complete. 2024-09-10T21:22:23.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.607+0000 7fd13d607740 20 client.17118 trim_cache size 0 max 16384 2024-09-10T21:22:23.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.625+0000 7fd13d607740 1 Processor -- start 2024-09-10T21:22:23.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.625+0000 7fd13d607740 1 -- start start 2024-09-10T21:22:23.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.625+0000 7fd13d607740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a0a0 0x5638f5437710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:23.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.625+0000 7fd13d607740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f543a9c0 0x5638f54406c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:23.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.625+0000 7fd13d607740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f5446950 0x5638f5440c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.625+0000 7fd13d607740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341ae260 con 0x5638f543a0a0 2024-09-10T21:22:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.625+0000 7fd13d607740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341afda0 con 0x5638f5446950 2024-09-10T21:22:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.625+0000 7fd13d607740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341ae930 con 0x5638f543a9c0 2024-09-10T21:22:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.625+0000 7fd138fce640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a0a0 0x5638f5437710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.625+0000 7fd138fce640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a0a0 0x5638f5437710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34650/0 (socket says 172.21.15.59:34650) 2024-09-10T21:22:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.625+0000 7fd138fce640 1 -- 172.21.15.59:0/1707592509 learned_addr learned my addr 172.21.15.59:0/1707592509 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.625+0000 7fd133fff640 1 --2- 172.21.15.59:0/1707592509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f543a9c0 0x5638f54406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.625+0000 7fd1397cf640 1 --2- 172.21.15.59:0/1707592509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f5446950 0x5638f5440c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.626+0000 7fd138fce640 1 -- 172.21.15.59:0/1707592509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f543a9c0 msgr2=0x5638f54406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.626+0000 7fd138fce640 1 --2- 172.21.15.59:0/1707592509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f543a9c0 0x5638f54406c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.626+0000 7fd138fce640 1 -- 172.21.15.59:0/1707592509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f5446950 msgr2=0x5638f5440c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.626+0000 7fd138fce640 1 --2- 172.21.15.59:0/1707592509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f5446950 0x5638f5440c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.626+0000 7fd138fce640 1 -- 172.21.15.59:0/1707592509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638f5437d00 con 0x5638f543a0a0 2024-09-10T21:22:23.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.626+0000 7fd1397cf640 1 --2- 172.21.15.59:0/1707592509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f5446950 0x5638f5440c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:22:23.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.626+0000 7fd138fce640 1 --2- 172.21.15.59:0/1707592509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a0a0 0x5638f5437710 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fd1280a9690 tx=0x7fd1280cf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789d6f69ed87369b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:23.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.626+0000 7fd11e7fc640 1 -- 172.21.15.59:0/1707592509 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1280abd70 con 0x5638f543a0a0 2024-09-10T21:22:23.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.626+0000 7fd11e7fc640 1 -- 172.21.15.59:0/1707592509 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1280b52f0 con 0x5638f543a0a0 2024-09-10T21:22:23.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.626+0000 7fd11e7fc640 1 -- 172.21.15.59:0/1707592509 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1280abb90 con 0x5638f543a0a0 2024-09-10T21:22:23.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.627+0000 7fd13d607740 1 -- 172.21.15.59:0/1707592509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a0a0 msgr2=0x5638f5437710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:23.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.627+0000 7fd13d607740 1 --2- 172.21.15.59:0/1707592509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a0a0 0x5638f5437710 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fd1280a9690 tx=0x7fd1280cf040 comp rx=0 tx=0).stop 2024-09-10T21:22:23.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.627+0000 7fd13d607740 1 -- 172.21.15.59:0/1707592509 shutdown_connections 2024-09-10T21:22:23.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.627+0000 7fd13d607740 1 --2- 172.21.15.59:0/1707592509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f5446950 0x5638f5440c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.627+0000 7fd13d607740 1 --2- 172.21.15.59:0/1707592509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f543a9c0 0x5638f54406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.627+0000 7fd13d607740 1 --2- 172.21.15.59:0/1707592509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f543a0a0 0x5638f5437710 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.627+0000 7fd13d607740 1 -- 172.21.15.59:0/1707592509 >> 172.21.15.59:0/1707592509 conn(0x5638f5437ed0 msgr2=0x5638f5441d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:23.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.627+0000 7fd13d607740 1 -- 172.21.15.59:0/1707592509 shutdown_connections 2024-09-10T21:22:23.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.627+0000 7fd13d607740 1 -- 172.21.15.59:0/1707592509 wait complete. 2024-09-10T21:22:23.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.627+0000 7fd13d607740 1 -- start start 2024-09-10T21:22:23.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.627+0000 7fd13d607740 1 Processor -- start 2024-09-10T21:22:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.628+0000 7fd13d607740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f543a0a0 0x5638f544eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.628+0000 7fd13d607740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f543a9c0 0x5638f544f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.628+0000 7fd13d607740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f5446950 0x5638f544b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.628+0000 7fd13d607740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341af6d0 con 0x5638f5446950 2024-09-10T21:22:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.628+0000 7fd13d607740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341af000 con 0x5638f543a9c0 2024-09-10T21:22:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.628+0000 7fd13d607740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd1341ac240 con 0x5638f543a0a0 2024-09-10T21:22:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.628+0000 7fd13d607740 10 client.0 _ll_register_callbacks cb 0x7fd120009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.628+0000 7fd1397cf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f5446950 0x5638f544b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.628+0000 7fd1397cf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f5446950 0x5638f544b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34662/0 (socket says 172.21.15.59:34662) 2024-09-10T21:22:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.628+0000 7fd1397cf640 1 -- 172.21.15.59:0/2973657017 learned_addr learned my addr 172.21.15.59:0/2973657017 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.628+0000 7fd138fce640 1 --2- 172.21.15.59:0/2973657017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f543a0a0 0x5638f544eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.628+0000 7fd133fff640 1 --2- 172.21.15.59:0/2973657017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f543a9c0 0x5638f544f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:23.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.628+0000 7fd1397cf640 1 -- 172.21.15.59:0/2973657017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f543a0a0 msgr2=0x5638f544eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.628+0000 7fd1397cf640 1 --2- 172.21.15.59:0/2973657017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f543a0a0 0x5638f544eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.628+0000 7fd1397cf640 1 -- 172.21.15.59:0/2973657017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f543a9c0 msgr2=0x5638f544f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.628+0000 7fd1397cf640 1 --2- 172.21.15.59:0/2973657017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f543a9c0 0x5638f544f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.628+0000 7fd1397cf640 1 -- 172.21.15.59:0/2973657017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638f5438950 con 0x5638f5446950 2024-09-10T21:22:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.628+0000 7fd1397cf640 1 --2- 172.21.15.59:0/2973657017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f5446950 0x5638f544b900 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd12c035000 tx=0x7fd12c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8e9d4cd1bafee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.628+0000 7fd113fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:22:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.629+0000 7fd113fff640 1 -- 172.21.15.59:0/2973657017 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c061020 con 0x5638f5446950 2024-09-10T21:22:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.629+0000 7fd113fff640 1 -- 172.21.15.59:0/2973657017 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd12c009800 con 0x5638f5446950 2024-09-10T21:22:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.629+0000 7fd13d607740 1 -- 172.21.15.59:0/2973657017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5638f53ae850 con 0x5638f5446950 2024-09-10T21:22:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.629+0000 7fd113fff640 1 -- 172.21.15.59:0/2973657017 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd12c057040 con 0x5638f5446950 2024-09-10T21:22:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.629+0000 7fd13d607740 10 client.17124 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.629+0000 7fd13d607740 1 -- 172.21.15.59:0/2973657017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5638f54c7f80 con 0x5638f5446950 2024-09-10T21:22:23.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.629+0000 7fd113fff640 1 -- 172.21.15.59:0/2973657017 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5638f53ae850 con 0x5638f5446950 2024-09-10T21:22:23.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.629+0000 7fd113fff640 1 -- 172.21.15.59:0/2973657017 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd12c030b80 con 0x5638f5446950 2024-09-10T21:22:23.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.629+0000 7fd13d607740 10 client.17124 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:23.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.629+0000 7fd13d607740 10 client.17124 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:22:23.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.629+0000 7fd13d607740 20 client.17124 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:23.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.629+0000 7fd13d607740 1 --2- 172.21.15.59:0/2973657017 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5638f54c84a0 0x5638f54ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:23.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.629+0000 7fd13d607740 4 client.17124 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:22:23.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.629+0000 7fd13d607740 1 -- 172.21.15.59:0/2973657017 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5638f53abc80 con 0x5638f54c84a0 2024-09-10T21:22:23.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.630+0000 7fd138fce640 1 --2- 172.21.15.59:0/2973657017 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5638f54c84a0 0x5638f54ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:23.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.630+0000 7fd113fff640 10 client.17124 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:23.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.630+0000 7fd138fce640 1 --2- 172.21.15.59:0/2973657017 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5638f54c84a0 0x5638f54ca8c0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ed720fcc011c3e4 server_cookie=3b0f7194f996d3f3 in_seq=0 out_seq=0 2024-09-10T21:22:23.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.630+0000 7fd113fff640 1 -- 172.21.15.59:0/2973657017 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3978 (crc 0 0 0) 0x5638f53abc80 con 0x5638f54c84a0 2024-09-10T21:22:23.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.630+0000 7fd113fff640 10 client.17124 handle_command_reply: tid=0 2024-09-10T21:22:23.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.630+0000 7fd13d607740 1 client.17124 shutdown 2024-09-10T21:22:23.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.630+0000 7fd13d607740 1 -- 172.21.15.59:0/2973657017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f5446950 msgr2=0x5638f544b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:23.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.630+0000 7fd13d607740 1 --2- 172.21.15.59:0/2973657017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f5446950 0x5638f544b900 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd12c035000 tx=0x7fd12c040000 comp rx=0 tx=0).stop 2024-09-10T21:22:23.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.631+0000 7fd13d607740 1 -- 172.21.15.59:0/2973657017 shutdown_connections 2024-09-10T21:22:23.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.631+0000 7fd13d607740 1 --2- 172.21.15.59:0/2973657017 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5638f54c84a0 0x5638f54ca8c0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.631+0000 7fd13d607740 1 --2- 172.21.15.59:0/2973657017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5638f5446950 0x5638f544b900 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.631+0000 7fd13d607740 1 --2- 172.21.15.59:0/2973657017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638f543a9c0 0x5638f544f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.631+0000 7fd13d607740 1 --2- 172.21.15.59:0/2973657017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5638f543a0a0 0x5638f544eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.631+0000 7fd13d607740 1 -- 172.21.15.59:0/2973657017 >> 172.21.15.59:0/2973657017 conn(0x5638f5437ed0 msgr2=0x5638f54452e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:23.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.631+0000 7fd113fff640 0 client.17124 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:23.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.631+0000 7fd13d607740 1 -- 172.21.15.59:0/2973657017 shutdown_connections 2024-09-10T21:22:23.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.631+0000 7fd13d607740 1 -- 172.21.15.59:0/2973657017 wait complete. 2024-09-10T21:22:23.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.631+0000 7fd13d607740 20 client.17124 trim_cache size 0 max 16384 2024-09-10T21:22:23.639 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:22:23.639 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:22:23.639 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-09-10T21:22:23.639 INFO:teuthology.orchestra.run.smithi059.stdout: "7de1e6cf-02c2-41f2-b957-563f88bae8ef": { 2024-09-10T21:22:23.639 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:23.639 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "7de1e6cf-02c2-41f2-b957-563f88bae8ef", 2024-09-10T21:22:23.639 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2024-09-10T21:22:23.639 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:22:23.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:23.639 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:22:23.640 INFO:teuthology.orchestra.run.smithi059.stdout: "d82f24b1-930e-4f83-a379-3084f22918d0": { 2024-09-10T21:22:23.640 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:21:37.203865+0000", 2024-09-10T21:22:23.640 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:23.640 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:23.640 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:23.640 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:23.640 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:23.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:23.640 INFO:teuthology.orchestra.run.smithi059.stdout: "800cdb00-6a99-4c42-8a9e-4b1c599c6af0": { 2024-09-10T21:22:23.640 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:52.224081+0000", 2024-09-10T21:22:23.640 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:23.640 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:23.640 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:23.641 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:23.641 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:23.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:23.641 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:22:23.641 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:22:23.641 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:23.641 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:23.641 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:23.641 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:23.641 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:23.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:23.641 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:22:23.641 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:22:23.641 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:23.642 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:23.642 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:23.642 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:23.642 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:23.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:23.642 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:22:23.642 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:22:23.642 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:23.642 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:23.642 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:23.642 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:23.642 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:23.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:23.642 INFO:teuthology.orchestra.run.smithi059.stdout: "7de1e6cf-02c2-41f2-b957-563f88bae8ef": { 2024-09-10T21:22:23.643 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:22:22.098651+0000", 2024-09-10T21:22:23.643 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:23.643 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:23.643 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:23.643 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:23.643 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:23.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:23.643 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:22:23.643 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:22:23.643 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:23.643 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:23.643 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:23.643 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:23.643 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:23.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:23.644 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:22:23.644 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:07.066301+0000", 2024-09-10T21:22:23.644 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:23.644 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:23.644 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:23.644 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:23.644 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:23.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:23.644 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:22:23.644 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:22:23.644 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:23.644 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:23.645 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:23.645 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:23.645 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:23.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:23.645 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:22:23.645 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:22:23.645 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:23.645 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:23.645 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:23.645 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:23.645 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:23.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:23.645 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:22:23.645 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:22:23.646 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:23.646 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:23.646 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:23.646 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:23.646 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:23.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:23.646 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:22:23.646 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:22:23.646 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:23.646 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:23.646 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:23.646 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:23.646 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:23.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:23.647 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:22:23.647 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:22:23.647 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:23.647 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:23.647 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:23.647 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:23.647 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:23.647 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:22:23.647 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:22:23.647 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:22:23.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.632+0000 7fd13b232640 1 -- 172.21.15.59:0/3795372312 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd1240b52e0 msgr2=0x7fd1240b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:23.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.632+0000 7fd13b232640 1 --2- 172.21.15.59:0/3795372312 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd1240b52e0 0x7fd1240b77a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd12c047000 tx=0x7fd12c02fa80 comp rx=0 tx=0).stop 2024-09-10T21:22:23.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.632+0000 7fd13b232640 1 -- 172.21.15.59:0/3795372312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd134101cd0 msgr2=0x7fd13419a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:23.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.632+0000 7fd13b232640 1 --2- 172.21.15.59:0/3795372312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd134101cd0 0x7fd13419a080 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd12800c920 tx=0x7fd12800cd20 comp rx=0 tx=0).stop 2024-09-10T21:22:23.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.632+0000 7fd13b232640 1 -- 172.21.15.59:0/3795372312 shutdown_connections 2024-09-10T21:22:23.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.632+0000 7fd13b232640 1 --2- 172.21.15.59:0/3795372312 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd1240b52e0 0x7fd1240b77a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.632+0000 7fd13b232640 1 --2- 172.21.15.59:0/3795372312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd134108060 0x7fd13419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.632+0000 7fd13b232640 1 --2- 172.21.15.59:0/3795372312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1341076e0 0x7fd13419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.632+0000 7fd13b232640 1 --2- 172.21.15.59:0/3795372312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd134101cd0 0x7fd13419a080 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:23.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.632+0000 7fd13b232640 1 -- 172.21.15.59:0/3795372312 >> 172.21.15.59:0/3795372312 conn(0x7fd1340fd720 msgr2=0x7fd1340ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:23.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.632+0000 7fd13b232640 1 -- 172.21.15.59:0/3795372312 shutdown_connections 2024-09-10T21:22:23.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:23.632+0000 7fd13b232640 1 -- 172.21.15.59:0/3795372312 wait complete. 2024-09-10T21:22:24.406 INFO:tasks.cephfs.filesystem:scrub status for tag:7de1e6cf-02c2-41f2-b957-563f88bae8ef - {'path': '/', 'tag': '7de1e6cf-02c2-41f2-b957-563f88bae8ef', 'options': 'recursive,force'} 2024-09-10T21:22:25.379 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:25 smithi192 ceph-mon[35363]: pgmap v554: 97 pgs: 97 active+clean; 4.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:22:25.379 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:25 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:22:25.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:25 smithi059 ceph-mon[30888]: pgmap v554: 97 pgs: 97 active+clean; 4.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:22:25.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:25 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:22:25.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:25 smithi154 ceph-mon[35041]: pgmap v554: 97 pgs: 97 active+clean; 4.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:22:25.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:25 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:22:27.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:27 smithi059 ceph-mon[30888]: pgmap v555: 97 pgs: 97 active+clean; 4.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:22:27.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:27 smithi154 ceph-mon[35041]: pgmap v555: 97 pgs: 97 active+clean; 4.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:22:27.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:27 smithi192 ceph-mon[35363]: pgmap v555: 97 pgs: 97 active+clean; 4.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:22:28.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:28 smithi154 ceph-mon[35041]: pgmap v556: 97 pgs: 97 active+clean; 4.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:22:28.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:28 smithi192 ceph-mon[35363]: pgmap v556: 97 pgs: 97 active+clean; 4.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:22:28.660 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:28 smithi059 ceph-mon[30888]: pgmap v556: 97 pgs: 97 active+clean; 4.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:22:30.681 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:30 smithi154 ceph-mon[35041]: pgmap v557: 97 pgs: 97 active+clean; 4.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:22:30.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:30 smithi192 ceph-mon[35363]: pgmap v557: 97 pgs: 97 active+clean; 4.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:22:30.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:30 smithi059 ceph-mon[30888]: pgmap v557: 97 pgs: 97 active+clean; 4.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:22:31.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:22:31.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:22:31.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:22:31.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:31 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:22:31.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:22:31.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:22:31.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:22:31.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:31 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:22:31.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:22:31.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T21:22:31.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:22:31.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:22:31.933 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:31 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:22:32.369 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.369 INFO:tasks.workunit.client.0.smithi059.stdout:313/600: open fd = 3 2024-09-10T21:22:32.369 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.369 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.369 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.369 INFO:tasks.workunit.client.0.smithi059.stdout:314/600: open fd = 3 2024-09-10T21:22:32.369 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.369 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.369 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.369 INFO:tasks.workunit.client.0.smithi059.stdout:315/600: open fd = 3 2024-09-10T21:22:32.369 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.370 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.370 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.370 INFO:tasks.workunit.client.0.smithi059.stdout:316/600: open fd = 3 2024-09-10T21:22:32.370 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.370 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.370 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.370 INFO:tasks.workunit.client.0.smithi059.stdout:317/600: open fd = 3 2024-09-10T21:22:32.370 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.370 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.370 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.370 INFO:tasks.workunit.client.0.smithi059.stdout:318/600: open fd = 3 2024-09-10T21:22:32.370 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.370 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.370 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.371 INFO:tasks.workunit.client.0.smithi059.stdout:319/600: open fd = 3 2024-09-10T21:22:32.371 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.371 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.371 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.371 INFO:tasks.workunit.client.0.smithi059.stdout:320/600: open fd = 3 2024-09-10T21:22:32.371 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.371 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.371 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.371 INFO:tasks.workunit.client.0.smithi059.stdout:321/600: open fd = 3 2024-09-10T21:22:32.371 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.371 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.371 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.371 INFO:tasks.workunit.client.0.smithi059.stdout:322/600: open fd = 3 2024-09-10T21:22:32.372 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.372 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.372 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.372 INFO:tasks.workunit.client.0.smithi059.stdout:323/600: open fd = 3 2024-09-10T21:22:32.372 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.372 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.372 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.372 INFO:tasks.workunit.client.0.smithi059.stdout:324/600: open fd = 3 2024-09-10T21:22:32.372 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.372 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.372 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.372 INFO:tasks.workunit.client.0.smithi059.stdout:325/600: open fd = 3 2024-09-10T21:22:32.372 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.372 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.373 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.373 INFO:tasks.workunit.client.0.smithi059.stdout:326/600: open fd = 3 2024-09-10T21:22:32.373 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.373 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.373 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.373 INFO:tasks.workunit.client.0.smithi059.stdout:327/600: open fd = 3 2024-09-10T21:22:32.373 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.373 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.373 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.373 INFO:tasks.workunit.client.0.smithi059.stdout:328/600: open fd = 3 2024-09-10T21:22:32.373 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.373 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.374 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.374 INFO:tasks.workunit.client.0.smithi059.stdout:329/600: open fd = 3 2024-09-10T21:22:32.374 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.374 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.374 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.374 INFO:tasks.workunit.client.0.smithi059.stdout:330/600: open fd = 3 2024-09-10T21:22:32.374 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.374 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.374 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.374 INFO:tasks.workunit.client.0.smithi059.stdout:331/600: open fd = 3 2024-09-10T21:22:32.374 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.374 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.374 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.374 INFO:tasks.workunit.client.0.smithi059.stdout:332/600: open fd = 3 2024-09-10T21:22:32.375 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.375 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.375 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.375 INFO:tasks.workunit.client.0.smithi059.stdout:333/600: open fd = 3 2024-09-10T21:22:32.375 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.375 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.375 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.375 INFO:tasks.workunit.client.0.smithi059.stdout:334/600: open fd = 3 2024-09-10T21:22:32.375 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.375 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.375 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.375 INFO:tasks.workunit.client.0.smithi059.stdout:335/600: open fd = 3 2024-09-10T21:22:32.375 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.375 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.375 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.376 INFO:tasks.workunit.client.0.smithi059.stdout:336/600: open fd = 3 2024-09-10T21:22:32.376 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.376 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.376 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.376 INFO:tasks.workunit.client.0.smithi059.stdout:337/600: open fd = 3 2024-09-10T21:22:32.376 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.376 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.376 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.376 INFO:tasks.workunit.client.0.smithi059.stdout:338/600: open fd = 3 2024-09-10T21:22:32.376 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.376 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.376 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.376 INFO:tasks.workunit.client.0.smithi059.stdout:339/600: open fd = 3 2024-09-10T21:22:32.376 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.377 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.377 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.377 INFO:tasks.workunit.client.0.smithi059.stdout:340/600: open fd = 3 2024-09-10T21:22:32.377 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.377 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.377 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.377 INFO:tasks.workunit.client.0.smithi059.stdout:341/600: open fd = 3 2024-09-10T21:22:32.377 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.377 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.377 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.377 INFO:tasks.workunit.client.0.smithi059.stdout:342/600: open fd = 3 2024-09-10T21:22:32.377 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.377 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.377 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.378 INFO:tasks.workunit.client.0.smithi059.stdout:343/600: open fd = 3 2024-09-10T21:22:32.378 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.378 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.378 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.378 INFO:tasks.workunit.client.0.smithi059.stdout:344/600: open fd = 3 2024-09-10T21:22:32.378 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.378 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.378 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.378 INFO:tasks.workunit.client.0.smithi059.stdout:345/600: open fd = 3 2024-09-10T21:22:32.378 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.378 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.378 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.378 INFO:tasks.workunit.client.0.smithi059.stdout:346/600: open fd = 3 2024-09-10T21:22:32.378 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.379 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.379 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.379 INFO:tasks.workunit.client.0.smithi059.stdout:347/600: open fd = 3 2024-09-10T21:22:32.379 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.379 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.379 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.379 INFO:tasks.workunit.client.0.smithi059.stdout:348/600: open fd = 3 2024-09-10T21:22:32.379 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.379 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.379 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.379 INFO:tasks.workunit.client.0.smithi059.stdout:349/600: open fd = 3 2024-09-10T21:22:32.379 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.379 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.379 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.379 INFO:tasks.workunit.client.0.smithi059.stdout:350/600: open fd = 3 2024-09-10T21:22:32.380 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.380 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.380 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.380 INFO:tasks.workunit.client.0.smithi059.stdout:351/600: open fd = 3 2024-09-10T21:22:32.380 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.380 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.380 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.380 INFO:tasks.workunit.client.0.smithi059.stdout:352/600: open fd = 3 2024-09-10T21:22:32.380 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.380 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.380 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.380 INFO:tasks.workunit.client.0.smithi059.stdout:353/600: open fd = 3 2024-09-10T21:22:32.380 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.380 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.381 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.381 INFO:tasks.workunit.client.0.smithi059.stdout:354/600: open fd = 3 2024-09-10T21:22:32.381 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.381 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.381 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.381 INFO:tasks.workunit.client.0.smithi059.stdout:355/600: open fd = 3 2024-09-10T21:22:32.381 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.381 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.381 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.381 INFO:tasks.workunit.client.0.smithi059.stdout:356/600: open fd = 3 2024-09-10T21:22:32.381 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.381 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.381 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.382 INFO:tasks.workunit.client.0.smithi059.stdout:357/600: open fd = 3 2024-09-10T21:22:32.382 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.382 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.382 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.382 INFO:tasks.workunit.client.0.smithi059.stdout:358/600: open fd = 3 2024-09-10T21:22:32.382 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.382 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.382 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.382 INFO:tasks.workunit.client.0.smithi059.stdout:359/600: open fd = 3 2024-09-10T21:22:32.382 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.382 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.382 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.382 INFO:tasks.workunit.client.0.smithi059.stdout:360/600: open fd = 3 2024-09-10T21:22:32.382 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.382 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.383 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.383 INFO:tasks.workunit.client.0.smithi059.stdout:361/600: open fd = 3 2024-09-10T21:22:32.383 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.383 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.383 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.383 INFO:tasks.workunit.client.0.smithi059.stdout:362/600: open fd = 3 2024-09-10T21:22:32.383 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.383 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.383 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.383 INFO:tasks.workunit.client.0.smithi059.stdout:363/600: open fd = 3 2024-09-10T21:22:32.383 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.383 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.383 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.383 INFO:tasks.workunit.client.0.smithi059.stdout:364/600: open fd = 3 2024-09-10T21:22:32.383 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.383 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.384 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.384 INFO:tasks.workunit.client.0.smithi059.stdout:365/600: open fd = 3 2024-09-10T21:22:32.384 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.384 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.384 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.384 INFO:tasks.workunit.client.0.smithi059.stdout:366/600: open fd = 3 2024-09-10T21:22:32.384 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.384 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.384 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.384 INFO:tasks.workunit.client.0.smithi059.stdout:367/600: open fd = 3 2024-09-10T21:22:32.384 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.384 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.384 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.384 INFO:tasks.workunit.client.0.smithi059.stdout:368/600: open fd = 3 2024-09-10T21:22:32.384 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.385 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.385 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.385 INFO:tasks.workunit.client.0.smithi059.stdout:369/600: open fd = 3 2024-09-10T21:22:32.385 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.385 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.385 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.385 INFO:tasks.workunit.client.0.smithi059.stdout:370/600: open fd = 3 2024-09-10T21:22:32.385 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.385 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.385 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.385 INFO:tasks.workunit.client.0.smithi059.stdout:371/600: open fd = 3 2024-09-10T21:22:32.385 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.385 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.385 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.385 INFO:tasks.workunit.client.0.smithi059.stdout:372/600: open fd = 3 2024-09-10T21:22:32.386 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.386 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.386 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.386 INFO:tasks.workunit.client.0.smithi059.stdout:373/600: open fd = 3 2024-09-10T21:22:32.386 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.386 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.386 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.386 INFO:tasks.workunit.client.0.smithi059.stdout:374/600: open fd = 3 2024-09-10T21:22:32.386 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.386 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:22:32.386 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:22:32.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:32 smithi192 ceph-mon[35363]: Adjusting osd_memory_target on smithi192 to 176.0M 2024-09-10T21:22:32.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:32 smithi192 ceph-mon[35363]: Adjusting osd_memory_target on smithi154 to 176.0M 2024-09-10T21:22:32.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:32 smithi192 ceph-mon[35363]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-09-10T21:22:32.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:32 smithi192 ceph-mon[35363]: Unable to set osd_memory_target on smithi192 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-10T21:22:32.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:32 smithi192 ceph-mon[35363]: Unable to set osd_memory_target on smithi154 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-09-10T21:22:32.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:32 smithi192 ceph-mon[35363]: Unable to set osd_memory_target on smithi059 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-10T21:22:32.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:32 smithi192 ceph-mon[35363]: pgmap v558: 97 pgs: 97 active+clean; 4.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:22:32.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:32 smithi059 ceph-mon[30888]: Adjusting osd_memory_target on smithi192 to 176.0M 2024-09-10T21:22:32.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:32 smithi059 ceph-mon[30888]: Adjusting osd_memory_target on smithi154 to 176.0M 2024-09-10T21:22:32.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:32 smithi059 ceph-mon[30888]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-09-10T21:22:32.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:32 smithi059 ceph-mon[30888]: Unable to set osd_memory_target on smithi192 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-10T21:22:32.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:32 smithi059 ceph-mon[30888]: Unable to set osd_memory_target on smithi154 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-09-10T21:22:32.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:32 smithi059 ceph-mon[30888]: Unable to set osd_memory_target on smithi059 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-10T21:22:32.911 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:32 smithi059 ceph-mon[30888]: pgmap v558: 97 pgs: 97 active+clean; 4.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:22:32.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:32 smithi154 ceph-mon[35041]: Adjusting osd_memory_target on smithi192 to 176.0M 2024-09-10T21:22:32.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:32 smithi154 ceph-mon[35041]: Adjusting osd_memory_target on smithi154 to 176.0M 2024-09-10T21:22:32.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:32 smithi154 ceph-mon[35041]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-09-10T21:22:32.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:32 smithi154 ceph-mon[35041]: Unable to set osd_memory_target on smithi192 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-10T21:22:32.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:32 smithi154 ceph-mon[35041]: Unable to set osd_memory_target on smithi154 to 184590336: error parsing value: Value '184590336' is below minimum 939524096 2024-09-10T21:22:32.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:32 smithi154 ceph-mon[35041]: Unable to set osd_memory_target on smithi059 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-10T21:22:32.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:32 smithi154 ceph-mon[35041]: pgmap v558: 97 pgs: 97 active+clean; 4.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:22:34.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:34 smithi192 ceph-mon[35363]: pgmap v559: 97 pgs: 97 active+clean; 5.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:22:34.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:34 smithi059 ceph-mon[30888]: pgmap v559: 97 pgs: 97 active+clean; 5.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:22:34.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:34 smithi154 ceph-mon[35041]: pgmap v559: 97 pgs: 97 active+clean; 5.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:22:36.713 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:36 smithi059 ceph-mon[30888]: pgmap v560: 97 pgs: 97 active+clean; 5.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:22:36.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:36 smithi192 ceph-mon[35363]: pgmap v560: 97 pgs: 97 active+clean; 5.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:22:36.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:36 smithi154 ceph-mon[35041]: pgmap v560: 97 pgs: 97 active+clean; 5.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:22:38.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:38 smithi192 ceph-mon[35363]: pgmap v561: 97 pgs: 97 active+clean; 5.0 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:22:38.912 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:38 smithi059 ceph-mon[30888]: pgmap v561: 97 pgs: 97 active+clean; 5.0 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:22:38.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:38 smithi154 ceph-mon[35041]: pgmap v561: 97 pgs: 97 active+clean; 5.0 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:22:40.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:40 smithi192 ceph-mon[35363]: pgmap v562: 97 pgs: 97 active+clean; 5.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:22:40.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:40 smithi059 ceph-mon[30888]: pgmap v562: 97 pgs: 97 active+clean; 5.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:22:40.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:40 smithi154 ceph-mon[35041]: pgmap v562: 97 pgs: 97 active+clean; 5.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:22:42.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:42 smithi192 ceph-mon[35363]: pgmap v563: 97 pgs: 97 active+clean; 5.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:22:42.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:42 smithi059 ceph-mon[30888]: pgmap v563: 97 pgs: 97 active+clean; 5.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:22:42.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:42 smithi154 ceph-mon[35041]: pgmap v563: 97 pgs: 97 active+clean; 5.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:22:44.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:44 smithi192 ceph-mon[35363]: pgmap v564: 97 pgs: 97 active+clean; 5.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:22:44.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:44 smithi059 ceph-mon[30888]: pgmap v564: 97 pgs: 97 active+clean; 5.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:22:44.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:44 smithi154 ceph-mon[35041]: pgmap v564: 97 pgs: 97 active+clean; 5.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:22:46.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:46 smithi192 ceph-mon[35363]: pgmap v565: 97 pgs: 97 active+clean; 5.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:22:46.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:46 smithi059 ceph-mon[30888]: pgmap v565: 97 pgs: 97 active+clean; 5.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:22:46.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:46 smithi154 ceph-mon[35041]: pgmap v565: 97 pgs: 97 active+clean; 5.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:22:48.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:48 smithi192 ceph-mon[35363]: pgmap v566: 97 pgs: 97 active+clean; 5.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:22:48.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:48 smithi059 ceph-mon[30888]: pgmap v566: 97 pgs: 97 active+clean; 5.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:22:48.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:48 smithi154 ceph-mon[35041]: pgmap v566: 97 pgs: 97 active+clean; 5.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:22:50.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:50 smithi192 ceph-mon[35363]: pgmap v567: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:22:50.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:50 smithi059 ceph-mon[30888]: pgmap v567: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:22:50.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:50 smithi154 ceph-mon[35041]: pgmap v567: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:22:52.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:52 smithi192 ceph-mon[35363]: pgmap v568: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:22:52.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:52 smithi059 ceph-mon[30888]: pgmap v568: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:22:52.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:52 smithi154 ceph-mon[35041]: pgmap v568: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:22:54.407 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:22:54.688 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:22:54.810 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:54 smithi059 ceph-mon[30888]: pgmap v569: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:22:54.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:54 smithi192 ceph-mon[35363]: pgmap v569: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:22:54.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:54 smithi154 ceph-mon[35041]: pgmap v569: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:22:55.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.165+0000 7f2c575bb640 1 -- 172.21.15.59:0/173114553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c5010f440 msgr2=0x7f2c50111830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.165+0000 7f2c575bb640 1 --2- 172.21.15.59:0/173114553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c5010f440 0x7f2c50111830 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f2c48009ca0 tx=0x7f2c4802a950 comp rx=0 tx=0).stop 2024-09-10T21:22:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.165+0000 7f2c575bb640 1 -- 172.21.15.59:0/173114553 shutdown_connections 2024-09-10T21:22:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.165+0000 7f2c575bb640 1 --2- 172.21.15.59:0/173114553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c5010f440 0x7f2c50111830 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.165+0000 7f2c575bb640 1 --2- 172.21.15.59:0/173114553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c501021b0 0x7f2c5010ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.165+0000 7f2c575bb640 1 --2- 172.21.15.59:0/173114553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c50101890 0x7f2c50101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.165+0000 7f2c575bb640 1 -- 172.21.15.59:0/173114553 >> 172.21.15.59:0/173114553 conn(0x7f2c500fd700 msgr2=0x7f2c500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.165+0000 7f2c575bb640 1 -- 172.21.15.59:0/173114553 shutdown_connections 2024-09-10T21:22:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.165+0000 7f2c575bb640 1 -- 172.21.15.59:0/173114553 wait complete. 2024-09-10T21:22:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.165+0000 7f2c575bb640 1 Processor -- start 2024-09-10T21:22:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.166+0000 7f2c575bb640 1 -- start start 2024-09-10T21:22:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.166+0000 7f2c575bb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c50101890 0x7f2c50103bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:55.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.166+0000 7f2c575bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c501021b0 0x7f2c50104100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:55.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.166+0000 7f2c575bb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c5010f440 0x7f2c50104640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:55.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.166+0000 7f2c575bb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2c50114f70 con 0x7f2c5010f440 2024-09-10T21:22:55.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.166+0000 7f2c575bb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2c50114df0 con 0x7f2c501021b0 2024-09-10T21:22:55.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.166+0000 7f2c575bb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501150f0 con 0x7f2c50101890 2024-09-10T21:22:55.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.166+0000 7f2c55b58640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c5010f440 0x7f2c50104640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:55.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.166+0000 7f2c55b58640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c5010f440 0x7f2c50104640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56326/0 (socket says 172.21.15.59:56326) 2024-09-10T21:22:55.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.166+0000 7f2c55b58640 1 -- 172.21.15.59:0/2330027300 learned_addr learned my addr 172.21.15.59:0/2330027300 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:55.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.166+0000 7f2c55357640 1 --2- 172.21.15.59:0/2330027300 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c50101890 0x7f2c50103bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:55.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.166+0000 7f2c54b56640 1 --2- 172.21.15.59:0/2330027300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c501021b0 0x7f2c50104100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:55.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.166+0000 7f2c55b58640 1 -- 172.21.15.59:0/2330027300 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c50101890 msgr2=0x7f2c50103bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:55.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.166+0000 7f2c55b58640 1 --2- 172.21.15.59:0/2330027300 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c50101890 0x7f2c50103bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.166+0000 7f2c55b58640 1 -- 172.21.15.59:0/2330027300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c501021b0 msgr2=0x7f2c50104100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:55.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.166+0000 7f2c55b58640 1 --2- 172.21.15.59:0/2330027300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c501021b0 0x7f2c50104100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.166+0000 7f2c55b58640 1 -- 172.21.15.59:0/2330027300 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c501ab9f0 con 0x7f2c5010f440 2024-09-10T21:22:55.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.167+0000 7f2c55b58640 1 --2- 172.21.15.59:0/2330027300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c5010f440 0x7f2c50104640 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f2c4802ae70 tx=0x7f2c4802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:55.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.167+0000 7f2c467fc640 1 -- 172.21.15.59:0/2330027300 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48034040 con 0x7f2c5010f440 2024-09-10T21:22:55.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.167+0000 7f2c575bb640 1 -- 172.21.15.59:0/2330027300 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c501abc80 con 0x7f2c5010f440 2024-09-10T21:22:55.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.167+0000 7f2c467fc640 1 -- 172.21.15.59:0/2330027300 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c480308f0 con 0x7f2c5010f440 2024-09-10T21:22:55.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.167+0000 7f2c467fc640 1 -- 172.21.15.59:0/2330027300 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c480046f0 con 0x7f2c5010f440 2024-09-10T21:22:55.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.167+0000 7f2c575bb640 1 -- 172.21.15.59:0/2330027300 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c501ac1b0 con 0x7f2c5010f440 2024-09-10T21:22:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.170+0000 7f2c467fc640 1 -- 172.21.15.59:0/2330027300 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f2c4804d030 con 0x7f2c5010f440 2024-09-10T21:22:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.170+0000 7f2c59990740 1 Processor -- start 2024-09-10T21:22:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.170+0000 7f2c59990740 1 -- start start 2024-09-10T21:22:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c59990740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6480 0x560432ec6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c59990740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 0x560432ed27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c59990740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 0x560432ed5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c59990740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560432e3ce50 con 0x560432ec6da0 2024-09-10T21:22:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c59990740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560432e2c280 con 0x560432ec6480 2024-09-10T21:22:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c59990740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x560432e30090 con 0x560432ed2d30 2024-09-10T21:22:55.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c467fc640 1 --2- 172.21.15.59:0/2330027300 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2c3c0b5360 0x7f2c3c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c55357640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 0x560432ed27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c55357640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 0x560432ed27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56332/0 (socket says 172.21.15.59:56332) 2024-09-10T21:22:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c55357640 1 -- 172.21.15.59:0/2925805055 learned_addr learned my addr 172.21.15.59:0/2925805055 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c54b56640 1 --2- 172.21.15.59:0/2925805055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6480 0x560432ec6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c55b58640 1 --2- 172.21.15.59:0/2330027300 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2c3c0b5360 0x7f2c3c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c54b56640 1 --2- 172.21.15.59:0/2925805055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 0x560432ed5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c55357640 1 -- 172.21.15.59:0/2925805055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 msgr2=0x560432ed5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c55357640 1 --2- 172.21.15.59:0/2925805055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 0x560432ed5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c55357640 1 -- 172.21.15.59:0/2925805055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6480 msgr2=0x560432ec6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c55357640 1 --2- 172.21.15.59:0/2925805055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6480 0x560432ec6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c55357640 1 -- 172.21.15.59:0/2925805055 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560432b8a650 con 0x560432ec6da0 2024-09-10T21:22:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c54b56640 1 --2- 172.21.15.59:0/2925805055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 0x560432ed5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:22:55.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.171+0000 7f2c467fc640 1 -- 172.21.15.59:0/2330027300 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2c48106870 con 0x7f2c5010f440 2024-09-10T21:22:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.172+0000 7f2c55b58640 1 --2- 172.21.15.59:0/2330027300 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2c3c0b5360 0x7f2c3c0b7820 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2c480ccff0 tx=0x7f2c480bf0d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.172+0000 7f2c55357640 1 --2- 172.21.15.59:0/2925805055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 0x560432ed27f0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00b760 tx=0x7f2c4c00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21ba885233d8954 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.172+0000 7f2c3b7fe640 1 -- 172.21.15.59:0/2925805055 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c003dd0 con 0x560432ec6da0 2024-09-10T21:22:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.172+0000 7f2c3b7fe640 1 -- 172.21.15.59:0/2925805055 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c4c015070 con 0x560432ec6da0 2024-09-10T21:22:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.172+0000 7f2c3b7fe640 1 -- 172.21.15.59:0/2925805055 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c004d90 con 0x560432ec6da0 2024-09-10T21:22:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.173+0000 7f2c59990740 1 -- 172.21.15.59:0/2925805055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 msgr2=0x560432ed27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.173+0000 7f2c59990740 1 --2- 172.21.15.59:0/2925805055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 0x560432ed27f0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00b760 tx=0x7f2c4c00bc20 comp rx=0 tx=0).stop 2024-09-10T21:22:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.173+0000 7f2c59990740 1 -- 172.21.15.59:0/2925805055 shutdown_connections 2024-09-10T21:22:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.173+0000 7f2c59990740 1 --2- 172.21.15.59:0/2925805055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 0x560432ed5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.173+0000 7f2c59990740 1 --2- 172.21.15.59:0/2925805055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 0x560432ed27f0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.173+0000 7f2c59990740 1 --2- 172.21.15.59:0/2925805055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6480 0x560432ec6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.173+0000 7f2c59990740 1 -- 172.21.15.59:0/2925805055 >> 172.21.15.59:0/2925805055 conn(0x560432ec42b0 msgr2=0x560432ec5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.173+0000 7f2c59990740 1 -- 172.21.15.59:0/2925805055 shutdown_connections 2024-09-10T21:22:55.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.173+0000 7f2c59990740 1 -- 172.21.15.59:0/2925805055 wait complete. 2024-09-10T21:22:55.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.173+0000 7f2c59990740 1 -- start start 2024-09-10T21:22:55.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.173+0000 7f2c59990740 1 Processor -- start 2024-09-10T21:22:55.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.174+0000 7f2c59990740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6480 0x560432ed2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:55.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.174+0000 7f2c59990740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 0x560432ecfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:55.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.174+0000 7f2c59990740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 0x560432ed00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:55.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.174+0000 7f2c59990740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560432c8d700 con 0x560432ec6da0 2024-09-10T21:22:55.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.174+0000 7f2c59990740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560432dc7110 con 0x560432ec6480 2024-09-10T21:22:55.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.174+0000 7f2c59990740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x560432ed59b0 con 0x560432ed2d30 2024-09-10T21:22:55.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.174+0000 7f2c59990740 10 client.0 _ll_register_callbacks cb 0x560432de0990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:55.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.174+0000 7f2c55357640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 0x560432ecfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:55.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.174+0000 7f2c55357640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 0x560432ecfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56340/0 (socket says 172.21.15.59:56340) 2024-09-10T21:22:55.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.174+0000 7f2c55357640 1 -- 172.21.15.59:0/1566589281 learned_addr learned my addr 172.21.15.59:0/1566589281 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:55.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.174+0000 7f2c54b56640 1 --2- 172.21.15.59:0/1566589281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 0x560432ed00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:55.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.174+0000 7f2c54b56640 1 --2- 172.21.15.59:0/1566589281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6480 0x560432ed2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:55.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.174+0000 7f2c55357640 1 -- 172.21.15.59:0/1566589281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 msgr2=0x560432ed00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:55.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.174+0000 7f2c55357640 1 --2- 172.21.15.59:0/1566589281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 0x560432ed00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.174+0000 7f2c55357640 1 -- 172.21.15.59:0/1566589281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6480 msgr2=0x560432ed2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:55.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.174+0000 7f2c55357640 1 --2- 172.21.15.59:0/1566589281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6480 0x560432ed2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.174+0000 7f2c55357640 1 -- 172.21.15.59:0/1566589281 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560432df4c40 con 0x560432ec6da0 2024-09-10T21:22:55.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.175+0000 7f2c55357640 1 --2- 172.21.15.59:0/1566589281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 0x560432ecfa70 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c004a70 tx=0x7f2c4c003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d451868d1b2e92 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:55.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.175+0000 7f2c38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:22:55.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.175+0000 7f2c38ff9640 1 -- 172.21.15.59:0/1566589281 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c028060 con 0x560432ec6da0 2024-09-10T21:22:55.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.175+0000 7f2c38ff9640 1 -- 172.21.15.59:0/1566589281 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2c4c011850 con 0x560432ec6da0 2024-09-10T21:22:55.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.175+0000 7f2c59990740 1 -- 172.21.15.59:0/1566589281 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c4c015070 con 0x560432ec6da0 2024-09-10T21:22:55.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.175+0000 7f2c38ff9640 1 -- 172.21.15.59:0/1566589281 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2c4c0046c0 con 0x560432ec6da0 2024-09-10T21:22:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.175+0000 7f2c59990740 10 client.17136 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.175+0000 7f2c59990740 1 -- 172.21.15.59:0/1566589281 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560432ee12e0 con 0x560432ec6da0 2024-09-10T21:22:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.175+0000 7f2c38ff9640 1 -- 172.21.15.59:0/1566589281 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c4c015070 con 0x560432ec6da0 2024-09-10T21:22:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.175+0000 7f2c38ff9640 1 -- 172.21.15.59:0/1566589281 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2c4c022070 con 0x560432ec6da0 2024-09-10T21:22:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.175+0000 7f2c59990740 10 client.17136 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.175+0000 7f2c59990740 10 client.17136 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:22:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.175+0000 7f2c59990740 20 client.17136 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.176+0000 7f2c59990740 1 --2- 172.21.15.59:0/1566589281 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x560432ee26e0 0x560432ee4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.176+0000 7f2c59990740 4 client.17136 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:22:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.176+0000 7f2c59990740 1 -- 172.21.15.59:0/1566589281 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560432e3eda0 con 0x560432ee26e0 2024-09-10T21:22:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.176+0000 7f2c54b56640 1 --2- 172.21.15.59:0/1566589281 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x560432ee26e0 0x560432ee4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.176+0000 7f2c54b56640 1 --2- 172.21.15.59:0/1566589281 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x560432ee26e0 0x560432ee4ad0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71f05d9b6f635e91 server_cookie=7d370d15dd9dd30b in_seq=0 out_seq=0 2024-09-10T21:22:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.176+0000 7f2c38ff9640 10 client.17136 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:55.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.177+0000 7f2c38ff9640 1 -- 172.21.15.59:0/1566589281 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560432e3eda0 con 0x560432ee26e0 2024-09-10T21:22:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.177+0000 7f2c38ff9640 10 client.17136 handle_command_reply: tid=0 2024-09-10T21:22:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.177+0000 7f2c59990740 1 client.17136 shutdown 2024-09-10T21:22:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.177+0000 7f2c59990740 1 -- 172.21.15.59:0/1566589281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 msgr2=0x560432ecfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.177+0000 7f2c59990740 1 --2- 172.21.15.59:0/1566589281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 0x560432ecfa70 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c004a70 tx=0x7f2c4c003e00 comp rx=0 tx=0).stop 2024-09-10T21:22:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.177+0000 7f2c59990740 1 -- 172.21.15.59:0/1566589281 shutdown_connections 2024-09-10T21:22:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.177+0000 7f2c59990740 1 --2- 172.21.15.59:0/1566589281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 0x560432ed00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.177+0000 7f2c59990740 1 --2- 172.21.15.59:0/1566589281 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x560432ee26e0 0x560432ee4ad0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.177+0000 7f2c59990740 1 --2- 172.21.15.59:0/1566589281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 0x560432ecfa70 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.177+0000 7f2c59990740 1 --2- 172.21.15.59:0/1566589281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6480 0x560432ed2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.177+0000 7f2c38ff9640 0 client.17136 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.177+0000 7f2c59990740 1 -- 172.21.15.59:0/1566589281 >> 172.21.15.59:0/1566589281 conn(0x560432ec42b0 msgr2=0x560432ec9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.178+0000 7f2c59990740 1 -- 172.21.15.59:0/1566589281 shutdown_connections 2024-09-10T21:22:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.178+0000 7f2c59990740 1 -- 172.21.15.59:0/1566589281 wait complete. 2024-09-10T21:22:55.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.178+0000 7f2c59990740 20 client.17136 trim_cache size 0 max 16384 2024-09-10T21:22:55.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.195+0000 7f2c59990740 1 Processor -- start 2024-09-10T21:22:55.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.195+0000 7f2c59990740 1 -- start start 2024-09-10T21:22:55.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.195+0000 7f2c59990740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6480 0x560432ec3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:55.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.195+0000 7f2c59990740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 0x560432ed4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:55.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.195+0000 7f2c59990740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 0x560432ed4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:55.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.195+0000 7f2c59990740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501b4810 con 0x560432ec6da0 2024-09-10T21:22:55.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.195+0000 7f2c59990740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501b6350 con 0x560432ec6480 2024-09-10T21:22:55.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.195+0000 7f2c59990740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501b4ee0 con 0x560432ed2d30 2024-09-10T21:22:55.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.196+0000 7f2c55357640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 0x560432ed4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:55.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.196+0000 7f2c55357640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 0x560432ed4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56346/0 (socket says 172.21.15.59:56346) 2024-09-10T21:22:55.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.196+0000 7f2c55357640 1 -- 172.21.15.59:0/2579735720 learned_addr learned my addr 172.21.15.59:0/2579735720 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:55.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.196+0000 7f2c54b56640 1 --2- 172.21.15.59:0/2579735720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6480 0x560432ec3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:55.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.196+0000 7f2c54b56640 1 --2- 172.21.15.59:0/2579735720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 0x560432ed4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:55.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.196+0000 7f2c55357640 1 -- 172.21.15.59:0/2579735720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 msgr2=0x560432ed4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:55.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.196+0000 7f2c55357640 1 --2- 172.21.15.59:0/2579735720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 0x560432ed4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.196+0000 7f2c55357640 1 -- 172.21.15.59:0/2579735720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6480 msgr2=0x560432ec3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:55.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.196+0000 7f2c55357640 1 --2- 172.21.15.59:0/2579735720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6480 0x560432ec3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.196+0000 7f2c55357640 1 -- 172.21.15.59:0/2579735720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560432ec4d30 con 0x560432ec6da0 2024-09-10T21:22:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.196+0000 7f2c54b56640 1 --2- 172.21.15.59:0/2579735720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 0x560432ed4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:22:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.196+0000 7f2c55357640 1 --2- 172.21.15.59:0/2579735720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 0x560432ed4120 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00beb0 tx=0x7f2c4c019f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98c527d50c88a3c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.196+0000 7f2c3affd640 1 -- 172.21.15.59:0/2579735720 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c033070 con 0x560432ec6da0 2024-09-10T21:22:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.196+0000 7f2c3affd640 1 -- 172.21.15.59:0/2579735720 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c4c015070 con 0x560432ec6da0 2024-09-10T21:22:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.196+0000 7f2c3affd640 1 -- 172.21.15.59:0/2579735720 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c028070 con 0x560432ec6da0 2024-09-10T21:22:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.197+0000 7f2c59990740 1 -- 172.21.15.59:0/2579735720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 msgr2=0x560432ed4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.197+0000 7f2c59990740 1 --2- 172.21.15.59:0/2579735720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 0x560432ed4120 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00beb0 tx=0x7f2c4c019f20 comp rx=0 tx=0).stop 2024-09-10T21:22:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.197+0000 7f2c59990740 1 -- 172.21.15.59:0/2579735720 shutdown_connections 2024-09-10T21:22:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.197+0000 7f2c59990740 1 --2- 172.21.15.59:0/2579735720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 0x560432ed4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.197+0000 7f2c59990740 1 --2- 172.21.15.59:0/2579735720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6da0 0x560432ed4120 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.197+0000 7f2c59990740 1 --2- 172.21.15.59:0/2579735720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6480 0x560432ec3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.197+0000 7f2c59990740 1 -- 172.21.15.59:0/2579735720 >> 172.21.15.59:0/2579735720 conn(0x560432ec42b0 msgr2=0x560432ece2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.197+0000 7f2c59990740 1 -- 172.21.15.59:0/2579735720 shutdown_connections 2024-09-10T21:22:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.197+0000 7f2c59990740 1 -- 172.21.15.59:0/2579735720 wait complete. 2024-09-10T21:22:55.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.198+0000 7f2c59990740 1 -- start start 2024-09-10T21:22:55.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.198+0000 7f2c59990740 1 Processor -- start 2024-09-10T21:22:55.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.198+0000 7f2c59990740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6480 0x560432ee4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:55.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.198+0000 7f2c59990740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6da0 0x560432ee4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:55.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.198+0000 7f2c59990740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 0x560432f4e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:55.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.198+0000 7f2c59990740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501b5c80 con 0x560432ec6480 2024-09-10T21:22:55.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.198+0000 7f2c59990740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501b55b0 con 0x560432ec6da0 2024-09-10T21:22:55.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.198+0000 7f2c59990740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2c501b27f0 con 0x560432ed2d30 2024-09-10T21:22:55.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.198+0000 7f2c59990740 10 client.0 _ll_register_callbacks cb 0x7f2c4000aa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:55.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.198+0000 7f2c54b56640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6480 0x560432ee4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:55.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.198+0000 7f2c54b56640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6480 0x560432ee4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56356/0 (socket says 172.21.15.59:56356) 2024-09-10T21:22:55.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.198+0000 7f2c54b56640 1 -- 172.21.15.59:0/3482832052 learned_addr learned my addr 172.21.15.59:0/3482832052 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:55.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.198+0000 7f2c55357640 1 --2- 172.21.15.59:0/3482832052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6da0 0x560432ee4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:55.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.199+0000 7f2c54b56640 1 -- 172.21.15.59:0/3482832052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 msgr2=0x560432f4e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.199+0000 7f2c54b56640 1 --2- 172.21.15.59:0/3482832052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 0x560432f4e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.199+0000 7f2c54b56640 1 -- 172.21.15.59:0/3482832052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6da0 msgr2=0x560432ee4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.199+0000 7f2c54b56640 1 --2- 172.21.15.59:0/3482832052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6da0 0x560432ee4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.199+0000 7f2c54b56640 1 -- 172.21.15.59:0/3482832052 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560432ed0940 con 0x560432ec6480 2024-09-10T21:22:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.199+0000 7f2c55357640 1 --2- 172.21.15.59:0/3482832052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6da0 0x560432ee4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:22:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.199+0000 7f2c54b56640 1 --2- 172.21.15.59:0/3482832052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6480 0x560432ee4230 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x560432c8d810 tx=0x7f2c40013e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b178799ef3124831 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.199+0000 7f2c38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:22:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.199+0000 7f2c38ff9640 1 -- 172.21.15.59:0/3482832052 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40022bf0 con 0x560432ec6480 2024-09-10T21:22:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.199+0000 7f2c38ff9640 1 -- 172.21.15.59:0/3482832052 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2c4001a040 con 0x560432ec6480 2024-09-10T21:22:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.199+0000 7f2c59990740 1 -- 172.21.15.59:0/3482832052 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c4c015070 con 0x560432ec6480 2024-09-10T21:22:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.199+0000 7f2c38ff9640 1 -- 172.21.15.59:0/3482832052 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2c40022d90 con 0x560432ec6480 2024-09-10T21:22:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.199+0000 7f2c59990740 10 client.17142 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.199+0000 7f2c59990740 1 -- 172.21.15.59:0/3482832052 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560432f4f990 con 0x560432ec6480 2024-09-10T21:22:55.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.199+0000 7f2c38ff9640 1 -- 172.21.15.59:0/3482832052 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c40011020 con 0x560432ec6480 2024-09-10T21:22:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.200+0000 7f2c38ff9640 1 -- 172.21.15.59:0/3482832052 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2c40020050 con 0x560432ec6480 2024-09-10T21:22:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.200+0000 7f2c59990740 10 client.17142 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.200+0000 7f2c59990740 10 client.17142 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:22:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.200+0000 7f2c59990740 20 client.17142 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.200+0000 7f2c59990740 1 --2- 172.21.15.59:0/3482832052 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x560432f50170 0x560432f52590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.200+0000 7f2c59990740 4 client.17142 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:22:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.200+0000 7f2c59990740 1 -- 172.21.15.59:0/3482832052 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f2c4c015070 con 0x560432f50170 2024-09-10T21:22:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.200+0000 7f2c55357640 1 --2- 172.21.15.59:0/3482832052 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x560432f50170 0x560432f52590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.201+0000 7f2c38ff9640 10 client.17142 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.201+0000 7f2c55357640 1 --2- 172.21.15.59:0/3482832052 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x560432f50170 0x560432f52590 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19b424cb9ce762fd server_cookie=8b97075e226f95e6 in_seq=0 out_seq=0 2024-09-10T21:22:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.201+0000 7f2c38ff9640 1 -- 172.21.15.59:0/3482832052 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x7f2c4c015070 con 0x560432f50170 2024-09-10T21:22:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.201+0000 7f2c38ff9640 10 client.17142 handle_command_reply: tid=0 2024-09-10T21:22:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.201+0000 7f2c59990740 1 client.17142 shutdown 2024-09-10T21:22:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.201+0000 7f2c59990740 1 -- 172.21.15.59:0/3482832052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6480 msgr2=0x560432ee4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.201+0000 7f2c59990740 1 --2- 172.21.15.59:0/3482832052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6480 0x560432ee4230 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x560432c8d810 tx=0x7f2c40013e60 comp rx=0 tx=0).stop 2024-09-10T21:22:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.201+0000 7f2c59990740 1 -- 172.21.15.59:0/3482832052 shutdown_connections 2024-09-10T21:22:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.201+0000 7f2c59990740 1 --2- 172.21.15.59:0/3482832052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560432ed2d30 0x560432f4e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.201+0000 7f2c59990740 1 --2- 172.21.15.59:0/3482832052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560432ec6da0 0x560432ee4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.201+0000 7f2c59990740 1 --2- 172.21.15.59:0/3482832052 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x560432f50170 0x560432f52590 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.201+0000 7f2c59990740 1 --2- 172.21.15.59:0/3482832052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560432ec6480 0x560432ee4230 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.201+0000 7f2c38ff9640 0 client.17142 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:22:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.201+0000 7f2c59990740 1 -- 172.21.15.59:0/3482832052 >> 172.21.15.59:0/3482832052 conn(0x560432ec42b0 msgr2=0x560432ed10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.201+0000 7f2c59990740 1 -- 172.21.15.59:0/3482832052 shutdown_connections 2024-09-10T21:22:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.201+0000 7f2c59990740 1 -- 172.21.15.59:0/3482832052 wait complete. 2024-09-10T21:22:55.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.201+0000 7f2c59990740 20 client.17142 trim_cache size 0 max 16384 2024-09-10T21:22:55.210 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:22:55.210 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:22:55.210 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:22:55.210 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:22:55.210 INFO:teuthology.orchestra.run.smithi059.stdout: "d82f24b1-930e-4f83-a379-3084f22918d0": { 2024-09-10T21:22:55.210 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:21:37.203865+0000", 2024-09-10T21:22:55.210 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:55.210 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:55.210 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:55.210 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:55.210 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:55.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:55.211 INFO:teuthology.orchestra.run.smithi059.stdout: "800cdb00-6a99-4c42-8a9e-4b1c599c6af0": { 2024-09-10T21:22:55.211 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:52.224081+0000", 2024-09-10T21:22:55.211 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:55.211 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:55.211 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:55.211 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:55.211 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:55.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:55.211 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:22:55.211 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:22:55.211 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:55.211 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:55.211 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:55.211 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:55.212 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:55.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:55.212 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:22:55.212 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:22:55.212 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:55.212 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:55.212 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:55.212 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:55.212 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:55.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:55.212 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:22:55.212 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:22:55.212 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:55.213 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:55.213 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:55.213 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:55.213 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:55.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:55.213 INFO:teuthology.orchestra.run.smithi059.stdout: "7de1e6cf-02c2-41f2-b957-563f88bae8ef": { 2024-09-10T21:22:55.213 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:22:22.098651+0000", 2024-09-10T21:22:55.213 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:55.213 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:55.213 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:55.213 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:55.213 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:55.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:55.213 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:22:55.214 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:22:55.214 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:55.214 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:55.214 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:55.214 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:55.214 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:55.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:55.214 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:22:55.214 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:07.066301+0000", 2024-09-10T21:22:55.214 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:55.214 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:55.214 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:55.214 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:55.214 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:55.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:55.215 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:22:55.215 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:22:55.215 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:55.215 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:55.215 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:55.215 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:55.215 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:55.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:55.215 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:22:55.215 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:22:55.215 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:55.215 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:55.215 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:55.216 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:55.216 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:55.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:55.216 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:22:55.216 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:22:55.216 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:55.216 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:55.216 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:55.216 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:55.216 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:55.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:55.216 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:22:55.216 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:22:55.216 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:55.217 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:55.217 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:55.217 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:55.217 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:55.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:22:55.217 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:22:55.217 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:22:55.217 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:22:55.217 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:22:55.217 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:22:55.217 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:22:55.217 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:22:55.217 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:22:55.218 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:22:55.218 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:22:55.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.202+0000 7f2c575bb640 1 -- 172.21.15.59:0/2330027300 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2c3c0b5360 msgr2=0x7f2c3c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:55.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.202+0000 7f2c575bb640 1 --2- 172.21.15.59:0/2330027300 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2c3c0b5360 0x7f2c3c0b7820 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2c480ccff0 tx=0x7f2c480bf0d0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.202+0000 7f2c575bb640 1 -- 172.21.15.59:0/2330027300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c5010f440 msgr2=0x7f2c50104640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.202+0000 7f2c575bb640 1 --2- 172.21.15.59:0/2330027300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c5010f440 0x7f2c50104640 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f2c4802ae70 tx=0x7f2c4802f5d0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.202+0000 7f2c575bb640 1 -- 172.21.15.59:0/2330027300 shutdown_connections 2024-09-10T21:22:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.202+0000 7f2c575bb640 1 --2- 172.21.15.59:0/2330027300 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2c3c0b5360 0x7f2c3c0b7820 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.202+0000 7f2c575bb640 1 --2- 172.21.15.59:0/2330027300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c5010f440 0x7f2c50104640 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.202+0000 7f2c575bb640 1 --2- 172.21.15.59:0/2330027300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c501021b0 0x7f2c50104100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.202+0000 7f2c575bb640 1 --2- 172.21.15.59:0/2330027300 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c50101890 0x7f2c50103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.202+0000 7f2c575bb640 1 -- 172.21.15.59:0/2330027300 >> 172.21.15.59:0/2330027300 conn(0x7f2c500fd700 msgr2=0x7f2c501116a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.202+0000 7f2c575bb640 1 -- 172.21.15.59:0/2330027300 shutdown_connections 2024-09-10T21:22:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:55.202+0000 7f2c575bb640 1 -- 172.21.15.59:0/2330027300 wait complete. 2024-09-10T21:22:56.121 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:22:56.121 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:22:56.391 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:22:56.660 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:56 smithi059 ceph-mon[30888]: pgmap v570: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:22:56.733 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:56 smithi154 ceph-mon[35041]: pgmap v570: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:22:56.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:56 smithi192 ceph-mon[35363]: pgmap v570: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:22:56.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.869+0000 7f4f06a1e640 1 -- 172.21.15.59:0/3212450834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f00102dc0 msgr2=0x7f4f001031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:56.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.869+0000 7f4f06a1e640 1 --2- 172.21.15.59:0/3212450834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f00102dc0 0x7f4f001031a0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0009900 tx=0x7f4ef002a410 comp rx=0 tx=0).stop 2024-09-10T21:22:56.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.869+0000 7f4f06a1e640 1 -- 172.21.15.59:0/3212450834 shutdown_connections 2024-09-10T21:22:56.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.869+0000 7f4f06a1e640 1 --2- 172.21.15.59:0/3212450834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f00109150 0x7f4f0010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:56.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.869+0000 7f4f06a1e640 1 --2- 172.21.15.59:0/3212450834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f001087d0 0x7f4f00108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:56.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.869+0000 7f4f06a1e640 1 --2- 172.21.15.59:0/3212450834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f00102dc0 0x7f4f001031a0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:56.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.870+0000 7f4f06a1e640 1 -- 172.21.15.59:0/3212450834 >> 172.21.15.59:0/3212450834 conn(0x7f4f000fe830 msgr2=0x7f4f00100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:56.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.870+0000 7f4f06a1e640 1 -- 172.21.15.59:0/3212450834 shutdown_connections 2024-09-10T21:22:56.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.870+0000 7f4f06a1e640 1 -- 172.21.15.59:0/3212450834 wait complete. 2024-09-10T21:22:56.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.870+0000 7f4f06a1e640 1 Processor -- start 2024-09-10T21:22:56.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.870+0000 7f4f06a1e640 1 -- start start 2024-09-10T21:22:56.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.870+0000 7f4f06a1e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f00102dc0 0x7f4f000754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:56.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.870+0000 7f4f06a1e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f001087d0 0x7f4f000759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:56.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.870+0000 7f4f06a1e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f00109150 0x7f4f00075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:56.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.870+0000 7f4f06a1e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4f00112e50 con 0x7f4f001087d0 2024-09-10T21:22:56.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.870+0000 7f4f06a1e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4f00112cd0 con 0x7f4f00102dc0 2024-09-10T21:22:56.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.870+0000 7f4f06a1e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4f00112fd0 con 0x7f4f00109150 2024-09-10T21:22:56.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.871+0000 7f4ef7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f001087d0 0x7f4f000759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:56.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.871+0000 7f4ef7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f001087d0 0x7f4f000759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56372/0 (socket says 172.21.15.59:56372) 2024-09-10T21:22:56.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.871+0000 7f4ef7fff640 1 -- 172.21.15.59:0/2466631204 learned_addr learned my addr 172.21.15.59:0/2466631204 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:56.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.871+0000 7f4f04fbb640 1 --2- 172.21.15.59:0/2466631204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f00109150 0x7f4f00075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:56.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.871+0000 7f4efffff640 1 --2- 172.21.15.59:0/2466631204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f00102dc0 0x7f4f000754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:56.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.871+0000 7f4ef7fff640 1 -- 172.21.15.59:0/2466631204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f00109150 msgr2=0x7f4f00075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:56.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.871+0000 7f4ef7fff640 1 --2- 172.21.15.59:0/2466631204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f00109150 0x7f4f00075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:56.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.871+0000 7f4ef7fff640 1 -- 172.21.15.59:0/2466631204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f00102dc0 msgr2=0x7f4f000754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:56.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.871+0000 7f4ef7fff640 1 --2- 172.21.15.59:0/2466631204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f00102dc0 0x7f4f000754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:56.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.871+0000 7f4ef7fff640 1 -- 172.21.15.59:0/2466631204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f001a7860 con 0x7f4f001087d0 2024-09-10T21:22:56.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.871+0000 7f4ef7fff640 1 --2- 172.21.15.59:0/2466631204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f001087d0 0x7f4f000759e0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800b4a0 tx=0x7f4ee800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:56.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.871+0000 7f4efdffb640 1 -- 172.21.15.59:0/2466631204 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8014070 con 0x7f4f001087d0 2024-09-10T21:22:56.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.871+0000 7f4efdffb640 1 -- 172.21.15.59:0/2466631204 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ee8010ac0 con 0x7f4f001087d0 2024-09-10T21:22:56.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.871+0000 7f4f06a1e640 1 -- 172.21.15.59:0/2466631204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f001a7b50 con 0x7f4f001087d0 2024-09-10T21:22:56.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.871+0000 7f4efdffb640 1 -- 172.21.15.59:0/2466631204 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8017c30 con 0x7f4f001087d0 2024-09-10T21:22:56.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.871+0000 7f4f06a1e640 1 -- 172.21.15.59:0/2466631204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f001a8090 con 0x7f4f001087d0 2024-09-10T21:22:56.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.872+0000 7f4f06a1e640 1 -- 172.21.15.59:0/2466631204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f00103220 con 0x7f4f001087d0 2024-09-10T21:22:56.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.874+0000 7f4efdffb640 1 -- 172.21.15.59:0/2466631204 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f4ee8010610 con 0x7f4f001087d0 2024-09-10T21:22:56.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.874+0000 7f4efdffb640 1 --2- 172.21.15.59:0/2466631204 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4eec0b52e0 0x7f4eec0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:56.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.875+0000 7f4efffff640 1 --2- 172.21.15.59:0/2466631204 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4eec0b52e0 0x7f4eec0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:56.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.875+0000 7f4efdffb640 1 -- 172.21.15.59:0/2466631204 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4ee80e53c0 con 0x7f4f001087d0 2024-09-10T21:22:56.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.875+0000 7f4efffff640 1 --2- 172.21.15.59:0/2466631204 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4eec0b52e0 0x7f4eec0b77a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0031440 tx=0x7f4ef0005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:56.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:56.877+0000 7f4efdffb640 1 -- 172.21.15.59:0/2466631204 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4ee80abc00 con 0x7f4f001087d0 2024-09-10T21:22:57.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:57.098+0000 7f4f06a1e640 1 -- 172.21.15.59:0/2466631204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f000767a0 con 0x7f4f001087d0 2024-09-10T21:22:57.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:57.099+0000 7f4efdffb640 1 -- 172.21.15.59:0/2466631204 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f4f000767a0 con 0x7f4f001087d0 2024-09-10T21:22:57.102 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:22:57.102 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:22:57.103 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:22:57.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:57.102+0000 7f4f06a1e640 1 -- 172.21.15.59:0/2466631204 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4eec0b52e0 msgr2=0x7f4eec0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:57.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:57.102+0000 7f4f06a1e640 1 --2- 172.21.15.59:0/2466631204 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4eec0b52e0 0x7f4eec0b77a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0031440 tx=0x7f4ef0005e80 comp rx=0 tx=0).stop 2024-09-10T21:22:57.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:57.102+0000 7f4f06a1e640 1 -- 172.21.15.59:0/2466631204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f001087d0 msgr2=0x7f4f000759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:57.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:57.102+0000 7f4f06a1e640 1 --2- 172.21.15.59:0/2466631204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f001087d0 0x7f4f000759e0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800b4a0 tx=0x7f4ee800b960 comp rx=0 tx=0).stop 2024-09-10T21:22:57.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:57.102+0000 7f4f06a1e640 1 -- 172.21.15.59:0/2466631204 shutdown_connections 2024-09-10T21:22:57.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:57.102+0000 7f4f06a1e640 1 --2- 172.21.15.59:0/2466631204 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4eec0b52e0 0x7f4eec0b77a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:57.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:57.102+0000 7f4f06a1e640 1 --2- 172.21.15.59:0/2466631204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f00109150 0x7f4f00075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:57.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:57.102+0000 7f4f06a1e640 1 --2- 172.21.15.59:0/2466631204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f001087d0 0x7f4f000759e0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:57.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:57.102+0000 7f4f06a1e640 1 --2- 172.21.15.59:0/2466631204 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f00102dc0 0x7f4f000754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:57.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:57.102+0000 7f4f06a1e640 1 -- 172.21.15.59:0/2466631204 >> 172.21.15.59:0/2466631204 conn(0x7f4f000fe830 msgr2=0x7f4f00100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:57.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:57.102+0000 7f4f06a1e640 1 -- 172.21.15.59:0/2466631204 shutdown_connections 2024-09-10T21:22:57.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:57.102+0000 7f4f06a1e640 1 -- 172.21.15.59:0/2466631204 wait complete. 2024-09-10T21:22:57.785 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:57 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2466631204' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:22:57.814 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:22:57.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:57 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2466631204' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:22:57.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:57 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2466631204' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:22:58.076 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:22:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.589+0000 7fe0e1139640 1 -- 172.21.15.59:0/2791582453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0dc101c90 msgr2=0x7fe0dc102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.589+0000 7fe0e1139640 1 --2- 172.21.15.59:0/2791582453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0dc101c90 0x7fe0dc102070 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc009ca0 tx=0x7fe0cc02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.589+0000 7fe0e1139640 1 -- 172.21.15.59:0/2791582453 shutdown_connections 2024-09-10T21:22:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.589+0000 7fe0e1139640 1 --2- 172.21.15.59:0/2791582453 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0dc108020 0x7fe0dc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.589+0000 7fe0e1139640 1 --2- 172.21.15.59:0/2791582453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0dc1076a0 0x7fe0dc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.589+0000 7fe0e1139640 1 --2- 172.21.15.59:0/2791582453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0dc101c90 0x7fe0dc102070 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.589+0000 7fe0e1139640 1 -- 172.21.15.59:0/2791582453 >> 172.21.15.59:0/2791582453 conn(0x7fe0dc0fd700 msgr2=0x7fe0dc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:58.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.589+0000 7fe0e1139640 1 -- 172.21.15.59:0/2791582453 shutdown_connections 2024-09-10T21:22:58.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.589+0000 7fe0e1139640 1 -- 172.21.15.59:0/2791582453 wait complete. 2024-09-10T21:22:58.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.590+0000 7fe0e1139640 1 Processor -- start 2024-09-10T21:22:58.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.590+0000 7fe0e1139640 1 -- start start 2024-09-10T21:22:58.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.590+0000 7fe0e1139640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0dc101c90 0x7fe0dc0fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:58.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.590+0000 7fe0e1139640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0dc1076a0 0x7fe0dc0fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:58.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.590+0000 7fe0e1139640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0dc108020 0x7fe0dc0fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:58.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.590+0000 7fe0e1139640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc111ce0 con 0x7fe0dc1076a0 2024-09-10T21:22:58.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.590+0000 7fe0e1139640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc111b60 con 0x7fe0dc108020 2024-09-10T21:22:58.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.590+0000 7fe0e1139640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc111e60 con 0x7fe0dc101c90 2024-09-10T21:22:58.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.590+0000 7fe0da59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0dc1076a0 0x7fe0dc0fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:58.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.590+0000 7fe0da59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0dc1076a0 0x7fe0dc0fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56390/0 (socket says 172.21.15.59:56390) 2024-09-10T21:22:58.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.590+0000 7fe0da59c640 1 -- 172.21.15.59:0/1596398641 learned_addr learned my addr 172.21.15.59:0/1596398641 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:58.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.591+0000 7fe0db59e640 1 --2- 172.21.15.59:0/1596398641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0dc108020 0x7fe0dc0fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:58.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.591+0000 7fe0dad9d640 1 --2- 172.21.15.59:0/1596398641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0dc101c90 0x7fe0dc0fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:58.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.591+0000 7fe0da59c640 1 -- 172.21.15.59:0/1596398641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0dc101c90 msgr2=0x7fe0dc0fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:58.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.591+0000 7fe0da59c640 1 --2- 172.21.15.59:0/1596398641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0dc101c90 0x7fe0dc0fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.591+0000 7fe0da59c640 1 -- 172.21.15.59:0/1596398641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0dc108020 msgr2=0x7fe0dc0fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:58.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.591+0000 7fe0da59c640 1 --2- 172.21.15.59:0/1596398641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0dc108020 0x7fe0dc0fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.591+0000 7fe0da59c640 1 -- 172.21.15.59:0/1596398641 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc1a7680 con 0x7fe0dc1076a0 2024-09-10T21:22:58.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.591+0000 7fe0dad9d640 1 --2- 172.21.15.59:0/1596398641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0dc101c90 0x7fe0dc0fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:22:58.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.591+0000 7fe0da59c640 1 --2- 172.21.15.59:0/1596398641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0dc1076a0 0x7fe0dc0fe140 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe0c400d950 tx=0x7fe0c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:58.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.591+0000 7fe0d3fff640 1 -- 172.21.15.59:0/1596398641 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4017070 con 0x7fe0dc1076a0 2024-09-10T21:22:58.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.591+0000 7fe0e1139640 1 -- 172.21.15.59:0/1596398641 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0dc1a7970 con 0x7fe0dc1076a0 2024-09-10T21:22:58.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.591+0000 7fe0d3fff640 1 -- 172.21.15.59:0/1596398641 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0c4009c30 con 0x7fe0dc1076a0 2024-09-10T21:22:58.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.591+0000 7fe0d3fff640 1 -- 172.21.15.59:0/1596398641 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c400f620 con 0x7fe0dc1076a0 2024-09-10T21:22:58.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.591+0000 7fe0e1139640 1 -- 172.21.15.59:0/1596398641 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0dc1a7f00 con 0x7fe0dc1076a0 2024-09-10T21:22:58.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.594+0000 7fe0d3fff640 1 -- 172.21.15.59:0/1596398641 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fe0c4010460 con 0x7fe0dc1076a0 2024-09-10T21:22:58.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.594+0000 7fe0e350e740 1 Processor -- start 2024-09-10T21:22:58.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.594+0000 7fe0e350e740 1 -- start start 2024-09-10T21:22:58.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.594+0000 7fe0e350e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726990f0 0x5581726994d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:58.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.594+0000 7fe0e350e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558172699a10 0x5581726a5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:58.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.594+0000 7fe0e350e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581726a59a0 0x5581726a7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:58.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.594+0000 7fe0e350e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55817260fea0 con 0x5581726990f0 2024-09-10T21:22:58.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.594+0000 7fe0e350e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5581725ff2d0 con 0x558172699a10 2024-09-10T21:22:58.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.594+0000 7fe0e350e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5581726030e0 con 0x5581726a59a0 2024-09-10T21:22:58.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.595+0000 7fe0db59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726990f0 0x5581726994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:58.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.595+0000 7fe0db59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726990f0 0x5581726994d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56406/0 (socket says 172.21.15.59:56406) 2024-09-10T21:22:58.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.595+0000 7fe0db59e640 1 -- 172.21.15.59:0/2627875021 learned_addr learned my addr 172.21.15.59:0/2627875021 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:58.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.595+0000 7fe0dad9d640 1 --2- 172.21.15.59:0/2627875021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558172699a10 0x5581726a5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:58.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.595+0000 7fe0da59c640 1 --2- 172.21.15.59:0/2627875021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581726a59a0 0x5581726a7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:58.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.595+0000 7fe0db59e640 1 -- 172.21.15.59:0/2627875021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581726a59a0 msgr2=0x5581726a7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:58.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.595+0000 7fe0db59e640 1 --2- 172.21.15.59:0/2627875021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581726a59a0 0x5581726a7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.595+0000 7fe0db59e640 1 -- 172.21.15.59:0/2627875021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558172699a10 msgr2=0x5581726a5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:58.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.595+0000 7fe0db59e640 1 --2- 172.21.15.59:0/2627875021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558172699a10 0x5581726a5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.595+0000 7fe0db59e640 1 -- 172.21.15.59:0/2627875021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55817235d650 con 0x5581726990f0 2024-09-10T21:22:58.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.595+0000 7fe0dad9d640 1 --2- 172.21.15.59:0/2627875021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558172699a10 0x5581726a5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:22:58.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.595+0000 7fe0d3fff640 1 --2- 172.21.15.59:0/1596398641 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe0c80b52e0 0x7fe0c80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:58.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.595+0000 7fe0dad9d640 1 --2- 172.21.15.59:0/1596398641 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe0c80b52e0 0x7fe0c80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:58.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.595+0000 7fe0db59e640 1 --2- 172.21.15.59:0/2627875021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726990f0 0x5581726994d0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4004650 tx=0x7fe0d400bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969adadec6c5c77d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:58.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.595+0000 7fe0d3fff640 1 -- 172.21.15.59:0/1596398641 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe0c40e5840 con 0x7fe0dc1076a0 2024-09-10T21:22:58.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.596+0000 7fe0d17fa640 1 -- 172.21.15.59:0/2627875021 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4003bd0 con 0x5581726990f0 2024-09-10T21:22:58.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.596+0000 7fe0d17fa640 1 -- 172.21.15.59:0/2627875021 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0d4015070 con 0x5581726990f0 2024-09-10T21:22:58.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.596+0000 7fe0d17fa640 1 -- 172.21.15.59:0/2627875021 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4004ce0 con 0x5581726990f0 2024-09-10T21:22:58.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.596+0000 7fe0e350e740 1 -- 172.21.15.59:0/2627875021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726990f0 msgr2=0x5581726994d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:58.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.596+0000 7fe0dad9d640 1 --2- 172.21.15.59:0/1596398641 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe0c80b52e0 0x7fe0c80b77a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x558172697e00 tx=0x7fe0cc0093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:58.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.596+0000 7fe0e350e740 1 --2- 172.21.15.59:0/2627875021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726990f0 0x5581726994d0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4004650 tx=0x7fe0d400bb10 comp rx=0 tx=0).stop 2024-09-10T21:22:58.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.597+0000 7fe0e350e740 1 -- 172.21.15.59:0/2627875021 shutdown_connections 2024-09-10T21:22:58.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.597+0000 7fe0e350e740 1 --2- 172.21.15.59:0/2627875021 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581726a59a0 0x5581726a7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.597+0000 7fe0e350e740 1 --2- 172.21.15.59:0/2627875021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558172699a10 0x5581726a5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.597+0000 7fe0e350e740 1 --2- 172.21.15.59:0/2627875021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726990f0 0x5581726994d0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.597+0000 7fe0e350e740 1 -- 172.21.15.59:0/2627875021 >> 172.21.15.59:0/2627875021 conn(0x558172696f20 msgr2=0x5581726980c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:58.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.597+0000 7fe0e350e740 1 -- 172.21.15.59:0/2627875021 shutdown_connections 2024-09-10T21:22:58.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.597+0000 7fe0e350e740 1 -- 172.21.15.59:0/2627875021 wait complete. 2024-09-10T21:22:58.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.597+0000 7fe0e350e740 1 -- start start 2024-09-10T21:22:58.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.597+0000 7fe0e350e740 1 Processor -- start 2024-09-10T21:22:58.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.597+0000 7fe0e350e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726990f0 0x5581726a5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:58.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.597+0000 7fe0e350e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558172699a10 0x5581726a26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:58.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.597+0000 7fe0e350e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581726a59a0 0x5581726a2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:58.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.597+0000 7fe0e350e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558172460700 con 0x5581726990f0 2024-09-10T21:22:58.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.597+0000 7fe0e350e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55817259a160 con 0x558172699a10 2024-09-10T21:22:58.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.597+0000 7fe0e350e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5581726a8670 con 0x5581726a59a0 2024-09-10T21:22:58.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.597+0000 7fe0e350e740 10 client.0 _ll_register_callbacks cb 0x5581725b39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:58.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.597+0000 7fe0dad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726990f0 0x5581726a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:58.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.597+0000 7fe0dad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726990f0 0x5581726a5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56422/0 (socket says 172.21.15.59:56422) 2024-09-10T21:22:58.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.597+0000 7fe0dad9d640 1 -- 172.21.15.59:0/3429327107 learned_addr learned my addr 172.21.15.59:0/3429327107 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:58.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.598+0000 7fe0da59c640 1 --2- 172.21.15.59:0/3429327107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558172699a10 0x5581726a26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:58.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.598+0000 7fe0db59e640 1 --2- 172.21.15.59:0/3429327107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581726a59a0 0x5581726a2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:58.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.598+0000 7fe0dad9d640 1 -- 172.21.15.59:0/3429327107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581726a59a0 msgr2=0x5581726a2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:58.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.598+0000 7fe0dad9d640 1 --2- 172.21.15.59:0/3429327107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581726a59a0 0x5581726a2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.598+0000 7fe0dad9d640 1 -- 172.21.15.59:0/3429327107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558172699a10 msgr2=0x5581726a26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:58.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.598+0000 7fe0dad9d640 1 --2- 172.21.15.59:0/3429327107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558172699a10 0x5581726a26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.598+0000 7fe0dad9d640 1 -- 172.21.15.59:0/3429327107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581725c7c90 con 0x5581726990f0 2024-09-10T21:22:58.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.598+0000 7fe0dad9d640 1 --2- 172.21.15.59:0/3429327107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726990f0 0x5581726a5260 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc035000 tx=0x7fe0cc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d16f5e2688039f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:58.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.598+0000 7fe0c27fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:22:58.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.598+0000 7fe0c27fc640 1 -- 172.21.15.59:0/3429327107 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc04f070 con 0x5581726990f0 2024-09-10T21:22:58.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.598+0000 7fe0c27fc640 1 -- 172.21.15.59:0/3429327107 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe0cc004240 con 0x5581726990f0 2024-09-10T21:22:58.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.598+0000 7fe0e350e740 1 -- 172.21.15.59:0/3429327107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0d4015070 con 0x5581726990f0 2024-09-10T21:22:58.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.598+0000 7fe0c27fc640 1 -- 172.21.15.59:0/3429327107 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0cc004480 con 0x5581726990f0 2024-09-10T21:22:58.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.598+0000 7fe0e350e740 10 client.17160 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:58.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.598+0000 7fe0e350e740 1 -- 172.21.15.59:0/3429327107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5581726b3fd0 con 0x5581726990f0 2024-09-10T21:22:58.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.599+0000 7fe0c27fc640 1 -- 172.21.15.59:0/3429327107 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0d4015070 con 0x5581726990f0 2024-09-10T21:22:58.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.599+0000 7fe0c27fc640 1 -- 172.21.15.59:0/3429327107 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe0cc044040 con 0x5581726990f0 2024-09-10T21:22:58.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.599+0000 7fe0e350e740 10 client.17160 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:58.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.599+0000 7fe0e350e740 10 client.17160 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:22:58.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.599+0000 7fe0e350e740 20 client.17160 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:58.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.599+0000 7fe0e350e740 1 --2- 172.21.15.59:0/3429327107 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5581726b53e0 0x5581726b7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:58.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.599+0000 7fe0e350e740 4 client.17160 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:22:58.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.599+0000 7fe0e350e740 1 -- 172.21.15.59:0/3429327107 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558172611df0 con 0x5581726b53e0 2024-09-10T21:22:58.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.599+0000 7fe0da59c640 1 --2- 172.21.15.59:0/3429327107 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5581726b53e0 0x5581726b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:58.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.600+0000 7fe0da59c640 1 --2- 172.21.15.59:0/3429327107 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5581726b53e0 0x5581726b7840 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b51f0e45bf4ab936 server_cookie=8d4fed2abf79aa47 in_seq=0 out_seq=0 2024-09-10T21:22:58.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.600+0000 7fe0c27fc640 10 client.17160 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:22:58.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.601+0000 7fe0c27fc640 1 -- 172.21.15.59:0/3429327107 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558172611df0 con 0x5581726b53e0 2024-09-10T21:22:58.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.601+0000 7fe0c27fc640 10 client.17160 handle_command_reply: tid=0 2024-09-10T21:22:58.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.601+0000 7fe0e350e740 1 client.17160 shutdown 2024-09-10T21:22:58.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.601+0000 7fe0e350e740 1 -- 172.21.15.59:0/3429327107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726990f0 msgr2=0x5581726a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:58.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.601+0000 7fe0e350e740 1 --2- 172.21.15.59:0/3429327107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726990f0 0x5581726a5260 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc035000 tx=0x7fe0cc0095c0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.601+0000 7fe0e350e740 1 -- 172.21.15.59:0/3429327107 shutdown_connections 2024-09-10T21:22:58.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.601+0000 7fe0e350e740 1 --2- 172.21.15.59:0/3429327107 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5581726b53e0 0x5581726b7840 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.601+0000 7fe0c27fc640 0 client.17160 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:22:58.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.601+0000 7fe0e350e740 1 --2- 172.21.15.59:0/3429327107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581726a59a0 0x5581726a2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.601+0000 7fe0e350e740 1 --2- 172.21.15.59:0/3429327107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558172699a10 0x5581726a26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.601+0000 7fe0e350e740 1 --2- 172.21.15.59:0/3429327107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726990f0 0x5581726a5260 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.601+0000 7fe0e350e740 1 -- 172.21.15.59:0/3429327107 >> 172.21.15.59:0/3429327107 conn(0x558172696f20 msgr2=0x55817269ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:58.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.601+0000 7fe0e350e740 1 -- 172.21.15.59:0/3429327107 shutdown_connections 2024-09-10T21:22:58.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.601+0000 7fe0e350e740 1 -- 172.21.15.59:0/3429327107 wait complete. 2024-09-10T21:22:58.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.601+0000 7fe0e350e740 20 client.17160 trim_cache size 0 max 16384 2024-09-10T21:22:58.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.614+0000 7fe0e350e740 1 Processor -- start 2024-09-10T21:22:58.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.614+0000 7fe0e350e740 1 -- start start 2024-09-10T21:22:58.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.614+0000 7fe0e350e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581726990f0 0x5581726b1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:58.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.614+0000 7fe0e350e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558172699a10 0x5581726a1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:58.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.614+0000 7fe0e350e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726a59a0 0x558172696780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:58.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.614+0000 7fe0e350e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1b0460 con 0x5581726a59a0 2024-09-10T21:22:58.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.614+0000 7fe0e350e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1b1fa0 con 0x5581726990f0 2024-09-10T21:22:58.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.614+0000 7fe0e350e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1b0b30 con 0x558172699a10 2024-09-10T21:22:58.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.615+0000 7fe0db59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726a59a0 0x558172696780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:58.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.615+0000 7fe0db59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726a59a0 0x558172696780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56430/0 (socket says 172.21.15.59:56430) 2024-09-10T21:22:58.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.615+0000 7fe0db59e640 1 -- 172.21.15.59:0/2331491958 learned_addr learned my addr 172.21.15.59:0/2331491958 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:58.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.615+0000 7fe0da59c640 1 --2- 172.21.15.59:0/2331491958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558172699a10 0x5581726a1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:58.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.615+0000 7fe0dad9d640 1 --2- 172.21.15.59:0/2331491958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581726990f0 0x5581726b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:58.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.615+0000 7fe0db59e640 1 -- 172.21.15.59:0/2331491958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558172699a10 msgr2=0x5581726a1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:58.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.615+0000 7fe0db59e640 1 --2- 172.21.15.59:0/2331491958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558172699a10 0x5581726a1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.615+0000 7fe0db59e640 1 -- 172.21.15.59:0/2331491958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581726990f0 msgr2=0x5581726b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:58.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.615+0000 7fe0db59e640 1 --2- 172.21.15.59:0/2331491958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581726990f0 0x5581726b1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.615+0000 7fe0db59e640 1 -- 172.21.15.59:0/2331491958 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581726a3000 con 0x5581726a59a0 2024-09-10T21:22:58.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.615+0000 7fe0dad9d640 1 --2- 172.21.15.59:0/2331491958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581726990f0 0x5581726b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:22:58.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.615+0000 7fe0da59c640 1 --2- 172.21.15.59:0/2331491958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558172699a10 0x5581726a1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:22:58.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.615+0000 7fe0db59e640 1 --2- 172.21.15.59:0/2331491958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726a59a0 0x558172696780 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400bfd0 tx=0x7fe0d4004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8d2826a85f2f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:58.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.615+0000 7fe0d0ff9640 1 -- 172.21.15.59:0/2331491958 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4027070 con 0x5581726a59a0 2024-09-10T21:22:58.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.615+0000 7fe0d0ff9640 1 -- 172.21.15.59:0/2331491958 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0d4015040 con 0x5581726a59a0 2024-09-10T21:22:58.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.615+0000 7fe0d0ff9640 1 -- 172.21.15.59:0/2331491958 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4019420 con 0x5581726a59a0 2024-09-10T21:22:58.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.616+0000 7fe0e350e740 1 -- 172.21.15.59:0/2331491958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726a59a0 msgr2=0x558172696780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:58.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.616+0000 7fe0e350e740 1 --2- 172.21.15.59:0/2331491958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726a59a0 0x558172696780 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400bfd0 tx=0x7fe0d4004390 comp rx=0 tx=0).stop 2024-09-10T21:22:58.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.616+0000 7fe0e350e740 1 -- 172.21.15.59:0/2331491958 shutdown_connections 2024-09-10T21:22:58.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.616+0000 7fe0e350e740 1 --2- 172.21.15.59:0/2331491958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5581726a59a0 0x558172696780 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.616+0000 7fe0e350e740 1 --2- 172.21.15.59:0/2331491958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558172699a10 0x5581726a1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.616+0000 7fe0e350e740 1 --2- 172.21.15.59:0/2331491958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581726990f0 0x5581726b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.616+0000 7fe0e350e740 1 -- 172.21.15.59:0/2331491958 >> 172.21.15.59:0/2331491958 conn(0x558172696f20 msgr2=0x558172698050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:58.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.616+0000 7fe0e350e740 1 -- 172.21.15.59:0/2331491958 shutdown_connections 2024-09-10T21:22:58.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.616+0000 7fe0e350e740 1 -- 172.21.15.59:0/2331491958 wait complete. 2024-09-10T21:22:58.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0e350e740 1 -- start start 2024-09-10T21:22:58.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0e350e740 1 Processor -- start 2024-09-10T21:22:58.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0e350e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581726990f0 0x5581726a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:58.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0e350e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558172699a10 0x5581726aa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:58.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0e350e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581726a59a0 0x558172721310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:58.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0e350e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1b18d0 con 0x558172699a10 2024-09-10T21:22:58.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0e350e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1b1200 con 0x5581726a59a0 2024-09-10T21:22:58.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0e350e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1ae440 con 0x5581726990f0 2024-09-10T21:22:58.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0e350e740 10 client.0 _ll_register_callbacks cb 0x7fe0cc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:22:58.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0da59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558172699a10 0x5581726aa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:58.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0da59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558172699a10 0x5581726aa180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56444/0 (socket says 172.21.15.59:56444) 2024-09-10T21:22:58.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0da59c640 1 -- 172.21.15.59:0/3357946438 learned_addr learned my addr 172.21.15.59:0/3357946438 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:22:58.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0dad9d640 1 --2- 172.21.15.59:0/3357946438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581726990f0 0x5581726a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:58.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0da59c640 1 -- 172.21.15.59:0/3357946438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581726990f0 msgr2=0x5581726a9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:58.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0da59c640 1 --2- 172.21.15.59:0/3357946438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581726990f0 0x5581726a9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0db59e640 1 --2- 172.21.15.59:0/3357946438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581726a59a0 0x558172721310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:58.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0da59c640 1 -- 172.21.15.59:0/3357946438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581726a59a0 msgr2=0x558172721310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:22:58.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0da59c640 1 --2- 172.21.15.59:0/3357946438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581726a59a0 0x558172721310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0da59c640 1 -- 172.21.15.59:0/3357946438 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558172721850 con 0x558172699a10 2024-09-10T21:22:58.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.617+0000 7fe0db59e640 1 --2- 172.21.15.59:0/3357946438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581726a59a0 0x558172721310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:22:58.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.618+0000 7fe0da59c640 1 --2- 172.21.15.59:0/3357946438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558172699a10 0x5581726aa180 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40abd30 tx=0x7fe0c40b5050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b77bcb6562fa6bc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:22:58.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.618+0000 7fe0c27fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:22:58.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.618+0000 7fe0c27fc640 1 -- 172.21.15.59:0/3357946438 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4020040 con 0x558172699a10 2024-09-10T21:22:58.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.618+0000 7fe0c27fc640 1 -- 172.21.15.59:0/3357946438 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe0c40ab490 con 0x558172699a10 2024-09-10T21:22:58.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.618+0000 7fe0e350e740 1 -- 172.21.15.59:0/3357946438 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0d4015040 con 0x558172699a10 2024-09-10T21:22:58.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.618+0000 7fe0c27fc640 1 -- 172.21.15.59:0/3357946438 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0c40ac730 con 0x558172699a10 2024-09-10T21:22:58.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.618+0000 7fe0e350e740 10 client.17166 fetch_fsmap learned FSMap version 28 2024-09-10T21:22:58.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.618+0000 7fe0e350e740 1 -- 172.21.15.59:0/3357946438 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558172722940 con 0x558172699a10 2024-09-10T21:22:58.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.618+0000 7fe0c27fc640 1 -- 172.21.15.59:0/3357946438 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0d4015040 con 0x558172699a10 2024-09-10T21:22:58.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.618+0000 7fe0c27fc640 1 -- 172.21.15.59:0/3357946438 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe0c4010780 con 0x558172699a10 2024-09-10T21:22:58.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.618+0000 7fe0e350e740 10 client.17166 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:22:58.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.618+0000 7fe0e350e740 10 client.17166 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:22:58.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.618+0000 7fe0e350e740 20 client.17166 populate_metadata read hostname 'smithi059' 2024-09-10T21:22:58.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.618+0000 7fe0e350e740 1 --2- 172.21.15.59:0/3357946438 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5581726b53e0 0x558172725080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:22:58.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.618+0000 7fe0e350e740 4 client.17166 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:22:58.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.618+0000 7fe0e350e740 1 -- 172.21.15.59:0/3357946438 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55817260d8a0 con 0x5581726b53e0 2024-09-10T21:22:58.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.619+0000 7fe0dad9d640 1 --2- 172.21.15.59:0/3357946438 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5581726b53e0 0x558172725080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:22:58.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.619+0000 7fe0dad9d640 1 --2- 172.21.15.59:0/3357946438 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5581726b53e0 0x558172725080 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=76baa74bd592c70 server_cookie=b2c3acf3ce139f17 in_seq=0 out_seq=0 2024-09-10T21:22:58.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.619+0000 7fe0c27fc640 10 client.17166 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:22:58.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.619+0000 7fe0c27fc640 1 -- 172.21.15.59:0/3357946438 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55817260d8a0 con 0x5581726b53e0 2024-09-10T21:22:58.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.619+0000 7fe0c27fc640 10 client.17166 handle_command_reply: tid=0 2024-09-10T21:22:58.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.619+0000 7fe0e350e740 1 client.17166 shutdown 2024-09-10T21:22:58.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.619+0000 7fe0e350e740 1 -- 172.21.15.59:0/3357946438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558172699a10 msgr2=0x5581726aa180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:58.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.619+0000 7fe0e350e740 1 --2- 172.21.15.59:0/3357946438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558172699a10 0x5581726aa180 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40abd30 tx=0x7fe0c40b5050 comp rx=0 tx=0).stop 2024-09-10T21:22:58.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e350e740 1 -- 172.21.15.59:0/3357946438 shutdown_connections 2024-09-10T21:22:58.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e350e740 1 --2- 172.21.15.59:0/3357946438 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5581726b53e0 0x558172725080 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e350e740 1 --2- 172.21.15.59:0/3357946438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5581726a59a0 0x558172721310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e350e740 1 --2- 172.21.15.59:0/3357946438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558172699a10 0x5581726aa180 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e350e740 1 --2- 172.21.15.59:0/3357946438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5581726990f0 0x5581726a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e350e740 1 -- 172.21.15.59:0/3357946438 >> 172.21.15.59:0/3357946438 conn(0x558172696f20 msgr2=0x5581726a0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:58.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0c27fc640 0 client.17166 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:22:58.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e350e740 1 -- 172.21.15.59:0/3357946438 shutdown_connections 2024-09-10T21:22:58.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e350e740 1 -- 172.21.15.59:0/3357946438 wait complete. 2024-09-10T21:22:58.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e350e740 20 client.17166 trim_cache size 0 max 16384 2024-09-10T21:22:58.628 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:22:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e1139640 1 -- 172.21.15.59:0/1596398641 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe0c80b52e0 msgr2=0x7fe0c80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e1139640 1 --2- 172.21.15.59:0/1596398641 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe0c80b52e0 0x7fe0c80b77a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x558172697e00 tx=0x7fe0cc0093f0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e1139640 1 -- 172.21.15.59:0/1596398641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0dc1076a0 msgr2=0x7fe0dc0fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:22:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e1139640 1 --2- 172.21.15.59:0/1596398641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0dc1076a0 0x7fe0dc0fe140 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe0c400d950 tx=0x7fe0c400de10 comp rx=0 tx=0).stop 2024-09-10T21:22:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e1139640 1 -- 172.21.15.59:0/1596398641 shutdown_connections 2024-09-10T21:22:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e1139640 1 --2- 172.21.15.59:0/1596398641 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe0c80b52e0 0x7fe0c80b77a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e1139640 1 --2- 172.21.15.59:0/1596398641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0dc108020 0x7fe0dc0fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e1139640 1 --2- 172.21.15.59:0/1596398641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0dc1076a0 0x7fe0dc0fe140 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e1139640 1 --2- 172.21.15.59:0/1596398641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0dc101c90 0x7fe0dc0fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:22:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e1139640 1 -- 172.21.15.59:0/1596398641 >> 172.21.15.59:0/1596398641 conn(0x7fe0dc0fd700 msgr2=0x7fe0dc06aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:22:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.620+0000 7fe0e1139640 1 -- 172.21.15.59:0/1596398641 shutdown_connections 2024-09-10T21:22:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:22:58.621+0000 7fe0e1139640 1 -- 172.21.15.59:0/1596398641 wait complete. 2024-09-10T21:22:58.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:22:58 smithi192 ceph-mon[35363]: pgmap v571: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:22:58.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:22:58 smithi059 ceph-mon[30888]: pgmap v571: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:22:58.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:22:58 smithi154 ceph-mon[35041]: pgmap v571: 97 pgs: 97 active+clean; 5.2 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:22:59.475 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:22:59.734 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:23:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.265+0000 7f39f4b96640 1 -- 172.21.15.59:0/4277942582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f0108020 msgr2=0x7f39f010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.265+0000 7f39f4b96640 1 --2- 172.21.15.59:0/4277942582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f0108020 0x7f39f010e820 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009ca0 tx=0x7f39e802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.265+0000 7f39f4b96640 1 -- 172.21.15.59:0/4277942582 shutdown_connections 2024-09-10T21:23:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.265+0000 7f39f4b96640 1 --2- 172.21.15.59:0/4277942582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f0108020 0x7f39f010e820 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.265+0000 7f39f4b96640 1 --2- 172.21.15.59:0/4277942582 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39f01076a0 0x7f39f0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.265+0000 7f39f4b96640 1 --2- 172.21.15.59:0/4277942582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39f0101c90 0x7f39f0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.265+0000 7f39f4b96640 1 -- 172.21.15.59:0/4277942582 >> 172.21.15.59:0/4277942582 conn(0x7f39f00fd700 msgr2=0x7f39f00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.265+0000 7f39f4b96640 1 -- 172.21.15.59:0/4277942582 shutdown_connections 2024-09-10T21:23:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.265+0000 7f39f4b96640 1 -- 172.21.15.59:0/4277942582 wait complete. 2024-09-10T21:23:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.265+0000 7f39f4b96640 1 Processor -- start 2024-09-10T21:23:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39f4b96640 1 -- start start 2024-09-10T21:23:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39f4b96640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39f0101c90 0x7f39f0197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39f4b96640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39f01076a0 0x7f39f0198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39f4b96640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f0108020 0x7f39f01988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39f4b96640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f39f0111ce0 con 0x7f39f0108020 2024-09-10T21:23:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39f4b96640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f39f0111b60 con 0x7f39f01076a0 2024-09-10T21:23:00.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39f4b96640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f39f0111e60 con 0x7f39f0101c90 2024-09-10T21:23:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39eed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f0108020 0x7f39f01988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39eed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f0108020 0x7f39f01988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46558/0 (socket says 172.21.15.59:46558) 2024-09-10T21:23:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39eed9d640 1 -- 172.21.15.59:0/2919681376 learned_addr learned my addr 172.21.15.59:0/2919681376 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39e7fff640 1 --2- 172.21.15.59:0/2919681376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39f01076a0 0x7f39f0198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39ee59c640 1 --2- 172.21.15.59:0/2919681376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39f0101c90 0x7f39f0197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39eed9d640 1 -- 172.21.15.59:0/2919681376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39f0101c90 msgr2=0x7f39f0197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39eed9d640 1 --2- 172.21.15.59:0/2919681376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39f0101c90 0x7f39f0197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39eed9d640 1 -- 172.21.15.59:0/2919681376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39f01076a0 msgr2=0x7f39f0198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39eed9d640 1 --2- 172.21.15.59:0/2919681376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39f01076a0 0x7f39f0198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39eed9d640 1 -- 172.21.15.59:0/2919681376 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f01a7630 con 0x7f39f0108020 2024-09-10T21:23:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39e7fff640 1 --2- 172.21.15.59:0/2919681376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39f01076a0 0x7f39f0198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:00.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39ee59c640 1 --2- 172.21.15.59:0/2919681376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39f0101c90 0x7f39f0197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.266+0000 7f39eed9d640 1 --2- 172.21.15.59:0/2919681376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f0108020 0x7f39f01988d0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f39e8005cc0 tx=0x7f39e802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.267+0000 7f39e77fe640 1 -- 172.21.15.59:0/2919681376 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e8003bf0 con 0x7f39f0108020 2024-09-10T21:23:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.267+0000 7f39f4b96640 1 -- 172.21.15.59:0/2919681376 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f01a78c0 con 0x7f39f0108020 2024-09-10T21:23:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.267+0000 7f39e77fe640 1 -- 172.21.15.59:0/2919681376 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39e8003d90 con 0x7f39f0108020 2024-09-10T21:23:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.267+0000 7f39e77fe640 1 -- 172.21.15.59:0/2919681376 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e802fbc0 con 0x7f39f0108020 2024-09-10T21:23:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.267+0000 7f39f4b96640 1 -- 172.21.15.59:0/2919681376 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f01a7e50 con 0x7f39f0108020 2024-09-10T21:23:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.269+0000 7f39f6f6b740 1 Processor -- start 2024-09-10T21:23:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.269+0000 7f39e77fe640 1 -- 172.21.15.59:0/2919681376 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f39e8004610 con 0x7f39f0108020 2024-09-10T21:23:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.269+0000 7f39f6f6b740 1 -- start start 2024-09-10T21:23:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.270+0000 7f39f6f6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d0064d0 0x56109d0068b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.270+0000 7f39f6f6b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d006df0 0x56109d012840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.270+0000 7f39f6f6b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d012d80 0x56109d015170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.270+0000 7f39f6f6b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56109cf7cea0 con 0x56109d0064d0 2024-09-10T21:23:00.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.270+0000 7f39f6f6b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56109cf6c2d0 con 0x56109d006df0 2024-09-10T21:23:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.270+0000 7f39f6f6b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56109cf700e0 con 0x56109d012d80 2024-09-10T21:23:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.270+0000 7f39e7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d0064d0 0x56109d0068b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.270+0000 7f39e7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d0064d0 0x56109d0068b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46570/0 (socket says 172.21.15.59:46570) 2024-09-10T21:23:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.270+0000 7f39e7fff640 1 -- 172.21.15.59:0/968154040 learned_addr learned my addr 172.21.15.59:0/968154040 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.270+0000 7f39ee59c640 1 --2- 172.21.15.59:0/968154040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d006df0 0x56109d012840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.270+0000 7f39e7fff640 1 --2- 172.21.15.59:0/968154040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d012d80 0x56109d015170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.270+0000 7f39e7fff640 1 -- 172.21.15.59:0/968154040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d012d80 msgr2=0x56109d015170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.270+0000 7f39e7fff640 1 --2- 172.21.15.59:0/968154040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d012d80 0x56109d015170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.270+0000 7f39e7fff640 1 -- 172.21.15.59:0/968154040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d006df0 msgr2=0x56109d012840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.270+0000 7f39e7fff640 1 --2- 172.21.15.59:0/968154040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d006df0 0x56109d012840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.270+0000 7f39e7fff640 1 -- 172.21.15.59:0/968154040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56109ccca650 con 0x56109d0064d0 2024-09-10T21:23:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.270+0000 7f39e77fe640 1 --2- 172.21.15.59:0/2919681376 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f39dc0b5360 0x7f39dc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:00.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.270+0000 7f39e7fff640 1 --2- 172.21.15.59:0/968154040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d0064d0 0x56109d0068b0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f39d800bfa0 tx=0x7f39d800b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be1ed1caba4bfa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:00.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.270+0000 7f39ee59c640 1 --2- 172.21.15.59:0/2919681376 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f39dc0b5360 0x7f39dc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:00.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.271+0000 7f39e77fe640 1 -- 172.21.15.59:0/2919681376 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f39e81070e0 con 0x7f39f0108020 2024-09-10T21:23:00.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.271+0000 7f39e4ff9640 1 -- 172.21.15.59:0/968154040 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d8004030 con 0x56109d0064d0 2024-09-10T21:23:00.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.271+0000 7f39e4ff9640 1 -- 172.21.15.59:0/968154040 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39d8019070 con 0x56109d0064d0 2024-09-10T21:23:00.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.271+0000 7f39e4ff9640 1 -- 172.21.15.59:0/968154040 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d800f3f0 con 0x56109d0064d0 2024-09-10T21:23:00.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.271+0000 7f39f6f6b740 1 -- 172.21.15.59:0/968154040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d0064d0 msgr2=0x56109d0068b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:00.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.271+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/968154040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d0064d0 0x56109d0068b0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f39d800bfa0 tx=0x7f39d800b730 comp rx=0 tx=0).stop 2024-09-10T21:23:00.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.271+0000 7f39ee59c640 1 --2- 172.21.15.59:0/2919681376 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f39dc0b5360 0x7f39dc0b7820 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f39e0005fd0 tx=0x7f39e0009350 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:00.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.271+0000 7f39f6f6b740 1 -- 172.21.15.59:0/968154040 shutdown_connections 2024-09-10T21:23:00.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.271+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/968154040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d012d80 0x56109d015170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.271+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/968154040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d006df0 0x56109d012840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.271+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/968154040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d0064d0 0x56109d0068b0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.271+0000 7f39f6f6b740 1 -- 172.21.15.59:0/968154040 >> 172.21.15.59:0/968154040 conn(0x56109d004300 msgr2=0x56109d0054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:00.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.272+0000 7f39f6f6b740 1 -- 172.21.15.59:0/968154040 shutdown_connections 2024-09-10T21:23:00.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.272+0000 7f39f6f6b740 1 -- 172.21.15.59:0/968154040 wait complete. 2024-09-10T21:23:00.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.272+0000 7f39f6f6b740 1 -- start start 2024-09-10T21:23:00.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.272+0000 7f39f6f6b740 1 Processor -- start 2024-09-10T21:23:00.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.272+0000 7f39f6f6b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d0064d0 0x56109d012690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:00.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.272+0000 7f39f6f6b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d006df0 0x56109d00fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:00.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.272+0000 7f39f6f6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d012d80 0x56109d010110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:00.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.272+0000 7f39f6f6b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56109cdcd700 con 0x56109d012d80 2024-09-10T21:23:00.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.272+0000 7f39f6f6b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56109cf07160 con 0x56109d006df0 2024-09-10T21:23:00.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.272+0000 7f39f6f6b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56109d015a00 con 0x56109d0064d0 2024-09-10T21:23:00.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.272+0000 7f39f6f6b740 10 client.0 _ll_register_callbacks cb 0x56109cf209e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:00.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.272+0000 7f39eed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d012d80 0x56109d010110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:00.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.272+0000 7f39eed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d012d80 0x56109d010110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46576/0 (socket says 172.21.15.59:46576) 2024-09-10T21:23:00.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.272+0000 7f39eed9d640 1 -- 172.21.15.59:0/3854714160 learned_addr learned my addr 172.21.15.59:0/3854714160 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39ee59c640 1 --2- 172.21.15.59:0/3854714160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d0064d0 0x56109d012690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39e7fff640 1 --2- 172.21.15.59:0/3854714160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d006df0 0x56109d00fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39eed9d640 1 -- 172.21.15.59:0/3854714160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d0064d0 msgr2=0x56109d012690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39eed9d640 1 --2- 172.21.15.59:0/3854714160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d0064d0 0x56109d012690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39eed9d640 1 -- 172.21.15.59:0/3854714160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d006df0 msgr2=0x56109d00fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39eed9d640 1 --2- 172.21.15.59:0/3854714160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d006df0 0x56109d00fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39eed9d640 1 -- 172.21.15.59:0/3854714160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56109cf34c90 con 0x56109d012d80 2024-09-10T21:23:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39ee59c640 1 --2- 172.21.15.59:0/3854714160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d0064d0 0x56109d012690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39e7fff640 1 --2- 172.21.15.59:0/3854714160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d006df0 0x56109d00fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39eed9d640 1 --2- 172.21.15.59:0/3854714160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d012d80 0x56109d010110 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f39e802f550 tx=0x7f39e80cd220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652b0d16c625fc05 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39d5ffb640 1 -- 172.21.15.59:0/3854714160 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e80cdfd0 con 0x56109d012d80 2024-09-10T21:23:00.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39d5ffb640 1 -- 172.21.15.59:0/3854714160 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f39e80d69d0 con 0x56109d012d80 2024-09-10T21:23:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39f6f6b740 1 -- 172.21.15.59:0/3854714160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39d8019070 con 0x56109d012d80 2024-09-10T21:23:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39d5ffb640 1 -- 172.21.15.59:0/3854714160 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f39e80e8050 con 0x56109d012d80 2024-09-10T21:23:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39f6f6b740 10 client.17178 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39f6f6b740 1 -- 172.21.15.59:0/3854714160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56109d021390 con 0x56109d012d80 2024-09-10T21:23:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39d5ffb640 1 -- 172.21.15.59:0/3854714160 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39d8019070 con 0x56109d012d80 2024-09-10T21:23:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39d5ffb640 1 -- 172.21.15.59:0/3854714160 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f39e80c9220 con 0x56109d012d80 2024-09-10T21:23:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39f6f6b740 10 client.17178 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.273+0000 7f39f6f6b740 10 client.17178 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:23:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.274+0000 7f39f6f6b740 20 client.17178 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.274+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/3854714160 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56109d0228e0 0x56109d024d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.274+0000 7f39f6f6b740 4 client.17178 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:23:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.274+0000 7f39f6f6b740 1 -- 172.21.15.59:0/3854714160 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56109cf7edf0 con 0x56109d0228e0 2024-09-10T21:23:00.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.274+0000 7f39ee59c640 1 --2- 172.21.15.59:0/3854714160 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56109d0228e0 0x56109d024d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.274+0000 7f39d5ffb640 10 client.17178 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:23:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.274+0000 7f39ee59c640 1 --2- 172.21.15.59:0/3854714160 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56109d0228e0 0x56109d024d80 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3032f8f3842145a0 server_cookie=59a14f53743a0b2c in_seq=0 out_seq=0 2024-09-10T21:23:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.275+0000 7f39d5ffb640 1 -- 172.21.15.59:0/3854714160 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56109cf7edf0 con 0x56109d0228e0 2024-09-10T21:23:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.275+0000 7f39d5ffb640 10 client.17178 handle_command_reply: tid=0 2024-09-10T21:23:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.275+0000 7f39f6f6b740 1 client.17178 shutdown 2024-09-10T21:23:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.275+0000 7f39f6f6b740 1 -- 172.21.15.59:0/3854714160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d012d80 msgr2=0x56109d010110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.275+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/3854714160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d012d80 0x56109d010110 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f39e802f550 tx=0x7f39e80cd220 comp rx=0 tx=0).stop 2024-09-10T21:23:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.275+0000 7f39f6f6b740 1 -- 172.21.15.59:0/3854714160 shutdown_connections 2024-09-10T21:23:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.275+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/3854714160 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56109d0228e0 0x56109d024d80 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.275+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/3854714160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d012d80 0x56109d010110 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.275+0000 7f39d5ffb640 0 client.17178 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:23:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.275+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/3854714160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d006df0 0x56109d00fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.275+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/3854714160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d0064d0 0x56109d012690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.275+0000 7f39f6f6b740 1 -- 172.21.15.59:0/3854714160 >> 172.21.15.59:0/3854714160 conn(0x56109d004300 msgr2=0x56109d009e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:00.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.275+0000 7f39f6f6b740 1 -- 172.21.15.59:0/3854714160 shutdown_connections 2024-09-10T21:23:00.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.275+0000 7f39f6f6b740 1 -- 172.21.15.59:0/3854714160 wait complete. 2024-09-10T21:23:00.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.275+0000 7f39f6f6b740 20 client.17178 trim_cache size 0 max 16384 2024-09-10T21:23:00.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.289+0000 7f39f6f6b740 1 Processor -- start 2024-09-10T21:23:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.289+0000 7f39f6f6b740 1 -- start start 2024-09-10T21:23:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.289+0000 7f39f6f6b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d0064d0 0x56109d003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.289+0000 7f39f6f6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d006df0 0x56109d00e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.289+0000 7f39f6f6b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d012d80 0x56109d00e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.289+0000 7f39f6f6b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01b0490 con 0x56109d006df0 2024-09-10T21:23:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.289+0000 7f39f6f6b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01b1fd0 con 0x56109d0064d0 2024-09-10T21:23:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.289+0000 7f39f6f6b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01b0b60 con 0x56109d012d80 2024-09-10T21:23:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.289+0000 7f39e7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d006df0 0x56109d00e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.289+0000 7f39e7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d006df0 0x56109d00e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46580/0 (socket says 172.21.15.59:46580) 2024-09-10T21:23:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.289+0000 7f39e7fff640 1 -- 172.21.15.59:0/1127210557 learned_addr learned my addr 172.21.15.59:0/1127210557 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.289+0000 7f39ee59c640 1 --2- 172.21.15.59:0/1127210557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d0064d0 0x56109d003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:00.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.289+0000 7f39e7fff640 1 -- 172.21.15.59:0/1127210557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d012d80 msgr2=0x56109d00e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.289+0000 7f39e7fff640 1 --2- 172.21.15.59:0/1127210557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d012d80 0x56109d00e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.289+0000 7f39e7fff640 1 -- 172.21.15.59:0/1127210557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d0064d0 msgr2=0x56109d003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.289+0000 7f39e7fff640 1 --2- 172.21.15.59:0/1127210557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d0064d0 0x56109d003cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.289+0000 7f39e7fff640 1 -- 172.21.15.59:0/1127210557 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56109d006c20 con 0x56109d006df0 2024-09-10T21:23:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.289+0000 7f39e7fff640 1 --2- 172.21.15.59:0/1127210557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d006df0 0x56109d00e360 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f39d8005f00 tx=0x7f39d800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3848226b32554c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.290+0000 7f39d7fff640 1 -- 172.21.15.59:0/1127210557 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d8022020 con 0x56109d006df0 2024-09-10T21:23:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.290+0000 7f39d7fff640 1 -- 172.21.15.59:0/1127210557 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39d8019040 con 0x56109d006df0 2024-09-10T21:23:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.290+0000 7f39d7fff640 1 -- 172.21.15.59:0/1127210557 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d8003af0 con 0x56109d006df0 2024-09-10T21:23:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.290+0000 7f39f6f6b740 1 -- 172.21.15.59:0/1127210557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d006df0 msgr2=0x56109d00e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.290+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/1127210557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d006df0 0x56109d00e360 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f39d8005f00 tx=0x7f39d800beb0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.290+0000 7f39f6f6b740 1 -- 172.21.15.59:0/1127210557 shutdown_connections 2024-09-10T21:23:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.290+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/1127210557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d012d80 0x56109d00e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.290+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/1127210557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d006df0 0x56109d00e360 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.290+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/1127210557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d0064d0 0x56109d003cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.290+0000 7f39f6f6b740 1 -- 172.21.15.59:0/1127210557 >> 172.21.15.59:0/1127210557 conn(0x56109d004300 msgr2=0x56109d00acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.290+0000 7f39f6f6b740 1 -- 172.21.15.59:0/1127210557 shutdown_connections 2024-09-10T21:23:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.290+0000 7f39f6f6b740 1 -- 172.21.15.59:0/1127210557 wait complete. 2024-09-10T21:23:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39f6f6b740 1 -- start start 2024-09-10T21:23:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39f6f6b740 1 Processor -- start 2024-09-10T21:23:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39f6f6b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d0064d0 0x56109d01acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39f6f6b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d006df0 0x56109d01b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39f6f6b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d012d80 0x56109d015c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39f6f6b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01b1900 con 0x56109d0064d0 2024-09-10T21:23:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39f6f6b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01b1230 con 0x56109d006df0 2024-09-10T21:23:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39f6f6b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f39f01ae470 con 0x56109d012d80 2024-09-10T21:23:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39f6f6b740 10 client.0 _ll_register_callbacks cb 0x7f39e8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39ee59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d0064d0 0x56109d01acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:00.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39ee59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d0064d0 0x56109d01acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46586/0 (socket says 172.21.15.59:46586) 2024-09-10T21:23:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39ee59c640 1 -- 172.21.15.59:0/3419689959 learned_addr learned my addr 172.21.15.59:0/3419689959 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39e7fff640 1 --2- 172.21.15.59:0/3419689959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d006df0 0x56109d01b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39eed9d640 1 --2- 172.21.15.59:0/3419689959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d012d80 0x56109d015c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39ee59c640 1 -- 172.21.15.59:0/3419689959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d012d80 msgr2=0x56109d015c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39ee59c640 1 --2- 172.21.15.59:0/3419689959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d012d80 0x56109d015c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39ee59c640 1 -- 172.21.15.59:0/3419689959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d006df0 msgr2=0x56109d01b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39ee59c640 1 --2- 172.21.15.59:0/3419689959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d006df0 0x56109d01b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39ee59c640 1 -- 172.21.15.59:0/3419689959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56109d01b9a0 con 0x56109d0064d0 2024-09-10T21:23:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.291+0000 7f39e7fff640 1 --2- 172.21.15.59:0/3419689959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d006df0 0x56109d01b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.292+0000 7f39ee59c640 1 --2- 172.21.15.59:0/3419689959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d0064d0 0x56109d01acd0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f39e0005f00 tx=0x7f39e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1b6f39dddb948c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.292+0000 7f39d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.292+0000 7f39d5ffb640 1 -- 172.21.15.59:0/3419689959 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e001f620 con 0x56109d0064d0 2024-09-10T21:23:00.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.292+0000 7f39d5ffb640 1 -- 172.21.15.59:0/3419689959 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f39e001f7c0 con 0x56109d0064d0 2024-09-10T21:23:00.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.292+0000 7f39f6f6b740 1 -- 172.21.15.59:0/3419689959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39d8019040 con 0x56109d0064d0 2024-09-10T21:23:00.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.292+0000 7f39d5ffb640 1 -- 172.21.15.59:0/3419689959 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f39e0036050 con 0x56109d0064d0 2024-09-10T21:23:00.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.292+0000 7f39f6f6b740 10 client.17184 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:00.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.292+0000 7f39f6f6b740 1 -- 172.21.15.59:0/3419689959 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56109d08fe40 con 0x56109d0064d0 2024-09-10T21:23:00.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.292+0000 7f39d5ffb640 1 -- 172.21.15.59:0/3419689959 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39d8019040 con 0x56109d0064d0 2024-09-10T21:23:00.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.292+0000 7f39d5ffb640 1 -- 172.21.15.59:0/3419689959 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f39e000f040 con 0x56109d0064d0 2024-09-10T21:23:00.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.293+0000 7f39f6f6b740 10 client.17184 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:00.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.293+0000 7f39f6f6b740 10 client.17184 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:23:00.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.293+0000 7f39f6f6b740 20 client.17184 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:00.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.293+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/3419689959 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56109d0228e0 0x56109d092580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:00.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.293+0000 7f39f6f6b740 4 client.17184 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:23:00.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.293+0000 7f39f6f6b740 1 -- 172.21.15.59:0/3419689959 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56109cf7a8a0 con 0x56109d0228e0 2024-09-10T21:23:00.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.293+0000 7f39e7fff640 1 --2- 172.21.15.59:0/3419689959 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56109d0228e0 0x56109d092580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:00.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.293+0000 7f39e7fff640 1 --2- 172.21.15.59:0/3419689959 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56109d0228e0 0x56109d092580 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d59abdb56dd2228f server_cookie=a4e1ca9d33f59eb3 in_seq=0 out_seq=0 2024-09-10T21:23:00.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.293+0000 7f39d5ffb640 10 client.17184 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:23:00.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.294+0000 7f39d5ffb640 1 -- 172.21.15.59:0/3419689959 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56109cf7a8a0 con 0x56109d0228e0 2024-09-10T21:23:00.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.294+0000 7f39d5ffb640 10 client.17184 handle_command_reply: tid=0 2024-09-10T21:23:00.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.294+0000 7f39f6f6b740 1 client.17184 shutdown 2024-09-10T21:23:00.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.294+0000 7f39f6f6b740 1 -- 172.21.15.59:0/3419689959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d0064d0 msgr2=0x56109d01acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:00.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.294+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/3419689959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d0064d0 0x56109d01acd0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f39e0005f00 tx=0x7f39e00046c0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.294+0000 7f39f6f6b740 1 -- 172.21.15.59:0/3419689959 shutdown_connections 2024-09-10T21:23:00.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.294+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/3419689959 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56109d0228e0 0x56109d092580 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.294+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/3419689959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56109d012d80 0x56109d015c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.294+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/3419689959 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56109d006df0 0x56109d01b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.294+0000 7f39f6f6b740 1 --2- 172.21.15.59:0/3419689959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56109d0064d0 0x56109d01acd0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.294+0000 7f39f6f6b740 1 -- 172.21.15.59:0/3419689959 >> 172.21.15.59:0/3419689959 conn(0x56109d004300 msgr2=0x56109d00acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:00.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.294+0000 7f39d5ffb640 0 client.17184 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:23:00.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.294+0000 7f39f6f6b740 1 -- 172.21.15.59:0/3419689959 shutdown_connections 2024-09-10T21:23:00.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.294+0000 7f39f6f6b740 1 -- 172.21.15.59:0/3419689959 wait complete. 2024-09-10T21:23:00.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.294+0000 7f39f6f6b740 20 client.17184 trim_cache size 0 max 16384 2024-09-10T21:23:00.304 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:23:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.295+0000 7f39f4b96640 1 -- 172.21.15.59:0/2919681376 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f39dc0b5360 msgr2=0x7f39dc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.295+0000 7f39f4b96640 1 --2- 172.21.15.59:0/2919681376 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f39dc0b5360 0x7f39dc0b7820 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f39e0005fd0 tx=0x7f39e0009350 comp rx=0 tx=0).stop 2024-09-10T21:23:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.295+0000 7f39f4b96640 1 -- 172.21.15.59:0/2919681376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f0108020 msgr2=0x7f39f01988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.295+0000 7f39f4b96640 1 --2- 172.21.15.59:0/2919681376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f0108020 0x7f39f01988d0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f39e8005cc0 tx=0x7f39e802f380 comp rx=0 tx=0).stop 2024-09-10T21:23:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.295+0000 7f39f4b96640 1 -- 172.21.15.59:0/2919681376 shutdown_connections 2024-09-10T21:23:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.295+0000 7f39f4b96640 1 --2- 172.21.15.59:0/2919681376 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f39dc0b5360 0x7f39dc0b7820 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.295+0000 7f39f4b96640 1 --2- 172.21.15.59:0/2919681376 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39f0108020 0x7f39f01988d0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.295+0000 7f39f4b96640 1 --2- 172.21.15.59:0/2919681376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39f01076a0 0x7f39f0198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.295+0000 7f39f4b96640 1 --2- 172.21.15.59:0/2919681376 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39f0101c90 0x7f39f0197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:00.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.295+0000 7f39f4b96640 1 -- 172.21.15.59:0/2919681376 >> 172.21.15.59:0/2919681376 conn(0x7f39f00fd700 msgr2=0x7f39f00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:00.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.295+0000 7f39f4b96640 1 -- 172.21.15.59:0/2919681376 shutdown_connections 2024-09-10T21:23:00.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:00.295+0000 7f39f4b96640 1 -- 172.21.15.59:0/2919681376 wait complete. 2024-09-10T21:23:00.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:00 smithi192 ceph-mon[35363]: pgmap v572: 97 pgs: 97 active+clean; 5.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:23:00.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:00 smithi059 ceph-mon[30888]: pgmap v572: 97 pgs: 97 active+clean; 5.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:23:00.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:00 smithi154 ceph-mon[35041]: pgmap v572: 97 pgs: 97 active+clean; 5.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:23:00.999 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:23:01.255 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:23:01.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.738+0000 7f9cdf0cc640 1 -- 172.21.15.59:0/507448380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd8102dc0 msgr2=0x7f9cd81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:01.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.738+0000 7f9cdf0cc640 1 --2- 172.21.15.59:0/507448380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd8102dc0 0x7f9cd81031a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009ca0 tx=0x7f9cc802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.738+0000 7f9cdf0cc640 1 -- 172.21.15.59:0/507448380 shutdown_connections 2024-09-10T21:23:01.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.738+0000 7f9cdf0cc640 1 --2- 172.21.15.59:0/507448380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cd8109150 0x7f9cd810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.738+0000 7f9cdf0cc640 1 --2- 172.21.15.59:0/507448380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd81087d0 0x7f9cd8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.738+0000 7f9cdf0cc640 1 --2- 172.21.15.59:0/507448380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd8102dc0 0x7f9cd81031a0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.738+0000 7f9cdf0cc640 1 -- 172.21.15.59:0/507448380 >> 172.21.15.59:0/507448380 conn(0x7f9cd80fe830 msgr2=0x7f9cd8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:01.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.738+0000 7f9cdf0cc640 1 -- 172.21.15.59:0/507448380 shutdown_connections 2024-09-10T21:23:01.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.738+0000 7f9cdf0cc640 1 -- 172.21.15.59:0/507448380 wait complete. 2024-09-10T21:23:01.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.739+0000 7f9cdf0cc640 1 Processor -- start 2024-09-10T21:23:01.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.739+0000 7f9cdf0cc640 1 -- start start 2024-09-10T21:23:01.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.739+0000 7f9cdf0cc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd8102dc0 0x7f9cd81992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:01.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.739+0000 7f9cdf0cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cd81087d0 0x7f9cd81997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:01.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.739+0000 7f9cdf0cc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd8109150 0x7f9cd819eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:01.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.739+0000 7f9cdf0cc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd8112dd0 con 0x7f9cd8102dc0 2024-09-10T21:23:01.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.739+0000 7f9cdf0cc640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd8112c50 con 0x7f9cd8109150 2024-09-10T21:23:01.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.739+0000 7f9cdf0cc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd8112f50 con 0x7f9cd81087d0 2024-09-10T21:23:01.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.739+0000 7f9cdce68640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd8102dc0 0x7f9cd81992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:01.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.739+0000 7f9cdce68640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd8102dc0 0x7f9cd81992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46606/0 (socket says 172.21.15.59:46606) 2024-09-10T21:23:01.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.739+0000 7f9cdce68640 1 -- 172.21.15.59:0/238788233 learned_addr learned my addr 172.21.15.59:0/238788233 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:01.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.740+0000 7f9cd7fff640 1 --2- 172.21.15.59:0/238788233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cd81087d0 0x7f9cd81997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:01.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.740+0000 7f9cdd669640 1 --2- 172.21.15.59:0/238788233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd8109150 0x7f9cd819eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:01.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.740+0000 7f9cdce68640 1 -- 172.21.15.59:0/238788233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cd81087d0 msgr2=0x7f9cd81997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:01.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.740+0000 7f9cdce68640 1 --2- 172.21.15.59:0/238788233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cd81087d0 0x7f9cd81997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.740+0000 7f9cdce68640 1 -- 172.21.15.59:0/238788233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd8109150 msgr2=0x7f9cd819eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:01.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.740+0000 7f9cdce68640 1 --2- 172.21.15.59:0/238788233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd8109150 0x7f9cd819eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.740+0000 7f9cdce68640 1 -- 172.21.15.59:0/238788233 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd819f350 con 0x7f9cd8102dc0 2024-09-10T21:23:01.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.740+0000 7f9cd7fff640 1 --2- 172.21.15.59:0/238788233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cd81087d0 0x7f9cd81997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:01.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.740+0000 7f9cdce68640 1 --2- 172.21.15.59:0/238788233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd8102dc0 0x7f9cd81992a0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8006010 tx=0x7f9cc80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:01.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.740+0000 7f9cd5ffb640 1 -- 172.21.15.59:0/238788233 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8003bf0 con 0x7f9cd8102dc0 2024-09-10T21:23:01.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.740+0000 7f9cd5ffb640 1 -- 172.21.15.59:0/238788233 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cc8003d90 con 0x7f9cd8102dc0 2024-09-10T21:23:01.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.740+0000 7f9cdf0cc640 1 -- 172.21.15.59:0/238788233 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd819f5e0 con 0x7f9cd8102dc0 2024-09-10T21:23:01.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.740+0000 7f9cd5ffb640 1 -- 172.21.15.59:0/238788233 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc802fc20 con 0x7f9cd8102dc0 2024-09-10T21:23:01.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.740+0000 7f9cdf0cc640 1 -- 172.21.15.59:0/238788233 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd81a5d00 con 0x7f9cd8102dc0 2024-09-10T21:23:01.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.743+0000 7f9ce14a1740 1 Processor -- start 2024-09-10T21:23:01.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.743+0000 7f9cd5ffb640 1 -- 172.21.15.59:0/238788233 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f9cc80046a0 con 0x7f9cd8102dc0 2024-09-10T21:23:01.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.743+0000 7f9ce14a1740 1 -- start start 2024-09-10T21:23:01.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.743+0000 7f9ce14a1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fb50f0 0x562e41fb54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:01.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.743+0000 7f9ce14a1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fb5a10 0x562e41fc1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:01.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.743+0000 7f9ce14a1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fc19a0 0x562e41fc3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:01.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.743+0000 7f9ce14a1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562e41f2bea0 con 0x562e41fb50f0 2024-09-10T21:23:01.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.743+0000 7f9ce14a1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562e41f1b2d0 con 0x562e41fb5a10 2024-09-10T21:23:01.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.743+0000 7f9ce14a1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562e41f1f0e0 con 0x562e41fc19a0 2024-09-10T21:23:01.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.743+0000 7f9cdd669640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fb50f0 0x562e41fb54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:01.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.743+0000 7f9cdd669640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fb50f0 0x562e41fb54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46608/0 (socket says 172.21.15.59:46608) 2024-09-10T21:23:01.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.743+0000 7f9cdd669640 1 -- 172.21.15.59:0/3972077913 learned_addr learned my addr 172.21.15.59:0/3972077913 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:01.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.743+0000 7f9cdce68640 1 --2- 172.21.15.59:0/3972077913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fb5a10 0x562e41fc1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:01.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.744+0000 7f9cd7fff640 1 --2- 172.21.15.59:0/3972077913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fc19a0 0x562e41fc3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:01.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.744+0000 7f9cdd669640 1 -- 172.21.15.59:0/3972077913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fc19a0 msgr2=0x562e41fc3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:01.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.744+0000 7f9cdd669640 1 --2- 172.21.15.59:0/3972077913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fc19a0 0x562e41fc3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.744+0000 7f9cdd669640 1 -- 172.21.15.59:0/3972077913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fb5a10 msgr2=0x562e41fc1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:01.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.744+0000 7f9cdd669640 1 --2- 172.21.15.59:0/3972077913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fb5a10 0x562e41fc1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.744+0000 7f9cdd669640 1 -- 172.21.15.59:0/3972077913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e41c79650 con 0x562e41fb50f0 2024-09-10T21:23:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.744+0000 7f9cd5ffb640 1 --2- 172.21.15.59:0/238788233 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9cc40b52e0 0x7f9cc40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.744+0000 7f9cdce68640 1 --2- 172.21.15.59:0/238788233 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9cc40b52e0 0x7f9cc40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.744+0000 7f9cdd669640 1 --2- 172.21.15.59:0/3972077913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fb50f0 0x562e41fb54d0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009b40 tx=0x7f9cd000e2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d382a5f6fece6cb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.744+0000 7f9cd5ffb640 1 -- 172.21.15.59:0/238788233 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9cc8106fa0 con 0x7f9cd8102dc0 2024-09-10T21:23:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.744+0000 7f9cceffd640 1 -- 172.21.15.59:0/3972077913 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0016070 con 0x562e41fb50f0 2024-09-10T21:23:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.744+0000 7f9cceffd640 1 -- 172.21.15.59:0/3972077913 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cd000ed20 con 0x562e41fb50f0 2024-09-10T21:23:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.744+0000 7f9cceffd640 1 -- 172.21.15.59:0/3972077913 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd00106f0 con 0x562e41fb50f0 2024-09-10T21:23:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.745+0000 7f9ce14a1740 1 -- 172.21.15.59:0/3972077913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fb50f0 msgr2=0x562e41fb54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.745+0000 7f9cdce68640 1 --2- 172.21.15.59:0/238788233 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9cc40b52e0 0x7f9cc40b77a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8104e40 tx=0x7f9cc80095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.745+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/3972077913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fb50f0 0x562e41fb54d0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009b40 tx=0x7f9cd000e2f0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.745+0000 7f9ce14a1740 1 -- 172.21.15.59:0/3972077913 shutdown_connections 2024-09-10T21:23:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.745+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/3972077913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fc19a0 0x562e41fc3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.745+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/3972077913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fb5a10 0x562e41fc1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.745+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/3972077913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fb50f0 0x562e41fb54d0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.745+0000 7f9ce14a1740 1 -- 172.21.15.59:0/3972077913 >> 172.21.15.59:0/3972077913 conn(0x562e41fb2f20 msgr2=0x562e41fb40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:01.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.745+0000 7f9ce14a1740 1 -- 172.21.15.59:0/3972077913 shutdown_connections 2024-09-10T21:23:01.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.745+0000 7f9ce14a1740 1 -- 172.21.15.59:0/3972077913 wait complete. 2024-09-10T21:23:01.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.745+0000 7f9ce14a1740 1 -- start start 2024-09-10T21:23:01.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.745+0000 7f9ce14a1740 1 Processor -- start 2024-09-10T21:23:01.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.746+0000 7f9ce14a1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fb50f0 0x562e41fc1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:01.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.746+0000 7f9ce14a1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fb5a10 0x562e41fbe6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:01.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.746+0000 7f9ce14a1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fc19a0 0x562e41fbec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:01.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.746+0000 7f9ce14a1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562e41d7c700 con 0x562e41fc19a0 2024-09-10T21:23:01.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.746+0000 7f9ce14a1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562e41eb6160 con 0x562e41fb50f0 2024-09-10T21:23:01.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.746+0000 7f9ce14a1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562e41fc4620 con 0x562e41fb5a10 2024-09-10T21:23:01.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.746+0000 7f9ce14a1740 10 client.0 _ll_register_callbacks cb 0x562e41ecf9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:01.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.746+0000 7f9cdd669640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fc19a0 0x562e41fbec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:01.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.746+0000 7f9cdd669640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fc19a0 0x562e41fbec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46614/0 (socket says 172.21.15.59:46614) 2024-09-10T21:23:01.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.746+0000 7f9cdd669640 1 -- 172.21.15.59:0/1937159815 learned_addr learned my addr 172.21.15.59:0/1937159815 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:01.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.746+0000 7f9cd7fff640 1 --2- 172.21.15.59:0/1937159815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fb5a10 0x562e41fbe6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:01.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.746+0000 7f9cdd669640 1 --2- 172.21.15.59:0/1937159815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fb50f0 0x562e41fc1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:01.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.746+0000 7f9cdd669640 1 -- 172.21.15.59:0/1937159815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fb5a10 msgr2=0x562e41fbe6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:01.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.746+0000 7f9cdd669640 1 --2- 172.21.15.59:0/1937159815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fb5a10 0x562e41fbe6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.746+0000 7f9cdd669640 1 -- 172.21.15.59:0/1937159815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fb50f0 msgr2=0x562e41fc1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:01.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.746+0000 7f9cdd669640 1 --2- 172.21.15.59:0/1937159815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fb50f0 0x562e41fc1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.746+0000 7f9cdd669640 1 -- 172.21.15.59:0/1937159815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e41ee3c90 con 0x562e41fc19a0 2024-09-10T21:23:01.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.747+0000 7f9cdd669640 1 --2- 172.21.15.59:0/1937159815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fc19a0 0x562e41fbec90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0000c00 tx=0x7f9cd0011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59a1a4cda07a18 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:01.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.747+0000 7f9cb7fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:01.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.747+0000 7f9cb7fff640 1 -- 172.21.15.59:0/1937159815 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0016050 con 0x562e41fc19a0 2024-09-10T21:23:01.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.747+0000 7f9cb7fff640 1 -- 172.21.15.59:0/1937159815 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9cd0011ca0 con 0x562e41fc19a0 2024-09-10T21:23:01.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.747+0000 7f9ce14a1740 1 -- 172.21.15.59:0/1937159815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cd000ed20 con 0x562e41fc19a0 2024-09-10T21:23:01.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.747+0000 7f9cb7fff640 1 -- 172.21.15.59:0/1937159815 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9cd0032050 con 0x562e41fc19a0 2024-09-10T21:23:01.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.747+0000 7f9ce14a1740 10 client.17196 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:01.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.747+0000 7f9ce14a1740 1 -- 172.21.15.59:0/1937159815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562e41fcff50 con 0x562e41fc19a0 2024-09-10T21:23:01.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.747+0000 7f9cb7fff640 1 -- 172.21.15.59:0/1937159815 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cd000ed20 con 0x562e41fc19a0 2024-09-10T21:23:01.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.747+0000 7f9cb7fff640 1 -- 172.21.15.59:0/1937159815 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9cd000f040 con 0x562e41fc19a0 2024-09-10T21:23:01.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.747+0000 7f9ce14a1740 10 client.17196 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:01.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.747+0000 7f9ce14a1740 10 client.17196 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:23:01.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.747+0000 7f9ce14a1740 20 client.17196 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:01.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.747+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/1937159815 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x562e41fd1360 0x562e41fd3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:01.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.747+0000 7f9ce14a1740 4 client.17196 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:23:01.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.747+0000 7f9ce14a1740 1 -- 172.21.15.59:0/1937159815 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e41f2ddf0 con 0x562e41fd1360 2024-09-10T21:23:01.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.748+0000 7f9cd7fff640 1 --2- 172.21.15.59:0/1937159815 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x562e41fd1360 0x562e41fd3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:01.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.748+0000 7f9cd7fff640 1 --2- 172.21.15.59:0/1937159815 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x562e41fd1360 0x562e41fd3750 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=df6fc47847dbea03 server_cookie=d3f9cdd19a8b1cfb in_seq=0 out_seq=0 2024-09-10T21:23:01.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.748+0000 7f9cb7fff640 10 client.17196 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:23:01.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.749+0000 7f9cb7fff640 1 -- 172.21.15.59:0/1937159815 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562e41f2ddf0 con 0x562e41fd1360 2024-09-10T21:23:01.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.749+0000 7f9cb7fff640 10 client.17196 handle_command_reply: tid=0 2024-09-10T21:23:01.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.749+0000 7f9ce14a1740 1 client.17196 shutdown 2024-09-10T21:23:01.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.749+0000 7f9ce14a1740 1 -- 172.21.15.59:0/1937159815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fc19a0 msgr2=0x562e41fbec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:01.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.749+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/1937159815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fc19a0 0x562e41fbec90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0000c00 tx=0x7f9cd0011f90 comp rx=0 tx=0).stop 2024-09-10T21:23:01.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.749+0000 7f9ce14a1740 1 -- 172.21.15.59:0/1937159815 shutdown_connections 2024-09-10T21:23:01.801 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:23:01.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.749+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/1937159815 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x562e41fd1360 0x562e41fd3750 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.749+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/1937159815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fc19a0 0x562e41fbec90 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.749+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/1937159815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fb5a10 0x562e41fbe6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.749+0000 7f9cb7fff640 0 client.17196 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:23:01.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.749+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/1937159815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fb50f0 0x562e41fc1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.749+0000 7f9ce14a1740 1 -- 172.21.15.59:0/1937159815 >> 172.21.15.59:0/1937159815 conn(0x562e41fb2f20 msgr2=0x562e41fb8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:01.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.750+0000 7f9ce14a1740 1 -- 172.21.15.59:0/1937159815 shutdown_connections 2024-09-10T21:23:01.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.750+0000 7f9ce14a1740 1 -- 172.21.15.59:0/1937159815 wait complete. 2024-09-10T21:23:01.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.750+0000 7f9ce14a1740 20 client.17196 trim_cache size 0 max 16384 2024-09-10T21:23:01.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.763+0000 7f9ce14a1740 1 Processor -- start 2024-09-10T21:23:01.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.763+0000 7f9ce14a1740 1 -- start start 2024-09-10T21:23:01.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.763+0000 7f9ce14a1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fb50f0 0x562e41fb1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:01.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.763+0000 7f9ce14a1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fb5a10 0x562e41fc2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:01.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.763+0000 7f9ce14a1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fc19a0 0x562e41fc32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:01.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.763+0000 7f9ce14a1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd81ae380 con 0x562e41fc19a0 2024-09-10T21:23:01.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.763+0000 7f9ce14a1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd81afec0 con 0x562e41fb50f0 2024-09-10T21:23:01.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.763+0000 7f9ce14a1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd81aea50 con 0x562e41fb5a10 2024-09-10T21:23:01.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.763+0000 7f9cdd669640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fc19a0 0x562e41fc32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:01.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.763+0000 7f9cdd669640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fc19a0 0x562e41fc32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46628/0 (socket says 172.21.15.59:46628) 2024-09-10T21:23:01.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.763+0000 7f9cdd669640 1 -- 172.21.15.59:0/3446018660 learned_addr learned my addr 172.21.15.59:0/3446018660 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:01.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.763+0000 7f9cd7fff640 1 --2- 172.21.15.59:0/3446018660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fb5a10 0x562e41fc2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:01.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.763+0000 7f9cdd669640 1 --2- 172.21.15.59:0/3446018660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fb50f0 0x562e41fb1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:01.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.763+0000 7f9cdd669640 1 -- 172.21.15.59:0/3446018660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fb5a10 msgr2=0x562e41fc2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:01.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.763+0000 7f9cdd669640 1 --2- 172.21.15.59:0/3446018660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fb5a10 0x562e41fc2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.763+0000 7f9cdd669640 1 -- 172.21.15.59:0/3446018660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fb50f0 msgr2=0x562e41fb1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:01.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.763+0000 7f9cdd669640 1 --2- 172.21.15.59:0/3446018660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fb50f0 0x562e41fb1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.763+0000 7f9cdd669640 1 -- 172.21.15.59:0/3446018660 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e41fb5840 con 0x562e41fc19a0 2024-09-10T21:23:01.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.764+0000 7f9cdd669640 1 --2- 172.21.15.59:0/3446018660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fc19a0 0x562e41fc32d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000e870 tx=0x7f9cd000e2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b346a1c2fb60b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:01.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.764+0000 7f9cce7fc640 1 -- 172.21.15.59:0/3446018660 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0016070 con 0x562e41fc19a0 2024-09-10T21:23:01.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.764+0000 7f9cce7fc640 1 -- 172.21.15.59:0/3446018660 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cd00118c0 con 0x562e41fc19a0 2024-09-10T21:23:01.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.764+0000 7f9cce7fc640 1 -- 172.21.15.59:0/3446018660 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0005020 con 0x562e41fc19a0 2024-09-10T21:23:01.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.764+0000 7f9ce14a1740 1 -- 172.21.15.59:0/3446018660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fc19a0 msgr2=0x562e41fc32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:01.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.764+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/3446018660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fc19a0 0x562e41fc32d0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000e870 tx=0x7f9cd000e2f0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.764+0000 7f9ce14a1740 1 -- 172.21.15.59:0/3446018660 shutdown_connections 2024-09-10T21:23:01.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.764+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/3446018660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fc19a0 0x562e41fc32d0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.764+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/3446018660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fb5a10 0x562e41fc2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.764+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/3446018660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fb50f0 0x562e41fb1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.764+0000 7f9ce14a1740 1 -- 172.21.15.59:0/3446018660 >> 172.21.15.59:0/3446018660 conn(0x562e41fb2f20 msgr2=0x562e41fb1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:01.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.765+0000 7f9ce14a1740 1 -- 172.21.15.59:0/3446018660 shutdown_connections 2024-09-10T21:23:01.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.765+0000 7f9ce14a1740 1 -- 172.21.15.59:0/3446018660 wait complete. 2024-09-10T21:23:01.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.765+0000 7f9ce14a1740 1 -- start start 2024-09-10T21:23:01.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.765+0000 7f9ce14a1740 1 Processor -- start 2024-09-10T21:23:01.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.765+0000 7f9ce14a1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fb50f0 0x562e41fc4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:01.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.765+0000 7f9ce14a1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fb5a10 0x562e41fc4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:01.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.765+0000 7f9ce14a1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fc19a0 0x562e41fc54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:01.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.765+0000 7f9ce14a1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd81af7f0 con 0x562e41fb5a10 2024-09-10T21:23:01.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.765+0000 7f9ce14a1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd81af120 con 0x562e41fc19a0 2024-09-10T21:23:01.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.765+0000 7f9ce14a1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd81ac360 con 0x562e41fb50f0 2024-09-10T21:23:01.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.765+0000 7f9ce14a1740 10 client.0 _ll_register_callbacks cb 0x7f9cd00099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:01.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.765+0000 7f9cd7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fb5a10 0x562e41fc4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:01.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.765+0000 7f9cd7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fb5a10 0x562e41fc4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46640/0 (socket says 172.21.15.59:46640) 2024-09-10T21:23:01.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.765+0000 7f9cd7fff640 1 -- 172.21.15.59:0/3939674895 learned_addr learned my addr 172.21.15.59:0/3939674895 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:01.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.766+0000 7f9cdd669640 1 --2- 172.21.15.59:0/3939674895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fc19a0 0x562e41fc54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:01.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.766+0000 7f9cdd669640 1 --2- 172.21.15.59:0/3939674895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fb50f0 0x562e41fc4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:01.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.766+0000 7f9cd7fff640 1 -- 172.21.15.59:0/3939674895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fb50f0 msgr2=0x562e41fc4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:01.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.766+0000 7f9cd7fff640 1 --2- 172.21.15.59:0/3939674895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fb50f0 0x562e41fc4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.766+0000 7f9cd7fff640 1 -- 172.21.15.59:0/3939674895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fc19a0 msgr2=0x562e41fc54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:01.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.766+0000 7f9cd7fff640 1 --2- 172.21.15.59:0/3939674895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fc19a0 0x562e41fc54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.766+0000 7f9cd7fff640 1 -- 172.21.15.59:0/3939674895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e4203e350 con 0x562e41fb5a10 2024-09-10T21:23:01.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.766+0000 7f9cdd669640 1 --2- 172.21.15.59:0/3939674895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fc19a0 0x562e41fc54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:01.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.766+0000 7f9cd7fff640 1 --2- 172.21.15.59:0/3939674895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fb5a10 0x562e41fc4f90 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009bc0 tx=0x7f9cc0010af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281cb2c247c82f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:01.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.766+0000 7f9cb7fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:01.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.766+0000 7f9cb7fff640 1 -- 172.21.15.59:0/3939674895 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc001c6c0 con 0x562e41fb5a10 2024-09-10T21:23:01.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.766+0000 7f9cb7fff640 1 -- 172.21.15.59:0/3939674895 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9cc001c860 con 0x562e41fb5a10 2024-09-10T21:23:01.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.766+0000 7f9ce14a1740 1 -- 172.21.15.59:0/3939674895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cd00118c0 con 0x562e41fb5a10 2024-09-10T21:23:01.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.766+0000 7f9cb7fff640 1 -- 172.21.15.59:0/3939674895 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9cc001ca60 con 0x562e41fb5a10 2024-09-10T21:23:01.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.766+0000 7f9ce14a1740 10 client.17202 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:01.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.766+0000 7f9ce14a1740 1 -- 172.21.15.59:0/3939674895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562e4203f6e0 con 0x562e41fb5a10 2024-09-10T21:23:01.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.766+0000 7f9cb7fff640 1 -- 172.21.15.59:0/3939674895 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cd00118c0 con 0x562e41fb5a10 2024-09-10T21:23:01.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.767+0000 7f9cb7fff640 1 -- 172.21.15.59:0/3939674895 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9cc002a400 con 0x562e41fb5a10 2024-09-10T21:23:01.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.767+0000 7f9ce14a1740 10 client.17202 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:01.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.767+0000 7f9ce14a1740 10 client.17202 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:23:01.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.767+0000 7f9ce14a1740 20 client.17202 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:01.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.767+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/3939674895 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x562e4203fe90 0x562e420422b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:01.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.767+0000 7f9ce14a1740 4 client.17202 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:23:01.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.767+0000 7f9ce14a1740 1 -- 172.21.15.59:0/3939674895 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562e41f298a0 con 0x562e4203fe90 2024-09-10T21:23:01.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.767+0000 7f9cdd669640 1 --2- 172.21.15.59:0/3939674895 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x562e4203fe90 0x562e420422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:01.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.767+0000 7f9cdd669640 1 --2- 172.21.15.59:0/3939674895 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x562e4203fe90 0x562e420422b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bf42ecb2087a947a server_cookie=11c11f2af4c8a63 in_seq=0 out_seq=0 2024-09-10T21:23:01.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.767+0000 7f9cb7fff640 10 client.17202 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:23:01.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.767+0000 7f9cb7fff640 1 -- 172.21.15.59:0/3939674895 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562e41f298a0 con 0x562e4203fe90 2024-09-10T21:23:01.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.767+0000 7f9cb7fff640 10 client.17202 handle_command_reply: tid=0 2024-09-10T21:23:01.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.767+0000 7f9ce14a1740 1 client.17202 shutdown 2024-09-10T21:23:01.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.767+0000 7f9ce14a1740 1 -- 172.21.15.59:0/3939674895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fb5a10 msgr2=0x562e41fc4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:01.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/3939674895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fb5a10 0x562e41fc4f90 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009bc0 tx=0x7f9cc0010af0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9ce14a1740 1 -- 172.21.15.59:0/3939674895 shutdown_connections 2024-09-10T21:23:01.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/3939674895 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x562e4203fe90 0x562e420422b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/3939674895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562e41fc19a0 0x562e41fc54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/3939674895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e41fb5a10 0x562e41fc4f90 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9cb7fff640 0 client.17202 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:23:01.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9ce14a1740 1 --2- 172.21.15.59:0/3939674895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562e41fb50f0 0x562e41fc4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9ce14a1740 1 -- 172.21.15.59:0/3939674895 >> 172.21.15.59:0/3939674895 conn(0x562e41fb2f20 msgr2=0x562e41fb1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:01.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9ce14a1740 1 -- 172.21.15.59:0/3939674895 shutdown_connections 2024-09-10T21:23:01.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9ce14a1740 1 -- 172.21.15.59:0/3939674895 wait complete. 2024-09-10T21:23:01.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9ce14a1740 20 client.17202 trim_cache size 0 max 16384 2024-09-10T21:23:01.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9cdf0cc640 1 -- 172.21.15.59:0/238788233 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9cc40b52e0 msgr2=0x7f9cc40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:01.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9cdf0cc640 1 --2- 172.21.15.59:0/238788233 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9cc40b52e0 0x7f9cc40b77a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8104e40 tx=0x7f9cc80095c0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9cdf0cc640 1 -- 172.21.15.59:0/238788233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd8102dc0 msgr2=0x7f9cd81992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:01.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9cdf0cc640 1 --2- 172.21.15.59:0/238788233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd8102dc0 0x7f9cd81992a0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8006010 tx=0x7f9cc80319f0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9cdf0cc640 1 -- 172.21.15.59:0/238788233 shutdown_connections 2024-09-10T21:23:01.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9cdf0cc640 1 --2- 172.21.15.59:0/238788233 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9cc40b52e0 0x7f9cc40b77a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9cdf0cc640 1 --2- 172.21.15.59:0/238788233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cd8109150 0x7f9cd819eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9cdf0cc640 1 --2- 172.21.15.59:0/238788233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cd81087d0 0x7f9cd81997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9cdf0cc640 1 --2- 172.21.15.59:0/238788233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd8102dc0 0x7f9cd81992a0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:01.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.768+0000 7f9cdf0cc640 1 -- 172.21.15.59:0/238788233 >> 172.21.15.59:0/238788233 conn(0x7f9cd80fe830 msgr2=0x7f9cd8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:01.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.769+0000 7f9cdf0cc640 1 -- 172.21.15.59:0/238788233 shutdown_connections 2024-09-10T21:23:01.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:01.769+0000 7f9cdf0cc640 1 -- 172.21.15.59:0/238788233 wait complete. 2024-09-10T21:23:02.588 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:23:02.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:02 smithi192 ceph-mon[35363]: pgmap v573: 97 pgs: 97 active+clean; 5.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:23:02.853 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:23:02.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:02 smithi059 ceph-mon[30888]: pgmap v573: 97 pgs: 97 active+clean; 5.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:23:02.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:02 smithi154 ceph-mon[35041]: pgmap v573: 97 pgs: 97 active+clean; 5.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:23:03.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.356+0000 7f2739eb4640 1 -- 172.21.15.59:0/2992544013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734108060 msgr2=0x7f273410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:03.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.356+0000 7f2739eb4640 1 --2- 172.21.15.59:0/2992544013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734108060 0x7f273410e860 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f272c009ca0 tx=0x7f272c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.356+0000 7f2739eb4640 1 -- 172.21.15.59:0/2992544013 shutdown_connections 2024-09-10T21:23:03.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.356+0000 7f2739eb4640 1 --2- 172.21.15.59:0/2992544013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734108060 0x7f273410e860 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.356+0000 7f2739eb4640 1 --2- 172.21.15.59:0/2992544013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27341076e0 0x7f2734107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.356+0000 7f2739eb4640 1 --2- 172.21.15.59:0/2992544013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2734101cd0 0x7f27341020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.356+0000 7f2739eb4640 1 -- 172.21.15.59:0/2992544013 >> 172.21.15.59:0/2992544013 conn(0x7f27340fd720 msgr2=0x7f27340ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:03.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.356+0000 7f2739eb4640 1 -- 172.21.15.59:0/2992544013 shutdown_connections 2024-09-10T21:23:03.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.356+0000 7f2739eb4640 1 -- 172.21.15.59:0/2992544013 wait complete. 2024-09-10T21:23:03.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.357+0000 7f2739eb4640 1 Processor -- start 2024-09-10T21:23:03.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.357+0000 7f2739eb4640 1 -- start start 2024-09-10T21:23:03.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.357+0000 7f2739eb4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2734101cd0 0x7f273419a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:03.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.357+0000 7f2739eb4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27341076e0 0x7f273419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:03.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.357+0000 7f2739eb4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734108060 0x7f273419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:03.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.357+0000 7f2739eb4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2734111d30 con 0x7f2734108060 2024-09-10T21:23:03.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.357+0000 7f2739eb4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2734111bb0 con 0x7f27341076e0 2024-09-10T21:23:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.357+0000 7f2739eb4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2734111eb0 con 0x7f2734101cd0 2024-09-10T21:23:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.357+0000 7f2733fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734108060 0x7f273419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.357+0000 7f2732ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27341076e0 0x7f273419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.357+0000 7f2733fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734108060 0x7f273419ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46654/0 (socket says 172.21.15.59:46654) 2024-09-10T21:23:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.357+0000 7f2733fff640 1 -- 172.21.15.59:0/3322604306 learned_addr learned my addr 172.21.15.59:0/3322604306 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.358+0000 7f27337fe640 1 --2- 172.21.15.59:0/3322604306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2734101cd0 0x7f273419a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.358+0000 7f2733fff640 1 -- 172.21.15.59:0/3322604306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2734101cd0 msgr2=0x7f273419a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.358+0000 7f2733fff640 1 --2- 172.21.15.59:0/3322604306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2734101cd0 0x7f273419a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.358+0000 7f2733fff640 1 -- 172.21.15.59:0/3322604306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27341076e0 msgr2=0x7f273419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.358+0000 7f2733fff640 1 --2- 172.21.15.59:0/3322604306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27341076e0 0x7f273419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.358+0000 7f2733fff640 1 -- 172.21.15.59:0/3322604306 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27341a5480 con 0x7f2734108060 2024-09-10T21:23:03.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.358+0000 7f2733fff640 1 --2- 172.21.15.59:0/3322604306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734108060 0x7f273419ab40 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f272c009430 tx=0x7f272c0317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:03.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.358+0000 7f2730ff9640 1 -- 172.21.15.59:0/3322604306 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c003b70 con 0x7f2734108060 2024-09-10T21:23:03.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.358+0000 7f2739eb4640 1 -- 172.21.15.59:0/3322604306 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27341a5710 con 0x7f2734108060 2024-09-10T21:23:03.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.358+0000 7f2730ff9640 1 -- 172.21.15.59:0/3322604306 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f272c003d10 con 0x7f2734108060 2024-09-10T21:23:03.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.358+0000 7f2730ff9640 1 -- 172.21.15.59:0/3322604306 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c02fa30 con 0x7f2734108060 2024-09-10T21:23:03.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.358+0000 7f2739eb4640 1 -- 172.21.15.59:0/3322604306 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27341a5c50 con 0x7f2734108060 2024-09-10T21:23:03.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.361+0000 7f273c289740 1 Processor -- start 2024-09-10T21:23:03.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.361+0000 7f2730ff9640 1 -- 172.21.15.59:0/3322604306 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f272c02fbd0 con 0x7f2734108060 2024-09-10T21:23:03.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.361+0000 7f273c289740 1 -- start start 2024-09-10T21:23:03.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.361+0000 7f273c289740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 0x55af4d6784d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:03.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.361+0000 7f273c289740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d684460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:03.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.361+0000 7f273c289740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 0x55af4d686d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:03.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.361+0000 7f273c289740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55af4d5eeea0 con 0x55af4d678a10 2024-09-10T21:23:03.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.361+0000 7f273c289740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55af4d5de2d0 con 0x55af4d6849a0 2024-09-10T21:23:03.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.361+0000 7f273c289740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55af4d5e20e0 con 0x55af4d6780f0 2024-09-10T21:23:03.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.361+0000 7f27337fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d684460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:03.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.361+0000 7f27337fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d684460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46660/0 (socket says 172.21.15.59:46660) 2024-09-10T21:23:03.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.361+0000 7f27337fe640 1 -- 172.21.15.59:0/4142062084 learned_addr learned my addr 172.21.15.59:0/4142062084 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:03.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.362+0000 7f2732ffd640 1 --2- 172.21.15.59:0/4142062084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 0x55af4d6784d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:03.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.362+0000 7f2732ffd640 1 --2- 172.21.15.59:0/4142062084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 0x55af4d686d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:03.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.362+0000 7f27337fe640 1 -- 172.21.15.59:0/4142062084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 msgr2=0x55af4d6784d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:03.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.362+0000 7f27337fe640 1 --2- 172.21.15.59:0/4142062084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 0x55af4d6784d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.362+0000 7f27337fe640 1 -- 172.21.15.59:0/4142062084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 msgr2=0x55af4d686d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:03.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.362+0000 7f27337fe640 1 --2- 172.21.15.59:0/4142062084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 0x55af4d686d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.362+0000 7f27337fe640 1 -- 172.21.15.59:0/4142062084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af4d33c650 con 0x55af4d678a10 2024-09-10T21:23:03.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.362+0000 7f2732ffd640 1 --2- 172.21.15.59:0/4142062084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 0x55af4d686d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:03.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.362+0000 7f2730ff9640 1 --2- 172.21.15.59:0/3322604306 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f271c0b52e0 0x7f271c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:03.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.362+0000 7f27337fe640 1 --2- 172.21.15.59:0/4142062084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d684460 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f272400bd50 tx=0x7f27240107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc643d5c4063e744 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:03.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.362+0000 7f2732ffd640 1 --2- 172.21.15.59:0/3322604306 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f271c0b52e0 0x7f271c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:03.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.362+0000 7f2730ff9640 1 -- 172.21.15.59:0/3322604306 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f272c106f90 con 0x7f2734108060 2024-09-10T21:23:03.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.362+0000 7f2719ffb640 1 -- 172.21.15.59:0/4142062084 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2724005220 con 0x55af4d678a10 2024-09-10T21:23:03.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.362+0000 7f2719ffb640 1 -- 172.21.15.59:0/4142062084 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f272400be40 con 0x55af4d678a10 2024-09-10T21:23:03.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.362+0000 7f2719ffb640 1 -- 172.21.15.59:0/4142062084 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27240117c0 con 0x55af4d678a10 2024-09-10T21:23:03.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.363+0000 7f2732ffd640 1 --2- 172.21.15.59:0/3322604306 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f271c0b52e0 0x7f271c0b77a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f273406c090 tx=0x7f27280046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:03.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.363+0000 7f273c289740 1 -- 172.21.15.59:0/4142062084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 msgr2=0x55af4d684460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:03.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.363+0000 7f273c289740 1 --2- 172.21.15.59:0/4142062084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d684460 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f272400bd50 tx=0x7f27240107a0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.363+0000 7f273c289740 1 -- 172.21.15.59:0/4142062084 shutdown_connections 2024-09-10T21:23:03.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.363+0000 7f273c289740 1 --2- 172.21.15.59:0/4142062084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 0x55af4d686d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.363+0000 7f273c289740 1 --2- 172.21.15.59:0/4142062084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d684460 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.363+0000 7f273c289740 1 --2- 172.21.15.59:0/4142062084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 0x55af4d6784d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.363+0000 7f273c289740 1 -- 172.21.15.59:0/4142062084 >> 172.21.15.59:0/4142062084 conn(0x55af4d675f20 msgr2=0x55af4d6770c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:03.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.363+0000 7f273c289740 1 -- 172.21.15.59:0/4142062084 shutdown_connections 2024-09-10T21:23:03.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.363+0000 7f273c289740 1 -- 172.21.15.59:0/4142062084 wait complete. 2024-09-10T21:23:03.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.364+0000 7f273c289740 1 -- start start 2024-09-10T21:23:03.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.364+0000 7f273c289740 1 Processor -- start 2024-09-10T21:23:03.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.364+0000 7f273c289740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 0x55af4d688bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:03.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.364+0000 7f273c289740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d689160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:03.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.364+0000 7f273c289740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 0x55af4d68e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:03.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.364+0000 7f273c289740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55af4d43f700 con 0x55af4d678a10 2024-09-10T21:23:03.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.364+0000 7f273c289740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55af4d579160 con 0x55af4d6849a0 2024-09-10T21:23:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.364+0000 7f273c289740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55af4d687620 con 0x55af4d6780f0 2024-09-10T21:23:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.364+0000 7f273c289740 10 client.0 _ll_register_callbacks cb 0x55af4d5929e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.364+0000 7f2732ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d689160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.364+0000 7f27337fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 0x55af4d688bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.364+0000 7f2732ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d689160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46666/0 (socket says 172.21.15.59:46666) 2024-09-10T21:23:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.364+0000 7f2732ffd640 1 -- 172.21.15.59:0/3098745094 learned_addr learned my addr 172.21.15.59:0/3098745094 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.364+0000 7f2733fff640 1 --2- 172.21.15.59:0/3098745094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 0x55af4d68e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.365+0000 7f2732ffd640 1 -- 172.21.15.59:0/3098745094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 msgr2=0x55af4d688bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.365+0000 7f2732ffd640 1 --2- 172.21.15.59:0/3098745094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 0x55af4d688bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.365+0000 7f2732ffd640 1 -- 172.21.15.59:0/3098745094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 msgr2=0x55af4d68e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:03.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.365+0000 7f2732ffd640 1 --2- 172.21.15.59:0/3098745094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 0x55af4d68e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.365+0000 7f2732ffd640 1 -- 172.21.15.59:0/3098745094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af4d5a6c90 con 0x55af4d678a10 2024-09-10T21:23:03.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.365+0000 7f2733fff640 1 --2- 172.21.15.59:0/3098745094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 0x55af4d68e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:03.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.365+0000 7f2732ffd640 1 --2- 172.21.15.59:0/3098745094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d689160 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f2728005f60 tx=0x7f2728005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f3c12e2c5117d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:03.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.365+0000 7f2712ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:03.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.365+0000 7f2712ffd640 1 -- 172.21.15.59:0/3098745094 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272800e570 con 0x55af4d678a10 2024-09-10T21:23:03.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.365+0000 7f2712ffd640 1 -- 172.21.15.59:0/3098745094 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f272800e710 con 0x55af4d678a10 2024-09-10T21:23:03.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.365+0000 7f273c289740 1 -- 172.21.15.59:0/3098745094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55af4d5f0df0 con 0x55af4d678a10 2024-09-10T21:23:03.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.365+0000 7f2712ffd640 1 -- 172.21.15.59:0/3098745094 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f272800e910 con 0x55af4d678a10 2024-09-10T21:23:03.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.365+0000 7f273c289740 10 client.17214 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:03.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.365+0000 7f273c289740 1 -- 172.21.15.59:0/3098745094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55af4d697370 con 0x55af4d678a10 2024-09-10T21:23:03.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.365+0000 7f2712ffd640 1 -- 172.21.15.59:0/3098745094 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55af4d5f0df0 con 0x55af4d678a10 2024-09-10T21:23:03.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.366+0000 7f2712ffd640 1 -- 172.21.15.59:0/3098745094 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2728036420 con 0x55af4d678a10 2024-09-10T21:23:03.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.366+0000 7f273c289740 10 client.17214 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:03.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.366+0000 7f273c289740 10 client.17214 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:23:03.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.366+0000 7f273c289740 20 client.17214 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:03.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.366+0000 7f273c289740 1 --2- 172.21.15.59:0/3098745094 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55af4d698920 0x55af4d69ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:03.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.366+0000 7f273c289740 4 client.17214 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:23:03.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.366+0000 7f273c289740 1 -- 172.21.15.59:0/3098745094 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af4d5ec8a0 con 0x55af4d698920 2024-09-10T21:23:03.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.366+0000 7f27337fe640 1 --2- 172.21.15.59:0/3098745094 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55af4d698920 0x55af4d69ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:03.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.366+0000 7f2712ffd640 10 client.17214 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:23:03.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.366+0000 7f27337fe640 1 --2- 172.21.15.59:0/3098745094 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55af4d698920 0x55af4d69ad10 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aa24da108a4035fc server_cookie=81c887cca1773748 in_seq=0 out_seq=0 2024-09-10T21:23:03.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.367+0000 7f2712ffd640 1 -- 172.21.15.59:0/3098745094 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55af4d5ec8a0 con 0x55af4d698920 2024-09-10T21:23:03.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.367+0000 7f2712ffd640 10 client.17214 handle_command_reply: tid=0 2024-09-10T21:23:03.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.367+0000 7f273c289740 1 client.17214 shutdown 2024-09-10T21:23:03.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.367+0000 7f273c289740 1 -- 172.21.15.59:0/3098745094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 msgr2=0x55af4d689160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:03.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.367+0000 7f273c289740 1 --2- 172.21.15.59:0/3098745094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d689160 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f2728005f60 tx=0x7f2728005f90 comp rx=0 tx=0).stop 2024-09-10T21:23:03.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.367+0000 7f273c289740 1 -- 172.21.15.59:0/3098745094 shutdown_connections 2024-09-10T21:23:03.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.367+0000 7f273c289740 1 --2- 172.21.15.59:0/3098745094 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55af4d698920 0x55af4d69ad10 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.367+0000 7f273c289740 1 --2- 172.21.15.59:0/3098745094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 0x55af4d68e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.367+0000 7f273c289740 1 --2- 172.21.15.59:0/3098745094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d689160 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.367+0000 7f273c289740 1 --2- 172.21.15.59:0/3098745094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 0x55af4d688bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.367+0000 7f273c289740 1 -- 172.21.15.59:0/3098745094 >> 172.21.15.59:0/3098745094 conn(0x55af4d675f20 msgr2=0x55af4d67bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:03.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.367+0000 7f2712ffd640 0 client.17214 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:23:03.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.367+0000 7f273c289740 1 -- 172.21.15.59:0/3098745094 shutdown_connections 2024-09-10T21:23:03.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.368+0000 7f273c289740 1 -- 172.21.15.59:0/3098745094 wait complete. 2024-09-10T21:23:03.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.368+0000 7f273c289740 20 client.17214 trim_cache size 0 max 16384 2024-09-10T21:23:03.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.381+0000 7f273c289740 1 Processor -- start 2024-09-10T21:23:03.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.381+0000 7f273c289740 1 -- start start 2024-09-10T21:23:03.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.381+0000 7f273c289740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 0x55af4d680d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:03.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.381+0000 7f273c289740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d681260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:03.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.381+0000 7f273c289740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 0x55af4d687870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:03.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.381+0000 7f273c289740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f27341ac0e0 con 0x55af4d678a10 2024-09-10T21:23:03.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.381+0000 7f273c289740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f27341adc20 con 0x55af4d6849a0 2024-09-10T21:23:03.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.381+0000 7f273c289740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f27341ac7b0 con 0x55af4d6780f0 2024-09-10T21:23:03.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.381+0000 7f2732ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d681260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:03.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.381+0000 7f2732ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d681260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46674/0 (socket says 172.21.15.59:46674) 2024-09-10T21:23:03.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.381+0000 7f2732ffd640 1 -- 172.21.15.59:0/278587130 learned_addr learned my addr 172.21.15.59:0/278587130 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:03.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.381+0000 7f2732ffd640 1 -- 172.21.15.59:0/278587130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 msgr2=0x55af4d680d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:03.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.381+0000 7f27337fe640 1 --2- 172.21.15.59:0/278587130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 0x55af4d680d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:03.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.381+0000 7f2733fff640 1 --2- 172.21.15.59:0/278587130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 0x55af4d687870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:03.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.381+0000 7f2732ffd640 1 --2- 172.21.15.59:0/278587130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 0x55af4d680d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.381+0000 7f2732ffd640 1 -- 172.21.15.59:0/278587130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 msgr2=0x55af4d687870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:03.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.381+0000 7f2732ffd640 1 --2- 172.21.15.59:0/278587130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 0x55af4d687870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.381+0000 7f2732ffd640 1 -- 172.21.15.59:0/278587130 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af4d678840 con 0x55af4d678a10 2024-09-10T21:23:03.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.381+0000 7f27337fe640 1 --2- 172.21.15.59:0/278587130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 0x55af4d680d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:03.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.382+0000 7f2732ffd640 1 --2- 172.21.15.59:0/278587130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d681260 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f2728010ed0 tx=0x7f2728009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2276b522b79fbe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:03.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.382+0000 7f27197fa640 1 -- 172.21.15.59:0/278587130 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272800f6d0 con 0x55af4d678a10 2024-09-10T21:23:03.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.382+0000 7f27197fa640 1 -- 172.21.15.59:0/278587130 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f272800e570 con 0x55af4d678a10 2024-09-10T21:23:03.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.382+0000 7f27197fa640 1 -- 172.21.15.59:0/278587130 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2728005040 con 0x55af4d678a10 2024-09-10T21:23:03.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.382+0000 7f273c289740 1 -- 172.21.15.59:0/278587130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 msgr2=0x55af4d681260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:03.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.382+0000 7f273c289740 1 --2- 172.21.15.59:0/278587130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d681260 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f2728010ed0 tx=0x7f2728009cb0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.382+0000 7f273c289740 1 -- 172.21.15.59:0/278587130 shutdown_connections 2024-09-10T21:23:03.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.382+0000 7f273c289740 1 --2- 172.21.15.59:0/278587130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 0x55af4d687870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.382+0000 7f273c289740 1 --2- 172.21.15.59:0/278587130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d681260 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.382+0000 7f273c289740 1 --2- 172.21.15.59:0/278587130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 0x55af4d680d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.382+0000 7f273c289740 1 -- 172.21.15.59:0/278587130 >> 172.21.15.59:0/278587130 conn(0x55af4d675f20 msgr2=0x55af4d688bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:03.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.383+0000 7f273c289740 1 -- 172.21.15.59:0/278587130 shutdown_connections 2024-09-10T21:23:03.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.383+0000 7f273c289740 1 -- 172.21.15.59:0/278587130 wait complete. 2024-09-10T21:23:03.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.383+0000 7f273c289740 1 -- start start 2024-09-10T21:23:03.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.383+0000 7f273c289740 1 Processor -- start 2024-09-10T21:23:03.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.383+0000 7f273c289740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 0x55af4d68f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:03.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.383+0000 7f273c289740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d68f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:03.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.383+0000 7f273c289740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 0x55af4d694100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:03.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.383+0000 7f273c289740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f27341ad550 con 0x55af4d678a10 2024-09-10T21:23:03.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.383+0000 7f273c289740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f27341ace80 con 0x55af4d6849a0 2024-09-10T21:23:03.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.383+0000 7f273c289740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f27341aa0c0 con 0x55af4d6780f0 2024-09-10T21:23:03.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.383+0000 7f273c289740 10 client.0 _ll_register_callbacks cb 0x7f2728009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:03.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.384+0000 7f2732ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d68f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:03.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.384+0000 7f2732ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d68f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46684/0 (socket says 172.21.15.59:46684) 2024-09-10T21:23:03.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.384+0000 7f2732ffd640 1 -- 172.21.15.59:0/1169444640 learned_addr learned my addr 172.21.15.59:0/1169444640 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:03.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.384+0000 7f2733fff640 1 --2- 172.21.15.59:0/1169444640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 0x55af4d694100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:03.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.384+0000 7f27337fe640 1 --2- 172.21.15.59:0/1169444640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 0x55af4d68f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:03.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.384+0000 7f2732ffd640 1 -- 172.21.15.59:0/1169444640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 msgr2=0x55af4d68f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:03.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.384+0000 7f2732ffd640 1 --2- 172.21.15.59:0/1169444640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 0x55af4d68f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.384+0000 7f2732ffd640 1 -- 172.21.15.59:0/1169444640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 msgr2=0x55af4d694100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:03.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.384+0000 7f2732ffd640 1 --2- 172.21.15.59:0/1169444640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 0x55af4d694100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.384+0000 7f2732ffd640 1 -- 172.21.15.59:0/1169444640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af4d68fea0 con 0x55af4d678a10 2024-09-10T21:23:03.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.384+0000 7f2732ffd640 1 --2- 172.21.15.59:0/1169444640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d68f5f0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f272801b040 tx=0x7f27280364f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93345a18d73f38c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:03.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.384+0000 7f2712ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:03.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.384+0000 7f2712ffd640 1 -- 172.21.15.59:0/1169444640 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2728042020 con 0x55af4d678a10 2024-09-10T21:23:03.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.384+0000 7f2712ffd640 1 -- 172.21.15.59:0/1169444640 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2728036a80 con 0x55af4d678a10 2024-09-10T21:23:03.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.384+0000 7f273c289740 1 -- 172.21.15.59:0/1169444640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f272800e570 con 0x55af4d678a10 2024-09-10T21:23:03.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.385+0000 7f2712ffd640 1 -- 172.21.15.59:0/1169444640 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f272800e720 con 0x55af4d678a10 2024-09-10T21:23:03.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.385+0000 7f273c289740 10 client.17220 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:03.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.385+0000 7f273c289740 1 -- 172.21.15.59:0/1169444640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55af4d705880 con 0x55af4d678a10 2024-09-10T21:23:03.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.385+0000 7f2712ffd640 1 -- 172.21.15.59:0/1169444640 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2728036c80 con 0x55af4d678a10 2024-09-10T21:23:03.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.385+0000 7f2712ffd640 1 -- 172.21.15.59:0/1169444640 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2728005270 con 0x55af4d678a10 2024-09-10T21:23:03.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.385+0000 7f273c289740 10 client.17220 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:03.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.385+0000 7f273c289740 10 client.17220 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:23:03.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.385+0000 7f273c289740 20 client.17220 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:03.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.385+0000 7f273c289740 1 --2- 172.21.15.59:0/1169444640 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55af4d705ef0 0x55af4d708310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:03.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.385+0000 7f273c289740 4 client.17220 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:23:03.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.385+0000 7f273c289740 1 -- 172.21.15.59:0/1169444640 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f272800e570 con 0x55af4d705ef0 2024-09-10T21:23:03.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.385+0000 7f27337fe640 1 --2- 172.21.15.59:0/1169444640 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55af4d705ef0 0x55af4d708310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:03.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.386+0000 7f27337fe640 1 --2- 172.21.15.59:0/1169444640 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55af4d705ef0 0x55af4d708310 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e3c0142d1fdf69f server_cookie=44df989953b9b478 in_seq=0 out_seq=0 2024-09-10T21:23:03.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.386+0000 7f2712ffd640 10 client.17220 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:23:03.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.386+0000 7f2712ffd640 1 -- 172.21.15.59:0/1169444640 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f272800e570 con 0x55af4d705ef0 2024-09-10T21:23:03.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.386+0000 7f2712ffd640 10 client.17220 handle_command_reply: tid=0 2024-09-10T21:23:03.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.386+0000 7f273c289740 1 client.17220 shutdown 2024-09-10T21:23:03.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.386+0000 7f273c289740 1 -- 172.21.15.59:0/1169444640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 msgr2=0x55af4d68f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:03.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.386+0000 7f273c289740 1 --2- 172.21.15.59:0/1169444640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d68f5f0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f272801b040 tx=0x7f27280364f0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.386+0000 7f273c289740 1 -- 172.21.15.59:0/1169444640 shutdown_connections 2024-09-10T21:23:03.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.386+0000 7f273c289740 1 --2- 172.21.15.59:0/1169444640 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55af4d705ef0 0x55af4d708310 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.386+0000 7f273c289740 1 --2- 172.21.15.59:0/1169444640 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55af4d6849a0 0x55af4d694100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.386+0000 7f273c289740 1 --2- 172.21.15.59:0/1169444640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af4d678a10 0x55af4d68f5f0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.386+0000 7f273c289740 1 --2- 172.21.15.59:0/1169444640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55af4d6780f0 0x55af4d68f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.386+0000 7f273c289740 1 -- 172.21.15.59:0/1169444640 >> 172.21.15.59:0/1169444640 conn(0x55af4d675f20 msgr2=0x55af4d680d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:03.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.386+0000 7f2712ffd640 0 client.17220 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:23:03.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.386+0000 7f273c289740 1 -- 172.21.15.59:0/1169444640 shutdown_connections 2024-09-10T21:23:03.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.386+0000 7f273c289740 1 -- 172.21.15.59:0/1169444640 wait complete. 2024-09-10T21:23:03.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.386+0000 7f273c289740 20 client.17220 trim_cache size 0 max 16384 2024-09-10T21:23:03.396 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:23:03.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.387+0000 7f2739eb4640 1 -- 172.21.15.59:0/3322604306 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f271c0b52e0 msgr2=0x7f271c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:03.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.387+0000 7f2739eb4640 1 --2- 172.21.15.59:0/3322604306 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f271c0b52e0 0x7f271c0b77a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f273406c090 tx=0x7f27280046c0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.387+0000 7f2739eb4640 1 -- 172.21.15.59:0/3322604306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734108060 msgr2=0x7f273419ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:03.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.387+0000 7f2739eb4640 1 --2- 172.21.15.59:0/3322604306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734108060 0x7f273419ab40 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f272c009430 tx=0x7f272c0317c0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.387+0000 7f2739eb4640 1 -- 172.21.15.59:0/3322604306 shutdown_connections 2024-09-10T21:23:03.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.387+0000 7f2739eb4640 1 --2- 172.21.15.59:0/3322604306 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f271c0b52e0 0x7f271c0b77a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.387+0000 7f2739eb4640 1 --2- 172.21.15.59:0/3322604306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2734108060 0x7f273419ab40 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.387+0000 7f2739eb4640 1 --2- 172.21.15.59:0/3322604306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27341076e0 0x7f273419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.387+0000 7f2739eb4640 1 --2- 172.21.15.59:0/3322604306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2734101cd0 0x7f273419a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:03.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.387+0000 7f2739eb4640 1 -- 172.21.15.59:0/3322604306 >> 172.21.15.59:0/3322604306 conn(0x7f27340fd720 msgr2=0x7f27340ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:03.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.387+0000 7f2739eb4640 1 -- 172.21.15.59:0/3322604306 shutdown_connections 2024-09-10T21:23:03.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:03.387+0000 7f2739eb4640 1 -- 172.21.15.59:0/3322604306 wait complete. 2024-09-10T21:23:04.219 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:23:04.477 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:23:04.756 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:04 smithi059 ceph-mon[30888]: pgmap v574: 97 pgs: 97 active+clean; 5.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:23:04.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:04 smithi192 ceph-mon[35363]: pgmap v574: 97 pgs: 97 active+clean; 5.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:23:04.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:04 smithi154 ceph-mon[35041]: pgmap v574: 97 pgs: 97 active+clean; 5.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:23:04.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.973+0000 7f3878bd5640 1 -- 172.21.15.59:0/462887309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3874101440 msgr2=0x7f3874101820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:04.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.973+0000 7f3878bd5640 1 --2- 172.21.15.59:0/462887309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3874101440 0x7f3874101820 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f3864009900 tx=0x7f386402a410 comp rx=0 tx=0).stop 2024-09-10T21:23:04.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.973+0000 7f3878bd5640 1 -- 172.21.15.59:0/462887309 shutdown_connections 2024-09-10T21:23:04.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.973+0000 7f3878bd5640 1 --2- 172.21.15.59:0/462887309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38741077d0 0x7f387410dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:04.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.973+0000 7f3878bd5640 1 --2- 172.21.15.59:0/462887309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3874106e50 0x7f3874107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:04.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.973+0000 7f3878bd5640 1 --2- 172.21.15.59:0/462887309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3874101440 0x7f3874101820 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:04.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.973+0000 7f3878bd5640 1 -- 172.21.15.59:0/462887309 >> 172.21.15.59:0/462887309 conn(0x7f3874078060 msgr2=0x7f38740ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:04.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.973+0000 7f3878bd5640 1 -- 172.21.15.59:0/462887309 shutdown_connections 2024-09-10T21:23:04.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.973+0000 7f3878bd5640 1 -- 172.21.15.59:0/462887309 wait complete. 2024-09-10T21:23:04.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.974+0000 7f3878bd5640 1 Processor -- start 2024-09-10T21:23:04.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.974+0000 7f3878bd5640 1 -- start start 2024-09-10T21:23:04.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.974+0000 7f3878bd5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3874101440 0x7f3874199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:04.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.974+0000 7f3878bd5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3874106e50 0x7f3874199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:04.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.974+0000 7f3878bd5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38741077d0 0x7f387419ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:04.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.974+0000 7f3878bd5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3874112e00 con 0x7f38741077d0 2024-09-10T21:23:04.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.974+0000 7f3878bd5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3874112c80 con 0x7f3874106e50 2024-09-10T21:23:04.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.974+0000 7f3878bd5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3874112f80 con 0x7f3874101440 2024-09-10T21:23:04.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.975+0000 7f3872d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38741077d0 0x7f387419ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:04.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.975+0000 7f3872d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38741077d0 0x7f387419ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46710/0 (socket says 172.21.15.59:46710) 2024-09-10T21:23:04.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.975+0000 7f3872d9d640 1 -- 172.21.15.59:0/3175935677 learned_addr learned my addr 172.21.15.59:0/3175935677 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:04.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.975+0000 7f387259c640 1 --2- 172.21.15.59:0/3175935677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3874101440 0x7f3874199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:04.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.975+0000 7f3871d9b640 1 --2- 172.21.15.59:0/3175935677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3874106e50 0x7f3874199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:04.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.975+0000 7f3872d9d640 1 -- 172.21.15.59:0/3175935677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3874101440 msgr2=0x7f3874199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:04.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.975+0000 7f3872d9d640 1 --2- 172.21.15.59:0/3175935677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3874101440 0x7f3874199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:04.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.975+0000 7f3872d9d640 1 -- 172.21.15.59:0/3175935677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3874106e50 msgr2=0x7f3874199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:04.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.975+0000 7f3872d9d640 1 --2- 172.21.15.59:0/3175935677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3874106e50 0x7f3874199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:04.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.975+0000 7f3872d9d640 1 -- 172.21.15.59:0/3175935677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387419f3c0 con 0x7f38741077d0 2024-09-10T21:23:04.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.975+0000 7f3872d9d640 1 --2- 172.21.15.59:0/3175935677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38741077d0 0x7f387419ebf0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f386c00b970 tx=0x7f386c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:04.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.975+0000 7f38637fe640 1 -- 172.21.15.59:0/3175935677 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c019070 con 0x7f38741077d0 2024-09-10T21:23:04.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.975+0000 7f38637fe640 1 -- 172.21.15.59:0/3175935677 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f386c014440 con 0x7f38741077d0 2024-09-10T21:23:04.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.975+0000 7f3878bd5640 1 -- 172.21.15.59:0/3175935677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f387419f6b0 con 0x7f38741077d0 2024-09-10T21:23:04.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.975+0000 7f38637fe640 1 -- 172.21.15.59:0/3175935677 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c0075d0 con 0x7f38741077d0 2024-09-10T21:23:04.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.975+0000 7f3878bd5640 1 -- 172.21.15.59:0/3175935677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38741a5d70 con 0x7f38741077d0 2024-09-10T21:23:04.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.978+0000 7f387afaa740 1 Processor -- start 2024-09-10T21:23:04.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.978+0000 7f38637fe640 1 -- 172.21.15.59:0/3175935677 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f386c00cb40 con 0x7f38741077d0 2024-09-10T21:23:04.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.978+0000 7f387afaa740 1 -- start start 2024-09-10T21:23:04.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.978+0000 7f387afaa740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a87b4d0 0x55799a87b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:04.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.978+0000 7f387afaa740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87bdf0 0x55799a88bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:04.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.978+0000 7f387afaa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a88c190 0x55799a88e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:04.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.979+0000 7f387afaa740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55799a7f1ea0 con 0x55799a87bdf0 2024-09-10T21:23:04.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.979+0000 7f387afaa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55799a7e12d0 con 0x55799a88c190 2024-09-10T21:23:04.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.979+0000 7f387afaa740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55799a7e50e0 con 0x55799a87b4d0 2024-09-10T21:23:04.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.979+0000 7f387259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87bdf0 0x55799a88bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:04.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.979+0000 7f387259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87bdf0 0x55799a88bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46726/0 (socket says 172.21.15.59:46726) 2024-09-10T21:23:04.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.979+0000 7f387259c640 1 -- 172.21.15.59:0/1585978152 learned_addr learned my addr 172.21.15.59:0/1585978152 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:04.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.979+0000 7f3871d9b640 1 --2- 172.21.15.59:0/1585978152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a87b4d0 0x55799a87b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:04.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.979+0000 7f3871d9b640 1 --2- 172.21.15.59:0/1585978152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a88c190 0x55799a88e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:04.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.979+0000 7f387259c640 1 -- 172.21.15.59:0/1585978152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a87b4d0 msgr2=0x55799a87b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:04.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.979+0000 7f387259c640 1 --2- 172.21.15.59:0/1585978152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a87b4d0 0x55799a87b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:04.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.979+0000 7f387259c640 1 -- 172.21.15.59:0/1585978152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a88c190 msgr2=0x55799a88e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:04.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.979+0000 7f387259c640 1 --2- 172.21.15.59:0/1585978152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a88c190 0x55799a88e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:04.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.979+0000 7f387259c640 1 -- 172.21.15.59:0/1585978152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55799a53f650 con 0x55799a87bdf0 2024-09-10T21:23:04.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.979+0000 7f387259c640 1 --2- 172.21.15.59:0/1585978152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87bdf0 0x55799a88bc50 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f3864033000 tx=0x7f3864031de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d7d5ded6d756c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:04.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.979+0000 7f3860ff9640 1 -- 172.21.15.59:0/1585978152 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864040070 con 0x55799a87bdf0 2024-09-10T21:23:04.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.979+0000 7f38637fe640 1 --2- 172.21.15.59:0/3175935677 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f385c0b52e0 0x7f385c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:04.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.980+0000 7f3860ff9640 1 -- 172.21.15.59:0/1585978152 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38640316a0 con 0x55799a87bdf0 2024-09-10T21:23:04.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.980+0000 7f3860ff9640 1 -- 172.21.15.59:0/1585978152 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864035040 con 0x55799a87bdf0 2024-09-10T21:23:04.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.980+0000 7f3871d9b640 1 --2- 172.21.15.59:0/3175935677 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f385c0b52e0 0x7f385c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:04.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.980+0000 7f38637fe640 1 -- 172.21.15.59:0/3175935677 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f386c0e52f0 con 0x7f38741077d0 2024-09-10T21:23:04.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.980+0000 7f387afaa740 1 -- 172.21.15.59:0/1585978152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87bdf0 msgr2=0x55799a88bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:04.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.980+0000 7f3871d9b640 1 --2- 172.21.15.59:0/3175935677 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f385c0b52e0 0x7f385c0b77a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f386800afd0 tx=0x7f386800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:04.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.980+0000 7f387afaa740 1 --2- 172.21.15.59:0/1585978152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87bdf0 0x55799a88bc50 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f3864033000 tx=0x7f3864031de0 comp rx=0 tx=0).stop 2024-09-10T21:23:04.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.980+0000 7f387afaa740 1 -- 172.21.15.59:0/1585978152 shutdown_connections 2024-09-10T21:23:04.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.980+0000 7f387afaa740 1 --2- 172.21.15.59:0/1585978152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a88c190 0x55799a88e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:04.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.980+0000 7f387afaa740 1 --2- 172.21.15.59:0/1585978152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87bdf0 0x55799a88bc50 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:04.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.980+0000 7f387afaa740 1 --2- 172.21.15.59:0/1585978152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a87b4d0 0x55799a87b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:04.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.980+0000 7f387afaa740 1 -- 172.21.15.59:0/1585978152 >> 172.21.15.59:0/1585978152 conn(0x55799a879300 msgr2=0x55799a87a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:04.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.980+0000 7f387afaa740 1 -- 172.21.15.59:0/1585978152 shutdown_connections 2024-09-10T21:23:04.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.980+0000 7f387afaa740 1 -- 172.21.15.59:0/1585978152 wait complete. 2024-09-10T21:23:04.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.981+0000 7f387afaa740 1 -- start start 2024-09-10T21:23:04.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.981+0000 7f387afaa740 1 Processor -- start 2024-09-10T21:23:04.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.981+0000 7f387afaa740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 0x55799a88ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:04.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.981+0000 7f387afaa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a87bdf0 0x55799a888ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:04.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.981+0000 7f387afaa740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a88c190 0x55799a889480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:04.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.981+0000 7f387afaa740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55799a642700 con 0x55799a87b4d0 2024-09-10T21:23:04.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.981+0000 7f387afaa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55799a77c160 con 0x55799a87bdf0 2024-09-10T21:23:04.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.981+0000 7f387afaa740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55799a88ede0 con 0x55799a88c190 2024-09-10T21:23:04.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.981+0000 7f387259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 0x55799a88ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:04.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.981+0000 7f387afaa740 10 client.0 _ll_register_callbacks cb 0x55799a7959e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:04.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.981+0000 7f387259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 0x55799a88ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46740/0 (socket says 172.21.15.59:46740) 2024-09-10T21:23:04.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.981+0000 7f387259c640 1 -- 172.21.15.59:0/3727592423 learned_addr learned my addr 172.21.15.59:0/3727592423 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:04.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.982+0000 7f3871d9b640 1 --2- 172.21.15.59:0/3727592423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a87bdf0 0x55799a888ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:04.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.982+0000 7f3872d9d640 1 --2- 172.21.15.59:0/3727592423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a88c190 0x55799a889480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:04.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.982+0000 7f387259c640 1 -- 172.21.15.59:0/3727592423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a88c190 msgr2=0x55799a889480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:04.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.982+0000 7f387259c640 1 --2- 172.21.15.59:0/3727592423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a88c190 0x55799a889480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:04.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.982+0000 7f387259c640 1 -- 172.21.15.59:0/3727592423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a87bdf0 msgr2=0x55799a888ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:04.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.982+0000 7f387259c640 1 --2- 172.21.15.59:0/3727592423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a87bdf0 0x55799a888ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:04.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.982+0000 7f387259c640 1 -- 172.21.15.59:0/3727592423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55799a7a9c90 con 0x55799a87b4d0 2024-09-10T21:23:04.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.982+0000 7f387259c640 1 --2- 172.21.15.59:0/3727592423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 0x55799a88ba50 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f386402a930 tx=0x7f38640035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57505261d761567d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:04.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.982+0000 7f3859ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:04.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.982+0000 7f3859ffb640 1 -- 172.21.15.59:0/3727592423 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864035070 con 0x55799a87b4d0 2024-09-10T21:23:04.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.982+0000 7f3859ffb640 1 -- 172.21.15.59:0/3727592423 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3864005020 con 0x55799a87b4d0 2024-09-10T21:23:04.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.982+0000 7f387afaa740 1 -- 172.21.15.59:0/3727592423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38640316a0 con 0x55799a87b4d0 2024-09-10T21:23:04.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.982+0000 7f3859ffb640 1 -- 172.21.15.59:0/3727592423 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3864040040 con 0x55799a87b4d0 2024-09-10T21:23:04.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.982+0000 7f387afaa740 10 client.17232 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:04.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.982+0000 7f387afaa740 1 -- 172.21.15.59:0/3727592423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55799a89a710 con 0x55799a87b4d0 2024-09-10T21:23:04.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.982+0000 7f3859ffb640 1 -- 172.21.15.59:0/3727592423 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38640316a0 con 0x55799a87b4d0 2024-09-10T21:23:04.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.983+0000 7f3859ffb640 1 -- 172.21.15.59:0/3727592423 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f386403c650 con 0x55799a87b4d0 2024-09-10T21:23:04.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.983+0000 7f387afaa740 10 client.17232 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:04.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.983+0000 7f387afaa740 10 client.17232 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:23:04.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.983+0000 7f387afaa740 20 client.17232 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:04.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.983+0000 7f387afaa740 1 --2- 172.21.15.59:0/3727592423 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55799a89ba60 0x55799a89de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:04.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.983+0000 7f387afaa740 4 client.17232 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:23:04.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.983+0000 7f387afaa740 1 -- 172.21.15.59:0/3727592423 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55799a7f3df0 con 0x55799a89ba60 2024-09-10T21:23:04.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.983+0000 7f3871d9b640 1 --2- 172.21.15.59:0/3727592423 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55799a89ba60 0x55799a89de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:04.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.983+0000 7f3871d9b640 1 --2- 172.21.15.59:0/3727592423 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55799a89ba60 0x55799a89de50 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b264d24428c057d5 server_cookie=330065de723f056e in_seq=0 out_seq=0 2024-09-10T21:23:04.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.983+0000 7f3859ffb640 10 client.17232 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:04.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.984+0000 7f3859ffb640 1 -- 172.21.15.59:0/3727592423 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55799a7f3df0 con 0x55799a89ba60 2024-09-10T21:23:04.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.984+0000 7f3859ffb640 10 client.17232 handle_command_reply: tid=0 2024-09-10T21:23:04.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.984+0000 7f387afaa740 1 client.17232 shutdown 2024-09-10T21:23:04.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.984+0000 7f387afaa740 1 -- 172.21.15.59:0/3727592423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 msgr2=0x55799a88ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:04.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.984+0000 7f387afaa740 1 --2- 172.21.15.59:0/3727592423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 0x55799a88ba50 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f386402a930 tx=0x7f38640035f0 comp rx=0 tx=0).stop 2024-09-10T21:23:04.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.985+0000 7f387afaa740 1 -- 172.21.15.59:0/3727592423 shutdown_connections 2024-09-10T21:23:04.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.985+0000 7f387afaa740 1 --2- 172.21.15.59:0/3727592423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a88c190 0x55799a889480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:04.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.985+0000 7f387afaa740 1 --2- 172.21.15.59:0/3727592423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a87bdf0 0x55799a888ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:04.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.985+0000 7f387afaa740 1 --2- 172.21.15.59:0/3727592423 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55799a89ba60 0x55799a89de50 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:04.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.985+0000 7f387afaa740 1 --2- 172.21.15.59:0/3727592423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 0x55799a88ba50 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:04.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.985+0000 7f3859ffb640 0 client.17232 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:04.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.985+0000 7f387afaa740 1 -- 172.21.15.59:0/3727592423 >> 172.21.15.59:0/3727592423 conn(0x55799a879300 msgr2=0x55799a878420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:04.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.985+0000 7f387afaa740 1 -- 172.21.15.59:0/3727592423 shutdown_connections 2024-09-10T21:23:04.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.985+0000 7f387afaa740 1 -- 172.21.15.59:0/3727592423 wait complete. 2024-09-10T21:23:04.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.985+0000 7f387afaa740 20 client.17232 trim_cache size 0 max 16384 2024-09-10T21:23:05.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.998+0000 7f387afaa740 1 Processor -- start 2024-09-10T21:23:05.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.998+0000 7f387afaa740 1 -- start start 2024-09-10T21:23:05.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.998+0000 7f387afaa740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 0x55799a898040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:05.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.998+0000 7f387afaa740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a87bdf0 0x55799a888390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:05.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.998+0000 7f387afaa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a88c190 0x55799a887720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:05.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.998+0000 7f387afaa740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f38741ac180 con 0x55799a87b4d0 2024-09-10T21:23:05.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.998+0000 7f387afaa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38741adcc0 con 0x55799a88c190 2024-09-10T21:23:05.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.998+0000 7f387afaa740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f38741ac850 con 0x55799a87bdf0 2024-09-10T21:23:05.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.998+0000 7f387259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 0x55799a898040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:05.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.998+0000 7f387259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 0x55799a898040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46756/0 (socket says 172.21.15.59:46756) 2024-09-10T21:23:05.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.998+0000 7f387259c640 1 -- 172.21.15.59:0/1557818401 learned_addr learned my addr 172.21.15.59:0/1557818401 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:05.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.999+0000 7f387259c640 1 -- 172.21.15.59:0/1557818401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a87bdf0 msgr2=0x55799a888390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:05.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.999+0000 7f3871d9b640 1 --2- 172.21.15.59:0/1557818401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a87bdf0 0x55799a888390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:05.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.999+0000 7f387259c640 1 --2- 172.21.15.59:0/1557818401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a87bdf0 0x55799a888390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:05.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.999+0000 7f3872d9d640 1 --2- 172.21.15.59:0/1557818401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a88c190 0x55799a887720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:05.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.999+0000 7f387259c640 1 -- 172.21.15.59:0/1557818401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a88c190 msgr2=0x55799a887720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:05.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.999+0000 7f387259c640 1 --2- 172.21.15.59:0/1557818401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a88c190 0x55799a887720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:05.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.999+0000 7f387259c640 1 -- 172.21.15.59:0/1557818401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55799a87bc20 con 0x55799a87b4d0 2024-09-10T21:23:05.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.999+0000 7f3871d9b640 1 --2- 172.21.15.59:0/1557818401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a87bdf0 0x55799a888390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:05.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.999+0000 7f3872d9d640 1 --2- 172.21.15.59:0/1557818401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a88c190 0x55799a887720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:05.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.999+0000 7f387259c640 1 --2- 172.21.15.59:0/1557818401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 0x55799a898040 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f3864006010 tx=0x7f3864000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5fc526a9920106 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:05.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.999+0000 7f385bfff640 1 -- 172.21.15.59:0/1557818401 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864035070 con 0x55799a87b4d0 2024-09-10T21:23:05.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.999+0000 7f385bfff640 1 -- 172.21.15.59:0/1557818401 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f386405c070 con 0x55799a87b4d0 2024-09-10T21:23:05.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:04.999+0000 7f385bfff640 1 -- 172.21.15.59:0/1557818401 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864004ff0 con 0x55799a87b4d0 2024-09-10T21:23:05.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.000+0000 7f387afaa740 1 -- 172.21.15.59:0/1557818401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 msgr2=0x55799a898040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:05.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.000+0000 7f387afaa740 1 --2- 172.21.15.59:0/1557818401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 0x55799a898040 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f3864006010 tx=0x7f3864000bc0 comp rx=0 tx=0).stop 2024-09-10T21:23:05.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.000+0000 7f387afaa740 1 -- 172.21.15.59:0/1557818401 shutdown_connections 2024-09-10T21:23:05.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.000+0000 7f387afaa740 1 --2- 172.21.15.59:0/1557818401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a88c190 0x55799a887720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:05.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.000+0000 7f387afaa740 1 --2- 172.21.15.59:0/1557818401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a87bdf0 0x55799a888390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:05.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.000+0000 7f387afaa740 1 --2- 172.21.15.59:0/1557818401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 0x55799a898040 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:05.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.000+0000 7f387afaa740 1 -- 172.21.15.59:0/1557818401 >> 172.21.15.59:0/1557818401 conn(0x55799a879300 msgr2=0x55799a88cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:05.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.000+0000 7f387afaa740 1 -- 172.21.15.59:0/1557818401 shutdown_connections 2024-09-10T21:23:05.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.000+0000 7f387afaa740 1 -- 172.21.15.59:0/1557818401 wait complete. 2024-09-10T21:23:05.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.000+0000 7f387afaa740 1 -- start start 2024-09-10T21:23:05.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.000+0000 7f387afaa740 1 Processor -- start 2024-09-10T21:23:05.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.000+0000 7f387afaa740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 0x55799a8940a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:05.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.000+0000 7f387afaa740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a87bdf0 0x55799a8945e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:05.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f387afaa740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a88c190 0x55799a891070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:05.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f387afaa740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f38741ad5f0 con 0x55799a87b4d0 2024-09-10T21:23:05.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f387afaa740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38741acf20 con 0x55799a87bdf0 2024-09-10T21:23:05.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f387afaa740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f38741aa160 con 0x55799a88c190 2024-09-10T21:23:05.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f387259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 0x55799a8940a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:05.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f387afaa740 10 client.0 _ll_register_callbacks cb 0x7f386800ad50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:05.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f387259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 0x55799a8940a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46770/0 (socket says 172.21.15.59:46770) 2024-09-10T21:23:05.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f387259c640 1 -- 172.21.15.59:0/2738738606 learned_addr learned my addr 172.21.15.59:0/2738738606 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:05.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f3872d9d640 1 --2- 172.21.15.59:0/2738738606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a88c190 0x55799a891070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:05.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f3871d9b640 1 --2- 172.21.15.59:0/2738738606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a87bdf0 0x55799a8945e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:05.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f387259c640 1 -- 172.21.15.59:0/2738738606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a88c190 msgr2=0x55799a891070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:05.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f387259c640 1 --2- 172.21.15.59:0/2738738606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a88c190 0x55799a891070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:05.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f387259c640 1 -- 172.21.15.59:0/2738738606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a87bdf0 msgr2=0x55799a8945e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:05.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f387259c640 1 --2- 172.21.15.59:0/2738738606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a87bdf0 0x55799a8945e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:05.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f387259c640 1 -- 172.21.15.59:0/2738738606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55799a894e50 con 0x55799a87b4d0 2024-09-10T21:23:05.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f3871d9b640 1 --2- 172.21.15.59:0/2738738606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a87bdf0 0x55799a8945e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:05.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f387259c640 1 --2- 172.21.15.59:0/2738738606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 0x55799a8940a0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f38640038a0 tx=0x7f386402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20990c9d3db2a11e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:05.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f3859ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:05.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f3859ffb640 1 -- 172.21.15.59:0/2738738606 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864035070 con 0x55799a87b4d0 2024-09-10T21:23:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f3859ffb640 1 -- 172.21.15.59:0/2738738606 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3864061660 con 0x55799a87b4d0 2024-09-10T21:23:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.001+0000 7f387afaa740 1 -- 172.21.15.59:0/2738738606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f386405c070 con 0x55799a87b4d0 2024-09-10T21:23:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.002+0000 7f3859ffb640 1 -- 172.21.15.59:0/2738738606 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3864061860 con 0x55799a87b4d0 2024-09-10T21:23:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.002+0000 7f387afaa740 10 client.17238 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.002+0000 7f387afaa740 1 -- 172.21.15.59:0/2738738606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55799a908bd0 con 0x55799a87b4d0 2024-09-10T21:23:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.002+0000 7f3859ffb640 1 -- 172.21.15.59:0/2738738606 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f386405c070 con 0x55799a87b4d0 2024-09-10T21:23:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.002+0000 7f3859ffb640 1 -- 172.21.15.59:0/2738738606 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f386406a9a0 con 0x55799a87b4d0 2024-09-10T21:23:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.002+0000 7f387afaa740 10 client.17238 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.002+0000 7f387afaa740 10 client.17238 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:23:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.002+0000 7f387afaa740 20 client.17238 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.002+0000 7f387afaa740 1 --2- 172.21.15.59:0/2738738606 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55799a909190 0x55799a90b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.002+0000 7f387afaa740 4 client.17238 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:23:05.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.002+0000 7f387afaa740 1 -- 172.21.15.59:0/2738738606 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55799a7ef8a0 con 0x55799a909190 2024-09-10T21:23:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.002+0000 7f3871d9b640 1 --2- 172.21.15.59:0/2738738606 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55799a909190 0x55799a90b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.003+0000 7f3871d9b640 1 --2- 172.21.15.59:0/2738738606 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55799a909190 0x55799a90b5b0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd0239c2e636de25 server_cookie=916804ba428034c in_seq=0 out_seq=0 2024-09-10T21:23:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.003+0000 7f3859ffb640 10 client.17238 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.003+0000 7f3859ffb640 1 -- 172.21.15.59:0/2738738606 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55799a7ef8a0 con 0x55799a909190 2024-09-10T21:23:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.003+0000 7f3859ffb640 10 client.17238 handle_command_reply: tid=0 2024-09-10T21:23:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.003+0000 7f387afaa740 1 client.17238 shutdown 2024-09-10T21:23:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.003+0000 7f387afaa740 1 -- 172.21.15.59:0/2738738606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 msgr2=0x55799a8940a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.003+0000 7f387afaa740 1 --2- 172.21.15.59:0/2738738606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 0x55799a8940a0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f38640038a0 tx=0x7f386402a410 comp rx=0 tx=0).stop 2024-09-10T21:23:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.003+0000 7f387afaa740 1 -- 172.21.15.59:0/2738738606 shutdown_connections 2024-09-10T21:23:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.003+0000 7f387afaa740 1 --2- 172.21.15.59:0/2738738606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55799a88c190 0x55799a891070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.003+0000 7f387afaa740 1 --2- 172.21.15.59:0/2738738606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55799a87bdf0 0x55799a8945e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.003+0000 7f387afaa740 1 --2- 172.21.15.59:0/2738738606 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55799a909190 0x55799a90b5b0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.003+0000 7f387afaa740 1 --2- 172.21.15.59:0/2738738606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55799a87b4d0 0x55799a8940a0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:05.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.003+0000 7f387afaa740 1 -- 172.21.15.59:0/2738738606 >> 172.21.15.59:0/2738738606 conn(0x55799a879300 msgr2=0x55799a887650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:05.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.003+0000 7f3859ffb640 0 client.17238 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:05.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.004+0000 7f387afaa740 1 -- 172.21.15.59:0/2738738606 shutdown_connections 2024-09-10T21:23:05.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.004+0000 7f387afaa740 1 -- 172.21.15.59:0/2738738606 wait complete. 2024-09-10T21:23:05.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.004+0000 7f387afaa740 20 client.17238 trim_cache size 0 max 16384 2024-09-10T21:23:05.012 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:23:05.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.004+0000 7f3878bd5640 1 -- 172.21.15.59:0/3175935677 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f385c0b52e0 msgr2=0x7f385c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:05.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.004+0000 7f3878bd5640 1 --2- 172.21.15.59:0/3175935677 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f385c0b52e0 0x7f385c0b77a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f386800afd0 tx=0x7f386800a2d0 comp rx=0 tx=0).stop 2024-09-10T21:23:05.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.004+0000 7f3878bd5640 1 -- 172.21.15.59:0/3175935677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38741077d0 msgr2=0x7f387419ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:05.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.004+0000 7f3878bd5640 1 --2- 172.21.15.59:0/3175935677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38741077d0 0x7f387419ebf0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f386c00b970 tx=0x7f386c00be30 comp rx=0 tx=0).stop 2024-09-10T21:23:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.004+0000 7f3878bd5640 1 -- 172.21.15.59:0/3175935677 shutdown_connections 2024-09-10T21:23:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.004+0000 7f3878bd5640 1 --2- 172.21.15.59:0/3175935677 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f385c0b52e0 0x7f385c0b77a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.004+0000 7f3878bd5640 1 --2- 172.21.15.59:0/3175935677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38741077d0 0x7f387419ebf0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.004+0000 7f3878bd5640 1 --2- 172.21.15.59:0/3175935677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3874106e50 0x7f3874199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.004+0000 7f3878bd5640 1 --2- 172.21.15.59:0/3175935677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3874101440 0x7f3874199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.004+0000 7f3878bd5640 1 -- 172.21.15.59:0/3175935677 >> 172.21.15.59:0/3175935677 conn(0x7f3874078060 msgr2=0x7f38740ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.004+0000 7f3878bd5640 1 -- 172.21.15.59:0/3175935677 shutdown_connections 2024-09-10T21:23:05.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:05.004+0000 7f3878bd5640 1 -- 172.21.15.59:0/3175935677 wait complete. 2024-09-10T21:23:06.821 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:23:06.821 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:23:06.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:06 smithi192 ceph-mon[35363]: pgmap v575: 97 pgs: 97 active+clean; 5.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:23:06.849 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:06 smithi059 ceph-mon[30888]: pgmap v575: 97 pgs: 97 active+clean; 5.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:23:06.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:06 smithi154 ceph-mon[35041]: pgmap v575: 97 pgs: 97 active+clean; 5.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:23:07.094 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:23:07.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.553+0000 7f3cb71ff640 1 -- 172.21.15.59:0/921978736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cb0104550 msgr2=0x7f3cb010cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:07.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.553+0000 7f3cb71ff640 1 --2- 172.21.15.59:0/921978736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cb0104550 0x7f3cb010cb30 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c009900 tx=0x7f3c9c02a410 comp rx=0 tx=0).stop 2024-09-10T21:23:07.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.553+0000 7f3cb71ff640 1 -- 172.21.15.59:0/921978736 shutdown_connections 2024-09-10T21:23:07.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.553+0000 7f3cb71ff640 1 --2- 172.21.15.59:0/921978736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cb010d100 0x7f3cb010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.553+0000 7f3cb71ff640 1 --2- 172.21.15.59:0/921978736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cb0104550 0x7f3cb010cb30 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.553+0000 7f3cb71ff640 1 --2- 172.21.15.59:0/921978736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cb0103b50 0x7f3cb0103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.553+0000 7f3cb71ff640 1 -- 172.21.15.59:0/921978736 >> 172.21.15.59:0/921978736 conn(0x7f3cb00fd700 msgr2=0x7f3cb00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:07.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.553+0000 7f3cb71ff640 1 -- 172.21.15.59:0/921978736 shutdown_connections 2024-09-10T21:23:07.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.553+0000 7f3cb71ff640 1 -- 172.21.15.59:0/921978736 wait complete. 2024-09-10T21:23:07.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.554+0000 7f3cb71ff640 1 Processor -- start 2024-09-10T21:23:07.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.554+0000 7f3cb71ff640 1 -- start start 2024-09-10T21:23:07.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.554+0000 7f3cb71ff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cb0103b50 0x7f3cb01019d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:07.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.554+0000 7f3cb71ff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cb0104550 0x7f3cb0101f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:07.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.554+0000 7f3cb71ff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cb010d100 0x7f3cb0102450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:07.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.554+0000 7f3cb71ff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb0112d60 con 0x7f3cb0104550 2024-09-10T21:23:07.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.554+0000 7f3cb71ff640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb0112be0 con 0x7f3cb0103b50 2024-09-10T21:23:07.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.554+0000 7f3cb71ff640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb0112ee0 con 0x7f3cb010d100 2024-09-10T21:23:07.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.554+0000 7f3caffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cb0104550 0x7f3cb0101f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:07.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.554+0000 7f3caffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cb0104550 0x7f3cb0101f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46792/0 (socket says 172.21.15.59:46792) 2024-09-10T21:23:07.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.554+0000 7f3caffff640 1 -- 172.21.15.59:0/2253527030 learned_addr learned my addr 172.21.15.59:0/2253527030 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:07.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.554+0000 7f3cb579c640 1 --2- 172.21.15.59:0/2253527030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cb010d100 0x7f3cb0102450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:07.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.555+0000 7f3cb4f9b640 1 --2- 172.21.15.59:0/2253527030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cb0103b50 0x7f3cb01019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:07.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.555+0000 7f3caffff640 1 -- 172.21.15.59:0/2253527030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cb010d100 msgr2=0x7f3cb0102450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:07.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.555+0000 7f3caffff640 1 --2- 172.21.15.59:0/2253527030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cb010d100 0x7f3cb0102450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.555+0000 7f3caffff640 1 -- 172.21.15.59:0/2253527030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cb0103b50 msgr2=0x7f3cb01019d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:07.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.555+0000 7f3caffff640 1 --2- 172.21.15.59:0/2253527030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cb0103b50 0x7f3cb01019d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.555+0000 7f3caffff640 1 -- 172.21.15.59:0/2253527030 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb01a7690 con 0x7f3cb0104550 2024-09-10T21:23:07.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.555+0000 7f3caffff640 1 --2- 172.21.15.59:0/2253527030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cb0104550 0x7f3cb0101f10 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c005940 tx=0x7f3c9c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:07.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.555+0000 7f3cadffb640 1 -- 172.21.15.59:0/2253527030 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c03f030 con 0x7f3cb0104550 2024-09-10T21:23:07.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.555+0000 7f3cb71ff640 1 -- 172.21.15.59:0/2253527030 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb01a7920 con 0x7f3cb0104550 2024-09-10T21:23:07.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.555+0000 7f3cadffb640 1 -- 172.21.15.59:0/2253527030 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c9c003cb0 con 0x7f3cb0104550 2024-09-10T21:23:07.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.555+0000 7f3cadffb640 1 -- 172.21.15.59:0/2253527030 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c035070 con 0x7f3cb0104550 2024-09-10T21:23:07.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.555+0000 7f3cb71ff640 1 -- 172.21.15.59:0/2253527030 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb01a7e00 con 0x7f3cb0104550 2024-09-10T21:23:07.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.558+0000 7f3cadffb640 1 -- 172.21.15.59:0/2253527030 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f3c9c03bbf0 con 0x7f3cb0104550 2024-09-10T21:23:07.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.558+0000 7f3cb95d4740 1 Processor -- start 2024-09-10T21:23:07.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.558+0000 7f3cb95d4740 1 -- start start 2024-09-10T21:23:07.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.558+0000 7f3cb95d4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cafee0 0x55da86cb02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:07.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.558+0000 7f3cb95d4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 0x55da86cbc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:07.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.558+0000 7f3cb95d4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cbc790 0x55da86cbeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:07.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.558+0000 7f3cb95d4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55da86c26e60 con 0x55da86cb0800 2024-09-10T21:23:07.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.558+0000 7f3cb95d4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55da86c16290 con 0x55da86cafee0 2024-09-10T21:23:07.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.558+0000 7f3cb95d4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55da86c1a0a0 con 0x55da86cbc790 2024-09-10T21:23:07.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.559+0000 7f3cb4f9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 0x55da86cbc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:07.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.559+0000 7f3cb579c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cafee0 0x55da86cb02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:07.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.559+0000 7f3cb4f9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 0x55da86cbc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46798/0 (socket says 172.21.15.59:46798) 2024-09-10T21:23:07.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.559+0000 7f3cb579c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cafee0 0x55da86cb02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:47106/0 (socket says 172.21.15.59:47106) 2024-09-10T21:23:07.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.559+0000 7f3cb4f9b640 1 -- 172.21.15.59:0/2438397613 learned_addr learned my addr 172.21.15.59:0/2438397613 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:07.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.559+0000 7f3cadffb640 1 --2- 172.21.15.59:0/2253527030 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3ca00b52e0 0x7f3ca00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:07.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.559+0000 7f3caffff640 1 --2- 172.21.15.59:0/2438397613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cbc790 0x55da86cbeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:07.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.559+0000 7f3cb579c640 1 --2- 172.21.15.59:0/2253527030 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3ca00b52e0 0x7f3ca00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:07.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.559+0000 7f3cb4f9b640 1 -- 172.21.15.59:0/2438397613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cbc790 msgr2=0x55da86cbeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:07.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.559+0000 7f3cb4f9b640 1 --2- 172.21.15.59:0/2438397613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cbc790 0x55da86cbeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.559+0000 7f3cb4f9b640 1 -- 172.21.15.59:0/2438397613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cafee0 msgr2=0x55da86cb02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:07.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.559+0000 7f3cb4f9b640 1 --2- 172.21.15.59:0/2438397613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cafee0 0x55da86cb02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.559+0000 7f3cb4f9b640 1 -- 172.21.15.59:0/2438397613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da86974930 con 0x55da86cb0800 2024-09-10T21:23:07.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.559+0000 7f3cadffb640 1 -- 172.21.15.59:0/2253527030 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3c9c106780 con 0x7f3cb0104550 2024-09-10T21:23:07.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.559+0000 7f3cb4f9b640 1 --2- 172.21.15.59:0/2438397613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 0x55da86cbc250 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400bd20 tx=0x7f3ca400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46f56cc419cd4f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:07.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.560+0000 7f3c9affd640 1 -- 172.21.15.59:0/2438397613 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4015070 con 0x55da86cb0800 2024-09-10T21:23:07.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.560+0000 7f3cb579c640 1 --2- 172.21.15.59:0/2253527030 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3ca00b52e0 0x7f3ca00b77a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0103a90 tx=0x7f3ca8004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:07.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.560+0000 7f3c9affd640 1 -- 172.21.15.59:0/2438397613 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ca400be10 con 0x55da86cb0800 2024-09-10T21:23:07.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.560+0000 7f3c9affd640 1 -- 172.21.15.59:0/2438397613 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40106c0 con 0x55da86cb0800 2024-09-10T21:23:07.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.560+0000 7f3cb95d4740 1 -- 172.21.15.59:0/2438397613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 msgr2=0x55da86cbc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:07.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.560+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/2438397613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 0x55da86cbc250 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400bd20 tx=0x7f3ca400f730 comp rx=0 tx=0).stop 2024-09-10T21:23:07.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.560+0000 7f3cb95d4740 1 -- 172.21.15.59:0/2438397613 shutdown_connections 2024-09-10T21:23:07.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.560+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/2438397613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cbc790 0x55da86cbeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.560+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/2438397613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 0x55da86cbc250 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.560+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/2438397613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cafee0 0x55da86cb02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.560+0000 7f3cb95d4740 1 -- 172.21.15.59:0/2438397613 >> 172.21.15.59:0/2438397613 conn(0x55da86cadd10 msgr2=0x55da86caeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:07.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.561+0000 7f3cb95d4740 1 -- 172.21.15.59:0/2438397613 shutdown_connections 2024-09-10T21:23:07.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.561+0000 7f3cb95d4740 1 -- 172.21.15.59:0/2438397613 wait complete. 2024-09-10T21:23:07.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.561+0000 7f3cb95d4740 1 -- start start 2024-09-10T21:23:07.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.561+0000 7f3cb95d4740 1 Processor -- start 2024-09-10T21:23:07.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.561+0000 7f3cb95d4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cafee0 0x55da86cb9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:07.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.561+0000 7f3cb95d4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 0x55da86cb9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:07.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.561+0000 7f3cb95d4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cbc790 0x55da86cba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:07.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.561+0000 7f3cb95d4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55da86a77890 con 0x55da86cb0800 2024-09-10T21:23:07.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.561+0000 7f3cb95d4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55da86bb0d40 con 0x55da86cafee0 2024-09-10T21:23:07.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.561+0000 7f3cb95d4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55da86cbf440 con 0x55da86cbc790 2024-09-10T21:23:07.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.561+0000 7f3cb95d4740 10 client.0 _ll_register_callbacks cb 0x55da86c14c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:07.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3caffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 0x55da86cb9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:07.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3caffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 0x55da86cb9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46810/0 (socket says 172.21.15.59:46810) 2024-09-10T21:23:07.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3caffff640 1 -- 172.21.15.59:0/3171474742 learned_addr learned my addr 172.21.15.59:0/3171474742 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:07.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3cb579c640 1 --2- 172.21.15.59:0/3171474742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cbc790 0x55da86cba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:07.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3cb4f9b640 1 --2- 172.21.15.59:0/3171474742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cafee0 0x55da86cb9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:07.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3caffff640 1 -- 172.21.15.59:0/3171474742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cbc790 msgr2=0x55da86cba200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:07.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3caffff640 1 --2- 172.21.15.59:0/3171474742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cbc790 0x55da86cba200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3caffff640 1 -- 172.21.15.59:0/3171474742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cafee0 msgr2=0x55da86cb9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:07.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3caffff640 1 --2- 172.21.15.59:0/3171474742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cafee0 0x55da86cb9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3caffff640 1 -- 172.21.15.59:0/3171474742 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da86cc8840 con 0x55da86cb0800 2024-09-10T21:23:07.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3cb579c640 1 --2- 172.21.15.59:0/3171474742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cbc790 0x55da86cba200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:07.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3cb4f9b640 1 --2- 172.21.15.59:0/3171474742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cafee0 0x55da86cb9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:07.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3caffff640 1 --2- 172.21.15.59:0/3171474742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 0x55da86cb9cc0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0ccc10 tx=0x7f3c9c099140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6bb82c1664d0d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:07.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3c8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:07.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3c8ffff640 1 -- 172.21.15.59:0/3171474742 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c049020 con 0x55da86cb0800 2024-09-10T21:23:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3c8ffff640 1 -- 172.21.15.59:0/3171474742 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3c9c0cd170 con 0x55da86cb0800 2024-09-10T21:23:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3cb95d4740 1 -- 172.21.15.59:0/3171474742 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ca400be10 con 0x55da86cb0800 2024-09-10T21:23:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3c8ffff640 1 -- 172.21.15.59:0/3171474742 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3c9c0cc680 con 0x55da86cb0800 2024-09-10T21:23:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3cb95d4740 10 client.17250 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.562+0000 7f3cb95d4740 1 -- 172.21.15.59:0/3171474742 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da86ccb1f0 con 0x55da86cb0800 2024-09-10T21:23:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.563+0000 7f3c8ffff640 1 -- 172.21.15.59:0/3171474742 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ca400be10 con 0x55da86cb0800 2024-09-10T21:23:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.563+0000 7f3c8ffff640 1 -- 172.21.15.59:0/3171474742 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3c9c0a3bd0 con 0x55da86cb0800 2024-09-10T21:23:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.563+0000 7f3cb95d4740 10 client.17250 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.563+0000 7f3cb95d4740 10 client.17250 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:23:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.563+0000 7f3cb95d4740 20 client.17250 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.563+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/3171474742 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55da86ccc6f0 0x55da86cceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.563+0000 7f3cb95d4740 4 client.17250 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:23:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.563+0000 7f3cb95d4740 1 -- 172.21.15.59:0/3171474742 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da86c28db0 con 0x55da86ccc6f0 2024-09-10T21:23:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.563+0000 7f3cb4f9b640 1 --2- 172.21.15.59:0/3171474742 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55da86ccc6f0 0x55da86cceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:07.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.564+0000 7f3cb4f9b640 1 --2- 172.21.15.59:0/3171474742 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55da86ccc6f0 0x55da86cceb60 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=948964b2be4118a6 server_cookie=cf77bb0fbd586647 in_seq=0 out_seq=0 2024-09-10T21:23:07.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.564+0000 7f3c8ffff640 10 client.17250 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:07.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.564+0000 7f3c8ffff640 1 -- 172.21.15.59:0/3171474742 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da86c28db0 con 0x55da86ccc6f0 2024-09-10T21:23:07.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.565+0000 7f3c8ffff640 10 client.17250 handle_command_reply: tid=0 2024-09-10T21:23:07.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.565+0000 7f3cb95d4740 1 client.17250 shutdown 2024-09-10T21:23:07.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.565+0000 7f3cb95d4740 1 -- 172.21.15.59:0/3171474742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 msgr2=0x55da86cb9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:07.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.565+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/3171474742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 0x55da86cb9cc0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0ccc10 tx=0x7f3c9c099140 comp rx=0 tx=0).stop 2024-09-10T21:23:07.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.565+0000 7f3cb95d4740 1 -- 172.21.15.59:0/3171474742 shutdown_connections 2024-09-10T21:23:07.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.565+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/3171474742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cbc790 0x55da86cba200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.565+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/3171474742 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55da86ccc6f0 0x55da86cceb60 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.565+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/3171474742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 0x55da86cb9cc0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.565+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/3171474742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cafee0 0x55da86cb9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.565+0000 7f3cb95d4740 1 -- 172.21.15.59:0/3171474742 >> 172.21.15.59:0/3171474742 conn(0x55da86cadd10 msgr2=0x55da86cacf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:07.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.565+0000 7f3c8ffff640 0 client.17250 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:07.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.565+0000 7f3cb95d4740 1 -- 172.21.15.59:0/3171474742 shutdown_connections 2024-09-10T21:23:07.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.565+0000 7f3cb95d4740 1 -- 172.21.15.59:0/3171474742 wait complete. 2024-09-10T21:23:07.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.565+0000 7f3cb95d4740 20 client.17250 trim_cache size 0 max 16384 2024-09-10T21:23:07.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.583+0000 7f3cb95d4740 1 Processor -- start 2024-09-10T21:23:07.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.583+0000 7f3cb95d4740 1 -- start start 2024-09-10T21:23:07.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.583+0000 7f3cb95d4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cafee0 0x55da86cb6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:07.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.583+0000 7f3cb95d4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 0x55da86cb70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:07.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.583+0000 7f3cb95d4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cbc790 0x55da86cd4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:07.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.584+0000 7f3cb95d4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01b04b0 con 0x55da86cb0800 2024-09-10T21:23:07.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.584+0000 7f3cb95d4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01b1ff0 con 0x55da86cbc790 2024-09-10T21:23:07.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.584+0000 7f3cb95d4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01b0b80 con 0x55da86cafee0 2024-09-10T21:23:07.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.584+0000 7f3caffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 0x55da86cb70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:07.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.584+0000 7f3caffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 0x55da86cb70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46814/0 (socket says 172.21.15.59:46814) 2024-09-10T21:23:07.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.584+0000 7f3caffff640 1 -- 172.21.15.59:0/2337410256 learned_addr learned my addr 172.21.15.59:0/2337410256 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:07.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.584+0000 7f3cb4f9b640 1 --2- 172.21.15.59:0/2337410256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cafee0 0x55da86cb6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:07.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.584+0000 7f3cb579c640 1 --2- 172.21.15.59:0/2337410256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cbc790 0x55da86cd4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:07.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.584+0000 7f3caffff640 1 -- 172.21.15.59:0/2337410256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cafee0 msgr2=0x55da86cb6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:07.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.584+0000 7f3caffff640 1 --2- 172.21.15.59:0/2337410256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cafee0 0x55da86cb6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.584+0000 7f3caffff640 1 -- 172.21.15.59:0/2337410256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cbc790 msgr2=0x55da86cd4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:07.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.584+0000 7f3caffff640 1 --2- 172.21.15.59:0/2337410256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cbc790 0x55da86cd4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.584+0000 7f3caffff640 1 -- 172.21.15.59:0/2337410256 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da86caf0d0 con 0x55da86cb0800 2024-09-10T21:23:07.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.584+0000 7f3cb4f9b640 1 --2- 172.21.15.59:0/2337410256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cafee0 0x55da86cb6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:23:07.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.584+0000 7f3caffff640 1 --2- 172.21.15.59:0/2337410256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 0x55da86cb70e0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c031440 tx=0x7f3c9c03b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a97793df2d58bea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:07.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.585+0000 7f3c9a7fc640 1 -- 172.21.15.59:0/2337410256 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c049030 con 0x55da86cb0800 2024-09-10T21:23:07.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.585+0000 7f3c9a7fc640 1 -- 172.21.15.59:0/2337410256 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c9c0cd610 con 0x55da86cb0800 2024-09-10T21:23:07.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.585+0000 7f3c9a7fc640 1 -- 172.21.15.59:0/2337410256 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c005d50 con 0x55da86cb0800 2024-09-10T21:23:07.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.585+0000 7f3cb95d4740 1 -- 172.21.15.59:0/2337410256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 msgr2=0x55da86cb70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:07.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.585+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/2337410256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 0x55da86cb70e0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c031440 tx=0x7f3c9c03b6b0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.585+0000 7f3cb95d4740 1 -- 172.21.15.59:0/2337410256 shutdown_connections 2024-09-10T21:23:07.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.585+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/2337410256 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cbc790 0x55da86cd4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.585+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/2337410256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cb0800 0x55da86cb70e0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.585+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/2337410256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cafee0 0x55da86cb6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.586+0000 7f3cb95d4740 1 -- 172.21.15.59:0/2337410256 >> 172.21.15.59:0/2337410256 conn(0x55da86cadd10 msgr2=0x55da86cb8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:07.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.586+0000 7f3cb95d4740 1 -- 172.21.15.59:0/2337410256 shutdown_connections 2024-09-10T21:23:07.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.586+0000 7f3cb95d4740 1 -- 172.21.15.59:0/2337410256 wait complete. 2024-09-10T21:23:07.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.586+0000 7f3cb95d4740 1 -- start start 2024-09-10T21:23:07.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.586+0000 7f3cb95d4740 1 Processor -- start 2024-09-10T21:23:07.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.586+0000 7f3cb95d4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cafee0 0x55da86cc4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:07.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.586+0000 7f3cb95d4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cb0800 0x55da86cc4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:07.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.586+0000 7f3cb95d4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cbc790 0x55da86cbf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:07.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.586+0000 7f3cb95d4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01b1920 con 0x55da86cafee0 2024-09-10T21:23:07.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.586+0000 7f3cb95d4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01b1250 con 0x55da86cb0800 2024-09-10T21:23:07.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.586+0000 7f3cb95d4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb01ae490 con 0x55da86cbc790 2024-09-10T21:23:07.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.587+0000 7f3cb95d4740 10 client.0 _ll_register_callbacks cb 0x7f3c9c03bf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:07.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.587+0000 7f3cb4f9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cafee0 0x55da86cc4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:07.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.587+0000 7f3cb4f9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cafee0 0x55da86cc4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46820/0 (socket says 172.21.15.59:46820) 2024-09-10T21:23:07.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.587+0000 7f3cb4f9b640 1 -- 172.21.15.59:0/66146534 learned_addr learned my addr 172.21.15.59:0/66146534 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:07.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.587+0000 7f3caffff640 1 --2- 172.21.15.59:0/66146534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cb0800 0x55da86cc4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:07.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.587+0000 7f3cb579c640 1 --2- 172.21.15.59:0/66146534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cbc790 0x55da86cbf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:07.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.587+0000 7f3cb4f9b640 1 -- 172.21.15.59:0/66146534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cbc790 msgr2=0x55da86cbf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:07.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.587+0000 7f3cb4f9b640 1 --2- 172.21.15.59:0/66146534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cbc790 0x55da86cbf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.587+0000 7f3cb4f9b640 1 -- 172.21.15.59:0/66146534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cb0800 msgr2=0x55da86cc4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:07.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.587+0000 7f3cb4f9b640 1 --2- 172.21.15.59:0/66146534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cb0800 0x55da86cc4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.587+0000 7f3cb4f9b640 1 -- 172.21.15.59:0/66146534 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da86cbff00 con 0x55da86cafee0 2024-09-10T21:23:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.587+0000 7f3cb4f9b640 1 --2- 172.21.15.59:0/66146534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cafee0 0x55da86cc4970 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400bc10 tx=0x7f3ca4005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f23188715e8784 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.587+0000 7f3c8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.587+0000 7f3c8ffff640 1 -- 172.21.15.59:0/66146534 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4015040 con 0x55da86cafee0 2024-09-10T21:23:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.587+0000 7f3c8ffff640 1 -- 172.21.15.59:0/66146534 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3ca4004680 con 0x55da86cafee0 2024-09-10T21:23:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.587+0000 7f3cb95d4740 1 -- 172.21.15.59:0/66146534 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c9c0cd610 con 0x55da86cafee0 2024-09-10T21:23:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.588+0000 7f3c8ffff640 1 -- 172.21.15.59:0/66146534 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3ca40048c0 con 0x55da86cafee0 2024-09-10T21:23:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.588+0000 7f3cb95d4740 10 client.17256 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.588+0000 7f3cb95d4740 1 -- 172.21.15.59:0/66146534 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da86d3a1a0 con 0x55da86cafee0 2024-09-10T21:23:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.588+0000 7f3c8ffff640 1 -- 172.21.15.59:0/66146534 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c9c0cd610 con 0x55da86cafee0 2024-09-10T21:23:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.588+0000 7f3c8ffff640 1 -- 172.21.15.59:0/66146534 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3ca4011970 con 0x55da86cafee0 2024-09-10T21:23:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.588+0000 7f3cb95d4740 10 client.17256 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:07.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.588+0000 7f3cb95d4740 10 client.17256 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:23:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.588+0000 7f3cb95d4740 20 client.17256 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.588+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/66146534 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55da86d3a7e0 0x55da86d3cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.588+0000 7f3cb95d4740 4 client.17256 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:23:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.588+0000 7f3cb95d4740 1 -- 172.21.15.59:0/66146534 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55da86c24860 con 0x55da86d3a7e0 2024-09-10T21:23:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.588+0000 7f3caffff640 1 --2- 172.21.15.59:0/66146534 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55da86d3a7e0 0x55da86d3cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.589+0000 7f3caffff640 1 --2- 172.21.15.59:0/66146534 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55da86d3a7e0 0x55da86d3cc00 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e99a22b0e6525beb server_cookie=e0fd588b2d8e7219 in_seq=0 out_seq=0 2024-09-10T21:23:07.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.589+0000 7f3c8ffff640 10 client.17256 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.590+0000 7f3c8ffff640 1 -- 172.21.15.59:0/66146534 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55da86c24860 con 0x55da86d3a7e0 2024-09-10T21:23:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.590+0000 7f3c8ffff640 10 client.17256 handle_command_reply: tid=0 2024-09-10T21:23:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.590+0000 7f3cb95d4740 1 client.17256 shutdown 2024-09-10T21:23:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.591+0000 7f3cb95d4740 1 -- 172.21.15.59:0/66146534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cafee0 msgr2=0x55da86cc4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.591+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/66146534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cafee0 0x55da86cc4970 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400bc10 tx=0x7f3ca4005d20 comp rx=0 tx=0).stop 2024-09-10T21:23:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.591+0000 7f3cb95d4740 1 -- 172.21.15.59:0/66146534 shutdown_connections 2024-09-10T21:23:07.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.591+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/66146534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da86cbc790 0x55da86cbf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.591+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/66146534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da86cb0800 0x55da86cc4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.591+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/66146534 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55da86d3a7e0 0x55da86d3cc00 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.591+0000 7f3cb95d4740 1 --2- 172.21.15.59:0/66146534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da86cafee0 0x55da86cc4970 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.591+0000 7f3cb95d4740 1 -- 172.21.15.59:0/66146534 >> 172.21.15.59:0/66146534 conn(0x55da86cadd10 msgr2=0x55da86cb6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:07.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.591+0000 7f3c8ffff640 0 client.17256 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:07.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.591+0000 7f3cb95d4740 1 -- 172.21.15.59:0/66146534 shutdown_connections 2024-09-10T21:23:07.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.591+0000 7f3cb95d4740 1 -- 172.21.15.59:0/66146534 wait complete. 2024-09-10T21:23:07.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.591+0000 7f3cb95d4740 20 client.17256 trim_cache size 0 max 16384 2024-09-10T21:23:07.597 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:23:07.597 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:23:07.598 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "cb01ac69-57ce-4c62-b57a-054abf74df29", 2024-09-10T21:23:07.598 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:23:07.598 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:23:07.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.592+0000 7f3cb71ff640 1 -- 172.21.15.59:0/2253527030 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3ca00b52e0 msgr2=0x7f3ca00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:07.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.592+0000 7f3cb71ff640 1 --2- 172.21.15.59:0/2253527030 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3ca00b52e0 0x7f3ca00b77a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0103a90 tx=0x7f3ca8004ab0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.592+0000 7f3cb71ff640 1 -- 172.21.15.59:0/2253527030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cb0104550 msgr2=0x7f3cb0101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:07.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.592+0000 7f3cb71ff640 1 --2- 172.21.15.59:0/2253527030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cb0104550 0x7f3cb0101f10 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c005940 tx=0x7f3c9c0042f0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.592+0000 7f3cb71ff640 1 -- 172.21.15.59:0/2253527030 shutdown_connections 2024-09-10T21:23:07.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.592+0000 7f3cb71ff640 1 --2- 172.21.15.59:0/2253527030 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3ca00b52e0 0x7f3ca00b77a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.592+0000 7f3cb71ff640 1 --2- 172.21.15.59:0/2253527030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cb010d100 0x7f3cb0102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.592+0000 7f3cb71ff640 1 --2- 172.21.15.59:0/2253527030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cb0104550 0x7f3cb0101f10 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.592+0000 7f3cb71ff640 1 --2- 172.21.15.59:0/2253527030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cb0103b50 0x7f3cb01019d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:07.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.592+0000 7f3cb71ff640 1 -- 172.21.15.59:0/2253527030 >> 172.21.15.59:0/2253527030 conn(0x7f3cb00fd700 msgr2=0x7f3cb00fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:07.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.592+0000 7f3cb71ff640 1 -- 172.21.15.59:0/2253527030 shutdown_connections 2024-09-10T21:23:07.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:07.592+0000 7f3cb71ff640 1 -- 172.21.15.59:0/2253527030 wait complete. 2024-09-10T21:23:08.444 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:23:08.746 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:23:08.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:08 smithi192 ceph-mon[35363]: pgmap v576: 97 pgs: 97 active+clean; 5.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:23:08.867 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:08 smithi059 ceph-mon[30888]: pgmap v576: 97 pgs: 97 active+clean; 5.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:23:08.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:08 smithi154 ceph-mon[35041]: pgmap v576: 97 pgs: 97 active+clean; 5.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:23:09.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.234+0000 7fce90f4d640 1 -- 172.21.15.59:0/4033717052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c103b50 msgr2=0x7fce8c103f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:09.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.234+0000 7fce90f4d640 1 --2- 172.21.15.59:0/4033717052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c103b50 0x7fce8c103f30 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fce7c009900 tx=0x7fce7c02a410 comp rx=0 tx=0).stop 2024-09-10T21:23:09.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.235+0000 7fce90f4d640 1 -- 172.21.15.59:0/4033717052 shutdown_connections 2024-09-10T21:23:09.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.235+0000 7fce90f4d640 1 --2- 172.21.15.59:0/4033717052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce8c10d100 0x7fce8c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.235+0000 7fce90f4d640 1 --2- 172.21.15.59:0/4033717052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce8c104550 0x7fce8c10cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.235+0000 7fce90f4d640 1 --2- 172.21.15.59:0/4033717052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c103b50 0x7fce8c103f30 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.235+0000 7fce90f4d640 1 -- 172.21.15.59:0/4033717052 >> 172.21.15.59:0/4033717052 conn(0x7fce8c0fd700 msgr2=0x7fce8c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:09.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.235+0000 7fce90f4d640 1 -- 172.21.15.59:0/4033717052 shutdown_connections 2024-09-10T21:23:09.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.235+0000 7fce90f4d640 1 -- 172.21.15.59:0/4033717052 wait complete. 2024-09-10T21:23:09.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.235+0000 7fce90f4d640 1 Processor -- start 2024-09-10T21:23:09.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.235+0000 7fce90f4d640 1 -- start start 2024-09-10T21:23:09.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce90f4d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c103b50 0x7fce8c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:09.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce90f4d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce8c104550 0x7fce8c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:09.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce90f4d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce8c10d100 0x7fce8c19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:09.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce90f4d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c112db0 con 0x7fce8c103b50 2024-09-10T21:23:09.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce90f4d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c112c30 con 0x7fce8c10d100 2024-09-10T21:23:09.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce90f4d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c112f30 con 0x7fce8c104550 2024-09-10T21:23:09.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce8a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c103b50 0x7fce8c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:09.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce8a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c103b50 0x7fce8c1992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42078/0 (socket says 172.21.15.59:42078) 2024-09-10T21:23:09.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce8a59c640 1 -- 172.21.15.59:0/877034600 learned_addr learned my addr 172.21.15.59:0/877034600 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:09.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce89d9b640 1 --2- 172.21.15.59:0/877034600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce8c104550 0x7fce8c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:09.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce8a59c640 1 -- 172.21.15.59:0/877034600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce8c104550 msgr2=0x7fce8c199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:09.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce8a59c640 1 --2- 172.21.15.59:0/877034600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce8c104550 0x7fce8c199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce8a59c640 1 -- 172.21.15.59:0/877034600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce8c10d100 msgr2=0x7fce8c19ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:09.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce8ad9d640 1 --2- 172.21.15.59:0/877034600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce8c10d100 0x7fce8c19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:09.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce8a59c640 1 --2- 172.21.15.59:0/877034600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce8c10d100 0x7fce8c19ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce8a59c640 1 -- 172.21.15.59:0/877034600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8c19f390 con 0x7fce8c103b50 2024-09-10T21:23:09.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce89d9b640 1 --2- 172.21.15.59:0/877034600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce8c104550 0x7fce8c199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:09.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce8ad9d640 1 --2- 172.21.15.59:0/877034600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce8c10d100 0x7fce8c19ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:09.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce8a59c640 1 --2- 172.21.15.59:0/877034600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c103b50 0x7fce8c1992e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fce7c005ab0 tx=0x7fce7c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:09.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.236+0000 7fce7b7fe640 1 -- 172.21.15.59:0/877034600 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c03f070 con 0x7fce8c103b50 2024-09-10T21:23:09.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.237+0000 7fce7b7fe640 1 -- 172.21.15.59:0/877034600 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce7c031d60 con 0x7fce8c103b50 2024-09-10T21:23:09.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.237+0000 7fce90f4d640 1 -- 172.21.15.59:0/877034600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce8c19f620 con 0x7fce8c103b50 2024-09-10T21:23:09.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.237+0000 7fce7b7fe640 1 -- 172.21.15.59:0/877034600 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c035030 con 0x7fce8c103b50 2024-09-10T21:23:09.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.237+0000 7fce90f4d640 1 -- 172.21.15.59:0/877034600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce8c1a5d40 con 0x7fce8c103b50 2024-09-10T21:23:09.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.240+0000 7fce93322740 1 Processor -- start 2024-09-10T21:23:09.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.240+0000 7fce93322740 1 -- start start 2024-09-10T21:23:09.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.240+0000 7fce93322740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c250a0 0x5603d7c25480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:09.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.240+0000 7fce93322740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603d7c259c0 0x5603d7c35820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:09.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.240+0000 7fce93322740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c35d60 0x5603d7c38150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:09.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.240+0000 7fce93322740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5603d7b9be50 con 0x5603d7c250a0 2024-09-10T21:23:09.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.240+0000 7fce93322740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5603d7b8b280 con 0x5603d7c35d60 2024-09-10T21:23:09.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.240+0000 7fce93322740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5603d7b8f090 con 0x5603d7c259c0 2024-09-10T21:23:09.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.240+0000 7fce7b7fe640 1 -- 172.21.15.59:0/877034600 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fce7c03b560 con 0x7fce8c103b50 2024-09-10T21:23:09.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.240+0000 7fce8ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c250a0 0x5603d7c25480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:09.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.240+0000 7fce8ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c250a0 0x5603d7c25480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42084/0 (socket says 172.21.15.59:42084) 2024-09-10T21:23:09.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.240+0000 7fce8ad9d640 1 -- 172.21.15.59:0/3032816422 learned_addr learned my addr 172.21.15.59:0/3032816422 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:09.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.241+0000 7fce8ad9d640 1 -- 172.21.15.59:0/3032816422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603d7c259c0 msgr2=0x5603d7c35820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:09.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.241+0000 7fce8ad9d640 1 --2- 172.21.15.59:0/3032816422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603d7c259c0 0x5603d7c35820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.241+0000 7fce8ad9d640 1 -- 172.21.15.59:0/3032816422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c35d60 msgr2=0x5603d7c38150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:09.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.241+0000 7fce8ad9d640 1 --2- 172.21.15.59:0/3032816422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c35d60 0x5603d7c38150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.241+0000 7fce8ad9d640 1 -- 172.21.15.59:0/3032816422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603d78e9650 con 0x5603d7c250a0 2024-09-10T21:23:09.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.241+0000 7fce8ad9d640 1 --2- 172.21.15.59:0/3032816422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c250a0 0x5603d7c25480 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fce84008e00 tx=0x7fce8400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6d8072f6635e9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:09.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.241+0000 7fce78ff9640 1 -- 172.21.15.59:0/3032816422 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8400f830 con 0x5603d7c250a0 2024-09-10T21:23:09.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.241+0000 7fce78ff9640 1 -- 172.21.15.59:0/3032816422 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce84018480 con 0x5603d7c250a0 2024-09-10T21:23:09.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.241+0000 7fce78ff9640 1 -- 172.21.15.59:0/3032816422 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8400e5b0 con 0x5603d7c250a0 2024-09-10T21:23:09.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.241+0000 7fce7b7fe640 1 --2- 172.21.15.59:0/877034600 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fce740b52e0 0x7fce740b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:09.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.242+0000 7fce8a59c640 1 --2- 172.21.15.59:0/877034600 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fce740b52e0 0x7fce740b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:09.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.242+0000 7fce7b7fe640 1 -- 172.21.15.59:0/877034600 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fce7c1068a0 con 0x7fce8c103b50 2024-09-10T21:23:09.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.242+0000 7fce93322740 1 -- 172.21.15.59:0/3032816422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c250a0 msgr2=0x5603d7c25480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:09.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.242+0000 7fce93322740 1 --2- 172.21.15.59:0/3032816422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c250a0 0x5603d7c25480 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fce84008e00 tx=0x7fce8400d710 comp rx=0 tx=0).stop 2024-09-10T21:23:09.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.242+0000 7fce93322740 1 -- 172.21.15.59:0/3032816422 shutdown_connections 2024-09-10T21:23:09.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.242+0000 7fce93322740 1 --2- 172.21.15.59:0/3032816422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c35d60 0x5603d7c38150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.242+0000 7fce93322740 1 --2- 172.21.15.59:0/3032816422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603d7c259c0 0x5603d7c35820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.242+0000 7fce93322740 1 --2- 172.21.15.59:0/3032816422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c250a0 0x5603d7c25480 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.242+0000 7fce93322740 1 -- 172.21.15.59:0/3032816422 >> 172.21.15.59:0/3032816422 conn(0x5603d7c22ed0 msgr2=0x5603d7c24070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:09.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.242+0000 7fce93322740 1 -- 172.21.15.59:0/3032816422 shutdown_connections 2024-09-10T21:23:09.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.242+0000 7fce8a59c640 1 --2- 172.21.15.59:0/877034600 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fce740b52e0 0x7fce740b77a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fce7c104740 tx=0x7fce7c0992c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:09.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.242+0000 7fce93322740 1 -- 172.21.15.59:0/3032816422 wait complete. 2024-09-10T21:23:09.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.242+0000 7fce93322740 1 -- start start 2024-09-10T21:23:09.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.242+0000 7fce93322740 1 Processor -- start 2024-09-10T21:23:09.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.243+0000 7fce93322740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c250a0 0x5603d7c356f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:09.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.243+0000 7fce93322740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c259c0 0x5603d7c32b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:09.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.243+0000 7fce93322740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603d7c35d60 0x5603d7c33210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:09.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.243+0000 7fce93322740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5603d79ec700 con 0x5603d7c250a0 2024-09-10T21:23:09.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.243+0000 7fce93322740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5603d7b26110 con 0x5603d7c259c0 2024-09-10T21:23:09.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.243+0000 7fce93322740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5603d7c38a10 con 0x5603d7c35d60 2024-09-10T21:23:09.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.243+0000 7fce93322740 10 client.0 _ll_register_callbacks cb 0x5603d7b3f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:09.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.243+0000 7fce8ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c250a0 0x5603d7c356f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:09.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.243+0000 7fce8ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c250a0 0x5603d7c356f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42098/0 (socket says 172.21.15.59:42098) 2024-09-10T21:23:09.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.243+0000 7fce8ad9d640 1 -- 172.21.15.59:0/793748666 learned_addr learned my addr 172.21.15.59:0/793748666 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:09.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.243+0000 7fce89d9b640 1 --2- 172.21.15.59:0/793748666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c259c0 0x5603d7c32b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:09.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.243+0000 7fce8ad9d640 1 -- 172.21.15.59:0/793748666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603d7c35d60 msgr2=0x5603d7c33210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:09.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.243+0000 7fce8ad9d640 1 --2- 172.21.15.59:0/793748666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603d7c35d60 0x5603d7c33210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.243+0000 7fce8ad9d640 1 -- 172.21.15.59:0/793748666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c259c0 msgr2=0x5603d7c32b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:09.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.243+0000 7fce8ad9d640 1 --2- 172.21.15.59:0/793748666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c259c0 0x5603d7c32b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.243+0000 7fce8ad9d640 1 -- 172.21.15.59:0/793748666 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603d7b53c40 con 0x5603d7c250a0 2024-09-10T21:23:09.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.243+0000 7fce89d9b640 1 --2- 172.21.15.59:0/793748666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c259c0 0x5603d7c32b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:09.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.243+0000 7fce8ad9d640 1 --2- 172.21.15.59:0/793748666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c250a0 0x5603d7c356f0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fce84018e80 tx=0x7fce84008b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb2d6e68dab6a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:09.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.243+0000 7fce71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:09.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.244+0000 7fce71ffb640 1 -- 172.21.15.59:0/793748666 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84029060 con 0x5603d7c250a0 2024-09-10T21:23:09.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.244+0000 7fce71ffb640 1 -- 172.21.15.59:0/793748666 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fce8400f830 con 0x5603d7c250a0 2024-09-10T21:23:09.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.244+0000 7fce93322740 1 -- 172.21.15.59:0/793748666 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce84018480 con 0x5603d7c250a0 2024-09-10T21:23:09.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.244+0000 7fce71ffb640 1 -- 172.21.15.59:0/793748666 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fce8401e070 con 0x5603d7c250a0 2024-09-10T21:23:09.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.244+0000 7fce93322740 10 client.17268 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:09.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.244+0000 7fce93322740 1 -- 172.21.15.59:0/793748666 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5603d7c44410 con 0x5603d7c250a0 2024-09-10T21:23:09.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.244+0000 7fce71ffb640 1 -- 172.21.15.59:0/793748666 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce84018480 con 0x5603d7c250a0 2024-09-10T21:23:09.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.244+0000 7fce71ffb640 1 -- 172.21.15.59:0/793748666 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fce8402faf0 con 0x5603d7c250a0 2024-09-10T21:23:09.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.244+0000 7fce93322740 10 client.17268 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:09.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.244+0000 7fce93322740 10 client.17268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:23:09.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.244+0000 7fce93322740 20 client.17268 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:09.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.244+0000 7fce93322740 1 --2- 172.21.15.59:0/793748666 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5603d7c45760 0x5603d7c47b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:09.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.244+0000 7fce93322740 4 client.17268 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:23:09.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.244+0000 7fce93322740 1 -- 172.21.15.59:0/793748666 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603d7b9dda0 con 0x5603d7c45760 2024-09-10T21:23:09.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.245+0000 7fce89d9b640 1 --2- 172.21.15.59:0/793748666 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5603d7c45760 0x5603d7c47b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:09.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.245+0000 7fce89d9b640 1 --2- 172.21.15.59:0/793748666 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5603d7c45760 0x5603d7c47b50 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2163fae7d080b84 server_cookie=978d84ebb9ef9738 in_seq=0 out_seq=0 2024-09-10T21:23:09.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.245+0000 7fce71ffb640 10 client.17268 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:09.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.246+0000 7fce71ffb640 1 -- 172.21.15.59:0/793748666 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5603d7b9dda0 con 0x5603d7c45760 2024-09-10T21:23:09.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.246+0000 7fce71ffb640 10 client.17268 handle_command_reply: tid=0 2024-09-10T21:23:09.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.246+0000 7fce93322740 1 client.17268 shutdown 2024-09-10T21:23:09.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.246+0000 7fce93322740 1 -- 172.21.15.59:0/793748666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c250a0 msgr2=0x5603d7c356f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:09.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.246+0000 7fce93322740 1 --2- 172.21.15.59:0/793748666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c250a0 0x5603d7c356f0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fce84018e80 tx=0x7fce84008b10 comp rx=0 tx=0).stop 2024-09-10T21:23:09.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.246+0000 7fce93322740 1 -- 172.21.15.59:0/793748666 shutdown_connections 2024-09-10T21:23:09.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.246+0000 7fce93322740 1 --2- 172.21.15.59:0/793748666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603d7c35d60 0x5603d7c33210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.246+0000 7fce93322740 1 --2- 172.21.15.59:0/793748666 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c259c0 0x5603d7c32b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.246+0000 7fce93322740 1 --2- 172.21.15.59:0/793748666 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5603d7c45760 0x5603d7c47b50 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.246+0000 7fce93322740 1 --2- 172.21.15.59:0/793748666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c250a0 0x5603d7c356f0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.246+0000 7fce71ffb640 0 client.17268 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:09.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.246+0000 7fce93322740 1 -- 172.21.15.59:0/793748666 >> 172.21.15.59:0/793748666 conn(0x5603d7c22ed0 msgr2=0x5603d7c28a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:09.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.246+0000 7fce93322740 1 -- 172.21.15.59:0/793748666 shutdown_connections 2024-09-10T21:23:09.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.246+0000 7fce93322740 1 -- 172.21.15.59:0/793748666 wait complete. 2024-09-10T21:23:09.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.246+0000 7fce93322740 20 client.17268 trim_cache size 0 max 16384 2024-09-10T21:23:09.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.264+0000 7fce93322740 1 Processor -- start 2024-09-10T21:23:09.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.264+0000 7fce93322740 1 -- start start 2024-09-10T21:23:09.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.264+0000 7fce93322740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c250a0 0x5603d7c41c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:09.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.264+0000 7fce93322740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603d7c259c0 0x5603d7c32050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:09.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.264+0000 7fce93322740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c35d60 0x5603d7c36c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:09.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.264+0000 7fce93322740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c1ac0d0 con 0x5603d7c35d60 2024-09-10T21:23:09.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.264+0000 7fce93322740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c1adc10 con 0x5603d7c250a0 2024-09-10T21:23:09.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.264+0000 7fce93322740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c1ac7a0 con 0x5603d7c259c0 2024-09-10T21:23:09.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.264+0000 7fce8ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c35d60 0x5603d7c36c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:09.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.265+0000 7fce8ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c35d60 0x5603d7c36c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42104/0 (socket says 172.21.15.59:42104) 2024-09-10T21:23:09.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.265+0000 7fce8ad9d640 1 -- 172.21.15.59:0/1630374951 learned_addr learned my addr 172.21.15.59:0/1630374951 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:09.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.265+0000 7fce8ad9d640 1 --2- 172.21.15.59:0/1630374951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c250a0 0x5603d7c41c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:09.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.265+0000 7fce89d9b640 1 --2- 172.21.15.59:0/1630374951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603d7c259c0 0x5603d7c32050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:09.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.265+0000 7fce8ad9d640 1 -- 172.21.15.59:0/1630374951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603d7c259c0 msgr2=0x5603d7c32050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.265+0000 7fce8ad9d640 1 --2- 172.21.15.59:0/1630374951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603d7c259c0 0x5603d7c32050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.265+0000 7fce8ad9d640 1 -- 172.21.15.59:0/1630374951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c250a0 msgr2=0x5603d7c41c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.265+0000 7fce8ad9d640 1 --2- 172.21.15.59:0/1630374951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c250a0 0x5603d7c41c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.265+0000 7fce8ad9d640 1 -- 172.21.15.59:0/1630374951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603d7c328f0 con 0x5603d7c35d60 2024-09-10T21:23:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.265+0000 7fce8ad9d640 1 --2- 172.21.15.59:0/1630374951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c35d60 0x5603d7c36c90 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fce8400df50 tx=0x7fce8400dee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a0463d58482d5a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.265+0000 7fce73fff640 1 -- 172.21.15.59:0/1630374951 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84029070 con 0x5603d7c35d60 2024-09-10T21:23:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.265+0000 7fce73fff640 1 -- 172.21.15.59:0/1630374951 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce84023e40 con 0x5603d7c35d60 2024-09-10T21:23:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.265+0000 7fce73fff640 1 -- 172.21.15.59:0/1630374951 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84034040 con 0x5603d7c35d60 2024-09-10T21:23:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.266+0000 7fce93322740 1 -- 172.21.15.59:0/1630374951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c35d60 msgr2=0x5603d7c36c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.266+0000 7fce93322740 1 --2- 172.21.15.59:0/1630374951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c35d60 0x5603d7c36c90 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fce8400df50 tx=0x7fce8400dee0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.266+0000 7fce93322740 1 -- 172.21.15.59:0/1630374951 shutdown_connections 2024-09-10T21:23:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.266+0000 7fce93322740 1 --2- 172.21.15.59:0/1630374951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c35d60 0x5603d7c36c90 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.266+0000 7fce93322740 1 --2- 172.21.15.59:0/1630374951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603d7c259c0 0x5603d7c32050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.266+0000 7fce93322740 1 --2- 172.21.15.59:0/1630374951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c250a0 0x5603d7c41c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.266+0000 7fce93322740 1 -- 172.21.15.59:0/1630374951 >> 172.21.15.59:0/1630374951 conn(0x5603d7c22ed0 msgr2=0x5603d7c37be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:09.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.266+0000 7fce93322740 1 -- 172.21.15.59:0/1630374951 shutdown_connections 2024-09-10T21:23:09.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.266+0000 7fce93322740 1 -- 172.21.15.59:0/1630374951 wait complete. 2024-09-10T21:23:09.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.266+0000 7fce93322740 1 -- start start 2024-09-10T21:23:09.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.266+0000 7fce93322740 1 Processor -- start 2024-09-10T21:23:09.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.267+0000 7fce93322740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c250a0 0x5603d7c3deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:09.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.267+0000 7fce93322740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c259c0 0x5603d7c3e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:09.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.267+0000 7fce93322740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603d7c35d60 0x5603d7c3aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:09.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.267+0000 7fce93322740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c1ad540 con 0x5603d7c259c0 2024-09-10T21:23:09.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.267+0000 7fce93322740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c1ace70 con 0x5603d7c250a0 2024-09-10T21:23:09.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.267+0000 7fce93322740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c1aa0d0 con 0x5603d7c35d60 2024-09-10T21:23:09.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.267+0000 7fce93322740 10 client.0 _ll_register_callbacks cb 0x7fce84008c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:09.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.267+0000 7fce89d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c259c0 0x5603d7c3e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:09.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.267+0000 7fce89d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c259c0 0x5603d7c3e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42118/0 (socket says 172.21.15.59:42118) 2024-09-10T21:23:09.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.267+0000 7fce89d9b640 1 -- 172.21.15.59:0/3945803563 learned_addr learned my addr 172.21.15.59:0/3945803563 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:09.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.267+0000 7fce8ad9d640 1 --2- 172.21.15.59:0/3945803563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c250a0 0x5603d7c3deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:09.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.267+0000 7fce8ad9d640 1 --2- 172.21.15.59:0/3945803563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603d7c35d60 0x5603d7c3aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:09.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.267+0000 7fce89d9b640 1 -- 172.21.15.59:0/3945803563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603d7c35d60 msgr2=0x5603d7c3aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:09.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.267+0000 7fce89d9b640 1 --2- 172.21.15.59:0/3945803563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603d7c35d60 0x5603d7c3aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.267+0000 7fce89d9b640 1 -- 172.21.15.59:0/3945803563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c250a0 msgr2=0x5603d7c3deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:09.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.267+0000 7fce89d9b640 1 --2- 172.21.15.59:0/3945803563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c250a0 0x5603d7c3deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.267+0000 7fce89d9b640 1 -- 172.21.15.59:0/3945803563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603d7c3b310 con 0x5603d7c259c0 2024-09-10T21:23:09.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.267+0000 7fce89d9b640 1 --2- 172.21.15.59:0/3945803563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c259c0 0x5603d7c3e3f0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fce80005fd0 tx=0x7fce80012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a4415838ec9cf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:09.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.267+0000 7fce71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:09.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.268+0000 7fce71ffb640 1 -- 172.21.15.59:0/3945803563 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce80011850 con 0x5603d7c259c0 2024-09-10T21:23:09.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.268+0000 7fce93322740 1 -- 172.21.15.59:0/3945803563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce84023e40 con 0x5603d7c259c0 2024-09-10T21:23:09.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.268+0000 7fce71ffb640 1 -- 172.21.15.59:0/3945803563 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fce800119f0 con 0x5603d7c259c0 2024-09-10T21:23:09.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.268+0000 7fce71ffb640 1 -- 172.21.15.59:0/3945803563 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fce80011bf0 con 0x5603d7c259c0 2024-09-10T21:23:09.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.268+0000 7fce93322740 10 client.17274 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:09.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.268+0000 7fce93322740 1 -- 172.21.15.59:0/3945803563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5603d7cb2d30 con 0x5603d7c259c0 2024-09-10T21:23:09.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.268+0000 7fce71ffb640 1 -- 172.21.15.59:0/3945803563 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce84023e40 con 0x5603d7c259c0 2024-09-10T21:23:09.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.268+0000 7fce71ffb640 1 -- 172.21.15.59:0/3945803563 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fce80021070 con 0x5603d7c259c0 2024-09-10T21:23:09.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.268+0000 7fce93322740 10 client.17274 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:09.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.268+0000 7fce93322740 10 client.17274 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:23:09.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.268+0000 7fce93322740 20 client.17274 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:09.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.268+0000 7fce93322740 1 --2- 172.21.15.59:0/3945803563 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5603d7cb34d0 0x5603d7cb58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:09.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.268+0000 7fce93322740 4 client.17274 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:23:09.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.268+0000 7fce93322740 1 -- 172.21.15.59:0/3945803563 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5603d7b99850 con 0x5603d7cb34d0 2024-09-10T21:23:09.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.269+0000 7fce8ad9d640 1 --2- 172.21.15.59:0/3945803563 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5603d7cb34d0 0x5603d7cb58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:09.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.269+0000 7fce8ad9d640 1 --2- 172.21.15.59:0/3945803563 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5603d7cb34d0 0x5603d7cb58f0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c88b1372a32a94cb server_cookie=d5feb5ac329b355c in_seq=0 out_seq=0 2024-09-10T21:23:09.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.269+0000 7fce71ffb640 10 client.17274 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:09.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.269+0000 7fce71ffb640 1 -- 172.21.15.59:0/3945803563 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4262 (crc 0 0 0) 0x5603d7b99850 con 0x5603d7cb34d0 2024-09-10T21:23:09.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.269+0000 7fce71ffb640 10 client.17274 handle_command_reply: tid=0 2024-09-10T21:23:09.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.269+0000 7fce93322740 1 client.17274 shutdown 2024-09-10T21:23:09.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.269+0000 7fce93322740 1 -- 172.21.15.59:0/3945803563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c259c0 msgr2=0x5603d7c3e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:09.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.269+0000 7fce93322740 1 --2- 172.21.15.59:0/3945803563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c259c0 0x5603d7c3e3f0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fce80005fd0 tx=0x7fce80012820 comp rx=0 tx=0).stop 2024-09-10T21:23:09.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.269+0000 7fce93322740 1 -- 172.21.15.59:0/3945803563 shutdown_connections 2024-09-10T21:23:09.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.269+0000 7fce93322740 1 --2- 172.21.15.59:0/3945803563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603d7c35d60 0x5603d7c3aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.269+0000 7fce93322740 1 --2- 172.21.15.59:0/3945803563 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5603d7cb34d0 0x5603d7cb58f0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.269+0000 7fce93322740 1 --2- 172.21.15.59:0/3945803563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5603d7c259c0 0x5603d7c3e3f0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.269+0000 7fce93322740 1 --2- 172.21.15.59:0/3945803563 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5603d7c250a0 0x5603d7c3deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.269+0000 7fce93322740 1 -- 172.21.15.59:0/3945803563 >> 172.21.15.59:0/3945803563 conn(0x5603d7c22ed0 msgr2=0x5603d7c37be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:09.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.270+0000 7fce71ffb640 0 client.17274 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:09.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.270+0000 7fce93322740 1 -- 172.21.15.59:0/3945803563 shutdown_connections 2024-09-10T21:23:09.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.270+0000 7fce93322740 1 -- 172.21.15.59:0/3945803563 wait complete. 2024-09-10T21:23:09.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.270+0000 7fce93322740 20 client.17274 trim_cache size 0 max 16384 2024-09-10T21:23:09.281 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:23:09.281 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:23:09.281 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-09-10T21:23:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: "cb01ac69-57ce-4c62-b57a-054abf74df29": { 2024-09-10T21:23:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "cb01ac69-57ce-4c62-b57a-054abf74df29", 2024-09-10T21:23:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2024-09-10T21:23:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:23:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:23:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: "cb01ac69-57ce-4c62-b57a-054abf74df29": { 2024-09-10T21:23:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:07.589420+0000", 2024-09-10T21:23:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:09.282 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:23:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:23:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:23:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:23:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:09.283 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:23:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:07.066301+0000", 2024-09-10T21:23:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:09.284 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:23:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:23:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "7de1e6cf-02c2-41f2-b957-563f88bae8ef": { 2024-09-10T21:23:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:22:22.098651+0000", 2024-09-10T21:23:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:09.285 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:23:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:23:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:09.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:23:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:23:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:23:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:23:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:09.287 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:23:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:23:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:09.288 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:23:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:23:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:23:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:23:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:09.289 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: "800cdb00-6a99-4c42-8a9e-4b1c599c6af0": { 2024-09-10T21:23:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:52.224081+0000", 2024-09-10T21:23:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: "d82f24b1-930e-4f83-a379-3084f22918d0": { 2024-09-10T21:23:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:21:37.203865+0000", 2024-09-10T21:23:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:09.290 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:09.291 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:09.291 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:09.291 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:09.291 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:23:09.291 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:23:09.291 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:23:09.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.270+0000 7fce90f4d640 1 -- 172.21.15.59:0/877034600 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fce740b52e0 msgr2=0x7fce740b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:09.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.270+0000 7fce90f4d640 1 --2- 172.21.15.59:0/877034600 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fce740b52e0 0x7fce740b77a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fce7c104740 tx=0x7fce7c0992c0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.270+0000 7fce90f4d640 1 -- 172.21.15.59:0/877034600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c103b50 msgr2=0x7fce8c1992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:09.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.270+0000 7fce90f4d640 1 --2- 172.21.15.59:0/877034600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c103b50 0x7fce8c1992e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fce7c005ab0 tx=0x7fce7c003cd0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.270+0000 7fce90f4d640 1 -- 172.21.15.59:0/877034600 shutdown_connections 2024-09-10T21:23:09.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.270+0000 7fce90f4d640 1 --2- 172.21.15.59:0/877034600 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fce740b52e0 0x7fce740b77a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.270+0000 7fce90f4d640 1 --2- 172.21.15.59:0/877034600 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce8c10d100 0x7fce8c19ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.270+0000 7fce90f4d640 1 --2- 172.21.15.59:0/877034600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce8c104550 0x7fce8c199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.270+0000 7fce90f4d640 1 --2- 172.21.15.59:0/877034600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8c103b50 0x7fce8c1992e0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:09.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.270+0000 7fce90f4d640 1 -- 172.21.15.59:0/877034600 >> 172.21.15.59:0/877034600 conn(0x7fce8c0fd700 msgr2=0x7fce8c0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:09.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.270+0000 7fce90f4d640 1 -- 172.21.15.59:0/877034600 shutdown_connections 2024-09-10T21:23:09.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:09.270+0000 7fce90f4d640 1 -- 172.21.15.59:0/877034600 wait complete. 2024-09-10T21:23:09.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:09 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:23:09.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:09 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:23:09.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:09 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:23:09.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:09 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:23:09.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:09 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:23:09.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:09 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:23:09.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:09 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:23:09.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:09 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:23:09.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:09 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:23:09.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:09 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:23:09.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:09 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:23:09.932 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:09 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:23:09.985 INFO:tasks.cephfs.filesystem:scrub status for tag:cb01ac69-57ce-4c62-b57a-054abf74df29 - {'path': '/', 'tag': 'cb01ac69-57ce-4c62-b57a-054abf74df29', 'options': 'recursive,force'} 2024-09-10T21:23:10.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:10 smithi192 ceph-mon[35363]: pgmap v577: 97 pgs: 97 active+clean; 5.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:23:10.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:10 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:23:10.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:10 smithi059 ceph-mon[30888]: pgmap v577: 97 pgs: 97 active+clean; 5.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:23:10.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:10 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:23:10.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:10 smithi154 ceph-mon[35041]: pgmap v577: 97 pgs: 97 active+clean; 5.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:23:10.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:10 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:23:12.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:12 smithi192 ceph-mon[35363]: pgmap v578: 97 pgs: 97 active+clean; 5.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-10T21:23:12.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:12 smithi059 ceph-mon[30888]: pgmap v578: 97 pgs: 97 active+clean; 5.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-10T21:23:12.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:12 smithi154 ceph-mon[35041]: pgmap v578: 97 pgs: 97 active+clean; 5.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-10T21:23:14.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:14 smithi192 ceph-mon[35363]: pgmap v579: 97 pgs: 97 active+clean; 5.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:23:14.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:14 smithi059 ceph-mon[30888]: pgmap v579: 97 pgs: 97 active+clean; 5.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:23:14.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:14 smithi154 ceph-mon[35041]: pgmap v579: 97 pgs: 97 active+clean; 5.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:23:16.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:16 smithi192 ceph-mon[35363]: pgmap v580: 97 pgs: 97 active+clean; 5.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-10T21:23:16.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:16 smithi059 ceph-mon[30888]: pgmap v580: 97 pgs: 97 active+clean; 5.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-10T21:23:16.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:16 smithi154 ceph-mon[35041]: pgmap v580: 97 pgs: 97 active+clean; 5.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-10T21:23:18.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:18 smithi192 ceph-mon[35363]: pgmap v581: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:23:18.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:18 smithi059 ceph-mon[30888]: pgmap v581: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:23:18.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:18 smithi154 ceph-mon[35041]: pgmap v581: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:23:20.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:20 smithi192 ceph-mon[35363]: pgmap v582: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:23:20.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:20 smithi059 ceph-mon[30888]: pgmap v582: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:23:20.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:20 smithi154 ceph-mon[35041]: pgmap v582: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:23:22.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:22 smithi192 ceph-mon[35363]: pgmap v583: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:23:22.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:22 smithi059 ceph-mon[30888]: pgmap v583: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:23:22.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:22 smithi154 ceph-mon[35041]: pgmap v583: 97 pgs: 97 active+clean; 5.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:23:25.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:25 smithi192 ceph-mon[35363]: pgmap v584: 97 pgs: 97 active+clean; 5.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:23:25.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:25 smithi059 ceph-mon[30888]: pgmap v584: 97 pgs: 97 active+clean; 5.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:23:25.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:25 smithi154 ceph-mon[35041]: pgmap v584: 97 pgs: 97 active+clean; 5.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:23:27.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:27 smithi192 ceph-mon[35363]: pgmap v585: 97 pgs: 97 active+clean; 5.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:23:27.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:27 smithi059 ceph-mon[30888]: pgmap v585: 97 pgs: 97 active+clean; 5.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:23:27.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:27 smithi154 ceph-mon[35041]: pgmap v585: 97 pgs: 97 active+clean; 5.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:23:29.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:29 smithi192 ceph-mon[35363]: pgmap v586: 97 pgs: 97 active+clean; 5.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:23:29.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:29 smithi059 ceph-mon[30888]: pgmap v586: 97 pgs: 97 active+clean; 5.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:23:29.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:29 smithi154 ceph-mon[35041]: pgmap v586: 97 pgs: 97 active+clean; 5.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:23:31.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:31 smithi192 ceph-mon[35363]: pgmap v587: 97 pgs: 97 active+clean; 5.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:23:31.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:31 smithi059 ceph-mon[30888]: pgmap v587: 97 pgs: 97 active+clean; 5.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:23:31.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:31 smithi154 ceph-mon[35041]: pgmap v587: 97 pgs: 97 active+clean; 5.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:23:32.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:32 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:23:32.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:32 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:23:32.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:32 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:23:32.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:32 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:23:32.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:32 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:23:32.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:32 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:23:32.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:32 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:23:32.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:32 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:23:32.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:32 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:23:32.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:32 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:23:32.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:32 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:23:32.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:32 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:23:33.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:33 smithi192 ceph-mon[35363]: pgmap v588: 97 pgs: 97 active+clean; 5.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:23:33.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:33 smithi059 ceph-mon[30888]: pgmap v588: 97 pgs: 97 active+clean; 5.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:23:33.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:33 smithi154 ceph-mon[35041]: pgmap v588: 97 pgs: 97 active+clean; 5.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:23:34.832 INFO:tasks.workunit.client.0.smithi059.stdout:375/600: open fd = 3 2024-09-10T21:23:34.832 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.832 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.832 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.832 INFO:tasks.workunit.client.0.smithi059.stdout:376/600: open fd = 3 2024-09-10T21:23:34.832 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.832 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.832 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.832 INFO:tasks.workunit.client.0.smithi059.stdout:377/600: open fd = 3 2024-09-10T21:23:34.832 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.832 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.833 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.833 INFO:tasks.workunit.client.0.smithi059.stdout:378/600: open fd = 3 2024-09-10T21:23:34.833 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.833 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.833 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.833 INFO:tasks.workunit.client.0.smithi059.stdout:379/600: open fd = 3 2024-09-10T21:23:34.833 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.833 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.833 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.833 INFO:tasks.workunit.client.0.smithi059.stdout:380/600: open fd = 3 2024-09-10T21:23:34.833 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.833 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.833 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.833 INFO:tasks.workunit.client.0.smithi059.stdout:381/600: open fd = 3 2024-09-10T21:23:34.834 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.834 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.834 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.834 INFO:tasks.workunit.client.0.smithi059.stdout:382/600: open fd = 3 2024-09-10T21:23:34.834 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.834 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.834 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.834 INFO:tasks.workunit.client.0.smithi059.stdout:383/600: open fd = 3 2024-09-10T21:23:34.834 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.834 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.834 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.834 INFO:tasks.workunit.client.0.smithi059.stdout:384/600: open fd = 3 2024-09-10T21:23:34.834 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.834 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.835 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.835 INFO:tasks.workunit.client.0.smithi059.stdout:385/600: open fd = 3 2024-09-10T21:23:34.835 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.835 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.835 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.835 INFO:tasks.workunit.client.0.smithi059.stdout:386/600: open fd = 3 2024-09-10T21:23:34.835 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.835 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.835 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.835 INFO:tasks.workunit.client.0.smithi059.stdout:387/600: open fd = 3 2024-09-10T21:23:34.835 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.835 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.835 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.835 INFO:tasks.workunit.client.0.smithi059.stdout:388/600: open fd = 3 2024-09-10T21:23:34.836 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.836 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.836 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.836 INFO:tasks.workunit.client.0.smithi059.stdout:389/600: open fd = 3 2024-09-10T21:23:34.836 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.836 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.836 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.836 INFO:tasks.workunit.client.0.smithi059.stdout:390/600: open fd = 3 2024-09-10T21:23:34.836 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.836 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.836 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.836 INFO:tasks.workunit.client.0.smithi059.stdout:391/600: open fd = 3 2024-09-10T21:23:34.836 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.836 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.836 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.837 INFO:tasks.workunit.client.0.smithi059.stdout:392/600: open fd = 3 2024-09-10T21:23:34.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.837 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.837 INFO:tasks.workunit.client.0.smithi059.stdout:393/600: open fd = 3 2024-09-10T21:23:34.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.837 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.837 INFO:tasks.workunit.client.0.smithi059.stdout:394/600: open fd = 3 2024-09-10T21:23:34.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.837 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.837 INFO:tasks.workunit.client.0.smithi059.stdout:395/600: open fd = 3 2024-09-10T21:23:34.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.838 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.838 INFO:tasks.workunit.client.0.smithi059.stdout:396/600: open fd = 3 2024-09-10T21:23:34.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.838 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.838 INFO:tasks.workunit.client.0.smithi059.stdout:397/600: open fd = 3 2024-09-10T21:23:34.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.838 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.838 INFO:tasks.workunit.client.0.smithi059.stdout:398/600: open fd = 3 2024-09-10T21:23:34.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.838 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.839 INFO:tasks.workunit.client.0.smithi059.stdout:399/600: open fd = 3 2024-09-10T21:23:34.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.839 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.839 INFO:tasks.workunit.client.0.smithi059.stdout:400/600: open fd = 3 2024-09-10T21:23:34.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.839 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.839 INFO:tasks.workunit.client.0.smithi059.stdout:401/600: open fd = 3 2024-09-10T21:23:34.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.839 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.839 INFO:tasks.workunit.client.0.smithi059.stdout:402/600: open fd = 3 2024-09-10T21:23:34.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.839 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.840 INFO:tasks.workunit.client.0.smithi059.stdout:403/600: open fd = 3 2024-09-10T21:23:34.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.840 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.840 INFO:tasks.workunit.client.0.smithi059.stdout:404/600: open fd = 3 2024-09-10T21:23:34.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.840 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.840 INFO:tasks.workunit.client.0.smithi059.stdout:405/600: open fd = 3 2024-09-10T21:23:34.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.840 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.840 INFO:tasks.workunit.client.0.smithi059.stdout:406/600: open fd = 3 2024-09-10T21:23:34.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.841 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.841 INFO:tasks.workunit.client.0.smithi059.stdout:407/600: open fd = 3 2024-09-10T21:23:34.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.841 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.841 INFO:tasks.workunit.client.0.smithi059.stdout:408/600: open fd = 3 2024-09-10T21:23:34.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.841 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.841 INFO:tasks.workunit.client.0.smithi059.stdout:409/600: open fd = 3 2024-09-10T21:23:34.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.841 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.842 INFO:tasks.workunit.client.0.smithi059.stdout:410/600: open fd = 3 2024-09-10T21:23:34.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.842 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.842 INFO:tasks.workunit.client.0.smithi059.stdout:411/600: open fd = 3 2024-09-10T21:23:34.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.842 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.842 INFO:tasks.workunit.client.0.smithi059.stdout:412/600: open fd = 3 2024-09-10T21:23:34.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.842 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.842 INFO:tasks.workunit.client.0.smithi059.stdout:413/600: open fd = 3 2024-09-10T21:23:34.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.842 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.843 INFO:tasks.workunit.client.0.smithi059.stdout:414/600: open fd = 3 2024-09-10T21:23:34.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.843 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.843 INFO:tasks.workunit.client.0.smithi059.stdout:415/600: open fd = 3 2024-09-10T21:23:34.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.843 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.843 INFO:tasks.workunit.client.0.smithi059.stdout:416/600: open fd = 3 2024-09-10T21:23:34.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.843 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.843 INFO:tasks.workunit.client.0.smithi059.stdout:417/600: open fd = 3 2024-09-10T21:23:34.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.844 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.844 INFO:tasks.workunit.client.0.smithi059.stdout:418/600: open fd = 3 2024-09-10T21:23:34.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.844 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.844 INFO:tasks.workunit.client.0.smithi059.stdout:419/600: open fd = 3 2024-09-10T21:23:34.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.844 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.844 INFO:tasks.workunit.client.0.smithi059.stdout:420/600: open fd = 3 2024-09-10T21:23:34.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.844 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.844 INFO:tasks.workunit.client.0.smithi059.stdout:421/600: open fd = 3 2024-09-10T21:23:34.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.845 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.845 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.845 INFO:tasks.workunit.client.0.smithi059.stdout:422/600: open fd = 3 2024-09-10T21:23:34.845 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.845 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.845 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.845 INFO:tasks.workunit.client.0.smithi059.stdout:423/600: open fd = 3 2024-09-10T21:23:34.845 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.845 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.845 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.845 INFO:tasks.workunit.client.0.smithi059.stdout:424/600: open fd = 3 2024-09-10T21:23:34.845 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.845 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.845 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.845 INFO:tasks.workunit.client.0.smithi059.stdout:425/600: open fd = 3 2024-09-10T21:23:34.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.846 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.846 INFO:tasks.workunit.client.0.smithi059.stdout:426/600: open fd = 3 2024-09-10T21:23:34.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.846 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.846 INFO:tasks.workunit.client.0.smithi059.stdout:427/600: open fd = 3 2024-09-10T21:23:34.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.846 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.846 INFO:tasks.workunit.client.0.smithi059.stdout:428/600: open fd = 3 2024-09-10T21:23:34.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.847 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.847 INFO:tasks.workunit.client.0.smithi059.stdout:429/600: open fd = 3 2024-09-10T21:23:34.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.847 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.847 INFO:tasks.workunit.client.0.smithi059.stdout:430/600: open fd = 3 2024-09-10T21:23:34.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.847 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.847 INFO:tasks.workunit.client.0.smithi059.stdout:431/600: open fd = 3 2024-09-10T21:23:34.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.847 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.847 INFO:tasks.workunit.client.0.smithi059.stdout:432/600: open fd = 3 2024-09-10T21:23:34.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.848 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.848 INFO:tasks.workunit.client.0.smithi059.stdout:433/600: open fd = 3 2024-09-10T21:23:34.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.848 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.848 INFO:tasks.workunit.client.0.smithi059.stdout:434/600: open fd = 3 2024-09-10T21:23:34.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.848 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.848 INFO:tasks.workunit.client.0.smithi059.stdout:435/600: open fd = 3 2024-09-10T21:23:34.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.849 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:34.849 INFO:tasks.workunit.client.0.smithi059.stdout:436/600: open fd = 3 2024-09-10T21:23:34.849 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.849 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:23:34.849 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:23:35.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:35 smithi192 ceph-mon[35363]: pgmap v589: 97 pgs: 97 active+clean; 5.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:23:35.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:35 smithi059 ceph-mon[30888]: pgmap v589: 97 pgs: 97 active+clean; 5.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:23:35.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:35 smithi154 ceph-mon[35041]: pgmap v589: 97 pgs: 97 active+clean; 5.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:23:37.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:37 smithi192 ceph-mon[35363]: pgmap v590: 97 pgs: 97 active+clean; 5.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:23:37.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:37 smithi059 ceph-mon[30888]: pgmap v590: 97 pgs: 97 active+clean; 5.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:23:37.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:37 smithi154 ceph-mon[35041]: pgmap v590: 97 pgs: 97 active+clean; 5.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:23:39.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:39 smithi192 ceph-mon[35363]: pgmap v591: 97 pgs: 97 active+clean; 5.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:23:39.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:39 smithi059 ceph-mon[30888]: pgmap v591: 97 pgs: 97 active+clean; 5.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:23:39.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:39 smithi154 ceph-mon[35041]: pgmap v591: 97 pgs: 97 active+clean; 5.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:23:39.987 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:23:40.263 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:23:40.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.763+0000 7efd34110640 1 -- 172.21.15.59:0/3093839611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd2c102150 msgr2=0x7efd2c10eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:40.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.763+0000 7efd34110640 1 --2- 172.21.15.59:0/3093839611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd2c102150 0x7efd2c10eea0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7efd20009900 tx=0x7efd2002a480 comp rx=0 tx=0).stop 2024-09-10T21:23:40.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.763+0000 7efd34110640 1 -- 172.21.15.59:0/3093839611 shutdown_connections 2024-09-10T21:23:40.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.763+0000 7efd34110640 1 --2- 172.21.15.59:0/3093839611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd2c10f3e0 0x7efd2c1117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.763+0000 7efd34110640 1 --2- 172.21.15.59:0/3093839611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd2c102150 0x7efd2c10eea0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.763+0000 7efd34110640 1 --2- 172.21.15.59:0/3093839611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd2c101830 0x7efd2c101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.763+0000 7efd34110640 1 -- 172.21.15.59:0/3093839611 >> 172.21.15.59:0/3093839611 conn(0x7efd2c0fd700 msgr2=0x7efd2c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:40.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.763+0000 7efd34110640 1 -- 172.21.15.59:0/3093839611 shutdown_connections 2024-09-10T21:23:40.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.763+0000 7efd34110640 1 -- 172.21.15.59:0/3093839611 wait complete. 2024-09-10T21:23:40.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.764+0000 7efd34110640 1 Processor -- start 2024-09-10T21:23:40.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.764+0000 7efd34110640 1 -- start start 2024-09-10T21:23:40.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.764+0000 7efd34110640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd2c101830 0x7efd2c19b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:40.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.764+0000 7efd34110640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd2c102150 0x7efd2c19bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:40.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.764+0000 7efd34110640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd2c10f3e0 0x7efd2c1a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:40.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.764+0000 7efd34110640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c115020 con 0x7efd2c102150 2024-09-10T21:23:40.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.764+0000 7efd34110640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c114ea0 con 0x7efd2c10f3e0 2024-09-10T21:23:40.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.764+0000 7efd34110640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1151a0 con 0x7efd2c101830 2024-09-10T21:23:40.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.764+0000 7efd316ab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd2c102150 0x7efd2c19bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:40.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.764+0000 7efd316ab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd2c102150 0x7efd2c19bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56180/0 (socket says 172.21.15.59:56180) 2024-09-10T21:23:40.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.764+0000 7efd316ab640 1 -- 172.21.15.59:0/1145377688 learned_addr learned my addr 172.21.15.59:0/1145377688 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:40.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.765+0000 7efd31eac640 1 --2- 172.21.15.59:0/1145377688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd2c101830 0x7efd2c19b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:40.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.765+0000 7efd326ad640 1 --2- 172.21.15.59:0/1145377688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd2c10f3e0 0x7efd2c1a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:40.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.765+0000 7efd316ab640 1 -- 172.21.15.59:0/1145377688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd2c101830 msgr2=0x7efd2c19b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:40.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.765+0000 7efd316ab640 1 --2- 172.21.15.59:0/1145377688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd2c101830 0x7efd2c19b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.765+0000 7efd316ab640 1 -- 172.21.15.59:0/1145377688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd2c10f3e0 msgr2=0x7efd2c1a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:40.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.765+0000 7efd316ab640 1 --2- 172.21.15.59:0/1145377688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd2c10f3e0 0x7efd2c1a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.765+0000 7efd316ab640 1 -- 172.21.15.59:0/1145377688 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c1a16c0 con 0x7efd2c102150 2024-09-10T21:23:40.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.765+0000 7efd31eac640 1 --2- 172.21.15.59:0/1145377688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd2c101830 0x7efd2c19b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:40.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.765+0000 7efd316ab640 1 --2- 172.21.15.59:0/1145377688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd2c102150 0x7efd2c19bb50 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7efd20006010 tx=0x7efd200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:40.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.765+0000 7efd2affd640 1 -- 172.21.15.59:0/1145377688 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2003f030 con 0x7efd2c102150 2024-09-10T21:23:40.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.765+0000 7efd2affd640 1 -- 172.21.15.59:0/1145377688 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd20003800 con 0x7efd2c102150 2024-09-10T21:23:40.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.765+0000 7efd34110640 1 -- 172.21.15.59:0/1145377688 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd2c1a1950 con 0x7efd2c102150 2024-09-10T21:23:40.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.765+0000 7efd2affd640 1 -- 172.21.15.59:0/1145377688 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd20035070 con 0x7efd2c102150 2024-09-10T21:23:40.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.765+0000 7efd34110640 1 -- 172.21.15.59:0/1145377688 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd2c1a8070 con 0x7efd2c102150 2024-09-10T21:23:40.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.768+0000 7efd2affd640 1 -- 172.21.15.59:0/1145377688 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7efd20031b10 con 0x7efd2c102150 2024-09-10T21:23:40.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.768+0000 7efd364e5740 1 Processor -- start 2024-09-10T21:23:40.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.768+0000 7efd364e5740 1 -- start start 2024-09-10T21:23:40.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.768+0000 7efd364e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551480 0x562460551860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:40.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.768+0000 7efd364e5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562460551da0 0x56246055d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:40.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.768+0000 7efd364e5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56246055dd30 0x562460560120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:40.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.768+0000 7efd364e5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5624604c7e50 con 0x56246055dd30 2024-09-10T21:23:40.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.768+0000 7efd364e5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5624604b7280 con 0x562460551480 2024-09-10T21:23:40.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.768+0000 7efd364e5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5624604bb090 con 0x562460551da0 2024-09-10T21:23:40.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.769+0000 7efd316ab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56246055dd30 0x562460560120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.769+0000 7efd31eac640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562460551da0 0x56246055d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.769+0000 7efd316ab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56246055dd30 0x562460560120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56188/0 (socket says 172.21.15.59:56188) 2024-09-10T21:23:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.769+0000 7efd316ab640 1 -- 172.21.15.59:0/3481702159 learned_addr learned my addr 172.21.15.59:0/3481702159 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.769+0000 7efd326ad640 1 --2- 172.21.15.59:0/3481702159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551480 0x562460551860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.769+0000 7efd2affd640 1 --2- 172.21.15.59:0/1145377688 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efd140b52e0 0x7efd140b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.769+0000 7efd326ad640 1 --2- 172.21.15.59:0/1145377688 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efd140b52e0 0x7efd140b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.769+0000 7efd31eac640 1 -- 172.21.15.59:0/3481702159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551480 msgr2=0x562460551860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.769+0000 7efd31eac640 1 --2- 172.21.15.59:0/3481702159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551480 0x562460551860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.769+0000 7efd31eac640 1 -- 172.21.15.59:0/3481702159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56246055dd30 msgr2=0x562460560120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.769+0000 7efd31eac640 1 --2- 172.21.15.59:0/3481702159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56246055dd30 0x562460560120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.769+0000 7efd31eac640 1 -- 172.21.15.59:0/3481702159 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562460215650 con 0x562460551da0 2024-09-10T21:23:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.769+0000 7efd2affd640 1 -- 172.21.15.59:0/1145377688 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7efd20105f20 con 0x7efd2c102150 2024-09-10T21:23:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.769+0000 7efd31eac640 1 --2- 172.21.15.59:0/3481702159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562460551da0 0x56246055d7f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009f60 tx=0x7efd1c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14c9345477f0b4e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.770+0000 7efd326ad640 1 --2- 172.21.15.59:0/1145377688 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efd140b52e0 0x7efd140b77a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7efd2400be90 tx=0x7efd240046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:40.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.770+0000 7efd13fff640 1 -- 172.21.15.59:0/3481702159 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c01a070 con 0x562460551da0 2024-09-10T21:23:40.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.770+0000 7efd13fff640 1 -- 172.21.15.59:0/3481702159 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd1c0158c0 con 0x562460551da0 2024-09-10T21:23:40.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.770+0000 7efd13fff640 1 -- 172.21.15.59:0/3481702159 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1c00a8c0 con 0x562460551da0 2024-09-10T21:23:40.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.770+0000 7efd364e5740 1 -- 172.21.15.59:0/3481702159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562460551da0 msgr2=0x56246055d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:40.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.770+0000 7efd364e5740 1 --2- 172.21.15.59:0/3481702159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562460551da0 0x56246055d7f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009f60 tx=0x7efd1c009f90 comp rx=0 tx=0).stop 2024-09-10T21:23:40.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.770+0000 7efd364e5740 1 -- 172.21.15.59:0/3481702159 shutdown_connections 2024-09-10T21:23:40.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.770+0000 7efd364e5740 1 --2- 172.21.15.59:0/3481702159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56246055dd30 0x562460560120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.770+0000 7efd364e5740 1 --2- 172.21.15.59:0/3481702159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562460551da0 0x56246055d7f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.770+0000 7efd364e5740 1 --2- 172.21.15.59:0/3481702159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551480 0x562460551860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.770+0000 7efd364e5740 1 -- 172.21.15.59:0/3481702159 >> 172.21.15.59:0/3481702159 conn(0x56246054f2b0 msgr2=0x562460550450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:40.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.771+0000 7efd364e5740 1 -- 172.21.15.59:0/3481702159 shutdown_connections 2024-09-10T21:23:40.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.771+0000 7efd364e5740 1 -- 172.21.15.59:0/3481702159 wait complete. 2024-09-10T21:23:40.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.771+0000 7efd364e5740 1 -- start start 2024-09-10T21:23:40.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.771+0000 7efd364e5740 1 Processor -- start 2024-09-10T21:23:40.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.771+0000 7efd364e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551480 0x56246055d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:40.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.771+0000 7efd364e5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562460551da0 0x56246055a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:40.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.771+0000 7efd364e5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56246055dd30 0x56246055af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:40.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd364e5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562460318700 con 0x562460551da0 2024-09-10T21:23:40.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd364e5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562460452110 con 0x562460551480 2024-09-10T21:23:40.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd364e5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5624605609b0 con 0x56246055dd30 2024-09-10T21:23:40.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd364e5740 10 client.0 _ll_register_callbacks cb 0x56246046b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:40.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd316ab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562460551da0 0x56246055a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:40.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd316ab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562460551da0 0x56246055a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56198/0 (socket says 172.21.15.59:56198) 2024-09-10T21:23:40.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd316ab640 1 -- 172.21.15.59:0/176704801 learned_addr learned my addr 172.21.15.59:0/176704801 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:40.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd31eac640 1 --2- 172.21.15.59:0/176704801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551480 0x56246055d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:40.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd326ad640 1 --2- 172.21.15.59:0/176704801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56246055dd30 0x56246055af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:40.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd316ab640 1 -- 172.21.15.59:0/176704801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56246055dd30 msgr2=0x56246055af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:40.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd316ab640 1 --2- 172.21.15.59:0/176704801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56246055dd30 0x56246055af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd316ab640 1 -- 172.21.15.59:0/176704801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551480 msgr2=0x56246055d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:40.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd316ab640 1 --2- 172.21.15.59:0/176704801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551480 0x56246055d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd316ab640 1 -- 172.21.15.59:0/176704801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56246047fc40 con 0x562460551da0 2024-09-10T21:23:40.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd316ab640 1 --2- 172.21.15.59:0/176704801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562460551da0 0x56246055a9c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7efd20103aa0 tx=0x7efd20005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd9c4e790b60356 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:40.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd117fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:40.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd117fa640 1 -- 172.21.15.59:0/176704801 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd20049070 con 0x562460551da0 2024-09-10T21:23:40.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd117fa640 1 -- 172.21.15.59:0/176704801 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7efd20095230 con 0x562460551da0 2024-09-10T21:23:40.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd364e5740 1 -- 172.21.15.59:0/176704801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd1c0158c0 con 0x562460551da0 2024-09-10T21:23:40.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd117fa640 1 -- 172.21.15.59:0/176704801 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd200c85b0 con 0x562460551da0 2024-09-10T21:23:40.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd364e5740 10 client.17286 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:40.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.772+0000 7efd364e5740 1 -- 172.21.15.59:0/176704801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56246056c270 con 0x562460551da0 2024-09-10T21:23:40.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.773+0000 7efd117fa640 1 -- 172.21.15.59:0/176704801 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd1c0158c0 con 0x562460551da0 2024-09-10T21:23:40.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.773+0000 7efd117fa640 1 -- 172.21.15.59:0/176704801 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efd200d5810 con 0x562460551da0 2024-09-10T21:23:40.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.773+0000 7efd364e5740 10 client.17286 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:40.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.773+0000 7efd364e5740 10 client.17286 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:23:40.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.773+0000 7efd364e5740 20 client.17286 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:40.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.773+0000 7efd364e5740 1 --2- 172.21.15.59:0/176704801 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56246056d6d0 0x56246056fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:40.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.773+0000 7efd364e5740 4 client.17286 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:23:40.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.773+0000 7efd364e5740 1 -- 172.21.15.59:0/176704801 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624604c9da0 con 0x56246056d6d0 2024-09-10T21:23:40.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.773+0000 7efd31eac640 1 --2- 172.21.15.59:0/176704801 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56246056d6d0 0x56246056fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:40.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.774+0000 7efd117fa640 10 client.17286 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:40.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.774+0000 7efd31eac640 1 --2- 172.21.15.59:0/176704801 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56246056d6d0 0x56246056fb50 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de9e4a0f59aacbd2 server_cookie=1a8fe0dbcda7f07e in_seq=0 out_seq=0 2024-09-10T21:23:40.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.775+0000 7efd117fa640 1 -- 172.21.15.59:0/176704801 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5624604c9da0 con 0x56246056d6d0 2024-09-10T21:23:40.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.775+0000 7efd117fa640 10 client.17286 handle_command_reply: tid=0 2024-09-10T21:23:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.775+0000 7efd364e5740 1 client.17286 shutdown 2024-09-10T21:23:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.775+0000 7efd364e5740 1 -- 172.21.15.59:0/176704801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562460551da0 msgr2=0x56246055a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.775+0000 7efd364e5740 1 --2- 172.21.15.59:0/176704801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562460551da0 0x56246055a9c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7efd20103aa0 tx=0x7efd20005a40 comp rx=0 tx=0).stop 2024-09-10T21:23:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.775+0000 7efd364e5740 1 -- 172.21.15.59:0/176704801 shutdown_connections 2024-09-10T21:23:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.775+0000 7efd364e5740 1 --2- 172.21.15.59:0/176704801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56246055dd30 0x56246055af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.775+0000 7efd364e5740 1 --2- 172.21.15.59:0/176704801 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56246056d6d0 0x56246056fb50 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.775+0000 7efd364e5740 1 --2- 172.21.15.59:0/176704801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562460551da0 0x56246055a9c0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.775+0000 7efd364e5740 1 --2- 172.21.15.59:0/176704801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551480 0x56246055d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.775+0000 7efd117fa640 0 client.17286 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.775+0000 7efd364e5740 1 -- 172.21.15.59:0/176704801 >> 172.21.15.59:0/176704801 conn(0x56246054f2b0 msgr2=0x562460554e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.775+0000 7efd364e5740 1 -- 172.21.15.59:0/176704801 shutdown_connections 2024-09-10T21:23:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.775+0000 7efd364e5740 1 -- 172.21.15.59:0/176704801 wait complete. 2024-09-10T21:23:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.775+0000 7efd364e5740 20 client.17286 trim_cache size 0 max 16384 2024-09-10T21:23:40.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.793+0000 7efd364e5740 1 Processor -- start 2024-09-10T21:23:40.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.793+0000 7efd364e5740 1 -- start start 2024-09-10T21:23:40.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.793+0000 7efd364e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551480 0x562460569c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:40.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.793+0000 7efd364e5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562460551da0 0x562460550a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:40.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.793+0000 7efd364e5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56246055dd30 0x562460559eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:40.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.793+0000 7efd364e5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1b0600 con 0x562460551da0 2024-09-10T21:23:40.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.793+0000 7efd364e5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1b2140 con 0x562460551480 2024-09-10T21:23:40.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.793+0000 7efd364e5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1b0cd0 con 0x56246055dd30 2024-09-10T21:23:40.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.793+0000 7efd316ab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562460551da0 0x562460550a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:40.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.793+0000 7efd316ab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562460551da0 0x562460550a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56214/0 (socket says 172.21.15.59:56214) 2024-09-10T21:23:40.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.793+0000 7efd316ab640 1 -- 172.21.15.59:0/3396897348 learned_addr learned my addr 172.21.15.59:0/3396897348 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:40.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.793+0000 7efd326ad640 1 --2- 172.21.15.59:0/3396897348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56246055dd30 0x562460559eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:40.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.793+0000 7efd31eac640 1 --2- 172.21.15.59:0/3396897348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551480 0x562460569c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:40.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.793+0000 7efd316ab640 1 -- 172.21.15.59:0/3396897348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56246055dd30 msgr2=0x562460559eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:40.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.793+0000 7efd316ab640 1 --2- 172.21.15.59:0/3396897348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56246055dd30 0x562460559eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.794+0000 7efd316ab640 1 -- 172.21.15.59:0/3396897348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551480 msgr2=0x562460569c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:40.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.794+0000 7efd316ab640 1 --2- 172.21.15.59:0/3396897348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551480 0x562460569c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.794+0000 7efd316ab640 1 -- 172.21.15.59:0/3396897348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562460559920 con 0x562460551da0 2024-09-10T21:23:40.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.794+0000 7efd31eac640 1 --2- 172.21.15.59:0/3396897348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551480 0x562460569c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:40.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.794+0000 7efd316ab640 1 --2- 172.21.15.59:0/3396897348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562460551da0 0x562460550a10 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7efd20004650 tx=0x7efd20003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55cc0eeeb8a1fcb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:40.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.794+0000 7efd137fe640 1 -- 172.21.15.59:0/3396897348 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd20049070 con 0x562460551da0 2024-09-10T21:23:40.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.794+0000 7efd137fe640 1 -- 172.21.15.59:0/3396897348 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd200cc220 con 0x562460551da0 2024-09-10T21:23:40.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.794+0000 7efd137fe640 1 -- 172.21.15.59:0/3396897348 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd200cbe80 con 0x562460551da0 2024-09-10T21:23:40.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.794+0000 7efd364e5740 1 -- 172.21.15.59:0/3396897348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562460551da0 msgr2=0x562460550a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:40.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.794+0000 7efd364e5740 1 --2- 172.21.15.59:0/3396897348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562460551da0 0x562460550a10 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7efd20004650 tx=0x7efd20003c20 comp rx=0 tx=0).stop 2024-09-10T21:23:40.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.795+0000 7efd364e5740 1 -- 172.21.15.59:0/3396897348 shutdown_connections 2024-09-10T21:23:40.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.795+0000 7efd364e5740 1 --2- 172.21.15.59:0/3396897348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56246055dd30 0x562460559eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.795+0000 7efd364e5740 1 --2- 172.21.15.59:0/3396897348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562460551da0 0x562460550a10 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.795+0000 7efd364e5740 1 --2- 172.21.15.59:0/3396897348 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551480 0x562460569c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.795+0000 7efd364e5740 1 -- 172.21.15.59:0/3396897348 >> 172.21.15.59:0/3396897348 conn(0x56246054f2b0 msgr2=0x562460550300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:40.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.795+0000 7efd364e5740 1 -- 172.21.15.59:0/3396897348 shutdown_connections 2024-09-10T21:23:40.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.795+0000 7efd364e5740 1 -- 172.21.15.59:0/3396897348 wait complete. 2024-09-10T21:23:40.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.795+0000 7efd364e5740 1 -- start start 2024-09-10T21:23:40.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.795+0000 7efd364e5740 1 Processor -- start 2024-09-10T21:23:40.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.795+0000 7efd364e5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562460551480 0x5624605660f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:40.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.795+0000 7efd364e5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551da0 0x562460566670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:40.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.795+0000 7efd364e5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56246055dd30 0x562460562820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:40.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.795+0000 7efd364e5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1b1a70 con 0x56246055dd30 2024-09-10T21:23:40.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.795+0000 7efd364e5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1b13a0 con 0x562460551da0 2024-09-10T21:23:40.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.795+0000 7efd364e5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c1ae5e0 con 0x562460551480 2024-09-10T21:23:40.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.796+0000 7efd364e5740 10 client.0 _ll_register_callbacks cb 0x7efd201096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:40.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.796+0000 7efd326ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56246055dd30 0x562460562820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:40.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.796+0000 7efd326ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56246055dd30 0x562460562820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56220/0 (socket says 172.21.15.59:56220) 2024-09-10T21:23:40.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.796+0000 7efd326ad640 1 -- 172.21.15.59:0/2167474045 learned_addr learned my addr 172.21.15.59:0/2167474045 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:40.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.796+0000 7efd31eac640 1 --2- 172.21.15.59:0/2167474045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562460551480 0x5624605660f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:40.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.796+0000 7efd316ab640 1 --2- 172.21.15.59:0/2167474045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551da0 0x562460566670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:40.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.796+0000 7efd326ad640 1 -- 172.21.15.59:0/2167474045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562460551480 msgr2=0x5624605660f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:40.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.796+0000 7efd326ad640 1 --2- 172.21.15.59:0/2167474045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562460551480 0x5624605660f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.796+0000 7efd326ad640 1 -- 172.21.15.59:0/2167474045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551da0 msgr2=0x562460566670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:40.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.796+0000 7efd326ad640 1 --2- 172.21.15.59:0/2167474045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551da0 0x562460566670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.796+0000 7efd326ad640 1 -- 172.21.15.59:0/2167474045 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562460563050 con 0x56246055dd30 2024-09-10T21:23:40.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.796+0000 7efd326ad640 1 --2- 172.21.15.59:0/2167474045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56246055dd30 0x562460562820 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7efd240179f0 tx=0x7efd240047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbab004de09961f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:40.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.796+0000 7efd117fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:40.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.796+0000 7efd117fa640 1 -- 172.21.15.59:0/2167474045 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd24028020 con 0x56246055dd30 2024-09-10T21:23:40.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.796+0000 7efd117fa640 1 -- 172.21.15.59:0/2167474045 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7efd24024660 con 0x56246055dd30 2024-09-10T21:23:40.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.796+0000 7efd364e5740 1 -- 172.21.15.59:0/2167474045 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd200cc220 con 0x56246055dd30 2024-09-10T21:23:40.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.797+0000 7efd117fa640 1 -- 172.21.15.59:0/2167474045 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd2400f040 con 0x56246055dd30 2024-09-10T21:23:40.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.797+0000 7efd364e5740 10 client.17292 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:40.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.797+0000 7efd364e5740 1 -- 172.21.15.59:0/2167474045 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5624605db340 con 0x56246055dd30 2024-09-10T21:23:40.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.797+0000 7efd117fa640 1 -- 172.21.15.59:0/2167474045 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd200cc220 con 0x56246055dd30 2024-09-10T21:23:40.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.797+0000 7efd117fa640 1 -- 172.21.15.59:0/2167474045 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efd2402f7a0 con 0x56246055dd30 2024-09-10T21:23:40.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.797+0000 7efd364e5740 10 client.17292 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:40.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.797+0000 7efd364e5740 10 client.17292 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:23:40.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.797+0000 7efd364e5740 20 client.17292 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:40.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.797+0000 7efd364e5740 1 --2- 172.21.15.59:0/2167474045 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5624605dbb70 0x5624605ddf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:40.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.797+0000 7efd364e5740 4 client.17292 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:23:40.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.797+0000 7efd364e5740 1 -- 172.21.15.59:0/2167474045 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5624604c5850 con 0x5624605dbb70 2024-09-10T21:23:40.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.797+0000 7efd31eac640 1 --2- 172.21.15.59:0/2167474045 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5624605dbb70 0x5624605ddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:40.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.798+0000 7efd117fa640 10 client.17292 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:40.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.798+0000 7efd31eac640 1 --2- 172.21.15.59:0/2167474045 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5624605dbb70 0x5624605ddf90 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21f8e124ad276832 server_cookie=b0bb471a6b87dfa2 in_seq=0 out_seq=0 2024-09-10T21:23:40.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.798+0000 7efd117fa640 1 -- 172.21.15.59:0/2167474045 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x5624604c5850 con 0x5624605dbb70 2024-09-10T21:23:40.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.798+0000 7efd117fa640 10 client.17292 handle_command_reply: tid=0 2024-09-10T21:23:40.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.798+0000 7efd364e5740 1 client.17292 shutdown 2024-09-10T21:23:40.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.798+0000 7efd364e5740 1 -- 172.21.15.59:0/2167474045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56246055dd30 msgr2=0x562460562820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:40.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.798+0000 7efd364e5740 1 --2- 172.21.15.59:0/2167474045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56246055dd30 0x562460562820 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7efd240179f0 tx=0x7efd240047d0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.798+0000 7efd364e5740 1 -- 172.21.15.59:0/2167474045 shutdown_connections 2024-09-10T21:23:40.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.798+0000 7efd364e5740 1 --2- 172.21.15.59:0/2167474045 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5624605dbb70 0x5624605ddf90 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.798+0000 7efd364e5740 1 --2- 172.21.15.59:0/2167474045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56246055dd30 0x562460562820 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.798+0000 7efd364e5740 1 --2- 172.21.15.59:0/2167474045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562460551da0 0x562460566670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.798+0000 7efd364e5740 1 --2- 172.21.15.59:0/2167474045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562460551480 0x5624605660f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.798+0000 7efd117fa640 0 client.17292 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:40.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.798+0000 7efd364e5740 1 -- 172.21.15.59:0/2167474045 >> 172.21.15.59:0/2167474045 conn(0x56246054f2b0 msgr2=0x56246055bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:40.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.798+0000 7efd364e5740 1 -- 172.21.15.59:0/2167474045 shutdown_connections 2024-09-10T21:23:40.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.798+0000 7efd364e5740 1 -- 172.21.15.59:0/2167474045 wait complete. 2024-09-10T21:23:40.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.798+0000 7efd364e5740 20 client.17292 trim_cache size 0 max 16384 2024-09-10T21:23:40.807 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:23:40.808 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:23:40.808 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:23:40.808 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:23:40.808 INFO:teuthology.orchestra.run.smithi059.stdout: "cb01ac69-57ce-4c62-b57a-054abf74df29": { 2024-09-10T21:23:40.808 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:07.589420+0000", 2024-09-10T21:23:40.808 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:40.808 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:40.808 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:40.808 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:40.808 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:40.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:40.808 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:23:40.808 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:23:40.809 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:40.809 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:40.809 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:40.809 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:40.809 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:40.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:40.809 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:23:40.809 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:23:40.809 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:40.809 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:40.809 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:40.809 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:40.809 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:40.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:40.810 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:23:40.810 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:07.066301+0000", 2024-09-10T21:23:40.810 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:40.810 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:40.810 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:40.810 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:40.810 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:40.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:40.810 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:23:40.810 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:23:40.810 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:40.810 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:40.810 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:40.811 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:40.811 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:40.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:40.811 INFO:teuthology.orchestra.run.smithi059.stdout: "7de1e6cf-02c2-41f2-b957-563f88bae8ef": { 2024-09-10T21:23:40.811 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:22:22.098651+0000", 2024-09-10T21:23:40.811 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:40.811 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:40.811 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:40.811 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:40.811 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:40.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:40.811 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:23:40.811 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:23:40.811 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:40.812 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:40.812 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:40.812 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:40.812 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:40.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:40.812 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:23:40.812 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:23:40.812 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:40.812 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:40.812 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:40.812 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:40.812 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:40.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:40.813 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:23:40.813 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:23:40.813 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:40.813 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:40.813 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:40.813 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:40.813 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:40.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:40.813 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:23:40.813 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:23:40.813 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:40.813 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:40.813 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:40.813 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:40.814 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:40.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:40.814 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:23:40.814 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:23:40.814 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:40.814 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:40.814 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:40.814 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:40.814 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:40.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:40.814 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:23:40.814 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:23:40.814 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:40.814 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:40.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:40.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:40.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:40.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:40.815 INFO:teuthology.orchestra.run.smithi059.stdout: "800cdb00-6a99-4c42-8a9e-4b1c599c6af0": { 2024-09-10T21:23:40.815 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:52.224081+0000", 2024-09-10T21:23:40.815 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:40.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:40.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:40.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:40.815 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:40.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:40.815 INFO:teuthology.orchestra.run.smithi059.stdout: "d82f24b1-930e-4f83-a379-3084f22918d0": { 2024-09-10T21:23:40.816 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:21:37.203865+0000", 2024-09-10T21:23:40.816 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:40.816 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:40.816 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:40.816 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:40.816 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:40.816 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:23:40.816 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:23:40.816 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:23:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.799+0000 7efd34110640 1 -- 172.21.15.59:0/1145377688 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efd140b52e0 msgr2=0x7efd140b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.799+0000 7efd34110640 1 --2- 172.21.15.59:0/1145377688 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efd140b52e0 0x7efd140b77a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7efd2400be90 tx=0x7efd240046c0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.799+0000 7efd34110640 1 -- 172.21.15.59:0/1145377688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd2c102150 msgr2=0x7efd2c19bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.799+0000 7efd34110640 1 --2- 172.21.15.59:0/1145377688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd2c102150 0x7efd2c19bb50 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7efd20006010 tx=0x7efd200042f0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.799+0000 7efd34110640 1 -- 172.21.15.59:0/1145377688 shutdown_connections 2024-09-10T21:23:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.799+0000 7efd34110640 1 --2- 172.21.15.59:0/1145377688 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efd140b52e0 0x7efd140b77a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.799+0000 7efd34110640 1 --2- 172.21.15.59:0/1145377688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd2c10f3e0 0x7efd2c1a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.799+0000 7efd34110640 1 --2- 172.21.15.59:0/1145377688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd2c102150 0x7efd2c19bb50 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.799+0000 7efd34110640 1 --2- 172.21.15.59:0/1145377688 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd2c101830 0x7efd2c19b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.799+0000 7efd34110640 1 -- 172.21.15.59:0/1145377688 >> 172.21.15.59:0/1145377688 conn(0x7efd2c0fd700 msgr2=0x7efd2c1108a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.799+0000 7efd34110640 1 -- 172.21.15.59:0/1145377688 shutdown_connections 2024-09-10T21:23:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:40.799+0000 7efd34110640 1 -- 172.21.15.59:0/1145377688 wait complete. 2024-09-10T21:23:41.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:41 smithi192 ceph-mon[35363]: pgmap v592: 97 pgs: 97 active+clean; 5.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:23:41.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:41 smithi059 ceph-mon[30888]: pgmap v592: 97 pgs: 97 active+clean; 5.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:23:41.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:41 smithi154 ceph-mon[35041]: pgmap v592: 97 pgs: 97 active+clean; 5.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:23:41.649 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:23:41.649 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:23:41.913 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:23:42.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.374+0000 7fe6d4083640 1 -- 172.21.15.59:0/384956229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6cc109150 msgr2=0x7fe6cc10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:42.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.374+0000 7fe6d4083640 1 --2- 172.21.15.59:0/384956229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6cc109150 0x7fe6cc10f950 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4009ca0 tx=0x7fe6c402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:23:42.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.374+0000 7fe6d4083640 1 -- 172.21.15.59:0/384956229 shutdown_connections 2024-09-10T21:23:42.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.374+0000 7fe6d4083640 1 --2- 172.21.15.59:0/384956229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6cc109150 0x7fe6cc10f950 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:42.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.374+0000 7fe6d4083640 1 --2- 172.21.15.59:0/384956229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6cc1087d0 0x7fe6cc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:42.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.374+0000 7fe6d4083640 1 --2- 172.21.15.59:0/384956229 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6cc102dc0 0x7fe6cc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:42.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.374+0000 7fe6d4083640 1 -- 172.21.15.59:0/384956229 >> 172.21.15.59:0/384956229 conn(0x7fe6cc0fe830 msgr2=0x7fe6cc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:42.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.374+0000 7fe6d4083640 1 -- 172.21.15.59:0/384956229 shutdown_connections 2024-09-10T21:23:42.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.374+0000 7fe6d4083640 1 -- 172.21.15.59:0/384956229 wait complete. 2024-09-10T21:23:42.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.375+0000 7fe6d4083640 1 Processor -- start 2024-09-10T21:23:42.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.375+0000 7fe6d4083640 1 -- start start 2024-09-10T21:23:42.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.375+0000 7fe6d4083640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6cc102dc0 0x7fe6cc199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:42.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.375+0000 7fe6d4083640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6cc1087d0 0x7fe6cc1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:42.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.375+0000 7fe6d4083640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6cc109150 0x7fe6cc19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:42.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.375+0000 7fe6d4083640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe6cc112dd0 con 0x7fe6cc102dc0 2024-09-10T21:23:42.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.375+0000 7fe6d4083640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe6cc112c50 con 0x7fe6cc109150 2024-09-10T21:23:42.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.375+0000 7fe6d4083640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe6cc112f50 con 0x7fe6cc1087d0 2024-09-10T21:23:42.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.375+0000 7fe6d1e1f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6cc102dc0 0x7fe6cc199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:42.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.375+0000 7fe6d1e1f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6cc102dc0 0x7fe6cc199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56242/0 (socket says 172.21.15.59:56242) 2024-09-10T21:23:42.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.375+0000 7fe6d1e1f640 1 -- 172.21.15.59:0/3626938120 learned_addr learned my addr 172.21.15.59:0/3626938120 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:42.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.375+0000 7fe6d161e640 1 --2- 172.21.15.59:0/3626938120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6cc1087d0 0x7fe6cc1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:42.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.376+0000 7fe6d2620640 1 --2- 172.21.15.59:0/3626938120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6cc109150 0x7fe6cc19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:42.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.376+0000 7fe6d1e1f640 1 -- 172.21.15.59:0/3626938120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6cc1087d0 msgr2=0x7fe6cc1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:42.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.376+0000 7fe6d1e1f640 1 --2- 172.21.15.59:0/3626938120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6cc1087d0 0x7fe6cc1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:42.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.376+0000 7fe6d1e1f640 1 -- 172.21.15.59:0/3626938120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6cc109150 msgr2=0x7fe6cc19eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:42.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.376+0000 7fe6d1e1f640 1 --2- 172.21.15.59:0/3626938120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6cc109150 0x7fe6cc19eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:42.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.376+0000 7fe6d1e1f640 1 -- 172.21.15.59:0/3626938120 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6cc19f310 con 0x7fe6cc102dc0 2024-09-10T21:23:42.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.376+0000 7fe6d2620640 1 --2- 172.21.15.59:0/3626938120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6cc109150 0x7fe6cc19eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:42.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.376+0000 7fe6d1e1f640 1 --2- 172.21.15.59:0/3626938120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6cc102dc0 0x7fe6cc199260 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800c890 tx=0x7fe6c800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:42.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.376+0000 7fe6c2ffd640 1 -- 172.21.15.59:0/3626938120 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8004220 con 0x7fe6cc102dc0 2024-09-10T21:23:42.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.376+0000 7fe6c2ffd640 1 -- 172.21.15.59:0/3626938120 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6c80043c0 con 0x7fe6cc102dc0 2024-09-10T21:23:42.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.376+0000 7fe6d4083640 1 -- 172.21.15.59:0/3626938120 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6cc19f600 con 0x7fe6cc102dc0 2024-09-10T21:23:42.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.376+0000 7fe6c2ffd640 1 -- 172.21.15.59:0/3626938120 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8004a00 con 0x7fe6cc102dc0 2024-09-10T21:23:42.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.376+0000 7fe6d4083640 1 -- 172.21.15.59:0/3626938120 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6cc1a5e90 con 0x7fe6cc102dc0 2024-09-10T21:23:42.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.377+0000 7fe6d4083640 1 -- 172.21.15.59:0/3626938120 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6cc1031a0 con 0x7fe6cc102dc0 2024-09-10T21:23:42.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.378+0000 7fe6c2ffd640 1 -- 172.21.15.59:0/3626938120 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fe6c80079b0 con 0x7fe6cc102dc0 2024-09-10T21:23:42.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.379+0000 7fe6c2ffd640 1 --2- 172.21.15.59:0/3626938120 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe6b80b5360 0x7fe6b80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:42.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.379+0000 7fe6d161e640 1 --2- 172.21.15.59:0/3626938120 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe6b80b5360 0x7fe6b80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:42.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.379+0000 7fe6c2ffd640 1 -- 172.21.15.59:0/3626938120 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe6c80e5c60 con 0x7fe6cc102dc0 2024-09-10T21:23:42.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.380+0000 7fe6d161e640 1 --2- 172.21.15.59:0/3626938120 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe6b80b5360 0x7fe6b80b7820 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc1020b0 tx=0x7fe6bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:42.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.382+0000 7fe6c2ffd640 1 -- 172.21.15.59:0/3626938120 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe6c8014030 con 0x7fe6cc102dc0 2024-09-10T21:23:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.603+0000 7fe6d4083640 1 -- 172.21.15.59:0/3626938120 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6cc19a390 con 0x7fe6cc102dc0 2024-09-10T21:23:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.603+0000 7fe6c2ffd640 1 -- 172.21.15.59:0/3626938120 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7fe6c80acbd0 con 0x7fe6cc102dc0 2024-09-10T21:23:42.606 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:23:42.607 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:23:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:23:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.606+0000 7fe6d4083640 1 -- 172.21.15.59:0/3626938120 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe6b80b5360 msgr2=0x7fe6b80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.606+0000 7fe6d4083640 1 --2- 172.21.15.59:0/3626938120 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe6b80b5360 0x7fe6b80b7820 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc1020b0 tx=0x7fe6bc00b390 comp rx=0 tx=0).stop 2024-09-10T21:23:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.606+0000 7fe6d4083640 1 -- 172.21.15.59:0/3626938120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6cc102dc0 msgr2=0x7fe6cc199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.606+0000 7fe6d4083640 1 --2- 172.21.15.59:0/3626938120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6cc102dc0 0x7fe6cc199260 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800c890 tx=0x7fe6c800cd50 comp rx=0 tx=0).stop 2024-09-10T21:23:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.606+0000 7fe6d4083640 1 -- 172.21.15.59:0/3626938120 shutdown_connections 2024-09-10T21:23:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.606+0000 7fe6d4083640 1 --2- 172.21.15.59:0/3626938120 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe6b80b5360 0x7fe6b80b7820 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.606+0000 7fe6d4083640 1 --2- 172.21.15.59:0/3626938120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe6cc109150 0x7fe6cc19eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.606+0000 7fe6d4083640 1 --2- 172.21.15.59:0/3626938120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6cc1087d0 0x7fe6cc1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.606+0000 7fe6d4083640 1 --2- 172.21.15.59:0/3626938120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6cc102dc0 0x7fe6cc199260 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.606+0000 7fe6d4083640 1 -- 172.21.15.59:0/3626938120 >> 172.21.15.59:0/3626938120 conn(0x7fe6cc0fe830 msgr2=0x7fe6cc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.606+0000 7fe6d4083640 1 -- 172.21.15.59:0/3626938120 shutdown_connections 2024-09-10T21:23:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:42.606+0000 7fe6d4083640 1 -- 172.21.15.59:0/3626938120 wait complete. 2024-09-10T21:23:43.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:43 smithi192 ceph-mon[35363]: pgmap v593: 97 pgs: 97 active+clean; 5.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:23:43.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:43 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3626938120' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:23:43.383 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:43 smithi059 ceph-mon[30888]: pgmap v593: 97 pgs: 97 active+clean; 5.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:23:43.383 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:43 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3626938120' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:23:43.416 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:23:43.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:43 smithi154 ceph-mon[35041]: pgmap v593: 97 pgs: 97 active+clean; 5.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:23:43.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:43 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3626938120' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:23:43.680 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:23:44.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.170+0000 7f402130d640 1 -- 172.21.15.59:0/797182125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f401c1087d0 msgr2=0x7f401c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.170+0000 7f402130d640 1 --2- 172.21.15.59:0/797182125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f401c1087d0 0x7f401c108c10 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f4004009900 tx=0x7f400402a410 comp rx=0 tx=0).stop 2024-09-10T21:23:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.170+0000 7f402130d640 1 -- 172.21.15.59:0/797182125 shutdown_connections 2024-09-10T21:23:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.170+0000 7f402130d640 1 --2- 172.21.15.59:0/797182125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f401c109150 0x7f401c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.170+0000 7f402130d640 1 --2- 172.21.15.59:0/797182125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f401c1087d0 0x7f401c108c10 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.170+0000 7f402130d640 1 --2- 172.21.15.59:0/797182125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f401c102dc0 0x7f401c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.170+0000 7f402130d640 1 -- 172.21.15.59:0/797182125 >> 172.21.15.59:0/797182125 conn(0x7f401c0fe830 msgr2=0x7f401c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.170+0000 7f402130d640 1 -- 172.21.15.59:0/797182125 shutdown_connections 2024-09-10T21:23:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.170+0000 7f402130d640 1 -- 172.21.15.59:0/797182125 wait complete. 2024-09-10T21:23:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.171+0000 7f402130d640 1 Processor -- start 2024-09-10T21:23:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.171+0000 7f402130d640 1 -- start start 2024-09-10T21:23:44.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.171+0000 7f402130d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f401c102dc0 0x7f401c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:44.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.171+0000 7f402130d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f401c1087d0 0x7f401c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:44.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.171+0000 7f402130d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f401c109150 0x7f401c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:44.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.171+0000 7f402130d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f401c112e60 con 0x7f401c102dc0 2024-09-10T21:23:44.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.171+0000 7f402130d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f401c112ce0 con 0x7f401c109150 2024-09-10T21:23:44.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.171+0000 7f402130d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f401c112fe0 con 0x7f401c1087d0 2024-09-10T21:23:44.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.171+0000 7f401affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f401c102dc0 0x7f401c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:44.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.172+0000 7f401affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f401c102dc0 0x7f401c0754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56262/0 (socket says 172.21.15.59:56262) 2024-09-10T21:23:44.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.172+0000 7f401affd640 1 -- 172.21.15.59:0/4277510918 learned_addr learned my addr 172.21.15.59:0/4277510918 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:44.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.172+0000 7f401b7fe640 1 --2- 172.21.15.59:0/4277510918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f401c109150 0x7f401c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:44.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.172+0000 7f4013fff640 1 --2- 172.21.15.59:0/4277510918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f401c1087d0 0x7f401c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:44.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.172+0000 7f401affd640 1 -- 172.21.15.59:0/4277510918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f401c1087d0 msgr2=0x7f401c0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:44.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.172+0000 7f401affd640 1 --2- 172.21.15.59:0/4277510918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f401c1087d0 0x7f401c0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.172+0000 7f401affd640 1 -- 172.21.15.59:0/4277510918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f401c109150 msgr2=0x7f401c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:44.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.172+0000 7f401affd640 1 --2- 172.21.15.59:0/4277510918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f401c109150 0x7f401c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.172+0000 7f401affd640 1 -- 172.21.15.59:0/4277510918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401c1a7650 con 0x7f401c102dc0 2024-09-10T21:23:44.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.172+0000 7f4013fff640 1 --2- 172.21.15.59:0/4277510918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f401c1087d0 0x7f401c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:44.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.172+0000 7f401affd640 1 --2- 172.21.15.59:0/4277510918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f401c102dc0 0x7f401c0754a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f400c00eab0 tx=0x7f400c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:44.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.172+0000 7f4018ff9640 1 -- 172.21.15.59:0/4277510918 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c00ce40 con 0x7f401c102dc0 2024-09-10T21:23:44.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.172+0000 7f4018ff9640 1 -- 172.21.15.59:0/4277510918 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f400c011920 con 0x7f401c102dc0 2024-09-10T21:23:44.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.172+0000 7f402130d640 1 -- 172.21.15.59:0/4277510918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f401c1a7940 con 0x7f401c102dc0 2024-09-10T21:23:44.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.172+0000 7f4018ff9640 1 -- 172.21.15.59:0/4277510918 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c010a30 con 0x7f401c102dc0 2024-09-10T21:23:44.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.172+0000 7f402130d640 1 -- 172.21.15.59:0/4277510918 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f401c1a7e50 con 0x7f401c102dc0 2024-09-10T21:23:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.175+0000 7f40236e2740 1 Processor -- start 2024-09-10T21:23:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.175+0000 7f4018ff9640 1 -- 172.21.15.59:0/4277510918 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f400c00f040 con 0x7f401c102dc0 2024-09-10T21:23:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.175+0000 7f40236e2740 1 -- start start 2024-09-10T21:23:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.176+0000 7f40236e2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2d4d0 0x55ad85e2d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.176+0000 7f40236e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad85e2ddf0 0x55ad85e39840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.176+0000 7f40236e2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e39d80 0x55ad85e3c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.176+0000 7f40236e2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ad85da3ea0 con 0x55ad85e2d4d0 2024-09-10T21:23:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.176+0000 7f40236e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ad85d932d0 con 0x55ad85e2ddf0 2024-09-10T21:23:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.176+0000 7f40236e2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ad85d970e0 con 0x55ad85e39d80 2024-09-10T21:23:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.176+0000 7f401b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2d4d0 0x55ad85e2d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.176+0000 7f401b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2d4d0 0x55ad85e2d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56270/0 (socket says 172.21.15.59:56270) 2024-09-10T21:23:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.176+0000 7f401b7fe640 1 -- 172.21.15.59:0/481997013 learned_addr learned my addr 172.21.15.59:0/481997013 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.176+0000 7f401affd640 1 --2- 172.21.15.59:0/481997013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad85e2ddf0 0x55ad85e39840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.176+0000 7f4013fff640 1 --2- 172.21.15.59:0/481997013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e39d80 0x55ad85e3c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.176+0000 7f401b7fe640 1 -- 172.21.15.59:0/481997013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e39d80 msgr2=0x55ad85e3c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.176+0000 7f401b7fe640 1 --2- 172.21.15.59:0/481997013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e39d80 0x55ad85e3c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.176+0000 7f401b7fe640 1 -- 172.21.15.59:0/481997013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad85e2ddf0 msgr2=0x55ad85e39840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.176+0000 7f401b7fe640 1 --2- 172.21.15.59:0/481997013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad85e2ddf0 0x55ad85e39840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.176+0000 7f401b7fe640 1 -- 172.21.15.59:0/481997013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad85af1650 con 0x55ad85e2d4d0 2024-09-10T21:23:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.176+0000 7f4013fff640 1 --2- 172.21.15.59:0/481997013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e39d80 0x55ad85e3c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.176+0000 7f401b7fe640 1 --2- 172.21.15.59:0/481997013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2d4d0 0x55ad85e2d8b0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f401400abc0 tx=0x7f401400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25f3af4aab5e283 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.176+0000 7f4018ff9640 1 --2- 172.21.15.59:0/4277510918 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f40080b52e0 0x7f40080b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.177+0000 7f40117fa640 1 -- 172.21.15.59:0/481997013 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401401d070 con 0x55ad85e2d4d0 2024-09-10T21:23:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.177+0000 7f40117fa640 1 -- 172.21.15.59:0/481997013 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4014018af0 con 0x55ad85e2d4d0 2024-09-10T21:23:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.177+0000 7f401affd640 1 --2- 172.21.15.59:0/4277510918 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f40080b52e0 0x7f40080b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.177+0000 7f40117fa640 1 -- 172.21.15.59:0/481997013 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4014010a40 con 0x55ad85e2d4d0 2024-09-10T21:23:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.177+0000 7f4018ff9640 1 -- 172.21.15.59:0/4277510918 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f400c0e5ef0 con 0x7f401c102dc0 2024-09-10T21:23:44.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.177+0000 7f40236e2740 1 -- 172.21.15.59:0/481997013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2d4d0 msgr2=0x55ad85e2d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:44.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.177+0000 7f401affd640 1 --2- 172.21.15.59:0/4277510918 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f40080b52e0 0x7f40080b77a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f400c0e3d90 tx=0x7f400c000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:44.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.177+0000 7f40236e2740 1 --2- 172.21.15.59:0/481997013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2d4d0 0x55ad85e2d8b0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f401400abc0 tx=0x7f401400f790 comp rx=0 tx=0).stop 2024-09-10T21:23:44.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.178+0000 7f40236e2740 1 -- 172.21.15.59:0/481997013 shutdown_connections 2024-09-10T21:23:44.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.178+0000 7f40236e2740 1 --2- 172.21.15.59:0/481997013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e39d80 0x55ad85e3c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.178+0000 7f40236e2740 1 --2- 172.21.15.59:0/481997013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad85e2ddf0 0x55ad85e39840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.178+0000 7f40236e2740 1 --2- 172.21.15.59:0/481997013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2d4d0 0x55ad85e2d8b0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.178+0000 7f40236e2740 1 -- 172.21.15.59:0/481997013 >> 172.21.15.59:0/481997013 conn(0x55ad85e2b300 msgr2=0x55ad85e2c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:44.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.178+0000 7f40236e2740 1 -- 172.21.15.59:0/481997013 shutdown_connections 2024-09-10T21:23:44.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.178+0000 7f40236e2740 1 -- 172.21.15.59:0/481997013 wait complete. 2024-09-10T21:23:44.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.178+0000 7f40236e2740 1 -- start start 2024-09-10T21:23:44.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.178+0000 7f40236e2740 1 Processor -- start 2024-09-10T21:23:44.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.178+0000 7f40236e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad85e2d4d0 0x55ad85e39730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:44.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.178+0000 7f40236e2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2ddf0 0x55ad85e36b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:44.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.178+0000 7f40236e2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e39d80 0x55ad85e37250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:44.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.178+0000 7f40236e2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ad85bf4700 con 0x55ad85e2ddf0 2024-09-10T21:23:44.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.178+0000 7f40236e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ad85d2e160 con 0x55ad85e2d4d0 2024-09-10T21:23:44.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.178+0000 7f40236e2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ad85e3ca00 con 0x55ad85e39d80 2024-09-10T21:23:44.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.178+0000 7f40236e2740 10 client.0 _ll_register_callbacks cb 0x55ad85d479e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:44.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.178+0000 7f4013fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2ddf0 0x55ad85e36b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:44.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.178+0000 7f4013fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2ddf0 0x55ad85e36b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56284/0 (socket says 172.21.15.59:56284) 2024-09-10T21:23:44.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.178+0000 7f4013fff640 1 -- 172.21.15.59:0/1656304080 learned_addr learned my addr 172.21.15.59:0/1656304080 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:44.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.179+0000 7f401b7fe640 1 --2- 172.21.15.59:0/1656304080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad85e2d4d0 0x55ad85e39730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:44.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.179+0000 7f401b7fe640 1 --2- 172.21.15.59:0/1656304080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e39d80 0x55ad85e37250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:44.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.179+0000 7f4013fff640 1 -- 172.21.15.59:0/1656304080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e39d80 msgr2=0x55ad85e37250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:44.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.179+0000 7f4013fff640 1 --2- 172.21.15.59:0/1656304080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e39d80 0x55ad85e37250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.179+0000 7f4013fff640 1 -- 172.21.15.59:0/1656304080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad85e2d4d0 msgr2=0x55ad85e39730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:44.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.179+0000 7f4013fff640 1 --2- 172.21.15.59:0/1656304080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad85e2d4d0 0x55ad85e39730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.179+0000 7f4013fff640 1 -- 172.21.15.59:0/1656304080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad85d5bc90 con 0x55ad85e2ddf0 2024-09-10T21:23:44.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.179+0000 7f401b7fe640 1 --2- 172.21.15.59:0/1656304080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e39d80 0x55ad85e37250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:44.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.179+0000 7f4013fff640 1 --2- 172.21.15.59:0/1656304080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2ddf0 0x55ad85e36b80 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4004009340 tx=0x7f4004005360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07c547b632f048b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:44.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.179+0000 7f40027fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:44.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.179+0000 7f40027fc640 1 -- 172.21.15.59:0/1656304080 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4004035030 con 0x55ad85e2ddf0 2024-09-10T21:23:44.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.179+0000 7f40027fc640 1 -- 172.21.15.59:0/1656304080 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f40040048c0 con 0x55ad85e2ddf0 2024-09-10T21:23:44.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.179+0000 7f40236e2740 1 -- 172.21.15.59:0/1656304080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4014018af0 con 0x55ad85e2ddf0 2024-09-10T21:23:44.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.179+0000 7f40027fc640 1 -- 172.21.15.59:0/1656304080 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f400404b070 con 0x55ad85e2ddf0 2024-09-10T21:23:44.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.179+0000 7f40236e2740 10 client.17310 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:44.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.179+0000 7f40236e2740 1 -- 172.21.15.59:0/1656304080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ad85e48410 con 0x55ad85e2ddf0 2024-09-10T21:23:44.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.180+0000 7f40027fc640 1 -- 172.21.15.59:0/1656304080 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4014018af0 con 0x55ad85e2ddf0 2024-09-10T21:23:44.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.180+0000 7f40027fc640 1 -- 172.21.15.59:0/1656304080 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f40040314a0 con 0x55ad85e2ddf0 2024-09-10T21:23:44.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.180+0000 7f40236e2740 10 client.17310 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:44.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.180+0000 7f40236e2740 10 client.17310 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:23:44.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.180+0000 7f40236e2740 20 client.17310 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:44.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.180+0000 7f40236e2740 1 --2- 172.21.15.59:0/1656304080 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55ad85e498d0 0x55ad85e4bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.180+0000 7f40236e2740 4 client.17310 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:23:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.180+0000 7f40236e2740 1 -- 172.21.15.59:0/1656304080 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad85da5df0 con 0x55ad85e498d0 2024-09-10T21:23:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.180+0000 7f401b7fe640 1 --2- 172.21.15.59:0/1656304080 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55ad85e498d0 0x55ad85e4bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.180+0000 7f401b7fe640 1 --2- 172.21.15.59:0/1656304080 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55ad85e498d0 0x55ad85e4bcc0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=71f92d44f4332219 server_cookie=6c6f8516e958f51f in_seq=0 out_seq=0 2024-09-10T21:23:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.180+0000 7f40027fc640 10 client.17310 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:23:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.181+0000 7f40027fc640 1 -- 172.21.15.59:0/1656304080 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ad85da5df0 con 0x55ad85e498d0 2024-09-10T21:23:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.181+0000 7f40027fc640 10 client.17310 handle_command_reply: tid=0 2024-09-10T21:23:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.181+0000 7f40236e2740 1 client.17310 shutdown 2024-09-10T21:23:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.181+0000 7f40236e2740 1 -- 172.21.15.59:0/1656304080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2ddf0 msgr2=0x55ad85e36b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.181+0000 7f40236e2740 1 --2- 172.21.15.59:0/1656304080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2ddf0 0x55ad85e36b80 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4004009340 tx=0x7f4004005360 comp rx=0 tx=0).stop 2024-09-10T21:23:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.181+0000 7f40236e2740 1 -- 172.21.15.59:0/1656304080 shutdown_connections 2024-09-10T21:23:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.181+0000 7f40236e2740 1 --2- 172.21.15.59:0/1656304080 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55ad85e498d0 0x55ad85e4bcc0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.181+0000 7f40236e2740 1 --2- 172.21.15.59:0/1656304080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e39d80 0x55ad85e37250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.181+0000 7f40236e2740 1 --2- 172.21.15.59:0/1656304080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2ddf0 0x55ad85e36b80 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.181+0000 7f40236e2740 1 --2- 172.21.15.59:0/1656304080 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad85e2d4d0 0x55ad85e39730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.181+0000 7f40027fc640 0 client.17310 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:23:44.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.181+0000 7f40236e2740 1 -- 172.21.15.59:0/1656304080 >> 172.21.15.59:0/1656304080 conn(0x55ad85e2b300 msgr2=0x55ad85e30ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:44.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.182+0000 7f40236e2740 1 -- 172.21.15.59:0/1656304080 shutdown_connections 2024-09-10T21:23:44.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.182+0000 7f40236e2740 1 -- 172.21.15.59:0/1656304080 wait complete. 2024-09-10T21:23:44.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.182+0000 7f40236e2740 20 client.17310 trim_cache size 0 max 16384 2024-09-10T21:23:44.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.195+0000 7f40236e2740 1 Processor -- start 2024-09-10T21:23:44.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.195+0000 7f40236e2740 1 -- start start 2024-09-10T21:23:44.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.195+0000 7f40236e2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2d4d0 0x55ad85e45c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:44.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.195+0000 7f40236e2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e2ddf0 0x55ad85e2a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:44.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.195+0000 7f40236e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad85e39d80 0x55ad85e3b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:44.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.195+0000 7f40236e2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1b03e0 con 0x55ad85e2d4d0 2024-09-10T21:23:44.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.195+0000 7f40236e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1b1f20 con 0x55ad85e39d80 2024-09-10T21:23:44.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.195+0000 7f40236e2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1b0ab0 con 0x55ad85e2ddf0 2024-09-10T21:23:44.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.195+0000 7f401b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2d4d0 0x55ad85e45c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:44.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.195+0000 7f401b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2d4d0 0x55ad85e45c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56286/0 (socket says 172.21.15.59:56286) 2024-09-10T21:23:44.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.195+0000 7f401b7fe640 1 -- 172.21.15.59:0/3146696782 learned_addr learned my addr 172.21.15.59:0/3146696782 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:44.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.195+0000 7f4013fff640 1 --2- 172.21.15.59:0/3146696782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e2ddf0 0x55ad85e2a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:44.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.196+0000 7f401b7fe640 1 -- 172.21.15.59:0/3146696782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e2ddf0 msgr2=0x55ad85e2a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:44.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.196+0000 7f401b7fe640 1 --2- 172.21.15.59:0/3146696782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e2ddf0 0x55ad85e2a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.196+0000 7f401b7fe640 1 -- 172.21.15.59:0/3146696782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad85e39d80 msgr2=0x55ad85e3b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:44.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.196+0000 7f401b7fe640 1 --2- 172.21.15.59:0/3146696782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad85e39d80 0x55ad85e3b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.196+0000 7f401b7fe640 1 -- 172.21.15.59:0/3146696782 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad85e35080 con 0x55ad85e2d4d0 2024-09-10T21:23:44.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.196+0000 7f401b7fe640 1 --2- 172.21.15.59:0/3146696782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2d4d0 0x55ad85e45c30 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f401400a980 tx=0x7f401400a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5dbdf3b14cc7fc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:44.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.196+0000 7f4010ff9640 1 -- 172.21.15.59:0/3146696782 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401401d040 con 0x55ad85e2d4d0 2024-09-10T21:23:44.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.196+0000 7f4010ff9640 1 -- 172.21.15.59:0/3146696782 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f401401e040 con 0x55ad85e2d4d0 2024-09-10T21:23:44.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.196+0000 7f4010ff9640 1 -- 172.21.15.59:0/3146696782 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4014010770 con 0x55ad85e2d4d0 2024-09-10T21:23:44.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.197+0000 7f40236e2740 1 -- 172.21.15.59:0/3146696782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2d4d0 msgr2=0x55ad85e45c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:44.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.197+0000 7f40236e2740 1 --2- 172.21.15.59:0/3146696782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2d4d0 0x55ad85e45c30 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f401400a980 tx=0x7f401400a780 comp rx=0 tx=0).stop 2024-09-10T21:23:44.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.197+0000 7f40236e2740 1 -- 172.21.15.59:0/3146696782 shutdown_connections 2024-09-10T21:23:44.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.197+0000 7f40236e2740 1 --2- 172.21.15.59:0/3146696782 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad85e39d80 0x55ad85e3b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.197+0000 7f40236e2740 1 --2- 172.21.15.59:0/3146696782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e2ddf0 0x55ad85e2a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.197+0000 7f40236e2740 1 --2- 172.21.15.59:0/3146696782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2d4d0 0x55ad85e45c30 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.197+0000 7f40236e2740 1 -- 172.21.15.59:0/3146696782 >> 172.21.15.59:0/3146696782 conn(0x55ad85e2b300 msgr2=0x55ad85e29c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:44.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.197+0000 7f40236e2740 1 -- 172.21.15.59:0/3146696782 shutdown_connections 2024-09-10T21:23:44.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.197+0000 7f40236e2740 1 -- 172.21.15.59:0/3146696782 wait complete. 2024-09-10T21:23:44.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.197+0000 7f40236e2740 1 -- start start 2024-09-10T21:23:44.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.197+0000 7f40236e2740 1 Processor -- start 2024-09-10T21:23:44.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.197+0000 7f40236e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad85e2d4d0 0x55ad85e41e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:44.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.197+0000 7f40236e2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2ddf0 0x55ad85e423c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:44.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.197+0000 7f40236e2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e39d80 0x55ad85e3cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:44.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.197+0000 7f40236e2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1b1850 con 0x55ad85e2ddf0 2024-09-10T21:23:44.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.197+0000 7f40236e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1b1180 con 0x55ad85e2d4d0 2024-09-10T21:23:44.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.197+0000 7f40236e2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f401c1ae3c0 con 0x55ad85e39d80 2024-09-10T21:23:44.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.198+0000 7f40236e2740 10 client.0 _ll_register_callbacks cb 0x7f4004009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:44.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.198+0000 7f4013fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2ddf0 0x55ad85e423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:44.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.198+0000 7f4013fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2ddf0 0x55ad85e423c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56300/0 (socket says 172.21.15.59:56300) 2024-09-10T21:23:44.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.198+0000 7f4013fff640 1 -- 172.21.15.59:0/3282201852 learned_addr learned my addr 172.21.15.59:0/3282201852 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:44.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.198+0000 7f401b7fe640 1 --2- 172.21.15.59:0/3282201852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad85e2d4d0 0x55ad85e41e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:44.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.198+0000 7f401b7fe640 1 --2- 172.21.15.59:0/3282201852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e39d80 0x55ad85e3cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:44.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.198+0000 7f4013fff640 1 -- 172.21.15.59:0/3282201852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e39d80 msgr2=0x55ad85e3cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:44.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.198+0000 7f4013fff640 1 --2- 172.21.15.59:0/3282201852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e39d80 0x55ad85e3cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.198+0000 7f4013fff640 1 -- 172.21.15.59:0/3282201852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad85e2d4d0 msgr2=0x55ad85e41e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:44.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.198+0000 7f4013fff640 1 --2- 172.21.15.59:0/3282201852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad85e2d4d0 0x55ad85e41e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.198+0000 7f4013fff640 1 -- 172.21.15.59:0/3282201852 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad85e3d3c0 con 0x55ad85e2ddf0 2024-09-10T21:23:44.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.198+0000 7f4013fff640 1 --2- 172.21.15.59:0/3282201852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2ddf0 0x55ad85e423c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f40040318c0 tx=0x7f40040054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77dde8f1345cbac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:44.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.198+0000 7f40027fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:44.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.198+0000 7f40027fc640 1 -- 172.21.15.59:0/3282201852 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4004035070 con 0x55ad85e2ddf0 2024-09-10T21:23:44.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.198+0000 7f40027fc640 1 -- 172.21.15.59:0/3282201852 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4004031cb0 con 0x55ad85e2ddf0 2024-09-10T21:23:44.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.198+0000 7f40236e2740 1 -- 172.21.15.59:0/3282201852 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f401401e040 con 0x55ad85e2ddf0 2024-09-10T21:23:44.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.198+0000 7f40027fc640 1 -- 172.21.15.59:0/3282201852 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f40040046c0 con 0x55ad85e2ddf0 2024-09-10T21:23:44.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.198+0000 7f40236e2740 10 client.17316 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:44.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.199+0000 7f40236e2740 1 -- 172.21.15.59:0/3282201852 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ad85eb71f0 con 0x55ad85e2ddf0 2024-09-10T21:23:44.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.199+0000 7f40027fc640 1 -- 172.21.15.59:0/3282201852 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f401401e040 con 0x55ad85e2ddf0 2024-09-10T21:23:44.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.199+0000 7f40027fc640 1 -- 172.21.15.59:0/3282201852 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4004058060 con 0x55ad85e2ddf0 2024-09-10T21:23:44.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.199+0000 7f40236e2740 10 client.17316 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:44.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.199+0000 7f40236e2740 10 client.17316 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:23:44.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.199+0000 7f40236e2740 20 client.17316 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:44.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.199+0000 7f40236e2740 1 --2- 172.21.15.59:0/3282201852 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55ad85e498d0 0x55ad85eb99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:44.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.199+0000 7f40236e2740 4 client.17316 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:23:44.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.199+0000 7f40236e2740 1 -- 172.21.15.59:0/3282201852 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ad85da18a0 con 0x55ad85e498d0 2024-09-10T21:23:44.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.199+0000 7f401b7fe640 1 --2- 172.21.15.59:0/3282201852 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55ad85e498d0 0x55ad85eb99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:44.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.200+0000 7f401b7fe640 1 --2- 172.21.15.59:0/3282201852 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55ad85e498d0 0x55ad85eb99d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=972de52e2f8d718f server_cookie=1f1eb24e341e17c4 in_seq=0 out_seq=0 2024-09-10T21:23:44.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.200+0000 7f40027fc640 10 client.17316 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:23:44.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.200+0000 7f40027fc640 1 -- 172.21.15.59:0/3282201852 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ad85da18a0 con 0x55ad85e498d0 2024-09-10T21:23:44.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.200+0000 7f40027fc640 10 client.17316 handle_command_reply: tid=0 2024-09-10T21:23:44.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.200+0000 7f40236e2740 1 client.17316 shutdown 2024-09-10T21:23:44.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.200+0000 7f40236e2740 1 -- 172.21.15.59:0/3282201852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2ddf0 msgr2=0x55ad85e423c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:44.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.200+0000 7f40236e2740 1 --2- 172.21.15.59:0/3282201852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2ddf0 0x55ad85e423c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f40040318c0 tx=0x7f40040054a0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.200+0000 7f40236e2740 1 -- 172.21.15.59:0/3282201852 shutdown_connections 2024-09-10T21:23:44.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.200+0000 7f40236e2740 1 --2- 172.21.15.59:0/3282201852 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55ad85e498d0 0x55ad85eb99d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.200+0000 7f40236e2740 1 --2- 172.21.15.59:0/3282201852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ad85e39d80 0x55ad85e3cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.200+0000 7f40236e2740 1 --2- 172.21.15.59:0/3282201852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad85e2ddf0 0x55ad85e423c0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.200+0000 7f40236e2740 1 --2- 172.21.15.59:0/3282201852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ad85e2d4d0 0x55ad85e41e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.200+0000 7f40236e2740 1 -- 172.21.15.59:0/3282201852 >> 172.21.15.59:0/3282201852 conn(0x55ad85e2b300 msgr2=0x55ad85e389d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:44.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.200+0000 7f40027fc640 0 client.17316 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:23:44.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.200+0000 7f40236e2740 1 -- 172.21.15.59:0/3282201852 shutdown_connections 2024-09-10T21:23:44.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.200+0000 7f40236e2740 1 -- 172.21.15.59:0/3282201852 wait complete. 2024-09-10T21:23:44.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.200+0000 7f40236e2740 20 client.17316 trim_cache size 0 max 16384 2024-09-10T21:23:44.208 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:23:44.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.201+0000 7f402130d640 1 -- 172.21.15.59:0/4277510918 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f40080b52e0 msgr2=0x7f40080b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:44.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.201+0000 7f402130d640 1 --2- 172.21.15.59:0/4277510918 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f40080b52e0 0x7f40080b77a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f400c0e3d90 tx=0x7f400c000f40 comp rx=0 tx=0).stop 2024-09-10T21:23:44.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.201+0000 7f402130d640 1 -- 172.21.15.59:0/4277510918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f401c102dc0 msgr2=0x7f401c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:44.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.201+0000 7f402130d640 1 --2- 172.21.15.59:0/4277510918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f401c102dc0 0x7f401c0754a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f400c00eab0 tx=0x7f400c00ef70 comp rx=0 tx=0).stop 2024-09-10T21:23:44.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.201+0000 7f402130d640 1 -- 172.21.15.59:0/4277510918 shutdown_connections 2024-09-10T21:23:44.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.201+0000 7f402130d640 1 --2- 172.21.15.59:0/4277510918 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f40080b52e0 0x7f40080b77a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.201+0000 7f402130d640 1 --2- 172.21.15.59:0/4277510918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f401c109150 0x7f401c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.201+0000 7f402130d640 1 --2- 172.21.15.59:0/4277510918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f401c1087d0 0x7f401c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.201+0000 7f402130d640 1 --2- 172.21.15.59:0/4277510918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f401c102dc0 0x7f401c0754a0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:44.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.201+0000 7f402130d640 1 -- 172.21.15.59:0/4277510918 >> 172.21.15.59:0/4277510918 conn(0x7f401c0fe830 msgr2=0x7f401c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:44.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.201+0000 7f402130d640 1 -- 172.21.15.59:0/4277510918 shutdown_connections 2024-09-10T21:23:44.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:44.201+0000 7f402130d640 1 -- 172.21.15.59:0/4277510918 wait complete. 2024-09-10T21:23:44.898 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:23:45.158 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:23:45.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:45 smithi059 ceph-mon[30888]: pgmap v594: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:23:45.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:45 smithi192 ceph-mon[35363]: pgmap v594: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:23:45.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:45 smithi154 ceph-mon[35041]: pgmap v594: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:23:45.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.643+0000 7fe28af77640 1 -- 172.21.15.59:0/2693603769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe284109150 msgr2=0x7fe28410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:45.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.643+0000 7fe28af77640 1 --2- 172.21.15.59:0/2693603769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe284109150 0x7fe28410f950 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009ca0 tx=0x7fe27c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.643+0000 7fe28af77640 1 -- 172.21.15.59:0/2693603769 shutdown_connections 2024-09-10T21:23:45.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.643+0000 7fe28af77640 1 --2- 172.21.15.59:0/2693603769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe284109150 0x7fe28410f950 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.643+0000 7fe28af77640 1 --2- 172.21.15.59:0/2693603769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe2841087d0 0x7fe284108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.643+0000 7fe28af77640 1 --2- 172.21.15.59:0/2693603769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe284102dc0 0x7fe2841031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.643+0000 7fe28af77640 1 -- 172.21.15.59:0/2693603769 >> 172.21.15.59:0/2693603769 conn(0x7fe2840fe830 msgr2=0x7fe284100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.643+0000 7fe28af77640 1 -- 172.21.15.59:0/2693603769 shutdown_connections 2024-09-10T21:23:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.643+0000 7fe28af77640 1 -- 172.21.15.59:0/2693603769 wait complete. 2024-09-10T21:23:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.643+0000 7fe28af77640 1 Processor -- start 2024-09-10T21:23:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.643+0000 7fe28af77640 1 -- start start 2024-09-10T21:23:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe28af77640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe284102dc0 0x7fe2841992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe28af77640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2841087d0 0x7fe284199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe28af77640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe284109150 0x7fe28419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe28af77640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe284112dd0 con 0x7fe2841087d0 2024-09-10T21:23:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe28af77640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe284112c50 con 0x7fe284109150 2024-09-10T21:23:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe28af77640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe284112f50 con 0x7fe284102dc0 2024-09-10T21:23:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe283fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2841087d0 0x7fe284199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe283fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2841087d0 0x7fe284199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56312/0 (socket says 172.21.15.59:56312) 2024-09-10T21:23:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe283fff640 1 -- 172.21.15.59:0/1018304304 learned_addr learned my addr 172.21.15.59:0/1018304304 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe288d13640 1 --2- 172.21.15.59:0/1018304304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe284102dc0 0x7fe2841992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe289514640 1 --2- 172.21.15.59:0/1018304304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe284109150 0x7fe28419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe283fff640 1 -- 172.21.15.59:0/1018304304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe284102dc0 msgr2=0x7fe2841992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe283fff640 1 --2- 172.21.15.59:0/1018304304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe284102dc0 0x7fe2841992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe283fff640 1 -- 172.21.15.59:0/1018304304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe284109150 msgr2=0x7fe28419eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe283fff640 1 --2- 172.21.15.59:0/1018304304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe284109150 0x7fe28419eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe283fff640 1 -- 172.21.15.59:0/1018304304 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28419f370 con 0x7fe2841087d0 2024-09-10T21:23:45.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe288d13640 1 --2- 172.21.15.59:0/1018304304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe284102dc0 0x7fe2841992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:45.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe289514640 1 --2- 172.21.15.59:0/1018304304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe284109150 0x7fe28419eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:45.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe283fff640 1 --2- 172.21.15.59:0/1018304304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2841087d0 0x7fe284199800 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fe27800d950 tx=0x7fe27800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:45.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe281ffb640 1 -- 172.21.15.59:0/1018304304 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe278017070 con 0x7fe2841087d0 2024-09-10T21:23:45.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe281ffb640 1 -- 172.21.15.59:0/1018304304 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe278009c30 con 0x7fe2841087d0 2024-09-10T21:23:45.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.644+0000 7fe281ffb640 1 -- 172.21.15.59:0/1018304304 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27800f620 con 0x7fe2841087d0 2024-09-10T21:23:45.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.645+0000 7fe28af77640 1 -- 172.21.15.59:0/1018304304 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28419f660 con 0x7fe2841087d0 2024-09-10T21:23:45.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.645+0000 7fe28af77640 1 -- 172.21.15.59:0/1018304304 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2841a5ef0 con 0x7fe2841087d0 2024-09-10T21:23:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.647+0000 7fe281ffb640 1 -- 172.21.15.59:0/1018304304 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fe278010460 con 0x7fe2841087d0 2024-09-10T21:23:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.647+0000 7fe28d34c740 1 Processor -- start 2024-09-10T21:23:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.647+0000 7fe28d34c740 1 -- start start 2024-09-10T21:23:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe28d34c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36650f0 0x5622d36654d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe28d34c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d3665a10 0x5622d3671460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe28d34c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d36719a0 0x5622d3673d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe28d34c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5622d35dbea0 con 0x5622d36719a0 2024-09-10T21:23:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe28d34c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5622d35cb2d0 con 0x5622d36650f0 2024-09-10T21:23:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe28d34c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5622d35cf0e0 con 0x5622d3665a10 2024-09-10T21:23:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe283fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d36719a0 0x5622d3673d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe289514640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36650f0 0x5622d36654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe288d13640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d3665a10 0x5622d3671460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe283fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d36719a0 0x5622d3673d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56328/0 (socket says 172.21.15.59:56328) 2024-09-10T21:23:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe283fff640 1 -- 172.21.15.59:0/340716347 learned_addr learned my addr 172.21.15.59:0/340716347 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe281ffb640 1 --2- 172.21.15.59:0/1018304304 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe26c0b5360 0x7fe26c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe288d13640 1 -- 172.21.15.59:0/340716347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36650f0 msgr2=0x5622d36654d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe288d13640 1 --2- 172.21.15.59:0/340716347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36650f0 0x5622d36654d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe288d13640 1 -- 172.21.15.59:0/340716347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d36719a0 msgr2=0x5622d3673d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe288d13640 1 --2- 172.21.15.59:0/340716347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d36719a0 0x5622d3673d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe288d13640 1 -- 172.21.15.59:0/340716347 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622d3329650 con 0x5622d3665a10 2024-09-10T21:23:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe283fff640 1 --2- 172.21.15.59:0/340716347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d36719a0 0x5622d3673d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:23:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe289514640 1 --2- 172.21.15.59:0/1018304304 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe26c0b5360 0x7fe26c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.648+0000 7fe281ffb640 1 -- 172.21.15.59:0/1018304304 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe2780e5840 con 0x7fe2841087d0 2024-09-10T21:23:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.649+0000 7fe288d13640 1 --2- 172.21.15.59:0/340716347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d3665a10 0x5622d3671460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe274008b80 tx=0x7fe27400e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbcbfb122a74df44 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.649+0000 7fe26affd640 1 -- 172.21.15.59:0/340716347 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe274014070 con 0x5622d3665a10 2024-09-10T21:23:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.649+0000 7fe26affd640 1 -- 172.21.15.59:0/340716347 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2740047a0 con 0x5622d3665a10 2024-09-10T21:23:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.649+0000 7fe26affd640 1 -- 172.21.15.59:0/340716347 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe274010690 con 0x5622d3665a10 2024-09-10T21:23:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.649+0000 7fe289514640 1 --2- 172.21.15.59:0/1018304304 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe26c0b5360 0x7fe26c0b7820 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe27c004af0 tx=0x7fe27c0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.650+0000 7fe28d34c740 1 -- 172.21.15.59:0/340716347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d3665a10 msgr2=0x5622d3671460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.650+0000 7fe28d34c740 1 --2- 172.21.15.59:0/340716347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d3665a10 0x5622d3671460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe274008b80 tx=0x7fe27400e720 comp rx=0 tx=0).stop 2024-09-10T21:23:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.650+0000 7fe28d34c740 1 -- 172.21.15.59:0/340716347 shutdown_connections 2024-09-10T21:23:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.650+0000 7fe28d34c740 1 --2- 172.21.15.59:0/340716347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d36719a0 0x5622d3673d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.650+0000 7fe28d34c740 1 --2- 172.21.15.59:0/340716347 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d3665a10 0x5622d3671460 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.650+0000 7fe28d34c740 1 --2- 172.21.15.59:0/340716347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36650f0 0x5622d36654d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.650+0000 7fe28d34c740 1 -- 172.21.15.59:0/340716347 >> 172.21.15.59:0/340716347 conn(0x5622d3662f20 msgr2=0x5622d36640c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.650+0000 7fe28d34c740 1 -- 172.21.15.59:0/340716347 shutdown_connections 2024-09-10T21:23:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.650+0000 7fe28d34c740 1 -- 172.21.15.59:0/340716347 wait complete. 2024-09-10T21:23:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.650+0000 7fe28d34c740 1 -- start start 2024-09-10T21:23:45.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.650+0000 7fe28d34c740 1 Processor -- start 2024-09-10T21:23:45.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe28d34c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36650f0 0x5622d3671220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe28d34c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d3665a10 0x5622d366e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe28d34c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d36719a0 0x5622d366ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe28d34c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5622d342c700 con 0x5622d36719a0 2024-09-10T21:23:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe28d34c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5622d3566160 con 0x5622d36650f0 2024-09-10T21:23:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe28d34c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5622d3674620 con 0x5622d3665a10 2024-09-10T21:23:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe28d34c740 10 client.0 _ll_register_callbacks cb 0x5622d357f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe289514640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d36719a0 0x5622d366ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe289514640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d36719a0 0x5622d366ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56334/0 (socket says 172.21.15.59:56334) 2024-09-10T21:23:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe289514640 1 -- 172.21.15.59:0/1231743437 learned_addr learned my addr 172.21.15.59:0/1231743437 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe288d13640 1 --2- 172.21.15.59:0/1231743437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36650f0 0x5622d3671220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe283fff640 1 --2- 172.21.15.59:0/1231743437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d3665a10 0x5622d366e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe289514640 1 -- 172.21.15.59:0/1231743437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d3665a10 msgr2=0x5622d366e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe289514640 1 --2- 172.21.15.59:0/1231743437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d3665a10 0x5622d366e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe289514640 1 -- 172.21.15.59:0/1231743437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36650f0 msgr2=0x5622d3671220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe289514640 1 --2- 172.21.15.59:0/1231743437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36650f0 0x5622d3671220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe289514640 1 -- 172.21.15.59:0/1231743437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622d3593c90 con 0x5622d36719a0 2024-09-10T21:23:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe288d13640 1 --2- 172.21.15.59:0/1231743437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36650f0 0x5622d3671220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe289514640 1 --2- 172.21.15.59:0/1231743437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d36719a0 0x5622d366ec10 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0318a0 tx=0x7fe27c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d871aa6abb137270 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe263fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.651+0000 7fe263fff640 1 -- 172.21.15.59:0/1231743437 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c004750 con 0x5622d36719a0 2024-09-10T21:23:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.652+0000 7fe263fff640 1 -- 172.21.15.59:0/1231743437 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe27c02f660 con 0x5622d36719a0 2024-09-10T21:23:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.652+0000 7fe28d34c740 1 -- 172.21.15.59:0/1231743437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2740047a0 con 0x5622d36719a0 2024-09-10T21:23:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.652+0000 7fe263fff640 1 -- 172.21.15.59:0/1231743437 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe27c058020 con 0x5622d36719a0 2024-09-10T21:23:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.652+0000 7fe28d34c740 10 client.17328 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.652+0000 7fe28d34c740 1 -- 172.21.15.59:0/1231743437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5622d367ff20 con 0x5622d36719a0 2024-09-10T21:23:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.652+0000 7fe263fff640 1 -- 172.21.15.59:0/1231743437 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2740047a0 con 0x5622d36719a0 2024-09-10T21:23:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.652+0000 7fe263fff640 1 -- 172.21.15.59:0/1231743437 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe27c030810 con 0x5622d36719a0 2024-09-10T21:23:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.652+0000 7fe28d34c740 10 client.17328 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.652+0000 7fe28d34c740 10 client.17328 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:23:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.652+0000 7fe28d34c740 20 client.17328 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.652+0000 7fe28d34c740 1 --2- 172.21.15.59:0/1231743437 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5622d3681570 0x5622d3683960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.652+0000 7fe28d34c740 4 client.17328 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:23:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.652+0000 7fe28d34c740 1 -- 172.21.15.59:0/1231743437 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622d35dddf0 con 0x5622d3681570 2024-09-10T21:23:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.653+0000 7fe288d13640 1 --2- 172.21.15.59:0/1231743437 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5622d3681570 0x5622d3683960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.653+0000 7fe288d13640 1 --2- 172.21.15.59:0/1231743437 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5622d3681570 0x5622d3683960 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3906454fb148b6eb server_cookie=ed35dfe2232722c8 in_seq=0 out_seq=0 2024-09-10T21:23:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.653+0000 7fe263fff640 10 client.17328 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:23:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.654+0000 7fe263fff640 1 -- 172.21.15.59:0/1231743437 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5622d35dddf0 con 0x5622d3681570 2024-09-10T21:23:45.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.654+0000 7fe263fff640 10 client.17328 handle_command_reply: tid=0 2024-09-10T21:23:45.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.654+0000 7fe28d34c740 1 client.17328 shutdown 2024-09-10T21:23:45.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.654+0000 7fe28d34c740 1 -- 172.21.15.59:0/1231743437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d36719a0 msgr2=0x5622d366ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:45.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.654+0000 7fe28d34c740 1 --2- 172.21.15.59:0/1231743437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d36719a0 0x5622d366ec10 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0318a0 tx=0x7fe27c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.654+0000 7fe28d34c740 1 -- 172.21.15.59:0/1231743437 shutdown_connections 2024-09-10T21:23:45.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.654+0000 7fe28d34c740 1 --2- 172.21.15.59:0/1231743437 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5622d3681570 0x5622d3683960 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.654+0000 7fe28d34c740 1 --2- 172.21.15.59:0/1231743437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d36719a0 0x5622d366ec10 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.654+0000 7fe28d34c740 1 --2- 172.21.15.59:0/1231743437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d3665a10 0x5622d366e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.654+0000 7fe28d34c740 1 --2- 172.21.15.59:0/1231743437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36650f0 0x5622d3671220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.654+0000 7fe28d34c740 1 -- 172.21.15.59:0/1231743437 >> 172.21.15.59:0/1231743437 conn(0x5622d3662f20 msgr2=0x5622d3668a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:45.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.654+0000 7fe263fff640 0 client.17328 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:23:45.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.654+0000 7fe28d34c740 1 -- 172.21.15.59:0/1231743437 shutdown_connections 2024-09-10T21:23:45.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.654+0000 7fe28d34c740 1 -- 172.21.15.59:0/1231743437 wait complete. 2024-09-10T21:23:45.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.654+0000 7fe28d34c740 20 client.17328 trim_cache size 0 max 16384 2024-09-10T21:23:45.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.667+0000 7fe28d34c740 1 Processor -- start 2024-09-10T21:23:45.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.667+0000 7fe28d34c740 1 -- start start 2024-09-10T21:23:45.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe28d34c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36650f0 0x5622d36703b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:45.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe28d34c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d3665a10 0x5622d3672d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:45.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe28d34c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d36719a0 0x5622d36732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:45.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe28d34c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe2841ae380 con 0x5622d3665a10 2024-09-10T21:23:45.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe28d34c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe2841afec0 con 0x5622d36650f0 2024-09-10T21:23:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe28d34c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe2841aea50 con 0x5622d36719a0 2024-09-10T21:23:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe283fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d3665a10 0x5622d3672d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe283fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d3665a10 0x5622d3672d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56344/0 (socket says 172.21.15.59:56344) 2024-09-10T21:23:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe283fff640 1 -- 172.21.15.59:0/2238473996 learned_addr learned my addr 172.21.15.59:0/2238473996 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe289514640 1 --2- 172.21.15.59:0/2238473996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d36719a0 0x5622d36732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe288d13640 1 --2- 172.21.15.59:0/2238473996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36650f0 0x5622d36703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe283fff640 1 -- 172.21.15.59:0/2238473996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d36719a0 msgr2=0x5622d36732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe283fff640 1 --2- 172.21.15.59:0/2238473996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d36719a0 0x5622d36732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe283fff640 1 -- 172.21.15.59:0/2238473996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36650f0 msgr2=0x5622d36703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe283fff640 1 --2- 172.21.15.59:0/2238473996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36650f0 0x5622d36703b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe283fff640 1 -- 172.21.15.59:0/2238473996 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622d3664600 con 0x5622d3665a10 2024-09-10T21:23:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe283fff640 1 --2- 172.21.15.59:0/2238473996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d3665a10 0x5622d3672d90 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fe2780a9240 tx=0x7fe27800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff80ac9bb3899150 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe26a7fc640 1 -- 172.21.15.59:0/2238473996 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe278020030 con 0x5622d3665a10 2024-09-10T21:23:45.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe26a7fc640 1 -- 172.21.15.59:0/2238473996 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2780abae0 con 0x5622d3665a10 2024-09-10T21:23:45.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.668+0000 7fe26a7fc640 1 -- 172.21.15.59:0/2238473996 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2780b5560 con 0x5622d3665a10 2024-09-10T21:23:45.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.669+0000 7fe28d34c740 1 -- 172.21.15.59:0/2238473996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d3665a10 msgr2=0x5622d3672d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:45.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.669+0000 7fe28d34c740 1 --2- 172.21.15.59:0/2238473996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d3665a10 0x5622d3672d90 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fe2780a9240 tx=0x7fe27800bf60 comp rx=0 tx=0).stop 2024-09-10T21:23:45.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.669+0000 7fe28d34c740 1 -- 172.21.15.59:0/2238473996 shutdown_connections 2024-09-10T21:23:45.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.669+0000 7fe28d34c740 1 --2- 172.21.15.59:0/2238473996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d36719a0 0x5622d36732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.669+0000 7fe28d34c740 1 --2- 172.21.15.59:0/2238473996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d3665a10 0x5622d3672d90 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.669+0000 7fe28d34c740 1 --2- 172.21.15.59:0/2238473996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36650f0 0x5622d36703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.669+0000 7fe28d34c740 1 -- 172.21.15.59:0/2238473996 >> 172.21.15.59:0/2238473996 conn(0x5622d3662f20 msgr2=0x5622d366fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:45.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.669+0000 7fe28d34c740 1 -- 172.21.15.59:0/2238473996 shutdown_connections 2024-09-10T21:23:45.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.669+0000 7fe28d34c740 1 -- 172.21.15.59:0/2238473996 wait complete. 2024-09-10T21:23:45.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.669+0000 7fe28d34c740 1 -- start start 2024-09-10T21:23:45.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.670+0000 7fe28d34c740 1 Processor -- start 2024-09-10T21:23:45.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.670+0000 7fe28d34c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d36650f0 0x5622d367a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:45.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.670+0000 7fe28d34c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d3665a10 0x5622d36748a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:45.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.670+0000 7fe28d34c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36719a0 0x5622d3674f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:45.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.670+0000 7fe28d34c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe2841af7f0 con 0x5622d3665a10 2024-09-10T21:23:45.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.670+0000 7fe28d34c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe2841af120 con 0x5622d36719a0 2024-09-10T21:23:45.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.670+0000 7fe28d34c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe2841ac360 con 0x5622d36650f0 2024-09-10T21:23:45.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.670+0000 7fe28d34c740 10 client.0 _ll_register_callbacks cb 0x7fe27c031520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:45.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.670+0000 7fe283fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d3665a10 0x5622d36748a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:45.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.670+0000 7fe283fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d3665a10 0x5622d36748a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56348/0 (socket says 172.21.15.59:56348) 2024-09-10T21:23:45.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.670+0000 7fe283fff640 1 -- 172.21.15.59:0/3387614642 learned_addr learned my addr 172.21.15.59:0/3387614642 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:45.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.670+0000 7fe288d13640 1 --2- 172.21.15.59:0/3387614642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d36650f0 0x5622d367a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:45.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.670+0000 7fe289514640 1 --2- 172.21.15.59:0/3387614642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36719a0 0x5622d3674f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:45.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.671+0000 7fe283fff640 1 -- 172.21.15.59:0/3387614642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d36650f0 msgr2=0x5622d367a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:45.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.671+0000 7fe283fff640 1 --2- 172.21.15.59:0/3387614642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d36650f0 0x5622d367a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.671+0000 7fe283fff640 1 -- 172.21.15.59:0/3387614642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36719a0 msgr2=0x5622d3674f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:45.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.671+0000 7fe283fff640 1 --2- 172.21.15.59:0/3387614642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36719a0 0x5622d3674f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.671+0000 7fe283fff640 1 -- 172.21.15.59:0/3387614642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622d3671590 con 0x5622d3665a10 2024-09-10T21:23:45.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.671+0000 7fe283fff640 1 --2- 172.21.15.59:0/3387614642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d3665a10 0x5622d36748a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fe2780058c0 tx=0x7fe278010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a819da89d6034a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:45.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.671+0000 7fe263fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:45.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.671+0000 7fe263fff640 1 -- 172.21.15.59:0/3387614642 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe278020070 con 0x5622d3665a10 2024-09-10T21:23:45.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.671+0000 7fe263fff640 1 -- 172.21.15.59:0/3387614642 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe2780ab430 con 0x5622d3665a10 2024-09-10T21:23:45.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.671+0000 7fe28d34c740 1 -- 172.21.15.59:0/3387614642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2780abae0 con 0x5622d3665a10 2024-09-10T21:23:45.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.671+0000 7fe263fff640 1 -- 172.21.15.59:0/3387614642 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe278009de0 con 0x5622d3665a10 2024-09-10T21:23:45.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.671+0000 7fe28d34c740 10 client.17334 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:45.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.671+0000 7fe28d34c740 1 -- 172.21.15.59:0/3387614642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5622d36ef2e0 con 0x5622d3665a10 2024-09-10T21:23:45.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.671+0000 7fe263fff640 1 -- 172.21.15.59:0/3387614642 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2780abae0 con 0x5622d3665a10 2024-09-10T21:23:45.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.671+0000 7fe263fff640 1 -- 172.21.15.59:0/3387614642 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe2780a7920 con 0x5622d3665a10 2024-09-10T21:23:45.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.672+0000 7fe28d34c740 10 client.17334 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:45.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.672+0000 7fe28d34c740 10 client.17334 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:23:45.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.672+0000 7fe28d34c740 20 client.17334 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:45.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.672+0000 7fe28d34c740 1 --2- 172.21.15.59:0/3387614642 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5622d36ef9e0 0x5622d36f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:45.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.672+0000 7fe28d34c740 4 client.17334 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:23:45.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.672+0000 7fe28d34c740 1 -- 172.21.15.59:0/3387614642 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5622d35d98a0 con 0x5622d36ef9e0 2024-09-10T21:23:45.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.672+0000 7fe288d13640 1 --2- 172.21.15.59:0/3387614642 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5622d36ef9e0 0x5622d36f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:45.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.672+0000 7fe288d13640 1 --2- 172.21.15.59:0/3387614642 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5622d36ef9e0 0x5622d36f1e00 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6c4f8e3184c42627 server_cookie=16d3a082644f864a in_seq=0 out_seq=0 2024-09-10T21:23:45.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.672+0000 7fe263fff640 10 client.17334 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:23:45.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.672+0000 7fe263fff640 1 -- 172.21.15.59:0/3387614642 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5622d35d98a0 con 0x5622d36ef9e0 2024-09-10T21:23:45.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.672+0000 7fe263fff640 10 client.17334 handle_command_reply: tid=0 2024-09-10T21:23:45.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.672+0000 7fe28d34c740 1 client.17334 shutdown 2024-09-10T21:23:45.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.673+0000 7fe28d34c740 1 -- 172.21.15.59:0/3387614642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d3665a10 msgr2=0x5622d36748a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:45.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.673+0000 7fe28d34c740 1 --2- 172.21.15.59:0/3387614642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d3665a10 0x5622d36748a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fe2780058c0 tx=0x7fe278010cb0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.673+0000 7fe28d34c740 1 -- 172.21.15.59:0/3387614642 shutdown_connections 2024-09-10T21:23:45.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.673+0000 7fe28d34c740 1 --2- 172.21.15.59:0/3387614642 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5622d36ef9e0 0x5622d36f1e00 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.673+0000 7fe28d34c740 1 --2- 172.21.15.59:0/3387614642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5622d36719a0 0x5622d3674f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.673+0000 7fe28d34c740 1 --2- 172.21.15.59:0/3387614642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5622d3665a10 0x5622d36748a0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.673+0000 7fe28d34c740 1 --2- 172.21.15.59:0/3387614642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5622d36650f0 0x5622d367a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.673+0000 7fe28d34c740 1 -- 172.21.15.59:0/3387614642 >> 172.21.15.59:0/3387614642 conn(0x5622d3662f20 msgr2=0x5622d36704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:45.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.673+0000 7fe263fff640 0 client.17334 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:23:45.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.673+0000 7fe28d34c740 1 -- 172.21.15.59:0/3387614642 shutdown_connections 2024-09-10T21:23:45.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.673+0000 7fe28d34c740 1 -- 172.21.15.59:0/3387614642 wait complete. 2024-09-10T21:23:45.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.673+0000 7fe28d34c740 20 client.17334 trim_cache size 0 max 16384 2024-09-10T21:23:45.681 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:23:45.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.673+0000 7fe28af77640 1 -- 172.21.15.59:0/1018304304 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe26c0b5360 msgr2=0x7fe26c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:45.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.673+0000 7fe28af77640 1 --2- 172.21.15.59:0/1018304304 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe26c0b5360 0x7fe26c0b7820 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe27c004af0 tx=0x7fe27c0095c0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.673+0000 7fe28af77640 1 -- 172.21.15.59:0/1018304304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2841087d0 msgr2=0x7fe284199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:45.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.673+0000 7fe28af77640 1 --2- 172.21.15.59:0/1018304304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2841087d0 0x7fe284199800 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fe27800d950 tx=0x7fe27800de10 comp rx=0 tx=0).stop 2024-09-10T21:23:45.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.674+0000 7fe28af77640 1 -- 172.21.15.59:0/1018304304 shutdown_connections 2024-09-10T21:23:45.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.674+0000 7fe28af77640 1 --2- 172.21.15.59:0/1018304304 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe26c0b5360 0x7fe26c0b7820 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.674+0000 7fe28af77640 1 --2- 172.21.15.59:0/1018304304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe284109150 0x7fe28419eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.674+0000 7fe28af77640 1 --2- 172.21.15.59:0/1018304304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2841087d0 0x7fe284199800 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.674+0000 7fe28af77640 1 --2- 172.21.15.59:0/1018304304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe284102dc0 0x7fe2841992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:45.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.674+0000 7fe28af77640 1 -- 172.21.15.59:0/1018304304 >> 172.21.15.59:0/1018304304 conn(0x7fe2840fe830 msgr2=0x7fe2840ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:45.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.674+0000 7fe28af77640 1 -- 172.21.15.59:0/1018304304 shutdown_connections 2024-09-10T21:23:45.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:45.674+0000 7fe28af77640 1 -- 172.21.15.59:0/1018304304 wait complete. 2024-09-10T21:23:46.521 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:23:46.779 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:23:47.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:47 smithi059 ceph-mon[30888]: pgmap v595: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:23:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.296+0000 7f78f1920640 1 -- 172.21.15.59:0/431883790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec103ce0 msgr2=0x7f78ec1040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.296+0000 7f78f1920640 1 --2- 172.21.15.59:0/431883790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec103ce0 0x7f78ec1040c0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009900 tx=0x7f78dc02a410 comp rx=0 tx=0).stop 2024-09-10T21:23:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.296+0000 7f78f1920640 1 -- 172.21.15.59:0/431883790 shutdown_connections 2024-09-10T21:23:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.296+0000 7f78f1920640 1 --2- 172.21.15.59:0/431883790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78ec10d140 0x7f78ec10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.296+0000 7f78f1920640 1 --2- 172.21.15.59:0/431883790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78ec104600 0x7f78ec10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.296+0000 7f78f1920640 1 --2- 172.21.15.59:0/431883790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec103ce0 0x7f78ec1040c0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.296+0000 7f78f1920640 1 -- 172.21.15.59:0/431883790 >> 172.21.15.59:0/431883790 conn(0x7f78ec0fd700 msgr2=0x7f78ec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.296+0000 7f78f1920640 1 -- 172.21.15.59:0/431883790 shutdown_connections 2024-09-10T21:23:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.296+0000 7f78f1920640 1 -- 172.21.15.59:0/431883790 wait complete. 2024-09-10T21:23:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.297+0000 7f78f1920640 1 Processor -- start 2024-09-10T21:23:47.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.297+0000 7f78f1920640 1 -- start start 2024-09-10T21:23:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.297+0000 7f78f1920640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78ec103ce0 0x7f78ec1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:47.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.297+0000 7f78f1920640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78ec104600 0x7f78ec1997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.297+0000 7f78f1920640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec10d140 0x7f78ec19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.297+0000 7f78f1920640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec112db0 con 0x7f78ec10d140 2024-09-10T21:23:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.297+0000 7f78f1920640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec112c30 con 0x7f78ec104600 2024-09-10T21:23:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.297+0000 7f78f1920640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec112f30 con 0x7f78ec103ce0 2024-09-10T21:23:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.298+0000 7f78eb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec10d140 0x7f78ec19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.298+0000 7f78eb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec10d140 0x7f78ec19eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56360/0 (socket says 172.21.15.59:56360) 2024-09-10T21:23:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.298+0000 7f78eb7fe640 1 -- 172.21.15.59:0/1680516397 learned_addr learned my addr 172.21.15.59:0/1680516397 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.298+0000 7f78eaffd640 1 --2- 172.21.15.59:0/1680516397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78ec103ce0 0x7f78ec1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.298+0000 7f78ea7fc640 1 --2- 172.21.15.59:0/1680516397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78ec104600 0x7f78ec1997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.298+0000 7f78eb7fe640 1 -- 172.21.15.59:0/1680516397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78ec103ce0 msgr2=0x7f78ec1992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.298+0000 7f78eb7fe640 1 --2- 172.21.15.59:0/1680516397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78ec103ce0 0x7f78ec1992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.298+0000 7f78eb7fe640 1 -- 172.21.15.59:0/1680516397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78ec104600 msgr2=0x7f78ec1997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:47.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.298+0000 7f78eb7fe640 1 --2- 172.21.15.59:0/1680516397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78ec104600 0x7f78ec1997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.298+0000 7f78eb7fe640 1 -- 172.21.15.59:0/1680516397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ec19f350 con 0x7f78ec10d140 2024-09-10T21:23:47.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.298+0000 7f78eb7fe640 1 --2- 172.21.15.59:0/1680516397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec10d140 0x7f78ec19eb80 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f78e400eaa0 tx=0x7f78e400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:47.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.298+0000 7f78f091e640 1 -- 172.21.15.59:0/1680516397 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e400cdb0 con 0x7f78ec10d140 2024-09-10T21:23:47.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.298+0000 7f78f1920640 1 -- 172.21.15.59:0/1680516397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78ec19f640 con 0x7f78ec10d140 2024-09-10T21:23:47.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.298+0000 7f78f091e640 1 -- 172.21.15.59:0/1680516397 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78e4005020 con 0x7f78ec10d140 2024-09-10T21:23:47.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.298+0000 7f78f091e640 1 -- 172.21.15.59:0/1680516397 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e40116d0 con 0x7f78ec10d140 2024-09-10T21:23:47.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.298+0000 7f78f1920640 1 -- 172.21.15.59:0/1680516397 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78ec1a5d00 con 0x7f78ec10d140 2024-09-10T21:23:47.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.301+0000 7f78f3cf5740 1 Processor -- start 2024-09-10T21:23:47.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.301+0000 7f78f091e640 1 -- 172.21.15.59:0/1680516397 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f78e4022060 con 0x7f78ec10d140 2024-09-10T21:23:47.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.301+0000 7f78f3cf5740 1 -- start start 2024-09-10T21:23:47.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.301+0000 7f78f3cf5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb64d0 0x558b59bb68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:47.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.301+0000 7f78f3cf5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bb6df0 0x558b59bc2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:47.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.301+0000 7f78f3cf5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 0x558b59bc5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:47.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.301+0000 7f78f3cf5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558b59b2cea0 con 0x558b59bc2d80 2024-09-10T21:23:47.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.301+0000 7f78f3cf5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558b59b1c2d0 con 0x558b59bb6df0 2024-09-10T21:23:47.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.301+0000 7f78f3cf5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558b59b200e0 con 0x558b59bb64d0 2024-09-10T21:23:47.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.302+0000 7f78ea7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 0x558b59bc5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:47.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.302+0000 7f78ea7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 0x558b59bc5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56370/0 (socket says 172.21.15.59:56370) 2024-09-10T21:23:47.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.302+0000 7f78ea7fc640 1 -- 172.21.15.59:0/3691903459 learned_addr learned my addr 172.21.15.59:0/3691903459 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:47.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.302+0000 7f78ea7fc640 1 --2- 172.21.15.59:0/3691903459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb64d0 0x558b59bb68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:47.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.302+0000 7f78eaffd640 1 --2- 172.21.15.59:0/3691903459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bb6df0 0x558b59bc2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:47.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.302+0000 7f78ea7fc640 1 -- 172.21.15.59:0/3691903459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb64d0 msgr2=0x558b59bb68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:47.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.302+0000 7f78ea7fc640 1 --2- 172.21.15.59:0/3691903459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb64d0 0x558b59bb68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.302+0000 7f78ea7fc640 1 -- 172.21.15.59:0/3691903459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bb6df0 msgr2=0x558b59bc2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:47.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.302+0000 7f78ea7fc640 1 --2- 172.21.15.59:0/3691903459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bb6df0 0x558b59bc2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.302+0000 7f78ea7fc640 1 -- 172.21.15.59:0/3691903459 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b5987a650 con 0x558b59bc2d80 2024-09-10T21:23:47.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.302+0000 7f78f091e640 1 --2- 172.21.15.59:0/1680516397 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f78d40b52e0 0x7f78d40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:47.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.302+0000 7f78ea7fc640 1 --2- 172.21.15.59:0/3691903459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 0x558b59bc5170 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f78e00127f0 tx=0x7f78e0005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27c7aac4ac5863b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:47.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.302+0000 7f78eaffd640 1 --2- 172.21.15.59:0/1680516397 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f78d40b52e0 0x7f78d40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:47.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.302+0000 7f78f091e640 1 -- 172.21.15.59:0/1680516397 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f78e40e55d0 con 0x7f78ec10d140 2024-09-10T21:23:47.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.302+0000 7f78d1ffb640 1 -- 172.21.15.59:0/3691903459 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0012d70 con 0x558b59bc2d80 2024-09-10T21:23:47.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.302+0000 7f78d1ffb640 1 -- 172.21.15.59:0/3691903459 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78e0005020 con 0x558b59bc2d80 2024-09-10T21:23:47.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.302+0000 7f78d1ffb640 1 -- 172.21.15.59:0/3691903459 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0004a00 con 0x558b59bc2d80 2024-09-10T21:23:47.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.303+0000 7f78eaffd640 1 --2- 172.21.15.59:0/1680516397 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f78d40b52e0 0x7f78d40b77a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f78dc031440 tx=0x7f78dc005890 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:47.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.303+0000 7f78f3cf5740 1 -- 172.21.15.59:0/3691903459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 msgr2=0x558b59bc5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:47.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.303+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/3691903459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 0x558b59bc5170 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f78e00127f0 tx=0x7f78e0005c50 comp rx=0 tx=0).stop 2024-09-10T21:23:47.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.303+0000 7f78f3cf5740 1 -- 172.21.15.59:0/3691903459 shutdown_connections 2024-09-10T21:23:47.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.303+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/3691903459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 0x558b59bc5170 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.303+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/3691903459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bb6df0 0x558b59bc2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.303+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/3691903459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb64d0 0x558b59bb68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.303+0000 7f78f3cf5740 1 -- 172.21.15.59:0/3691903459 >> 172.21.15.59:0/3691903459 conn(0x558b59bb4300 msgr2=0x558b59bb54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:47.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.303+0000 7f78f3cf5740 1 -- 172.21.15.59:0/3691903459 shutdown_connections 2024-09-10T21:23:47.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.303+0000 7f78f3cf5740 1 -- 172.21.15.59:0/3691903459 wait complete. 2024-09-10T21:23:47.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.304+0000 7f78f3cf5740 1 -- start start 2024-09-10T21:23:47.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.304+0000 7f78f3cf5740 1 Processor -- start 2024-09-10T21:23:47.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.304+0000 7f78f3cf5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb64d0 0x558b59bc27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:47.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.304+0000 7f78f3cf5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bb6df0 0x558b59bbfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:47.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.304+0000 7f78f3cf5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 0x558b59bc0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:47.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.304+0000 7f78f3cf5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558b5997d700 con 0x558b59bc2d80 2024-09-10T21:23:47.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.304+0000 7f78f3cf5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558b59ab7160 con 0x558b59bb6df0 2024-09-10T21:23:47.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.304+0000 7f78f3cf5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558b59bc5a00 con 0x558b59bb64d0 2024-09-10T21:23:47.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.304+0000 7f78f3cf5740 10 client.0 _ll_register_callbacks cb 0x558b59ad09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:47.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.304+0000 7f78eb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 0x558b59bc0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:47.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.304+0000 7f78eb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 0x558b59bc0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56376/0 (socket says 172.21.15.59:56376) 2024-09-10T21:23:47.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.304+0000 7f78eb7fe640 1 -- 172.21.15.59:0/1252817862 learned_addr learned my addr 172.21.15.59:0/1252817862 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:47.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.304+0000 7f78eaffd640 1 --2- 172.21.15.59:0/1252817862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb64d0 0x558b59bc27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:47.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.305+0000 7f78ea7fc640 1 --2- 172.21.15.59:0/1252817862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bb6df0 0x558b59bbfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:47.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.305+0000 7f78eb7fe640 1 -- 172.21.15.59:0/1252817862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb64d0 msgr2=0x558b59bc27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:47.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.305+0000 7f78eb7fe640 1 --2- 172.21.15.59:0/1252817862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb64d0 0x558b59bc27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.305+0000 7f78eb7fe640 1 -- 172.21.15.59:0/1252817862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bb6df0 msgr2=0x558b59bbfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:47.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.305+0000 7f78eb7fe640 1 --2- 172.21.15.59:0/1252817862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bb6df0 0x558b59bbfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.305+0000 7f78eb7fe640 1 -- 172.21.15.59:0/1252817862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b59ae4c90 con 0x558b59bc2d80 2024-09-10T21:23:47.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.305+0000 7f78eb7fe640 1 --2- 172.21.15.59:0/1252817862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 0x558b59bc0380 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f78e400cfd0 tx=0x7f78e40ab6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bbccfc5a2e8cc87 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:47.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.305+0000 7f78caffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:47.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.305+0000 7f78caffd640 1 -- 172.21.15.59:0/1252817862 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e401f040 con 0x558b59bc2d80 2024-09-10T21:23:47.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.305+0000 7f78caffd640 1 -- 172.21.15.59:0/1252817862 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f78e40930c0 con 0x558b59bc2d80 2024-09-10T21:23:47.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.305+0000 7f78f3cf5740 1 -- 172.21.15.59:0/1252817862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78e0005020 con 0x558b59bc2d80 2024-09-10T21:23:47.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.305+0000 7f78caffd640 1 -- 172.21.15.59:0/1252817862 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f78e4093300 con 0x558b59bc2d80 2024-09-10T21:23:47.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.305+0000 7f78f3cf5740 10 client.17346 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:47.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.305+0000 7f78f3cf5740 1 -- 172.21.15.59:0/1252817862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558b59bd1460 con 0x558b59bc2d80 2024-09-10T21:23:47.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.305+0000 7f78caffd640 1 -- 172.21.15.59:0/1252817862 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78e0005020 con 0x558b59bc2d80 2024-09-10T21:23:47.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.306+0000 7f78caffd640 1 -- 172.21.15.59:0/1252817862 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f78e400f040 con 0x558b59bc2d80 2024-09-10T21:23:47.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.306+0000 7f78f3cf5740 10 client.17346 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:47.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.306+0000 7f78f3cf5740 10 client.17346 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:23:47.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.306+0000 7f78f3cf5740 20 client.17346 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:47.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.306+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/1252817862 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x558b59bd29c0 0x558b59bd4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:47.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.306+0000 7f78f3cf5740 4 client.17346 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:23:47.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.306+0000 7f78f3cf5740 1 -- 172.21.15.59:0/1252817862 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b59b2edf0 con 0x558b59bd29c0 2024-09-10T21:23:47.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.306+0000 7f78eaffd640 1 --2- 172.21.15.59:0/1252817862 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x558b59bd29c0 0x558b59bd4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:47.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.307+0000 7f78eaffd640 1 --2- 172.21.15.59:0/1252817862 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x558b59bd29c0 0x558b59bd4db0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4a2d11ba011aa073 server_cookie=4266201073eebf54 in_seq=0 out_seq=0 2024-09-10T21:23:47.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.307+0000 7f78caffd640 10 client.17346 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:23:47.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.307+0000 7f78caffd640 1 -- 172.21.15.59:0/1252817862 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558b59b2edf0 con 0x558b59bd29c0 2024-09-10T21:23:47.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.307+0000 7f78caffd640 10 client.17346 handle_command_reply: tid=0 2024-09-10T21:23:47.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.307+0000 7f78f3cf5740 1 client.17346 shutdown 2024-09-10T21:23:47.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.307+0000 7f78f3cf5740 1 -- 172.21.15.59:0/1252817862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 msgr2=0x558b59bc0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:47.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.307+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/1252817862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 0x558b59bc0380 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f78e400cfd0 tx=0x7f78e40ab6a0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.307+0000 7f78f3cf5740 1 -- 172.21.15.59:0/1252817862 shutdown_connections 2024-09-10T21:23:47.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.308+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/1252817862 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x558b59bd29c0 0x558b59bd4db0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.308+0000 7f78caffd640 0 client.17346 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:23:47.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.308+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/1252817862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 0x558b59bc0380 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.308+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/1252817862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bb6df0 0x558b59bbfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.308+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/1252817862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb64d0 0x558b59bc27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.308+0000 7f78f3cf5740 1 -- 172.21.15.59:0/1252817862 >> 172.21.15.59:0/1252817862 conn(0x558b59bb4300 msgr2=0x558b59bb9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:47.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.308+0000 7f78f3cf5740 1 -- 172.21.15.59:0/1252817862 shutdown_connections 2024-09-10T21:23:47.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.308+0000 7f78f3cf5740 1 -- 172.21.15.59:0/1252817862 wait complete. 2024-09-10T21:23:47.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.308+0000 7f78f3cf5740 20 client.17346 trim_cache size 0 max 16384 2024-09-10T21:23:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78f3cf5740 1 Processor -- start 2024-09-10T21:23:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78f3cf5740 1 -- start start 2024-09-10T21:23:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78f3cf5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bb64d0 0x558b59bb3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:47.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78f3cf5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb6df0 0x558b59bc1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:47.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78f3cf5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 0x558b59bc4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:47.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78f3cf5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec1ae290 con 0x558b59bc2d80 2024-09-10T21:23:47.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78f3cf5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec1afdd0 con 0x558b59bb64d0 2024-09-10T21:23:47.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78f3cf5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec1ae960 con 0x558b59bb6df0 2024-09-10T21:23:47.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78eb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 0x558b59bc4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:47.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78eb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 0x558b59bc4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56392/0 (socket says 172.21.15.59:56392) 2024-09-10T21:23:47.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78eb7fe640 1 -- 172.21.15.59:0/3773111661 learned_addr learned my addr 172.21.15.59:0/3773111661 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:47.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78ea7fc640 1 --2- 172.21.15.59:0/3773111661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb6df0 0x558b59bc1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:47.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78eaffd640 1 --2- 172.21.15.59:0/3773111661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bb64d0 0x558b59bb3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:47.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78eb7fe640 1 -- 172.21.15.59:0/3773111661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb6df0 msgr2=0x558b59bc1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:47.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78eb7fe640 1 --2- 172.21.15.59:0/3773111661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb6df0 0x558b59bc1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78eb7fe640 1 -- 172.21.15.59:0/3773111661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bb64d0 msgr2=0x558b59bb3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78eb7fe640 1 --2- 172.21.15.59:0/3773111661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bb64d0 0x558b59bb3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78eb7fe640 1 -- 172.21.15.59:0/3773111661 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b59bb6c20 con 0x558b59bc2d80 2024-09-10T21:23:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78ea7fc640 1 --2- 172.21.15.59:0/3773111661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb6df0 0x558b59bc1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.321+0000 7f78eaffd640 1 --2- 172.21.15.59:0/3773111661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bb64d0 0x558b59bb3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.322+0000 7f78eb7fe640 1 --2- 172.21.15.59:0/3773111661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 0x558b59bc4170 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f78e40a8440 tx=0x7f78e40ab710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4690e3668e243f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.322+0000 7f78d17fa640 1 -- 172.21.15.59:0/3773111661 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e401f070 con 0x558b59bc2d80 2024-09-10T21:23:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.322+0000 7f78d17fa640 1 -- 172.21.15.59:0/3773111661 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78e40930a0 con 0x558b59bc2d80 2024-09-10T21:23:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.322+0000 7f78d17fa640 1 -- 172.21.15.59:0/3773111661 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e40a7a20 con 0x558b59bc2d80 2024-09-10T21:23:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.322+0000 7f78f3cf5740 1 -- 172.21.15.59:0/3773111661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 msgr2=0x558b59bc4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.322+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/3773111661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 0x558b59bc4170 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f78e40a8440 tx=0x7f78e40ab710 comp rx=0 tx=0).stop 2024-09-10T21:23:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.322+0000 7f78f3cf5740 1 -- 172.21.15.59:0/3773111661 shutdown_connections 2024-09-10T21:23:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.322+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/3773111661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bc2d80 0x558b59bc4170 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.322+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/3773111661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb6df0 0x558b59bc1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.322+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/3773111661 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bb64d0 0x558b59bb3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.322+0000 7f78f3cf5740 1 -- 172.21.15.59:0/3773111661 >> 172.21.15.59:0/3773111661 conn(0x558b59bb4300 msgr2=0x558b59bc1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.322+0000 7f78f3cf5740 1 -- 172.21.15.59:0/3773111661 shutdown_connections 2024-09-10T21:23:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.322+0000 7f78f3cf5740 1 -- 172.21.15.59:0/3773111661 wait complete. 2024-09-10T21:23:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.323+0000 7f78f3cf5740 1 -- start start 2024-09-10T21:23:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.323+0000 7f78f3cf5740 1 Processor -- start 2024-09-10T21:23:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.323+0000 7f78f3cf5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bb64d0 0x558b59bc4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.323+0000 7f78f3cf5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb6df0 0x558b59bc48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.323+0000 7f78f3cf5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bc2d80 0x558b59bc4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.323+0000 7f78f3cf5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec1af700 con 0x558b59bb64d0 2024-09-10T21:23:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.323+0000 7f78f3cf5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec1af030 con 0x558b59bc2d80 2024-09-10T21:23:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.323+0000 7f78f3cf5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec1ac270 con 0x558b59bb6df0 2024-09-10T21:23:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.323+0000 7f78f3cf5740 10 client.0 _ll_register_callbacks cb 0x7f78e4009270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:47.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.323+0000 7f78eaffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bb64d0 0x558b59bc4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.323+0000 7f78eaffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bb64d0 0x558b59bc4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56396/0 (socket says 172.21.15.59:56396) 2024-09-10T21:23:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.323+0000 7f78eaffd640 1 -- 172.21.15.59:0/2669106165 learned_addr learned my addr 172.21.15.59:0/2669106165 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.323+0000 7f78ea7fc640 1 --2- 172.21.15.59:0/2669106165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb6df0 0x558b59bc48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.324+0000 7f78eb7fe640 1 --2- 172.21.15.59:0/2669106165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bc2d80 0x558b59bc4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.324+0000 7f78eaffd640 1 -- 172.21.15.59:0/2669106165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb6df0 msgr2=0x558b59bc48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.324+0000 7f78eaffd640 1 --2- 172.21.15.59:0/2669106165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb6df0 0x558b59bc48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.324+0000 7f78eaffd640 1 -- 172.21.15.59:0/2669106165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bc2d80 msgr2=0x558b59bc4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.324+0000 7f78eaffd640 1 --2- 172.21.15.59:0/2669106165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bc2d80 0x558b59bc4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.324+0000 7f78eaffd640 1 -- 172.21.15.59:0/2669106165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b59bc6020 con 0x558b59bb64d0 2024-09-10T21:23:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.324+0000 7f78eb7fe640 1 --2- 172.21.15.59:0/2669106165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bc2d80 0x558b59bc4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.324+0000 7f78eaffd640 1 --2- 172.21.15.59:0/2669106165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bb64d0 0x558b59bc4390 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f78dc02a930 tx=0x7f78dc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef5c7a1b836096d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.324+0000 7f78caffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:47.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.324+0000 7f78caffd640 1 -- 172.21.15.59:0/2669106165 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc035040 con 0x558b59bb64d0 2024-09-10T21:23:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.324+0000 7f78caffd640 1 -- 172.21.15.59:0/2669106165 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f78dc005240 con 0x558b59bb64d0 2024-09-10T21:23:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.324+0000 7f78f3cf5740 1 -- 172.21.15.59:0/2669106165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78e40930a0 con 0x558b59bb64d0 2024-09-10T21:23:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.324+0000 7f78caffd640 1 -- 172.21.15.59:0/2669106165 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f78dc061070 con 0x558b59bb64d0 2024-09-10T21:23:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.324+0000 7f78f3cf5740 10 client.17352 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.324+0000 7f78f3cf5740 1 -- 172.21.15.59:0/2669106165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558b59c3fb80 con 0x558b59bb64d0 2024-09-10T21:23:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.325+0000 7f78caffd640 1 -- 172.21.15.59:0/2669106165 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78e40930a0 con 0x558b59bb64d0 2024-09-10T21:23:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.325+0000 7f78caffd640 1 -- 172.21.15.59:0/2669106165 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f78dc0035f0 con 0x558b59bb64d0 2024-09-10T21:23:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.325+0000 7f78f3cf5740 10 client.17352 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.325+0000 7f78f3cf5740 10 client.17352 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:23:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.325+0000 7f78f3cf5740 20 client.17352 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.325+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/2669106165 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x558b59bd29c0 0x558b59c42320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:47.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.325+0000 7f78f3cf5740 4 client.17352 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:23:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.325+0000 7f78f3cf5740 1 -- 172.21.15.59:0/2669106165 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558b59b2a8a0 con 0x558b59bd29c0 2024-09-10T21:23:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.325+0000 7f78ea7fc640 1 --2- 172.21.15.59:0/2669106165 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x558b59bd29c0 0x558b59c42320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.326+0000 7f78ea7fc640 1 --2- 172.21.15.59:0/2669106165 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x558b59bd29c0 0x558b59c42320 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=beffa62e07f2a60d server_cookie=852726f70643fc86 in_seq=0 out_seq=0 2024-09-10T21:23:47.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.326+0000 7f78caffd640 10 client.17352 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:23:47.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.326+0000 7f78caffd640 1 -- 172.21.15.59:0/2669106165 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558b59b2a8a0 con 0x558b59bd29c0 2024-09-10T21:23:47.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.326+0000 7f78caffd640 10 client.17352 handle_command_reply: tid=0 2024-09-10T21:23:47.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.326+0000 7f78f3cf5740 1 client.17352 shutdown 2024-09-10T21:23:47.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.326+0000 7f78f3cf5740 1 -- 172.21.15.59:0/2669106165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bb64d0 msgr2=0x558b59bc4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:47.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.326+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/2669106165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bb64d0 0x558b59bc4390 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f78dc02a930 tx=0x7f78dc009260 comp rx=0 tx=0).stop 2024-09-10T21:23:47.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.326+0000 7f78f3cf5740 1 -- 172.21.15.59:0/2669106165 shutdown_connections 2024-09-10T21:23:47.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.326+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/2669106165 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x558b59bd29c0 0x558b59c42320 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.326+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/2669106165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558b59bc2d80 0x558b59bc4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.326+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/2669106165 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558b59bb6df0 0x558b59bc48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.326+0000 7f78caffd640 0 client.17352 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:23:47.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.326+0000 7f78f3cf5740 1 --2- 172.21.15.59:0/2669106165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558b59bb64d0 0x558b59bc4390 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.326+0000 7f78f3cf5740 1 -- 172.21.15.59:0/2669106165 >> 172.21.15.59:0/2669106165 conn(0x558b59bb4300 msgr2=0x558b59bc1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:47.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.326+0000 7f78f3cf5740 1 -- 172.21.15.59:0/2669106165 shutdown_connections 2024-09-10T21:23:47.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.326+0000 7f78f3cf5740 1 -- 172.21.15.59:0/2669106165 wait complete. 2024-09-10T21:23:47.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.327+0000 7f78f3cf5740 20 client.17352 trim_cache size 0 max 16384 2024-09-10T21:23:47.336 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:23:47.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.327+0000 7f78f1920640 1 -- 172.21.15.59:0/1680516397 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f78d40b52e0 msgr2=0x7f78d40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:47.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.327+0000 7f78f1920640 1 --2- 172.21.15.59:0/1680516397 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f78d40b52e0 0x7f78d40b77a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f78dc031440 tx=0x7f78dc005890 comp rx=0 tx=0).stop 2024-09-10T21:23:47.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.327+0000 7f78f1920640 1 -- 172.21.15.59:0/1680516397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec10d140 msgr2=0x7f78ec19eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:47.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.327+0000 7f78f1920640 1 --2- 172.21.15.59:0/1680516397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec10d140 0x7f78ec19eb80 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f78e400eaa0 tx=0x7f78e400ef60 comp rx=0 tx=0).stop 2024-09-10T21:23:47.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.327+0000 7f78f1920640 1 -- 172.21.15.59:0/1680516397 shutdown_connections 2024-09-10T21:23:47.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.327+0000 7f78f1920640 1 --2- 172.21.15.59:0/1680516397 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f78d40b52e0 0x7f78d40b77a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.327+0000 7f78f1920640 1 --2- 172.21.15.59:0/1680516397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78ec10d140 0x7f78ec19eb80 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.327+0000 7f78f1920640 1 --2- 172.21.15.59:0/1680516397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78ec104600 0x7f78ec1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.327+0000 7f78f1920640 1 --2- 172.21.15.59:0/1680516397 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78ec103ce0 0x7f78ec1992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:47.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.327+0000 7f78f1920640 1 -- 172.21.15.59:0/1680516397 >> 172.21.15.59:0/1680516397 conn(0x7f78ec0fd700 msgr2=0x7f78ec0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:47.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.327+0000 7f78f1920640 1 -- 172.21.15.59:0/1680516397 shutdown_connections 2024-09-10T21:23:47.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:47.327+0000 7f78f1920640 1 -- 172.21.15.59:0/1680516397 wait complete. 2024-09-10T21:23:47.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:47 smithi154 ceph-mon[35041]: pgmap v595: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:23:47.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:47 smithi192 ceph-mon[35363]: pgmap v595: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:23:48.217 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:23:48.476 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:23:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.975+0000 7fd50afcf640 1 -- 172.21.15.59:0/1382868283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd50410f3d0 msgr2=0x7fd5041117c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.975+0000 7fd50afcf640 1 --2- 172.21.15.59:0/1382868283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd50410f3d0 0x7fd5041117c0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009ca0 tx=0x7fd4fc02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.975+0000 7fd50afcf640 1 -- 172.21.15.59:0/1382868283 shutdown_connections 2024-09-10T21:23:49.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.975+0000 7fd50afcf640 1 --2- 172.21.15.59:0/1382868283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd50410f3d0 0x7fd5041117c0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.975+0000 7fd50afcf640 1 --2- 172.21.15.59:0/1382868283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd504075de0 0x7fd50410ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.975+0000 7fd50afcf640 1 --2- 172.21.15.59:0/1382868283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5040754c0 0x7fd5040758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.975+0000 7fd50afcf640 1 -- 172.21.15.59:0/1382868283 >> 172.21.15.59:0/1382868283 conn(0x7fd5040fe830 msgr2=0x7fd504100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.976+0000 7fd50afcf640 1 -- 172.21.15.59:0/1382868283 shutdown_connections 2024-09-10T21:23:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.976+0000 7fd50afcf640 1 -- 172.21.15.59:0/1382868283 wait complete. 2024-09-10T21:23:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.976+0000 7fd50afcf640 1 Processor -- start 2024-09-10T21:23:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.976+0000 7fd50afcf640 1 -- start start 2024-09-10T21:23:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.976+0000 7fd50afcf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5040754c0 0x7fd50419b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.976+0000 7fd50afcf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd504075de0 0x7fd50419b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.976+0000 7fd50afcf640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd50410f3d0 0x7fd5041a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:49.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.976+0000 7fd50afcf640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd504114f90 con 0x7fd504075de0 2024-09-10T21:23:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.976+0000 7fd50afcf640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd504114e10 con 0x7fd50410f3d0 2024-09-10T21:23:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.976+0000 7fd50afcf640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd504115110 con 0x7fd5040754c0 2024-09-10T21:23:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.976+0000 7fd503fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd504075de0 0x7fd50419b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.976+0000 7fd503fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd504075de0 0x7fd50419b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56412/0 (socket says 172.21.15.59:56412) 2024-09-10T21:23:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.977+0000 7fd503fff640 1 -- 172.21.15.59:0/2101055490 learned_addr learned my addr 172.21.15.59:0/2101055490 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.977+0000 7fd508d6b640 1 --2- 172.21.15.59:0/2101055490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5040754c0 0x7fd50419b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.977+0000 7fd50956c640 1 --2- 172.21.15.59:0/2101055490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd50410f3d0 0x7fd5041a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.977+0000 7fd503fff640 1 -- 172.21.15.59:0/2101055490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5040754c0 msgr2=0x7fd50419b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:49.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.977+0000 7fd503fff640 1 --2- 172.21.15.59:0/2101055490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5040754c0 0x7fd50419b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.977+0000 7fd503fff640 1 -- 172.21.15.59:0/2101055490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd50410f3d0 msgr2=0x7fd5041a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.977+0000 7fd503fff640 1 --2- 172.21.15.59:0/2101055490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd50410f3d0 0x7fd5041a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.977+0000 7fd503fff640 1 -- 172.21.15.59:0/2101055490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5041a14f0 con 0x7fd504075de0 2024-09-10T21:23:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.977+0000 7fd503fff640 1 --2- 172.21.15.59:0/2101055490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd504075de0 0x7fd50419b980 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fd4f800d770 tx=0x7fd4f800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.977+0000 7fd501ffb640 1 -- 172.21.15.59:0/2101055490 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8017070 con 0x7fd504075de0 2024-09-10T21:23:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.977+0000 7fd50afcf640 1 -- 172.21.15.59:0/2101055490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5041a17e0 con 0x7fd504075de0 2024-09-10T21:23:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.977+0000 7fd501ffb640 1 -- 172.21.15.59:0/2101055490 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4f80054d0 con 0x7fd504075de0 2024-09-10T21:23:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.977+0000 7fd501ffb640 1 -- 172.21.15.59:0/2101055490 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8004c30 con 0x7fd504075de0 2024-09-10T21:23:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.977+0000 7fd50afcf640 1 -- 172.21.15.59:0/2101055490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5041a7ea0 con 0x7fd504075de0 2024-09-10T21:23:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.980+0000 7fd501ffb640 1 -- 172.21.15.59:0/2101055490 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd4f8004e10 con 0x7fd504075de0 2024-09-10T21:23:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.980+0000 7fd50d3a4740 1 Processor -- start 2024-09-10T21:23:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.980+0000 7fd50d3a4740 1 -- start start 2024-09-10T21:23:49.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.980+0000 7fd50d3a4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d20f0 0x563ace3d24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:49.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.980+0000 7fd50d3a4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3d2a10 0x563ace3de460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:49.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.980+0000 7fd50d3a4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 0x563ace3e0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:49.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.980+0000 7fd50d3a4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563ace348ea0 con 0x563ace3de9a0 2024-09-10T21:23:49.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.980+0000 7fd50d3a4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563ace3382d0 con 0x563ace3d2a10 2024-09-10T21:23:49.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.980+0000 7fd50d3a4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563ace33c0e0 con 0x563ace3d20f0 2024-09-10T21:23:49.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.980+0000 7fd503fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 0x563ace3e0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:49.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.980+0000 7fd503fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 0x563ace3e0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56414/0 (socket says 172.21.15.59:56414) 2024-09-10T21:23:49.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.981+0000 7fd503fff640 1 -- 172.21.15.59:0/741075906 learned_addr learned my addr 172.21.15.59:0/741075906 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:49.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.981+0000 7fd50956c640 1 --2- 172.21.15.59:0/741075906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d20f0 0x563ace3d24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:49.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.981+0000 7fd501ffb640 1 --2- 172.21.15.59:0/2101055490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd4ec0b52e0 0x7fd4ec0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.981+0000 7fd508d6b640 1 --2- 172.21.15.59:0/741075906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3d2a10 0x563ace3de460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.981+0000 7fd50956c640 1 --2- 172.21.15.59:0/2101055490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd4ec0b52e0 0x7fd4ec0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.981+0000 7fd501ffb640 1 -- 172.21.15.59:0/2101055490 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd4f80e57b0 con 0x7fd504075de0 2024-09-10T21:23:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.981+0000 7fd503fff640 1 -- 172.21.15.59:0/741075906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d20f0 msgr2=0x563ace3d24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.981+0000 7fd503fff640 1 --2- 172.21.15.59:0/741075906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d20f0 0x563ace3d24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.981+0000 7fd503fff640 1 -- 172.21.15.59:0/741075906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3d2a10 msgr2=0x563ace3de460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.981+0000 7fd503fff640 1 --2- 172.21.15.59:0/741075906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3d2a10 0x563ace3de460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.981+0000 7fd503fff640 1 -- 172.21.15.59:0/741075906 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ace096650 con 0x563ace3de9a0 2024-09-10T21:23:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.981+0000 7fd503fff640 1 --2- 172.21.15.59:0/741075906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 0x563ace3e0d90 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80a8510 tx=0x7fd4f8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a91a0ceb362c5be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.981+0000 7fd4eaffd640 1 -- 172.21.15.59:0/741075906 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8020030 con 0x563ace3de9a0 2024-09-10T21:23:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.981+0000 7fd50956c640 1 --2- 172.21.15.59:0/2101055490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd4ec0b52e0 0x7fd4ec0b77a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc005cc0 tx=0x7fd4fc02a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:49.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.981+0000 7fd4eaffd640 1 -- 172.21.15.59:0/741075906 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4f80aba50 con 0x563ace3de9a0 2024-09-10T21:23:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.981+0000 7fd4eaffd640 1 -- 172.21.15.59:0/741075906 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80b0a20 con 0x563ace3de9a0 2024-09-10T21:23:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.982+0000 7fd50d3a4740 1 -- 172.21.15.59:0/741075906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 msgr2=0x563ace3e0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.982+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/741075906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 0x563ace3e0d90 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80a8510 tx=0x7fd4f8009f90 comp rx=0 tx=0).stop 2024-09-10T21:23:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.982+0000 7fd50d3a4740 1 -- 172.21.15.59:0/741075906 shutdown_connections 2024-09-10T21:23:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.982+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/741075906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 0x563ace3e0d90 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.982+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/741075906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3d2a10 0x563ace3de460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.982+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/741075906 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d20f0 0x563ace3d24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.982+0000 7fd50d3a4740 1 -- 172.21.15.59:0/741075906 >> 172.21.15.59:0/741075906 conn(0x563ace3cff20 msgr2=0x563ace3d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.982+0000 7fd50d3a4740 1 -- 172.21.15.59:0/741075906 shutdown_connections 2024-09-10T21:23:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.982+0000 7fd50d3a4740 1 -- 172.21.15.59:0/741075906 wait complete. 2024-09-10T21:23:49.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.982+0000 7fd50d3a4740 1 -- start start 2024-09-10T21:23:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.983+0000 7fd50d3a4740 1 Processor -- start 2024-09-10T21:23:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.983+0000 7fd50d3a4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d20f0 0x563ace3de290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.983+0000 7fd50d3a4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3d2a10 0x563ace3db6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.983+0000 7fd50d3a4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3de9a0 0x563ace3dbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.983+0000 7fd50d3a4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563ace199700 con 0x563ace3d2a10 2024-09-10T21:23:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.983+0000 7fd50d3a4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563ace2d3160 con 0x563ace3de9a0 2024-09-10T21:23:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.983+0000 7fd50d3a4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563ace3e15c0 con 0x563ace3d20f0 2024-09-10T21:23:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.983+0000 7fd50d3a4740 10 client.0 _ll_register_callbacks cb 0x563ace2ec9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.983+0000 7fd503fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3d2a10 0x563ace3db6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.983+0000 7fd503fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3d2a10 0x563ace3db6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56432/0 (socket says 172.21.15.59:56432) 2024-09-10T21:23:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.983+0000 7fd503fff640 1 -- 172.21.15.59:0/457189647 learned_addr learned my addr 172.21.15.59:0/457189647 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:49.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.983+0000 7fd50956c640 1 --2- 172.21.15.59:0/457189647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3de9a0 0x563ace3dbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.983+0000 7fd508d6b640 1 --2- 172.21.15.59:0/457189647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d20f0 0x563ace3de290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.983+0000 7fd503fff640 1 -- 172.21.15.59:0/457189647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d20f0 msgr2=0x563ace3de290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.983+0000 7fd503fff640 1 --2- 172.21.15.59:0/457189647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d20f0 0x563ace3de290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.983+0000 7fd503fff640 1 -- 172.21.15.59:0/457189647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3de9a0 msgr2=0x563ace3dbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.983+0000 7fd503fff640 1 --2- 172.21.15.59:0/457189647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3de9a0 0x563ace3dbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.983+0000 7fd503fff640 1 -- 172.21.15.59:0/457189647 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ace300c90 con 0x563ace3d2a10 2024-09-10T21:23:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.983+0000 7fd508d6b640 1 --2- 172.21.15.59:0/457189647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d20f0 0x563ace3de290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.984+0000 7fd503fff640 1 --2- 172.21.15.59:0/457189647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3d2a10 0x563ace3db6e0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80e5aa0 tx=0x7fd4f80abe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1649c86632e13d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.984+0000 7fd4e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.984+0000 7fd4e3fff640 1 -- 172.21.15.59:0/457189647 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80ab890 con 0x563ace3d2a10 2024-09-10T21:23:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.984+0000 7fd4e3fff640 1 -- 172.21.15.59:0/457189647 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd4f80e5ba0 con 0x563ace3d2a10 2024-09-10T21:23:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.984+0000 7fd50d3a4740 1 -- 172.21.15.59:0/457189647 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4f80aba50 con 0x563ace3d2a10 2024-09-10T21:23:49.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.984+0000 7fd4e3fff640 1 -- 172.21.15.59:0/457189647 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd4f80ab6b0 con 0x563ace3d2a10 2024-09-10T21:23:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.984+0000 7fd50d3a4740 10 client.17364 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.984+0000 7fd50d3a4740 1 -- 172.21.15.59:0/457189647 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563ace3ecf50 con 0x563ace3d2a10 2024-09-10T21:23:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.984+0000 7fd4e3fff640 1 -- 172.21.15.59:0/457189647 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4f80aba50 con 0x563ace3d2a10 2024-09-10T21:23:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.984+0000 7fd4e3fff640 1 -- 172.21.15.59:0/457189647 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd4f80970d0 con 0x563ace3d2a10 2024-09-10T21:23:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.984+0000 7fd50d3a4740 10 client.17364 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.984+0000 7fd50d3a4740 10 client.17364 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:23:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.984+0000 7fd50d3a4740 20 client.17364 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.984+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/457189647 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x563ace3ee2a0 0x563ace3f0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.984+0000 7fd50d3a4740 4 client.17364 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:23:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.984+0000 7fd50d3a4740 1 -- 172.21.15.59:0/457189647 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ace34adf0 con 0x563ace3ee2a0 2024-09-10T21:23:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.985+0000 7fd508d6b640 1 --2- 172.21.15.59:0/457189647 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x563ace3ee2a0 0x563ace3f0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.985+0000 7fd4e3fff640 10 client.17364 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:23:49.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.985+0000 7fd508d6b640 1 --2- 172.21.15.59:0/457189647 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x563ace3ee2a0 0x563ace3f0690 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c45568bb754b9294 server_cookie=6e80684ba67f889 in_seq=0 out_seq=0 2024-09-10T21:23:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.986+0000 7fd4e3fff640 1 -- 172.21.15.59:0/457189647 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ace34adf0 con 0x563ace3ee2a0 2024-09-10T21:23:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.986+0000 7fd4e3fff640 10 client.17364 handle_command_reply: tid=0 2024-09-10T21:23:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.986+0000 7fd50d3a4740 1 client.17364 shutdown 2024-09-10T21:23:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.986+0000 7fd50d3a4740 1 -- 172.21.15.59:0/457189647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3d2a10 msgr2=0x563ace3db6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.986+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/457189647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3d2a10 0x563ace3db6e0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80e5aa0 tx=0x7fd4f80abe40 comp rx=0 tx=0).stop 2024-09-10T21:23:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.986+0000 7fd50d3a4740 1 -- 172.21.15.59:0/457189647 shutdown_connections 2024-09-10T21:23:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.986+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/457189647 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x563ace3ee2a0 0x563ace3f0690 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.986+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/457189647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3de9a0 0x563ace3dbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.986+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/457189647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3d2a10 0x563ace3db6e0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.986+0000 7fd4e3fff640 0 client.17364 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:23:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.986+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/457189647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d20f0 0x563ace3de290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.986+0000 7fd50d3a4740 1 -- 172.21.15.59:0/457189647 >> 172.21.15.59:0/457189647 conn(0x563ace3cff20 msgr2=0x563ace3d5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:49.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.986+0000 7fd50d3a4740 1 -- 172.21.15.59:0/457189647 shutdown_connections 2024-09-10T21:23:49.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.986+0000 7fd50d3a4740 1 -- 172.21.15.59:0/457189647 wait complete. 2024-09-10T21:23:49.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:48.986+0000 7fd50d3a4740 20 client.17364 trim_cache size 0 max 16384 2024-09-10T21:23:49.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.000+0000 7fd50d3a4740 1 Processor -- start 2024-09-10T21:23:49.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.000+0000 7fd50d3a4740 1 -- start start 2024-09-10T21:23:49.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.000+0000 7fd50d3a4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d20f0 0x563ace3d9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:49.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.000+0000 7fd50d3a4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3d2a10 0x563ace3da4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:49.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.000+0000 7fd50d3a4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 0x563ace3d88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:49.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.000+0000 7fd50d3a4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd5041b0520 con 0x563ace3de9a0 2024-09-10T21:23:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.000+0000 7fd50d3a4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd5041b2060 con 0x563ace3d2a10 2024-09-10T21:23:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.000+0000 7fd50d3a4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd5041b0bf0 con 0x563ace3d20f0 2024-09-10T21:23:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.000+0000 7fd50956c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 0x563ace3d88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.000+0000 7fd50956c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 0x563ace3d88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56434/0 (socket says 172.21.15.59:56434) 2024-09-10T21:23:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.000+0000 7fd50956c640 1 -- 172.21.15.59:0/4181567274 learned_addr learned my addr 172.21.15.59:0/4181567274 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.000+0000 7fd503fff640 1 --2- 172.21.15.59:0/4181567274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3d2a10 0x563ace3da4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.000+0000 7fd508d6b640 1 --2- 172.21.15.59:0/4181567274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d20f0 0x563ace3d9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.000+0000 7fd50956c640 1 -- 172.21.15.59:0/4181567274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d20f0 msgr2=0x563ace3d9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.000+0000 7fd50956c640 1 --2- 172.21.15.59:0/4181567274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d20f0 0x563ace3d9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.000+0000 7fd50956c640 1 -- 172.21.15.59:0/4181567274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3d2a10 msgr2=0x563ace3da4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.000+0000 7fd50956c640 1 --2- 172.21.15.59:0/4181567274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3d2a10 0x563ace3da4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.000+0000 7fd50956c640 1 -- 172.21.15.59:0/4181567274 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ace3d6400 con 0x563ace3de9a0 2024-09-10T21:23:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.000+0000 7fd508d6b640 1 --2- 172.21.15.59:0/4181567274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d20f0 0x563ace3d9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:49.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.001+0000 7fd50956c640 1 --2- 172.21.15.59:0/4181567274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 0x563ace3d88f0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fd50406c280 tx=0x7fd4fc009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32dac45ea5b9d647 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.001+0000 7fd4ea7fc640 1 -- 172.21.15.59:0/4181567274 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc045070 con 0x563ace3de9a0 2024-09-10T21:23:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.001+0000 7fd4ea7fc640 1 -- 172.21.15.59:0/4181567274 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4fc036040 con 0x563ace3de9a0 2024-09-10T21:23:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.001+0000 7fd4ea7fc640 1 -- 172.21.15.59:0/4181567274 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc02fbd0 con 0x563ace3de9a0 2024-09-10T21:23:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.001+0000 7fd50d3a4740 1 -- 172.21.15.59:0/4181567274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 msgr2=0x563ace3d88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.001+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/4181567274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 0x563ace3d88f0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fd50406c280 tx=0x7fd4fc009360 comp rx=0 tx=0).stop 2024-09-10T21:23:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.002+0000 7fd50d3a4740 1 -- 172.21.15.59:0/4181567274 shutdown_connections 2024-09-10T21:23:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.002+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/4181567274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 0x563ace3d88f0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.002+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/4181567274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3d2a10 0x563ace3da4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.002+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/4181567274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d20f0 0x563ace3d9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.002+0000 7fd50d3a4740 1 -- 172.21.15.59:0/4181567274 >> 172.21.15.59:0/4181567274 conn(0x563ace3cff20 msgr2=0x563ace3d6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.002+0000 7fd50d3a4740 1 -- 172.21.15.59:0/4181567274 shutdown_connections 2024-09-10T21:23:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.002+0000 7fd50d3a4740 1 -- 172.21.15.59:0/4181567274 wait complete. 2024-09-10T21:23:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.002+0000 7fd50d3a4740 1 -- start start 2024-09-10T21:23:49.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.002+0000 7fd50d3a4740 1 Processor -- start 2024-09-10T21:23:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.002+0000 7fd50d3a4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3d20f0 0x563ace3f2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.002+0000 7fd50d3a4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d2a10 0x563ace3f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.002+0000 7fd50d3a4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 0x563ace453ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.002+0000 7fd50d3a4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd5041b1990 con 0x563ace3de9a0 2024-09-10T21:23:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.002+0000 7fd50d3a4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd5041b12c0 con 0x563ace3d20f0 2024-09-10T21:23:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.002+0000 7fd50d3a4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd5041ae500 con 0x563ace3d2a10 2024-09-10T21:23:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.003+0000 7fd50d3a4740 10 client.0 _ll_register_callbacks cb 0x7fd4f400c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.003+0000 7fd50956c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 0x563ace453ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.003+0000 7fd50956c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 0x563ace453ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56438/0 (socket says 172.21.15.59:56438) 2024-09-10T21:23:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.003+0000 7fd50956c640 1 -- 172.21.15.59:0/3783169658 learned_addr learned my addr 172.21.15.59:0/3783169658 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.003+0000 7fd503fff640 1 --2- 172.21.15.59:0/3783169658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d2a10 0x563ace3f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.003+0000 7fd508d6b640 1 --2- 172.21.15.59:0/3783169658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3d20f0 0x563ace3f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.003+0000 7fd50956c640 1 -- 172.21.15.59:0/3783169658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d2a10 msgr2=0x563ace3f25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.003+0000 7fd50956c640 1 --2- 172.21.15.59:0/3783169658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d2a10 0x563ace3f25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.003+0000 7fd50956c640 1 -- 172.21.15.59:0/3783169658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3d20f0 msgr2=0x563ace3f2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.003+0000 7fd50956c640 1 --2- 172.21.15.59:0/3783169658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3d20f0 0x563ace3f2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.003+0000 7fd50956c640 1 -- 172.21.15.59:0/3783169658 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ace4545d0 con 0x563ace3de9a0 2024-09-10T21:23:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.003+0000 7fd50956c640 1 --2- 172.21.15.59:0/3783169658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 0x563ace453ec0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc02ade0 tx=0x7fd4fc005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8251bd377ff933 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.003+0000 7fd4e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.003+0000 7fd4e3fff640 1 -- 172.21.15.59:0/3783169658 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc05a030 con 0x563ace3de9a0 2024-09-10T21:23:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.003+0000 7fd4e3fff640 1 -- 172.21.15.59:0/3783169658 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd4fc02fd50 con 0x563ace3de9a0 2024-09-10T21:23:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.003+0000 7fd50d3a4740 1 -- 172.21.15.59:0/3783169658 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4fc036040 con 0x563ace3de9a0 2024-09-10T21:23:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.004+0000 7fd4e3fff640 1 -- 172.21.15.59:0/3783169658 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd4fc045070 con 0x563ace3de9a0 2024-09-10T21:23:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.004+0000 7fd50d3a4740 10 client.17370 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.004+0000 7fd50d3a4740 1 -- 172.21.15.59:0/3783169658 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563ace45b920 con 0x563ace3de9a0 2024-09-10T21:23:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.004+0000 7fd4e3fff640 1 -- 172.21.15.59:0/3783169658 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4fc036040 con 0x563ace3de9a0 2024-09-10T21:23:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.004+0000 7fd4e3fff640 1 -- 172.21.15.59:0/3783169658 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd4fc030650 con 0x563ace3de9a0 2024-09-10T21:23:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.004+0000 7fd50d3a4740 10 client.17370 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.004+0000 7fd50d3a4740 10 client.17370 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:23:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.004+0000 7fd50d3a4740 20 client.17370 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:49.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.004+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/3783169658 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x563ace45c040 0x563ace45e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.004+0000 7fd50d3a4740 4 client.17370 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:23:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.004+0000 7fd50d3a4740 1 -- 172.21.15.59:0/3783169658 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563ace3468a0 con 0x563ace45c040 2024-09-10T21:23:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.004+0000 7fd508d6b640 1 --2- 172.21.15.59:0/3783169658 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x563ace45c040 0x563ace45e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.005+0000 7fd4e3fff640 10 client.17370 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:23:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.005+0000 7fd508d6b640 1 --2- 172.21.15.59:0/3783169658 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x563ace45c040 0x563ace45e460 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4b6df5e1129c8a02 server_cookie=4d59d0aad1bf285f in_seq=0 out_seq=0 2024-09-10T21:23:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.005+0000 7fd4e3fff640 1 -- 172.21.15.59:0/3783169658 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563ace3468a0 con 0x563ace45c040 2024-09-10T21:23:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.005+0000 7fd4e3fff640 10 client.17370 handle_command_reply: tid=0 2024-09-10T21:23:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.005+0000 7fd50d3a4740 1 client.17370 shutdown 2024-09-10T21:23:49.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.005+0000 7fd50d3a4740 1 -- 172.21.15.59:0/3783169658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 msgr2=0x563ace453ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.005+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/3783169658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 0x563ace453ec0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc02ade0 tx=0x7fd4fc005c30 comp rx=0 tx=0).stop 2024-09-10T21:23:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.005+0000 7fd50d3a4740 1 -- 172.21.15.59:0/3783169658 shutdown_connections 2024-09-10T21:23:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.005+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/3783169658 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x563ace45c040 0x563ace45e460 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.005+0000 7fd4e3fff640 0 client.17370 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:23:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.005+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/3783169658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ace3de9a0 0x563ace453ec0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.005+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/3783169658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563ace3d2a10 0x563ace3f25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.005+0000 7fd50d3a4740 1 --2- 172.21.15.59:0/3783169658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ace3d20f0 0x563ace3f2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.005+0000 7fd50d3a4740 1 -- 172.21.15.59:0/3783169658 >> 172.21.15.59:0/3783169658 conn(0x563ace3cff20 msgr2=0x563ace3dcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.005+0000 7fd50d3a4740 1 -- 172.21.15.59:0/3783169658 shutdown_connections 2024-09-10T21:23:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.005+0000 7fd50d3a4740 1 -- 172.21.15.59:0/3783169658 wait complete. 2024-09-10T21:23:49.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.005+0000 7fd50d3a4740 20 client.17370 trim_cache size 0 max 16384 2024-09-10T21:23:49.022 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:23:49.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.006+0000 7fd50afcf640 1 -- 172.21.15.59:0/2101055490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd4ec0b52e0 msgr2=0x7fd4ec0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:49.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.006+0000 7fd50afcf640 1 --2- 172.21.15.59:0/2101055490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd4ec0b52e0 0x7fd4ec0b77a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc005cc0 tx=0x7fd4fc02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.006+0000 7fd50afcf640 1 -- 172.21.15.59:0/2101055490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd504075de0 msgr2=0x7fd50419b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:49.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.006+0000 7fd50afcf640 1 --2- 172.21.15.59:0/2101055490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd504075de0 0x7fd50419b980 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fd4f800d770 tx=0x7fd4f800dc30 comp rx=0 tx=0).stop 2024-09-10T21:23:49.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.006+0000 7fd50afcf640 1 -- 172.21.15.59:0/2101055490 shutdown_connections 2024-09-10T21:23:49.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.006+0000 7fd50afcf640 1 --2- 172.21.15.59:0/2101055490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd4ec0b52e0 0x7fd4ec0b77a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.006+0000 7fd50afcf640 1 --2- 172.21.15.59:0/2101055490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd50410f3d0 0x7fd5041a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.006+0000 7fd50afcf640 1 --2- 172.21.15.59:0/2101055490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd504075de0 0x7fd50419b980 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.006+0000 7fd50afcf640 1 --2- 172.21.15.59:0/2101055490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5040754c0 0x7fd50419b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:49.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.006+0000 7fd50afcf640 1 -- 172.21.15.59:0/2101055490 >> 172.21.15.59:0/2101055490 conn(0x7fd5040fe830 msgr2=0x7fd5041115a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:49.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.006+0000 7fd50afcf640 1 -- 172.21.15.59:0/2101055490 shutdown_connections 2024-09-10T21:23:49.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:49.006+0000 7fd50afcf640 1 -- 172.21.15.59:0/2101055490 wait complete. 2024-09-10T21:23:49.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:49 smithi059 ceph-mon[30888]: pgmap v596: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:23:49.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:49 smithi154 ceph-mon[35041]: pgmap v596: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:23:49.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:49 smithi192 ceph-mon[35363]: pgmap v596: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:23:49.760 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:23:50.019 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:23:50.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.544+0000 7f34442d8640 1 -- 172.21.15.59:0/1934431753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f343c101c90 msgr2=0x7f343c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:50.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.544+0000 7f34442d8640 1 --2- 172.21.15.59:0/1934431753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f343c101c90 0x7f343c102070 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f3438009900 tx=0x7f343802a410 comp rx=0 tx=0).stop 2024-09-10T21:23:50.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.544+0000 7f34442d8640 1 -- 172.21.15.59:0/1934431753 shutdown_connections 2024-09-10T21:23:50.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.544+0000 7f34442d8640 1 --2- 172.21.15.59:0/1934431753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f343c108020 0x7f343c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.544+0000 7f34442d8640 1 --2- 172.21.15.59:0/1934431753 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f343c1076a0 0x7f343c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.544+0000 7f34442d8640 1 --2- 172.21.15.59:0/1934431753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f343c101c90 0x7f343c102070 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.544+0000 7f34442d8640 1 -- 172.21.15.59:0/1934431753 >> 172.21.15.59:0/1934431753 conn(0x7f343c0fd700 msgr2=0x7f343c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:50.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.544+0000 7f34442d8640 1 -- 172.21.15.59:0/1934431753 shutdown_connections 2024-09-10T21:23:50.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.544+0000 7f34442d8640 1 -- 172.21.15.59:0/1934431753 wait complete. 2024-09-10T21:23:50.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.544+0000 7f34442d8640 1 Processor -- start 2024-09-10T21:23:50.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.544+0000 7f34442d8640 1 -- start start 2024-09-10T21:23:50.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.545+0000 7f34442d8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f343c101c90 0x7f343c199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:50.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.545+0000 7f34442d8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f343c1076a0 0x7f343c199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:50.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.545+0000 7f34442d8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f343c108020 0x7f343c19ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:50.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.545+0000 7f34442d8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f343c111d70 con 0x7f343c108020 2024-09-10T21:23:50.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.545+0000 7f34442d8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f343c111bf0 con 0x7f343c101c90 2024-09-10T21:23:50.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.545+0000 7f34442d8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f343c111ef0 con 0x7f343c1076a0 2024-09-10T21:23:50.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.545+0000 7f3442875640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f343c108020 0x7f343c19ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:50.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.545+0000 7f3442875640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f343c108020 0x7f343c19ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37294/0 (socket says 172.21.15.59:37294) 2024-09-10T21:23:50.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.545+0000 7f3442875640 1 -- 172.21.15.59:0/3652076574 learned_addr learned my addr 172.21.15.59:0/3652076574 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:50.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.545+0000 7f3441873640 1 --2- 172.21.15.59:0/3652076574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f343c1076a0 0x7f343c199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:50.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.545+0000 7f3442074640 1 --2- 172.21.15.59:0/3652076574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f343c101c90 0x7f343c199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:50.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.545+0000 7f3442875640 1 -- 172.21.15.59:0/3652076574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f343c1076a0 msgr2=0x7f343c199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:50.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.545+0000 7f3442875640 1 --2- 172.21.15.59:0/3652076574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f343c1076a0 0x7f343c199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.545+0000 7f3442875640 1 -- 172.21.15.59:0/3652076574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f343c101c90 msgr2=0x7f343c199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:50.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.545+0000 7f3442875640 1 --2- 172.21.15.59:0/3652076574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f343c101c90 0x7f343c199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.545+0000 7f3442875640 1 -- 172.21.15.59:0/3652076574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343c19f4c0 con 0x7f343c108020 2024-09-10T21:23:50.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.545+0000 7f3442074640 1 --2- 172.21.15.59:0/3652076574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f343c101c90 0x7f343c199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:50.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.545+0000 7f3442875640 1 --2- 172.21.15.59:0/3652076574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f343c108020 0x7f343c19ecf0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f343400b970 tx=0x7f343400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:50.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.546+0000 7f34337fe640 1 -- 172.21.15.59:0/3652076574 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3434019070 con 0x7f343c108020 2024-09-10T21:23:50.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.546+0000 7f34337fe640 1 -- 172.21.15.59:0/3652076574 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3434014440 con 0x7f343c108020 2024-09-10T21:23:50.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.546+0000 7f34442d8640 1 -- 172.21.15.59:0/3652076574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f343c19f7b0 con 0x7f343c108020 2024-09-10T21:23:50.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.546+0000 7f34337fe640 1 -- 172.21.15.59:0/3652076574 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34340075d0 con 0x7f343c108020 2024-09-10T21:23:50.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.546+0000 7f34442d8640 1 -- 172.21.15.59:0/3652076574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f343c1a5ef0 con 0x7f343c108020 2024-09-10T21:23:50.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.548+0000 7f34337fe640 1 -- 172.21.15.59:0/3652076574 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f34340145f0 con 0x7f343c108020 2024-09-10T21:23:50.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.548+0000 7f34466ad740 1 Processor -- start 2024-09-10T21:23:50.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.548+0000 7f34466ad740 1 -- start start 2024-09-10T21:23:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.549+0000 7f34466ad740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 0x555a4b74e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.549+0000 7f34466ad740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b74edf0 0x555a4b75a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.549+0000 7f34466ad740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b75ad80 0x555a4b75d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.549+0000 7f34466ad740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555a4b6c4ea0 con 0x555a4b74e4d0 2024-09-10T21:23:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.549+0000 7f34466ad740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555a4b6b42d0 con 0x555a4b75ad80 2024-09-10T21:23:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.549+0000 7f34466ad740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555a4b6b80e0 con 0x555a4b74edf0 2024-09-10T21:23:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.549+0000 7f3441873640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 0x555a4b74e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.549+0000 7f3441873640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 0x555a4b74e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37298/0 (socket says 172.21.15.59:37298) 2024-09-10T21:23:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.549+0000 7f3441873640 1 -- 172.21.15.59:0/503025465 learned_addr learned my addr 172.21.15.59:0/503025465 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.549+0000 7f3442074640 1 --2- 172.21.15.59:0/503025465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b74edf0 0x555a4b75a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.549+0000 7f3441873640 1 --2- 172.21.15.59:0/503025465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b75ad80 0x555a4b75d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.549+0000 7f3441873640 1 -- 172.21.15.59:0/503025465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b74edf0 msgr2=0x555a4b75a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:50.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.549+0000 7f3441873640 1 --2- 172.21.15.59:0/503025465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b74edf0 0x555a4b75a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.549+0000 7f3441873640 1 -- 172.21.15.59:0/503025465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b75ad80 msgr2=0x555a4b75d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.549+0000 7f3441873640 1 --2- 172.21.15.59:0/503025465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b75ad80 0x555a4b75d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.549+0000 7f3441873640 1 -- 172.21.15.59:0/503025465 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a4b412650 con 0x555a4b74e4d0 2024-09-10T21:23:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.549+0000 7f34337fe640 1 --2- 172.21.15.59:0/3652076574 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f34280b5360 0x7f34280b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.549+0000 7f3442074640 1 --2- 172.21.15.59:0/3652076574 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f34280b5360 0x7f34280b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.549+0000 7f3441873640 1 --2- 172.21.15.59:0/503025465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 0x555a4b74e8b0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f342c009fd0 tx=0x7f342c0095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fce0725ff37db71 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.550+0000 7f34337fe640 1 -- 172.21.15.59:0/3652076574 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f34340e5310 con 0x7f343c108020 2024-09-10T21:23:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.550+0000 7f3430de6640 1 -- 172.21.15.59:0/503025465 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c00f040 con 0x555a4b74e4d0 2024-09-10T21:23:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.550+0000 7f3430de6640 1 -- 172.21.15.59:0/503025465 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f342c01c070 con 0x555a4b74e4d0 2024-09-10T21:23:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.550+0000 7f3430de6640 1 -- 172.21.15.59:0/503025465 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c015640 con 0x555a4b74e4d0 2024-09-10T21:23:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.550+0000 7f3442074640 1 --2- 172.21.15.59:0/3652076574 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f34280b5360 0x7f34280b7820 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3438000c00 tx=0x7f3438005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.550+0000 7f34466ad740 1 -- 172.21.15.59:0/503025465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 msgr2=0x555a4b74e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:50.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.550+0000 7f34466ad740 1 --2- 172.21.15.59:0/503025465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 0x555a4b74e8b0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f342c009fd0 tx=0x7f342c0095d0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.551+0000 7f34466ad740 1 -- 172.21.15.59:0/503025465 shutdown_connections 2024-09-10T21:23:50.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.551+0000 7f34466ad740 1 --2- 172.21.15.59:0/503025465 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b75ad80 0x555a4b75d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.551+0000 7f34466ad740 1 --2- 172.21.15.59:0/503025465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b74edf0 0x555a4b75a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.551+0000 7f34466ad740 1 --2- 172.21.15.59:0/503025465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 0x555a4b74e8b0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.551+0000 7f34466ad740 1 -- 172.21.15.59:0/503025465 >> 172.21.15.59:0/503025465 conn(0x555a4b74c300 msgr2=0x555a4b74d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:50.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.551+0000 7f34466ad740 1 -- 172.21.15.59:0/503025465 shutdown_connections 2024-09-10T21:23:50.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.551+0000 7f34466ad740 1 -- 172.21.15.59:0/503025465 wait complete. 2024-09-10T21:23:50.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.551+0000 7f34466ad740 1 -- start start 2024-09-10T21:23:50.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.551+0000 7f34466ad740 1 Processor -- start 2024-09-10T21:23:50.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.551+0000 7f34466ad740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b74e4d0 0x555a4b75a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:50.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.551+0000 7f34466ad740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74edf0 0x555a4b757ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:50.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.551+0000 7f34466ad740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b75ad80 0x555a4b758110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:50.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.551+0000 7f34466ad740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555a4b515700 con 0x555a4b74edf0 2024-09-10T21:23:50.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.551+0000 7f34466ad740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555a4b64f160 con 0x555a4b74e4d0 2024-09-10T21:23:50.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.551+0000 7f34466ad740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x555a4b75d9a0 con 0x555a4b75ad80 2024-09-10T21:23:50.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.552+0000 7f34466ad740 10 client.0 _ll_register_callbacks cb 0x555a4b6689e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:50.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.552+0000 7f3441873640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74edf0 0x555a4b757ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:50.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.552+0000 7f3441873640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74edf0 0x555a4b757ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37300/0 (socket says 172.21.15.59:37300) 2024-09-10T21:23:50.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.552+0000 7f3441873640 1 -- 172.21.15.59:0/471483422 learned_addr learned my addr 172.21.15.59:0/471483422 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:50.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.552+0000 7f3442875640 1 --2- 172.21.15.59:0/471483422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b75ad80 0x555a4b758110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:50.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.552+0000 7f3442074640 1 --2- 172.21.15.59:0/471483422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b74e4d0 0x555a4b75a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:50.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.552+0000 7f3441873640 1 -- 172.21.15.59:0/471483422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b75ad80 msgr2=0x555a4b758110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:50.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.552+0000 7f3441873640 1 --2- 172.21.15.59:0/471483422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b75ad80 0x555a4b758110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.552+0000 7f3441873640 1 -- 172.21.15.59:0/471483422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b74e4d0 msgr2=0x555a4b75a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:50.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.552+0000 7f3441873640 1 --2- 172.21.15.59:0/471483422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b74e4d0 0x555a4b75a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.552+0000 7f3441873640 1 -- 172.21.15.59:0/471483422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a4b67cc90 con 0x555a4b74edf0 2024-09-10T21:23:50.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.552+0000 7f3441873640 1 --2- 172.21.15.59:0/471483422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74edf0 0x555a4b757ae0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f342c009fa0 tx=0x7f342c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14c944ff00b98c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:50.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.552+0000 7f3425ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:50.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.552+0000 7f3425ffb640 1 -- 172.21.15.59:0/471483422 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c025070 con 0x555a4b74edf0 2024-09-10T21:23:50.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.552+0000 7f3425ffb640 1 -- 172.21.15.59:0/471483422 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f342c017720 con 0x555a4b74edf0 2024-09-10T21:23:50.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.552+0000 7f34466ad740 1 -- 172.21.15.59:0/471483422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f342c01c070 con 0x555a4b74edf0 2024-09-10T21:23:50.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.553+0000 7f3425ffb640 1 -- 172.21.15.59:0/471483422 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f342c031050 con 0x555a4b74edf0 2024-09-10T21:23:50.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.553+0000 7f34466ad740 10 client.17382 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:50.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.553+0000 7f34466ad740 1 -- 172.21.15.59:0/471483422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555a4b769300 con 0x555a4b74edf0 2024-09-10T21:23:50.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.553+0000 7f3425ffb640 1 -- 172.21.15.59:0/471483422 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f342c01c070 con 0x555a4b74edf0 2024-09-10T21:23:50.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.553+0000 7f3425ffb640 1 -- 172.21.15.59:0/471483422 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f342c0153e0 con 0x555a4b74edf0 2024-09-10T21:23:50.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.553+0000 7f34466ad740 10 client.17382 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:50.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.553+0000 7f34466ad740 10 client.17382 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:23:50.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.553+0000 7f34466ad740 20 client.17382 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:50.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.553+0000 7f34466ad740 1 --2- 172.21.15.59:0/471483422 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555a4b76a6b0 0x555a4b76caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:50.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.553+0000 7f34466ad740 4 client.17382 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:23:50.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.553+0000 7f34466ad740 1 -- 172.21.15.59:0/471483422 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a4b6c6df0 con 0x555a4b76a6b0 2024-09-10T21:23:50.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.553+0000 7f3442074640 1 --2- 172.21.15.59:0/471483422 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555a4b76a6b0 0x555a4b76caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:50.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.554+0000 7f3442074640 1 --2- 172.21.15.59:0/471483422 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555a4b76a6b0 0x555a4b76caa0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7deca926812f3c4 server_cookie=2edf5697d5df8351 in_seq=0 out_seq=0 2024-09-10T21:23:50.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.554+0000 7f3425ffb640 10 client.17382 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:50.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.555+0000 7f3425ffb640 1 -- 172.21.15.59:0/471483422 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555a4b6c6df0 con 0x555a4b76a6b0 2024-09-10T21:23:50.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.555+0000 7f3425ffb640 10 client.17382 handle_command_reply: tid=0 2024-09-10T21:23:50.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.555+0000 7f34466ad740 1 client.17382 shutdown 2024-09-10T21:23:50.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.555+0000 7f34466ad740 1 -- 172.21.15.59:0/471483422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74edf0 msgr2=0x555a4b757ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:50.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.555+0000 7f34466ad740 1 --2- 172.21.15.59:0/471483422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74edf0 0x555a4b757ae0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f342c009fa0 tx=0x7f342c009bd0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.555+0000 7f34466ad740 1 -- 172.21.15.59:0/471483422 shutdown_connections 2024-09-10T21:23:50.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.555+0000 7f34466ad740 1 --2- 172.21.15.59:0/471483422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b75ad80 0x555a4b758110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.555+0000 7f34466ad740 1 --2- 172.21.15.59:0/471483422 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555a4b76a6b0 0x555a4b76caa0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.555+0000 7f3425ffb640 0 client.17382 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:50.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.555+0000 7f34466ad740 1 --2- 172.21.15.59:0/471483422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74edf0 0x555a4b757ae0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.555+0000 7f34466ad740 1 --2- 172.21.15.59:0/471483422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b74e4d0 0x555a4b75a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.555+0000 7f34466ad740 1 -- 172.21.15.59:0/471483422 >> 172.21.15.59:0/471483422 conn(0x555a4b74c300 msgr2=0x555a4b751e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:50.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.555+0000 7f34466ad740 1 -- 172.21.15.59:0/471483422 shutdown_connections 2024-09-10T21:23:50.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.555+0000 7f34466ad740 1 -- 172.21.15.59:0/471483422 wait complete. 2024-09-10T21:23:50.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.556+0000 7f34466ad740 20 client.17382 trim_cache size 0 max 16384 2024-09-10T21:23:50.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.569+0000 7f34466ad740 1 Processor -- start 2024-09-10T21:23:50.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.569+0000 7f34466ad740 1 -- start start 2024-09-10T21:23:50.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.569+0000 7f34466ad740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 0x555a4b766bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:50.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.569+0000 7f34466ad740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b74edf0 0x555a4b74b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:50.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.569+0000 7f34466ad740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b75ad80 0x555a4b75c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:50.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.569+0000 7f34466ad740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f343c1ae460 con 0x555a4b74e4d0 2024-09-10T21:23:50.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.569+0000 7f34466ad740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f343c1affa0 con 0x555a4b74edf0 2024-09-10T21:23:50.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.569+0000 7f34466ad740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f343c1aeb30 con 0x555a4b75ad80 2024-09-10T21:23:50.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.569+0000 7f3442074640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 0x555a4b766bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:50.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.569+0000 7f3442074640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 0x555a4b766bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37316/0 (socket says 172.21.15.59:37316) 2024-09-10T21:23:50.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.569+0000 7f3442074640 1 -- 172.21.15.59:0/503201586 learned_addr learned my addr 172.21.15.59:0/503201586 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:50.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.569+0000 7f3441873640 1 --2- 172.21.15.59:0/503201586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b74edf0 0x555a4b74b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:50.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.569+0000 7f3442074640 1 -- 172.21.15.59:0/503201586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b75ad80 msgr2=0x555a4b75c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:50.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.569+0000 7f3442074640 1 --2- 172.21.15.59:0/503201586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b75ad80 0x555a4b75c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.569+0000 7f3442074640 1 -- 172.21.15.59:0/503201586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b74edf0 msgr2=0x555a4b74b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:50.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.569+0000 7f3442074640 1 --2- 172.21.15.59:0/503201586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b74edf0 0x555a4b74b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.569+0000 7f3442074640 1 -- 172.21.15.59:0/503201586 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a4b76d030 con 0x555a4b74e4d0 2024-09-10T21:23:50.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.569+0000 7f3441873640 1 --2- 172.21.15.59:0/503201586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b74edf0 0x555a4b74b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:50.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.569+0000 7f3442074640 1 --2- 172.21.15.59:0/503201586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 0x555a4b766bd0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f3438003820 tx=0x7f343803e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6495128b5e3f89 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:50.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.570+0000 7f3427fff640 1 -- 172.21.15.59:0/503201586 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3438035040 con 0x555a4b74e4d0 2024-09-10T21:23:50.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.570+0000 7f3427fff640 1 -- 172.21.15.59:0/503201586 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3438031950 con 0x555a4b74e4d0 2024-09-10T21:23:50.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.570+0000 7f3427fff640 1 -- 172.21.15.59:0/503201586 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34380538a0 con 0x555a4b74e4d0 2024-09-10T21:23:50.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.570+0000 7f34466ad740 1 -- 172.21.15.59:0/503201586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 msgr2=0x555a4b766bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:50.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.570+0000 7f34466ad740 1 --2- 172.21.15.59:0/503201586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 0x555a4b766bd0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f3438003820 tx=0x7f343803e000 comp rx=0 tx=0).stop 2024-09-10T21:23:50.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.570+0000 7f34466ad740 1 -- 172.21.15.59:0/503201586 shutdown_connections 2024-09-10T21:23:50.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.570+0000 7f34466ad740 1 --2- 172.21.15.59:0/503201586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b75ad80 0x555a4b75c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.570+0000 7f34466ad740 1 --2- 172.21.15.59:0/503201586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b74edf0 0x555a4b74b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.570+0000 7f34466ad740 1 --2- 172.21.15.59:0/503201586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 0x555a4b766bd0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.570+0000 7f34466ad740 1 -- 172.21.15.59:0/503201586 >> 172.21.15.59:0/503201586 conn(0x555a4b74c300 msgr2=0x555a4b74ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:50.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.570+0000 7f34466ad740 1 -- 172.21.15.59:0/503201586 shutdown_connections 2024-09-10T21:23:50.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.570+0000 7f34466ad740 1 -- 172.21.15.59:0/503201586 wait complete. 2024-09-10T21:23:50.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.571+0000 7f34466ad740 1 -- start start 2024-09-10T21:23:50.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.571+0000 7f34466ad740 1 Processor -- start 2024-09-10T21:23:50.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.571+0000 7f34466ad740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 0x555a4b763160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:50.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.571+0000 7f34466ad740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b74edf0 0x555a4b753d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:50.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.571+0000 7f34466ad740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b75ad80 0x555a4b754240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:50.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.571+0000 7f34466ad740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f343c1af8d0 con 0x555a4b74e4d0 2024-09-10T21:23:50.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.571+0000 7f34466ad740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f343c1af200 con 0x555a4b74edf0 2024-09-10T21:23:50.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.571+0000 7f34466ad740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f343c1ac440 con 0x555a4b75ad80 2024-09-10T21:23:50.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.571+0000 7f34466ad740 10 client.0 _ll_register_callbacks cb 0x7f3438009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:50.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.571+0000 7f3442074640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 0x555a4b763160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:50.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.571+0000 7f3442074640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 0x555a4b763160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37332/0 (socket says 172.21.15.59:37332) 2024-09-10T21:23:50.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.571+0000 7f3442074640 1 -- 172.21.15.59:0/492513500 learned_addr learned my addr 172.21.15.59:0/492513500 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:50.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.571+0000 7f3442875640 1 --2- 172.21.15.59:0/492513500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b75ad80 0x555a4b754240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:50.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.571+0000 7f3441873640 1 --2- 172.21.15.59:0/492513500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b74edf0 0x555a4b753d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:50.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.571+0000 7f3442074640 1 -- 172.21.15.59:0/492513500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b75ad80 msgr2=0x555a4b754240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:50.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.571+0000 7f3442074640 1 --2- 172.21.15.59:0/492513500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b75ad80 0x555a4b754240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.572+0000 7f3442074640 1 -- 172.21.15.59:0/492513500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b74edf0 msgr2=0x555a4b753d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:50.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.572+0000 7f3442074640 1 --2- 172.21.15.59:0/492513500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b74edf0 0x555a4b753d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.572+0000 7f3442074640 1 -- 172.21.15.59:0/492513500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a4b7547b0 con 0x555a4b74e4d0 2024-09-10T21:23:50.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.572+0000 7f3442875640 1 --2- 172.21.15.59:0/492513500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b75ad80 0x555a4b754240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:50.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.572+0000 7f3442074640 1 --2- 172.21.15.59:0/492513500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 0x555a4b763160 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f343802a930 tx=0x7f3438003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07af2942daf411e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:50.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.572+0000 7f3425ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:50.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.572+0000 7f3425ffb640 1 -- 172.21.15.59:0/492513500 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3438035040 con 0x555a4b74e4d0 2024-09-10T21:23:50.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.572+0000 7f3425ffb640 1 -- 172.21.15.59:0/492513500 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3438031b00 con 0x555a4b74e4d0 2024-09-10T21:23:50.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.572+0000 7f34466ad740 1 -- 172.21.15.59:0/492513500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3438031950 con 0x555a4b74e4d0 2024-09-10T21:23:50.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.572+0000 7f3425ffb640 1 -- 172.21.15.59:0/492513500 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3438031d20 con 0x555a4b74e4d0 2024-09-10T21:23:50.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.572+0000 7f34466ad740 10 client.17388 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:50.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.572+0000 7f34466ad740 1 -- 172.21.15.59:0/492513500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555a4b755a20 con 0x555a4b74e4d0 2024-09-10T21:23:50.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.572+0000 7f3425ffb640 1 -- 172.21.15.59:0/492513500 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3438031950 con 0x555a4b74e4d0 2024-09-10T21:23:50.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.572+0000 7f3425ffb640 1 -- 172.21.15.59:0/492513500 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f343803c460 con 0x555a4b74e4d0 2024-09-10T21:23:50.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.573+0000 7f34466ad740 10 client.17388 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:50.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.573+0000 7f34466ad740 10 client.17388 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:23:50.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.573+0000 7f34466ad740 20 client.17388 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:50.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.573+0000 7f34466ad740 1 --2- 172.21.15.59:0/492513500 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555a4b7d88e0 0x555a4b7dad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:50.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.573+0000 7f34466ad740 4 client.17388 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:23:50.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.573+0000 7f34466ad740 1 -- 172.21.15.59:0/492513500 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555a4b6c28a0 con 0x555a4b7d88e0 2024-09-10T21:23:50.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.573+0000 7f3441873640 1 --2- 172.21.15.59:0/492513500 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555a4b7d88e0 0x555a4b7dad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:50.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.573+0000 7f3441873640 1 --2- 172.21.15.59:0/492513500 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555a4b7d88e0 0x555a4b7dad00 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1d859f57e9554ab server_cookie=8493336125d9d092 in_seq=0 out_seq=0 2024-09-10T21:23:50.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.573+0000 7f3425ffb640 10 client.17388 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:50.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.573+0000 7f3425ffb640 1 -- 172.21.15.59:0/492513500 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555a4b6c28a0 con 0x555a4b7d88e0 2024-09-10T21:23:50.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.573+0000 7f3425ffb640 10 client.17388 handle_command_reply: tid=0 2024-09-10T21:23:50.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.573+0000 7f34466ad740 1 client.17388 shutdown 2024-09-10T21:23:50.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.574+0000 7f34466ad740 1 -- 172.21.15.59:0/492513500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 msgr2=0x555a4b763160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:50.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.574+0000 7f34466ad740 1 --2- 172.21.15.59:0/492513500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 0x555a4b763160 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f343802a930 tx=0x7f3438003f80 comp rx=0 tx=0).stop 2024-09-10T21:23:50.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.574+0000 7f34466ad740 1 -- 172.21.15.59:0/492513500 shutdown_connections 2024-09-10T21:23:50.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.574+0000 7f34466ad740 1 --2- 172.21.15.59:0/492513500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x555a4b75ad80 0x555a4b754240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.574+0000 7f34466ad740 1 --2- 172.21.15.59:0/492513500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555a4b74edf0 0x555a4b753d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.574+0000 7f34466ad740 1 --2- 172.21.15.59:0/492513500 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x555a4b7d88e0 0x555a4b7dad00 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.574+0000 7f34466ad740 1 --2- 172.21.15.59:0/492513500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555a4b74e4d0 0x555a4b763160 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.574+0000 7f34466ad740 1 -- 172.21.15.59:0/492513500 >> 172.21.15.59:0/492513500 conn(0x555a4b74c300 msgr2=0x555a4b759930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:50.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.574+0000 7f3425ffb640 0 client.17388 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:50.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.574+0000 7f34466ad740 1 -- 172.21.15.59:0/492513500 shutdown_connections 2024-09-10T21:23:50.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.574+0000 7f34466ad740 1 -- 172.21.15.59:0/492513500 wait complete. 2024-09-10T21:23:50.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.574+0000 7f34466ad740 20 client.17388 trim_cache size 0 max 16384 2024-09-10T21:23:50.582 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:23:50.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.574+0000 7f34442d8640 1 -- 172.21.15.59:0/3652076574 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f34280b5360 msgr2=0x7f34280b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:50.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.574+0000 7f34442d8640 1 --2- 172.21.15.59:0/3652076574 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f34280b5360 0x7f34280b7820 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3438000c00 tx=0x7f3438005a40 comp rx=0 tx=0).stop 2024-09-10T21:23:50.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.574+0000 7f34442d8640 1 -- 172.21.15.59:0/3652076574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f343c108020 msgr2=0x7f343c19ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:50.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.574+0000 7f34442d8640 1 --2- 172.21.15.59:0/3652076574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f343c108020 0x7f343c19ecf0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f343400b970 tx=0x7f343400bd70 comp rx=0 tx=0).stop 2024-09-10T21:23:50.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.574+0000 7f34442d8640 1 -- 172.21.15.59:0/3652076574 shutdown_connections 2024-09-10T21:23:50.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.575+0000 7f34442d8640 1 --2- 172.21.15.59:0/3652076574 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f34280b5360 0x7f34280b7820 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.575+0000 7f34442d8640 1 --2- 172.21.15.59:0/3652076574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f343c108020 0x7f343c19ecf0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.575+0000 7f34442d8640 1 --2- 172.21.15.59:0/3652076574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f343c1076a0 0x7f343c199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.575+0000 7f34442d8640 1 --2- 172.21.15.59:0/3652076574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f343c101c90 0x7f343c199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:50.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.575+0000 7f34442d8640 1 -- 172.21.15.59:0/3652076574 >> 172.21.15.59:0/3652076574 conn(0x7f343c0fd700 msgr2=0x7f343c06adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:50.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.575+0000 7f34442d8640 1 -- 172.21.15.59:0/3652076574 shutdown_connections 2024-09-10T21:23:50.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:50.575+0000 7f34442d8640 1 -- 172.21.15.59:0/3652076574 wait complete. 2024-09-10T21:23:51.347 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:51 smithi059 ceph-mon[30888]: pgmap v597: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:23:51.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:51 smithi154 ceph-mon[35041]: pgmap v597: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:23:51.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:51 smithi192 ceph-mon[35363]: pgmap v597: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:23:52.377 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:23:52.378 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:23:52.648 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:23:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.101+0000 7f5ab4d79640 1 -- 172.21.15.59:0/1838572647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ab010f3e0 msgr2=0x7f5ab01117d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.101+0000 7f5ab4d79640 1 --2- 172.21.15.59:0/1838572647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ab010f3e0 0x7f5ab01117d0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8009ca0 tx=0x7f5aa802a950 comp rx=0 tx=0).stop 2024-09-10T21:23:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.101+0000 7f5ab4d79640 1 -- 172.21.15.59:0/1838572647 shutdown_connections 2024-09-10T21:23:53.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.101+0000 7f5ab4d79640 1 --2- 172.21.15.59:0/1838572647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ab010f3e0 0x7f5ab01117d0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.101+0000 7f5ab4d79640 1 --2- 172.21.15.59:0/1838572647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ab0102150 0x7f5ab010eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.101+0000 7f5ab4d79640 1 --2- 172.21.15.59:0/1838572647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ab0101830 0x7f5ab0101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.101+0000 7f5ab4d79640 1 -- 172.21.15.59:0/1838572647 >> 172.21.15.59:0/1838572647 conn(0x7f5ab00fd700 msgr2=0x7f5ab00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.101+0000 7f5ab4d79640 1 -- 172.21.15.59:0/1838572647 shutdown_connections 2024-09-10T21:23:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.101+0000 7f5ab4d79640 1 -- 172.21.15.59:0/1838572647 wait complete. 2024-09-10T21:23:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.102+0000 7f5ab4d79640 1 Processor -- start 2024-09-10T21:23:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.102+0000 7f5ab4d79640 1 -- start start 2024-09-10T21:23:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.102+0000 7f5ab4d79640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ab0101830 0x7f5ab019b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.102+0000 7f5ab4d79640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ab0102150 0x7f5ab019ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.102+0000 7f5ab4d79640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ab010f3e0 0x7f5ab01a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.102+0000 7f5ab4d79640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab0115010 con 0x7f5ab0102150 2024-09-10T21:23:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.102+0000 7f5ab4d79640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab0114e90 con 0x7f5ab010f3e0 2024-09-10T21:23:53.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.102+0000 7f5ab4d79640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab0115190 con 0x7f5ab0101830 2024-09-10T21:23:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.102+0000 7f5aadd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ab0102150 0x7f5ab019ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.102+0000 7f5aadd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ab0102150 0x7f5ab019ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37358/0 (socket says 172.21.15.59:37358) 2024-09-10T21:23:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.102+0000 7f5aadd9b640 1 -- 172.21.15.59:0/1582557112 learned_addr learned my addr 172.21.15.59:0/1582557112 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.102+0000 7f5aae59c640 1 --2- 172.21.15.59:0/1582557112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ab0101830 0x7f5ab019b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.102+0000 7f5aadd9b640 1 -- 172.21.15.59:0/1582557112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ab0101830 msgr2=0x7f5ab019b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.102+0000 7f5aadd9b640 1 --2- 172.21.15.59:0/1582557112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ab0101830 0x7f5ab019b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.102+0000 7f5aaed9d640 1 --2- 172.21.15.59:0/1582557112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ab010f3e0 0x7f5ab01a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.102+0000 7f5aadd9b640 1 -- 172.21.15.59:0/1582557112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ab010f3e0 msgr2=0x7f5ab01a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.102+0000 7f5aadd9b640 1 --2- 172.21.15.59:0/1582557112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ab010f3e0 0x7f5ab01a0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.103+0000 7f5aadd9b640 1 -- 172.21.15.59:0/1582557112 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab01a15f0 con 0x7f5ab0102150 2024-09-10T21:23:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.103+0000 7f5aadd9b640 1 --2- 172.21.15.59:0/1582557112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ab0102150 0x7f5ab019ba80 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400c970 tx=0x7f5aa400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:53.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.103+0000 7f5a9f7fe640 1 -- 172.21.15.59:0/1582557112 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4007bb0 con 0x7f5ab0102150 2024-09-10T21:23:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.103+0000 7f5a9f7fe640 1 -- 172.21.15.59:0/1582557112 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5aa4007d50 con 0x7f5ab0102150 2024-09-10T21:23:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.103+0000 7f5ab4d79640 1 -- 172.21.15.59:0/1582557112 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab01a18e0 con 0x7f5ab0102150 2024-09-10T21:23:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.103+0000 7f5a9f7fe640 1 -- 172.21.15.59:0/1582557112 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4004de0 con 0x7f5ab0102150 2024-09-10T21:23:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.103+0000 7f5ab4d79640 1 -- 172.21.15.59:0/1582557112 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab01a7fa0 con 0x7f5ab0102150 2024-09-10T21:23:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.106+0000 7f5ab714e740 1 Processor -- start 2024-09-10T21:23:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.106+0000 7f5ab714e740 1 -- start start 2024-09-10T21:23:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.106+0000 7f5a9f7fe640 1 -- 172.21.15.59:0/1582557112 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f5aa4004fa0 con 0x7f5ab0102150 2024-09-10T21:23:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.107+0000 7f5ab714e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661e62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.107+0000 7f5ab714e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661e6800 0x55ed661f2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.107+0000 7f5ab714e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661f2790 0x55ed661f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.107+0000 7f5ab714e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ed6615ce60 con 0x55ed661e5ee0 2024-09-10T21:23:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.107+0000 7f5ab714e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ed6614c290 con 0x55ed661f2790 2024-09-10T21:23:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.107+0000 7f5ab714e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ed661500a0 con 0x55ed661e6800 2024-09-10T21:23:53.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.107+0000 7f5aaed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661e62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.107+0000 7f5aaed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661e62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37360/0 (socket says 172.21.15.59:37360) 2024-09-10T21:23:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.107+0000 7f5aaed9d640 1 -- 172.21.15.59:0/1347380601 learned_addr learned my addr 172.21.15.59:0/1347380601 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.107+0000 7f5aadd9b640 1 --2- 172.21.15.59:0/1347380601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661f2790 0x55ed661f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.107+0000 7f5aae59c640 1 --2- 172.21.15.59:0/1347380601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661e6800 0x55ed661f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.107+0000 7f5aaed9d640 1 -- 172.21.15.59:0/1347380601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661e6800 msgr2=0x55ed661f2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.107+0000 7f5aaed9d640 1 --2- 172.21.15.59:0/1347380601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661e6800 0x55ed661f2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.107+0000 7f5aaed9d640 1 -- 172.21.15.59:0/1347380601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661f2790 msgr2=0x55ed661f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.107+0000 7f5aaed9d640 1 --2- 172.21.15.59:0/1347380601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661f2790 0x55ed661f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.107+0000 7f5aaed9d640 1 -- 172.21.15.59:0/1347380601 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed65eaa930 con 0x55ed661e5ee0 2024-09-10T21:23:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.107+0000 7f5aaed9d640 1 --2- 172.21.15.59:0/1347380601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661e62c0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f5aa802f6a0 tx=0x7f5aa802f6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4074f9287d50c646 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.107+0000 7f5a9f7fe640 1 --2- 172.21.15.59:0/1582557112 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5a980b52e0 0x7f5a980b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.108+0000 7f5a9cff9640 1 -- 172.21.15.59:0/1347380601 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8034050 con 0x55ed661e5ee0 2024-09-10T21:23:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.108+0000 7f5aae59c640 1 --2- 172.21.15.59:0/1582557112 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5a980b52e0 0x7f5a980b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:53.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.108+0000 7f5a9f7fe640 1 -- 172.21.15.59:0/1582557112 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5aa40e58b0 con 0x7f5ab0102150 2024-09-10T21:23:53.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.108+0000 7f5a9cff9640 1 -- 172.21.15.59:0/1347380601 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5aa802fd20 con 0x55ed661e5ee0 2024-09-10T21:23:53.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.108+0000 7f5a9cff9640 1 -- 172.21.15.59:0/1347380601 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa80045a0 con 0x55ed661e5ee0 2024-09-10T21:23:53.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.108+0000 7f5ab714e740 1 -- 172.21.15.59:0/1347380601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 msgr2=0x55ed661e62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:53.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.108+0000 7f5ab714e740 1 --2- 172.21.15.59:0/1347380601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661e62c0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f5aa802f6a0 tx=0x7f5aa802f6d0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.108+0000 7f5aae59c640 1 --2- 172.21.15.59:0/1582557112 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5a980b52e0 0x7f5a980b77a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55ed661e9060 tx=0x7f5aa0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:53.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.108+0000 7f5ab714e740 1 -- 172.21.15.59:0/1347380601 shutdown_connections 2024-09-10T21:23:53.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.108+0000 7f5ab714e740 1 --2- 172.21.15.59:0/1347380601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661f2790 0x55ed661f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.108+0000 7f5ab714e740 1 --2- 172.21.15.59:0/1347380601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661e6800 0x55ed661f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.108+0000 7f5ab714e740 1 --2- 172.21.15.59:0/1347380601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661e62c0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.108+0000 7f5ab714e740 1 -- 172.21.15.59:0/1347380601 >> 172.21.15.59:0/1347380601 conn(0x55ed661e3d10 msgr2=0x55ed661e4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:53.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.109+0000 7f5ab714e740 1 -- 172.21.15.59:0/1347380601 shutdown_connections 2024-09-10T21:23:53.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.109+0000 7f5ab714e740 1 -- 172.21.15.59:0/1347380601 wait complete. 2024-09-10T21:23:53.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.109+0000 7f5ab714e740 1 -- start start 2024-09-10T21:23:53.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.109+0000 7f5ab714e740 1 Processor -- start 2024-09-10T21:23:53.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.109+0000 7f5ab714e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661ef730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:53.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.109+0000 7f5ab714e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661e6800 0x55ed661efc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:53.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.109+0000 7f5ab714e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661f2790 0x55ed661f01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:53.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.109+0000 7f5ab714e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ed65fad890 con 0x55ed661e5ee0 2024-09-10T21:23:53.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.109+0000 7f5ab714e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ed660e6d40 con 0x55ed661e6800 2024-09-10T21:23:53.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.109+0000 7f5ab714e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55ed661f53e0 con 0x55ed661f2790 2024-09-10T21:23:53.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.109+0000 7f5ab714e740 10 client.0 _ll_register_callbacks cb 0x55ed6614ac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:53.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.109+0000 7f5aae59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661ef730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:53.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.110+0000 7f5aae59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661ef730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37368/0 (socket says 172.21.15.59:37368) 2024-09-10T21:23:53.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.110+0000 7f5aae59c640 1 -- 172.21.15.59:0/3970064303 learned_addr learned my addr 172.21.15.59:0/3970064303 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:53.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.110+0000 7f5aadd9b640 1 --2- 172.21.15.59:0/3970064303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661e6800 0x55ed661efc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:53.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.110+0000 7f5aaed9d640 1 --2- 172.21.15.59:0/3970064303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661f2790 0x55ed661f01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:53.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.110+0000 7f5aae59c640 1 -- 172.21.15.59:0/3970064303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661f2790 msgr2=0x55ed661f01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:53.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.110+0000 7f5aae59c640 1 --2- 172.21.15.59:0/3970064303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661f2790 0x55ed661f01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.110+0000 7f5aae59c640 1 -- 172.21.15.59:0/3970064303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661e6800 msgr2=0x55ed661efc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:53.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.110+0000 7f5aae59c640 1 --2- 172.21.15.59:0/3970064303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661e6800 0x55ed661efc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.110+0000 7f5aae59c640 1 -- 172.21.15.59:0/3970064303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed661fe7f0 con 0x55ed661e5ee0 2024-09-10T21:23:53.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.110+0000 7f5aadd9b640 1 --2- 172.21.15.59:0/3970064303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661e6800 0x55ed661efc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:53.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.110+0000 7f5aae59c640 1 --2- 172.21.15.59:0/3970064303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661ef730 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f5aa00149f0 tx=0x7f5aa00047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949cd43735f2b31 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:53.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.110+0000 7f5a95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:53.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.110+0000 7f5a95ffb640 1 -- 172.21.15.59:0/3970064303 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0025070 con 0x55ed661e5ee0 2024-09-10T21:23:53.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.110+0000 7f5a95ffb640 1 -- 172.21.15.59:0/3970064303 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5aa0021600 con 0x55ed661e5ee0 2024-09-10T21:23:53.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.110+0000 7f5ab714e740 1 -- 172.21.15.59:0/3970064303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5aa802fd20 con 0x55ed661e5ee0 2024-09-10T21:23:53.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.110+0000 7f5a95ffb640 1 -- 172.21.15.59:0/3970064303 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5aa0021840 con 0x55ed661e5ee0 2024-09-10T21:23:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.110+0000 7f5ab714e740 10 client.17400 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.110+0000 7f5ab714e740 1 -- 172.21.15.59:0/3970064303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ed66201200 con 0x55ed661e5ee0 2024-09-10T21:23:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.111+0000 7f5a95ffb640 1 -- 172.21.15.59:0/3970064303 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5aa802fd20 con 0x55ed661e5ee0 2024-09-10T21:23:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.111+0000 7f5a95ffb640 1 -- 172.21.15.59:0/3970064303 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5aa0020070 con 0x55ed661e5ee0 2024-09-10T21:23:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.111+0000 7f5ab714e740 10 client.17400 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.111+0000 7f5ab714e740 10 client.17400 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:23:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.111+0000 7f5ab714e740 20 client.17400 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.111+0000 7f5ab714e740 1 --2- 172.21.15.59:0/3970064303 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55ed66202610 0x55ed66204a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.111+0000 7f5ab714e740 4 client.17400 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:23:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.111+0000 7f5ab714e740 1 -- 172.21.15.59:0/3970064303 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed6615edb0 con 0x55ed66202610 2024-09-10T21:23:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.111+0000 7f5aadd9b640 1 --2- 172.21.15.59:0/3970064303 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55ed66202610 0x55ed66204a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.112+0000 7f5a95ffb640 10 client.17400 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.112+0000 7f5aadd9b640 1 --2- 172.21.15.59:0/3970064303 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55ed66202610 0x55ed66204a80 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfe583dcead506e9 server_cookie=1e6a2dbba018cd32 in_seq=0 out_seq=0 2024-09-10T21:23:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.113+0000 7f5a95ffb640 1 -- 172.21.15.59:0/3970064303 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ed6615edb0 con 0x55ed66202610 2024-09-10T21:23:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.113+0000 7f5a95ffb640 10 client.17400 handle_command_reply: tid=0 2024-09-10T21:23:53.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.113+0000 7f5ab714e740 1 client.17400 shutdown 2024-09-10T21:23:53.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.113+0000 7f5ab714e740 1 -- 172.21.15.59:0/3970064303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 msgr2=0x55ed661ef730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:53.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.113+0000 7f5ab714e740 1 --2- 172.21.15.59:0/3970064303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661ef730 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f5aa00149f0 tx=0x7f5aa00047d0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.113+0000 7f5ab714e740 1 -- 172.21.15.59:0/3970064303 shutdown_connections 2024-09-10T21:23:53.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.113+0000 7f5ab714e740 1 --2- 172.21.15.59:0/3970064303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661f2790 0x55ed661f01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.113+0000 7f5ab714e740 1 --2- 172.21.15.59:0/3970064303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661e6800 0x55ed661efc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.113+0000 7f5ab714e740 1 --2- 172.21.15.59:0/3970064303 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55ed66202610 0x55ed66204a80 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.113+0000 7f5ab714e740 1 --2- 172.21.15.59:0/3970064303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661ef730 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.113+0000 7f5ab714e740 1 -- 172.21.15.59:0/3970064303 >> 172.21.15.59:0/3970064303 conn(0x55ed661e3d10 msgr2=0x55ed661e2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:53.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.113+0000 7f5a95ffb640 0 client.17400 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:53.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.113+0000 7f5ab714e740 1 -- 172.21.15.59:0/3970064303 shutdown_connections 2024-09-10T21:23:53.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.113+0000 7f5ab714e740 1 -- 172.21.15.59:0/3970064303 wait complete. 2024-09-10T21:23:53.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.113+0000 7f5ab714e740 20 client.17400 trim_cache size 0 max 16384 2024-09-10T21:23:53.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.131+0000 7f5ab714e740 1 Processor -- start 2024-09-10T21:23:53.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.131+0000 7f5ab714e740 1 -- start start 2024-09-10T21:23:53.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.131+0000 7f5ab714e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661ed260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:53.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.131+0000 7f5ab714e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661e6800 0x55ed6620a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:53.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.131+0000 7f5ab714e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661f2790 0x55ed6620a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:53.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.131+0000 7f5ab714e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab01b04f0 con 0x55ed661e5ee0 2024-09-10T21:23:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.131+0000 7f5ab714e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab01b2030 con 0x55ed661f2790 2024-09-10T21:23:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.131+0000 7f5ab714e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab01b0bc0 con 0x55ed661e6800 2024-09-10T21:23:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.132+0000 7f5aae59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661ed260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.132+0000 7f5aae59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661ed260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37374/0 (socket says 172.21.15.59:37374) 2024-09-10T21:23:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.132+0000 7f5aae59c640 1 -- 172.21.15.59:0/4145170927 learned_addr learned my addr 172.21.15.59:0/4145170927 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.132+0000 7f5aadd9b640 1 --2- 172.21.15.59:0/4145170927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661e6800 0x55ed6620a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.132+0000 7f5aaed9d640 1 --2- 172.21.15.59:0/4145170927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661f2790 0x55ed6620a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.132+0000 7f5aae59c640 1 -- 172.21.15.59:0/4145170927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661e6800 msgr2=0x55ed6620a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.132+0000 7f5aae59c640 1 --2- 172.21.15.59:0/4145170927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661e6800 0x55ed6620a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.132+0000 7f5aae59c640 1 -- 172.21.15.59:0/4145170927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661f2790 msgr2=0x55ed6620a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.132+0000 7f5aae59c640 1 --2- 172.21.15.59:0/4145170927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661f2790 0x55ed6620a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.132+0000 7f5aae59c640 1 -- 172.21.15.59:0/4145170927 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed66204df0 con 0x55ed661e5ee0 2024-09-10T21:23:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.132+0000 7f5aae59c640 1 --2- 172.21.15.59:0/4145170927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661ed260 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0004700 tx=0x7f5aa0006ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c14e959d175e711 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.132+0000 7f5a97fff640 1 -- 172.21.15.59:0/4145170927 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0025040 con 0x55ed661e5ee0 2024-09-10T21:23:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.132+0000 7f5a97fff640 1 -- 172.21.15.59:0/4145170927 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5aa003b070 con 0x55ed661e5ee0 2024-09-10T21:23:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.132+0000 7f5a97fff640 1 -- 172.21.15.59:0/4145170927 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0029970 con 0x55ed661e5ee0 2024-09-10T21:23:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.133+0000 7f5ab714e740 1 -- 172.21.15.59:0/4145170927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 msgr2=0x55ed661ed260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.133+0000 7f5ab714e740 1 --2- 172.21.15.59:0/4145170927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661ed260 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0004700 tx=0x7f5aa0006ab0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.133+0000 7f5ab714e740 1 -- 172.21.15.59:0/4145170927 shutdown_connections 2024-09-10T21:23:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.133+0000 7f5ab714e740 1 --2- 172.21.15.59:0/4145170927 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661f2790 0x55ed6620a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.133+0000 7f5ab714e740 1 --2- 172.21.15.59:0/4145170927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661e6800 0x55ed6620a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.133+0000 7f5ab714e740 1 --2- 172.21.15.59:0/4145170927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661ed260 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.133+0000 7f5ab714e740 1 -- 172.21.15.59:0/4145170927 >> 172.21.15.59:0/4145170927 conn(0x55ed661e3d10 msgr2=0x55ed661ecb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.133+0000 7f5ab714e740 1 -- 172.21.15.59:0/4145170927 shutdown_connections 2024-09-10T21:23:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.133+0000 7f5ab714e740 1 -- 172.21.15.59:0/4145170927 wait complete. 2024-09-10T21:23:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.133+0000 7f5ab714e740 1 -- start start 2024-09-10T21:23:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5ab714e740 1 Processor -- start 2024-09-10T21:23:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5ab714e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661fa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5ab714e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661e6800 0x55ed661fac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5ab714e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661f2790 0x55ed661f5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5ab714e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab01b1960 con 0x55ed661e5ee0 2024-09-10T21:23:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5ab714e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab01b1290 con 0x55ed661f2790 2024-09-10T21:23:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5ab714e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab01ae4d0 con 0x55ed661e6800 2024-09-10T21:23:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5ab714e740 10 client.0 _ll_register_callbacks cb 0x7f5aa0009490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5aae59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661fa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5aae59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661fa6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37386/0 (socket says 172.21.15.59:37386) 2024-09-10T21:23:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5aae59c640 1 -- 172.21.15.59:0/3398400596 learned_addr learned my addr 172.21.15.59:0/3398400596 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5aadd9b640 1 --2- 172.21.15.59:0/3398400596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661e6800 0x55ed661fac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5aaed9d640 1 --2- 172.21.15.59:0/3398400596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661f2790 0x55ed661f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5aae59c640 1 -- 172.21.15.59:0/3398400596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661e6800 msgr2=0x55ed661fac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5aae59c640 1 --2- 172.21.15.59:0/3398400596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661e6800 0x55ed661fac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5aae59c640 1 -- 172.21.15.59:0/3398400596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661f2790 msgr2=0x55ed661f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5aae59c640 1 --2- 172.21.15.59:0/3398400596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661f2790 0x55ed661f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5aae59c640 1 -- 172.21.15.59:0/3398400596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed661fb420 con 0x55ed661e5ee0 2024-09-10T21:23:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5aadd9b640 1 --2- 172.21.15.59:0/3398400596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661e6800 0x55ed661fac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5aae59c640 1 --2- 172.21.15.59:0/3398400596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661fa6e0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0016040 tx=0x7f5aa0029f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6029499eed2b20 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.134+0000 7f5a95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.135+0000 7f5a95ffb640 1 -- 172.21.15.59:0/3398400596 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0045020 con 0x55ed661e5ee0 2024-09-10T21:23:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.135+0000 7f5a95ffb640 1 -- 172.21.15.59:0/3398400596 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f5aa0021bf0 con 0x55ed661e5ee0 2024-09-10T21:23:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.135+0000 7f5ab714e740 1 -- 172.21.15.59:0/3398400596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5aa003b070 con 0x55ed661e5ee0 2024-09-10T21:23:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.135+0000 7f5a95ffb640 1 -- 172.21.15.59:0/3398400596 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5aa0025040 con 0x55ed661e5ee0 2024-09-10T21:23:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.135+0000 7f5ab714e740 10 client.17406 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.135+0000 7f5ab714e740 1 -- 172.21.15.59:0/3398400596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ed6626fb90 con 0x55ed661e5ee0 2024-09-10T21:23:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.135+0000 7f5a95ffb640 1 -- 172.21.15.59:0/3398400596 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5aa003b070 con 0x55ed661e5ee0 2024-09-10T21:23:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.135+0000 7f5a95ffb640 1 -- 172.21.15.59:0/3398400596 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5aa0020040 con 0x55ed661e5ee0 2024-09-10T21:23:53.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.135+0000 7f5ab714e740 10 client.17406 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:53.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.135+0000 7f5ab714e740 10 client.17406 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:23:53.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.135+0000 7f5ab714e740 20 client.17406 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:53.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.135+0000 7f5ab714e740 1 --2- 172.21.15.59:0/3398400596 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55ed66270220 0x55ed66272640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:53.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.135+0000 7f5ab714e740 4 client.17406 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:23:53.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.135+0000 7f5ab714e740 1 -- 172.21.15.59:0/3398400596 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ed6615a860 con 0x55ed66270220 2024-09-10T21:23:53.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.136+0000 7f5aadd9b640 1 --2- 172.21.15.59:0/3398400596 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55ed66270220 0x55ed66272640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:53.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.136+0000 7f5a95ffb640 10 client.17406 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:53.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.136+0000 7f5aadd9b640 1 --2- 172.21.15.59:0/3398400596 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55ed66270220 0x55ed66272640 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54fe75e447e35f55 server_cookie=7be5b1c1da5d6f69 in_seq=0 out_seq=0 2024-09-10T21:23:53.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.138+0000 7f5a95ffb640 1 -- 172.21.15.59:0/3398400596 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ed6615a860 con 0x55ed66270220 2024-09-10T21:23:53.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.138+0000 7f5a95ffb640 10 client.17406 handle_command_reply: tid=0 2024-09-10T21:23:53.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.138+0000 7f5ab714e740 1 client.17406 shutdown 2024-09-10T21:23:53.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.138+0000 7f5ab714e740 1 -- 172.21.15.59:0/3398400596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 msgr2=0x55ed661fa6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:53.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.138+0000 7f5ab714e740 1 --2- 172.21.15.59:0/3398400596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661fa6e0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0016040 tx=0x7f5aa0029f90 comp rx=0 tx=0).stop 2024-09-10T21:23:53.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.138+0000 7f5ab714e740 1 -- 172.21.15.59:0/3398400596 shutdown_connections 2024-09-10T21:23:53.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.138+0000 7f5ab714e740 1 --2- 172.21.15.59:0/3398400596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ed661f2790 0x55ed661f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.138+0000 7f5ab714e740 1 --2- 172.21.15.59:0/3398400596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55ed661e6800 0x55ed661fac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.138+0000 7f5ab714e740 1 --2- 172.21.15.59:0/3398400596 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55ed66270220 0x55ed66272640 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.138+0000 7f5ab714e740 1 --2- 172.21.15.59:0/3398400596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed661e5ee0 0x55ed661fa6e0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.138+0000 7f5ab714e740 1 -- 172.21.15.59:0/3398400596 >> 172.21.15.59:0/3398400596 conn(0x55ed661e3d10 msgr2=0x55ed661f0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:53.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.138+0000 7f5a95ffb640 0 client.17406 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:53.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.138+0000 7f5ab714e740 1 -- 172.21.15.59:0/3398400596 shutdown_connections 2024-09-10T21:23:53.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.138+0000 7f5ab714e740 1 -- 172.21.15.59:0/3398400596 wait complete. 2024-09-10T21:23:53.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.138+0000 7f5ab714e740 20 client.17406 trim_cache size 0 max 16384 2024-09-10T21:23:53.147 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:23:53.147 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:23:53.147 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "0fb476f2-3572-4daf-8d42-5cf40259db46", 2024-09-10T21:23:53.147 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:23:53.147 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:23:53.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.139+0000 7f5ab4d79640 1 -- 172.21.15.59:0/1582557112 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5a980b52e0 msgr2=0x7f5a980b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.139+0000 7f5ab4d79640 1 --2- 172.21.15.59:0/1582557112 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5a980b52e0 0x7f5a980b77a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x55ed661e9060 tx=0x7f5aa0009110 comp rx=0 tx=0).stop 2024-09-10T21:23:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.139+0000 7f5ab4d79640 1 -- 172.21.15.59:0/1582557112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ab0102150 msgr2=0x7f5ab019ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.139+0000 7f5ab4d79640 1 --2- 172.21.15.59:0/1582557112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ab0102150 0x7f5ab019ba80 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400c970 tx=0x7f5aa400cd70 comp rx=0 tx=0).stop 2024-09-10T21:23:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.139+0000 7f5ab4d79640 1 -- 172.21.15.59:0/1582557112 shutdown_connections 2024-09-10T21:23:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.139+0000 7f5ab4d79640 1 --2- 172.21.15.59:0/1582557112 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f5a980b52e0 0x7f5a980b77a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.139+0000 7f5ab4d79640 1 --2- 172.21.15.59:0/1582557112 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ab010f3e0 0x7f5ab01a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.139+0000 7f5ab4d79640 1 --2- 172.21.15.59:0/1582557112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ab0102150 0x7f5ab019ba80 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.139+0000 7f5ab4d79640 1 --2- 172.21.15.59:0/1582557112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ab0101830 0x7f5ab019b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.139+0000 7f5ab4d79640 1 -- 172.21.15.59:0/1582557112 >> 172.21.15.59:0/1582557112 conn(0x7f5ab00fd700 msgr2=0x7f5ab0111590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.139+0000 7f5ab4d79640 1 -- 172.21.15.59:0/1582557112 shutdown_connections 2024-09-10T21:23:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:53.139+0000 7f5ab4d79640 1 -- 172.21.15.59:0/1582557112 wait complete. 2024-09-10T21:23:53.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:53 smithi059 ceph-mon[30888]: pgmap v598: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:23:53.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:53 smithi154 ceph-mon[35041]: pgmap v598: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:23:53.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:53 smithi192 ceph-mon[35363]: pgmap v598: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:23:53.930 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:23:54.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:54 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:23:54.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:54 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:23:54.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:54 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:23:54.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:54 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:23:54.191 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:23:54.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:54 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:23:54.432 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:54 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:23:54.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:54 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:23:54.433 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:54 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:23:54.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:54 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:23:54.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:54 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:23:54.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:54 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:23:54.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:54 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:23:54.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.657+0000 7f3ffd6cd640 1 -- 172.21.15.59:0/150085098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff81076e0 msgr2=0x7f3ff8107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:54.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.657+0000 7f3ffd6cd640 1 --2- 172.21.15.59:0/150085098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff81076e0 0x7f3ff8107b20 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009900 tx=0x7f3fe002a410 comp rx=0 tx=0).stop 2024-09-10T21:23:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.657+0000 7f3ffd6cd640 1 -- 172.21.15.59:0/150085098 shutdown_connections 2024-09-10T21:23:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.657+0000 7f3ffd6cd640 1 --2- 172.21.15.59:0/150085098 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ff8108060 0x7f3ff810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.657+0000 7f3ffd6cd640 1 --2- 172.21.15.59:0/150085098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff81076e0 0x7f3ff8107b20 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.657+0000 7f3ffd6cd640 1 --2- 172.21.15.59:0/150085098 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff8101cd0 0x7f3ff81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.657+0000 7f3ffd6cd640 1 -- 172.21.15.59:0/150085098 >> 172.21.15.59:0/150085098 conn(0x7f3ff80fd700 msgr2=0x7f3ff80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.657+0000 7f3ffd6cd640 1 -- 172.21.15.59:0/150085098 shutdown_connections 2024-09-10T21:23:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.657+0000 7f3ffd6cd640 1 -- 172.21.15.59:0/150085098 wait complete. 2024-09-10T21:23:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.658+0000 7f3ffd6cd640 1 Processor -- start 2024-09-10T21:23:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.658+0000 7f3ffd6cd640 1 -- start start 2024-09-10T21:23:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.658+0000 7f3ffd6cd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff8101cd0 0x7f3ff819b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.658+0000 7f3ffd6cd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff81076e0 0x7f3ff819b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.658+0000 7f3ffd6cd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ff8108060 0x7f3ff81a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.658+0000 7f3ffd6cd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff8111ce0 con 0x7f3ff8101cd0 2024-09-10T21:23:54.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.658+0000 7f3ffd6cd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff8111b60 con 0x7f3ff8108060 2024-09-10T21:23:54.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.658+0000 7f3ffd6cd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff8111e60 con 0x7f3ff81076e0 2024-09-10T21:23:54.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.658+0000 7f3ff6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff8101cd0 0x7f3ff819b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:54.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.658+0000 7f3ff6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff8101cd0 0x7f3ff819b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37406/0 (socket says 172.21.15.59:37406) 2024-09-10T21:23:54.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.658+0000 7f3ff6ffd640 1 -- 172.21.15.59:0/2164865279 learned_addr learned my addr 172.21.15.59:0/2164865279 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:54.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.658+0000 7f3feffff640 1 --2- 172.21.15.59:0/2164865279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff81076e0 0x7f3ff819b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:54.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.659+0000 7f3ff77fe640 1 --2- 172.21.15.59:0/2164865279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ff8108060 0x7f3ff81a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:54.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.659+0000 7f3ff6ffd640 1 -- 172.21.15.59:0/2164865279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff81076e0 msgr2=0x7f3ff819b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:54.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.659+0000 7f3ff6ffd640 1 --2- 172.21.15.59:0/2164865279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff81076e0 0x7f3ff819b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.659+0000 7f3ff6ffd640 1 -- 172.21.15.59:0/2164865279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ff8108060 msgr2=0x7f3ff81a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:54.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.659+0000 7f3ff6ffd640 1 --2- 172.21.15.59:0/2164865279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ff8108060 0x7f3ff81a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.659+0000 7f3ff6ffd640 1 -- 172.21.15.59:0/2164865279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff81a1550 con 0x7f3ff8101cd0 2024-09-10T21:23:54.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.659+0000 7f3ff6ffd640 1 --2- 172.21.15.59:0/2164865279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff8101cd0 0x7f3ff819b4a0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800d770 tx=0x7f3fe800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:54.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.659+0000 7f3ff4ff9640 1 -- 172.21.15.59:0/2164865279 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8017070 con 0x7f3ff8101cd0 2024-09-10T21:23:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.659+0000 7f3ff4ff9640 1 -- 172.21.15.59:0/2164865279 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fe80054d0 con 0x7f3ff8101cd0 2024-09-10T21:23:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.659+0000 7f3ffd6cd640 1 -- 172.21.15.59:0/2164865279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff81a1840 con 0x7f3ff8101cd0 2024-09-10T21:23:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.659+0000 7f3ff4ff9640 1 -- 172.21.15.59:0/2164865279 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8004c30 con 0x7f3ff8101cd0 2024-09-10T21:23:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.659+0000 7f3ffd6cd640 1 -- 172.21.15.59:0/2164865279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff81a7f00 con 0x7f3ff8101cd0 2024-09-10T21:23:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.661+0000 7f3ff4ff9640 1 -- 172.21.15.59:0/2164865279 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f3fe8004e10 con 0x7f3ff8101cd0 2024-09-10T21:23:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.662+0000 7f3fffaa2740 1 Processor -- start 2024-09-10T21:23:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.662+0000 7f3fffaa2740 1 -- start start 2024-09-10T21:23:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.662+0000 7f3fffaa2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c77480 0x55dca3c77860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.662+0000 7f3fffaa2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c77da0 0x55dca3c837f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.662+0000 7f3fffaa2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c83d30 0x55dca3c86120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.662+0000 7f3fffaa2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55dca3bede50 con 0x55dca3c83d30 2024-09-10T21:23:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.662+0000 7f3fffaa2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dca3bdd280 con 0x55dca3c77480 2024-09-10T21:23:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.662+0000 7f3fffaa2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55dca3be1090 con 0x55dca3c77da0 2024-09-10T21:23:54.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.662+0000 7f3feffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c83d30 0x55dca3c86120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.662+0000 7f3feffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c83d30 0x55dca3c86120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37418/0 (socket says 172.21.15.59:37418) 2024-09-10T21:23:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.662+0000 7f3feffff640 1 -- 172.21.15.59:0/2211348950 learned_addr learned my addr 172.21.15.59:0/2211348950 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.662+0000 7f3ff6ffd640 1 --2- 172.21.15.59:0/2211348950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c77da0 0x55dca3c837f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.662+0000 7f3ff77fe640 1 --2- 172.21.15.59:0/2211348950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c77480 0x55dca3c77860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.663+0000 7f3feffff640 1 -- 172.21.15.59:0/2211348950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c77da0 msgr2=0x55dca3c837f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.663+0000 7f3feffff640 1 --2- 172.21.15.59:0/2211348950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c77da0 0x55dca3c837f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.663+0000 7f3feffff640 1 -- 172.21.15.59:0/2211348950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c77480 msgr2=0x55dca3c77860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.663+0000 7f3feffff640 1 --2- 172.21.15.59:0/2211348950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c77480 0x55dca3c77860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.663+0000 7f3feffff640 1 -- 172.21.15.59:0/2211348950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca393b650 con 0x55dca3c83d30 2024-09-10T21:23:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.663+0000 7f3ff4ff9640 1 --2- 172.21.15.59:0/2164865279 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3fe40b5360 0x7f3fe40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.663+0000 7f3feffff640 1 --2- 172.21.15.59:0/2211348950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c83d30 0x55dca3c86120 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009900 tx=0x7f3fe0032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c8bcdd24ac58f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.663+0000 7f3ff77fe640 1 --2- 172.21.15.59:0/2164865279 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3fe40b5360 0x7f3fe40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.663+0000 7f3ff4ff9640 1 -- 172.21.15.59:0/2164865279 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3fe80e5750 con 0x7f3ff8101cd0 2024-09-10T21:23:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.663+0000 7f3fed7fa640 1 -- 172.21.15.59:0/2211348950 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe003f070 con 0x55dca3c83d30 2024-09-10T21:23:54.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.663+0000 7f3fed7fa640 1 -- 172.21.15.59:0/2211348950 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fe00316a0 con 0x55dca3c83d30 2024-09-10T21:23:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.663+0000 7f3fed7fa640 1 -- 172.21.15.59:0/2211348950 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0035070 con 0x55dca3c83d30 2024-09-10T21:23:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.664+0000 7f3fffaa2740 1 -- 172.21.15.59:0/2211348950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c83d30 msgr2=0x55dca3c86120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.664+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/2211348950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c83d30 0x55dca3c86120 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009900 tx=0x7f3fe0032c40 comp rx=0 tx=0).stop 2024-09-10T21:23:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.664+0000 7f3ff77fe640 1 --2- 172.21.15.59:0/2164865279 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3fe40b5360 0x7f3fe40b7820 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0005fd0 tx=0x7f3ff0009740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.664+0000 7f3fffaa2740 1 -- 172.21.15.59:0/2211348950 shutdown_connections 2024-09-10T21:23:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.664+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/2211348950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c83d30 0x55dca3c86120 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.664+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/2211348950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c77da0 0x55dca3c837f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.664+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/2211348950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c77480 0x55dca3c77860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.664+0000 7f3fffaa2740 1 -- 172.21.15.59:0/2211348950 >> 172.21.15.59:0/2211348950 conn(0x55dca3c752b0 msgr2=0x55dca3c76450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.664+0000 7f3fffaa2740 1 -- 172.21.15.59:0/2211348950 shutdown_connections 2024-09-10T21:23:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.664+0000 7f3fffaa2740 1 -- 172.21.15.59:0/2211348950 wait complete. 2024-09-10T21:23:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.664+0000 7f3fffaa2740 1 -- start start 2024-09-10T21:23:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3fffaa2740 1 Processor -- start 2024-09-10T21:23:54.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3fffaa2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c77480 0x55dca3c835a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3fffaa2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c77da0 0x55dca3c809f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3fffaa2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c83d30 0x55dca3c80f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3fffaa2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55dca3a3e700 con 0x55dca3c77480 2024-09-10T21:23:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3fffaa2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dca3b78110 con 0x55dca3c77da0 2024-09-10T21:23:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3fffaa2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55dca3c86950 con 0x55dca3c83d30 2024-09-10T21:23:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3fffaa2740 10 client.0 _ll_register_callbacks cb 0x55dca3b91990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3ff6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c77480 0x55dca3c835a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3ff6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c77480 0x55dca3c835a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37430/0 (socket says 172.21.15.59:37430) 2024-09-10T21:23:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3ff6ffd640 1 -- 172.21.15.59:0/3352568082 learned_addr learned my addr 172.21.15.59:0/3352568082 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3ff77fe640 1 --2- 172.21.15.59:0/3352568082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c83d30 0x55dca3c80f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3feffff640 1 --2- 172.21.15.59:0/3352568082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c77da0 0x55dca3c809f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3ff6ffd640 1 -- 172.21.15.59:0/3352568082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c83d30 msgr2=0x55dca3c80f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:54.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3ff6ffd640 1 --2- 172.21.15.59:0/3352568082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c83d30 0x55dca3c80f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3ff6ffd640 1 -- 172.21.15.59:0/3352568082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c77da0 msgr2=0x55dca3c809f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:54.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3ff6ffd640 1 --2- 172.21.15.59:0/3352568082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c77da0 0x55dca3c809f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3ff6ffd640 1 -- 172.21.15.59:0/3352568082 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dca3ba5c40 con 0x55dca3c77480 2024-09-10T21:23:54.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3feffff640 1 --2- 172.21.15.59:0/3352568082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c77da0 0x55dca3c809f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:54.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3ff6ffd640 1 --2- 172.21.15.59:0/3352568082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c77480 0x55dca3c835a0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009610 tx=0x7f3fe80a85b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58708e422956880a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:54.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.665+0000 7f3fde7fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:54.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.666+0000 7f3fde7fc640 1 -- 172.21.15.59:0/3352568082 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8020070 con 0x55dca3c77480 2024-09-10T21:23:54.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.666+0000 7f3fde7fc640 1 -- 172.21.15.59:0/3352568082 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3fe80930f0 con 0x55dca3c77480 2024-09-10T21:23:54.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.666+0000 7f3fffaa2740 1 -- 172.21.15.59:0/3352568082 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fe00316a0 con 0x55dca3c77480 2024-09-10T21:23:54.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.666+0000 7f3fde7fc640 1 -- 172.21.15.59:0/3352568082 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3fe80ab650 con 0x55dca3c77480 2024-09-10T21:23:54.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.666+0000 7f3fffaa2740 10 client.17418 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:54.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.666+0000 7f3fffaa2740 1 -- 172.21.15.59:0/3352568082 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dca3c922e0 con 0x55dca3c77480 2024-09-10T21:23:54.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.666+0000 7f3fde7fc640 1 -- 172.21.15.59:0/3352568082 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fe00316a0 con 0x55dca3c77480 2024-09-10T21:23:54.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.666+0000 7f3fde7fc640 1 -- 172.21.15.59:0/3352568082 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3fe80ab140 con 0x55dca3c77480 2024-09-10T21:23:54.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.666+0000 7f3fffaa2740 10 client.17418 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:54.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.666+0000 7f3fffaa2740 10 client.17418 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:23:54.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.666+0000 7f3fffaa2740 20 client.17418 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:54.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.666+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/3352568082 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55dca3c937a0 0x55dca3c95bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:54.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.666+0000 7f3fffaa2740 4 client.17418 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:23:54.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.666+0000 7f3fffaa2740 1 -- 172.21.15.59:0/3352568082 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dca3befda0 con 0x55dca3c937a0 2024-09-10T21:23:54.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.667+0000 7f3feffff640 1 --2- 172.21.15.59:0/3352568082 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55dca3c937a0 0x55dca3c95bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:54.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.667+0000 7f3fde7fc640 10 client.17418 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:54.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.667+0000 7f3feffff640 1 --2- 172.21.15.59:0/3352568082 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55dca3c937a0 0x55dca3c95bb0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=454c05d5eef77f8a server_cookie=ba394491a2a7546a in_seq=0 out_seq=0 2024-09-10T21:23:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.668+0000 7f3fde7fc640 1 -- 172.21.15.59:0/3352568082 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dca3befda0 con 0x55dca3c937a0 2024-09-10T21:23:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.668+0000 7f3fde7fc640 10 client.17418 handle_command_reply: tid=0 2024-09-10T21:23:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.668+0000 7f3fffaa2740 1 client.17418 shutdown 2024-09-10T21:23:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.668+0000 7f3fffaa2740 1 -- 172.21.15.59:0/3352568082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c77480 msgr2=0x55dca3c835a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.668+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/3352568082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c77480 0x55dca3c835a0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009610 tx=0x7f3fe80a85b0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.668+0000 7f3fffaa2740 1 -- 172.21.15.59:0/3352568082 shutdown_connections 2024-09-10T21:23:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.668+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/3352568082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c83d30 0x55dca3c80f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.668+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/3352568082 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c77da0 0x55dca3c809f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.668+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/3352568082 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55dca3c937a0 0x55dca3c95bb0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.668+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/3352568082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c77480 0x55dca3c835a0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.668+0000 7f3fffaa2740 1 -- 172.21.15.59:0/3352568082 >> 172.21.15.59:0/3352568082 conn(0x55dca3c752b0 msgr2=0x55dca3c7ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.668+0000 7f3fde7fc640 0 client.17418 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.668+0000 7f3fffaa2740 1 -- 172.21.15.59:0/3352568082 shutdown_connections 2024-09-10T21:23:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.668+0000 7f3fffaa2740 1 -- 172.21.15.59:0/3352568082 wait complete. 2024-09-10T21:23:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.668+0000 7f3fffaa2740 20 client.17418 trim_cache size 0 max 16384 2024-09-10T21:23:54.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.686+0000 7f3fffaa2740 1 Processor -- start 2024-09-10T21:23:54.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.686+0000 7f3fffaa2740 1 -- start start 2024-09-10T21:23:54.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.686+0000 7f3fffaa2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c77480 0x55dca3c8fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:54.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.686+0000 7f3fffaa2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c77da0 0x55dca3c766a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:54.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.686+0000 7f3fffaa2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c83d30 0x55dca3c74bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:54.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.686+0000 7f3fffaa2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff81b0470 con 0x55dca3c83d30 2024-09-10T21:23:54.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.686+0000 7f3fffaa2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff81b1fb0 con 0x55dca3c77da0 2024-09-10T21:23:54.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.686+0000 7f3fffaa2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff81b0b40 con 0x55dca3c77480 2024-09-10T21:23:54.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.687+0000 7f3ff77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c83d30 0x55dca3c74bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:54.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.687+0000 7f3ff77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c83d30 0x55dca3c74bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37438/0 (socket says 172.21.15.59:37438) 2024-09-10T21:23:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.687+0000 7f3ff77fe640 1 -- 172.21.15.59:0/529918748 learned_addr learned my addr 172.21.15.59:0/529918748 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.687+0000 7f3ff6ffd640 1 --2- 172.21.15.59:0/529918748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c77480 0x55dca3c8fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.687+0000 7f3feffff640 1 --2- 172.21.15.59:0/529918748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c77da0 0x55dca3c766a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.687+0000 7f3ff77fe640 1 -- 172.21.15.59:0/529918748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c77480 msgr2=0x55dca3c8fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.687+0000 7f3ff77fe640 1 --2- 172.21.15.59:0/529918748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c77480 0x55dca3c8fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.687+0000 7f3ff77fe640 1 -- 172.21.15.59:0/529918748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c77da0 msgr2=0x55dca3c766a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.687+0000 7f3ff77fe640 1 --2- 172.21.15.59:0/529918748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c77da0 0x55dca3c766a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.687+0000 7f3ff77fe640 1 -- 172.21.15.59:0/529918748 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca3c83910 con 0x55dca3c83d30 2024-09-10T21:23:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.687+0000 7f3feffff640 1 --2- 172.21.15.59:0/529918748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c77da0 0x55dca3c766a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.687+0000 7f3ff77fe640 1 --2- 172.21.15.59:0/529918748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c83d30 0x55dca3c74bc0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f3ff001e6d0 tx=0x7f3ff0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e30f8ef09b0f93 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.687+0000 7f3fecff9640 1 -- 172.21.15.59:0/529918748 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0004b20 con 0x55dca3c83d30 2024-09-10T21:23:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.687+0000 7f3fecff9640 1 -- 172.21.15.59:0/529918748 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ff0004cc0 con 0x55dca3c83d30 2024-09-10T21:23:54.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.687+0000 7f3fecff9640 1 -- 172.21.15.59:0/529918748 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff0005480 con 0x55dca3c83d30 2024-09-10T21:23:54.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.688+0000 7f3fffaa2740 1 -- 172.21.15.59:0/529918748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c83d30 msgr2=0x55dca3c74bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:54.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.688+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/529918748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c83d30 0x55dca3c74bc0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f3ff001e6d0 tx=0x7f3ff0015000 comp rx=0 tx=0).stop 2024-09-10T21:23:54.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.688+0000 7f3fffaa2740 1 -- 172.21.15.59:0/529918748 shutdown_connections 2024-09-10T21:23:54.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.688+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/529918748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c83d30 0x55dca3c74bc0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.688+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/529918748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c77da0 0x55dca3c766a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.688+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/529918748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c77480 0x55dca3c8fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.688+0000 7f3fffaa2740 1 -- 172.21.15.59:0/529918748 >> 172.21.15.59:0/529918748 conn(0x55dca3c752b0 msgr2=0x55dca3c75f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:54.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.688+0000 7f3fffaa2740 1 -- 172.21.15.59:0/529918748 shutdown_connections 2024-09-10T21:23:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.688+0000 7f3fffaa2740 1 -- 172.21.15.59:0/529918748 wait complete. 2024-09-10T21:23:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.688+0000 7f3fffaa2740 1 -- start start 2024-09-10T21:23:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.689+0000 7f3fffaa2740 1 Processor -- start 2024-09-10T21:23:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.689+0000 7f3fffaa2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c77480 0x55dca3c8c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.689+0000 7f3fffaa2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c77da0 0x55dca3c879d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.689+0000 7f3fffaa2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c83d30 0x55dca3c88050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.689+0000 7f3fffaa2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff81b18e0 con 0x55dca3c77da0 2024-09-10T21:23:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.689+0000 7f3fffaa2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff81b1210 con 0x55dca3c83d30 2024-09-10T21:23:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.689+0000 7f3fffaa2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff81ae450 con 0x55dca3c77480 2024-09-10T21:23:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.689+0000 7f3fffaa2740 10 client.0 _ll_register_callbacks cb 0x7f3fe80eb220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.689+0000 7f3feffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c77da0 0x55dca3c879d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.689+0000 7f3feffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c77da0 0x55dca3c879d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37442/0 (socket says 172.21.15.59:37442) 2024-09-10T21:23:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.689+0000 7f3feffff640 1 -- 172.21.15.59:0/3641068867 learned_addr learned my addr 172.21.15.59:0/3641068867 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.689+0000 7f3ff6ffd640 1 --2- 172.21.15.59:0/3641068867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c77480 0x55dca3c8c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.689+0000 7f3feffff640 1 -- 172.21.15.59:0/3641068867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c77480 msgr2=0x55dca3c8c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.689+0000 7f3feffff640 1 --2- 172.21.15.59:0/3641068867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c77480 0x55dca3c8c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.689+0000 7f3feffff640 1 -- 172.21.15.59:0/3641068867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c83d30 msgr2=0x55dca3c88050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.689+0000 7f3feffff640 1 --2- 172.21.15.59:0/3641068867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c83d30 0x55dca3c88050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.689+0000 7f3feffff640 1 -- 172.21.15.59:0/3641068867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dca3cff680 con 0x55dca3c77da0 2024-09-10T21:23:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.689+0000 7f3feffff640 1 --2- 172.21.15.59:0/3641068867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c77da0 0x55dca3c879d0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f3fe002a930 tx=0x7f3fe002aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29ad801dd4f4191 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.689+0000 7f3fde7fc640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.690+0000 7f3fde7fc640 1 -- 172.21.15.59:0/3641068867 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe003f040 con 0x55dca3c77da0 2024-09-10T21:23:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.690+0000 7f3fde7fc640 1 -- 172.21.15.59:0/3641068867 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3fe0031b10 con 0x55dca3c77da0 2024-09-10T21:23:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.690+0000 7f3fffaa2740 1 -- 172.21.15.59:0/3641068867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ff0004cc0 con 0x55dca3c77da0 2024-09-10T21:23:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.690+0000 7f3fde7fc640 1 -- 172.21.15.59:0/3641068867 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3fe005c050 con 0x55dca3c77da0 2024-09-10T21:23:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.690+0000 7f3fffaa2740 10 client.17424 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.690+0000 7f3fffaa2740 1 -- 172.21.15.59:0/3641068867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dca3d00830 con 0x55dca3c77da0 2024-09-10T21:23:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.690+0000 7f3fde7fc640 1 -- 172.21.15.59:0/3641068867 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ff0004cc0 con 0x55dca3c77da0 2024-09-10T21:23:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.690+0000 7f3fde7fc640 1 -- 172.21.15.59:0/3641068867 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3fe0053070 con 0x55dca3c77da0 2024-09-10T21:23:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.690+0000 7f3fffaa2740 10 client.17424 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.690+0000 7f3fffaa2740 10 client.17424 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:23:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.690+0000 7f3fffaa2740 20 client.17424 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.690+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/3641068867 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55dca3d00bf0 0x55dca3d02fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.690+0000 7f3fffaa2740 4 client.17424 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:23:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.690+0000 7f3fffaa2740 1 -- 172.21.15.59:0/3641068867 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dca3beb850 con 0x55dca3d00bf0 2024-09-10T21:23:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.691+0000 7f3ff6ffd640 1 --2- 172.21.15.59:0/3641068867 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55dca3d00bf0 0x55dca3d02fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.691+0000 7f3ff6ffd640 1 --2- 172.21.15.59:0/3641068867 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55dca3d00bf0 0x55dca3d02fe0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c79e8adb54e5918d server_cookie=689017ecf5e6e502 in_seq=0 out_seq=0 2024-09-10T21:23:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.691+0000 7f3fde7fc640 10 client.17424 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.691+0000 7f3fde7fc640 1 -- 172.21.15.59:0/3641068867 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x55dca3beb850 con 0x55dca3d00bf0 2024-09-10T21:23:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.691+0000 7f3fde7fc640 10 client.17424 handle_command_reply: tid=0 2024-09-10T21:23:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.691+0000 7f3fffaa2740 1 client.17424 shutdown 2024-09-10T21:23:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.692+0000 7f3fffaa2740 1 -- 172.21.15.59:0/3641068867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c77da0 msgr2=0x55dca3c879d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.692+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/3641068867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c77da0 0x55dca3c879d0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f3fe002a930 tx=0x7f3fe002aa90 comp rx=0 tx=0).stop 2024-09-10T21:23:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.692+0000 7f3fffaa2740 1 -- 172.21.15.59:0/3641068867 shutdown_connections 2024-09-10T21:23:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.692+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/3641068867 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dca3c83d30 0x55dca3c88050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.692+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/3641068867 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55dca3d00bf0 0x55dca3d02fe0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.692+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/3641068867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dca3c77da0 0x55dca3c879d0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.692+0000 7f3fde7fc640 0 client.17424 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:23:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.692+0000 7f3fffaa2740 1 --2- 172.21.15.59:0/3641068867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dca3c77480 0x55dca3c8c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.692+0000 7f3fffaa2740 1 -- 172.21.15.59:0/3641068867 >> 172.21.15.59:0/3641068867 conn(0x55dca3c752b0 msgr2=0x55dca3c82020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.692+0000 7f3fffaa2740 1 -- 172.21.15.59:0/3641068867 shutdown_connections 2024-09-10T21:23:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.692+0000 7f3fffaa2740 1 -- 172.21.15.59:0/3641068867 wait complete. 2024-09-10T21:23:54.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.692+0000 7f3fffaa2740 20 client.17424 trim_cache size 0 max 16384 2024-09-10T21:23:54.700 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:23:54.700 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:23:54.700 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:23:54.700 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:23:54.700 INFO:teuthology.orchestra.run.smithi059.stdout: "0fb476f2-3572-4daf-8d42-5cf40259db46": { 2024-09-10T21:23:54.700 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:53.136187+0000", 2024-09-10T21:23:54.700 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:54.700 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:54.700 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:54.701 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:54.701 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:54.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:54.701 INFO:teuthology.orchestra.run.smithi059.stdout: "cb01ac69-57ce-4c62-b57a-054abf74df29": { 2024-09-10T21:23:54.701 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:07.589420+0000", 2024-09-10T21:23:54.701 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:54.701 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:54.701 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:54.701 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:54.701 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:54.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:54.701 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:23:54.701 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:23:54.701 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:54.702 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:54.702 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:54.702 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:54.702 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:54.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:54.702 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:23:54.702 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:23:54.702 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:54.702 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:54.702 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:54.702 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:54.702 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:54.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:54.702 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:23:54.702 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:07.066301+0000", 2024-09-10T21:23:54.703 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:54.703 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:54.703 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:54.703 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:54.703 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:54.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:54.703 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:23:54.703 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:23:54.703 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:54.703 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:54.703 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:54.703 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:54.703 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:54.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:54.704 INFO:teuthology.orchestra.run.smithi059.stdout: "7de1e6cf-02c2-41f2-b957-563f88bae8ef": { 2024-09-10T21:23:54.704 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:22:22.098651+0000", 2024-09-10T21:23:54.704 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:54.704 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:54.704 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:54.704 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:54.704 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:54.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:54.704 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:23:54.704 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:23:54.704 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:54.704 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:54.705 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:54.705 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:54.705 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:54.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:54.705 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:23:54.705 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:23:54.705 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:54.705 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:54.705 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:54.705 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:54.705 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:54.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:54.706 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:23:54.706 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:23:54.706 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:54.706 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:54.706 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:54.706 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:54.706 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:54.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:54.706 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:23:54.706 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:23:54.706 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:54.706 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:54.706 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:54.706 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:54.707 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:54.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:54.707 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:23:54.707 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:23:54.707 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:54.707 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:54.707 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:54.707 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:54.707 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:54.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:54.707 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:23:54.707 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:23:54.707 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:54.707 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:54.708 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:54.708 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:54.708 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:54.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:54.708 INFO:teuthology.orchestra.run.smithi059.stdout: "800cdb00-6a99-4c42-8a9e-4b1c599c6af0": { 2024-09-10T21:23:54.708 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:52.224081+0000", 2024-09-10T21:23:54.708 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:54.708 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:54.708 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:54.708 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:54.708 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:54.708 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:23:54.708 INFO:teuthology.orchestra.run.smithi059.stdout: "d82f24b1-930e-4f83-a379-3084f22918d0": { 2024-09-10T21:23:54.708 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:21:37.203865+0000", 2024-09-10T21:23:54.708 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:23:54.709 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:23:54.709 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:23:54.709 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:23:54.709 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:23:54.709 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:23:54.709 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:23:54.709 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:23:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.692+0000 7f3ffd6cd640 1 -- 172.21.15.59:0/2164865279 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3fe40b5360 msgr2=0x7f3fe40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.692+0000 7f3ffd6cd640 1 --2- 172.21.15.59:0/2164865279 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3fe40b5360 0x7f3fe40b7820 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0005fd0 tx=0x7f3ff0009740 comp rx=0 tx=0).stop 2024-09-10T21:23:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.693+0000 7f3ffd6cd640 1 -- 172.21.15.59:0/2164865279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff8101cd0 msgr2=0x7f3ff819b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.693+0000 7f3ffd6cd640 1 --2- 172.21.15.59:0/2164865279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff8101cd0 0x7f3ff819b4a0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f3fe800d770 tx=0x7f3fe800dc30 comp rx=0 tx=0).stop 2024-09-10T21:23:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.693+0000 7f3ffd6cd640 1 -- 172.21.15.59:0/2164865279 shutdown_connections 2024-09-10T21:23:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.693+0000 7f3ffd6cd640 1 --2- 172.21.15.59:0/2164865279 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3fe40b5360 0x7f3fe40b7820 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.693+0000 7f3ffd6cd640 1 --2- 172.21.15.59:0/2164865279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ff8108060 0x7f3ff81a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.693+0000 7f3ffd6cd640 1 --2- 172.21.15.59:0/2164865279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ff81076e0 0x7f3ff819b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.693+0000 7f3ffd6cd640 1 --2- 172.21.15.59:0/2164865279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ff8101cd0 0x7f3ff819b4a0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.693+0000 7f3ffd6cd640 1 -- 172.21.15.59:0/2164865279 >> 172.21.15.59:0/2164865279 conn(0x7f3ff80fd700 msgr2=0x7f3ff8100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.693+0000 7f3ffd6cd640 1 -- 172.21.15.59:0/2164865279 shutdown_connections 2024-09-10T21:23:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:54.693+0000 7f3ffd6cd640 1 -- 172.21.15.59:0/2164865279 wait complete. 2024-09-10T21:23:55.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:55 smithi059 ceph-mon[30888]: pgmap v599: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:23:55.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:55 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:23:55.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:55 smithi154 ceph-mon[35041]: pgmap v599: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:23:55.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:55 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:23:55.545 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:23:55.545 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:23:55.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:55 smithi192 ceph-mon[35363]: pgmap v599: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:23:55.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:55 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:23:55.804 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:23:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.325+0000 7f74d733a640 1 -- 172.21.15.59:0/147350351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74d01076e0 msgr2=0x7f74d0107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.325+0000 7f74d733a640 1 --2- 172.21.15.59:0/147350351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74d01076e0 0x7f74d0107b20 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f74c0009900 tx=0x7f74c002a410 comp rx=0 tx=0).stop 2024-09-10T21:23:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.325+0000 7f74d733a640 1 -- 172.21.15.59:0/147350351 shutdown_connections 2024-09-10T21:23:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.325+0000 7f74d733a640 1 --2- 172.21.15.59:0/147350351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74d0108060 0x7f74d010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.325+0000 7f74d733a640 1 --2- 172.21.15.59:0/147350351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74d01076e0 0x7f74d0107b20 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:56.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.325+0000 7f74d733a640 1 --2- 172.21.15.59:0/147350351 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74d0101cd0 0x7f74d01020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.325+0000 7f74d733a640 1 -- 172.21.15.59:0/147350351 >> 172.21.15.59:0/147350351 conn(0x7f74d00fd700 msgr2=0x7f74d00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.325+0000 7f74d733a640 1 -- 172.21.15.59:0/147350351 shutdown_connections 2024-09-10T21:23:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.325+0000 7f74d733a640 1 -- 172.21.15.59:0/147350351 wait complete. 2024-09-10T21:23:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.326+0000 7f74d733a640 1 Processor -- start 2024-09-10T21:23:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.326+0000 7f74d733a640 1 -- start start 2024-09-10T21:23:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.326+0000 7f74d733a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74d0101cd0 0x7f74d01992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.326+0000 7f74d733a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74d01076e0 0x7f74d01997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.326+0000 7f74d733a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74d0108060 0x7f74d019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.326+0000 7f74d733a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f74d0111cb0 con 0x7f74d01076e0 2024-09-10T21:23:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.326+0000 7f74d733a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f74d0111b30 con 0x7f74d0101cd0 2024-09-10T21:23:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.326+0000 7f74d733a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f74d0111e30 con 0x7f74d0108060 2024-09-10T21:23:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.326+0000 7f74d48d5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74d01076e0 0x7f74d01997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.326+0000 7f74d48d5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74d01076e0 0x7f74d01997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37454/0 (socket says 172.21.15.59:37454) 2024-09-10T21:23:56.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.326+0000 7f74d48d5640 1 -- 172.21.15.59:0/3527152434 learned_addr learned my addr 172.21.15.59:0/3527152434 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.326+0000 7f74d58d7640 1 --2- 172.21.15.59:0/3527152434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74d0108060 0x7f74d019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.327+0000 7f74d50d6640 1 --2- 172.21.15.59:0/3527152434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74d0101cd0 0x7f74d01992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.327+0000 7f74d48d5640 1 -- 172.21.15.59:0/3527152434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74d0108060 msgr2=0x7f74d019eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.327+0000 7f74d48d5640 1 --2- 172.21.15.59:0/3527152434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74d0108060 0x7f74d019eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.327+0000 7f74d48d5640 1 -- 172.21.15.59:0/3527152434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74d0101cd0 msgr2=0x7f74d01992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.327+0000 7f74d48d5640 1 --2- 172.21.15.59:0/3527152434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74d0101cd0 0x7f74d01992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.327+0000 7f74d48d5640 1 -- 172.21.15.59:0/3527152434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d019f350 con 0x7f74d01076e0 2024-09-10T21:23:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.327+0000 7f74d58d7640 1 --2- 172.21.15.59:0/3527152434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74d0108060 0x7f74d019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.327+0000 7f74d50d6640 1 --2- 172.21.15.59:0/3527152434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74d0101cd0 0x7f74d01992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.327+0000 7f74d48d5640 1 --2- 172.21.15.59:0/3527152434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74d01076e0 0x7f74d01997e0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f74c0005940 tx=0x7f74c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.327+0000 7f74c67fc640 1 -- 172.21.15.59:0/3527152434 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c003f030 con 0x7f74d01076e0 2024-09-10T21:23:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.327+0000 7f74d733a640 1 -- 172.21.15.59:0/3527152434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d019f5e0 con 0x7f74d01076e0 2024-09-10T21:23:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.327+0000 7f74c67fc640 1 -- 172.21.15.59:0/3527152434 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74c0003cb0 con 0x7f74d01076e0 2024-09-10T21:23:56.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.327+0000 7f74c67fc640 1 -- 172.21.15.59:0/3527152434 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c0035070 con 0x7f74d01076e0 2024-09-10T21:23:56.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.327+0000 7f74d733a640 1 -- 172.21.15.59:0/3527152434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d01a5d00 con 0x7f74d01076e0 2024-09-10T21:23:56.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.328+0000 7f74d733a640 1 -- 172.21.15.59:0/3527152434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74d01020b0 con 0x7f74d01076e0 2024-09-10T21:23:56.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.329+0000 7f74c67fc640 1 -- 172.21.15.59:0/3527152434 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f74c003bbf0 con 0x7f74d01076e0 2024-09-10T21:23:56.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.330+0000 7f74c67fc640 1 --2- 172.21.15.59:0/3527152434 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f74bc0b52e0 0x7f74bc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:56.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.330+0000 7f74d50d6640 1 --2- 172.21.15.59:0/3527152434 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f74bc0b52e0 0x7f74bc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:56.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.330+0000 7f74c67fc640 1 -- 172.21.15.59:0/3527152434 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f74c0106ab0 con 0x7f74d01076e0 2024-09-10T21:23:56.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.331+0000 7f74d50d6640 1 --2- 172.21.15.59:0/3527152434 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f74bc0b52e0 0x7f74bc0b77a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0058c0 tx=0x7f74cc005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:56.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.333+0000 7f74c67fc640 1 -- 172.21.15.59:0/3527152434 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f74c00cd940 con 0x7f74d01076e0 2024-09-10T21:23:56.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.554+0000 7f74d733a640 1 -- 172.21.15.59:0/3527152434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74d019a3d0 con 0x7f74d01076e0 2024-09-10T21:23:56.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.555+0000 7f74c67fc640 1 -- 172.21.15.59:0/3527152434 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f74c00cd240 con 0x7f74d01076e0 2024-09-10T21:23:56.558 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:23:56.558 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:23:56.558 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:23:56.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.557+0000 7f74d733a640 1 -- 172.21.15.59:0/3527152434 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f74bc0b52e0 msgr2=0x7f74bc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:56.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.557+0000 7f74d733a640 1 --2- 172.21.15.59:0/3527152434 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f74bc0b52e0 0x7f74bc0b77a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0058c0 tx=0x7f74cc005d30 comp rx=0 tx=0).stop 2024-09-10T21:23:56.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.557+0000 7f74d733a640 1 -- 172.21.15.59:0/3527152434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74d01076e0 msgr2=0x7f74d01997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:56.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.557+0000 7f74d733a640 1 --2- 172.21.15.59:0/3527152434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74d01076e0 0x7f74d01997e0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f74c0005940 tx=0x7f74c00042f0 comp rx=0 tx=0).stop 2024-09-10T21:23:56.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.557+0000 7f74d733a640 1 -- 172.21.15.59:0/3527152434 shutdown_connections 2024-09-10T21:23:56.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.557+0000 7f74d733a640 1 --2- 172.21.15.59:0/3527152434 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f74bc0b52e0 0x7f74bc0b77a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:56.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.557+0000 7f74d733a640 1 --2- 172.21.15.59:0/3527152434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74d0108060 0x7f74d019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:56.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.557+0000 7f74d733a640 1 --2- 172.21.15.59:0/3527152434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74d01076e0 0x7f74d01997e0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:56.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.557+0000 7f74d733a640 1 --2- 172.21.15.59:0/3527152434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f74d0101cd0 0x7f74d01992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:56.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.557+0000 7f74d733a640 1 -- 172.21.15.59:0/3527152434 >> 172.21.15.59:0/3527152434 conn(0x7f74d00fd700 msgr2=0x7f74d01005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:56.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.557+0000 7f74d733a640 1 -- 172.21.15.59:0/3527152434 shutdown_connections 2024-09-10T21:23:56.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:56.557+0000 7f74d733a640 1 -- 172.21.15.59:0/3527152434 wait complete. 2024-09-10T21:23:57.267 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:57 smithi059 ceph-mon[30888]: pgmap v600: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:23:57.267 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:57 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3527152434' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:23:57.298 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:23:57.378 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:57 smithi192 ceph-mon[35363]: pgmap v600: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:23:57.379 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:57 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3527152434' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:23:57.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:57 smithi154 ceph-mon[35041]: pgmap v600: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:23:57.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:57 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3527152434' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:23:57.557 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:23:58.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.087+0000 7fbe9b385640 1 -- 172.21.15.59:0/2417056799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9410d140 msgr2=0x7fbe9410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:58.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.087+0000 7fbe9b385640 1 --2- 172.21.15.59:0/2417056799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9410d140 0x7fbe9410f5a0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009900 tx=0x7fbe8c02a410 comp rx=0 tx=0).stop 2024-09-10T21:23:58.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.087+0000 7fbe9b385640 1 -- 172.21.15.59:0/2417056799 shutdown_connections 2024-09-10T21:23:58.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.087+0000 7fbe9b385640 1 --2- 172.21.15.59:0/2417056799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9410d140 0x7fbe9410f5a0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.087+0000 7fbe9b385640 1 --2- 172.21.15.59:0/2417056799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe94104600 0x7fbe9410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.087+0000 7fbe9b385640 1 --2- 172.21.15.59:0/2417056799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe94103ce0 0x7fbe941040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.087+0000 7fbe9b385640 1 -- 172.21.15.59:0/2417056799 >> 172.21.15.59:0/2417056799 conn(0x7fbe940fd700 msgr2=0x7fbe940ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:58.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.087+0000 7fbe9b385640 1 -- 172.21.15.59:0/2417056799 shutdown_connections 2024-09-10T21:23:58.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.087+0000 7fbe9b385640 1 -- 172.21.15.59:0/2417056799 wait complete. 2024-09-10T21:23:58.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.087+0000 7fbe9b385640 1 Processor -- start 2024-09-10T21:23:58.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.088+0000 7fbe9b385640 1 -- start start 2024-09-10T21:23:58.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.088+0000 7fbe9b385640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe94103ce0 0x7fbe94199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:58.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.088+0000 7fbe9b385640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe94104600 0x7fbe941997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:58.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.088+0000 7fbe9b385640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9410d140 0x7fbe9419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:58.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.088+0000 7fbe9b385640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbe94112db0 con 0x7fbe9410d140 2024-09-10T21:23:58.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.088+0000 7fbe9b385640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbe94112c30 con 0x7fbe94103ce0 2024-09-10T21:23:58.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.088+0000 7fbe9b385640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbe94112f30 con 0x7fbe94104600 2024-09-10T21:23:58.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.088+0000 7fbe99922640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9410d140 0x7fbe9419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:58.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.088+0000 7fbe99922640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9410d140 0x7fbe9419eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37470/0 (socket says 172.21.15.59:37470) 2024-09-10T21:23:58.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.088+0000 7fbe99922640 1 -- 172.21.15.59:0/2373559353 learned_addr learned my addr 172.21.15.59:0/2373559353 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:58.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.088+0000 7fbe99121640 1 --2- 172.21.15.59:0/2373559353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe94103ce0 0x7fbe94199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:58.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.088+0000 7fbe98920640 1 --2- 172.21.15.59:0/2373559353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe94104600 0x7fbe941997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:58.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.088+0000 7fbe99922640 1 -- 172.21.15.59:0/2373559353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe94104600 msgr2=0x7fbe941997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:58.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.088+0000 7fbe99922640 1 --2- 172.21.15.59:0/2373559353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe94104600 0x7fbe941997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.088+0000 7fbe99922640 1 -- 172.21.15.59:0/2373559353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe94103ce0 msgr2=0x7fbe94199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:58.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.088+0000 7fbe99922640 1 --2- 172.21.15.59:0/2373559353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe94103ce0 0x7fbe94199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.088+0000 7fbe99922640 1 -- 172.21.15.59:0/2373559353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9419f310 con 0x7fbe9410d140 2024-09-10T21:23:58.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.089+0000 7fbe99922640 1 --2- 172.21.15.59:0/2373559353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9410d140 0x7fbe9419eb40 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c004770 tx=0x7fbe8c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:58.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.089+0000 7fbe867fc640 1 -- 172.21.15.59:0/2373559353 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c03f030 con 0x7fbe9410d140 2024-09-10T21:23:58.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.089+0000 7fbe867fc640 1 -- 172.21.15.59:0/2373559353 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe8c003aa0 con 0x7fbe9410d140 2024-09-10T21:23:58.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.089+0000 7fbe9b385640 1 -- 172.21.15.59:0/2373559353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9419f5a0 con 0x7fbe9410d140 2024-09-10T21:23:58.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.089+0000 7fbe867fc640 1 -- 172.21.15.59:0/2373559353 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c035070 con 0x7fbe9410d140 2024-09-10T21:23:58.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.089+0000 7fbe9b385640 1 -- 172.21.15.59:0/2373559353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe941a5cc0 con 0x7fbe9410d140 2024-09-10T21:23:58.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.091+0000 7fbe9d75a740 1 Processor -- start 2024-09-10T21:23:58.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.091+0000 7fbe867fc640 1 -- 172.21.15.59:0/2373559353 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fbe8c0035f0 con 0x7fbe9410d140 2024-09-10T21:23:58.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe9d75a740 1 -- start start 2024-09-10T21:23:58.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe9d75a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068d94d0 0x5578068d98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:58.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe9d75a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d9df0 0x5578068e9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:58.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe9d75a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068ea190 0x5578068ec580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:58.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe9d75a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55780684fea0 con 0x5578068d9df0 2024-09-10T21:23:58.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe9d75a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55780683f2d0 con 0x5578068ea190 2024-09-10T21:23:58.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe9d75a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5578068430e0 con 0x5578068d94d0 2024-09-10T21:23:58.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe99121640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d9df0 0x5578068e9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:58.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe99121640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d9df0 0x5578068e9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37486/0 (socket says 172.21.15.59:37486) 2024-09-10T21:23:58.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe99121640 1 -- 172.21.15.59:0/2084038 learned_addr learned my addr 172.21.15.59:0/2084038 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:58.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe98920640 1 --2- 172.21.15.59:0/2084038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068ea190 0x5578068ec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:58.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe98920640 1 --2- 172.21.15.59:0/2084038 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068d94d0 0x5578068d98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:58.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe99121640 1 -- 172.21.15.59:0/2084038 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068d94d0 msgr2=0x5578068d98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:58.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe99121640 1 --2- 172.21.15.59:0/2084038 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068d94d0 0x5578068d98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe99121640 1 -- 172.21.15.59:0/2084038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068ea190 msgr2=0x5578068ec580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:58.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe99121640 1 --2- 172.21.15.59:0/2084038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068ea190 0x5578068ec580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe99121640 1 -- 172.21.15.59:0/2084038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55780659d650 con 0x5578068d9df0 2024-09-10T21:23:58.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe98920640 1 --2- 172.21.15.59:0/2084038 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068d94d0 0x5578068d98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:58.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe867fc640 1 --2- 172.21.15.59:0/2373559353 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbe800b52e0 0x7fbe800b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:58.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.092+0000 7fbe99121640 1 --2- 172.21.15.59:0/2084038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d9df0 0x5578068e9c50 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fbe88003a20 tx=0x7fbe88003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b70b3b0da894b07 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:58.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.093+0000 7fbe98920640 1 --2- 172.21.15.59:0/2373559353 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbe800b52e0 0x7fbe800b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:58.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.093+0000 7fbe867fc640 1 -- 172.21.15.59:0/2373559353 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbe8c106260 con 0x7fbe9410d140 2024-09-10T21:23:58.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.093+0000 7fbe7f7fe640 1 -- 172.21.15.59:0/2084038 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88004b20 con 0x5578068d9df0 2024-09-10T21:23:58.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.093+0000 7fbe98920640 1 --2- 172.21.15.59:0/2373559353 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbe800b52e0 0x7fbe800b77a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x5578068d9480 tx=0x7fbe90014040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:58.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.093+0000 7fbe7f7fe640 1 -- 172.21.15.59:0/2084038 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe88004cc0 con 0x5578068d9df0 2024-09-10T21:23:58.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.093+0000 7fbe7f7fe640 1 -- 172.21.15.59:0/2084038 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe880126b0 con 0x5578068d9df0 2024-09-10T21:23:58.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.094+0000 7fbe9d75a740 1 -- 172.21.15.59:0/2084038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d9df0 msgr2=0x5578068e9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:58.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.094+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/2084038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d9df0 0x5578068e9c50 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fbe88003a20 tx=0x7fbe88003ee0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.094+0000 7fbe9d75a740 1 -- 172.21.15.59:0/2084038 shutdown_connections 2024-09-10T21:23:58.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.094+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/2084038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068ea190 0x5578068ec580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.094+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/2084038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d9df0 0x5578068e9c50 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.094+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/2084038 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068d94d0 0x5578068d98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.094+0000 7fbe9d75a740 1 -- 172.21.15.59:0/2084038 >> 172.21.15.59:0/2084038 conn(0x5578068d7300 msgr2=0x5578068d84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:58.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.094+0000 7fbe9d75a740 1 -- 172.21.15.59:0/2084038 shutdown_connections 2024-09-10T21:23:58.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.094+0000 7fbe9d75a740 1 -- 172.21.15.59:0/2084038 wait complete. 2024-09-10T21:23:58.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.094+0000 7fbe9d75a740 1 -- start start 2024-09-10T21:23:58.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.094+0000 7fbe9d75a740 1 Processor -- start 2024-09-10T21:23:58.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.095+0000 7fbe9d75a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d94d0 0x5578068e9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:58.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.095+0000 7fbe9d75a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068d9df0 0x5578068e6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:58.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.095+0000 7fbe9d75a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068ea190 0x5578068e7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:58.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.095+0000 7fbe9d75a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5578066a0700 con 0x5578068d94d0 2024-09-10T21:23:58.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.095+0000 7fbe9d75a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5578067da160 con 0x5578068d9df0 2024-09-10T21:23:58.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.095+0000 7fbe9d75a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5578068ece40 con 0x5578068ea190 2024-09-10T21:23:58.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.095+0000 7fbe99121640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d94d0 0x5578068e9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:58.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.095+0000 7fbe99121640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d94d0 0x5578068e9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37492/0 (socket says 172.21.15.59:37492) 2024-09-10T21:23:58.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.095+0000 7fbe99121640 1 -- 172.21.15.59:0/1392435852 learned_addr learned my addr 172.21.15.59:0/1392435852 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:58.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.095+0000 7fbe9d75a740 10 client.0 _ll_register_callbacks cb 0x5578067f39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:58.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.095+0000 7fbe98920640 1 --2- 172.21.15.59:0/1392435852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068d9df0 0x5578068e6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:58.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.095+0000 7fbe99922640 1 --2- 172.21.15.59:0/1392435852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068ea190 0x5578068e7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:58.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.095+0000 7fbe99121640 1 -- 172.21.15.59:0/1392435852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068ea190 msgr2=0x5578068e7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:58.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.095+0000 7fbe99121640 1 --2- 172.21.15.59:0/1392435852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068ea190 0x5578068e7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.095+0000 7fbe99121640 1 -- 172.21.15.59:0/1392435852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068d9df0 msgr2=0x5578068e6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:58.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.095+0000 7fbe99121640 1 --2- 172.21.15.59:0/1392435852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068d9df0 0x5578068e6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.095+0000 7fbe99121640 1 -- 172.21.15.59:0/1392435852 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557806807c90 con 0x5578068d94d0 2024-09-10T21:23:58.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.095+0000 7fbe99121640 1 --2- 172.21.15.59:0/1392435852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d94d0 0x5578068e9a10 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fbe880049d0 tx=0x7fbe88009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f899a897fdb45513 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:58.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.095+0000 7fbe7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:58.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.097+0000 7fbe7cff9640 1 -- 172.21.15.59:0/1392435852 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88005280 con 0x5578068d94d0 2024-09-10T21:23:58.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.097+0000 7fbe7cff9640 1 -- 172.21.15.59:0/1392435852 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbe88005420 con 0x5578068d94d0 2024-09-10T21:23:58.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.097+0000 7fbe9d75a740 1 -- 172.21.15.59:0/1392435852 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe88004cc0 con 0x5578068d94d0 2024-09-10T21:23:58.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.097+0000 7fbe7cff9640 1 -- 172.21.15.59:0/1392435852 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbe88005660 con 0x5578068d94d0 2024-09-10T21:23:58.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.097+0000 7fbe9d75a740 10 client.17442 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:58.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.097+0000 7fbe9d75a740 1 -- 172.21.15.59:0/1392435852 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5578068f8660 con 0x5578068d94d0 2024-09-10T21:23:58.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.097+0000 7fbe7cff9640 1 -- 172.21.15.59:0/1392435852 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe88004cc0 con 0x5578068d94d0 2024-09-10T21:23:58.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.098+0000 7fbe7cff9640 1 -- 172.21.15.59:0/1392435852 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbe8800f040 con 0x5578068d94d0 2024-09-10T21:23:58.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.098+0000 7fbe9d75a740 10 client.17442 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:58.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.098+0000 7fbe9d75a740 10 client.17442 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:23:58.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.098+0000 7fbe9d75a740 20 client.17442 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:58.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.098+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/1392435852 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5578068f9a10 0x5578068fbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:58.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.098+0000 7fbe9d75a740 4 client.17442 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:23:58.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.098+0000 7fbe9d75a740 1 -- 172.21.15.59:0/1392435852 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557806851df0 con 0x5578068f9a10 2024-09-10T21:23:58.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.098+0000 7fbe98920640 1 --2- 172.21.15.59:0/1392435852 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5578068f9a10 0x5578068fbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:58.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.098+0000 7fbe98920640 1 --2- 172.21.15.59:0/1392435852 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5578068f9a10 0x5578068fbe00 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3923640120686ad8 server_cookie=2ecee699e7d029d4 in_seq=0 out_seq=0 2024-09-10T21:23:58.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.098+0000 7fbe7cff9640 10 client.17442 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:23:58.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.099+0000 7fbe7cff9640 1 -- 172.21.15.59:0/1392435852 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557806851df0 con 0x5578068f9a10 2024-09-10T21:23:58.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.099+0000 7fbe7cff9640 10 client.17442 handle_command_reply: tid=0 2024-09-10T21:23:58.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.099+0000 7fbe9d75a740 1 client.17442 shutdown 2024-09-10T21:23:58.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.099+0000 7fbe9d75a740 1 -- 172.21.15.59:0/1392435852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d94d0 msgr2=0x5578068e9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:58.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.099+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/1392435852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d94d0 0x5578068e9a10 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fbe880049d0 tx=0x7fbe88009c30 comp rx=0 tx=0).stop 2024-09-10T21:23:58.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.099+0000 7fbe9d75a740 1 -- 172.21.15.59:0/1392435852 shutdown_connections 2024-09-10T21:23:58.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.099+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/1392435852 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5578068f9a10 0x5578068fbe00 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.099+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/1392435852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068ea190 0x5578068e7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.099+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/1392435852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068d9df0 0x5578068e6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.099+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/1392435852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d94d0 0x5578068e9a10 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.099+0000 7fbe9d75a740 1 -- 172.21.15.59:0/1392435852 >> 172.21.15.59:0/1392435852 conn(0x5578068d7300 msgr2=0x5578068d6420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:58.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.099+0000 7fbe7cff9640 0 client.17442 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:23:58.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.100+0000 7fbe9d75a740 1 -- 172.21.15.59:0/1392435852 shutdown_connections 2024-09-10T21:23:58.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.100+0000 7fbe9d75a740 1 -- 172.21.15.59:0/1392435852 wait complete. 2024-09-10T21:23:58.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.100+0000 7fbe9d75a740 20 client.17442 trim_cache size 0 max 16384 2024-09-10T21:23:58.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.113+0000 7fbe9d75a740 1 Processor -- start 2024-09-10T21:23:58.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.113+0000 7fbe9d75a740 1 -- start start 2024-09-10T21:23:58.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.113+0000 7fbe9d75a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d94d0 0x5578068e5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:58.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.113+0000 7fbe9d75a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068d9df0 0x5578068e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:58.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.113+0000 7fbe9d75a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068ea190 0x557806901670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:58.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.113+0000 7fbe9d75a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbe941ac0f0 con 0x5578068d94d0 2024-09-10T21:23:58.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.113+0000 7fbe9d75a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbe941adc30 con 0x5578068d9df0 2024-09-10T21:23:58.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.113+0000 7fbe9d75a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbe941ac7c0 con 0x5578068ea190 2024-09-10T21:23:58.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.113+0000 7fbe99121640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d94d0 0x5578068e5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:58.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.113+0000 7fbe99121640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d94d0 0x5578068e5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37504/0 (socket says 172.21.15.59:37504) 2024-09-10T21:23:58.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.113+0000 7fbe99121640 1 -- 172.21.15.59:0/2308899167 learned_addr learned my addr 172.21.15.59:0/2308899167 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:58.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.113+0000 7fbe99922640 1 --2- 172.21.15.59:0/2308899167 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068ea190 0x557806901670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:58.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.113+0000 7fbe98920640 1 --2- 172.21.15.59:0/2308899167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068d9df0 0x5578068e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:58.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.113+0000 7fbe99121640 1 -- 172.21.15.59:0/2308899167 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068ea190 msgr2=0x557806901670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:58.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.113+0000 7fbe99121640 1 --2- 172.21.15.59:0/2308899167 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068ea190 0x557806901670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.113+0000 7fbe99121640 1 -- 172.21.15.59:0/2308899167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068d9df0 msgr2=0x5578068e5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:58.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.113+0000 7fbe99121640 1 --2- 172.21.15.59:0/2308899167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068d9df0 0x5578068e5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.113+0000 7fbe99121640 1 -- 172.21.15.59:0/2308899167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578068df630 con 0x5578068d94d0 2024-09-10T21:23:58.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.113+0000 7fbe98920640 1 --2- 172.21.15.59:0/2308899167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068d9df0 0x5578068e5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:58.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.114+0000 7fbe99121640 1 --2- 172.21.15.59:0/2308899167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d94d0 0x5578068e5700 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fbe88003f20 tx=0x7fbe88005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360a695e72ee8b8c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:58.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.114+0000 7fbe7effd640 1 -- 172.21.15.59:0/2308899167 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe880099c0 con 0x5578068d94d0 2024-09-10T21:23:58.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.114+0000 7fbe7effd640 1 -- 172.21.15.59:0/2308899167 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe88035020 con 0x5578068d94d0 2024-09-10T21:23:58.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.114+0000 7fbe7effd640 1 -- 172.21.15.59:0/2308899167 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe880052e0 con 0x5578068d94d0 2024-09-10T21:23:58.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.114+0000 7fbe9d75a740 1 -- 172.21.15.59:0/2308899167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d94d0 msgr2=0x5578068e5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:58.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.114+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/2308899167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d94d0 0x5578068e5700 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fbe88003f20 tx=0x7fbe88005bd0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.115+0000 7fbe9d75a740 1 -- 172.21.15.59:0/2308899167 shutdown_connections 2024-09-10T21:23:58.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.115+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/2308899167 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068ea190 0x557806901670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.115+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/2308899167 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068d9df0 0x5578068e5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.115+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/2308899167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d94d0 0x5578068e5700 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.115+0000 7fbe9d75a740 1 -- 172.21.15.59:0/2308899167 >> 172.21.15.59:0/2308899167 conn(0x5578068d7300 msgr2=0x5578068fba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:58.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.115+0000 7fbe9d75a740 1 -- 172.21.15.59:0/2308899167 shutdown_connections 2024-09-10T21:23:58.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.115+0000 7fbe9d75a740 1 -- 172.21.15.59:0/2308899167 wait complete. 2024-09-10T21:23:58.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.115+0000 7fbe9d75a740 1 -- start start 2024-09-10T21:23:58.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.115+0000 7fbe9d75a740 1 Processor -- start 2024-09-10T21:23:58.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe9d75a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068d94d0 0x5578068f2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:58.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe9d75a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d9df0 0x557806901360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:58.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe9d75a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068ea190 0x557806901990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:58.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe9d75a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbe941ad560 con 0x5578068d9df0 2024-09-10T21:23:58.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe9d75a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbe941ace90 con 0x5578068d94d0 2024-09-10T21:23:58.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe9d75a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbe941aa0d0 con 0x5578068ea190 2024-09-10T21:23:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe9d75a740 10 client.0 _ll_register_callbacks cb 0x7fbe88009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe98920640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d9df0 0x557806901360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe98920640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d9df0 0x557806901360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37518/0 (socket says 172.21.15.59:37518) 2024-09-10T21:23:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe98920640 1 -- 172.21.15.59:0/233216151 learned_addr learned my addr 172.21.15.59:0/233216151 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe99922640 1 --2- 172.21.15.59:0/233216151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068ea190 0x557806901990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe99121640 1 --2- 172.21.15.59:0/233216151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068d94d0 0x5578068f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe98920640 1 -- 172.21.15.59:0/233216151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068ea190 msgr2=0x557806901990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe98920640 1 --2- 172.21.15.59:0/233216151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068ea190 0x557806901990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe98920640 1 -- 172.21.15.59:0/233216151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068d94d0 msgr2=0x5578068f2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe98920640 1 --2- 172.21.15.59:0/233216151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068d94d0 0x5578068f2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe98920640 1 -- 172.21.15.59:0/233216151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557806965870 con 0x5578068d9df0 2024-09-10T21:23:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe98920640 1 --2- 172.21.15.59:0/233216151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d9df0 0x557806901360 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fbe941012f0 tx=0x7fbe90005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a7d5eeb0ff9780 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:58.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.116+0000 7fbe7cff9640 1 -- 172.21.15.59:0/233216151 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9001e960 con 0x5578068d9df0 2024-09-10T21:23:58.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.117+0000 7fbe7cff9640 1 -- 172.21.15.59:0/233216151 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbe9001eb00 con 0x5578068d9df0 2024-09-10T21:23:58.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.117+0000 7fbe9d75a740 1 -- 172.21.15.59:0/233216151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe88035020 con 0x5578068d9df0 2024-09-10T21:23:58.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.117+0000 7fbe7cff9640 1 -- 172.21.15.59:0/233216151 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbe9001ed00 con 0x5578068d9df0 2024-09-10T21:23:58.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.117+0000 7fbe9d75a740 10 client.17448 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:58.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.117+0000 7fbe9d75a740 1 -- 172.21.15.59:0/233216151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5578069669c0 con 0x5578068d9df0 2024-09-10T21:23:58.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.117+0000 7fbe7cff9640 1 -- 172.21.15.59:0/233216151 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe88035020 con 0x5578068d9df0 2024-09-10T21:23:58.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.117+0000 7fbe7cff9640 1 -- 172.21.15.59:0/233216151 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbe90031400 con 0x5578068d9df0 2024-09-10T21:23:58.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.117+0000 7fbe9d75a740 10 client.17448 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:58.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.117+0000 7fbe9d75a740 10 client.17448 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:23:58.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.117+0000 7fbe9d75a740 20 client.17448 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:58.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.117+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/233216151 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5578069671a0 0x5578069695c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:58.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.117+0000 7fbe9d75a740 4 client.17448 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:23:58.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.117+0000 7fbe9d75a740 1 -- 172.21.15.59:0/233216151 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55780684d8a0 con 0x5578069671a0 2024-09-10T21:23:58.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.118+0000 7fbe99121640 1 --2- 172.21.15.59:0/233216151 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5578069671a0 0x5578069695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:58.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.118+0000 7fbe99121640 1 --2- 172.21.15.59:0/233216151 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5578069671a0 0x5578069695c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=befd183ab892868 server_cookie=cc7cf5540dac4886 in_seq=0 out_seq=0 2024-09-10T21:23:58.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.118+0000 7fbe7cff9640 10 client.17448 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:23:58.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.118+0000 7fbe7cff9640 1 -- 172.21.15.59:0/233216151 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55780684d8a0 con 0x5578069671a0 2024-09-10T21:23:58.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.118+0000 7fbe7cff9640 10 client.17448 handle_command_reply: tid=0 2024-09-10T21:23:58.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.118+0000 7fbe9d75a740 1 client.17448 shutdown 2024-09-10T21:23:58.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.118+0000 7fbe9d75a740 1 -- 172.21.15.59:0/233216151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d9df0 msgr2=0x557806901360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:58.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.118+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/233216151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d9df0 0x557806901360 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fbe941012f0 tx=0x7fbe90005c90 comp rx=0 tx=0).stop 2024-09-10T21:23:58.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.118+0000 7fbe9d75a740 1 -- 172.21.15.59:0/233216151 shutdown_connections 2024-09-10T21:23:58.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.118+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/233216151 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5578069671a0 0x5578069695c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.118+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/233216151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5578068ea190 0x557806901990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.118+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/233216151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578068d9df0 0x557806901360 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.118+0000 7fbe9d75a740 1 --2- 172.21.15.59:0/233216151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5578068d94d0 0x5578068f2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.118+0000 7fbe9d75a740 1 -- 172.21.15.59:0/233216151 >> 172.21.15.59:0/233216151 conn(0x5578068d7300 msgr2=0x5578068e56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:58.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.118+0000 7fbe7cff9640 0 client.17448 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:23:58.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.119+0000 7fbe9d75a740 1 -- 172.21.15.59:0/233216151 shutdown_connections 2024-09-10T21:23:58.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.119+0000 7fbe9d75a740 1 -- 172.21.15.59:0/233216151 wait complete. 2024-09-10T21:23:58.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.119+0000 7fbe9d75a740 20 client.17448 trim_cache size 0 max 16384 2024-09-10T21:23:58.134 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:23:58.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.119+0000 7fbe9b385640 1 -- 172.21.15.59:0/2373559353 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbe800b52e0 msgr2=0x7fbe800b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:58.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.119+0000 7fbe9b385640 1 --2- 172.21.15.59:0/2373559353 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbe800b52e0 0x7fbe800b77a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x5578068d9480 tx=0x7fbe90014040 comp rx=0 tx=0).stop 2024-09-10T21:23:58.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.119+0000 7fbe9b385640 1 -- 172.21.15.59:0/2373559353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9410d140 msgr2=0x7fbe9419eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:58.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.119+0000 7fbe9b385640 1 --2- 172.21.15.59:0/2373559353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9410d140 0x7fbe9419eb40 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c004770 tx=0x7fbe8c004270 comp rx=0 tx=0).stop 2024-09-10T21:23:58.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.119+0000 7fbe9b385640 1 -- 172.21.15.59:0/2373559353 shutdown_connections 2024-09-10T21:23:58.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.119+0000 7fbe9b385640 1 --2- 172.21.15.59:0/2373559353 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbe800b52e0 0x7fbe800b77a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.119+0000 7fbe9b385640 1 --2- 172.21.15.59:0/2373559353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9410d140 0x7fbe9419eb40 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.119+0000 7fbe9b385640 1 --2- 172.21.15.59:0/2373559353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe94104600 0x7fbe941997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.119+0000 7fbe9b385640 1 --2- 172.21.15.59:0/2373559353 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe94103ce0 0x7fbe94199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:58.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.119+0000 7fbe9b385640 1 -- 172.21.15.59:0/2373559353 >> 172.21.15.59:0/2373559353 conn(0x7fbe940fd700 msgr2=0x7fbe940fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:58.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.119+0000 7fbe9b385640 1 -- 172.21.15.59:0/2373559353 shutdown_connections 2024-09-10T21:23:58.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:58.120+0000 7fbe9b385640 1 -- 172.21.15.59:0/2373559353 wait complete. 2024-09-10T21:23:58.891 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:23:59.149 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:23:59.159 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:23:59 smithi059 ceph-mon[30888]: pgmap v601: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:23:59.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:23:59 smithi154 ceph-mon[35041]: pgmap v601: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:23:59.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:23:59 smithi192 ceph-mon[35363]: pgmap v601: 97 pgs: 97 active+clean; 5.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:23:59.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.662+0000 7ffb54cc9640 1 -- 172.21.15.59:0/2435513609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb50108060 msgr2=0x7ffb5010e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:59.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.662+0000 7ffb54cc9640 1 --2- 172.21.15.59:0/2435513609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb50108060 0x7ffb5010e860 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009900 tx=0x7ffb4802a410 comp rx=0 tx=0).stop 2024-09-10T21:23:59.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.662+0000 7ffb54cc9640 1 -- 172.21.15.59:0/2435513609 shutdown_connections 2024-09-10T21:23:59.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.662+0000 7ffb54cc9640 1 --2- 172.21.15.59:0/2435513609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb50108060 0x7ffb5010e860 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.662+0000 7ffb54cc9640 1 --2- 172.21.15.59:0/2435513609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb501076e0 0x7ffb50107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.662+0000 7ffb54cc9640 1 --2- 172.21.15.59:0/2435513609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb50101cd0 0x7ffb501020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.662+0000 7ffb54cc9640 1 -- 172.21.15.59:0/2435513609 >> 172.21.15.59:0/2435513609 conn(0x7ffb500fd700 msgr2=0x7ffb500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:59.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.663+0000 7ffb54cc9640 1 -- 172.21.15.59:0/2435513609 shutdown_connections 2024-09-10T21:23:59.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.663+0000 7ffb54cc9640 1 -- 172.21.15.59:0/2435513609 wait complete. 2024-09-10T21:23:59.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.663+0000 7ffb54cc9640 1 Processor -- start 2024-09-10T21:23:59.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.663+0000 7ffb54cc9640 1 -- start start 2024-09-10T21:23:59.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.663+0000 7ffb54cc9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb50101cd0 0x7ffb501980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.663+0000 7ffb54cc9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb501076e0 0x7ffb50198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb54cc9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb50108060 0x7ffb5019d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb54cc9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffb50111ce0 con 0x7ffb50108060 2024-09-10T21:23:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb54cc9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffb50111b60 con 0x7ffb50101cd0 2024-09-10T21:23:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb54cc9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ffb50111e60 con 0x7ffb501076e0 2024-09-10T21:23:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb4ed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb50108060 0x7ffb5019d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb4ed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb50108060 0x7ffb5019d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51828/0 (socket says 172.21.15.59:51828) 2024-09-10T21:23:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb4ed9d640 1 -- 172.21.15.59:0/3325100056 learned_addr learned my addr 172.21.15.59:0/3325100056 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb4dd9b640 1 --2- 172.21.15.59:0/3325100056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb501076e0 0x7ffb50198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb4e59c640 1 --2- 172.21.15.59:0/3325100056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb50101cd0 0x7ffb501980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb4ed9d640 1 -- 172.21.15.59:0/3325100056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb501076e0 msgr2=0x7ffb50198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb4ed9d640 1 --2- 172.21.15.59:0/3325100056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb501076e0 0x7ffb50198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb4ed9d640 1 -- 172.21.15.59:0/3325100056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb50101cd0 msgr2=0x7ffb501980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:59.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb4ed9d640 1 --2- 172.21.15.59:0/3325100056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb50101cd0 0x7ffb501980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb4ed9d640 1 -- 172.21.15.59:0/3325100056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5019e1a0 con 0x7ffb50108060 2024-09-10T21:23:59.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb4e59c640 1 --2- 172.21.15.59:0/3325100056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb50101cd0 0x7ffb501980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:59.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb4ed9d640 1 --2- 172.21.15.59:0/3325100056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb50108060 0x7ffb5019d9d0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7ffb48004770 tx=0x7ffb48004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:59.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb477fe640 1 -- 172.21.15.59:0/3325100056 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48046070 con 0x7ffb50108060 2024-09-10T21:23:59.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb54cc9640 1 -- 172.21.15.59:0/3325100056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb5019e430 con 0x7ffb50108060 2024-09-10T21:23:59.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb477fe640 1 -- 172.21.15.59:0/3325100056 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb48003aa0 con 0x7ffb50108060 2024-09-10T21:23:59.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.664+0000 7ffb477fe640 1 -- 172.21.15.59:0/3325100056 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48035050 con 0x7ffb50108060 2024-09-10T21:23:59.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.665+0000 7ffb54cc9640 1 -- 172.21.15.59:0/3325100056 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb5006b490 con 0x7ffb50108060 2024-09-10T21:23:59.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.667+0000 7ffb5709e740 1 Processor -- start 2024-09-10T21:23:59.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.667+0000 7ffb477fe640 1 -- 172.21.15.59:0/3325100056 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7ffb480035f0 con 0x7ffb50108060 2024-09-10T21:23:59.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.667+0000 7ffb5709e740 1 -- start start 2024-09-10T21:23:59.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.667+0000 7ffb5709e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 0x55dfdd41f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:59.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.667+0000 7ffb5709e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 0x55dfdd42b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:59.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.667+0000 7ffb5709e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd42e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:59.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.667+0000 7ffb5709e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55dfdd395ea0 con 0x55dfdd42bd80 2024-09-10T21:23:59.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.667+0000 7ffb5709e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dfdd3852d0 con 0x55dfdd41fdf0 2024-09-10T21:23:59.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.667+0000 7ffb5709e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55dfdd3890e0 con 0x55dfdd41f4d0 2024-09-10T21:23:59.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.668+0000 7ffb4dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd42e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:59.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.668+0000 7ffb4dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd42e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51830/0 (socket says 172.21.15.59:51830) 2024-09-10T21:23:59.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.668+0000 7ffb4dd9b640 1 -- 172.21.15.59:0/3570470981 learned_addr learned my addr 172.21.15.59:0/3570470981 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:59.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.668+0000 7ffb4dd9b640 1 --2- 172.21.15.59:0/3570470981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 0x55dfdd41f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:59.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.668+0000 7ffb4e59c640 1 --2- 172.21.15.59:0/3570470981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 0x55dfdd42b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:59.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.668+0000 7ffb4dd9b640 1 -- 172.21.15.59:0/3570470981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 msgr2=0x55dfdd41f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:59.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.668+0000 7ffb4dd9b640 1 --2- 172.21.15.59:0/3570470981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 0x55dfdd41f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.668+0000 7ffb4dd9b640 1 -- 172.21.15.59:0/3570470981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 msgr2=0x55dfdd42b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:59.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.668+0000 7ffb477fe640 1 --2- 172.21.15.59:0/3325100056 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffb3c0b52e0 0x7ffb3c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:59.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.668+0000 7ffb4dd9b640 1 --2- 172.21.15.59:0/3570470981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 0x55dfdd42b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.668+0000 7ffb4dd9b640 1 -- 172.21.15.59:0/3570470981 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfdd0e3650 con 0x55dfdd42bd80 2024-09-10T21:23:59.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.668+0000 7ffb4ed9d640 1 --2- 172.21.15.59:0/3325100056 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffb3c0b52e0 0x7ffb3c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:59.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.668+0000 7ffb4dd9b640 1 --2- 172.21.15.59:0/3570470981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd42e170 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7ffb38012740 tx=0x7ffb3800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e3f9f55cd0f4b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:59.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.668+0000 7ffb477fe640 1 -- 172.21.15.59:0/3325100056 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ffb48107ac0 con 0x7ffb50108060 2024-09-10T21:23:59.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.668+0000 7ffb44ff9640 1 -- 172.21.15.59:0/3570470981 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb38012cc0 con 0x55dfdd42bd80 2024-09-10T21:23:59.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.669+0000 7ffb44ff9640 1 -- 172.21.15.59:0/3570470981 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb38010c20 con 0x55dfdd42bd80 2024-09-10T21:23:59.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.669+0000 7ffb44ff9640 1 -- 172.21.15.59:0/3570470981 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3801ea50 con 0x55dfdd42bd80 2024-09-10T21:23:59.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.669+0000 7ffb5709e740 1 -- 172.21.15.59:0/3570470981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 msgr2=0x55dfdd42e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:59.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.669+0000 7ffb4ed9d640 1 --2- 172.21.15.59:0/3325100056 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffb3c0b52e0 0x7ffb3c0b77a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ffb480cdfb0 tx=0x7ffb48003f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:59.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.669+0000 7ffb5709e740 1 --2- 172.21.15.59:0/3570470981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd42e170 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7ffb38012740 tx=0x7ffb3800b700 comp rx=0 tx=0).stop 2024-09-10T21:23:59.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.669+0000 7ffb5709e740 1 -- 172.21.15.59:0/3570470981 shutdown_connections 2024-09-10T21:23:59.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.669+0000 7ffb5709e740 1 --2- 172.21.15.59:0/3570470981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd42e170 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.669+0000 7ffb5709e740 1 --2- 172.21.15.59:0/3570470981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 0x55dfdd42b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.669+0000 7ffb5709e740 1 --2- 172.21.15.59:0/3570470981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 0x55dfdd41f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.669+0000 7ffb5709e740 1 -- 172.21.15.59:0/3570470981 >> 172.21.15.59:0/3570470981 conn(0x55dfdd41d300 msgr2=0x55dfdd41e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:59.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.670+0000 7ffb5709e740 1 -- 172.21.15.59:0/3570470981 shutdown_connections 2024-09-10T21:23:59.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.670+0000 7ffb5709e740 1 -- 172.21.15.59:0/3570470981 wait complete. 2024-09-10T21:23:59.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.670+0000 7ffb5709e740 1 -- start start 2024-09-10T21:23:59.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.670+0000 7ffb5709e740 1 Processor -- start 2024-09-10T21:23:59.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.670+0000 7ffb5709e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 0x55dfdd42b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:59.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.670+0000 7ffb5709e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 0x55dfdd428b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:59.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.670+0000 7ffb5709e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd429190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.670+0000 7ffb5709e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55dfdd1e6700 con 0x55dfdd42bd80 2024-09-10T21:23:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.670+0000 7ffb5709e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dfdd320160 con 0x55dfdd41fdf0 2024-09-10T21:23:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.670+0000 7ffb5709e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55dfdd42ea00 con 0x55dfdd41f4d0 2024-09-10T21:23:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.670+0000 7ffb5709e740 10 client.0 _ll_register_callbacks cb 0x55dfdd3399e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.670+0000 7ffb4dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd429190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.670+0000 7ffb4dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd429190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51844/0 (socket says 172.21.15.59:51844) 2024-09-10T21:23:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.670+0000 7ffb4dd9b640 1 -- 172.21.15.59:0/1020721995 learned_addr learned my addr 172.21.15.59:0/1020721995 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.671+0000 7ffb4dd9b640 1 --2- 172.21.15.59:0/1020721995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 0x55dfdd42b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.671+0000 7ffb4e59c640 1 --2- 172.21.15.59:0/1020721995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 0x55dfdd428b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.671+0000 7ffb4dd9b640 1 -- 172.21.15.59:0/1020721995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 msgr2=0x55dfdd42b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.671+0000 7ffb4dd9b640 1 --2- 172.21.15.59:0/1020721995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 0x55dfdd42b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.671+0000 7ffb4dd9b640 1 -- 172.21.15.59:0/1020721995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 msgr2=0x55dfdd428b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:59.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.671+0000 7ffb4dd9b640 1 --2- 172.21.15.59:0/1020721995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 0x55dfdd428b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.671+0000 7ffb4dd9b640 1 -- 172.21.15.59:0/1020721995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfdd34dc90 con 0x55dfdd42bd80 2024-09-10T21:23:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.671+0000 7ffb4e59c640 1 --2- 172.21.15.59:0/1020721995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 0x55dfdd428b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:23:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.671+0000 7ffb4dd9b640 1 --2- 172.21.15.59:0/1020721995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd429190 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800b450 tx=0x7ffb38014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426417b76912ca98 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.671+0000 7ffb35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.671+0000 7ffb35ffb640 1 -- 172.21.15.59:0/1020721995 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb38024040 con 0x55dfdd42bd80 2024-09-10T21:23:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.671+0000 7ffb35ffb640 1 -- 172.21.15.59:0/1020721995 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ffb38010970 con 0x55dfdd42bd80 2024-09-10T21:23:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.671+0000 7ffb5709e740 1 -- 172.21.15.59:0/1020721995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb38010c20 con 0x55dfdd42bd80 2024-09-10T21:23:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.671+0000 7ffb35ffb640 1 -- 172.21.15.59:0/1020721995 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffb3801e810 con 0x55dfdd42bd80 2024-09-10T21:23:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.671+0000 7ffb5709e740 10 client.17460 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.671+0000 7ffb5709e740 1 -- 172.21.15.59:0/1020721995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dfdd43a380 con 0x55dfdd42bd80 2024-09-10T21:23:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.672+0000 7ffb35ffb640 1 -- 172.21.15.59:0/1020721995 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb38010c20 con 0x55dfdd42bd80 2024-09-10T21:23:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.672+0000 7ffb35ffb640 1 -- 172.21.15.59:0/1020721995 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffb3802a070 con 0x55dfdd42bd80 2024-09-10T21:23:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.672+0000 7ffb5709e740 10 client.17460 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.672+0000 7ffb5709e740 10 client.17460 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:23:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.672+0000 7ffb5709e740 20 client.17460 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.672+0000 7ffb5709e740 1 --2- 172.21.15.59:0/1020721995 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55dfdd43b780 0x55dfdd43db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.672+0000 7ffb5709e740 4 client.17460 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:23:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.672+0000 7ffb5709e740 1 -- 172.21.15.59:0/1020721995 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfdd397df0 con 0x55dfdd43b780 2024-09-10T21:23:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.672+0000 7ffb4e59c640 1 --2- 172.21.15.59:0/1020721995 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55dfdd43b780 0x55dfdd43db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.673+0000 7ffb4e59c640 1 --2- 172.21.15.59:0/1020721995 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55dfdd43b780 0x55dfdd43db70 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=31385f0212ea325d server_cookie=781f8ccc5e2d1c13 in_seq=0 out_seq=0 2024-09-10T21:23:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.673+0000 7ffb35ffb640 10 client.17460 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:23:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.673+0000 7ffb35ffb640 1 -- 172.21.15.59:0/1020721995 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dfdd397df0 con 0x55dfdd43b780 2024-09-10T21:23:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.673+0000 7ffb35ffb640 10 client.17460 handle_command_reply: tid=0 2024-09-10T21:23:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.673+0000 7ffb5709e740 1 client.17460 shutdown 2024-09-10T21:23:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.674+0000 7ffb5709e740 1 -- 172.21.15.59:0/1020721995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 msgr2=0x55dfdd429190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.674+0000 7ffb5709e740 1 --2- 172.21.15.59:0/1020721995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd429190 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800b450 tx=0x7ffb38014040 comp rx=0 tx=0).stop 2024-09-10T21:23:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.674+0000 7ffb5709e740 1 -- 172.21.15.59:0/1020721995 shutdown_connections 2024-09-10T21:23:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.674+0000 7ffb5709e740 1 --2- 172.21.15.59:0/1020721995 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55dfdd43b780 0x55dfdd43db70 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.674+0000 7ffb5709e740 1 --2- 172.21.15.59:0/1020721995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd429190 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.674+0000 7ffb5709e740 1 --2- 172.21.15.59:0/1020721995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 0x55dfdd428b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.674+0000 7ffb35ffb640 0 client.17460 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:23:59.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.674+0000 7ffb5709e740 1 --2- 172.21.15.59:0/1020721995 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 0x55dfdd42b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.674+0000 7ffb5709e740 1 -- 172.21.15.59:0/1020721995 >> 172.21.15.59:0/1020721995 conn(0x55dfdd41d300 msgr2=0x55dfdd422ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:59.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.674+0000 7ffb5709e740 1 -- 172.21.15.59:0/1020721995 shutdown_connections 2024-09-10T21:23:59.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.674+0000 7ffb5709e740 1 -- 172.21.15.59:0/1020721995 wait complete. 2024-09-10T21:23:59.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.674+0000 7ffb5709e740 20 client.17460 trim_cache size 0 max 16384 2024-09-10T21:23:59.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.687+0000 7ffb5709e740 1 Processor -- start 2024-09-10T21:23:59.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.687+0000 7ffb5709e740 1 -- start start 2024-09-10T21:23:59.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.687+0000 7ffb5709e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 0x55dfdd423540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:59.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.687+0000 7ffb5709e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 0x55dfdd437c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:59.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.687+0000 7ffb5709e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd42d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:59.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.687+0000 7ffb5709e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501abf90 con 0x55dfdd42bd80 2024-09-10T21:23:59.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.687+0000 7ffb5709e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501adad0 con 0x55dfdd41fdf0 2024-09-10T21:23:59.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.687+0000 7ffb5709e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501ac660 con 0x55dfdd41f4d0 2024-09-10T21:23:59.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.687+0000 7ffb4dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd42d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:59.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.687+0000 7ffb4dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd42d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51856/0 (socket says 172.21.15.59:51856) 2024-09-10T21:23:59.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.687+0000 7ffb4dd9b640 1 -- 172.21.15.59:0/502923344 learned_addr learned my addr 172.21.15.59:0/502923344 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:59.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.688+0000 7ffb4e59c640 1 --2- 172.21.15.59:0/502923344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 0x55dfdd437c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:59.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.688+0000 7ffb4dd9b640 1 --2- 172.21.15.59:0/502923344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 0x55dfdd423540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:59.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.688+0000 7ffb4dd9b640 1 -- 172.21.15.59:0/502923344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 msgr2=0x55dfdd423540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:59.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.688+0000 7ffb4dd9b640 1 --2- 172.21.15.59:0/502923344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 0x55dfdd423540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.688+0000 7ffb4dd9b640 1 -- 172.21.15.59:0/502923344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 msgr2=0x55dfdd437c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:59.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.688+0000 7ffb4dd9b640 1 --2- 172.21.15.59:0/502923344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 0x55dfdd437c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.688+0000 7ffb4dd9b640 1 -- 172.21.15.59:0/502923344 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfdd41dfe0 con 0x55dfdd42bd80 2024-09-10T21:23:59.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.688+0000 7ffb4dd9b640 1 --2- 172.21.15.59:0/502923344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd42d170 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800bad0 tx=0x7ffb38012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734585e0659c52e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:59.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.688+0000 7ffb37fff640 1 -- 172.21.15.59:0/502923344 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3803d070 con 0x55dfdd42bd80 2024-09-10T21:23:59.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.688+0000 7ffb37fff640 1 -- 172.21.15.59:0/502923344 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb38016040 con 0x55dfdd42bd80 2024-09-10T21:23:59.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.688+0000 7ffb37fff640 1 -- 172.21.15.59:0/502923344 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb380109a0 con 0x55dfdd42bd80 2024-09-10T21:23:59.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.688+0000 7ffb5709e740 1 -- 172.21.15.59:0/502923344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 msgr2=0x55dfdd42d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:59.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.688+0000 7ffb5709e740 1 --2- 172.21.15.59:0/502923344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd42d170 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800bad0 tx=0x7ffb38012f90 comp rx=0 tx=0).stop 2024-09-10T21:23:59.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.689+0000 7ffb5709e740 1 -- 172.21.15.59:0/502923344 shutdown_connections 2024-09-10T21:23:59.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.689+0000 7ffb5709e740 1 --2- 172.21.15.59:0/502923344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd42d170 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.689+0000 7ffb5709e740 1 --2- 172.21.15.59:0/502923344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 0x55dfdd437c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.689+0000 7ffb5709e740 1 --2- 172.21.15.59:0/502923344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 0x55dfdd423540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.689+0000 7ffb5709e740 1 -- 172.21.15.59:0/502923344 >> 172.21.15.59:0/502923344 conn(0x55dfdd41d300 msgr2=0x55dfdd42a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:59.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.689+0000 7ffb5709e740 1 -- 172.21.15.59:0/502923344 shutdown_connections 2024-09-10T21:23:59.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.689+0000 7ffb5709e740 1 -- 172.21.15.59:0/502923344 wait complete. 2024-09-10T21:23:59.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.689+0000 7ffb5709e740 1 -- start start 2024-09-10T21:23:59.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.689+0000 7ffb5709e740 1 Processor -- start 2024-09-10T21:23:59.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.689+0000 7ffb5709e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 0x55dfdd433e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:59.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.689+0000 7ffb5709e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 0x55dfdd434390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.689+0000 7ffb5709e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd42ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.689+0000 7ffb5709e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501ad400 con 0x55dfdd42bd80 2024-09-10T21:23:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.689+0000 7ffb5709e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501acd30 con 0x55dfdd41fdf0 2024-09-10T21:23:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.689+0000 7ffb5709e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ffb501a9f70 con 0x55dfdd41f4d0 2024-09-10T21:23:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.689+0000 7ffb5709e740 10 client.0 _ll_register_callbacks cb 0x7ffb400097e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:23:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.689+0000 7ffb4dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd42ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.689+0000 7ffb4dd9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd42ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51864/0 (socket says 172.21.15.59:51864) 2024-09-10T21:23:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.689+0000 7ffb4dd9b640 1 -- 172.21.15.59:0/3970464487 learned_addr learned my addr 172.21.15.59:0/3970464487 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:23:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.690+0000 7ffb4dd9b640 1 --2- 172.21.15.59:0/3970464487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 0x55dfdd433e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.690+0000 7ffb4e59c640 1 --2- 172.21.15.59:0/3970464487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 0x55dfdd434390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.690+0000 7ffb4dd9b640 1 -- 172.21.15.59:0/3970464487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 msgr2=0x55dfdd433e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.690+0000 7ffb4dd9b640 1 --2- 172.21.15.59:0/3970464487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 0x55dfdd433e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.690+0000 7ffb4dd9b640 1 -- 172.21.15.59:0/3970464487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 msgr2=0x55dfdd434390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:23:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.690+0000 7ffb4dd9b640 1 --2- 172.21.15.59:0/3970464487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 0x55dfdd434390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.690+0000 7ffb4dd9b640 1 -- 172.21.15.59:0/3970464487 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfdd42f290 con 0x55dfdd42bd80 2024-09-10T21:23:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.690+0000 7ffb4e59c640 1 --2- 172.21.15.59:0/3970464487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 0x55dfdd434390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:23:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.690+0000 7ffb4dd9b640 1 --2- 172.21.15.59:0/3970464487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd42ec20 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7ffb3803b040 tx=0x7ffb3800b510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e348e5c40326b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:23:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.690+0000 7ffb35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:23:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.690+0000 7ffb35ffb640 1 -- 172.21.15.59:0/3970464487 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3803d040 con 0x55dfdd42bd80 2024-09-10T21:23:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.690+0000 7ffb35ffb640 1 -- 172.21.15.59:0/3970464487 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ffb3802ab40 con 0x55dfdd42bd80 2024-09-10T21:23:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.690+0000 7ffb5709e740 1 -- 172.21.15.59:0/3970464487 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb38016040 con 0x55dfdd42bd80 2024-09-10T21:23:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.690+0000 7ffb35ffb640 1 -- 172.21.15.59:0/3970464487 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffb3802ad40 con 0x55dfdd42bd80 2024-09-10T21:23:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.690+0000 7ffb5709e740 10 client.17466 fetch_fsmap learned FSMap version 28 2024-09-10T21:23:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.690+0000 7ffb5709e740 1 -- 172.21.15.59:0/3970464487 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dfdd4a8d30 con 0x55dfdd42bd80 2024-09-10T21:23:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.690+0000 7ffb35ffb640 1 -- 172.21.15.59:0/3970464487 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb38016040 con 0x55dfdd42bd80 2024-09-10T21:23:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.691+0000 7ffb35ffb640 1 -- 172.21.15.59:0/3970464487 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ffb3802a040 con 0x55dfdd42bd80 2024-09-10T21:23:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.691+0000 7ffb5709e740 10 client.17466 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:23:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.691+0000 7ffb5709e740 10 client.17466 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:23:59.722 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:23:59.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.691+0000 7ffb5709e740 20 client.17466 populate_metadata read hostname 'smithi059' 2024-09-10T21:23:59.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.691+0000 7ffb5709e740 1 --2- 172.21.15.59:0/3970464487 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55dfdd4a93c0 0x55dfdd4ab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:23:59.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.691+0000 7ffb5709e740 4 client.17466 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:23:59.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.691+0000 7ffb5709e740 1 -- 172.21.15.59:0/3970464487 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dfdd3938a0 con 0x55dfdd4a93c0 2024-09-10T21:23:59.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.691+0000 7ffb4e59c640 1 --2- 172.21.15.59:0/3970464487 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55dfdd4a93c0 0x55dfdd4ab7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:23:59.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.691+0000 7ffb35ffb640 10 client.17466 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:23:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.691+0000 7ffb4e59c640 1 --2- 172.21.15.59:0/3970464487 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55dfdd4a93c0 0x55dfdd4ab7e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e057751d9a39ab48 server_cookie=e816785d161a2215 in_seq=0 out_seq=0 2024-09-10T21:23:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.692+0000 7ffb35ffb640 1 -- 172.21.15.59:0/3970464487 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dfdd3938a0 con 0x55dfdd4a93c0 2024-09-10T21:23:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.692+0000 7ffb35ffb640 10 client.17466 handle_command_reply: tid=0 2024-09-10T21:23:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.692+0000 7ffb5709e740 1 client.17466 shutdown 2024-09-10T21:23:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.692+0000 7ffb5709e740 1 -- 172.21.15.59:0/3970464487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 msgr2=0x55dfdd42ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.692+0000 7ffb5709e740 1 --2- 172.21.15.59:0/3970464487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd42ec20 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7ffb3803b040 tx=0x7ffb3800b510 comp rx=0 tx=0).stop 2024-09-10T21:23:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.692+0000 7ffb5709e740 1 -- 172.21.15.59:0/3970464487 shutdown_connections 2024-09-10T21:23:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.692+0000 7ffb5709e740 1 --2- 172.21.15.59:0/3970464487 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55dfdd4a93c0 0x55dfdd4ab7e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.692+0000 7ffb5709e740 1 --2- 172.21.15.59:0/3970464487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdd42bd80 0x55dfdd42ec20 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.692+0000 7ffb5709e740 1 --2- 172.21.15.59:0/3970464487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dfdd41fdf0 0x55dfdd434390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.692+0000 7ffb5709e740 1 --2- 172.21.15.59:0/3970464487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55dfdd41f4d0 0x55dfdd433e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.692+0000 7ffb5709e740 1 -- 172.21.15.59:0/3970464487 >> 172.21.15.59:0/3970464487 conn(0x55dfdd41d300 msgr2=0x55dfdd422530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.692+0000 7ffb35ffb640 0 client.17466 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:23:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.692+0000 7ffb5709e740 1 -- 172.21.15.59:0/3970464487 shutdown_connections 2024-09-10T21:23:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.692+0000 7ffb5709e740 1 -- 172.21.15.59:0/3970464487 wait complete. 2024-09-10T21:23:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.692+0000 7ffb5709e740 20 client.17466 trim_cache size 0 max 16384 2024-09-10T21:23:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.692+0000 7ffb54cc9640 1 -- 172.21.15.59:0/3325100056 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffb3c0b52e0 msgr2=0x7ffb3c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.692+0000 7ffb54cc9640 1 --2- 172.21.15.59:0/3325100056 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffb3c0b52e0 0x7ffb3c0b77a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ffb480cdfb0 tx=0x7ffb48003f50 comp rx=0 tx=0).stop 2024-09-10T21:23:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.692+0000 7ffb54cc9640 1 -- 172.21.15.59:0/3325100056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb50108060 msgr2=0x7ffb5019d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:23:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.692+0000 7ffb54cc9640 1 --2- 172.21.15.59:0/3325100056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb50108060 0x7ffb5019d9d0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7ffb48004770 tx=0x7ffb48004270 comp rx=0 tx=0).stop 2024-09-10T21:23:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.693+0000 7ffb54cc9640 1 -- 172.21.15.59:0/3325100056 shutdown_connections 2024-09-10T21:23:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.693+0000 7ffb54cc9640 1 --2- 172.21.15.59:0/3325100056 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ffb3c0b52e0 0x7ffb3c0b77a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.693+0000 7ffb54cc9640 1 --2- 172.21.15.59:0/3325100056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb50108060 0x7ffb5019d9d0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.693+0000 7ffb54cc9640 1 --2- 172.21.15.59:0/3325100056 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb501076e0 0x7ffb50198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.693+0000 7ffb54cc9640 1 --2- 172.21.15.59:0/3325100056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffb50101cd0 0x7ffb501980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:23:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.693+0000 7ffb54cc9640 1 -- 172.21.15.59:0/3325100056 >> 172.21.15.59:0/3325100056 conn(0x7ffb500fd700 msgr2=0x7ffb500fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:23:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.693+0000 7ffb54cc9640 1 -- 172.21.15.59:0/3325100056 shutdown_connections 2024-09-10T21:23:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:23:59.693+0000 7ffb54cc9640 1 -- 172.21.15.59:0/3325100056 wait complete. 2024-09-10T21:24:00.458 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:24:00.717 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:24:01.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.265+0000 7fc98db02640 1 -- 172.21.15.59:0/748768899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9881087d0 msgr2=0x7fc988108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:01.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.265+0000 7fc98db02640 1 --2- 172.21.15.59:0/748768899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9881087d0 0x7fc988108c10 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009900 tx=0x7fc97c02a410 comp rx=0 tx=0).stop 2024-09-10T21:24:01.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.265+0000 7fc98db02640 1 -- 172.21.15.59:0/748768899 shutdown_connections 2024-09-10T21:24:01.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.265+0000 7fc98db02640 1 --2- 172.21.15.59:0/748768899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc988109150 0x7fc98810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.265+0000 7fc98db02640 1 --2- 172.21.15.59:0/748768899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9881087d0 0x7fc988108c10 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.265+0000 7fc98db02640 1 --2- 172.21.15.59:0/748768899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc988102dc0 0x7fc9881031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.265+0000 7fc98db02640 1 -- 172.21.15.59:0/748768899 >> 172.21.15.59:0/748768899 conn(0x7fc9880fe830 msgr2=0x7fc988100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:01.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.265+0000 7fc98db02640 1 -- 172.21.15.59:0/748768899 shutdown_connections 2024-09-10T21:24:01.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.265+0000 7fc98db02640 1 -- 172.21.15.59:0/748768899 wait complete. 2024-09-10T21:24:01.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.266+0000 7fc98db02640 1 Processor -- start 2024-09-10T21:24:01.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.266+0000 7fc98db02640 1 -- start start 2024-09-10T21:24:01.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.266+0000 7fc98db02640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc988102dc0 0x7fc9881992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:01.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.266+0000 7fc98db02640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9881087d0 0x7fc988199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:01.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.266+0000 7fc98db02640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc988109150 0x7fc98819ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:01.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.266+0000 7fc98db02640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc988112e10 con 0x7fc988102dc0 2024-09-10T21:24:01.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.266+0000 7fc98db02640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc988112c90 con 0x7fc988109150 2024-09-10T21:24:01.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.266+0000 7fc98db02640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc988112f90 con 0x7fc9881087d0 2024-09-10T21:24:01.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.266+0000 7fc9877fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc988102dc0 0x7fc9881992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:01.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.267+0000 7fc9877fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc988102dc0 0x7fc9881992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51890/0 (socket says 172.21.15.59:51890) 2024-09-10T21:24:01.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.267+0000 7fc9877fe640 1 -- 172.21.15.59:0/3055675907 learned_addr learned my addr 172.21.15.59:0/3055675907 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:01.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.267+0000 7fc986ffd640 1 --2- 172.21.15.59:0/3055675907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9881087d0 0x7fc988199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:01.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.267+0000 7fc987fff640 1 --2- 172.21.15.59:0/3055675907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc988109150 0x7fc98819ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:01.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.267+0000 7fc9877fe640 1 -- 172.21.15.59:0/3055675907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9881087d0 msgr2=0x7fc988199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:01.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.267+0000 7fc9877fe640 1 --2- 172.21.15.59:0/3055675907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9881087d0 0x7fc988199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.267+0000 7fc9877fe640 1 -- 172.21.15.59:0/3055675907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc988109150 msgr2=0x7fc98819ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:01.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.267+0000 7fc9877fe640 1 --2- 172.21.15.59:0/3055675907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc988109150 0x7fc98819ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.267+0000 7fc9877fe640 1 -- 172.21.15.59:0/3055675907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98819f390 con 0x7fc988102dc0 2024-09-10T21:24:01.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.267+0000 7fc987fff640 1 --2- 172.21.15.59:0/3055675907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc988109150 0x7fc98819ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:01.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.267+0000 7fc9877fe640 1 --2- 172.21.15.59:0/3055675907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc988102dc0 0x7fc9881992e0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fc97800b4a0 tx=0x7fc97800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:01.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.267+0000 7fc984ff9640 1 -- 172.21.15.59:0/3055675907 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978014070 con 0x7fc988102dc0 2024-09-10T21:24:01.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.267+0000 7fc98db02640 1 -- 172.21.15.59:0/3055675907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc98819f680 con 0x7fc988102dc0 2024-09-10T21:24:01.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.267+0000 7fc984ff9640 1 -- 172.21.15.59:0/3055675907 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc978010ac0 con 0x7fc988102dc0 2024-09-10T21:24:01.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.267+0000 7fc984ff9640 1 -- 172.21.15.59:0/3055675907 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978017c30 con 0x7fc988102dc0 2024-09-10T21:24:01.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.267+0000 7fc98db02640 1 -- 172.21.15.59:0/3055675907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9881a5dc0 con 0x7fc988102dc0 2024-09-10T21:24:01.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.270+0000 7fc98fed7740 1 Processor -- start 2024-09-10T21:24:01.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.270+0000 7fc98fed7740 1 -- start start 2024-09-10T21:24:01.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.270+0000 7fc984ff9640 1 -- 172.21.15.59:0/3055675907 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fc978010610 con 0x7fc988102dc0 2024-09-10T21:24:01.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.270+0000 7fc98fed7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b10f0 0x558a8c8b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:01.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.270+0000 7fc98fed7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8b1a10 0x558a8c8c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:01.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.270+0000 7fc98fed7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8c1db0 0x558a8c8c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:01.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.270+0000 7fc98fed7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558a8c827ea0 con 0x558a8c8b10f0 2024-09-10T21:24:01.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.270+0000 7fc98fed7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558a8c8172d0 con 0x558a8c8b1a10 2024-09-10T21:24:01.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.270+0000 7fc98fed7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558a8c81b0e0 con 0x558a8c8c1db0 2024-09-10T21:24:01.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.270+0000 7fc987fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b10f0 0x558a8c8b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:01.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.270+0000 7fc987fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b10f0 0x558a8c8b14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51892/0 (socket says 172.21.15.59:51892) 2024-09-10T21:24:01.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.270+0000 7fc987fff640 1 -- 172.21.15.59:0/2848734570 learned_addr learned my addr 172.21.15.59:0/2848734570 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:01.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.270+0000 7fc986ffd640 1 --2- 172.21.15.59:0/2848734570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8c1db0 0x558a8c8c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:01.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.270+0000 7fc9877fe640 1 --2- 172.21.15.59:0/2848734570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8b1a10 0x558a8c8c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:01.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.270+0000 7fc987fff640 1 -- 172.21.15.59:0/2848734570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8c1db0 msgr2=0x558a8c8c41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:01.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.270+0000 7fc987fff640 1 --2- 172.21.15.59:0/2848734570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8c1db0 0x558a8c8c41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.270+0000 7fc987fff640 1 -- 172.21.15.59:0/2848734570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8b1a10 msgr2=0x558a8c8c1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.270+0000 7fc987fff640 1 --2- 172.21.15.59:0/2848734570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8b1a10 0x558a8c8c1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.270+0000 7fc987fff640 1 -- 172.21.15.59:0/2848734570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a8c575650 con 0x558a8c8b10f0 2024-09-10T21:24:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.271+0000 7fc986ffd640 1 --2- 172.21.15.59:0/2848734570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8c1db0 0x558a8c8c41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.271+0000 7fc9877fe640 1 --2- 172.21.15.59:0/2848734570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8b1a10 0x558a8c8c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.271+0000 7fc987fff640 1 --2- 172.21.15.59:0/2848734570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b10f0 0x558a8c8b14d0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fc980009ed0 tx=0x7fc98000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b909b7f075f20803 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.271+0000 7fc96dffb640 1 -- 172.21.15.59:0/2848734570 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc980004d20 con 0x558a8c8b10f0 2024-09-10T21:24:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.271+0000 7fc96dffb640 1 -- 172.21.15.59:0/2848734570 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9800054d0 con 0x558a8c8b10f0 2024-09-10T21:24:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.271+0000 7fc96dffb640 1 -- 172.21.15.59:0/2848734570 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc980011860 con 0x558a8c8b10f0 2024-09-10T21:24:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.271+0000 7fc984ff9640 1 --2- 172.21.15.59:0/3055675907 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc9700b52e0 0x7fc9700b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.271+0000 7fc9877fe640 1 --2- 172.21.15.59:0/3055675907 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc9700b52e0 0x7fc9700b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.271+0000 7fc984ff9640 1 -- 172.21.15.59:0/3055675907 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc9780e5460 con 0x7fc988102dc0 2024-09-10T21:24:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.272+0000 7fc98fed7740 1 -- 172.21.15.59:0/2848734570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b10f0 msgr2=0x558a8c8b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:01.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.272+0000 7fc98fed7740 1 --2- 172.21.15.59:0/2848734570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b10f0 0x558a8c8b14d0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fc980009ed0 tx=0x7fc98000f730 comp rx=0 tx=0).stop 2024-09-10T21:24:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.272+0000 7fc98fed7740 1 -- 172.21.15.59:0/2848734570 shutdown_connections 2024-09-10T21:24:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.272+0000 7fc98fed7740 1 --2- 172.21.15.59:0/2848734570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8c1db0 0x558a8c8c41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.272+0000 7fc98fed7740 1 --2- 172.21.15.59:0/2848734570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8b1a10 0x558a8c8c1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.272+0000 7fc98fed7740 1 --2- 172.21.15.59:0/2848734570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b10f0 0x558a8c8b14d0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.272+0000 7fc98fed7740 1 -- 172.21.15.59:0/2848734570 >> 172.21.15.59:0/2848734570 conn(0x558a8c8aef20 msgr2=0x558a8c8b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.272+0000 7fc98fed7740 1 -- 172.21.15.59:0/2848734570 shutdown_connections 2024-09-10T21:24:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.272+0000 7fc9877fe640 1 --2- 172.21.15.59:0/3055675907 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc9700b52e0 0x7fc9700b77a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc9780e3300 tx=0x7fc978012000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.272+0000 7fc98fed7740 1 -- 172.21.15.59:0/2848734570 wait complete. 2024-09-10T21:24:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.272+0000 7fc98fed7740 1 -- start start 2024-09-10T21:24:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.272+0000 7fc98fed7740 1 Processor -- start 2024-09-10T21:24:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.273+0000 7fc98fed7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8b10f0 0x558a8c8c1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.273+0000 7fc98fed7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8b1a10 0x558a8c8bea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:01.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.273+0000 7fc98fed7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8c1db0 0x558a8c8befb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.273+0000 7fc98fed7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558a8c678700 con 0x558a8c8c1db0 2024-09-10T21:24:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.273+0000 7fc98fed7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558a8c7b2160 con 0x558a8c8b10f0 2024-09-10T21:24:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.273+0000 7fc98fed7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558a8c8c4a60 con 0x558a8c8b1a10 2024-09-10T21:24:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.273+0000 7fc98fed7740 10 client.0 _ll_register_callbacks cb 0x558a8c7cb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.273+0000 7fc987fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8c1db0 0x558a8c8befb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.273+0000 7fc987fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8b10f0 0x558a8c8c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.273+0000 7fc987fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8b10f0 0x558a8c8c1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:40648/0 (socket says 172.21.15.59:40648) 2024-09-10T21:24:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.273+0000 7fc987fff640 1 -- 172.21.15.59:0/2201382025 learned_addr learned my addr 172.21.15.59:0/2201382025 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.273+0000 7fc986ffd640 1 --2- 172.21.15.59:0/2201382025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8b1a10 0x558a8c8bea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.273+0000 7fc987fff640 1 -- 172.21.15.59:0/2201382025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8b1a10 msgr2=0x558a8c8bea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.273+0000 7fc987fff640 1 --2- 172.21.15.59:0/2201382025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8b1a10 0x558a8c8bea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.273+0000 7fc987fff640 1 -- 172.21.15.59:0/2201382025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8b10f0 msgr2=0x558a8c8c1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.273+0000 7fc987fff640 1 --2- 172.21.15.59:0/2201382025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8b10f0 0x558a8c8c1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.273+0000 7fc987fff640 1 -- 172.21.15.59:0/2201382025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a8c7dfc90 con 0x558a8c8c1db0 2024-09-10T21:24:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.273+0000 7fc987fff640 1 --2- 172.21.15.59:0/2201382025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8c1db0 0x558a8c8befb0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fc9800119c0 tx=0x7fc980011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15e105d679356a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.273+0000 7fc966ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.274+0000 7fc966ffd640 1 -- 172.21.15.59:0/2201382025 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc980004a40 con 0x558a8c8c1db0 2024-09-10T21:24:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.274+0000 7fc966ffd640 1 -- 172.21.15.59:0/2201382025 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc980004be0 con 0x558a8c8c1db0 2024-09-10T21:24:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.274+0000 7fc98fed7740 1 -- 172.21.15.59:0/2201382025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9800054d0 con 0x558a8c8c1db0 2024-09-10T21:24:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.274+0000 7fc966ffd640 1 -- 172.21.15.59:0/2201382025 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc980011a40 con 0x558a8c8c1db0 2024-09-10T21:24:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.274+0000 7fc98fed7740 10 client.17478 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.274+0000 7fc98fed7740 1 -- 172.21.15.59:0/2201382025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558a8c8d0260 con 0x558a8c8c1db0 2024-09-10T21:24:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.274+0000 7fc966ffd640 1 -- 172.21.15.59:0/2201382025 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9800054d0 con 0x558a8c8c1db0 2024-09-10T21:24:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.274+0000 7fc966ffd640 1 -- 172.21.15.59:0/2201382025 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc9800298e0 con 0x558a8c8c1db0 2024-09-10T21:24:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.274+0000 7fc98fed7740 10 client.17478 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.274+0000 7fc98fed7740 10 client.17478 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:24:01.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.274+0000 7fc98fed7740 20 client.17478 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.274+0000 7fc98fed7740 1 --2- 172.21.15.59:0/2201382025 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x558a8c8d1670 0x558a8c8d3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.274+0000 7fc98fed7740 4 client.17478 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:24:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.274+0000 7fc98fed7740 1 -- 172.21.15.59:0/2201382025 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a8c829df0 con 0x558a8c8d1670 2024-09-10T21:24:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.275+0000 7fc986ffd640 1 --2- 172.21.15.59:0/2201382025 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x558a8c8d1670 0x558a8c8d3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.275+0000 7fc986ffd640 1 --2- 172.21.15.59:0/2201382025 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x558a8c8d1670 0x558a8c8d3a60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3d673fbe1577aada server_cookie=1e0e475a7ea45024 in_seq=0 out_seq=0 2024-09-10T21:24:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.275+0000 7fc966ffd640 10 client.17478 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:24:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.276+0000 7fc966ffd640 1 -- 172.21.15.59:0/2201382025 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558a8c829df0 con 0x558a8c8d1670 2024-09-10T21:24:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.276+0000 7fc966ffd640 10 client.17478 handle_command_reply: tid=0 2024-09-10T21:24:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.276+0000 7fc98fed7740 1 client.17478 shutdown 2024-09-10T21:24:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.276+0000 7fc98fed7740 1 -- 172.21.15.59:0/2201382025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8c1db0 msgr2=0x558a8c8befb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.276+0000 7fc98fed7740 1 --2- 172.21.15.59:0/2201382025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8c1db0 0x558a8c8befb0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fc9800119c0 tx=0x7fc980011440 comp rx=0 tx=0).stop 2024-09-10T21:24:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.276+0000 7fc98fed7740 1 -- 172.21.15.59:0/2201382025 shutdown_connections 2024-09-10T21:24:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.276+0000 7fc98fed7740 1 --2- 172.21.15.59:0/2201382025 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x558a8c8d1670 0x558a8c8d3a60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.276+0000 7fc98fed7740 1 --2- 172.21.15.59:0/2201382025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8c1db0 0x558a8c8befb0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.276+0000 7fc98fed7740 1 --2- 172.21.15.59:0/2201382025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8b1a10 0x558a8c8bea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.276+0000 7fc966ffd640 0 client.17478 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:24:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.276+0000 7fc98fed7740 1 --2- 172.21.15.59:0/2201382025 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8b10f0 0x558a8c8c1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.276+0000 7fc98fed7740 1 -- 172.21.15.59:0/2201382025 >> 172.21.15.59:0/2201382025 conn(0x558a8c8aef20 msgr2=0x558a8c8b4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.276+0000 7fc98fed7740 1 -- 172.21.15.59:0/2201382025 shutdown_connections 2024-09-10T21:24:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.276+0000 7fc98fed7740 1 -- 172.21.15.59:0/2201382025 wait complete. 2024-09-10T21:24:01.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.276+0000 7fc98fed7740 20 client.17478 trim_cache size 0 max 16384 2024-09-10T21:24:01.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.289+0000 7fc98fed7740 1 Processor -- start 2024-09-10T21:24:01.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.289+0000 7fc98fed7740 1 -- start start 2024-09-10T21:24:01.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.290+0000 7fc98fed7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8b10f0 0x558a8c8c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:01.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.290+0000 7fc98fed7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b1a10 0x558a8c8a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:01.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.290+0000 7fc98fed7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8c1db0 0x558a8c8d91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:01.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.290+0000 7fc98fed7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc9881ac1c0 con 0x558a8c8b1a10 2024-09-10T21:24:01.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.290+0000 7fc98fed7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc9881add00 con 0x558a8c8c1db0 2024-09-10T21:24:01.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.290+0000 7fc98fed7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc9881ac890 con 0x558a8c8b10f0 2024-09-10T21:24:01.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.290+0000 7fc986ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b1a10 0x558a8c8a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:01.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.290+0000 7fc986ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b1a10 0x558a8c8a9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51908/0 (socket says 172.21.15.59:51908) 2024-09-10T21:24:01.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.290+0000 7fc986ffd640 1 -- 172.21.15.59:0/1542809095 learned_addr learned my addr 172.21.15.59:0/1542809095 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:01.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.290+0000 7fc987fff640 1 --2- 172.21.15.59:0/1542809095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8c1db0 0x558a8c8d91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:01.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.290+0000 7fc987fff640 1 --2- 172.21.15.59:0/1542809095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8b10f0 0x558a8c8c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:01.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.290+0000 7fc986ffd640 1 -- 172.21.15.59:0/1542809095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8b10f0 msgr2=0x558a8c8c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:01.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.290+0000 7fc986ffd640 1 --2- 172.21.15.59:0/1542809095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8b10f0 0x558a8c8c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.290+0000 7fc986ffd640 1 -- 172.21.15.59:0/1542809095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8c1db0 msgr2=0x558a8c8d91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:01.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.290+0000 7fc986ffd640 1 --2- 172.21.15.59:0/1542809095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8c1db0 0x558a8c8d91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.290+0000 7fc986ffd640 1 -- 172.21.15.59:0/1542809095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a8c8aa550 con 0x558a8c8b1a10 2024-09-10T21:24:01.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.290+0000 7fc987fff640 1 --2- 172.21.15.59:0/1542809095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8b10f0 0x558a8c8c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.290+0000 7fc986ffd640 1 --2- 172.21.15.59:0/1542809095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b1a10 0x558a8c8a9e70 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fc97c02a930 tx=0x7fc97c005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=299fd636d2d27d3f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.290+0000 7fc96d7fa640 1 -- 172.21.15.59:0/1542809095 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c035040 con 0x558a8c8b1a10 2024-09-10T21:24:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.291+0000 7fc96d7fa640 1 -- 172.21.15.59:0/1542809095 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc97c005040 con 0x558a8c8b1a10 2024-09-10T21:24:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.291+0000 7fc96d7fa640 1 -- 172.21.15.59:0/1542809095 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97c004cb0 con 0x558a8c8b1a10 2024-09-10T21:24:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.291+0000 7fc98fed7740 1 -- 172.21.15.59:0/1542809095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b1a10 msgr2=0x558a8c8a9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.291+0000 7fc98fed7740 1 --2- 172.21.15.59:0/1542809095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b1a10 0x558a8c8a9e70 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fc97c02a930 tx=0x7fc97c005c00 comp rx=0 tx=0).stop 2024-09-10T21:24:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.291+0000 7fc98fed7740 1 -- 172.21.15.59:0/1542809095 shutdown_connections 2024-09-10T21:24:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.291+0000 7fc98fed7740 1 --2- 172.21.15.59:0/1542809095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8c1db0 0x558a8c8d91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.291+0000 7fc98fed7740 1 --2- 172.21.15.59:0/1542809095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b1a10 0x558a8c8a9e70 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.291+0000 7fc98fed7740 1 --2- 172.21.15.59:0/1542809095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8b10f0 0x558a8c8c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.291+0000 7fc98fed7740 1 -- 172.21.15.59:0/1542809095 >> 172.21.15.59:0/1542809095 conn(0x558a8c8aef20 msgr2=0x558a8c8c3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.291+0000 7fc98fed7740 1 -- 172.21.15.59:0/1542809095 shutdown_connections 2024-09-10T21:24:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.291+0000 7fc98fed7740 1 -- 172.21.15.59:0/1542809095 wait complete. 2024-09-10T21:24:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.292+0000 7fc98fed7740 1 -- start start 2024-09-10T21:24:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.292+0000 7fc98fed7740 1 Processor -- start 2024-09-10T21:24:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.292+0000 7fc98fed7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b10f0 0x558a8c8c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.292+0000 7fc98fed7740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8b1a10 0x558a8c8ca230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.292+0000 7fc98fed7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8c1db0 0x558a8c8c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.292+0000 7fc98fed7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc9881ad630 con 0x558a8c8b10f0 2024-09-10T21:24:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.292+0000 7fc98fed7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc9881acf60 con 0x558a8c8c1db0 2024-09-10T21:24:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.292+0000 7fc98fed7740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc9881aa1c0 con 0x558a8c8b1a10 2024-09-10T21:24:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.292+0000 7fc98fed7740 10 client.0 _ll_register_callbacks cb 0x7fc9800116a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.292+0000 7fc987fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b10f0 0x558a8c8c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.292+0000 7fc987fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b10f0 0x558a8c8c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51918/0 (socket says 172.21.15.59:51918) 2024-09-10T21:24:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.292+0000 7fc987fff640 1 -- 172.21.15.59:0/712931213 learned_addr learned my addr 172.21.15.59:0/712931213 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.293+0000 7fc986ffd640 1 --2- 172.21.15.59:0/712931213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8b1a10 0x558a8c8ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.293+0000 7fc987fff640 1 -- 172.21.15.59:0/712931213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8b1a10 msgr2=0x558a8c8ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.293+0000 7fc987fff640 1 --2- 172.21.15.59:0/712931213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8b1a10 0x558a8c8ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.293+0000 7fc987fff640 1 -- 172.21.15.59:0/712931213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8c1db0 msgr2=0x558a8c8c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.293+0000 7fc987fff640 1 --2- 172.21.15.59:0/712931213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8c1db0 0x558a8c8c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.293+0000 7fc987fff640 1 -- 172.21.15.59:0/712931213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a8c8c7200 con 0x558a8c8b10f0 2024-09-10T21:24:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.293+0000 7fc986ffd640 1 --2- 172.21.15.59:0/712931213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8b1a10 0x558a8c8ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.293+0000 7fc987fff640 1 --2- 172.21.15.59:0/712931213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b10f0 0x558a8c8c9cf0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fc980009c30 tx=0x7fc9800021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfff6eb6d5810bbe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.293+0000 7fc966ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.293+0000 7fc966ffd640 1 -- 172.21.15.59:0/712931213 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc980043060 con 0x558a8c8b10f0 2024-09-10T21:24:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.293+0000 7fc966ffd640 1 -- 172.21.15.59:0/712931213 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc980011be0 con 0x558a8c8b10f0 2024-09-10T21:24:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.293+0000 7fc98fed7740 1 -- 172.21.15.59:0/712931213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc97c005040 con 0x558a8c8b10f0 2024-09-10T21:24:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.293+0000 7fc966ffd640 1 -- 172.21.15.59:0/712931213 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc980039040 con 0x558a8c8b10f0 2024-09-10T21:24:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.293+0000 7fc98fed7740 10 client.17484 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.293+0000 7fc98fed7740 1 -- 172.21.15.59:0/712931213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558a8c93ea50 con 0x558a8c8b10f0 2024-09-10T21:24:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.293+0000 7fc966ffd640 1 -- 172.21.15.59:0/712931213 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc97c005040 con 0x558a8c8b10f0 2024-09-10T21:24:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.294+0000 7fc966ffd640 1 -- 172.21.15.59:0/712931213 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc9800057c0 con 0x558a8c8b10f0 2024-09-10T21:24:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.294+0000 7fc98fed7740 10 client.17484 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.294+0000 7fc98fed7740 10 client.17484 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:24:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.294+0000 7fc98fed7740 20 client.17484 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.294+0000 7fc98fed7740 1 --2- 172.21.15.59:0/712931213 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x558a8c93f200 0x558a8c941620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.294+0000 7fc98fed7740 4 client.17484 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:24:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.294+0000 7fc98fed7740 1 -- 172.21.15.59:0/712931213 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558a8c8258a0 con 0x558a8c93f200 2024-09-10T21:24:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.294+0000 7fc986ffd640 1 --2- 172.21.15.59:0/712931213 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x558a8c93f200 0x558a8c941620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.294+0000 7fc986ffd640 1 --2- 172.21.15.59:0/712931213 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x558a8c93f200 0x558a8c941620 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fa1909519b057a61 server_cookie=8ace76a346660e0a in_seq=0 out_seq=0 2024-09-10T21:24:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.294+0000 7fc966ffd640 10 client.17484 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:24:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.295+0000 7fc966ffd640 1 -- 172.21.15.59:0/712931213 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558a8c8258a0 con 0x558a8c93f200 2024-09-10T21:24:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.295+0000 7fc966ffd640 10 client.17484 handle_command_reply: tid=0 2024-09-10T21:24:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.295+0000 7fc98fed7740 1 client.17484 shutdown 2024-09-10T21:24:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.295+0000 7fc98fed7740 1 -- 172.21.15.59:0/712931213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b10f0 msgr2=0x558a8c8c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.295+0000 7fc98fed7740 1 --2- 172.21.15.59:0/712931213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b10f0 0x558a8c8c9cf0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fc980009c30 tx=0x7fc9800021d0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.295+0000 7fc98fed7740 1 -- 172.21.15.59:0/712931213 shutdown_connections 2024-09-10T21:24:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.295+0000 7fc98fed7740 1 --2- 172.21.15.59:0/712931213 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x558a8c93f200 0x558a8c941620 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.295+0000 7fc98fed7740 1 --2- 172.21.15.59:0/712931213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a8c8c1db0 0x558a8c8c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.295+0000 7fc98fed7740 1 --2- 172.21.15.59:0/712931213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558a8c8b1a10 0x558a8c8ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.295+0000 7fc98fed7740 1 --2- 172.21.15.59:0/712931213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558a8c8b10f0 0x558a8c8c9cf0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.295+0000 7fc98fed7740 1 -- 172.21.15.59:0/712931213 >> 172.21.15.59:0/712931213 conn(0x558a8c8aef20 msgr2=0x558a8c8c0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.295+0000 7fc966ffd640 0 client.17484 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:24:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.295+0000 7fc98fed7740 1 -- 172.21.15.59:0/712931213 shutdown_connections 2024-09-10T21:24:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.295+0000 7fc98fed7740 1 -- 172.21.15.59:0/712931213 wait complete. 2024-09-10T21:24:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.295+0000 7fc98fed7740 20 client.17484 trim_cache size 0 max 16384 2024-09-10T21:24:01.304 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:24:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.296+0000 7fc98db02640 1 -- 172.21.15.59:0/3055675907 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc9700b52e0 msgr2=0x7fc9700b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.296+0000 7fc98db02640 1 --2- 172.21.15.59:0/3055675907 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc9700b52e0 0x7fc9700b77a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc9780e3300 tx=0x7fc978012000 comp rx=0 tx=0).stop 2024-09-10T21:24:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.296+0000 7fc98db02640 1 -- 172.21.15.59:0/3055675907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc988102dc0 msgr2=0x7fc9881992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.296+0000 7fc98db02640 1 --2- 172.21.15.59:0/3055675907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc988102dc0 0x7fc9881992e0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fc97800b4a0 tx=0x7fc97800b960 comp rx=0 tx=0).stop 2024-09-10T21:24:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.296+0000 7fc98db02640 1 -- 172.21.15.59:0/3055675907 shutdown_connections 2024-09-10T21:24:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.296+0000 7fc98db02640 1 --2- 172.21.15.59:0/3055675907 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc9700b52e0 0x7fc9700b77a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.296+0000 7fc98db02640 1 --2- 172.21.15.59:0/3055675907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc988109150 0x7fc98819ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.296+0000 7fc98db02640 1 --2- 172.21.15.59:0/3055675907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9881087d0 0x7fc988199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.296+0000 7fc98db02640 1 --2- 172.21.15.59:0/3055675907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc988102dc0 0x7fc9881992e0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.296+0000 7fc98db02640 1 -- 172.21.15.59:0/3055675907 >> 172.21.15.59:0/3055675907 conn(0x7fc9880fe830 msgr2=0x7fc988100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.296+0000 7fc98db02640 1 -- 172.21.15.59:0/3055675907 shutdown_connections 2024-09-10T21:24:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:01.296+0000 7fc98db02640 1 -- 172.21.15.59:0/3055675907 wait complete. 2024-09-10T21:24:01.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:01 smithi059 ceph-mon[30888]: pgmap v602: 97 pgs: 97 active+clean; 6.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:24:01.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:01 smithi154 ceph-mon[35041]: pgmap v602: 97 pgs: 97 active+clean; 6.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:24:01.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:01 smithi192 ceph-mon[35363]: pgmap v602: 97 pgs: 97 active+clean; 6.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:24:02.172 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:24:02.435 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:24:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.956+0000 7f971c7fd640 1 -- 172.21.15.59:0/13775900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f971410d140 msgr2=0x7f971410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.956+0000 7f971c7fd640 1 --2- 172.21.15.59:0/13775900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f971410d140 0x7f971410f5a0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f970c009900 tx=0x7f970c02a410 comp rx=0 tx=0).stop 2024-09-10T21:24:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.956+0000 7f971c7fd640 1 -- 172.21.15.59:0/13775900 shutdown_connections 2024-09-10T21:24:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.956+0000 7f971c7fd640 1 --2- 172.21.15.59:0/13775900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f971410d140 0x7f971410f5a0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.956+0000 7f971c7fd640 1 --2- 172.21.15.59:0/13775900 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9714104600 0x7f971410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.956+0000 7f971c7fd640 1 --2- 172.21.15.59:0/13775900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9714103ce0 0x7f97141040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.956+0000 7f971c7fd640 1 -- 172.21.15.59:0/13775900 >> 172.21.15.59:0/13775900 conn(0x7f97140fd700 msgr2=0x7f97140ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.957+0000 7f971c7fd640 1 -- 172.21.15.59:0/13775900 shutdown_connections 2024-09-10T21:24:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.957+0000 7f971c7fd640 1 -- 172.21.15.59:0/13775900 wait complete. 2024-09-10T21:24:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.957+0000 7f971c7fd640 1 Processor -- start 2024-09-10T21:24:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.957+0000 7f971c7fd640 1 -- start start 2024-09-10T21:24:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.957+0000 7f971c7fd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9714103ce0 0x7f9714101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.957+0000 7f971c7fd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9714104600 0x7f9714101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.957+0000 7f971c7fd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f971410d140 0x7f9714102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.957+0000 7f971c7fd640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9714112db0 con 0x7f971410d140 2024-09-10T21:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.957+0000 7f971c7fd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9714112c30 con 0x7f9714104600 2024-09-10T21:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.957+0000 7f971c7fd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9714112f30 con 0x7f9714103ce0 2024-09-10T21:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.957+0000 7f971ad9a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f971410d140 0x7f9714102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.958+0000 7f971ad9a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f971410d140 0x7f9714102410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51932/0 (socket says 172.21.15.59:51932) 2024-09-10T21:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.958+0000 7f971ad9a640 1 -- 172.21.15.59:0/3966006977 learned_addr learned my addr 172.21.15.59:0/3966006977 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.958+0000 7f971a599640 1 --2- 172.21.15.59:0/3966006977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9714103ce0 0x7f9714101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.958+0000 7f9719d98640 1 --2- 172.21.15.59:0/3966006977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9714104600 0x7f9714101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.958+0000 7f971ad9a640 1 -- 172.21.15.59:0/3966006977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9714103ce0 msgr2=0x7f9714101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.958+0000 7f971ad9a640 1 --2- 172.21.15.59:0/3966006977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9714103ce0 0x7f9714101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.958+0000 7f971ad9a640 1 -- 172.21.15.59:0/3966006977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9714104600 msgr2=0x7f9714101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.958+0000 7f971ad9a640 1 --2- 172.21.15.59:0/3966006977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9714104600 0x7f9714101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.958+0000 7f971ad9a640 1 -- 172.21.15.59:0/3966006977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97141a75e0 con 0x7f971410d140 2024-09-10T21:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.958+0000 7f9719d98640 1 --2- 172.21.15.59:0/3966006977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9714104600 0x7f9714101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.958+0000 7f971ad9a640 1 --2- 172.21.15.59:0/3966006977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f971410d140 0x7f9714102410 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f970c004770 tx=0x7f970c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.958+0000 7f97137fe640 1 -- 172.21.15.59:0/3966006977 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c03f030 con 0x7f971410d140 2024-09-10T21:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.958+0000 7f97137fe640 1 -- 172.21.15.59:0/3966006977 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f970c003aa0 con 0x7f971410d140 2024-09-10T21:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.958+0000 7f971c7fd640 1 -- 172.21.15.59:0/3966006977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97141a7870 con 0x7f971410d140 2024-09-10T21:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.958+0000 7f97137fe640 1 -- 172.21.15.59:0/3966006977 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c035070 con 0x7f971410d140 2024-09-10T21:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.958+0000 7f971c7fd640 1 -- 172.21.15.59:0/3966006977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97141a7da0 con 0x7f971410d140 2024-09-10T21:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.961+0000 7f971ebd2740 1 Processor -- start 2024-09-10T21:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.961+0000 7f97137fe640 1 -- 172.21.15.59:0/3966006977 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f970c0035f0 con 0x7f971410d140 2024-09-10T21:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.961+0000 7f971ebd2740 1 -- start start 2024-09-10T21:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f971ebd2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345a0f0 0x55be0345a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f971ebd2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be0345aa10 0x55be03466460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f971ebd2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be034669a0 0x55be03468d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f971ebd2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55be033d0ea0 con 0x55be034669a0 2024-09-10T21:24:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f971ebd2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55be033c02d0 con 0x55be0345aa10 2024-09-10T21:24:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f971ebd2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55be033c40e0 con 0x55be0345a0f0 2024-09-10T21:24:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f9719d98640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be034669a0 0x55be03468d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f9719d98640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be034669a0 0x55be03468d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51942/0 (socket says 172.21.15.59:51942) 2024-09-10T21:24:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f9719d98640 1 -- 172.21.15.59:0/1307899587 learned_addr learned my addr 172.21.15.59:0/1307899587 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f9719d98640 1 --2- 172.21.15.59:0/1307899587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345a0f0 0x55be0345a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f971a599640 1 --2- 172.21.15.59:0/1307899587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be0345aa10 0x55be03466460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f9719d98640 1 -- 172.21.15.59:0/1307899587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345a0f0 msgr2=0x55be0345a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f9719d98640 1 --2- 172.21.15.59:0/1307899587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345a0f0 0x55be0345a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f9719d98640 1 -- 172.21.15.59:0/1307899587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be0345aa10 msgr2=0x55be03466460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f9719d98640 1 --2- 172.21.15.59:0/1307899587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be0345aa10 0x55be03466460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f9719d98640 1 -- 172.21.15.59:0/1307899587 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be0311e650 con 0x55be034669a0 2024-09-10T21:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f971a599640 1 --2- 172.21.15.59:0/1307899587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be0345aa10 0x55be03466460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f97137fe640 1 --2- 172.21.15.59:0/3966006977 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f96fc0b5360 0x7f96fc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f9719d98640 1 --2- 172.21.15.59:0/1307899587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be034669a0 0x55be03468d90 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f9708014980 tx=0x7f970800b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb156554a727d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.962+0000 7f971a599640 1 --2- 172.21.15.59:0/3966006977 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f96fc0b5360 0x7f96fc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.963+0000 7f97137fe640 1 -- 172.21.15.59:0/3966006977 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f970c106350 con 0x7f971410d140 2024-09-10T21:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.963+0000 7f9710ff9640 1 -- 172.21.15.59:0/1307899587 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97080142d0 con 0x55be034669a0 2024-09-10T21:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.963+0000 7f9710ff9640 1 -- 172.21.15.59:0/1307899587 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f970800f760 con 0x55be034669a0 2024-09-10T21:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.963+0000 7f9710ff9640 1 -- 172.21.15.59:0/1307899587 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9708003850 con 0x55be034669a0 2024-09-10T21:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.964+0000 7f971ebd2740 1 -- 172.21.15.59:0/1307899587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be034669a0 msgr2=0x55be03468d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.964+0000 7f971a599640 1 --2- 172.21.15.59:0/3966006977 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f96fc0b5360 0x7f96fc0b7820 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x55be03458e00 tx=0x7f97040075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.964+0000 7f971ebd2740 1 --2- 172.21.15.59:0/1307899587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be034669a0 0x55be03468d90 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f9708014980 tx=0x7f970800b570 comp rx=0 tx=0).stop 2024-09-10T21:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.964+0000 7f971ebd2740 1 -- 172.21.15.59:0/1307899587 shutdown_connections 2024-09-10T21:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.964+0000 7f971ebd2740 1 --2- 172.21.15.59:0/1307899587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be034669a0 0x55be03468d90 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.964+0000 7f971ebd2740 1 --2- 172.21.15.59:0/1307899587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be0345aa10 0x55be03466460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.964+0000 7f971ebd2740 1 --2- 172.21.15.59:0/1307899587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345a0f0 0x55be0345a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.964+0000 7f971ebd2740 1 -- 172.21.15.59:0/1307899587 >> 172.21.15.59:0/1307899587 conn(0x55be03457f20 msgr2=0x55be034590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.964+0000 7f971ebd2740 1 -- 172.21.15.59:0/1307899587 shutdown_connections 2024-09-10T21:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.964+0000 7f971ebd2740 1 -- 172.21.15.59:0/1307899587 wait complete. 2024-09-10T21:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.964+0000 7f971ebd2740 1 -- start start 2024-09-10T21:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.964+0000 7f971ebd2740 1 Processor -- start 2024-09-10T21:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.964+0000 7f971ebd2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be0345a0f0 0x55be034662f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.964+0000 7f971ebd2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345aa10 0x55be03463740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.964+0000 7f971ebd2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be034669a0 0x55be03463da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.964+0000 7f971ebd2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55be03221700 con 0x55be0345a0f0 2024-09-10T21:24:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.964+0000 7f971ebd2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55be0335b160 con 0x55be034669a0 2024-09-10T21:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.964+0000 7f971ebd2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55be034695c0 con 0x55be0345aa10 2024-09-10T21:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.965+0000 7f971ebd2740 10 client.0 _ll_register_callbacks cb 0x55be033749e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.965+0000 7f971a599640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be0345a0f0 0x55be034662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.965+0000 7f971a599640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be0345a0f0 0x55be034662f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51948/0 (socket says 172.21.15.59:51948) 2024-09-10T21:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.965+0000 7f971a599640 1 -- 172.21.15.59:0/1073325338 learned_addr learned my addr 172.21.15.59:0/1073325338 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.965+0000 7f971ad9a640 1 --2- 172.21.15.59:0/1073325338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be034669a0 0x55be03463da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.965+0000 7f9719d98640 1 --2- 172.21.15.59:0/1073325338 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345aa10 0x55be03463740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.965+0000 7f971a599640 1 -- 172.21.15.59:0/1073325338 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345aa10 msgr2=0x55be03463740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.965+0000 7f971a599640 1 --2- 172.21.15.59:0/1073325338 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345aa10 0x55be03463740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.965+0000 7f971a599640 1 -- 172.21.15.59:0/1073325338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be034669a0 msgr2=0x55be03463da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.965+0000 7f971a599640 1 --2- 172.21.15.59:0/1073325338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be034669a0 0x55be03463da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.965+0000 7f971a599640 1 -- 172.21.15.59:0/1073325338 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be03388c90 con 0x55be0345a0f0 2024-09-10T21:24:02.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.965+0000 7f971a599640 1 --2- 172.21.15.59:0/1073325338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be0345a0f0 0x55be034662f0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f9704007ac0 tx=0x7f9704004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de97c670826e62d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.965+0000 7f96f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.965+0000 7f96f9ffb640 1 -- 172.21.15.59:0/1073325338 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970402b060 con 0x55be0345a0f0 2024-09-10T21:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.965+0000 7f96f9ffb640 1 -- 172.21.15.59:0/1073325338 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9704026420 con 0x55be0345a0f0 2024-09-10T21:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.965+0000 7f971ebd2740 1 -- 172.21.15.59:0/1073325338 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f970800f760 con 0x55be0345a0f0 2024-09-10T21:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.966+0000 7f96f9ffb640 1 -- 172.21.15.59:0/1073325338 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9704026620 con 0x55be0345a0f0 2024-09-10T21:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.966+0000 7f971ebd2740 10 client.17496 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.966+0000 7f971ebd2740 1 -- 172.21.15.59:0/1073325338 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55be03474fb0 con 0x55be0345a0f0 2024-09-10T21:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.966+0000 7f96f9ffb640 1 -- 172.21.15.59:0/1073325338 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f970800f760 con 0x55be0345a0f0 2024-09-10T21:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.966+0000 7f96f9ffb640 1 -- 172.21.15.59:0/1073325338 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f970401a390 con 0x55be0345a0f0 2024-09-10T21:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.966+0000 7f971ebd2740 10 client.17496 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.966+0000 7f971ebd2740 10 client.17496 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.966+0000 7f971ebd2740 20 client.17496 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.966+0000 7f971ebd2740 1 --2- 172.21.15.59:0/1073325338 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55be034764c0 0x55be03478900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:02.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.966+0000 7f971ebd2740 4 client.17496 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:24:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.966+0000 7f971ebd2740 1 -- 172.21.15.59:0/1073325338 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be033d2df0 con 0x55be034764c0 2024-09-10T21:24:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.967+0000 7f9719d98640 1 --2- 172.21.15.59:0/1073325338 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55be034764c0 0x55be03478900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.967+0000 7f9719d98640 1 --2- 172.21.15.59:0/1073325338 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55be034764c0 0x55be03478900 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2f6fdd12f4775473 server_cookie=a1a64fc6d4eb281 in_seq=0 out_seq=0 2024-09-10T21:24:02.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.967+0000 7f96f9ffb640 10 client.17496 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:24:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.968+0000 7f96f9ffb640 1 -- 172.21.15.59:0/1073325338 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55be033d2df0 con 0x55be034764c0 2024-09-10T21:24:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.968+0000 7f96f9ffb640 10 client.17496 handle_command_reply: tid=0 2024-09-10T21:24:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.968+0000 7f971ebd2740 1 client.17496 shutdown 2024-09-10T21:24:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.968+0000 7f971ebd2740 1 -- 172.21.15.59:0/1073325338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be0345a0f0 msgr2=0x55be034662f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.968+0000 7f971ebd2740 1 --2- 172.21.15.59:0/1073325338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be0345a0f0 0x55be034662f0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f9704007ac0 tx=0x7f9704004a40 comp rx=0 tx=0).stop 2024-09-10T21:24:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.968+0000 7f971ebd2740 1 -- 172.21.15.59:0/1073325338 shutdown_connections 2024-09-10T21:24:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.968+0000 7f971ebd2740 1 --2- 172.21.15.59:0/1073325338 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55be034764c0 0x55be03478900 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.968+0000 7f971ebd2740 1 --2- 172.21.15.59:0/1073325338 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be034669a0 0x55be03463da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.968+0000 7f971ebd2740 1 --2- 172.21.15.59:0/1073325338 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345aa10 0x55be03463740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.968+0000 7f971ebd2740 1 --2- 172.21.15.59:0/1073325338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be0345a0f0 0x55be034662f0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.968+0000 7f971ebd2740 1 -- 172.21.15.59:0/1073325338 >> 172.21.15.59:0/1073325338 conn(0x55be03457f20 msgr2=0x55be0345dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.968+0000 7f96f9ffb640 0 client.17496 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:24:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.968+0000 7f971ebd2740 1 -- 172.21.15.59:0/1073325338 shutdown_connections 2024-09-10T21:24:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.968+0000 7f971ebd2740 1 -- 172.21.15.59:0/1073325338 wait complete. 2024-09-10T21:24:02.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.968+0000 7f971ebd2740 20 client.17496 trim_cache size 0 max 16384 2024-09-10T21:24:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.981+0000 7f971ebd2740 1 Processor -- start 2024-09-10T21:24:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.981+0000 7f971ebd2740 1 -- start start 2024-09-10T21:24:02.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.981+0000 7f971ebd2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be0345a0f0 0x55be034727f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.981+0000 7f971ebd2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345aa10 0x55be03452e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.982+0000 7f971ebd2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be034669a0 0x55be03465480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.982+0000 7f971ebd2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f97141b0440 con 0x55be034669a0 2024-09-10T21:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.982+0000 7f971ebd2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f97141b1f80 con 0x55be0345a0f0 2024-09-10T21:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.982+0000 7f971ebd2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f97141b0b10 con 0x55be0345aa10 2024-09-10T21:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.982+0000 7f971ad9a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be034669a0 0x55be03465480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.982+0000 7f971ad9a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be034669a0 0x55be03465480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51954/0 (socket says 172.21.15.59:51954) 2024-09-10T21:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.982+0000 7f971ad9a640 1 -- 172.21.15.59:0/180340572 learned_addr learned my addr 172.21.15.59:0/180340572 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.982+0000 7f9719d98640 1 --2- 172.21.15.59:0/180340572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345aa10 0x55be03452e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.982+0000 7f971a599640 1 --2- 172.21.15.59:0/180340572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be0345a0f0 0x55be034727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.982+0000 7f971ad9a640 1 -- 172.21.15.59:0/180340572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345aa10 msgr2=0x55be03452e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.982+0000 7f971ad9a640 1 --2- 172.21.15.59:0/180340572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345aa10 0x55be03452e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.982+0000 7f971ad9a640 1 -- 172.21.15.59:0/180340572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be0345a0f0 msgr2=0x55be034727f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.982+0000 7f971ad9a640 1 --2- 172.21.15.59:0/180340572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be0345a0f0 0x55be034727f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.982+0000 7f971ad9a640 1 -- 172.21.15.59:0/180340572 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be034634f0 con 0x55be034669a0 2024-09-10T21:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.982+0000 7f971ad9a640 1 --2- 172.21.15.59:0/180340572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be034669a0 0x55be03465480 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f970c1041f0 tx=0x7f970c003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac599e67adf97e65 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.982+0000 7f96fbfff640 1 -- 172.21.15.59:0/180340572 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c049070 con 0x55be034669a0 2024-09-10T21:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.982+0000 7f96fbfff640 1 -- 172.21.15.59:0/180340572 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f970c0cc650 con 0x55be034669a0 2024-09-10T21:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.982+0000 7f96fbfff640 1 -- 172.21.15.59:0/180340572 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c0d1620 con 0x55be034669a0 2024-09-10T21:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.983+0000 7f971ebd2740 1 -- 172.21.15.59:0/180340572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be034669a0 msgr2=0x55be03465480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.983+0000 7f971ebd2740 1 --2- 172.21.15.59:0/180340572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be034669a0 0x55be03465480 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f970c1041f0 tx=0x7f970c003f50 comp rx=0 tx=0).stop 2024-09-10T21:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.983+0000 7f971ebd2740 1 -- 172.21.15.59:0/180340572 shutdown_connections 2024-09-10T21:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.983+0000 7f971ebd2740 1 --2- 172.21.15.59:0/180340572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be034669a0 0x55be03465480 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.983+0000 7f971ebd2740 1 --2- 172.21.15.59:0/180340572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345aa10 0x55be03452e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.983+0000 7f971ebd2740 1 --2- 172.21.15.59:0/180340572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be0345a0f0 0x55be034727f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.983+0000 7f971ebd2740 1 -- 172.21.15.59:0/180340572 >> 172.21.15.59:0/180340572 conn(0x55be03457f20 msgr2=0x55be03464d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.983+0000 7f971ebd2740 1 -- 172.21.15.59:0/180340572 shutdown_connections 2024-09-10T21:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.983+0000 7f971ebd2740 1 -- 172.21.15.59:0/180340572 wait complete. 2024-09-10T21:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.983+0000 7f971ebd2740 1 -- start start 2024-09-10T21:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.984+0000 7f971ebd2740 1 Processor -- start 2024-09-10T21:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.984+0000 7f971ebd2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be0345a0f0 0x55be0346e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.984+0000 7f971ebd2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345aa10 0x55be0346eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.984+0000 7f971ebd2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be034669a0 0x55be03469810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.984+0000 7f971ebd2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f97141b18b0 con 0x55be0345a0f0 2024-09-10T21:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.984+0000 7f971ebd2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f97141b11e0 con 0x55be034669a0 2024-09-10T21:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.984+0000 7f971ebd2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f97141ae420 con 0x55be0345aa10 2024-09-10T21:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.984+0000 7f971ebd2740 10 client.0 _ll_register_callbacks cb 0x7f9704007d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:02.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.984+0000 7f971a599640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be0345a0f0 0x55be0346e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.984+0000 7f971a599640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be0345a0f0 0x55be0346e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51960/0 (socket says 172.21.15.59:51960) 2024-09-10T21:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.984+0000 7f971a599640 1 -- 172.21.15.59:0/2539804869 learned_addr learned my addr 172.21.15.59:0/2539804869 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.984+0000 7f9719d98640 1 --2- 172.21.15.59:0/2539804869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345aa10 0x55be0346eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.984+0000 7f971ad9a640 1 --2- 172.21.15.59:0/2539804869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be034669a0 0x55be03469810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.984+0000 7f971a599640 1 -- 172.21.15.59:0/2539804869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345aa10 msgr2=0x55be0346eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.984+0000 7f971a599640 1 --2- 172.21.15.59:0/2539804869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345aa10 0x55be0346eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.984+0000 7f971a599640 1 -- 172.21.15.59:0/2539804869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be034669a0 msgr2=0x55be03469810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.984+0000 7f971a599640 1 --2- 172.21.15.59:0/2539804869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be034669a0 0x55be03469810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.984+0000 7f971a599640 1 -- 172.21.15.59:0/2539804869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be03469d50 con 0x55be0345a0f0 2024-09-10T21:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.985+0000 7f971a599640 1 --2- 172.21.15.59:0/2539804869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be0345a0f0 0x55be0346e860 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f9704016040 tx=0x7f970401a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71139c2fb8ce876 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.985+0000 7f96f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.985+0000 7f96f9ffb640 1 -- 172.21.15.59:0/2539804869 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9704041060 con 0x55be0345a0f0 2024-09-10T21:24:02.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.985+0000 7f96f9ffb640 1 -- 172.21.15.59:0/2539804869 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9704026420 con 0x55be0345a0f0 2024-09-10T21:24:02.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.985+0000 7f971ebd2740 1 -- 172.21.15.59:0/2539804869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f970c0cc650 con 0x55be0345a0f0 2024-09-10T21:24:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.985+0000 7f96f9ffb640 1 -- 172.21.15.59:0/2539804869 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f970402b020 con 0x55be0345a0f0 2024-09-10T21:24:02.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.985+0000 7f971ebd2740 10 client.17502 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.985+0000 7f971ebd2740 1 -- 172.21.15.59:0/2539804869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55be034e3c10 con 0x55be0345a0f0 2024-09-10T21:24:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.985+0000 7f96f9ffb640 1 -- 172.21.15.59:0/2539804869 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f970c0cc650 con 0x55be0345a0f0 2024-09-10T21:24:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.985+0000 7f96f9ffb640 1 -- 172.21.15.59:0/2539804869 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9704026950 con 0x55be0345a0f0 2024-09-10T21:24:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.985+0000 7f971ebd2740 10 client.17502 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.985+0000 7f971ebd2740 10 client.17502 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:24:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.985+0000 7f971ebd2740 20 client.17502 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.985+0000 7f971ebd2740 1 --2- 172.21.15.59:0/2539804869 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55be034e43c0 0x55be034e67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.985+0000 7f971ebd2740 4 client.17502 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:24:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.985+0000 7f971ebd2740 1 -- 172.21.15.59:0/2539804869 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55be033ce8a0 con 0x55be034e43c0 2024-09-10T21:24:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.986+0000 7f9719d98640 1 --2- 172.21.15.59:0/2539804869 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55be034e43c0 0x55be034e67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.986+0000 7f9719d98640 1 --2- 172.21.15.59:0/2539804869 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55be034e43c0 0x55be034e67e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a612d0a22235ec5e server_cookie=8d6715b29fe8f9af in_seq=0 out_seq=0 2024-09-10T21:24:02.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.986+0000 7f96f9ffb640 10 client.17502 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:24:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.987+0000 7f96f9ffb640 1 -- 172.21.15.59:0/2539804869 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55be033ce8a0 con 0x55be034e43c0 2024-09-10T21:24:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.987+0000 7f96f9ffb640 10 client.17502 handle_command_reply: tid=0 2024-09-10T21:24:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.987+0000 7f971ebd2740 1 client.17502 shutdown 2024-09-10T21:24:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.987+0000 7f971ebd2740 1 -- 172.21.15.59:0/2539804869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be0345a0f0 msgr2=0x55be0346e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.987+0000 7f971ebd2740 1 --2- 172.21.15.59:0/2539804869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be0345a0f0 0x55be0346e860 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f9704016040 tx=0x7f970401a640 comp rx=0 tx=0).stop 2024-09-10T21:24:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.987+0000 7f971ebd2740 1 -- 172.21.15.59:0/2539804869 shutdown_connections 2024-09-10T21:24:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.987+0000 7f971ebd2740 1 --2- 172.21.15.59:0/2539804869 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55be034e43c0 0x55be034e67e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.987+0000 7f971ebd2740 1 --2- 172.21.15.59:0/2539804869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be034669a0 0x55be03469810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.987+0000 7f971ebd2740 1 --2- 172.21.15.59:0/2539804869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55be0345aa10 0x55be0346eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.987+0000 7f971ebd2740 1 --2- 172.21.15.59:0/2539804869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be0345a0f0 0x55be0346e860 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.987+0000 7f96f9ffb640 0 client.17502 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:24:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.987+0000 7f971ebd2740 1 -- 172.21.15.59:0/2539804869 >> 172.21.15.59:0/2539804869 conn(0x55be03457f20 msgr2=0x55be03465590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.987+0000 7f971ebd2740 1 -- 172.21.15.59:0/2539804869 shutdown_connections 2024-09-10T21:24:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.987+0000 7f971ebd2740 1 -- 172.21.15.59:0/2539804869 wait complete. 2024-09-10T21:24:02.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.987+0000 7f971ebd2740 20 client.17502 trim_cache size 0 max 16384 2024-09-10T21:24:02.996 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:24:02.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.987+0000 7f971c7fd640 1 -- 172.21.15.59:0/3966006977 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f96fc0b5360 msgr2=0x7f96fc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:02.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.987+0000 7f971c7fd640 1 --2- 172.21.15.59:0/3966006977 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f96fc0b5360 0x7f96fc0b7820 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x55be03458e00 tx=0x7f97040075b0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.987+0000 7f971c7fd640 1 -- 172.21.15.59:0/3966006977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f971410d140 msgr2=0x7f9714102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.987+0000 7f971c7fd640 1 --2- 172.21.15.59:0/3966006977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f971410d140 0x7f9714102410 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f970c004770 tx=0x7f970c004270 comp rx=0 tx=0).stop 2024-09-10T21:24:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.988+0000 7f971c7fd640 1 -- 172.21.15.59:0/3966006977 shutdown_connections 2024-09-10T21:24:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.988+0000 7f971c7fd640 1 --2- 172.21.15.59:0/3966006977 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f96fc0b5360 0x7f96fc0b7820 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.988+0000 7f971c7fd640 1 --2- 172.21.15.59:0/3966006977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f971410d140 0x7f9714102410 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.988+0000 7f971c7fd640 1 --2- 172.21.15.59:0/3966006977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9714104600 0x7f9714101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.988+0000 7f971c7fd640 1 --2- 172.21.15.59:0/3966006977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9714103ce0 0x7f9714101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.988+0000 7f971c7fd640 1 -- 172.21.15.59:0/3966006977 >> 172.21.15.59:0/3966006977 conn(0x7f97140fd700 msgr2=0x7f971410f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.988+0000 7f971c7fd640 1 -- 172.21.15.59:0/3966006977 shutdown_connections 2024-09-10T21:24:02.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:02.988+0000 7f971c7fd640 1 -- 172.21.15.59:0/3966006977 wait complete. 2024-09-10T21:24:03.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:03 smithi059 ceph-mon[30888]: pgmap v603: 97 pgs: 97 active+clean; 6.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:24:03.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:03 smithi154 ceph-mon[35041]: pgmap v603: 97 pgs: 97 active+clean; 6.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:24:03.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:03 smithi192 ceph-mon[35363]: pgmap v603: 97 pgs: 97 active+clean; 6.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:24:03.764 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:24:04.028 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:24:04.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.565+0000 7efd44484640 1 -- 172.21.15.59:0/3559095610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd3c10d100 msgr2=0x7efd3c10f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:04.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.566+0000 7efd44484640 1 --2- 172.21.15.59:0/3559095610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd3c10d100 0x7efd3c10f570 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7efd34009ca0 tx=0x7efd3402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.566+0000 7efd44484640 1 -- 172.21.15.59:0/3559095610 shutdown_connections 2024-09-10T21:24:04.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.566+0000 7efd44484640 1 --2- 172.21.15.59:0/3559095610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd3c10d100 0x7efd3c10f570 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.566+0000 7efd44484640 1 --2- 172.21.15.59:0/3559095610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd3c104550 0x7efd3c10cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.566+0000 7efd44484640 1 --2- 172.21.15.59:0/3559095610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd3c103b50 0x7efd3c103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.566+0000 7efd44484640 1 -- 172.21.15.59:0/3559095610 >> 172.21.15.59:0/3559095610 conn(0x7efd3c0fd700 msgr2=0x7efd3c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:04.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.566+0000 7efd44484640 1 -- 172.21.15.59:0/3559095610 shutdown_connections 2024-09-10T21:24:04.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.566+0000 7efd44484640 1 -- 172.21.15.59:0/3559095610 wait complete. 2024-09-10T21:24:04.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.566+0000 7efd44484640 1 Processor -- start 2024-09-10T21:24:04.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.567+0000 7efd44484640 1 -- start start 2024-09-10T21:24:04.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.567+0000 7efd44484640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd3c103b50 0x7efd3c1019d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:04.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.567+0000 7efd44484640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd3c104550 0x7efd3c101f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:04.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.567+0000 7efd44484640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd3c10d100 0x7efd3c102450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:04.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.567+0000 7efd44484640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c112d80 con 0x7efd3c103b50 2024-09-10T21:24:04.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.567+0000 7efd44484640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c112c00 con 0x7efd3c10d100 2024-09-10T21:24:04.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.567+0000 7efd44484640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c112f00 con 0x7efd3c104550 2024-09-10T21:24:04.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.567+0000 7efd42220640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd3c103b50 0x7efd3c1019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:04.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.567+0000 7efd42220640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd3c103b50 0x7efd3c1019d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51982/0 (socket says 172.21.15.59:51982) 2024-09-10T21:24:04.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.567+0000 7efd42220640 1 -- 172.21.15.59:0/3876894714 learned_addr learned my addr 172.21.15.59:0/3876894714 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:04.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.567+0000 7efd42a21640 1 --2- 172.21.15.59:0/3876894714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd3c10d100 0x7efd3c102450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:04.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.567+0000 7efd41a1f640 1 --2- 172.21.15.59:0/3876894714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd3c104550 0x7efd3c101f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:04.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.567+0000 7efd42220640 1 -- 172.21.15.59:0/3876894714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd3c104550 msgr2=0x7efd3c101f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:04.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.567+0000 7efd42220640 1 --2- 172.21.15.59:0/3876894714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd3c104550 0x7efd3c101f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.567+0000 7efd42220640 1 -- 172.21.15.59:0/3876894714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd3c10d100 msgr2=0x7efd3c102450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:04.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.567+0000 7efd42220640 1 --2- 172.21.15.59:0/3876894714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd3c10d100 0x7efd3c102450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.567+0000 7efd42220640 1 -- 172.21.15.59:0/3876894714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd3c1a7610 con 0x7efd3c103b50 2024-09-10T21:24:04.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.567+0000 7efd42220640 1 --2- 172.21.15.59:0/3876894714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd3c103b50 0x7efd3c1019d0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7efd3800d950 tx=0x7efd3800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:04.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.568+0000 7efd337fe640 1 -- 172.21.15.59:0/3876894714 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd38017070 con 0x7efd3c103b50 2024-09-10T21:24:04.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.568+0000 7efd44484640 1 -- 172.21.15.59:0/3876894714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd3c1a7900 con 0x7efd3c103b50 2024-09-10T21:24:04.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.568+0000 7efd337fe640 1 -- 172.21.15.59:0/3876894714 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd38009c30 con 0x7efd3c103b50 2024-09-10T21:24:04.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.568+0000 7efd337fe640 1 -- 172.21.15.59:0/3876894714 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3800f620 con 0x7efd3c103b50 2024-09-10T21:24:04.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.568+0000 7efd44484640 1 -- 172.21.15.59:0/3876894714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd3c1a7e40 con 0x7efd3c103b50 2024-09-10T21:24:04.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.570+0000 7efd337fe640 1 -- 172.21.15.59:0/3876894714 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7efd38010460 con 0x7efd3c103b50 2024-09-10T21:24:04.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.570+0000 7efd46859740 1 Processor -- start 2024-09-10T21:24:04.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.570+0000 7efd46859740 1 -- start start 2024-09-10T21:24:04.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.571+0000 7efd46859740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b498b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:04.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.571+0000 7efd46859740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b49df0 0x55a901b55840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:04.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.571+0000 7efd46859740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b55d80 0x55a901b58170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:04.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.571+0000 7efd46859740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a901abfea0 con 0x55a901b494d0 2024-09-10T21:24:04.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.571+0000 7efd46859740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a901aaf2d0 con 0x55a901b55d80 2024-09-10T21:24:04.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.571+0000 7efd46859740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a901ab30e0 con 0x55a901b49df0 2024-09-10T21:24:04.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.571+0000 7efd42a21640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:04.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.571+0000 7efd42a21640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b498b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51984/0 (socket says 172.21.15.59:51984) 2024-09-10T21:24:04.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.571+0000 7efd42a21640 1 -- 172.21.15.59:0/2953263367 learned_addr learned my addr 172.21.15.59:0/2953263367 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:04.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.571+0000 7efd42220640 1 --2- 172.21.15.59:0/2953263367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b49df0 0x55a901b55840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:04.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.571+0000 7efd41a1f640 1 --2- 172.21.15.59:0/2953263367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b55d80 0x55a901b58170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:04.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.571+0000 7efd42a21640 1 -- 172.21.15.59:0/2953263367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b49df0 msgr2=0x55a901b55840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:04.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.571+0000 7efd42a21640 1 --2- 172.21.15.59:0/2953263367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b49df0 0x55a901b55840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.571+0000 7efd337fe640 1 --2- 172.21.15.59:0/3876894714 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efd280b52e0 0x7efd280b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:04.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.571+0000 7efd42a21640 1 -- 172.21.15.59:0/2953263367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b55d80 msgr2=0x55a901b58170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:04.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.571+0000 7efd42a21640 1 --2- 172.21.15.59:0/2953263367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b55d80 0x55a901b58170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.571+0000 7efd42a21640 1 -- 172.21.15.59:0/2953263367 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a90180d650 con 0x55a901b494d0 2024-09-10T21:24:04.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.571+0000 7efd337fe640 1 -- 172.21.15.59:0/3876894714 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7efd380e58f0 con 0x7efd3c103b50 2024-09-10T21:24:04.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.572+0000 7efd42a21640 1 --2- 172.21.15.59:0/3876894714 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efd280b52e0 0x7efd280b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:04.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.572+0000 7efd42a21640 1 --2- 172.21.15.59:0/2953263367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b498b0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7efd34005cc0 tx=0x7efd340093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0b12926fb6b211 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:04.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.572+0000 7efd30ff9640 1 -- 172.21.15.59:0/2953263367 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3404d070 con 0x55a901b494d0 2024-09-10T21:24:04.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.572+0000 7efd30ff9640 1 -- 172.21.15.59:0/2953263367 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd34036040 con 0x55a901b494d0 2024-09-10T21:24:04.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.572+0000 7efd30ff9640 1 -- 172.21.15.59:0/2953263367 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd340047d0 con 0x55a901b494d0 2024-09-10T21:24:04.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.573+0000 7efd46859740 1 -- 172.21.15.59:0/2953263367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 msgr2=0x55a901b498b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:04.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.573+0000 7efd46859740 1 --2- 172.21.15.59:0/2953263367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b498b0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7efd34005cc0 tx=0x7efd340093e0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.573+0000 7efd42a21640 1 --2- 172.21.15.59:0/3876894714 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efd280b52e0 0x7efd280b77a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efd34009a60 tx=0x7efd3404b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:04.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.573+0000 7efd46859740 1 -- 172.21.15.59:0/2953263367 shutdown_connections 2024-09-10T21:24:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.573+0000 7efd46859740 1 --2- 172.21.15.59:0/2953263367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b55d80 0x55a901b58170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.573+0000 7efd46859740 1 --2- 172.21.15.59:0/2953263367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b49df0 0x55a901b55840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.573+0000 7efd46859740 1 --2- 172.21.15.59:0/2953263367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b498b0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.573+0000 7efd46859740 1 -- 172.21.15.59:0/2953263367 >> 172.21.15.59:0/2953263367 conn(0x55a901b47300 msgr2=0x55a901b484a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.573+0000 7efd46859740 1 -- 172.21.15.59:0/2953263367 shutdown_connections 2024-09-10T21:24:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.573+0000 7efd46859740 1 -- 172.21.15.59:0/2953263367 wait complete. 2024-09-10T21:24:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.573+0000 7efd46859740 1 -- start start 2024-09-10T21:24:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.573+0000 7efd46859740 1 Processor -- start 2024-09-10T21:24:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd46859740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd46859740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b49df0 0x55a901b52a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd46859740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b55d80 0x55a901b52f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:04.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd46859740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a901910700 con 0x55a901b494d0 2024-09-10T21:24:04.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd46859740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a901a4a160 con 0x55a901b49df0 2024-09-10T21:24:04.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd46859740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a901b58a00 con 0x55a901b55d80 2024-09-10T21:24:04.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd46859740 10 client.0 _ll_register_callbacks cb 0x55a901a639e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:04.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd42220640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:04.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd42220640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52000/0 (socket says 172.21.15.59:52000) 2024-09-10T21:24:04.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd42220640 1 -- 172.21.15.59:0/2094111923 learned_addr learned my addr 172.21.15.59:0/2094111923 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:04.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd41a1f640 1 --2- 172.21.15.59:0/2094111923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b49df0 0x55a901b52a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:04.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd42a21640 1 --2- 172.21.15.59:0/2094111923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b55d80 0x55a901b52f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:04.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd42220640 1 -- 172.21.15.59:0/2094111923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b55d80 msgr2=0x55a901b52f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:04.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd42220640 1 --2- 172.21.15.59:0/2094111923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b55d80 0x55a901b52f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd42220640 1 -- 172.21.15.59:0/2094111923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b49df0 msgr2=0x55a901b52a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:04.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd42220640 1 --2- 172.21.15.59:0/2094111923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b49df0 0x55a901b52a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd42220640 1 -- 172.21.15.59:0/2094111923 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a901a77c90 con 0x55a901b494d0 2024-09-10T21:24:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd42a21640 1 --2- 172.21.15.59:0/2094111923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b55d80 0x55a901b52f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd41a1f640 1 --2- 172.21.15.59:0/2094111923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b49df0 0x55a901b52a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd42220640 1 --2- 172.21.15.59:0/2094111923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b555d0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7efd380abde0 tx=0x7efd380a85b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef0e4d796becaf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd25ffb640 1 -- 172.21.15.59:0/2094111923 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd38020070 con 0x55a901b494d0 2024-09-10T21:24:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd25ffb640 1 -- 172.21.15.59:0/2094111923 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7efd380ab540 con 0x55a901b494d0 2024-09-10T21:24:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.574+0000 7efd46859740 1 -- 172.21.15.59:0/2094111923 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd34036040 con 0x55a901b494d0 2024-09-10T21:24:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.575+0000 7efd25ffb640 1 -- 172.21.15.59:0/2094111923 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd380aba30 con 0x55a901b494d0 2024-09-10T21:24:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.575+0000 7efd46859740 10 client.17514 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.575+0000 7efd46859740 1 -- 172.21.15.59:0/2094111923 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a901b642f0 con 0x55a901b494d0 2024-09-10T21:24:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.575+0000 7efd25ffb640 1 -- 172.21.15.59:0/2094111923 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd34036040 con 0x55a901b494d0 2024-09-10T21:24:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.575+0000 7efd25ffb640 1 -- 172.21.15.59:0/2094111923 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efd380a7a30 con 0x55a901b494d0 2024-09-10T21:24:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.575+0000 7efd46859740 10 client.17514 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:04.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.575+0000 7efd46859740 10 client.17514 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:24:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.575+0000 7efd46859740 20 client.17514 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.575+0000 7efd46859740 1 --2- 172.21.15.59:0/2094111923 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a901b65800 0x55a901b67c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.575+0000 7efd46859740 4 client.17514 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:24:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.575+0000 7efd46859740 1 -- 172.21.15.59:0/2094111923 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a901ac1df0 con 0x55a901b65800 2024-09-10T21:24:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.575+0000 7efd41a1f640 1 --2- 172.21.15.59:0/2094111923 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a901b65800 0x55a901b67c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.576+0000 7efd41a1f640 1 --2- 172.21.15.59:0/2094111923 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a901b65800 0x55a901b67c30 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b8ae568098ebec server_cookie=ad6fd1275a5c6b03 in_seq=0 out_seq=0 2024-09-10T21:24:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.576+0000 7efd25ffb640 10 client.17514 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.576+0000 7efd25ffb640 1 -- 172.21.15.59:0/2094111923 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a901ac1df0 con 0x55a901b65800 2024-09-10T21:24:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.576+0000 7efd25ffb640 10 client.17514 handle_command_reply: tid=0 2024-09-10T21:24:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.577+0000 7efd46859740 1 client.17514 shutdown 2024-09-10T21:24:04.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.577+0000 7efd46859740 1 -- 172.21.15.59:0/2094111923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 msgr2=0x55a901b555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.577+0000 7efd46859740 1 --2- 172.21.15.59:0/2094111923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b555d0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7efd380abde0 tx=0x7efd380a85b0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.577+0000 7efd46859740 1 -- 172.21.15.59:0/2094111923 shutdown_connections 2024-09-10T21:24:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.577+0000 7efd46859740 1 --2- 172.21.15.59:0/2094111923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b55d80 0x55a901b52f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.577+0000 7efd46859740 1 --2- 172.21.15.59:0/2094111923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b49df0 0x55a901b52a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.577+0000 7efd46859740 1 --2- 172.21.15.59:0/2094111923 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a901b65800 0x55a901b67c30 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.577+0000 7efd46859740 1 --2- 172.21.15.59:0/2094111923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b555d0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.577+0000 7efd46859740 1 -- 172.21.15.59:0/2094111923 >> 172.21.15.59:0/2094111923 conn(0x55a901b47300 msgr2=0x55a901b4ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.577+0000 7efd25ffb640 0 client.17514 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.577+0000 7efd46859740 1 -- 172.21.15.59:0/2094111923 shutdown_connections 2024-09-10T21:24:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.577+0000 7efd46859740 1 -- 172.21.15.59:0/2094111923 wait complete. 2024-09-10T21:24:04.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.577+0000 7efd46859740 20 client.17514 trim_cache size 0 max 16384 2024-09-10T21:24:04.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.590+0000 7efd46859740 1 Processor -- start 2024-09-10T21:24:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.590+0000 7efd46859740 1 -- start start 2024-09-10T21:24:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.590+0000 7efd46859740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b4dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.590+0000 7efd46859740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b49df0 0x55a901b4e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.590+0000 7efd46859740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b55d80 0x55a901b4fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.590+0000 7efd46859740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c1b0480 con 0x55a901b494d0 2024-09-10T21:24:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.590+0000 7efd46859740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c1b1fc0 con 0x55a901b49df0 2024-09-10T21:24:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.590+0000 7efd46859740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c1b0b50 con 0x55a901b55d80 2024-09-10T21:24:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.590+0000 7efd42220640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b4dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.590+0000 7efd42220640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b4dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52002/0 (socket says 172.21.15.59:52002) 2024-09-10T21:24:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.590+0000 7efd42220640 1 -- 172.21.15.59:0/2054703305 learned_addr learned my addr 172.21.15.59:0/2054703305 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.591+0000 7efd41a1f640 1 --2- 172.21.15.59:0/2054703305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b49df0 0x55a901b4e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.591+0000 7efd42a21640 1 --2- 172.21.15.59:0/2054703305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b55d80 0x55a901b4fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.591+0000 7efd42220640 1 -- 172.21.15.59:0/2054703305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b55d80 msgr2=0x55a901b4fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.591+0000 7efd42220640 1 --2- 172.21.15.59:0/2054703305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b55d80 0x55a901b4fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.591+0000 7efd42220640 1 -- 172.21.15.59:0/2054703305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b49df0 msgr2=0x55a901b4e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.591+0000 7efd42220640 1 --2- 172.21.15.59:0/2054703305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b49df0 0x55a901b4e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.591+0000 7efd42220640 1 -- 172.21.15.59:0/2054703305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a901b49c20 con 0x55a901b494d0 2024-09-10T21:24:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.591+0000 7efd41a1f640 1 --2- 172.21.15.59:0/2054703305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b49df0 0x55a901b4e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.591+0000 7efd42a21640 1 --2- 172.21.15.59:0/2054703305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b55d80 0x55a901b4fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.591+0000 7efd42220640 1 --2- 172.21.15.59:0/2054703305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b4dc50 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7efd380cf2e0 tx=0x7efd38010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ff642a4c177ba9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.591+0000 7efd27fff640 1 -- 172.21.15.59:0/2054703305 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd38020070 con 0x55a901b494d0 2024-09-10T21:24:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.591+0000 7efd27fff640 1 -- 172.21.15.59:0/2054703305 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd380abbf0 con 0x55a901b494d0 2024-09-10T21:24:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.591+0000 7efd27fff640 1 -- 172.21.15.59:0/2054703305 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd380ab850 con 0x55a901b494d0 2024-09-10T21:24:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.592+0000 7efd46859740 1 -- 172.21.15.59:0/2054703305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 msgr2=0x55a901b4dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.592+0000 7efd46859740 1 --2- 172.21.15.59:0/2054703305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b4dc50 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7efd380cf2e0 tx=0x7efd38010cb0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.592+0000 7efd46859740 1 -- 172.21.15.59:0/2054703305 shutdown_connections 2024-09-10T21:24:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.592+0000 7efd46859740 1 --2- 172.21.15.59:0/2054703305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b55d80 0x55a901b4fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.592+0000 7efd46859740 1 --2- 172.21.15.59:0/2054703305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b49df0 0x55a901b4e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.592+0000 7efd46859740 1 --2- 172.21.15.59:0/2054703305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b4dc50 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.592+0000 7efd46859740 1 -- 172.21.15.59:0/2054703305 >> 172.21.15.59:0/2054703305 conn(0x55a901b47300 msgr2=0x55a901b67810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.592+0000 7efd46859740 1 -- 172.21.15.59:0/2054703305 shutdown_connections 2024-09-10T21:24:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.592+0000 7efd46859740 1 -- 172.21.15.59:0/2054703305 wait complete. 2024-09-10T21:24:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.592+0000 7efd46859740 1 -- start start 2024-09-10T21:24:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.592+0000 7efd46859740 1 Processor -- start 2024-09-10T21:24:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd46859740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b5e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd46859740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b49df0 0x55a901b59b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd46859740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b55d80 0x55a901b5a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd46859740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c1b18f0 con 0x55a901b494d0 2024-09-10T21:24:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd46859740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c1b1220 con 0x55a901b49df0 2024-09-10T21:24:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd46859740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efd3c1ae460 con 0x55a901b55d80 2024-09-10T21:24:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd42220640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b5e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd46859740 10 client.0 _ll_register_callbacks cb 0x7efd3800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd42220640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b5e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52004/0 (socket says 172.21.15.59:52004) 2024-09-10T21:24:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd42220640 1 -- 172.21.15.59:0/978489752 learned_addr learned my addr 172.21.15.59:0/978489752 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd41a1f640 1 --2- 172.21.15.59:0/978489752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b49df0 0x55a901b59b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd42a21640 1 --2- 172.21.15.59:0/978489752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b55d80 0x55a901b5a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd42220640 1 -- 172.21.15.59:0/978489752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b55d80 msgr2=0x55a901b5a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd42220640 1 --2- 172.21.15.59:0/978489752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b55d80 0x55a901b5a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd42220640 1 -- 172.21.15.59:0/978489752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b49df0 msgr2=0x55a901b59b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd42220640 1 --2- 172.21.15.59:0/978489752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b49df0 0x55a901b59b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd42220640 1 -- 172.21.15.59:0/978489752 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a901bd1700 con 0x55a901b494d0 2024-09-10T21:24:04.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd42220640 1 --2- 172.21.15.59:0/978489752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b5e610 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7efd380ac070 tx=0x7efd380a8620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c67a4613f37ae5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:04.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:04.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd25ffb640 1 -- 172.21.15.59:0/978489752 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd38020030 con 0x55a901b494d0 2024-09-10T21:24:04.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd25ffb640 1 -- 172.21.15.59:0/978489752 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7efd380cdac0 con 0x55a901b494d0 2024-09-10T21:24:04.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.593+0000 7efd46859740 1 -- 172.21.15.59:0/978489752 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd380abbf0 con 0x55a901b494d0 2024-09-10T21:24:04.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.594+0000 7efd25ffb640 1 -- 172.21.15.59:0/978489752 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd380ab850 con 0x55a901b494d0 2024-09-10T21:24:04.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.594+0000 7efd46859740 10 client.17520 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:04.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.594+0000 7efd46859740 1 -- 172.21.15.59:0/978489752 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a901bd2840 con 0x55a901b494d0 2024-09-10T21:24:04.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.594+0000 7efd25ffb640 1 -- 172.21.15.59:0/978489752 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd380abbf0 con 0x55a901b494d0 2024-09-10T21:24:04.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.594+0000 7efd25ffb640 1 -- 172.21.15.59:0/978489752 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7efd380b1d50 con 0x55a901b494d0 2024-09-10T21:24:04.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.594+0000 7efd46859740 10 client.17520 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:04.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.594+0000 7efd46859740 10 client.17520 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:24:04.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.594+0000 7efd46859740 20 client.17520 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:04.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.594+0000 7efd46859740 1 --2- 172.21.15.59:0/978489752 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a901bd2cf0 0x55a901bd5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:04.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.594+0000 7efd46859740 4 client.17520 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:24:04.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.594+0000 7efd46859740 1 -- 172.21.15.59:0/978489752 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a901abd8a0 con 0x55a901bd2cf0 2024-09-10T21:24:04.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.594+0000 7efd41a1f640 1 --2- 172.21.15.59:0/978489752 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a901bd2cf0 0x55a901bd5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:04.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.595+0000 7efd25ffb640 10 client.17520 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:04.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.595+0000 7efd41a1f640 1 --2- 172.21.15.59:0/978489752 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a901bd2cf0 0x55a901bd5110 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b728c7aecffb0ea7 server_cookie=3d76c4d08b0c99c3 in_seq=0 out_seq=0 2024-09-10T21:24:04.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.595+0000 7efd25ffb640 1 -- 172.21.15.59:0/978489752 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a901abd8a0 con 0x55a901bd2cf0 2024-09-10T21:24:04.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.595+0000 7efd25ffb640 10 client.17520 handle_command_reply: tid=0 2024-09-10T21:24:04.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.595+0000 7efd46859740 1 client.17520 shutdown 2024-09-10T21:24:04.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.595+0000 7efd46859740 1 -- 172.21.15.59:0/978489752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 msgr2=0x55a901b5e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.595+0000 7efd46859740 1 --2- 172.21.15.59:0/978489752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b5e610 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7efd380ac070 tx=0x7efd380a8620 comp rx=0 tx=0).stop 2024-09-10T21:24:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.595+0000 7efd46859740 1 -- 172.21.15.59:0/978489752 shutdown_connections 2024-09-10T21:24:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.595+0000 7efd46859740 1 --2- 172.21.15.59:0/978489752 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a901b55d80 0x55a901b5a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.595+0000 7efd46859740 1 --2- 172.21.15.59:0/978489752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a901b49df0 0x55a901b59b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.595+0000 7efd46859740 1 --2- 172.21.15.59:0/978489752 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a901bd2cf0 0x55a901bd5110 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.595+0000 7efd25ffb640 0 client.17520 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.595+0000 7efd46859740 1 --2- 172.21.15.59:0/978489752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a901b494d0 0x55a901b5e610 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.595+0000 7efd46859740 1 -- 172.21.15.59:0/978489752 >> 172.21.15.59:0/978489752 conn(0x55a901b47300 msgr2=0x55a901b4dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.595+0000 7efd46859740 1 -- 172.21.15.59:0/978489752 shutdown_connections 2024-09-10T21:24:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.595+0000 7efd46859740 1 -- 172.21.15.59:0/978489752 wait complete. 2024-09-10T21:24:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.595+0000 7efd46859740 20 client.17520 trim_cache size 0 max 16384 2024-09-10T21:24:04.604 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:24:04.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.596+0000 7efd44484640 1 -- 172.21.15.59:0/3876894714 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efd280b52e0 msgr2=0x7efd280b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.596+0000 7efd44484640 1 --2- 172.21.15.59:0/3876894714 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efd280b52e0 0x7efd280b77a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efd34009a60 tx=0x7efd3404b000 comp rx=0 tx=0).stop 2024-09-10T21:24:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.596+0000 7efd44484640 1 -- 172.21.15.59:0/3876894714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd3c103b50 msgr2=0x7efd3c1019d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.596+0000 7efd44484640 1 --2- 172.21.15.59:0/3876894714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd3c103b50 0x7efd3c1019d0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7efd3800d950 tx=0x7efd3800de10 comp rx=0 tx=0).stop 2024-09-10T21:24:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.596+0000 7efd44484640 1 -- 172.21.15.59:0/3876894714 shutdown_connections 2024-09-10T21:24:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.596+0000 7efd44484640 1 --2- 172.21.15.59:0/3876894714 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7efd280b52e0 0x7efd280b77a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.596+0000 7efd44484640 1 --2- 172.21.15.59:0/3876894714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd3c10d100 0x7efd3c102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.596+0000 7efd44484640 1 --2- 172.21.15.59:0/3876894714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd3c104550 0x7efd3c101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.596+0000 7efd44484640 1 --2- 172.21.15.59:0/3876894714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd3c103b50 0x7efd3c1019d0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.596+0000 7efd44484640 1 -- 172.21.15.59:0/3876894714 >> 172.21.15.59:0/3876894714 conn(0x7efd3c0fd700 msgr2=0x7efd3c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.596+0000 7efd44484640 1 -- 172.21.15.59:0/3876894714 shutdown_connections 2024-09-10T21:24:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:04.596+0000 7efd44484640 1 -- 172.21.15.59:0/3876894714 wait complete. 2024-09-10T21:24:05.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:05 smithi059 ceph-mon[30888]: pgmap v604: 97 pgs: 97 active+clean; 6.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:24:05.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:05 smithi154 ceph-mon[35041]: pgmap v604: 97 pgs: 97 active+clean; 6.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:24:05.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:05 smithi192 ceph-mon[35363]: pgmap v604: 97 pgs: 97 active+clean; 6.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:24:06.566 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:24:06.566 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:24:06.840 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:24:07.260 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:07 smithi059 ceph-mon[30888]: pgmap v605: 97 pgs: 97 active+clean; 6.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:24:07.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.344+0000 7f4473d91640 1 -- 172.21.15.59:0/1609402140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f446c106e40 msgr2=0x7f446c107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:07.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.344+0000 7f4473d91640 1 --2- 172.21.15.59:0/1609402140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f446c106e40 0x7f446c107280 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f445c00aa10 tx=0x7f445c02b720 comp rx=0 tx=0).stop 2024-09-10T21:24:07.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.344+0000 7f4473d91640 1 -- 172.21.15.59:0/1609402140 shutdown_connections 2024-09-10T21:24:07.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.344+0000 7f4473d91640 1 --2- 172.21.15.59:0/1609402140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f446c1077c0 0x7f446c10dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.344+0000 7f4473d91640 1 --2- 172.21.15.59:0/1609402140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f446c106e40 0x7f446c107280 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.344+0000 7f4473d91640 1 --2- 172.21.15.59:0/1609402140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f446c101810 0x7f446c101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.344+0000 7f4473d91640 1 -- 172.21.15.59:0/1609402140 >> 172.21.15.59:0/1609402140 conn(0x7f446c076f50 msgr2=0x7f446c077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.344+0000 7f4473d91640 1 -- 172.21.15.59:0/1609402140 shutdown_connections 2024-09-10T21:24:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.344+0000 7f4473d91640 1 -- 172.21.15.59:0/1609402140 wait complete. 2024-09-10T21:24:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.344+0000 7f4473d91640 1 Processor -- start 2024-09-10T21:24:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.344+0000 7f4473d91640 1 -- start start 2024-09-10T21:24:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f4473d91640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f446c101810 0x7f446c196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f4473d91640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f446c106e40 0x7f446c197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f4473d91640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f446c1077c0 0x7f446c197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f4473d91640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f446c110c50 con 0x7f446c106e40 2024-09-10T21:24:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f4473d91640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f446c110ad0 con 0x7f446c1077c0 2024-09-10T21:24:07.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f4473d91640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f446c110dd0 con 0x7f446c101810 2024-09-10T21:24:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f447132c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f446c106e40 0x7f446c197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f447132c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f446c106e40 0x7f446c197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52014/0 (socket says 172.21.15.59:52014) 2024-09-10T21:24:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f447132c640 1 -- 172.21.15.59:0/4252066490 learned_addr learned my addr 172.21.15.59:0/4252066490 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f4471b2d640 1 --2- 172.21.15.59:0/4252066490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f446c101810 0x7f446c196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f447232e640 1 --2- 172.21.15.59:0/4252066490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f446c1077c0 0x7f446c197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f447132c640 1 -- 172.21.15.59:0/4252066490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f446c101810 msgr2=0x7f446c196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f447132c640 1 --2- 172.21.15.59:0/4252066490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f446c101810 0x7f446c196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f447132c640 1 -- 172.21.15.59:0/4252066490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f446c1077c0 msgr2=0x7f446c197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f447132c640 1 --2- 172.21.15.59:0/4252066490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f446c1077c0 0x7f446c197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f447132c640 1 -- 172.21.15.59:0/4252066490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446c1a77d0 con 0x7f446c106e40 2024-09-10T21:24:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f447232e640 1 --2- 172.21.15.59:0/4252066490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f446c1077c0 0x7f446c197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f447132c640 1 --2- 172.21.15.59:0/4252066490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f446c106e40 0x7f446c197510 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f445c005ab0 tx=0x7f445c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:07.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f4462ffd640 1 -- 172.21.15.59:0/4252066490 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c03f070 con 0x7f446c106e40 2024-09-10T21:24:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f4462ffd640 1 -- 172.21.15.59:0/4252066490 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f445c030e70 con 0x7f446c106e40 2024-09-10T21:24:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f4473d91640 1 -- 172.21.15.59:0/4252066490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f446c1a7a60 con 0x7f446c106e40 2024-09-10T21:24:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.345+0000 7f4462ffd640 1 -- 172.21.15.59:0/4252066490 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c036040 con 0x7f446c106e40 2024-09-10T21:24:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.346+0000 7f4473d91640 1 -- 172.21.15.59:0/4252066490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f446c1a7f90 con 0x7f446c106e40 2024-09-10T21:24:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.349+0000 7f4476166740 1 Processor -- start 2024-09-10T21:24:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.349+0000 7f4476166740 1 -- start start 2024-09-10T21:24:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.349+0000 7f4462ffd640 1 -- 172.21.15.59:0/4252066490 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f445c00b040 con 0x7f446c106e40 2024-09-10T21:24:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.349+0000 7f4476166740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6eee0 0x55e190d6f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.349+0000 7f4476166740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d6f800 0x55e190d7b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.349+0000 7f4476166740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d7b790 0x55e190d7db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.349+0000 7f4476166740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e190ce5e60 con 0x55e190d7b790 2024-09-10T21:24:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.349+0000 7f4476166740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e190cd5290 con 0x55e190d6f800 2024-09-10T21:24:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.349+0000 7f4476166740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55e190cd90a0 con 0x55e190d6eee0 2024-09-10T21:24:07.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.349+0000 7f447132c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d7b790 0x55e190d7db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.349+0000 7f447132c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d7b790 0x55e190d7db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52016/0 (socket says 172.21.15.59:52016) 2024-09-10T21:24:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.349+0000 7f447132c640 1 -- 172.21.15.59:0/4096557188 learned_addr learned my addr 172.21.15.59:0/4096557188 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.349+0000 7f447232e640 1 --2- 172.21.15.59:0/4096557188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6eee0 0x55e190d6f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.349+0000 7f4471b2d640 1 --2- 172.21.15.59:0/4096557188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d6f800 0x55e190d7b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.350+0000 7f447132c640 1 -- 172.21.15.59:0/4096557188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6eee0 msgr2=0x55e190d6f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.350+0000 7f447132c640 1 --2- 172.21.15.59:0/4096557188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6eee0 0x55e190d6f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.350+0000 7f447132c640 1 -- 172.21.15.59:0/4096557188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d6f800 msgr2=0x55e190d7b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.350+0000 7f447132c640 1 --2- 172.21.15.59:0/4096557188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d6f800 0x55e190d7b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.350+0000 7f447132c640 1 -- 172.21.15.59:0/4096557188 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e190a33930 con 0x55e190d7b790 2024-09-10T21:24:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.350+0000 7f447132c640 1 --2- 172.21.15.59:0/4096557188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d7b790 0x55e190d7db80 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f445c10e510 tx=0x7f445c10e600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80ed41aaad69f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.350+0000 7f4462ffd640 1 --2- 172.21.15.59:0/4252066490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f44580b5360 0x7f44580b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:07.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.350+0000 7f447232e640 1 --2- 172.21.15.59:0/4252066490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f44580b5360 0x7f44580b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.350+0000 7f4457fff640 1 -- 172.21.15.59:0/4096557188 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c0c9120 con 0x55e190d7b790 2024-09-10T21:24:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.350+0000 7f4457fff640 1 -- 172.21.15.59:0/4096557188 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f445c10ee30 con 0x55e190d7b790 2024-09-10T21:24:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.350+0000 7f4457fff640 1 -- 172.21.15.59:0/4096557188 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c0cc240 con 0x55e190d7b790 2024-09-10T21:24:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.350+0000 7f4462ffd640 1 -- 172.21.15.59:0/4252066490 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f445c1062e0 con 0x7f446c106e40 2024-09-10T21:24:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.351+0000 7f4476166740 1 -- 172.21.15.59:0/4096557188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d7b790 msgr2=0x55e190d7db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.351+0000 7f4476166740 1 --2- 172.21.15.59:0/4096557188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d7b790 0x55e190d7db80 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f445c10e510 tx=0x7f445c10e600 comp rx=0 tx=0).stop 2024-09-10T21:24:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.351+0000 7f447232e640 1 --2- 172.21.15.59:0/4252066490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f44580b5360 0x7f44580b7820 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f446c199090 tx=0x7f44640095b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.351+0000 7f4476166740 1 -- 172.21.15.59:0/4096557188 shutdown_connections 2024-09-10T21:24:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.351+0000 7f4476166740 1 --2- 172.21.15.59:0/4096557188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d7b790 0x55e190d7db80 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.351+0000 7f4476166740 1 --2- 172.21.15.59:0/4096557188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d6f800 0x55e190d7b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.351+0000 7f4476166740 1 --2- 172.21.15.59:0/4096557188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6eee0 0x55e190d6f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.351+0000 7f4476166740 1 -- 172.21.15.59:0/4096557188 >> 172.21.15.59:0/4096557188 conn(0x55e190d6cd10 msgr2=0x55e190d6deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.351+0000 7f4476166740 1 -- 172.21.15.59:0/4096557188 shutdown_connections 2024-09-10T21:24:07.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.351+0000 7f4476166740 1 -- 172.21.15.59:0/4096557188 wait complete. 2024-09-10T21:24:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.351+0000 7f4476166740 1 -- start start 2024-09-10T21:24:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.351+0000 7f4476166740 1 Processor -- start 2024-09-10T21:24:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.352+0000 7f4476166740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d6eee0 0x55e190d7b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.352+0000 7f4476166740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6f800 0x55e190d78690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.352+0000 7f4476166740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d7b790 0x55e190d78e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.352+0000 7f4476166740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e190b36890 con 0x55e190d7b790 2024-09-10T21:24:07.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.352+0000 7f4476166740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e190c6fd40 con 0x55e190d6eee0 2024-09-10T21:24:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.352+0000 7f4476166740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55e190d7e200 con 0x55e190d6f800 2024-09-10T21:24:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.352+0000 7f4476166740 10 client.0 _ll_register_callbacks cb 0x55e190cd3c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.352+0000 7f447232e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d7b790 0x55e190d78e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.352+0000 7f447232e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d7b790 0x55e190d78e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52018/0 (socket says 172.21.15.59:52018) 2024-09-10T21:24:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.352+0000 7f447232e640 1 -- 172.21.15.59:0/1850820462 learned_addr learned my addr 172.21.15.59:0/1850820462 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.352+0000 7f4471b2d640 1 --2- 172.21.15.59:0/1850820462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d6eee0 0x55e190d7b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.352+0000 7f447232e640 1 -- 172.21.15.59:0/1850820462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6f800 msgr2=0x55e190d78690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.352+0000 7f447132c640 1 --2- 172.21.15.59:0/1850820462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6f800 0x55e190d78690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.352+0000 7f447232e640 1 --2- 172.21.15.59:0/1850820462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6f800 0x55e190d78690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.352+0000 7f447232e640 1 -- 172.21.15.59:0/1850820462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d6eee0 msgr2=0x55e190d7b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.352+0000 7f447232e640 1 --2- 172.21.15.59:0/1850820462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d6eee0 0x55e190d7b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.352+0000 7f447232e640 1 -- 172.21.15.59:0/1850820462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e190d874f0 con 0x55e190d7b790 2024-09-10T21:24:07.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.352+0000 7f4471b2d640 1 --2- 172.21.15.59:0/1850820462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d6eee0 0x55e190d7b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:07.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.352+0000 7f447132c640 1 --2- 172.21.15.59:0/1850820462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6f800 0x55e190d78690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:07.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.353+0000 7f447232e640 1 --2- 172.21.15.59:0/1850820462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d7b790 0x55e190d78e20 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f4464012900 tx=0x7f4464004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c42119dba45725 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:07.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.353+0000 7f44557fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:07.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.353+0000 7f44557fa640 1 -- 172.21.15.59:0/1850820462 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446400fd60 con 0x55e190d7b790 2024-09-10T21:24:07.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.353+0000 7f44557fa640 1 -- 172.21.15.59:0/1850820462 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f446401f420 con 0x55e190d7b790 2024-09-10T21:24:07.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.353+0000 7f4476166740 1 -- 172.21.15.59:0/1850820462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f445c10ee30 con 0x55e190d7b790 2024-09-10T21:24:07.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.353+0000 7f44557fa640 1 -- 172.21.15.59:0/1850820462 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f44640096c0 con 0x55e190d7b790 2024-09-10T21:24:07.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.353+0000 7f4476166740 10 client.17532 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:07.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.353+0000 7f4476166740 1 -- 172.21.15.59:0/1850820462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e190d89ed0 con 0x55e190d7b790 2024-09-10T21:24:07.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.353+0000 7f44557fa640 1 -- 172.21.15.59:0/1850820462 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f445c10ee30 con 0x55e190d7b790 2024-09-10T21:24:07.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.353+0000 7f44557fa640 1 -- 172.21.15.59:0/1850820462 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4464027730 con 0x55e190d7b790 2024-09-10T21:24:07.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.353+0000 7f4476166740 10 client.17532 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:07.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.353+0000 7f4476166740 10 client.17532 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:24:07.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.353+0000 7f4476166740 20 client.17532 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:07.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.353+0000 7f4476166740 1 --2- 172.21.15.59:0/1850820462 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e190d8b3e0 0x55e190d8d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:07.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.354+0000 7f4476166740 4 client.17532 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:24:07.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.354+0000 7f4476166740 1 -- 172.21.15.59:0/1850820462 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e190ce7db0 con 0x55e190d8b3e0 2024-09-10T21:24:07.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.354+0000 7f4471b2d640 1 --2- 172.21.15.59:0/1850820462 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e190d8b3e0 0x55e190d8d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:07.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.354+0000 7f4471b2d640 1 --2- 172.21.15.59:0/1850820462 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e190d8b3e0 0x55e190d8d840 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7496f1b3f152b9de server_cookie=460c9a4cb29bd31 in_seq=0 out_seq=0 2024-09-10T21:24:07.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.354+0000 7f44557fa640 10 client.17532 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:07.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.355+0000 7f44557fa640 1 -- 172.21.15.59:0/1850820462 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e190ce7db0 con 0x55e190d8b3e0 2024-09-10T21:24:07.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.355+0000 7f44557fa640 10 client.17532 handle_command_reply: tid=0 2024-09-10T21:24:07.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.355+0000 7f4476166740 1 client.17532 shutdown 2024-09-10T21:24:07.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.355+0000 7f4476166740 1 -- 172.21.15.59:0/1850820462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d7b790 msgr2=0x55e190d78e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:07.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.355+0000 7f4476166740 1 --2- 172.21.15.59:0/1850820462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d7b790 0x55e190d78e20 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f4464012900 tx=0x7f4464004a40 comp rx=0 tx=0).stop 2024-09-10T21:24:07.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.355+0000 7f4476166740 1 -- 172.21.15.59:0/1850820462 shutdown_connections 2024-09-10T21:24:07.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.355+0000 7f4476166740 1 --2- 172.21.15.59:0/1850820462 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e190d8b3e0 0x55e190d8d840 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.355+0000 7f4476166740 1 --2- 172.21.15.59:0/1850820462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d7b790 0x55e190d78e20 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.355+0000 7f4476166740 1 --2- 172.21.15.59:0/1850820462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6f800 0x55e190d78690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.355+0000 7f4476166740 1 --2- 172.21.15.59:0/1850820462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d6eee0 0x55e190d7b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.355+0000 7f44557fa640 0 client.17532 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:07.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.355+0000 7f4476166740 1 -- 172.21.15.59:0/1850820462 >> 172.21.15.59:0/1850820462 conn(0x55e190d6cd10 msgr2=0x55e190d6bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:07.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.355+0000 7f4476166740 1 -- 172.21.15.59:0/1850820462 shutdown_connections 2024-09-10T21:24:07.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.355+0000 7f4476166740 1 -- 172.21.15.59:0/1850820462 wait complete. 2024-09-10T21:24:07.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.355+0000 7f4476166740 20 client.17532 trim_cache size 0 max 16384 2024-09-10T21:24:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.373+0000 7f4476166740 1 Processor -- start 2024-09-10T21:24:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.373+0000 7f4476166740 1 -- start start 2024-09-10T21:24:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.373+0000 7f4476166740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6eee0 0x55e190d758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.373+0000 7f4476166740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d6f800 0x55e190d75de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.373+0000 7f4476166740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d7b790 0x55e190d93150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.373+0000 7f4476166740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f446c1b05b0 con 0x55e190d6f800 2024-09-10T21:24:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.373+0000 7f4476166740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f446c1b20f0 con 0x55e190d7b790 2024-09-10T21:24:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.373+0000 7f4476166740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f446c1b0c80 con 0x55e190d6eee0 2024-09-10T21:24:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.374+0000 7f447132c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d6f800 0x55e190d75de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.374+0000 7f447132c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d6f800 0x55e190d75de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52034/0 (socket says 172.21.15.59:52034) 2024-09-10T21:24:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.374+0000 7f447132c640 1 -- 172.21.15.59:0/2154913104 learned_addr learned my addr 172.21.15.59:0/2154913104 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.374+0000 7f4471b2d640 1 --2- 172.21.15.59:0/2154913104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6eee0 0x55e190d758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.374+0000 7f447232e640 1 --2- 172.21.15.59:0/2154913104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d7b790 0x55e190d93150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.374+0000 7f447132c640 1 -- 172.21.15.59:0/2154913104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6eee0 msgr2=0x55e190d758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.374+0000 7f447132c640 1 --2- 172.21.15.59:0/2154913104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6eee0 0x55e190d758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.374+0000 7f447132c640 1 -- 172.21.15.59:0/2154913104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d7b790 msgr2=0x55e190d93150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.374+0000 7f447132c640 1 --2- 172.21.15.59:0/2154913104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d7b790 0x55e190d93150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.374+0000 7f447132c640 1 -- 172.21.15.59:0/2154913104 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e190d8dec0 con 0x55e190d6f800 2024-09-10T21:24:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.374+0000 7f4471b2d640 1 --2- 172.21.15.59:0/2154913104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6eee0 0x55e190d758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.374+0000 7f447132c640 1 --2- 172.21.15.59:0/2154913104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d6f800 0x55e190d75de0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f445c104180 tx=0x7f445c032f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297c8a4ab8c4c6e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.374+0000 7f44577fe640 1 -- 172.21.15.59:0/2154913104 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c0cc420 con 0x55e190d6f800 2024-09-10T21:24:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.374+0000 7f44577fe640 1 -- 172.21.15.59:0/2154913104 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f445c003e40 con 0x55e190d6f800 2024-09-10T21:24:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.374+0000 7f44577fe640 1 -- 172.21.15.59:0/2154913104 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c0cc610 con 0x55e190d6f800 2024-09-10T21:24:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.375+0000 7f4476166740 1 -- 172.21.15.59:0/2154913104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d6f800 msgr2=0x55e190d75de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.375+0000 7f4476166740 1 --2- 172.21.15.59:0/2154913104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d6f800 0x55e190d75de0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f445c104180 tx=0x7f445c032f10 comp rx=0 tx=0).stop 2024-09-10T21:24:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.375+0000 7f4476166740 1 -- 172.21.15.59:0/2154913104 shutdown_connections 2024-09-10T21:24:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.375+0000 7f4476166740 1 --2- 172.21.15.59:0/2154913104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d7b790 0x55e190d93150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.375+0000 7f4476166740 1 --2- 172.21.15.59:0/2154913104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d6f800 0x55e190d75de0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.375+0000 7f4476166740 1 --2- 172.21.15.59:0/2154913104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6eee0 0x55e190d758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.375+0000 7f4476166740 1 -- 172.21.15.59:0/2154913104 >> 172.21.15.59:0/2154913104 conn(0x55e190d6cd10 msgr2=0x55e190d76ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.375+0000 7f4476166740 1 -- 172.21.15.59:0/2154913104 shutdown_connections 2024-09-10T21:24:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.375+0000 7f4476166740 1 -- 172.21.15.59:0/2154913104 wait complete. 2024-09-10T21:24:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.375+0000 7f4476166740 1 -- start start 2024-09-10T21:24:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.375+0000 7f4476166740 1 Processor -- start 2024-09-10T21:24:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f4476166740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6eee0 0x55e190d83450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f4476166740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d6f800 0x55e190d83990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f4476166740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d7b790 0x55e190d74cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f4476166740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f446c1b1a20 con 0x55e190d6f800 2024-09-10T21:24:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f4476166740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f446c1b1350 con 0x55e190d7b790 2024-09-10T21:24:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f4476166740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f446c1ae590 con 0x55e190d6eee0 2024-09-10T21:24:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f4476166740 10 client.0 _ll_register_callbacks cb 0x7f4464011f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f447132c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d6f800 0x55e190d83990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f447132c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d6f800 0x55e190d83990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52038/0 (socket says 172.21.15.59:52038) 2024-09-10T21:24:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f447132c640 1 -- 172.21.15.59:0/2063692896 learned_addr learned my addr 172.21.15.59:0/2063692896 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f4471b2d640 1 --2- 172.21.15.59:0/2063692896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6eee0 0x55e190d83450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f447132c640 1 -- 172.21.15.59:0/2063692896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6eee0 msgr2=0x55e190d83450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f447132c640 1 --2- 172.21.15.59:0/2063692896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6eee0 0x55e190d83450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f447132c640 1 -- 172.21.15.59:0/2063692896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d7b790 msgr2=0x55e190d74cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f447132c640 1 --2- 172.21.15.59:0/2063692896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d7b790 0x55e190d74cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f447132c640 1 -- 172.21.15.59:0/2063692896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e190d84170 con 0x55e190d6f800 2024-09-10T21:24:07.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f4471b2d640 1 --2- 172.21.15.59:0/2063692896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6eee0 0x55e190d83450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:07.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f447132c640 1 --2- 172.21.15.59:0/2063692896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d6f800 0x55e190d83990 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f445c0cc7d0 tx=0x7f445c0329e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7921475d0b24fc60 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:07.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f44557fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:07.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.376+0000 7f44557fa640 1 -- 172.21.15.59:0/2063692896 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c049070 con 0x55e190d6f800 2024-09-10T21:24:07.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.377+0000 7f44557fa640 1 -- 172.21.15.59:0/2063692896 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f445c0c8040 con 0x55e190d6f800 2024-09-10T21:24:07.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.377+0000 7f4476166740 1 -- 172.21.15.59:0/2063692896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e190ce3860 con 0x55e190d6f800 2024-09-10T21:24:07.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.377+0000 7f44557fa640 1 -- 172.21.15.59:0/2063692896 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f445c0cc8a0 con 0x55e190d6f800 2024-09-10T21:24:07.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.377+0000 7f4476166740 10 client.17538 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:07.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.377+0000 7f4476166740 1 -- 172.21.15.59:0/2063692896 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e190df9990 con 0x55e190d6f800 2024-09-10T21:24:07.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.377+0000 7f44557fa640 1 -- 172.21.15.59:0/2063692896 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e190ce3860 con 0x55e190d6f800 2024-09-10T21:24:07.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.377+0000 7f44557fa640 1 -- 172.21.15.59:0/2063692896 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f445c0c8d40 con 0x55e190d6f800 2024-09-10T21:24:07.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.377+0000 7f4476166740 10 client.17538 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:07.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.377+0000 7f4476166740 10 client.17538 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:24:07.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.377+0000 7f4476166740 20 client.17538 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:07.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.377+0000 7f4476166740 1 --2- 172.21.15.59:0/2063692896 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e190df9d30 0x55e190dfc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:07.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.377+0000 7f4476166740 4 client.17538 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:24:07.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.377+0000 7f4476166740 1 -- 172.21.15.59:0/2063692896 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e190ce0c90 con 0x55e190df9d30 2024-09-10T21:24:07.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.377+0000 7f4471b2d640 1 --2- 172.21.15.59:0/2063692896 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e190df9d30 0x55e190dfc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:07.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.378+0000 7f4471b2d640 1 --2- 172.21.15.59:0/2063692896 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e190df9d30 0x55e190dfc120 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d77c2d7e55304f97 server_cookie=c5c7a85c56e119f4 in_seq=0 out_seq=0 2024-09-10T21:24:07.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.378+0000 7f44557fa640 10 client.17538 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:07.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.380+0000 7f44557fa640 1 -- 172.21.15.59:0/2063692896 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e190ce0c90 con 0x55e190df9d30 2024-09-10T21:24:07.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.380+0000 7f44557fa640 10 client.17538 handle_command_reply: tid=0 2024-09-10T21:24:07.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.380+0000 7f4476166740 1 client.17538 shutdown 2024-09-10T21:24:07.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.380+0000 7f4476166740 1 -- 172.21.15.59:0/2063692896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d6f800 msgr2=0x55e190d83990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:07.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.380+0000 7f4476166740 1 --2- 172.21.15.59:0/2063692896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d6f800 0x55e190d83990 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f445c0cc7d0 tx=0x7f445c0329e0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.380+0000 7f4476166740 1 -- 172.21.15.59:0/2063692896 shutdown_connections 2024-09-10T21:24:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.380+0000 7f4476166740 1 --2- 172.21.15.59:0/2063692896 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e190d7b790 0x55e190d74cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.380+0000 7f4476166740 1 --2- 172.21.15.59:0/2063692896 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e190df9d30 0x55e190dfc120 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.380+0000 7f4476166740 1 --2- 172.21.15.59:0/2063692896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e190d6f800 0x55e190d83990 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.380+0000 7f4476166740 1 --2- 172.21.15.59:0/2063692896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e190d6eee0 0x55e190d83450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.380+0000 7f44557fa640 0 client.17538 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.380+0000 7f4476166740 1 -- 172.21.15.59:0/2063692896 >> 172.21.15.59:0/2063692896 conn(0x55e190d6cd10 msgr2=0x55e190d6b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.380+0000 7f4476166740 1 -- 172.21.15.59:0/2063692896 shutdown_connections 2024-09-10T21:24:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.380+0000 7f4476166740 1 -- 172.21.15.59:0/2063692896 wait complete. 2024-09-10T21:24:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.380+0000 7f4476166740 20 client.17538 trim_cache size 0 max 16384 2024-09-10T21:24:07.390 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:24:07.390 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:24:07.391 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "ec2c29bb-febd-4190-959f-09af3764b7ad", 2024-09-10T21:24:07.391 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:24:07.391 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:24:07.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.381+0000 7f4473d91640 1 -- 172.21.15.59:0/4252066490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f44580b5360 msgr2=0x7f44580b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:07.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.381+0000 7f4473d91640 1 --2- 172.21.15.59:0/4252066490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f44580b5360 0x7f44580b7820 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f446c199090 tx=0x7f44640095b0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.381+0000 7f4473d91640 1 -- 172.21.15.59:0/4252066490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f446c106e40 msgr2=0x7f446c197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:07.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.381+0000 7f4473d91640 1 --2- 172.21.15.59:0/4252066490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f446c106e40 0x7f446c197510 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f445c005ab0 tx=0x7f445c003cd0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.381+0000 7f4473d91640 1 -- 172.21.15.59:0/4252066490 shutdown_connections 2024-09-10T21:24:07.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.381+0000 7f4473d91640 1 --2- 172.21.15.59:0/4252066490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f44580b5360 0x7f44580b7820 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.381+0000 7f4473d91640 1 --2- 172.21.15.59:0/4252066490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f446c1077c0 0x7f446c197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.381+0000 7f4473d91640 1 --2- 172.21.15.59:0/4252066490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f446c106e40 0x7f446c197510 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.381+0000 7f4473d91640 1 --2- 172.21.15.59:0/4252066490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f446c101810 0x7f446c196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:07.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.381+0000 7f4473d91640 1 -- 172.21.15.59:0/4252066490 >> 172.21.15.59:0/4252066490 conn(0x7f446c076f50 msgr2=0x7f446c104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:07.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.381+0000 7f4473d91640 1 -- 172.21.15.59:0/4252066490 shutdown_connections 2024-09-10T21:24:07.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:07.381+0000 7f4473d91640 1 -- 172.21.15.59:0/4252066490 wait complete. 2024-09-10T21:24:07.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:07 smithi154 ceph-mon[35041]: pgmap v605: 97 pgs: 97 active+clean; 6.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:24:07.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:07 smithi192 ceph-mon[35363]: pgmap v605: 97 pgs: 97 active+clean; 6.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:24:08.268 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:24:08.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:08 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:24:08.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:08 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:24:08.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:08 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:24:08.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:08 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:24:08.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:08 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:24:08.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:08 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:24:08.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:08 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:24:08.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:08 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:24:08.533 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:24:08.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:08 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:24:08.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:08 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:24:08.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:08 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:24:08.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:08 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:24:09.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.035+0000 7f6602957640 1 -- 172.21.15.59:0/1010381011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65fc1045c0 msgr2=0x7f65fc10cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:09.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.035+0000 7f6602957640 1 --2- 172.21.15.59:0/1010381011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65fc1045c0 0x7f65fc10cab0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009900 tx=0x7f65f002a410 comp rx=0 tx=0).stop 2024-09-10T21:24:09.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.035+0000 7f6602957640 1 -- 172.21.15.59:0/1010381011 shutdown_connections 2024-09-10T21:24:09.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.035+0000 7f6602957640 1 --2- 172.21.15.59:0/1010381011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65fc10d100 0x7f65fc10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.035+0000 7f6602957640 1 --2- 172.21.15.59:0/1010381011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65fc1045c0 0x7f65fc10cab0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.035+0000 7f6602957640 1 --2- 172.21.15.59:0/1010381011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65fc103ca0 0x7f65fc104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.035+0000 7f6602957640 1 -- 172.21.15.59:0/1010381011 >> 172.21.15.59:0/1010381011 conn(0x7f65fc0fd700 msgr2=0x7f65fc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:09.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.035+0000 7f6602957640 1 -- 172.21.15.59:0/1010381011 shutdown_connections 2024-09-10T21:24:09.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.035+0000 7f6602957640 1 -- 172.21.15.59:0/1010381011 wait complete. 2024-09-10T21:24:09.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.035+0000 7f6602957640 1 Processor -- start 2024-09-10T21:24:09.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.035+0000 7f6602957640 1 -- start start 2024-09-10T21:24:09.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.036+0000 7f6602957640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65fc103ca0 0x7f65fc101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:09.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.036+0000 7f6602957640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65fc1045c0 0x7f65fc101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:09.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.036+0000 7f6602957640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65fc10d100 0x7f65fc1023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.036+0000 7f6602957640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc112d70 con 0x7f65fc103ca0 2024-09-10T21:24:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.036+0000 7f6602957640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc112bf0 con 0x7f65fc10d100 2024-09-10T21:24:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.036+0000 7f6602957640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc112ef0 con 0x7f65fc1045c0 2024-09-10T21:24:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.036+0000 7f65fbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65fc103ca0 0x7f65fc101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.036+0000 7f65fbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65fc103ca0 0x7f65fc101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52060/0 (socket says 172.21.15.59:52060) 2024-09-10T21:24:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.036+0000 7f65fbfff640 1 -- 172.21.15.59:0/3341378287 learned_addr learned my addr 172.21.15.59:0/3341378287 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.036+0000 7f6600ef4640 1 --2- 172.21.15.59:0/3341378287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65fc10d100 0x7f65fc1023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.036+0000 7f65fb7fe640 1 --2- 172.21.15.59:0/3341378287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65fc1045c0 0x7f65fc101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.036+0000 7f65fbfff640 1 -- 172.21.15.59:0/3341378287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65fc1045c0 msgr2=0x7f65fc101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.036+0000 7f65fbfff640 1 --2- 172.21.15.59:0/3341378287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65fc1045c0 0x7f65fc101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.036+0000 7f65fbfff640 1 -- 172.21.15.59:0/3341378287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65fc10d100 msgr2=0x7f65fc1023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.036+0000 7f65fbfff640 1 --2- 172.21.15.59:0/3341378287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65fc10d100 0x7f65fc1023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.036+0000 7f65fbfff640 1 -- 172.21.15.59:0/3341378287 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65fc1a7700 con 0x7f65fc103ca0 2024-09-10T21:24:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.036+0000 7f65fb7fe640 1 --2- 172.21.15.59:0/3341378287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65fc1045c0 0x7f65fc101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.036+0000 7f6600ef4640 1 --2- 172.21.15.59:0/3341378287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65fc10d100 0x7f65fc1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.037+0000 7f65fbfff640 1 --2- 172.21.15.59:0/3341378287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65fc103ca0 0x7f65fc101950 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00c890 tx=0x7f65ec00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.037+0000 7f65f97fa640 1 -- 172.21.15.59:0/3341378287 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec004220 con 0x7f65fc103ca0 2024-09-10T21:24:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.037+0000 7f65f97fa640 1 -- 172.21.15.59:0/3341378287 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65ec0043c0 con 0x7f65fc103ca0 2024-09-10T21:24:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.037+0000 7f6602957640 1 -- 172.21.15.59:0/3341378287 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65fc1a79f0 con 0x7f65fc103ca0 2024-09-10T21:24:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.037+0000 7f65f97fa640 1 -- 172.21.15.59:0/3341378287 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec004a00 con 0x7f65fc103ca0 2024-09-10T21:24:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.037+0000 7f6602957640 1 -- 172.21.15.59:0/3341378287 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65fc1a7f50 con 0x7f65fc103ca0 2024-09-10T21:24:09.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.039+0000 7f6604d2c740 1 Processor -- start 2024-09-10T21:24:09.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.039+0000 7f65f97fa640 1 -- 172.21.15.59:0/3341378287 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f65ec0079b0 con 0x7f65fc103ca0 2024-09-10T21:24:09.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.039+0000 7f6604d2c740 1 -- start start 2024-09-10T21:24:09.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.040+0000 7f6604d2c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8da0a0 0x55da8f8da480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:09.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.040+0000 7f6604d2c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da8f8da9c0 0x55da8f8e6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:09.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.040+0000 7f6604d2c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8e6950 0x55da8f8e8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:09.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.040+0000 7f6604d2c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55da8f850e50 con 0x55da8f8e6950 2024-09-10T21:24:09.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.040+0000 7f6604d2c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55da8f840280 con 0x55da8f8da9c0 2024-09-10T21:24:09.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.040+0000 7f6604d2c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55da8f844090 con 0x55da8f8da0a0 2024-09-10T21:24:09.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.040+0000 7f65fb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8e6950 0x55da8f8e8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:09.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.040+0000 7f65fb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8e6950 0x55da8f8e8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52066/0 (socket says 172.21.15.59:52066) 2024-09-10T21:24:09.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.040+0000 7f65fb7fe640 1 -- 172.21.15.59:0/300681899 learned_addr learned my addr 172.21.15.59:0/300681899 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:09.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.040+0000 7f6600ef4640 1 --2- 172.21.15.59:0/300681899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8da0a0 0x55da8f8da480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:09.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.040+0000 7f65fbfff640 1 --2- 172.21.15.59:0/300681899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da8f8da9c0 0x55da8f8e6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:09.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.040+0000 7f65fb7fe640 1 -- 172.21.15.59:0/300681899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8da0a0 msgr2=0x55da8f8da480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:09.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.040+0000 7f65fb7fe640 1 --2- 172.21.15.59:0/300681899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8da0a0 0x55da8f8da480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.040+0000 7f65fb7fe640 1 -- 172.21.15.59:0/300681899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da8f8da9c0 msgr2=0x55da8f8e6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:09.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.040+0000 7f65fb7fe640 1 --2- 172.21.15.59:0/300681899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da8f8da9c0 0x55da8f8e6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.040+0000 7f65fb7fe640 1 -- 172.21.15.59:0/300681899 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da8f59e650 con 0x55da8f8e6950 2024-09-10T21:24:09.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.040+0000 7f65f97fa640 1 --2- 172.21.15.59:0/3341378287 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f65e40b5360 0x7f65e40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:09.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.041+0000 7f65fb7fe640 1 --2- 172.21.15.59:0/300681899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8e6950 0x55da8f8e8d40 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f65fc06b950 tx=0x7f65f0031db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6bf324b4a1ff91 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:09.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.041+0000 7f6600ef4640 1 --2- 172.21.15.59:0/3341378287 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f65e40b5360 0x7f65e40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:09.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.041+0000 7f65f97fa640 1 -- 172.21.15.59:0/3341378287 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f65ec0e59d0 con 0x7f65fc103ca0 2024-09-10T21:24:09.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.041+0000 7f65e27fc640 1 -- 172.21.15.59:0/300681899 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f003f070 con 0x55da8f8e6950 2024-09-10T21:24:09.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.041+0000 7f65e27fc640 1 -- 172.21.15.59:0/300681899 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65f00316a0 con 0x55da8f8e6950 2024-09-10T21:24:09.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.041+0000 7f65e27fc640 1 -- 172.21.15.59:0/300681899 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0035070 con 0x55da8f8e6950 2024-09-10T21:24:09.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.042+0000 7f6604d2c740 1 -- 172.21.15.59:0/300681899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8e6950 msgr2=0x55da8f8e8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:09.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.042+0000 7f6604d2c740 1 --2- 172.21.15.59:0/300681899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8e6950 0x55da8f8e8d40 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f65fc06b950 tx=0x7f65f0031db0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.042+0000 7f6600ef4640 1 --2- 172.21.15.59:0/3341378287 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f65e40b5360 0x7f65e40b7820 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f65fc103a10 tx=0x7f65f400a750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:09.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.042+0000 7f6604d2c740 1 -- 172.21.15.59:0/300681899 shutdown_connections 2024-09-10T21:24:09.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.042+0000 7f6604d2c740 1 --2- 172.21.15.59:0/300681899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8e6950 0x55da8f8e8d40 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.042+0000 7f6604d2c740 1 --2- 172.21.15.59:0/300681899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da8f8da9c0 0x55da8f8e6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.042+0000 7f6604d2c740 1 --2- 172.21.15.59:0/300681899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8da0a0 0x55da8f8da480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.042+0000 7f6604d2c740 1 -- 172.21.15.59:0/300681899 >> 172.21.15.59:0/300681899 conn(0x55da8f8d7ed0 msgr2=0x55da8f8d9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:09.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.042+0000 7f6604d2c740 1 -- 172.21.15.59:0/300681899 shutdown_connections 2024-09-10T21:24:09.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.042+0000 7f6604d2c740 1 -- 172.21.15.59:0/300681899 wait complete. 2024-09-10T21:24:09.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.042+0000 7f6604d2c740 1 -- start start 2024-09-10T21:24:09.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.042+0000 7f6604d2c740 1 Processor -- start 2024-09-10T21:24:09.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f6604d2c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8da0a0 0x55da8f8e6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:09.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f6604d2c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8da9c0 0x55da8f8e36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:09.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f6604d2c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da8f8e6950 0x55da8f8e3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:09.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f6604d2c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55da8f6a1700 con 0x55da8f8da0a0 2024-09-10T21:24:09.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f6604d2c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55da8f7db110 con 0x55da8f8e6950 2024-09-10T21:24:09.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f6604d2c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55da8f8e9570 con 0x55da8f8da9c0 2024-09-10T21:24:09.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f6604d2c740 10 client.0 _ll_register_callbacks cb 0x55da8f7f4990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:09.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f65fbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8da0a0 0x55da8f8e6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:09.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f65fb7fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8da9c0 0x55da8f8e36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:09.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f65fbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8da0a0 0x55da8f8e6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52078/0 (socket says 172.21.15.59:52078) 2024-09-10T21:24:09.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f65fb7fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8da9c0 0x55da8f8e36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:56392/0 (socket says 172.21.15.59:56392) 2024-09-10T21:24:09.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f65fbfff640 1 -- 172.21.15.59:0/453835373 learned_addr learned my addr 172.21.15.59:0/453835373 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:09.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f6600ef4640 1 --2- 172.21.15.59:0/453835373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da8f8e6950 0x55da8f8e3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:09.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f65fbfff640 1 -- 172.21.15.59:0/453835373 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8da9c0 msgr2=0x55da8f8e36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:09.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f65fbfff640 1 --2- 172.21.15.59:0/453835373 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8da9c0 0x55da8f8e36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f65fbfff640 1 -- 172.21.15.59:0/453835373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da8f8e6950 msgr2=0x55da8f8e3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:09.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f65fbfff640 1 --2- 172.21.15.59:0/453835373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da8f8e6950 0x55da8f8e3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f65fbfff640 1 -- 172.21.15.59:0/453835373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da8f808c40 con 0x55da8f8da0a0 2024-09-10T21:24:09.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f65fbfff640 1 --2- 172.21.15.59:0/453835373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8da0a0 0x55da8f8e6260 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0a93d0 tx=0x7f65ec0a80f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4825f37849f4eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:09.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f65db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:09.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f65db7fe640 1 -- 172.21.15.59:0/453835373 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec01d040 con 0x55da8f8da0a0 2024-09-10T21:24:09.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f65db7fe640 1 -- 172.21.15.59:0/453835373 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f65ec0cdb40 con 0x55da8f8da0a0 2024-09-10T21:24:09.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.043+0000 7f6604d2c740 1 -- 172.21.15.59:0/453835373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65f00316a0 con 0x55da8f8da0a0 2024-09-10T21:24:09.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.044+0000 7f65db7fe640 1 -- 172.21.15.59:0/453835373 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f65ec005290 con 0x55da8f8da0a0 2024-09-10T21:24:09.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.044+0000 7f6604d2c740 10 client.17550 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:09.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.044+0000 7f6604d2c740 1 -- 172.21.15.59:0/453835373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da8f8f4ed0 con 0x55da8f8da0a0 2024-09-10T21:24:09.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.044+0000 7f65db7fe640 1 -- 172.21.15.59:0/453835373 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65f00316a0 con 0x55da8f8da0a0 2024-09-10T21:24:09.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.044+0000 7f65db7fe640 1 -- 172.21.15.59:0/453835373 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f65ec0a7ab0 con 0x55da8f8da0a0 2024-09-10T21:24:09.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.044+0000 7f6604d2c740 10 client.17550 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:09.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.044+0000 7f6604d2c740 10 client.17550 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:24:09.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.044+0000 7f6604d2c740 20 client.17550 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:09.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.044+0000 7f6604d2c740 1 --2- 172.21.15.59:0/453835373 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55da8f8f62e0 0x55da8f8f86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:09.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.044+0000 7f6604d2c740 4 client.17550 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:24:09.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.044+0000 7f6604d2c740 1 -- 172.21.15.59:0/453835373 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da8f852da0 con 0x55da8f8f62e0 2024-09-10T21:24:09.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.045+0000 7f65fb7fe640 1 --2- 172.21.15.59:0/453835373 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55da8f8f62e0 0x55da8f8f86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:09.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.045+0000 7f65db7fe640 10 client.17550 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:09.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.045+0000 7f65fb7fe640 1 --2- 172.21.15.59:0/453835373 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55da8f8f62e0 0x55da8f8f86f0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8190e0c216e68e86 server_cookie=5e2773066744fa8e in_seq=0 out_seq=0 2024-09-10T21:24:09.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.046+0000 7f65db7fe640 1 -- 172.21.15.59:0/453835373 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da8f852da0 con 0x55da8f8f62e0 2024-09-10T21:24:09.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.046+0000 7f65db7fe640 10 client.17550 handle_command_reply: tid=0 2024-09-10T21:24:09.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.046+0000 7f6604d2c740 1 client.17550 shutdown 2024-09-10T21:24:09.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.046+0000 7f6604d2c740 1 -- 172.21.15.59:0/453835373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8da0a0 msgr2=0x55da8f8e6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:09.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.046+0000 7f6604d2c740 1 --2- 172.21.15.59:0/453835373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8da0a0 0x55da8f8e6260 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0a93d0 tx=0x7f65ec0a80f0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.046+0000 7f6604d2c740 1 -- 172.21.15.59:0/453835373 shutdown_connections 2024-09-10T21:24:09.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.046+0000 7f6604d2c740 1 --2- 172.21.15.59:0/453835373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da8f8e6950 0x55da8f8e3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.046+0000 7f6604d2c740 1 --2- 172.21.15.59:0/453835373 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8da9c0 0x55da8f8e36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.046+0000 7f6604d2c740 1 --2- 172.21.15.59:0/453835373 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55da8f8f62e0 0x55da8f8f86f0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.046+0000 7f6604d2c740 1 --2- 172.21.15.59:0/453835373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8da0a0 0x55da8f8e6260 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.046+0000 7f6604d2c740 1 -- 172.21.15.59:0/453835373 >> 172.21.15.59:0/453835373 conn(0x55da8f8d7ed0 msgr2=0x55da8f8dda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:09.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.046+0000 7f65db7fe640 0 client.17550 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:09.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.046+0000 7f6604d2c740 1 -- 172.21.15.59:0/453835373 shutdown_connections 2024-09-10T21:24:09.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.046+0000 7f6604d2c740 1 -- 172.21.15.59:0/453835373 wait complete. 2024-09-10T21:24:09.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.046+0000 7f6604d2c740 20 client.17550 trim_cache size 0 max 16384 2024-09-10T21:24:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.064+0000 7f6604d2c740 1 Processor -- start 2024-09-10T21:24:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.064+0000 7f6604d2c740 1 -- start start 2024-09-10T21:24:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.064+0000 7f6604d2c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8da0a0 0x55da8f8f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.064+0000 7f6604d2c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da8f8da9c0 0x55da8f8f82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.064+0000 7f6604d2c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8e6950 0x55da8f8dd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.064+0000 7f6604d2c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc1b0490 con 0x55da8f8da0a0 2024-09-10T21:24:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.064+0000 7f6604d2c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc1b1fd0 con 0x55da8f8da9c0 2024-09-10T21:24:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.064+0000 7f6604d2c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc1b0b60 con 0x55da8f8e6950 2024-09-10T21:24:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.064+0000 7f65fbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8da0a0 0x55da8f8f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.064+0000 7f65fbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8da0a0 0x55da8f8f27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52088/0 (socket says 172.21.15.59:52088) 2024-09-10T21:24:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.064+0000 7f65fbfff640 1 -- 172.21.15.59:0/1563276702 learned_addr learned my addr 172.21.15.59:0/1563276702 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.064+0000 7f6600ef4640 1 --2- 172.21.15.59:0/1563276702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8e6950 0x55da8f8dd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.064+0000 7f65fbfff640 1 -- 172.21.15.59:0/1563276702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8e6950 msgr2=0x55da8f8dd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.064+0000 7f65fbfff640 1 --2- 172.21.15.59:0/1563276702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8e6950 0x55da8f8dd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.064+0000 7f65fbfff640 1 -- 172.21.15.59:0/1563276702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da8f8da9c0 msgr2=0x55da8f8f82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.064+0000 7f65fbfff640 1 --2- 172.21.15.59:0/1563276702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da8f8da9c0 0x55da8f8f82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.064+0000 7f65fbfff640 1 -- 172.21.15.59:0/1563276702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da8f8da7f0 con 0x55da8f8da0a0 2024-09-10T21:24:09.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.064+0000 7f65fbfff640 1 --2- 172.21.15.59:0/1563276702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8da0a0 0x55da8f8f27a0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0ac0f0 tx=0x7f65ec0b56f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740fffe5bc94283 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:09.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.065+0000 7f65e1ffb640 1 -- 172.21.15.59:0/1563276702 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec01d030 con 0x55da8f8da0a0 2024-09-10T21:24:09.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.065+0000 7f65e1ffb640 1 -- 172.21.15.59:0/1563276702 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65ec0cde50 con 0x55da8f8da0a0 2024-09-10T21:24:09.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.065+0000 7f65e1ffb640 1 -- 172.21.15.59:0/1563276702 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec0ac160 con 0x55da8f8da0a0 2024-09-10T21:24:09.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.065+0000 7f6604d2c740 1 -- 172.21.15.59:0/1563276702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8da0a0 msgr2=0x55da8f8f27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.065+0000 7f6604d2c740 1 --2- 172.21.15.59:0/1563276702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8da0a0 0x55da8f8f27a0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0ac0f0 tx=0x7f65ec0b56f0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.065+0000 7f6604d2c740 1 -- 172.21.15.59:0/1563276702 shutdown_connections 2024-09-10T21:24:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.065+0000 7f6604d2c740 1 --2- 172.21.15.59:0/1563276702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8e6950 0x55da8f8dd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.065+0000 7f6604d2c740 1 --2- 172.21.15.59:0/1563276702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da8f8da9c0 0x55da8f8f82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.065+0000 7f6604d2c740 1 --2- 172.21.15.59:0/1563276702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8da0a0 0x55da8f8f27a0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.065+0000 7f6604d2c740 1 -- 172.21.15.59:0/1563276702 >> 172.21.15.59:0/1563276702 conn(0x55da8f8d7ed0 msgr2=0x55da8f8dd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.065+0000 7f6604d2c740 1 -- 172.21.15.59:0/1563276702 shutdown_connections 2024-09-10T21:24:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.065+0000 7f6604d2c740 1 -- 172.21.15.59:0/1563276702 wait complete. 2024-09-10T21:24:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.066+0000 7f6604d2c740 1 -- start start 2024-09-10T21:24:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.066+0000 7f6604d2c740 1 Processor -- start 2024-09-10T21:24:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.066+0000 7f6604d2c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8da0a0 0x55da8f8ef1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:09.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.066+0000 7f6604d2c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da8f8da9c0 0x55da8f8e97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:09.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.066+0000 7f6604d2c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8e6950 0x55da8f8e9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:09.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.066+0000 7f6604d2c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc1b1900 con 0x55da8f8e6950 2024-09-10T21:24:09.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.066+0000 7f6604d2c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc1b1230 con 0x55da8f8da9c0 2024-09-10T21:24:09.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.066+0000 7f6604d2c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc1ae470 con 0x55da8f8da0a0 2024-09-10T21:24:09.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.066+0000 7f6604d2c740 10 client.0 _ll_register_callbacks cb 0x7f65ec004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:09.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.066+0000 7f6600ef4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8e6950 0x55da8f8e9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:09.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.066+0000 7f6600ef4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8e6950 0x55da8f8e9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52104/0 (socket says 172.21.15.59:52104) 2024-09-10T21:24:09.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.066+0000 7f6600ef4640 1 -- 172.21.15.59:0/1204882245 learned_addr learned my addr 172.21.15.59:0/1204882245 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:09.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.066+0000 7f65fbfff640 1 --2- 172.21.15.59:0/1204882245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8da0a0 0x55da8f8ef1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:09.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.067+0000 7f65fb7fe640 1 --2- 172.21.15.59:0/1204882245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da8f8da9c0 0x55da8f8e97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:09.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.067+0000 7f6600ef4640 1 -- 172.21.15.59:0/1204882245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8da0a0 msgr2=0x55da8f8ef1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:09.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.067+0000 7f6600ef4640 1 --2- 172.21.15.59:0/1204882245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8da0a0 0x55da8f8ef1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.067+0000 7f6600ef4640 1 -- 172.21.15.59:0/1204882245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da8f8da9c0 msgr2=0x55da8f8e97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.067+0000 7f6600ef4640 1 --2- 172.21.15.59:0/1204882245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da8f8da9c0 0x55da8f8e97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.067+0000 7f6600ef4640 1 -- 172.21.15.59:0/1204882245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da8f9631c0 con 0x55da8f8e6950 2024-09-10T21:24:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.067+0000 7f6600ef4640 1 --2- 172.21.15.59:0/1204882245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8e6950 0x55da8f8e9f50 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f65f401def0 tx=0x7f65f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1310fe8e352cd5e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.067+0000 7f65db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.067+0000 7f65db7fe640 1 -- 172.21.15.59:0/1204882245 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f401b600 con 0x55da8f8e6950 2024-09-10T21:24:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.067+0000 7f65db7fe640 1 -- 172.21.15.59:0/1204882245 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f65f401b7a0 con 0x55da8f8e6950 2024-09-10T21:24:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.067+0000 7f6604d2c740 1 -- 172.21.15.59:0/1204882245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65ec0cde50 con 0x55da8f8e6950 2024-09-10T21:24:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.067+0000 7f65db7fe640 1 -- 172.21.15.59:0/1204882245 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f65f401b9e0 con 0x55da8f8e6950 2024-09-10T21:24:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.067+0000 7f6604d2c740 10 client.17556 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.067+0000 7f6604d2c740 1 -- 172.21.15.59:0/1204882245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da8f964500 con 0x55da8f8e6950 2024-09-10T21:24:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.068+0000 7f65db7fe640 1 -- 172.21.15.59:0/1204882245 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65ec0cde50 con 0x55da8f8e6950 2024-09-10T21:24:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.068+0000 7f65db7fe640 1 -- 172.21.15.59:0/1204882245 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f65f4028b70 con 0x55da8f8e6950 2024-09-10T21:24:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.068+0000 7f6604d2c740 10 client.17556 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.068+0000 7f6604d2c740 10 client.17556 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:24:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.068+0000 7f6604d2c740 20 client.17556 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.068+0000 7f6604d2c740 1 --2- 172.21.15.59:0/1204882245 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55da8f964c70 0x55da8f967090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.068+0000 7f6604d2c740 4 client.17556 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:24:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.068+0000 7f6604d2c740 1 -- 172.21.15.59:0/1204882245 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55da8f84e850 con 0x55da8f964c70 2024-09-10T21:24:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.068+0000 7f65fbfff640 1 --2- 172.21.15.59:0/1204882245 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55da8f964c70 0x55da8f967090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.069+0000 7f65fbfff640 1 --2- 172.21.15.59:0/1204882245 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55da8f964c70 0x55da8f967090 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be1317d736bafaf4 server_cookie=42f26a046653fc6c in_seq=0 out_seq=0 2024-09-10T21:24:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.069+0000 7f65db7fe640 10 client.17556 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.069+0000 7f65db7fe640 1 -- 172.21.15.59:0/1204882245 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4830 (crc 0 0 0) 0x55da8f84e850 con 0x55da8f964c70 2024-09-10T21:24:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.069+0000 7f65db7fe640 10 client.17556 handle_command_reply: tid=0 2024-09-10T21:24:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.069+0000 7f6604d2c740 1 client.17556 shutdown 2024-09-10T21:24:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.069+0000 7f6604d2c740 1 -- 172.21.15.59:0/1204882245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8e6950 msgr2=0x55da8f8e9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.069+0000 7f6604d2c740 1 --2- 172.21.15.59:0/1204882245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8e6950 0x55da8f8e9f50 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f65f401def0 tx=0x7f65f4004a40 comp rx=0 tx=0).stop 2024-09-10T21:24:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.069+0000 7f6604d2c740 1 -- 172.21.15.59:0/1204882245 shutdown_connections 2024-09-10T21:24:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.069+0000 7f6604d2c740 1 --2- 172.21.15.59:0/1204882245 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55da8f964c70 0x55da8f967090 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.069+0000 7f6604d2c740 1 --2- 172.21.15.59:0/1204882245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da8f8e6950 0x55da8f8e9f50 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.069+0000 7f6604d2c740 1 --2- 172.21.15.59:0/1204882245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55da8f8da9c0 0x55da8f8e97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.069+0000 7f65db7fe640 0 client.17556 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.069+0000 7f6604d2c740 1 --2- 172.21.15.59:0/1204882245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55da8f8da0a0 0x55da8f8ef1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.069+0000 7f6604d2c740 1 -- 172.21.15.59:0/1204882245 >> 172.21.15.59:0/1204882245 conn(0x55da8f8d7ed0 msgr2=0x55da8f8dd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.069+0000 7f6604d2c740 1 -- 172.21.15.59:0/1204882245 shutdown_connections 2024-09-10T21:24:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.069+0000 7f6604d2c740 1 -- 172.21.15.59:0/1204882245 wait complete. 2024-09-10T21:24:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.069+0000 7f6604d2c740 20 client.17556 trim_cache size 0 max 16384 2024-09-10T21:24:09.080 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:24:09.080 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:24:09.081 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-09-10T21:24:09.081 INFO:teuthology.orchestra.run.smithi059.stdout: "ec2c29bb-febd-4190-959f-09af3764b7ad": { 2024-09-10T21:24:09.081 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:09.081 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "ec2c29bb-febd-4190-959f-09af3764b7ad", 2024-09-10T21:24:09.081 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2024-09-10T21:24:09.081 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:24:09.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:09.081 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:24:09.081 INFO:teuthology.orchestra.run.smithi059.stdout: "0fb476f2-3572-4daf-8d42-5cf40259db46": { 2024-09-10T21:24:09.081 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:53.136187+0000", 2024-09-10T21:24:09.081 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:09.081 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:09.081 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:09.081 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:09.082 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:09.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:09.082 INFO:teuthology.orchestra.run.smithi059.stdout: "cb01ac69-57ce-4c62-b57a-054abf74df29": { 2024-09-10T21:24:09.082 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:07.589420+0000", 2024-09-10T21:24:09.082 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:09.082 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:09.082 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:09.082 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:09.082 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:09.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:09.082 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:24:09.082 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:24:09.082 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:09.082 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:09.082 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:09.083 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:09.083 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:09.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:09.083 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:24:09.083 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:24:09.083 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:09.083 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:09.083 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:09.083 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:09.083 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:09.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:09.083 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:24:09.083 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:07.066301+0000", 2024-09-10T21:24:09.083 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:09.083 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:09.084 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:09.084 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:09.084 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:09.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:09.084 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:24:09.084 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:24:09.084 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:09.084 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:09.084 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:09.084 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:09.084 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:09.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:09.084 INFO:teuthology.orchestra.run.smithi059.stdout: "7de1e6cf-02c2-41f2-b957-563f88bae8ef": { 2024-09-10T21:24:09.084 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:22:22.098651+0000", 2024-09-10T21:24:09.084 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:09.085 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:09.085 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:09.085 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:09.085 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:09.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:09.085 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:24:09.085 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:24:09.085 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:09.085 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:09.085 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:09.085 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:09.085 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:09.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:09.085 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:24:09.086 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:24:09.086 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:09.086 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:09.086 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:09.086 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:09.086 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:09.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:09.086 INFO:teuthology.orchestra.run.smithi059.stdout: "ec2c29bb-febd-4190-959f-09af3764b7ad": { 2024-09-10T21:24:09.086 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:24:07.378801+0000", 2024-09-10T21:24:09.086 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:09.086 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:09.086 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:09.086 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:09.086 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:09.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:09.086 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:24:09.087 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:24:09.087 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:09.087 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:09.087 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:09.087 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:09.087 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:09.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:09.087 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:24:09.087 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:24:09.087 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:09.087 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:09.087 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:09.087 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:09.087 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:09.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:24:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:24:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:24:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:24:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "800cdb00-6a99-4c42-8a9e-4b1c599c6af0": { 2024-09-10T21:24:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:52.224081+0000", 2024-09-10T21:24:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "d82f24b1-930e-4f83-a379-3084f22918d0": { 2024-09-10T21:24:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:21:37.203865+0000", 2024-09-10T21:24:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:09.090 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:09.090 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:24:09.090 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:24:09.090 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:24:09.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.070+0000 7f6602957640 1 -- 172.21.15.59:0/3341378287 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f65e40b5360 msgr2=0x7f65e40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:09.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.070+0000 7f6602957640 1 --2- 172.21.15.59:0/3341378287 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f65e40b5360 0x7f65e40b7820 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f65fc103a10 tx=0x7f65f400a750 comp rx=0 tx=0).stop 2024-09-10T21:24:09.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.070+0000 7f6602957640 1 -- 172.21.15.59:0/3341378287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65fc103ca0 msgr2=0x7f65fc101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:09.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.070+0000 7f6602957640 1 --2- 172.21.15.59:0/3341378287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65fc103ca0 0x7f65fc101950 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00c890 tx=0x7f65ec00cd50 comp rx=0 tx=0).stop 2024-09-10T21:24:09.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.070+0000 7f6602957640 1 -- 172.21.15.59:0/3341378287 shutdown_connections 2024-09-10T21:24:09.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.070+0000 7f6602957640 1 --2- 172.21.15.59:0/3341378287 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f65e40b5360 0x7f65e40b7820 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.070+0000 7f6602957640 1 --2- 172.21.15.59:0/3341378287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65fc10d100 0x7f65fc1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.070+0000 7f6602957640 1 --2- 172.21.15.59:0/3341378287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65fc1045c0 0x7f65fc101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.070+0000 7f6602957640 1 --2- 172.21.15.59:0/3341378287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65fc103ca0 0x7f65fc101950 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:09.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.070+0000 7f6602957640 1 -- 172.21.15.59:0/3341378287 >> 172.21.15.59:0/3341378287 conn(0x7f65fc0fd700 msgr2=0x7f65fc0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:09.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.070+0000 7f6602957640 1 -- 172.21.15.59:0/3341378287 shutdown_connections 2024-09-10T21:24:09.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:09.070+0000 7f6602957640 1 -- 172.21.15.59:0/3341378287 wait complete. 2024-09-10T21:24:09.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:09 smithi059 ceph-mon[30888]: pgmap v606: 97 pgs: 97 active+clean; 6.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:24:09.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:09 smithi154 ceph-mon[35041]: pgmap v606: 97 pgs: 97 active+clean; 6.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:24:09.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:09 smithi192 ceph-mon[35363]: pgmap v606: 97 pgs: 97 active+clean; 6.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:24:09.938 INFO:tasks.cephfs.filesystem:scrub status for tag:ec2c29bb-febd-4190-959f-09af3764b7ad - {'path': '/', 'tag': 'ec2c29bb-febd-4190-959f-09af3764b7ad', 'options': 'recursive,force'} 2024-09-10T21:24:10.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:10 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:24:10.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:10 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:24:10.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:10 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:24:11.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:11 smithi059 ceph-mon[30888]: pgmap v607: 97 pgs: 97 active+clean; 6.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:24:11.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:11 smithi154 ceph-mon[35041]: pgmap v607: 97 pgs: 97 active+clean; 6.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:24:11.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:11 smithi192 ceph-mon[35363]: pgmap v607: 97 pgs: 97 active+clean; 6.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:24:13.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:13 smithi059 ceph-mon[30888]: pgmap v608: 97 pgs: 97 active+clean; 6.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:24:13.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:13 smithi154 ceph-mon[35041]: pgmap v608: 97 pgs: 97 active+clean; 6.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:24:13.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:13 smithi192 ceph-mon[35363]: pgmap v608: 97 pgs: 97 active+clean; 6.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:24:15.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:15 smithi059 ceph-mon[30888]: pgmap v609: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:24:15.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:15 smithi154 ceph-mon[35041]: pgmap v609: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:24:15.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:15 smithi192 ceph-mon[35363]: pgmap v609: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:24:16.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:16 smithi192 ceph-mon[35363]: pgmap v610: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:24:16.660 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:16 smithi059 ceph-mon[30888]: pgmap v610: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:24:16.681 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:16 smithi154 ceph-mon[35041]: pgmap v610: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:24:18.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:18 smithi192 ceph-mon[35363]: pgmap v611: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:24:18.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:18 smithi059 ceph-mon[30888]: pgmap v611: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:24:18.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:18 smithi154 ceph-mon[35041]: pgmap v611: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:24:20.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:20 smithi192 ceph-mon[35363]: pgmap v612: 97 pgs: 97 active+clean; 6.2 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:24:20.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:20 smithi059 ceph-mon[30888]: pgmap v612: 97 pgs: 97 active+clean; 6.2 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:24:20.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:20 smithi154 ceph-mon[35041]: pgmap v612: 97 pgs: 97 active+clean; 6.2 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:24:22.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:22 smithi192 ceph-mon[35363]: pgmap v613: 97 pgs: 97 active+clean; 6.2 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:24:22.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:22 smithi059 ceph-mon[30888]: pgmap v613: 97 pgs: 97 active+clean; 6.2 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:24:22.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:22 smithi154 ceph-mon[35041]: pgmap v613: 97 pgs: 97 active+clean; 6.2 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:24:24.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:24 smithi192 ceph-mon[35363]: pgmap v614: 97 pgs: 97 active+clean; 6.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:24:24.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:24 smithi059 ceph-mon[30888]: pgmap v614: 97 pgs: 97 active+clean; 6.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:24:24.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:24 smithi154 ceph-mon[35041]: pgmap v614: 97 pgs: 97 active+clean; 6.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:24:26.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:26 smithi192 ceph-mon[35363]: pgmap v615: 97 pgs: 97 active+clean; 6.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:24:26.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:26 smithi059 ceph-mon[30888]: pgmap v615: 97 pgs: 97 active+clean; 6.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:24:26.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:26 smithi154 ceph-mon[35041]: pgmap v615: 97 pgs: 97 active+clean; 6.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:24:28.733 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:28 smithi154 ceph-mon[35041]: pgmap v616: 97 pgs: 97 active+clean; 6.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:24:28.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:28 smithi192 ceph-mon[35363]: pgmap v616: 97 pgs: 97 active+clean; 6.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:24:28.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:28 smithi059 ceph-mon[30888]: pgmap v616: 97 pgs: 97 active+clean; 6.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:24:30.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:30 smithi192 ceph-mon[35363]: pgmap v617: 97 pgs: 97 active+clean; 6.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:24:30.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:30 smithi059 ceph-mon[30888]: pgmap v617: 97 pgs: 97 active+clean; 6.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:24:30.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:30 smithi154 ceph-mon[35041]: pgmap v617: 97 pgs: 97 active+clean; 6.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:24:32.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:32 smithi192 ceph-mon[35363]: pgmap v618: 97 pgs: 97 active+clean; 6.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:24:32.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:32 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:24:32.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:32 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:24:32.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:32 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:24:32.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:32 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:24:32.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:32 smithi059 ceph-mon[30888]: pgmap v618: 97 pgs: 97 active+clean; 6.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:24:32.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:32 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:24:32.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:32 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:24:32.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:32 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:24:32.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:32 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:24:32.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:32 smithi154 ceph-mon[35041]: pgmap v618: 97 pgs: 97 active+clean; 6.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:24:32.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:32 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:24:32.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:32 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:24:32.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:32 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:24:32.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:32 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:24:34.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:34 smithi192 ceph-mon[35363]: pgmap v619: 97 pgs: 97 active+clean; 6.4 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:24:34.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:34 smithi059 ceph-mon[30888]: pgmap v619: 97 pgs: 97 active+clean; 6.4 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:24:34.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:34 smithi154 ceph-mon[35041]: pgmap v619: 97 pgs: 97 active+clean; 6.4 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:24:36.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:36 smithi192 ceph-mon[35363]: pgmap v620: 97 pgs: 97 active+clean; 6.4 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:24:36.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:36 smithi059 ceph-mon[30888]: pgmap v620: 97 pgs: 97 active+clean; 6.4 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:24:36.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:36 smithi154 ceph-mon[35041]: pgmap v620: 97 pgs: 97 active+clean; 6.4 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:24:37.332 INFO:tasks.workunit.client.0.smithi059.stdout:437/600: open fd = 3 2024-09-10T21:24:37.333 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.333 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.333 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.333 INFO:tasks.workunit.client.0.smithi059.stdout:438/600: open fd = 3 2024-09-10T21:24:37.333 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.333 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.333 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.333 INFO:tasks.workunit.client.0.smithi059.stdout:439/600: open fd = 3 2024-09-10T21:24:37.333 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.333 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.333 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.333 INFO:tasks.workunit.client.0.smithi059.stdout:440/600: open fd = 3 2024-09-10T21:24:37.334 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.334 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.334 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.334 INFO:tasks.workunit.client.0.smithi059.stdout:441/600: open fd = 3 2024-09-10T21:24:37.334 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.334 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.334 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.334 INFO:tasks.workunit.client.0.smithi059.stdout:442/600: open fd = 3 2024-09-10T21:24:37.334 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.334 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.334 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.334 INFO:tasks.workunit.client.0.smithi059.stdout:443/600: open fd = 3 2024-09-10T21:24:37.334 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.334 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.335 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.335 INFO:tasks.workunit.client.0.smithi059.stdout:444/600: open fd = 3 2024-09-10T21:24:37.335 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.335 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.335 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.335 INFO:tasks.workunit.client.0.smithi059.stdout:445/600: open fd = 3 2024-09-10T21:24:37.335 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.335 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.335 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.335 INFO:tasks.workunit.client.0.smithi059.stdout:446/600: open fd = 3 2024-09-10T21:24:37.335 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.335 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.335 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.335 INFO:tasks.workunit.client.0.smithi059.stdout:447/600: open fd = 3 2024-09-10T21:24:37.336 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.336 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.336 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.336 INFO:tasks.workunit.client.0.smithi059.stdout:448/600: open fd = 3 2024-09-10T21:24:37.336 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.336 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.336 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.336 INFO:tasks.workunit.client.0.smithi059.stdout:449/600: open fd = 3 2024-09-10T21:24:37.336 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.336 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.337 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.337 INFO:tasks.workunit.client.0.smithi059.stdout:450/600: open fd = 3 2024-09-10T21:24:37.337 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.337 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.337 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.337 INFO:tasks.workunit.client.0.smithi059.stdout:451/600: open fd = 3 2024-09-10T21:24:37.337 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.337 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.337 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.337 INFO:tasks.workunit.client.0.smithi059.stdout:452/600: open fd = 3 2024-09-10T21:24:37.337 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.337 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.337 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.338 INFO:tasks.workunit.client.0.smithi059.stdout:453/600: open fd = 3 2024-09-10T21:24:37.338 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.338 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.338 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.338 INFO:tasks.workunit.client.0.smithi059.stdout:454/600: open fd = 3 2024-09-10T21:24:37.338 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.338 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.338 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.338 INFO:tasks.workunit.client.0.smithi059.stdout:455/600: open fd = 3 2024-09-10T21:24:37.338 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.338 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.338 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.338 INFO:tasks.workunit.client.0.smithi059.stdout:456/600: open fd = 3 2024-09-10T21:24:37.338 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.339 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.339 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.339 INFO:tasks.workunit.client.0.smithi059.stdout:457/600: open fd = 3 2024-09-10T21:24:37.339 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.339 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.339 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.339 INFO:tasks.workunit.client.0.smithi059.stdout:458/600: open fd = 3 2024-09-10T21:24:37.339 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.339 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.339 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.339 INFO:tasks.workunit.client.0.smithi059.stdout:459/600: open fd = 3 2024-09-10T21:24:37.339 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.339 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.339 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.339 INFO:tasks.workunit.client.0.smithi059.stdout:460/600: open fd = 3 2024-09-10T21:24:37.340 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.340 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.340 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.340 INFO:tasks.workunit.client.0.smithi059.stdout:461/600: open fd = 3 2024-09-10T21:24:37.340 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.340 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.340 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.340 INFO:tasks.workunit.client.0.smithi059.stdout:462/600: open fd = 3 2024-09-10T21:24:37.340 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.340 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.340 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.340 INFO:tasks.workunit.client.0.smithi059.stdout:463/600: open fd = 3 2024-09-10T21:24:37.340 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.340 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.341 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.341 INFO:tasks.workunit.client.0.smithi059.stdout:464/600: open fd = 3 2024-09-10T21:24:37.341 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.341 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.341 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.341 INFO:tasks.workunit.client.0.smithi059.stdout:465/600: open fd = 3 2024-09-10T21:24:37.341 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.341 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.341 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.341 INFO:tasks.workunit.client.0.smithi059.stdout:466/600: open fd = 3 2024-09-10T21:24:37.341 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.341 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.341 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.341 INFO:tasks.workunit.client.0.smithi059.stdout:467/600: open fd = 3 2024-09-10T21:24:37.342 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.342 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.342 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.342 INFO:tasks.workunit.client.0.smithi059.stdout:468/600: open fd = 3 2024-09-10T21:24:37.342 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.342 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.342 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.342 INFO:tasks.workunit.client.0.smithi059.stdout:469/600: open fd = 3 2024-09-10T21:24:37.342 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.342 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.342 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.342 INFO:tasks.workunit.client.0.smithi059.stdout:470/600: open fd = 3 2024-09-10T21:24:37.343 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.343 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.343 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.343 INFO:tasks.workunit.client.0.smithi059.stdout:471/600: open fd = 3 2024-09-10T21:24:37.343 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.343 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.343 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.344 INFO:tasks.workunit.client.0.smithi059.stdout:472/600: open fd = 3 2024-09-10T21:24:37.344 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.344 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.344 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.344 INFO:tasks.workunit.client.0.smithi059.stdout:473/600: open fd = 3 2024-09-10T21:24:37.344 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.344 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.344 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.344 INFO:tasks.workunit.client.0.smithi059.stdout:474/600: open fd = 3 2024-09-10T21:24:37.344 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.344 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.344 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.344 INFO:tasks.workunit.client.0.smithi059.stdout:475/600: open fd = 3 2024-09-10T21:24:37.344 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.344 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.345 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.345 INFO:tasks.workunit.client.0.smithi059.stdout:476/600: open fd = 3 2024-09-10T21:24:37.345 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.345 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.345 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.345 INFO:tasks.workunit.client.0.smithi059.stdout:477/600: open fd = 3 2024-09-10T21:24:37.345 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.345 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.345 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.345 INFO:tasks.workunit.client.0.smithi059.stdout:478/600: open fd = 3 2024-09-10T21:24:37.345 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.346 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.346 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.346 INFO:tasks.workunit.client.0.smithi059.stdout:479/600: open fd = 3 2024-09-10T21:24:37.346 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.346 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.346 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.347 INFO:tasks.workunit.client.0.smithi059.stdout:480/600: open fd = 3 2024-09-10T21:24:37.347 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.347 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.347 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.347 INFO:tasks.workunit.client.0.smithi059.stdout:481/600: open fd = 3 2024-09-10T21:24:37.347 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.347 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.347 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.347 INFO:tasks.workunit.client.0.smithi059.stdout:482/600: open fd = 3 2024-09-10T21:24:37.347 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.347 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.347 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.347 INFO:tasks.workunit.client.0.smithi059.stdout:483/600: open fd = 3 2024-09-10T21:24:37.347 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.348 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.348 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.348 INFO:tasks.workunit.client.0.smithi059.stdout:484/600: open fd = 3 2024-09-10T21:24:37.348 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.348 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.348 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.348 INFO:tasks.workunit.client.0.smithi059.stdout:485/600: open fd = 3 2024-09-10T21:24:37.348 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.348 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.348 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.348 INFO:tasks.workunit.client.0.smithi059.stdout:486/600: open fd = 3 2024-09-10T21:24:37.348 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.348 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.348 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.349 INFO:tasks.workunit.client.0.smithi059.stdout:487/600: open fd = 3 2024-09-10T21:24:37.349 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.349 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.349 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.349 INFO:tasks.workunit.client.0.smithi059.stdout:488/600: open fd = 3 2024-09-10T21:24:37.349 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.349 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.349 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.349 INFO:tasks.workunit.client.0.smithi059.stdout:489/600: open fd = 3 2024-09-10T21:24:37.349 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.349 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.349 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.349 INFO:tasks.workunit.client.0.smithi059.stdout:490/600: open fd = 3 2024-09-10T21:24:37.349 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.349 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.350 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.350 INFO:tasks.workunit.client.0.smithi059.stdout:491/600: open fd = 3 2024-09-10T21:24:37.350 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.350 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.350 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.350 INFO:tasks.workunit.client.0.smithi059.stdout:492/600: open fd = 3 2024-09-10T21:24:37.350 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.350 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.350 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.350 INFO:tasks.workunit.client.0.smithi059.stdout:493/600: open fd = 3 2024-09-10T21:24:37.350 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.350 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.350 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.350 INFO:tasks.workunit.client.0.smithi059.stdout:494/600: open fd = 3 2024-09-10T21:24:37.350 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.351 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.351 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.351 INFO:tasks.workunit.client.0.smithi059.stdout:495/600: open fd = 3 2024-09-10T21:24:37.351 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.351 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.351 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.351 INFO:tasks.workunit.client.0.smithi059.stdout:496/600: open fd = 3 2024-09-10T21:24:37.351 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.351 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.351 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.351 INFO:tasks.workunit.client.0.smithi059.stdout:497/600: open fd = 3 2024-09-10T21:24:37.351 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.351 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.351 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:37.352 INFO:tasks.workunit.client.0.smithi059.stdout:498/600: open fd = 3 2024-09-10T21:24:37.352 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.352 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:24:37.352 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:24:38.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:38 smithi192 ceph-mon[35363]: pgmap v621: 97 pgs: 97 active+clean; 6.4 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:24:38.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:38 smithi059 ceph-mon[30888]: pgmap v621: 97 pgs: 97 active+clean; 6.4 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:24:38.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:38 smithi154 ceph-mon[35041]: pgmap v621: 97 pgs: 97 active+clean; 6.4 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:24:39.939 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:24:40.214 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:24:40.595 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:40 smithi059 ceph-mon[30888]: pgmap v622: 97 pgs: 97 active+clean; 6.4 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:24:40.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.812+0000 7f8596c0d640 1 -- 172.21.15.59:0/2972900866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8590102dc0 msgr2=0x7f85901031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:40.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.812+0000 7f8596c0d640 1 --2- 172.21.15.59:0/2972900866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8590102dc0 0x7f85901031a0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f8584009900 tx=0x7f858402a410 comp rx=0 tx=0).stop 2024-09-10T21:24:40.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.812+0000 7f8596c0d640 1 -- 172.21.15.59:0/2972900866 shutdown_connections 2024-09-10T21:24:40.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.812+0000 7f8596c0d640 1 --2- 172.21.15.59:0/2972900866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8590109150 0x7f859010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.812+0000 7f8596c0d640 1 --2- 172.21.15.59:0/2972900866 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85901087d0 0x7f8590108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.812+0000 7f8596c0d640 1 --2- 172.21.15.59:0/2972900866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8590102dc0 0x7f85901031a0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.812+0000 7f8596c0d640 1 -- 172.21.15.59:0/2972900866 >> 172.21.15.59:0/2972900866 conn(0x7f85900fe830 msgr2=0x7f8590100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.812+0000 7f8596c0d640 1 -- 172.21.15.59:0/2972900866 shutdown_connections 2024-09-10T21:24:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.812+0000 7f8596c0d640 1 -- 172.21.15.59:0/2972900866 wait complete. 2024-09-10T21:24:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.813+0000 7f8596c0d640 1 Processor -- start 2024-09-10T21:24:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.813+0000 7f8596c0d640 1 -- start start 2024-09-10T21:24:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.813+0000 7f8596c0d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8590102dc0 0x7f85901992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.813+0000 7f8596c0d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85901087d0 0x7f85901997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.813+0000 7f8596c0d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8590109150 0x7f859019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.813+0000 7f8596c0d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8590112dd0 con 0x7f8590102dc0 2024-09-10T21:24:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.813+0000 7f8596c0d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8590112c50 con 0x7f8590109150 2024-09-10T21:24:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.813+0000 7f8596c0d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8590112f50 con 0x7f85901087d0 2024-09-10T21:24:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.814+0000 7f85949a9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8590102dc0 0x7f85901992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.814+0000 7f85949a9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8590102dc0 0x7f85901992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52366/0 (socket says 172.21.15.59:52366) 2024-09-10T21:24:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.814+0000 7f85949a9640 1 -- 172.21.15.59:0/325923779 learned_addr learned my addr 172.21.15.59:0/325923779 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.814+0000 7f85951aa640 1 --2- 172.21.15.59:0/325923779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8590109150 0x7f859019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.814+0000 7f858ffff640 1 --2- 172.21.15.59:0/325923779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85901087d0 0x7f85901997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.814+0000 7f85949a9640 1 -- 172.21.15.59:0/325923779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85901087d0 msgr2=0x7f85901997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.814+0000 7f85949a9640 1 --2- 172.21.15.59:0/325923779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85901087d0 0x7f85901997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.814+0000 7f85949a9640 1 -- 172.21.15.59:0/325923779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8590109150 msgr2=0x7f859019eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.814+0000 7f85949a9640 1 --2- 172.21.15.59:0/325923779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8590109150 0x7f859019eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.814+0000 7f85949a9640 1 -- 172.21.15.59:0/325923779 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859019f350 con 0x7f8590102dc0 2024-09-10T21:24:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.814+0000 7f858ffff640 1 --2- 172.21.15.59:0/325923779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85901087d0 0x7f85901997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.814+0000 7f85949a9640 1 --2- 172.21.15.59:0/325923779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8590102dc0 0x7f85901992a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f8584005940 tx=0x7f85840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.814+0000 7f858dffb640 1 -- 172.21.15.59:0/325923779 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858403f030 con 0x7f8590102dc0 2024-09-10T21:24:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.814+0000 7f858dffb640 1 -- 172.21.15.59:0/325923779 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8584003cb0 con 0x7f8590102dc0 2024-09-10T21:24:40.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.814+0000 7f8596c0d640 1 -- 172.21.15.59:0/325923779 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859019f5e0 con 0x7f8590102dc0 2024-09-10T21:24:40.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.814+0000 7f858dffb640 1 -- 172.21.15.59:0/325923779 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8584035070 con 0x7f8590102dc0 2024-09-10T21:24:40.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.815+0000 7f8596c0d640 1 -- 172.21.15.59:0/325923779 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85901a5d00 con 0x7f8590102dc0 2024-09-10T21:24:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.817+0000 7f858dffb640 1 -- 172.21.15.59:0/325923779 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f858403bbf0 con 0x7f8590102dc0 2024-09-10T21:24:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.817+0000 7f8598fe2740 1 Processor -- start 2024-09-10T21:24:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.817+0000 7f8598fe2740 1 -- start start 2024-09-10T21:24:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.818+0000 7f8598fe2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cb480 0x557f4c5cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.818+0000 7f8598fe2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5cbda0 0x557f4c5d77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.818+0000 7f8598fe2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5d7d30 0x557f4c5da120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.818+0000 7f8598fe2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557f4c541e50 con 0x557f4c5cb480 2024-09-10T21:24:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.818+0000 7f8598fe2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557f4c531280 con 0x557f4c5d7d30 2024-09-10T21:24:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.818+0000 7f8598fe2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557f4c535090 con 0x557f4c5cbda0 2024-09-10T21:24:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.818+0000 7f85951aa640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cb480 0x557f4c5cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.818+0000 7f85951aa640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cb480 0x557f4c5cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52368/0 (socket says 172.21.15.59:52368) 2024-09-10T21:24:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.818+0000 7f85951aa640 1 -- 172.21.15.59:0/1890388320 learned_addr learned my addr 172.21.15.59:0/1890388320 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.818+0000 7f858ffff640 1 --2- 172.21.15.59:0/1890388320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5d7d30 0x557f4c5da120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.818+0000 7f85949a9640 1 --2- 172.21.15.59:0/1890388320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5cbda0 0x557f4c5d77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.818+0000 7f85951aa640 1 -- 172.21.15.59:0/1890388320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5cbda0 msgr2=0x557f4c5d77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.818+0000 7f85951aa640 1 --2- 172.21.15.59:0/1890388320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5cbda0 0x557f4c5d77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.818+0000 7f85951aa640 1 -- 172.21.15.59:0/1890388320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5d7d30 msgr2=0x557f4c5da120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.818+0000 7f85951aa640 1 --2- 172.21.15.59:0/1890388320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5d7d30 0x557f4c5da120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.818+0000 7f85951aa640 1 -- 172.21.15.59:0/1890388320 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f4c28f650 con 0x557f4c5cb480 2024-09-10T21:24:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.818+0000 7f858ffff640 1 --2- 172.21.15.59:0/1890388320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5d7d30 0x557f4c5da120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.819+0000 7f85951aa640 1 --2- 172.21.15.59:0/1890388320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cb480 0x557f4c5cb860 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f8588010370 tx=0x7f8588010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2029e5b4be9921 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.819+0000 7f858dffb640 1 --2- 172.21.15.59:0/325923779 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f85800b52e0 0x7f85800b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.819+0000 7f85949a9640 1 --2- 172.21.15.59:0/325923779 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f85800b52e0 0x7f85800b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.819+0000 7f858dffb640 1 -- 172.21.15.59:0/325923779 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8584106780 con 0x7f8590102dc0 2024-09-10T21:24:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.819+0000 7f857affd640 1 -- 172.21.15.59:0/1890388320 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8588016070 con 0x557f4c5cb480 2024-09-10T21:24:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.819+0000 7f857affd640 1 -- 172.21.15.59:0/1890388320 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8588004d20 con 0x557f4c5cb480 2024-09-10T21:24:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.819+0000 7f857affd640 1 -- 172.21.15.59:0/1890388320 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8588005420 con 0x557f4c5cb480 2024-09-10T21:24:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.820+0000 7f8598fe2740 1 -- 172.21.15.59:0/1890388320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cb480 msgr2=0x557f4c5cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.820+0000 7f85949a9640 1 --2- 172.21.15.59:0/325923779 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f85800b52e0 0x7f85800b77a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8584006010 tx=0x7f85840b4040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:40.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.820+0000 7f8598fe2740 1 --2- 172.21.15.59:0/1890388320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cb480 0x557f4c5cb860 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f8588010370 tx=0x7f8588010830 comp rx=0 tx=0).stop 2024-09-10T21:24:40.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.820+0000 7f8598fe2740 1 -- 172.21.15.59:0/1890388320 shutdown_connections 2024-09-10T21:24:40.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.820+0000 7f8598fe2740 1 --2- 172.21.15.59:0/1890388320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5d7d30 0x557f4c5da120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.820+0000 7f8598fe2740 1 --2- 172.21.15.59:0/1890388320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5cbda0 0x557f4c5d77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.820+0000 7f8598fe2740 1 --2- 172.21.15.59:0/1890388320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cb480 0x557f4c5cb860 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.820+0000 7f8598fe2740 1 -- 172.21.15.59:0/1890388320 >> 172.21.15.59:0/1890388320 conn(0x557f4c5c92b0 msgr2=0x557f4c5ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:40.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.820+0000 7f8598fe2740 1 -- 172.21.15.59:0/1890388320 shutdown_connections 2024-09-10T21:24:40.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.820+0000 7f8598fe2740 1 -- 172.21.15.59:0/1890388320 wait complete. 2024-09-10T21:24:40.827 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:40 smithi192 ceph-mon[35363]: pgmap v622: 97 pgs: 97 active+clean; 6.4 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:24:40.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.820+0000 7f8598fe2740 1 -- start start 2024-09-10T21:24:40.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.820+0000 7f8598fe2740 1 Processor -- start 2024-09-10T21:24:40.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.821+0000 7f8598fe2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5cb480 0x557f4c5d7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:40.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.821+0000 7f8598fe2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cbda0 0x557f4c5d4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:40.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.821+0000 7f8598fe2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5d7d30 0x557f4c5d50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:40.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.821+0000 7f8598fe2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557f4c392700 con 0x557f4c5cbda0 2024-09-10T21:24:40.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.821+0000 7f8598fe2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557f4c4cc110 con 0x557f4c5cb480 2024-09-10T21:24:40.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.821+0000 7f8598fe2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x557f4c5dedc0 con 0x557f4c5d7d30 2024-09-10T21:24:40.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.821+0000 7f8598fe2740 10 client.0 _ll_register_callbacks cb 0x557f4c4e5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:40.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.821+0000 7f858ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cbda0 0x557f4c5d4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:40.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.821+0000 7f858ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cbda0 0x557f4c5d4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52372/0 (socket says 172.21.15.59:52372) 2024-09-10T21:24:40.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.821+0000 7f858ffff640 1 -- 172.21.15.59:0/206409542 learned_addr learned my addr 172.21.15.59:0/206409542 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:40.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.821+0000 7f85951aa640 1 --2- 172.21.15.59:0/206409542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5cb480 0x557f4c5d7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:40.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.821+0000 7f85951aa640 1 --2- 172.21.15.59:0/206409542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5d7d30 0x557f4c5d50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:40.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.821+0000 7f858ffff640 1 -- 172.21.15.59:0/206409542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5d7d30 msgr2=0x557f4c5d50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:40.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.821+0000 7f858ffff640 1 --2- 172.21.15.59:0/206409542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5d7d30 0x557f4c5d50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.821+0000 7f858ffff640 1 -- 172.21.15.59:0/206409542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5cb480 msgr2=0x557f4c5d7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:40.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.821+0000 7f858ffff640 1 --2- 172.21.15.59:0/206409542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5cb480 0x557f4c5d7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.821+0000 7f858ffff640 1 -- 172.21.15.59:0/206409542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f4c4f9c40 con 0x557f4c5cbda0 2024-09-10T21:24:40.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.821+0000 7f858ffff640 1 --2- 172.21.15.59:0/206409542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cbda0 0x557f4c5d4a90 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f857c00bf70 tx=0x7f857c011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c775166a95c2a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:40.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.821+0000 7f856ffff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:40.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.822+0000 7f856ffff640 1 -- 172.21.15.59:0/206409542 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c004230 con 0x557f4c5cbda0 2024-09-10T21:24:40.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.822+0000 7f856ffff640 1 -- 172.21.15.59:0/206409542 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f857c0043d0 con 0x557f4c5cbda0 2024-09-10T21:24:40.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.822+0000 7f8598fe2740 1 -- 172.21.15.59:0/206409542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8588004d20 con 0x557f4c5cbda0 2024-09-10T21:24:40.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.822+0000 7f856ffff640 1 -- 172.21.15.59:0/206409542 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f857c022070 con 0x557f4c5cbda0 2024-09-10T21:24:40.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.822+0000 7f8598fe2740 10 client.17568 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:40.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.822+0000 7f8598fe2740 1 -- 172.21.15.59:0/206409542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557f4c5ea780 con 0x557f4c5cbda0 2024-09-10T21:24:40.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.822+0000 7f856ffff640 1 -- 172.21.15.59:0/206409542 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8588004d20 con 0x557f4c5cbda0 2024-09-10T21:24:40.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.822+0000 7f856ffff640 1 -- 172.21.15.59:0/206409542 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f857c012820 con 0x557f4c5cbda0 2024-09-10T21:24:40.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.822+0000 7f8598fe2740 10 client.17568 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:40.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.822+0000 7f8598fe2740 10 client.17568 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:24:40.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.822+0000 7f8598fe2740 20 client.17568 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:40.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.822+0000 7f8598fe2740 1 --2- 172.21.15.59:0/206409542 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557f4c5ebc40 0x557f4c5ee070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:40.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.822+0000 7f8598fe2740 4 client.17568 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:24:40.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.822+0000 7f8598fe2740 1 -- 172.21.15.59:0/206409542 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f4c543da0 con 0x557f4c5ebc40 2024-09-10T21:24:40.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.823+0000 7f85951aa640 1 --2- 172.21.15.59:0/206409542 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557f4c5ebc40 0x557f4c5ee070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:40.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.823+0000 7f85951aa640 1 --2- 172.21.15.59:0/206409542 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557f4c5ebc40 0x557f4c5ee070 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a199296e1696a23 server_cookie=fb4ea261e1d72bf in_seq=0 out_seq=0 2024-09-10T21:24:40.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.823+0000 7f856ffff640 10 client.17568 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:40.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.824+0000 7f856ffff640 1 -- 172.21.15.59:0/206409542 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557f4c543da0 con 0x557f4c5ebc40 2024-09-10T21:24:40.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.824+0000 7f856ffff640 10 client.17568 handle_command_reply: tid=0 2024-09-10T21:24:40.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.824+0000 7f8598fe2740 1 client.17568 shutdown 2024-09-10T21:24:40.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.824+0000 7f8598fe2740 1 -- 172.21.15.59:0/206409542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cbda0 msgr2=0x557f4c5d4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:40.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.824+0000 7f8598fe2740 1 --2- 172.21.15.59:0/206409542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cbda0 0x557f4c5d4a90 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f857c00bf70 tx=0x7f857c011870 comp rx=0 tx=0).stop 2024-09-10T21:24:40.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.824+0000 7f8598fe2740 1 -- 172.21.15.59:0/206409542 shutdown_connections 2024-09-10T21:24:40.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.824+0000 7f8598fe2740 1 --2- 172.21.15.59:0/206409542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5d7d30 0x557f4c5d50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.824+0000 7f8598fe2740 1 --2- 172.21.15.59:0/206409542 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557f4c5ebc40 0x557f4c5ee070 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.824+0000 7f8598fe2740 1 --2- 172.21.15.59:0/206409542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cbda0 0x557f4c5d4a90 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.824+0000 7f8598fe2740 1 --2- 172.21.15.59:0/206409542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5cb480 0x557f4c5d7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.824+0000 7f8598fe2740 1 -- 172.21.15.59:0/206409542 >> 172.21.15.59:0/206409542 conn(0x557f4c5c92b0 msgr2=0x557f4c5cee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:40.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.824+0000 7f856ffff640 0 client.17568 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:40.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.824+0000 7f8598fe2740 1 -- 172.21.15.59:0/206409542 shutdown_connections 2024-09-10T21:24:40.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.824+0000 7f8598fe2740 1 -- 172.21.15.59:0/206409542 wait complete. 2024-09-10T21:24:40.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.824+0000 7f8598fe2740 20 client.17568 trim_cache size 0 max 16384 2024-09-10T21:24:40.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.841+0000 7f8598fe2740 1 Processor -- start 2024-09-10T21:24:40.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.842+0000 7f8598fe2740 1 -- start start 2024-09-10T21:24:40.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.842+0000 7f8598fe2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5cb480 0x557f4c5e7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:40.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.842+0000 7f8598fe2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cbda0 0x557f4c5d3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:40.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.842+0000 7f8598fe2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5d7d30 0x557f4c5d3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:40.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.842+0000 7f8598fe2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f85901ac0c0 con 0x557f4c5cbda0 2024-09-10T21:24:40.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.842+0000 7f8598fe2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f85901adc00 con 0x557f4c5d7d30 2024-09-10T21:24:40.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.842+0000 7f8598fe2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f85901ac790 con 0x557f4c5cb480 2024-09-10T21:24:40.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.842+0000 7f858ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cbda0 0x557f4c5d3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:40.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.842+0000 7f858ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cbda0 0x557f4c5d3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52378/0 (socket says 172.21.15.59:52378) 2024-09-10T21:24:40.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.842+0000 7f858ffff640 1 -- 172.21.15.59:0/4194910266 learned_addr learned my addr 172.21.15.59:0/4194910266 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:40.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.842+0000 7f85951aa640 1 --2- 172.21.15.59:0/4194910266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5cb480 0x557f4c5e7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:40.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.842+0000 7f85951aa640 1 --2- 172.21.15.59:0/4194910266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5d7d30 0x557f4c5d3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:40.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.842+0000 7f858ffff640 1 -- 172.21.15.59:0/4194910266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5cb480 msgr2=0x557f4c5e7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:40.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.842+0000 7f858ffff640 1 --2- 172.21.15.59:0/4194910266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5cb480 0x557f4c5e7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.842+0000 7f858ffff640 1 -- 172.21.15.59:0/4194910266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5d7d30 msgr2=0x557f4c5d3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:40.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.842+0000 7f858ffff640 1 --2- 172.21.15.59:0/4194910266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5d7d30 0x557f4c5d3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.842+0000 7f858ffff640 1 -- 172.21.15.59:0/4194910266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f4c5cbbd0 con 0x557f4c5cbda0 2024-09-10T21:24:40.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.842+0000 7f858ffff640 1 --2- 172.21.15.59:0/4194910266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cbda0 0x557f4c5d3310 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f857c00ba40 tx=0x7f857c005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3559409b17dcb7d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:40.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.843+0000 7f857a7fc640 1 -- 172.21.15.59:0/4194910266 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c035070 con 0x557f4c5cbda0 2024-09-10T21:24:40.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.843+0000 7f857a7fc640 1 -- 172.21.15.59:0/4194910266 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f857c0129c0 con 0x557f4c5cbda0 2024-09-10T21:24:40.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.843+0000 7f857a7fc640 1 -- 172.21.15.59:0/4194910266 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c027c40 con 0x557f4c5cbda0 2024-09-10T21:24:40.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.843+0000 7f8598fe2740 1 -- 172.21.15.59:0/4194910266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cbda0 msgr2=0x557f4c5d3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:40.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.843+0000 7f8598fe2740 1 --2- 172.21.15.59:0/4194910266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cbda0 0x557f4c5d3310 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f857c00ba40 tx=0x7f857c005710 comp rx=0 tx=0).stop 2024-09-10T21:24:40.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.843+0000 7f8598fe2740 1 -- 172.21.15.59:0/4194910266 shutdown_connections 2024-09-10T21:24:40.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.843+0000 7f8598fe2740 1 --2- 172.21.15.59:0/4194910266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5d7d30 0x557f4c5d3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.843+0000 7f8598fe2740 1 --2- 172.21.15.59:0/4194910266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5cbda0 0x557f4c5d3310 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.843+0000 7f8598fe2740 1 --2- 172.21.15.59:0/4194910266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5cb480 0x557f4c5e7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.843+0000 7f8598fe2740 1 -- 172.21.15.59:0/4194910266 >> 172.21.15.59:0/4194910266 conn(0x557f4c5c92b0 msgr2=0x557f4c5ca370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:40.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.843+0000 7f8598fe2740 1 -- 172.21.15.59:0/4194910266 shutdown_connections 2024-09-10T21:24:40.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.843+0000 7f8598fe2740 1 -- 172.21.15.59:0/4194910266 wait complete. 2024-09-10T21:24:40.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.844+0000 7f8598fe2740 1 -- start start 2024-09-10T21:24:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.844+0000 7f8598fe2740 1 Processor -- start 2024-09-10T21:24:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.844+0000 7f8598fe2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5cb480 0x557f4c5e4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.844+0000 7f8598fe2740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5cbda0 0x557f4c5e45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.844+0000 7f8598fe2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5d7d30 0x557f4c5df010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.844+0000 7f8598fe2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f85901ad530 con 0x557f4c5d7d30 2024-09-10T21:24:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.844+0000 7f8598fe2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f85901ace60 con 0x557f4c5cb480 2024-09-10T21:24:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.844+0000 7f8598fe2740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f85901aa0a0 con 0x557f4c5cbda0 2024-09-10T21:24:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.844+0000 7f8598fe2740 10 client.0 _ll_register_callbacks cb 0x7f857c00b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.844+0000 7f85951aa640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5d7d30 0x557f4c5df010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.844+0000 7f85951aa640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5d7d30 0x557f4c5df010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52386/0 (socket says 172.21.15.59:52386) 2024-09-10T21:24:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.844+0000 7f85951aa640 1 -- 172.21.15.59:0/2261125646 learned_addr learned my addr 172.21.15.59:0/2261125646 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.845+0000 7f858ffff640 1 --2- 172.21.15.59:0/2261125646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5cbda0 0x557f4c5e45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.845+0000 7f85951aa640 1 --2- 172.21.15.59:0/2261125646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5cb480 0x557f4c5e4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.845+0000 7f85951aa640 1 -- 172.21.15.59:0/2261125646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5cbda0 msgr2=0x557f4c5e45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.845+0000 7f85951aa640 1 --2- 172.21.15.59:0/2261125646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5cbda0 0x557f4c5e45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.845+0000 7f85951aa640 1 -- 172.21.15.59:0/2261125646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5cb480 msgr2=0x557f4c5e4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.845+0000 7f85951aa640 1 --2- 172.21.15.59:0/2261125646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5cb480 0x557f4c5e4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.845+0000 7f85951aa640 1 -- 172.21.15.59:0/2261125646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f4c5df5a0 con 0x557f4c5d7d30 2024-09-10T21:24:40.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.845+0000 7f85951aa640 1 --2- 172.21.15.59:0/2261125646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5d7d30 0x557f4c5df010 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f8588012fd0 tx=0x7f857c00ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9f58df1a8b75bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:40.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.845+0000 7f856ffff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:40.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.845+0000 7f856ffff640 1 -- 172.21.15.59:0/2261125646 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8588016040 con 0x557f4c5d7d30 2024-09-10T21:24:40.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.845+0000 7f856ffff640 1 -- 172.21.15.59:0/2261125646 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8588003a30 con 0x557f4c5d7d30 2024-09-10T21:24:40.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.845+0000 7f8598fe2740 1 -- 172.21.15.59:0/2261125646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f857c0129c0 con 0x557f4c5d7d30 2024-09-10T21:24:40.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.845+0000 7f856ffff640 1 -- 172.21.15.59:0/2261125646 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8588039030 con 0x557f4c5d7d30 2024-09-10T21:24:40.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.845+0000 7f8598fe2740 10 client.17574 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:40.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.845+0000 7f8598fe2740 1 -- 172.21.15.59:0/2261125646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557f4c659410 con 0x557f4c5d7d30 2024-09-10T21:24:40.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.846+0000 7f856ffff640 1 -- 172.21.15.59:0/2261125646 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f857c0129c0 con 0x557f4c5d7d30 2024-09-10T21:24:40.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.846+0000 7f856ffff640 1 -- 172.21.15.59:0/2261125646 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f858803c070 con 0x557f4c5d7d30 2024-09-10T21:24:40.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.846+0000 7f8598fe2740 10 client.17574 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:40.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.846+0000 7f8598fe2740 10 client.17574 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:24:40.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.846+0000 7f8598fe2740 20 client.17574 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:40.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.846+0000 7f8598fe2740 1 --2- 172.21.15.59:0/2261125646 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557f4c6598e0 0x557f4c65bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:40.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.846+0000 7f8598fe2740 4 client.17574 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:24:40.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.846+0000 7f8598fe2740 1 -- 172.21.15.59:0/2261125646 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557f4c53f850 con 0x557f4c6598e0 2024-09-10T21:24:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.846+0000 7f858ffff640 1 --2- 172.21.15.59:0/2261125646 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557f4c6598e0 0x557f4c65bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.847+0000 7f856ffff640 10 client.17574 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.847+0000 7f858ffff640 1 --2- 172.21.15.59:0/2261125646 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557f4c6598e0 0x557f4c65bcd0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9970401ccb7aeac server_cookie=fb1012144be98b17 in_seq=0 out_seq=0 2024-09-10T21:24:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.847+0000 7f856ffff640 1 -- 172.21.15.59:0/2261125646 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x557f4c53f850 con 0x557f4c6598e0 2024-09-10T21:24:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.847+0000 7f856ffff640 10 client.17574 handle_command_reply: tid=0 2024-09-10T21:24:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.847+0000 7f8598fe2740 1 client.17574 shutdown 2024-09-10T21:24:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.847+0000 7f8598fe2740 1 -- 172.21.15.59:0/2261125646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5d7d30 msgr2=0x557f4c5df010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.847+0000 7f8598fe2740 1 --2- 172.21.15.59:0/2261125646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5d7d30 0x557f4c5df010 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f8588012fd0 tx=0x7f857c00ba70 comp rx=0 tx=0).stop 2024-09-10T21:24:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.847+0000 7f8598fe2740 1 -- 172.21.15.59:0/2261125646 shutdown_connections 2024-09-10T21:24:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.847+0000 7f8598fe2740 1 --2- 172.21.15.59:0/2261125646 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x557f4c6598e0 0x557f4c65bcd0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.847+0000 7f8598fe2740 1 --2- 172.21.15.59:0/2261125646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f4c5d7d30 0x557f4c5df010 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.847+0000 7f8598fe2740 1 --2- 172.21.15.59:0/2261125646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x557f4c5cbda0 0x557f4c5e45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.847+0000 7f8598fe2740 1 --2- 172.21.15.59:0/2261125646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f4c5cb480 0x557f4c5e4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.847+0000 7f8598fe2740 1 -- 172.21.15.59:0/2261125646 >> 172.21.15.59:0/2261125646 conn(0x557f4c5c92b0 msgr2=0x557f4c5d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.847+0000 7f856ffff640 0 client.17574 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.847+0000 7f8598fe2740 1 -- 172.21.15.59:0/2261125646 shutdown_connections 2024-09-10T21:24:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.848+0000 7f8598fe2740 1 -- 172.21.15.59:0/2261125646 wait complete. 2024-09-10T21:24:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.848+0000 7f8598fe2740 20 client.17574 trim_cache size 0 max 16384 2024-09-10T21:24:40.861 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:24:40.862 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:24:40.862 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:24:40.862 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:24:40.862 INFO:teuthology.orchestra.run.smithi059.stdout: "0fb476f2-3572-4daf-8d42-5cf40259db46": { 2024-09-10T21:24:40.862 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:53.136187+0000", 2024-09-10T21:24:40.862 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:40.862 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:40.862 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:40.862 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:40.862 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:40.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:40.862 INFO:teuthology.orchestra.run.smithi059.stdout: "cb01ac69-57ce-4c62-b57a-054abf74df29": { 2024-09-10T21:24:40.863 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:07.589420+0000", 2024-09-10T21:24:40.863 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:40.863 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:40.863 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:40.863 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:40.863 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:40.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:40.863 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:24:40.863 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:24:40.863 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:40.863 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:40.863 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:40.863 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:40.864 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:40.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:40.864 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:24:40.864 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:24:40.864 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:40.864 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:40.864 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:40.864 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:40.864 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:40.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:40.864 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:24:40.864 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:07.066301+0000", 2024-09-10T21:24:40.864 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:40.865 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:40.865 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:40.865 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:40.865 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:40.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:40.865 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:24:40.865 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:24:40.865 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:40.865 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:40.865 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:40.865 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:40.865 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:40.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:40.865 INFO:teuthology.orchestra.run.smithi059.stdout: "7de1e6cf-02c2-41f2-b957-563f88bae8ef": { 2024-09-10T21:24:40.866 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:22:22.098651+0000", 2024-09-10T21:24:40.866 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:40.866 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:40.866 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:40.866 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:40.866 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:40.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:40.866 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:24:40.866 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:24:40.866 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:40.866 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:40.866 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:40.866 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:40.866 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:40.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:40.867 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:24:40.867 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:24:40.867 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:40.867 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:40.867 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:40.867 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:40.867 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:40.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:40.867 INFO:teuthology.orchestra.run.smithi059.stdout: "ec2c29bb-febd-4190-959f-09af3764b7ad": { 2024-09-10T21:24:40.867 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:24:07.378801+0000", 2024-09-10T21:24:40.867 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:40.867 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:40.867 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:40.867 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:40.868 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:40.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:40.868 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:24:40.868 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:24:40.868 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:40.868 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:40.868 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:40.868 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:40.868 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:40.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:40.868 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:24:40.868 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:24:40.868 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:40.868 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:40.869 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:40.869 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:40.869 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:40.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:40.869 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:24:40.869 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:24:40.869 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:40.869 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:40.869 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:40.869 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:40.869 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:40.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:40.869 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:24:40.869 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:24:40.869 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:40.870 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:40.870 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:40.870 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:40.870 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:40.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:40.870 INFO:teuthology.orchestra.run.smithi059.stdout: "800cdb00-6a99-4c42-8a9e-4b1c599c6af0": { 2024-09-10T21:24:40.870 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:52.224081+0000", 2024-09-10T21:24:40.870 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:40.870 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:40.871 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:40.871 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:40.871 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:40.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:40.871 INFO:teuthology.orchestra.run.smithi059.stdout: "d82f24b1-930e-4f83-a379-3084f22918d0": { 2024-09-10T21:24:40.871 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:21:37.203865+0000", 2024-09-10T21:24:40.871 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:40.871 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:40.871 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:40.871 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:40.871 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:40.871 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:24:40.871 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:24:40.871 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:24:40.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.848+0000 7f8596c0d640 1 -- 172.21.15.59:0/325923779 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f85800b52e0 msgr2=0x7f85800b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:40.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.848+0000 7f8596c0d640 1 --2- 172.21.15.59:0/325923779 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f85800b52e0 0x7f85800b77a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8584006010 tx=0x7f85840b4040 comp rx=0 tx=0).stop 2024-09-10T21:24:40.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.848+0000 7f8596c0d640 1 -- 172.21.15.59:0/325923779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8590102dc0 msgr2=0x7f85901992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:40.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.848+0000 7f8596c0d640 1 --2- 172.21.15.59:0/325923779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8590102dc0 0x7f85901992a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f8584005940 tx=0x7f85840042f0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.848+0000 7f8596c0d640 1 -- 172.21.15.59:0/325923779 shutdown_connections 2024-09-10T21:24:40.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.848+0000 7f8596c0d640 1 --2- 172.21.15.59:0/325923779 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f85800b52e0 0x7f85800b77a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.848+0000 7f8596c0d640 1 --2- 172.21.15.59:0/325923779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8590109150 0x7f859019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.848+0000 7f8596c0d640 1 --2- 172.21.15.59:0/325923779 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85901087d0 0x7f85901997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.848+0000 7f8596c0d640 1 --2- 172.21.15.59:0/325923779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8590102dc0 0x7f85901992a0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:40.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.848+0000 7f8596c0d640 1 -- 172.21.15.59:0/325923779 >> 172.21.15.59:0/325923779 conn(0x7f85900fe830 msgr2=0x7f8590100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:40.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.848+0000 7f8596c0d640 1 -- 172.21.15.59:0/325923779 shutdown_connections 2024-09-10T21:24:40.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:40.848+0000 7f8596c0d640 1 -- 172.21.15.59:0/325923779 wait complete. 2024-09-10T21:24:40.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:40 smithi154 ceph-mon[35041]: pgmap v622: 97 pgs: 97 active+clean; 6.4 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:24:41.784 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:24:41.784 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:24:42.046 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:24:42.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.535+0000 7f9b96479640 1 -- 172.21.15.59:0/2776155637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b90102dc0 msgr2=0x7f9b901031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:42.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.535+0000 7f9b96479640 1 --2- 172.21.15.59:0/2776155637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b90102dc0 0x7f9b901031a0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f9b80009900 tx=0x7f9b8002a3f0 comp rx=0 tx=0).stop 2024-09-10T21:24:42.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.535+0000 7f9b96479640 1 -- 172.21.15.59:0/2776155637 shutdown_connections 2024-09-10T21:24:42.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.535+0000 7f9b96479640 1 --2- 172.21.15.59:0/2776155637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b90109150 0x7f9b9010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:42.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.535+0000 7f9b96479640 1 --2- 172.21.15.59:0/2776155637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b901087d0 0x7f9b90108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:42.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.535+0000 7f9b96479640 1 --2- 172.21.15.59:0/2776155637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b90102dc0 0x7f9b901031a0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:42.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.535+0000 7f9b96479640 1 -- 172.21.15.59:0/2776155637 >> 172.21.15.59:0/2776155637 conn(0x7f9b900fe830 msgr2=0x7f9b90100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:42.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.535+0000 7f9b96479640 1 -- 172.21.15.59:0/2776155637 shutdown_connections 2024-09-10T21:24:42.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.535+0000 7f9b96479640 1 -- 172.21.15.59:0/2776155637 wait complete. 2024-09-10T21:24:42.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.535+0000 7f9b96479640 1 Processor -- start 2024-09-10T21:24:42.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.535+0000 7f9b96479640 1 -- start start 2024-09-10T21:24:42.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.536+0000 7f9b96479640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b90102dc0 0x7f9b900754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:42.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.536+0000 7f9b96479640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b901087d0 0x7f9b900759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:42.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.536+0000 7f9b96479640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b90109150 0x7f9b90075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:42.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.536+0000 7f9b96479640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9b90112e10 con 0x7f9b90102dc0 2024-09-10T21:24:42.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.536+0000 7f9b96479640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9b90112c90 con 0x7f9b90109150 2024-09-10T21:24:42.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.536+0000 7f9b96479640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9b90112f90 con 0x7f9b901087d0 2024-09-10T21:24:42.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.536+0000 7f9b8ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b90102dc0 0x7f9b900754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:42.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.536+0000 7f9b8ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b90102dc0 0x7f9b900754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52396/0 (socket says 172.21.15.59:52396) 2024-09-10T21:24:42.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.536+0000 7f9b8ffff640 1 -- 172.21.15.59:0/1615786374 learned_addr learned my addr 172.21.15.59:0/1615786374 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:42.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.536+0000 7f9b87fff640 1 --2- 172.21.15.59:0/1615786374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b901087d0 0x7f9b900759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:42.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.536+0000 7f9b94a16640 1 --2- 172.21.15.59:0/1615786374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b90109150 0x7f9b90075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:42.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.536+0000 7f9b8ffff640 1 -- 172.21.15.59:0/1615786374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b901087d0 msgr2=0x7f9b900759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:42.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.536+0000 7f9b8ffff640 1 --2- 172.21.15.59:0/1615786374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b901087d0 0x7f9b900759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:42.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.536+0000 7f9b8ffff640 1 -- 172.21.15.59:0/1615786374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b90109150 msgr2=0x7f9b90075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:42.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.536+0000 7f9b8ffff640 1 --2- 172.21.15.59:0/1615786374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b90109150 0x7f9b90075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:42.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.536+0000 7f9b8ffff640 1 -- 172.21.15.59:0/1615786374 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b901a76a0 con 0x7f9b90102dc0 2024-09-10T21:24:42.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.536+0000 7f9b94a16640 1 --2- 172.21.15.59:0/1615786374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b90109150 0x7f9b90075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:42.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.536+0000 7f9b8ffff640 1 --2- 172.21.15.59:0/1615786374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b90102dc0 0x7f9b900754a0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f9b80005940 tx=0x7f9b800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:42.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.537+0000 7f9b8dffb640 1 -- 172.21.15.59:0/1615786374 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8003f030 con 0x7f9b90102dc0 2024-09-10T21:24:42.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.537+0000 7f9b8dffb640 1 -- 172.21.15.59:0/1615786374 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b80003cb0 con 0x7f9b90102dc0 2024-09-10T21:24:42.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.537+0000 7f9b96479640 1 -- 172.21.15.59:0/1615786374 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b901a7930 con 0x7f9b90102dc0 2024-09-10T21:24:42.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.537+0000 7f9b8dffb640 1 -- 172.21.15.59:0/1615786374 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80035070 con 0x7f9b90102dc0 2024-09-10T21:24:42.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.537+0000 7f9b96479640 1 -- 172.21.15.59:0/1615786374 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b901a7e10 con 0x7f9b90102dc0 2024-09-10T21:24:42.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.538+0000 7f9b96479640 1 -- 172.21.15.59:0/1615786374 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b901031a0 con 0x7f9b90102dc0 2024-09-10T21:24:42.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.539+0000 7f9b8dffb640 1 -- 172.21.15.59:0/1615786374 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f9b8003bbf0 con 0x7f9b90102dc0 2024-09-10T21:24:42.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.540+0000 7f9b8dffb640 1 --2- 172.21.15.59:0/1615786374 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9b7c0b52e0 0x7f9b7c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:42.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.540+0000 7f9b87fff640 1 --2- 172.21.15.59:0/1615786374 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9b7c0b52e0 0x7f9b7c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:42.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.540+0000 7f9b8dffb640 1 -- 172.21.15.59:0/1615786374 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9b801069b0 con 0x7f9b90102dc0 2024-09-10T21:24:42.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.541+0000 7f9b87fff640 1 --2- 172.21.15.59:0/1615786374 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9b7c0b52e0 0x7f9b7c0b77a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9b90076f90 tx=0x7f9b7800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:42.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.543+0000 7f9b8dffb640 1 -- 172.21.15.59:0/1615786374 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9b800cd840 con 0x7f9b90102dc0 2024-09-10T21:24:42.769 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:42 smithi059 ceph-mon[30888]: pgmap v623: 97 pgs: 97 active+clean; 6.4 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:24:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.765+0000 7f9b96479640 1 -- 172.21.15.59:0/1615786374 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b901a81e0 con 0x7f9b90102dc0 2024-09-10T21:24:42.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.766+0000 7f9b8dffb640 1 -- 172.21.15.59:0/1615786374 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f9b800cd140 con 0x7f9b90102dc0 2024-09-10T21:24:42.770 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:24:42.770 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:24:42.770 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:24:42.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.768+0000 7f9b96479640 1 -- 172.21.15.59:0/1615786374 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9b7c0b52e0 msgr2=0x7f9b7c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:42.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.768+0000 7f9b96479640 1 --2- 172.21.15.59:0/1615786374 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9b7c0b52e0 0x7f9b7c0b77a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9b90076f90 tx=0x7f9b7800b390 comp rx=0 tx=0).stop 2024-09-10T21:24:42.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.768+0000 7f9b96479640 1 -- 172.21.15.59:0/1615786374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b90102dc0 msgr2=0x7f9b900754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:42.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.768+0000 7f9b96479640 1 --2- 172.21.15.59:0/1615786374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b90102dc0 0x7f9b900754a0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f9b80005940 tx=0x7f9b800042f0 comp rx=0 tx=0).stop 2024-09-10T21:24:42.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.768+0000 7f9b96479640 1 -- 172.21.15.59:0/1615786374 shutdown_connections 2024-09-10T21:24:42.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.768+0000 7f9b96479640 1 --2- 172.21.15.59:0/1615786374 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9b7c0b52e0 0x7f9b7c0b77a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:42.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.768+0000 7f9b96479640 1 --2- 172.21.15.59:0/1615786374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9b90109150 0x7f9b90075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:42.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.768+0000 7f9b96479640 1 --2- 172.21.15.59:0/1615786374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9b901087d0 0x7f9b900759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:42.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.768+0000 7f9b96479640 1 --2- 172.21.15.59:0/1615786374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b90102dc0 0x7f9b900754a0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:42.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.768+0000 7f9b96479640 1 -- 172.21.15.59:0/1615786374 >> 172.21.15.59:0/1615786374 conn(0x7f9b900fe830 msgr2=0x7f9b901000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:42.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.768+0000 7f9b96479640 1 -- 172.21.15.59:0/1615786374 shutdown_connections 2024-09-10T21:24:42.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:42.768+0000 7f9b96479640 1 -- 172.21.15.59:0/1615786374 wait complete. 2024-09-10T21:24:42.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:42 smithi192 ceph-mon[35363]: pgmap v623: 97 pgs: 97 active+clean; 6.4 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:24:42.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:42 smithi154 ceph-mon[35041]: pgmap v623: 97 pgs: 97 active+clean; 6.4 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:24:43.589 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:24:43.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:43 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1615786374' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:24:43.856 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:24:43.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:43 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1615786374' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:24:43.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:43 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1615786374' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:24:44.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.319+0000 7f6bfbfa1640 1 -- 172.21.15.59:0/3647284314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf4102dc0 msgr2=0x7f6bf41031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:44.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.319+0000 7f6bfbfa1640 1 --2- 172.21.15.59:0/3647284314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf4102dc0 0x7f6bf41031a0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009ca0 tx=0x7f6bf002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.319+0000 7f6bfbfa1640 1 -- 172.21.15.59:0/3647284314 shutdown_connections 2024-09-10T21:24:44.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.319+0000 7f6bfbfa1640 1 --2- 172.21.15.59:0/3647284314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bf4109150 0x7f6bf410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.319+0000 7f6bfbfa1640 1 --2- 172.21.15.59:0/3647284314 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bf41087d0 0x7f6bf4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.319+0000 7f6bfbfa1640 1 --2- 172.21.15.59:0/3647284314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf4102dc0 0x7f6bf41031a0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.319+0000 7f6bfbfa1640 1 -- 172.21.15.59:0/3647284314 >> 172.21.15.59:0/3647284314 conn(0x7f6bf40fe830 msgr2=0x7f6bf4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:44.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.319+0000 7f6bfbfa1640 1 -- 172.21.15.59:0/3647284314 shutdown_connections 2024-09-10T21:24:44.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.319+0000 7f6bfbfa1640 1 -- 172.21.15.59:0/3647284314 wait complete. 2024-09-10T21:24:44.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bfbfa1640 1 Processor -- start 2024-09-10T21:24:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bfbfa1640 1 -- start start 2024-09-10T21:24:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bfbfa1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf4102dc0 0x7f6bf40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bfbfa1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bf41087d0 0x7f6bf40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bfbfa1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bf4109150 0x7f6bf4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bfbfa1640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf4112e10 con 0x7f6bf4102dc0 2024-09-10T21:24:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bfbfa1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf4112c90 con 0x7f6bf41087d0 2024-09-10T21:24:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bfbfa1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf4112f90 con 0x7f6bf4109150 2024-09-10T21:24:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bf9d3d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf4102dc0 0x7f6bf40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bf9d3d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf4102dc0 0x7f6bf40754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52420/0 (socket says 172.21.15.59:52420) 2024-09-10T21:24:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bf9d3d640 1 -- 172.21.15.59:0/4091390560 learned_addr learned my addr 172.21.15.59:0/4091390560 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bf953c640 1 --2- 172.21.15.59:0/4091390560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bf41087d0 0x7f6bf40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bfa53e640 1 --2- 172.21.15.59:0/4091390560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bf4109150 0x7f6bf4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bf9d3d640 1 -- 172.21.15.59:0/4091390560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bf4109150 msgr2=0x7f6bf4075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:44.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bf9d3d640 1 --2- 172.21.15.59:0/4091390560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bf4109150 0x7f6bf4075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bf9d3d640 1 -- 172.21.15.59:0/4091390560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bf41087d0 msgr2=0x7f6bf40759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bf9d3d640 1 --2- 172.21.15.59:0/4091390560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bf41087d0 0x7f6bf40759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bf9d3d640 1 -- 172.21.15.59:0/4091390560 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf41a7660 con 0x7f6bf4102dc0 2024-09-10T21:24:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bfa53e640 1 --2- 172.21.15.59:0/4091390560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bf4109150 0x7f6bf4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.320+0000 7f6bf953c640 1 --2- 172.21.15.59:0/4091390560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bf41087d0 0x7f6bf40759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.321+0000 7f6bf9d3d640 1 --2- 172.21.15.59:0/4091390560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf4102dc0 0x7f6bf40754a0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0006010 tx=0x7f6bf00319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.321+0000 7f6beaffd640 1 -- 172.21.15.59:0/4091390560 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0003bf0 con 0x7f6bf4102dc0 2024-09-10T21:24:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.321+0000 7f6beaffd640 1 -- 172.21.15.59:0/4091390560 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bf0003d90 con 0x7f6bf4102dc0 2024-09-10T21:24:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.321+0000 7f6bfbfa1640 1 -- 172.21.15.59:0/4091390560 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf41a78f0 con 0x7f6bf4102dc0 2024-09-10T21:24:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.321+0000 7f6beaffd640 1 -- 172.21.15.59:0/4091390560 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf002fc20 con 0x7f6bf4102dc0 2024-09-10T21:24:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.321+0000 7f6bfbfa1640 1 -- 172.21.15.59:0/4091390560 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf41a7e30 con 0x7f6bf4102dc0 2024-09-10T21:24:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.323+0000 7f6bfe376740 1 Processor -- start 2024-09-10T21:24:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.323+0000 7f6beaffd640 1 -- 172.21.15.59:0/4091390560 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f6bf00046a0 con 0x7f6bf4102dc0 2024-09-10T21:24:44.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.324+0000 7f6bfe376740 1 -- start start 2024-09-10T21:24:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.324+0000 7f6bfe376740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b454d0 0x55daf4b458b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.324+0000 7f6bfe376740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 0x55daf4b51840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.324+0000 7f6bfe376740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b51d80 0x55daf4b54170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.324+0000 7f6bfe376740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55daf4abbea0 con 0x55daf4b45df0 2024-09-10T21:24:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.324+0000 7f6bfe376740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55daf4aab2d0 con 0x55daf4b51d80 2024-09-10T21:24:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.324+0000 7f6bfe376740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55daf4aaf0e0 con 0x55daf4b454d0 2024-09-10T21:24:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.324+0000 7f6bf9d3d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 0x55daf4b51840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.324+0000 7f6bf9d3d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 0x55daf4b51840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52430/0 (socket says 172.21.15.59:52430) 2024-09-10T21:24:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.324+0000 7f6bf9d3d640 1 -- 172.21.15.59:0/1580984265 learned_addr learned my addr 172.21.15.59:0/1580984265 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.324+0000 7f6bfa53e640 1 --2- 172.21.15.59:0/1580984265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b454d0 0x55daf4b458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.324+0000 7f6bf953c640 1 --2- 172.21.15.59:0/1580984265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b51d80 0x55daf4b54170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:44.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.324+0000 7f6bf9d3d640 1 -- 172.21.15.59:0/1580984265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b454d0 msgr2=0x55daf4b458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:44.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.324+0000 7f6bf9d3d640 1 --2- 172.21.15.59:0/1580984265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b454d0 0x55daf4b458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.324+0000 7f6bf9d3d640 1 -- 172.21.15.59:0/1580984265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b51d80 msgr2=0x55daf4b54170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:44.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.324+0000 7f6bf9d3d640 1 --2- 172.21.15.59:0/1580984265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b51d80 0x55daf4b54170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.324+0000 7f6bf9d3d640 1 -- 172.21.15.59:0/1580984265 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daf4809650 con 0x55daf4b45df0 2024-09-10T21:24:44.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.324+0000 7f6bfa53e640 1 --2- 172.21.15.59:0/1580984265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b454d0 0x55daf4b458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:24:44.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.325+0000 7f6beaffd640 1 --2- 172.21.15.59:0/4091390560 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6be00b52e0 0x7f6be00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:44.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.325+0000 7f6bf9d3d640 1 --2- 172.21.15.59:0/1580984265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 0x55daf4b51840 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f6bf010af50 tx=0x7f6bf010f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af6bbe6ad7afa17 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:44.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.325+0000 7f6bfa53e640 1 --2- 172.21.15.59:0/4091390560 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6be00b52e0 0x7f6be00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:44.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.325+0000 7f6bdffff640 1 -- 172.21.15.59:0/1580984265 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf00c9e10 con 0x55daf4b45df0 2024-09-10T21:24:44.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.325+0000 7f6beaffd640 1 -- 172.21.15.59:0/4091390560 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6bf0106fd0 con 0x7f6bf4102dc0 2024-09-10T21:24:44.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.325+0000 7f6bdffff640 1 -- 172.21.15.59:0/1580984265 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bf00cd2d0 con 0x55daf4b45df0 2024-09-10T21:24:44.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.325+0000 7f6bdffff640 1 -- 172.21.15.59:0/1580984265 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf00ccf30 con 0x55daf4b45df0 2024-09-10T21:24:44.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.326+0000 7f6bfe376740 1 -- 172.21.15.59:0/1580984265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 msgr2=0x55daf4b51840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:44.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.326+0000 7f6bfa53e640 1 --2- 172.21.15.59:0/4091390560 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6be00b52e0 0x7f6be00b77a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4077560 tx=0x7f6bec00b370 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:44.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.326+0000 7f6bfe376740 1 --2- 172.21.15.59:0/1580984265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 0x55daf4b51840 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f6bf010af50 tx=0x7f6bf010f1a0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.326+0000 7f6bfe376740 1 -- 172.21.15.59:0/1580984265 shutdown_connections 2024-09-10T21:24:44.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.326+0000 7f6bfe376740 1 --2- 172.21.15.59:0/1580984265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b51d80 0x55daf4b54170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.326+0000 7f6bfe376740 1 --2- 172.21.15.59:0/1580984265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 0x55daf4b51840 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.326+0000 7f6bfe376740 1 --2- 172.21.15.59:0/1580984265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b454d0 0x55daf4b458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.326+0000 7f6bfe376740 1 -- 172.21.15.59:0/1580984265 >> 172.21.15.59:0/1580984265 conn(0x55daf4b43300 msgr2=0x55daf4b444a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:44.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.326+0000 7f6bfe376740 1 -- 172.21.15.59:0/1580984265 shutdown_connections 2024-09-10T21:24:44.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.326+0000 7f6bfe376740 1 -- 172.21.15.59:0/1580984265 wait complete. 2024-09-10T21:24:44.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.326+0000 7f6bfe376740 1 -- start start 2024-09-10T21:24:44.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.326+0000 7f6bfe376740 1 Processor -- start 2024-09-10T21:24:44.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.327+0000 7f6bfe376740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b454d0 0x55daf4b516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:44.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.327+0000 7f6bfe376740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 0x55daf4b4eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:44.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.327+0000 7f6bfe376740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b51d80 0x55daf4b4f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:44.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.327+0000 7f6bfe376740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55daf490c700 con 0x55daf4b45df0 2024-09-10T21:24:44.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.327+0000 7f6bfe376740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55daf4a46160 con 0x55daf4b454d0 2024-09-10T21:24:44.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.327+0000 7f6bfe376740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55daf4abbea0 con 0x55daf4b51d80 2024-09-10T21:24:44.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.327+0000 7f6bfe376740 10 client.0 _ll_register_callbacks cb 0x55daf4a5f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:44.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.327+0000 7f6bf953c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 0x55daf4b4eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:44.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.327+0000 7f6bf953c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 0x55daf4b4eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52446/0 (socket says 172.21.15.59:52446) 2024-09-10T21:24:44.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.327+0000 7f6bf953c640 1 -- 172.21.15.59:0/1446946203 learned_addr learned my addr 172.21.15.59:0/1446946203 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:44.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.327+0000 7f6bf9d3d640 1 --2- 172.21.15.59:0/1446946203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b454d0 0x55daf4b516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:44.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.327+0000 7f6bfa53e640 1 --2- 172.21.15.59:0/1446946203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b51d80 0x55daf4b4f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:44.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.327+0000 7f6bf953c640 1 -- 172.21.15.59:0/1446946203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b51d80 msgr2=0x55daf4b4f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:44.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.327+0000 7f6bf953c640 1 --2- 172.21.15.59:0/1446946203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b51d80 0x55daf4b4f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.327+0000 7f6bf953c640 1 -- 172.21.15.59:0/1446946203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b454d0 msgr2=0x55daf4b516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:44.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.327+0000 7f6bf953c640 1 --2- 172.21.15.59:0/1446946203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b454d0 0x55daf4b516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.327+0000 7f6bf953c640 1 -- 172.21.15.59:0/1446946203 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daf4a73c90 con 0x55daf4b45df0 2024-09-10T21:24:44.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.327+0000 7f6bfa53e640 1 --2- 172.21.15.59:0/1446946203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b51d80 0x55daf4b4f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:44.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.328+0000 7f6bf953c640 1 --2- 172.21.15.59:0/1446946203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 0x55daf4b4eb10 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f6be400bad0 tx=0x7f6be400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38fd6c3e27a60353 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:44.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.328+0000 7f6bdd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:44.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.328+0000 7f6bdd7fa640 1 -- 172.21.15.59:0/1446946203 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4005220 con 0x55daf4b45df0 2024-09-10T21:24:44.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.328+0000 7f6bdd7fa640 1 -- 172.21.15.59:0/1446946203 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6be40053c0 con 0x55daf4b45df0 2024-09-10T21:24:44.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.328+0000 7f6bfe376740 1 -- 172.21.15.59:0/1446946203 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bf00cd2d0 con 0x55daf4b45df0 2024-09-10T21:24:44.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.328+0000 7f6bdd7fa640 1 -- 172.21.15.59:0/1446946203 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6be4021070 con 0x55daf4b45df0 2024-09-10T21:24:44.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.328+0000 7f6bfe376740 10 client.17592 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:44.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.328+0000 7f6bfe376740 1 -- 172.21.15.59:0/1446946203 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55daf4b5ffa0 con 0x55daf4b45df0 2024-09-10T21:24:44.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.328+0000 7f6bdd7fa640 1 -- 172.21.15.59:0/1446946203 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bf00cd2d0 con 0x55daf4b45df0 2024-09-10T21:24:44.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.328+0000 7f6bdd7fa640 1 -- 172.21.15.59:0/1446946203 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6be4019030 con 0x55daf4b45df0 2024-09-10T21:24:44.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.328+0000 7f6bfe376740 10 client.17592 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:44.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.328+0000 7f6bfe376740 10 client.17592 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:24:44.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.328+0000 7f6bfe376740 20 client.17592 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:44.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.328+0000 7f6bfe376740 1 --2- 172.21.15.59:0/1446946203 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55daf4b61500 0x55daf4b638f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:44.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.328+0000 7f6bfe376740 4 client.17592 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:24:44.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.328+0000 7f6bfe376740 1 -- 172.21.15.59:0/1446946203 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55daf4abddf0 con 0x55daf4b61500 2024-09-10T21:24:44.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.329+0000 7f6bf9d3d640 1 --2- 172.21.15.59:0/1446946203 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55daf4b61500 0x55daf4b638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:44.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.329+0000 7f6bdd7fa640 10 client.17592 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:24:44.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.329+0000 7f6bf9d3d640 1 --2- 172.21.15.59:0/1446946203 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55daf4b61500 0x55daf4b638f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=27a8eb85e75a52b7 server_cookie=67e5eb3b2fd6e2df in_seq=0 out_seq=0 2024-09-10T21:24:44.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.330+0000 7f6bdd7fa640 1 -- 172.21.15.59:0/1446946203 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55daf4abddf0 con 0x55daf4b61500 2024-09-10T21:24:44.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.330+0000 7f6bdd7fa640 10 client.17592 handle_command_reply: tid=0 2024-09-10T21:24:44.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.330+0000 7f6bfe376740 1 client.17592 shutdown 2024-09-10T21:24:44.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.330+0000 7f6bfe376740 1 -- 172.21.15.59:0/1446946203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 msgr2=0x55daf4b4eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:44.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.330+0000 7f6bfe376740 1 --2- 172.21.15.59:0/1446946203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 0x55daf4b4eb10 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f6be400bad0 tx=0x7f6be400bf90 comp rx=0 tx=0).stop 2024-09-10T21:24:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.330+0000 7f6bfe376740 1 -- 172.21.15.59:0/1446946203 shutdown_connections 2024-09-10T21:24:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.330+0000 7f6bfe376740 1 --2- 172.21.15.59:0/1446946203 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55daf4b61500 0x55daf4b638f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.330+0000 7f6bfe376740 1 --2- 172.21.15.59:0/1446946203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b51d80 0x55daf4b4f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.330+0000 7f6bfe376740 1 --2- 172.21.15.59:0/1446946203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 0x55daf4b4eb10 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.330+0000 7f6bfe376740 1 --2- 172.21.15.59:0/1446946203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b454d0 0x55daf4b516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.330+0000 7f6bdd7fa640 0 client.17592 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:24:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.330+0000 7f6bfe376740 1 -- 172.21.15.59:0/1446946203 >> 172.21.15.59:0/1446946203 conn(0x55daf4b43300 msgr2=0x55daf4b48ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.330+0000 7f6bfe376740 1 -- 172.21.15.59:0/1446946203 shutdown_connections 2024-09-10T21:24:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.330+0000 7f6bfe376740 1 -- 172.21.15.59:0/1446946203 wait complete. 2024-09-10T21:24:44.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.330+0000 7f6bfe376740 20 client.17592 trim_cache size 0 max 16384 2024-09-10T21:24:44.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.344+0000 7f6bfe376740 1 Processor -- start 2024-09-10T21:24:44.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.344+0000 7f6bfe376740 1 -- start start 2024-09-10T21:24:44.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.344+0000 7f6bfe376740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b454d0 0x55daf4b5d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:44.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.344+0000 7f6bfe376740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 0x55daf4b3e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:44.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.344+0000 7f6bfe376740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b51d80 0x55daf4b42310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:44.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.344+0000 7f6bfe376740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf41b04d0 con 0x55daf4b45df0 2024-09-10T21:24:44.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.344+0000 7f6bfe376740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf41b2010 con 0x55daf4b454d0 2024-09-10T21:24:44.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.344+0000 7f6bfe376740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf41b0ba0 con 0x55daf4b51d80 2024-09-10T21:24:44.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.344+0000 7f6bf953c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 0x55daf4b3e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:44.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.344+0000 7f6bf953c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 0x55daf4b3e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52458/0 (socket says 172.21.15.59:52458) 2024-09-10T21:24:44.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.344+0000 7f6bf953c640 1 -- 172.21.15.59:0/1299305801 learned_addr learned my addr 172.21.15.59:0/1299305801 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:44.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.344+0000 7f6bfa53e640 1 --2- 172.21.15.59:0/1299305801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b51d80 0x55daf4b42310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:44.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.344+0000 7f6bf9d3d640 1 --2- 172.21.15.59:0/1299305801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b454d0 0x55daf4b5d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:44.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.344+0000 7f6bf953c640 1 -- 172.21.15.59:0/1299305801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b51d80 msgr2=0x55daf4b42310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:44.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.344+0000 7f6bf953c640 1 --2- 172.21.15.59:0/1299305801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b51d80 0x55daf4b42310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.344+0000 7f6bf953c640 1 -- 172.21.15.59:0/1299305801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b454d0 msgr2=0x55daf4b5d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:44.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.344+0000 7f6bf953c640 1 --2- 172.21.15.59:0/1299305801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b454d0 0x55daf4b5d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.344+0000 7f6bf953c640 1 -- 172.21.15.59:0/1299305801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daf4b4d010 con 0x55daf4b45df0 2024-09-10T21:24:44.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.344+0000 7f6bfa53e640 1 --2- 172.21.15.59:0/1299305801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b51d80 0x55daf4b42310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:44.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.345+0000 7f6bf953c640 1 --2- 172.21.15.59:0/1299305801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 0x55daf4b3e320 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f6be4000c00 tx=0x7f6be4003e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c222190990c4c05 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:44.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.345+0000 7f6bdf7fe640 1 -- 172.21.15.59:0/1299305801 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4011a90 con 0x55daf4b45df0 2024-09-10T21:24:44.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.345+0000 7f6bdf7fe640 1 -- 172.21.15.59:0/1299305801 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6be40054f0 con 0x55daf4b45df0 2024-09-10T21:24:44.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.345+0000 7f6bdf7fe640 1 -- 172.21.15.59:0/1299305801 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4004b60 con 0x55daf4b45df0 2024-09-10T21:24:44.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.345+0000 7f6bfe376740 1 -- 172.21.15.59:0/1299305801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 msgr2=0x55daf4b3e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:44.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.345+0000 7f6bfe376740 1 --2- 172.21.15.59:0/1299305801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 0x55daf4b3e320 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f6be4000c00 tx=0x7f6be4003e80 comp rx=0 tx=0).stop 2024-09-10T21:24:44.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.345+0000 7f6bfe376740 1 -- 172.21.15.59:0/1299305801 shutdown_connections 2024-09-10T21:24:44.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.345+0000 7f6bfe376740 1 --2- 172.21.15.59:0/1299305801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b51d80 0x55daf4b42310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.345+0000 7f6bfe376740 1 --2- 172.21.15.59:0/1299305801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b45df0 0x55daf4b3e320 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.345+0000 7f6bfe376740 1 --2- 172.21.15.59:0/1299305801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b454d0 0x55daf4b5d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.345+0000 7f6bfe376740 1 -- 172.21.15.59:0/1299305801 >> 172.21.15.59:0/1299305801 conn(0x55daf4b43300 msgr2=0x55daf4b41c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:44.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.345+0000 7f6bfe376740 1 -- 172.21.15.59:0/1299305801 shutdown_connections 2024-09-10T21:24:44.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.345+0000 7f6bfe376740 1 -- 172.21.15.59:0/1299305801 wait complete. 2024-09-10T21:24:44.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.346+0000 7f6bfe376740 1 -- start start 2024-09-10T21:24:44.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.346+0000 7f6bfe376740 1 Processor -- start 2024-09-10T21:24:44.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.346+0000 7f6bfe376740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b454d0 0x55daf4b598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:44.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.346+0000 7f6bfe376740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b45df0 0x55daf4b59de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:44.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.346+0000 7f6bfe376740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b51d80 0x55daf4b54850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:44.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.346+0000 7f6bfe376740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf41b1940 con 0x55daf4b51d80 2024-09-10T21:24:44.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.346+0000 7f6bfe376740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf41b1270 con 0x55daf4b45df0 2024-09-10T21:24:44.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.346+0000 7f6bfe376740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf41ae4b0 con 0x55daf4b454d0 2024-09-10T21:24:44.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.346+0000 7f6bfe376740 10 client.0 _ll_register_callbacks cb 0x7f6be4004080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:44.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.346+0000 7f6bfa53e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b51d80 0x55daf4b54850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:44.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.346+0000 7f6bfa53e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b51d80 0x55daf4b54850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52472/0 (socket says 172.21.15.59:52472) 2024-09-10T21:24:44.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.346+0000 7f6bfa53e640 1 -- 172.21.15.59:0/3159018859 learned_addr learned my addr 172.21.15.59:0/3159018859 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:44.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.347+0000 7f6bf9d3d640 1 --2- 172.21.15.59:0/3159018859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b454d0 0x55daf4b598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:44.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.347+0000 7f6bf953c640 1 --2- 172.21.15.59:0/3159018859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b45df0 0x55daf4b59de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:44.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.347+0000 7f6bfa53e640 1 -- 172.21.15.59:0/3159018859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b454d0 msgr2=0x55daf4b598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:44.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.347+0000 7f6bfa53e640 1 --2- 172.21.15.59:0/3159018859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b454d0 0x55daf4b598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.347+0000 7f6bfa53e640 1 -- 172.21.15.59:0/3159018859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b45df0 msgr2=0x55daf4b59de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.347+0000 7f6bfa53e640 1 --2- 172.21.15.59:0/3159018859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b45df0 0x55daf4b59de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.347+0000 7f6bfa53e640 1 -- 172.21.15.59:0/3159018859 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daf4b54d90 con 0x55daf4b51d80 2024-09-10T21:24:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.347+0000 7f6bf953c640 1 --2- 172.21.15.59:0/3159018859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b45df0 0x55daf4b59de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.347+0000 7f6bfa53e640 1 --2- 172.21.15.59:0/3159018859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b51d80 0x55daf4b54850 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f6bec01cbe0 tx=0x7f6bec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdeb1377b0ecd8b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.347+0000 7f6bdd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.347+0000 7f6bdd7fa640 1 -- 172.21.15.59:0/3159018859 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec02a060 con 0x55daf4b51d80 2024-09-10T21:24:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.347+0000 7f6bdd7fa640 1 -- 172.21.15.59:0/3159018859 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6bec01aad0 con 0x55daf4b51d80 2024-09-10T21:24:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.347+0000 7f6bfe376740 1 -- 172.21.15.59:0/3159018859 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6be40054f0 con 0x55daf4b51d80 2024-09-10T21:24:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.347+0000 7f6bdd7fa640 1 -- 172.21.15.59:0/3159018859 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6bec01acd0 con 0x55daf4b51d80 2024-09-10T21:24:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.347+0000 7f6bfe376740 10 client.17598 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.347+0000 7f6bfe376740 1 -- 172.21.15.59:0/3159018859 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55daf4bceb50 con 0x55daf4b51d80 2024-09-10T21:24:44.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.348+0000 7f6bdd7fa640 1 -- 172.21.15.59:0/3159018859 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6be40054f0 con 0x55daf4b51d80 2024-09-10T21:24:44.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.348+0000 7f6bdd7fa640 1 -- 172.21.15.59:0/3159018859 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6bec024070 con 0x55daf4b51d80 2024-09-10T21:24:44.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.348+0000 7f6bfe376740 10 client.17598 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:44.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.348+0000 7f6bfe376740 10 client.17598 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:24:44.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.348+0000 7f6bfe376740 20 client.17598 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:44.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.348+0000 7f6bfe376740 1 --2- 172.21.15.59:0/3159018859 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55daf4bcf330 0x55daf4bd1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:44.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.348+0000 7f6bfe376740 4 client.17598 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:24:44.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.348+0000 7f6bfe376740 1 -- 172.21.15.59:0/3159018859 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55daf4ab98a0 con 0x55daf4bcf330 2024-09-10T21:24:44.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.348+0000 7f6bf9d3d640 1 --2- 172.21.15.59:0/3159018859 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55daf4bcf330 0x55daf4bd1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:44.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.348+0000 7f6bdd7fa640 10 client.17598 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:24:44.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.348+0000 7f6bf9d3d640 1 --2- 172.21.15.59:0/3159018859 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55daf4bcf330 0x55daf4bd1750 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ee90e4779acef7e3 server_cookie=d369c08cba1d391b in_seq=0 out_seq=0 2024-09-10T21:24:44.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.349+0000 7f6bdd7fa640 1 -- 172.21.15.59:0/3159018859 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55daf4ab98a0 con 0x55daf4bcf330 2024-09-10T21:24:44.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.349+0000 7f6bdd7fa640 10 client.17598 handle_command_reply: tid=0 2024-09-10T21:24:44.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.349+0000 7f6bfe376740 1 client.17598 shutdown 2024-09-10T21:24:44.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.349+0000 7f6bfe376740 1 -- 172.21.15.59:0/3159018859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b51d80 msgr2=0x55daf4b54850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:44.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.349+0000 7f6bfe376740 1 --2- 172.21.15.59:0/3159018859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b51d80 0x55daf4b54850 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f6bec01cbe0 tx=0x7f6bec0046c0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.349+0000 7f6bfe376740 1 -- 172.21.15.59:0/3159018859 shutdown_connections 2024-09-10T21:24:44.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.349+0000 7f6bfe376740 1 --2- 172.21.15.59:0/3159018859 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x55daf4bcf330 0x55daf4bd1750 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.349+0000 7f6bfe376740 1 --2- 172.21.15.59:0/3159018859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55daf4b51d80 0x55daf4b54850 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.349+0000 7f6bfe376740 1 --2- 172.21.15.59:0/3159018859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55daf4b45df0 0x55daf4b59de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.349+0000 7f6bdd7fa640 0 client.17598 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:24:44.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.349+0000 7f6bfe376740 1 --2- 172.21.15.59:0/3159018859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55daf4b454d0 0x55daf4b598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.349+0000 7f6bfe376740 1 -- 172.21.15.59:0/3159018859 >> 172.21.15.59:0/3159018859 conn(0x55daf4b43300 msgr2=0x55daf4b50960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:44.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.349+0000 7f6bfe376740 1 -- 172.21.15.59:0/3159018859 shutdown_connections 2024-09-10T21:24:44.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.349+0000 7f6bfe376740 1 -- 172.21.15.59:0/3159018859 wait complete. 2024-09-10T21:24:44.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.349+0000 7f6bfe376740 20 client.17598 trim_cache size 0 max 16384 2024-09-10T21:24:44.359 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:24:44.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.350+0000 7f6bfbfa1640 1 -- 172.21.15.59:0/4091390560 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6be00b52e0 msgr2=0x7f6be00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:44.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.350+0000 7f6bfbfa1640 1 --2- 172.21.15.59:0/4091390560 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6be00b52e0 0x7f6be00b77a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4077560 tx=0x7f6bec00b370 comp rx=0 tx=0).stop 2024-09-10T21:24:44.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.350+0000 7f6bfbfa1640 1 -- 172.21.15.59:0/4091390560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf4102dc0 msgr2=0x7f6bf40754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:44.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.350+0000 7f6bfbfa1640 1 --2- 172.21.15.59:0/4091390560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf4102dc0 0x7f6bf40754a0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0006010 tx=0x7f6bf00319f0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.350+0000 7f6bfbfa1640 1 -- 172.21.15.59:0/4091390560 shutdown_connections 2024-09-10T21:24:44.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.350+0000 7f6bfbfa1640 1 --2- 172.21.15.59:0/4091390560 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6be00b52e0 0x7f6be00b77a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.350+0000 7f6bfbfa1640 1 --2- 172.21.15.59:0/4091390560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bf4109150 0x7f6bf4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.350+0000 7f6bfbfa1640 1 --2- 172.21.15.59:0/4091390560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6bf41087d0 0x7f6bf40759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.350+0000 7f6bfbfa1640 1 --2- 172.21.15.59:0/4091390560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf4102dc0 0x7f6bf40754a0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:44.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.350+0000 7f6bfbfa1640 1 -- 172.21.15.59:0/4091390560 >> 172.21.15.59:0/4091390560 conn(0x7f6bf40fe830 msgr2=0x7f6bf4100040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:44.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.350+0000 7f6bfbfa1640 1 -- 172.21.15.59:0/4091390560 shutdown_connections 2024-09-10T21:24:44.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:44.350+0000 7f6bfbfa1640 1 -- 172.21.15.59:0/4091390560 wait complete. 2024-09-10T21:24:44.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:44 smithi192 ceph-mon[35363]: pgmap v624: 97 pgs: 97 active+clean; 6.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:24:44.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:44 smithi059 ceph-mon[30888]: pgmap v624: 97 pgs: 97 active+clean; 6.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:24:44.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:44 smithi154 ceph-mon[35041]: pgmap v624: 97 pgs: 97 active+clean; 6.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:24:45.178 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:24:45.439 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:24:45.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.896+0000 7fcb129c2640 1 -- 172.21.15.59:0/712292672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb0c101ca0 msgr2=0x7fcb0c102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:45.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.896+0000 7fcb129c2640 1 --2- 172.21.15.59:0/712292672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb0c101ca0 0x7fcb0c102080 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009900 tx=0x7fcafc02a410 comp rx=0 tx=0).stop 2024-09-10T21:24:45.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.896+0000 7fcb129c2640 1 -- 172.21.15.59:0/712292672 shutdown_connections 2024-09-10T21:24:45.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.896+0000 7fcb129c2640 1 --2- 172.21.15.59:0/712292672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb0c108030 0x7fcb0c10e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.896+0000 7fcb129c2640 1 --2- 172.21.15.59:0/712292672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb0c1076b0 0x7fcb0c107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.896+0000 7fcb129c2640 1 --2- 172.21.15.59:0/712292672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb0c101ca0 0x7fcb0c102080 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.896+0000 7fcb129c2640 1 -- 172.21.15.59:0/712292672 >> 172.21.15.59:0/712292672 conn(0x7fcb0c0fd730 msgr2=0x7fcb0c0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.896+0000 7fcb129c2640 1 -- 172.21.15.59:0/712292672 shutdown_connections 2024-09-10T21:24:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.896+0000 7fcb129c2640 1 -- 172.21.15.59:0/712292672 wait complete. 2024-09-10T21:24:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.896+0000 7fcb129c2640 1 Processor -- start 2024-09-10T21:24:45.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.897+0000 7fcb129c2640 1 -- start start 2024-09-10T21:24:45.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.897+0000 7fcb129c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb0c101ca0 0x7fcb0c19a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:45.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.897+0000 7fcb129c2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb0c1076b0 0x7fcb0c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:45.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.897+0000 7fcb129c2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb0c108030 0x7fcb0c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:45.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.897+0000 7fcb129c2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c111cf0 con 0x7fcb0c1076b0 2024-09-10T21:24:45.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.897+0000 7fcb129c2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c111b70 con 0x7fcb0c101ca0 2024-09-10T21:24:45.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.897+0000 7fcb129c2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c111e70 con 0x7fcb0c108030 2024-09-10T21:24:45.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.897+0000 7fcb0b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb0c1076b0 0x7fcb0c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:45.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.897+0000 7fcb0b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb0c1076b0 0x7fcb0c19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52484/0 (socket says 172.21.15.59:52484) 2024-09-10T21:24:45.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.897+0000 7fcb0b7fe640 1 -- 172.21.15.59:0/3558176730 learned_addr learned my addr 172.21.15.59:0/3558176730 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:45.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.897+0000 7fcb0bfff640 1 --2- 172.21.15.59:0/3558176730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb0c101ca0 0x7fcb0c19a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:45.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.897+0000 7fcb10f5f640 1 --2- 172.21.15.59:0/3558176730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb0c108030 0x7fcb0c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:45.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.897+0000 7fcb0b7fe640 1 -- 172.21.15.59:0/3558176730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb0c108030 msgr2=0x7fcb0c19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:45.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.897+0000 7fcb0b7fe640 1 --2- 172.21.15.59:0/3558176730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb0c108030 0x7fcb0c19aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.897+0000 7fcb0b7fe640 1 -- 172.21.15.59:0/3558176730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb0c101ca0 msgr2=0x7fcb0c19a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:45.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.897+0000 7fcb0b7fe640 1 --2- 172.21.15.59:0/3558176730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb0c101ca0 0x7fcb0c19a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.897+0000 7fcb0b7fe640 1 -- 172.21.15.59:0/3558176730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0c1a54e0 con 0x7fcb0c1076b0 2024-09-10T21:24:45.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.897+0000 7fcb0bfff640 1 --2- 172.21.15.59:0/3558176730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb0c101ca0 0x7fcb0c19a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:45.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.898+0000 7fcb0b7fe640 1 --2- 172.21.15.59:0/3558176730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb0c1076b0 0x7fcb0c19a640 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000d950 tx=0x7fcb0000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:45.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.898+0000 7fcb097fa640 1 -- 172.21.15.59:0/3558176730 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb00017070 con 0x7fcb0c1076b0 2024-09-10T21:24:45.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.898+0000 7fcb097fa640 1 -- 172.21.15.59:0/3558176730 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb00009c30 con 0x7fcb0c1076b0 2024-09-10T21:24:45.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.898+0000 7fcb129c2640 1 -- 172.21.15.59:0/3558176730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb0c1a57d0 con 0x7fcb0c1076b0 2024-09-10T21:24:45.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.898+0000 7fcb097fa640 1 -- 172.21.15.59:0/3558176730 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0000f620 con 0x7fcb0c1076b0 2024-09-10T21:24:45.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.898+0000 7fcb129c2640 1 -- 172.21.15.59:0/3558176730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb0c1a5de0 con 0x7fcb0c1076b0 2024-09-10T21:24:45.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.900+0000 7fcb097fa640 1 -- 172.21.15.59:0/3558176730 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fcb00010460 con 0x7fcb0c1076b0 2024-09-10T21:24:45.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb14d97740 1 Processor -- start 2024-09-10T21:24:45.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb14d97740 1 -- start start 2024-09-10T21:24:45.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb14d97740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a0f4d0 0x564208a0f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:45.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb14d97740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0fdf0 0x564208a1b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:45.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb14d97740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a1bd80 0x564208a1e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:45.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb14d97740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564208985ea0 con 0x564208a0f4d0 2024-09-10T21:24:45.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb14d97740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5642089752d0 con 0x564208a0fdf0 2024-09-10T21:24:45.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb14d97740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5642089790e0 con 0x564208a1bd80 2024-09-10T21:24:45.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb10f5f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a0f4d0 0x564208a0f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:45.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb10f5f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a0f4d0 0x564208a0f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52496/0 (socket says 172.21.15.59:52496) 2024-09-10T21:24:45.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb10f5f640 1 -- 172.21.15.59:0/387881551 learned_addr learned my addr 172.21.15.59:0/387881551 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:45.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb0b7fe640 1 --2- 172.21.15.59:0/387881551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a1bd80 0x564208a1e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:45.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb0bfff640 1 --2- 172.21.15.59:0/387881551 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0fdf0 0x564208a1b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:45.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb10f5f640 1 -- 172.21.15.59:0/387881551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a1bd80 msgr2=0x564208a1e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:45.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb097fa640 1 --2- 172.21.15.59:0/3558176730 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcaf40b5360 0x7fcaf40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:45.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb10f5f640 1 --2- 172.21.15.59:0/387881551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a1bd80 0x564208a1e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb10f5f640 1 -- 172.21.15.59:0/387881551 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0fdf0 msgr2=0x564208a1b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:45.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb10f5f640 1 --2- 172.21.15.59:0/387881551 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0fdf0 0x564208a1b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb10f5f640 1 -- 172.21.15.59:0/387881551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642086d3650 con 0x564208a0f4d0 2024-09-10T21:24:45.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.901+0000 7fcb0bfff640 1 --2- 172.21.15.59:0/387881551 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0fdf0 0x564208a1b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:45.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.902+0000 7fcb097fa640 1 -- 172.21.15.59:0/3558176730 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcb000e58d0 con 0x7fcb0c1076b0 2024-09-10T21:24:45.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.902+0000 7fcb10f5f640 1 --2- 172.21.15.59:0/3558176730 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcaf40b5360 0x7fcaf40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:45.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.902+0000 7fcb10f5f640 1 --2- 172.21.15.59:0/387881551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a0f4d0 0x564208a0f8b0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fcb04009ef0 tx=0x7fcb0400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e1fd2bf9e30484 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:45.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.902+0000 7fcaf27fc640 1 -- 172.21.15.59:0/387881551 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb04007640 con 0x564208a0f4d0 2024-09-10T21:24:45.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.902+0000 7fcaf27fc640 1 -- 172.21.15.59:0/387881551 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb04007d10 con 0x564208a0f4d0 2024-09-10T21:24:45.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.902+0000 7fcaf27fc640 1 -- 172.21.15.59:0/387881551 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0400a400 con 0x564208a0f4d0 2024-09-10T21:24:45.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.903+0000 7fcb14d97740 1 -- 172.21.15.59:0/387881551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a0f4d0 msgr2=0x564208a0f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:45.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.903+0000 7fcb14d97740 1 --2- 172.21.15.59:0/387881551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a0f4d0 0x564208a0f8b0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fcb04009ef0 tx=0x7fcb0400c7f0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.903+0000 7fcb10f5f640 1 --2- 172.21.15.59:0/3558176730 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcaf40b5360 0x7fcaf40b7820 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcb04017fd0 tx=0x7fcb0400ab40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:45.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.903+0000 7fcb14d97740 1 -- 172.21.15.59:0/387881551 shutdown_connections 2024-09-10T21:24:45.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.903+0000 7fcb14d97740 1 --2- 172.21.15.59:0/387881551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a1bd80 0x564208a1e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.903+0000 7fcb14d97740 1 --2- 172.21.15.59:0/387881551 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0fdf0 0x564208a1b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.903+0000 7fcb14d97740 1 --2- 172.21.15.59:0/387881551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a0f4d0 0x564208a0f8b0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.903+0000 7fcb14d97740 1 -- 172.21.15.59:0/387881551 >> 172.21.15.59:0/387881551 conn(0x564208a0d300 msgr2=0x564208a0e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:45.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.903+0000 7fcb14d97740 1 -- 172.21.15.59:0/387881551 shutdown_connections 2024-09-10T21:24:45.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.903+0000 7fcb14d97740 1 -- 172.21.15.59:0/387881551 wait complete. 2024-09-10T21:24:45.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.903+0000 7fcb14d97740 1 -- start start 2024-09-10T21:24:45.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.904+0000 7fcb14d97740 1 Processor -- start 2024-09-10T21:24:45.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.904+0000 7fcb14d97740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0f4d0 0x564208a1b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:45.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.904+0000 7fcb14d97740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a0fdf0 0x564208a18ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:45.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.904+0000 7fcb14d97740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a1bd80 0x564208a190f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:45.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.904+0000 7fcb14d97740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5642087d6700 con 0x564208a1bd80 2024-09-10T21:24:45.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.904+0000 7fcb14d97740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564208910160 con 0x564208a0f4d0 2024-09-10T21:24:45.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.904+0000 7fcb14d97740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564208a22e10 con 0x564208a0fdf0 2024-09-10T21:24:45.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.904+0000 7fcb14d97740 10 client.0 _ll_register_callbacks cb 0x5642089299e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:45.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.904+0000 7fcb10f5f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a1bd80 0x564208a190f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:45.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.904+0000 7fcb10f5f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a1bd80 0x564208a190f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52498/0 (socket says 172.21.15.59:52498) 2024-09-10T21:24:45.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.904+0000 7fcb10f5f640 1 -- 172.21.15.59:0/1730127869 learned_addr learned my addr 172.21.15.59:0/1730127869 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:45.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.904+0000 7fcb0bfff640 1 --2- 172.21.15.59:0/1730127869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0f4d0 0x564208a1b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:45.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.904+0000 7fcb0b7fe640 1 --2- 172.21.15.59:0/1730127869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a0fdf0 0x564208a18ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:45.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.904+0000 7fcb10f5f640 1 -- 172.21.15.59:0/1730127869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a0fdf0 msgr2=0x564208a18ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:45.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.904+0000 7fcb10f5f640 1 --2- 172.21.15.59:0/1730127869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a0fdf0 0x564208a18ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.904+0000 7fcb10f5f640 1 -- 172.21.15.59:0/1730127869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0f4d0 msgr2=0x564208a1b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:45.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.904+0000 7fcb10f5f640 1 --2- 172.21.15.59:0/1730127869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0f4d0 0x564208a1b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.904+0000 7fcb10f5f640 1 -- 172.21.15.59:0/1730127869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56420893dc90 con 0x564208a1bd80 2024-09-10T21:24:45.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.905+0000 7fcb10f5f640 1 --2- 172.21.15.59:0/1730127869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a1bd80 0x564208a190f0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400c830 tx=0x7fcb04013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afedb1c67cb0b887 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:45.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.905+0000 7fcaeb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:45.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.905+0000 7fcaeb7fe640 1 -- 172.21.15.59:0/1730127869 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb040093d0 con 0x564208a1bd80 2024-09-10T21:24:45.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.905+0000 7fcaeb7fe640 1 -- 172.21.15.59:0/1730127869 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcb04017410 con 0x564208a1bd80 2024-09-10T21:24:45.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.905+0000 7fcb14d97740 1 -- 172.21.15.59:0/1730127869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb04007d10 con 0x564208a1bd80 2024-09-10T21:24:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.905+0000 7fcaeb7fe640 1 -- 172.21.15.59:0/1730127869 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcb04017610 con 0x564208a1bd80 2024-09-10T21:24:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.905+0000 7fcb14d97740 10 client.17610 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.905+0000 7fcb14d97740 1 -- 172.21.15.59:0/1730127869 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564208a2e740 con 0x564208a1bd80 2024-09-10T21:24:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.905+0000 7fcaeb7fe640 1 -- 172.21.15.59:0/1730127869 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb04007d10 con 0x564208a1bd80 2024-09-10T21:24:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.905+0000 7fcaeb7fe640 1 -- 172.21.15.59:0/1730127869 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcb0402b070 con 0x564208a1bd80 2024-09-10T21:24:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.905+0000 7fcb14d97740 10 client.17610 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.905+0000 7fcb14d97740 10 client.17610 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:24:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.905+0000 7fcb14d97740 20 client.17610 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.905+0000 7fcb14d97740 1 --2- 172.21.15.59:0/1730127869 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x564208a2fba0 0x564208a31f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.905+0000 7fcb14d97740 4 client.17610 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:24:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.905+0000 7fcb14d97740 1 -- 172.21.15.59:0/1730127869 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564208987df0 con 0x564208a2fba0 2024-09-10T21:24:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.906+0000 7fcb0bfff640 1 --2- 172.21.15.59:0/1730127869 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x564208a2fba0 0x564208a31f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:45.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.906+0000 7fcb0bfff640 1 --2- 172.21.15.59:0/1730127869 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x564208a2fba0 0x564208a31f90 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cec47a49cf629bf9 server_cookie=f0ca8915beb5ab7d in_seq=0 out_seq=0 2024-09-10T21:24:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.906+0000 7fcaeb7fe640 10 client.17610 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:24:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.907+0000 7fcaeb7fe640 1 -- 172.21.15.59:0/1730127869 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564208987df0 con 0x564208a2fba0 2024-09-10T21:24:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.907+0000 7fcaeb7fe640 10 client.17610 handle_command_reply: tid=0 2024-09-10T21:24:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.907+0000 7fcb14d97740 1 client.17610 shutdown 2024-09-10T21:24:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.907+0000 7fcb14d97740 1 -- 172.21.15.59:0/1730127869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a1bd80 msgr2=0x564208a190f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.907+0000 7fcb14d97740 1 --2- 172.21.15.59:0/1730127869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a1bd80 0x564208a190f0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400c830 tx=0x7fcb04013000 comp rx=0 tx=0).stop 2024-09-10T21:24:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.907+0000 7fcb14d97740 1 -- 172.21.15.59:0/1730127869 shutdown_connections 2024-09-10T21:24:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.907+0000 7fcb14d97740 1 --2- 172.21.15.59:0/1730127869 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x564208a2fba0 0x564208a31f90 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.907+0000 7fcb14d97740 1 --2- 172.21.15.59:0/1730127869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a1bd80 0x564208a190f0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.907+0000 7fcb14d97740 1 --2- 172.21.15.59:0/1730127869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a0fdf0 0x564208a18ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.907+0000 7fcaeb7fe640 0 client.17610 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:24:45.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.907+0000 7fcb14d97740 1 --2- 172.21.15.59:0/1730127869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0f4d0 0x564208a1b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.907+0000 7fcb14d97740 1 -- 172.21.15.59:0/1730127869 >> 172.21.15.59:0/1730127869 conn(0x564208a0d300 msgr2=0x564208a12ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:45.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.907+0000 7fcb14d97740 1 -- 172.21.15.59:0/1730127869 shutdown_connections 2024-09-10T21:24:45.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.907+0000 7fcb14d97740 1 -- 172.21.15.59:0/1730127869 wait complete. 2024-09-10T21:24:45.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.907+0000 7fcb14d97740 20 client.17610 trim_cache size 0 max 16384 2024-09-10T21:24:45.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.921+0000 7fcb14d97740 1 Processor -- start 2024-09-10T21:24:45.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.921+0000 7fcb14d97740 1 -- start start 2024-09-10T21:24:45.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.921+0000 7fcb14d97740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a0f4d0 0x564208a2c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:45.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.921+0000 7fcb14d97740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0fdf0 0x564208a1a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:45.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.921+0000 7fcb14d97740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a1bd80 0x564208a1d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:45.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.921+0000 7fcb14d97740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c1ac120 con 0x564208a0f4d0 2024-09-10T21:24:45.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.921+0000 7fcb14d97740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c1adc60 con 0x564208a0fdf0 2024-09-10T21:24:45.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.921+0000 7fcb14d97740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c1ac7f0 con 0x564208a1bd80 2024-09-10T21:24:45.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.921+0000 7fcb0bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a0f4d0 0x564208a2c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:45.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.921+0000 7fcb0bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a0f4d0 0x564208a2c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52506/0 (socket says 172.21.15.59:52506) 2024-09-10T21:24:45.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.921+0000 7fcb0bfff640 1 -- 172.21.15.59:0/2922122462 learned_addr learned my addr 172.21.15.59:0/2922122462 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:45.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.921+0000 7fcb10f5f640 1 --2- 172.21.15.59:0/2922122462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a1bd80 0x564208a1d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:45.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.921+0000 7fcb0b7fe640 1 --2- 172.21.15.59:0/2922122462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0fdf0 0x564208a1a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:45.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.921+0000 7fcb0bfff640 1 -- 172.21.15.59:0/2922122462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a1bd80 msgr2=0x564208a1d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:45.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.921+0000 7fcb0bfff640 1 --2- 172.21.15.59:0/2922122462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a1bd80 0x564208a1d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.921+0000 7fcb0bfff640 1 -- 172.21.15.59:0/2922122462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0fdf0 msgr2=0x564208a1a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:45.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.921+0000 7fcb0bfff640 1 --2- 172.21.15.59:0/2922122462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0fdf0 0x564208a1a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.921+0000 7fcb0bfff640 1 -- 172.21.15.59:0/2922122462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564208a16fc0 con 0x564208a0f4d0 2024-09-10T21:24:45.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.922+0000 7fcb0bfff640 1 --2- 172.21.15.59:0/2922122462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a0f4d0 0x564208a2c040 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fcafc031440 tx=0x7fcafc009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e1a2245d33f363 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:45.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.922+0000 7fcaf1ffb640 1 -- 172.21.15.59:0/2922122462 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcafc035040 con 0x564208a0f4d0 2024-09-10T21:24:45.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.922+0000 7fcaf1ffb640 1 -- 172.21.15.59:0/2922122462 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcafc005040 con 0x564208a0f4d0 2024-09-10T21:24:45.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.922+0000 7fcaf1ffb640 1 -- 172.21.15.59:0/2922122462 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcafc004920 con 0x564208a0f4d0 2024-09-10T21:24:45.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.922+0000 7fcb14d97740 1 -- 172.21.15.59:0/2922122462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a0f4d0 msgr2=0x564208a2c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:45.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.922+0000 7fcb14d97740 1 --2- 172.21.15.59:0/2922122462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a0f4d0 0x564208a2c040 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fcafc031440 tx=0x7fcafc009680 comp rx=0 tx=0).stop 2024-09-10T21:24:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.923+0000 7fcb14d97740 1 -- 172.21.15.59:0/2922122462 shutdown_connections 2024-09-10T21:24:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.923+0000 7fcb14d97740 1 --2- 172.21.15.59:0/2922122462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a1bd80 0x564208a1d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.923+0000 7fcb14d97740 1 --2- 172.21.15.59:0/2922122462 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0fdf0 0x564208a1a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.923+0000 7fcb14d97740 1 --2- 172.21.15.59:0/2922122462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a0f4d0 0x564208a2c040 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.923+0000 7fcb14d97740 1 -- 172.21.15.59:0/2922122462 >> 172.21.15.59:0/2922122462 conn(0x564208a0d300 msgr2=0x564208a1a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.923+0000 7fcb14d97740 1 -- 172.21.15.59:0/2922122462 shutdown_connections 2024-09-10T21:24:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.923+0000 7fcb14d97740 1 -- 172.21.15.59:0/2922122462 wait complete. 2024-09-10T21:24:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.923+0000 7fcb14d97740 1 -- start start 2024-09-10T21:24:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.923+0000 7fcb14d97740 1 Processor -- start 2024-09-10T21:24:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.923+0000 7fcb14d97740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a0f4d0 0x564208a28290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.923+0000 7fcb14d97740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0fdf0 0x564208a287d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.923+0000 7fcb14d97740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a1bd80 0x564208a23060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:45.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.923+0000 7fcb14d97740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c1ad590 con 0x564208a1bd80 2024-09-10T21:24:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.923+0000 7fcb14d97740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c1acec0 con 0x564208a0fdf0 2024-09-10T21:24:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.923+0000 7fcb14d97740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c1aa120 con 0x564208a0f4d0 2024-09-10T21:24:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.924+0000 7fcb14d97740 10 client.0 _ll_register_callbacks cb 0x7fcb04009dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.924+0000 7fcb10f5f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a1bd80 0x564208a23060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.924+0000 7fcb0bfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a0f4d0 0x564208a28290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.924+0000 7fcb10f5f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a1bd80 0x564208a23060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52508/0 (socket says 172.21.15.59:52508) 2024-09-10T21:24:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.924+0000 7fcb10f5f640 1 -- 172.21.15.59:0/2418147715 learned_addr learned my addr 172.21.15.59:0/2418147715 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.924+0000 7fcb0bfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a0f4d0 0x564208a28290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:48928/0 (socket says 172.21.15.59:48928) 2024-09-10T21:24:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.924+0000 7fcb0b7fe640 1 --2- 172.21.15.59:0/2418147715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0fdf0 0x564208a287d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.924+0000 7fcb10f5f640 1 -- 172.21.15.59:0/2418147715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a0f4d0 msgr2=0x564208a28290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.924+0000 7fcb10f5f640 1 --2- 172.21.15.59:0/2418147715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a0f4d0 0x564208a28290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.924+0000 7fcb10f5f640 1 -- 172.21.15.59:0/2418147715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0fdf0 msgr2=0x564208a287d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:45.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.924+0000 7fcb10f5f640 1 --2- 172.21.15.59:0/2418147715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0fdf0 0x564208a287d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.924+0000 7fcb10f5f640 1 -- 172.21.15.59:0/2418147715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564208a23670 con 0x564208a1bd80 2024-09-10T21:24:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.924+0000 7fcb10f5f640 1 --2- 172.21.15.59:0/2418147715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a1bd80 0x564208a23060 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fcb04007c60 tx=0x7fcb04004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0932721d7937ebc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.924+0000 7fcaeb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.924+0000 7fcaeb7fe640 1 -- 172.21.15.59:0/2418147715 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb04026070 con 0x564208a1bd80 2024-09-10T21:24:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.924+0000 7fcaeb7fe640 1 -- 172.21.15.59:0/2418147715 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fcb04017410 con 0x564208a1bd80 2024-09-10T21:24:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.924+0000 7fcb14d97740 1 -- 172.21.15.59:0/2418147715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcafc005040 con 0x564208a1bd80 2024-09-10T21:24:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.925+0000 7fcaeb7fe640 1 -- 172.21.15.59:0/2418147715 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fcb04049070 con 0x564208a1bd80 2024-09-10T21:24:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.925+0000 7fcb14d97740 10 client.17616 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.925+0000 7fcb14d97740 1 -- 172.21.15.59:0/2418147715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564208a9d180 con 0x564208a1bd80 2024-09-10T21:24:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.925+0000 7fcaeb7fe640 1 -- 172.21.15.59:0/2418147715 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcafc005040 con 0x564208a1bd80 2024-09-10T21:24:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.925+0000 7fcaeb7fe640 1 -- 172.21.15.59:0/2418147715 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fcb04041030 con 0x564208a1bd80 2024-09-10T21:24:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.925+0000 7fcb14d97740 10 client.17616 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:45.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.925+0000 7fcb14d97740 10 client.17616 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:24:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.925+0000 7fcb14d97740 20 client.17616 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.925+0000 7fcb14d97740 1 --2- 172.21.15.59:0/2418147715 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x564208a9d840 0x564208a9fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.925+0000 7fcb14d97740 4 client.17616 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:24:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.925+0000 7fcb14d97740 1 -- 172.21.15.59:0/2418147715 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5642089838a0 con 0x564208a9d840 2024-09-10T21:24:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.925+0000 7fcb0bfff640 1 --2- 172.21.15.59:0/2418147715 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x564208a9d840 0x564208a9fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.926+0000 7fcb0bfff640 1 --2- 172.21.15.59:0/2418147715 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x564208a9d840 0x564208a9fc60 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fcfcc8f4fbeb4b75 server_cookie=38669fdc5178c864 in_seq=0 out_seq=0 2024-09-10T21:24:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.926+0000 7fcaeb7fe640 10 client.17616 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:24:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.926+0000 7fcaeb7fe640 1 -- 172.21.15.59:0/2418147715 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5642089838a0 con 0x564208a9d840 2024-09-10T21:24:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.926+0000 7fcaeb7fe640 10 client.17616 handle_command_reply: tid=0 2024-09-10T21:24:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.926+0000 7fcb14d97740 1 client.17616 shutdown 2024-09-10T21:24:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.926+0000 7fcb14d97740 1 -- 172.21.15.59:0/2418147715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a1bd80 msgr2=0x564208a23060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.926+0000 7fcb14d97740 1 --2- 172.21.15.59:0/2418147715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a1bd80 0x564208a23060 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fcb04007c60 tx=0x7fcb04004a00 comp rx=0 tx=0).stop 2024-09-10T21:24:45.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.926+0000 7fcb14d97740 1 -- 172.21.15.59:0/2418147715 shutdown_connections 2024-09-10T21:24:45.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.926+0000 7fcb14d97740 1 --2- 172.21.15.59:0/2418147715 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x564208a9d840 0x564208a9fc60 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.926+0000 7fcb14d97740 1 --2- 172.21.15.59:0/2418147715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564208a1bd80 0x564208a23060 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.926+0000 7fcb14d97740 1 --2- 172.21.15.59:0/2418147715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564208a0fdf0 0x564208a287d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.926+0000 7fcaeb7fe640 0 client.17616 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:24:45.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.926+0000 7fcb14d97740 1 --2- 172.21.15.59:0/2418147715 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564208a0f4d0 0x564208a28290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.926+0000 7fcb14d97740 1 -- 172.21.15.59:0/2418147715 >> 172.21.15.59:0/2418147715 conn(0x564208a0d300 msgr2=0x564208a1a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:45.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.926+0000 7fcb14d97740 1 -- 172.21.15.59:0/2418147715 shutdown_connections 2024-09-10T21:24:45.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.926+0000 7fcb14d97740 1 -- 172.21.15.59:0/2418147715 wait complete. 2024-09-10T21:24:45.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.927+0000 7fcb14d97740 20 client.17616 trim_cache size 0 max 16384 2024-09-10T21:24:45.935 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:24:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.927+0000 7fcb129c2640 1 -- 172.21.15.59:0/3558176730 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcaf40b5360 msgr2=0x7fcaf40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.927+0000 7fcb129c2640 1 --2- 172.21.15.59:0/3558176730 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcaf40b5360 0x7fcaf40b7820 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcb04017fd0 tx=0x7fcb0400ab40 comp rx=0 tx=0).stop 2024-09-10T21:24:45.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.927+0000 7fcb129c2640 1 -- 172.21.15.59:0/3558176730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb0c1076b0 msgr2=0x7fcb0c19a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.927+0000 7fcb129c2640 1 --2- 172.21.15.59:0/3558176730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb0c1076b0 0x7fcb0c19a640 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000d950 tx=0x7fcb0000de10 comp rx=0 tx=0).stop 2024-09-10T21:24:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.927+0000 7fcb129c2640 1 -- 172.21.15.59:0/3558176730 shutdown_connections 2024-09-10T21:24:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.927+0000 7fcb129c2640 1 --2- 172.21.15.59:0/3558176730 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fcaf40b5360 0x7fcaf40b7820 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.927+0000 7fcb129c2640 1 --2- 172.21.15.59:0/3558176730 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb0c108030 0x7fcb0c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.927+0000 7fcb129c2640 1 --2- 172.21.15.59:0/3558176730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb0c1076b0 0x7fcb0c19a640 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.927+0000 7fcb129c2640 1 --2- 172.21.15.59:0/3558176730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb0c101ca0 0x7fcb0c19a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.927+0000 7fcb129c2640 1 -- 172.21.15.59:0/3558176730 >> 172.21.15.59:0/3558176730 conn(0x7fcb0c0fd730 msgr2=0x7fcb0c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.927+0000 7fcb129c2640 1 -- 172.21.15.59:0/3558176730 shutdown_connections 2024-09-10T21:24:45.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:45.927+0000 7fcb129c2640 1 -- 172.21.15.59:0/3558176730 wait complete. 2024-09-10T21:24:46.725 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:24:46.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:46 smithi192 ceph-mon[35363]: pgmap v625: 97 pgs: 97 active+clean; 6.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:24:46.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:46 smithi059 ceph-mon[30888]: pgmap v625: 97 pgs: 97 active+clean; 6.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:24:46.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:46 smithi154 ceph-mon[35041]: pgmap v625: 97 pgs: 97 active+clean; 6.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:24:46.984 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:24:47.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.455+0000 7fce25bc7640 1 -- 172.21.15.59:0/4213354915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce20104600 msgr2=0x7fce2010caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:47.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.455+0000 7fce25bc7640 1 --2- 172.21.15.59:0/4213354915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce20104600 0x7fce2010caf0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fce14009900 tx=0x7fce1402a410 comp rx=0 tx=0).stop 2024-09-10T21:24:47.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.455+0000 7fce25bc7640 1 -- 172.21.15.59:0/4213354915 shutdown_connections 2024-09-10T21:24:47.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.455+0000 7fce25bc7640 1 --2- 172.21.15.59:0/4213354915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce2010d140 0x7fce2010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.455+0000 7fce25bc7640 1 --2- 172.21.15.59:0/4213354915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce20104600 0x7fce2010caf0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.455+0000 7fce25bc7640 1 --2- 172.21.15.59:0/4213354915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce20103ce0 0x7fce201040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.455+0000 7fce25bc7640 1 -- 172.21.15.59:0/4213354915 >> 172.21.15.59:0/4213354915 conn(0x7fce200fd700 msgr2=0x7fce200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.455+0000 7fce25bc7640 1 -- 172.21.15.59:0/4213354915 shutdown_connections 2024-09-10T21:24:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.455+0000 7fce25bc7640 1 -- 172.21.15.59:0/4213354915 wait complete. 2024-09-10T21:24:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.456+0000 7fce25bc7640 1 Processor -- start 2024-09-10T21:24:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.456+0000 7fce25bc7640 1 -- start start 2024-09-10T21:24:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.456+0000 7fce25bc7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce20103ce0 0x7fce20101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.456+0000 7fce25bc7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce20104600 0x7fce20101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.456+0000 7fce25bc7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce2010d140 0x7fce20102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.456+0000 7fce25bc7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fce20112db0 con 0x7fce20103ce0 2024-09-10T21:24:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.456+0000 7fce25bc7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fce20112c30 con 0x7fce2010d140 2024-09-10T21:24:47.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.456+0000 7fce25bc7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fce20112f30 con 0x7fce20104600 2024-09-10T21:24:47.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.456+0000 7fce1f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce20103ce0 0x7fce20101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:47.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.456+0000 7fce1f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce20103ce0 0x7fce20101990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52534/0 (socket says 172.21.15.59:52534) 2024-09-10T21:24:47.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.456+0000 7fce1f7fe640 1 -- 172.21.15.59:0/3729152620 learned_addr learned my addr 172.21.15.59:0/3729152620 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:47.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.457+0000 7fce1effd640 1 --2- 172.21.15.59:0/3729152620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce20104600 0x7fce20101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:47.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.457+0000 7fce1ffff640 1 --2- 172.21.15.59:0/3729152620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce2010d140 0x7fce20102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:47.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.457+0000 7fce1f7fe640 1 -- 172.21.15.59:0/3729152620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce20104600 msgr2=0x7fce20101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:47.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.457+0000 7fce1f7fe640 1 --2- 172.21.15.59:0/3729152620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce20104600 0x7fce20101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.457+0000 7fce1f7fe640 1 -- 172.21.15.59:0/3729152620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce2010d140 msgr2=0x7fce20102410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:47.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.457+0000 7fce1f7fe640 1 --2- 172.21.15.59:0/3729152620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce2010d140 0x7fce20102410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.457+0000 7fce1f7fe640 1 -- 172.21.15.59:0/3729152620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce201a7680 con 0x7fce20103ce0 2024-09-10T21:24:47.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.457+0000 7fce1f7fe640 1 --2- 172.21.15.59:0/3729152620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce20103ce0 0x7fce20101990 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fce1000c920 tx=0x7fce1000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:47.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.457+0000 7fce1cff9640 1 -- 172.21.15.59:0/3729152620 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce10007c70 con 0x7fce20103ce0 2024-09-10T21:24:47.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.457+0000 7fce1cff9640 1 -- 172.21.15.59:0/3729152620 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce10007e10 con 0x7fce20103ce0 2024-09-10T21:24:47.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.457+0000 7fce25bc7640 1 -- 172.21.15.59:0/3729152620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce201a7970 con 0x7fce20103ce0 2024-09-10T21:24:47.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.457+0000 7fce1cff9640 1 -- 172.21.15.59:0/3729152620 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce10018820 con 0x7fce20103ce0 2024-09-10T21:24:47.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.457+0000 7fce25bc7640 1 -- 172.21.15.59:0/3729152620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce201a7e80 con 0x7fce20103ce0 2024-09-10T21:24:47.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce27f9c740 1 Processor -- start 2024-09-10T21:24:47.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce27f9c740 1 -- start start 2024-09-10T21:24:47.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce1cff9640 1 -- 172.21.15.59:0/3729152620 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fce1000f450 con 0x7fce20103ce0 2024-09-10T21:24:47.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce27f9c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 0x55b60af6f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:47.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce27f9c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af6fa10 0x55b60af7b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:47.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce27f9c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 0x55b60af7dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:47.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce27f9c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b60aee5ea0 con 0x55b60af7b9a0 2024-09-10T21:24:47.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce27f9c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b60aed52d0 con 0x55b60af6f0f0 2024-09-10T21:24:47.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce27f9c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b60aed90e0 con 0x55b60af6fa10 2024-09-10T21:24:47.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce1effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 0x55b60af7dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:47.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce1effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 0x55b60af7dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52538/0 (socket says 172.21.15.59:52538) 2024-09-10T21:24:47.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce1effd640 1 -- 172.21.15.59:0/1323699424 learned_addr learned my addr 172.21.15.59:0/1323699424 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:47.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce1f7fe640 1 --2- 172.21.15.59:0/1323699424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af6fa10 0x55b60af7b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:47.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce1ffff640 1 --2- 172.21.15.59:0/1323699424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 0x55b60af6f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:47.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce1effd640 1 -- 172.21.15.59:0/1323699424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af6fa10 msgr2=0x55b60af7b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:47.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce1effd640 1 --2- 172.21.15.59:0/1323699424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af6fa10 0x55b60af7b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce1effd640 1 -- 172.21.15.59:0/1323699424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 msgr2=0x55b60af6f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:47.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce1effd640 1 --2- 172.21.15.59:0/1323699424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 0x55b60af6f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce1effd640 1 -- 172.21.15.59:0/1323699424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b60ac33650 con 0x55b60af7b9a0 2024-09-10T21:24:47.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.460+0000 7fce1ffff640 1 --2- 172.21.15.59:0/1323699424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 0x55b60af6f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:47.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.461+0000 7fce1effd640 1 --2- 172.21.15.59:0/1323699424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 0x55b60af7dd90 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fce2006c330 tx=0x7fce14032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71c4a74e84b346e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:47.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.461+0000 7fce1cff9640 1 --2- 172.21.15.59:0/3729152620 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fce080b52e0 0x7fce080b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:47.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.461+0000 7fce05ffb640 1 -- 172.21.15.59:0/1323699424 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce14040070 con 0x55b60af7b9a0 2024-09-10T21:24:47.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.461+0000 7fce05ffb640 1 -- 172.21.15.59:0/1323699424 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce14032e50 con 0x55b60af7b9a0 2024-09-10T21:24:47.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.461+0000 7fce1ffff640 1 --2- 172.21.15.59:0/3729152620 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fce080b52e0 0x7fce080b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:47.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.461+0000 7fce05ffb640 1 -- 172.21.15.59:0/1323699424 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce14035040 con 0x55b60af7b9a0 2024-09-10T21:24:47.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.461+0000 7fce1cff9640 1 -- 172.21.15.59:0/3729152620 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fce100e5d10 con 0x7fce20103ce0 2024-09-10T21:24:47.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.462+0000 7fce27f9c740 1 -- 172.21.15.59:0/1323699424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 msgr2=0x55b60af7dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:47.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.462+0000 7fce1ffff640 1 --2- 172.21.15.59:0/3729152620 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fce080b52e0 0x7fce080b77a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fce20103a50 tx=0x7fce18009420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:47.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.462+0000 7fce27f9c740 1 --2- 172.21.15.59:0/1323699424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 0x55b60af7dd90 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fce2006c330 tx=0x7fce14032c60 comp rx=0 tx=0).stop 2024-09-10T21:24:47.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.462+0000 7fce27f9c740 1 -- 172.21.15.59:0/1323699424 shutdown_connections 2024-09-10T21:24:47.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.462+0000 7fce27f9c740 1 --2- 172.21.15.59:0/1323699424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 0x55b60af7dd90 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.462+0000 7fce27f9c740 1 --2- 172.21.15.59:0/1323699424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af6fa10 0x55b60af7b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.462+0000 7fce27f9c740 1 --2- 172.21.15.59:0/1323699424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 0x55b60af6f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.462+0000 7fce27f9c740 1 -- 172.21.15.59:0/1323699424 >> 172.21.15.59:0/1323699424 conn(0x55b60af6cf20 msgr2=0x55b60af6e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.462+0000 7fce27f9c740 1 -- 172.21.15.59:0/1323699424 shutdown_connections 2024-09-10T21:24:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.462+0000 7fce27f9c740 1 -- 172.21.15.59:0/1323699424 wait complete. 2024-09-10T21:24:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.462+0000 7fce27f9c740 1 -- start start 2024-09-10T21:24:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.462+0000 7fce27f9c740 1 Processor -- start 2024-09-10T21:24:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.462+0000 7fce27f9c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 0x55b60af7b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.462+0000 7fce27f9c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af6fa10 0x55b60af786b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.462+0000 7fce27f9c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af7b9a0 0x55b60af78c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fce27f9c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b60ad36700 con 0x55b60af6fa10 2024-09-10T21:24:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fce27f9c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b60ae70160 con 0x55b60af6f0f0 2024-09-10T21:24:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fce27f9c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b60af7e5c0 con 0x55b60af7b9a0 2024-09-10T21:24:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fce27f9c740 10 client.0 _ll_register_callbacks cb 0x55b60ae899e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:47.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fce1effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af6fa10 0x55b60af786b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fce1effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af6fa10 0x55b60af786b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52550/0 (socket says 172.21.15.59:52550) 2024-09-10T21:24:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fce1effd640 1 -- 172.21.15.59:0/2063489714 learned_addr learned my addr 172.21.15.59:0/2063489714 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fce1ffff640 1 --2- 172.21.15.59:0/2063489714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af7b9a0 0x55b60af78c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fce1f7fe640 1 --2- 172.21.15.59:0/2063489714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 0x55b60af7b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fce1effd640 1 -- 172.21.15.59:0/2063489714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af7b9a0 msgr2=0x55b60af78c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fce1effd640 1 --2- 172.21.15.59:0/2063489714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af7b9a0 0x55b60af78c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fce1effd640 1 -- 172.21.15.59:0/2063489714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 msgr2=0x55b60af7b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fce1effd640 1 --2- 172.21.15.59:0/2063489714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 0x55b60af7b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fce1effd640 1 -- 172.21.15.59:0/2063489714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b60ae9dc90 con 0x55b60af6fa10 2024-09-10T21:24:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fce1f7fe640 1 --2- 172.21.15.59:0/2063489714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 0x55b60af7b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fce1effd640 1 --2- 172.21.15.59:0/2063489714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af6fa10 0x55b60af786b0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fce14006010 tx=0x7fce14005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ecb09e62feb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fcdfeffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:47.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fcdfeffd640 1 -- 172.21.15.59:0/2063489714 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1404b020 con 0x55b60af6fa10 2024-09-10T21:24:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fcdfeffd640 1 -- 172.21.15.59:0/2063489714 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fce14004040 con 0x55b60af6fa10 2024-09-10T21:24:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.463+0000 7fce27f9c740 1 -- 172.21.15.59:0/2063489714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce14032e50 con 0x55b60af6fa10 2024-09-10T21:24:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.464+0000 7fcdfeffd640 1 -- 172.21.15.59:0/2063489714 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fce14035070 con 0x55b60af6fa10 2024-09-10T21:24:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.464+0000 7fce27f9c740 10 client.17628 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.464+0000 7fce27f9c740 1 -- 172.21.15.59:0/2063489714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b60af89e90 con 0x55b60af6fa10 2024-09-10T21:24:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.464+0000 7fcdfeffd640 1 -- 172.21.15.59:0/2063489714 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce14032e50 con 0x55b60af6fa10 2024-09-10T21:24:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.464+0000 7fcdfeffd640 1 -- 172.21.15.59:0/2063489714 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fce14004750 con 0x55b60af6fa10 2024-09-10T21:24:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.464+0000 7fce27f9c740 10 client.17628 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.464+0000 7fce27f9c740 10 client.17628 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:24:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.464+0000 7fce27f9c740 20 client.17628 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.464+0000 7fce27f9c740 1 --2- 172.21.15.59:0/2063489714 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55b60af8b1e0 0x55b60af8d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.464+0000 7fce27f9c740 4 client.17628 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:24:47.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.464+0000 7fce27f9c740 1 -- 172.21.15.59:0/2063489714 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b60aee7df0 con 0x55b60af8b1e0 2024-09-10T21:24:47.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.464+0000 7fce1f7fe640 1 --2- 172.21.15.59:0/2063489714 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55b60af8b1e0 0x55b60af8d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:47.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.465+0000 7fce1f7fe640 1 --2- 172.21.15.59:0/2063489714 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55b60af8b1e0 0x55b60af8d5d0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=78113a4d85d2464e server_cookie=8aa1f8b9f51b6d83 in_seq=0 out_seq=0 2024-09-10T21:24:47.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.465+0000 7fcdfeffd640 10 client.17628 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:24:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.465+0000 7fcdfeffd640 1 -- 172.21.15.59:0/2063489714 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b60aee7df0 con 0x55b60af8b1e0 2024-09-10T21:24:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.465+0000 7fcdfeffd640 10 client.17628 handle_command_reply: tid=0 2024-09-10T21:24:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.466+0000 7fce27f9c740 1 client.17628 shutdown 2024-09-10T21:24:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.466+0000 7fce27f9c740 1 -- 172.21.15.59:0/2063489714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af6fa10 msgr2=0x55b60af786b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.466+0000 7fce27f9c740 1 --2- 172.21.15.59:0/2063489714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af6fa10 0x55b60af786b0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fce14006010 tx=0x7fce14005590 comp rx=0 tx=0).stop 2024-09-10T21:24:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.466+0000 7fce27f9c740 1 -- 172.21.15.59:0/2063489714 shutdown_connections 2024-09-10T21:24:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.466+0000 7fce27f9c740 1 --2- 172.21.15.59:0/2063489714 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55b60af8b1e0 0x55b60af8d5d0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.466+0000 7fce27f9c740 1 --2- 172.21.15.59:0/2063489714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af7b9a0 0x55b60af78c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.466+0000 7fce27f9c740 1 --2- 172.21.15.59:0/2063489714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af6fa10 0x55b60af786b0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.466+0000 7fce27f9c740 1 --2- 172.21.15.59:0/2063489714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 0x55b60af7b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.466+0000 7fce27f9c740 1 -- 172.21.15.59:0/2063489714 >> 172.21.15.59:0/2063489714 conn(0x55b60af6cf20 msgr2=0x55b60af72a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.466+0000 7fcdfeffd640 0 client.17628 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:24:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.466+0000 7fce27f9c740 1 -- 172.21.15.59:0/2063489714 shutdown_connections 2024-09-10T21:24:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.466+0000 7fce27f9c740 1 -- 172.21.15.59:0/2063489714 wait complete. 2024-09-10T21:24:47.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.466+0000 7fce27f9c740 20 client.17628 trim_cache size 0 max 16384 2024-09-10T21:24:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.479+0000 7fce27f9c740 1 Processor -- start 2024-09-10T21:24:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.479+0000 7fce27f9c740 1 -- start start 2024-09-10T21:24:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.480+0000 7fce27f9c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 0x55b60af6c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.480+0000 7fce27f9c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af6fa10 0x55b60af7cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:47.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.480+0000 7fce27f9c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 0x55b60af7d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.480+0000 7fce27f9c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fce201b0450 con 0x55b60af7b9a0 2024-09-10T21:24:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.480+0000 7fce27f9c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fce201b1f90 con 0x55b60af6f0f0 2024-09-10T21:24:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.480+0000 7fce27f9c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fce201b0b20 con 0x55b60af6fa10 2024-09-10T21:24:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.480+0000 7fce1ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 0x55b60af7d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.480+0000 7fce1ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 0x55b60af7d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52560/0 (socket says 172.21.15.59:52560) 2024-09-10T21:24:47.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.480+0000 7fce1ffff640 1 -- 172.21.15.59:0/1941045437 learned_addr learned my addr 172.21.15.59:0/1941045437 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.480+0000 7fce1f7fe640 1 --2- 172.21.15.59:0/1941045437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 0x55b60af6c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.480+0000 7fce1effd640 1 --2- 172.21.15.59:0/1941045437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af6fa10 0x55b60af7cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.480+0000 7fce1ffff640 1 -- 172.21.15.59:0/1941045437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af6fa10 msgr2=0x55b60af7cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.480+0000 7fce1ffff640 1 --2- 172.21.15.59:0/1941045437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af6fa10 0x55b60af7cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.480+0000 7fce1ffff640 1 -- 172.21.15.59:0/1941045437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 msgr2=0x55b60af6c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.480+0000 7fce1ffff640 1 --2- 172.21.15.59:0/1941045437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 0x55b60af6c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.480+0000 7fce1ffff640 1 -- 172.21.15.59:0/1941045437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b60af687e0 con 0x55b60af7b9a0 2024-09-10T21:24:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.480+0000 7fce1f7fe640 1 --2- 172.21.15.59:0/1941045437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 0x55b60af6c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.480+0000 7fce1ffff640 1 --2- 172.21.15.59:0/1941045437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 0x55b60af7d2d0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fce18011790 tx=0x7fce18013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1552caa607a1dd82 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.480+0000 7fce057fa640 1 -- 172.21.15.59:0/1941045437 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18011e50 con 0x55b60af7b9a0 2024-09-10T21:24:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.481+0000 7fce057fa640 1 -- 172.21.15.59:0/1941045437 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce1801d930 con 0x55b60af7b9a0 2024-09-10T21:24:47.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.481+0000 7fce057fa640 1 -- 172.21.15.59:0/1941045437 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18005620 con 0x55b60af7b9a0 2024-09-10T21:24:47.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.481+0000 7fce27f9c740 1 -- 172.21.15.59:0/1941045437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 msgr2=0x55b60af7d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:47.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.481+0000 7fce27f9c740 1 --2- 172.21.15.59:0/1941045437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 0x55b60af7d2d0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fce18011790 tx=0x7fce18013000 comp rx=0 tx=0).stop 2024-09-10T21:24:47.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.481+0000 7fce27f9c740 1 -- 172.21.15.59:0/1941045437 shutdown_connections 2024-09-10T21:24:47.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.481+0000 7fce27f9c740 1 --2- 172.21.15.59:0/1941045437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 0x55b60af7d2d0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.481+0000 7fce27f9c740 1 --2- 172.21.15.59:0/1941045437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af6fa10 0x55b60af7cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.481+0000 7fce27f9c740 1 --2- 172.21.15.59:0/1941045437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 0x55b60af6c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.481+0000 7fce27f9c740 1 -- 172.21.15.59:0/1941045437 >> 172.21.15.59:0/1941045437 conn(0x55b60af6cf20 msgr2=0x55b60af7a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:47.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.481+0000 7fce27f9c740 1 -- 172.21.15.59:0/1941045437 shutdown_connections 2024-09-10T21:24:47.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.481+0000 7fce27f9c740 1 -- 172.21.15.59:0/1941045437 wait complete. 2024-09-10T21:24:47.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.481+0000 7fce27f9c740 1 -- start start 2024-09-10T21:24:47.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.482+0000 7fce27f9c740 1 Processor -- start 2024-09-10T21:24:47.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.482+0000 7fce27f9c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 0x55b60af8c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:47.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.482+0000 7fce27f9c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af6fa10 0x55b60af8c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:47.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.482+0000 7fce27f9c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 0x55b60af8cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:47.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.482+0000 7fce27f9c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fce201b18c0 con 0x55b60af7b9a0 2024-09-10T21:24:47.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.482+0000 7fce27f9c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fce201b11f0 con 0x55b60af6f0f0 2024-09-10T21:24:47.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.482+0000 7fce27f9c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fce201ae430 con 0x55b60af6fa10 2024-09-10T21:24:47.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.482+0000 7fce27f9c740 10 client.0 _ll_register_callbacks cb 0x7fce14032bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:47.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.482+0000 7fce1ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 0x55b60af8cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:47.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.482+0000 7fce1ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 0x55b60af8cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52572/0 (socket says 172.21.15.59:52572) 2024-09-10T21:24:47.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.482+0000 7fce1ffff640 1 -- 172.21.15.59:0/2665262493 learned_addr learned my addr 172.21.15.59:0/2665262493 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:47.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.482+0000 7fce1f7fe640 1 --2- 172.21.15.59:0/2665262493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 0x55b60af8c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:47.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.482+0000 7fce1effd640 1 --2- 172.21.15.59:0/2665262493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af6fa10 0x55b60af8c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:47.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.483+0000 7fce1ffff640 1 -- 172.21.15.59:0/2665262493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af6fa10 msgr2=0x55b60af8c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:47.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.483+0000 7fce1ffff640 1 --2- 172.21.15.59:0/2665262493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af6fa10 0x55b60af8c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.483+0000 7fce1ffff640 1 -- 172.21.15.59:0/2665262493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 msgr2=0x55b60af8c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:47.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.483+0000 7fce1ffff640 1 --2- 172.21.15.59:0/2665262493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 0x55b60af8c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.483+0000 7fce1ffff640 1 -- 172.21.15.59:0/2665262493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b60aff6dc0 con 0x55b60af7b9a0 2024-09-10T21:24:47.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.483+0000 7fce1ffff640 1 --2- 172.21.15.59:0/2665262493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 0x55b60af8cc20 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fce18006010 tx=0x7fce1801dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d25bb8ffbfdd1d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:47.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.483+0000 7fcdfeffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:47.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.483+0000 7fcdfeffd640 1 -- 172.21.15.59:0/2665262493 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18004c50 con 0x55b60af7b9a0 2024-09-10T21:24:47.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.483+0000 7fcdfeffd640 1 -- 172.21.15.59:0/2665262493 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fce18003970 con 0x55b60af7b9a0 2024-09-10T21:24:47.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.483+0000 7fce27f9c740 1 -- 172.21.15.59:0/2665262493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce1801d930 con 0x55b60af7b9a0 2024-09-10T21:24:47.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.483+0000 7fcdfeffd640 1 -- 172.21.15.59:0/2665262493 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fce18004df0 con 0x55b60af7b9a0 2024-09-10T21:24:47.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.483+0000 7fce27f9c740 10 client.17634 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:47.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.483+0000 7fce27f9c740 1 -- 172.21.15.59:0/2665262493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b60aff80a0 con 0x55b60af7b9a0 2024-09-10T21:24:47.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.483+0000 7fcdfeffd640 1 -- 172.21.15.59:0/2665262493 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce1801d930 con 0x55b60af7b9a0 2024-09-10T21:24:47.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.484+0000 7fcdfeffd640 1 -- 172.21.15.59:0/2665262493 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fce1803e5a0 con 0x55b60af7b9a0 2024-09-10T21:24:47.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.484+0000 7fce27f9c740 10 client.17634 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:47.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.484+0000 7fce27f9c740 10 client.17634 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:24:47.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.484+0000 7fce27f9c740 20 client.17634 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:47.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.484+0000 7fce27f9c740 1 --2- 172.21.15.59:0/2665262493 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55b60aff8740 0x55b60affab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:47.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.484+0000 7fce27f9c740 4 client.17634 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:24:47.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.484+0000 7fce27f9c740 1 -- 172.21.15.59:0/2665262493 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b60aee38a0 con 0x55b60aff8740 2024-09-10T21:24:47.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.484+0000 7fce1f7fe640 1 --2- 172.21.15.59:0/2665262493 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55b60aff8740 0x55b60affab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:47.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.484+0000 7fce1f7fe640 1 --2- 172.21.15.59:0/2665262493 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55b60aff8740 0x55b60affab60 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=973716bb6690eb5a server_cookie=5ea213f3cb110833 in_seq=0 out_seq=0 2024-09-10T21:24:47.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.484+0000 7fcdfeffd640 10 client.17634 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:24:47.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.485+0000 7fcdfeffd640 1 -- 172.21.15.59:0/2665262493 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b60aee38a0 con 0x55b60aff8740 2024-09-10T21:24:47.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.485+0000 7fcdfeffd640 10 client.17634 handle_command_reply: tid=0 2024-09-10T21:24:47.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.485+0000 7fce27f9c740 1 client.17634 shutdown 2024-09-10T21:24:47.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.485+0000 7fce27f9c740 1 -- 172.21.15.59:0/2665262493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 msgr2=0x55b60af8cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:47.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.485+0000 7fce27f9c740 1 --2- 172.21.15.59:0/2665262493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 0x55b60af8cc20 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fce18006010 tx=0x7fce1801dd10 comp rx=0 tx=0).stop 2024-09-10T21:24:47.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.485+0000 7fce27f9c740 1 -- 172.21.15.59:0/2665262493 shutdown_connections 2024-09-10T21:24:47.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.485+0000 7fce27f9c740 1 --2- 172.21.15.59:0/2665262493 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55b60aff8740 0x55b60affab60 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.485+0000 7fce27f9c740 1 --2- 172.21.15.59:0/2665262493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60af7b9a0 0x55b60af8cc20 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.485+0000 7fce27f9c740 1 --2- 172.21.15.59:0/2665262493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b60af6fa10 0x55b60af8c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.485+0000 7fce27f9c740 1 --2- 172.21.15.59:0/2665262493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b60af6f0f0 0x55b60af8c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.485+0000 7fce27f9c740 1 -- 172.21.15.59:0/2665262493 >> 172.21.15.59:0/2665262493 conn(0x55b60af6cf20 msgr2=0x55b60af76f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:47.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.485+0000 7fcdfeffd640 0 client.17634 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:24:47.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.485+0000 7fce27f9c740 1 -- 172.21.15.59:0/2665262493 shutdown_connections 2024-09-10T21:24:47.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.485+0000 7fce27f9c740 1 -- 172.21.15.59:0/2665262493 wait complete. 2024-09-10T21:24:47.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.485+0000 7fce27f9c740 20 client.17634 trim_cache size 0 max 16384 2024-09-10T21:24:47.494 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:24:47.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.486+0000 7fce25bc7640 1 -- 172.21.15.59:0/3729152620 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fce080b52e0 msgr2=0x7fce080b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:47.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.486+0000 7fce25bc7640 1 --2- 172.21.15.59:0/3729152620 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fce080b52e0 0x7fce080b77a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fce20103a50 tx=0x7fce18009420 comp rx=0 tx=0).stop 2024-09-10T21:24:47.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.486+0000 7fce25bc7640 1 -- 172.21.15.59:0/3729152620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce20103ce0 msgr2=0x7fce20101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:47.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.486+0000 7fce25bc7640 1 --2- 172.21.15.59:0/3729152620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce20103ce0 0x7fce20101990 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fce1000c920 tx=0x7fce1000cde0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.486+0000 7fce25bc7640 1 -- 172.21.15.59:0/3729152620 shutdown_connections 2024-09-10T21:24:47.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.486+0000 7fce25bc7640 1 --2- 172.21.15.59:0/3729152620 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fce080b52e0 0x7fce080b77a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.486+0000 7fce25bc7640 1 --2- 172.21.15.59:0/3729152620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce2010d140 0x7fce20102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.486+0000 7fce25bc7640 1 --2- 172.21.15.59:0/3729152620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce20104600 0x7fce20101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.486+0000 7fce25bc7640 1 --2- 172.21.15.59:0/3729152620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce20103ce0 0x7fce20101990 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:47.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.486+0000 7fce25bc7640 1 -- 172.21.15.59:0/3729152620 >> 172.21.15.59:0/3729152620 conn(0x7fce200fd700 msgr2=0x7fce200fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:47.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.486+0000 7fce25bc7640 1 -- 172.21.15.59:0/3729152620 shutdown_connections 2024-09-10T21:24:47.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:47.486+0000 7fce25bc7640 1 -- 172.21.15.59:0/3729152620 wait complete. 2024-09-10T21:24:48.288 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:24:48.552 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:24:48.782 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:48 smithi059 ceph-mon[30888]: pgmap v626: 97 pgs: 97 active+clean; 6.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:24:48.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:48 smithi192 ceph-mon[35363]: pgmap v626: 97 pgs: 97 active+clean; 6.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:24:48.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:48 smithi154 ceph-mon[35041]: pgmap v626: 97 pgs: 97 active+clean; 6.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:24:49.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.997+0000 7f243359e640 1 -- 172.21.15.59:0/3908888602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2434108fa0 msgr2=0x7f243410f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:49.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.997+0000 7f243359e640 1 --2- 172.21.15.59:0/3908888602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2434108fa0 0x7f243410f7a0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f242c009900 tx=0x7f242c02a410 comp rx=0 tx=0).stop 2024-09-10T21:24:49.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.997+0000 7f243359e640 1 -- 172.21.15.59:0/3908888602 shutdown_connections 2024-09-10T21:24:49.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.997+0000 7f243359e640 1 --2- 172.21.15.59:0/3908888602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2434108fa0 0x7f243410f7a0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.997+0000 7f243359e640 1 --2- 172.21.15.59:0/3908888602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2434108620 0x7f2434108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.997+0000 7f243359e640 1 --2- 172.21.15.59:0/3908888602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2434102c10 0x7f2434102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.997+0000 7f243359e640 1 -- 172.21.15.59:0/3908888602 >> 172.21.15.59:0/3908888602 conn(0x7f24340fe6c0 msgr2=0x7f2434100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.997+0000 7f243359e640 1 -- 172.21.15.59:0/3908888602 shutdown_connections 2024-09-10T21:24:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.997+0000 7f243359e640 1 -- 172.21.15.59:0/3908888602 wait complete. 2024-09-10T21:24:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.998+0000 7f243359e640 1 Processor -- start 2024-09-10T21:24:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.998+0000 7f243359e640 1 -- start start 2024-09-10T21:24:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.998+0000 7f243359e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2434102c10 0x7f2434198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.998+0000 7f243359e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2434108620 0x7f2434199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.998+0000 7f243359e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2434108fa0 0x7f243419e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.998+0000 7f243359e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2434112c60 con 0x7f2434108fa0 2024-09-10T21:24:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.998+0000 7f243359e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2434112ae0 con 0x7f2434102c10 2024-09-10T21:24:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.998+0000 7f243359e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2434112de0 con 0x7f2434108620 2024-09-10T21:24:49.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.999+0000 7f243259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2434102c10 0x7f2434198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:49.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.999+0000 7f2431d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2434108620 0x7f2434199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:49.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.999+0000 7f2432d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2434108fa0 0x7f243419e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:49.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.999+0000 7f2431d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2434108620 0x7f2434199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:49006/0 (socket says 172.21.15.59:49006) 2024-09-10T21:24:49.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.999+0000 7f243259c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2434102c10 0x7f2434198f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:56154/0 (socket says 172.21.15.59:56154) 2024-09-10T21:24:49.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.999+0000 7f2431d9b640 1 -- 172.21.15.59:0/1108706543 learned_addr learned my addr 172.21.15.59:0/1108706543 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:49.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.999+0000 7f2432d9d640 1 -- 172.21.15.59:0/1108706543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2434108620 msgr2=0x7f2434199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:49.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.999+0000 7f2432d9d640 1 --2- 172.21.15.59:0/1108706543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2434108620 0x7f2434199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.999+0000 7f2432d9d640 1 -- 172.21.15.59:0/1108706543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2434102c10 msgr2=0x7f2434198f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:49.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.999+0000 7f2432d9d640 1 --2- 172.21.15.59:0/1108706543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2434102c10 0x7f2434198f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.999+0000 7f2432d9d640 1 -- 172.21.15.59:0/1108706543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243419efe0 con 0x7f2434108fa0 2024-09-10T21:24:49.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.999+0000 7f2432d9d640 1 --2- 172.21.15.59:0/1108706543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2434108fa0 0x7f243419e810 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f242c005940 tx=0x7f242c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:49.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.999+0000 7f24237fe640 1 -- 172.21.15.59:0/1108706543 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c03f030 con 0x7f2434108fa0 2024-09-10T21:24:49.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.999+0000 7f24237fe640 1 -- 172.21.15.59:0/1108706543 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f242c003cb0 con 0x7f2434108fa0 2024-09-10T21:24:49.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.999+0000 7f243359e640 1 -- 172.21.15.59:0/1108706543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f243419f270 con 0x7f2434108fa0 2024-09-10T21:24:49.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.999+0000 7f24237fe640 1 -- 172.21.15.59:0/1108706543 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c035070 con 0x7f2434108fa0 2024-09-10T21:24:49.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:48.999+0000 7f243359e640 1 -- 172.21.15.59:0/1108706543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24341a5990 con 0x7f2434108fa0 2024-09-10T21:24:49.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.002+0000 7f24237fe640 1 -- 172.21.15.59:0/1108706543 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f242c003800 con 0x7f2434108fa0 2024-09-10T21:24:49.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.002+0000 7f243afd8740 1 Processor -- start 2024-09-10T21:24:49.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.002+0000 7f243afd8740 1 -- start start 2024-09-10T21:24:49.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.002+0000 7f243afd8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 0x5576d361ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:49.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.002+0000 7f243afd8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576d361efc0 0x5576d362aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:49.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.002+0000 7f243afd8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576d362af50 0x5576d362d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:49.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.002+0000 7f243afd8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5576d3594ea0 con 0x5576d361e6a0 2024-09-10T21:24:49.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.002+0000 7f243afd8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5576d35842d0 con 0x5576d362af50 2024-09-10T21:24:49.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.002+0000 7f243afd8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5576d35880e0 con 0x5576d361efc0 2024-09-10T21:24:49.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.002+0000 7f2431d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 0x5576d361ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:49.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.002+0000 7f2431d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 0x5576d361ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52594/0 (socket says 172.21.15.59:52594) 2024-09-10T21:24:49.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.002+0000 7f2431d9b640 1 -- 172.21.15.59:0/2450338858 learned_addr learned my addr 172.21.15.59:0/2450338858 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:49.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.003+0000 7f243259c640 1 --2- 172.21.15.59:0/2450338858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576d361efc0 0x5576d362aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:49.064 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:24:49.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.003+0000 7f2431d9b640 1 --2- 172.21.15.59:0/2450338858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576d362af50 0x5576d362d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:49.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.003+0000 7f24237fe640 1 --2- 172.21.15.59:0/1108706543 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f241c0b5390 0x7f241c0b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:49.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.003+0000 7f2431d9b640 1 -- 172.21.15.59:0/2450338858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576d361efc0 msgr2=0x5576d362aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:49.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.003+0000 7f2431d9b640 1 --2- 172.21.15.59:0/2450338858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576d361efc0 0x5576d362aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.003+0000 7f2431d9b640 1 -- 172.21.15.59:0/2450338858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576d362af50 msgr2=0x5576d362d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.003+0000 7f2431d9b640 1 --2- 172.21.15.59:0/2450338858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576d362af50 0x5576d362d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.003+0000 7f2431d9b640 1 -- 172.21.15.59:0/2450338858 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576d32e2650 con 0x5576d361e6a0 2024-09-10T21:24:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.003+0000 7f2432d9d640 1 --2- 172.21.15.59:0/1108706543 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f241c0b5390 0x7f241c0b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.003+0000 7f2431d9b640 1 --2- 172.21.15.59:0/2450338858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 0x5576d361ea80 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f24280139a0 tx=0x7f2428007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84d8e5876463fea server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.003+0000 7f24237fe640 1 -- 172.21.15.59:0/1108706543 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f242c106210 con 0x7f2434108fa0 2024-09-10T21:24:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.003+0000 7f2420ff9640 1 -- 172.21.15.59:0/2450338858 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24280110d0 con 0x5576d361e6a0 2024-09-10T21:24:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.003+0000 7f2420ff9640 1 -- 172.21.15.59:0/2450338858 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2428011af0 con 0x5576d361e6a0 2024-09-10T21:24:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.003+0000 7f2420ff9640 1 -- 172.21.15.59:0/2450338858 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24280054a0 con 0x5576d361e6a0 2024-09-10T21:24:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.004+0000 7f243afd8740 1 -- 172.21.15.59:0/2450338858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 msgr2=0x5576d361ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.004+0000 7f243afd8740 1 --2- 172.21.15.59:0/2450338858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 0x5576d361ea80 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f24280139a0 tx=0x7f2428007bc0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.004+0000 7f2432d9d640 1 --2- 172.21.15.59:0/1108706543 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f241c0b5390 0x7f241c0b7850 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f242c0c9020 tx=0x7f242c099f20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:49.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.004+0000 7f243afd8740 1 -- 172.21.15.59:0/2450338858 shutdown_connections 2024-09-10T21:24:49.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.004+0000 7f243afd8740 1 --2- 172.21.15.59:0/2450338858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576d362af50 0x5576d362d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.004+0000 7f243afd8740 1 --2- 172.21.15.59:0/2450338858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576d361efc0 0x5576d362aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.004+0000 7f243afd8740 1 --2- 172.21.15.59:0/2450338858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 0x5576d361ea80 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.004+0000 7f243afd8740 1 -- 172.21.15.59:0/2450338858 >> 172.21.15.59:0/2450338858 conn(0x5576d361c4d0 msgr2=0x5576d361d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:49.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.004+0000 7f243afd8740 1 -- 172.21.15.59:0/2450338858 shutdown_connections 2024-09-10T21:24:49.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.004+0000 7f243afd8740 1 -- 172.21.15.59:0/2450338858 wait complete. 2024-09-10T21:24:49.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.004+0000 7f243afd8740 1 -- start start 2024-09-10T21:24:49.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f243afd8740 1 Processor -- start 2024-09-10T21:24:49.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f243afd8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576d361e6a0 0x5576d362a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:49.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f243afd8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361efc0 0x5576d3627bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:49.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f243afd8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576d362af50 0x5576d3628110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:49.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f243afd8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5576d33e5700 con 0x5576d361efc0 2024-09-10T21:24:49.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f243afd8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5576d351f160 con 0x5576d361e6a0 2024-09-10T21:24:49.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f243afd8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5576d362dbd0 con 0x5576d362af50 2024-09-10T21:24:49.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f243afd8740 10 client.0 _ll_register_callbacks cb 0x5576d35389e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:49.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f243259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361efc0 0x5576d3627bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:49.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f243259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361efc0 0x5576d3627bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52604/0 (socket says 172.21.15.59:52604) 2024-09-10T21:24:49.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f243259c640 1 -- 172.21.15.59:0/1519613678 learned_addr learned my addr 172.21.15.59:0/1519613678 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:49.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f2431d9b640 1 --2- 172.21.15.59:0/1519613678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576d361e6a0 0x5576d362a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:49.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f2431d9b640 1 --2- 172.21.15.59:0/1519613678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576d362af50 0x5576d3628110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:49.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f243259c640 1 -- 172.21.15.59:0/1519613678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576d362af50 msgr2=0x5576d3628110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:49.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f243259c640 1 --2- 172.21.15.59:0/1519613678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576d362af50 0x5576d3628110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f243259c640 1 -- 172.21.15.59:0/1519613678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576d361e6a0 msgr2=0x5576d362a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:49.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f243259c640 1 --2- 172.21.15.59:0/1519613678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576d361e6a0 0x5576d362a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f243259c640 1 -- 172.21.15.59:0/1519613678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576d354cc90 con 0x5576d361efc0 2024-09-10T21:24:49.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f2431d9b640 1 --2- 172.21.15.59:0/1519613678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576d361e6a0 0x5576d362a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:49.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f243259c640 1 --2- 172.21.15.59:0/1519613678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361efc0 0x5576d3627bd0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f242400bad0 tx=0x7f242400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64a81c6b1f4cea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:49.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.005+0000 7f2419ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:49.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.006+0000 7f2419ffb640 1 -- 172.21.15.59:0/1519613678 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424005020 con 0x5576d361efc0 2024-09-10T21:24:49.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.006+0000 7f2419ffb640 1 -- 172.21.15.59:0/1519613678 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f24240051c0 con 0x5576d361efc0 2024-09-10T21:24:49.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.006+0000 7f243afd8740 1 -- 172.21.15.59:0/1519613678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2428011af0 con 0x5576d361efc0 2024-09-10T21:24:49.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.006+0000 7f2419ffb640 1 -- 172.21.15.59:0/1519613678 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2424005400 con 0x5576d361efc0 2024-09-10T21:24:49.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.006+0000 7f243afd8740 10 client.17646 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:49.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.006+0000 7f243afd8740 1 -- 172.21.15.59:0/1519613678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5576d363d8b0 con 0x5576d361efc0 2024-09-10T21:24:49.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.006+0000 7f2419ffb640 1 -- 172.21.15.59:0/1519613678 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2428011af0 con 0x5576d361efc0 2024-09-10T21:24:49.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.006+0000 7f2419ffb640 1 -- 172.21.15.59:0/1519613678 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f242401b670 con 0x5576d361efc0 2024-09-10T21:24:49.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.006+0000 7f243afd8740 10 client.17646 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:49.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.006+0000 7f243afd8740 10 client.17646 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:24:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.006+0000 7f243afd8740 20 client.17646 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.006+0000 7f243afd8740 1 --2- 172.21.15.59:0/1519613678 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5576d363ed70 0x5576d3641160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.006+0000 7f243afd8740 4 client.17646 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:24:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.006+0000 7f243afd8740 1 -- 172.21.15.59:0/1519613678 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576d3596df0 con 0x5576d363ed70 2024-09-10T21:24:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.007+0000 7f2431d9b640 1 --2- 172.21.15.59:0/1519613678 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5576d363ed70 0x5576d3641160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.007+0000 7f2419ffb640 10 client.17646 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:24:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.007+0000 7f2431d9b640 1 --2- 172.21.15.59:0/1519613678 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5576d363ed70 0x5576d3641160 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=56354ea1b2a6ffdb server_cookie=4ee9e7e00145fe4b in_seq=0 out_seq=0 2024-09-10T21:24:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.008+0000 7f2419ffb640 1 -- 172.21.15.59:0/1519613678 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5576d3596df0 con 0x5576d363ed70 2024-09-10T21:24:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.008+0000 7f2419ffb640 10 client.17646 handle_command_reply: tid=0 2024-09-10T21:24:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.008+0000 7f243afd8740 1 client.17646 shutdown 2024-09-10T21:24:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.008+0000 7f243afd8740 1 -- 172.21.15.59:0/1519613678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361efc0 msgr2=0x5576d3627bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:49.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.008+0000 7f243afd8740 1 --2- 172.21.15.59:0/1519613678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361efc0 0x5576d3627bd0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f242400bad0 tx=0x7f242400bed0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.008+0000 7f243afd8740 1 -- 172.21.15.59:0/1519613678 shutdown_connections 2024-09-10T21:24:49.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.008+0000 7f243afd8740 1 --2- 172.21.15.59:0/1519613678 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5576d363ed70 0x5576d3641160 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.008+0000 7f2419ffb640 0 client.17646 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:24:49.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.008+0000 7f243afd8740 1 --2- 172.21.15.59:0/1519613678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576d362af50 0x5576d3628110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.008+0000 7f243afd8740 1 --2- 172.21.15.59:0/1519613678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361efc0 0x5576d3627bd0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.008+0000 7f243afd8740 1 --2- 172.21.15.59:0/1519613678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576d361e6a0 0x5576d362a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.008+0000 7f243afd8740 1 -- 172.21.15.59:0/1519613678 >> 172.21.15.59:0/1519613678 conn(0x5576d361c4d0 msgr2=0x5576d3622040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:49.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.008+0000 7f243afd8740 1 -- 172.21.15.59:0/1519613678 shutdown_connections 2024-09-10T21:24:49.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.008+0000 7f243afd8740 1 -- 172.21.15.59:0/1519613678 wait complete. 2024-09-10T21:24:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.008+0000 7f243afd8740 20 client.17646 trim_cache size 0 max 16384 2024-09-10T21:24:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.021+0000 7f243afd8740 1 Processor -- start 2024-09-10T21:24:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.021+0000 7f243afd8740 1 -- start start 2024-09-10T21:24:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.022+0000 7f243afd8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 0x5576d361be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.022+0000 7f243afd8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576d361efc0 0x5576d361d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.022+0000 7f243afd8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576d362af50 0x5576d3624de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.022+0000 7f243afd8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f24341abd80 con 0x5576d361e6a0 2024-09-10T21:24:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.022+0000 7f243afd8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24341ad8c0 con 0x5576d362af50 2024-09-10T21:24:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.022+0000 7f243afd8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f24341ac450 con 0x5576d361efc0 2024-09-10T21:24:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.022+0000 7f2431d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 0x5576d361be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:49.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.022+0000 7f2431d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 0x5576d361be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52612/0 (socket says 172.21.15.59:52612) 2024-09-10T21:24:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.022+0000 7f2431d9b640 1 -- 172.21.15.59:0/1095975826 learned_addr learned my addr 172.21.15.59:0/1095975826 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.022+0000 7f243259c640 1 --2- 172.21.15.59:0/1095975826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576d361efc0 0x5576d361d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.022+0000 7f2431d9b640 1 -- 172.21.15.59:0/1095975826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576d361efc0 msgr2=0x5576d361d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.022+0000 7f2431d9b640 1 --2- 172.21.15.59:0/1095975826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576d361efc0 0x5576d361d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.022+0000 7f2431d9b640 1 -- 172.21.15.59:0/1095975826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576d362af50 msgr2=0x5576d3624de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.022+0000 7f2431d9b640 1 --2- 172.21.15.59:0/1095975826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576d362af50 0x5576d3624de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.022+0000 7f2431d9b640 1 -- 172.21.15.59:0/1095975826 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576d3622920 con 0x5576d361e6a0 2024-09-10T21:24:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.022+0000 7f2431d9b640 1 --2- 172.21.15.59:0/1095975826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 0x5576d361be60 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f2428005130 tx=0x7f2428013770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9555f268261a40c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.022+0000 7f241bfff640 1 -- 172.21.15.59:0/1095975826 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2428011cf0 con 0x5576d361e6a0 2024-09-10T21:24:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.022+0000 7f241bfff640 1 -- 172.21.15.59:0/1095975826 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f242802f070 con 0x5576d361e6a0 2024-09-10T21:24:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.022+0000 7f241bfff640 1 -- 172.21.15.59:0/1095975826 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24280056d0 con 0x5576d361e6a0 2024-09-10T21:24:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.023+0000 7f243afd8740 1 -- 172.21.15.59:0/1095975826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 msgr2=0x5576d361be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:49.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.023+0000 7f243afd8740 1 --2- 172.21.15.59:0/1095975826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 0x5576d361be60 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f2428005130 tx=0x7f2428013770 comp rx=0 tx=0).stop 2024-09-10T21:24:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.023+0000 7f243afd8740 1 -- 172.21.15.59:0/1095975826 shutdown_connections 2024-09-10T21:24:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.023+0000 7f243afd8740 1 --2- 172.21.15.59:0/1095975826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576d362af50 0x5576d3624de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.023+0000 7f243afd8740 1 --2- 172.21.15.59:0/1095975826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576d361efc0 0x5576d361d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.023+0000 7f243afd8740 1 --2- 172.21.15.59:0/1095975826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 0x5576d361be60 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.023+0000 7f243afd8740 1 -- 172.21.15.59:0/1095975826 >> 172.21.15.59:0/1095975826 conn(0x5576d361c4d0 msgr2=0x5576d3626450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.023+0000 7f243afd8740 1 -- 172.21.15.59:0/1095975826 shutdown_connections 2024-09-10T21:24:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.023+0000 7f243afd8740 1 -- 172.21.15.59:0/1095975826 wait complete. 2024-09-10T21:24:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.023+0000 7f243afd8740 1 -- start start 2024-09-10T21:24:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.024+0000 7f243afd8740 1 Processor -- start 2024-09-10T21:24:49.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.024+0000 7f243afd8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 0x5576d3633d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.024+0000 7f243afd8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576d361efc0 0x5576d3634320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.024+0000 7f243afd8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576d362af50 0x5576d36a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.024+0000 7f243afd8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f24341ad1f0 con 0x5576d361e6a0 2024-09-10T21:24:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.024+0000 7f243afd8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24341acb20 con 0x5576d361efc0 2024-09-10T21:24:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.024+0000 7f243afd8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f24341a9d80 con 0x5576d362af50 2024-09-10T21:24:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.024+0000 7f243afd8740 10 client.0 _ll_register_callbacks cb 0x7f24240040a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.024+0000 7f2431d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 0x5576d3633d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.024+0000 7f2431d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 0x5576d3633d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52628/0 (socket says 172.21.15.59:52628) 2024-09-10T21:24:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.024+0000 7f2431d9b640 1 -- 172.21.15.59:0/3889176932 learned_addr learned my addr 172.21.15.59:0/3889176932 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.024+0000 7f2431d9b640 1 -- 172.21.15.59:0/3889176932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576d362af50 msgr2=0x5576d36a4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:49.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.024+0000 7f2431d9b640 1 --2- 172.21.15.59:0/3889176932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576d362af50 0x5576d36a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.024+0000 7f2431d9b640 1 -- 172.21.15.59:0/3889176932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576d361efc0 msgr2=0x5576d3634320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.024+0000 7f2431d9b640 1 --2- 172.21.15.59:0/3889176932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576d361efc0 0x5576d3634320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.024+0000 7f2431d9b640 1 -- 172.21.15.59:0/3889176932 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576d36a54a0 con 0x5576d361e6a0 2024-09-10T21:24:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.024+0000 7f2431d9b640 1 --2- 172.21.15.59:0/3889176932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 0x5576d3633d80 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f2428013740 tx=0x7f2428011140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa58b5422267e700 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.024+0000 7f2419ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.025+0000 7f2419ffb640 1 -- 172.21.15.59:0/3889176932 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2428025050 con 0x5576d361e6a0 2024-09-10T21:24:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.025+0000 7f2419ffb640 1 -- 172.21.15.59:0/3889176932 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2428007c10 con 0x5576d361e6a0 2024-09-10T21:24:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.025+0000 7f243afd8740 1 -- 172.21.15.59:0/3889176932 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f242802f070 con 0x5576d361e6a0 2024-09-10T21:24:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.025+0000 7f2419ffb640 1 -- 172.21.15.59:0/3889176932 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2428005160 con 0x5576d361e6a0 2024-09-10T21:24:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.025+0000 7f243afd8740 10 client.17652 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.025+0000 7f243afd8740 1 -- 172.21.15.59:0/3889176932 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5576d36ac920 con 0x5576d361e6a0 2024-09-10T21:24:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.025+0000 7f2419ffb640 1 -- 172.21.15.59:0/3889176932 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f242802f070 con 0x5576d361e6a0 2024-09-10T21:24:49.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.025+0000 7f2419ffb640 1 -- 172.21.15.59:0/3889176932 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f242802a070 con 0x5576d361e6a0 2024-09-10T21:24:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.025+0000 7f243afd8740 10 client.17652 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.025+0000 7f243afd8740 10 client.17652 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:24:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.025+0000 7f243afd8740 20 client.17652 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.025+0000 7f243afd8740 1 --2- 172.21.15.59:0/3889176932 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5576d363ed70 0x5576d36aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.025+0000 7f243afd8740 4 client.17652 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:24:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.025+0000 7f243afd8740 1 -- 172.21.15.59:0/3889176932 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5576d35928a0 con 0x5576d363ed70 2024-09-10T21:24:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.026+0000 7f243259c640 1 --2- 172.21.15.59:0/3889176932 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5576d363ed70 0x5576d36aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.026+0000 7f243259c640 1 --2- 172.21.15.59:0/3889176932 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5576d363ed70 0x5576d36aee90 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f1e40b4a1db5eba5 server_cookie=a4011753f7436fc in_seq=0 out_seq=0 2024-09-10T21:24:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.026+0000 7f2419ffb640 10 client.17652 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:24:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.026+0000 7f2419ffb640 1 -- 172.21.15.59:0/3889176932 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5576d35928a0 con 0x5576d363ed70 2024-09-10T21:24:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.026+0000 7f2419ffb640 10 client.17652 handle_command_reply: tid=0 2024-09-10T21:24:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.026+0000 7f243afd8740 1 client.17652 shutdown 2024-09-10T21:24:49.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.026+0000 7f243afd8740 1 -- 172.21.15.59:0/3889176932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 msgr2=0x5576d3633d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.026+0000 7f243afd8740 1 --2- 172.21.15.59:0/3889176932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 0x5576d3633d80 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f2428013740 tx=0x7f2428011140 comp rx=0 tx=0).stop 2024-09-10T21:24:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.026+0000 7f243afd8740 1 -- 172.21.15.59:0/3889176932 shutdown_connections 2024-09-10T21:24:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.026+0000 7f243afd8740 1 --2- 172.21.15.59:0/3889176932 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x5576d363ed70 0x5576d36aee90 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.026+0000 7f243afd8740 1 --2- 172.21.15.59:0/3889176932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5576d362af50 0x5576d36a4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.026+0000 7f243afd8740 1 --2- 172.21.15.59:0/3889176932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5576d361efc0 0x5576d3634320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.026+0000 7f2419ffb640 0 client.17652 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:24:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.026+0000 7f243afd8740 1 --2- 172.21.15.59:0/3889176932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d361e6a0 0x5576d3633d80 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.026+0000 7f243afd8740 1 -- 172.21.15.59:0/3889176932 >> 172.21.15.59:0/3889176932 conn(0x5576d361c4d0 msgr2=0x5576d36263d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.026+0000 7f243afd8740 1 -- 172.21.15.59:0/3889176932 shutdown_connections 2024-09-10T21:24:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.026+0000 7f243afd8740 1 -- 172.21.15.59:0/3889176932 wait complete. 2024-09-10T21:24:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.027+0000 7f243afd8740 20 client.17652 trim_cache size 0 max 16384 2024-09-10T21:24:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.027+0000 7f243359e640 1 -- 172.21.15.59:0/1108706543 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f241c0b5390 msgr2=0x7f241c0b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.027+0000 7f243359e640 1 --2- 172.21.15.59:0/1108706543 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f241c0b5390 0x7f241c0b7850 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f242c0c9020 tx=0x7f242c099f20 comp rx=0 tx=0).stop 2024-09-10T21:24:49.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.027+0000 7f243359e640 1 -- 172.21.15.59:0/1108706543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2434108fa0 msgr2=0x7f243419e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:49.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.027+0000 7f243359e640 1 --2- 172.21.15.59:0/1108706543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2434108fa0 0x7f243419e810 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f242c005940 tx=0x7f242c0042f0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.027+0000 7f243359e640 1 -- 172.21.15.59:0/1108706543 shutdown_connections 2024-09-10T21:24:49.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.027+0000 7f243359e640 1 --2- 172.21.15.59:0/1108706543 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f241c0b5390 0x7f241c0b7850 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.027+0000 7f243359e640 1 --2- 172.21.15.59:0/1108706543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2434108fa0 0x7f243419e810 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.027+0000 7f243359e640 1 --2- 172.21.15.59:0/1108706543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2434108620 0x7f2434199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.027+0000 7f243359e640 1 --2- 172.21.15.59:0/1108706543 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2434102c10 0x7f2434198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:49.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.027+0000 7f243359e640 1 -- 172.21.15.59:0/1108706543 >> 172.21.15.59:0/1108706543 conn(0x7f24340fe6c0 msgr2=0x7f2434104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:49.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.027+0000 7f243359e640 1 -- 172.21.15.59:0/1108706543 shutdown_connections 2024-09-10T21:24:49.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:49.027+0000 7f243359e640 1 -- 172.21.15.59:0/1108706543 wait complete. 2024-09-10T21:24:49.917 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:24:50.180 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:24:50.568 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:50 smithi059 ceph-mon[30888]: pgmap v627: 97 pgs: 97 active+clean; 6.6 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:24:50.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.648+0000 7f7e4c397640 1 -- 172.21.15.59:0/655167121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e44101cd0 msgr2=0x7f7e441020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:50.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.648+0000 7f7e4c397640 1 --2- 172.21.15.59:0/655167121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e44101cd0 0x7f7e441020b0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f7e40009900 tx=0x7f7e4002a410 comp rx=0 tx=0).stop 2024-09-10T21:24:50.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.648+0000 7f7e4c397640 1 -- 172.21.15.59:0/655167121 shutdown_connections 2024-09-10T21:24:50.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.648+0000 7f7e4c397640 1 --2- 172.21.15.59:0/655167121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e44108060 0x7f7e4410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.648+0000 7f7e4c397640 1 --2- 172.21.15.59:0/655167121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e441076e0 0x7f7e44107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.648+0000 7f7e4c397640 1 --2- 172.21.15.59:0/655167121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e44101cd0 0x7f7e441020b0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.648+0000 7f7e4c397640 1 -- 172.21.15.59:0/655167121 >> 172.21.15.59:0/655167121 conn(0x7f7e440fd700 msgr2=0x7f7e440ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:50.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.648+0000 7f7e4c397640 1 -- 172.21.15.59:0/655167121 shutdown_connections 2024-09-10T21:24:50.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.648+0000 7f7e4c397640 1 -- 172.21.15.59:0/655167121 wait complete. 2024-09-10T21:24:50.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e4c397640 1 Processor -- start 2024-09-10T21:24:50.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e4c397640 1 -- start start 2024-09-10T21:24:50.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e4c397640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e44101cd0 0x7f7e44199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:50.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e4c397640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e441076e0 0x7f7e44199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:50.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e4c397640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e44108060 0x7f7e4419ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:50.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e4c397640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7e44111d20 con 0x7f7e44101cd0 2024-09-10T21:24:50.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e4c397640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e44111ba0 con 0x7f7e441076e0 2024-09-10T21:24:50.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e4c397640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7e44111ea0 con 0x7f7e44108060 2024-09-10T21:24:50.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e4a133640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e44101cd0 0x7f7e44199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:50.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e4a133640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e44101cd0 0x7f7e44199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46128/0 (socket says 172.21.15.59:46128) 2024-09-10T21:24:50.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e4a133640 1 -- 172.21.15.59:0/2144786621 learned_addr learned my addr 172.21.15.59:0/2144786621 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:50.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e49932640 1 --2- 172.21.15.59:0/2144786621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e441076e0 0x7f7e44199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:50.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e4a934640 1 --2- 172.21.15.59:0/2144786621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e44108060 0x7f7e4419ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:50.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e4a133640 1 -- 172.21.15.59:0/2144786621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e44108060 msgr2=0x7f7e4419ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:50.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e4a133640 1 --2- 172.21.15.59:0/2144786621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e44108060 0x7f7e4419ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e4a133640 1 -- 172.21.15.59:0/2144786621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e441076e0 msgr2=0x7f7e44199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:50.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e4a133640 1 --2- 172.21.15.59:0/2144786621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e441076e0 0x7f7e44199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e4a133640 1 -- 172.21.15.59:0/2144786621 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4419f3f0 con 0x7f7e44101cd0 2024-09-10T21:24:50.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e49932640 1 --2- 172.21.15.59:0/2144786621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e441076e0 0x7f7e44199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:50.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.649+0000 7f7e4a934640 1 --2- 172.21.15.59:0/2144786621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e44108060 0x7f7e4419ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:50.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.650+0000 7f7e4a133640 1 --2- 172.21.15.59:0/2144786621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e44101cd0 0x7f7e44199340 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f7e40006010 tx=0x7f7e400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:50.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.650+0000 7f7e3b7fe640 1 -- 172.21.15.59:0/2144786621 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4003f030 con 0x7f7e44101cd0 2024-09-10T21:24:50.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.650+0000 7f7e3b7fe640 1 -- 172.21.15.59:0/2144786621 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e40003800 con 0x7f7e44101cd0 2024-09-10T21:24:50.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.650+0000 7f7e4c397640 1 -- 172.21.15.59:0/2144786621 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e4419f680 con 0x7f7e44101cd0 2024-09-10T21:24:50.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.650+0000 7f7e3b7fe640 1 -- 172.21.15.59:0/2144786621 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40035070 con 0x7f7e44101cd0 2024-09-10T21:24:50.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.650+0000 7f7e4c397640 1 -- 172.21.15.59:0/2144786621 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e441a5da0 con 0x7f7e44101cd0 2024-09-10T21:24:50.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e4e76c740 1 Processor -- start 2024-09-10T21:24:50.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e4e76c740 1 -- start start 2024-09-10T21:24:50.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e3b7fe640 1 -- 172.21.15.59:0/2144786621 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f7e40031b10 con 0x7f7e44101cd0 2024-09-10T21:24:50.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e4e76c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c84d0 0x55d2185c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:50.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e4e76c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c8df0 0x55d2185d4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:50.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e4e76c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185d4d80 0x55d2185d7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:50.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e4e76c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d21853eea0 con 0x55d2185c8df0 2024-09-10T21:24:50.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e4e76c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d21852e2d0 con 0x55d2185c84d0 2024-09-10T21:24:50.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e4e76c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d2185320e0 con 0x55d2185d4d80 2024-09-10T21:24:50.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e4a133640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c8df0 0x55d2185d4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:50.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e4a133640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c8df0 0x55d2185d4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46136/0 (socket says 172.21.15.59:46136) 2024-09-10T21:24:50.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e4a133640 1 -- 172.21.15.59:0/3116937628 learned_addr learned my addr 172.21.15.59:0/3116937628 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:50.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e4a934640 1 --2- 172.21.15.59:0/3116937628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c84d0 0x55d2185c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:50.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e49932640 1 --2- 172.21.15.59:0/3116937628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185d4d80 0x55d2185d7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:50.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e4a133640 1 -- 172.21.15.59:0/3116937628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185d4d80 msgr2=0x55d2185d7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:50.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e4a133640 1 --2- 172.21.15.59:0/3116937628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185d4d80 0x55d2185d7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e4a133640 1 -- 172.21.15.59:0/3116937628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c84d0 msgr2=0x55d2185c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:50.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e4a133640 1 --2- 172.21.15.59:0/3116937628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c84d0 0x55d2185c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e4a133640 1 -- 172.21.15.59:0/3116937628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d21828c650 con 0x55d2185c8df0 2024-09-10T21:24:50.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.653+0000 7f7e4a934640 1 --2- 172.21.15.59:0/3116937628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c84d0 0x55d2185c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:24:50.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.654+0000 7f7e4a133640 1 --2- 172.21.15.59:0/3116937628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c8df0 0x55d2185d4840 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f7e4010c7e0 tx=0x7f7e4010c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6786624fb5049a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:50.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.654+0000 7f7e3b7fe640 1 --2- 172.21.15.59:0/2144786621 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7e300b52e0 0x7f7e300b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:50.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.654+0000 7f7e38de6640 1 -- 172.21.15.59:0/3116937628 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e400c93e0 con 0x55d2185c8df0 2024-09-10T21:24:50.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.654+0000 7f7e4a934640 1 --2- 172.21.15.59:0/2144786621 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7e300b52e0 0x7f7e300b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:50.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.654+0000 7f7e38de6640 1 -- 172.21.15.59:0/3116937628 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e40113030 con 0x55d2185c8df0 2024-09-10T21:24:50.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.654+0000 7f7e38de6640 1 -- 172.21.15.59:0/3116937628 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e400cc500 con 0x55d2185c8df0 2024-09-10T21:24:50.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.654+0000 7f7e3b7fe640 1 -- 172.21.15.59:0/2144786621 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7e401065a0 con 0x7f7e44101cd0 2024-09-10T21:24:50.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.655+0000 7f7e4e76c740 1 -- 172.21.15.59:0/3116937628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c8df0 msgr2=0x55d2185d4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:50.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.655+0000 7f7e4a934640 1 --2- 172.21.15.59:0/2144786621 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7e300b52e0 0x7f7e300b77a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c005cc0 tx=0x7f7e3c008620 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:50.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.655+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/3116937628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c8df0 0x55d2185d4840 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f7e4010c7e0 tx=0x7f7e4010c8d0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.655+0000 7f7e4e76c740 1 -- 172.21.15.59:0/3116937628 shutdown_connections 2024-09-10T21:24:50.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.655+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/3116937628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185d4d80 0x55d2185d7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.655+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/3116937628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c8df0 0x55d2185d4840 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.655+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/3116937628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c84d0 0x55d2185c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.655+0000 7f7e4e76c740 1 -- 172.21.15.59:0/3116937628 >> 172.21.15.59:0/3116937628 conn(0x55d2185c6300 msgr2=0x55d2185c74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:50.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.655+0000 7f7e4e76c740 1 -- 172.21.15.59:0/3116937628 shutdown_connections 2024-09-10T21:24:50.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.655+0000 7f7e4e76c740 1 -- 172.21.15.59:0/3116937628 wait complete. 2024-09-10T21:24:50.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.655+0000 7f7e4e76c740 1 -- start start 2024-09-10T21:24:50.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e4e76c740 1 Processor -- start 2024-09-10T21:24:50.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e4e76c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c84d0 0x55d2185d4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:50.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e4e76c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c8df0 0x55d2185d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:50.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e4e76c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185d4d80 0x55d2185d2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:50.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e4e76c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d21838f700 con 0x55d2185c84d0 2024-09-10T21:24:50.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e4e76c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d2184c9160 con 0x55d2185c8df0 2024-09-10T21:24:50.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e4e76c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d2185d77c0 con 0x55d2185d4d80 2024-09-10T21:24:50.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e4e76c740 10 client.0 _ll_register_callbacks cb 0x55d2184e29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:50.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e4a133640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c84d0 0x55d2185d4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:50.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e4a133640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c84d0 0x55d2185d4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46138/0 (socket says 172.21.15.59:46138) 2024-09-10T21:24:50.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e4a133640 1 -- 172.21.15.59:0/1239264434 learned_addr learned my addr 172.21.15.59:0/1239264434 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:50.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e4a934640 1 --2- 172.21.15.59:0/1239264434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185d4d80 0x55d2185d2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:50.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e49932640 1 --2- 172.21.15.59:0/1239264434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c8df0 0x55d2185d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:50.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e4a133640 1 -- 172.21.15.59:0/1239264434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185d4d80 msgr2=0x55d2185d2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:50.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e4a133640 1 --2- 172.21.15.59:0/1239264434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185d4d80 0x55d2185d2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e4a133640 1 -- 172.21.15.59:0/1239264434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c8df0 msgr2=0x55d2185d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:50.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e4a133640 1 --2- 172.21.15.59:0/1239264434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c8df0 0x55d2185d1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e4a133640 1 -- 172.21.15.59:0/1239264434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2184f6c90 con 0x55d2185c84d0 2024-09-10T21:24:50.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e49932640 1 --2- 172.21.15.59:0/1239264434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c8df0 0x55d2185d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:50.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e4a133640 1 --2- 172.21.15.59:0/1239264434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c84d0 0x55d2185d4620 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f7e40031ae0 tx=0x7f7e40004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d438d3a66cf258 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:50.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.656+0000 7f7e2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:50.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.657+0000 7f7e2dffb640 1 -- 172.21.15.59:0/1239264434 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40049070 con 0x55d2185c84d0 2024-09-10T21:24:50.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.657+0000 7f7e2dffb640 1 -- 172.21.15.59:0/1239264434 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7e4003fe00 con 0x55d2185c84d0 2024-09-10T21:24:50.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.657+0000 7f7e4e76c740 1 -- 172.21.15.59:0/1239264434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e40113030 con 0x55d2185c84d0 2024-09-10T21:24:50.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.657+0000 7f7e2dffb640 1 -- 172.21.15.59:0/1239264434 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7e400cc6e0 con 0x55d2185c84d0 2024-09-10T21:24:50.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.657+0000 7f7e4e76c740 10 client.17664 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:50.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.657+0000 7f7e4e76c740 1 -- 172.21.15.59:0/1239264434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d2185e3030 con 0x55d2185c84d0 2024-09-10T21:24:50.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.657+0000 7f7e2dffb640 1 -- 172.21.15.59:0/1239264434 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e40113030 con 0x55d2185c84d0 2024-09-10T21:24:50.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.657+0000 7f7e2dffb640 1 -- 172.21.15.59:0/1239264434 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7e400b40e0 con 0x55d2185c84d0 2024-09-10T21:24:50.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.657+0000 7f7e4e76c740 10 client.17664 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:50.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.657+0000 7f7e4e76c740 10 client.17664 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:24:50.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.657+0000 7f7e4e76c740 20 client.17664 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:50.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.657+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/1239264434 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d2185e4380 0x55d2185e6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:50.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.657+0000 7f7e4e76c740 4 client.17664 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:24:50.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.657+0000 7f7e4e76c740 1 -- 172.21.15.59:0/1239264434 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d218540df0 con 0x55d2185e4380 2024-09-10T21:24:50.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.658+0000 7f7e49932640 1 --2- 172.21.15.59:0/1239264434 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d2185e4380 0x55d2185e6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:50.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.658+0000 7f7e49932640 1 --2- 172.21.15.59:0/1239264434 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d2185e4380 0x55d2185e6770 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77386bfdd593f3f5 server_cookie=8b13219b7dbca3a6 in_seq=0 out_seq=0 2024-09-10T21:24:50.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.658+0000 7f7e2dffb640 10 client.17664 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:50.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.659+0000 7f7e2dffb640 1 -- 172.21.15.59:0/1239264434 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d218540df0 con 0x55d2185e4380 2024-09-10T21:24:50.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.659+0000 7f7e2dffb640 10 client.17664 handle_command_reply: tid=0 2024-09-10T21:24:50.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.659+0000 7f7e4e76c740 1 client.17664 shutdown 2024-09-10T21:24:50.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.659+0000 7f7e4e76c740 1 -- 172.21.15.59:0/1239264434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c84d0 msgr2=0x55d2185d4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:50.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.659+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/1239264434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c84d0 0x55d2185d4620 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f7e40031ae0 tx=0x7f7e40004480 comp rx=0 tx=0).stop 2024-09-10T21:24:50.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.659+0000 7f7e4e76c740 1 -- 172.21.15.59:0/1239264434 shutdown_connections 2024-09-10T21:24:50.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.659+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/1239264434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185d4d80 0x55d2185d2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.659+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/1239264434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c8df0 0x55d2185d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.659+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/1239264434 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d2185e4380 0x55d2185e6770 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.659+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/1239264434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c84d0 0x55d2185d4620 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.659+0000 7f7e2dffb640 0 client.17664 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:50.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.659+0000 7f7e4e76c740 1 -- 172.21.15.59:0/1239264434 >> 172.21.15.59:0/1239264434 conn(0x55d2185c6300 msgr2=0x55d2185cbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:50.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.659+0000 7f7e4e76c740 1 -- 172.21.15.59:0/1239264434 shutdown_connections 2024-09-10T21:24:50.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.659+0000 7f7e4e76c740 1 -- 172.21.15.59:0/1239264434 wait complete. 2024-09-10T21:24:50.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.659+0000 7f7e4e76c740 20 client.17664 trim_cache size 0 max 16384 2024-09-10T21:24:50.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e4e76c740 1 Processor -- start 2024-09-10T21:24:50.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e4e76c740 1 -- start start 2024-09-10T21:24:50.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e4e76c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c84d0 0x55d2185e09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:50.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e4e76c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c8df0 0x55d2185c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:50.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e4e76c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185d4d80 0x55d2185c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:50.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e4e76c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441ac190 con 0x55d2185c84d0 2024-09-10T21:24:50.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e4e76c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441adcd0 con 0x55d2185c8df0 2024-09-10T21:24:50.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e4e76c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441ac860 con 0x55d2185d4d80 2024-09-10T21:24:50.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e4a133640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c84d0 0x55d2185e09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:50.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e4a133640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c84d0 0x55d2185e09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46144/0 (socket says 172.21.15.59:46144) 2024-09-10T21:24:50.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e4a133640 1 -- 172.21.15.59:0/770819894 learned_addr learned my addr 172.21.15.59:0/770819894 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:50.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e49932640 1 --2- 172.21.15.59:0/770819894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c8df0 0x55d2185c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:50.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e4a934640 1 --2- 172.21.15.59:0/770819894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185d4d80 0x55d2185c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:50.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e4a133640 1 -- 172.21.15.59:0/770819894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185d4d80 msgr2=0x55d2185c76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:50.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e4a133640 1 --2- 172.21.15.59:0/770819894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185d4d80 0x55d2185c76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e4a133640 1 -- 172.21.15.59:0/770819894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c8df0 msgr2=0x55d2185c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:50.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e4a133640 1 --2- 172.21.15.59:0/770819894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c8df0 0x55d2185c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e4a133640 1 -- 172.21.15.59:0/770819894 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2185c1990 con 0x55d2185c84d0 2024-09-10T21:24:50.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e4a934640 1 --2- 172.21.15.59:0/770819894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185d4d80 0x55d2185c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:50.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e4a133640 1 --2- 172.21.15.59:0/770819894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c84d0 0x55d2185e09b0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f7e400cca90 tx=0x7f7e400cd4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a517d31369e87306 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:50.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e2ffff640 1 -- 172.21.15.59:0/770819894 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40049040 con 0x55d2185c84d0 2024-09-10T21:24:50.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e2ffff640 1 -- 172.21.15.59:0/770819894 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e40113070 con 0x55d2185c84d0 2024-09-10T21:24:50.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.673+0000 7f7e2ffff640 1 -- 172.21.15.59:0/770819894 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e400cc8d0 con 0x55d2185c84d0 2024-09-10T21:24:50.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.674+0000 7f7e4e76c740 1 -- 172.21.15.59:0/770819894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c84d0 msgr2=0x55d2185e09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:50.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.674+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/770819894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c84d0 0x55d2185e09b0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f7e400cca90 tx=0x7f7e400cd4b0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.674+0000 7f7e4e76c740 1 -- 172.21.15.59:0/770819894 shutdown_connections 2024-09-10T21:24:50.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.674+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/770819894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185d4d80 0x55d2185c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.674+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/770819894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c8df0 0x55d2185c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.674+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/770819894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185c84d0 0x55d2185e09b0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.674+0000 7f7e4e76c740 1 -- 172.21.15.59:0/770819894 >> 172.21.15.59:0/770819894 conn(0x55d2185c6300 msgr2=0x55d2185ccd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:50.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.674+0000 7f7e4e76c740 1 -- 172.21.15.59:0/770819894 shutdown_connections 2024-09-10T21:24:50.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.674+0000 7f7e4e76c740 1 -- 172.21.15.59:0/770819894 wait complete. 2024-09-10T21:24:50.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.674+0000 7f7e4e76c740 1 -- start start 2024-09-10T21:24:50.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.674+0000 7f7e4e76c740 1 Processor -- start 2024-09-10T21:24:50.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.675+0000 7f7e4e76c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185c84d0 0x55d2185dcc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:50.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.675+0000 7f7e4e76c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c8df0 0x55d2185dd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:50.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.675+0000 7f7e4e76c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185d4d80 0x55d2185d79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:50.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.675+0000 7f7e4e76c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441ad600 con 0x55d2185d4d80 2024-09-10T21:24:50.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.675+0000 7f7e4e76c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441acf30 con 0x55d2185c8df0 2024-09-10T21:24:50.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.675+0000 7f7e4e76c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441aa190 con 0x55d2185c84d0 2024-09-10T21:24:50.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.675+0000 7f7e4e76c740 10 client.0 _ll_register_callbacks cb 0x7f7e3c0084f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:50.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.675+0000 7f7e4a934640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185d4d80 0x55d2185d79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:50.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.675+0000 7f7e4a934640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185d4d80 0x55d2185d79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46158/0 (socket says 172.21.15.59:46158) 2024-09-10T21:24:50.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.675+0000 7f7e4a934640 1 -- 172.21.15.59:0/2251750027 learned_addr learned my addr 172.21.15.59:0/2251750027 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:50.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.675+0000 7f7e49932640 1 --2- 172.21.15.59:0/2251750027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c8df0 0x55d2185dd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:50.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.675+0000 7f7e4a133640 1 --2- 172.21.15.59:0/2251750027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185c84d0 0x55d2185dcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:50.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.675+0000 7f7e4a934640 1 -- 172.21.15.59:0/2251750027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185c84d0 msgr2=0x55d2185dcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:50.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.675+0000 7f7e4a934640 1 --2- 172.21.15.59:0/2251750027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185c84d0 0x55d2185dcc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.675+0000 7f7e4a934640 1 -- 172.21.15.59:0/2251750027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c8df0 msgr2=0x55d2185dd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:50.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.675+0000 7f7e4a934640 1 --2- 172.21.15.59:0/2251750027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c8df0 0x55d2185dd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.675+0000 7f7e4a934640 1 -- 172.21.15.59:0/2251750027 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2185d8220 con 0x55d2185d4d80 2024-09-10T21:24:50.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.675+0000 7f7e4a934640 1 --2- 172.21.15.59:0/2251750027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185d4d80 0x55d2185d79f0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00eec0 tx=0x7f7e3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8e3536e456e8eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:50.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.675+0000 7f7e2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:50.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.676+0000 7f7e2dffb640 1 -- 172.21.15.59:0/2251750027 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c02c060 con 0x55d2185d4d80 2024-09-10T21:24:50.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.676+0000 7f7e4e76c740 1 -- 172.21.15.59:0/2251750027 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e40113070 con 0x55d2185d4d80 2024-09-10T21:24:50.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.676+0000 7f7e2dffb640 1 -- 172.21.15.59:0/2251750027 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7e3c008db0 con 0x55d2185d4d80 2024-09-10T21:24:50.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.676+0000 7f7e2dffb640 1 -- 172.21.15.59:0/2251750027 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7e3c01eb40 con 0x55d2185d4d80 2024-09-10T21:24:50.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.676+0000 7f7e4e76c740 10 client.17670 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:50.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.676+0000 7f7e4e76c740 1 -- 172.21.15.59:0/2251750027 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d218651cf0 con 0x55d2185d4d80 2024-09-10T21:24:50.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.676+0000 7f7e2dffb640 1 -- 172.21.15.59:0/2251750027 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e40113070 con 0x55d2185d4d80 2024-09-10T21:24:50.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.676+0000 7f7e2dffb640 1 -- 172.21.15.59:0/2251750027 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7e3c01a400 con 0x55d2185d4d80 2024-09-10T21:24:50.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.676+0000 7f7e4e76c740 10 client.17670 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:50.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.676+0000 7f7e4e76c740 10 client.17670 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:24:50.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.676+0000 7f7e4e76c740 20 client.17670 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:50.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.676+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/2251750027 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d218652410 0x55d218654830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:50.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.676+0000 7f7e4e76c740 4 client.17670 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:24:50.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.676+0000 7f7e4e76c740 1 -- 172.21.15.59:0/2251750027 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d21853c8a0 con 0x55d218652410 2024-09-10T21:24:50.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.677+0000 7f7e4a133640 1 --2- 172.21.15.59:0/2251750027 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d218652410 0x55d218654830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:50.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.677+0000 7f7e4a133640 1 --2- 172.21.15.59:0/2251750027 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d218652410 0x55d218654830 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d828c39b58051d1 server_cookie=8f8d3e21c5a1ba9f in_seq=0 out_seq=0 2024-09-10T21:24:50.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.677+0000 7f7e2dffb640 10 client.17670 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:50.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.677+0000 7f7e2dffb640 1 -- 172.21.15.59:0/2251750027 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d21853c8a0 con 0x55d218652410 2024-09-10T21:24:50.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.677+0000 7f7e2dffb640 10 client.17670 handle_command_reply: tid=0 2024-09-10T21:24:50.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.677+0000 7f7e4e76c740 1 client.17670 shutdown 2024-09-10T21:24:50.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.677+0000 7f7e4e76c740 1 -- 172.21.15.59:0/2251750027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185d4d80 msgr2=0x55d2185d79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:50.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.677+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/2251750027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185d4d80 0x55d2185d79f0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00eec0 tx=0x7f7e3c004a40 comp rx=0 tx=0).stop 2024-09-10T21:24:50.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.677+0000 7f7e4e76c740 1 -- 172.21.15.59:0/2251750027 shutdown_connections 2024-09-10T21:24:50.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.677+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/2251750027 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d218652410 0x55d218654830 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.677+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/2251750027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2185d4d80 0x55d2185d79f0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.677+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/2251750027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d2185c8df0 0x55d2185dd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.677+0000 7f7e2dffb640 0 client.17670 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:50.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.677+0000 7f7e4e76c740 1 --2- 172.21.15.59:0/2251750027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d2185c84d0 0x55d2185dcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.677+0000 7f7e4e76c740 1 -- 172.21.15.59:0/2251750027 >> 172.21.15.59:0/2251750027 conn(0x55d2185c6300 msgr2=0x55d2185c7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:50.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.678+0000 7f7e4e76c740 1 -- 172.21.15.59:0/2251750027 shutdown_connections 2024-09-10T21:24:50.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.678+0000 7f7e4e76c740 1 -- 172.21.15.59:0/2251750027 wait complete. 2024-09-10T21:24:50.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.678+0000 7f7e4e76c740 20 client.17670 trim_cache size 0 max 16384 2024-09-10T21:24:50.686 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:24:50.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.678+0000 7f7e4c397640 1 -- 172.21.15.59:0/2144786621 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7e300b52e0 msgr2=0x7f7e300b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:50.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.678+0000 7f7e4c397640 1 --2- 172.21.15.59:0/2144786621 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7e300b52e0 0x7f7e300b77a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c005cc0 tx=0x7f7e3c008620 comp rx=0 tx=0).stop 2024-09-10T21:24:50.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.678+0000 7f7e4c397640 1 -- 172.21.15.59:0/2144786621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e44101cd0 msgr2=0x7f7e44199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:50.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.678+0000 7f7e4c397640 1 --2- 172.21.15.59:0/2144786621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e44101cd0 0x7f7e44199340 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f7e40006010 tx=0x7f7e400042f0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.678+0000 7f7e4c397640 1 -- 172.21.15.59:0/2144786621 shutdown_connections 2024-09-10T21:24:50.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.678+0000 7f7e4c397640 1 --2- 172.21.15.59:0/2144786621 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f7e300b52e0 0x7f7e300b77a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.678+0000 7f7e4c397640 1 --2- 172.21.15.59:0/2144786621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e44108060 0x7f7e4419ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.678+0000 7f7e4c397640 1 --2- 172.21.15.59:0/2144786621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e441076e0 0x7f7e44199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.678+0000 7f7e4c397640 1 --2- 172.21.15.59:0/2144786621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e44101cd0 0x7f7e44199340 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:50.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.678+0000 7f7e4c397640 1 -- 172.21.15.59:0/2144786621 >> 172.21.15.59:0/2144786621 conn(0x7f7e440fd700 msgr2=0x7f7e44105a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:50.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.678+0000 7f7e4c397640 1 -- 172.21.15.59:0/2144786621 shutdown_connections 2024-09-10T21:24:50.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:50.678+0000 7f7e4c397640 1 -- 172.21.15.59:0/2144786621 wait complete. 2024-09-10T21:24:50.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:50 smithi192 ceph-mon[35363]: pgmap v627: 97 pgs: 97 active+clean; 6.6 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:24:50.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:50 smithi154 ceph-mon[35041]: pgmap v627: 97 pgs: 97 active+clean; 6.6 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:24:52.529 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:24:52.529 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:24:52.801 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:24:52.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:52 smithi192 ceph-mon[35363]: pgmap v628: 97 pgs: 97 active+clean; 6.6 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:24:52.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:52 smithi059 ceph-mon[30888]: pgmap v628: 97 pgs: 97 active+clean; 6.6 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:24:52.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:52 smithi154 ceph-mon[35041]: pgmap v628: 97 pgs: 97 active+clean; 6.6 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:24:53.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.286+0000 7f08f17c5640 1 -- 172.21.15.59:0/186426951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08ec103cd0 msgr2=0x7f08ec1040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:53.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.286+0000 7f08f17c5640 1 --2- 172.21.15.59:0/186426951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08ec103cd0 0x7f08ec1040b0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009ca0 tx=0x7f08dc02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.286+0000 7f08f17c5640 1 -- 172.21.15.59:0/186426951 shutdown_connections 2024-09-10T21:24:53.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.287+0000 7f08f17c5640 1 --2- 172.21.15.59:0/186426951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08ec10d130 0x7f08ec10f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.287+0000 7f08f17c5640 1 --2- 172.21.15.59:0/186426951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec1045f0 0x7f08ec10cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.287+0000 7f08f17c5640 1 --2- 172.21.15.59:0/186426951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08ec103cd0 0x7f08ec1040b0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.287+0000 7f08f17c5640 1 -- 172.21.15.59:0/186426951 >> 172.21.15.59:0/186426951 conn(0x7f08ec0fd770 msgr2=0x7f08ec0ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:53.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.287+0000 7f08f17c5640 1 -- 172.21.15.59:0/186426951 shutdown_connections 2024-09-10T21:24:53.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.287+0000 7f08f17c5640 1 -- 172.21.15.59:0/186426951 wait complete. 2024-09-10T21:24:53.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.287+0000 7f08f17c5640 1 Processor -- start 2024-09-10T21:24:53.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.287+0000 7f08f17c5640 1 -- start start 2024-09-10T21:24:53.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08f17c5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08ec103cd0 0x7f08ec101980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:53.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08f17c5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08ec1045f0 0x7f08ec101ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:53.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08f17c5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec10d130 0x7f08ec102400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:53.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08f17c5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f08ec112da0 con 0x7f08ec1045f0 2024-09-10T21:24:53.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08f17c5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f08ec112c20 con 0x7f08ec103cd0 2024-09-10T21:24:53.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08f17c5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f08ec112f20 con 0x7f08ec10d130 2024-09-10T21:24:53.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08ea7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08ec1045f0 0x7f08ec101ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:53.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08ea7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08ec1045f0 0x7f08ec101ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46164/0 (socket says 172.21.15.59:46164) 2024-09-10T21:24:53.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08ea7fc640 1 -- 172.21.15.59:0/3432035496 learned_addr learned my addr 172.21.15.59:0/3432035496 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:53.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08eb7fe640 1 --2- 172.21.15.59:0/3432035496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec10d130 0x7f08ec102400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:53.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08eaffd640 1 --2- 172.21.15.59:0/3432035496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08ec103cd0 0x7f08ec101980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:53.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08ea7fc640 1 -- 172.21.15.59:0/3432035496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec10d130 msgr2=0x7f08ec102400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:53.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08ea7fc640 1 --2- 172.21.15.59:0/3432035496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec10d130 0x7f08ec102400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08ea7fc640 1 -- 172.21.15.59:0/3432035496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08ec103cd0 msgr2=0x7f08ec101980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:53.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08ea7fc640 1 --2- 172.21.15.59:0/3432035496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08ec103cd0 0x7f08ec101980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08ea7fc640 1 -- 172.21.15.59:0/3432035496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08ec1a7650 con 0x7f08ec1045f0 2024-09-10T21:24:53.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08eb7fe640 1 --2- 172.21.15.59:0/3432035496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec10d130 0x7f08ec102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:53.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08ea7fc640 1 --2- 172.21.15.59:0/3432035496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08ec1045f0 0x7f08ec101ec0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f08e000d750 tx=0x7f08e000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:53.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08d3fff640 1 -- 172.21.15.59:0/3432035496 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e0017070 con 0x7f08ec1045f0 2024-09-10T21:24:53.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08f17c5640 1 -- 172.21.15.59:0/3432035496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08ec1a7940 con 0x7f08ec1045f0 2024-09-10T21:24:53.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08d3fff640 1 -- 172.21.15.59:0/3432035496 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08e0004020 con 0x7f08ec1045f0 2024-09-10T21:24:53.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08d3fff640 1 -- 172.21.15.59:0/3432035496 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e0003c00 con 0x7f08ec1045f0 2024-09-10T21:24:53.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.288+0000 7f08f17c5640 1 -- 172.21.15.59:0/3432035496 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08ec1a7e80 con 0x7f08ec1045f0 2024-09-10T21:24:53.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.291+0000 7f08f3b9a740 1 Processor -- start 2024-09-10T21:24:53.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.291+0000 7f08d3fff640 1 -- 172.21.15.59:0/3432035496 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f08e0009a30 con 0x7f08ec1045f0 2024-09-10T21:24:53.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.291+0000 7f08f3b9a740 1 -- start start 2024-09-10T21:24:53.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.291+0000 7f08f3b9a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d7ee0 0x55bc558d82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:53.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.291+0000 7f08f3b9a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558d8800 0x55bc558e4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:53.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.291+0000 7f08f3b9a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 0x55bc558e6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:53.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.291+0000 7f08f3b9a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bc5584ee60 con 0x55bc558e4790 2024-09-10T21:24:53.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.291+0000 7f08f3b9a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bc5583e290 con 0x55bc558d7ee0 2024-09-10T21:24:53.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.291+0000 7f08f3b9a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55bc558420a0 con 0x55bc558d8800 2024-09-10T21:24:53.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.292+0000 7f08ea7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 0x55bc558e6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:53.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.292+0000 7f08eaffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558d8800 0x55bc558e4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:53.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.292+0000 7f08ea7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 0x55bc558e6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46170/0 (socket says 172.21.15.59:46170) 2024-09-10T21:24:53.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.292+0000 7f08ea7fc640 1 -- 172.21.15.59:0/1608600398 learned_addr learned my addr 172.21.15.59:0/1608600398 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:53.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.292+0000 7f08eb7fe640 1 --2- 172.21.15.59:0/1608600398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d7ee0 0x55bc558d82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:53.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.292+0000 7f08ea7fc640 1 -- 172.21.15.59:0/1608600398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558d8800 msgr2=0x55bc558e4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:53.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.292+0000 7f08ea7fc640 1 --2- 172.21.15.59:0/1608600398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558d8800 0x55bc558e4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.292+0000 7f08ea7fc640 1 -- 172.21.15.59:0/1608600398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d7ee0 msgr2=0x55bc558d82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:53.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.292+0000 7f08ea7fc640 1 --2- 172.21.15.59:0/1608600398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d7ee0 0x55bc558d82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.292+0000 7f08ea7fc640 1 -- 172.21.15.59:0/1608600398 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc5559c930 con 0x55bc558e4790 2024-09-10T21:24:53.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.292+0000 7f08d3fff640 1 --2- 172.21.15.59:0/3432035496 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f08d40b52e0 0x7f08d40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:53.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.292+0000 7f08eb7fe640 1 --2- 172.21.15.59:0/3432035496 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f08d40b52e0 0x7f08d40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:53.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.292+0000 7f08ea7fc640 1 --2- 172.21.15.59:0/1608600398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 0x55bc558e6b80 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f08e00eb700 tx=0x7f08e00ebbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12b59bac5761883 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:53.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.292+0000 7f08d3fff640 1 -- 172.21.15.59:0/3432035496 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f08e00e5560 con 0x7f08ec1045f0 2024-09-10T21:24:53.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.293+0000 7f08d17fa640 1 -- 172.21.15.59:0/1608600398 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e0020070 con 0x55bc558e4790 2024-09-10T21:24:53.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.293+0000 7f08d17fa640 1 -- 172.21.15.59:0/1608600398 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08e00ab860 con 0x55bc558e4790 2024-09-10T21:24:53.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.293+0000 7f08d17fa640 1 -- 172.21.15.59:0/1608600398 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e00a7bf0 con 0x55bc558e4790 2024-09-10T21:24:53.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.293+0000 7f08f3b9a740 1 -- 172.21.15.59:0/1608600398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 msgr2=0x55bc558e6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:53.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.293+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/1608600398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 0x55bc558e6b80 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f08e00eb700 tx=0x7f08e00ebbc0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.293+0000 7f08eb7fe640 1 --2- 172.21.15.59:0/3432035496 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f08d40b52e0 0x7f08d40b77a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f08ec103a40 tx=0x7f08e400c4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:53.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.293+0000 7f08f3b9a740 1 -- 172.21.15.59:0/1608600398 shutdown_connections 2024-09-10T21:24:53.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.293+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/1608600398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 0x55bc558e6b80 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.293+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/1608600398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558d8800 0x55bc558e4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.293+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/1608600398 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d7ee0 0x55bc558d82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.293+0000 7f08f3b9a740 1 -- 172.21.15.59:0/1608600398 >> 172.21.15.59:0/1608600398 conn(0x55bc558d5d10 msgr2=0x55bc558d6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:53.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.293+0000 7f08f3b9a740 1 -- 172.21.15.59:0/1608600398 shutdown_connections 2024-09-10T21:24:53.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.293+0000 7f08f3b9a740 1 -- 172.21.15.59:0/1608600398 wait complete. 2024-09-10T21:24:53.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.294+0000 7f08f3b9a740 1 -- start start 2024-09-10T21:24:53.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.294+0000 7f08f3b9a740 1 Processor -- start 2024-09-10T21:24:53.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.294+0000 7f08f3b9a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d7ee0 0x55bc558e1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:53.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.294+0000 7f08f3b9a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558d8800 0x55bc558e1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:53.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.294+0000 7f08f3b9a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 0x55bc558e21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:53.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.294+0000 7f08f3b9a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bc5569f890 con 0x55bc558e4790 2024-09-10T21:24:53.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.294+0000 7f08f3b9a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55bc557d8d40 con 0x55bc558d7ee0 2024-09-10T21:24:53.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.294+0000 7f08f3b9a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55bc558e73e0 con 0x55bc558d8800 2024-09-10T21:24:53.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.294+0000 7f08f3b9a740 10 client.0 _ll_register_callbacks cb 0x55bc5583cc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:53.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.294+0000 7f08eb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 0x55bc558e21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:53.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.294+0000 7f08eb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 0x55bc558e21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46182/0 (socket says 172.21.15.59:46182) 2024-09-10T21:24:53.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.294+0000 7f08eb7fe640 1 -- 172.21.15.59:0/3130591923 learned_addr learned my addr 172.21.15.59:0/3130591923 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:53.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.294+0000 7f08ea7fc640 1 --2- 172.21.15.59:0/3130591923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558d8800 0x55bc558e1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:53.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.294+0000 7f08eaffd640 1 --2- 172.21.15.59:0/3130591923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d7ee0 0x55bc558e1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:53.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.294+0000 7f08eb7fe640 1 -- 172.21.15.59:0/3130591923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558d8800 msgr2=0x55bc558e1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:53.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.294+0000 7f08eb7fe640 1 --2- 172.21.15.59:0/3130591923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558d8800 0x55bc558e1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.294+0000 7f08eb7fe640 1 -- 172.21.15.59:0/3130591923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d7ee0 msgr2=0x55bc558e1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:53.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.294+0000 7f08eb7fe640 1 --2- 172.21.15.59:0/3130591923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d7ee0 0x55bc558e1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.295+0000 7f08eb7fe640 1 -- 172.21.15.59:0/3130591923 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc558f0810 con 0x55bc558e4790 2024-09-10T21:24:53.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.295+0000 7f08eaffd640 1 --2- 172.21.15.59:0/3130591923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d7ee0 0x55bc558e1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:53.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.295+0000 7f08eb7fe640 1 --2- 172.21.15.59:0/3130591923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 0x55bc558e21f0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f08e400ede0 tx=0x7f08e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3f3c66bc339c28 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:53.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.295+0000 7f08ceff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:53.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.295+0000 7f08ceff5640 1 -- 172.21.15.59:0/3130591923 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e401cb20 con 0x55bc558e4790 2024-09-10T21:24:53.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.295+0000 7f08ceff5640 1 -- 172.21.15.59:0/3130591923 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f08e401ccc0 con 0x55bc558e4790 2024-09-10T21:24:53.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.295+0000 7f08f3b9a740 1 -- 172.21.15.59:0/3130591923 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08e00ab860 con 0x55bc558e4790 2024-09-10T21:24:53.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.295+0000 7f08ceff5640 1 -- 172.21.15.59:0/3130591923 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f08e402f070 con 0x55bc558e4790 2024-09-10T21:24:53.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.295+0000 7f08f3b9a740 10 client.17682 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:53.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.295+0000 7f08f3b9a740 1 -- 172.21.15.59:0/3130591923 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bc558f3220 con 0x55bc558e4790 2024-09-10T21:24:53.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.295+0000 7f08ceff5640 1 -- 172.21.15.59:0/3130591923 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08e00ab860 con 0x55bc558e4790 2024-09-10T21:24:53.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.295+0000 7f08ceff5640 1 -- 172.21.15.59:0/3130591923 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f08e401a390 con 0x55bc558e4790 2024-09-10T21:24:53.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.296+0000 7f08f3b9a740 10 client.17682 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:53.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.296+0000 7f08f3b9a740 10 client.17682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:24:53.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.296+0000 7f08f3b9a740 20 client.17682 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:53.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.296+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/3130591923 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55bc558f4730 0x55bc558f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:53.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.296+0000 7f08f3b9a740 4 client.17682 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:24:53.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.296+0000 7f08f3b9a740 1 -- 172.21.15.59:0/3130591923 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc55850db0 con 0x55bc558f4730 2024-09-10T21:24:53.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.296+0000 7f08eaffd640 1 --2- 172.21.15.59:0/3130591923 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55bc558f4730 0x55bc558f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:53.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.296+0000 7f08ceff5640 10 client.17682 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:53.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.296+0000 7f08eaffd640 1 --2- 172.21.15.59:0/3130591923 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55bc558f4730 0x55bc558f6b90 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d10730f51a49da2 server_cookie=3dc14c2cc3dbcea7 in_seq=0 out_seq=0 2024-09-10T21:24:53.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.297+0000 7f08ceff5640 1 -- 172.21.15.59:0/3130591923 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bc55850db0 con 0x55bc558f4730 2024-09-10T21:24:53.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.297+0000 7f08ceff5640 10 client.17682 handle_command_reply: tid=0 2024-09-10T21:24:53.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.297+0000 7f08f3b9a740 1 client.17682 shutdown 2024-09-10T21:24:53.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.297+0000 7f08f3b9a740 1 -- 172.21.15.59:0/3130591923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 msgr2=0x55bc558e21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:53.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.297+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/3130591923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 0x55bc558e21f0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f08e400ede0 tx=0x7f08e40046c0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.297+0000 7f08f3b9a740 1 -- 172.21.15.59:0/3130591923 shutdown_connections 2024-09-10T21:24:53.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.297+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/3130591923 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55bc558f4730 0x55bc558f6b90 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.297+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/3130591923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 0x55bc558e21f0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.297+0000 7f08ceff5640 0 client.17682 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:53.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.297+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/3130591923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558d8800 0x55bc558e1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.297+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/3130591923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d7ee0 0x55bc558e1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.297+0000 7f08f3b9a740 1 -- 172.21.15.59:0/3130591923 >> 172.21.15.59:0/3130591923 conn(0x55bc558d5d10 msgr2=0x55bc558d4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:53.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.297+0000 7f08f3b9a740 1 -- 172.21.15.59:0/3130591923 shutdown_connections 2024-09-10T21:24:53.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.297+0000 7f08f3b9a740 1 -- 172.21.15.59:0/3130591923 wait complete. 2024-09-10T21:24:53.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.297+0000 7f08f3b9a740 20 client.17682 trim_cache size 0 max 16384 2024-09-10T21:24:53.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.315+0000 7f08f3b9a740 1 Processor -- start 2024-09-10T21:24:53.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.315+0000 7f08f3b9a740 1 -- start start 2024-09-10T21:24:53.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.315+0000 7f08f3b9a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558d7ee0 0x55bc558de980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:53.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.315+0000 7f08f3b9a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d8800 0x55bc558deec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:53.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.315+0000 7f08f3b9a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 0x55bc558fc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:53.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.315+0000 7f08f3b9a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f08ec1b0540 con 0x55bc558e4790 2024-09-10T21:24:53.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.315+0000 7f08f3b9a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f08ec1b2080 con 0x55bc558d8800 2024-09-10T21:24:53.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.315+0000 7f08f3b9a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f08ec1b0c10 con 0x55bc558d7ee0 2024-09-10T21:24:53.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.316+0000 7f08eb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 0x55bc558fc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:53.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.316+0000 7f08eb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 0x55bc558fc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46198/0 (socket says 172.21.15.59:46198) 2024-09-10T21:24:53.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.316+0000 7f08eb7fe640 1 -- 172.21.15.59:0/2326863893 learned_addr learned my addr 172.21.15.59:0/2326863893 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:53.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.316+0000 7f08eaffd640 1 --2- 172.21.15.59:0/2326863893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558d7ee0 0x55bc558de980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:53.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.316+0000 7f08ea7fc640 1 --2- 172.21.15.59:0/2326863893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d8800 0x55bc558deec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:53.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.316+0000 7f08eb7fe640 1 -- 172.21.15.59:0/2326863893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558d7ee0 msgr2=0x55bc558de980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:53.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.316+0000 7f08eb7fe640 1 --2- 172.21.15.59:0/2326863893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558d7ee0 0x55bc558de980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.316+0000 7f08eb7fe640 1 -- 172.21.15.59:0/2326863893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d8800 msgr2=0x55bc558deec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:53.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.316+0000 7f08eb7fe640 1 --2- 172.21.15.59:0/2326863893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d8800 0x55bc558deec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.316+0000 7f08eb7fe640 1 -- 172.21.15.59:0/2326863893 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc558f0640 con 0x55bc558e4790 2024-09-10T21:24:53.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.316+0000 7f08ea7fc640 1 --2- 172.21.15.59:0/2326863893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d8800 0x55bc558deec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:53.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.316+0000 7f08eb7fe640 1 --2- 172.21.15.59:0/2326863893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 0x55bc558fc460 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f08e400d010 tx=0x7f08e4005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b508bfe3ced27be server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:53.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.316+0000 7f08d0ff9640 1 -- 172.21.15.59:0/2326863893 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e401ac20 con 0x55bc558e4790 2024-09-10T21:24:53.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.316+0000 7f08d0ff9640 1 -- 172.21.15.59:0/2326863893 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08e403a070 con 0x55bc558e4790 2024-09-10T21:24:53.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.316+0000 7f08d0ff9640 1 -- 172.21.15.59:0/2326863893 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e4004930 con 0x55bc558e4790 2024-09-10T21:24:53.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.317+0000 7f08f3b9a740 1 -- 172.21.15.59:0/2326863893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 msgr2=0x55bc558fc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:53.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.317+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/2326863893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 0x55bc558fc460 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f08e400d010 tx=0x7f08e4005f60 comp rx=0 tx=0).stop 2024-09-10T21:24:53.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.317+0000 7f08f3b9a740 1 -- 172.21.15.59:0/2326863893 shutdown_connections 2024-09-10T21:24:53.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.317+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/2326863893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558e4790 0x55bc558fc460 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.317+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/2326863893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d8800 0x55bc558deec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.317+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/2326863893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558d7ee0 0x55bc558de980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.317+0000 7f08f3b9a740 1 -- 172.21.15.59:0/2326863893 >> 172.21.15.59:0/2326863893 conn(0x55bc558d5d10 msgr2=0x55bc558dfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:53.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.317+0000 7f08f3b9a740 1 -- 172.21.15.59:0/2326863893 shutdown_connections 2024-09-10T21:24:53.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.317+0000 7f08f3b9a740 1 -- 172.21.15.59:0/2326863893 wait complete. 2024-09-10T21:24:53.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.317+0000 7f08f3b9a740 1 -- start start 2024-09-10T21:24:53.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08f3b9a740 1 Processor -- start 2024-09-10T21:24:53.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08f3b9a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d7ee0 0x55bc558e8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:53.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08f3b9a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558d8800 0x55bc558e94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:53.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08f3b9a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558e4790 0x55bc5595a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:53.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08f3b9a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f08ec1b19b0 con 0x55bc558d8800 2024-09-10T21:24:53.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08f3b9a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f08ec1b12e0 con 0x55bc558d7ee0 2024-09-10T21:24:53.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08f3b9a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f08ec1ae520 con 0x55bc558e4790 2024-09-10T21:24:53.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08f3b9a740 10 client.0 _ll_register_callbacks cb 0x7f08e400ea30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:53.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08ea7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558d8800 0x55bc558e94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:53.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08ea7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558d8800 0x55bc558e94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46212/0 (socket says 172.21.15.59:46212) 2024-09-10T21:24:53.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08ea7fc640 1 -- 172.21.15.59:0/4285904507 learned_addr learned my addr 172.21.15.59:0/4285904507 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:53.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08eaffd640 1 --2- 172.21.15.59:0/4285904507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d7ee0 0x55bc558e8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:53.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08eb7fe640 1 --2- 172.21.15.59:0/4285904507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558e4790 0x55bc5595a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:53.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08ea7fc640 1 -- 172.21.15.59:0/4285904507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558e4790 msgr2=0x55bc5595a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:53.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08ea7fc640 1 --2- 172.21.15.59:0/4285904507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558e4790 0x55bc5595a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08ea7fc640 1 -- 172.21.15.59:0/4285904507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d7ee0 msgr2=0x55bc558e8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:53.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08ea7fc640 1 --2- 172.21.15.59:0/4285904507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d7ee0 0x55bc558e8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08ea7fc640 1 -- 172.21.15.59:0/4285904507 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc5595ad70 con 0x55bc558d8800 2024-09-10T21:24:53.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08eaffd640 1 --2- 172.21.15.59:0/4285904507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d7ee0 0x55bc558e8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:53.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.318+0000 7f08eb7fe640 1 --2- 172.21.15.59:0/4285904507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558e4790 0x55bc5595a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:53.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.319+0000 7f08ea7fc640 1 --2- 172.21.15.59:0/4285904507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558d8800 0x55bc558e94e0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f08e00ed4b0 tx=0x7f08e00e58f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c6d5ee18f3fa40 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:53.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.319+0000 7f08ceff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:53.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.319+0000 7f08ceff5640 1 -- 172.21.15.59:0/4285904507 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e0020040 con 0x55bc558d8800 2024-09-10T21:24:53.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.319+0000 7f08ceff5640 1 -- 172.21.15.59:0/4285904507 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f08e0009d50 con 0x55bc558d8800 2024-09-10T21:24:53.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.319+0000 7f08f3b9a740 1 -- 172.21.15.59:0/4285904507 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08e403a070 con 0x55bc558d8800 2024-09-10T21:24:53.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.319+0000 7f08ceff5640 1 -- 172.21.15.59:0/4285904507 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f08e00ab4c0 con 0x55bc558d8800 2024-09-10T21:24:53.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.319+0000 7f08f3b9a740 10 client.17688 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:53.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.319+0000 7f08f3b9a740 1 -- 172.21.15.59:0/4285904507 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bc55962160 con 0x55bc558d8800 2024-09-10T21:24:53.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.319+0000 7f08ceff5640 1 -- 172.21.15.59:0/4285904507 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08e403a070 con 0x55bc558d8800 2024-09-10T21:24:53.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.319+0000 7f08ceff5640 1 -- 172.21.15.59:0/4285904507 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f08e00eb190 con 0x55bc558d8800 2024-09-10T21:24:53.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.319+0000 7f08f3b9a740 10 client.17688 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:53.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.319+0000 7f08f3b9a740 10 client.17688 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:24:53.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.319+0000 7f08f3b9a740 20 client.17688 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:53.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.319+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/4285904507 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55bc558f4730 0x55bc559644b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:53.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.319+0000 7f08f3b9a740 4 client.17688 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:24:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.319+0000 7f08f3b9a740 1 -- 172.21.15.59:0/4285904507 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55bc5584c860 con 0x55bc558f4730 2024-09-10T21:24:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.320+0000 7f08eaffd640 1 --2- 172.21.15.59:0/4285904507 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55bc558f4730 0x55bc559644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.320+0000 7f08eaffd640 1 --2- 172.21.15.59:0/4285904507 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55bc558f4730 0x55bc559644b0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49850704d30ca6cf server_cookie=1b9411df3df2e70c in_seq=0 out_seq=0 2024-09-10T21:24:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.320+0000 7f08ceff5640 10 client.17688 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:53.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.322+0000 7f08ceff5640 1 -- 172.21.15.59:0/4285904507 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bc5584c860 con 0x55bc558f4730 2024-09-10T21:24:53.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.322+0000 7f08ceff5640 10 client.17688 handle_command_reply: tid=0 2024-09-10T21:24:53.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.322+0000 7f08f3b9a740 1 client.17688 shutdown 2024-09-10T21:24:53.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.322+0000 7f08f3b9a740 1 -- 172.21.15.59:0/4285904507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558d8800 msgr2=0x55bc558e94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:53.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.322+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/4285904507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558d8800 0x55bc558e94e0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f08e00ed4b0 tx=0x7f08e00e58f0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.322+0000 7f08f3b9a740 1 -- 172.21.15.59:0/4285904507 shutdown_connections 2024-09-10T21:24:53.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.322+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/4285904507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55bc558e4790 0x55bc5595a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.322+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/4285904507 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55bc558f4730 0x55bc559644b0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.322+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/4285904507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bc558d8800 0x55bc558e94e0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.322+0000 7f08ceff5640 0 client.17688 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.322+0000 7f08f3b9a740 1 --2- 172.21.15.59:0/4285904507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55bc558d7ee0 0x55bc558e8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.322+0000 7f08f3b9a740 1 -- 172.21.15.59:0/4285904507 >> 172.21.15.59:0/4285904507 conn(0x55bc558d5d10 msgr2=0x55bc558efe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.322+0000 7f08f3b9a740 1 -- 172.21.15.59:0/4285904507 shutdown_connections 2024-09-10T21:24:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.322+0000 7f08f3b9a740 1 -- 172.21.15.59:0/4285904507 wait complete. 2024-09-10T21:24:53.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.322+0000 7f08f3b9a740 20 client.17688 trim_cache size 0 max 16384 2024-09-10T21:24:53.334 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:24:53.334 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:24:53.334 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "3ac3cde1-bbc5-4c68-9fc6-bc3e3022aea8", 2024-09-10T21:24:53.335 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:24:53.335 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:24:53.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.323+0000 7f08f17c5640 1 -- 172.21.15.59:0/3432035496 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f08d40b52e0 msgr2=0x7f08d40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:53.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.323+0000 7f08f17c5640 1 --2- 172.21.15.59:0/3432035496 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f08d40b52e0 0x7f08d40b77a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f08ec103a40 tx=0x7f08e400c4d0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.323+0000 7f08f17c5640 1 -- 172.21.15.59:0/3432035496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08ec1045f0 msgr2=0x7f08ec101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:53.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.323+0000 7f08f17c5640 1 --2- 172.21.15.59:0/3432035496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08ec1045f0 0x7f08ec101ec0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f08e000d750 tx=0x7f08e000dc10 comp rx=0 tx=0).stop 2024-09-10T21:24:53.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.323+0000 7f08f17c5640 1 -- 172.21.15.59:0/3432035496 shutdown_connections 2024-09-10T21:24:53.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.323+0000 7f08f17c5640 1 --2- 172.21.15.59:0/3432035496 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f08d40b52e0 0x7f08d40b77a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.323+0000 7f08f17c5640 1 --2- 172.21.15.59:0/3432035496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08ec10d130 0x7f08ec102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.323+0000 7f08f17c5640 1 --2- 172.21.15.59:0/3432035496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08ec1045f0 0x7f08ec101ec0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.323+0000 7f08f17c5640 1 --2- 172.21.15.59:0/3432035496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08ec103cd0 0x7f08ec101980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:53.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.323+0000 7f08f17c5640 1 -- 172.21.15.59:0/3432035496 >> 172.21.15.59:0/3432035496 conn(0x7f08ec0fd770 msgr2=0x7f08ec10f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:53.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.323+0000 7f08f17c5640 1 -- 172.21.15.59:0/3432035496 shutdown_connections 2024-09-10T21:24:53.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:53.323+0000 7f08f17c5640 1 -- 172.21.15.59:0/3432035496 wait complete. 2024-09-10T21:24:54.152 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:24:54.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:54 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:24:54.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:54 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:24:54.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:54 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:24:54.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:54 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:24:54.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:54 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:24:54.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:54 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:24:54.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:54 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:24:54.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:54 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:24:54.414 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:24:54.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:54 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:24:54.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:54 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:24:54.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:54 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:24:54.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:54 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:24:54.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.862+0000 7f38cf236640 1 -- 172.21.15.59:0/1089284922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c8101cd0 msgr2=0x7f38c81020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:54.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.862+0000 7f38cf236640 1 --2- 172.21.15.59:0/1089284922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c8101cd0 0x7f38c81020b0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009900 tx=0x7f38b802a410 comp rx=0 tx=0).stop 2024-09-10T21:24:54.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.862+0000 7f38cf236640 1 -- 172.21.15.59:0/1089284922 shutdown_connections 2024-09-10T21:24:54.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.862+0000 7f38cf236640 1 --2- 172.21.15.59:0/1089284922 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38c8108060 0x7f38c810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.862+0000 7f38cf236640 1 --2- 172.21.15.59:0/1089284922 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38c81076e0 0x7f38c8107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.862+0000 7f38cf236640 1 --2- 172.21.15.59:0/1089284922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c8101cd0 0x7f38c81020b0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.862+0000 7f38cf236640 1 -- 172.21.15.59:0/1089284922 >> 172.21.15.59:0/1089284922 conn(0x7f38c80fd700 msgr2=0x7f38c80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:54.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.862+0000 7f38cf236640 1 -- 172.21.15.59:0/1089284922 shutdown_connections 2024-09-10T21:24:54.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.863+0000 7f38cf236640 1 -- 172.21.15.59:0/1089284922 wait complete. 2024-09-10T21:24:54.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38cf236640 1 Processor -- start 2024-09-10T21:24:54.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38cf236640 1 -- start start 2024-09-10T21:24:54.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38cf236640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38c8101cd0 0x7f38c819a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:54.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38cf236640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38c81076e0 0x7f38c819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:54.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38cf236640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c8108060 0x7f38c81a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:54.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38cf236640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f38c8111d20 con 0x7f38c8108060 2024-09-10T21:24:54.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38cf236640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38c8111ba0 con 0x7f38c81076e0 2024-09-10T21:24:54.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38cf236640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f38c8111ea0 con 0x7f38c8101cd0 2024-09-10T21:24:54.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38cd7d3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c8108060 0x7f38c81a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:54.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38cd7d3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c8108060 0x7f38c81a5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46240/0 (socket says 172.21.15.59:46240) 2024-09-10T21:24:54.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38cd7d3640 1 -- 172.21.15.59:0/2016038317 learned_addr learned my addr 172.21.15.59:0/2016038317 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:54.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38ccfd2640 1 --2- 172.21.15.59:0/2016038317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38c8101cd0 0x7f38c819a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:54.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38cd7d3640 1 -- 172.21.15.59:0/2016038317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38c8101cd0 msgr2=0x7f38c819a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:54.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38cd7d3640 1 --2- 172.21.15.59:0/2016038317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38c8101cd0 0x7f38c819a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38cd7d3640 1 -- 172.21.15.59:0/2016038317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38c81076e0 msgr2=0x7f38c819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:54.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38c7fff640 1 --2- 172.21.15.59:0/2016038317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38c81076e0 0x7f38c819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:54.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38cd7d3640 1 --2- 172.21.15.59:0/2016038317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38c81076e0 0x7f38c819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38cd7d3640 1 -- 172.21.15.59:0/2016038317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c81a5670 con 0x7f38c8108060 2024-09-10T21:24:54.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38ccfd2640 1 --2- 172.21.15.59:0/2016038317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38c8101cd0 0x7f38c819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:54.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.864+0000 7f38c7fff640 1 --2- 172.21.15.59:0/2016038317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38c81076e0 0x7f38c819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.865+0000 7f38cd7d3640 1 --2- 172.21.15.59:0/2016038317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c8108060 0x7f38c81a5130 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f38c000eaa0 tx=0x7f38c000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.865+0000 7f38c5ffb640 1 -- 172.21.15.59:0/2016038317 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c000cdb0 con 0x7f38c8108060 2024-09-10T21:24:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.865+0000 7f38cf236640 1 -- 172.21.15.59:0/2016038317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c81a5840 con 0x7f38c8108060 2024-09-10T21:24:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.865+0000 7f38c5ffb640 1 -- 172.21.15.59:0/2016038317 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38c0005020 con 0x7f38c8108060 2024-09-10T21:24:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.865+0000 7f38c5ffb640 1 -- 172.21.15.59:0/2016038317 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c00116d0 con 0x7f38c8108060 2024-09-10T21:24:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.865+0000 7f38cf236640 1 -- 172.21.15.59:0/2016038317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c81a5da0 con 0x7f38c8108060 2024-09-10T21:24:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.868+0000 7f38d160b740 1 Processor -- start 2024-09-10T21:24:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.868+0000 7f38c5ffb640 1 -- 172.21.15.59:0/2016038317 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f38c000f040 con 0x7f38c8108060 2024-09-10T21:24:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.868+0000 7f38d160b740 1 -- start start 2024-09-10T21:24:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.869+0000 7f38d160b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a631774480 0x55a631774860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.869+0000 7f38d160b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774da0 0x55a6317807f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.869+0000 7f38d160b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631780d30 0x55a631783120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.869+0000 7f38d160b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a6316eae50 con 0x55a631774da0 2024-09-10T21:24:54.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.869+0000 7f38d160b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a6316da280 con 0x55a631780d30 2024-09-10T21:24:54.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.869+0000 7f38d160b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a6316de090 con 0x55a631774480 2024-09-10T21:24:54.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.869+0000 7f38ccfd2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774da0 0x55a6317807f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:54.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.869+0000 7f38ccfd2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774da0 0x55a6317807f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46254/0 (socket says 172.21.15.59:46254) 2024-09-10T21:24:54.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.869+0000 7f38ccfd2640 1 -- 172.21.15.59:0/3552423366 learned_addr learned my addr 172.21.15.59:0/3552423366 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:54.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.869+0000 7f38c7fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a631774480 0x55a631774860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:54.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.869+0000 7f38c7fff640 1 --2- 172.21.15.59:0/3552423366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631780d30 0x55a631783120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:54.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.869+0000 7f38c5ffb640 1 --2- 172.21.15.59:0/2016038317 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f38b00b52e0 0x7f38b00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:54.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.869+0000 7f38ccfd2640 1 -- 172.21.15.59:0/3552423366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a631774480 msgr2=0x55a631774860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:54.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.869+0000 7f38ccfd2640 1 --2- 172.21.15.59:0/3552423366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a631774480 0x55a631774860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.869+0000 7f38ccfd2640 1 -- 172.21.15.59:0/3552423366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631780d30 msgr2=0x55a631783120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:54.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.869+0000 7f38ccfd2640 1 --2- 172.21.15.59:0/3552423366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631780d30 0x55a631783120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.869+0000 7f38ccfd2640 1 -- 172.21.15.59:0/3552423366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a631438650 con 0x55a631774da0 2024-09-10T21:24:54.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.870+0000 7f38c5ffb640 1 -- 172.21.15.59:0/2016038317 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f38c00e5a70 con 0x7f38c8108060 2024-09-10T21:24:54.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.870+0000 7f38ccfd2640 1 --2- 172.21.15.59:0/3552423366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774da0 0x55a6317807f0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f38b8000c00 tx=0x7f38b8032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9495761f6f9b3f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:54.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.870+0000 7f38cd7d3640 1 --2- 172.21.15.59:0/2016038317 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f38b00b52e0 0x7f38b00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:54.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.870+0000 7f38aeffd640 1 -- 172.21.15.59:0/3552423366 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b803f070 con 0x55a631774da0 2024-09-10T21:24:54.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.870+0000 7f38aeffd640 1 -- 172.21.15.59:0/3552423366 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38b80316a0 con 0x55a631774da0 2024-09-10T21:24:54.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.870+0000 7f38aeffd640 1 -- 172.21.15.59:0/3552423366 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b8035070 con 0x55a631774da0 2024-09-10T21:24:54.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.871+0000 7f38d160b740 1 -- 172.21.15.59:0/3552423366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774da0 msgr2=0x55a6317807f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:54.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.871+0000 7f38d160b740 1 --2- 172.21.15.59:0/3552423366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774da0 0x55a6317807f0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f38b8000c00 tx=0x7f38b8032ce0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.871+0000 7f38cd7d3640 1 --2- 172.21.15.59:0/2016038317 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f38b00b52e0 0x7f38b00b77a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f38c00ac1f0 tx=0x7f38c000cf50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:54.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.871+0000 7f38d160b740 1 -- 172.21.15.59:0/3552423366 shutdown_connections 2024-09-10T21:24:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.871+0000 7f38d160b740 1 --2- 172.21.15.59:0/3552423366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631780d30 0x55a631783120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.871+0000 7f38d160b740 1 --2- 172.21.15.59:0/3552423366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774da0 0x55a6317807f0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.871+0000 7f38d160b740 1 --2- 172.21.15.59:0/3552423366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a631774480 0x55a631774860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.871+0000 7f38d160b740 1 -- 172.21.15.59:0/3552423366 >> 172.21.15.59:0/3552423366 conn(0x55a6317722b0 msgr2=0x55a631773450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.871+0000 7f38d160b740 1 -- 172.21.15.59:0/3552423366 shutdown_connections 2024-09-10T21:24:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.871+0000 7f38d160b740 1 -- 172.21.15.59:0/3552423366 wait complete. 2024-09-10T21:24:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.871+0000 7f38d160b740 1 -- start start 2024-09-10T21:24:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.871+0000 7f38d160b740 1 Processor -- start 2024-09-10T21:24:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.871+0000 7f38d160b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774480 0x55a631780620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.871+0000 7f38d160b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631774da0 0x55a63177da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38d160b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a631780d30 0x55a63177e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38d160b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a63153b700 con 0x55a631774480 2024-09-10T21:24:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38d160b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a631675110 con 0x55a631774da0 2024-09-10T21:24:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38d160b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a631783950 con 0x55a631780d30 2024-09-10T21:24:54.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38d160b740 10 client.0 _ll_register_callbacks cb 0x55a63168e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:54.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38c7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774480 0x55a631780620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:54.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38c7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774480 0x55a631780620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46264/0 (socket says 172.21.15.59:46264) 2024-09-10T21:24:54.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38c7fff640 1 -- 172.21.15.59:0/1659529157 learned_addr learned my addr 172.21.15.59:0/1659529157 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:54.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38ccfd2640 1 --2- 172.21.15.59:0/1659529157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631774da0 0x55a63177da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:54.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38c7fff640 1 -- 172.21.15.59:0/1659529157 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a631780d30 msgr2=0x55a63177e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:54.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38c7fff640 1 --2- 172.21.15.59:0/1659529157 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a631780d30 0x55a63177e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38c7fff640 1 -- 172.21.15.59:0/1659529157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631774da0 msgr2=0x55a63177da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:54.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38c7fff640 1 --2- 172.21.15.59:0/1659529157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631774da0 0x55a63177da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38c7fff640 1 -- 172.21.15.59:0/1659529157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6316a2c40 con 0x55a631774480 2024-09-10T21:24:54.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38ccfd2640 1 --2- 172.21.15.59:0/1659529157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631774da0 0x55a63177da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:54.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38c7fff640 1 --2- 172.21.15.59:0/1659529157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774480 0x55a631780620 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0135d0 tx=0x7f38bc013a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fb2fa2d1ff42e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:54.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:54.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38a7fff640 1 -- 172.21.15.59:0/1659529157 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc01a070 con 0x55a631774480 2024-09-10T21:24:54.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38a7fff640 1 -- 172.21.15.59:0/1659529157 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f38bc0147c0 con 0x55a631774480 2024-09-10T21:24:54.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38d160b740 1 -- 172.21.15.59:0/1659529157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38b80316a0 con 0x55a631774480 2024-09-10T21:24:54.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.872+0000 7f38a7fff640 1 -- 172.21.15.59:0/1659529157 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f38bc025050 con 0x55a631774480 2024-09-10T21:24:54.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.873+0000 7f38d160b740 10 client.17700 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:54.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.873+0000 7f38d160b740 1 -- 172.21.15.59:0/1659529157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a63178f2e0 con 0x55a631774480 2024-09-10T21:24:54.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.873+0000 7f38a7fff640 1 -- 172.21.15.59:0/1659529157 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38b80316a0 con 0x55a631774480 2024-09-10T21:24:54.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.873+0000 7f38a7fff640 1 -- 172.21.15.59:0/1659529157 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f38bc015070 con 0x55a631774480 2024-09-10T21:24:54.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.873+0000 7f38d160b740 10 client.17700 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:54.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.873+0000 7f38d160b740 10 client.17700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:24:54.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.873+0000 7f38d160b740 20 client.17700 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.873+0000 7f38d160b740 1 --2- 172.21.15.59:0/1659529157 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a631790790 0x55a631792ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.873+0000 7f38d160b740 4 client.17700 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:24:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.873+0000 7f38d160b740 1 -- 172.21.15.59:0/1659529157 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6316ecda0 con 0x55a631790790 2024-09-10T21:24:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.873+0000 7f38ccfd2640 1 --2- 172.21.15.59:0/1659529157 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a631790790 0x55a631792ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.874+0000 7f38ccfd2640 1 --2- 172.21.15.59:0/1659529157 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a631790790 0x55a631792ba0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3814b95350d40976 server_cookie=d4899370d63adc2a in_seq=0 out_seq=0 2024-09-10T21:24:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.874+0000 7f38a7fff640 10 client.17700 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.875+0000 7f38a7fff640 1 -- 172.21.15.59:0/1659529157 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a6316ecda0 con 0x55a631790790 2024-09-10T21:24:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.875+0000 7f38a7fff640 10 client.17700 handle_command_reply: tid=0 2024-09-10T21:24:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.875+0000 7f38d160b740 1 client.17700 shutdown 2024-09-10T21:24:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.875+0000 7f38d160b740 1 -- 172.21.15.59:0/1659529157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774480 msgr2=0x55a631780620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.875+0000 7f38d160b740 1 --2- 172.21.15.59:0/1659529157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774480 0x55a631780620 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f38bc0135d0 tx=0x7f38bc013a90 comp rx=0 tx=0).stop 2024-09-10T21:24:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.875+0000 7f38d160b740 1 -- 172.21.15.59:0/1659529157 shutdown_connections 2024-09-10T21:24:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.875+0000 7f38d160b740 1 --2- 172.21.15.59:0/1659529157 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a631780d30 0x55a63177e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.875+0000 7f38d160b740 1 --2- 172.21.15.59:0/1659529157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631774da0 0x55a63177da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.875+0000 7f38d160b740 1 --2- 172.21.15.59:0/1659529157 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a631790790 0x55a631792ba0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.875+0000 7f38d160b740 1 --2- 172.21.15.59:0/1659529157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774480 0x55a631780620 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.875+0000 7f38d160b740 1 -- 172.21.15.59:0/1659529157 >> 172.21.15.59:0/1659529157 conn(0x55a6317722b0 msgr2=0x55a631777e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.875+0000 7f38a7fff640 0 client.17700 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.875+0000 7f38d160b740 1 -- 172.21.15.59:0/1659529157 shutdown_connections 2024-09-10T21:24:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.875+0000 7f38d160b740 1 -- 172.21.15.59:0/1659529157 wait complete. 2024-09-10T21:24:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.875+0000 7f38d160b740 20 client.17700 trim_cache size 0 max 16384 2024-09-10T21:24:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.892+0000 7f38d160b740 1 Processor -- start 2024-09-10T21:24:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.892+0000 7f38d160b740 1 -- start start 2024-09-10T21:24:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38d160b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631774480 0x55a63178cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38d160b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774da0 0x55a63176d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38d160b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a631780d30 0x55a63177f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:54.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38d160b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f38c81ae370 con 0x55a631774da0 2024-09-10T21:24:54.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38d160b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38c81afeb0 con 0x55a631774480 2024-09-10T21:24:54.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38d160b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f38c81aea40 con 0x55a631780d30 2024-09-10T21:24:54.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38ccfd2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774da0 0x55a63176d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:54.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38ccfd2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774da0 0x55a63176d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46278/0 (socket says 172.21.15.59:46278) 2024-09-10T21:24:54.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38ccfd2640 1 -- 172.21.15.59:0/2266407723 learned_addr learned my addr 172.21.15.59:0/2266407723 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:54.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38c7fff640 1 --2- 172.21.15.59:0/2266407723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631774480 0x55a63178cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:54.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38c7fff640 1 --2- 172.21.15.59:0/2266407723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a631780d30 0x55a63177f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:54.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38ccfd2640 1 -- 172.21.15.59:0/2266407723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a631780d30 msgr2=0x55a63177f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:54.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38ccfd2640 1 --2- 172.21.15.59:0/2266407723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a631780d30 0x55a63177f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38ccfd2640 1 -- 172.21.15.59:0/2266407723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631774480 msgr2=0x55a63178cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:54.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38ccfd2640 1 --2- 172.21.15.59:0/2266407723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631774480 0x55a63178cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38ccfd2640 1 -- 172.21.15.59:0/2266407723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a63177d820 con 0x55a631774da0 2024-09-10T21:24:54.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38ccfd2640 1 --2- 172.21.15.59:0/2266407723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774da0 0x55a63176d2d0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009900 tx=0x7f38b8005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72e311ff6815285 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:54.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38ae7fc640 1 -- 172.21.15.59:0/2266407723 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b8050070 con 0x55a631774da0 2024-09-10T21:24:54.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38ae7fc640 1 -- 172.21.15.59:0/2266407723 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38b80046c0 con 0x55a631774da0 2024-09-10T21:24:54.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.893+0000 7f38ae7fc640 1 -- 172.21.15.59:0/2266407723 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b8035050 con 0x55a631774da0 2024-09-10T21:24:54.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.894+0000 7f38d160b740 1 -- 172.21.15.59:0/2266407723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774da0 msgr2=0x55a63176d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:54.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.894+0000 7f38d160b740 1 --2- 172.21.15.59:0/2266407723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774da0 0x55a63176d2d0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009900 tx=0x7f38b8005a20 comp rx=0 tx=0).stop 2024-09-10T21:24:54.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.894+0000 7f38d160b740 1 -- 172.21.15.59:0/2266407723 shutdown_connections 2024-09-10T21:24:54.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.894+0000 7f38d160b740 1 --2- 172.21.15.59:0/2266407723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a631780d30 0x55a63177f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.894+0000 7f38d160b740 1 --2- 172.21.15.59:0/2266407723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631774da0 0x55a63176d2d0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.894+0000 7f38d160b740 1 --2- 172.21.15.59:0/2266407723 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631774480 0x55a63178cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.894+0000 7f38d160b740 1 -- 172.21.15.59:0/2266407723 >> 172.21.15.59:0/2266407723 conn(0x55a6317722b0 msgr2=0x55a63177f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:54.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.894+0000 7f38d160b740 1 -- 172.21.15.59:0/2266407723 shutdown_connections 2024-09-10T21:24:54.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.894+0000 7f38d160b740 1 -- 172.21.15.59:0/2266407723 wait complete. 2024-09-10T21:24:54.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.894+0000 7f38d160b740 1 -- start start 2024-09-10T21:24:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.895+0000 7f38d160b740 1 Processor -- start 2024-09-10T21:24:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.895+0000 7f38d160b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a631774480 0x55a631788dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.895+0000 7f38d160b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631774da0 0x55a631789310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.895+0000 7f38d160b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631780d30 0x55a631783ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.895+0000 7f38d160b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f38c81af7e0 con 0x55a631780d30 2024-09-10T21:24:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.895+0000 7f38d160b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38c81af110 con 0x55a631774da0 2024-09-10T21:24:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.895+0000 7f38d160b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f38c81ac350 con 0x55a631774480 2024-09-10T21:24:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.895+0000 7f38d160b740 10 client.0 _ll_register_callbacks cb 0x7f38bc00c960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.895+0000 7f38c7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631780d30 0x55a631783ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.895+0000 7f38c7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631780d30 0x55a631783ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46290/0 (socket says 172.21.15.59:46290) 2024-09-10T21:24:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.895+0000 7f38c7fff640 1 -- 172.21.15.59:0/1064960017 learned_addr learned my addr 172.21.15.59:0/1064960017 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.895+0000 7f38ccfd2640 1 --2- 172.21.15.59:0/1064960017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631774da0 0x55a631789310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.895+0000 7f38c7fff640 1 --2- 172.21.15.59:0/1064960017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a631774480 0x55a631788dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:54.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.895+0000 7f38c7fff640 1 -- 172.21.15.59:0/1064960017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a631774480 msgr2=0x55a631788dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:54.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.895+0000 7f38c7fff640 1 --2- 172.21.15.59:0/1064960017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a631774480 0x55a631788dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.895+0000 7f38c7fff640 1 -- 172.21.15.59:0/1064960017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631774da0 msgr2=0x55a631789310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:54.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.895+0000 7f38c7fff640 1 --2- 172.21.15.59:0/1064960017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631774da0 0x55a631789310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.895+0000 7f38c7fff640 1 -- 172.21.15.59:0/1064960017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6317842e0 con 0x55a631780d30 2024-09-10T21:24:54.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.896+0000 7f38c7fff640 1 --2- 172.21.15.59:0/1064960017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631780d30 0x55a631783ba0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f38bc016c50 tx=0x7f38bc004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b56f8eb0885eb47 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:54.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.896+0000 7f38a7fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:54.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.896+0000 7f38a7fff640 1 -- 172.21.15.59:0/1064960017 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc01a040 con 0x55a631780d30 2024-09-10T21:24:54.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.896+0000 7f38a7fff640 1 -- 172.21.15.59:0/1064960017 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f38bc016840 con 0x55a631780d30 2024-09-10T21:24:54.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.896+0000 7f38d160b740 1 -- 172.21.15.59:0/1064960017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38b80046c0 con 0x55a631780d30 2024-09-10T21:24:54.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.896+0000 7f38a7fff640 1 -- 172.21.15.59:0/1064960017 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f38bc039050 con 0x55a631780d30 2024-09-10T21:24:54.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.896+0000 7f38d160b740 10 client.17706 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:54.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.896+0000 7f38d160b740 1 -- 172.21.15.59:0/1064960017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a6317fe110 con 0x55a631780d30 2024-09-10T21:24:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.896+0000 7f38a7fff640 1 -- 172.21.15.59:0/1064960017 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38b80046c0 con 0x55a631780d30 2024-09-10T21:24:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.896+0000 7f38a7fff640 1 -- 172.21.15.59:0/1064960017 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f38bc0145c0 con 0x55a631780d30 2024-09-10T21:24:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.896+0000 7f38d160b740 10 client.17706 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.896+0000 7f38d160b740 10 client.17706 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:24:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.896+0000 7f38d160b740 20 client.17706 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.896+0000 7f38d160b740 1 --2- 172.21.15.59:0/1064960017 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a6317fe8c0 0x55a631800ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.896+0000 7f38d160b740 4 client.17706 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:24:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.896+0000 7f38d160b740 1 -- 172.21.15.59:0/1064960017 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a6316e8850 con 0x55a6317fe8c0 2024-09-10T21:24:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.897+0000 7f38ccfd2640 1 --2- 172.21.15.59:0/1064960017 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a6317fe8c0 0x55a631800ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.897+0000 7f38ccfd2640 1 --2- 172.21.15.59:0/1064960017 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a6317fe8c0 0x55a631800ce0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=256fd05989f0b012 server_cookie=21a37150dc3b9892 in_seq=0 out_seq=0 2024-09-10T21:24:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.897+0000 7f38a7fff640 10 client.17706 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.897+0000 7f38a7fff640 1 -- 172.21.15.59:0/1064960017 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4918 (crc 0 0 0) 0x55a6316e8850 con 0x55a6317fe8c0 2024-09-10T21:24:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.897+0000 7f38a7fff640 10 client.17706 handle_command_reply: tid=0 2024-09-10T21:24:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.897+0000 7f38d160b740 1 client.17706 shutdown 2024-09-10T21:24:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.898+0000 7f38d160b740 1 -- 172.21.15.59:0/1064960017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631780d30 msgr2=0x55a631783ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.898+0000 7f38d160b740 1 --2- 172.21.15.59:0/1064960017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631780d30 0x55a631783ba0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f38bc016c50 tx=0x7f38bc004660 comp rx=0 tx=0).stop 2024-09-10T21:24:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.898+0000 7f38d160b740 1 -- 172.21.15.59:0/1064960017 shutdown_connections 2024-09-10T21:24:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.898+0000 7f38d160b740 1 --2- 172.21.15.59:0/1064960017 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a6317fe8c0 0x55a631800ce0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.898+0000 7f38a7fff640 0 client.17706 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:24:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.898+0000 7f38d160b740 1 --2- 172.21.15.59:0/1064960017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a631780d30 0x55a631783ba0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.898+0000 7f38d160b740 1 --2- 172.21.15.59:0/1064960017 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a631774da0 0x55a631789310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.898+0000 7f38d160b740 1 --2- 172.21.15.59:0/1064960017 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a631774480 0x55a631788dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.898+0000 7f38d160b740 1 -- 172.21.15.59:0/1064960017 >> 172.21.15.59:0/1064960017 conn(0x55a6317722b0 msgr2=0x55a63177f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.898+0000 7f38d160b740 1 -- 172.21.15.59:0/1064960017 shutdown_connections 2024-09-10T21:24:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.898+0000 7f38d160b740 1 -- 172.21.15.59:0/1064960017 wait complete. 2024-09-10T21:24:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.898+0000 7f38d160b740 20 client.17706 trim_cache size 0 max 16384 2024-09-10T21:24:54.918 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:24:54.918 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:24:54.918 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:24:54.918 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:24:54.918 INFO:teuthology.orchestra.run.smithi059.stdout: "3ac3cde1-bbc5-4c68-9fc6-bc3e3022aea8": { 2024-09-10T21:24:54.918 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:24:53.320547+0000", 2024-09-10T21:24:54.918 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:54.918 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:54.918 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:54.919 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:54.919 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:54.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:54.919 INFO:teuthology.orchestra.run.smithi059.stdout: "0fb476f2-3572-4daf-8d42-5cf40259db46": { 2024-09-10T21:24:54.919 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:53.136187+0000", 2024-09-10T21:24:54.919 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:54.919 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:54.919 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:54.919 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:54.919 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:54.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:54.919 INFO:teuthology.orchestra.run.smithi059.stdout: "cb01ac69-57ce-4c62-b57a-054abf74df29": { 2024-09-10T21:24:54.919 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:07.589420+0000", 2024-09-10T21:24:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:24:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:24:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:24:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:24:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:24:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:07.066301+0000", 2024-09-10T21:24:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:24:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:24:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: "7de1e6cf-02c2-41f2-b957-563f88bae8ef": { 2024-09-10T21:24:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:22:22.098651+0000", 2024-09-10T21:24:54.923 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:54.923 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:54.923 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:54.923 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:54.923 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:54.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:54.923 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:24:54.923 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:24:54.923 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:54.923 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:54.923 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:54.923 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:54.923 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:54.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:54.924 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:24:54.924 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:24:54.924 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:54.924 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:54.924 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:54.924 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:54.924 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:54.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:54.924 INFO:teuthology.orchestra.run.smithi059.stdout: "ec2c29bb-febd-4190-959f-09af3764b7ad": { 2024-09-10T21:24:54.924 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:24:07.378801+0000", 2024-09-10T21:24:54.924 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:54.924 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:54.924 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:54.924 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:54.925 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:54.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:54.925 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:24:54.925 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:24:54.925 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:54.925 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:54.925 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:54.925 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:54.925 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:54.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:54.925 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:24:54.925 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:24:54.925 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:54.925 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:54.926 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:54.926 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:54.926 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:54.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:54.926 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:24:54.926 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:24:54.926 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:54.926 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:54.926 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:54.926 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:54.926 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:54.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:54.926 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:24:54.927 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:24:54.927 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:54.927 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:54.927 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:54.927 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:54.927 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:54.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:54.927 INFO:teuthology.orchestra.run.smithi059.stdout: "800cdb00-6a99-4c42-8a9e-4b1c599c6af0": { 2024-09-10T21:24:54.927 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:52.224081+0000", 2024-09-10T21:24:54.927 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:54.927 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:54.927 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:54.927 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:54.927 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:54.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:24:54.928 INFO:teuthology.orchestra.run.smithi059.stdout: "d82f24b1-930e-4f83-a379-3084f22918d0": { 2024-09-10T21:24:54.928 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:21:37.203865+0000", 2024-09-10T21:24:54.928 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:24:54.928 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:24:54.928 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:24:54.928 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:24:54.928 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:24:54.928 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:24:54.928 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:24:54.928 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:24:54.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.899+0000 7f38cf236640 1 -- 172.21.15.59:0/2016038317 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f38b00b52e0 msgr2=0x7f38b00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:54.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.899+0000 7f38cf236640 1 --2- 172.21.15.59:0/2016038317 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f38b00b52e0 0x7f38b00b77a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f38c00ac1f0 tx=0x7f38c000cf50 comp rx=0 tx=0).stop 2024-09-10T21:24:54.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.899+0000 7f38cf236640 1 -- 172.21.15.59:0/2016038317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c8108060 msgr2=0x7f38c81a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:54.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.899+0000 7f38cf236640 1 --2- 172.21.15.59:0/2016038317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c8108060 0x7f38c81a5130 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f38c000eaa0 tx=0x7f38c000ef60 comp rx=0 tx=0).stop 2024-09-10T21:24:54.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.899+0000 7f38cf236640 1 -- 172.21.15.59:0/2016038317 shutdown_connections 2024-09-10T21:24:54.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.899+0000 7f38cf236640 1 --2- 172.21.15.59:0/2016038317 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f38b00b52e0 0x7f38b00b77a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.899+0000 7f38cf236640 1 --2- 172.21.15.59:0/2016038317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c8108060 0x7f38c81a5130 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.899+0000 7f38cf236640 1 --2- 172.21.15.59:0/2016038317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38c81076e0 0x7f38c819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.899+0000 7f38cf236640 1 --2- 172.21.15.59:0/2016038317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38c8101cd0 0x7f38c819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:54.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.899+0000 7f38cf236640 1 -- 172.21.15.59:0/2016038317 >> 172.21.15.59:0/2016038317 conn(0x7f38c80fd700 msgr2=0x7f38c80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:54.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.899+0000 7f38cf236640 1 -- 172.21.15.59:0/2016038317 shutdown_connections 2024-09-10T21:24:54.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:54.899+0000 7f38cf236640 1 -- 172.21.15.59:0/2016038317 wait complete. 2024-09-10T21:24:55.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:55 smithi059 ceph-mon[30888]: pgmap v629: 97 pgs: 97 active+clean; 6.6 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:24:55.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:55 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:24:55.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:55 smithi192 ceph-mon[35363]: pgmap v629: 97 pgs: 97 active+clean; 6.6 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:24:55.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:55 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:24:55.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:55 smithi154 ceph-mon[35041]: pgmap v629: 97 pgs: 97 active+clean; 6.6 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:24:55.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:55 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:24:55.805 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:24:55.806 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:24:56.070 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:24:56.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.587+0000 7f8eec315640 1 -- 172.21.15.59:0/2990746956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ee4102920 msgr2=0x7f8ee4102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:56.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.587+0000 7f8eec315640 1 --2- 172.21.15.59:0/2990746956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ee4102920 0x7f8ee4102d00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0009900 tx=0x7f8ee002a410 comp rx=0 tx=0).stop 2024-09-10T21:24:56.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.587+0000 7f8eec315640 1 -- 172.21.15.59:0/2990746956 shutdown_connections 2024-09-10T21:24:56.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.587+0000 7f8eec315640 1 --2- 172.21.15.59:0/2990746956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ee4108120 0x7f8ee410e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:56.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.587+0000 7f8eec315640 1 --2- 172.21.15.59:0/2990746956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee4107780 0x7f8ee4107be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:56.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.587+0000 7f8eec315640 1 --2- 172.21.15.59:0/2990746956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ee4102920 0x7f8ee4102d00 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:56.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.587+0000 7f8eec315640 1 -- 172.21.15.59:0/2990746956 >> 172.21.15.59:0/2990746956 conn(0x7f8ee4076f50 msgr2=0x7f8ee4077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:56.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.587+0000 7f8eec315640 1 -- 172.21.15.59:0/2990746956 shutdown_connections 2024-09-10T21:24:56.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.587+0000 7f8eec315640 1 -- 172.21.15.59:0/2990746956 wait complete. 2024-09-10T21:24:56.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.587+0000 7f8eec315640 1 Processor -- start 2024-09-10T21:24:56.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.587+0000 7f8eec315640 1 -- start start 2024-09-10T21:24:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.588+0000 7f8eec315640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee4102920 0x7f8ee4199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.588+0000 7f8eec315640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ee4107780 0x7f8ee4199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.588+0000 7f8eec315640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ee4108120 0x7f8ee419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.588+0000 7f8eec315640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee4111ca0 con 0x7f8ee4107780 2024-09-10T21:24:56.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.588+0000 7f8eec315640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee4111b20 con 0x7f8ee4102920 2024-09-10T21:24:56.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.588+0000 7f8eec315640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee4111e20 con 0x7f8ee4108120 2024-09-10T21:24:56.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.588+0000 7f8ee98b0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ee4107780 0x7f8ee4199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:56.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.588+0000 7f8ee98b0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ee4107780 0x7f8ee4199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46302/0 (socket says 172.21.15.59:46302) 2024-09-10T21:24:56.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.588+0000 7f8ee98b0640 1 -- 172.21.15.59:0/4205020012 learned_addr learned my addr 172.21.15.59:0/4205020012 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:56.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.588+0000 7f8eea8b2640 1 --2- 172.21.15.59:0/4205020012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ee4108120 0x7f8ee419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:56.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.588+0000 7f8eea0b1640 1 --2- 172.21.15.59:0/4205020012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee4102920 0x7f8ee4199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:56.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.588+0000 7f8ee98b0640 1 -- 172.21.15.59:0/4205020012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ee4108120 msgr2=0x7f8ee419eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:56.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.588+0000 7f8ee98b0640 1 --2- 172.21.15.59:0/4205020012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ee4108120 0x7f8ee419eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:56.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.588+0000 7f8ee98b0640 1 -- 172.21.15.59:0/4205020012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee4102920 msgr2=0x7f8ee4199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:56.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.588+0000 7f8ee98b0640 1 --2- 172.21.15.59:0/4205020012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee4102920 0x7f8ee4199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:56.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.588+0000 7f8ee98b0640 1 -- 172.21.15.59:0/4205020012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee419f2b0 con 0x7f8ee4107780 2024-09-10T21:24:56.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.588+0000 7f8ee98b0640 1 --2- 172.21.15.59:0/4205020012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ee4107780 0x7f8ee4199740 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400c920 tx=0x7f8ed400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:56.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.589+0000 7f8edb7fe640 1 -- 172.21.15.59:0/4205020012 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4007c70 con 0x7f8ee4107780 2024-09-10T21:24:56.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.589+0000 7f8eec315640 1 -- 172.21.15.59:0/4205020012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee419f5a0 con 0x7f8ee4107780 2024-09-10T21:24:56.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.589+0000 7f8edb7fe640 1 -- 172.21.15.59:0/4205020012 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ed4007e10 con 0x7f8ee4107780 2024-09-10T21:24:56.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.589+0000 7f8edb7fe640 1 -- 172.21.15.59:0/4205020012 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4018820 con 0x7f8ee4107780 2024-09-10T21:24:56.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.589+0000 7f8eec315640 1 -- 172.21.15.59:0/4205020012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee41a5c60 con 0x7f8ee4107780 2024-09-10T21:24:56.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.590+0000 7f8eec315640 1 -- 172.21.15.59:0/4205020012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ee4102d00 con 0x7f8ee4107780 2024-09-10T21:24:56.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.591+0000 7f8edb7fe640 1 -- 172.21.15.59:0/4205020012 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f8ed400f450 con 0x7f8ee4107780 2024-09-10T21:24:56.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.592+0000 7f8edb7fe640 1 --2- 172.21.15.59:0/4205020012 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8ed00b52e0 0x7f8ed00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:56.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.592+0000 7f8eea0b1640 1 --2- 172.21.15.59:0/4205020012 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8ed00b52e0 0x7f8ed00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:56.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.592+0000 7f8edb7fe640 1 -- 172.21.15.59:0/4205020012 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8ed40e5d20 con 0x7f8ee4107780 2024-09-10T21:24:56.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.592+0000 7f8eea0b1640 1 --2- 172.21.15.59:0/4205020012 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8ed00b52e0 0x7f8ed00b77a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0031440 tx=0x7f8ee00095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:56.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.596+0000 7f8edb7fe640 1 -- 172.21.15.59:0/4205020012 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8ed4014030 con 0x7f8ee4107780 2024-09-10T21:24:56.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.819+0000 7f8eec315640 1 -- 172.21.15.59:0/4205020012 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ee419a330 con 0x7f8ee4107780 2024-09-10T21:24:56.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.820+0000 7f8edb7fe640 1 -- 172.21.15.59:0/4205020012 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f8ed40acc10 con 0x7f8ee4107780 2024-09-10T21:24:56.823 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:24:56.823 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:24:56.823 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:24:56.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.822+0000 7f8eec315640 1 -- 172.21.15.59:0/4205020012 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8ed00b52e0 msgr2=0x7f8ed00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:56.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.822+0000 7f8eec315640 1 --2- 172.21.15.59:0/4205020012 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8ed00b52e0 0x7f8ed00b77a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0031440 tx=0x7f8ee00095f0 comp rx=0 tx=0).stop 2024-09-10T21:24:56.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.822+0000 7f8eec315640 1 -- 172.21.15.59:0/4205020012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ee4107780 msgr2=0x7f8ee4199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:56.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.822+0000 7f8eec315640 1 --2- 172.21.15.59:0/4205020012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ee4107780 0x7f8ee4199740 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400c920 tx=0x7f8ed400cde0 comp rx=0 tx=0).stop 2024-09-10T21:24:56.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.822+0000 7f8eec315640 1 -- 172.21.15.59:0/4205020012 shutdown_connections 2024-09-10T21:24:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.822+0000 7f8eec315640 1 --2- 172.21.15.59:0/4205020012 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8ed00b52e0 0x7f8ed00b77a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.822+0000 7f8eec315640 1 --2- 172.21.15.59:0/4205020012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ee4108120 0x7f8ee419eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.822+0000 7f8eec315640 1 --2- 172.21.15.59:0/4205020012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ee4107780 0x7f8ee4199740 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.822+0000 7f8eec315640 1 --2- 172.21.15.59:0/4205020012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee4102920 0x7f8ee4199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.822+0000 7f8eec315640 1 -- 172.21.15.59:0/4205020012 >> 172.21.15.59:0/4205020012 conn(0x7f8ee4076f50 msgr2=0x7f8ee4105a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.822+0000 7f8eec315640 1 -- 172.21.15.59:0/4205020012 shutdown_connections 2024-09-10T21:24:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:56.822+0000 7f8eec315640 1 -- 172.21.15.59:0/4205020012 wait complete. 2024-09-10T21:24:57.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:57 smithi059 ceph-mon[30888]: pgmap v630: 97 pgs: 97 active+clean; 6.6 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:24:57.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:57 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/4205020012' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:24:57.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:57 smithi192 ceph-mon[35363]: pgmap v630: 97 pgs: 97 active+clean; 6.6 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:24:57.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:57 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/4205020012' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:24:57.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:57 smithi154 ceph-mon[35041]: pgmap v630: 97 pgs: 97 active+clean; 6.6 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:24:57.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:57 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/4205020012' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:24:57.625 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:24:57.882 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:24:58.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.387+0000 7f784d5de640 1 -- 172.21.15.59:0/2325500993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784810d120 msgr2=0x7f784810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:58.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.387+0000 7f784d5de640 1 --2- 172.21.15.59:0/2325500993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784810d120 0x7f784810f550 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f7840009900 tx=0x7f784002a410 comp rx=0 tx=0).stop 2024-09-10T21:24:58.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.388+0000 7f784d5de640 1 -- 172.21.15.59:0/2325500993 shutdown_connections 2024-09-10T21:24:58.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.388+0000 7f784d5de640 1 --2- 172.21.15.59:0/2325500993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784810d120 0x7f784810f550 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.388+0000 7f784d5de640 1 --2- 172.21.15.59:0/2325500993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7848104570 0x7f784810cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.388+0000 7f784d5de640 1 --2- 172.21.15.59:0/2325500993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7848103b70 0x7f7848103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.388+0000 7f784d5de640 1 -- 172.21.15.59:0/2325500993 >> 172.21.15.59:0/2325500993 conn(0x7f78480fd700 msgr2=0x7f78480ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:58.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.388+0000 7f784d5de640 1 -- 172.21.15.59:0/2325500993 shutdown_connections 2024-09-10T21:24:58.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.388+0000 7f784d5de640 1 -- 172.21.15.59:0/2325500993 wait complete. 2024-09-10T21:24:58.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.388+0000 7f784d5de640 1 Processor -- start 2024-09-10T21:24:58.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.388+0000 7f784d5de640 1 -- start start 2024-09-10T21:24:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.389+0000 7f784d5de640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7848103b70 0x7f7848199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.389+0000 7f784d5de640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7848104570 0x7f7848199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.389+0000 7f784d5de640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f784810d120 0x7f784819eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.389+0000 7f784d5de640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7848112d60 con 0x7f7848103b70 2024-09-10T21:24:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.389+0000 7f784d5de640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7848112be0 con 0x7f784810d120 2024-09-10T21:24:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.389+0000 7f784d5de640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7848112ee0 con 0x7f7848104570 2024-09-10T21:24:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.389+0000 7f7846ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7848103b70 0x7f7848199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.389+0000 7f7846ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7848103b70 0x7f7848199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46318/0 (socket says 172.21.15.59:46318) 2024-09-10T21:24:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.389+0000 7f7846ffd640 1 -- 172.21.15.59:0/2182749934 learned_addr learned my addr 172.21.15.59:0/2182749934 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.389+0000 7f78467fc640 1 --2- 172.21.15.59:0/2182749934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7848104570 0x7f7848199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.389+0000 7f78477fe640 1 --2- 172.21.15.59:0/2182749934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f784810d120 0x7f784819eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.389+0000 7f7846ffd640 1 -- 172.21.15.59:0/2182749934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7848104570 msgr2=0x7f7848199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:58.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.389+0000 7f7846ffd640 1 --2- 172.21.15.59:0/2182749934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7848104570 0x7f7848199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.389+0000 7f7846ffd640 1 -- 172.21.15.59:0/2182749934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f784810d120 msgr2=0x7f784819eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:58.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.389+0000 7f7846ffd640 1 --2- 172.21.15.59:0/2182749934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f784810d120 0x7f784819eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.389+0000 7f7846ffd640 1 -- 172.21.15.59:0/2182749934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784819f300 con 0x7f7848103b70 2024-09-10T21:24:58.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.389+0000 7f78467fc640 1 --2- 172.21.15.59:0/2182749934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7848104570 0x7f7848199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:58.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.389+0000 7f7846ffd640 1 --2- 172.21.15.59:0/2182749934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7848103b70 0x7f7848199250 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f783800cce0 tx=0x7f783800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:58.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.390+0000 7f782ffff640 1 -- 172.21.15.59:0/2182749934 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838004b20 con 0x7f7848103b70 2024-09-10T21:24:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.390+0000 7f782ffff640 1 -- 172.21.15.59:0/2182749934 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7838004cc0 con 0x7f7848103b70 2024-09-10T21:24:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.390+0000 7f784d5de640 1 -- 172.21.15.59:0/2182749934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f784819f5f0 con 0x7f7848103b70 2024-09-10T21:24:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.390+0000 7f782ffff640 1 -- 172.21.15.59:0/2182749934 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783800f6b0 con 0x7f7848103b70 2024-09-10T21:24:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.390+0000 7f784d5de640 1 -- 172.21.15.59:0/2182749934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78481a5e80 con 0x7f7848103b70 2024-09-10T21:24:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.392+0000 7f782ffff640 1 -- 172.21.15.59:0/2182749934 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f783800f850 con 0x7f7848103b70 2024-09-10T21:24:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.392+0000 7f784f9b3740 1 Processor -- start 2024-09-10T21:24:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f784f9b3740 1 -- start start 2024-09-10T21:24:58.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f784f9b3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 0x563be280e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f784f9b3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be280edf0 0x563be281ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f784f9b3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be281f190 0x563be2821580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f784f9b3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563be2784ea0 con 0x563be280e4d0 2024-09-10T21:24:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f784f9b3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563be27742d0 con 0x563be280edf0 2024-09-10T21:24:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f784f9b3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563be27780e0 con 0x563be281f190 2024-09-10T21:24:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f78477fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 0x563be280e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f78477fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 0x563be280e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46330/0 (socket says 172.21.15.59:46330) 2024-09-10T21:24:58.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f78477fe640 1 -- 172.21.15.59:0/3698330275 learned_addr learned my addr 172.21.15.59:0/3698330275 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f7846ffd640 1 --2- 172.21.15.59:0/3698330275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be280edf0 0x563be281ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f78467fc640 1 --2- 172.21.15.59:0/3698330275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be281f190 0x563be2821580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f78477fe640 1 -- 172.21.15.59:0/3698330275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be281f190 msgr2=0x563be2821580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f78477fe640 1 --2- 172.21.15.59:0/3698330275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be281f190 0x563be2821580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f78477fe640 1 -- 172.21.15.59:0/3698330275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be280edf0 msgr2=0x563be281ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f78477fe640 1 --2- 172.21.15.59:0/3698330275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be280edf0 0x563be281ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f78477fe640 1 -- 172.21.15.59:0/3698330275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563be24d2650 con 0x563be280e4d0 2024-09-10T21:24:58.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f78467fc640 1 --2- 172.21.15.59:0/3698330275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be281f190 0x563be2821580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:58.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f7846ffd640 1 --2- 172.21.15.59:0/3698330275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be280edf0 0x563be281ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:58.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.393+0000 7f782ffff640 1 --2- 172.21.15.59:0/2182749934 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f78300b5360 0x7f78300b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:58.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.394+0000 7f78477fe640 1 --2- 172.21.15.59:0/3698330275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 0x563be280e8b0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f7840031440 tx=0x7f7840032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a54cedd027718e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:58.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.394+0000 7f7846ffd640 1 --2- 172.21.15.59:0/2182749934 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f78300b5360 0x7f78300b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:58.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.394+0000 7f782ffff640 1 -- 172.21.15.59:0/2182749934 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f78380e5c60 con 0x7f7848103b70 2024-09-10T21:24:58.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.394+0000 7f782d7fa640 1 -- 172.21.15.59:0/3698330275 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840035030 con 0x563be280e4d0 2024-09-10T21:24:58.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.394+0000 7f782d7fa640 1 -- 172.21.15.59:0/3698330275 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78400316a0 con 0x563be280e4d0 2024-09-10T21:24:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.394+0000 7f782d7fa640 1 -- 172.21.15.59:0/3698330275 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78400046c0 con 0x563be280e4d0 2024-09-10T21:24:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.395+0000 7f784f9b3740 1 -- 172.21.15.59:0/3698330275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 msgr2=0x563be280e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.395+0000 7f784f9b3740 1 --2- 172.21.15.59:0/3698330275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 0x563be280e8b0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f7840031440 tx=0x7f7840032c50 comp rx=0 tx=0).stop 2024-09-10T21:24:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.395+0000 7f7846ffd640 1 --2- 172.21.15.59:0/2182749934 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f78300b5360 0x7f78300b7820 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f78380e3b00 tx=0x7f7838005870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.395+0000 7f784f9b3740 1 -- 172.21.15.59:0/3698330275 shutdown_connections 2024-09-10T21:24:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.395+0000 7f784f9b3740 1 --2- 172.21.15.59:0/3698330275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be281f190 0x563be2821580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.395+0000 7f784f9b3740 1 --2- 172.21.15.59:0/3698330275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be280edf0 0x563be281ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.395+0000 7f784f9b3740 1 --2- 172.21.15.59:0/3698330275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 0x563be280e8b0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.395+0000 7f784f9b3740 1 -- 172.21.15.59:0/3698330275 >> 172.21.15.59:0/3698330275 conn(0x563be280c300 msgr2=0x563be280d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.395+0000 7f784f9b3740 1 -- 172.21.15.59:0/3698330275 shutdown_connections 2024-09-10T21:24:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.395+0000 7f784f9b3740 1 -- 172.21.15.59:0/3698330275 wait complete. 2024-09-10T21:24:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.395+0000 7f784f9b3740 1 -- start start 2024-09-10T21:24:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.395+0000 7f784f9b3740 1 Processor -- start 2024-09-10T21:24:58.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.396+0000 7f784f9b3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be280e4d0 0x563be281ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:58.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.396+0000 7f784f9b3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280edf0 0x563be281bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:58.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.396+0000 7f784f9b3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be281f190 0x563be281c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:58.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.396+0000 7f784f9b3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563be25d5700 con 0x563be280edf0 2024-09-10T21:24:58.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.396+0000 7f784f9b3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563be270f160 con 0x563be281f190 2024-09-10T21:24:58.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.396+0000 7f784f9b3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x563be2821de0 con 0x563be280e4d0 2024-09-10T21:24:58.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.396+0000 7f784f9b3740 10 client.0 _ll_register_callbacks cb 0x563be27289e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:58.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.396+0000 7f78467fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280edf0 0x563be281bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:58.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.396+0000 7f78467fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280edf0 0x563be281bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46338/0 (socket says 172.21.15.59:46338) 2024-09-10T21:24:58.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.396+0000 7f78467fc640 1 -- 172.21.15.59:0/3631268166 learned_addr learned my addr 172.21.15.59:0/3631268166 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:58.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.396+0000 7f78477fe640 1 --2- 172.21.15.59:0/3631268166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be280e4d0 0x563be281ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:58.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.396+0000 7f78477fe640 1 --2- 172.21.15.59:0/3631268166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be281f190 0x563be281c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:58.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.396+0000 7f78467fc640 1 -- 172.21.15.59:0/3631268166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be280e4d0 msgr2=0x563be281ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:58.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.396+0000 7f78467fc640 1 --2- 172.21.15.59:0/3631268166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be280e4d0 0x563be281ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.396+0000 7f78467fc640 1 -- 172.21.15.59:0/3631268166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be281f190 msgr2=0x563be281c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:58.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.396+0000 7f78467fc640 1 --2- 172.21.15.59:0/3631268166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be281f190 0x563be281c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.396+0000 7f78467fc640 1 -- 172.21.15.59:0/3631268166 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563be273cc90 con 0x563be280edf0 2024-09-10T21:24:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.396+0000 7f78467fc640 1 --2- 172.21.15.59:0/3631268166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280edf0 0x563be281bee0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f783c010670 tx=0x7f783c010b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1cebd0f5084aa9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.396+0000 7f782aff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.397+0000 7f782aff5640 1 -- 172.21.15.59:0/3631268166 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c00baa0 con 0x563be280edf0 2024-09-10T21:24:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.397+0000 7f782aff5640 1 -- 172.21.15.59:0/3631268166 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f783c00bc40 con 0x563be280edf0 2024-09-10T21:24:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.397+0000 7f784f9b3740 1 -- 172.21.15.59:0/3631268166 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78400316a0 con 0x563be280edf0 2024-09-10T21:24:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.397+0000 7f782aff5640 1 -- 172.21.15.59:0/3631268166 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f783c00be40 con 0x563be280edf0 2024-09-10T21:24:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.397+0000 7f784f9b3740 10 client.17724 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:58.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.397+0000 7f784f9b3740 1 -- 172.21.15.59:0/3631268166 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563be282d700 con 0x563be280edf0 2024-09-10T21:24:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.397+0000 7f782aff5640 1 -- 172.21.15.59:0/3631268166 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78400316a0 con 0x563be280edf0 2024-09-10T21:24:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.397+0000 7f782aff5640 1 -- 172.21.15.59:0/3631268166 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f783c00f040 con 0x563be280edf0 2024-09-10T21:24:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.397+0000 7f784f9b3740 10 client.17724 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.397+0000 7f784f9b3740 10 client.17724 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:24:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.397+0000 7f784f9b3740 20 client.17724 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.397+0000 7f784f9b3740 1 --2- 172.21.15.59:0/3631268166 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x563be282ed40 0x563be2831130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.397+0000 7f784f9b3740 4 client.17724 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:24:58.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.397+0000 7f784f9b3740 1 -- 172.21.15.59:0/3631268166 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563be2786df0 con 0x563be282ed40 2024-09-10T21:24:58.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.398+0000 7f78477fe640 1 --2- 172.21.15.59:0/3631268166 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x563be282ed40 0x563be2831130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:58.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.398+0000 7f78477fe640 1 --2- 172.21.15.59:0/3631268166 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x563be282ed40 0x563be2831130 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=68f0b0c7000aa269 server_cookie=ca2302d7d896ba45 in_seq=0 out_seq=0 2024-09-10T21:24:58.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.398+0000 7f782aff5640 10 client.17724 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:24:58.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.399+0000 7f782aff5640 1 -- 172.21.15.59:0/3631268166 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563be2786df0 con 0x563be282ed40 2024-09-10T21:24:58.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.399+0000 7f782aff5640 10 client.17724 handle_command_reply: tid=0 2024-09-10T21:24:58.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.399+0000 7f784f9b3740 1 client.17724 shutdown 2024-09-10T21:24:58.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.399+0000 7f784f9b3740 1 -- 172.21.15.59:0/3631268166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280edf0 msgr2=0x563be281bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:58.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.399+0000 7f784f9b3740 1 --2- 172.21.15.59:0/3631268166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280edf0 0x563be281bee0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f783c010670 tx=0x7f783c010b30 comp rx=0 tx=0).stop 2024-09-10T21:24:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.399+0000 7f784f9b3740 1 -- 172.21.15.59:0/3631268166 shutdown_connections 2024-09-10T21:24:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.399+0000 7f784f9b3740 1 --2- 172.21.15.59:0/3631268166 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x563be282ed40 0x563be2831130 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.399+0000 7f784f9b3740 1 --2- 172.21.15.59:0/3631268166 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be281f190 0x563be281c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.399+0000 7f784f9b3740 1 --2- 172.21.15.59:0/3631268166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280edf0 0x563be281bee0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.399+0000 7f782aff5640 0 client.17724 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:24:58.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.399+0000 7f784f9b3740 1 --2- 172.21.15.59:0/3631268166 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be280e4d0 0x563be281ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.399+0000 7f784f9b3740 1 -- 172.21.15.59:0/3631268166 >> 172.21.15.59:0/3631268166 conn(0x563be280c300 msgr2=0x563be2811ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:58.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.399+0000 7f784f9b3740 1 -- 172.21.15.59:0/3631268166 shutdown_connections 2024-09-10T21:24:58.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.399+0000 7f784f9b3740 1 -- 172.21.15.59:0/3631268166 wait complete. 2024-09-10T21:24:58.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.399+0000 7f784f9b3740 20 client.17724 trim_cache size 0 max 16384 2024-09-10T21:24:58.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.412+0000 7f784f9b3740 1 Processor -- start 2024-09-10T21:24:58.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.412+0000 7f784f9b3740 1 -- start start 2024-09-10T21:24:58.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f784f9b3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 0x563be282b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:58.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f784f9b3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be280edf0 0x563be280d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:58.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f784f9b3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be281f190 0x563be280d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:58.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f784f9b3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78481ac050 con 0x563be280e4d0 2024-09-10T21:24:58.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f784f9b3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78481adb90 con 0x563be280edf0 2024-09-10T21:24:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f784f9b3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f78481ac720 con 0x563be281f190 2024-09-10T21:24:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f78477fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 0x563be282b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f78477fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 0x563be282b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46352/0 (socket says 172.21.15.59:46352) 2024-09-10T21:24:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f78477fe640 1 -- 172.21.15.59:0/1078369285 learned_addr learned my addr 172.21.15.59:0/1078369285 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f78467fc640 1 --2- 172.21.15.59:0/1078369285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be280edf0 0x563be280d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f78477fe640 1 -- 172.21.15.59:0/1078369285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be281f190 msgr2=0x563be280d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f78477fe640 1 --2- 172.21.15.59:0/1078369285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be281f190 0x563be280d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f78477fe640 1 -- 172.21.15.59:0/1078369285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be280edf0 msgr2=0x563be280d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f78477fe640 1 --2- 172.21.15.59:0/1078369285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be280edf0 0x563be280d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f78477fe640 1 -- 172.21.15.59:0/1078369285 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563be2806920 con 0x563be280e4d0 2024-09-10T21:24:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f78467fc640 1 --2- 172.21.15.59:0/1078369285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be280edf0 0x563be280d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f78477fe640 1 --2- 172.21.15.59:0/1078369285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 0x563be282b070 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f78400095d0 tx=0x7f7840009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f848f9b71ce4a4b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f782cff9640 1 -- 172.21.15.59:0/1078369285 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840035040 con 0x563be280e4d0 2024-09-10T21:24:58.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f782cff9640 1 -- 172.21.15.59:0/1078369285 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78400316a0 con 0x563be280e4d0 2024-09-10T21:24:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.413+0000 7f782cff9640 1 -- 172.21.15.59:0/1078369285 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840004dc0 con 0x563be280e4d0 2024-09-10T21:24:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.414+0000 7f784f9b3740 1 -- 172.21.15.59:0/1078369285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 msgr2=0x563be282b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.414+0000 7f784f9b3740 1 --2- 172.21.15.59:0/1078369285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 0x563be282b070 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f78400095d0 tx=0x7f7840009560 comp rx=0 tx=0).stop 2024-09-10T21:24:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.414+0000 7f784f9b3740 1 -- 172.21.15.59:0/1078369285 shutdown_connections 2024-09-10T21:24:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.414+0000 7f784f9b3740 1 --2- 172.21.15.59:0/1078369285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be281f190 0x563be280d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.414+0000 7f784f9b3740 1 --2- 172.21.15.59:0/1078369285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be280edf0 0x563be280d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.414+0000 7f784f9b3740 1 --2- 172.21.15.59:0/1078369285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 0x563be282b070 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.414+0000 7f784f9b3740 1 -- 172.21.15.59:0/1078369285 >> 172.21.15.59:0/1078369285 conn(0x563be280c300 msgr2=0x563be281a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.414+0000 7f784f9b3740 1 -- 172.21.15.59:0/1078369285 shutdown_connections 2024-09-10T21:24:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.414+0000 7f784f9b3740 1 -- 172.21.15.59:0/1078369285 wait complete. 2024-09-10T21:24:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.414+0000 7f784f9b3740 1 -- start start 2024-09-10T21:24:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.414+0000 7f784f9b3740 1 Processor -- start 2024-09-10T21:24:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f784f9b3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 0x563be2827590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:58.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f784f9b3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be280edf0 0x563be2827af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f784f9b3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be281f190 0x563be28222c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f784f9b3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78481ad4c0 con 0x563be280e4d0 2024-09-10T21:24:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f784f9b3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78481acdf0 con 0x563be281f190 2024-09-10T21:24:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f784f9b3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f78481aa030 con 0x563be280edf0 2024-09-10T21:24:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f784f9b3740 10 client.0 _ll_register_callbacks cb 0x7f783c00e3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f78477fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 0x563be2827590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f78477fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 0x563be2827590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46364/0 (socket says 172.21.15.59:46364) 2024-09-10T21:24:58.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f78477fe640 1 -- 172.21.15.59:0/461243903 learned_addr learned my addr 172.21.15.59:0/461243903 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f78467fc640 1 --2- 172.21.15.59:0/461243903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be280edf0 0x563be2827af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f78477fe640 1 --2- 172.21.15.59:0/461243903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be281f190 0x563be28222c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f78477fe640 1 -- 172.21.15.59:0/461243903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be280edf0 msgr2=0x563be2827af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f78477fe640 1 --2- 172.21.15.59:0/461243903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be280edf0 0x563be2827af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f78477fe640 1 -- 172.21.15.59:0/461243903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be281f190 msgr2=0x563be28222c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:58.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f78477fe640 1 --2- 172.21.15.59:0/461243903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be281f190 0x563be28222c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f78477fe640 1 -- 172.21.15.59:0/461243903 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563be2822af0 con 0x563be280e4d0 2024-09-10T21:24:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f78477fe640 1 --2- 172.21.15.59:0/461243903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 0x563be2827590 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f7840033000 tx=0x7f7840004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c75e2aced1468a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f782aff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f782aff5640 1 -- 172.21.15.59:0/461243903 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840060060 con 0x563be280e4d0 2024-09-10T21:24:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f782aff5640 1 -- 172.21.15.59:0/461243903 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7840004880 con 0x563be280e4d0 2024-09-10T21:24:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.415+0000 7f784f9b3740 1 -- 172.21.15.59:0/461243903 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78400316a0 con 0x563be280e4d0 2024-09-10T21:24:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.416+0000 7f782aff5640 1 -- 172.21.15.59:0/461243903 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7840035040 con 0x563be280e4d0 2024-09-10T21:24:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.416+0000 7f784f9b3740 10 client.17730 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.416+0000 7f784f9b3740 1 -- 172.21.15.59:0/461243903 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563be289c6e0 con 0x563be280e4d0 2024-09-10T21:24:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.416+0000 7f782aff5640 1 -- 172.21.15.59:0/461243903 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78400316a0 con 0x563be280e4d0 2024-09-10T21:24:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.416+0000 7f782aff5640 1 -- 172.21.15.59:0/461243903 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7840003780 con 0x563be280e4d0 2024-09-10T21:24:58.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.416+0000 7f784f9b3740 10 client.17730 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.416+0000 7f784f9b3740 10 client.17730 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:24:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.416+0000 7f784f9b3740 20 client.17730 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.416+0000 7f784f9b3740 1 --2- 172.21.15.59:0/461243903 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x563be289c8b0 0x563be289eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.416+0000 7f784f9b3740 4 client.17730 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:24:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.416+0000 7f784f9b3740 1 -- 172.21.15.59:0/461243903 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563be27828a0 con 0x563be289c8b0 2024-09-10T21:24:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.416+0000 7f78467fc640 1 --2- 172.21.15.59:0/461243903 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x563be289c8b0 0x563be289eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.417+0000 7f782aff5640 10 client.17730 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:24:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.417+0000 7f78467fc640 1 --2- 172.21.15.59:0/461243903 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x563be289c8b0 0x563be289eca0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bf6e59eacdec107b server_cookie=22513a7e7c6a4a91 in_seq=0 out_seq=0 2024-09-10T21:24:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.417+0000 7f782aff5640 1 -- 172.21.15.59:0/461243903 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563be27828a0 con 0x563be289c8b0 2024-09-10T21:24:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.417+0000 7f782aff5640 10 client.17730 handle_command_reply: tid=0 2024-09-10T21:24:58.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.417+0000 7f784f9b3740 1 client.17730 shutdown 2024-09-10T21:24:58.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.417+0000 7f784f9b3740 1 -- 172.21.15.59:0/461243903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 msgr2=0x563be2827590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:58.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.417+0000 7f784f9b3740 1 --2- 172.21.15.59:0/461243903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 0x563be2827590 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f7840033000 tx=0x7f7840004c60 comp rx=0 tx=0).stop 2024-09-10T21:24:58.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.417+0000 7f784f9b3740 1 -- 172.21.15.59:0/461243903 shutdown_connections 2024-09-10T21:24:58.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.417+0000 7f784f9b3740 1 --2- 172.21.15.59:0/461243903 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x563be289c8b0 0x563be289eca0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.417+0000 7f782aff5640 0 client.17730 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:24:58.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.417+0000 7f784f9b3740 1 --2- 172.21.15.59:0/461243903 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563be281f190 0x563be28222c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.417+0000 7f784f9b3740 1 --2- 172.21.15.59:0/461243903 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563be280edf0 0x563be2827af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.417+0000 7f784f9b3740 1 --2- 172.21.15.59:0/461243903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563be280e4d0 0x563be2827590 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.417+0000 7f784f9b3740 1 -- 172.21.15.59:0/461243903 >> 172.21.15.59:0/461243903 conn(0x563be280c300 msgr2=0x563be2811680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:58.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.417+0000 7f784f9b3740 1 -- 172.21.15.59:0/461243903 shutdown_connections 2024-09-10T21:24:58.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.418+0000 7f784f9b3740 1 -- 172.21.15.59:0/461243903 wait complete. 2024-09-10T21:24:58.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.418+0000 7f784f9b3740 20 client.17730 trim_cache size 0 max 16384 2024-09-10T21:24:58.438 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:24:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.418+0000 7f784d5de640 1 -- 172.21.15.59:0/2182749934 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f78300b5360 msgr2=0x7f78300b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.418+0000 7f784d5de640 1 --2- 172.21.15.59:0/2182749934 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f78300b5360 0x7f78300b7820 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f78380e3b00 tx=0x7f7838005870 comp rx=0 tx=0).stop 2024-09-10T21:24:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.418+0000 7f784d5de640 1 -- 172.21.15.59:0/2182749934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7848103b70 msgr2=0x7f7848199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.418+0000 7f784d5de640 1 --2- 172.21.15.59:0/2182749934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7848103b70 0x7f7848199250 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f783800cce0 tx=0x7f783800a620 comp rx=0 tx=0).stop 2024-09-10T21:24:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.418+0000 7f784d5de640 1 -- 172.21.15.59:0/2182749934 shutdown_connections 2024-09-10T21:24:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.418+0000 7f784d5de640 1 --2- 172.21.15.59:0/2182749934 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f78300b5360 0x7f78300b7820 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.418+0000 7f784d5de640 1 --2- 172.21.15.59:0/2182749934 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f784810d120 0x7f784819eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.418+0000 7f784d5de640 1 --2- 172.21.15.59:0/2182749934 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7848104570 0x7f7848199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.418+0000 7f784d5de640 1 --2- 172.21.15.59:0/2182749934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7848103b70 0x7f7848199250 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.418+0000 7f784d5de640 1 -- 172.21.15.59:0/2182749934 >> 172.21.15.59:0/2182749934 conn(0x7f78480fd700 msgr2=0x7f78480fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.418+0000 7f784d5de640 1 -- 172.21.15.59:0/2182749934 shutdown_connections 2024-09-10T21:24:58.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:58.418+0000 7f784d5de640 1 -- 172.21.15.59:0/2182749934 wait complete. 2024-09-10T21:24:59.086 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:24:59.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:24:59 smithi192 ceph-mon[35363]: pgmap v631: 97 pgs: 97 active+clean; 6.6 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:24:59.343 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:24:59.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:24:59 smithi059 ceph-mon[30888]: pgmap v631: 97 pgs: 97 active+clean; 6.6 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:24:59.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:24:59 smithi154 ceph-mon[35041]: pgmap v631: 97 pgs: 97 active+clean; 6.6 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:24:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.829+0000 7fe7cb915640 1 -- 172.21.15.59:0/2388085735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7c4104600 msgr2=0x7fe7c410caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.829+0000 7fe7cb915640 1 --2- 172.21.15.59:0/2388085735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7c4104600 0x7fe7c410caf0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4009900 tx=0x7fe7b402a410 comp rx=0 tx=0).stop 2024-09-10T21:24:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.829+0000 7fe7cb915640 1 -- 172.21.15.59:0/2388085735 shutdown_connections 2024-09-10T21:24:59.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.829+0000 7fe7cb915640 1 --2- 172.21.15.59:0/2388085735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7c410d140 0x7fe7c410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.829+0000 7fe7cb915640 1 --2- 172.21.15.59:0/2388085735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7c4104600 0x7fe7c410caf0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.829+0000 7fe7cb915640 1 --2- 172.21.15.59:0/2388085735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c4103ce0 0x7fe7c41040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.829+0000 7fe7cb915640 1 -- 172.21.15.59:0/2388085735 >> 172.21.15.59:0/2388085735 conn(0x7fe7c40fd720 msgr2=0x7fe7c40ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.829+0000 7fe7cb915640 1 -- 172.21.15.59:0/2388085735 shutdown_connections 2024-09-10T21:24:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.829+0000 7fe7cb915640 1 -- 172.21.15.59:0/2388085735 wait complete. 2024-09-10T21:24:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7cb915640 1 Processor -- start 2024-09-10T21:24:59.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7cb915640 1 -- start start 2024-09-10T21:24:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7cb915640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c4103ce0 0x7fe7c4199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7cb915640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7c4104600 0x7fe7c41997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7cb915640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7c410d140 0x7fe7c419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7cb915640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c4112db0 con 0x7fe7c4104600 2024-09-10T21:24:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7cb915640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c4112c30 con 0x7fe7c4103ce0 2024-09-10T21:24:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7cb915640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c4112f30 con 0x7fe7c410d140 2024-09-10T21:24:59.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7c8eb0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7c4104600 0x7fe7c41997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7c8eb0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7c4104600 0x7fe7c41997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45600/0 (socket says 172.21.15.59:45600) 2024-09-10T21:24:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7c8eb0640 1 -- 172.21.15.59:0/4203101750 learned_addr learned my addr 172.21.15.59:0/4203101750 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7c96b1640 1 --2- 172.21.15.59:0/4203101750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c4103ce0 0x7fe7c4199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7c9eb2640 1 --2- 172.21.15.59:0/4203101750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7c410d140 0x7fe7c419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7c8eb0640 1 -- 172.21.15.59:0/4203101750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7c410d140 msgr2=0x7fe7c419eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7c8eb0640 1 --2- 172.21.15.59:0/4203101750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7c410d140 0x7fe7c419eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7c8eb0640 1 -- 172.21.15.59:0/4203101750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c4103ce0 msgr2=0x7fe7c4199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:59.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7c8eb0640 1 --2- 172.21.15.59:0/4203101750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c4103ce0 0x7fe7c4199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7c8eb0640 1 -- 172.21.15.59:0/4203101750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c419f330 con 0x7fe7c4104600 2024-09-10T21:24:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7c9eb2640 1 --2- 172.21.15.59:0/4203101750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7c410d140 0x7fe7c419eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.830+0000 7fe7c96b1640 1 --2- 172.21.15.59:0/4203101750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c4103ce0 0x7fe7c4199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.831+0000 7fe7c8eb0640 1 --2- 172.21.15.59:0/4203101750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7c4104600 0x7fe7c41997c0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4006010 tx=0x7fe7b4004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.831+0000 7fe7ba7fc640 1 -- 172.21.15.59:0/4203101750 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b403f030 con 0x7fe7c4104600 2024-09-10T21:24:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.831+0000 7fe7cb915640 1 -- 172.21.15.59:0/4203101750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c419f5c0 con 0x7fe7c4104600 2024-09-10T21:24:59.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.831+0000 7fe7ba7fc640 1 -- 172.21.15.59:0/4203101750 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7b4003aa0 con 0x7fe7c4104600 2024-09-10T21:24:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.831+0000 7fe7ba7fc640 1 -- 172.21.15.59:0/4203101750 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4035070 con 0x7fe7c4104600 2024-09-10T21:24:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.831+0000 7fe7cb915640 1 -- 172.21.15.59:0/4203101750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c41a5ce0 con 0x7fe7c4104600 2024-09-10T21:24:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.834+0000 7fe7cdcea740 1 Processor -- start 2024-09-10T21:24:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.834+0000 7fe7cdcea740 1 -- start start 2024-09-10T21:24:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.834+0000 7fe7cdcea740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b4770f0 0x56026b4774d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:59.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.834+0000 7fe7cdcea740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b477a10 0x56026b483460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:59.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.834+0000 7fe7cdcea740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4839a0 0x56026b485d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:59.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.834+0000 7fe7cdcea740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56026b3edea0 con 0x56026b4839a0 2024-09-10T21:24:59.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.834+0000 7fe7cdcea740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56026b3dd2d0 con 0x56026b4770f0 2024-09-10T21:24:59.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.834+0000 7fe7cdcea740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56026b3e10e0 con 0x56026b477a10 2024-09-10T21:24:59.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.835+0000 7fe7ba7fc640 1 -- 172.21.15.59:0/4203101750 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fe7b40035f0 con 0x7fe7c4104600 2024-09-10T21:24:59.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.835+0000 7fe7c96b1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b477a10 0x56026b483460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:59.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.835+0000 7fe7c9eb2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b4770f0 0x56026b4774d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:59.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.835+0000 7fe7c8eb0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4839a0 0x56026b485d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:59.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.835+0000 7fe7c96b1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b477a10 0x56026b483460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:59658/0 (socket says 172.21.15.59:59658) 2024-09-10T21:24:59.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.835+0000 7fe7c96b1640 1 -- 172.21.15.59:0/2953776776 learned_addr learned my addr 172.21.15.59:0/2953776776 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:59.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.835+0000 7fe7c96b1640 1 -- 172.21.15.59:0/2953776776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b4770f0 msgr2=0x56026b4774d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:59.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.835+0000 7fe7c96b1640 1 --2- 172.21.15.59:0/2953776776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b4770f0 0x56026b4774d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.835+0000 7fe7c96b1640 1 -- 172.21.15.59:0/2953776776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4839a0 msgr2=0x56026b485d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:59.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.835+0000 7fe7c96b1640 1 --2- 172.21.15.59:0/2953776776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4839a0 0x56026b485d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.835+0000 7fe7c96b1640 1 -- 172.21.15.59:0/2953776776 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56026b13b650 con 0x56026b477a10 2024-09-10T21:24:59.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.835+0000 7fe7c8eb0640 1 --2- 172.21.15.59:0/2953776776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4839a0 0x56026b485d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:24:59.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.835+0000 7fe7c96b1640 1 --2- 172.21.15.59:0/2953776776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b477a10 0x56026b483460 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe7c000bd40 tx=0x7fe7c000f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b5f1819f2d3996d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:59.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.836+0000 7fe7af7fe640 1 -- 172.21.15.59:0/2953776776 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0015070 con 0x56026b477a10 2024-09-10T21:24:59.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.836+0000 7fe7af7fe640 1 -- 172.21.15.59:0/2953776776 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7c000be30 con 0x56026b477a10 2024-09-10T21:24:59.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.836+0000 7fe7af7fe640 1 -- 172.21.15.59:0/2953776776 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0011900 con 0x56026b477a10 2024-09-10T21:24:59.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.836+0000 7fe7ba7fc640 1 --2- 172.21.15.59:0/4203101750 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe7b00b52e0 0x7fe7b00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:59.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.836+0000 7fe7c9eb2640 1 --2- 172.21.15.59:0/4203101750 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe7b00b52e0 0x7fe7b00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:59.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.836+0000 7fe7ba7fc640 1 -- 172.21.15.59:0/4203101750 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe7b41063a0 con 0x7fe7c4104600 2024-09-10T21:24:59.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.836+0000 7fe7cdcea740 1 -- 172.21.15.59:0/2953776776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b477a10 msgr2=0x56026b483460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:59.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.836+0000 7fe7c9eb2640 1 --2- 172.21.15.59:0/4203101750 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe7b00b52e0 0x7fe7b00b77a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc005fd0 tx=0x7fe7bc0086a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:59.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.836+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/2953776776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b477a10 0x56026b483460 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe7c000bd40 tx=0x7fe7c000f730 comp rx=0 tx=0).stop 2024-09-10T21:24:59.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.836+0000 7fe7cdcea740 1 -- 172.21.15.59:0/2953776776 shutdown_connections 2024-09-10T21:24:59.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.836+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/2953776776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4839a0 0x56026b485d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.836+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/2953776776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b477a10 0x56026b483460 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.836+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/2953776776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b4770f0 0x56026b4774d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.836+0000 7fe7cdcea740 1 -- 172.21.15.59:0/2953776776 >> 172.21.15.59:0/2953776776 conn(0x56026b474f20 msgr2=0x56026b4760c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.836+0000 7fe7cdcea740 1 -- 172.21.15.59:0/2953776776 shutdown_connections 2024-09-10T21:24:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.836+0000 7fe7cdcea740 1 -- 172.21.15.59:0/2953776776 wait complete. 2024-09-10T21:24:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.837+0000 7fe7cdcea740 1 -- start start 2024-09-10T21:24:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.837+0000 7fe7cdcea740 1 Processor -- start 2024-09-10T21:24:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.838+0000 7fe7cdcea740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4770f0 0x56026b4832d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.838+0000 7fe7cdcea740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b477a10 0x56026b480720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.838+0000 7fe7cdcea740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b4839a0 0x56026b480da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.838+0000 7fe7cdcea740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56026b23e700 con 0x56026b4770f0 2024-09-10T21:24:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.838+0000 7fe7cdcea740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56026b378160 con 0x56026b477a10 2024-09-10T21:24:59.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.838+0000 7fe7cdcea740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56026b486620 con 0x56026b4839a0 2024-09-10T21:24:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.838+0000 7fe7cdcea740 10 client.0 _ll_register_callbacks cb 0x56026b3919e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.838+0000 7fe7c96b1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4770f0 0x56026b4832d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.838+0000 7fe7c96b1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4770f0 0x56026b4832d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45616/0 (socket says 172.21.15.59:45616) 2024-09-10T21:24:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.838+0000 7fe7c96b1640 1 -- 172.21.15.59:0/1911765589 learned_addr learned my addr 172.21.15.59:0/1911765589 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.838+0000 7fe7c9eb2640 1 --2- 172.21.15.59:0/1911765589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b4839a0 0x56026b480da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.838+0000 7fe7c8eb0640 1 --2- 172.21.15.59:0/1911765589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b477a10 0x56026b480720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.838+0000 7fe7c96b1640 1 -- 172.21.15.59:0/1911765589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b4839a0 msgr2=0x56026b480da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.838+0000 7fe7c96b1640 1 --2- 172.21.15.59:0/1911765589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b4839a0 0x56026b480da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.838+0000 7fe7c96b1640 1 -- 172.21.15.59:0/1911765589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b477a10 msgr2=0x56026b480720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.838+0000 7fe7c96b1640 1 --2- 172.21.15.59:0/1911765589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b477a10 0x56026b480720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.838+0000 7fe7c96b1640 1 -- 172.21.15.59:0/1911765589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56026b3a5c90 con 0x56026b4770f0 2024-09-10T21:24:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.838+0000 7fe7c96b1640 1 --2- 172.21.15.59:0/1911765589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4770f0 0x56026b4832d0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00058c0 tx=0x7fe7c000ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45dad2e72b69753 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.838+0000 7fe7acff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.839+0000 7fe7acff9640 1 -- 172.21.15.59:0/1911765589 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0015070 con 0x56026b4770f0 2024-09-10T21:24:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.839+0000 7fe7cdcea740 1 -- 172.21.15.59:0/1911765589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7c000be30 con 0x56026b4770f0 2024-09-10T21:24:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.839+0000 7fe7acff9640 1 -- 172.21.15.59:0/1911765589 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe7c0005250 con 0x56026b4770f0 2024-09-10T21:24:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.839+0000 7fe7acff9640 1 -- 172.21.15.59:0/1911765589 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe7c0005450 con 0x56026b4770f0 2024-09-10T21:24:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.839+0000 7fe7cdcea740 10 client.17742 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.839+0000 7fe7cdcea740 1 -- 172.21.15.59:0/1911765589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56026b491f90 con 0x56026b4770f0 2024-09-10T21:24:59.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.839+0000 7fe7acff9640 1 -- 172.21.15.59:0/1911765589 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7c000be30 con 0x56026b4770f0 2024-09-10T21:24:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.839+0000 7fe7acff9640 1 -- 172.21.15.59:0/1911765589 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe7c0011bf0 con 0x56026b4770f0 2024-09-10T21:24:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.839+0000 7fe7cdcea740 10 client.17742 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.839+0000 7fe7cdcea740 10 client.17742 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:24:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.839+0000 7fe7cdcea740 20 client.17742 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.839+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/1911765589 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56026b493390 0x56026b495780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.839+0000 7fe7cdcea740 4 client.17742 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:24:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.839+0000 7fe7cdcea740 1 -- 172.21.15.59:0/1911765589 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56026b3efdf0 con 0x56026b493390 2024-09-10T21:24:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.840+0000 7fe7c8eb0640 1 --2- 172.21.15.59:0/1911765589 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56026b493390 0x56026b495780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.840+0000 7fe7c8eb0640 1 --2- 172.21.15.59:0/1911765589 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56026b493390 0x56026b495780 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9e0e9fb8abf84426 server_cookie=845abb85b031d865 in_seq=0 out_seq=0 2024-09-10T21:24:59.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.840+0000 7fe7acff9640 10 client.17742 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:24:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.841+0000 7fe7acff9640 1 -- 172.21.15.59:0/1911765589 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56026b3efdf0 con 0x56026b493390 2024-09-10T21:24:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.841+0000 7fe7acff9640 10 client.17742 handle_command_reply: tid=0 2024-09-10T21:24:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.841+0000 7fe7cdcea740 1 client.17742 shutdown 2024-09-10T21:24:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.841+0000 7fe7cdcea740 1 -- 172.21.15.59:0/1911765589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4770f0 msgr2=0x56026b4832d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.841+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/1911765589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4770f0 0x56026b4832d0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00058c0 tx=0x7fe7c000ffd0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.841+0000 7fe7cdcea740 1 -- 172.21.15.59:0/1911765589 shutdown_connections 2024-09-10T21:24:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.841+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/1911765589 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56026b493390 0x56026b495780 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.841+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/1911765589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b4839a0 0x56026b480da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.841+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/1911765589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b477a10 0x56026b480720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.841+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/1911765589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4770f0 0x56026b4832d0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.841+0000 7fe7cdcea740 1 -- 172.21.15.59:0/1911765589 >> 172.21.15.59:0/1911765589 conn(0x56026b474f20 msgr2=0x56026b47aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.841+0000 7fe7acff9640 0 client.17742 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:24:59.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.841+0000 7fe7cdcea740 1 -- 172.21.15.59:0/1911765589 shutdown_connections 2024-09-10T21:24:59.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.841+0000 7fe7cdcea740 1 -- 172.21.15.59:0/1911765589 wait complete. 2024-09-10T21:24:59.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.841+0000 7fe7cdcea740 20 client.17742 trim_cache size 0 max 16384 2024-09-10T21:24:59.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7cdcea740 1 Processor -- start 2024-09-10T21:24:59.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7cdcea740 1 -- start start 2024-09-10T21:24:59.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7cdcea740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b477a10 0x56026b476680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:59.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7cdcea740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b4839a0 0x56026b4700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:59.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7cdcea740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b474760 0x56026b48bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:59.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7cdcea740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c41ae2c0 con 0x56026b474760 2024-09-10T21:24:59.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7cdcea740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c41afe00 con 0x56026b477a10 2024-09-10T21:24:59.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7cdcea740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c41ae990 con 0x56026b4839a0 2024-09-10T21:24:59.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7c9eb2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b474760 0x56026b48bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:59.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7c9eb2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b474760 0x56026b48bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45622/0 (socket says 172.21.15.59:45622) 2024-09-10T21:24:59.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7c9eb2640 1 -- 172.21.15.59:0/3325346692 learned_addr learned my addr 172.21.15.59:0/3325346692 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:59.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7c96b1640 1 --2- 172.21.15.59:0/3325346692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b477a10 0x56026b476680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:59.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7c8eb0640 1 --2- 172.21.15.59:0/3325346692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b4839a0 0x56026b4700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:59.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7c9eb2640 1 -- 172.21.15.59:0/3325346692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b4839a0 msgr2=0x56026b4700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:59.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7c9eb2640 1 --2- 172.21.15.59:0/3325346692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b4839a0 0x56026b4700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7c9eb2640 1 -- 172.21.15.59:0/3325346692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b477a10 msgr2=0x56026b476680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:59.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7c9eb2640 1 --2- 172.21.15.59:0/3325346692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b477a10 0x56026b476680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7c9eb2640 1 -- 172.21.15.59:0/3325346692 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56026b4707e0 con 0x56026b474760 2024-09-10T21:24:59.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7c8eb0640 1 --2- 172.21.15.59:0/3325346692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b4839a0 0x56026b4700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:24:59.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7c96b1640 1 --2- 172.21.15.59:0/3325346692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b477a10 0x56026b476680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:59.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.855+0000 7fe7c9eb2640 1 --2- 172.21.15.59:0/3325346692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b474760 0x56026b48bc90 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc008670 tx=0x7fe7bc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfdf7a9ed25e318 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:59.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.856+0000 7fe7aeffd640 1 -- 172.21.15.59:0/3325346692 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc02b070 con 0x56026b474760 2024-09-10T21:24:59.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.856+0000 7fe7aeffd640 1 -- 172.21.15.59:0/3325346692 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7bc01dba0 con 0x56026b474760 2024-09-10T21:24:59.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.856+0000 7fe7aeffd640 1 -- 172.21.15.59:0/3325346692 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc026c70 con 0x56026b474760 2024-09-10T21:24:59.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.856+0000 7fe7cdcea740 1 -- 172.21.15.59:0/3325346692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b474760 msgr2=0x56026b48bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:59.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.856+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/3325346692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b474760 0x56026b48bc90 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc008670 tx=0x7fe7bc013000 comp rx=0 tx=0).stop 2024-09-10T21:24:59.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.856+0000 7fe7cdcea740 1 -- 172.21.15.59:0/3325346692 shutdown_connections 2024-09-10T21:24:59.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.856+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/3325346692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b474760 0x56026b48bc90 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.856+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/3325346692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b4839a0 0x56026b4700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.856+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/3325346692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b477a10 0x56026b476680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.856+0000 7fe7cdcea740 1 -- 172.21.15.59:0/3325346692 >> 172.21.15.59:0/3325346692 conn(0x56026b474f20 msgr2=0x56026b475f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:59.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.856+0000 7fe7cdcea740 1 -- 172.21.15.59:0/3325346692 shutdown_connections 2024-09-10T21:24:59.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.856+0000 7fe7cdcea740 1 -- 172.21.15.59:0/3325346692 wait complete. 2024-09-10T21:24:59.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.857+0000 7fe7cdcea740 1 -- start start 2024-09-10T21:24:59.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.857+0000 7fe7cdcea740 1 Processor -- start 2024-09-10T21:24:59.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.857+0000 7fe7cdcea740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b474760 0x56026b49a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:59.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.857+0000 7fe7cdcea740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b477a10 0x56026b49aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:59.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.857+0000 7fe7cdcea740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4839a0 0x56026b503f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:59.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.857+0000 7fe7cdcea740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c41af730 con 0x56026b4839a0 2024-09-10T21:24:59.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.857+0000 7fe7cdcea740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c41af060 con 0x56026b477a10 2024-09-10T21:24:59.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.857+0000 7fe7cdcea740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c41ac2a0 con 0x56026b474760 2024-09-10T21:24:59.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.857+0000 7fe7cdcea740 10 client.0 _ll_register_callbacks cb 0x7fe7b4109d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:24:59.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.857+0000 7fe7c9eb2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4839a0 0x56026b503f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:59.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.857+0000 7fe7c9eb2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4839a0 0x56026b503f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45630/0 (socket says 172.21.15.59:45630) 2024-09-10T21:24:59.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.857+0000 7fe7c9eb2640 1 -- 172.21.15.59:0/3313625251 learned_addr learned my addr 172.21.15.59:0/3313625251 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:24:59.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.857+0000 7fe7c96b1640 1 --2- 172.21.15.59:0/3313625251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b474760 0x56026b49a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:59.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.858+0000 7fe7c8eb0640 1 --2- 172.21.15.59:0/3313625251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b477a10 0x56026b49aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:59.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.858+0000 7fe7c9eb2640 1 -- 172.21.15.59:0/3313625251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b474760 msgr2=0x56026b49a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:59.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.858+0000 7fe7c9eb2640 1 --2- 172.21.15.59:0/3313625251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b474760 0x56026b49a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.858+0000 7fe7c9eb2640 1 -- 172.21.15.59:0/3313625251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b477a10 msgr2=0x56026b49aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:24:59.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.858+0000 7fe7c9eb2640 1 --2- 172.21.15.59:0/3313625251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b477a10 0x56026b49aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.858+0000 7fe7c9eb2640 1 -- 172.21.15.59:0/3313625251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56026b5045d0 con 0x56026b4839a0 2024-09-10T21:24:59.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.858+0000 7fe7c8eb0640 1 --2- 172.21.15.59:0/3313625251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b477a10 0x56026b49aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:24:59.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.858+0000 7fe7c9eb2640 1 --2- 172.21.15.59:0/3313625251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4839a0 0x56026b503f90 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc01d010 tx=0x7fe7bc026780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99efe0c33f5d6c75 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:24:59.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.858+0000 7fe7acff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:24:59.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.858+0000 7fe7acff9640 1 -- 172.21.15.59:0/3313625251 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc02b040 con 0x56026b4839a0 2024-09-10T21:24:59.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.858+0000 7fe7acff9640 1 -- 172.21.15.59:0/3313625251 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe7bc01d870 con 0x56026b4839a0 2024-09-10T21:24:59.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.858+0000 7fe7cdcea740 1 -- 172.21.15.59:0/3313625251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7bc01dba0 con 0x56026b4839a0 2024-09-10T21:24:59.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.858+0000 7fe7acff9640 1 -- 172.21.15.59:0/3313625251 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe7bc004a40 con 0x56026b4839a0 2024-09-10T21:24:59.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.858+0000 7fe7cdcea740 10 client.17748 fetch_fsmap learned FSMap version 28 2024-09-10T21:24:59.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.858+0000 7fe7cdcea740 1 -- 172.21.15.59:0/3313625251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56026b505840 con 0x56026b4839a0 2024-09-10T21:24:59.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.859+0000 7fe7acff9640 1 -- 172.21.15.59:0/3313625251 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7bc01dba0 con 0x56026b4839a0 2024-09-10T21:24:59.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.859+0000 7fe7acff9640 1 -- 172.21.15.59:0/3313625251 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe7bc005300 con 0x56026b4839a0 2024-09-10T21:24:59.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.859+0000 7fe7cdcea740 10 client.17748 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:24:59.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.859+0000 7fe7cdcea740 10 client.17748 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:24:59.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.859+0000 7fe7cdcea740 20 client.17748 populate_metadata read hostname 'smithi059' 2024-09-10T21:24:59.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.859+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/3313625251 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56026b505f90 0x56026b5083b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:24:59.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.859+0000 7fe7cdcea740 4 client.17748 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:24:59.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.859+0000 7fe7cdcea740 1 -- 172.21.15.59:0/3313625251 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56026b3eb8a0 con 0x56026b505f90 2024-09-10T21:24:59.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.859+0000 7fe7c96b1640 1 --2- 172.21.15.59:0/3313625251 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56026b505f90 0x56026b5083b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:24:59.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.860+0000 7fe7c96b1640 1 --2- 172.21.15.59:0/3313625251 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56026b505f90 0x56026b5083b0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9fe651371425501b server_cookie=79d9fc37451513c7 in_seq=0 out_seq=0 2024-09-10T21:24:59.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.860+0000 7fe7acff9640 10 client.17748 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:24:59.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.860+0000 7fe7acff9640 1 -- 172.21.15.59:0/3313625251 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56026b3eb8a0 con 0x56026b505f90 2024-09-10T21:24:59.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.860+0000 7fe7acff9640 10 client.17748 handle_command_reply: tid=0 2024-09-10T21:24:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.860+0000 7fe7cdcea740 1 client.17748 shutdown 2024-09-10T21:24:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.860+0000 7fe7cdcea740 1 -- 172.21.15.59:0/3313625251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4839a0 msgr2=0x56026b503f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.860+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/3313625251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4839a0 0x56026b503f90 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc01d010 tx=0x7fe7bc026780 comp rx=0 tx=0).stop 2024-09-10T21:24:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.860+0000 7fe7cdcea740 1 -- 172.21.15.59:0/3313625251 shutdown_connections 2024-09-10T21:24:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.860+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/3313625251 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x56026b505f90 0x56026b5083b0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.860+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/3313625251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56026b4839a0 0x56026b503f90 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.860+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/3313625251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56026b477a10 0x56026b49aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.860+0000 7fe7cdcea740 1 --2- 172.21.15.59:0/3313625251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56026b474760 0x56026b49a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.860+0000 7fe7cdcea740 1 -- 172.21.15.59:0/3313625251 >> 172.21.15.59:0/3313625251 conn(0x56026b474f20 msgr2=0x56026b473750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.860+0000 7fe7acff9640 0 client.17748 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:24:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.860+0000 7fe7cdcea740 1 -- 172.21.15.59:0/3313625251 shutdown_connections 2024-09-10T21:24:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.860+0000 7fe7cdcea740 1 -- 172.21.15.59:0/3313625251 wait complete. 2024-09-10T21:24:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.860+0000 7fe7cdcea740 20 client.17748 trim_cache size 0 max 16384 2024-09-10T21:24:59.874 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:24:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.861+0000 7fe7cb915640 1 -- 172.21.15.59:0/4203101750 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe7b00b52e0 msgr2=0x7fe7b00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.861+0000 7fe7cb915640 1 --2- 172.21.15.59:0/4203101750 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe7b00b52e0 0x7fe7b00b77a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc005fd0 tx=0x7fe7bc0086a0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.861+0000 7fe7cb915640 1 -- 172.21.15.59:0/4203101750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7c4104600 msgr2=0x7fe7c41997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:24:59.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.861+0000 7fe7cb915640 1 --2- 172.21.15.59:0/4203101750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7c4104600 0x7fe7c41997c0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4006010 tx=0x7fe7b4004060 comp rx=0 tx=0).stop 2024-09-10T21:24:59.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.861+0000 7fe7cb915640 1 -- 172.21.15.59:0/4203101750 shutdown_connections 2024-09-10T21:24:59.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.861+0000 7fe7cb915640 1 --2- 172.21.15.59:0/4203101750 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe7b00b52e0 0x7fe7b00b77a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.861+0000 7fe7cb915640 1 --2- 172.21.15.59:0/4203101750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7c410d140 0x7fe7c419eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.861+0000 7fe7cb915640 1 --2- 172.21.15.59:0/4203101750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7c4104600 0x7fe7c41997c0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.861+0000 7fe7cb915640 1 --2- 172.21.15.59:0/4203101750 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7c4103ce0 0x7fe7c4199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:24:59.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.861+0000 7fe7cb915640 1 -- 172.21.15.59:0/4203101750 >> 172.21.15.59:0/4203101750 conn(0x7fe7c40fd720 msgr2=0x7fe7c40fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:24:59.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.861+0000 7fe7cb915640 1 -- 172.21.15.59:0/4203101750 shutdown_connections 2024-09-10T21:24:59.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:24:59.861+0000 7fe7cb915640 1 -- 172.21.15.59:0/4203101750 wait complete. 2024-09-10T21:25:00.722 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:25:00.986 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:25:01.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:01 smithi192 ceph-mon[35363]: pgmap v632: 97 pgs: 97 active+clean; 6.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:25:01.384 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:01 smithi059 ceph-mon[30888]: pgmap v632: 97 pgs: 97 active+clean; 6.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:25:01.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:01 smithi154 ceph-mon[35041]: pgmap v632: 97 pgs: 97 active+clean; 6.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:25:01.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.468+0000 7f4fbfbf7640 1 -- 172.21.15.59:0/666846944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fb8101c90 msgr2=0x7f4fb8102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:01.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.468+0000 7f4fbfbf7640 1 --2- 172.21.15.59:0/666846944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fb8101c90 0x7f4fb8102070 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8009ca0 tx=0x7f4fa802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.468+0000 7f4fbfbf7640 1 -- 172.21.15.59:0/666846944 shutdown_connections 2024-09-10T21:25:01.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.468+0000 7f4fbfbf7640 1 --2- 172.21.15.59:0/666846944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fb8108020 0x7f4fb810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.468+0000 7f4fbfbf7640 1 --2- 172.21.15.59:0/666846944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fb81076a0 0x7f4fb8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.468+0000 7f4fbfbf7640 1 --2- 172.21.15.59:0/666846944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fb8101c90 0x7f4fb8102070 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.468+0000 7f4fbfbf7640 1 -- 172.21.15.59:0/666846944 >> 172.21.15.59:0/666846944 conn(0x7f4fb80fd700 msgr2=0x7f4fb80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:01.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.468+0000 7f4fbfbf7640 1 -- 172.21.15.59:0/666846944 shutdown_connections 2024-09-10T21:25:01.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.468+0000 7f4fbfbf7640 1 -- 172.21.15.59:0/666846944 wait complete. 2024-09-10T21:25:01.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.468+0000 7f4fbfbf7640 1 Processor -- start 2024-09-10T21:25:01.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.469+0000 7f4fbfbf7640 1 -- start start 2024-09-10T21:25:01.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.469+0000 7f4fbfbf7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fb8101c90 0x7f4fb819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:01.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.469+0000 7f4fbfbf7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fb81076a0 0x7f4fb819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:01.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.469+0000 7f4fbfbf7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fb8108020 0x7f4fb819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:01.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.469+0000 7f4fbfbf7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb8111ce0 con 0x7f4fb81076a0 2024-09-10T21:25:01.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.469+0000 7f4fbfbf7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb8111b60 con 0x7f4fb8108020 2024-09-10T21:25:01.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.469+0000 7f4fbfbf7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb8111e60 con 0x7f4fb8101c90 2024-09-10T21:25:01.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.469+0000 7f4fbd192640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fb81076a0 0x7f4fb819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:01.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.469+0000 7f4fbd192640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fb81076a0 0x7f4fb819a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45660/0 (socket says 172.21.15.59:45660) 2024-09-10T21:25:01.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.469+0000 7f4fbd192640 1 -- 172.21.15.59:0/376766097 learned_addr learned my addr 172.21.15.59:0/376766097 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:01.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.469+0000 7f4fbd993640 1 --2- 172.21.15.59:0/376766097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fb8101c90 0x7f4fb819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:01.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.469+0000 7f4fbe194640 1 --2- 172.21.15.59:0/376766097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fb8108020 0x7f4fb819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:01.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.469+0000 7f4fbd192640 1 -- 172.21.15.59:0/376766097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fb8101c90 msgr2=0x7f4fb819a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:01.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.469+0000 7f4fbd192640 1 --2- 172.21.15.59:0/376766097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fb8101c90 0x7f4fb819a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.469+0000 7f4fbd192640 1 -- 172.21.15.59:0/376766097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fb8108020 msgr2=0x7f4fb819aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:01.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.469+0000 7f4fbd192640 1 --2- 172.21.15.59:0/376766097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fb8108020 0x7f4fb819aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.469+0000 7f4fbd192640 1 -- 172.21.15.59:0/376766097 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb81a5400 con 0x7f4fb81076a0 2024-09-10T21:25:01.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.469+0000 7f4fbe194640 1 --2- 172.21.15.59:0/376766097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fb8108020 0x7f4fb819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:01.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.470+0000 7f4fbd192640 1 --2- 172.21.15.59:0/376766097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fb81076a0 0x7f4fb819a560 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00c920 tx=0x7f4fac00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:01.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.470+0000 7f4fb6ffd640 1 -- 172.21.15.59:0/376766097 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fac007c70 con 0x7f4fb81076a0 2024-09-10T21:25:01.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.470+0000 7f4fb6ffd640 1 -- 172.21.15.59:0/376766097 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fac007e10 con 0x7f4fb81076a0 2024-09-10T21:25:01.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.470+0000 7f4fbfbf7640 1 -- 172.21.15.59:0/376766097 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb81a56f0 con 0x7f4fb81076a0 2024-09-10T21:25:01.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.470+0000 7f4fb6ffd640 1 -- 172.21.15.59:0/376766097 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fac018820 con 0x7f4fb81076a0 2024-09-10T21:25:01.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.470+0000 7f4fbfbf7640 1 -- 172.21.15.59:0/376766097 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fb81a5c30 con 0x7f4fb81076a0 2024-09-10T21:25:01.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.472+0000 7f4fc1fcc740 1 Processor -- start 2024-09-10T21:25:01.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.472+0000 7f4fc1fcc740 1 -- start start 2024-09-10T21:25:01.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.473+0000 7f4fb6ffd640 1 -- 172.21.15.59:0/376766097 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f4fac00f450 con 0x7f4fb81076a0 2024-09-10T21:25:01.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.473+0000 7f4fc1fcc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecf00f0 0x55e1aecf04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:01.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.473+0000 7f4fc1fcc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecf0a10 0x55e1aecfc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:01.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.473+0000 7f4fc1fcc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecfc9a0 0x55e1aecfed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:01.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.473+0000 7f4fc1fcc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e1aec66ea0 con 0x55e1aecfc9a0 2024-09-10T21:25:01.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.473+0000 7f4fc1fcc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e1aec562d0 con 0x55e1aecf00f0 2024-09-10T21:25:01.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.473+0000 7f4fc1fcc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55e1aec5a0e0 con 0x55e1aecf0a10 2024-09-10T21:25:01.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.473+0000 7f4fbd192640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecfc9a0 0x55e1aecfed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:01.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.473+0000 7f4fbd993640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecf0a10 0x55e1aecfc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:01.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.473+0000 7f4fbd993640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecf0a10 0x55e1aecfc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:59736/0 (socket says 172.21.15.59:59736) 2024-09-10T21:25:01.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.473+0000 7f4fbd192640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecfc9a0 0x55e1aecfed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45672/0 (socket says 172.21.15.59:45672) 2024-09-10T21:25:01.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.473+0000 7f4fbd993640 1 -- 172.21.15.59:0/3770038292 learned_addr learned my addr 172.21.15.59:0/3770038292 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:01.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.473+0000 7f4fbe194640 1 --2- 172.21.15.59:0/3770038292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecf00f0 0x55e1aecf04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:01.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.473+0000 7f4fbd993640 1 -- 172.21.15.59:0/3770038292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecf00f0 msgr2=0x55e1aecf04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:01.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.473+0000 7f4fbd993640 1 --2- 172.21.15.59:0/3770038292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecf00f0 0x55e1aecf04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.473+0000 7f4fbd993640 1 -- 172.21.15.59:0/3770038292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecfc9a0 msgr2=0x55e1aecfed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:01.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.473+0000 7f4fbd993640 1 --2- 172.21.15.59:0/3770038292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecfc9a0 0x55e1aecfed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.473+0000 7f4fbd993640 1 -- 172.21.15.59:0/3770038292 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1ae9b4650 con 0x55e1aecf0a10 2024-09-10T21:25:01.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.473+0000 7f4fbd192640 1 --2- 172.21.15.59:0/3770038292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecfc9a0 0x55e1aecfed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:25:01.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.474+0000 7f4fb6ffd640 1 --2- 172.21.15.59:0/376766097 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4fa00b52e0 0x7f4fa00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:01.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.474+0000 7f4fbd993640 1 --2- 172.21.15.59:0/3770038292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecf0a10 0x55e1aecfc460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4fa802f480 tx=0x7f4fa802f4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f42b4dd63d5d1019 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:01.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.474+0000 7f4fbe194640 1 --2- 172.21.15.59:0/376766097 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4fa00b52e0 0x7f4fa00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:01.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.474+0000 7f4fb6ffd640 1 -- 172.21.15.59:0/376766097 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4fac0e5dd0 con 0x7f4fb81076a0 2024-09-10T21:25:01.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.474+0000 7f4f9ffff640 1 -- 172.21.15.59:0/3770038292 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8031450 con 0x55e1aecf0a10 2024-09-10T21:25:01.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.474+0000 7f4f9ffff640 1 -- 172.21.15.59:0/3770038292 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fa8036040 con 0x55e1aecf0a10 2024-09-10T21:25:01.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.474+0000 7f4f9ffff640 1 -- 172.21.15.59:0/3770038292 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa80043d0 con 0x55e1aecf0a10 2024-09-10T21:25:01.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.475+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/3770038292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecf0a10 msgr2=0x55e1aecfc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:01.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.475+0000 7f4fbe194640 1 --2- 172.21.15.59:0/376766097 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4fa00b52e0 0x7f4fa00b77a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0005fd0 tx=0x7f4fb0009440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:01.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.475+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/3770038292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecf0a10 0x55e1aecfc460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4fa802f480 tx=0x7f4fa802f4b0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.475+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/3770038292 shutdown_connections 2024-09-10T21:25:01.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.475+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/3770038292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecfc9a0 0x55e1aecfed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.475+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/3770038292 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecf0a10 0x55e1aecfc460 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.475+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/3770038292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecf00f0 0x55e1aecf04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.475+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/3770038292 >> 172.21.15.59:0/3770038292 conn(0x55e1aecedf20 msgr2=0x55e1aecef0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.475+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/3770038292 shutdown_connections 2024-09-10T21:25:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.475+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/3770038292 wait complete. 2024-09-10T21:25:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.475+0000 7f4fc1fcc740 1 -- start start 2024-09-10T21:25:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.475+0000 7f4fc1fcc740 1 Processor -- start 2024-09-10T21:25:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.476+0000 7f4fc1fcc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecf00f0 0x55e1aecfc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.476+0000 7f4fc1fcc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecf0a10 0x55e1aecf9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.476+0000 7f4fc1fcc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecfc9a0 0x55e1aecf9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.476+0000 7f4fc1fcc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e1aeab7700 con 0x55e1aecf0a10 2024-09-10T21:25:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.476+0000 7f4fc1fcc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e1aebf1160 con 0x55e1aecfc9a0 2024-09-10T21:25:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.476+0000 7f4fc1fcc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55e1aecff5c0 con 0x55e1aecf00f0 2024-09-10T21:25:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.476+0000 7f4fc1fcc740 10 client.0 _ll_register_callbacks cb 0x55e1aec0a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:01.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.476+0000 7f4fbd192640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecf0a10 0x55e1aecf9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:01.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.476+0000 7f4fbd192640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecf0a10 0x55e1aecf9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45676/0 (socket says 172.21.15.59:45676) 2024-09-10T21:25:01.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.476+0000 7f4fbd192640 1 -- 172.21.15.59:0/3727598363 learned_addr learned my addr 172.21.15.59:0/3727598363 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:01.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.476+0000 7f4fbd993640 1 --2- 172.21.15.59:0/3727598363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecf00f0 0x55e1aecfc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:01.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.476+0000 7f4fbe194640 1 --2- 172.21.15.59:0/3727598363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecfc9a0 0x55e1aecf9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:01.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.476+0000 7f4fbd192640 1 -- 172.21.15.59:0/3727598363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecf00f0 msgr2=0x55e1aecfc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:01.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.476+0000 7f4fbd192640 1 --2- 172.21.15.59:0/3727598363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecf00f0 0x55e1aecfc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.476+0000 7f4fbd192640 1 -- 172.21.15.59:0/3727598363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecfc9a0 msgr2=0x55e1aecf9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:01.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.476+0000 7f4fbd192640 1 --2- 172.21.15.59:0/3727598363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecfc9a0 0x55e1aecf9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.476+0000 7f4fbd192640 1 -- 172.21.15.59:0/3727598363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1aec1ec90 con 0x55e1aecf0a10 2024-09-10T21:25:01.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.476+0000 7f4fbd192640 1 --2- 172.21.15.59:0/3727598363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecf0a10 0x55e1aecf9660 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00c8f0 tx=0x7f4fac0a8520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28648ec5225e4c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:01.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.476+0000 7f4f9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:01.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.477+0000 7f4f9d7fa640 1 -- 172.21.15.59:0/3727598363 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fac0abd30 con 0x55e1aecf0a10 2024-09-10T21:25:01.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.477+0000 7f4f9d7fa640 1 -- 172.21.15.59:0/3727598363 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4fac0ac820 con 0x55e1aecf0a10 2024-09-10T21:25:01.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.477+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/3727598363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fa8036040 con 0x55e1aecf0a10 2024-09-10T21:25:01.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.477+0000 7f4f9d7fa640 1 -- 172.21.15.59:0/3727598363 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4fac0ac0d0 con 0x55e1aecf0a10 2024-09-10T21:25:01.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.477+0000 7f4fc1fcc740 10 client.17760 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:01.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.477+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/3727598363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e1aed0ae70 con 0x55e1aecf0a10 2024-09-10T21:25:01.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.477+0000 7f4f9d7fa640 1 -- 172.21.15.59:0/3727598363 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fa8036040 con 0x55e1aecf0a10 2024-09-10T21:25:01.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.477+0000 7f4f9d7fa640 1 -- 172.21.15.59:0/3727598363 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4fac0b56c0 con 0x55e1aecf0a10 2024-09-10T21:25:01.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.477+0000 7f4fc1fcc740 10 client.17760 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:01.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.477+0000 7f4fc1fcc740 10 client.17760 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:25:01.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.477+0000 7f4fc1fcc740 20 client.17760 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:01.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.477+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/3727598363 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55e1aed0c380 0x55e1aed0e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:01.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.477+0000 7f4fc1fcc740 4 client.17760 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:25:01.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.477+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/3727598363 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1aec68df0 con 0x55e1aed0c380 2024-09-10T21:25:01.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.478+0000 7f4fbd993640 1 --2- 172.21.15.59:0/3727598363 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55e1aed0c380 0x55e1aed0e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:01.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.478+0000 7f4f9d7fa640 10 client.17760 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:25:01.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.478+0000 7f4fbd993640 1 --2- 172.21.15.59:0/3727598363 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55e1aed0c380 0x55e1aed0e770 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3ac0b8459a01d5cd server_cookie=e9278dfaa319fb34 in_seq=0 out_seq=0 2024-09-10T21:25:01.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.479+0000 7f4f9d7fa640 1 -- 172.21.15.59:0/3727598363 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e1aec68df0 con 0x55e1aed0c380 2024-09-10T21:25:01.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.479+0000 7f4f9d7fa640 10 client.17760 handle_command_reply: tid=0 2024-09-10T21:25:01.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.479+0000 7f4fc1fcc740 1 client.17760 shutdown 2024-09-10T21:25:01.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.479+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/3727598363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecf0a10 msgr2=0x55e1aecf9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:01.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.479+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/3727598363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecf0a10 0x55e1aecf9660 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00c8f0 tx=0x7f4fac0a8520 comp rx=0 tx=0).stop 2024-09-10T21:25:01.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.479+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/3727598363 shutdown_connections 2024-09-10T21:25:01.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.479+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/3727598363 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55e1aed0c380 0x55e1aed0e770 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.479+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/3727598363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecfc9a0 0x55e1aecf9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.479+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/3727598363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecf0a10 0x55e1aecf9660 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.479+0000 7f4f9d7fa640 0 client.17760 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:25:01.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.479+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/3727598363 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecf00f0 0x55e1aecfc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.479+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/3727598363 >> 172.21.15.59:0/3727598363 conn(0x55e1aecedf20 msgr2=0x55e1aecf3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:01.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.479+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/3727598363 shutdown_connections 2024-09-10T21:25:01.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.479+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/3727598363 wait complete. 2024-09-10T21:25:01.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.479+0000 7f4fc1fcc740 20 client.17760 trim_cache size 0 max 16384 2024-09-10T21:25:01.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.492+0000 7f4fc1fcc740 1 Processor -- start 2024-09-10T21:25:01.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.492+0000 7f4fc1fcc740 1 -- start start 2024-09-10T21:25:01.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.493+0000 7f4fc1fcc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecf00f0 0x55e1aed087f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:01.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.493+0000 7f4fc1fcc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecf0a10 0x55e1aecef650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:01.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.493+0000 7f4fc1fcc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecfc9a0 0x55e1aecece60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:01.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.493+0000 7f4fc1fcc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb81ae230 con 0x55e1aecfc9a0 2024-09-10T21:25:01.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.493+0000 7f4fc1fcc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb81afd70 con 0x55e1aecf0a10 2024-09-10T21:25:01.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.493+0000 7f4fc1fcc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb81ae900 con 0x55e1aecf00f0 2024-09-10T21:25:01.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.493+0000 7f4fbe194640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecfc9a0 0x55e1aecece60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:01.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.493+0000 7f4fbe194640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecfc9a0 0x55e1aecece60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45686/0 (socket says 172.21.15.59:45686) 2024-09-10T21:25:01.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.493+0000 7f4fbe194640 1 -- 172.21.15.59:0/1667810707 learned_addr learned my addr 172.21.15.59:0/1667810707 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:01.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.493+0000 7f4fbd993640 1 --2- 172.21.15.59:0/1667810707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecf00f0 0x55e1aed087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:01.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.493+0000 7f4fbd192640 1 --2- 172.21.15.59:0/1667810707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecf0a10 0x55e1aecef650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:01.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.493+0000 7f4fbe194640 1 -- 172.21.15.59:0/1667810707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecf00f0 msgr2=0x55e1aed087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:01.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.493+0000 7f4fbe194640 1 --2- 172.21.15.59:0/1667810707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecf00f0 0x55e1aed087f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.493+0000 7f4fbe194640 1 -- 172.21.15.59:0/1667810707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecf0a10 msgr2=0x55e1aecef650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:01.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.493+0000 7f4fbe194640 1 --2- 172.21.15.59:0/1667810707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecf0a10 0x55e1aecef650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.493+0000 7f4fbe194640 1 -- 172.21.15.59:0/1667810707 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1aecf9f50 con 0x55e1aecfc9a0 2024-09-10T21:25:01.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.493+0000 7f4fbe194640 1 --2- 172.21.15.59:0/1667810707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecfc9a0 0x55e1aecece60 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0012640 tx=0x7f4fb0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48395d7d3b6d4dd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:01.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.494+0000 7f4f9f7fe640 1 -- 172.21.15.59:0/1667810707 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0020830 con 0x55e1aecfc9a0 2024-09-10T21:25:01.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.494+0000 7f4f9f7fe640 1 -- 172.21.15.59:0/1667810707 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fb00283e0 con 0x55e1aecfc9a0 2024-09-10T21:25:01.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.494+0000 7f4f9f7fe640 1 -- 172.21.15.59:0/1667810707 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb001b5c0 con 0x55e1aecfc9a0 2024-09-10T21:25:01.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.494+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/1667810707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecfc9a0 msgr2=0x55e1aecece60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:01.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.494+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/1667810707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecfc9a0 0x55e1aecece60 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0012640 tx=0x7f4fb0014000 comp rx=0 tx=0).stop 2024-09-10T21:25:01.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.494+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/1667810707 shutdown_connections 2024-09-10T21:25:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.494+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/1667810707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecfc9a0 0x55e1aecece60 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.494+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/1667810707 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecf0a10 0x55e1aecef650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.494+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/1667810707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecf00f0 0x55e1aed087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.494+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/1667810707 >> 172.21.15.59:0/1667810707 conn(0x55e1aecedf20 msgr2=0x55e1aecec750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.494+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/1667810707 shutdown_connections 2024-09-10T21:25:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.494+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/1667810707 wait complete. 2024-09-10T21:25:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.495+0000 7f4fc1fcc740 1 -- start start 2024-09-10T21:25:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.495+0000 7f4fc1fcc740 1 Processor -- start 2024-09-10T21:25:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.495+0000 7f4fc1fcc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecf00f0 0x55e1aed050a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.495+0000 7f4fc1fcc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecf0a10 0x55e1aecff810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.495+0000 7f4fc1fcc740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecfc9a0 0x55e1aecffdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.495+0000 7f4fc1fcc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb81af6a0 con 0x55e1aecf00f0 2024-09-10T21:25:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.495+0000 7f4fc1fcc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb81aefd0 con 0x55e1aecf0a10 2024-09-10T21:25:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.495+0000 7f4fc1fcc740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb81ac210 con 0x55e1aecfc9a0 2024-09-10T21:25:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.495+0000 7f4fc1fcc740 10 client.0 _ll_register_callbacks cb 0x7f4fac00cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.495+0000 7f4fbd993640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecf00f0 0x55e1aed050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.495+0000 7f4fbd993640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecf00f0 0x55e1aed050a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45696/0 (socket says 172.21.15.59:45696) 2024-09-10T21:25:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.495+0000 7f4fbd993640 1 -- 172.21.15.59:0/2387680812 learned_addr learned my addr 172.21.15.59:0/2387680812 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.495+0000 7f4fbd192640 1 --2- 172.21.15.59:0/2387680812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecf0a10 0x55e1aecff810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.496+0000 7f4fbd993640 1 -- 172.21.15.59:0/2387680812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecfc9a0 msgr2=0x55e1aecffdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.496+0000 7f4fbe194640 1 --2- 172.21.15.59:0/2387680812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecfc9a0 0x55e1aecffdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.496+0000 7f4fbd993640 1 --2- 172.21.15.59:0/2387680812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecfc9a0 0x55e1aecffdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.496+0000 7f4fbd993640 1 -- 172.21.15.59:0/2387680812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecf0a10 msgr2=0x55e1aecff810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.496+0000 7f4fbd993640 1 --2- 172.21.15.59:0/2387680812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecf0a10 0x55e1aecff810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.496+0000 7f4fbd993640 1 -- 172.21.15.59:0/2387680812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1aed00620 con 0x55e1aecf00f0 2024-09-10T21:25:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.496+0000 7f4fbe194640 1 --2- 172.21.15.59:0/2387680812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecfc9a0 0x55e1aecffdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.496+0000 7f4fbd993640 1 --2- 172.21.15.59:0/2387680812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecf00f0 0x55e1aed050a0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8009960 tx=0x7f4fa802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43efd8b55f7797f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.496+0000 7f4f9d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.496+0000 7f4f9d7fa640 1 -- 172.21.15.59:0/2387680812 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa805c060 con 0x55e1aecf00f0 2024-09-10T21:25:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.496+0000 7f4f9d7fa640 1 -- 172.21.15.59:0/2387680812 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4fa8003b70 con 0x55e1aecf00f0 2024-09-10T21:25:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.496+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/2387680812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fb00283e0 con 0x55e1aecf00f0 2024-09-10T21:25:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.496+0000 7f4f9d7fa640 1 -- 172.21.15.59:0/2387680812 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4fa804a040 con 0x55e1aecf00f0 2024-09-10T21:25:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.496+0000 7f4fc1fcc740 10 client.17766 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.496+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/2387680812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e1aed7a340 con 0x55e1aecf00f0 2024-09-10T21:25:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.496+0000 7f4f9d7fa640 1 -- 172.21.15.59:0/2387680812 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fb00283e0 con 0x55e1aecf00f0 2024-09-10T21:25:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.497+0000 7f4f9d7fa640 1 -- 172.21.15.59:0/2387680812 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4fa8004150 con 0x55e1aecf00f0 2024-09-10T21:25:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.497+0000 7f4fc1fcc740 10 client.17766 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.497+0000 7f4fc1fcc740 10 client.17766 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:25:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.497+0000 7f4fc1fcc740 20 client.17766 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:01.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.497+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/2387680812 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55e1aed7a640 0x55e1aed7ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:01.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.497+0000 7f4fc1fcc740 4 client.17766 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:25:01.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.497+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/2387680812 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e1aec648a0 con 0x55e1aed7a640 2024-09-10T21:25:01.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.497+0000 7f4fbd192640 1 --2- 172.21.15.59:0/2387680812 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55e1aed7a640 0x55e1aed7ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:01.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.497+0000 7f4fbd192640 1 --2- 172.21.15.59:0/2387680812 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55e1aed7a640 0x55e1aed7ca30 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aeb124c7250bc77 server_cookie=281b99e5b7bb9947 in_seq=0 out_seq=0 2024-09-10T21:25:01.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.497+0000 7f4f9d7fa640 10 client.17766 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:25:01.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.498+0000 7f4f9d7fa640 1 -- 172.21.15.59:0/2387680812 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e1aec648a0 con 0x55e1aed7a640 2024-09-10T21:25:01.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.498+0000 7f4f9d7fa640 10 client.17766 handle_command_reply: tid=0 2024-09-10T21:25:01.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.498+0000 7f4fc1fcc740 1 client.17766 shutdown 2024-09-10T21:25:01.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.498+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/2387680812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecf00f0 msgr2=0x55e1aed050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:01.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.498+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/2387680812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecf00f0 0x55e1aed050a0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8009960 tx=0x7f4fa802a8c0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.498+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/2387680812 shutdown_connections 2024-09-10T21:25:01.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.498+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/2387680812 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55e1aed7a640 0x55e1aed7ca30 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.498+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/2387680812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e1aecfc9a0 0x55e1aecffdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.498+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/2387680812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e1aecf0a10 0x55e1aecff810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.498+0000 7f4f9d7fa640 0 client.17766 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:25:01.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.498+0000 7f4fc1fcc740 1 --2- 172.21.15.59:0/2387680812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1aecf00f0 0x55e1aed050a0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.498+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/2387680812 >> 172.21.15.59:0/2387680812 conn(0x55e1aecedf20 msgr2=0x55e1aecfb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:01.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.498+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/2387680812 shutdown_connections 2024-09-10T21:25:01.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.498+0000 7f4fc1fcc740 1 -- 172.21.15.59:0/2387680812 wait complete. 2024-09-10T21:25:01.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.498+0000 7f4fc1fcc740 20 client.17766 trim_cache size 0 max 16384 2024-09-10T21:25:01.506 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:25:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.498+0000 7f4fbfbf7640 1 -- 172.21.15.59:0/376766097 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4fa00b52e0 msgr2=0x7f4fa00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.499+0000 7f4fbfbf7640 1 --2- 172.21.15.59:0/376766097 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4fa00b52e0 0x7f4fa00b77a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0005fd0 tx=0x7f4fb0009440 comp rx=0 tx=0).stop 2024-09-10T21:25:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.499+0000 7f4fbfbf7640 1 -- 172.21.15.59:0/376766097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fb81076a0 msgr2=0x7f4fb819a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.499+0000 7f4fbfbf7640 1 --2- 172.21.15.59:0/376766097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fb81076a0 0x7f4fb819a560 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f4fac00c920 tx=0x7f4fac00cde0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.499+0000 7f4fbfbf7640 1 -- 172.21.15.59:0/376766097 shutdown_connections 2024-09-10T21:25:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.499+0000 7f4fbfbf7640 1 --2- 172.21.15.59:0/376766097 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4fa00b52e0 0x7f4fa00b77a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.499+0000 7f4fbfbf7640 1 --2- 172.21.15.59:0/376766097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fb8108020 0x7f4fb819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.499+0000 7f4fbfbf7640 1 --2- 172.21.15.59:0/376766097 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fb81076a0 0x7f4fb819a560 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.499+0000 7f4fbfbf7640 1 --2- 172.21.15.59:0/376766097 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fb8101c90 0x7f4fb819a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:01.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.499+0000 7f4fbfbf7640 1 -- 172.21.15.59:0/376766097 >> 172.21.15.59:0/376766097 conn(0x7f4fb80fd700 msgr2=0x7f4fb80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:01.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.499+0000 7f4fbfbf7640 1 -- 172.21.15.59:0/376766097 shutdown_connections 2024-09-10T21:25:01.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:01.499+0000 7f4fbfbf7640 1 -- 172.21.15.59:0/376766097 wait complete. 2024-09-10T21:25:02.303 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:25:02.561 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:25:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.033+0000 7f53dc6de640 1 -- 172.21.15.59:0/2211026808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53d4101c90 msgr2=0x7f53d4102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.033+0000 7f53dc6de640 1 --2- 172.21.15.59:0/2211026808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53d4101c90 0x7f53d4102070 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009ca0 tx=0x7f53c402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.033+0000 7f53dc6de640 1 -- 172.21.15.59:0/2211026808 shutdown_connections 2024-09-10T21:25:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.033+0000 7f53dc6de640 1 --2- 172.21.15.59:0/2211026808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53d4108020 0x7f53d410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.033+0000 7f53dc6de640 1 --2- 172.21.15.59:0/2211026808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53d41076a0 0x7f53d4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.033+0000 7f53dc6de640 1 --2- 172.21.15.59:0/2211026808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53d4101c90 0x7f53d4102070 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.033+0000 7f53dc6de640 1 -- 172.21.15.59:0/2211026808 >> 172.21.15.59:0/2211026808 conn(0x7f53d40fd700 msgr2=0x7f53d40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.033+0000 7f53dc6de640 1 -- 172.21.15.59:0/2211026808 shutdown_connections 2024-09-10T21:25:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.033+0000 7f53dc6de640 1 -- 172.21.15.59:0/2211026808 wait complete. 2024-09-10T21:25:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.034+0000 7f53dc6de640 1 Processor -- start 2024-09-10T21:25:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.034+0000 7f53dc6de640 1 -- start start 2024-09-10T21:25:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.034+0000 7f53dc6de640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53d4101c90 0x7f53d4198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.034+0000 7f53dc6de640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53d41076a0 0x7f53d41986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.034+0000 7f53dc6de640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53d4108020 0x7f53d419da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.034+0000 7f53dc6de640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53d4111ce0 con 0x7f53d4101c90 2024-09-10T21:25:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.034+0000 7f53dc6de640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53d4111b60 con 0x7f53d4108020 2024-09-10T21:25:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.034+0000 7f53dc6de640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f53d4111e60 con 0x7f53d41076a0 2024-09-10T21:25:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.034+0000 7f53da47a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53d4101c90 0x7f53d4198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.035+0000 7f53da47a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53d4101c90 0x7f53d4198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45710/0 (socket says 172.21.15.59:45710) 2024-09-10T21:25:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.035+0000 7f53da47a640 1 -- 172.21.15.59:0/2377401714 learned_addr learned my addr 172.21.15.59:0/2377401714 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.035+0000 7f53d9c79640 1 --2- 172.21.15.59:0/2377401714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53d41076a0 0x7f53d41986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.035+0000 7f53dac7b640 1 --2- 172.21.15.59:0/2377401714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53d4108020 0x7f53d419da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.035+0000 7f53da47a640 1 -- 172.21.15.59:0/2377401714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53d41076a0 msgr2=0x7f53d41986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.035+0000 7f53da47a640 1 --2- 172.21.15.59:0/2377401714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53d41076a0 0x7f53d41986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.035+0000 7f53da47a640 1 -- 172.21.15.59:0/2377401714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53d4108020 msgr2=0x7f53d419da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:03.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.035+0000 7f53da47a640 1 --2- 172.21.15.59:0/2377401714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53d4108020 0x7f53d419da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.035+0000 7f53da47a640 1 -- 172.21.15.59:0/2377401714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d419e220 con 0x7f53d4101c90 2024-09-10T21:25:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.035+0000 7f53da47a640 1 --2- 172.21.15.59:0/2377401714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53d4101c90 0x7f53d4198170 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f53c4006010 tx=0x7f53c40319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.035+0000 7f53d37fe640 1 -- 172.21.15.59:0/2377401714 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4003bf0 con 0x7f53d4101c90 2024-09-10T21:25:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.035+0000 7f53d37fe640 1 -- 172.21.15.59:0/2377401714 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53c4003d90 con 0x7f53d4101c90 2024-09-10T21:25:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.035+0000 7f53dc6de640 1 -- 172.21.15.59:0/2377401714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d419e4b0 con 0x7f53d4101c90 2024-09-10T21:25:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.035+0000 7f53d37fe640 1 -- 172.21.15.59:0/2377401714 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c402fc20 con 0x7f53d4101c90 2024-09-10T21:25:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.035+0000 7f53dc6de640 1 -- 172.21.15.59:0/2377401714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d41a4bd0 con 0x7f53d4101c90 2024-09-10T21:25:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.038+0000 7f53d37fe640 1 -- 172.21.15.59:0/2377401714 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f53c40046a0 con 0x7f53d4101c90 2024-09-10T21:25:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.038+0000 7f53deab3740 1 Processor -- start 2024-09-10T21:25:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.038+0000 7f53deab3740 1 -- start start 2024-09-10T21:25:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.038+0000 7f53deab3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f76d0e90a0 0x55f76d0e94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.038+0000 7f53deab3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e9af0 0x55f76d0e9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.038+0000 7f53deab3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0f9ed0 0x55f76d0fc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.038+0000 7f53deab3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f76d05fea0 con 0x55f76d0e9af0 2024-09-10T21:25:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.038+0000 7f53deab3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f76d04f2d0 con 0x55f76d0e90a0 2024-09-10T21:25:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.038+0000 7f53deab3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55f76d0530e0 con 0x55f76d0f9ed0 2024-09-10T21:25:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.038+0000 7f53da47a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e9af0 0x55f76d0e9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.039+0000 7f53da47a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e9af0 0x55f76d0e9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45714/0 (socket says 172.21.15.59:45714) 2024-09-10T21:25:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.039+0000 7f53da47a640 1 -- 172.21.15.59:0/870416132 learned_addr learned my addr 172.21.15.59:0/870416132 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.039+0000 7f53d9c79640 1 --2- 172.21.15.59:0/870416132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0f9ed0 0x55f76d0fc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.039+0000 7f53dac7b640 1 --2- 172.21.15.59:0/870416132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f76d0e90a0 0x55f76d0e94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.039+0000 7f53d37fe640 1 --2- 172.21.15.59:0/2377401714 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f53bc0b52e0 0x7f53bc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.039+0000 7f53da47a640 1 -- 172.21.15.59:0/870416132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0f9ed0 msgr2=0x55f76d0fc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.039+0000 7f53da47a640 1 --2- 172.21.15.59:0/870416132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0f9ed0 0x55f76d0fc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.039+0000 7f53da47a640 1 -- 172.21.15.59:0/870416132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f76d0e90a0 msgr2=0x55f76d0e94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.039+0000 7f53da47a640 1 --2- 172.21.15.59:0/870416132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f76d0e90a0 0x55f76d0e94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.039+0000 7f53da47a640 1 -- 172.21.15.59:0/870416132 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f76cdad650 con 0x55f76d0e9af0 2024-09-10T21:25:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.039+0000 7f53d9c79640 1 --2- 172.21.15.59:0/870416132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0f9ed0 0x55f76d0fc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:25:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.039+0000 7f53dac7b640 1 --2- 172.21.15.59:0/2377401714 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f53bc0b52e0 0x7f53bc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.039+0000 7f53d37fe640 1 -- 172.21.15.59:0/2377401714 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f53c4106f30 con 0x7f53d4101c90 2024-09-10T21:25:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.039+0000 7f53da47a640 1 --2- 172.21.15.59:0/870416132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e9af0 0x55f76d0e9f50 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f53c40b92b0 tx=0x7f53c4091ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372f12938a1d950a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.039+0000 7f53d0ff9640 1 -- 172.21.15.59:0/870416132 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c40cd4f0 con 0x55f76d0e9af0 2024-09-10T21:25:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.039+0000 7f53d0ff9640 1 -- 172.21.15.59:0/870416132 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53c40b7a60 con 0x55f76d0e9af0 2024-09-10T21:25:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.040+0000 7f53d0ff9640 1 -- 172.21.15.59:0/870416132 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c40b7860 con 0x55f76d0e9af0 2024-09-10T21:25:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.040+0000 7f53deab3740 1 -- 172.21.15.59:0/870416132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e9af0 msgr2=0x55f76d0e9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.040+0000 7f53dac7b640 1 --2- 172.21.15.59:0/2377401714 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f53bc0b52e0 0x7f53bc0b77a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00bcc0 tx=0x7f53cc0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.040+0000 7f53deab3740 1 --2- 172.21.15.59:0/870416132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e9af0 0x55f76d0e9f50 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f53c40b92b0 tx=0x7f53c4091ef0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.040+0000 7f53deab3740 1 -- 172.21.15.59:0/870416132 shutdown_connections 2024-09-10T21:25:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.040+0000 7f53deab3740 1 --2- 172.21.15.59:0/870416132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0f9ed0 0x55f76d0fc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.040+0000 7f53deab3740 1 --2- 172.21.15.59:0/870416132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e9af0 0x55f76d0e9f50 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.040+0000 7f53deab3740 1 --2- 172.21.15.59:0/870416132 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f76d0e90a0 0x55f76d0e94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.040+0000 7f53deab3740 1 -- 172.21.15.59:0/870416132 >> 172.21.15.59:0/870416132 conn(0x55f76d0e7300 msgr2=0x55f76d0e84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.040+0000 7f53deab3740 1 -- 172.21.15.59:0/870416132 shutdown_connections 2024-09-10T21:25:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.040+0000 7f53deab3740 1 -- 172.21.15.59:0/870416132 wait complete. 2024-09-10T21:25:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.041+0000 7f53deab3740 1 -- start start 2024-09-10T21:25:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.041+0000 7f53deab3740 1 Processor -- start 2024-09-10T21:25:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.041+0000 7f53deab3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f76d0e90a0 0x55f76d0f1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.041+0000 7f53deab3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0e9af0 0x55f76d0ee5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.041+0000 7f53deab3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0f9ed0 0x55f76d0eeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.041+0000 7f53deab3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f76ceb0700 con 0x55f76d0f9ed0 2024-09-10T21:25:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.041+0000 7f53deab3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f76cfea160 con 0x55f76d0e90a0 2024-09-10T21:25:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.041+0000 7f53deab3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55f76d05fea0 con 0x55f76d0e9af0 2024-09-10T21:25:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.041+0000 7f53deab3740 10 client.0 _ll_register_callbacks cb 0x55f76d0039e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.041+0000 7f53dac7b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0f9ed0 0x55f76d0eeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.041+0000 7f53dac7b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0f9ed0 0x55f76d0eeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45726/0 (socket says 172.21.15.59:45726) 2024-09-10T21:25:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.041+0000 7f53da47a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f76d0e90a0 0x55f76d0f1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.041+0000 7f53dac7b640 1 -- 172.21.15.59:0/2807966631 learned_addr learned my addr 172.21.15.59:0/2807966631 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.042+0000 7f53d9c79640 1 --2- 172.21.15.59:0/2807966631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0e9af0 0x55f76d0ee5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.042+0000 7f53dac7b640 1 -- 172.21.15.59:0/2807966631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0e9af0 msgr2=0x55f76d0ee5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.042+0000 7f53dac7b640 1 --2- 172.21.15.59:0/2807966631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0e9af0 0x55f76d0ee5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.042+0000 7f53dac7b640 1 -- 172.21.15.59:0/2807966631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f76d0e90a0 msgr2=0x55f76d0f1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.042+0000 7f53dac7b640 1 --2- 172.21.15.59:0/2807966631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f76d0e90a0 0x55f76d0f1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.042+0000 7f53dac7b640 1 -- 172.21.15.59:0/2807966631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f76d017c90 con 0x55f76d0f9ed0 2024-09-10T21:25:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.042+0000 7f53d9c79640 1 --2- 172.21.15.59:0/2807966631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0e9af0 0x55f76d0ee5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:25:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.042+0000 7f53dac7b640 1 --2- 172.21.15.59:0/2807966631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0f9ed0 0x55f76d0eeae0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f53cc005bc0 tx=0x7f53cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28afaa75a702137f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.042+0000 7f53b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.042+0000 7f53b9ffb640 1 -- 172.21.15.59:0/2807966631 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc02b060 con 0x55f76d0f9ed0 2024-09-10T21:25:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.042+0000 7f53b9ffb640 1 -- 172.21.15.59:0/2807966631 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f53cc01c960 con 0x55f76d0f9ed0 2024-09-10T21:25:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.042+0000 7f53deab3740 1 -- 172.21.15.59:0/2807966631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f76d061df0 con 0x55f76d0f9ed0 2024-09-10T21:25:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.042+0000 7f53b9ffb640 1 -- 172.21.15.59:0/2807966631 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53cc01cb60 con 0x55f76d0f9ed0 2024-09-10T21:25:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.042+0000 7f53deab3740 10 client.17778 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.042+0000 7f53deab3740 1 -- 172.21.15.59:0/2807966631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f76d108220 con 0x55f76d0f9ed0 2024-09-10T21:25:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.043+0000 7f53b9ffb640 1 -- 172.21.15.59:0/2807966631 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f76d061df0 con 0x55f76d0f9ed0 2024-09-10T21:25:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.043+0000 7f53b9ffb640 1 -- 172.21.15.59:0/2807966631 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f53cc0103d0 con 0x55f76d0f9ed0 2024-09-10T21:25:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.043+0000 7f53deab3740 10 client.17778 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.043+0000 7f53deab3740 10 client.17778 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:25:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.043+0000 7f53deab3740 20 client.17778 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.043+0000 7f53deab3740 1 --2- 172.21.15.59:0/2807966631 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55f76d109730 0x55f76d10bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.043+0000 7f53deab3740 4 client.17778 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:25:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.043+0000 7f53deab3740 1 -- 172.21.15.59:0/2807966631 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f76d05d8a0 con 0x55f76d109730 2024-09-10T21:25:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.043+0000 7f53da47a640 1 --2- 172.21.15.59:0/2807966631 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55f76d109730 0x55f76d10bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:03.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.044+0000 7f53da47a640 1 --2- 172.21.15.59:0/2807966631 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55f76d109730 0x55f76d10bb50 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fa886d843b815cc server_cookie=8ec7011d9b1ac906 in_seq=0 out_seq=0 2024-09-10T21:25:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.044+0000 7f53b9ffb640 10 client.17778 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:25:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.044+0000 7f53b9ffb640 1 -- 172.21.15.59:0/2807966631 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f76d05d8a0 con 0x55f76d109730 2024-09-10T21:25:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.044+0000 7f53b9ffb640 10 client.17778 handle_command_reply: tid=0 2024-09-10T21:25:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.044+0000 7f53deab3740 1 client.17778 shutdown 2024-09-10T21:25:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.045+0000 7f53deab3740 1 -- 172.21.15.59:0/2807966631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0f9ed0 msgr2=0x55f76d0eeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.045+0000 7f53deab3740 1 --2- 172.21.15.59:0/2807966631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0f9ed0 0x55f76d0eeae0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f53cc005bc0 tx=0x7f53cc004730 comp rx=0 tx=0).stop 2024-09-10T21:25:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.045+0000 7f53deab3740 1 -- 172.21.15.59:0/2807966631 shutdown_connections 2024-09-10T21:25:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.045+0000 7f53deab3740 1 --2- 172.21.15.59:0/2807966631 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55f76d109730 0x55f76d10bb50 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.045+0000 7f53deab3740 1 --2- 172.21.15.59:0/2807966631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0f9ed0 0x55f76d0eeae0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.045+0000 7f53deab3740 1 --2- 172.21.15.59:0/2807966631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0e9af0 0x55f76d0ee5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.045+0000 7f53deab3740 1 --2- 172.21.15.59:0/2807966631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f76d0e90a0 0x55f76d0f1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.045+0000 7f53b9ffb640 0 client.17778 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:25:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.045+0000 7f53deab3740 1 -- 172.21.15.59:0/2807966631 >> 172.21.15.59:0/2807966631 conn(0x55f76d0e7300 msgr2=0x55f76d0e6420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:03.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.045+0000 7f53deab3740 1 -- 172.21.15.59:0/2807966631 shutdown_connections 2024-09-10T21:25:03.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.045+0000 7f53deab3740 1 -- 172.21.15.59:0/2807966631 wait complete. 2024-09-10T21:25:03.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.045+0000 7f53deab3740 20 client.17778 trim_cache size 0 max 16384 2024-09-10T21:25:03.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.058+0000 7f53deab3740 1 Processor -- start 2024-09-10T21:25:03.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.058+0000 7f53deab3740 1 -- start start 2024-09-10T21:25:03.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.058+0000 7f53deab3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e90a0 0x55f76d0e6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:03.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.058+0000 7f53deab3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0e9af0 0x55f76d0f02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:03.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.058+0000 7f53deab3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f76d0f9ed0 0x55f76d0f7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:03.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.058+0000 7f53deab3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53d41ac0e0 con 0x55f76d0e90a0 2024-09-10T21:25:03.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.058+0000 7f53deab3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53d41adc20 con 0x55f76d0f9ed0 2024-09-10T21:25:03.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.058+0000 7f53deab3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f53d41ac7b0 con 0x55f76d0e9af0 2024-09-10T21:25:03.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.058+0000 7f53da47a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e90a0 0x55f76d0e6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:03.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.058+0000 7f53da47a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e90a0 0x55f76d0e6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45742/0 (socket says 172.21.15.59:45742) 2024-09-10T21:25:03.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.058+0000 7f53da47a640 1 -- 172.21.15.59:0/3951309403 learned_addr learned my addr 172.21.15.59:0/3951309403 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:03.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.058+0000 7f53d9c79640 1 --2- 172.21.15.59:0/3951309403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0e9af0 0x55f76d0f02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:03.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.059+0000 7f53da47a640 1 -- 172.21.15.59:0/3951309403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0e9af0 msgr2=0x55f76d0f02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:03.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.059+0000 7f53da47a640 1 --2- 172.21.15.59:0/3951309403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0e9af0 0x55f76d0f02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.059+0000 7f53da47a640 1 -- 172.21.15.59:0/3951309403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f76d0f9ed0 msgr2=0x55f76d0f7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:03.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.059+0000 7f53da47a640 1 --2- 172.21.15.59:0/3951309403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f76d0f9ed0 0x55f76d0f7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.059+0000 7f53da47a640 1 -- 172.21.15.59:0/3951309403 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f76d0ee350 con 0x55f76d0e90a0 2024-09-10T21:25:03.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.059+0000 7f53da47a640 1 --2- 172.21.15.59:0/3951309403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e90a0 0x55f76d0e6c10 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f53c40cd6b0 tx=0x7f53c402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b1ab9bda2f89bf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:03.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.059+0000 7f53bbfff640 1 -- 172.21.15.59:0/3951309403 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c40fd9f0 con 0x55f76d0e90a0 2024-09-10T21:25:03.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.059+0000 7f53bbfff640 1 -- 172.21.15.59:0/3951309403 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53c4036040 con 0x55f76d0e90a0 2024-09-10T21:25:03.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.059+0000 7f53bbfff640 1 -- 172.21.15.59:0/3951309403 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c40fdc00 con 0x55f76d0e90a0 2024-09-10T21:25:03.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.060+0000 7f53deab3740 1 -- 172.21.15.59:0/3951309403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e90a0 msgr2=0x55f76d0e6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:03.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.060+0000 7f53deab3740 1 --2- 172.21.15.59:0/3951309403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e90a0 0x55f76d0e6c10 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f53c40cd6b0 tx=0x7f53c402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.060+0000 7f53deab3740 1 -- 172.21.15.59:0/3951309403 shutdown_connections 2024-09-10T21:25:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.060+0000 7f53deab3740 1 --2- 172.21.15.59:0/3951309403 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f76d0f9ed0 0x55f76d0f7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.060+0000 7f53deab3740 1 --2- 172.21.15.59:0/3951309403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0e9af0 0x55f76d0f02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.060+0000 7f53deab3740 1 --2- 172.21.15.59:0/3951309403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e90a0 0x55f76d0e6c10 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.060+0000 7f53deab3740 1 -- 172.21.15.59:0/3951309403 >> 172.21.15.59:0/3951309403 conn(0x55f76d0e7300 msgr2=0x55f76d0efbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.060+0000 7f53deab3740 1 -- 172.21.15.59:0/3951309403 shutdown_connections 2024-09-10T21:25:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.060+0000 7f53deab3740 1 -- 172.21.15.59:0/3951309403 wait complete. 2024-09-10T21:25:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.060+0000 7f53deab3740 1 -- start start 2024-09-10T21:25:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.060+0000 7f53deab3740 1 Processor -- start 2024-09-10T21:25:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53deab3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e90a0 0x55f76d16f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53deab3740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0e9af0 0x55f76d16fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53deab3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f76d0f9ed0 0x55f76d101b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:03.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53deab3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53d41ad550 con 0x55f76d0e90a0 2024-09-10T21:25:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53deab3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53d41ace80 con 0x55f76d0f9ed0 2024-09-10T21:25:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53deab3740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f53d41aa0c0 con 0x55f76d0e9af0 2024-09-10T21:25:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53deab3740 10 client.0 _ll_register_callbacks cb 0x7f53cc00ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53da47a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e90a0 0x55f76d16f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53da47a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e90a0 0x55f76d16f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45754/0 (socket says 172.21.15.59:45754) 2024-09-10T21:25:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53da47a640 1 -- 172.21.15.59:0/2699047940 learned_addr learned my addr 172.21.15.59:0/2699047940 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53d9c79640 1 --2- 172.21.15.59:0/2699047940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0e9af0 0x55f76d16fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53dac7b640 1 --2- 172.21.15.59:0/2699047940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f76d0f9ed0 0x55f76d101b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53da47a640 1 -- 172.21.15.59:0/2699047940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0e9af0 msgr2=0x55f76d16fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53da47a640 1 --2- 172.21.15.59:0/2699047940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0e9af0 0x55f76d16fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53da47a640 1 -- 172.21.15.59:0/2699047940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f76d0f9ed0 msgr2=0x55f76d101b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53da47a640 1 --2- 172.21.15.59:0/2699047940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f76d0f9ed0 0x55f76d101b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53da47a640 1 -- 172.21.15.59:0/2699047940 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f76d102220 con 0x55f76d0e90a0 2024-09-10T21:25:03.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53da47a640 1 --2- 172.21.15.59:0/2699047940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e90a0 0x55f76d16f910 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009a60 tx=0x7f53c402f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463943de1a4986cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:03.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:03.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53b9ffb640 1 -- 172.21.15.59:0/2699047940 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c40cce90 con 0x55f76d0e90a0 2024-09-10T21:25:03.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53b9ffb640 1 -- 172.21.15.59:0/2699047940 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f53c402fdc0 con 0x55f76d0e90a0 2024-09-10T21:25:03.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.061+0000 7f53deab3740 1 -- 172.21.15.59:0/2699047940 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53c4036040 con 0x55f76d0e90a0 2024-09-10T21:25:03.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.062+0000 7f53b9ffb640 1 -- 172.21.15.59:0/2699047940 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53c40cd070 con 0x55f76d0e90a0 2024-09-10T21:25:03.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.062+0000 7f53deab3740 10 client.17784 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:03.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.062+0000 7f53deab3740 1 -- 172.21.15.59:0/2699047940 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f76d177320 con 0x55f76d0e90a0 2024-09-10T21:25:03.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.062+0000 7f53b9ffb640 1 -- 172.21.15.59:0/2699047940 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53c4036040 con 0x55f76d0e90a0 2024-09-10T21:25:03.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.062+0000 7f53b9ffb640 1 -- 172.21.15.59:0/2699047940 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f53c410a6a0 con 0x55f76d0e90a0 2024-09-10T21:25:03.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.062+0000 7f53deab3740 10 client.17784 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:03.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.062+0000 7f53deab3740 10 client.17784 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:25:03.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.062+0000 7f53deab3740 20 client.17784 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.062+0000 7f53deab3740 1 --2- 172.21.15.59:0/2699047940 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55f76d1777a0 0x55f76d179b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.062+0000 7f53deab3740 4 client.17784 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:25:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.062+0000 7f53deab3740 1 -- 172.21.15.59:0/2699047940 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f76d05acd0 con 0x55f76d1777a0 2024-09-10T21:25:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.062+0000 7f53d9c79640 1 --2- 172.21.15.59:0/2699047940 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55f76d1777a0 0x55f76d179b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.063+0000 7f53d9c79640 1 --2- 172.21.15.59:0/2699047940 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55f76d1777a0 0x55f76d179b90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fca15e1f99d36a86 server_cookie=55eb4320b95ca945 in_seq=0 out_seq=0 2024-09-10T21:25:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.063+0000 7f53b9ffb640 10 client.17784 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:25:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.063+0000 7f53b9ffb640 1 -- 172.21.15.59:0/2699047940 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f76d05acd0 con 0x55f76d1777a0 2024-09-10T21:25:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.063+0000 7f53b9ffb640 10 client.17784 handle_command_reply: tid=0 2024-09-10T21:25:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.063+0000 7f53deab3740 1 client.17784 shutdown 2024-09-10T21:25:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.063+0000 7f53deab3740 1 -- 172.21.15.59:0/2699047940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e90a0 msgr2=0x55f76d16f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.063+0000 7f53deab3740 1 --2- 172.21.15.59:0/2699047940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e90a0 0x55f76d16f910 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009a60 tx=0x7f53c402f6f0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.063+0000 7f53deab3740 1 -- 172.21.15.59:0/2699047940 shutdown_connections 2024-09-10T21:25:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.063+0000 7f53deab3740 1 --2- 172.21.15.59:0/2699047940 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55f76d1777a0 0x55f76d179b90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.063+0000 7f53deab3740 1 --2- 172.21.15.59:0/2699047940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f76d0f9ed0 0x55f76d101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.063+0000 7f53deab3740 1 --2- 172.21.15.59:0/2699047940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55f76d0e9af0 0x55f76d16fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.063+0000 7f53deab3740 1 --2- 172.21.15.59:0/2699047940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f76d0e90a0 0x55f76d16f910 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.063+0000 7f53deab3740 1 -- 172.21.15.59:0/2699047940 >> 172.21.15.59:0/2699047940 conn(0x55f76d0e7300 msgr2=0x55f76d0f03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:03.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.063+0000 7f53b9ffb640 0 client.17784 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:25:03.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.063+0000 7f53deab3740 1 -- 172.21.15.59:0/2699047940 shutdown_connections 2024-09-10T21:25:03.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.063+0000 7f53deab3740 1 -- 172.21.15.59:0/2699047940 wait complete. 2024-09-10T21:25:03.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.063+0000 7f53deab3740 20 client.17784 trim_cache size 0 max 16384 2024-09-10T21:25:03.071 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:25:03.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.064+0000 7f53dc6de640 1 -- 172.21.15.59:0/2377401714 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f53bc0b52e0 msgr2=0x7f53bc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:03.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.064+0000 7f53dc6de640 1 --2- 172.21.15.59:0/2377401714 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f53bc0b52e0 0x7f53bc0b77a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00bcc0 tx=0x7f53cc0046c0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.064+0000 7f53dc6de640 1 -- 172.21.15.59:0/2377401714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53d4101c90 msgr2=0x7f53d4198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:03.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.064+0000 7f53dc6de640 1 --2- 172.21.15.59:0/2377401714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53d4101c90 0x7f53d4198170 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f53c4006010 tx=0x7f53c40319f0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.064+0000 7f53dc6de640 1 -- 172.21.15.59:0/2377401714 shutdown_connections 2024-09-10T21:25:03.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.064+0000 7f53dc6de640 1 --2- 172.21.15.59:0/2377401714 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f53bc0b52e0 0x7f53bc0b77a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.064+0000 7f53dc6de640 1 --2- 172.21.15.59:0/2377401714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53d4108020 0x7f53d419da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.064+0000 7f53dc6de640 1 --2- 172.21.15.59:0/2377401714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53d41076a0 0x7f53d41986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.064+0000 7f53dc6de640 1 --2- 172.21.15.59:0/2377401714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53d4101c90 0x7f53d4198170 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.064+0000 7f53dc6de640 1 -- 172.21.15.59:0/2377401714 >> 172.21.15.59:0/2377401714 conn(0x7f53d40fd700 msgr2=0x7f53d40ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.064+0000 7f53dc6de640 1 -- 172.21.15.59:0/2377401714 shutdown_connections 2024-09-10T21:25:03.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:03.064+0000 7f53dc6de640 1 -- 172.21.15.59:0/2377401714 wait complete. 2024-09-10T21:25:03.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:03 smithi192 ceph-mon[35363]: pgmap v633: 97 pgs: 97 active+clean; 6.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:25:03.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:03 smithi059 ceph-mon[30888]: pgmap v633: 97 pgs: 97 active+clean; 6.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:25:03.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:03 smithi154 ceph-mon[35041]: pgmap v633: 97 pgs: 97 active+clean; 6.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:25:03.958 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:25:04.222 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:25:04.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.651+0000 7feaa9919640 1 -- 172.21.15.59:0/649464552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa410d140 msgr2=0x7feaa410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:04.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.651+0000 7feaa9919640 1 --2- 172.21.15.59:0/649464552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa410d140 0x7feaa410f5a0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009ca0 tx=0x7fea9c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.651+0000 7feaa9919640 1 -- 172.21.15.59:0/649464552 shutdown_connections 2024-09-10T21:25:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.651+0000 7feaa9919640 1 --2- 172.21.15.59:0/649464552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa410d140 0x7feaa410f5a0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.651+0000 7feaa9919640 1 --2- 172.21.15.59:0/649464552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaa4104600 0x7feaa410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.651+0000 7feaa9919640 1 --2- 172.21.15.59:0/649464552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feaa4103ce0 0x7feaa41040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.651+0000 7feaa9919640 1 -- 172.21.15.59:0/649464552 >> 172.21.15.59:0/649464552 conn(0x7feaa40fd700 msgr2=0x7feaa40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.651+0000 7feaa9919640 1 -- 172.21.15.59:0/649464552 shutdown_connections 2024-09-10T21:25:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.651+0000 7feaa9919640 1 -- 172.21.15.59:0/649464552 wait complete. 2024-09-10T21:25:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.652+0000 7feaa9919640 1 Processor -- start 2024-09-10T21:25:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.652+0000 7feaa9919640 1 -- start start 2024-09-10T21:25:04.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.652+0000 7feaa9919640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feaa4103ce0 0x7feaa41992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:04.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.652+0000 7feaa9919640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa4104600 0x7feaa4199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:04.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.652+0000 7feaa9919640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaa410d140 0x7feaa419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:04.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.652+0000 7feaa9919640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feaa4112df0 con 0x7feaa4104600 2024-09-10T21:25:04.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.652+0000 7feaa9919640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feaa4112c70 con 0x7feaa410d140 2024-09-10T21:25:04.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.652+0000 7feaa9919640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feaa4112f70 con 0x7feaa4103ce0 2024-09-10T21:25:04.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.652+0000 7fea9a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa4104600 0x7feaa4199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:04.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.652+0000 7fea9a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa4104600 0x7feaa4199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45766/0 (socket says 172.21.15.59:45766) 2024-09-10T21:25:04.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.652+0000 7fea9a7fc640 1 -- 172.21.15.59:0/575020986 learned_addr learned my addr 172.21.15.59:0/575020986 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:04.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.653+0000 7feaa2ffd640 1 --2- 172.21.15.59:0/575020986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feaa4103ce0 0x7feaa41992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:04.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.653+0000 7feaa37fe640 1 --2- 172.21.15.59:0/575020986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaa410d140 0x7feaa419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:04.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.653+0000 7fea9a7fc640 1 -- 172.21.15.59:0/575020986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feaa4103ce0 msgr2=0x7feaa41992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:04.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.653+0000 7fea9a7fc640 1 --2- 172.21.15.59:0/575020986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feaa4103ce0 0x7feaa41992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.653+0000 7fea9a7fc640 1 -- 172.21.15.59:0/575020986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaa410d140 msgr2=0x7feaa419eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:04.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.653+0000 7fea9a7fc640 1 --2- 172.21.15.59:0/575020986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaa410d140 0x7feaa419eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.653+0000 7fea9a7fc640 1 -- 172.21.15.59:0/575020986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa419f370 con 0x7feaa4104600 2024-09-10T21:25:04.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.653+0000 7feaa37fe640 1 --2- 172.21.15.59:0/575020986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaa410d140 0x7feaa419eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:04.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.653+0000 7fea9a7fc640 1 --2- 172.21.15.59:0/575020986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa4104600 0x7feaa4199800 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fea8c00d750 tx=0x7fea8c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:04.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.653+0000 7feaa8917640 1 -- 172.21.15.59:0/575020986 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c017070 con 0x7feaa4104600 2024-09-10T21:25:04.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.653+0000 7feaa9919640 1 -- 172.21.15.59:0/575020986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa419f660 con 0x7feaa4104600 2024-09-10T21:25:04.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.653+0000 7feaa8917640 1 -- 172.21.15.59:0/575020986 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea8c004020 con 0x7feaa4104600 2024-09-10T21:25:04.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.653+0000 7feaa8917640 1 -- 172.21.15.59:0/575020986 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c003c00 con 0x7feaa4104600 2024-09-10T21:25:04.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.653+0000 7feaa9919640 1 -- 172.21.15.59:0/575020986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa41a5ef0 con 0x7feaa4104600 2024-09-10T21:25:04.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.656+0000 7feaa8917640 1 -- 172.21.15.59:0/575020986 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fea8c009a30 con 0x7feaa4104600 2024-09-10T21:25:04.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.656+0000 7feaabcee740 1 Processor -- start 2024-09-10T21:25:04.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.656+0000 7feaabcee740 1 -- start start 2024-09-10T21:25:04.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.656+0000 7feaabcee740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f910f0 0x5601d3f914d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:04.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.656+0000 7feaabcee740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f91a10 0x5601d3f9d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:04.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.656+0000 7feaabcee740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f9d9a0 0x5601d3f9fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:04.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.656+0000 7feaabcee740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5601d3f07ea0 con 0x5601d3f9d9a0 2024-09-10T21:25:04.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.656+0000 7feaabcee740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5601d3ef72d0 con 0x5601d3f910f0 2024-09-10T21:25:04.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.656+0000 7feaabcee740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5601d3efb0e0 con 0x5601d3f91a10 2024-09-10T21:25:04.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.656+0000 7fea9a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f9d9a0 0x5601d3f9fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:04.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.656+0000 7fea9a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f9d9a0 0x5601d3f9fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45778/0 (socket says 172.21.15.59:45778) 2024-09-10T21:25:04.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.656+0000 7fea9a7fc640 1 -- 172.21.15.59:0/1263243591 learned_addr learned my addr 172.21.15.59:0/1263243591 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:04.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.656+0000 7feaa2ffd640 1 --2- 172.21.15.59:0/1263243591 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f91a10 0x5601d3f9d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:04.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.656+0000 7feaa37fe640 1 --2- 172.21.15.59:0/1263243591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f910f0 0x5601d3f914d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:04.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.657+0000 7fea9a7fc640 1 -- 172.21.15.59:0/1263243591 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f91a10 msgr2=0x5601d3f9d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:04.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.657+0000 7fea9a7fc640 1 --2- 172.21.15.59:0/1263243591 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f91a10 0x5601d3f9d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.657+0000 7fea9a7fc640 1 -- 172.21.15.59:0/1263243591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f910f0 msgr2=0x5601d3f914d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:04.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.657+0000 7fea9a7fc640 1 --2- 172.21.15.59:0/1263243591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f910f0 0x5601d3f914d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.657+0000 7fea9a7fc640 1 -- 172.21.15.59:0/1263243591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601d3c55650 con 0x5601d3f9d9a0 2024-09-10T21:25:04.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.657+0000 7feaa8917640 1 --2- 172.21.15.59:0/575020986 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fea900b52e0 0x7fea900b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:04.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.657+0000 7feaa37fe640 1 --2- 172.21.15.59:0/575020986 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fea900b52e0 0x7fea900b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:04.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.657+0000 7fea9a7fc640 1 --2- 172.21.15.59:0/1263243591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f9d9a0 0x5601d3f9fd90 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0eb670 tx=0x7fea8c0ebb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabd2a4e07579568 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:04.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.657+0000 7feaa8917640 1 -- 172.21.15.59:0/575020986 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fea8c0e5590 con 0x7feaa4104600 2024-09-10T21:25:04.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.657+0000 7fea99ffb640 1 -- 172.21.15.59:0/1263243591 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c0a7bc0 con 0x5601d3f9d9a0 2024-09-10T21:25:04.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.657+0000 7fea99ffb640 1 -- 172.21.15.59:0/1263243591 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea8c0ab830 con 0x5601d3f9d9a0 2024-09-10T21:25:04.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.657+0000 7fea99ffb640 1 -- 172.21.15.59:0/1263243591 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c0ab490 con 0x5601d3f9d9a0 2024-09-10T21:25:04.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.658+0000 7feaabcee740 1 -- 172.21.15.59:0/1263243591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f9d9a0 msgr2=0x5601d3f9fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:04.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.658+0000 7feaa37fe640 1 --2- 172.21.15.59:0/575020986 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fea900b52e0 0x7fea900b77a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fea9c004af0 tx=0x7fea9c005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:04.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.658+0000 7feaabcee740 1 --2- 172.21.15.59:0/1263243591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f9d9a0 0x5601d3f9fd90 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0eb670 tx=0x7fea8c0ebb30 comp rx=0 tx=0).stop 2024-09-10T21:25:04.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.658+0000 7feaabcee740 1 -- 172.21.15.59:0/1263243591 shutdown_connections 2024-09-10T21:25:04.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.658+0000 7feaabcee740 1 --2- 172.21.15.59:0/1263243591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f9d9a0 0x5601d3f9fd90 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.658+0000 7feaabcee740 1 --2- 172.21.15.59:0/1263243591 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f91a10 0x5601d3f9d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.658+0000 7feaabcee740 1 --2- 172.21.15.59:0/1263243591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f910f0 0x5601d3f914d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.658+0000 7feaabcee740 1 -- 172.21.15.59:0/1263243591 >> 172.21.15.59:0/1263243591 conn(0x5601d3f8ef20 msgr2=0x5601d3f900c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:04.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.658+0000 7feaabcee740 1 -- 172.21.15.59:0/1263243591 shutdown_connections 2024-09-10T21:25:04.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.658+0000 7feaabcee740 1 -- 172.21.15.59:0/1263243591 wait complete. 2024-09-10T21:25:04.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.658+0000 7feaabcee740 1 -- start start 2024-09-10T21:25:04.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.659+0000 7feaabcee740 1 Processor -- start 2024-09-10T21:25:04.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.659+0000 7feaabcee740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f910f0 0x5601d3f9d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.659+0000 7feaabcee740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f91a10 0x5601d3f9a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.659+0000 7feaabcee740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f9d9a0 0x5601d3f9ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.659+0000 7feaabcee740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5601d3d58700 con 0x5601d3f9d9a0 2024-09-10T21:25:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.659+0000 7feaabcee740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5601d3e92160 con 0x5601d3f91a10 2024-09-10T21:25:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.659+0000 7feaabcee740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5601d3fa0620 con 0x5601d3f910f0 2024-09-10T21:25:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.659+0000 7feaabcee740 10 client.0 _ll_register_callbacks cb 0x5601d3eab9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.659+0000 7feaa37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f9d9a0 0x5601d3f9ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.659+0000 7fea9a7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f91a10 0x5601d3f9a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.659+0000 7feaa2ffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f910f0 0x5601d3f9d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.659+0000 7feaa37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f9d9a0 0x5601d3f9ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45784/0 (socket says 172.21.15.59:45784) 2024-09-10T21:25:04.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.659+0000 7feaa37fe640 1 -- 172.21.15.59:0/2693558558 learned_addr learned my addr 172.21.15.59:0/2693558558 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:04.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.659+0000 7fea9a7fc640 1 --2- 172.21.15.59:0/2693558558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f91a10 0x5601d3f9a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.59:37476/0 (socket says 172.21.15.59:37476) 2024-09-10T21:25:04.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.660+0000 7feaa37fe640 1 -- 172.21.15.59:0/2693558558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f910f0 msgr2=0x5601d3f9d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:04.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.660+0000 7feaa37fe640 1 --2- 172.21.15.59:0/2693558558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f910f0 0x5601d3f9d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.660+0000 7feaa37fe640 1 -- 172.21.15.59:0/2693558558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f91a10 msgr2=0x5601d3f9a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:04.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.660+0000 7feaa37fe640 1 --2- 172.21.15.59:0/2693558558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f91a10 0x5601d3f9a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.660+0000 7feaa37fe640 1 -- 172.21.15.59:0/2693558558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601d3ebfc90 con 0x5601d3f9d9a0 2024-09-10T21:25:04.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.660+0000 7fea9a7fc640 1 --2- 172.21.15.59:0/2693558558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f91a10 0x5601d3f9a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:25:04.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.660+0000 7feaa37fe640 1 --2- 172.21.15.59:0/2693558558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f9d9a0 0x5601d3f9ad00 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0314d0 tx=0x7fea9c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6bc364f6235ce3c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:04.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.660+0000 7fea82ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:04.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.660+0000 7fea82ffd640 1 -- 172.21.15.59:0/2693558558 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c004250 con 0x5601d3f9d9a0 2024-09-10T21:25:04.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.660+0000 7fea82ffd640 1 -- 172.21.15.59:0/2693558558 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fea9c0043f0 con 0x5601d3f9d9a0 2024-09-10T21:25:04.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.660+0000 7feaabcee740 1 -- 172.21.15.59:0/2693558558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea8c0ab830 con 0x5601d3f9d9a0 2024-09-10T21:25:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.661+0000 7fea82ffd640 1 -- 172.21.15.59:0/2693558558 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fea9c0045f0 con 0x5601d3f9d9a0 2024-09-10T21:25:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.661+0000 7feaabcee740 10 client.17796 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.661+0000 7feaabcee740 1 -- 172.21.15.59:0/2693558558 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5601d3fabfa0 con 0x5601d3f9d9a0 2024-09-10T21:25:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.661+0000 7fea82ffd640 1 -- 172.21.15.59:0/2693558558 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea8c0ab830 con 0x5601d3f9d9a0 2024-09-10T21:25:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.661+0000 7fea82ffd640 1 -- 172.21.15.59:0/2693558558 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fea9c050070 con 0x5601d3f9d9a0 2024-09-10T21:25:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.661+0000 7feaabcee740 10 client.17796 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.661+0000 7feaabcee740 10 client.17796 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:25:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.661+0000 7feaabcee740 20 client.17796 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.661+0000 7feaabcee740 1 --2- 172.21.15.59:0/2693558558 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5601d3fad450 0x5601d3faf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.661+0000 7feaabcee740 4 client.17796 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:25:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.661+0000 7feaabcee740 1 -- 172.21.15.59:0/2693558558 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601d3f09df0 con 0x5601d3fad450 2024-09-10T21:25:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.662+0000 7feaa2ffd640 1 --2- 172.21.15.59:0/2693558558 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5601d3fad450 0x5601d3faf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:04.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.662+0000 7fea82ffd640 10 client.17796 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.662+0000 7feaa2ffd640 1 --2- 172.21.15.59:0/2693558558 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5601d3fad450 0x5601d3faf890 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baf72ba906cce6d2 server_cookie=3e5b2a29acee7167 in_seq=0 out_seq=0 2024-09-10T21:25:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.663+0000 7fea82ffd640 1 -- 172.21.15.59:0/2693558558 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5601d3f09df0 con 0x5601d3fad450 2024-09-10T21:25:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.663+0000 7fea82ffd640 10 client.17796 handle_command_reply: tid=0 2024-09-10T21:25:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.663+0000 7feaabcee740 1 client.17796 shutdown 2024-09-10T21:25:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.663+0000 7feaabcee740 1 -- 172.21.15.59:0/2693558558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f9d9a0 msgr2=0x5601d3f9ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.663+0000 7feaabcee740 1 --2- 172.21.15.59:0/2693558558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f9d9a0 0x5601d3f9ad00 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0314d0 tx=0x7fea9c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.663+0000 7feaabcee740 1 -- 172.21.15.59:0/2693558558 shutdown_connections 2024-09-10T21:25:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.663+0000 7feaabcee740 1 --2- 172.21.15.59:0/2693558558 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5601d3fad450 0x5601d3faf890 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.663+0000 7feaabcee740 1 --2- 172.21.15.59:0/2693558558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f9d9a0 0x5601d3f9ad00 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.663+0000 7feaabcee740 1 --2- 172.21.15.59:0/2693558558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f91a10 0x5601d3f9a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.663+0000 7feaabcee740 1 --2- 172.21.15.59:0/2693558558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f910f0 0x5601d3f9d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.663+0000 7feaabcee740 1 -- 172.21.15.59:0/2693558558 >> 172.21.15.59:0/2693558558 conn(0x5601d3f8ef20 msgr2=0x5601d3f94a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:04.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.663+0000 7fea82ffd640 0 client.17796 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:04.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.663+0000 7feaabcee740 1 -- 172.21.15.59:0/2693558558 shutdown_connections 2024-09-10T21:25:04.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.663+0000 7feaabcee740 1 -- 172.21.15.59:0/2693558558 wait complete. 2024-09-10T21:25:04.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.663+0000 7feaabcee740 20 client.17796 trim_cache size 0 max 16384 2024-09-10T21:25:04.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7feaabcee740 1 Processor -- start 2024-09-10T21:25:04.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7feaabcee740 1 -- start start 2024-09-10T21:25:04.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7feaabcee740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f910f0 0x5601d3fa9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:04.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7feaabcee740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f91a10 0x5601d3f9c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:04.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7feaabcee740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f9d9a0 0x5601d3fa5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:04.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7feaabcee740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feaa41ae400 con 0x5601d3f91a10 2024-09-10T21:25:04.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7feaabcee740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feaa41aff40 con 0x5601d3f910f0 2024-09-10T21:25:04.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7feaabcee740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feaa41aead0 con 0x5601d3f9d9a0 2024-09-10T21:25:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7fea9a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f91a10 0x5601d3f9c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7fea9a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f91a10 0x5601d3f9c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45800/0 (socket says 172.21.15.59:45800) 2024-09-10T21:25:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7fea9a7fc640 1 -- 172.21.15.59:0/3296703439 learned_addr learned my addr 172.21.15.59:0/3296703439 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7feaa2ffd640 1 --2- 172.21.15.59:0/3296703439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f910f0 0x5601d3fa9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7feaa37fe640 1 --2- 172.21.15.59:0/3296703439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f9d9a0 0x5601d3fa5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7fea9a7fc640 1 -- 172.21.15.59:0/3296703439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f9d9a0 msgr2=0x5601d3fa5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7fea9a7fc640 1 --2- 172.21.15.59:0/3296703439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f9d9a0 0x5601d3fa5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7fea9a7fc640 1 -- 172.21.15.59:0/3296703439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f910f0 msgr2=0x5601d3fa9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7fea9a7fc640 1 --2- 172.21.15.59:0/3296703439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f910f0 0x5601d3fa9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7fea9a7fc640 1 -- 172.21.15.59:0/3296703439 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601d3f8fc00 con 0x5601d3f91a10 2024-09-10T21:25:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7feaa37fe640 1 --2- 172.21.15.59:0/3296703439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f9d9a0 0x5601d3fa5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.677+0000 7feaa2ffd640 1 --2- 172.21.15.59:0/3296703439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f910f0 0x5601d3fa9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:25:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.678+0000 7fea9a7fc640 1 --2- 172.21.15.59:0/3296703439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f91a10 0x5601d3f9c430 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0a8f90 tx=0x7fea8c0e5810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6057af91b831dfa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:04.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.678+0000 7fea997fa640 1 -- 172.21.15.59:0/3296703439 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c020070 con 0x5601d3f91a10 2024-09-10T21:25:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.678+0000 7fea997fa640 1 -- 172.21.15.59:0/3296703439 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea8c0ab830 con 0x5601d3f91a10 2024-09-10T21:25:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.678+0000 7fea997fa640 1 -- 172.21.15.59:0/3296703439 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c0ab670 con 0x5601d3f91a10 2024-09-10T21:25:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.678+0000 7feaabcee740 1 -- 172.21.15.59:0/3296703439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f91a10 msgr2=0x5601d3f9c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.678+0000 7feaabcee740 1 --2- 172.21.15.59:0/3296703439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f91a10 0x5601d3f9c430 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0a8f90 tx=0x7fea8c0e5810 comp rx=0 tx=0).stop 2024-09-10T21:25:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.678+0000 7feaabcee740 1 -- 172.21.15.59:0/3296703439 shutdown_connections 2024-09-10T21:25:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.678+0000 7feaabcee740 1 --2- 172.21.15.59:0/3296703439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f9d9a0 0x5601d3fa5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.678+0000 7feaabcee740 1 --2- 172.21.15.59:0/3296703439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f91a10 0x5601d3f9c430 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.678+0000 7feaabcee740 1 --2- 172.21.15.59:0/3296703439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f910f0 0x5601d3fa9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.678+0000 7feaabcee740 1 -- 172.21.15.59:0/3296703439 >> 172.21.15.59:0/3296703439 conn(0x5601d3f8ef20 msgr2=0x5601d3f9bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.678+0000 7feaabcee740 1 -- 172.21.15.59:0/3296703439 shutdown_connections 2024-09-10T21:25:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.678+0000 7feaabcee740 1 -- 172.21.15.59:0/3296703439 wait complete. 2024-09-10T21:25:04.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.679+0000 7feaabcee740 1 -- start start 2024-09-10T21:25:04.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.679+0000 7feaabcee740 1 Processor -- start 2024-09-10T21:25:04.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.679+0000 7feaabcee740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f910f0 0x5601d3fb54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:04.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.679+0000 7feaabcee740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f91a10 0x5601d3fb5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:04.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.679+0000 7feaabcee740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f9d9a0 0x5601d3fb4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:04.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.679+0000 7feaabcee740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feaa41af870 con 0x5601d3f91a10 2024-09-10T21:25:04.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.679+0000 7feaabcee740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feaa41af1a0 con 0x5601d3f9d9a0 2024-09-10T21:25:04.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.679+0000 7feaabcee740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feaa41ac3e0 con 0x5601d3f910f0 2024-09-10T21:25:04.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.679+0000 7feaabcee740 10 client.0 _ll_register_callbacks cb 0x7fea9c032f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:04.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.680+0000 7fea9a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f91a10 0x5601d3fb5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:04.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.680+0000 7fea9a7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f91a10 0x5601d3fb5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45804/0 (socket says 172.21.15.59:45804) 2024-09-10T21:25:04.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.680+0000 7fea9a7fc640 1 -- 172.21.15.59:0/1874730122 learned_addr learned my addr 172.21.15.59:0/1874730122 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:04.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.680+0000 7feaa2ffd640 1 --2- 172.21.15.59:0/1874730122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f910f0 0x5601d3fb54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.680+0000 7feaa37fe640 1 --2- 172.21.15.59:0/1874730122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f9d9a0 0x5601d3fb4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.680+0000 7fea9a7fc640 1 -- 172.21.15.59:0/1874730122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f910f0 msgr2=0x5601d3fb54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.680+0000 7fea9a7fc640 1 --2- 172.21.15.59:0/1874730122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f910f0 0x5601d3fb54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.680+0000 7fea9a7fc640 1 -- 172.21.15.59:0/1874730122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f9d9a0 msgr2=0x5601d3fb4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.680+0000 7fea9a7fc640 1 --2- 172.21.15.59:0/1874730122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f9d9a0 0x5601d3fb4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.680+0000 7fea9a7fc640 1 -- 172.21.15.59:0/1874730122 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601d3fb4ac0 con 0x5601d3f91a10 2024-09-10T21:25:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.680+0000 7fea9a7fc640 1 --2- 172.21.15.59:0/1874730122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f91a10 0x5601d3fb5a70 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0ed4b0 tx=0x7fea8c0ebb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f7b732125b4aad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.680+0000 7fea82ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.680+0000 7fea82ffd640 1 -- 172.21.15.59:0/1874730122 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c020030 con 0x5601d3f91a10 2024-09-10T21:25:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.680+0000 7fea82ffd640 1 -- 172.21.15.59:0/1874730122 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fea8c0e30e0 con 0x5601d3f91a10 2024-09-10T21:25:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.680+0000 7feaabcee740 1 -- 172.21.15.59:0/1874730122 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea8c0ab830 con 0x5601d3f91a10 2024-09-10T21:25:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.680+0000 7fea82ffd640 1 -- 172.21.15.59:0/1874730122 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fea8c0abaf0 con 0x5601d3f91a10 2024-09-10T21:25:04.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.680+0000 7feaabcee740 10 client.17802 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.680+0000 7feaabcee740 1 -- 172.21.15.59:0/1874730122 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5601d401ef70 con 0x5601d3f91a10 2024-09-10T21:25:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.681+0000 7fea82ffd640 1 -- 172.21.15.59:0/1874730122 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea8c0ab830 con 0x5601d3f91a10 2024-09-10T21:25:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.681+0000 7fea82ffd640 1 -- 172.21.15.59:0/1874730122 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fea8c093070 con 0x5601d3f91a10 2024-09-10T21:25:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.681+0000 7feaabcee740 10 client.17802 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.681+0000 7feaabcee740 10 client.17802 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:25:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.681+0000 7feaabcee740 20 client.17802 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.681+0000 7feaabcee740 1 --2- 172.21.15.59:0/1874730122 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5601d401f2b0 0x5601d40216a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.681+0000 7feaabcee740 4 client.17802 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:25:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.681+0000 7feaabcee740 1 -- 172.21.15.59:0/1874730122 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5601d3f058a0 con 0x5601d401f2b0 2024-09-10T21:25:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.681+0000 7feaa2ffd640 1 --2- 172.21.15.59:0/1874730122 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5601d401f2b0 0x5601d40216a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.682+0000 7feaa2ffd640 1 --2- 172.21.15.59:0/1874730122 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5601d401f2b0 0x5601d40216a0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=674985d9fac0f135 server_cookie=4f767c9b9a04ef8e in_seq=0 out_seq=0 2024-09-10T21:25:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.682+0000 7fea82ffd640 10 client.17802 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:04.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.682+0000 7fea82ffd640 1 -- 172.21.15.59:0/1874730122 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5601d3f058a0 con 0x5601d401f2b0 2024-09-10T21:25:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.682+0000 7fea82ffd640 10 client.17802 handle_command_reply: tid=0 2024-09-10T21:25:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.682+0000 7feaabcee740 1 client.17802 shutdown 2024-09-10T21:25:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.682+0000 7feaabcee740 1 -- 172.21.15.59:0/1874730122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f91a10 msgr2=0x5601d3fb5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.682+0000 7feaabcee740 1 --2- 172.21.15.59:0/1874730122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f91a10 0x5601d3fb5a70 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0ed4b0 tx=0x7fea8c0ebb30 comp rx=0 tx=0).stop 2024-09-10T21:25:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.682+0000 7feaabcee740 1 -- 172.21.15.59:0/1874730122 shutdown_connections 2024-09-10T21:25:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.682+0000 7feaabcee740 1 --2- 172.21.15.59:0/1874730122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5601d3f9d9a0 0x5601d3fb4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.682+0000 7feaabcee740 1 --2- 172.21.15.59:0/1874730122 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5601d401f2b0 0x5601d40216a0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.682+0000 7feaabcee740 1 --2- 172.21.15.59:0/1874730122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601d3f91a10 0x5601d3fb5a70 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.682+0000 7feaabcee740 1 --2- 172.21.15.59:0/1874730122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5601d3f910f0 0x5601d3fb54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.682+0000 7feaabcee740 1 -- 172.21.15.59:0/1874730122 >> 172.21.15.59:0/1874730122 conn(0x5601d3f8ef20 msgr2=0x5601d3f9c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.682+0000 7fea82ffd640 0 client.17802 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.682+0000 7feaabcee740 1 -- 172.21.15.59:0/1874730122 shutdown_connections 2024-09-10T21:25:04.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.682+0000 7feaabcee740 1 -- 172.21.15.59:0/1874730122 wait complete. 2024-09-10T21:25:04.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.682+0000 7feaabcee740 20 client.17802 trim_cache size 0 max 16384 2024-09-10T21:25:04.691 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:25:04.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.683+0000 7feaa9919640 1 -- 172.21.15.59:0/575020986 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fea900b52e0 msgr2=0x7fea900b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:04.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.683+0000 7feaa9919640 1 --2- 172.21.15.59:0/575020986 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fea900b52e0 0x7fea900b77a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fea9c004af0 tx=0x7fea9c005d80 comp rx=0 tx=0).stop 2024-09-10T21:25:04.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.683+0000 7feaa9919640 1 -- 172.21.15.59:0/575020986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa4104600 msgr2=0x7feaa4199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:04.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.683+0000 7feaa9919640 1 --2- 172.21.15.59:0/575020986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa4104600 0x7feaa4199800 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fea8c00d750 tx=0x7fea8c00dc10 comp rx=0 tx=0).stop 2024-09-10T21:25:04.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.683+0000 7feaa9919640 1 -- 172.21.15.59:0/575020986 shutdown_connections 2024-09-10T21:25:04.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.683+0000 7feaa9919640 1 --2- 172.21.15.59:0/575020986 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fea900b52e0 0x7fea900b77a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.683+0000 7feaa9919640 1 --2- 172.21.15.59:0/575020986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaa410d140 0x7feaa419eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.683+0000 7feaa9919640 1 --2- 172.21.15.59:0/575020986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa4104600 0x7feaa4199800 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.683+0000 7feaa9919640 1 --2- 172.21.15.59:0/575020986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feaa4103ce0 0x7feaa41992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:04.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.683+0000 7feaa9919640 1 -- 172.21.15.59:0/575020986 >> 172.21.15.59:0/575020986 conn(0x7feaa40fd700 msgr2=0x7feaa40fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:04.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.683+0000 7feaa9919640 1 -- 172.21.15.59:0/575020986 shutdown_connections 2024-09-10T21:25:04.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:04.683+0000 7feaa9919640 1 -- 172.21.15.59:0/575020986 wait complete. 2024-09-10T21:25:05.336 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:05 smithi059 ceph-mon[30888]: pgmap v634: 97 pgs: 97 active+clean; 6.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:25:05.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:05 smithi154 ceph-mon[35041]: pgmap v634: 97 pgs: 97 active+clean; 6.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:25:05.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:05 smithi192 ceph-mon[35363]: pgmap v634: 97 pgs: 97 active+clean; 6.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:25:06.558 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:25:06.558 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:25:06.830 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:25:07.228 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:07 smithi059 ceph-mon[30888]: pgmap v635: 97 pgs: 97 active+clean; 6.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-10T21:25:07.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.312+0000 7f06f0a46640 1 -- 172.21.15.59:0/626854537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06ec1076a0 msgr2=0x7f06ec107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:07.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.312+0000 7f06f0a46640 1 --2- 172.21.15.59:0/626854537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06ec1076a0 0x7f06ec107ae0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009900 tx=0x7f06e002a410 comp rx=0 tx=0).stop 2024-09-10T21:25:07.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.312+0000 7f06f0a46640 1 -- 172.21.15.59:0/626854537 shutdown_connections 2024-09-10T21:25:07.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.312+0000 7f06f0a46640 1 --2- 172.21.15.59:0/626854537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06ec108020 0x7f06ec10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.312+0000 7f06f0a46640 1 --2- 172.21.15.59:0/626854537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06ec1076a0 0x7f06ec107ae0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.312+0000 7f06f0a46640 1 --2- 172.21.15.59:0/626854537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec101c90 0x7f06ec102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.312+0000 7f06f0a46640 1 -- 172.21.15.59:0/626854537 >> 172.21.15.59:0/626854537 conn(0x7f06ec0fd700 msgr2=0x7f06ec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:07.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.312+0000 7f06f0a46640 1 -- 172.21.15.59:0/626854537 shutdown_connections 2024-09-10T21:25:07.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.312+0000 7f06f0a46640 1 -- 172.21.15.59:0/626854537 wait complete. 2024-09-10T21:25:07.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06f0a46640 1 Processor -- start 2024-09-10T21:25:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06f0a46640 1 -- start start 2024-09-10T21:25:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06f0a46640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06ec101c90 0x7f06ec19b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06f0a46640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec1076a0 0x7f06ec19b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06f0a46640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06ec108020 0x7f06ec1a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06f0a46640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec112d40 con 0x7f06ec108020 2024-09-10T21:25:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06f0a46640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec112bc0 con 0x7f06ec1076a0 2024-09-10T21:25:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06f0a46640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec112ec0 con 0x7f06ec101c90 2024-09-10T21:25:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06ead9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06ec108020 0x7f06ec1a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06ead9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06ec108020 0x7f06ec1a0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45824/0 (socket says 172.21.15.59:45824) 2024-09-10T21:25:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06ead9d640 1 -- 172.21.15.59:0/1907164623 learned_addr learned my addr 172.21.15.59:0/1907164623 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:07.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06ea59c640 1 --2- 172.21.15.59:0/1907164623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06ec101c90 0x7f06ec19b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06e9d9b640 1 --2- 172.21.15.59:0/1907164623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec1076a0 0x7f06ec19b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06ead9d640 1 -- 172.21.15.59:0/1907164623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06ec101c90 msgr2=0x7f06ec19b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06ead9d640 1 --2- 172.21.15.59:0/1907164623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06ec101c90 0x7f06ec19b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06ead9d640 1 -- 172.21.15.59:0/1907164623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec1076a0 msgr2=0x7f06ec19b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06ead9d640 1 --2- 172.21.15.59:0/1907164623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec1076a0 0x7f06ec19b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06ead9d640 1 -- 172.21.15.59:0/1907164623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ec1a1530 con 0x7f06ec108020 2024-09-10T21:25:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06e9d9b640 1 --2- 172.21.15.59:0/1907164623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec1076a0 0x7f06ec19b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:25:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.313+0000 7f06ead9d640 1 --2- 172.21.15.59:0/1907164623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06ec108020 0x7f06ec1a0d60 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f06e400cce0 tx=0x7f06e400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.314+0000 7f06db7fe640 1 -- 172.21.15.59:0/1907164623 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e400f450 con 0x7f06ec108020 2024-09-10T21:25:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.314+0000 7f06db7fe640 1 -- 172.21.15.59:0/1907164623 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06e400faa0 con 0x7f06ec108020 2024-09-10T21:25:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.314+0000 7f06f0a46640 1 -- 172.21.15.59:0/1907164623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ec1a1820 con 0x7f06ec108020 2024-09-10T21:25:07.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.314+0000 7f06db7fe640 1 -- 172.21.15.59:0/1907164623 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4018b70 con 0x7f06ec108020 2024-09-10T21:25:07.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.314+0000 7f06f0a46640 1 -- 172.21.15.59:0/1907164623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ec1a7ee0 con 0x7f06ec108020 2024-09-10T21:25:07.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.317+0000 7f06f2e1b740 1 Processor -- start 2024-09-10T21:25:07.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.317+0000 7f06db7fe640 1 -- 172.21.15.59:0/1907164623 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f06e400f5f0 con 0x7f06ec108020 2024-09-10T21:25:07.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.317+0000 7f06f2e1b740 1 -- start start 2024-09-10T21:25:07.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.317+0000 7f06f2e1b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722eaee0 0x5629722eb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:07.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.317+0000 7f06f2e1b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eb800 0x5629722f7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:07.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.317+0000 7f06f2e1b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722f7790 0x5629722f9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:07.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.317+0000 7f06f2e1b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562972261e60 con 0x5629722eaee0 2024-09-10T21:25:07.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.317+0000 7f06f2e1b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562972251290 con 0x5629722eb800 2024-09-10T21:25:07.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.317+0000 7f06f2e1b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5629722550a0 con 0x5629722f7790 2024-09-10T21:25:07.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.318+0000 7f06e9d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722eaee0 0x5629722eb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:07.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.318+0000 7f06e9d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722eaee0 0x5629722eb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45834/0 (socket says 172.21.15.59:45834) 2024-09-10T21:25:07.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.318+0000 7f06e9d9b640 1 -- 172.21.15.59:0/887906694 learned_addr learned my addr 172.21.15.59:0/887906694 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:07.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.318+0000 7f06ea59c640 1 --2- 172.21.15.59:0/887906694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eb800 0x5629722f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:07.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.318+0000 7f06e9d9b640 1 --2- 172.21.15.59:0/887906694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722f7790 0x5629722f9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:07.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.318+0000 7f06e9d9b640 1 -- 172.21.15.59:0/887906694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722f7790 msgr2=0x5629722f9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:07.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.318+0000 7f06e9d9b640 1 --2- 172.21.15.59:0/887906694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722f7790 0x5629722f9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.318+0000 7f06e9d9b640 1 -- 172.21.15.59:0/887906694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eb800 msgr2=0x5629722f7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:07.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.318+0000 7f06e9d9b640 1 --2- 172.21.15.59:0/887906694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eb800 0x5629722f7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.318+0000 7f06e9d9b640 1 -- 172.21.15.59:0/887906694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562971faf930 con 0x5629722eaee0 2024-09-10T21:25:07.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.318+0000 7f06db7fe640 1 --2- 172.21.15.59:0/1907164623 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f06d40b5360 0x7f06d40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:07.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.318+0000 7f06e9d9b640 1 --2- 172.21.15.59:0/887906694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722eaee0 0x5629722eb2c0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009900 tx=0x7f06e0009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f66c816ac30d04 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:07.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.318+0000 7f06ea59c640 1 --2- 172.21.15.59:0/1907164623 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f06d40b5360 0x7f06d40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:07.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.318+0000 7f06db7fe640 1 -- 172.21.15.59:0/1907164623 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f06e40e6290 con 0x7f06ec108020 2024-09-10T21:25:07.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.318+0000 7f06d8ff9640 1 -- 172.21.15.59:0/887906694 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0035070 con 0x5629722eaee0 2024-09-10T21:25:07.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.318+0000 7f06d8ff9640 1 -- 172.21.15.59:0/887906694 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06e0044070 con 0x5629722eaee0 2024-09-10T21:25:07.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.318+0000 7f06d8ff9640 1 -- 172.21.15.59:0/887906694 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0003d40 con 0x5629722eaee0 2024-09-10T21:25:07.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.319+0000 7f06f2e1b740 1 -- 172.21.15.59:0/887906694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722eaee0 msgr2=0x5629722eb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:07.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.319+0000 7f06ea59c640 1 --2- 172.21.15.59:0/1907164623 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f06d40b5360 0x7f06d40b7820 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x5629722ee060 tx=0x7f06dc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:07.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.319+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/887906694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722eaee0 0x5629722eb2c0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009900 tx=0x7f06e0009560 comp rx=0 tx=0).stop 2024-09-10T21:25:07.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.319+0000 7f06f2e1b740 1 -- 172.21.15.59:0/887906694 shutdown_connections 2024-09-10T21:25:07.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.319+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/887906694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722f7790 0x5629722f9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.319+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/887906694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eb800 0x5629722f7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.319+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/887906694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722eaee0 0x5629722eb2c0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.319+0000 7f06f2e1b740 1 -- 172.21.15.59:0/887906694 >> 172.21.15.59:0/887906694 conn(0x5629722e8d10 msgr2=0x5629722e9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:07.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.319+0000 7f06f2e1b740 1 -- 172.21.15.59:0/887906694 shutdown_connections 2024-09-10T21:25:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.319+0000 7f06f2e1b740 1 -- 172.21.15.59:0/887906694 wait complete. 2024-09-10T21:25:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.320+0000 7f06f2e1b740 1 -- start start 2024-09-10T21:25:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.320+0000 7f06f2e1b740 1 Processor -- start 2024-09-10T21:25:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.320+0000 7f06f2e1b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722eaee0 0x5629722f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.320+0000 7f06f2e1b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eb800 0x5629722f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.320+0000 7f06f2e1b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722f7790 0x5629722f5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.320+0000 7f06f2e1b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5629720b2890 con 0x5629722eaee0 2024-09-10T21:25:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.320+0000 7f06f2e1b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5629721ebd40 con 0x5629722eb800 2024-09-10T21:25:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.320+0000 7f06f2e1b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5629722fa3e0 con 0x5629722f7790 2024-09-10T21:25:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.320+0000 7f06f2e1b740 10 client.0 _ll_register_callbacks cb 0x56297224fc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.320+0000 7f06ea59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722eaee0 0x5629722f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.320+0000 7f06ea59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722eaee0 0x5629722f47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45848/0 (socket says 172.21.15.59:45848) 2024-09-10T21:25:07.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.320+0000 7f06ea59c640 1 -- 172.21.15.59:0/808780609 learned_addr learned my addr 172.21.15.59:0/808780609 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.320+0000 7f06e9d9b640 1 --2- 172.21.15.59:0/808780609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eb800 0x5629722f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.320+0000 7f06ead9d640 1 --2- 172.21.15.59:0/808780609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722f7790 0x5629722f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.320+0000 7f06ea59c640 1 -- 172.21.15.59:0/808780609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722f7790 msgr2=0x5629722f5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.320+0000 7f06ea59c640 1 --2- 172.21.15.59:0/808780609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722f7790 0x5629722f5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.320+0000 7f06ea59c640 1 -- 172.21.15.59:0/808780609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eb800 msgr2=0x5629722f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.320+0000 7f06ea59c640 1 --2- 172.21.15.59:0/808780609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eb800 0x5629722f4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.320+0000 7f06ea59c640 1 -- 172.21.15.59:0/808780609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562972303870 con 0x5629722eaee0 2024-09-10T21:25:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.321+0000 7f06ea59c640 1 --2- 172.21.15.59:0/808780609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722eaee0 0x5629722f47e0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f06dc004130 tx=0x7f06dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26af07bebf8f638b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.321+0000 7f06d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.321+0000 7f06d1ffb640 1 -- 172.21.15.59:0/808780609 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc02c060 con 0x5629722eaee0 2024-09-10T21:25:07.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.321+0000 7f06d1ffb640 1 -- 172.21.15.59:0/808780609 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f06dc017030 con 0x5629722eaee0 2024-09-10T21:25:07.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.321+0000 7f06f2e1b740 1 -- 172.21.15.59:0/808780609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06e0044070 con 0x5629722eaee0 2024-09-10T21:25:07.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.321+0000 7f06d1ffb640 1 -- 172.21.15.59:0/808780609 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f06dc027410 con 0x5629722eaee0 2024-09-10T21:25:07.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.321+0000 7f06f2e1b740 10 client.17814 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:07.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.321+0000 7f06f2e1b740 1 -- 172.21.15.59:0/808780609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562972306280 con 0x5629722eaee0 2024-09-10T21:25:07.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.321+0000 7f06d1ffb640 1 -- 172.21.15.59:0/808780609 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06e0044070 con 0x5629722eaee0 2024-09-10T21:25:07.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.321+0000 7f06d1ffb640 1 -- 172.21.15.59:0/808780609 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f06dc01c480 con 0x5629722eaee0 2024-09-10T21:25:07.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.321+0000 7f06f2e1b740 10 client.17814 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:07.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.321+0000 7f06f2e1b740 10 client.17814 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:25:07.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.321+0000 7f06f2e1b740 20 client.17814 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:07.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.322+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/808780609 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562972307740 0x562972309b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:07.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.322+0000 7f06f2e1b740 4 client.17814 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:25:07.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.322+0000 7f06f2e1b740 1 -- 172.21.15.59:0/808780609 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562972263db0 con 0x562972307740 2024-09-10T21:25:07.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.322+0000 7f06e9d9b640 1 --2- 172.21.15.59:0/808780609 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562972307740 0x562972309b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:07.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.322+0000 7f06d1ffb640 10 client.17814 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:07.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.322+0000 7f06e9d9b640 1 --2- 172.21.15.59:0/808780609 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562972307740 0x562972309b90 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6374e87392bffa26 server_cookie=27bb2df5c4a09584 in_seq=0 out_seq=0 2024-09-10T21:25:07.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.323+0000 7f06d1ffb640 1 -- 172.21.15.59:0/808780609 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562972263db0 con 0x562972307740 2024-09-10T21:25:07.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.323+0000 7f06d1ffb640 10 client.17814 handle_command_reply: tid=0 2024-09-10T21:25:07.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.323+0000 7f06f2e1b740 1 client.17814 shutdown 2024-09-10T21:25:07.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.323+0000 7f06f2e1b740 1 -- 172.21.15.59:0/808780609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722eaee0 msgr2=0x5629722f47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:07.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.323+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/808780609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722eaee0 0x5629722f47e0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f06dc004130 tx=0x7f06dc0046c0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.323+0000 7f06f2e1b740 1 -- 172.21.15.59:0/808780609 shutdown_connections 2024-09-10T21:25:07.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.323+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/808780609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722f7790 0x5629722f5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.323+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/808780609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eb800 0x5629722f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.323+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/808780609 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562972307740 0x562972309b90 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.323+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/808780609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722eaee0 0x5629722f47e0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.323+0000 7f06d1ffb640 0 client.17814 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:07.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.323+0000 7f06f2e1b740 1 -- 172.21.15.59:0/808780609 >> 172.21.15.59:0/808780609 conn(0x5629722e8d10 msgr2=0x5629722e7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:07.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.323+0000 7f06f2e1b740 1 -- 172.21.15.59:0/808780609 shutdown_connections 2024-09-10T21:25:07.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.323+0000 7f06f2e1b740 1 -- 172.21.15.59:0/808780609 wait complete. 2024-09-10T21:25:07.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.323+0000 7f06f2e1b740 20 client.17814 trim_cache size 0 max 16384 2024-09-10T21:25:07.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.341+0000 7f06f2e1b740 1 Processor -- start 2024-09-10T21:25:07.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.341+0000 7f06f2e1b740 1 -- start start 2024-09-10T21:25:07.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.341+0000 7f06f2e1b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eaee0 0x5629722ef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:07.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.341+0000 7f06f2e1b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722eb800 0x5629722f6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:07.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.341+0000 7f06f2e1b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722f7790 0x5629722f19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:07.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.341+0000 7f06f2e1b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec1b03a0 con 0x5629722f7790 2024-09-10T21:25:07.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.341+0000 7f06f2e1b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec1b1ee0 con 0x5629722eaee0 2024-09-10T21:25:07.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.341+0000 7f06f2e1b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec1b0a70 con 0x5629722eb800 2024-09-10T21:25:07.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.342+0000 7f06ead9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722f7790 0x5629722f19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:07.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.342+0000 7f06ead9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722f7790 0x5629722f19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45860/0 (socket says 172.21.15.59:45860) 2024-09-10T21:25:07.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.342+0000 7f06ead9d640 1 -- 172.21.15.59:0/150464911 learned_addr learned my addr 172.21.15.59:0/150464911 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:07.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.342+0000 7f06e9d9b640 1 --2- 172.21.15.59:0/150464911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722eb800 0x5629722f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:07.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.342+0000 7f06ea59c640 1 --2- 172.21.15.59:0/150464911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eaee0 0x5629722ef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:07.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.342+0000 7f06ead9d640 1 -- 172.21.15.59:0/150464911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722eb800 msgr2=0x5629722f6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:07.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.342+0000 7f06ead9d640 1 --2- 172.21.15.59:0/150464911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722eb800 0x5629722f6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.342+0000 7f06ead9d640 1 -- 172.21.15.59:0/150464911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eaee0 msgr2=0x5629722ef0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:07.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.342+0000 7f06ead9d640 1 --2- 172.21.15.59:0/150464911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eaee0 0x5629722ef0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.342+0000 7f06ead9d640 1 -- 172.21.15.59:0/150464911 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629722f3740 con 0x5629722f7790 2024-09-10T21:25:07.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.342+0000 7f06ead9d640 1 --2- 172.21.15.59:0/150464911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722f7790 0x5629722f19f0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f06e40aca10 tx=0x7f06e400af30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c87d79162957c21 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:07.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.342+0000 7f06d3fff640 1 -- 172.21.15.59:0/150464911 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e40ac590 con 0x5629722f7790 2024-09-10T21:25:07.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.342+0000 7f06d3fff640 1 -- 172.21.15.59:0/150464911 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06e40a8040 con 0x5629722f7790 2024-09-10T21:25:07.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.342+0000 7f06d3fff640 1 -- 172.21.15.59:0/150464911 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e40b6010 con 0x5629722f7790 2024-09-10T21:25:07.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.343+0000 7f06f2e1b740 1 -- 172.21.15.59:0/150464911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722f7790 msgr2=0x5629722f19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:07.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.343+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/150464911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722f7790 0x5629722f19f0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f06e40aca10 tx=0x7f06e400af30 comp rx=0 tx=0).stop 2024-09-10T21:25:07.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.343+0000 7f06f2e1b740 1 -- 172.21.15.59:0/150464911 shutdown_connections 2024-09-10T21:25:07.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.343+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/150464911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722f7790 0x5629722f19f0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.343+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/150464911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722eb800 0x5629722f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.343+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/150464911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eaee0 0x5629722ef0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.343+0000 7f06f2e1b740 1 -- 172.21.15.59:0/150464911 >> 172.21.15.59:0/150464911 conn(0x5629722e8d10 msgr2=0x5629722f5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:07.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.343+0000 7f06f2e1b740 1 -- 172.21.15.59:0/150464911 shutdown_connections 2024-09-10T21:25:07.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.343+0000 7f06f2e1b740 1 -- 172.21.15.59:0/150464911 wait complete. 2024-09-10T21:25:07.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.343+0000 7f06f2e1b740 1 -- start start 2024-09-10T21:25:07.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.343+0000 7f06f2e1b740 1 Processor -- start 2024-09-10T21:25:07.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06f2e1b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722eaee0 0x5629722fbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:07.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06f2e1b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eb800 0x5629722fc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:07.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06f2e1b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722f7790 0x56297236d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:07.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06f2e1b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec1b1810 con 0x5629722f7790 2024-09-10T21:25:07.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06f2e1b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec1b1140 con 0x5629722eb800 2024-09-10T21:25:07.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06f2e1b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec1ae380 con 0x5629722eaee0 2024-09-10T21:25:07.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06f2e1b740 10 client.0 _ll_register_callbacks cb 0x7f06dc004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:07.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06ead9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722f7790 0x56297236d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:07.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06ea59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722eaee0 0x5629722fbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:07.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06ead9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722f7790 0x56297236d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45862/0 (socket says 172.21.15.59:45862) 2024-09-10T21:25:07.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06ead9d640 1 -- 172.21.15.59:0/1359927392 learned_addr learned my addr 172.21.15.59:0/1359927392 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:07.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06e9d9b640 1 --2- 172.21.15.59:0/1359927392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eb800 0x5629722fc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:07.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06ea59c640 1 -- 172.21.15.59:0/1359927392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eb800 msgr2=0x5629722fc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:07.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06ea59c640 1 --2- 172.21.15.59:0/1359927392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eb800 0x5629722fc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06ea59c640 1 -- 172.21.15.59:0/1359927392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722f7790 msgr2=0x56297236d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:07.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06ea59c640 1 --2- 172.21.15.59:0/1359927392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722f7790 0x56297236d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06ea59c640 1 -- 172.21.15.59:0/1359927392 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56297236ddb0 con 0x5629722eaee0 2024-09-10T21:25:07.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06ead9d640 1 --2- 172.21.15.59:0/1359927392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722f7790 0x56297236d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:25:07.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06ea59c640 1 --2- 172.21.15.59:0/1359927392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722eaee0 0x5629722fbf90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f06dc000c00 tx=0x7f06dc01c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee4c7c9985e25771 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:07.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.344+0000 7f06d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-10T21:25:07.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.345+0000 7f06d1ffb640 1 -- 172.21.15.59:0/1359927392 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc037030 con 0x5629722eaee0 2024-09-10T21:25:07.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.345+0000 7f06f2e1b740 1 -- 172.21.15.59:0/1359927392 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06e40a8040 con 0x5629722eaee0 2024-09-10T21:25:07.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.345+0000 7f06d1ffb640 1 -- 172.21.15.59:0/1359927392 <== mon.1 v2:172.21.15.192:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f06dc005250 con 0x5629722eaee0 2024-09-10T21:25:07.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.345+0000 7f06d1ffb640 1 -- 172.21.15.59:0/1359927392 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f06dc02c020 con 0x5629722eaee0 2024-09-10T21:25:07.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.345+0000 7f06f2e1b740 10 client.26878 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:07.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.345+0000 7f06f2e1b740 1 -- 172.21.15.59:0/1359927392 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5629723751f0 con 0x5629722eaee0 2024-09-10T21:25:07.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.345+0000 7f06d1ffb640 1 -- 172.21.15.59:0/1359927392 <== mon.1 v2:172.21.15.192:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06e40a8040 con 0x5629722eaee0 2024-09-10T21:25:07.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.345+0000 7f06d1ffb640 1 -- 172.21.15.59:0/1359927392 <== mon.1 v2:172.21.15.192:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f06dc0275b0 con 0x5629722eaee0 2024-09-10T21:25:07.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.345+0000 7f06f2e1b740 10 client.26878 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:07.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.345+0000 7f06f2e1b740 10 client.26878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:25:07.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.345+0000 7f06f2e1b740 20 client.26878 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:07.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.345+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/1359927392 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562972375990 0x562972377db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:07.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.345+0000 7f06f2e1b740 4 client.26878 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:25:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.345+0000 7f06f2e1b740 1 -- 172.21.15.59:0/1359927392 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56297225f860 con 0x562972375990 2024-09-10T21:25:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.346+0000 7f06e9d9b640 1 --2- 172.21.15.59:0/1359927392 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562972375990 0x562972377db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.346+0000 7f06e9d9b640 1 --2- 172.21.15.59:0/1359927392 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562972375990 0x562972377db0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91c8b9cc5b1bbbb2 server_cookie=d9c679a783a350ca in_seq=0 out_seq=0 2024-09-10T21:25:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.346+0000 7f06d1ffb640 10 client.26878 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.348+0000 7f06d1ffb640 1 -- 172.21.15.59:0/1359927392 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56297225f860 con 0x562972375990 2024-09-10T21:25:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.348+0000 7f06d1ffb640 10 client.26878 handle_command_reply: tid=0 2024-09-10T21:25:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.348+0000 7f06f2e1b740 1 client.26878 shutdown 2024-09-10T21:25:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.348+0000 7f06f2e1b740 1 -- 172.21.15.59:0/1359927392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722eaee0 msgr2=0x5629722fbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.348+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/1359927392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722eaee0 0x5629722fbf90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f06dc000c00 tx=0x7f06dc01c6a0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.348+0000 7f06f2e1b740 1 -- 172.21.15.59:0/1359927392 shutdown_connections 2024-09-10T21:25:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.348+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/1359927392 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562972375990 0x562972377db0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.348+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/1359927392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5629722f7790 0x56297236d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.348+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/1359927392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5629722eb800 0x5629722fc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.348+0000 7f06d1ffb640 0 client.26878 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:07.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.348+0000 7f06f2e1b740 1 --2- 172.21.15.59:0/1359927392 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5629722eaee0 0x5629722fbf90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.348+0000 7f06f2e1b740 1 -- 172.21.15.59:0/1359927392 >> 172.21.15.59:0/1359927392 conn(0x5629722e8d10 msgr2=0x5629722e7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:07.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.348+0000 7f06f2e1b740 1 -- 172.21.15.59:0/1359927392 shutdown_connections 2024-09-10T21:25:07.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.348+0000 7f06f2e1b740 1 -- 172.21.15.59:0/1359927392 wait complete. 2024-09-10T21:25:07.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.349+0000 7f06f2e1b740 20 client.26878 trim_cache size 0 max 16384 2024-09-10T21:25:07.360 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:25:07.360 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:25:07.360 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "5e9056fa-94a3-4be5-a66c-5033a946ad88", 2024-09-10T21:25:07.361 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:25:07.361 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:25:07.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.349+0000 7f06f0a46640 1 -- 172.21.15.59:0/1907164623 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f06d40b5360 msgr2=0x7f06d40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:07.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.349+0000 7f06f0a46640 1 --2- 172.21.15.59:0/1907164623 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f06d40b5360 0x7f06d40b7820 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x5629722ee060 tx=0x7f06dc00b390 comp rx=0 tx=0).stop 2024-09-10T21:25:07.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.349+0000 7f06f0a46640 1 -- 172.21.15.59:0/1907164623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06ec108020 msgr2=0x7f06ec1a0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:07.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.349+0000 7f06f0a46640 1 --2- 172.21.15.59:0/1907164623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06ec108020 0x7f06ec1a0d60 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f06e400cce0 tx=0x7f06e400a620 comp rx=0 tx=0).stop 2024-09-10T21:25:07.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.349+0000 7f06f0a46640 1 -- 172.21.15.59:0/1907164623 shutdown_connections 2024-09-10T21:25:07.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.349+0000 7f06f0a46640 1 --2- 172.21.15.59:0/1907164623 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f06d40b5360 0x7f06d40b7820 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.349+0000 7f06f0a46640 1 --2- 172.21.15.59:0/1907164623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06ec108020 0x7f06ec1a0d60 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.349+0000 7f06f0a46640 1 --2- 172.21.15.59:0/1907164623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06ec1076a0 0x7f06ec19b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.349+0000 7f06f0a46640 1 --2- 172.21.15.59:0/1907164623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06ec101c90 0x7f06ec19b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:07.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.349+0000 7f06f0a46640 1 -- 172.21.15.59:0/1907164623 >> 172.21.15.59:0/1907164623 conn(0x7f06ec0fd700 msgr2=0x7f06ec104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:07.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.349+0000 7f06f0a46640 1 -- 172.21.15.59:0/1907164623 shutdown_connections 2024-09-10T21:25:07.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:07.349+0000 7f06f0a46640 1 -- 172.21.15.59:0/1907164623 wait complete. 2024-09-10T21:25:07.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:07 smithi154 ceph-mon[35041]: pgmap v635: 97 pgs: 97 active+clean; 6.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-10T21:25:07.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:07 smithi192 ceph-mon[35363]: pgmap v635: 97 pgs: 97 active+clean; 6.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 13 op/s 2024-09-10T21:25:08.232 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:08 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:25:08.232 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:08 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:25:08.232 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:08 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:25:08.232 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:08 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:25:08.233 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:25:08.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:08 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:25:08.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:08 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:25:08.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:08 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:25:08.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:08 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:25:08.493 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:25:08.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:08 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:25:08.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:08 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:25:08.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:08 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:25:08.577 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:08 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:25:09.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.046+0000 7fdbc3940640 1 -- 172.21.15.59:0/952148276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbbc1087d0 msgr2=0x7fdbbc108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:09.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.046+0000 7fdbc3940640 1 --2- 172.21.15.59:0/952148276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbbc1087d0 0x7fdbbc108c10 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fdbac009900 tx=0x7fdbac02a410 comp rx=0 tx=0).stop 2024-09-10T21:25:09.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.046+0000 7fdbc3940640 1 -- 172.21.15.59:0/952148276 shutdown_connections 2024-09-10T21:25:09.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.046+0000 7fdbc3940640 1 --2- 172.21.15.59:0/952148276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbbc109150 0x7fdbbc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.046+0000 7fdbc3940640 1 --2- 172.21.15.59:0/952148276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbbc1087d0 0x7fdbbc108c10 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.046+0000 7fdbc3940640 1 --2- 172.21.15.59:0/952148276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc102dc0 0x7fdbbc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.046+0000 7fdbc3940640 1 -- 172.21.15.59:0/952148276 >> 172.21.15.59:0/952148276 conn(0x7fdbbc0fe830 msgr2=0x7fdbbc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:09.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.046+0000 7fdbc3940640 1 -- 172.21.15.59:0/952148276 shutdown_connections 2024-09-10T21:25:09.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.046+0000 7fdbc3940640 1 -- 172.21.15.59:0/952148276 wait complete. 2024-09-10T21:25:09.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.046+0000 7fdbc3940640 1 Processor -- start 2024-09-10T21:25:09.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.047+0000 7fdbc3940640 1 -- start start 2024-09-10T21:25:09.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.047+0000 7fdbc3940640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbbc102dc0 0x7fdbbc199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:09.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.047+0000 7fdbc3940640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbbc1087d0 0x7fdbbc199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:09.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.047+0000 7fdbc3940640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc109150 0x7fdbbc19ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:09.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.047+0000 7fdbc3940640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc112e50 con 0x7fdbbc102dc0 2024-09-10T21:25:09.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.047+0000 7fdbc3940640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc112cd0 con 0x7fdbbc109150 2024-09-10T21:25:09.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.047+0000 7fdbc3940640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc112fd0 con 0x7fdbbc1087d0 2024-09-10T21:25:09.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.047+0000 7fdbc16dc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbbc102dc0 0x7fdbbc199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:09.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.047+0000 7fdbc16dc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbbc102dc0 0x7fdbbc199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45874/0 (socket says 172.21.15.59:45874) 2024-09-10T21:25:09.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.047+0000 7fdbc16dc640 1 -- 172.21.15.59:0/614074923 learned_addr learned my addr 172.21.15.59:0/614074923 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:09.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.047+0000 7fdbc1edd640 1 --2- 172.21.15.59:0/614074923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc109150 0x7fdbbc19ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:09.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.047+0000 7fdbc0edb640 1 --2- 172.21.15.59:0/614074923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbbc1087d0 0x7fdbbc199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:09.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.047+0000 7fdbc16dc640 1 -- 172.21.15.59:0/614074923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbbc1087d0 msgr2=0x7fdbbc199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:09.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.047+0000 7fdbc16dc640 1 --2- 172.21.15.59:0/614074923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbbc1087d0 0x7fdbbc199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.047+0000 7fdbc16dc640 1 -- 172.21.15.59:0/614074923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc109150 msgr2=0x7fdbbc19ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.047+0000 7fdbc16dc640 1 --2- 172.21.15.59:0/614074923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc109150 0x7fdbbc19ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.047+0000 7fdbc16dc640 1 -- 172.21.15.59:0/614074923 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbbc19f4f0 con 0x7fdbbc102dc0 2024-09-10T21:25:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.047+0000 7fdbc1edd640 1 --2- 172.21.15.59:0/614074923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc109150 0x7fdbbc19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:25:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.047+0000 7fdbc16dc640 1 --2- 172.21.15.59:0/614074923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbbc102dc0 0x7fdbbc199440 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800ba50 tx=0x7fdbb800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.048+0000 7fdbb27fc640 1 -- 172.21.15.59:0/614074923 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8019070 con 0x7fdbbc102dc0 2024-09-10T21:25:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.048+0000 7fdbb27fc640 1 -- 172.21.15.59:0/614074923 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbb800cbe0 con 0x7fdbbc102dc0 2024-09-10T21:25:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.048+0000 7fdbc3940640 1 -- 172.21.15.59:0/614074923 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbbc19f7e0 con 0x7fdbbc102dc0 2024-09-10T21:25:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.048+0000 7fdbb27fc640 1 -- 172.21.15.59:0/614074923 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb80075d0 con 0x7fdbbc102dc0 2024-09-10T21:25:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.048+0000 7fdbc3940640 1 -- 172.21.15.59:0/614074923 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbbc1a5f20 con 0x7fdbbc102dc0 2024-09-10T21:25:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.050+0000 7fdbc5d15740 1 Processor -- start 2024-09-10T21:25:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.050+0000 7fdbc5d15740 1 -- start start 2024-09-10T21:25:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbb27fc640 1 -- 172.21.15.59:0/614074923 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fdbb8007830 con 0x7fdbbc102dc0 2024-09-10T21:25:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbc5d15740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c2f0a0 0x55e028c2f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbc5d15740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c2f9c0 0x55e028c3b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbc5d15740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c3b950 0x55e028c3dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbc5d15740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e028ba5e50 con 0x55e028c3b950 2024-09-10T21:25:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbc5d15740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e028b95280 con 0x55e028c2f9c0 2024-09-10T21:25:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbc5d15740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55e028b99090 con 0x55e028c2f0a0 2024-09-10T21:25:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbc0edb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c3b950 0x55e028c3dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbc0edb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c3b950 0x55e028c3dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45882/0 (socket says 172.21.15.59:45882) 2024-09-10T21:25:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbc0edb640 1 -- 172.21.15.59:0/1387174887 learned_addr learned my addr 172.21.15.59:0/1387174887 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbc16dc640 1 --2- 172.21.15.59:0/1387174887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c2f9c0 0x55e028c3b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbc1edd640 1 --2- 172.21.15.59:0/1387174887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c2f0a0 0x55e028c2f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbc0edb640 1 -- 172.21.15.59:0/1387174887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c2f0a0 msgr2=0x55e028c2f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbc0edb640 1 --2- 172.21.15.59:0/1387174887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c2f0a0 0x55e028c2f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbc0edb640 1 -- 172.21.15.59:0/1387174887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c2f9c0 msgr2=0x55e028c3b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:09.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbc0edb640 1 --2- 172.21.15.59:0/1387174887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c2f9c0 0x55e028c3b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbc0edb640 1 -- 172.21.15.59:0/1387174887 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0288f3650 con 0x55e028c3b950 2024-09-10T21:25:09.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbc1edd640 1 --2- 172.21.15.59:0/1387174887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c2f0a0 0x55e028c2f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:25:09.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbc0edb640 1 --2- 172.21.15.59:0/1387174887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c3b950 0x55e028c3dd40 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fdbac02a930 tx=0x7fdbac031cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a12829c42319c33 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:09.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.051+0000 7fdbb27fc640 1 --2- 172.21.15.59:0/614074923 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdba80b52e0 0x7fdba80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:09.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.052+0000 7fdbc1edd640 1 --2- 172.21.15.59:0/614074923 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdba80b52e0 0x7fdba80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:09.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.052+0000 7fdba77fe640 1 -- 172.21.15.59:0/1387174887 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbac03f070 con 0x55e028c3b950 2024-09-10T21:25:09.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.052+0000 7fdbb27fc640 1 -- 172.21.15.59:0/614074923 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdbb80e5400 con 0x7fdbbc102dc0 2024-09-10T21:25:09.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.052+0000 7fdba77fe640 1 -- 172.21.15.59:0/1387174887 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbac0316a0 con 0x55e028c3b950 2024-09-10T21:25:09.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.052+0000 7fdba77fe640 1 -- 172.21.15.59:0/1387174887 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbac035070 con 0x55e028c3b950 2024-09-10T21:25:09.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.052+0000 7fdbc5d15740 1 -- 172.21.15.59:0/1387174887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c3b950 msgr2=0x55e028c3dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:09.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.052+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/1387174887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c3b950 0x55e028c3dd40 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fdbac02a930 tx=0x7fdbac031cd0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.052+0000 7fdbc1edd640 1 --2- 172.21.15.59:0/614074923 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdba80b52e0 0x7fdba80b77a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400ba10 tx=0x7fdbb4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:09.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.052+0000 7fdbc5d15740 1 -- 172.21.15.59:0/1387174887 shutdown_connections 2024-09-10T21:25:09.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.052+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/1387174887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c3b950 0x55e028c3dd40 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.052+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/1387174887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c2f9c0 0x55e028c3b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.052+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/1387174887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c2f0a0 0x55e028c2f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.052+0000 7fdbc5d15740 1 -- 172.21.15.59:0/1387174887 >> 172.21.15.59:0/1387174887 conn(0x55e028c2ced0 msgr2=0x55e028c2e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:09.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.052+0000 7fdbc5d15740 1 -- 172.21.15.59:0/1387174887 shutdown_connections 2024-09-10T21:25:09.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.052+0000 7fdbc5d15740 1 -- 172.21.15.59:0/1387174887 wait complete. 2024-09-10T21:25:09.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.053+0000 7fdbc5d15740 1 -- start start 2024-09-10T21:25:09.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.053+0000 7fdbc5d15740 1 Processor -- start 2024-09-10T21:25:09.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.053+0000 7fdbc5d15740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f0a0 0x55e028c3b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:09.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.053+0000 7fdbc5d15740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c2f9c0 0x55e028c38650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:09.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.053+0000 7fdbc5d15740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c3b950 0x55e028c38c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.053+0000 7fdbc5d15740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e0289f6700 con 0x55e028c2f0a0 2024-09-10T21:25:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.053+0000 7fdbc5d15740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e028b30110 con 0x55e028c2f9c0 2024-09-10T21:25:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.053+0000 7fdbc5d15740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55e028c3e570 con 0x55e028c3b950 2024-09-10T21:25:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.053+0000 7fdbc5d15740 10 client.0 _ll_register_callbacks cb 0x55e028b49990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.053+0000 7fdbc16dc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f0a0 0x55e028c3b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.053+0000 7fdbc16dc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f0a0 0x55e028c3b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45890/0 (socket says 172.21.15.59:45890) 2024-09-10T21:25:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.053+0000 7fdbc16dc640 1 -- 172.21.15.59:0/2503274119 learned_addr learned my addr 172.21.15.59:0/2503274119 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.054+0000 7fdbc0edb640 1 --2- 172.21.15.59:0/2503274119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c2f9c0 0x55e028c38650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.054+0000 7fdbc1edd640 1 --2- 172.21.15.59:0/2503274119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c3b950 0x55e028c38c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.054+0000 7fdbc16dc640 1 -- 172.21.15.59:0/2503274119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c3b950 msgr2=0x55e028c38c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.054+0000 7fdbc16dc640 1 --2- 172.21.15.59:0/2503274119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c3b950 0x55e028c38c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.054+0000 7fdbc16dc640 1 -- 172.21.15.59:0/2503274119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c2f9c0 msgr2=0x55e028c38650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.054+0000 7fdbc16dc640 1 --2- 172.21.15.59:0/2503274119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c2f9c0 0x55e028c38650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.054+0000 7fdbc16dc640 1 -- 172.21.15.59:0/2503274119 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e028b5dc40 con 0x55e028c2f0a0 2024-09-10T21:25:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.054+0000 7fdbc0edb640 1 --2- 172.21.15.59:0/2503274119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c2f9c0 0x55e028c38650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:25:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.054+0000 7fdbc16dc640 1 --2- 172.21.15.59:0/2503274119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f0a0 0x55e028c3b200 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fdbb80a8e60 tx=0x7fdbb80a8300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6df7b9938fe2af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.054+0000 7fdba4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.054+0000 7fdba4ff9640 1 -- 172.21.15.59:0/2503274119 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb80ab540 con 0x55e028c2f0a0 2024-09-10T21:25:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.054+0000 7fdba4ff9640 1 -- 172.21.15.59:0/2503274119 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdbb80b4cf0 con 0x55e028c2f0a0 2024-09-10T21:25:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.054+0000 7fdbc5d15740 1 -- 172.21.15.59:0/2503274119 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbac0316a0 con 0x55e028c2f0a0 2024-09-10T21:25:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.054+0000 7fdba4ff9640 1 -- 172.21.15.59:0/2503274119 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdbb80a7360 con 0x55e028c2f0a0 2024-09-10T21:25:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.054+0000 7fdbc5d15740 10 client.17832 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.054+0000 7fdbc5d15740 1 -- 172.21.15.59:0/2503274119 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e028c49f40 con 0x55e028c2f0a0 2024-09-10T21:25:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.054+0000 7fdba4ff9640 1 -- 172.21.15.59:0/2503274119 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbac0316a0 con 0x55e028c2f0a0 2024-09-10T21:25:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.055+0000 7fdba4ff9640 1 -- 172.21.15.59:0/2503274119 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdbb80a7040 con 0x55e028c2f0a0 2024-09-10T21:25:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.055+0000 7fdbc5d15740 10 client.17832 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.055+0000 7fdbc5d15740 10 client.17832 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:25:09.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.055+0000 7fdbc5d15740 20 client.17832 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:09.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.055+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/2503274119 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e028c4b400 0x55e028c4d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:09.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.055+0000 7fdbc5d15740 4 client.17832 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:25:09.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.055+0000 7fdbc5d15740 1 -- 172.21.15.59:0/2503274119 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e028ba7da0 con 0x55e028c4b400 2024-09-10T21:25:09.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.055+0000 7fdbc0edb640 1 --2- 172.21.15.59:0/2503274119 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e028c4b400 0x55e028c4d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:09.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.055+0000 7fdbc0edb640 1 --2- 172.21.15.59:0/2503274119 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e028c4b400 0x55e028c4d7f0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45599a0b65bb75e9 server_cookie=41d9e44e88d17456 in_seq=0 out_seq=0 2024-09-10T21:25:09.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.055+0000 7fdba4ff9640 10 client.17832 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:09.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.056+0000 7fdba4ff9640 1 -- 172.21.15.59:0/2503274119 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e028ba7da0 con 0x55e028c4b400 2024-09-10T21:25:09.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.056+0000 7fdba4ff9640 10 client.17832 handle_command_reply: tid=0 2024-09-10T21:25:09.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.056+0000 7fdbc5d15740 1 client.17832 shutdown 2024-09-10T21:25:09.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.056+0000 7fdbc5d15740 1 -- 172.21.15.59:0/2503274119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f0a0 msgr2=0x55e028c3b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:09.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.056+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/2503274119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f0a0 0x55e028c3b200 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fdbb80a8e60 tx=0x7fdbb80a8300 comp rx=0 tx=0).stop 2024-09-10T21:25:09.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.056+0000 7fdbc5d15740 1 -- 172.21.15.59:0/2503274119 shutdown_connections 2024-09-10T21:25:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.056+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/2503274119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c3b950 0x55e028c38c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.056+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/2503274119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c2f9c0 0x55e028c38650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.056+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/2503274119 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e028c4b400 0x55e028c4d7f0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.056+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/2503274119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f0a0 0x55e028c3b200 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.056+0000 7fdba4ff9640 0 client.17832 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.056+0000 7fdbc5d15740 1 -- 172.21.15.59:0/2503274119 >> 172.21.15.59:0/2503274119 conn(0x55e028c2ced0 msgr2=0x55e028c32a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.056+0000 7fdbc5d15740 1 -- 172.21.15.59:0/2503274119 shutdown_connections 2024-09-10T21:25:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.057+0000 7fdbc5d15740 1 -- 172.21.15.59:0/2503274119 wait complete. 2024-09-10T21:25:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.057+0000 7fdbc5d15740 20 client.17832 trim_cache size 0 max 16384 2024-09-10T21:25:09.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.074+0000 7fdbc5d15740 1 Processor -- start 2024-09-10T21:25:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.074+0000 7fdbc5d15740 1 -- start start 2024-09-10T21:25:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.074+0000 7fdbc5d15740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c2f0a0 0x55e028c477d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.074+0000 7fdbc5d15740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f9c0 0x55e028c43c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.074+0000 7fdbc5d15740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c3b950 0x55e028c44150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.074+0000 7fdbc5d15740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1ae350 con 0x55e028c2f9c0 2024-09-10T21:25:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.074+0000 7fdbc5d15740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1afe90 con 0x55e028c2f0a0 2024-09-10T21:25:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.074+0000 7fdbc5d15740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1aea20 con 0x55e028c3b950 2024-09-10T21:25:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.074+0000 7fdbc0edb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f9c0 0x55e028c43c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.074+0000 7fdbc0edb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f9c0 0x55e028c43c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45902/0 (socket says 172.21.15.59:45902) 2024-09-10T21:25:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.074+0000 7fdbc0edb640 1 -- 172.21.15.59:0/1078770444 learned_addr learned my addr 172.21.15.59:0/1078770444 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.075+0000 7fdbc1edd640 1 --2- 172.21.15.59:0/1078770444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c3b950 0x55e028c44150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.075+0000 7fdbc16dc640 1 --2- 172.21.15.59:0/1078770444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c2f0a0 0x55e028c477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.075+0000 7fdbc0edb640 1 -- 172.21.15.59:0/1078770444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c3b950 msgr2=0x55e028c44150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.075+0000 7fdbc0edb640 1 --2- 172.21.15.59:0/1078770444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c3b950 0x55e028c44150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.075+0000 7fdbc0edb640 1 -- 172.21.15.59:0/1078770444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c2f0a0 msgr2=0x55e028c477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.075+0000 7fdbc0edb640 1 --2- 172.21.15.59:0/1078770444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c2f0a0 0x55e028c477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.075+0000 7fdbc0edb640 1 -- 172.21.15.59:0/1078770444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e028c4de20 con 0x55e028c2f9c0 2024-09-10T21:25:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.075+0000 7fdbc0edb640 1 --2- 172.21.15.59:0/1078770444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f9c0 0x55e028c43c10 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fdbac009900 tx=0x7fdbac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1006991e0242eec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.075+0000 7fdba6ffd640 1 -- 172.21.15.59:0/1078770444 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbac03f040 con 0x55e028c2f9c0 2024-09-10T21:25:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.075+0000 7fdba6ffd640 1 -- 172.21.15.59:0/1078770444 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbac005400 con 0x55e028c2f9c0 2024-09-10T21:25:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.075+0000 7fdba6ffd640 1 -- 172.21.15.59:0/1078770444 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbac035040 con 0x55e028c2f9c0 2024-09-10T21:25:09.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.076+0000 7fdbc5d15740 1 -- 172.21.15.59:0/1078770444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f9c0 msgr2=0x55e028c43c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:09.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.076+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/1078770444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f9c0 0x55e028c43c10 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fdbac009900 tx=0x7fdbac000bc0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.076+0000 7fdbc5d15740 1 -- 172.21.15.59:0/1078770444 shutdown_connections 2024-09-10T21:25:09.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.076+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/1078770444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c3b950 0x55e028c44150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.076+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/1078770444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f9c0 0x55e028c43c10 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.076+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/1078770444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c2f0a0 0x55e028c477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.076+0000 7fdbc5d15740 1 -- 172.21.15.59:0/1078770444 >> 172.21.15.59:0/1078770444 conn(0x55e028c2ced0 msgr2=0x55e028c2df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:09.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.076+0000 7fdbc5d15740 1 -- 172.21.15.59:0/1078770444 shutdown_connections 2024-09-10T21:25:09.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.076+0000 7fdbc5d15740 1 -- 172.21.15.59:0/1078770444 wait complete. 2024-09-10T21:25:09.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.076+0000 7fdbc5d15740 1 -- start start 2024-09-10T21:25:09.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.076+0000 7fdbc5d15740 1 Processor -- start 2024-09-10T21:25:09.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdbc5d15740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f0a0 0x55e028c52060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:09.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdbc5d15740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c2f9c0 0x55e028c525a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:09.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdbc5d15740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c3b950 0x55e028c52ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:09.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdbc5d15740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1af7c0 con 0x55e028c2f0a0 2024-09-10T21:25:09.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdbc5d15740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1af0f0 con 0x55e028c3b950 2024-09-10T21:25:09.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdbc5d15740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1ac330 con 0x55e028c2f9c0 2024-09-10T21:25:09.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdbc5d15740 10 client.0 _ll_register_callbacks cb 0x7fdbb8009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:09.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdbc16dc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f0a0 0x55e028c52060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:09.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdbc16dc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f0a0 0x55e028c52060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45914/0 (socket says 172.21.15.59:45914) 2024-09-10T21:25:09.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdbc16dc640 1 -- 172.21.15.59:0/1291583659 learned_addr learned my addr 172.21.15.59:0/1291583659 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:09.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdbc0edb640 1 --2- 172.21.15.59:0/1291583659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c2f9c0 0x55e028c525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:09.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdbc1edd640 1 --2- 172.21.15.59:0/1291583659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c3b950 0x55e028c52ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:09.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdbc16dc640 1 -- 172.21.15.59:0/1291583659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c2f9c0 msgr2=0x55e028c525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:09.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdbc16dc640 1 --2- 172.21.15.59:0/1291583659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c2f9c0 0x55e028c525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdbc16dc640 1 -- 172.21.15.59:0/1291583659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c3b950 msgr2=0x55e028c52ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:09.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdbc16dc640 1 --2- 172.21.15.59:0/1291583659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c3b950 0x55e028c52ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdbc16dc640 1 -- 172.21.15.59:0/1291583659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e028c53220 con 0x55e028c2f0a0 2024-09-10T21:25:09.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdbc1edd640 1 --2- 172.21.15.59:0/1291583659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c3b950 0x55e028c52ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:25:09.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdbc16dc640 1 --2- 172.21.15.59:0/1291583659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f0a0 0x55e028c52060 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fdbb80b5320 tx=0x7fdbb80e5340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd6034f2f9018b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:09.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdba4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:09.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.077+0000 7fdba4ff9640 1 -- 172.21.15.59:0/1291583659 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb80e8e60 con 0x55e028c2f0a0 2024-09-10T21:25:09.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.078+0000 7fdba4ff9640 1 -- 172.21.15.59:0/1291583659 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fdbb80b0220 con 0x55e028c2f0a0 2024-09-10T21:25:09.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.078+0000 7fdbc5d15740 1 -- 172.21.15.59:0/1291583659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbac005400 con 0x55e028c2f0a0 2024-09-10T21:25:09.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.078+0000 7fdba4ff9640 1 -- 172.21.15.59:0/1291583659 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdbb80ab360 con 0x55e028c2f0a0 2024-09-10T21:25:09.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.078+0000 7fdbc5d15740 10 client.17838 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:09.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.078+0000 7fdbc5d15740 1 -- 172.21.15.59:0/1291583659 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e028cbc7f0 con 0x55e028c2f0a0 2024-09-10T21:25:09.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.078+0000 7fdba4ff9640 1 -- 172.21.15.59:0/1291583659 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbac005400 con 0x55e028c2f0a0 2024-09-10T21:25:09.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.078+0000 7fdba4ff9640 1 -- 172.21.15.59:0/1291583659 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fdbb80a7040 con 0x55e028c2f0a0 2024-09-10T21:25:09.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.078+0000 7fdbc5d15740 10 client.17838 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:09.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.078+0000 7fdbc5d15740 10 client.17838 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:25:09.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.078+0000 7fdbc5d15740 20 client.17838 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:09.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.078+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/1291583659 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e028cbcf70 0x55e028cbf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:09.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.078+0000 7fdbc5d15740 4 client.17838 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:25:09.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.078+0000 7fdbc5d15740 1 -- 172.21.15.59:0/1291583659 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e028ba3850 con 0x55e028cbcf70 2024-09-10T21:25:09.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.079+0000 7fdbc0edb640 1 --2- 172.21.15.59:0/1291583659 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e028cbcf70 0x55e028cbf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:09.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.079+0000 7fdba4ff9640 10 client.17838 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:09.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.079+0000 7fdbc0edb640 1 --2- 172.21.15.59:0/1291583659 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e028cbcf70 0x55e028cbf390 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4179aac82fbb0df server_cookie=e6607e95f8b166b in_seq=0 out_seq=0 2024-09-10T21:25:09.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.079+0000 7fdba4ff9640 1 -- 172.21.15.59:0/1291583659 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5398 (crc 0 0 0) 0x55e028ba3850 con 0x55e028cbcf70 2024-09-10T21:25:09.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.079+0000 7fdba4ff9640 10 client.17838 handle_command_reply: tid=0 2024-09-10T21:25:09.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.079+0000 7fdbc5d15740 1 client.17838 shutdown 2024-09-10T21:25:09.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.079+0000 7fdbc5d15740 1 -- 172.21.15.59:0/1291583659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f0a0 msgr2=0x55e028c52060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:09.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.079+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/1291583659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f0a0 0x55e028c52060 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fdbb80b5320 tx=0x7fdbb80e5340 comp rx=0 tx=0).stop 2024-09-10T21:25:09.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.079+0000 7fdbc5d15740 1 -- 172.21.15.59:0/1291583659 shutdown_connections 2024-09-10T21:25:09.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.079+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/1291583659 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e028c3b950 0x55e028c52ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.079+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/1291583659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55e028c2f9c0 0x55e028c525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.079+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/1291583659 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55e028cbcf70 0x55e028cbf390 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.079+0000 7fdbc5d15740 1 --2- 172.21.15.59:0/1291583659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e028c2f0a0 0x55e028c52060 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.079+0000 7fdbc5d15740 1 -- 172.21.15.59:0/1291583659 >> 172.21.15.59:0/1291583659 conn(0x55e028c2ced0 msgr2=0x55e028c39c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:09.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.080+0000 7fdba4ff9640 0 client.17838 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:09.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.080+0000 7fdbc5d15740 1 -- 172.21.15.59:0/1291583659 shutdown_connections 2024-09-10T21:25:09.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.080+0000 7fdbc5d15740 1 -- 172.21.15.59:0/1291583659 wait complete. 2024-09-10T21:25:09.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.080+0000 7fdbc5d15740 20 client.17838 trim_cache size 0 max 16384 2024-09-10T21:25:09.088 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:25:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:25:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-09-10T21:25:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "5e9056fa-94a3-4be5-a66c-5033a946ad88": { 2024-09-10T21:25:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "5e9056fa-94a3-4be5-a66c-5033a946ad88", 2024-09-10T21:25:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2024-09-10T21:25:09.088 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:25:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:25:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "5e9056fa-94a3-4be5-a66c-5033a946ad88": { 2024-09-10T21:25:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:25:07.346164+0000", 2024-09-10T21:25:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "3ac3cde1-bbc5-4c68-9fc6-bc3e3022aea8": { 2024-09-10T21:25:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:24:53.320547+0000", 2024-09-10T21:25:09.089 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:09.090 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:09.090 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:09.090 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:09.090 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:09.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:09.090 INFO:teuthology.orchestra.run.smithi059.stdout: "0fb476f2-3572-4daf-8d42-5cf40259db46": { 2024-09-10T21:25:09.090 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:53.136187+0000", 2024-09-10T21:25:09.090 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:09.090 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:09.090 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:09.090 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:09.090 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:09.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:09.090 INFO:teuthology.orchestra.run.smithi059.stdout: "cb01ac69-57ce-4c62-b57a-054abf74df29": { 2024-09-10T21:25:09.091 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:07.589420+0000", 2024-09-10T21:25:09.091 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:09.091 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:09.091 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:09.091 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:09.091 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:09.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:09.091 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:25:09.091 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:25:09.091 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:09.091 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:09.091 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:09.091 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:09.091 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:09.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:09.092 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:25:09.092 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:25:09.092 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:09.092 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:09.092 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:09.092 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:09.092 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:09.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:09.092 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:25:09.092 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:07.066301+0000", 2024-09-10T21:25:09.092 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:09.092 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:09.093 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:09.093 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:09.093 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:09.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:09.093 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:25:09.093 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:25:09.093 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:09.093 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:09.093 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:09.093 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:09.093 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:09.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:09.093 INFO:teuthology.orchestra.run.smithi059.stdout: "7de1e6cf-02c2-41f2-b957-563f88bae8ef": { 2024-09-10T21:25:09.094 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:22:22.098651+0000", 2024-09-10T21:25:09.094 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:09.094 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:09.094 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:09.094 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:09.094 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:09.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:09.094 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:25:09.094 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:25:09.094 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:09.094 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:09.094 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:09.094 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:09.094 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:09.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:09.095 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:25:09.095 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:25:09.095 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:09.095 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:09.095 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:09.095 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:09.095 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:09.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:09.095 INFO:teuthology.orchestra.run.smithi059.stdout: "ec2c29bb-febd-4190-959f-09af3764b7ad": { 2024-09-10T21:25:09.095 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:24:07.378801+0000", 2024-09-10T21:25:09.095 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:09.095 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:09.095 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:09.096 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:09.096 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:09.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:09.096 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:25:09.096 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:25:09.096 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:09.096 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:09.096 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:09.096 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:09.096 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:09.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:09.096 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:25:09.096 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:25:09.096 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:09.097 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:09.097 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:09.097 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:09.097 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:09.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:09.097 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:25:09.097 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:25:09.097 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:09.097 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:09.097 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:09.097 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:09.097 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:09.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:09.097 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:25:09.098 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:25:09.098 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:09.098 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:09.098 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:09.098 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:09.098 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:09.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:09.098 INFO:teuthology.orchestra.run.smithi059.stdout: "800cdb00-6a99-4c42-8a9e-4b1c599c6af0": { 2024-09-10T21:25:09.098 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:52.224081+0000", 2024-09-10T21:25:09.098 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:09.098 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:09.099 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:09.099 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:09.099 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:09.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:09.099 INFO:teuthology.orchestra.run.smithi059.stdout: "d82f24b1-930e-4f83-a379-3084f22918d0": { 2024-09-10T21:25:09.099 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:21:37.203865+0000", 2024-09-10T21:25:09.099 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:09.099 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:09.099 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:09.099 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:09.099 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:09.099 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:25:09.099 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:25:09.099 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:25:09.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.080+0000 7fdbc3940640 1 -- 172.21.15.59:0/614074923 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdba80b52e0 msgr2=0x7fdba80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:09.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.080+0000 7fdbc3940640 1 --2- 172.21.15.59:0/614074923 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdba80b52e0 0x7fdba80b77a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400ba10 tx=0x7fdbb4008040 comp rx=0 tx=0).stop 2024-09-10T21:25:09.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.080+0000 7fdbc3940640 1 -- 172.21.15.59:0/614074923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbbc102dc0 msgr2=0x7fdbbc199440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.080+0000 7fdbc3940640 1 --2- 172.21.15.59:0/614074923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbbc102dc0 0x7fdbbc199440 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800ba50 tx=0x7fdbb800bf10 comp rx=0 tx=0).stop 2024-09-10T21:25:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.081+0000 7fdbc3940640 1 -- 172.21.15.59:0/614074923 shutdown_connections 2024-09-10T21:25:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.081+0000 7fdbc3940640 1 --2- 172.21.15.59:0/614074923 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fdba80b52e0 0x7fdba80b77a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.081+0000 7fdbc3940640 1 --2- 172.21.15.59:0/614074923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbbc109150 0x7fdbbc19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.081+0000 7fdbc3940640 1 --2- 172.21.15.59:0/614074923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbbc1087d0 0x7fdbbc199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.081+0000 7fdbc3940640 1 --2- 172.21.15.59:0/614074923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbbc102dc0 0x7fdbbc199440 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.081+0000 7fdbc3940640 1 -- 172.21.15.59:0/614074923 >> 172.21.15.59:0/614074923 conn(0x7fdbbc0fe830 msgr2=0x7fdbbc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.081+0000 7fdbc3940640 1 -- 172.21.15.59:0/614074923 shutdown_connections 2024-09-10T21:25:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:09.081+0000 7fdbc3940640 1 -- 172.21.15.59:0/614074923 wait complete. 2024-09-10T21:25:09.384 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:09 smithi059 ceph-mon[30888]: pgmap v636: 97 pgs: 97 active+clean; 6.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:25:09.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:09 smithi154 ceph-mon[35041]: pgmap v636: 97 pgs: 97 active+clean; 6.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:25:09.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:09 smithi192 ceph-mon[35363]: pgmap v636: 97 pgs: 97 active+clean; 6.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-10T21:25:09.919 INFO:tasks.cephfs.filesystem:scrub status for tag:5e9056fa-94a3-4be5-a66c-5033a946ad88 - {'path': '/', 'tag': '5e9056fa-94a3-4be5-a66c-5033a946ad88', 'options': 'recursive,force'} 2024-09-10T21:25:10.159 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:10 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:25:10.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:10 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:25:10.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:10 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:25:11.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:11 smithi059 ceph-mon[30888]: pgmap v637: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:25:11.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:11 smithi154 ceph-mon[35041]: pgmap v637: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:25:11.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:11 smithi192 ceph-mon[35363]: pgmap v637: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:25:13.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:13 smithi059 ceph-mon[30888]: pgmap v638: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-10T21:25:13.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:13 smithi154 ceph-mon[35041]: pgmap v638: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-10T21:25:13.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:13 smithi192 ceph-mon[35363]: pgmap v638: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-10T21:25:15.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:15 smithi059 ceph-mon[30888]: pgmap v639: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:25:15.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:15 smithi154 ceph-mon[35041]: pgmap v639: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:25:15.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:15 smithi192 ceph-mon[35363]: pgmap v639: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:25:17.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:17 smithi059 ceph-mon[30888]: pgmap v640: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:25:17.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:17 smithi154 ceph-mon[35041]: pgmap v640: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:25:17.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:17 smithi192 ceph-mon[35363]: pgmap v640: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:25:19.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:19 smithi059 ceph-mon[30888]: pgmap v641: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:25:19.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:19 smithi154 ceph-mon[35041]: pgmap v641: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:25:19.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:19 smithi192 ceph-mon[35363]: pgmap v641: 97 pgs: 97 active+clean; 6.8 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:25:21.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:21 smithi059 ceph-mon[30888]: pgmap v642: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:25:21.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:21 smithi154 ceph-mon[35041]: pgmap v642: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:25:21.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:21 smithi192 ceph-mon[35363]: pgmap v642: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:25:23.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:23 smithi059 ceph-mon[30888]: pgmap v643: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:25:23.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:23 smithi154 ceph-mon[35041]: pgmap v643: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:25:23.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:23 smithi192 ceph-mon[35363]: pgmap v643: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:25:25.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:25 smithi059 ceph-mon[30888]: pgmap v644: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:25:25.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:25 smithi154 ceph-mon[35041]: pgmap v644: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:25:25.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:25 smithi192 ceph-mon[35363]: pgmap v644: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:25:27.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:27 smithi059 ceph-mon[30888]: pgmap v645: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:25:27.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:27 smithi154 ceph-mon[35041]: pgmap v645: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:25:27.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:27 smithi192 ceph-mon[35363]: pgmap v645: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:25:29.378 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:29 smithi192 ceph-mon[35363]: pgmap v646: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:25:29.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:29 smithi059 ceph-mon[30888]: pgmap v646: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:25:29.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:29 smithi154 ceph-mon[35041]: pgmap v646: 97 pgs: 97 active+clean; 6.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:25:31.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:31 smithi059 ceph-mon[30888]: pgmap v647: 97 pgs: 97 active+clean; 7.0 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:25:31.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:31 smithi154 ceph-mon[35041]: pgmap v647: 97 pgs: 97 active+clean; 7.0 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:25:31.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:31 smithi192 ceph-mon[35363]: pgmap v647: 97 pgs: 97 active+clean; 7.0 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:25:33.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:33 smithi192 ceph-mon[35363]: pgmap v648: 97 pgs: 97 active+clean; 7.0 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:25:33.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:33 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:25:33.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:33 smithi059 ceph-mon[30888]: pgmap v648: 97 pgs: 97 active+clean; 7.0 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:25:33.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:33 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:25:33.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:33 smithi154 ceph-mon[35041]: pgmap v648: 97 pgs: 97 active+clean; 7.0 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:25:33.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:33 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:25:35.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:34 smithi192 ceph-mon[35363]: pgmap v649: 97 pgs: 97 active+clean; 7.1 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:25:35.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.076 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:25:35.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:25:35.077 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:34 smithi059 ceph-mon[30888]: pgmap v649: 97 pgs: 97 active+clean; 7.1 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:25:35.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:25:35.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:25:35.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:34 smithi154 ceph-mon[35041]: pgmap v649: 97 pgs: 97 active+clean; 7.1 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:25:35.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:35.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:25:35.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:25:35.182 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:25:37.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:36 smithi059 ceph-mon[30888]: pgmap v650: 97 pgs: 97 active+clean; 7.1 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:25:37.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:36 smithi154 ceph-mon[35041]: pgmap v650: 97 pgs: 97 active+clean; 7.1 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:25:37.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:36 smithi192 ceph-mon[35363]: pgmap v650: 97 pgs: 97 active+clean; 7.1 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:25:39.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:38 smithi059 ceph-mon[30888]: pgmap v651: 97 pgs: 97 active+clean; 7.1 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:25:39.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:38 smithi154 ceph-mon[35041]: pgmap v651: 97 pgs: 97 active+clean; 7.1 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:25:39.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:38 smithi192 ceph-mon[35363]: pgmap v651: 97 pgs: 97 active+clean; 7.1 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:25:39.836 INFO:tasks.workunit.client.0.smithi059.stdout:499/600: open fd = 3 2024-09-10T21:25:39.836 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.836 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.836 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.836 INFO:tasks.workunit.client.0.smithi059.stdout:500/600: open fd = 3 2024-09-10T21:25:39.836 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.837 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.837 INFO:tasks.workunit.client.0.smithi059.stdout:501/600: open fd = 3 2024-09-10T21:25:39.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.837 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.837 INFO:tasks.workunit.client.0.smithi059.stdout:502/600: open fd = 3 2024-09-10T21:25:39.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.837 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.837 INFO:tasks.workunit.client.0.smithi059.stdout:503/600: open fd = 3 2024-09-10T21:25:39.837 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.838 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.838 INFO:tasks.workunit.client.0.smithi059.stdout:504/600: open fd = 3 2024-09-10T21:25:39.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.838 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.838 INFO:tasks.workunit.client.0.smithi059.stdout:505/600: open fd = 3 2024-09-10T21:25:39.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.838 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.838 INFO:tasks.workunit.client.0.smithi059.stdout:506/600: open fd = 3 2024-09-10T21:25:39.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.838 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.838 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.839 INFO:tasks.workunit.client.0.smithi059.stdout:507/600: open fd = 3 2024-09-10T21:25:39.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.839 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.839 INFO:tasks.workunit.client.0.smithi059.stdout:508/600: open fd = 3 2024-09-10T21:25:39.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.839 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.839 INFO:tasks.workunit.client.0.smithi059.stdout:509/600: open fd = 3 2024-09-10T21:25:39.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.839 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.839 INFO:tasks.workunit.client.0.smithi059.stdout:510/600: open fd = 3 2024-09-10T21:25:39.839 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.840 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.840 INFO:tasks.workunit.client.0.smithi059.stdout:511/600: open fd = 3 2024-09-10T21:25:39.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.840 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.840 INFO:tasks.workunit.client.0.smithi059.stdout:512/600: open fd = 3 2024-09-10T21:25:39.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.840 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.840 INFO:tasks.workunit.client.0.smithi059.stdout:513/600: open fd = 3 2024-09-10T21:25:39.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.840 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.840 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.840 INFO:tasks.workunit.client.0.smithi059.stdout:514/600: open fd = 3 2024-09-10T21:25:39.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.841 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.841 INFO:tasks.workunit.client.0.smithi059.stdout:515/600: open fd = 3 2024-09-10T21:25:39.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.841 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.841 INFO:tasks.workunit.client.0.smithi059.stdout:516/600: open fd = 3 2024-09-10T21:25:39.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.841 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.841 INFO:tasks.workunit.client.0.smithi059.stdout:517/600: open fd = 3 2024-09-10T21:25:39.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.841 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.841 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.842 INFO:tasks.workunit.client.0.smithi059.stdout:518/600: open fd = 3 2024-09-10T21:25:39.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.842 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.842 INFO:tasks.workunit.client.0.smithi059.stdout:519/600: open fd = 3 2024-09-10T21:25:39.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.842 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.842 INFO:tasks.workunit.client.0.smithi059.stdout:520/600: open fd = 3 2024-09-10T21:25:39.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.842 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.842 INFO:tasks.workunit.client.0.smithi059.stdout:521/600: open fd = 3 2024-09-10T21:25:39.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.842 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.843 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.843 INFO:tasks.workunit.client.0.smithi059.stdout:522/600: open fd = 3 2024-09-10T21:25:39.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.843 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.843 INFO:tasks.workunit.client.0.smithi059.stdout:523/600: open fd = 3 2024-09-10T21:25:39.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.843 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.843 INFO:tasks.workunit.client.0.smithi059.stdout:524/600: open fd = 3 2024-09-10T21:25:39.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.843 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.843 INFO:tasks.workunit.client.0.smithi059.stdout:525/600: open fd = 3 2024-09-10T21:25:39.843 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.844 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.844 INFO:tasks.workunit.client.0.smithi059.stdout:526/600: open fd = 3 2024-09-10T21:25:39.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.844 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.844 INFO:tasks.workunit.client.0.smithi059.stdout:527/600: open fd = 3 2024-09-10T21:25:39.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.844 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.844 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.845 INFO:tasks.workunit.client.0.smithi059.stdout:528/600: open fd = 3 2024-09-10T21:25:39.845 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.845 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.845 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.845 INFO:tasks.workunit.client.0.smithi059.stdout:529/600: open fd = 3 2024-09-10T21:25:39.845 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.845 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.845 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.845 INFO:tasks.workunit.client.0.smithi059.stdout:530/600: open fd = 3 2024-09-10T21:25:39.845 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.845 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.846 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.846 INFO:tasks.workunit.client.0.smithi059.stdout:531/600: open fd = 3 2024-09-10T21:25:39.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.846 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.846 INFO:tasks.workunit.client.0.smithi059.stdout:532/600: open fd = 3 2024-09-10T21:25:39.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.846 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.846 INFO:tasks.workunit.client.0.smithi059.stdout:533/600: open fd = 3 2024-09-10T21:25:39.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.846 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.846 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.846 INFO:tasks.workunit.client.0.smithi059.stdout:534/600: open fd = 3 2024-09-10T21:25:39.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.847 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.847 INFO:tasks.workunit.client.0.smithi059.stdout:535/600: open fd = 3 2024-09-10T21:25:39.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.847 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.847 INFO:tasks.workunit.client.0.smithi059.stdout:536/600: open fd = 3 2024-09-10T21:25:39.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.847 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.847 INFO:tasks.workunit.client.0.smithi059.stdout:537/600: open fd = 3 2024-09-10T21:25:39.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.847 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.847 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.848 INFO:tasks.workunit.client.0.smithi059.stdout:538/600: open fd = 3 2024-09-10T21:25:39.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.848 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.848 INFO:tasks.workunit.client.0.smithi059.stdout:539/600: open fd = 3 2024-09-10T21:25:39.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.848 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.848 INFO:tasks.workunit.client.0.smithi059.stdout:540/600: open fd = 3 2024-09-10T21:25:39.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.848 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.848 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.848 INFO:tasks.workunit.client.0.smithi059.stdout:541/600: open fd = 3 2024-09-10T21:25:39.849 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.849 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.849 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.849 INFO:tasks.workunit.client.0.smithi059.stdout:542/600: open fd = 3 2024-09-10T21:25:39.849 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.849 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.849 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.849 INFO:tasks.workunit.client.0.smithi059.stdout:543/600: open fd = 3 2024-09-10T21:25:39.849 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.849 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.849 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.849 INFO:tasks.workunit.client.0.smithi059.stdout:544/600: open fd = 3 2024-09-10T21:25:39.849 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.849 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.849 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.850 INFO:tasks.workunit.client.0.smithi059.stdout:545/600: open fd = 3 2024-09-10T21:25:39.850 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.850 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.850 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.850 INFO:tasks.workunit.client.0.smithi059.stdout:546/600: open fd = 3 2024-09-10T21:25:39.850 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.850 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.850 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.850 INFO:tasks.workunit.client.0.smithi059.stdout:547/600: open fd = 3 2024-09-10T21:25:39.850 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.850 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.850 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.850 INFO:tasks.workunit.client.0.smithi059.stdout:548/600: open fd = 3 2024-09-10T21:25:39.850 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.851 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.851 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.851 INFO:tasks.workunit.client.0.smithi059.stdout:549/600: open fd = 3 2024-09-10T21:25:39.851 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.851 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.851 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.851 INFO:tasks.workunit.client.0.smithi059.stdout:550/600: open fd = 3 2024-09-10T21:25:39.851 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.851 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.851 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.851 INFO:tasks.workunit.client.0.smithi059.stdout:551/600: open fd = 3 2024-09-10T21:25:39.851 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.851 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.851 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.852 INFO:tasks.workunit.client.0.smithi059.stdout:552/600: open fd = 3 2024-09-10T21:25:39.852 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.852 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.852 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.852 INFO:tasks.workunit.client.0.smithi059.stdout:553/600: open fd = 3 2024-09-10T21:25:39.852 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.852 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.852 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.852 INFO:tasks.workunit.client.0.smithi059.stdout:554/600: open fd = 3 2024-09-10T21:25:39.852 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.852 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.852 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.852 INFO:tasks.workunit.client.0.smithi059.stdout:555/600: open fd = 3 2024-09-10T21:25:39.853 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.853 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.853 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.853 INFO:tasks.workunit.client.0.smithi059.stdout:556/600: open fd = 3 2024-09-10T21:25:39.853 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.853 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.853 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.853 INFO:tasks.workunit.client.0.smithi059.stdout:557/600: open fd = 3 2024-09-10T21:25:39.853 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.853 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.853 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.854 INFO:tasks.workunit.client.0.smithi059.stdout:558/600: open fd = 3 2024-09-10T21:25:39.854 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.854 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.854 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.854 INFO:tasks.workunit.client.0.smithi059.stdout:559/600: open fd = 3 2024-09-10T21:25:39.854 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.854 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.854 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.854 INFO:tasks.workunit.client.0.smithi059.stdout:560/600: open fd = 3 2024-09-10T21:25:39.854 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.854 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:25:39.854 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:25:39.920 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:25:40.196 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:25:40.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.669+0000 7f9acb6b3640 1 -- 172.21.15.59:0/532441915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ac4103ca0 msgr2=0x7f9ac4104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:40.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.669+0000 7f9acb6b3640 1 --2- 172.21.15.59:0/532441915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ac4103ca0 0x7f9ac4104080 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009900 tx=0x7f9ac002a410 comp rx=0 tx=0).stop 2024-09-10T21:25:40.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.669+0000 7f9acb6b3640 1 -- 172.21.15.59:0/532441915 shutdown_connections 2024-09-10T21:25:40.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.669+0000 7f9acb6b3640 1 --2- 172.21.15.59:0/532441915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac410d100 0x7f9ac410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.669+0000 7f9acb6b3640 1 --2- 172.21.15.59:0/532441915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ac41045c0 0x7f9ac410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.669+0000 7f9acb6b3640 1 --2- 172.21.15.59:0/532441915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ac4103ca0 0x7f9ac4104080 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.669+0000 7f9acb6b3640 1 -- 172.21.15.59:0/532441915 >> 172.21.15.59:0/532441915 conn(0x7f9ac40fd700 msgr2=0x7f9ac40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:40.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.669+0000 7f9acb6b3640 1 -- 172.21.15.59:0/532441915 shutdown_connections 2024-09-10T21:25:40.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.669+0000 7f9acb6b3640 1 -- 172.21.15.59:0/532441915 wait complete. 2024-09-10T21:25:40.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.670+0000 7f9acb6b3640 1 Processor -- start 2024-09-10T21:25:40.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.670+0000 7f9acb6b3640 1 -- start start 2024-09-10T21:25:40.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.670+0000 7f9acb6b3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac4103ca0 0x7f9ac4101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:40.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.670+0000 7f9acb6b3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ac41045c0 0x7f9ac4101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:40.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.670+0000 7f9acb6b3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ac410d100 0x7f9ac41023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:40.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.670+0000 7f9acb6b3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac4112e00 con 0x7f9ac41045c0 2024-09-10T21:25:40.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.670+0000 7f9acb6b3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac4112c80 con 0x7f9ac410d100 2024-09-10T21:25:40.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.670+0000 7f9acb6b3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac4112f80 con 0x7f9ac4103ca0 2024-09-10T21:25:40.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.670+0000 7f9ac8c4e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ac41045c0 0x7f9ac4101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.670+0000 7f9ac8c4e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ac41045c0 0x7f9ac4101e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34442/0 (socket says 172.21.15.59:34442) 2024-09-10T21:25:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.670+0000 7f9ac8c4e640 1 -- 172.21.15.59:0/4247959260 learned_addr learned my addr 172.21.15.59:0/4247959260 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.670+0000 7f9ac9c50640 1 --2- 172.21.15.59:0/4247959260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ac410d100 0x7f9ac41023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.670+0000 7f9ac944f640 1 --2- 172.21.15.59:0/4247959260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac4103ca0 0x7f9ac4101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.670+0000 7f9ac8c4e640 1 -- 172.21.15.59:0/4247959260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac4103ca0 msgr2=0x7f9ac4101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.670+0000 7f9ac8c4e640 1 --2- 172.21.15.59:0/4247959260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac4103ca0 0x7f9ac4101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.670+0000 7f9ac8c4e640 1 -- 172.21.15.59:0/4247959260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ac410d100 msgr2=0x7f9ac41023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.670+0000 7f9ac8c4e640 1 --2- 172.21.15.59:0/4247959260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ac410d100 0x7f9ac41023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.670+0000 7f9ac8c4e640 1 -- 172.21.15.59:0/4247959260 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac41a7710 con 0x7f9ac41045c0 2024-09-10T21:25:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.670+0000 7f9ac944f640 1 --2- 172.21.15.59:0/4247959260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac4103ca0 0x7f9ac4101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:25:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.671+0000 7f9ac8c4e640 1 --2- 172.21.15.59:0/4247959260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ac41045c0 0x7f9ac4101e90 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400d750 tx=0x7f9ab400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.671+0000 7f9aba7fc640 1 -- 172.21.15.59:0/4247959260 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4017070 con 0x7f9ac41045c0 2024-09-10T21:25:40.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.671+0000 7f9aba7fc640 1 -- 172.21.15.59:0/4247959260 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ab4004020 con 0x7f9ac41045c0 2024-09-10T21:25:40.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.671+0000 7f9acb6b3640 1 -- 172.21.15.59:0/4247959260 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac41a7a00 con 0x7f9ac41045c0 2024-09-10T21:25:40.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.671+0000 7f9aba7fc640 1 -- 172.21.15.59:0/4247959260 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4003c00 con 0x7f9ac41045c0 2024-09-10T21:25:40.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.671+0000 7f9acb6b3640 1 -- 172.21.15.59:0/4247959260 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac41a7fc0 con 0x7f9ac41045c0 2024-09-10T21:25:40.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9aba7fc640 1 -- 172.21.15.59:0/4247959260 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f9ab4009a30 con 0x7f9ac41045c0 2024-09-10T21:25:40.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9acda88740 1 Processor -- start 2024-09-10T21:25:40.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9acda88740 1 -- start start 2024-09-10T21:25:40.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9acda88740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951480 0x560758951860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:40.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9acda88740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951da0 0x56075895d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:40.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9acda88740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075895dd30 0x560758960120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:40.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9acda88740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5607588c7e50 con 0x560758951480 2024-09-10T21:25:40.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9acda88740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5607588b7280 con 0x560758951da0 2024-09-10T21:25:40.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9acda88740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5607588bb090 con 0x56075895dd30 2024-09-10T21:25:40.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9ac9c50640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951480 0x560758951860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:40.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9ac9c50640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951480 0x560758951860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34450/0 (socket says 172.21.15.59:34450) 2024-09-10T21:25:40.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9ac9c50640 1 -- 172.21.15.59:0/2205275052 learned_addr learned my addr 172.21.15.59:0/2205275052 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:40.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9ac944f640 1 --2- 172.21.15.59:0/2205275052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951da0 0x56075895d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:40.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9ac8c4e640 1 --2- 172.21.15.59:0/2205275052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075895dd30 0x560758960120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:40.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9ac9c50640 1 -- 172.21.15.59:0/2205275052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075895dd30 msgr2=0x560758960120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:40.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9ac9c50640 1 --2- 172.21.15.59:0/2205275052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075895dd30 0x560758960120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9ac9c50640 1 -- 172.21.15.59:0/2205275052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951da0 msgr2=0x56075895d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:40.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9ac9c50640 1 --2- 172.21.15.59:0/2205275052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951da0 0x56075895d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9ac9c50640 1 -- 172.21.15.59:0/2205275052 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560758615650 con 0x560758951480 2024-09-10T21:25:40.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9ac944f640 1 --2- 172.21.15.59:0/2205275052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951da0 0x56075895d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:25:40.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.674+0000 7f9ac8c4e640 1 --2- 172.21.15.59:0/2205275052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075895dd30 0x560758960120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:40.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.675+0000 7f9aba7fc640 1 --2- 172.21.15.59:0/4247959260 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9ab00b52e0 0x7f9ab00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:40.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.675+0000 7f9ac9c50640 1 --2- 172.21.15.59:0/2205275052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951480 0x560758951860 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00a400 tx=0x7f9abc009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bada36532ce33b7e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:40.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.675+0000 7f9ac944f640 1 --2- 172.21.15.59:0/4247959260 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9ab00b52e0 0x7f9ab00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:40.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.675+0000 7f9aba7fc640 1 -- 172.21.15.59:0/4247959260 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9ab40e5480 con 0x7f9ac41045c0 2024-09-10T21:25:40.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.675+0000 7f9aaf7fe640 1 -- 172.21.15.59:0/2205275052 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc013790 con 0x560758951480 2024-09-10T21:25:40.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.675+0000 7f9aaf7fe640 1 -- 172.21.15.59:0/2205275052 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9abc019070 con 0x560758951480 2024-09-10T21:25:40.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.675+0000 7f9aaf7fe640 1 -- 172.21.15.59:0/2205275052 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc014d00 con 0x560758951480 2024-09-10T21:25:40.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.676+0000 7f9acda88740 1 -- 172.21.15.59:0/2205275052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951480 msgr2=0x560758951860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:40.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.676+0000 7f9acda88740 1 --2- 172.21.15.59:0/2205275052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951480 0x560758951860 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f9abc00a400 tx=0x7f9abc009650 comp rx=0 tx=0).stop 2024-09-10T21:25:40.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.676+0000 7f9ac944f640 1 --2- 172.21.15.59:0/4247959260 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9ab00b52e0 0x7f9ab00b77a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0000c00 tx=0x7f9ac00040d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:40.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.676+0000 7f9acda88740 1 -- 172.21.15.59:0/2205275052 shutdown_connections 2024-09-10T21:25:40.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.676+0000 7f9acda88740 1 --2- 172.21.15.59:0/2205275052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075895dd30 0x560758960120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.676+0000 7f9acda88740 1 --2- 172.21.15.59:0/2205275052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951da0 0x56075895d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.676+0000 7f9acda88740 1 --2- 172.21.15.59:0/2205275052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951480 0x560758951860 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.676+0000 7f9acda88740 1 -- 172.21.15.59:0/2205275052 >> 172.21.15.59:0/2205275052 conn(0x56075894f2b0 msgr2=0x560758950450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:40.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.676+0000 7f9acda88740 1 -- 172.21.15.59:0/2205275052 shutdown_connections 2024-09-10T21:25:40.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.676+0000 7f9acda88740 1 -- 172.21.15.59:0/2205275052 wait complete. 2024-09-10T21:25:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.676+0000 7f9acda88740 1 -- start start 2024-09-10T21:25:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.676+0000 7f9acda88740 1 Processor -- start 2024-09-10T21:25:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.677+0000 7f9acda88740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951480 0x56075895d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.677+0000 7f9acda88740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560758951da0 0x56075895aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.677+0000 7f9acda88740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56075895dd30 0x56075895b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.677+0000 7f9acda88740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560758718700 con 0x56075895dd30 2024-09-10T21:25:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.677+0000 7f9acda88740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560758852110 con 0x560758951480 2024-09-10T21:25:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.677+0000 7f9acda88740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5607589609b0 con 0x560758951da0 2024-09-10T21:25:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.677+0000 7f9acda88740 10 client.0 _ll_register_callbacks cb 0x56075886b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.677+0000 7f9ac9c50640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56075895dd30 0x56075895b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.677+0000 7f9ac9c50640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56075895dd30 0x56075895b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34462/0 (socket says 172.21.15.59:34462) 2024-09-10T21:25:40.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.677+0000 7f9ac9c50640 1 -- 172.21.15.59:0/3568037050 learned_addr learned my addr 172.21.15.59:0/3568037050 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:40.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.677+0000 7f9ac8c4e640 1 --2- 172.21.15.59:0/3568037050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560758951da0 0x56075895aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:40.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.677+0000 7f9ac944f640 1 --2- 172.21.15.59:0/3568037050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951480 0x56075895d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:40.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.677+0000 7f9ac9c50640 1 -- 172.21.15.59:0/3568037050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560758951da0 msgr2=0x56075895aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:40.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.677+0000 7f9ac9c50640 1 --2- 172.21.15.59:0/3568037050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560758951da0 0x56075895aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.677+0000 7f9ac9c50640 1 -- 172.21.15.59:0/3568037050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951480 msgr2=0x56075895d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:40.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.677+0000 7f9ac9c50640 1 --2- 172.21.15.59:0/3568037050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951480 0x56075895d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.677+0000 7f9ac9c50640 1 -- 172.21.15.59:0/3568037050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56075887fc40 con 0x56075895dd30 2024-09-10T21:25:40.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.677+0000 7f9ac8c4e640 1 --2- 172.21.15.59:0/3568037050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560758951da0 0x56075895aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:40.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.678+0000 7f9ac9c50640 1 --2- 172.21.15.59:0/3568037050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56075895dd30 0x56075895b0c0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0149a0 tx=0x7f9abc014710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb7b4d2f8a5a17f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:40.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.678+0000 7f9aacff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:40.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.678+0000 7f9aacff9640 1 -- 172.21.15.59:0/3568037050 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc013590 con 0x56075895dd30 2024-09-10T21:25:40.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.678+0000 7f9aacff9640 1 -- 172.21.15.59:0/3568037050 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9abc013730 con 0x56075895dd30 2024-09-10T21:25:40.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.678+0000 7f9acda88740 1 -- 172.21.15.59:0/3568037050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9abc019070 con 0x56075895dd30 2024-09-10T21:25:40.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.678+0000 7f9aacff9640 1 -- 172.21.15.59:0/3568037050 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9abc02e070 con 0x56075895dd30 2024-09-10T21:25:40.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.678+0000 7f9acda88740 10 client.17850 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:40.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.678+0000 7f9acda88740 1 -- 172.21.15.59:0/3568037050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56075896c2b0 con 0x56075895dd30 2024-09-10T21:25:40.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.678+0000 7f9aacff9640 1 -- 172.21.15.59:0/3568037050 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9abc019070 con 0x56075895dd30 2024-09-10T21:25:40.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.678+0000 7f9aacff9640 1 -- 172.21.15.59:0/3568037050 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9abc027a10 con 0x56075895dd30 2024-09-10T21:25:40.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.678+0000 7f9acda88740 10 client.17850 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:40.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.678+0000 7f9acda88740 10 client.17850 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:25:40.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.679+0000 7f9acda88740 20 client.17850 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:40.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.679+0000 7f9acda88740 1 --2- 172.21.15.59:0/3568037050 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56075896d710 0x56075896fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:40.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.679+0000 7f9acda88740 4 client.17850 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:25:40.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.679+0000 7f9acda88740 1 -- 172.21.15.59:0/3568037050 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607588c9da0 con 0x56075896d710 2024-09-10T21:25:40.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.679+0000 7f9ac944f640 1 --2- 172.21.15.59:0/3568037050 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56075896d710 0x56075896fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:40.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.679+0000 7f9ac944f640 1 --2- 172.21.15.59:0/3568037050 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56075896d710 0x56075896fb00 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b62b3f76c9fd0573 server_cookie=f4f51c92bc7d48e5 in_seq=0 out_seq=0 2024-09-10T21:25:40.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.679+0000 7f9aacff9640 10 client.17850 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:40.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.680+0000 7f9aacff9640 1 -- 172.21.15.59:0/3568037050 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5607588c9da0 con 0x56075896d710 2024-09-10T21:25:40.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.680+0000 7f9aacff9640 10 client.17850 handle_command_reply: tid=0 2024-09-10T21:25:40.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.680+0000 7f9acda88740 1 client.17850 shutdown 2024-09-10T21:25:40.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.680+0000 7f9acda88740 1 -- 172.21.15.59:0/3568037050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56075895dd30 msgr2=0x56075895b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:40.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.680+0000 7f9acda88740 1 --2- 172.21.15.59:0/3568037050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56075895dd30 0x56075895b0c0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0149a0 tx=0x7f9abc014710 comp rx=0 tx=0).stop 2024-09-10T21:25:40.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.680+0000 7f9acda88740 1 -- 172.21.15.59:0/3568037050 shutdown_connections 2024-09-10T21:25:40.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.680+0000 7f9acda88740 1 --2- 172.21.15.59:0/3568037050 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x56075896d710 0x56075896fb00 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.680+0000 7f9acda88740 1 --2- 172.21.15.59:0/3568037050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56075895dd30 0x56075895b0c0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.680+0000 7f9acda88740 1 --2- 172.21.15.59:0/3568037050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560758951da0 0x56075895aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.680+0000 7f9acda88740 1 --2- 172.21.15.59:0/3568037050 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951480 0x56075895d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.680+0000 7f9acda88740 1 -- 172.21.15.59:0/3568037050 >> 172.21.15.59:0/3568037050 conn(0x56075894f2b0 msgr2=0x560758954e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:40.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.680+0000 7f9aacff9640 0 client.17850 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:40.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.680+0000 7f9acda88740 1 -- 172.21.15.59:0/3568037050 shutdown_connections 2024-09-10T21:25:40.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.680+0000 7f9acda88740 1 -- 172.21.15.59:0/3568037050 wait complete. 2024-09-10T21:25:40.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.681+0000 7f9acda88740 20 client.17850 trim_cache size 0 max 16384 2024-09-10T21:25:40.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.698+0000 7f9acda88740 1 Processor -- start 2024-09-10T21:25:40.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.698+0000 7f9acda88740 1 -- start start 2024-09-10T21:25:40.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.698+0000 7f9acda88740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951480 0x56075894ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:40.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.698+0000 7f9acda88740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951da0 0x56075895c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:40.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.698+0000 7f9acda88740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075895dd30 0x56075895f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:40.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.698+0000 7f9acda88740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac41b05f0 con 0x560758951480 2024-09-10T21:25:40.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.698+0000 7f9acda88740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac41b2130 con 0x560758951da0 2024-09-10T21:25:40.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.698+0000 7f9acda88740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac41b0cc0 con 0x56075895dd30 2024-09-10T21:25:40.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.698+0000 7f9ac944f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951480 0x56075894ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:40.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.698+0000 7f9ac944f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951480 0x56075894ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34476/0 (socket says 172.21.15.59:34476) 2024-09-10T21:25:40.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.698+0000 7f9ac944f640 1 -- 172.21.15.59:0/3654591998 learned_addr learned my addr 172.21.15.59:0/3654591998 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:40.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.699+0000 7f9ac9c50640 1 --2- 172.21.15.59:0/3654591998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075895dd30 0x56075895f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:40.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.699+0000 7f9ac944f640 1 -- 172.21.15.59:0/3654591998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075895dd30 msgr2=0x56075895f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:40.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.699+0000 7f9ac944f640 1 --2- 172.21.15.59:0/3654591998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075895dd30 0x56075895f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.699+0000 7f9ac944f640 1 -- 172.21.15.59:0/3654591998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951da0 msgr2=0x56075895c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:40.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.699+0000 7f9ac8c4e640 1 --2- 172.21.15.59:0/3654591998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951da0 0x56075895c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:40.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.699+0000 7f9ac944f640 1 --2- 172.21.15.59:0/3654591998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951da0 0x56075895c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.699+0000 7f9ac944f640 1 -- 172.21.15.59:0/3654591998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56075895a840 con 0x560758951480 2024-09-10T21:25:40.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.699+0000 7f9ac8c4e640 1 --2- 172.21.15.59:0/3654591998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951da0 0x56075895c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:40.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.699+0000 7f9ac944f640 1 --2- 172.21.15.59:0/3654591998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951480 0x56075894ebc0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009230 tx=0x7f9ac003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9d8d5ab8e33e05 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:40.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.699+0000 7f9aaeffd640 1 -- 172.21.15.59:0/3654591998 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0035050 con 0x560758951480 2024-09-10T21:25:40.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.699+0000 7f9aaeffd640 1 -- 172.21.15.59:0/3654591998 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ac0004e30 con 0x560758951480 2024-09-10T21:25:40.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.699+0000 7f9aaeffd640 1 -- 172.21.15.59:0/3654591998 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac00324b0 con 0x560758951480 2024-09-10T21:25:40.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.700+0000 7f9acda88740 1 -- 172.21.15.59:0/3654591998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951480 msgr2=0x56075894ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:40.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.700+0000 7f9acda88740 1 --2- 172.21.15.59:0/3654591998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951480 0x56075894ebc0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009230 tx=0x7f9ac003d000 comp rx=0 tx=0).stop 2024-09-10T21:25:40.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.700+0000 7f9acda88740 1 -- 172.21.15.59:0/3654591998 shutdown_connections 2024-09-10T21:25:40.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.700+0000 7f9acda88740 1 --2- 172.21.15.59:0/3654591998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075895dd30 0x56075895f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.700+0000 7f9acda88740 1 --2- 172.21.15.59:0/3654591998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951da0 0x56075895c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.700+0000 7f9acda88740 1 --2- 172.21.15.59:0/3654591998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951480 0x56075894ebc0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.700+0000 7f9acda88740 1 -- 172.21.15.59:0/3654591998 >> 172.21.15.59:0/3654591998 conn(0x56075894f2b0 msgr2=0x56075895c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:40.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.700+0000 7f9acda88740 1 -- 172.21.15.59:0/3654591998 shutdown_connections 2024-09-10T21:25:40.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.700+0000 7f9acda88740 1 -- 172.21.15.59:0/3654591998 wait complete. 2024-09-10T21:25:40.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.700+0000 7f9acda88740 1 -- start start 2024-09-10T21:25:40.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.700+0000 7f9acda88740 1 Processor -- start 2024-09-10T21:25:40.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9acda88740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951480 0x560758965c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:40.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9acda88740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951da0 0x5607589661c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:40.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9acda88740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075895dd30 0x560758960c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:40.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9acda88740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac41b1a60 con 0x560758951da0 2024-09-10T21:25:40.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9acda88740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac41b1390 con 0x560758951480 2024-09-10T21:25:40.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9acda88740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac41ae5d0 con 0x56075895dd30 2024-09-10T21:25:40.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9acda88740 10 client.0 _ll_register_callbacks cb 0x7f9abc009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:40.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9ac8c4e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951da0 0x5607589661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:40.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9ac8c4e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951da0 0x5607589661c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34478/0 (socket says 172.21.15.59:34478) 2024-09-10T21:25:40.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9ac8c4e640 1 -- 172.21.15.59:0/4020847064 learned_addr learned my addr 172.21.15.59:0/4020847064 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:40.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9ac944f640 1 --2- 172.21.15.59:0/4020847064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951480 0x560758965c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:40.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9ac9c50640 1 --2- 172.21.15.59:0/4020847064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075895dd30 0x560758960c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:40.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9ac8c4e640 1 -- 172.21.15.59:0/4020847064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075895dd30 msgr2=0x560758960c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:40.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9ac8c4e640 1 --2- 172.21.15.59:0/4020847064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075895dd30 0x560758960c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9ac8c4e640 1 -- 172.21.15.59:0/4020847064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951480 msgr2=0x560758965c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:40.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9ac8c4e640 1 --2- 172.21.15.59:0/4020847064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951480 0x560758965c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9ac8c4e640 1 -- 172.21.15.59:0/4020847064 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560758961170 con 0x560758951da0 2024-09-10T21:25:40.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9ac8c4e640 1 --2- 172.21.15.59:0/4020847064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951da0 0x5607589661c0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400d720 tx=0x7f9ab40ab680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639720fd9f92f02d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:40.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9aacff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:40.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9aacff9640 1 -- 172.21.15.59:0/4020847064 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4020040 con 0x560758951da0 2024-09-10T21:25:40.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9aacff9640 1 -- 172.21.15.59:0/4020847064 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f9ab40041d0 con 0x560758951da0 2024-09-10T21:25:40.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.701+0000 7f9acda88740 1 -- 172.21.15.59:0/4020847064 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ac0004e30 con 0x560758951da0 2024-09-10T21:25:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.702+0000 7f9aacff9640 1 -- 172.21.15.59:0/4020847064 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9ab40ac370 con 0x560758951da0 2024-09-10T21:25:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.702+0000 7f9acda88740 10 client.17856 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.702+0000 7f9acda88740 1 -- 172.21.15.59:0/4020847064 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5607589da8d0 con 0x560758951da0 2024-09-10T21:25:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.702+0000 7f9aacff9640 1 -- 172.21.15.59:0/4020847064 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ac0004e30 con 0x560758951da0 2024-09-10T21:25:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.702+0000 7f9aacff9640 1 -- 172.21.15.59:0/4020847064 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f9ab40a7ee0 con 0x560758951da0 2024-09-10T21:25:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.702+0000 7f9acda88740 10 client.17856 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.702+0000 7f9acda88740 10 client.17856 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:25:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.702+0000 7f9acda88740 20 client.17856 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.702+0000 7f9acda88740 1 --2- 172.21.15.59:0/4020847064 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5607589db000 0x5607589dd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.702+0000 7f9acda88740 4 client.17856 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:25:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.702+0000 7f9acda88740 1 -- 172.21.15.59:0/4020847064 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5607588c5850 con 0x5607589db000 2024-09-10T21:25:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.702+0000 7f9ac944f640 1 --2- 172.21.15.59:0/4020847064 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5607589db000 0x5607589dd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:40.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.703+0000 7f9ac944f640 1 --2- 172.21.15.59:0/4020847064 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5607589db000 0x5607589dd420 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3700450b0993604 server_cookie=ed1689e891199c09 in_seq=0 out_seq=0 2024-09-10T21:25:40.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.703+0000 7f9aacff9640 10 client.17856 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:40.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.703+0000 7f9aacff9640 1 -- 172.21.15.59:0/4020847064 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5202 (crc 0 0 0) 0x5607588c5850 con 0x5607589db000 2024-09-10T21:25:40.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.703+0000 7f9aacff9640 10 client.17856 handle_command_reply: tid=0 2024-09-10T21:25:40.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.703+0000 7f9acda88740 1 client.17856 shutdown 2024-09-10T21:25:40.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.703+0000 7f9acda88740 1 -- 172.21.15.59:0/4020847064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951da0 msgr2=0x5607589661c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:40.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.703+0000 7f9acda88740 1 --2- 172.21.15.59:0/4020847064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951da0 0x5607589661c0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400d720 tx=0x7f9ab40ab680 comp rx=0 tx=0).stop 2024-09-10T21:25:40.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acda88740 1 -- 172.21.15.59:0/4020847064 shutdown_connections 2024-09-10T21:25:40.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acda88740 1 --2- 172.21.15.59:0/4020847064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56075895dd30 0x560758960c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acda88740 1 --2- 172.21.15.59:0/4020847064 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5607589db000 0x5607589dd420 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acda88740 1 --2- 172.21.15.59:0/4020847064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560758951da0 0x5607589661c0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acda88740 1 --2- 172.21.15.59:0/4020847064 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758951480 0x560758965c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acda88740 1 -- 172.21.15.59:0/4020847064 >> 172.21.15.59:0/4020847064 conn(0x56075894f2b0 msgr2=0x56075895c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:40.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9aacff9640 0 client.17856 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:40.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acda88740 1 -- 172.21.15.59:0/4020847064 shutdown_connections 2024-09-10T21:25:40.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acda88740 1 -- 172.21.15.59:0/4020847064 wait complete. 2024-09-10T21:25:40.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acda88740 20 client.17856 trim_cache size 0 max 16384 2024-09-10T21:25:40.712 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:25:40.712 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:25:40.712 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:25:40.712 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:25:40.712 INFO:teuthology.orchestra.run.smithi059.stdout: "5e9056fa-94a3-4be5-a66c-5033a946ad88": { 2024-09-10T21:25:40.712 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:25:07.346164+0000", 2024-09-10T21:25:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: "3ac3cde1-bbc5-4c68-9fc6-bc3e3022aea8": { 2024-09-10T21:25:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:24:53.320547+0000", 2024-09-10T21:25:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:40.713 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: "0fb476f2-3572-4daf-8d42-5cf40259db46": { 2024-09-10T21:25:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:53.136187+0000", 2024-09-10T21:25:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: "cb01ac69-57ce-4c62-b57a-054abf74df29": { 2024-09-10T21:25:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:07.589420+0000", 2024-09-10T21:25:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:25:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:25:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:40.715 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:25:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:25:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:25:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:07.066301+0000", 2024-09-10T21:25:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:40.716 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:25:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:25:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: "7de1e6cf-02c2-41f2-b957-563f88bae8ef": { 2024-09-10T21:25:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:22:22.098651+0000", 2024-09-10T21:25:40.717 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:25:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:25:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:40.718 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:25:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:25:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "ec2c29bb-febd-4190-959f-09af3764b7ad": { 2024-09-10T21:25:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:24:07.378801+0000", 2024-09-10T21:25:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:40.719 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:25:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:25:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:25:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:25:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:40.720 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:25:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:25:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:25:40.721 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:25:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "800cdb00-6a99-4c42-8a9e-4b1c599c6af0": { 2024-09-10T21:25:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:52.224081+0000", 2024-09-10T21:25:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:40.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: "d82f24b1-930e-4f83-a379-3084f22918d0": { 2024-09-10T21:25:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:21:37.203865+0000", 2024-09-10T21:25:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:25:40.723 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:25:40.723 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:25:40.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acb6b3640 1 -- 172.21.15.59:0/4247959260 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9ab00b52e0 msgr2=0x7f9ab00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:40.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acb6b3640 1 --2- 172.21.15.59:0/4247959260 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9ab00b52e0 0x7f9ab00b77a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0000c00 tx=0x7f9ac00040d0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acb6b3640 1 -- 172.21.15.59:0/4247959260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ac41045c0 msgr2=0x7f9ac4101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:40.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acb6b3640 1 --2- 172.21.15.59:0/4247959260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ac41045c0 0x7f9ac4101e90 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400d750 tx=0x7f9ab400dc10 comp rx=0 tx=0).stop 2024-09-10T21:25:40.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acb6b3640 1 -- 172.21.15.59:0/4247959260 shutdown_connections 2024-09-10T21:25:40.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acb6b3640 1 --2- 172.21.15.59:0/4247959260 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f9ab00b52e0 0x7f9ab00b77a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acb6b3640 1 --2- 172.21.15.59:0/4247959260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ac410d100 0x7f9ac41023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acb6b3640 1 --2- 172.21.15.59:0/4247959260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ac41045c0 0x7f9ac4101e90 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acb6b3640 1 --2- 172.21.15.59:0/4247959260 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ac4103ca0 0x7f9ac4101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:40.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acb6b3640 1 -- 172.21.15.59:0/4247959260 >> 172.21.15.59:0/4247959260 conn(0x7f9ac40fd700 msgr2=0x7f9ac410f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:40.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.704+0000 7f9acb6b3640 1 -- 172.21.15.59:0/4247959260 shutdown_connections 2024-09-10T21:25:40.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:40.705+0000 7f9acb6b3640 1 -- 172.21.15.59:0/4247959260 wait complete. 2024-09-10T21:25:40.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:40 smithi059 ceph-mon[30888]: pgmap v652: 97 pgs: 97 active+clean; 7.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:25:41.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:40 smithi154 ceph-mon[35041]: pgmap v652: 97 pgs: 97 active+clean; 7.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:25:41.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:40 smithi192 ceph-mon[35363]: pgmap v652: 97 pgs: 97 active+clean; 7.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:25:41.486 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:25:41.486 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:25:41.748 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:25:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.217+0000 7f9581149640 1 -- 172.21.15.59:0/1219504127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f957c103b30 msgr2=0x7f957c103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.217+0000 7f9581149640 1 --2- 172.21.15.59:0/1219504127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f957c103b30 0x7f957c103f10 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f956c009900 tx=0x7f956c02a410 comp rx=0 tx=0).stop 2024-09-10T21:25:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.217+0000 7f9581149640 1 -- 172.21.15.59:0/1219504127 shutdown_connections 2024-09-10T21:25:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.217+0000 7f9581149640 1 --2- 172.21.15.59:0/1219504127 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f957c10d0e0 0x7f957c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.217+0000 7f9581149640 1 --2- 172.21.15.59:0/1219504127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f957c104530 0x7f957c10cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.217+0000 7f9581149640 1 --2- 172.21.15.59:0/1219504127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f957c103b30 0x7f957c103f10 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.217+0000 7f9581149640 1 -- 172.21.15.59:0/1219504127 >> 172.21.15.59:0/1219504127 conn(0x7f957c0fd700 msgr2=0x7f957c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.217+0000 7f9581149640 1 -- 172.21.15.59:0/1219504127 shutdown_connections 2024-09-10T21:25:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.217+0000 7f9581149640 1 -- 172.21.15.59:0/1219504127 wait complete. 2024-09-10T21:25:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.218+0000 7f9581149640 1 Processor -- start 2024-09-10T21:25:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.219+0000 7f9581149640 1 -- start start 2024-09-10T21:25:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.219+0000 7f9581149640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f957c103b30 0x7f957c1991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.219+0000 7f9581149640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f957c104530 0x7f957c199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.219+0000 7f9581149640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f957c10d0e0 0x7f957c19ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.219+0000 7f9581149640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f957c112d60 con 0x7f957c10d0e0 2024-09-10T21:25:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.219+0000 7f9581149640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f957c112be0 con 0x7f957c104530 2024-09-10T21:25:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.219+0000 7f9581149640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f957c112ee0 con 0x7f957c103b30 2024-09-10T21:25:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.219+0000 7f957b59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f957c10d0e0 0x7f957c19ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.219+0000 7f957b59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f957c10d0e0 0x7f957c19ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34490/0 (socket says 172.21.15.59:34490) 2024-09-10T21:25:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.219+0000 7f957b59e640 1 -- 172.21.15.59:0/620187005 learned_addr learned my addr 172.21.15.59:0/620187005 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.219+0000 7f957a59c640 1 --2- 172.21.15.59:0/620187005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f957c104530 0x7f957c199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.219+0000 7f957ad9d640 1 --2- 172.21.15.59:0/620187005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f957c103b30 0x7f957c1991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.219+0000 7f957b59e640 1 -- 172.21.15.59:0/620187005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f957c103b30 msgr2=0x7f957c1991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.219+0000 7f957b59e640 1 --2- 172.21.15.59:0/620187005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f957c103b30 0x7f957c1991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.219+0000 7f957b59e640 1 -- 172.21.15.59:0/620187005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f957c104530 msgr2=0x7f957c199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.219+0000 7f957b59e640 1 --2- 172.21.15.59:0/620187005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f957c104530 0x7f957c199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.219+0000 7f957b59e640 1 -- 172.21.15.59:0/620187005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f957c19f2a0 con 0x7f957c10d0e0 2024-09-10T21:25:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.219+0000 7f957ad9d640 1 --2- 172.21.15.59:0/620187005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f957c103b30 0x7f957c1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.219+0000 7f957a59c640 1 --2- 172.21.15.59:0/620187005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f957c104530 0x7f957c199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:25:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.220+0000 7f957b59e640 1 --2- 172.21.15.59:0/620187005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f957c10d0e0 0x7f957c19ead0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f957400c970 tx=0x7f957400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.220+0000 7f9563fff640 1 -- 172.21.15.59:0/620187005 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9574007bb0 con 0x7f957c10d0e0 2024-09-10T21:25:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.220+0000 7f9581149640 1 -- 172.21.15.59:0/620187005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f957c19f590 con 0x7f957c10d0e0 2024-09-10T21:25:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.220+0000 7f9563fff640 1 -- 172.21.15.59:0/620187005 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9574007d50 con 0x7f957c10d0e0 2024-09-10T21:25:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.220+0000 7f9563fff640 1 -- 172.21.15.59:0/620187005 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9574018770 con 0x7f957c10d0e0 2024-09-10T21:25:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.220+0000 7f9581149640 1 -- 172.21.15.59:0/620187005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f957c1a5c50 con 0x7f957c10d0e0 2024-09-10T21:25:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.221+0000 7f9581149640 1 -- 172.21.15.59:0/620187005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f957c103f10 con 0x7f957c10d0e0 2024-09-10T21:25:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.222+0000 7f9563fff640 1 -- 172.21.15.59:0/620187005 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f957400f990 con 0x7f957c10d0e0 2024-09-10T21:25:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.223+0000 7f9563fff640 1 --2- 172.21.15.59:0/620187005 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f95640b52e0 0x7f95640b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.223+0000 7f957ad9d640 1 --2- 172.21.15.59:0/620187005 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f95640b52e0 0x7f95640b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.223+0000 7f9563fff640 1 -- 172.21.15.59:0/620187005 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f95740e5e10 con 0x7f957c10d0e0 2024-09-10T21:25:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.224+0000 7f957ad9d640 1 --2- 172.21.15.59:0/620187005 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f95640b52e0 0x7f95640b77a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f956c000c00 tx=0x7f956c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.226+0000 7f9563fff640 1 -- 172.21.15.59:0/620187005 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9574014030 con 0x7f957c10d0e0 2024-09-10T21:25:42.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.448+0000 7f9581149640 1 -- 172.21.15.59:0/620187005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f957c19a320 con 0x7f957c10d0e0 2024-09-10T21:25:42.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.448+0000 7f9563fff640 1 -- 172.21.15.59:0/620187005 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f957c19a320 con 0x7f957c10d0e0 2024-09-10T21:25:42.451 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:25:42.451 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:25:42.452 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:25:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.450+0000 7f9581149640 1 -- 172.21.15.59:0/620187005 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f95640b52e0 msgr2=0x7f95640b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.450+0000 7f9581149640 1 --2- 172.21.15.59:0/620187005 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f95640b52e0 0x7f95640b77a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f956c000c00 tx=0x7f956c031400 comp rx=0 tx=0).stop 2024-09-10T21:25:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.450+0000 7f9581149640 1 -- 172.21.15.59:0/620187005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f957c10d0e0 msgr2=0x7f957c19ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.450+0000 7f9581149640 1 --2- 172.21.15.59:0/620187005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f957c10d0e0 0x7f957c19ead0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f957400c970 tx=0x7f957400ce30 comp rx=0 tx=0).stop 2024-09-10T21:25:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.451+0000 7f9581149640 1 -- 172.21.15.59:0/620187005 shutdown_connections 2024-09-10T21:25:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.451+0000 7f9581149640 1 --2- 172.21.15.59:0/620187005 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f95640b52e0 0x7f95640b77a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.451+0000 7f9581149640 1 --2- 172.21.15.59:0/620187005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f957c10d0e0 0x7f957c19ead0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.451+0000 7f9581149640 1 --2- 172.21.15.59:0/620187005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f957c104530 0x7f957c199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.451+0000 7f9581149640 1 --2- 172.21.15.59:0/620187005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f957c103b30 0x7f957c1991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.451+0000 7f9581149640 1 -- 172.21.15.59:0/620187005 >> 172.21.15.59:0/620187005 conn(0x7f957c0fd700 msgr2=0x7f957c0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.451+0000 7f9581149640 1 -- 172.21.15.59:0/620187005 shutdown_connections 2024-09-10T21:25:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:42.451+0000 7f9581149640 1 -- 172.21.15.59:0/620187005 wait complete. 2024-09-10T21:25:43.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:42 smithi059 ceph-mon[30888]: pgmap v653: 97 pgs: 97 active+clean; 7.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:25:43.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:42 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/620187005' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:25:43.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:42 smithi154 ceph-mon[35041]: pgmap v653: 97 pgs: 97 active+clean; 7.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:25:43.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:42 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/620187005' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:25:43.215 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:25:43.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:42 smithi192 ceph-mon[35363]: pgmap v653: 97 pgs: 97 active+clean; 7.1 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:25:43.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:42 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/620187005' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:25:43.475 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:25:43.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.968+0000 7f1ff081c640 1 -- 172.21.15.59:0/1463196147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fec1076a0 msgr2=0x7f1fec107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:43.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.968+0000 7f1ff081c640 1 --2- 172.21.15.59:0/1463196147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fec1076a0 0x7f1fec107ae0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009900 tx=0x7f1fe002a410 comp rx=0 tx=0).stop 2024-09-10T21:25:43.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.968+0000 7f1ff081c640 1 -- 172.21.15.59:0/1463196147 shutdown_connections 2024-09-10T21:25:43.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.968+0000 7f1ff081c640 1 --2- 172.21.15.59:0/1463196147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec108020 0x7f1fec10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.968+0000 7f1ff081c640 1 --2- 172.21.15.59:0/1463196147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fec1076a0 0x7f1fec107ae0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.968+0000 7f1ff081c640 1 --2- 172.21.15.59:0/1463196147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fec101c90 0x7f1fec102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.968+0000 7f1ff081c640 1 -- 172.21.15.59:0/1463196147 >> 172.21.15.59:0/1463196147 conn(0x7f1fec0fd700 msgr2=0x7f1fec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:43.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.968+0000 7f1ff081c640 1 -- 172.21.15.59:0/1463196147 shutdown_connections 2024-09-10T21:25:43.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.968+0000 7f1ff081c640 1 -- 172.21.15.59:0/1463196147 wait complete. 2024-09-10T21:25:43.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.969+0000 7f1ff081c640 1 Processor -- start 2024-09-10T21:25:43.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.969+0000 7f1ff081c640 1 -- start start 2024-09-10T21:25:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.970+0000 7f1ff081c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fec101c90 0x7f1fec19a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.970+0000 7f1ff081c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fec1076a0 0x7f1fec19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.970+0000 7f1ff081c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec108020 0x7f1fec19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.970+0000 7f1ff081c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec111ca0 con 0x7f1fec101c90 2024-09-10T21:25:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.970+0000 7f1ff081c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec111b20 con 0x7f1fec1076a0 2024-09-10T21:25:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.970+0000 7f1ff081c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec111e20 con 0x7f1fec108020 2024-09-10T21:25:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.970+0000 7f1fea59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fec101c90 0x7f1fec19a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.970+0000 7f1fea59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fec101c90 0x7f1fec19a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34508/0 (socket says 172.21.15.59:34508) 2024-09-10T21:25:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.970+0000 7f1fea59c640 1 -- 172.21.15.59:0/1191497517 learned_addr learned my addr 172.21.15.59:0/1191497517 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.970+0000 7f1fe9d9b640 1 --2- 172.21.15.59:0/1191497517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fec1076a0 0x7f1fec19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.970+0000 7f1fead9d640 1 --2- 172.21.15.59:0/1191497517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec108020 0x7f1fec19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:43.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.970+0000 7f1fea59c640 1 -- 172.21.15.59:0/1191497517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec108020 msgr2=0x7f1fec19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:43.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.970+0000 7f1fea59c640 1 --2- 172.21.15.59:0/1191497517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec108020 0x7f1fec19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.970+0000 7f1fea59c640 1 -- 172.21.15.59:0/1191497517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fec1076a0 msgr2=0x7f1fec19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:43.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.970+0000 7f1fea59c640 1 --2- 172.21.15.59:0/1191497517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fec1076a0 0x7f1fec19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.970+0000 7f1fea59c640 1 -- 172.21.15.59:0/1191497517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec1a54b0 con 0x7f1fec101c90 2024-09-10T21:25:43.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.970+0000 7f1fea59c640 1 --2- 172.21.15.59:0/1191497517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fec101c90 0x7f1fec19a0d0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00d950 tx=0x7f1fdc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:43.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.970+0000 7f1fdb7fe640 1 -- 172.21.15.59:0/1191497517 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc017070 con 0x7f1fec101c90 2024-09-10T21:25:43.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.970+0000 7f1fdb7fe640 1 -- 172.21.15.59:0/1191497517 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fdc009c30 con 0x7f1fec101c90 2024-09-10T21:25:43.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.971+0000 7f1ff081c640 1 -- 172.21.15.59:0/1191497517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fec1a57a0 con 0x7f1fec101c90 2024-09-10T21:25:43.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.971+0000 7f1fdb7fe640 1 -- 172.21.15.59:0/1191497517 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc00f620 con 0x7f1fec101c90 2024-09-10T21:25:43.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.971+0000 7f1ff081c640 1 -- 172.21.15.59:0/1191497517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fec1a5d00 con 0x7f1fec101c90 2024-09-10T21:25:43.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.973+0000 7f1fdb7fe640 1 -- 172.21.15.59:0/1191497517 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f1fdc010460 con 0x7f1fec101c90 2024-09-10T21:25:43.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.973+0000 7f1ff2bf1740 1 Processor -- start 2024-09-10T21:25:43.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.974+0000 7f1ff2bf1740 1 -- start start 2024-09-10T21:25:43.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.974+0000 7f1ff2bf1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5637515970f0 0x5637515974d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:43.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.974+0000 7f1ff2bf1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 0x5637515a3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:43.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.974+0000 7f1ff2bf1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 0x5637515a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:43.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.974+0000 7f1ff2bf1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56375150dea0 con 0x563751597a10 2024-09-10T21:25:43.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.974+0000 7f1ff2bf1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5637514fd2d0 con 0x5637515a39a0 2024-09-10T21:25:43.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.974+0000 7f1ff2bf1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5637515010e0 con 0x5637515970f0 2024-09-10T21:25:43.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.974+0000 7f1fea59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 0x5637515a3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:43.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.974+0000 7f1fea59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 0x5637515a3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34518/0 (socket says 172.21.15.59:34518) 2024-09-10T21:25:43.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.974+0000 7f1fea59c640 1 -- 172.21.15.59:0/2793410439 learned_addr learned my addr 172.21.15.59:0/2793410439 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:43.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.974+0000 7f1fead9d640 1 --2- 172.21.15.59:0/2793410439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5637515970f0 0x5637515974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:43.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.974+0000 7f1fe9d9b640 1 --2- 172.21.15.59:0/2793410439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 0x5637515a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:43.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.974+0000 7f1fea59c640 1 -- 172.21.15.59:0/2793410439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5637515970f0 msgr2=0x5637515974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:43.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.974+0000 7f1fea59c640 1 --2- 172.21.15.59:0/2793410439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5637515970f0 0x5637515974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.974+0000 7f1fea59c640 1 -- 172.21.15.59:0/2793410439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 msgr2=0x5637515a5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:43.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.974+0000 7f1fea59c640 1 --2- 172.21.15.59:0/2793410439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 0x5637515a5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.974+0000 7f1fdb7fe640 1 --2- 172.21.15.59:0/1191497517 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1fd40b5360 0x7f1fd40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:43.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.974+0000 7f1fea59c640 1 -- 172.21.15.59:0/2793410439 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56375125b650 con 0x563751597a10 2024-09-10T21:25:43.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.975+0000 7f1fead9d640 1 --2- 172.21.15.59:0/1191497517 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1fd40b5360 0x7f1fd40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:43.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.975+0000 7f1fea59c640 1 --2- 172.21.15.59:0/2793410439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 0x5637515a3460 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0a8010 tx=0x7f1fdc0a86c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd9b6da558305a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:43.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.975+0000 7f1fdb7fe640 1 -- 172.21.15.59:0/1191497517 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1fdc0e5820 con 0x7f1fec101c90 2024-09-10T21:25:43.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.975+0000 7f1fd8ff9640 1 -- 172.21.15.59:0/2793410439 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc020020 con 0x563751597a10 2024-09-10T21:25:43.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.975+0000 7f1fd8ff9640 1 -- 172.21.15.59:0/2793410439 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fdc0abac0 con 0x563751597a10 2024-09-10T21:25:43.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.975+0000 7f1fd8ff9640 1 -- 172.21.15.59:0/2793410439 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc0d8e60 con 0x563751597a10 2024-09-10T21:25:43.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.976+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/2793410439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 msgr2=0x5637515a3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:43.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.976+0000 7f1fead9d640 1 --2- 172.21.15.59:0/1191497517 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1fd40b5360 0x7f1fd40b7820 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1fec19b0b0 tx=0x7f1fe4009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:43.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.976+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/2793410439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 0x5637515a3460 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0a8010 tx=0x7f1fdc0a86c0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.976+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/2793410439 shutdown_connections 2024-09-10T21:25:43.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.976+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/2793410439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 0x5637515a5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.976+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/2793410439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 0x5637515a3460 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.976+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/2793410439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5637515970f0 0x5637515974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.976+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/2793410439 >> 172.21.15.59:0/2793410439 conn(0x563751594f20 msgr2=0x5637515960c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:43.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.976+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/2793410439 shutdown_connections 2024-09-10T21:25:43.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.976+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/2793410439 wait complete. 2024-09-10T21:25:43.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.976+0000 7f1ff2bf1740 1 -- start start 2024-09-10T21:25:43.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.976+0000 7f1ff2bf1740 1 Processor -- start 2024-09-10T21:25:43.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.977+0000 7f1ff2bf1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5637515970f0 0x5637515a3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:43.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.977+0000 7f1ff2bf1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 0x5637515a0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:43.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.977+0000 7f1ff2bf1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 0x5637515a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:43.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.977+0000 7f1ff2bf1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56375135e700 con 0x563751597a10 2024-09-10T21:25:43.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.977+0000 7f1ff2bf1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563751498160 con 0x5637515a39a0 2024-09-10T21:25:43.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.977+0000 7f1ff2bf1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5637515a6620 con 0x5637515970f0 2024-09-10T21:25:43.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.977+0000 7f1ff2bf1740 10 client.0 _ll_register_callbacks cb 0x5637514b19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:43.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.977+0000 7f1fe9d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 0x5637515a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:43.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.977+0000 7f1fe9d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 0x5637515a0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34532/0 (socket says 172.21.15.59:34532) 2024-09-10T21:25:43.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.977+0000 7f1fe9d9b640 1 -- 172.21.15.59:0/2587910426 learned_addr learned my addr 172.21.15.59:0/2587910426 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:43.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.977+0000 7f1fea59c640 1 --2- 172.21.15.59:0/2587910426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5637515970f0 0x5637515a3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:43.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.977+0000 7f1fead9d640 1 --2- 172.21.15.59:0/2587910426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 0x5637515a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.977+0000 7f1fe9d9b640 1 -- 172.21.15.59:0/2587910426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5637515970f0 msgr2=0x5637515a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.977+0000 7f1fe9d9b640 1 --2- 172.21.15.59:0/2587910426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5637515970f0 0x5637515a3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.977+0000 7f1fe9d9b640 1 -- 172.21.15.59:0/2587910426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 msgr2=0x5637515a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.977+0000 7f1fe9d9b640 1 --2- 172.21.15.59:0/2587910426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 0x5637515a0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.977+0000 7f1fe9d9b640 1 -- 172.21.15.59:0/2587910426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637514c5c90 con 0x563751597a10 2024-09-10T21:25:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.977+0000 7f1fe9d9b640 1 --2- 172.21.15.59:0/2587910426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 0x5637515a0650 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009900 tx=0x7f1fe00316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba156676bdc4b30 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.977+0000 7f1fd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.978+0000 7f1fd1ffb640 1 -- 172.21.15.59:0/2587910426 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0035040 con 0x563751597a10 2024-09-10T21:25:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.978+0000 7f1fd1ffb640 1 -- 172.21.15.59:0/2587910426 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1fe0004040 con 0x563751597a10 2024-09-10T21:25:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.978+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/2587910426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fdc0abac0 con 0x563751597a10 2024-09-10T21:25:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.978+0000 7f1fd1ffb640 1 -- 172.21.15.59:0/2587910426 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1fe0032e30 con 0x563751597a10 2024-09-10T21:25:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.978+0000 7f1ff2bf1740 10 client.17874 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.978+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/2587910426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5637515b1ed0 con 0x563751597a10 2024-09-10T21:25:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.978+0000 7f1fd1ffb640 1 -- 172.21.15.59:0/2587910426 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fdc0abac0 con 0x563751597a10 2024-09-10T21:25:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.978+0000 7f1fd1ffb640 1 -- 172.21.15.59:0/2587910426 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1fe00047e0 con 0x563751597a10 2024-09-10T21:25:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.978+0000 7f1ff2bf1740 10 client.17874 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.978+0000 7f1ff2bf1740 10 client.17874 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:25:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.978+0000 7f1ff2bf1740 20 client.17874 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.978+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/2587910426 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5637515b3430 0x5637515b5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.978+0000 7f1ff2bf1740 4 client.17874 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:25:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.978+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/2587910426 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56375150fdf0 con 0x5637515b3430 2024-09-10T21:25:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.979+0000 7f1fea59c640 1 --2- 172.21.15.59:0/2587910426 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5637515b3430 0x5637515b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.979+0000 7f1fea59c640 1 --2- 172.21.15.59:0/2587910426 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5637515b3430 0x5637515b5840 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d7a306a7c18b523e server_cookie=653aea6968fd2d6e in_seq=0 out_seq=0 2024-09-10T21:25:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.979+0000 7f1fd1ffb640 10 client.17874 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:25:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.980+0000 7f1fd1ffb640 1 -- 172.21.15.59:0/2587910426 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56375150fdf0 con 0x5637515b3430 2024-09-10T21:25:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.980+0000 7f1fd1ffb640 10 client.17874 handle_command_reply: tid=0 2024-09-10T21:25:43.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.980+0000 7f1ff2bf1740 1 client.17874 shutdown 2024-09-10T21:25:43.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.980+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/2587910426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 msgr2=0x5637515a0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:43.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.980+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/2587910426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 0x5637515a0650 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0009900 tx=0x7f1fe00316d0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.980+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/2587910426 shutdown_connections 2024-09-10T21:25:43.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.980+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/2587910426 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5637515b3430 0x5637515b5840 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.980+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/2587910426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 0x5637515a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.980+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/2587910426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 0x5637515a0650 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.980+0000 7f1fd1ffb640 0 client.17874 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:25:43.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.980+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/2587910426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5637515970f0 0x5637515a3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.980+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/2587910426 >> 172.21.15.59:0/2587910426 conn(0x563751594f20 msgr2=0x56375159aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:43.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.980+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/2587910426 shutdown_connections 2024-09-10T21:25:43.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.980+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/2587910426 wait complete. 2024-09-10T21:25:43.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.980+0000 7f1ff2bf1740 20 client.17874 trim_cache size 0 max 16384 2024-09-10T21:25:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.993+0000 7f1ff2bf1740 1 Processor -- start 2024-09-10T21:25:43.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.993+0000 7f1ff2bf1740 1 -- start start 2024-09-10T21:25:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.993+0000 7f1ff2bf1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637515970f0 0x5637515af850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.993+0000 7f1ff2bf1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563751597a10 0x56375159a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.993+0000 7f1ff2bf1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 0x56375159ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.993+0000 7f1ff2bf1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec1ae290 con 0x5637515970f0 2024-09-10T21:25:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.993+0000 7f1ff2bf1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec1afdd0 con 0x5637515a39a0 2024-09-10T21:25:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.993+0000 7f1ff2bf1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec1ae960 con 0x563751597a10 2024-09-10T21:25:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.993+0000 7f1fea59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637515970f0 0x5637515af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.994+0000 7f1fea59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637515970f0 0x5637515af850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34538/0 (socket says 172.21.15.59:34538) 2024-09-10T21:25:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.994+0000 7f1fea59c640 1 -- 172.21.15.59:0/1585712776 learned_addr learned my addr 172.21.15.59:0/1585712776 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.994+0000 7f1fe9d9b640 1 --2- 172.21.15.59:0/1585712776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563751597a10 0x56375159a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.994+0000 7f1fead9d640 1 --2- 172.21.15.59:0/1585712776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 0x56375159ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.994+0000 7f1fea59c640 1 -- 172.21.15.59:0/1585712776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563751597a10 msgr2=0x56375159a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:43.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.994+0000 7f1fea59c640 1 --2- 172.21.15.59:0/1585712776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563751597a10 0x56375159a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.994+0000 7f1fea59c640 1 -- 172.21.15.59:0/1585712776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 msgr2=0x56375159ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.994+0000 7f1fea59c640 1 --2- 172.21.15.59:0/1585712776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 0x56375159ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.994+0000 7f1fea59c640 1 -- 172.21.15.59:0/1585712776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637515a0f40 con 0x5637515970f0 2024-09-10T21:25:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.994+0000 7f1fea59c640 1 --2- 172.21.15.59:0/1585712776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637515970f0 0x5637515af850 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0a9220 tx=0x7f1fdc00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5821179fe8a9153f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.994+0000 7f1fd3fff640 1 -- 172.21.15.59:0/1585712776 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc020040 con 0x5637515970f0 2024-09-10T21:25:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.994+0000 7f1fd3fff640 1 -- 172.21.15.59:0/1585712776 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fdc0abac0 con 0x5637515970f0 2024-09-10T21:25:43.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.994+0000 7f1fd3fff640 1 -- 172.21.15.59:0/1585712776 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc0abfb0 con 0x5637515970f0 2024-09-10T21:25:44.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.995+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/1585712776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637515970f0 msgr2=0x5637515af850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:44.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.995+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/1585712776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637515970f0 0x5637515af850 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0a9220 tx=0x7f1fdc00bf60 comp rx=0 tx=0).stop 2024-09-10T21:25:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.995+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/1585712776 shutdown_connections 2024-09-10T21:25:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.995+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/1585712776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 0x56375159ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.995+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/1585712776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x563751597a10 0x56375159a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.995+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/1585712776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637515970f0 0x5637515af850 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.995+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/1585712776 >> 172.21.15.59:0/1585712776 conn(0x563751594f20 msgr2=0x56375159a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.995+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/1585712776 shutdown_connections 2024-09-10T21:25:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.995+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/1585712776 wait complete. 2024-09-10T21:25:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.995+0000 7f1ff2bf1740 1 -- start start 2024-09-10T21:25:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.995+0000 7f1ff2bf1740 1 Processor -- start 2024-09-10T21:25:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1ff2bf1740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5637515970f0 0x56375159e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1ff2bf1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 0x5637515ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1ff2bf1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 0x5637515ac080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:44.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1ff2bf1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec1af700 con 0x563751597a10 2024-09-10T21:25:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1ff2bf1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec1af030 con 0x5637515a39a0 2024-09-10T21:25:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1ff2bf1740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec1ac270 con 0x5637515970f0 2024-09-10T21:25:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1ff2bf1740 10 client.0 _ll_register_callbacks cb 0x7f1fe0009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1fe9d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 0x5637515ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1fe9d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 0x5637515ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34546/0 (socket says 172.21.15.59:34546) 2024-09-10T21:25:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1fe9d9b640 1 -- 172.21.15.59:0/1565565615 learned_addr learned my addr 172.21.15.59:0/1565565615 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1fea59c640 1 --2- 172.21.15.59:0/1565565615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5637515970f0 0x56375159e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1fead9d640 1 --2- 172.21.15.59:0/1565565615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 0x5637515ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1fe9d9b640 1 -- 172.21.15.59:0/1565565615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5637515970f0 msgr2=0x56375159e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1fe9d9b640 1 --2- 172.21.15.59:0/1565565615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5637515970f0 0x56375159e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1fe9d9b640 1 -- 172.21.15.59:0/1565565615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 msgr2=0x5637515ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1fe9d9b640 1 --2- 172.21.15.59:0/1565565615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 0x5637515ac080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:44.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1fe9d9b640 1 -- 172.21.15.59:0/1565565615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56375159c8f0 con 0x563751597a10 2024-09-10T21:25:44.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1fea59c640 1 --2- 172.21.15.59:0/1565565615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5637515970f0 0x56375159e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:25:44.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1fe9d9b640 1 --2- 172.21.15.59:0/1565565615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 0x5637515ab8f0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0006010 tx=0x7f1fe00035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149ec0c4b288dec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:44.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1fd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:44.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1fd1ffb640 1 -- 172.21.15.59:0/1565565615 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0035070 con 0x563751597a10 2024-09-10T21:25:44.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1fd1ffb640 1 -- 172.21.15.59:0/1565565615 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f1fe0004df0 con 0x563751597a10 2024-09-10T21:25:44.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.996+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/1565565615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fdc0abac0 con 0x563751597a10 2024-09-10T21:25:44.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.997+0000 7f1fd1ffb640 1 -- 172.21.15.59:0/1565565615 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1fe0004ff0 con 0x563751597a10 2024-09-10T21:25:44.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.997+0000 7f1ff2bf1740 10 client.17880 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:44.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.997+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/1565565615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5637516216e0 con 0x563751597a10 2024-09-10T21:25:44.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.997+0000 7f1fd1ffb640 1 -- 172.21.15.59:0/1565565615 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fdc0abac0 con 0x563751597a10 2024-09-10T21:25:44.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.997+0000 7f1fd1ffb640 1 -- 172.21.15.59:0/1565565615 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1fe0046c30 con 0x563751597a10 2024-09-10T21:25:44.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.997+0000 7f1ff2bf1740 10 client.17880 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:44.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.997+0000 7f1ff2bf1740 10 client.17880 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:25:44.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.997+0000 7f1ff2bf1740 20 client.17880 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:44.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.997+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/1565565615 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x563751621e50 0x563751624270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:44.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.997+0000 7f1ff2bf1740 4 client.17880 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:25:44.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.997+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/1565565615 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56375150b8a0 con 0x563751621e50 2024-09-10T21:25:44.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.997+0000 7f1fea59c640 1 --2- 172.21.15.59:0/1565565615 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x563751621e50 0x563751624270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:44.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.998+0000 7f1fea59c640 1 --2- 172.21.15.59:0/1565565615 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x563751621e50 0x563751624270 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=97532858cbb19b7e server_cookie=93c6e1d9fd123a24 in_seq=0 out_seq=0 2024-09-10T21:25:44.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.998+0000 7f1fd1ffb640 10 client.17880 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:25:44.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.998+0000 7f1fd1ffb640 1 -- 172.21.15.59:0/1565565615 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56375150b8a0 con 0x563751621e50 2024-09-10T21:25:44.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.998+0000 7f1fd1ffb640 10 client.17880 handle_command_reply: tid=0 2024-09-10T21:25:44.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.998+0000 7f1ff2bf1740 1 client.17880 shutdown 2024-09-10T21:25:44.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.998+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/1565565615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 msgr2=0x5637515ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:44.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.998+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/1565565615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 0x5637515ab8f0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0006010 tx=0x7f1fe00035f0 comp rx=0 tx=0).stop 2024-09-10T21:25:44.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.998+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/1565565615 shutdown_connections 2024-09-10T21:25:44.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.998+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/1565565615 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x563751621e50 0x563751624270 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:44.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.998+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/1565565615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637515a39a0 0x5637515ac080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:44.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.998+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/1565565615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563751597a10 0x5637515ab8f0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:44.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.998+0000 7f1fd1ffb640 0 client.17880 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:25:44.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.998+0000 7f1ff2bf1740 1 --2- 172.21.15.59:0/1565565615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5637515970f0 0x56375159e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:44.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.998+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/1565565615 >> 172.21.15.59:0/1565565615 conn(0x563751594f20 msgr2=0x56375159a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:44.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.998+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/1565565615 shutdown_connections 2024-09-10T21:25:44.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.998+0000 7f1ff2bf1740 1 -- 172.21.15.59:0/1565565615 wait complete. 2024-09-10T21:25:44.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.998+0000 7f1ff2bf1740 20 client.17880 trim_cache size 0 max 16384 2024-09-10T21:25:44.006 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:25:44.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.999+0000 7f1ff081c640 1 -- 172.21.15.59:0/1191497517 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1fd40b5360 msgr2=0x7f1fd40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:44.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.999+0000 7f1ff081c640 1 --2- 172.21.15.59:0/1191497517 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1fd40b5360 0x7f1fd40b7820 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1fec19b0b0 tx=0x7f1fe4009760 comp rx=0 tx=0).stop 2024-09-10T21:25:44.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.999+0000 7f1ff081c640 1 -- 172.21.15.59:0/1191497517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fec101c90 msgr2=0x7f1fec19a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:44.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.999+0000 7f1ff081c640 1 --2- 172.21.15.59:0/1191497517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fec101c90 0x7f1fec19a0d0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00d950 tx=0x7f1fdc00de10 comp rx=0 tx=0).stop 2024-09-10T21:25:44.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.999+0000 7f1ff081c640 1 -- 172.21.15.59:0/1191497517 shutdown_connections 2024-09-10T21:25:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.999+0000 7f1ff081c640 1 --2- 172.21.15.59:0/1191497517 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f1fd40b5360 0x7f1fd40b7820 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.999+0000 7f1ff081c640 1 --2- 172.21.15.59:0/1191497517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec108020 0x7f1fec19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.999+0000 7f1ff081c640 1 --2- 172.21.15.59:0/1191497517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fec1076a0 0x7f1fec19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.999+0000 7f1ff081c640 1 --2- 172.21.15.59:0/1191497517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fec101c90 0x7f1fec19a0d0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.999+0000 7f1ff081c640 1 -- 172.21.15.59:0/1191497517 >> 172.21.15.59:0/1191497517 conn(0x7f1fec0fd700 msgr2=0x7f1fec0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.999+0000 7f1ff081c640 1 -- 172.21.15.59:0/1191497517 shutdown_connections 2024-09-10T21:25:44.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:43.999+0000 7f1ff081c640 1 -- 172.21.15.59:0/1191497517 wait complete. 2024-09-10T21:25:44.726 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:25:44.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:44 smithi059 ceph-mon[30888]: pgmap v654: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:25:44.990 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:25:45.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:44 smithi154 ceph-mon[35041]: pgmap v654: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:25:45.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:44 smithi192 ceph-mon[35363]: pgmap v654: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-10T21:25:45.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.469+0000 7f205c468640 1 -- 172.21.15.59:0/91049819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20541087a0 msgr2=0x7f2054108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:45.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.469+0000 7f205c468640 1 --2- 172.21.15.59:0/91049819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20541087a0 0x7f2054108be0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f2048009900 tx=0x7f204802a410 comp rx=0 tx=0).stop 2024-09-10T21:25:45.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.469+0000 7f205c468640 1 -- 172.21.15.59:0/91049819 shutdown_connections 2024-09-10T21:25:45.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.469+0000 7f205c468640 1 --2- 172.21.15.59:0/91049819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2054109120 0x7f205410f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.469+0000 7f205c468640 1 --2- 172.21.15.59:0/91049819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20541087a0 0x7f2054108be0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.469+0000 7f205c468640 1 --2- 172.21.15.59:0/91049819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2054102d90 0x7f2054103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.469+0000 7f205c468640 1 -- 172.21.15.59:0/91049819 >> 172.21.15.59:0/91049819 conn(0x7f20540fe820 msgr2=0x7f2054100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:45.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.469+0000 7f205c468640 1 -- 172.21.15.59:0/91049819 shutdown_connections 2024-09-10T21:25:45.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.469+0000 7f205c468640 1 -- 172.21.15.59:0/91049819 wait complete. 2024-09-10T21:25:45.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f205c468640 1 Processor -- start 2024-09-10T21:25:45.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f205c468640 1 -- start start 2024-09-10T21:25:45.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f205c468640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2054102d90 0x7f20540754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:45.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f205c468640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20541087a0 0x7f20540759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:45.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f205c468640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2054109120 0x7f2054075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:45.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f205c468640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2054112d70 con 0x7f2054102d90 2024-09-10T21:25:45.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f205c468640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2054112bf0 con 0x7f2054109120 2024-09-10T21:25:45.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f205c468640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2054112ef0 con 0x7f20541087a0 2024-09-10T21:25:45.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f205a204640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2054102d90 0x7f20540754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f205a204640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2054102d90 0x7f20540754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34556/0 (socket says 172.21.15.59:34556) 2024-09-10T21:25:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f205a204640 1 -- 172.21.15.59:0/521451877 learned_addr learned my addr 172.21.15.59:0/521451877 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f2059a03640 1 --2- 172.21.15.59:0/521451877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20541087a0 0x7f20540759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f205a204640 1 -- 172.21.15.59:0/521451877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20541087a0 msgr2=0x7f20540759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f205a204640 1 --2- 172.21.15.59:0/521451877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20541087a0 0x7f20540759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f205aa05640 1 --2- 172.21.15.59:0/521451877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2054109120 0x7f2054075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f205a204640 1 -- 172.21.15.59:0/521451877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2054109120 msgr2=0x7f2054075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f205a204640 1 --2- 172.21.15.59:0/521451877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2054109120 0x7f2054075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f205a204640 1 -- 172.21.15.59:0/521451877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20541a7680 con 0x7f2054102d90 2024-09-10T21:25:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f2059a03640 1 --2- 172.21.15.59:0/521451877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20541087a0 0x7f20540759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.470+0000 7f205aa05640 1 --2- 172.21.15.59:0/521451877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2054109120 0x7f2054075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.471+0000 7f205a204640 1 --2- 172.21.15.59:0/521451877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2054102d90 0x7f20540754a0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f204c00d950 tx=0x7f204c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.471+0000 7f20537fe640 1 -- 172.21.15.59:0/521451877 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c017030 con 0x7f2054102d90 2024-09-10T21:25:45.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.471+0000 7f205c468640 1 -- 172.21.15.59:0/521451877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20541a7970 con 0x7f2054102d90 2024-09-10T21:25:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.471+0000 7f20537fe640 1 -- 172.21.15.59:0/521451877 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f204c004020 con 0x7f2054102d90 2024-09-10T21:25:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.471+0000 7f20537fe640 1 -- 172.21.15.59:0/521451877 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c0047a0 con 0x7f2054102d90 2024-09-10T21:25:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.471+0000 7f205c468640 1 -- 172.21.15.59:0/521451877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20541a7eb0 con 0x7f2054102d90 2024-09-10T21:25:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.473+0000 7f20537fe640 1 -- 172.21.15.59:0/521451877 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f204c009a30 con 0x7f2054102d90 2024-09-10T21:25:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.474+0000 7f205e83d740 1 Processor -- start 2024-09-10T21:25:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.474+0000 7f205e83d740 1 -- start start 2024-09-10T21:25:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.474+0000 7f205e83d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd934f64d0 0x55cd934f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.474+0000 7f205e83d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd934f6df0 0x55cd93502840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.474+0000 7f205e83d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd93502d80 0x55cd93505170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.474+0000 7f205e83d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cd9346cea0 con 0x55cd934f6df0 2024-09-10T21:25:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.474+0000 7f205e83d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cd9345c2d0 con 0x55cd934f64d0 2024-09-10T21:25:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.474+0000 7f205e83d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cd934600e0 con 0x55cd93502d80 2024-09-10T21:25:45.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.474+0000 7f205a204640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd934f6df0 0x55cd93502840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.474+0000 7f205a204640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd934f6df0 0x55cd93502840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34562/0 (socket says 172.21.15.59:34562) 2024-09-10T21:25:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.474+0000 7f205a204640 1 -- 172.21.15.59:0/2366425300 learned_addr learned my addr 172.21.15.59:0/2366425300 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.474+0000 7f2059a03640 1 --2- 172.21.15.59:0/2366425300 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd93502d80 0x55cd93505170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.474+0000 7f205aa05640 1 --2- 172.21.15.59:0/2366425300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd934f64d0 0x55cd934f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.474+0000 7f20537fe640 1 --2- 172.21.15.59:0/521451877 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f203c0b52e0 0x7f203c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.475+0000 7f205aa05640 1 --2- 172.21.15.59:0/521451877 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f203c0b52e0 0x7f203c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.475+0000 7f205a204640 1 -- 172.21.15.59:0/2366425300 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd93502d80 msgr2=0x55cd93505170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.475+0000 7f205a204640 1 --2- 172.21.15.59:0/2366425300 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd93502d80 0x55cd93505170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.475+0000 7f205a204640 1 -- 172.21.15.59:0/2366425300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd934f64d0 msgr2=0x55cd934f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.475+0000 7f205a204640 1 --2- 172.21.15.59:0/2366425300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd934f64d0 0x55cd934f68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.475+0000 7f205a204640 1 -- 172.21.15.59:0/2366425300 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd931ba650 con 0x55cd934f6df0 2024-09-10T21:25:45.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.475+0000 7f2059a03640 1 --2- 172.21.15.59:0/2366425300 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd93502d80 0x55cd93505170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:25:45.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.475+0000 7f20537fe640 1 -- 172.21.15.59:0/521451877 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f204c0e5780 con 0x7f2054102d90 2024-09-10T21:25:45.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.475+0000 7f205a204640 1 --2- 172.21.15.59:0/2366425300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd934f6df0 0x55cd93502840 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f204c01ef90 tx=0x7f204c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87266b9bba2e039f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:45.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.475+0000 7f205aa05640 1 --2- 172.21.15.59:0/521451877 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f203c0b52e0 0x7f203c0b77a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2054077560 tx=0x7f2044004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:45.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.475+0000 7f2050de6640 1 -- 172.21.15.59:0/2366425300 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c0abce0 con 0x55cd934f6df0 2024-09-10T21:25:45.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.475+0000 7f2050de6640 1 -- 172.21.15.59:0/2366425300 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f204c0aba20 con 0x55cd934f6df0 2024-09-10T21:25:45.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.475+0000 7f2050de6640 1 -- 172.21.15.59:0/2366425300 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c01ebc0 con 0x55cd934f6df0 2024-09-10T21:25:45.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.476+0000 7f205e83d740 1 -- 172.21.15.59:0/2366425300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd934f6df0 msgr2=0x55cd93502840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:45.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.476+0000 7f205e83d740 1 --2- 172.21.15.59:0/2366425300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd934f6df0 0x55cd93502840 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f204c01ef90 tx=0x7f204c021000 comp rx=0 tx=0).stop 2024-09-10T21:25:45.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.476+0000 7f205e83d740 1 -- 172.21.15.59:0/2366425300 shutdown_connections 2024-09-10T21:25:45.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.476+0000 7f205e83d740 1 --2- 172.21.15.59:0/2366425300 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd93502d80 0x55cd93505170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.476+0000 7f205e83d740 1 --2- 172.21.15.59:0/2366425300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd934f6df0 0x55cd93502840 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.476+0000 7f205e83d740 1 --2- 172.21.15.59:0/2366425300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd934f64d0 0x55cd934f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.476+0000 7f205e83d740 1 -- 172.21.15.59:0/2366425300 >> 172.21.15.59:0/2366425300 conn(0x55cd934f4300 msgr2=0x55cd934f54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:45.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.476+0000 7f205e83d740 1 -- 172.21.15.59:0/2366425300 shutdown_connections 2024-09-10T21:25:45.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.476+0000 7f205e83d740 1 -- 172.21.15.59:0/2366425300 wait complete. 2024-09-10T21:25:45.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.477+0000 7f205e83d740 1 -- start start 2024-09-10T21:25:45.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.477+0000 7f205e83d740 1 Processor -- start 2024-09-10T21:25:45.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.477+0000 7f205e83d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd934f64d0 0x55cd93502650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:45.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.477+0000 7f205e83d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd934f6df0 0x55cd934ffaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:45.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.477+0000 7f205e83d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd93502d80 0x55cd93500080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:45.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.477+0000 7f205e83d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cd932bd700 con 0x55cd934f6df0 2024-09-10T21:25:45.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.477+0000 7f205e83d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cd933f7160 con 0x55cd93502d80 2024-09-10T21:25:45.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.477+0000 7f205e83d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55cd935059a0 con 0x55cd934f64d0 2024-09-10T21:25:45.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.477+0000 7f205e83d740 10 client.0 _ll_register_callbacks cb 0x55cd934109e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:45.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.477+0000 7f2059a03640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd934f6df0 0x55cd934ffaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:45.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.477+0000 7f2059a03640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd934f6df0 0x55cd934ffaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34578/0 (socket says 172.21.15.59:34578) 2024-09-10T21:25:45.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.477+0000 7f2059a03640 1 -- 172.21.15.59:0/3345198201 learned_addr learned my addr 172.21.15.59:0/3345198201 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:45.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.477+0000 7f205aa05640 1 --2- 172.21.15.59:0/3345198201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd93502d80 0x55cd93500080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:45.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.477+0000 7f205a204640 1 --2- 172.21.15.59:0/3345198201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd934f64d0 0x55cd93502650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:45.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.477+0000 7f2059a03640 1 -- 172.21.15.59:0/3345198201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd934f64d0 msgr2=0x55cd93502650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:45.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.477+0000 7f2059a03640 1 --2- 172.21.15.59:0/3345198201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd934f64d0 0x55cd93502650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.477+0000 7f2059a03640 1 -- 172.21.15.59:0/3345198201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd93502d80 msgr2=0x55cd93500080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:45.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.477+0000 7f2059a03640 1 --2- 172.21.15.59:0/3345198201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd93502d80 0x55cd93500080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.477+0000 7f2059a03640 1 -- 172.21.15.59:0/3345198201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd93424c90 con 0x55cd934f6df0 2024-09-10T21:25:45.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.478+0000 7f2059a03640 1 --2- 172.21.15.59:0/3345198201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd934f6df0 0x55cd934ffaa0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f2048009230 tx=0x7f20480316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b937a45105b582 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:45.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.478+0000 7f2039ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:45.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.478+0000 7f2039ffb640 1 -- 172.21.15.59:0/3345198201 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048040070 con 0x55cd934f6df0 2024-09-10T21:25:45.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.478+0000 7f2039ffb640 1 -- 172.21.15.59:0/3345198201 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2048004250 con 0x55cd934f6df0 2024-09-10T21:25:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.478+0000 7f205e83d740 1 -- 172.21.15.59:0/3345198201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f204c0aba20 con 0x55cd934f6df0 2024-09-10T21:25:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.478+0000 7f2039ffb640 1 -- 172.21.15.59:0/3345198201 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2048035040 con 0x55cd934f6df0 2024-09-10T21:25:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.478+0000 7f205e83d740 10 client.17892 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.478+0000 7f205e83d740 1 -- 172.21.15.59:0/3345198201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cd93519ac0 con 0x55cd934f6df0 2024-09-10T21:25:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.478+0000 7f2039ffb640 1 -- 172.21.15.59:0/3345198201 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f204c0aba20 con 0x55cd934f6df0 2024-09-10T21:25:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.478+0000 7f2039ffb640 1 -- 172.21.15.59:0/3345198201 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2048004920 con 0x55cd934f6df0 2024-09-10T21:25:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.478+0000 7f205e83d740 10 client.17892 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.478+0000 7f205e83d740 10 client.17892 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:25:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.478+0000 7f205e83d740 20 client.17892 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.478+0000 7f205e83d740 1 --2- 172.21.15.59:0/3345198201 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55cd9351afd0 0x55cd9351d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.478+0000 7f205e83d740 4 client.17892 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:25:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.478+0000 7f205e83d740 1 -- 172.21.15.59:0/3345198201 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd9346edf0 con 0x55cd9351afd0 2024-09-10T21:25:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.479+0000 7f205a204640 1 --2- 172.21.15.59:0/3345198201 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55cd9351afd0 0x55cd9351d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:45.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.479+0000 7f2039ffb640 10 client.17892 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:25:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.479+0000 7f205a204640 1 --2- 172.21.15.59:0/3345198201 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55cd9351afd0 0x55cd9351d3c0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fce20453418fd02b server_cookie=a8c61c8329de012d in_seq=0 out_seq=0 2024-09-10T21:25:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.480+0000 7f2039ffb640 1 -- 172.21.15.59:0/3345198201 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cd9346edf0 con 0x55cd9351afd0 2024-09-10T21:25:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.480+0000 7f2039ffb640 10 client.17892 handle_command_reply: tid=0 2024-09-10T21:25:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.480+0000 7f205e83d740 1 client.17892 shutdown 2024-09-10T21:25:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.480+0000 7f205e83d740 1 -- 172.21.15.59:0/3345198201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd934f6df0 msgr2=0x55cd934ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.480+0000 7f205e83d740 1 --2- 172.21.15.59:0/3345198201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd934f6df0 0x55cd934ffaa0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f2048009230 tx=0x7f20480316d0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.480+0000 7f205e83d740 1 -- 172.21.15.59:0/3345198201 shutdown_connections 2024-09-10T21:25:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.480+0000 7f205e83d740 1 --2- 172.21.15.59:0/3345198201 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55cd9351afd0 0x55cd9351d3c0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.480+0000 7f205e83d740 1 --2- 172.21.15.59:0/3345198201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd93502d80 0x55cd93500080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.480+0000 7f205e83d740 1 --2- 172.21.15.59:0/3345198201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd934f6df0 0x55cd934ffaa0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.480+0000 7f2039ffb640 0 client.17892 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:25:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.480+0000 7f205e83d740 1 --2- 172.21.15.59:0/3345198201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd934f64d0 0x55cd93502650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.480+0000 7f205e83d740 1 -- 172.21.15.59:0/3345198201 >> 172.21.15.59:0/3345198201 conn(0x55cd934f4300 msgr2=0x55cd934f9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.480+0000 7f205e83d740 1 -- 172.21.15.59:0/3345198201 shutdown_connections 2024-09-10T21:25:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.480+0000 7f205e83d740 1 -- 172.21.15.59:0/3345198201 wait complete. 2024-09-10T21:25:45.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.480+0000 7f205e83d740 20 client.17892 trim_cache size 0 max 16384 2024-09-10T21:25:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.494+0000 7f205e83d740 1 Processor -- start 2024-09-10T21:25:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.494+0000 7f205e83d740 1 -- start start 2024-09-10T21:25:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.494+0000 7f205e83d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd934f64d0 0x55cd934f5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.494+0000 7f205e83d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd934f6df0 0x55cd93504170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.494+0000 7f205e83d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd93502d80 0x55cd935046b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.494+0000 7f205e83d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f20541ac160 con 0x55cd93502d80 2024-09-10T21:25:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.494+0000 7f205e83d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20541adca0 con 0x55cd934f64d0 2024-09-10T21:25:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.494+0000 7f205e83d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f20541ac830 con 0x55cd934f6df0 2024-09-10T21:25:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.494+0000 7f205aa05640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd93502d80 0x55cd935046b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.494+0000 7f205aa05640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd93502d80 0x55cd935046b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34580/0 (socket says 172.21.15.59:34580) 2024-09-10T21:25:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.494+0000 7f205aa05640 1 -- 172.21.15.59:0/1968807214 learned_addr learned my addr 172.21.15.59:0/1968807214 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:45.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.494+0000 7f2059a03640 1 --2- 172.21.15.59:0/1968807214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd934f6df0 0x55cd93504170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.494+0000 7f205a204640 1 --2- 172.21.15.59:0/1968807214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd934f64d0 0x55cd934f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.495+0000 7f205aa05640 1 -- 172.21.15.59:0/1968807214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd934f6df0 msgr2=0x55cd93504170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.495+0000 7f205aa05640 1 --2- 172.21.15.59:0/1968807214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd934f6df0 0x55cd93504170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.495+0000 7f205aa05640 1 -- 172.21.15.59:0/1968807214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd934f64d0 msgr2=0x55cd934f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.495+0000 7f205aa05640 1 --2- 172.21.15.59:0/1968807214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd934f64d0 0x55cd934f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.495+0000 7f205aa05640 1 -- 172.21.15.59:0/1968807214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd9351d730 con 0x55cd93502d80 2024-09-10T21:25:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.495+0000 7f205a204640 1 --2- 172.21.15.59:0/1968807214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd934f64d0 0x55cd934f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:25:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.495+0000 7f205aa05640 1 --2- 172.21.15.59:0/1968807214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd93502d80 0x55cd935046b0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f204400b860 tx=0x7f20440099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e1201da884c33b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.495+0000 7f203bfff640 1 -- 172.21.15.59:0/1968807214 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044019070 con 0x55cd93502d80 2024-09-10T21:25:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.495+0000 7f203bfff640 1 -- 172.21.15.59:0/1968807214 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2044003e20 con 0x55cd93502d80 2024-09-10T21:25:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.495+0000 7f203bfff640 1 -- 172.21.15.59:0/1968807214 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044004560 con 0x55cd93502d80 2024-09-10T21:25:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.495+0000 7f205e83d740 1 -- 172.21.15.59:0/1968807214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd93502d80 msgr2=0x55cd935046b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.495+0000 7f205e83d740 1 --2- 172.21.15.59:0/1968807214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd93502d80 0x55cd935046b0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f204400b860 tx=0x7f20440099e0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.496+0000 7f205e83d740 1 -- 172.21.15.59:0/1968807214 shutdown_connections 2024-09-10T21:25:45.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.496+0000 7f205e83d740 1 --2- 172.21.15.59:0/1968807214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd93502d80 0x55cd935046b0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.496+0000 7f205e83d740 1 --2- 172.21.15.59:0/1968807214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd934f6df0 0x55cd93504170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.496+0000 7f205e83d740 1 --2- 172.21.15.59:0/1968807214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd934f64d0 0x55cd934f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.496+0000 7f205e83d740 1 -- 172.21.15.59:0/1968807214 >> 172.21.15.59:0/1968807214 conn(0x55cd934f4300 msgr2=0x55cd934f5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.496+0000 7f205e83d740 1 -- 172.21.15.59:0/1968807214 shutdown_connections 2024-09-10T21:25:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.496+0000 7f205e83d740 1 -- 172.21.15.59:0/1968807214 wait complete. 2024-09-10T21:25:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.496+0000 7f205e83d740 1 -- start start 2024-09-10T21:25:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.496+0000 7f205e83d740 1 Processor -- start 2024-09-10T21:25:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.496+0000 7f205e83d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd934f64d0 0x55cd935134d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.496+0000 7f205e83d740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd934f6df0 0x55cd93513a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.496+0000 7f205e83d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd93502d80 0x55cd9350e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.496+0000 7f205e83d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f20541ad5d0 con 0x55cd93502d80 2024-09-10T21:25:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.496+0000 7f205e83d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f20541acf00 con 0x55cd934f64d0 2024-09-10T21:25:45.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.496+0000 7f205e83d740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f20541aa160 con 0x55cd934f6df0 2024-09-10T21:25:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.496+0000 7f205e83d740 10 client.0 _ll_register_callbacks cb 0x7f2048009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.497+0000 7f205aa05640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd93502d80 0x55cd9350e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.497+0000 7f205aa05640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd93502d80 0x55cd9350e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34584/0 (socket says 172.21.15.59:34584) 2024-09-10T21:25:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.497+0000 7f205aa05640 1 -- 172.21.15.59:0/16234479 learned_addr learned my addr 172.21.15.59:0/16234479 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.497+0000 7f2059a03640 1 --2- 172.21.15.59:0/16234479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd934f6df0 0x55cd93513a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.497+0000 7f205a204640 1 --2- 172.21.15.59:0/16234479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd934f64d0 0x55cd935134d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.497+0000 7f205aa05640 1 -- 172.21.15.59:0/16234479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd934f6df0 msgr2=0x55cd93513a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.497+0000 7f205aa05640 1 --2- 172.21.15.59:0/16234479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd934f6df0 0x55cd93513a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.497+0000 7f205aa05640 1 -- 172.21.15.59:0/16234479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd934f64d0 msgr2=0x55cd935134d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.497+0000 7f205aa05640 1 --2- 172.21.15.59:0/16234479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd934f64d0 0x55cd935134d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.497+0000 7f205aa05640 1 -- 172.21.15.59:0/16234479 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd9350ea70 con 0x55cd93502d80 2024-09-10T21:25:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.497+0000 7f205aa05640 1 --2- 172.21.15.59:0/16234479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd93502d80 0x55cd9350e480 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f2044004a80 tx=0x7f2044003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68e0ad1d49c13af server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.497+0000 7f2039ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:45.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.497+0000 7f2039ffb640 1 -- 172.21.15.59:0/16234479 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044039060 con 0x55cd93502d80 2024-09-10T21:25:45.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.497+0000 7f205e83d740 1 -- 172.21.15.59:0/16234479 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2044003e20 con 0x55cd93502d80 2024-09-10T21:25:45.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.497+0000 7f2039ffb640 1 -- 172.21.15.59:0/16234479 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2044021da0 con 0x55cd93502d80 2024-09-10T21:25:45.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.497+0000 7f2039ffb640 1 -- 172.21.15.59:0/16234479 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2044019040 con 0x55cd93502d80 2024-09-10T21:25:45.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.497+0000 7f205e83d740 10 client.17898 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:45.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.497+0000 7f205e83d740 1 -- 172.21.15.59:0/16234479 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cd93588720 con 0x55cd93502d80 2024-09-10T21:25:45.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.498+0000 7f2039ffb640 1 -- 172.21.15.59:0/16234479 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2044003e20 con 0x55cd93502d80 2024-09-10T21:25:45.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.498+0000 7f2039ffb640 1 -- 172.21.15.59:0/16234479 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2044033030 con 0x55cd93502d80 2024-09-10T21:25:45.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.498+0000 7f205e83d740 10 client.17898 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:45.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.498+0000 7f205e83d740 10 client.17898 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:25:45.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.498+0000 7f205e83d740 20 client.17898 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:45.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.498+0000 7f205e83d740 1 --2- 172.21.15.59:0/16234479 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55cd93588d40 0x55cd9358b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:45.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.498+0000 7f205e83d740 4 client.17898 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:25:45.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.498+0000 7f205e83d740 1 -- 172.21.15.59:0/16234479 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cd9346a8a0 con 0x55cd93588d40 2024-09-10T21:25:45.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.498+0000 7f205a204640 1 --2- 172.21.15.59:0/16234479 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55cd93588d40 0x55cd9358b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:45.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.499+0000 7f205a204640 1 --2- 172.21.15.59:0/16234479 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55cd93588d40 0x55cd9358b160 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ac6edce11315ba1a server_cookie=af20a6f4d4e262a6 in_seq=0 out_seq=0 2024-09-10T21:25:45.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.499+0000 7f2039ffb640 10 client.17898 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:25:45.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.499+0000 7f2039ffb640 1 -- 172.21.15.59:0/16234479 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cd9346a8a0 con 0x55cd93588d40 2024-09-10T21:25:45.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.499+0000 7f2039ffb640 10 client.17898 handle_command_reply: tid=0 2024-09-10T21:25:45.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.499+0000 7f205e83d740 1 client.17898 shutdown 2024-09-10T21:25:45.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.499+0000 7f205e83d740 1 -- 172.21.15.59:0/16234479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd93502d80 msgr2=0x55cd9350e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:45.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.499+0000 7f205e83d740 1 --2- 172.21.15.59:0/16234479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd93502d80 0x55cd9350e480 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f2044004a80 tx=0x7f2044003ba0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.499+0000 7f205e83d740 1 -- 172.21.15.59:0/16234479 shutdown_connections 2024-09-10T21:25:45.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.499+0000 7f205e83d740 1 --2- 172.21.15.59:0/16234479 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x55cd93588d40 0x55cd9358b160 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.499+0000 7f205e83d740 1 --2- 172.21.15.59:0/16234479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cd93502d80 0x55cd9350e480 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.499+0000 7f205e83d740 1 --2- 172.21.15.59:0/16234479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55cd934f6df0 0x55cd93513a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.499+0000 7f205e83d740 1 --2- 172.21.15.59:0/16234479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cd934f64d0 0x55cd935134d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.499+0000 7f2039ffb640 0 client.17898 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:25:45.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.499+0000 7f205e83d740 1 -- 172.21.15.59:0/16234479 >> 172.21.15.59:0/16234479 conn(0x55cd934f4300 msgr2=0x55cd934f2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:45.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.499+0000 7f205e83d740 1 -- 172.21.15.59:0/16234479 shutdown_connections 2024-09-10T21:25:45.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.499+0000 7f205e83d740 1 -- 172.21.15.59:0/16234479 wait complete. 2024-09-10T21:25:45.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.499+0000 7f205e83d740 20 client.17898 trim_cache size 0 max 16384 2024-09-10T21:25:45.508 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:25:45.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.500+0000 7f205c468640 1 -- 172.21.15.59:0/521451877 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f203c0b52e0 msgr2=0x7f203c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:45.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.500+0000 7f205c468640 1 --2- 172.21.15.59:0/521451877 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f203c0b52e0 0x7f203c0b77a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2054077560 tx=0x7f2044004ab0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.500+0000 7f205c468640 1 -- 172.21.15.59:0/521451877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2054102d90 msgr2=0x7f20540754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:45.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.500+0000 7f205c468640 1 --2- 172.21.15.59:0/521451877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2054102d90 0x7f20540754a0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f204c00d950 tx=0x7f204c00de10 comp rx=0 tx=0).stop 2024-09-10T21:25:45.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.500+0000 7f205c468640 1 -- 172.21.15.59:0/521451877 shutdown_connections 2024-09-10T21:25:45.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.500+0000 7f205c468640 1 --2- 172.21.15.59:0/521451877 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f203c0b52e0 0x7f203c0b77a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.500+0000 7f205c468640 1 --2- 172.21.15.59:0/521451877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2054109120 0x7f2054075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.500+0000 7f205c468640 1 --2- 172.21.15.59:0/521451877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20541087a0 0x7f20540759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.500+0000 7f205c468640 1 --2- 172.21.15.59:0/521451877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2054102d90 0x7f20540754a0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:45.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.500+0000 7f205c468640 1 -- 172.21.15.59:0/521451877 >> 172.21.15.59:0/521451877 conn(0x7f20540fe820 msgr2=0x7f2054100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:45.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.500+0000 7f205c468640 1 -- 172.21.15.59:0/521451877 shutdown_connections 2024-09-10T21:25:45.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:45.500+0000 7f205c468640 1 -- 172.21.15.59:0/521451877 wait complete. 2024-09-10T21:25:46.323 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:25:46.584 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:25:46.963 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:46 smithi059 ceph-mon[30888]: pgmap v655: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:25:47.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.045+0000 7fec9fb66640 1 -- 172.21.15.59:0/4041571360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec98109150 msgr2=0x7fec9810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:47.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.045+0000 7fec9fb66640 1 --2- 172.21.15.59:0/4041571360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec98109150 0x7fec9810f950 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fec90009ca0 tx=0x7fec9002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.045+0000 7fec9fb66640 1 -- 172.21.15.59:0/4041571360 shutdown_connections 2024-09-10T21:25:47.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.045+0000 7fec9fb66640 1 --2- 172.21.15.59:0/4041571360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec98109150 0x7fec9810f950 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.045+0000 7fec9fb66640 1 --2- 172.21.15.59:0/4041571360 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec981087d0 0x7fec98108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.045+0000 7fec9fb66640 1 --2- 172.21.15.59:0/4041571360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec98102dc0 0x7fec981031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.045+0000 7fec9fb66640 1 -- 172.21.15.59:0/4041571360 >> 172.21.15.59:0/4041571360 conn(0x7fec980fe830 msgr2=0x7fec98100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:47.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.045+0000 7fec9fb66640 1 -- 172.21.15.59:0/4041571360 shutdown_connections 2024-09-10T21:25:47.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.045+0000 7fec9fb66640 1 -- 172.21.15.59:0/4041571360 wait complete. 2024-09-10T21:25:47.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.046+0000 7fec9fb66640 1 Processor -- start 2024-09-10T21:25:47.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.046+0000 7fec9fb66640 1 -- start start 2024-09-10T21:25:47.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.046+0000 7fec9fb66640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec98102dc0 0x7fec980754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:47.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.046+0000 7fec9fb66640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec981087d0 0x7fec980759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:47.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.046+0000 7fec9fb66640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec98109150 0x7fec98075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:47.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.046+0000 7fec9fb66640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fec98112dd0 con 0x7fec98109150 2024-09-10T21:25:47.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.046+0000 7fec9fb66640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec98112c50 con 0x7fec981087d0 2024-09-10T21:25:47.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.046+0000 7fec9fb66640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fec98112f50 con 0x7fec98102dc0 2024-09-10T21:25:47.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.046+0000 7fec9e103640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec98109150 0x7fec98075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:47.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.046+0000 7fec9e103640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec98109150 0x7fec98075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34600/0 (socket says 172.21.15.59:34600) 2024-09-10T21:25:47.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.046+0000 7fec9e103640 1 -- 172.21.15.59:0/1885784396 learned_addr learned my addr 172.21.15.59:0/1885784396 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:47.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.046+0000 7fec9d902640 1 --2- 172.21.15.59:0/1885784396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec98102dc0 0x7fec980754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:47.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.047+0000 7fec9d101640 1 --2- 172.21.15.59:0/1885784396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec981087d0 0x7fec980759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:47.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.047+0000 7fec9e103640 1 -- 172.21.15.59:0/1885784396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec98102dc0 msgr2=0x7fec980754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:47.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.047+0000 7fec9e103640 1 --2- 172.21.15.59:0/1885784396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec98102dc0 0x7fec980754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.047+0000 7fec9e103640 1 -- 172.21.15.59:0/1885784396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec981087d0 msgr2=0x7fec980759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:47.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.047+0000 7fec9e103640 1 --2- 172.21.15.59:0/1885784396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec981087d0 0x7fec980759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.047+0000 7fec9e103640 1 -- 172.21.15.59:0/1885784396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec981a7680 con 0x7fec98109150 2024-09-10T21:25:47.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.047+0000 7fec9d101640 1 --2- 172.21.15.59:0/1885784396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec981087d0 0x7fec980759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:47.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.047+0000 7fec9e103640 1 --2- 172.21.15.59:0/1885784396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec98109150 0x7fec98075f20 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fec90005cc0 tx=0x7fec9002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:47.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.047+0000 7fec8effd640 1 -- 172.21.15.59:0/1885784396 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec90003bf0 con 0x7fec98109150 2024-09-10T21:25:47.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.047+0000 7fec8effd640 1 -- 172.21.15.59:0/1885784396 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec90003d90 con 0x7fec98109150 2024-09-10T21:25:47.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.047+0000 7fec9fb66640 1 -- 172.21.15.59:0/1885784396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec981a7910 con 0x7fec98109150 2024-09-10T21:25:47.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.047+0000 7fec8effd640 1 -- 172.21.15.59:0/1885784396 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9002fbc0 con 0x7fec98109150 2024-09-10T21:25:47.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.047+0000 7fec9fb66640 1 -- 172.21.15.59:0/1885784396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec981a7e50 con 0x7fec98109150 2024-09-10T21:25:47.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.050+0000 7fec8effd640 1 -- 172.21.15.59:0/1885784396 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fec90004610 con 0x7fec98109150 2024-09-10T21:25:47.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.050+0000 7feca1f3b740 1 Processor -- start 2024-09-10T21:25:47.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.050+0000 7feca1f3b740 1 -- start start 2024-09-10T21:25:47.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.050+0000 7feca1f3b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b79160f0 0x5563b79164d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:47.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.050+0000 7feca1f3b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b7916a10 0x5563b7922460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:47.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.050+0000 7feca1f3b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 0x5563b7924d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:47.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.050+0000 7feca1f3b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5563b788cea0 con 0x5563b79229a0 2024-09-10T21:25:47.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.050+0000 7feca1f3b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5563b787c2d0 con 0x5563b7916a10 2024-09-10T21:25:47.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.050+0000 7feca1f3b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5563b78800e0 con 0x5563b79160f0 2024-09-10T21:25:47.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.051+0000 7fec9d101640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 0x5563b7924d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:47.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.051+0000 7fec9d101640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 0x5563b7924d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34602/0 (socket says 172.21.15.59:34602) 2024-09-10T21:25:47.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.051+0000 7fec9d101640 1 -- 172.21.15.59:0/4212599419 learned_addr learned my addr 172.21.15.59:0/4212599419 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:47.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.051+0000 7fec9d101640 1 --2- 172.21.15.59:0/4212599419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b79160f0 0x5563b79164d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:47.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.051+0000 7fec9d902640 1 --2- 172.21.15.59:0/4212599419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b7916a10 0x5563b7922460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:47.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.051+0000 7fec8effd640 1 --2- 172.21.15.59:0/1885784396 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fec840b52e0 0x7fec840b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:47.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.051+0000 7fec9d101640 1 -- 172.21.15.59:0/4212599419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b79160f0 msgr2=0x5563b79164d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:47.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.051+0000 7fec9d101640 1 --2- 172.21.15.59:0/4212599419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b79160f0 0x5563b79164d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.051+0000 7fec9d101640 1 -- 172.21.15.59:0/4212599419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b7916a10 msgr2=0x5563b7922460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.051+0000 7fec9d101640 1 --2- 172.21.15.59:0/4212599419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b7916a10 0x5563b7922460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.051+0000 7fec9d101640 1 -- 172.21.15.59:0/4212599419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563b75da650 con 0x5563b79229a0 2024-09-10T21:25:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.051+0000 7fec9e103640 1 --2- 172.21.15.59:0/1885784396 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fec840b52e0 0x7fec840b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.051+0000 7fec9d902640 1 --2- 172.21.15.59:0/4212599419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b7916a10 0x5563b7922460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:25:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.051+0000 7fec8effd640 1 -- 172.21.15.59:0/1885784396 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fec901070a0 con 0x7fec98109150 2024-09-10T21:25:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.051+0000 7fec9d101640 1 --2- 172.21.15.59:0/4212599419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 0x5563b7924d90 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fec88012820 tx=0x7fec8800d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a12010b3fbd8c38 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.051+0000 7fec83fff640 1 -- 172.21.15.59:0/4212599419 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88012e60 con 0x5563b79229a0 2024-09-10T21:25:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.051+0000 7fec83fff640 1 -- 172.21.15.59:0/4212599419 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec880103d0 con 0x5563b79229a0 2024-09-10T21:25:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.051+0000 7fec83fff640 1 -- 172.21.15.59:0/4212599419 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8800f620 con 0x5563b79229a0 2024-09-10T21:25:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.052+0000 7feca1f3b740 1 -- 172.21.15.59:0/4212599419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 msgr2=0x5563b7924d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.052+0000 7fec9e103640 1 --2- 172.21.15.59:0/1885784396 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fec840b52e0 0x7fec840b77a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fec900cd590 tx=0x7fec90092060 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.052+0000 7feca1f3b740 1 --2- 172.21.15.59:0/4212599419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 0x5563b7924d90 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fec88012820 tx=0x7fec8800d3c0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.052+0000 7feca1f3b740 1 -- 172.21.15.59:0/4212599419 shutdown_connections 2024-09-10T21:25:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.052+0000 7feca1f3b740 1 --2- 172.21.15.59:0/4212599419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 0x5563b7924d90 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.052+0000 7feca1f3b740 1 --2- 172.21.15.59:0/4212599419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b7916a10 0x5563b7922460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.052+0000 7feca1f3b740 1 --2- 172.21.15.59:0/4212599419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b79160f0 0x5563b79164d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.052+0000 7feca1f3b740 1 -- 172.21.15.59:0/4212599419 >> 172.21.15.59:0/4212599419 conn(0x5563b7913f20 msgr2=0x5563b79150c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.052+0000 7feca1f3b740 1 -- 172.21.15.59:0/4212599419 shutdown_connections 2024-09-10T21:25:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.052+0000 7feca1f3b740 1 -- 172.21.15.59:0/4212599419 wait complete. 2024-09-10T21:25:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.053+0000 7feca1f3b740 1 -- start start 2024-09-10T21:25:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.053+0000 7feca1f3b740 1 Processor -- start 2024-09-10T21:25:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.053+0000 7feca1f3b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b79160f0 0x5563b7922270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.053+0000 7feca1f3b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b7916a10 0x5563b791f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.053+0000 7feca1f3b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 0x5563b791fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.053+0000 7feca1f3b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5563b76dd700 con 0x5563b79229a0 2024-09-10T21:25:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.053+0000 7feca1f3b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5563b7817160 con 0x5563b7916a10 2024-09-10T21:25:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.053+0000 7feca1f3b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5563b7925620 con 0x5563b79160f0 2024-09-10T21:25:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.053+0000 7feca1f3b740 10 client.0 _ll_register_callbacks cb 0x5563b78309e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.053+0000 7fec9d101640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 0x5563b791fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.053+0000 7fec9d101640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 0x5563b791fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34612/0 (socket says 172.21.15.59:34612) 2024-09-10T21:25:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.053+0000 7fec9d101640 1 -- 172.21.15.59:0/4210026238 learned_addr learned my addr 172.21.15.59:0/4210026238 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.053+0000 7fec9d902640 1 --2- 172.21.15.59:0/4210026238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b7916a10 0x5563b791f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.054+0000 7fec9d101640 1 -- 172.21.15.59:0/4210026238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b79160f0 msgr2=0x5563b7922270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.054+0000 7fec9d101640 1 --2- 172.21.15.59:0/4210026238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b79160f0 0x5563b7922270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.054+0000 7fec9d101640 1 -- 172.21.15.59:0/4210026238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b7916a10 msgr2=0x5563b791f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.054+0000 7fec9d101640 1 --2- 172.21.15.59:0/4210026238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b7916a10 0x5563b791f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.054+0000 7fec9d101640 1 -- 172.21.15.59:0/4210026238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563b7844c90 con 0x5563b79229a0 2024-09-10T21:25:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.054+0000 7fec9d902640 1 --2- 172.21.15.59:0/4210026238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b7916a10 0x5563b791f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.054+0000 7fec9d101640 1 --2- 172.21.15.59:0/4210026238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 0x5563b791fca0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fec880058c0 tx=0x7fec8800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef25eff58ad8bef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.054+0000 7fec817fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.054+0000 7fec817fa640 1 -- 172.21.15.59:0/4210026238 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88012e60 con 0x5563b79229a0 2024-09-10T21:25:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.054+0000 7feca1f3b740 1 -- 172.21.15.59:0/4210026238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec880103d0 con 0x5563b79229a0 2024-09-10T21:25:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.054+0000 7fec817fa640 1 -- 172.21.15.59:0/4210026238 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fec88010790 con 0x5563b79229a0 2024-09-10T21:25:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.054+0000 7fec817fa640 1 -- 172.21.15.59:0/4210026238 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fec88010ea0 con 0x5563b79229a0 2024-09-10T21:25:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.054+0000 7feca1f3b740 10 client.17910 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.054+0000 7feca1f3b740 1 -- 172.21.15.59:0/4210026238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5563b7930f60 con 0x5563b79229a0 2024-09-10T21:25:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.054+0000 7fec817fa640 1 -- 172.21.15.59:0/4210026238 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec880103d0 con 0x5563b79229a0 2024-09-10T21:25:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.054+0000 7fec817fa640 1 -- 172.21.15.59:0/4210026238 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fec88026730 con 0x5563b79229a0 2024-09-10T21:25:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.055+0000 7feca1f3b740 10 client.17910 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.055+0000 7feca1f3b740 10 client.17910 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:25:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.055+0000 7feca1f3b740 20 client.17910 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.055+0000 7feca1f3b740 1 --2- 172.21.15.59:0/4210026238 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5563b79322b0 0x5563b79346a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.055+0000 7feca1f3b740 4 client.17910 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:25:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.055+0000 7feca1f3b740 1 -- 172.21.15.59:0/4210026238 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563b788edf0 con 0x5563b79322b0 2024-09-10T21:25:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.055+0000 7fec9d902640 1 --2- 172.21.15.59:0/4210026238 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5563b79322b0 0x5563b79346a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.055+0000 7fec817fa640 10 client.17910 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:25:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.055+0000 7fec9d902640 1 --2- 172.21.15.59:0/4210026238 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5563b79322b0 0x5563b79346a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6ce6b78e8aa0b2a4 server_cookie=5ce0136c02b74715 in_seq=0 out_seq=0 2024-09-10T21:25:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.056+0000 7fec817fa640 1 -- 172.21.15.59:0/4210026238 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5563b788edf0 con 0x5563b79322b0 2024-09-10T21:25:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.056+0000 7fec817fa640 10 client.17910 handle_command_reply: tid=0 2024-09-10T21:25:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.056+0000 7feca1f3b740 1 client.17910 shutdown 2024-09-10T21:25:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.056+0000 7feca1f3b740 1 -- 172.21.15.59:0/4210026238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 msgr2=0x5563b791fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.056+0000 7feca1f3b740 1 --2- 172.21.15.59:0/4210026238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 0x5563b791fca0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fec880058c0 tx=0x7fec8800dd40 comp rx=0 tx=0).stop 2024-09-10T21:25:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.056+0000 7feca1f3b740 1 -- 172.21.15.59:0/4210026238 shutdown_connections 2024-09-10T21:25:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.056+0000 7feca1f3b740 1 --2- 172.21.15.59:0/4210026238 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5563b79322b0 0x5563b79346a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.056+0000 7feca1f3b740 1 --2- 172.21.15.59:0/4210026238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 0x5563b791fca0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.056+0000 7feca1f3b740 1 --2- 172.21.15.59:0/4210026238 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b7916a10 0x5563b791f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.056+0000 7feca1f3b740 1 --2- 172.21.15.59:0/4210026238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b79160f0 0x5563b7922270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.056+0000 7fec817fa640 0 client.17910 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:25:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.056+0000 7feca1f3b740 1 -- 172.21.15.59:0/4210026238 >> 172.21.15.59:0/4210026238 conn(0x5563b7913f20 msgr2=0x5563b7919a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.056+0000 7feca1f3b740 1 -- 172.21.15.59:0/4210026238 shutdown_connections 2024-09-10T21:25:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.056+0000 7feca1f3b740 1 -- 172.21.15.59:0/4210026238 wait complete. 2024-09-10T21:25:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.056+0000 7feca1f3b740 20 client.17910 trim_cache size 0 max 16384 2024-09-10T21:25:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.070+0000 7feca1f3b740 1 Processor -- start 2024-09-10T21:25:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.070+0000 7feca1f3b740 1 -- start start 2024-09-10T21:25:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.070+0000 7feca1f3b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b79160f0 0x5563b7913760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.070+0000 7feca1f3b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b7916a10 0x5563b7921400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.070+0000 7feca1f3b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 0x5563b791c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.070+0000 7feca1f3b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fec981b04b0 con 0x5563b79229a0 2024-09-10T21:25:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.070+0000 7feca1f3b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec981b1ff0 con 0x5563b7916a10 2024-09-10T21:25:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.070+0000 7feca1f3b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fec981b0b80 con 0x5563b79160f0 2024-09-10T21:25:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.070+0000 7fec9d101640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 0x5563b791c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:47.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.070+0000 7fec9d101640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 0x5563b791c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34618/0 (socket says 172.21.15.59:34618) 2024-09-10T21:25:47.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.070+0000 7fec9d101640 1 -- 172.21.15.59:0/1507265304 learned_addr learned my addr 172.21.15.59:0/1507265304 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:47.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.070+0000 7fec9d902640 1 --2- 172.21.15.59:0/1507265304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b7916a10 0x5563b7921400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:47.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.070+0000 7fec9d101640 1 --2- 172.21.15.59:0/1507265304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b79160f0 0x5563b7913760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:47.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.070+0000 7fec9d101640 1 -- 172.21.15.59:0/1507265304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b79160f0 msgr2=0x5563b7913760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:47.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.070+0000 7fec9d101640 1 --2- 172.21.15.59:0/1507265304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b79160f0 0x5563b7913760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.070+0000 7fec9d101640 1 -- 172.21.15.59:0/1507265304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b7916a10 msgr2=0x5563b7921400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:47.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.070+0000 7fec9d101640 1 --2- 172.21.15.59:0/1507265304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b7916a10 0x5563b7921400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.070+0000 7fec9d101640 1 -- 172.21.15.59:0/1507265304 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563b79149a0 con 0x5563b79229a0 2024-09-10T21:25:47.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.071+0000 7fec9d101640 1 --2- 172.21.15.59:0/1507265304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 0x5563b791c8d0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fec8800ddb0 tx=0x7fec8800d860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4793bf3ecb939395 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:47.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.071+0000 7fec837fe640 1 -- 172.21.15.59:0/1507265304 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec880103d0 con 0x5563b79229a0 2024-09-10T21:25:47.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.071+0000 7fec837fe640 1 -- 172.21.15.59:0/1507265304 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec88005c20 con 0x5563b79229a0 2024-09-10T21:25:47.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.071+0000 7fec837fe640 1 -- 172.21.15.59:0/1507265304 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88026690 con 0x5563b79229a0 2024-09-10T21:25:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.071+0000 7feca1f3b740 1 -- 172.21.15.59:0/1507265304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 msgr2=0x5563b791c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.071+0000 7feca1f3b740 1 --2- 172.21.15.59:0/1507265304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 0x5563b791c8d0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fec8800ddb0 tx=0x7fec8800d860 comp rx=0 tx=0).stop 2024-09-10T21:25:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.071+0000 7feca1f3b740 1 -- 172.21.15.59:0/1507265304 shutdown_connections 2024-09-10T21:25:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.071+0000 7feca1f3b740 1 --2- 172.21.15.59:0/1507265304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b79229a0 0x5563b791c8d0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.071+0000 7feca1f3b740 1 --2- 172.21.15.59:0/1507265304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b7916a10 0x5563b7921400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.071+0000 7feca1f3b740 1 --2- 172.21.15.59:0/1507265304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b79160f0 0x5563b7913760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.071+0000 7feca1f3b740 1 -- 172.21.15.59:0/1507265304 >> 172.21.15.59:0/1507265304 conn(0x5563b7913f20 msgr2=0x5563b7920cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.072+0000 7feca1f3b740 1 -- 172.21.15.59:0/1507265304 shutdown_connections 2024-09-10T21:25:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.072+0000 7feca1f3b740 1 -- 172.21.15.59:0/1507265304 wait complete. 2024-09-10T21:25:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.072+0000 7feca1f3b740 1 -- start start 2024-09-10T21:25:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.072+0000 7feca1f3b740 1 Processor -- start 2024-09-10T21:25:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.072+0000 7feca1f3b740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b79160f0 0x5563b7926d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.072+0000 7feca1f3b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b7916a10 0x5563b7927260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7feca1f3b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b79229a0 0x5563b799e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7feca1f3b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fec981b1920 con 0x5563b7916a10 2024-09-10T21:25:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7feca1f3b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec981b1250 con 0x5563b79229a0 2024-09-10T21:25:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7feca1f3b740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fec981ae490 con 0x5563b79160f0 2024-09-10T21:25:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7feca1f3b740 10 client.0 _ll_register_callbacks cb 0x7fec8800dde0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7fec9d902640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b7916a10 0x5563b7927260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7fec9d902640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b7916a10 0x5563b7927260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34628/0 (socket says 172.21.15.59:34628) 2024-09-10T21:25:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7fec9d902640 1 -- 172.21.15.59:0/180045451 learned_addr learned my addr 172.21.15.59:0/180045451 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7fec9d101640 1 --2- 172.21.15.59:0/180045451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b79229a0 0x5563b799e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7fec9d101640 1 --2- 172.21.15.59:0/180045451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b79160f0 0x5563b7926d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7fec9d902640 1 -- 172.21.15.59:0/180045451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b79160f0 msgr2=0x5563b7926d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7fec9d902640 1 --2- 172.21.15.59:0/180045451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b79160f0 0x5563b7926d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7fec9d902640 1 -- 172.21.15.59:0/180045451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b79229a0 msgr2=0x5563b799e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7fec9d902640 1 --2- 172.21.15.59:0/180045451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b79229a0 0x5563b799e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7fec9d902640 1 -- 172.21.15.59:0/180045451 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563b799e5a0 con 0x5563b7916a10 2024-09-10T21:25:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7fec9d902640 1 --2- 172.21.15.59:0/180045451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b7916a10 0x5563b7927260 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x5563b7934e00 tx=0x7fec9400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab2937a1918bb23 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7fec817fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7fec817fa640 1 -- 172.21.15.59:0/180045451 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec94028060 con 0x5563b7916a10 2024-09-10T21:25:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7fec817fa640 1 -- 172.21.15.59:0/180045451 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fec94012450 con 0x5563b7916a10 2024-09-10T21:25:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.073+0000 7feca1f3b740 1 -- 172.21.15.59:0/180045451 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec88005c20 con 0x5563b7916a10 2024-09-10T21:25:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.074+0000 7fec817fa640 1 -- 172.21.15.59:0/180045451 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fec94003f70 con 0x5563b7916a10 2024-09-10T21:25:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.074+0000 7feca1f3b740 10 client.17916 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.074+0000 7feca1f3b740 1 -- 172.21.15.59:0/180045451 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5563b799f8e0 con 0x5563b7916a10 2024-09-10T21:25:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.074+0000 7fec817fa640 1 -- 172.21.15.59:0/180045451 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec88005c20 con 0x5563b7916a10 2024-09-10T21:25:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.074+0000 7fec817fa640 1 -- 172.21.15.59:0/180045451 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fec94023810 con 0x5563b7916a10 2024-09-10T21:25:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.074+0000 7feca1f3b740 10 client.17916 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.074+0000 7feca1f3b740 10 client.17916 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:25:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.074+0000 7feca1f3b740 20 client.17916 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.074+0000 7feca1f3b740 1 --2- 172.21.15.59:0/180045451 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5563b79a0090 0x5563b79a24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.074+0000 7feca1f3b740 4 client.17916 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:25:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.074+0000 7feca1f3b740 1 -- 172.21.15.59:0/180045451 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5563b788a8a0 con 0x5563b79a0090 2024-09-10T21:25:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.074+0000 7fec9d101640 1 --2- 172.21.15.59:0/180045451 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5563b79a0090 0x5563b79a24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.075+0000 7fec9d101640 1 --2- 172.21.15.59:0/180045451 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5563b79a0090 0x5563b79a24b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c1a0a6c5adca9cb1 server_cookie=b0cdb491dedfaac0 in_seq=0 out_seq=0 2024-09-10T21:25:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.075+0000 7fec817fa640 10 client.17916 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:25:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.075+0000 7fec817fa640 1 -- 172.21.15.59:0/180045451 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5563b788a8a0 con 0x5563b79a0090 2024-09-10T21:25:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.075+0000 7fec817fa640 10 client.17916 handle_command_reply: tid=0 2024-09-10T21:25:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.075+0000 7feca1f3b740 1 client.17916 shutdown 2024-09-10T21:25:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.075+0000 7feca1f3b740 1 -- 172.21.15.59:0/180045451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b7916a10 msgr2=0x5563b7927260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.075+0000 7feca1f3b740 1 --2- 172.21.15.59:0/180045451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b7916a10 0x5563b7927260 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x5563b7934e00 tx=0x7fec9400bda0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.075+0000 7feca1f3b740 1 -- 172.21.15.59:0/180045451 shutdown_connections 2024-09-10T21:25:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.075+0000 7feca1f3b740 1 --2- 172.21.15.59:0/180045451 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x5563b79a0090 0x5563b79a24b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.075+0000 7feca1f3b740 1 --2- 172.21.15.59:0/180045451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563b79229a0 0x5563b799e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.075+0000 7fec817fa640 0 client.17916 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:25:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.075+0000 7feca1f3b740 1 --2- 172.21.15.59:0/180045451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563b7916a10 0x5563b7927260 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.075+0000 7feca1f3b740 1 --2- 172.21.15.59:0/180045451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5563b79160f0 0x5563b7926d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.075+0000 7feca1f3b740 1 -- 172.21.15.59:0/180045451 >> 172.21.15.59:0/180045451 conn(0x5563b7913f20 msgr2=0x5563b7921510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.075+0000 7feca1f3b740 1 -- 172.21.15.59:0/180045451 shutdown_connections 2024-09-10T21:25:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.076+0000 7feca1f3b740 1 -- 172.21.15.59:0/180045451 wait complete. 2024-09-10T21:25:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.076+0000 7feca1f3b740 20 client.17916 trim_cache size 0 max 16384 2024-09-10T21:25:47.093 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:25:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.076+0000 7fec9fb66640 1 -- 172.21.15.59:0/1885784396 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fec840b52e0 msgr2=0x7fec840b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.076+0000 7fec9fb66640 1 --2- 172.21.15.59:0/1885784396 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fec840b52e0 0x7fec840b77a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fec900cd590 tx=0x7fec90092060 comp rx=0 tx=0).stop 2024-09-10T21:25:47.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.076+0000 7fec9fb66640 1 -- 172.21.15.59:0/1885784396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec98109150 msgr2=0x7fec98075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:47.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.076+0000 7fec9fb66640 1 --2- 172.21.15.59:0/1885784396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec98109150 0x7fec98075f20 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fec90005cc0 tx=0x7fec9002f380 comp rx=0 tx=0).stop 2024-09-10T21:25:47.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.076+0000 7fec9fb66640 1 -- 172.21.15.59:0/1885784396 shutdown_connections 2024-09-10T21:25:47.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.076+0000 7fec9fb66640 1 --2- 172.21.15.59:0/1885784396 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fec840b52e0 0x7fec840b77a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.076+0000 7fec9fb66640 1 --2- 172.21.15.59:0/1885784396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec98109150 0x7fec98075f20 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.076+0000 7fec9fb66640 1 --2- 172.21.15.59:0/1885784396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec981087d0 0x7fec980759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.076+0000 7fec9fb66640 1 --2- 172.21.15.59:0/1885784396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec98102dc0 0x7fec980754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:47.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.076+0000 7fec9fb66640 1 -- 172.21.15.59:0/1885784396 >> 172.21.15.59:0/1885784396 conn(0x7fec980fe830 msgr2=0x7fec980ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:47.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.076+0000 7fec9fb66640 1 -- 172.21.15.59:0/1885784396 shutdown_connections 2024-09-10T21:25:47.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:47.076+0000 7fec9fb66640 1 -- 172.21.15.59:0/1885784396 wait complete. 2024-09-10T21:25:47.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:46 smithi154 ceph-mon[35041]: pgmap v655: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:25:47.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:46 smithi192 ceph-mon[35363]: pgmap v655: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:25:47.888 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:25:48.152 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:25:48.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.612+0000 7fd3185d3640 1 -- 172.21.15.59:0/3861004335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3101087d0 msgr2=0x7fd310108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:48.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.612+0000 7fd3185d3640 1 --2- 172.21.15.59:0/3861004335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3101087d0 0x7fd310108c10 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fd300009900 tx=0x7fd30002a410 comp rx=0 tx=0).stop 2024-09-10T21:25:48.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.612+0000 7fd3185d3640 1 -- 172.21.15.59:0/3861004335 shutdown_connections 2024-09-10T21:25:48.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.612+0000 7fd3185d3640 1 --2- 172.21.15.59:0/3861004335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd310109150 0x7fd31010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.612+0000 7fd3185d3640 1 --2- 172.21.15.59:0/3861004335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3101087d0 0x7fd310108c10 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.612+0000 7fd3185d3640 1 --2- 172.21.15.59:0/3861004335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd310102dc0 0x7fd3101031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.612+0000 7fd3185d3640 1 -- 172.21.15.59:0/3861004335 >> 172.21.15.59:0/3861004335 conn(0x7fd3100fe830 msgr2=0x7fd310100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:48.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.612+0000 7fd3185d3640 1 -- 172.21.15.59:0/3861004335 shutdown_connections 2024-09-10T21:25:48.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.612+0000 7fd3185d3640 1 -- 172.21.15.59:0/3861004335 wait complete. 2024-09-10T21:25:48.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.613+0000 7fd3185d3640 1 Processor -- start 2024-09-10T21:25:48.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.613+0000 7fd3185d3640 1 -- start start 2024-09-10T21:25:48.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.613+0000 7fd3185d3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd310102dc0 0x7fd310199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:48.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.613+0000 7fd3185d3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3101087d0 0x7fd310199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:48.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.613+0000 7fd3185d3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd310109150 0x7fd31019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:48.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.613+0000 7fd3185d3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd310112e10 con 0x7fd310109150 2024-09-10T21:25:48.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.613+0000 7fd3185d3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd310112c90 con 0x7fd310102dc0 2024-09-10T21:25:48.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.613+0000 7fd3185d3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd310112f90 con 0x7fd3101087d0 2024-09-10T21:25:48.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.613+0000 7fd316b70640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd310109150 0x7fd31019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:48.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.613+0000 7fd316b70640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd310109150 0x7fd31019ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34652/0 (socket says 172.21.15.59:34652) 2024-09-10T21:25:48.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.613+0000 7fd316b70640 1 -- 172.21.15.59:0/2742935855 learned_addr learned my addr 172.21.15.59:0/2742935855 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:48.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.613+0000 7fd315b6e640 1 --2- 172.21.15.59:0/2742935855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3101087d0 0x7fd310199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:48.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.613+0000 7fd31636f640 1 --2- 172.21.15.59:0/2742935855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd310102dc0 0x7fd310199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:48.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.614+0000 7fd316b70640 1 -- 172.21.15.59:0/2742935855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3101087d0 msgr2=0x7fd310199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:48.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.614+0000 7fd316b70640 1 --2- 172.21.15.59:0/2742935855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3101087d0 0x7fd310199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.614+0000 7fd316b70640 1 -- 172.21.15.59:0/2742935855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd310102dc0 msgr2=0x7fd310199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:48.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.614+0000 7fd316b70640 1 --2- 172.21.15.59:0/2742935855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd310102dc0 0x7fd310199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.614+0000 7fd316b70640 1 -- 172.21.15.59:0/2742935855 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31019f3b0 con 0x7fd310109150 2024-09-10T21:25:48.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.614+0000 7fd31636f640 1 --2- 172.21.15.59:0/2742935855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd310102dc0 0x7fd310199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:25:48.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.614+0000 7fd316b70640 1 --2- 172.21.15.59:0/2742935855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd310109150 0x7fd31019ebe0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fd30800c970 tx=0x7fd30800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:48.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.614+0000 7fd3077fe640 1 -- 172.21.15.59:0/2742935855 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308007bb0 con 0x7fd310109150 2024-09-10T21:25:48.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.614+0000 7fd3077fe640 1 -- 172.21.15.59:0/2742935855 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd308007d50 con 0x7fd310109150 2024-09-10T21:25:48.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.614+0000 7fd3185d3640 1 -- 172.21.15.59:0/2742935855 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31019f6a0 con 0x7fd310109150 2024-09-10T21:25:48.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.614+0000 7fd3077fe640 1 -- 172.21.15.59:0/2742935855 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308004e60 con 0x7fd310109150 2024-09-10T21:25:48.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.614+0000 7fd3185d3640 1 -- 172.21.15.59:0/2742935855 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3101a5d60 con 0x7fd310109150 2024-09-10T21:25:48.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.617+0000 7fd31a9a8740 1 Processor -- start 2024-09-10T21:25:48.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.617+0000 7fd3077fe640 1 -- 172.21.15.59:0/2742935855 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fd308005020 con 0x7fd310109150 2024-09-10T21:25:48.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.617+0000 7fd31a9a8740 1 -- start start 2024-09-10T21:25:48.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.618+0000 7fd31a9a8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb540f0 0x56101fb544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:48.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.618+0000 7fd31a9a8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb54a10 0x56101fb60460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:48.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.618+0000 7fd31a9a8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb609a0 0x56101fb62d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:48.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.618+0000 7fd31a9a8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56101facaea0 con 0x56101fb609a0 2024-09-10T21:25:48.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.618+0000 7fd31a9a8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56101faba2d0 con 0x56101fb540f0 2024-09-10T21:25:48.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.618+0000 7fd31a9a8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56101fabe0e0 con 0x56101fb54a10 2024-09-10T21:25:48.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.618+0000 7fd315b6e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb609a0 0x56101fb62d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:48.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.618+0000 7fd315b6e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb609a0 0x56101fb62d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34654/0 (socket says 172.21.15.59:34654) 2024-09-10T21:25:48.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.618+0000 7fd315b6e640 1 -- 172.21.15.59:0/1254710269 learned_addr learned my addr 172.21.15.59:0/1254710269 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:48.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.618+0000 7fd315b6e640 1 --2- 172.21.15.59:0/1254710269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb540f0 0x56101fb544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:48.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.618+0000 7fd31636f640 1 --2- 172.21.15.59:0/1254710269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb54a10 0x56101fb60460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:48.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.618+0000 7fd315b6e640 1 -- 172.21.15.59:0/1254710269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb54a10 msgr2=0x56101fb60460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:48.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.618+0000 7fd315b6e640 1 --2- 172.21.15.59:0/1254710269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb54a10 0x56101fb60460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.618+0000 7fd315b6e640 1 -- 172.21.15.59:0/1254710269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb540f0 msgr2=0x56101fb544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:48.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.618+0000 7fd315b6e640 1 --2- 172.21.15.59:0/1254710269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb540f0 0x56101fb544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.618+0000 7fd315b6e640 1 -- 172.21.15.59:0/1254710269 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56101f818650 con 0x56101fb609a0 2024-09-10T21:25:48.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.618+0000 7fd3077fe640 1 --2- 172.21.15.59:0/2742935855 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2fc0b52e0 0x7fd2fc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:48.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.618+0000 7fd315b6e640 1 --2- 172.21.15.59:0/1254710269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb609a0 0x56101fb62d90 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fd300009900 tx=0x7fd300009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc420eb3d8a1be0a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:48.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.619+0000 7fd31636f640 1 --2- 172.21.15.59:0/2742935855 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2fc0b52e0 0x7fd2fc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:48.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.619+0000 7fd3077fe640 1 -- 172.21.15.59:0/2742935855 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd3080e58b0 con 0x7fd310109150 2024-09-10T21:25:48.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.619+0000 7fd304ff9640 1 -- 172.21.15.59:0/1254710269 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd300035070 con 0x56101fb609a0 2024-09-10T21:25:48.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.619+0000 7fd304ff9640 1 -- 172.21.15.59:0/1254710269 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd300031900 con 0x56101fb609a0 2024-09-10T21:25:48.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.619+0000 7fd304ff9640 1 -- 172.21.15.59:0/1254710269 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3000047a0 con 0x56101fb609a0 2024-09-10T21:25:48.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.619+0000 7fd31a9a8740 1 -- 172.21.15.59:0/1254710269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb609a0 msgr2=0x56101fb62d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:48.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.619+0000 7fd31636f640 1 --2- 172.21.15.59:0/2742935855 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2fc0b52e0 0x7fd2fc0b77a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x56101fb52e00 tx=0x7fd30c00e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.619+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/1254710269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb609a0 0x56101fb62d90 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fd300009900 tx=0x7fd300009560 comp rx=0 tx=0).stop 2024-09-10T21:25:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.620+0000 7fd31a9a8740 1 -- 172.21.15.59:0/1254710269 shutdown_connections 2024-09-10T21:25:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.620+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/1254710269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb609a0 0x56101fb62d90 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.620+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/1254710269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb54a10 0x56101fb60460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.620+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/1254710269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb540f0 0x56101fb544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.620+0000 7fd31a9a8740 1 -- 172.21.15.59:0/1254710269 >> 172.21.15.59:0/1254710269 conn(0x56101fb51f20 msgr2=0x56101fb530c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.620+0000 7fd31a9a8740 1 -- 172.21.15.59:0/1254710269 shutdown_connections 2024-09-10T21:25:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.620+0000 7fd31a9a8740 1 -- 172.21.15.59:0/1254710269 wait complete. 2024-09-10T21:25:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.620+0000 7fd31a9a8740 1 -- start start 2024-09-10T21:25:48.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.620+0000 7fd31a9a8740 1 Processor -- start 2024-09-10T21:25:48.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.621+0000 7fd31a9a8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb540f0 0x56101fb5ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:48.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.621+0000 7fd31a9a8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb54a10 0x56101fb5d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:48.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.621+0000 7fd31a9a8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb609a0 0x56101fb5dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:48.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.621+0000 7fd31a9a8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56101f91b700 con 0x56101fb609a0 2024-09-10T21:25:48.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.621+0000 7fd31a9a8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56101fa55160 con 0x56101fb54a10 2024-09-10T21:25:48.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.621+0000 7fd31a9a8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56101fb63560 con 0x56101fb540f0 2024-09-10T21:25:48.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.621+0000 7fd31a9a8740 10 client.0 _ll_register_callbacks cb 0x56101fa6e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:48.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.621+0000 7fd316b70640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb609a0 0x56101fb5dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:48.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.621+0000 7fd316b70640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb609a0 0x56101fb5dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34670/0 (socket says 172.21.15.59:34670) 2024-09-10T21:25:48.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.621+0000 7fd316b70640 1 -- 172.21.15.59:0/1226656163 learned_addr learned my addr 172.21.15.59:0/1226656163 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:48.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.621+0000 7fd31636f640 1 --2- 172.21.15.59:0/1226656163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb540f0 0x56101fb5ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:48.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.621+0000 7fd315b6e640 1 --2- 172.21.15.59:0/1226656163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb54a10 0x56101fb5d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:48.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.621+0000 7fd316b70640 1 -- 172.21.15.59:0/1226656163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb540f0 msgr2=0x56101fb5ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:48.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.621+0000 7fd316b70640 1 --2- 172.21.15.59:0/1226656163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb540f0 0x56101fb5ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.621+0000 7fd316b70640 1 -- 172.21.15.59:0/1226656163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb54a10 msgr2=0x56101fb5d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:48.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.621+0000 7fd316b70640 1 --2- 172.21.15.59:0/1226656163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb54a10 0x56101fb5d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.621+0000 7fd316b70640 1 -- 172.21.15.59:0/1226656163 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56101fa82c90 con 0x56101fb609a0 2024-09-10T21:25:48.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.621+0000 7fd316b70640 1 --2- 172.21.15.59:0/1226656163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb609a0 0x56101fb5dc80 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fd30800a520 tx=0x7fd3080ab870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e42e56f9ada83e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:48.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.621+0000 7fd2f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:48.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.622+0000 7fd2f9ffb640 1 -- 172.21.15.59:0/1226656163 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30801d040 con 0x56101fb609a0 2024-09-10T21:25:48.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.622+0000 7fd2f9ffb640 1 -- 172.21.15.59:0/1226656163 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd3080b5340 con 0x56101fb609a0 2024-09-10T21:25:48.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.622+0000 7fd31a9a8740 1 -- 172.21.15.59:0/1226656163 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56101faccdf0 con 0x56101fb609a0 2024-09-10T21:25:48.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.622+0000 7fd2f9ffb640 1 -- 172.21.15.59:0/1226656163 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd308091e60 con 0x56101fb609a0 2024-09-10T21:25:48.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.622+0000 7fd31a9a8740 10 client.17928 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.622+0000 7fd31a9a8740 1 -- 172.21.15.59:0/1226656163 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56101fb77720 con 0x56101fb609a0 2024-09-10T21:25:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.622+0000 7fd2f9ffb640 1 -- 172.21.15.59:0/1226656163 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56101faccdf0 con 0x56101fb609a0 2024-09-10T21:25:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.622+0000 7fd2f9ffb640 1 -- 172.21.15.59:0/1226656163 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd3080a7990 con 0x56101fb609a0 2024-09-10T21:25:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.622+0000 7fd31a9a8740 10 client.17928 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.622+0000 7fd31a9a8740 10 client.17928 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:25:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.622+0000 7fd31a9a8740 20 client.17928 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.622+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/1226656163 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x56101fb78c30 0x56101fb7b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.622+0000 7fd31a9a8740 4 client.17928 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:25:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.622+0000 7fd31a9a8740 1 -- 172.21.15.59:0/1226656163 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56101fac88a0 con 0x56101fb78c30 2024-09-10T21:25:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.623+0000 7fd31636f640 1 --2- 172.21.15.59:0/1226656163 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x56101fb78c30 0x56101fb7b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.623+0000 7fd31636f640 1 --2- 172.21.15.59:0/1226656163 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x56101fb78c30 0x56101fb7b020 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=73fa15b27f665c4e server_cookie=478296547eaec6e in_seq=0 out_seq=0 2024-09-10T21:25:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.623+0000 7fd2f9ffb640 10 client.17928 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:25:48.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.624+0000 7fd2f9ffb640 1 -- 172.21.15.59:0/1226656163 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56101fac88a0 con 0x56101fb78c30 2024-09-10T21:25:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.624+0000 7fd2f9ffb640 10 client.17928 handle_command_reply: tid=0 2024-09-10T21:25:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.624+0000 7fd31a9a8740 1 client.17928 shutdown 2024-09-10T21:25:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.624+0000 7fd31a9a8740 1 -- 172.21.15.59:0/1226656163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb609a0 msgr2=0x56101fb5dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.624+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/1226656163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb609a0 0x56101fb5dc80 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fd30800a520 tx=0x7fd3080ab870 comp rx=0 tx=0).stop 2024-09-10T21:25:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.624+0000 7fd31a9a8740 1 -- 172.21.15.59:0/1226656163 shutdown_connections 2024-09-10T21:25:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.624+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/1226656163 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x56101fb78c30 0x56101fb7b020 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.624+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/1226656163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb609a0 0x56101fb5dc80 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.624+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/1226656163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb54a10 0x56101fb5d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.624+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/1226656163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb540f0 0x56101fb5ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.624+0000 7fd31a9a8740 1 -- 172.21.15.59:0/1226656163 >> 172.21.15.59:0/1226656163 conn(0x56101fb51f20 msgr2=0x56101fb57a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.624+0000 7fd2f9ffb640 0 client.17928 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:25:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.624+0000 7fd31a9a8740 1 -- 172.21.15.59:0/1226656163 shutdown_connections 2024-09-10T21:25:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.624+0000 7fd31a9a8740 1 -- 172.21.15.59:0/1226656163 wait complete. 2024-09-10T21:25:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.625+0000 7fd31a9a8740 20 client.17928 trim_cache size 0 max 16384 2024-09-10T21:25:48.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd31a9a8740 1 Processor -- start 2024-09-10T21:25:48.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd31a9a8740 1 -- start start 2024-09-10T21:25:48.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd31a9a8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb540f0 0x56101fb5f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:48.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd31a9a8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb54a10 0x56101fb61d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:48.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd31a9a8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb609a0 0x56101fb622d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:48.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd31a9a8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd3101ac1c0 con 0x56101fb54a10 2024-09-10T21:25:48.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd31a9a8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3101add00 con 0x56101fb540f0 2024-09-10T21:25:48.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd31a9a8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd3101ac890 con 0x56101fb609a0 2024-09-10T21:25:48.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd315b6e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb54a10 0x56101fb61d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:48.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd315b6e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb54a10 0x56101fb61d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34684/0 (socket says 172.21.15.59:34684) 2024-09-10T21:25:48.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd315b6e640 1 -- 172.21.15.59:0/3099396606 learned_addr learned my addr 172.21.15.59:0/3099396606 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:48.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd31636f640 1 --2- 172.21.15.59:0/3099396606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb540f0 0x56101fb5f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:48.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd316b70640 1 --2- 172.21.15.59:0/3099396606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb609a0 0x56101fb622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:48.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd315b6e640 1 -- 172.21.15.59:0/3099396606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb609a0 msgr2=0x56101fb622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:48.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd315b6e640 1 --2- 172.21.15.59:0/3099396606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb609a0 0x56101fb622d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd315b6e640 1 -- 172.21.15.59:0/3099396606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb540f0 msgr2=0x56101fb5f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:48.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd315b6e640 1 --2- 172.21.15.59:0/3099396606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb540f0 0x56101fb5f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd315b6e640 1 -- 172.21.15.59:0/3099396606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56101fb529a0 con 0x56101fb54a10 2024-09-10T21:25:48.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd31636f640 1 --2- 172.21.15.59:0/3099396606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb540f0 0x56101fb5f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:48.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.638+0000 7fd316b70640 1 --2- 172.21.15.59:0/3099396606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb609a0 0x56101fb622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:48.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.639+0000 7fd315b6e640 1 --2- 172.21.15.59:0/3099396606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb54a10 0x56101fb61d90 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fd300005230 tx=0x7fd30002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb31ee5129656544 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:48.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.639+0000 7fd2fbfff640 1 -- 172.21.15.59:0/3099396606 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd300050070 con 0x56101fb54a10 2024-09-10T21:25:48.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.639+0000 7fd2fbfff640 1 -- 172.21.15.59:0/3099396606 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd300031ac0 con 0x56101fb54a10 2024-09-10T21:25:48.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.639+0000 7fd2fbfff640 1 -- 172.21.15.59:0/3099396606 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd300035040 con 0x56101fb54a10 2024-09-10T21:25:48.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.639+0000 7fd31a9a8740 1 -- 172.21.15.59:0/3099396606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb54a10 msgr2=0x56101fb61d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:48.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.639+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/3099396606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb54a10 0x56101fb61d90 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fd300005230 tx=0x7fd30002a410 comp rx=0 tx=0).stop 2024-09-10T21:25:48.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.639+0000 7fd31a9a8740 1 -- 172.21.15.59:0/3099396606 shutdown_connections 2024-09-10T21:25:48.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.639+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/3099396606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb609a0 0x56101fb622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.639+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/3099396606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb54a10 0x56101fb61d90 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.639+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/3099396606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb540f0 0x56101fb5f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.639+0000 7fd31a9a8740 1 -- 172.21.15.59:0/3099396606 >> 172.21.15.59:0/3099396606 conn(0x56101fb51f20 msgr2=0x56101fb5ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:48.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.640+0000 7fd31a9a8740 1 -- 172.21.15.59:0/3099396606 shutdown_connections 2024-09-10T21:25:48.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.640+0000 7fd31a9a8740 1 -- 172.21.15.59:0/3099396606 wait complete. 2024-09-10T21:25:48.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.640+0000 7fd31a9a8740 1 -- start start 2024-09-10T21:25:48.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.640+0000 7fd31a9a8740 1 Processor -- start 2024-09-10T21:25:48.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.640+0000 7fd31a9a8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb540f0 0x56101fb754a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:48.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.640+0000 7fd31a9a8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb54a10 0x56101fb759e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:48.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.640+0000 7fd31a9a8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb609a0 0x56101fb75f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:48.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.640+0000 7fd31a9a8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd3101ad630 con 0x56101fb540f0 2024-09-10T21:25:48.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.640+0000 7fd31a9a8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3101acf60 con 0x56101fb609a0 2024-09-10T21:25:48.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.640+0000 7fd31a9a8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd3101aa1c0 con 0x56101fb54a10 2024-09-10T21:25:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.640+0000 7fd31a9a8740 10 client.0 _ll_register_callbacks cb 0x7fd30800a470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.640+0000 7fd31636f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb540f0 0x56101fb754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.640+0000 7fd31636f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb540f0 0x56101fb754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34696/0 (socket says 172.21.15.59:34696) 2024-09-10T21:25:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.640+0000 7fd31636f640 1 -- 172.21.15.59:0/3239152554 learned_addr learned my addr 172.21.15.59:0/3239152554 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.640+0000 7fd315b6e640 1 --2- 172.21.15.59:0/3239152554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb54a10 0x56101fb759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.641+0000 7fd316b70640 1 --2- 172.21.15.59:0/3239152554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb609a0 0x56101fb75f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.641+0000 7fd31636f640 1 -- 172.21.15.59:0/3239152554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb54a10 msgr2=0x56101fb759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.641+0000 7fd31636f640 1 --2- 172.21.15.59:0/3239152554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb54a10 0x56101fb759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.641+0000 7fd31636f640 1 -- 172.21.15.59:0/3239152554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb609a0 msgr2=0x56101fb75f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.641+0000 7fd31636f640 1 --2- 172.21.15.59:0/3239152554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb609a0 0x56101fb75f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.641+0000 7fd31636f640 1 -- 172.21.15.59:0/3239152554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56101fb70650 con 0x56101fb540f0 2024-09-10T21:25:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.641+0000 7fd316b70640 1 --2- 172.21.15.59:0/3239152554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb609a0 0x56101fb75f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.641+0000 7fd31636f640 1 --2- 172.21.15.59:0/3239152554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb540f0 0x56101fb754a0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009f80 tx=0x7fd30c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98002162014e979 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.641+0000 7fd2f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:48.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.641+0000 7fd2f9ffb640 1 -- 172.21.15.59:0/3239152554 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c01e040 con 0x56101fb540f0 2024-09-10T21:25:48.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.641+0000 7fd2f9ffb640 1 -- 172.21.15.59:0/3239152554 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fd30c025ab0 con 0x56101fb540f0 2024-09-10T21:25:48.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.641+0000 7fd31a9a8740 1 -- 172.21.15.59:0/3239152554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd300031ac0 con 0x56101fb540f0 2024-09-10T21:25:48.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.641+0000 7fd2f9ffb640 1 -- 172.21.15.59:0/3239152554 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd30c03a070 con 0x56101fb540f0 2024-09-10T21:25:48.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.641+0000 7fd31a9a8740 10 client.17934 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:48.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.641+0000 7fd31a9a8740 1 -- 172.21.15.59:0/3239152554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56101fbe5f10 con 0x56101fb540f0 2024-09-10T21:25:48.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.642+0000 7fd2f9ffb640 1 -- 172.21.15.59:0/3239152554 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd300031ac0 con 0x56101fb540f0 2024-09-10T21:25:48.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.642+0000 7fd2f9ffb640 1 -- 172.21.15.59:0/3239152554 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd30c03e3d0 con 0x56101fb540f0 2024-09-10T21:25:48.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.642+0000 7fd31a9a8740 10 client.17934 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:48.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.642+0000 7fd31a9a8740 10 client.17934 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:25:48.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.642+0000 7fd31a9a8740 20 client.17934 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:48.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.642+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/3239152554 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x56101fbe66a0 0x56101fbe8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:48.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.642+0000 7fd31a9a8740 4 client.17934 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:25:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.642+0000 7fd31a9a8740 1 -- 172.21.15.59:0/3239152554 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56101fac5cd0 con 0x56101fbe66a0 2024-09-10T21:25:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.642+0000 7fd315b6e640 1 --2- 172.21.15.59:0/3239152554 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x56101fbe66a0 0x56101fbe8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.643+0000 7fd315b6e640 1 --2- 172.21.15.59:0/3239152554 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x56101fbe66a0 0x56101fbe8ac0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=677b7c659a5b983b server_cookie=b09a51e484865be4 in_seq=0 out_seq=0 2024-09-10T21:25:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.643+0000 7fd2f9ffb640 10 client.17934 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:25:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.643+0000 7fd2f9ffb640 1 -- 172.21.15.59:0/3239152554 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56101fac5cd0 con 0x56101fbe66a0 2024-09-10T21:25:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.643+0000 7fd2f9ffb640 10 client.17934 handle_command_reply: tid=0 2024-09-10T21:25:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.643+0000 7fd31a9a8740 1 client.17934 shutdown 2024-09-10T21:25:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.643+0000 7fd31a9a8740 1 -- 172.21.15.59:0/3239152554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb540f0 msgr2=0x56101fb754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.643+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/3239152554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb540f0 0x56101fb754a0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009f80 tx=0x7fd30c004a40 comp rx=0 tx=0).stop 2024-09-10T21:25:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.643+0000 7fd31a9a8740 1 -- 172.21.15.59:0/3239152554 shutdown_connections 2024-09-10T21:25:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.643+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/3239152554 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x56101fbe66a0 0x56101fbe8ac0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.643+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/3239152554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56101fb609a0 0x56101fb75f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.643+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/3239152554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56101fb54a10 0x56101fb759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.643+0000 7fd2f9ffb640 0 client.17934 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:25:48.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.643+0000 7fd31a9a8740 1 --2- 172.21.15.59:0/3239152554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56101fb540f0 0x56101fb754a0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.643+0000 7fd31a9a8740 1 -- 172.21.15.59:0/3239152554 >> 172.21.15.59:0/3239152554 conn(0x56101fb51f20 msgr2=0x56101fb5f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:48.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.643+0000 7fd31a9a8740 1 -- 172.21.15.59:0/3239152554 shutdown_connections 2024-09-10T21:25:48.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.643+0000 7fd31a9a8740 1 -- 172.21.15.59:0/3239152554 wait complete. 2024-09-10T21:25:48.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.643+0000 7fd31a9a8740 20 client.17934 trim_cache size 0 max 16384 2024-09-10T21:25:48.653 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:25:48.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.644+0000 7fd3185d3640 1 -- 172.21.15.59:0/2742935855 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2fc0b52e0 msgr2=0x7fd2fc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:48.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.644+0000 7fd3185d3640 1 --2- 172.21.15.59:0/2742935855 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2fc0b52e0 0x7fd2fc0b77a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x56101fb52e00 tx=0x7fd30c00e040 comp rx=0 tx=0).stop 2024-09-10T21:25:48.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.644+0000 7fd3185d3640 1 -- 172.21.15.59:0/2742935855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd310109150 msgr2=0x7fd31019ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:48.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.644+0000 7fd3185d3640 1 --2- 172.21.15.59:0/2742935855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd310109150 0x7fd31019ebe0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fd30800c970 tx=0x7fd30800ce30 comp rx=0 tx=0).stop 2024-09-10T21:25:48.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.644+0000 7fd3185d3640 1 -- 172.21.15.59:0/2742935855 shutdown_connections 2024-09-10T21:25:48.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.644+0000 7fd3185d3640 1 --2- 172.21.15.59:0/2742935855 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fd2fc0b52e0 0x7fd2fc0b77a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.644+0000 7fd3185d3640 1 --2- 172.21.15.59:0/2742935855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd310109150 0x7fd31019ebe0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.644+0000 7fd3185d3640 1 --2- 172.21.15.59:0/2742935855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3101087d0 0x7fd310199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.644+0000 7fd3185d3640 1 --2- 172.21.15.59:0/2742935855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd310102dc0 0x7fd310199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:48.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.644+0000 7fd3185d3640 1 -- 172.21.15.59:0/2742935855 >> 172.21.15.59:0/2742935855 conn(0x7fd3100fe830 msgr2=0x7fd310100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:48.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.644+0000 7fd3185d3640 1 -- 172.21.15.59:0/2742935855 shutdown_connections 2024-09-10T21:25:48.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:48.644+0000 7fd3185d3640 1 -- 172.21.15.59:0/2742935855 wait complete. 2024-09-10T21:25:49.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:48 smithi059 ceph-mon[30888]: pgmap v656: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:25:49.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:48 smithi154 ceph-mon[35041]: pgmap v656: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:25:49.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:48 smithi192 ceph-mon[35363]: pgmap v656: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:25:49.507 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:25:49.772 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:25:50.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.231+0000 7f43afe61640 1 -- 172.21.15.59:0/3145305915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a81087d0 msgr2=0x7f43a8108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:50.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.231+0000 7f43afe61640 1 --2- 172.21.15.59:0/3145305915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a81087d0 0x7f43a8108c10 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f439c009900 tx=0x7f439c02a3f0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.231+0000 7f43afe61640 1 -- 172.21.15.59:0/3145305915 shutdown_connections 2024-09-10T21:25:50.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.231+0000 7f43afe61640 1 --2- 172.21.15.59:0/3145305915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43a8109150 0x7f43a810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.231+0000 7f43afe61640 1 --2- 172.21.15.59:0/3145305915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a81087d0 0x7f43a8108c10 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.231+0000 7f43afe61640 1 --2- 172.21.15.59:0/3145305915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43a8102dc0 0x7f43a81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.231+0000 7f43afe61640 1 -- 172.21.15.59:0/3145305915 >> 172.21.15.59:0/3145305915 conn(0x7f43a80fe830 msgr2=0x7f43a8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.231+0000 7f43afe61640 1 -- 172.21.15.59:0/3145305915 shutdown_connections 2024-09-10T21:25:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.231+0000 7f43afe61640 1 -- 172.21.15.59:0/3145305915 wait complete. 2024-09-10T21:25:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.231+0000 7f43afe61640 1 Processor -- start 2024-09-10T21:25:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.232+0000 7f43afe61640 1 -- start start 2024-09-10T21:25:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.232+0000 7f43afe61640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a8102dc0 0x7f43a81991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.232+0000 7f43afe61640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43a81087d0 0x7f43a81996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.232+0000 7f43afe61640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43a8109150 0x7f43a819ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.232+0000 7f43afe61640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8112e10 con 0x7f43a8102dc0 2024-09-10T21:25:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.232+0000 7f43afe61640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8112c90 con 0x7f43a8109150 2024-09-10T21:25:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.232+0000 7f43afe61640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8112f90 con 0x7f43a81087d0 2024-09-10T21:25:50.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.232+0000 7f43adbfd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a8102dc0 0x7f43a81991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:50.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.232+0000 7f43adbfd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a8102dc0 0x7f43a81991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41094/0 (socket says 172.21.15.59:41094) 2024-09-10T21:25:50.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.232+0000 7f43adbfd640 1 -- 172.21.15.59:0/623340491 learned_addr learned my addr 172.21.15.59:0/623340491 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:50.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.232+0000 7f43ae3fe640 1 --2- 172.21.15.59:0/623340491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43a8109150 0x7f43a819ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:50.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.232+0000 7f43ad3fc640 1 --2- 172.21.15.59:0/623340491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43a81087d0 0x7f43a81996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:50.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.232+0000 7f43adbfd640 1 -- 172.21.15.59:0/623340491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43a81087d0 msgr2=0x7f43a81996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:50.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.232+0000 7f43adbfd640 1 --2- 172.21.15.59:0/623340491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43a81087d0 0x7f43a81996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.232+0000 7f43adbfd640 1 -- 172.21.15.59:0/623340491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43a8109150 msgr2=0x7f43a819ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:50.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.232+0000 7f43adbfd640 1 --2- 172.21.15.59:0/623340491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43a8109150 0x7f43a819ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.232+0000 7f43adbfd640 1 -- 172.21.15.59:0/623340491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a819f250 con 0x7f43a8102dc0 2024-09-10T21:25:50.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.232+0000 7f43ad3fc640 1 --2- 172.21.15.59:0/623340491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43a81087d0 0x7f43a81996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:50.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.232+0000 7f43adbfd640 1 --2- 172.21.15.59:0/623340491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a8102dc0 0x7f43a81991a0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f439800cce0 tx=0x7f439800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:50.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.233+0000 7f43a6ffd640 1 -- 172.21.15.59:0/623340491 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439800f650 con 0x7f43a8102dc0 2024-09-10T21:25:50.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.233+0000 7f43a6ffd640 1 -- 172.21.15.59:0/623340491 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f439800fca0 con 0x7f43a8102dc0 2024-09-10T21:25:50.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.233+0000 7f43afe61640 1 -- 172.21.15.59:0/623340491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43a819f540 con 0x7f43a8102dc0 2024-09-10T21:25:50.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.233+0000 7f43a6ffd640 1 -- 172.21.15.59:0/623340491 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4398018b40 con 0x7f43a8102dc0 2024-09-10T21:25:50.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.233+0000 7f43afe61640 1 -- 172.21.15.59:0/623340491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43a81a5c00 con 0x7f43a8102dc0 2024-09-10T21:25:50.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.236+0000 7f43b2236740 1 Processor -- start 2024-09-10T21:25:50.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.236+0000 7f43b2236740 1 -- start start 2024-09-10T21:25:50.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.236+0000 7f43b2236740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e83560f0 0x55d9e83564d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:50.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.236+0000 7f43b2236740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e8356a10 0x55d9e8362460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:50.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.236+0000 7f43b2236740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e83629a0 0x55d9e8364d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:50.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.236+0000 7f43b2236740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d9e82ccea0 con 0x55d9e8356a10 2024-09-10T21:25:50.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.236+0000 7f43b2236740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d9e82bc2d0 con 0x55d9e83560f0 2024-09-10T21:25:50.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.236+0000 7f43b2236740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d9e82c00e0 con 0x55d9e83629a0 2024-09-10T21:25:50.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.236+0000 7f43a6ffd640 1 -- 172.21.15.59:0/623340491 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f439800f7f0 con 0x7f43a8102dc0 2024-09-10T21:25:50.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.236+0000 7f43adbfd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e8356a10 0x55d9e8362460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:50.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.236+0000 7f43ae3fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e83560f0 0x55d9e83564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:50.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.237+0000 7f43adbfd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e8356a10 0x55d9e8362460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41102/0 (socket says 172.21.15.59:41102) 2024-09-10T21:25:50.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.237+0000 7f43adbfd640 1 -- 172.21.15.59:0/1971136890 learned_addr learned my addr 172.21.15.59:0/1971136890 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:50.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.237+0000 7f43ad3fc640 1 --2- 172.21.15.59:0/1971136890 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e83629a0 0x55d9e8364d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:50.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.237+0000 7f43adbfd640 1 -- 172.21.15.59:0/1971136890 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e83629a0 msgr2=0x55d9e8364d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:50.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.237+0000 7f43adbfd640 1 --2- 172.21.15.59:0/1971136890 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e83629a0 0x55d9e8364d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.237+0000 7f43adbfd640 1 -- 172.21.15.59:0/1971136890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e83560f0 msgr2=0x55d9e83564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:50.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.237+0000 7f43adbfd640 1 --2- 172.21.15.59:0/1971136890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e83560f0 0x55d9e83564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.237+0000 7f43adbfd640 1 -- 172.21.15.59:0/1971136890 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e801a650 con 0x55d9e8356a10 2024-09-10T21:25:50.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.237+0000 7f43ae3fe640 1 --2- 172.21.15.59:0/1971136890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e83560f0 0x55d9e83564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:25:50.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.237+0000 7f43adbfd640 1 --2- 172.21.15.59:0/1971136890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e8356a10 0x55d9e8362460 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f43980ee480 tx=0x7f43980ee570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb64229d08d6ce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:50.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.237+0000 7f43a6ffd640 1 --2- 172.21.15.59:0/623340491 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43900b52e0 0x7f43900b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:50.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.237+0000 7f438ffff640 1 -- 172.21.15.59:0/1971136890 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43980f9070 con 0x55d9e8356a10 2024-09-10T21:25:50.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.238+0000 7f438ffff640 1 -- 172.21.15.59:0/1971136890 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43980e82d0 con 0x55d9e8356a10 2024-09-10T21:25:50.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.238+0000 7f438ffff640 1 -- 172.21.15.59:0/1971136890 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43980f4770 con 0x55d9e8356a10 2024-09-10T21:25:50.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.238+0000 7f43ae3fe640 1 --2- 172.21.15.59:0/623340491 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43900b52e0 0x7f43900b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:50.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.238+0000 7f43a6ffd640 1 -- 172.21.15.59:0/623340491 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f43980e6150 con 0x7f43a8102dc0 2024-09-10T21:25:50.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.238+0000 7f43b2236740 1 -- 172.21.15.59:0/1971136890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e8356a10 msgr2=0x55d9e8362460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:50.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.238+0000 7f43ae3fe640 1 --2- 172.21.15.59:0/623340491 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43900b52e0 0x7f43900b77a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f43a000ce30 tx=0x7f43a000c430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:50.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.238+0000 7f43b2236740 1 --2- 172.21.15.59:0/1971136890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e8356a10 0x55d9e8362460 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f43980ee480 tx=0x7f43980ee570 comp rx=0 tx=0).stop 2024-09-10T21:25:50.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.238+0000 7f43b2236740 1 -- 172.21.15.59:0/1971136890 shutdown_connections 2024-09-10T21:25:50.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.238+0000 7f43b2236740 1 --2- 172.21.15.59:0/1971136890 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e83629a0 0x55d9e8364d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.238+0000 7f43b2236740 1 --2- 172.21.15.59:0/1971136890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e8356a10 0x55d9e8362460 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.238+0000 7f43b2236740 1 --2- 172.21.15.59:0/1971136890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e83560f0 0x55d9e83564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.238+0000 7f43b2236740 1 -- 172.21.15.59:0/1971136890 >> 172.21.15.59:0/1971136890 conn(0x55d9e8353f20 msgr2=0x55d9e83550c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:50.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.239+0000 7f43b2236740 1 -- 172.21.15.59:0/1971136890 shutdown_connections 2024-09-10T21:25:50.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.239+0000 7f43b2236740 1 -- 172.21.15.59:0/1971136890 wait complete. 2024-09-10T21:25:50.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.239+0000 7f43b2236740 1 -- start start 2024-09-10T21:25:50.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.239+0000 7f43b2236740 1 Processor -- start 2024-09-10T21:25:50.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.239+0000 7f43b2236740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e83560f0 0x55d9e8362360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:50.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.239+0000 7f43b2236740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e8356a10 0x55d9e835f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:50.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.239+0000 7f43b2236740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e83629a0 0x55d9e835fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:50.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.239+0000 7f43b2236740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d9e811d700 con 0x55d9e83629a0 2024-09-10T21:25:50.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.239+0000 7f43b2236740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d9e8257160 con 0x55d9e83560f0 2024-09-10T21:25:50.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.239+0000 7f43b2236740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d9e8365620 con 0x55d9e8356a10 2024-09-10T21:25:50.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.239+0000 7f43b2236740 10 client.0 _ll_register_callbacks cb 0x55d9e82709e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:50.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.240+0000 7f43ae3fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e83629a0 0x55d9e835fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:50.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.240+0000 7f43ae3fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e83629a0 0x55d9e835fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41112/0 (socket says 172.21.15.59:41112) 2024-09-10T21:25:50.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.240+0000 7f43ae3fe640 1 -- 172.21.15.59:0/1175333317 learned_addr learned my addr 172.21.15.59:0/1175333317 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:50.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.240+0000 7f43ad3fc640 1 --2- 172.21.15.59:0/1175333317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e8356a10 0x55d9e835f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:50.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.240+0000 7f43adbfd640 1 --2- 172.21.15.59:0/1175333317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e83560f0 0x55d9e8362360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:50.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.240+0000 7f43ae3fe640 1 -- 172.21.15.59:0/1175333317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e8356a10 msgr2=0x55d9e835f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:50.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.240+0000 7f43ae3fe640 1 --2- 172.21.15.59:0/1175333317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e8356a10 0x55d9e835f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.240+0000 7f43ae3fe640 1 -- 172.21.15.59:0/1175333317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e83560f0 msgr2=0x55d9e8362360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:50.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.240+0000 7f43ae3fe640 1 --2- 172.21.15.59:0/1175333317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e83560f0 0x55d9e8362360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.240+0000 7f43ae3fe640 1 -- 172.21.15.59:0/1175333317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9e8284c90 con 0x55d9e83629a0 2024-09-10T21:25:50.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.240+0000 7f43ae3fe640 1 --2- 172.21.15.59:0/1175333317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e83629a0 0x55d9e835fe80 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f43a000eb90 tx=0x7f43a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d128fb646e807f96 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:50.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.240+0000 7f438d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:50.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.240+0000 7f438d7fa640 1 -- 172.21.15.59:0/1175333317 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a001cb20 con 0x55d9e83629a0 2024-09-10T21:25:50.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.240+0000 7f43b2236740 1 -- 172.21.15.59:0/1175333317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43980e82d0 con 0x55d9e83629a0 2024-09-10T21:25:50.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.240+0000 7f438d7fa640 1 -- 172.21.15.59:0/1175333317 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f43a001ccc0 con 0x55d9e83629a0 2024-09-10T21:25:50.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.240+0000 7f438d7fa640 1 -- 172.21.15.59:0/1175333317 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f43a002f070 con 0x55d9e83629a0 2024-09-10T21:25:50.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.240+0000 7f43b2236740 10 client.17946 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:50.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.240+0000 7f43b2236740 1 -- 172.21.15.59:0/1175333317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d9e83710c0 con 0x55d9e83629a0 2024-09-10T21:25:50.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.241+0000 7f438d7fa640 1 -- 172.21.15.59:0/1175333317 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43980e82d0 con 0x55d9e83629a0 2024-09-10T21:25:50.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.241+0000 7f438d7fa640 1 -- 172.21.15.59:0/1175333317 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f43a001d410 con 0x55d9e83629a0 2024-09-10T21:25:50.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.241+0000 7f43b2236740 10 client.17946 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:50.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.241+0000 7f43b2236740 10 client.17946 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:25:50.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.241+0000 7f43b2236740 20 client.17946 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:50.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.241+0000 7f43b2236740 1 --2- 172.21.15.59:0/1175333317 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d9e83725d0 0x55d9e8374a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:50.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.241+0000 7f43b2236740 4 client.17946 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:25:50.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.241+0000 7f43b2236740 1 -- 172.21.15.59:0/1175333317 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9e82cedf0 con 0x55d9e83725d0 2024-09-10T21:25:50.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.241+0000 7f43adbfd640 1 --2- 172.21.15.59:0/1175333317 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d9e83725d0 0x55d9e8374a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:50.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.242+0000 7f43adbfd640 1 --2- 172.21.15.59:0/1175333317 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d9e83725d0 0x55d9e8374a30 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65349cd3ad773fb1 server_cookie=a90df08e0022eda5 in_seq=0 out_seq=0 2024-09-10T21:25:50.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.242+0000 7f438d7fa640 10 client.17946 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:50.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.242+0000 7f438d7fa640 1 -- 172.21.15.59:0/1175333317 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d9e82cedf0 con 0x55d9e83725d0 2024-09-10T21:25:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.242+0000 7f438d7fa640 10 client.17946 handle_command_reply: tid=0 2024-09-10T21:25:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.242+0000 7f43b2236740 1 client.17946 shutdown 2024-09-10T21:25:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.242+0000 7f43b2236740 1 -- 172.21.15.59:0/1175333317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e83629a0 msgr2=0x55d9e835fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.242+0000 7f43b2236740 1 --2- 172.21.15.59:0/1175333317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e83629a0 0x55d9e835fe80 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f43a000eb90 tx=0x7f43a00046c0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.243+0000 7f43b2236740 1 -- 172.21.15.59:0/1175333317 shutdown_connections 2024-09-10T21:25:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.243+0000 7f43b2236740 1 --2- 172.21.15.59:0/1175333317 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d9e83725d0 0x55d9e8374a30 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.243+0000 7f43b2236740 1 --2- 172.21.15.59:0/1175333317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e83629a0 0x55d9e835fe80 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.243+0000 7f43b2236740 1 --2- 172.21.15.59:0/1175333317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e8356a10 0x55d9e835f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.243+0000 7f438d7fa640 0 client.17946 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:50.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.243+0000 7f43b2236740 1 --2- 172.21.15.59:0/1175333317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e83560f0 0x55d9e8362360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.243+0000 7f43b2236740 1 -- 172.21.15.59:0/1175333317 >> 172.21.15.59:0/1175333317 conn(0x55d9e8353f20 msgr2=0x55d9e8359ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.243+0000 7f43b2236740 1 -- 172.21.15.59:0/1175333317 shutdown_connections 2024-09-10T21:25:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.243+0000 7f43b2236740 1 -- 172.21.15.59:0/1175333317 wait complete. 2024-09-10T21:25:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.243+0000 7f43b2236740 20 client.17946 trim_cache size 0 max 16384 2024-09-10T21:25:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.256+0000 7f43b2236740 1 Processor -- start 2024-09-10T21:25:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.256+0000 7f43b2236740 1 -- start start 2024-09-10T21:25:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.256+0000 7f43b2236740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e83560f0 0x55d9e836e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.256+0000 7f43b2236740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e8356a10 0x55d9e8359860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.256+0000 7f43b2236740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e83629a0 0x55d9e8359da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.256+0000 7f43b2236740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81ae290 con 0x55d9e83560f0 2024-09-10T21:25:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.256+0000 7f43b2236740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81afdd0 con 0x55d9e8356a10 2024-09-10T21:25:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.256+0000 7f43b2236740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81ae960 con 0x55d9e83629a0 2024-09-10T21:25:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.256+0000 7f43adbfd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e83560f0 0x55d9e836e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:50.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.256+0000 7f43adbfd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e83560f0 0x55d9e836e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41114/0 (socket says 172.21.15.59:41114) 2024-09-10T21:25:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.256+0000 7f43adbfd640 1 -- 172.21.15.59:0/2729530898 learned_addr learned my addr 172.21.15.59:0/2729530898 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.256+0000 7f43adbfd640 1 -- 172.21.15.59:0/2729530898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e83629a0 msgr2=0x55d9e8359da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.256+0000 7f43ad3fc640 1 --2- 172.21.15.59:0/2729530898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e8356a10 0x55d9e8359860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.256+0000 7f43adbfd640 1 --2- 172.21.15.59:0/2729530898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e83629a0 0x55d9e8359da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.256+0000 7f43adbfd640 1 -- 172.21.15.59:0/2729530898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e8356a10 msgr2=0x55d9e8359860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.256+0000 7f43adbfd640 1 --2- 172.21.15.59:0/2729530898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e8356a10 0x55d9e8359860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.256+0000 7f43adbfd640 1 -- 172.21.15.59:0/2729530898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e8356840 con 0x55d9e83560f0 2024-09-10T21:25:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.256+0000 7f43ad3fc640 1 --2- 172.21.15.59:0/2729530898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e8356a10 0x55d9e8359860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.257+0000 7f43adbfd640 1 --2- 172.21.15.59:0/2729530898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e83560f0 0x55d9e836e880 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f439800ab20 tx=0x7f4398007940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d993b3fb7d9e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.257+0000 7f438f7fe640 1 -- 172.21.15.59:0/2729530898 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43980a8f90 con 0x55d9e83560f0 2024-09-10T21:25:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.257+0000 7f438f7fe640 1 -- 172.21.15.59:0/2729530898 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43980eee90 con 0x55d9e83560f0 2024-09-10T21:25:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.257+0000 7f438f7fe640 1 -- 172.21.15.59:0/2729530898 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43980a80b0 con 0x55d9e83560f0 2024-09-10T21:25:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.257+0000 7f43b2236740 1 -- 172.21.15.59:0/2729530898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e83560f0 msgr2=0x55d9e836e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.257+0000 7f43b2236740 1 --2- 172.21.15.59:0/2729530898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e83560f0 0x55d9e836e880 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f439800ab20 tx=0x7f4398007940 comp rx=0 tx=0).stop 2024-09-10T21:25:50.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.257+0000 7f43b2236740 1 -- 172.21.15.59:0/2729530898 shutdown_connections 2024-09-10T21:25:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.257+0000 7f43b2236740 1 --2- 172.21.15.59:0/2729530898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e83629a0 0x55d9e8359da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.257+0000 7f43b2236740 1 --2- 172.21.15.59:0/2729530898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e8356a10 0x55d9e8359860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.257+0000 7f43b2236740 1 --2- 172.21.15.59:0/2729530898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e83560f0 0x55d9e836e880 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.257+0000 7f43b2236740 1 -- 172.21.15.59:0/2729530898 >> 172.21.15.59:0/2729530898 conn(0x55d9e8353f20 msgr2=0x55d9e8359150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.257+0000 7f43b2236740 1 -- 172.21.15.59:0/2729530898 shutdown_connections 2024-09-10T21:25:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.257+0000 7f43b2236740 1 -- 172.21.15.59:0/2729530898 wait complete. 2024-09-10T21:25:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.258+0000 7f43b2236740 1 -- start start 2024-09-10T21:25:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.258+0000 7f43b2236740 1 Processor -- start 2024-09-10T21:25:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.258+0000 7f43b2236740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e83560f0 0x55d9e836a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.258+0000 7f43b2236740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e8356a10 0x55d9e836ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.258+0000 7f43b2236740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e83629a0 0x55d9e83658a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.258+0000 7f43b2236740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81af700 con 0x55d9e8356a10 2024-09-10T21:25:50.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.258+0000 7f43b2236740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81af030 con 0x55d9e83560f0 2024-09-10T21:25:50.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.258+0000 7f43b2236740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81ac270 con 0x55d9e83629a0 2024-09-10T21:25:50.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.258+0000 7f43b2236740 10 client.0 _ll_register_callbacks cb 0x7f43a000cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:50.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.259+0000 7f43ad3fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e8356a10 0x55d9e836ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:50.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.259+0000 7f43ad3fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e8356a10 0x55d9e836ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41116/0 (socket says 172.21.15.59:41116) 2024-09-10T21:25:50.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.259+0000 7f43ad3fc640 1 -- 172.21.15.59:0/243476826 learned_addr learned my addr 172.21.15.59:0/243476826 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:50.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.259+0000 7f43adbfd640 1 --2- 172.21.15.59:0/243476826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e83560f0 0x55d9e836a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:50.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.259+0000 7f43ae3fe640 1 --2- 172.21.15.59:0/243476826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e83629a0 0x55d9e83658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:50.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.259+0000 7f43ad3fc640 1 -- 172.21.15.59:0/243476826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e83629a0 msgr2=0x55d9e83658a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:50.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.259+0000 7f43ad3fc640 1 --2- 172.21.15.59:0/243476826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e83629a0 0x55d9e83658a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.259+0000 7f43ad3fc640 1 -- 172.21.15.59:0/243476826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e83560f0 msgr2=0x55d9e836a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:50.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.259+0000 7f43ad3fc640 1 --2- 172.21.15.59:0/243476826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e83560f0 0x55d9e836a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.259+0000 7f43ad3fc640 1 -- 172.21.15.59:0/243476826 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9e8365de0 con 0x55d9e8356a10 2024-09-10T21:25:50.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.259+0000 7f43ad3fc640 1 --2- 172.21.15.59:0/243476826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e8356a10 0x55d9e836ae30 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f439c005ec0 tx=0x7f439c032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbfd0c9e549d8f56 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:50.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.259+0000 7f438d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:50.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.259+0000 7f438d7fa640 1 -- 172.21.15.59:0/243476826 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c035040 con 0x55d9e8356a10 2024-09-10T21:25:50.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.259+0000 7f438d7fa640 1 -- 172.21.15.59:0/243476826 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f439c004040 con 0x55d9e8356a10 2024-09-10T21:25:50.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.259+0000 7f43b2236740 1 -- 172.21.15.59:0/243476826 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43980eee90 con 0x55d9e8356a10 2024-09-10T21:25:50.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.259+0000 7f438d7fa640 1 -- 172.21.15.59:0/243476826 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f439c04c070 con 0x55d9e8356a10 2024-09-10T21:25:50.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.259+0000 7f43b2236740 10 client.17952 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:50.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.259+0000 7f43b2236740 1 -- 172.21.15.59:0/243476826 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d9e83dfc60 con 0x55d9e8356a10 2024-09-10T21:25:50.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.260+0000 7f438d7fa640 1 -- 172.21.15.59:0/243476826 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43980eee90 con 0x55d9e8356a10 2024-09-10T21:25:50.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.260+0000 7f438d7fa640 1 -- 172.21.15.59:0/243476826 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f439c0048f0 con 0x55d9e8356a10 2024-09-10T21:25:50.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.260+0000 7f43b2236740 10 client.17952 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:50.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.260+0000 7f43b2236740 10 client.17952 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:25:50.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.260+0000 7f43b2236740 20 client.17952 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:50.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.260+0000 7f43b2236740 1 --2- 172.21.15.59:0/243476826 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d9e83e0410 0x55d9e83e2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:50.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.260+0000 7f43b2236740 4 client.17952 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:25:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.260+0000 7f43b2236740 1 -- 172.21.15.59:0/243476826 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d9e82ca8a0 con 0x55d9e83e0410 2024-09-10T21:25:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.260+0000 7f43adbfd640 1 --2- 172.21.15.59:0/243476826 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d9e83e0410 0x55d9e83e2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.260+0000 7f43adbfd640 1 --2- 172.21.15.59:0/243476826 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d9e83e0410 0x55d9e83e2830 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e434566cbf77e1f server_cookie=a28e0e62ae6f43e7 in_seq=0 out_seq=0 2024-09-10T21:25:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.260+0000 7f438d7fa640 10 client.17952 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.261+0000 7f438d7fa640 1 -- 172.21.15.59:0/243476826 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d9e82ca8a0 con 0x55d9e83e0410 2024-09-10T21:25:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.261+0000 7f438d7fa640 10 client.17952 handle_command_reply: tid=0 2024-09-10T21:25:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.261+0000 7f43b2236740 1 client.17952 shutdown 2024-09-10T21:25:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.261+0000 7f43b2236740 1 -- 172.21.15.59:0/243476826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e8356a10 msgr2=0x55d9e836ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.261+0000 7f43b2236740 1 --2- 172.21.15.59:0/243476826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e8356a10 0x55d9e836ae30 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f439c005ec0 tx=0x7f439c032f90 comp rx=0 tx=0).stop 2024-09-10T21:25:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.261+0000 7f43b2236740 1 -- 172.21.15.59:0/243476826 shutdown_connections 2024-09-10T21:25:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.261+0000 7f43b2236740 1 --2- 172.21.15.59:0/243476826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d9e83629a0 0x55d9e83658a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.261+0000 7f43b2236740 1 --2- 172.21.15.59:0/243476826 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d9e83e0410 0x55d9e83e2830 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.261+0000 7f43b2236740 1 --2- 172.21.15.59:0/243476826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d9e8356a10 0x55d9e836ae30 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.261+0000 7f43b2236740 1 --2- 172.21.15.59:0/243476826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9e83560f0 0x55d9e836a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.261+0000 7f438d7fa640 0 client.17952 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.261+0000 7f43b2236740 1 -- 172.21.15.59:0/243476826 >> 172.21.15.59:0/243476826 conn(0x55d9e8353f20 msgr2=0x55d9e8359970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.261+0000 7f43b2236740 1 -- 172.21.15.59:0/243476826 shutdown_connections 2024-09-10T21:25:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.261+0000 7f43b2236740 1 -- 172.21.15.59:0/243476826 wait complete. 2024-09-10T21:25:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.261+0000 7f43b2236740 20 client.17952 trim_cache size 0 max 16384 2024-09-10T21:25:50.292 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:25:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.261+0000 7f43afe61640 1 -- 172.21.15.59:0/623340491 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43900b52e0 msgr2=0x7f43900b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:50.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.262+0000 7f43afe61640 1 --2- 172.21.15.59:0/623340491 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43900b52e0 0x7f43900b77a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f43a000ce30 tx=0x7f43a000c430 comp rx=0 tx=0).stop 2024-09-10T21:25:50.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.262+0000 7f43afe61640 1 -- 172.21.15.59:0/623340491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a8102dc0 msgr2=0x7f43a81991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:50.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.262+0000 7f43afe61640 1 --2- 172.21.15.59:0/623340491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a8102dc0 0x7f43a81991a0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f439800cce0 tx=0x7f439800a620 comp rx=0 tx=0).stop 2024-09-10T21:25:50.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.262+0000 7f43afe61640 1 -- 172.21.15.59:0/623340491 shutdown_connections 2024-09-10T21:25:50.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.262+0000 7f43afe61640 1 --2- 172.21.15.59:0/623340491 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f43900b52e0 0x7f43900b77a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.262+0000 7f43afe61640 1 --2- 172.21.15.59:0/623340491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43a8109150 0x7f43a819ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.262+0000 7f43afe61640 1 --2- 172.21.15.59:0/623340491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43a81087d0 0x7f43a81996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.262+0000 7f43afe61640 1 --2- 172.21.15.59:0/623340491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a8102dc0 0x7f43a81991a0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:50.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.262+0000 7f43afe61640 1 -- 172.21.15.59:0/623340491 >> 172.21.15.59:0/623340491 conn(0x7f43a80fe830 msgr2=0x7f43a8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:50.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.262+0000 7f43afe61640 1 -- 172.21.15.59:0/623340491 shutdown_connections 2024-09-10T21:25:50.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:50.262+0000 7f43afe61640 1 -- 172.21.15.59:0/623340491 wait complete. 2024-09-10T21:25:51.159 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:50 smithi059 ceph-mon[30888]: pgmap v657: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:25:51.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:50 smithi154 ceph-mon[35041]: pgmap v657: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:25:51.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:50 smithi192 ceph-mon[35363]: pgmap v657: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 17 op/s 2024-09-10T21:25:52.018 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:25:52.018 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:25:52.292 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:25:52.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.800+0000 7f02e0bd9640 1 -- 172.21.15.59:0/1378010826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02dc104600 msgr2=0x7f02dc10caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:52.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.800+0000 7f02e0bd9640 1 --2- 172.21.15.59:0/1378010826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02dc104600 0x7f02dc10caf0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009900 tx=0x7f02c402a410 comp rx=0 tx=0).stop 2024-09-10T21:25:52.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.800+0000 7f02e0bd9640 1 -- 172.21.15.59:0/1378010826 shutdown_connections 2024-09-10T21:25:52.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.800+0000 7f02e0bd9640 1 --2- 172.21.15.59:0/1378010826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02dc10d140 0x7f02dc10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.800+0000 7f02e0bd9640 1 --2- 172.21.15.59:0/1378010826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02dc104600 0x7f02dc10caf0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.800+0000 7f02e0bd9640 1 --2- 172.21.15.59:0/1378010826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc103ce0 0x7f02dc1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.800+0000 7f02e0bd9640 1 -- 172.21.15.59:0/1378010826 >> 172.21.15.59:0/1378010826 conn(0x7f02dc0fd700 msgr2=0x7f02dc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:52.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.800+0000 7f02e0bd9640 1 -- 172.21.15.59:0/1378010826 shutdown_connections 2024-09-10T21:25:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.800+0000 7f02e0bd9640 1 -- 172.21.15.59:0/1378010826 wait complete. 2024-09-10T21:25:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.801+0000 7f02e0bd9640 1 Processor -- start 2024-09-10T21:25:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.801+0000 7f02e0bd9640 1 -- start start 2024-09-10T21:25:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.801+0000 7f02e0bd9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc103ce0 0x7f02dc1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.801+0000 7f02e0bd9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02dc104600 0x7f02dc199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.801+0000 7f02e0bd9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02dc10d140 0x7f02dc19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.801+0000 7f02e0bd9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc112e00 con 0x7f02dc104600 2024-09-10T21:25:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.801+0000 7f02e0bd9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc112c80 con 0x7f02dc103ce0 2024-09-10T21:25:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.801+0000 7f02e0bd9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc112f80 con 0x7f02dc10d140 2024-09-10T21:25:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.801+0000 7f02d3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02dc104600 0x7f02dc199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.801+0000 7f02d3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02dc104600 0x7f02dc199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41136/0 (socket says 172.21.15.59:41136) 2024-09-10T21:25:52.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.801+0000 7f02d3fff640 1 -- 172.21.15.59:0/1410388291 learned_addr learned my addr 172.21.15.59:0/1410388291 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.802+0000 7f02da59c640 1 --2- 172.21.15.59:0/1410388291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc103ce0 0x7f02dc1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.802+0000 7f02dad9d640 1 --2- 172.21.15.59:0/1410388291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02dc10d140 0x7f02dc19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.802+0000 7f02d3fff640 1 -- 172.21.15.59:0/1410388291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02dc10d140 msgr2=0x7f02dc19ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.802+0000 7f02d3fff640 1 --2- 172.21.15.59:0/1410388291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02dc10d140 0x7f02dc19ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.802+0000 7f02d3fff640 1 -- 172.21.15.59:0/1410388291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc103ce0 msgr2=0x7f02dc1992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.802+0000 7f02d3fff640 1 --2- 172.21.15.59:0/1410388291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc103ce0 0x7f02dc1992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.802+0000 7f02d3fff640 1 -- 172.21.15.59:0/1410388291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02dc19f3a0 con 0x7f02dc104600 2024-09-10T21:25:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.802+0000 7f02dad9d640 1 --2- 172.21.15.59:0/1410388291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02dc10d140 0x7f02dc19ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:25:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.802+0000 7f02d3fff640 1 --2- 172.21.15.59:0/1410388291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02dc104600 0x7f02dc199830 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f02c4005ab0 tx=0x7f02c4003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.802+0000 7f02d37fe640 1 -- 172.21.15.59:0/1410388291 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c403f070 con 0x7f02dc104600 2024-09-10T21:25:52.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.802+0000 7f02d37fe640 1 -- 172.21.15.59:0/1410388291 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02c4031b50 con 0x7f02dc104600 2024-09-10T21:25:52.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.802+0000 7f02d37fe640 1 -- 172.21.15.59:0/1410388291 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4035030 con 0x7f02dc104600 2024-09-10T21:25:52.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.802+0000 7f02e0bd9640 1 -- 172.21.15.59:0/1410388291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02dc19f630 con 0x7f02dc104600 2024-09-10T21:25:52.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.802+0000 7f02e0bd9640 1 -- 172.21.15.59:0/1410388291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02dc1a5d50 con 0x7f02dc104600 2024-09-10T21:25:52.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.805+0000 7f02d37fe640 1 -- 172.21.15.59:0/1410388291 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f02c40316a0 con 0x7f02dc104600 2024-09-10T21:25:52.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.805+0000 7f02e2fae740 1 Processor -- start 2024-09-10T21:25:52.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.805+0000 7f02e2fae740 1 -- start start 2024-09-10T21:25:52.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.805+0000 7f02e2fae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf62aee0 0x55b3bf62b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:52.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.805+0000 7f02e2fae740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62b800 0x55b3bf637250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:52.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.805+0000 7f02e2fae740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf637790 0x55b3bf639b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:52.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.805+0000 7f02e2fae740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b3bf5a1e60 con 0x55b3bf637790 2024-09-10T21:25:52.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.805+0000 7f02e2fae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b3bf591290 con 0x55b3bf62aee0 2024-09-10T21:25:52.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.805+0000 7f02e2fae740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b3bf5950a0 con 0x55b3bf62b800 2024-09-10T21:25:52.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.805+0000 7f02d3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf637790 0x55b3bf639b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:52.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.805+0000 7f02d3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf637790 0x55b3bf639b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41140/0 (socket says 172.21.15.59:41140) 2024-09-10T21:25:52.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.805+0000 7f02d3fff640 1 -- 172.21.15.59:0/3714753364 learned_addr learned my addr 172.21.15.59:0/3714753364 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:52.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.806+0000 7f02dad9d640 1 --2- 172.21.15.59:0/3714753364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf62aee0 0x55b3bf62b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:52.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.806+0000 7f02da59c640 1 --2- 172.21.15.59:0/3714753364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62b800 0x55b3bf637250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:52.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.806+0000 7f02d3fff640 1 -- 172.21.15.59:0/3714753364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62b800 msgr2=0x55b3bf637250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:52.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.806+0000 7f02d3fff640 1 --2- 172.21.15.59:0/3714753364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62b800 0x55b3bf637250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.806+0000 7f02d3fff640 1 -- 172.21.15.59:0/3714753364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf62aee0 msgr2=0x55b3bf62b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:52.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.806+0000 7f02d3fff640 1 --2- 172.21.15.59:0/3714753364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf62aee0 0x55b3bf62b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.806+0000 7f02d3fff640 1 -- 172.21.15.59:0/3714753364 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3bf2ef930 con 0x55b3bf637790 2024-09-10T21:25:52.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.806+0000 7f02da59c640 1 --2- 172.21.15.59:0/3714753364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62b800 0x55b3bf637250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:25:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.806+0000 7f02d3fff640 1 --2- 172.21.15.59:0/3714753364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf637790 0x55b3bf639b80 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f02c410c780 tx=0x7f02c410c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9e9f2f2750b6cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.806+0000 7f02d37fe640 1 --2- 172.21.15.59:0/1410388291 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f02c80b52e0 0x7f02c80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.806+0000 7f02dad9d640 1 --2- 172.21.15.59:0/1410388291 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f02c80b52e0 0x7f02c80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.806+0000 7f02d0ff9640 1 -- 172.21.15.59:0/3714753364 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c40c9420 con 0x55b3bf637790 2024-09-10T21:25:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.806+0000 7f02d0ff9640 1 -- 172.21.15.59:0/3714753364 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02c4113030 con 0x55b3bf637790 2024-09-10T21:25:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.806+0000 7f02d0ff9640 1 -- 172.21.15.59:0/3714753364 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c40d5700 con 0x55b3bf637790 2024-09-10T21:25:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.806+0000 7f02d37fe640 1 -- 172.21.15.59:0/1410388291 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f02c41065e0 con 0x7f02dc104600 2024-09-10T21:25:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.807+0000 7f02e2fae740 1 -- 172.21.15.59:0/3714753364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf637790 msgr2=0x55b3bf639b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.807+0000 7f02e2fae740 1 --2- 172.21.15.59:0/3714753364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf637790 0x55b3bf639b80 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f02c410c780 tx=0x7f02c410c870 comp rx=0 tx=0).stop 2024-09-10T21:25:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.807+0000 7f02dad9d640 1 --2- 172.21.15.59:0/1410388291 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f02c80b52e0 0x7f02c80b77a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f02d4007f10 tx=0x7f02d40076a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.807+0000 7f02e2fae740 1 -- 172.21.15.59:0/3714753364 shutdown_connections 2024-09-10T21:25:52.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.807+0000 7f02e2fae740 1 --2- 172.21.15.59:0/3714753364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf637790 0x55b3bf639b80 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.807+0000 7f02e2fae740 1 --2- 172.21.15.59:0/3714753364 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62b800 0x55b3bf637250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.807+0000 7f02e2fae740 1 --2- 172.21.15.59:0/3714753364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf62aee0 0x55b3bf62b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.807+0000 7f02e2fae740 1 -- 172.21.15.59:0/3714753364 >> 172.21.15.59:0/3714753364 conn(0x55b3bf628d10 msgr2=0x55b3bf629eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.807+0000 7f02e2fae740 1 -- 172.21.15.59:0/3714753364 shutdown_connections 2024-09-10T21:25:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.807+0000 7f02e2fae740 1 -- 172.21.15.59:0/3714753364 wait complete. 2024-09-10T21:25:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.808+0000 7f02e2fae740 1 -- start start 2024-09-10T21:25:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.808+0000 7f02e2fae740 1 Processor -- start 2024-09-10T21:25:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.808+0000 7f02e2fae740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62aee0 0x55b3bf634700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.808+0000 7f02e2fae740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62b800 0x55b3bf634c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.808+0000 7f02e2fae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf637790 0x55b3bf635180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.808+0000 7f02e2fae740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b3bf3f2890 con 0x55b3bf62b800 2024-09-10T21:25:52.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.808+0000 7f02e2fae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b3bf52bd40 con 0x55b3bf637790 2024-09-10T21:25:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.808+0000 7f02e2fae740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b3bf63a200 con 0x55b3bf62aee0 2024-09-10T21:25:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.808+0000 7f02e2fae740 10 client.0 _ll_register_callbacks cb 0x55b3bf58fc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.808+0000 7f02d3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62b800 0x55b3bf634c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.808+0000 7f02d3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62b800 0x55b3bf634c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41152/0 (socket says 172.21.15.59:41152) 2024-09-10T21:25:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.808+0000 7f02d3fff640 1 -- 172.21.15.59:0/2509646039 learned_addr learned my addr 172.21.15.59:0/2509646039 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.808+0000 7f02dad9d640 1 --2- 172.21.15.59:0/2509646039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf637790 0x55b3bf635180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.808+0000 7f02da59c640 1 --2- 172.21.15.59:0/2509646039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62aee0 0x55b3bf634700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.808+0000 7f02d3fff640 1 -- 172.21.15.59:0/2509646039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62aee0 msgr2=0x55b3bf634700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.808+0000 7f02d3fff640 1 --2- 172.21.15.59:0/2509646039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62aee0 0x55b3bf634700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.809+0000 7f02d3fff640 1 -- 172.21.15.59:0/2509646039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf637790 msgr2=0x55b3bf635180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.809+0000 7f02d3fff640 1 --2- 172.21.15.59:0/2509646039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf637790 0x55b3bf635180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.809+0000 7f02d3fff640 1 -- 172.21.15.59:0/2509646039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3bf6434c0 con 0x55b3bf62b800 2024-09-10T21:25:52.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.809+0000 7f02dad9d640 1 --2- 172.21.15.59:0/2509646039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf637790 0x55b3bf635180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:25:52.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.809+0000 7f02d3fff640 1 --2- 172.21.15.59:0/2509646039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62b800 0x55b3bf634c40 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f02c40ccad0 tx=0x7f02c4003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4174b480241af6bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:52.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.809+0000 7f02c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:52.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.809+0000 7f02c1ffb640 1 -- 172.21.15.59:0/2509646039 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c40d58f0 con 0x55b3bf62b800 2024-09-10T21:25:52.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.809+0000 7f02c1ffb640 1 -- 172.21.15.59:0/2509646039 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f02c40433b0 con 0x55b3bf62b800 2024-09-10T21:25:52.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.809+0000 7f02e2fae740 1 -- 172.21.15.59:0/2509646039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02c4113030 con 0x55b3bf62b800 2024-09-10T21:25:52.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.809+0000 7f02c1ffb640 1 -- 172.21.15.59:0/2509646039 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f02c40cb8e0 con 0x55b3bf62b800 2024-09-10T21:25:52.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.809+0000 7f02e2fae740 10 client.17964 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:52.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.809+0000 7f02e2fae740 1 -- 172.21.15.59:0/2509646039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b3bf645e70 con 0x55b3bf62b800 2024-09-10T21:25:52.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.809+0000 7f02c1ffb640 1 -- 172.21.15.59:0/2509646039 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02c40d0070 con 0x55b3bf62b800 2024-09-10T21:25:52.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.809+0000 7f02c1ffb640 1 -- 172.21.15.59:0/2509646039 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f02c40b4110 con 0x55b3bf62b800 2024-09-10T21:25:52.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.809+0000 7f02e2fae740 10 client.17964 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:52.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.809+0000 7f02e2fae740 10 client.17964 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:25:52.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.809+0000 7f02e2fae740 20 client.17964 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:52.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.810+0000 7f02e2fae740 1 --2- 172.21.15.59:0/2509646039 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b3bf6471c0 0x55b3bf6495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:52.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.810+0000 7f02e2fae740 4 client.17964 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:25:52.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.810+0000 7f02e2fae740 1 -- 172.21.15.59:0/2509646039 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3bf5a3db0 con 0x55b3bf6471c0 2024-09-10T21:25:52.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.810+0000 7f02da59c640 1 --2- 172.21.15.59:0/2509646039 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b3bf6471c0 0x55b3bf6495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:52.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.810+0000 7f02da59c640 1 --2- 172.21.15.59:0/2509646039 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b3bf6471c0 0x55b3bf6495b0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b1940d9217d1d5b server_cookie=2aa7b0a0a3dbdef2 in_seq=0 out_seq=0 2024-09-10T21:25:52.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.810+0000 7f02c1ffb640 10 client.17964 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:52.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.811+0000 7f02c1ffb640 1 -- 172.21.15.59:0/2509646039 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b3bf5a3db0 con 0x55b3bf6471c0 2024-09-10T21:25:52.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.811+0000 7f02c1ffb640 10 client.17964 handle_command_reply: tid=0 2024-09-10T21:25:52.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.811+0000 7f02e2fae740 1 client.17964 shutdown 2024-09-10T21:25:52.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.811+0000 7f02e2fae740 1 -- 172.21.15.59:0/2509646039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62b800 msgr2=0x55b3bf634c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:52.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.811+0000 7f02e2fae740 1 --2- 172.21.15.59:0/2509646039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62b800 0x55b3bf634c40 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f02c40ccad0 tx=0x7f02c4003f90 comp rx=0 tx=0).stop 2024-09-10T21:25:52.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.811+0000 7f02e2fae740 1 -- 172.21.15.59:0/2509646039 shutdown_connections 2024-09-10T21:25:52.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.811+0000 7f02e2fae740 1 --2- 172.21.15.59:0/2509646039 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf637790 0x55b3bf635180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.811+0000 7f02e2fae740 1 --2- 172.21.15.59:0/2509646039 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b3bf6471c0 0x55b3bf6495b0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.811+0000 7f02e2fae740 1 --2- 172.21.15.59:0/2509646039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62b800 0x55b3bf634c40 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.811+0000 7f02e2fae740 1 --2- 172.21.15.59:0/2509646039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62aee0 0x55b3bf634700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.811+0000 7f02c1ffb640 0 client.17964 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:52.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.811+0000 7f02e2fae740 1 -- 172.21.15.59:0/2509646039 >> 172.21.15.59:0/2509646039 conn(0x55b3bf628d10 msgr2=0x55b3bf627f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:52.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.811+0000 7f02e2fae740 1 -- 172.21.15.59:0/2509646039 shutdown_connections 2024-09-10T21:25:52.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.811+0000 7f02e2fae740 1 -- 172.21.15.59:0/2509646039 wait complete. 2024-09-10T21:25:52.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.811+0000 7f02e2fae740 20 client.17964 trim_cache size 0 max 16384 2024-09-10T21:25:52.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.829+0000 7f02e2fae740 1 Processor -- start 2024-09-10T21:25:52.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.829+0000 7f02e2fae740 1 -- start start 2024-09-10T21:25:52.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.829+0000 7f02e2fae740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62aee0 0x55b3bf627e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:52.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.829+0000 7f02e2fae740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62b800 0x55b3bf631930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:52.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.829+0000 7f02e2fae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf637790 0x55b3bf631e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:52.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.829+0000 7f02e2fae740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc1ae340 con 0x55b3bf62aee0 2024-09-10T21:25:52.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.829+0000 7f02e2fae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc1afe80 con 0x55b3bf637790 2024-09-10T21:25:52.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.829+0000 7f02e2fae740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc1aea10 con 0x55b3bf62b800 2024-09-10T21:25:52.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.830+0000 7f02da59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62aee0 0x55b3bf627e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:52.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.830+0000 7f02da59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62aee0 0x55b3bf627e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41162/0 (socket says 172.21.15.59:41162) 2024-09-10T21:25:52.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.830+0000 7f02da59c640 1 -- 172.21.15.59:0/3398232642 learned_addr learned my addr 172.21.15.59:0/3398232642 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:52.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.830+0000 7f02d3fff640 1 --2- 172.21.15.59:0/3398232642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62b800 0x55b3bf631930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:52.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.830+0000 7f02dad9d640 1 --2- 172.21.15.59:0/3398232642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf637790 0x55b3bf631e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:52.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.830+0000 7f02da59c640 1 -- 172.21.15.59:0/3398232642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62b800 msgr2=0x55b3bf631930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:52.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.830+0000 7f02da59c640 1 --2- 172.21.15.59:0/3398232642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62b800 0x55b3bf631930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.830+0000 7f02da59c640 1 -- 172.21.15.59:0/3398232642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf637790 msgr2=0x55b3bf631e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:52.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.830+0000 7f02da59c640 1 --2- 172.21.15.59:0/3398232642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf637790 0x55b3bf631e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.830+0000 7f02da59c640 1 -- 172.21.15.59:0/3398232642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3bf62b630 con 0x55b3bf62aee0 2024-09-10T21:25:52.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.830+0000 7f02d3fff640 1 --2- 172.21.15.59:0/3398232642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62b800 0x55b3bf631930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:52.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.830+0000 7f02dad9d640 1 --2- 172.21.15.59:0/3398232642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf637790 0x55b3bf631e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:52.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.830+0000 7f02da59c640 1 --2- 172.21.15.59:0/3398232642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62aee0 0x55b3bf627e60 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00b620 tx=0x7f02cc00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f688b4cbb80c75fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:52.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.830+0000 7f02c3fff640 1 -- 172.21.15.59:0/3398232642 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc003b20 con 0x55b3bf62aee0 2024-09-10T21:25:52.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.830+0000 7f02c3fff640 1 -- 172.21.15.59:0/3398232642 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02cc0054d0 con 0x55b3bf62aee0 2024-09-10T21:25:52.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.830+0000 7f02c3fff640 1 -- 172.21.15.59:0/3398232642 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc004da0 con 0x55b3bf62aee0 2024-09-10T21:25:52.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.831+0000 7f02e2fae740 1 -- 172.21.15.59:0/3398232642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62aee0 msgr2=0x55b3bf627e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:52.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.831+0000 7f02e2fae740 1 --2- 172.21.15.59:0/3398232642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62aee0 0x55b3bf627e60 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00b620 tx=0x7f02cc00bc20 comp rx=0 tx=0).stop 2024-09-10T21:25:52.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.831+0000 7f02e2fae740 1 -- 172.21.15.59:0/3398232642 shutdown_connections 2024-09-10T21:25:52.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.831+0000 7f02e2fae740 1 --2- 172.21.15.59:0/3398232642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf637790 0x55b3bf631e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.831+0000 7f02e2fae740 1 --2- 172.21.15.59:0/3398232642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62b800 0x55b3bf631930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.831+0000 7f02e2fae740 1 --2- 172.21.15.59:0/3398232642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62aee0 0x55b3bf627e60 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.831+0000 7f02e2fae740 1 -- 172.21.15.59:0/3398232642 >> 172.21.15.59:0/3398232642 conn(0x55b3bf628d10 msgr2=0x55b3bf627750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:52.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.831+0000 7f02e2fae740 1 -- 172.21.15.59:0/3398232642 shutdown_connections 2024-09-10T21:25:52.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.831+0000 7f02e2fae740 1 -- 172.21.15.59:0/3398232642 wait complete. 2024-09-10T21:25:52.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.831+0000 7f02e2fae740 1 -- start start 2024-09-10T21:25:52.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.831+0000 7f02e2fae740 1 Processor -- start 2024-09-10T21:25:52.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.831+0000 7f02e2fae740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62aee0 0x55b3bf6ac070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:52.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.831+0000 7f02e2fae740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62b800 0x55b3bf6ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:52.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02e2fae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf637790 0x55b3bf6b1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:52.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02e2fae740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc1af7b0 con 0x55b3bf62b800 2024-09-10T21:25:52.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02e2fae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc1af0e0 con 0x55b3bf637790 2024-09-10T21:25:52.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02e2fae740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc1ac320 con 0x55b3bf62aee0 2024-09-10T21:25:52.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02e2fae740 10 client.0 _ll_register_callbacks cb 0x7f02d4007540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:52.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02d3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62b800 0x55b3bf6ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:52.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02d3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62b800 0x55b3bf6ac5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41178/0 (socket says 172.21.15.59:41178) 2024-09-10T21:25:52.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02d3fff640 1 -- 172.21.15.59:0/563507973 learned_addr learned my addr 172.21.15.59:0/563507973 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:52.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02da59c640 1 --2- 172.21.15.59:0/563507973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62aee0 0x55b3bf6ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:52.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02dad9d640 1 --2- 172.21.15.59:0/563507973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf637790 0x55b3bf6b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:52.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02d3fff640 1 -- 172.21.15.59:0/563507973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62aee0 msgr2=0x55b3bf6ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:52.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02d3fff640 1 --2- 172.21.15.59:0/563507973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62aee0 0x55b3bf6ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02d3fff640 1 -- 172.21.15.59:0/563507973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf637790 msgr2=0x55b3bf6b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:52.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02d3fff640 1 --2- 172.21.15.59:0/563507973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf637790 0x55b3bf6b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02d3fff640 1 -- 172.21.15.59:0/563507973 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3bf6b1c90 con 0x55b3bf62b800 2024-09-10T21:25:52.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02d3fff640 1 --2- 172.21.15.59:0/563507973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62b800 0x55b3bf6ac5f0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f02c4104480 tx=0x7f02c4031f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8644c2617f5a69f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:52.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:52.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02c1ffb640 1 -- 172.21.15.59:0/563507973 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c40cc540 con 0x55b3bf62b800 2024-09-10T21:25:52.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02c1ffb640 1 -- 172.21.15.59:0/563507973 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f02c40b4110 con 0x55b3bf62b800 2024-09-10T21:25:52.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.832+0000 7f02e2fae740 1 -- 172.21.15.59:0/563507973 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02cc0054d0 con 0x55b3bf62b800 2024-09-10T21:25:52.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.833+0000 7f02c1ffb640 1 -- 172.21.15.59:0/563507973 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f02c40cc720 con 0x55b3bf62b800 2024-09-10T21:25:52.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.833+0000 7f02e2fae740 10 client.17970 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:52.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.833+0000 7f02e2fae740 1 -- 172.21.15.59:0/563507973 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b3bf6b1c90 con 0x55b3bf62b800 2024-09-10T21:25:52.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.833+0000 7f02c1ffb640 1 -- 172.21.15.59:0/563507973 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02cc0054d0 con 0x55b3bf62b800 2024-09-10T21:25:52.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.833+0000 7f02c1ffb640 1 -- 172.21.15.59:0/563507973 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f02c40c9040 con 0x55b3bf62b800 2024-09-10T21:25:52.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.833+0000 7f02e2fae740 10 client.17970 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:52.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.833+0000 7f02e2fae740 10 client.17970 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:25:52.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.833+0000 7f02e2fae740 20 client.17970 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:52.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.833+0000 7f02e2fae740 1 --2- 172.21.15.59:0/563507973 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b3bf6b9440 0x55b3bf6bb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:52.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.833+0000 7f02e2fae740 4 client.17970 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:25:52.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.833+0000 7f02e2fae740 1 -- 172.21.15.59:0/563507973 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b3bf62a8a0 con 0x55b3bf6b9440 2024-09-10T21:25:52.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.833+0000 7f02da59c640 1 --2- 172.21.15.59:0/563507973 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b3bf6b9440 0x55b3bf6bb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:52.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.834+0000 7f02c1ffb640 10 client.17970 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:52.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.834+0000 7f02da59c640 1 --2- 172.21.15.59:0/563507973 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b3bf6b9440 0x55b3bf6bb860 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1abc5fda1fbad65 server_cookie=c67eb4b0b719e89d in_seq=0 out_seq=0 2024-09-10T21:25:52.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.836+0000 7f02c1ffb640 1 -- 172.21.15.59:0/563507973 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b3bf62a8a0 con 0x55b3bf6b9440 2024-09-10T21:25:52.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.836+0000 7f02c1ffb640 10 client.17970 handle_command_reply: tid=0 2024-09-10T21:25:52.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.836+0000 7f02e2fae740 1 client.17970 shutdown 2024-09-10T21:25:52.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.836+0000 7f02e2fae740 1 -- 172.21.15.59:0/563507973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62b800 msgr2=0x55b3bf6ac5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:52.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.836+0000 7f02e2fae740 1 --2- 172.21.15.59:0/563507973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62b800 0x55b3bf6ac5f0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f02c4104480 tx=0x7f02c4031f50 comp rx=0 tx=0).stop 2024-09-10T21:25:52.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.836+0000 7f02e2fae740 1 -- 172.21.15.59:0/563507973 shutdown_connections 2024-09-10T21:25:52.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.836+0000 7f02e2fae740 1 --2- 172.21.15.59:0/563507973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b3bf637790 0x55b3bf6b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.836+0000 7f02e2fae740 1 --2- 172.21.15.59:0/563507973 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55b3bf6b9440 0x55b3bf6bb860 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.836+0000 7f02e2fae740 1 --2- 172.21.15.59:0/563507973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3bf62b800 0x55b3bf6ac5f0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.836+0000 7f02c1ffb640 0 client.17970 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:52.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.836+0000 7f02e2fae740 1 --2- 172.21.15.59:0/563507973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b3bf62aee0 0x55b3bf6ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.836+0000 7f02e2fae740 1 -- 172.21.15.59:0/563507973 >> 172.21.15.59:0/563507973 conn(0x55b3bf628d10 msgr2=0x55b3bf636550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:52.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.836+0000 7f02e2fae740 1 -- 172.21.15.59:0/563507973 shutdown_connections 2024-09-10T21:25:52.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.836+0000 7f02e2fae740 1 -- 172.21.15.59:0/563507973 wait complete. 2024-09-10T21:25:52.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.836+0000 7f02e2fae740 20 client.17970 trim_cache size 0 max 16384 2024-09-10T21:25:52.847 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:25:52.847 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:25:52.847 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "c1d7b6a9-2cd5-4680-80e3-076ef527cd5d", 2024-09-10T21:25:52.848 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:25:52.848 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:25:52.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.837+0000 7f02e0bd9640 1 -- 172.21.15.59:0/1410388291 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f02c80b52e0 msgr2=0x7f02c80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:52.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.837+0000 7f02e0bd9640 1 --2- 172.21.15.59:0/1410388291 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f02c80b52e0 0x7f02c80b77a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f02d4007f10 tx=0x7f02d40076a0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.837+0000 7f02e0bd9640 1 -- 172.21.15.59:0/1410388291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02dc104600 msgr2=0x7f02dc199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:52.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.837+0000 7f02e0bd9640 1 --2- 172.21.15.59:0/1410388291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02dc104600 0x7f02dc199830 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f02c4005ab0 tx=0x7f02c4003b90 comp rx=0 tx=0).stop 2024-09-10T21:25:52.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.837+0000 7f02e0bd9640 1 -- 172.21.15.59:0/1410388291 shutdown_connections 2024-09-10T21:25:52.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.837+0000 7f02e0bd9640 1 --2- 172.21.15.59:0/1410388291 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f02c80b52e0 0x7f02c80b77a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.837+0000 7f02e0bd9640 1 --2- 172.21.15.59:0/1410388291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02dc10d140 0x7f02dc19ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.837+0000 7f02e0bd9640 1 --2- 172.21.15.59:0/1410388291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02dc104600 0x7f02dc199830 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.837+0000 7f02e0bd9640 1 --2- 172.21.15.59:0/1410388291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02dc103ce0 0x7f02dc1992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:52.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.837+0000 7f02e0bd9640 1 -- 172.21.15.59:0/1410388291 >> 172.21.15.59:0/1410388291 conn(0x7f02dc0fd700 msgr2=0x7f02dc10f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:52.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.837+0000 7f02e0bd9640 1 -- 172.21.15.59:0/1410388291 shutdown_connections 2024-09-10T21:25:52.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:52.837+0000 7f02e0bd9640 1 -- 172.21.15.59:0/1410388291 wait complete. 2024-09-10T21:25:53.159 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:52 smithi059 ceph-mon[30888]: pgmap v658: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:25:53.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:52 smithi154 ceph-mon[35041]: pgmap v658: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:25:53.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:52 smithi192 ceph-mon[35363]: pgmap v658: 97 pgs: 97 active+clean; 7.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:25:53.701 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:25:53.968 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:25:54.089 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:53 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:25:54.089 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:53 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:25:54.089 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:53 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:25:54.089 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:53 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:25:54.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:53 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:25:54.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:53 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:25:54.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:53 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:25:54.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:53 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:25:54.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:53 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:25:54.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:53 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:25:54.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:53 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:25:54.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:53 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:25:54.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.484+0000 7f70a77ba640 1 -- 172.21.15.59:0/780350163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70a01087d0 msgr2=0x7f70a0108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:54.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.484+0000 7f70a77ba640 1 --2- 172.21.15.59:0/780350163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70a01087d0 0x7f70a0108c10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7090009860 tx=0x7f709002a340 comp rx=0 tx=0).stop 2024-09-10T21:25:54.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.484+0000 7f70a77ba640 1 -- 172.21.15.59:0/780350163 shutdown_connections 2024-09-10T21:25:54.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.484+0000 7f70a77ba640 1 --2- 172.21.15.59:0/780350163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a0109150 0x7f70a010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.484+0000 7f70a77ba640 1 --2- 172.21.15.59:0/780350163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70a01087d0 0x7f70a0108c10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.484+0000 7f70a77ba640 1 --2- 172.21.15.59:0/780350163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70a0102dc0 0x7f70a01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.484+0000 7f70a77ba640 1 -- 172.21.15.59:0/780350163 >> 172.21.15.59:0/780350163 conn(0x7f70a00fe830 msgr2=0x7f70a0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.484+0000 7f70a77ba640 1 -- 172.21.15.59:0/780350163 shutdown_connections 2024-09-10T21:25:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.484+0000 7f70a77ba640 1 -- 172.21.15.59:0/780350163 wait complete. 2024-09-10T21:25:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.485+0000 7f70a77ba640 1 Processor -- start 2024-09-10T21:25:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.485+0000 7f70a77ba640 1 -- start start 2024-09-10T21:25:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.485+0000 7f70a77ba640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a0102dc0 0x7f70a00754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.485+0000 7f70a77ba640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70a01087d0 0x7f70a00759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.485+0000 7f70a77ba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70a0109150 0x7f70a0075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.485+0000 7f70a77ba640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f70a0112da0 con 0x7f70a0102dc0 2024-09-10T21:25:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.485+0000 7f70a77ba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70a0112c20 con 0x7f70a0109150 2024-09-10T21:25:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.485+0000 7f70a77ba640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f70a0112f20 con 0x7f70a01087d0 2024-09-10T21:25:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.485+0000 7f70a5556640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a0102dc0 0x7f70a00754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.486+0000 7f70a5556640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a0102dc0 0x7f70a00754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41198/0 (socket says 172.21.15.59:41198) 2024-09-10T21:25:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.486+0000 7f70a5556640 1 -- 172.21.15.59:0/1728573509 learned_addr learned my addr 172.21.15.59:0/1728573509 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.486+0000 7f70a4d55640 1 --2- 172.21.15.59:0/1728573509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70a01087d0 0x7f70a00759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.486+0000 7f70a5d57640 1 --2- 172.21.15.59:0/1728573509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70a0109150 0x7f70a0075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.486+0000 7f70a5556640 1 -- 172.21.15.59:0/1728573509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70a01087d0 msgr2=0x7f70a00759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.486+0000 7f70a5556640 1 --2- 172.21.15.59:0/1728573509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70a01087d0 0x7f70a00759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.486+0000 7f70a5556640 1 -- 172.21.15.59:0/1728573509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70a0109150 msgr2=0x7f70a0075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:54.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.486+0000 7f70a5556640 1 --2- 172.21.15.59:0/1728573509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70a0109150 0x7f70a0075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.486+0000 7f70a5556640 1 -- 172.21.15.59:0/1728573509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a01a7690 con 0x7f70a0102dc0 2024-09-10T21:25:54.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.486+0000 7f70a5556640 1 --2- 172.21.15.59:0/1728573509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a0102dc0 0x7f70a00754a0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f709c00e9f0 tx=0x7f709c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:54.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.486+0000 7f70967fc640 1 -- 172.21.15.59:0/1728573509 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c00cd80 con 0x7f70a0102dc0 2024-09-10T21:25:54.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.486+0000 7f70a77ba640 1 -- 172.21.15.59:0/1728573509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a01a7980 con 0x7f70a0102dc0 2024-09-10T21:25:54.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.486+0000 7f70967fc640 1 -- 172.21.15.59:0/1728573509 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f709c0108e0 con 0x7f70a0102dc0 2024-09-10T21:25:54.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.486+0000 7f70967fc640 1 -- 172.21.15.59:0/1728573509 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c018980 con 0x7f70a0102dc0 2024-09-10T21:25:54.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.486+0000 7f70a77ba640 1 -- 172.21.15.59:0/1728573509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a01a7e90 con 0x7f70a0102dc0 2024-09-10T21:25:54.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.489+0000 7f70a9b8f740 1 Processor -- start 2024-09-10T21:25:54.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.489+0000 7f70a9b8f740 1 -- start start 2024-09-10T21:25:54.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.489+0000 7f70967fc640 1 -- 172.21.15.59:0/1728573509 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f709c010430 con 0x7f70a0102dc0 2024-09-10T21:25:54.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.489+0000 7f70a9b8f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce303c480 0x558ce303c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:54.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.489+0000 7f70a9b8f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce303cda0 0x558ce30487f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:54.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.489+0000 7f70a9b8f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce3048d30 0x558ce304b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:54.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.489+0000 7f70a9b8f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558ce2fb2e50 con 0x558ce3048d30 2024-09-10T21:25:54.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.489+0000 7f70a9b8f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558ce2fa2280 con 0x558ce303cda0 2024-09-10T21:25:54.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.489+0000 7f70a9b8f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558ce2fa6090 con 0x558ce303c480 2024-09-10T21:25:54.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.489+0000 7f70a4d55640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce3048d30 0x558ce304b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:54.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.489+0000 7f70a4d55640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce3048d30 0x558ce304b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41202/0 (socket says 172.21.15.59:41202) 2024-09-10T21:25:54.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.489+0000 7f70a4d55640 1 -- 172.21.15.59:0/1335521794 learned_addr learned my addr 172.21.15.59:0/1335521794 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:54.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.490+0000 7f70a5556640 1 --2- 172.21.15.59:0/1335521794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce303cda0 0x558ce30487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:54.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.490+0000 7f70a5d57640 1 --2- 172.21.15.59:0/1335521794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce303c480 0x558ce303c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:54.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.490+0000 7f70a4d55640 1 -- 172.21.15.59:0/1335521794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce303c480 msgr2=0x558ce303c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:54.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.490+0000 7f70a4d55640 1 --2- 172.21.15.59:0/1335521794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce303c480 0x558ce303c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.490+0000 7f70a4d55640 1 -- 172.21.15.59:0/1335521794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce303cda0 msgr2=0x558ce30487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:54.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.490+0000 7f70a4d55640 1 --2- 172.21.15.59:0/1335521794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce303cda0 0x558ce30487f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.490+0000 7f70a4d55640 1 -- 172.21.15.59:0/1335521794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ce2d00650 con 0x558ce3048d30 2024-09-10T21:25:54.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.490+0000 7f70a5556640 1 --2- 172.21.15.59:0/1335521794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce303cda0 0x558ce30487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:25:54.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.490+0000 7f70a5d57640 1 --2- 172.21.15.59:0/1335521794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce303c480 0x558ce303c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:25:54.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.490+0000 7f70967fc640 1 --2- 172.21.15.59:0/1728573509 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f708c0b52e0 0x7f708c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:54.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.490+0000 7f70a4d55640 1 --2- 172.21.15.59:0/1335521794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce3048d30 0x558ce304b120 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f7090009860 tx=0x7f7090005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af754b3bbd8b079 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:54.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.490+0000 7f70a5d57640 1 --2- 172.21.15.59:0/1728573509 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f708c0b52e0 0x7f708c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:54.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.490+0000 7f70967fc640 1 -- 172.21.15.59:0/1728573509 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f709c0e5fa0 con 0x7f70a0102dc0 2024-09-10T21:25:54.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.490+0000 7f708b7fe640 1 -- 172.21.15.59:0/1335521794 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7090037040 con 0x558ce3048d30 2024-09-10T21:25:54.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.490+0000 7f708b7fe640 1 -- 172.21.15.59:0/1335521794 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7090030450 con 0x558ce3048d30 2024-09-10T21:25:54.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.490+0000 7f708b7fe640 1 -- 172.21.15.59:0/1335521794 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70900039e0 con 0x558ce3048d30 2024-09-10T21:25:54.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.491+0000 7f70a9b8f740 1 -- 172.21.15.59:0/1335521794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce3048d30 msgr2=0x558ce304b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:54.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.491+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/1335521794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce3048d30 0x558ce304b120 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f7090009860 tx=0x7f7090005b10 comp rx=0 tx=0).stop 2024-09-10T21:25:54.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.491+0000 7f70a5d57640 1 --2- 172.21.15.59:0/1728573509 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f708c0b52e0 0x7f708c0b77a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f70a0077560 tx=0x7f70980095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:54.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.491+0000 7f70a9b8f740 1 -- 172.21.15.59:0/1335521794 shutdown_connections 2024-09-10T21:25:54.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.491+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/1335521794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce3048d30 0x558ce304b120 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.491+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/1335521794 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce303cda0 0x558ce30487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.491+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/1335521794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce303c480 0x558ce303c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.491+0000 7f70a9b8f740 1 -- 172.21.15.59:0/1335521794 >> 172.21.15.59:0/1335521794 conn(0x558ce303a2b0 msgr2=0x558ce303b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.491+0000 7f70a9b8f740 1 -- 172.21.15.59:0/1335521794 shutdown_connections 2024-09-10T21:25:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.491+0000 7f70a9b8f740 1 -- 172.21.15.59:0/1335521794 wait complete. 2024-09-10T21:25:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.491+0000 7f70a9b8f740 1 -- start start 2024-09-10T21:25:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.492+0000 7f70a9b8f740 1 Processor -- start 2024-09-10T21:25:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.492+0000 7f70a9b8f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303c480 0x558ce30485d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.492+0000 7f70a9b8f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce303cda0 0x558ce3045a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.492+0000 7f70a9b8f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce3048d30 0x558ce3045fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.492+0000 7f70a9b8f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558ce2e03700 con 0x558ce303c480 2024-09-10T21:25:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.492+0000 7f70a9b8f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558ce2f3d110 con 0x558ce3048d30 2024-09-10T21:25:54.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.492+0000 7f70a9b8f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558ce304b950 con 0x558ce303cda0 2024-09-10T21:25:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.492+0000 7f70a9b8f740 10 client.0 _ll_register_callbacks cb 0x558ce2f56990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.492+0000 7f70a5556640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303c480 0x558ce30485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.492+0000 7f70a5556640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303c480 0x558ce30485d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41204/0 (socket says 172.21.15.59:41204) 2024-09-10T21:25:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.492+0000 7f70a5556640 1 -- 172.21.15.59:0/1403189220 learned_addr learned my addr 172.21.15.59:0/1403189220 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.492+0000 7f70a4d55640 1 --2- 172.21.15.59:0/1403189220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce303cda0 0x558ce3045a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.492+0000 7f70a5d57640 1 --2- 172.21.15.59:0/1403189220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce3048d30 0x558ce3045fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.493+0000 7f70a5556640 1 -- 172.21.15.59:0/1403189220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce303cda0 msgr2=0x558ce3045a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.493+0000 7f70a5556640 1 --2- 172.21.15.59:0/1403189220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce303cda0 0x558ce3045a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.493+0000 7f70a5556640 1 -- 172.21.15.59:0/1403189220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce3048d30 msgr2=0x558ce3045fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.493+0000 7f70a5556640 1 --2- 172.21.15.59:0/1403189220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce3048d30 0x558ce3045fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.493+0000 7f70a5556640 1 -- 172.21.15.59:0/1403189220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ce2f6ac40 con 0x558ce303c480 2024-09-10T21:25:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.493+0000 7f70a5d57640 1 --2- 172.21.15.59:0/1403189220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce3048d30 0x558ce3045fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:54.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.493+0000 7f70a5556640 1 --2- 172.21.15.59:0/1403189220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303c480 0x558ce30485d0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f709c00e9c0 tx=0x7f709c0e9840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ae0e0d3d81b6de server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.493+0000 7f7088ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.493+0000 7f7088ff9640 1 -- 172.21.15.59:0/1403189220 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c0cf040 con 0x558ce303c480 2024-09-10T21:25:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.493+0000 7f7088ff9640 1 -- 172.21.15.59:0/1403189220 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f709c0abbf0 con 0x558ce303c480 2024-09-10T21:25:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.493+0000 7f70a9b8f740 1 -- 172.21.15.59:0/1403189220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7090030450 con 0x558ce303c480 2024-09-10T21:25:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.493+0000 7f7088ff9640 1 -- 172.21.15.59:0/1403189220 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f709c0ac0e0 con 0x558ce303c480 2024-09-10T21:25:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.493+0000 7f70a9b8f740 10 client.17982 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.493+0000 7f70a9b8f740 1 -- 172.21.15.59:0/1403189220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558ce30572a0 con 0x558ce303c480 2024-09-10T21:25:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.493+0000 7f7088ff9640 1 -- 172.21.15.59:0/1403189220 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7090030450 con 0x558ce303c480 2024-09-10T21:25:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.493+0000 7f7088ff9640 1 -- 172.21.15.59:0/1403189220 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f709c0cfae0 con 0x558ce303c480 2024-09-10T21:25:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.494+0000 7f70a9b8f740 10 client.17982 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.494+0000 7f70a9b8f740 10 client.17982 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:25:54.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.494+0000 7f70a9b8f740 20 client.17982 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.494+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/1403189220 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558ce3058760 0x558ce305ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.494+0000 7f70a9b8f740 4 client.17982 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:25:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.494+0000 7f70a9b8f740 1 -- 172.21.15.59:0/1403189220 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ce2fb4da0 con 0x558ce3058760 2024-09-10T21:25:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.494+0000 7f70a4d55640 1 --2- 172.21.15.59:0/1403189220 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558ce3058760 0x558ce305ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.494+0000 7f70a4d55640 1 --2- 172.21.15.59:0/1403189220 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558ce3058760 0x558ce305ab50 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f36a52ccc51ea214 server_cookie=768b7c90a511b51c in_seq=0 out_seq=0 2024-09-10T21:25:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.494+0000 7f7088ff9640 10 client.17982 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.495+0000 7f7088ff9640 1 -- 172.21.15.59:0/1403189220 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558ce2fb4da0 con 0x558ce3058760 2024-09-10T21:25:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.495+0000 7f7088ff9640 10 client.17982 handle_command_reply: tid=0 2024-09-10T21:25:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.495+0000 7f70a9b8f740 1 client.17982 shutdown 2024-09-10T21:25:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.495+0000 7f70a9b8f740 1 -- 172.21.15.59:0/1403189220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303c480 msgr2=0x558ce30485d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.495+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/1403189220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303c480 0x558ce30485d0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f709c00e9c0 tx=0x7f709c0e9840 comp rx=0 tx=0).stop 2024-09-10T21:25:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.495+0000 7f70a9b8f740 1 -- 172.21.15.59:0/1403189220 shutdown_connections 2024-09-10T21:25:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.495+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/1403189220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce3048d30 0x558ce3045fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.495+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/1403189220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce303cda0 0x558ce3045a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.495+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/1403189220 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558ce3058760 0x558ce305ab50 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.495+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/1403189220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303c480 0x558ce30485d0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.495+0000 7f70a9b8f740 1 -- 172.21.15.59:0/1403189220 >> 172.21.15.59:0/1403189220 conn(0x558ce303a2b0 msgr2=0x558ce303fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.495+0000 7f7088ff9640 0 client.17982 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.495+0000 7f70a9b8f740 1 -- 172.21.15.59:0/1403189220 shutdown_connections 2024-09-10T21:25:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.496+0000 7f70a9b8f740 1 -- 172.21.15.59:0/1403189220 wait complete. 2024-09-10T21:25:54.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.496+0000 7f70a9b8f740 20 client.17982 trim_cache size 0 max 16384 2024-09-10T21:25:54.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.513+0000 7f70a9b8f740 1 Processor -- start 2024-09-10T21:25:54.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.513+0000 7f70a9b8f740 1 -- start start 2024-09-10T21:25:54.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.513+0000 7f70a9b8f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce303c480 0x558ce3054b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:54.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.513+0000 7f70a9b8f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303cda0 0x558ce305a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.513+0000 7f70a9b8f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce3048d30 0x558ce30442a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.513+0000 7f70a9b8f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f70a01b04e0 con 0x558ce303cda0 2024-09-10T21:25:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.513+0000 7f70a9b8f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70a01b2020 con 0x558ce303c480 2024-09-10T21:25:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.513+0000 7f70a9b8f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f70a01b0bb0 con 0x558ce3048d30 2024-09-10T21:25:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.513+0000 7f70a4d55640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303cda0 0x558ce305a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.513+0000 7f70a4d55640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303cda0 0x558ce305a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41218/0 (socket says 172.21.15.59:41218) 2024-09-10T21:25:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.513+0000 7f70a4d55640 1 -- 172.21.15.59:0/788209865 learned_addr learned my addr 172.21.15.59:0/788209865 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.514+0000 7f70a5d57640 1 --2- 172.21.15.59:0/788209865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce3048d30 0x558ce30442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.514+0000 7f70a4d55640 1 -- 172.21.15.59:0/788209865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce3048d30 msgr2=0x558ce30442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.514+0000 7f70a4d55640 1 --2- 172.21.15.59:0/788209865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce3048d30 0x558ce30442a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.514+0000 7f70a5556640 1 --2- 172.21.15.59:0/788209865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce303c480 0x558ce3054b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.514+0000 7f70a4d55640 1 -- 172.21.15.59:0/788209865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce303c480 msgr2=0x558ce3054b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.514+0000 7f70a4d55640 1 --2- 172.21.15.59:0/788209865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce303c480 0x558ce3054b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.514+0000 7f70a4d55640 1 -- 172.21.15.59:0/788209865 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ce30457d0 con 0x558ce303cda0 2024-09-10T21:25:54.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.514+0000 7f70a5556640 1 --2- 172.21.15.59:0/788209865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce303c480 0x558ce3054b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:54.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.514+0000 7f70a4d55640 1 --2- 172.21.15.59:0/788209865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303cda0 0x558ce305a770 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f7090005e00 tx=0x7f709002a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d34096e120622f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:54.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.514+0000 7f708affd640 1 -- 172.21.15.59:0/788209865 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7090037040 con 0x558ce303cda0 2024-09-10T21:25:54.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.514+0000 7f708affd640 1 -- 172.21.15.59:0/788209865 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7090005500 con 0x558ce303cda0 2024-09-10T21:25:54.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.514+0000 7f708affd640 1 -- 172.21.15.59:0/788209865 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70900049b0 con 0x558ce303cda0 2024-09-10T21:25:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.515+0000 7f70a9b8f740 1 -- 172.21.15.59:0/788209865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303cda0 msgr2=0x558ce305a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.515+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/788209865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303cda0 0x558ce305a770 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f7090005e00 tx=0x7f709002a340 comp rx=0 tx=0).stop 2024-09-10T21:25:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.515+0000 7f70a9b8f740 1 -- 172.21.15.59:0/788209865 shutdown_connections 2024-09-10T21:25:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.515+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/788209865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce3048d30 0x558ce30442a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.515+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/788209865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303cda0 0x558ce305a770 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.515+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/788209865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce303c480 0x558ce3054b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.515+0000 7f70a9b8f740 1 -- 172.21.15.59:0/788209865 >> 172.21.15.59:0/788209865 conn(0x558ce303a2b0 msgr2=0x558ce303b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.515+0000 7f70a9b8f740 1 -- 172.21.15.59:0/788209865 shutdown_connections 2024-09-10T21:25:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.515+0000 7f70a9b8f740 1 -- 172.21.15.59:0/788209865 wait complete. 2024-09-10T21:25:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.515+0000 7f70a9b8f740 1 -- start start 2024-09-10T21:25:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.515+0000 7f70a9b8f740 1 Processor -- start 2024-09-10T21:25:54.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f70a9b8f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce303c480 0x558ce3050bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:54.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f70a9b8f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303cda0 0x558ce3051130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:54.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f70a9b8f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce3048d30 0x558ce304bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:54.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f70a9b8f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f70a01b1950 con 0x558ce303cda0 2024-09-10T21:25:54.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f70a9b8f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70a01b1280 con 0x558ce3048d30 2024-09-10T21:25:54.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f70a9b8f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f70a01ae4c0 con 0x558ce303c480 2024-09-10T21:25:54.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f70a9b8f740 10 client.0 _ll_register_callbacks cb 0x7f709c009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:54.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f70a4d55640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303cda0 0x558ce3051130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:54.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f70a4d55640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303cda0 0x558ce3051130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41222/0 (socket says 172.21.15.59:41222) 2024-09-10T21:25:54.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f70a4d55640 1 -- 172.21.15.59:0/3150351450 learned_addr learned my addr 172.21.15.59:0/3150351450 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:54.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f70a5556640 1 --2- 172.21.15.59:0/3150351450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce303c480 0x558ce3050bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:54.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f70a5d57640 1 --2- 172.21.15.59:0/3150351450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce3048d30 0x558ce304bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:54.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f70a4d55640 1 -- 172.21.15.59:0/3150351450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce303c480 msgr2=0x558ce3050bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f70a4d55640 1 --2- 172.21.15.59:0/3150351450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce303c480 0x558ce3050bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f70a4d55640 1 -- 172.21.15.59:0/3150351450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce3048d30 msgr2=0x558ce304bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f70a4d55640 1 --2- 172.21.15.59:0/3150351450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce3048d30 0x558ce304bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f70a4d55640 1 -- 172.21.15.59:0/3150351450 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ce3051960 con 0x558ce303cda0 2024-09-10T21:25:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f70a4d55640 1 --2- 172.21.15.59:0/3150351450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303cda0 0x558ce3051130 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f7090009780 tx=0x7f7090005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1bea4ec6fb9d2e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f7088ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.516+0000 7f7088ff9640 1 -- 172.21.15.59:0/3150351450 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7090037040 con 0x558ce303cda0 2024-09-10T21:25:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.517+0000 7f7088ff9640 1 -- 172.21.15.59:0/3150351450 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7090005050 con 0x558ce303cda0 2024-09-10T21:25:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.517+0000 7f70a9b8f740 1 -- 172.21.15.59:0/3150351450 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7090005500 con 0x558ce303cda0 2024-09-10T21:25:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.517+0000 7f7088ff9640 1 -- 172.21.15.59:0/3150351450 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7090005250 con 0x558ce303cda0 2024-09-10T21:25:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.517+0000 7f70a9b8f740 10 client.17988 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.517+0000 7f70a9b8f740 1 -- 172.21.15.59:0/3150351450 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558ce30c5ad0 con 0x558ce303cda0 2024-09-10T21:25:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.517+0000 7f7088ff9640 1 -- 172.21.15.59:0/3150351450 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7090005500 con 0x558ce303cda0 2024-09-10T21:25:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.517+0000 7f7088ff9640 1 -- 172.21.15.59:0/3150351450 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7090050430 con 0x558ce303cda0 2024-09-10T21:25:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.517+0000 7f70a9b8f740 10 client.17988 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.517+0000 7f70a9b8f740 10 client.17988 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:25:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.517+0000 7f70a9b8f740 20 client.17988 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.517+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/3150351450 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558ce30c5df0 0x558ce30c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.517+0000 7f70a9b8f740 4 client.17988 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:25:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.517+0000 7f70a9b8f740 1 -- 172.21.15.59:0/3150351450 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558ce2fb0850 con 0x558ce30c5df0 2024-09-10T21:25:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.517+0000 7f70a5556640 1 --2- 172.21.15.59:0/3150351450 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558ce30c5df0 0x558ce30c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.518+0000 7f70a5556640 1 --2- 172.21.15.59:0/3150351450 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558ce30c5df0 0x558ce30c81e0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=beeb7e20b1a02991 server_cookie=7a971586bfb21404 in_seq=0 out_seq=0 2024-09-10T21:25:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.518+0000 7f7088ff9640 10 client.17988 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.518+0000 7f7088ff9640 1 -- 172.21.15.59:0/3150351450 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5486 (crc 0 0 0) 0x558ce2fb0850 con 0x558ce30c5df0 2024-09-10T21:25:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.518+0000 7f7088ff9640 10 client.17988 handle_command_reply: tid=0 2024-09-10T21:25:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.518+0000 7f70a9b8f740 1 client.17988 shutdown 2024-09-10T21:25:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.518+0000 7f70a9b8f740 1 -- 172.21.15.59:0/3150351450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303cda0 msgr2=0x558ce3051130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.518+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/3150351450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303cda0 0x558ce3051130 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f7090009780 tx=0x7f7090005f90 comp rx=0 tx=0).stop 2024-09-10T21:25:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.518+0000 7f70a9b8f740 1 -- 172.21.15.59:0/3150351450 shutdown_connections 2024-09-10T21:25:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.518+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/3150351450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558ce3048d30 0x558ce304bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.518+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/3150351450 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x558ce30c5df0 0x558ce30c81e0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.518+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/3150351450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558ce303cda0 0x558ce3051130 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.518+0000 7f70a9b8f740 1 --2- 172.21.15.59:0/3150351450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558ce303c480 0x558ce3050bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.518+0000 7f7088ff9640 0 client.17988 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:25:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.518+0000 7f70a9b8f740 1 -- 172.21.15.59:0/3150351450 >> 172.21.15.59:0/3150351450 conn(0x558ce303a2b0 msgr2=0x558ce303b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.518+0000 7f70a9b8f740 1 -- 172.21.15.59:0/3150351450 shutdown_connections 2024-09-10T21:25:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.518+0000 7f70a9b8f740 1 -- 172.21.15.59:0/3150351450 wait complete. 2024-09-10T21:25:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.519+0000 7f70a9b8f740 20 client.17988 trim_cache size 0 max 16384 2024-09-10T21:25:54.527 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:25:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:25:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:25:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:25:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "c1d7b6a9-2cd5-4680-80e3-076ef527cd5d": { 2024-09-10T21:25:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:25:52.833923+0000", 2024-09-10T21:25:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "5e9056fa-94a3-4be5-a66c-5033a946ad88": { 2024-09-10T21:25:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:25:07.346164+0000", 2024-09-10T21:25:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "3ac3cde1-bbc5-4c68-9fc6-bc3e3022aea8": { 2024-09-10T21:25:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:24:53.320547+0000", 2024-09-10T21:25:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "0fb476f2-3572-4daf-8d42-5cf40259db46": { 2024-09-10T21:25:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:53.136187+0000", 2024-09-10T21:25:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "cb01ac69-57ce-4c62-b57a-054abf74df29": { 2024-09-10T21:25:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:07.589420+0000", 2024-09-10T21:25:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:25:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:25:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:25:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:25:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:25:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:07.066301+0000", 2024-09-10T21:25:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:25:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:25:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "7de1e6cf-02c2-41f2-b957-563f88bae8ef": { 2024-09-10T21:25:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:22:22.098651+0000", 2024-09-10T21:25:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:25:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:25:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:25:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:25:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "ec2c29bb-febd-4190-959f-09af3764b7ad": { 2024-09-10T21:25:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:24:07.378801+0000", 2024-09-10T21:25:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:25:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:25:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:25:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:25:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:25:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:25:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:25:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:25:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "800cdb00-6a99-4c42-8a9e-4b1c599c6af0": { 2024-09-10T21:25:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:52.224081+0000", 2024-09-10T21:25:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:25:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "d82f24b1-930e-4f83-a379-3084f22918d0": { 2024-09-10T21:25:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:21:37.203865+0000", 2024-09-10T21:25:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:25:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:25:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:25:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:25:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:25:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:25:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:25:54.538 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:25:54.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.519+0000 7f70a77ba640 1 -- 172.21.15.59:0/1728573509 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f708c0b52e0 msgr2=0x7f708c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:54.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.519+0000 7f70a77ba640 1 --2- 172.21.15.59:0/1728573509 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f708c0b52e0 0x7f708c0b77a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f70a0077560 tx=0x7f70980095c0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.519+0000 7f70a77ba640 1 -- 172.21.15.59:0/1728573509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a0102dc0 msgr2=0x7f70a00754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.519+0000 7f70a77ba640 1 --2- 172.21.15.59:0/1728573509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a0102dc0 0x7f70a00754a0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f709c00e9f0 tx=0x7f709c00eeb0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.519+0000 7f70a77ba640 1 -- 172.21.15.59:0/1728573509 shutdown_connections 2024-09-10T21:25:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.519+0000 7f70a77ba640 1 --2- 172.21.15.59:0/1728573509 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f708c0b52e0 0x7f708c0b77a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.519+0000 7f70a77ba640 1 --2- 172.21.15.59:0/1728573509 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70a0109150 0x7f70a0075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.519+0000 7f70a77ba640 1 --2- 172.21.15.59:0/1728573509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70a01087d0 0x7f70a00759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.519+0000 7f70a77ba640 1 --2- 172.21.15.59:0/1728573509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a0102dc0 0x7f70a00754a0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.519+0000 7f70a77ba640 1 -- 172.21.15.59:0/1728573509 >> 172.21.15.59:0/1728573509 conn(0x7f70a00fe830 msgr2=0x7f70a0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.519+0000 7f70a77ba640 1 -- 172.21.15.59:0/1728573509 shutdown_connections 2024-09-10T21:25:54.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:54.519+0000 7f70a77ba640 1 -- 172.21.15.59:0/1728573509 wait complete. 2024-09-10T21:25:55.159 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:54 smithi059 ceph-mon[30888]: pgmap v659: 97 pgs: 97 active+clean; 7.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:25:55.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:54 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:25:55.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:54 smithi154 ceph-mon[35041]: pgmap v659: 97 pgs: 97 active+clean; 7.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:25:55.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:54 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:25:55.296 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:25:55.296 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:25:55.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:54 smithi192 ceph-mon[35363]: pgmap v659: 97 pgs: 97 active+clean; 7.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-10T21:25:55.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:54 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:25:55.559 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:25:56.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.082+0000 7f4d39d08640 1 -- 172.21.15.59:0/1209199812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d34108020 msgr2=0x7f4d3410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.082+0000 7f4d39d08640 1 --2- 172.21.15.59:0/1209199812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d34108020 0x7f4d3410e820 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009900 tx=0x7f4d2c02a410 comp rx=0 tx=0).stop 2024-09-10T21:25:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.082+0000 7f4d39d08640 1 -- 172.21.15.59:0/1209199812 shutdown_connections 2024-09-10T21:25:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.082+0000 7f4d39d08640 1 --2- 172.21.15.59:0/1209199812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d34108020 0x7f4d3410e820 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.082+0000 7f4d39d08640 1 --2- 172.21.15.59:0/1209199812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d341076a0 0x7f4d34107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.082+0000 7f4d39d08640 1 --2- 172.21.15.59:0/1209199812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d34101c90 0x7f4d34102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.082+0000 7f4d39d08640 1 -- 172.21.15.59:0/1209199812 >> 172.21.15.59:0/1209199812 conn(0x7f4d340fd700 msgr2=0x7f4d340ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.082+0000 7f4d39d08640 1 -- 172.21.15.59:0/1209199812 shutdown_connections 2024-09-10T21:25:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.082+0000 7f4d39d08640 1 -- 172.21.15.59:0/1209199812 wait complete. 2024-09-10T21:25:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.082+0000 7f4d39d08640 1 Processor -- start 2024-09-10T21:25:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.083+0000 7f4d39d08640 1 -- start start 2024-09-10T21:25:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.083+0000 7f4d39d08640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d34101c90 0x7f4d340fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:56.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.083+0000 7f4d39d08640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d341076a0 0x7f4d340fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:56.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.083+0000 7f4d39d08640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d34108020 0x7f4d340fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:56.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.083+0000 7f4d39d08640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34111ce0 con 0x7f4d34108020 2024-09-10T21:25:56.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.083+0000 7f4d39d08640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34111b60 con 0x7f4d34101c90 2024-09-10T21:25:56.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.083+0000 7f4d39d08640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34111e60 con 0x7f4d341076a0 2024-09-10T21:25:56.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.083+0000 7f4d33fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d34108020 0x7f4d340fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:56.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.083+0000 7f4d33fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d34108020 0x7f4d340fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41242/0 (socket says 172.21.15.59:41242) 2024-09-10T21:25:56.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.083+0000 7f4d33fff640 1 -- 172.21.15.59:0/2695513650 learned_addr learned my addr 172.21.15.59:0/2695513650 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:56.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.083+0000 7f4d337fe640 1 --2- 172.21.15.59:0/2695513650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d34101c90 0x7f4d340fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:56.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.083+0000 7f4d32ffd640 1 --2- 172.21.15.59:0/2695513650 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d341076a0 0x7f4d340fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:56.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.083+0000 7f4d33fff640 1 -- 172.21.15.59:0/2695513650 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d341076a0 msgr2=0x7f4d340fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:56.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.083+0000 7f4d33fff640 1 --2- 172.21.15.59:0/2695513650 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d341076a0 0x7f4d340fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:56.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.083+0000 7f4d33fff640 1 -- 172.21.15.59:0/2695513650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d34101c90 msgr2=0x7f4d340fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:56.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.083+0000 7f4d33fff640 1 --2- 172.21.15.59:0/2695513650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d34101c90 0x7f4d340fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:56.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.083+0000 7f4d33fff640 1 -- 172.21.15.59:0/2695513650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d341a76f0 con 0x7f4d34108020 2024-09-10T21:25:56.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.084+0000 7f4d33fff640 1 --2- 172.21.15.59:0/2695513650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d34108020 0x7f4d340fe680 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c004770 tx=0x7f4d2c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:56.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.084+0000 7f4d30ff9640 1 -- 172.21.15.59:0/2695513650 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c03f030 con 0x7f4d34108020 2024-09-10T21:25:56.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.084+0000 7f4d39d08640 1 -- 172.21.15.59:0/2695513650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d341a7980 con 0x7f4d34108020 2024-09-10T21:25:56.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.084+0000 7f4d30ff9640 1 -- 172.21.15.59:0/2695513650 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d2c003aa0 con 0x7f4d34108020 2024-09-10T21:25:56.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.084+0000 7f4d30ff9640 1 -- 172.21.15.59:0/2695513650 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c035070 con 0x7f4d34108020 2024-09-10T21:25:56.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.084+0000 7f4d39d08640 1 -- 172.21.15.59:0/2695513650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d341a7e60 con 0x7f4d34108020 2024-09-10T21:25:56.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.085+0000 7f4d39d08640 1 -- 172.21.15.59:0/2695513650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d34102070 con 0x7f4d34108020 2024-09-10T21:25:56.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.086+0000 7f4d30ff9640 1 -- 172.21.15.59:0/2695513650 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f4d2c0035f0 con 0x7f4d34108020 2024-09-10T21:25:56.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.087+0000 7f4d30ff9640 1 --2- 172.21.15.59:0/2695513650 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4d1c0b52e0 0x7f4d1c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:56.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.087+0000 7f4d337fe640 1 --2- 172.21.15.59:0/2695513650 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4d1c0b52e0 0x7f4d1c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:56.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.087+0000 7f4d30ff9640 1 -- 172.21.15.59:0/2695513650 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4d2c106930 con 0x7f4d34108020 2024-09-10T21:25:56.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.087+0000 7f4d337fe640 1 --2- 172.21.15.59:0/2695513650 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4d1c0b52e0 0x7f4d1c0b77a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4d24005fd0 tx=0x7f4d24009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:56.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.090+0000 7f4d30ff9640 1 -- 172.21.15.59:0/2695513650 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4d2c0cd820 con 0x7f4d34108020 2024-09-10T21:25:56.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.312+0000 7f4d39d08640 1 -- 172.21.15.59:0/2695513650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d340fef00 con 0x7f4d34108020 2024-09-10T21:25:56.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.313+0000 7f4d30ff9640 1 -- 172.21.15.59:0/2695513650 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f4d2c0cd120 con 0x7f4d34108020 2024-09-10T21:25:56.317 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:25:56.317 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:25:56.317 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:25:56.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.315+0000 7f4d39d08640 1 -- 172.21.15.59:0/2695513650 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4d1c0b52e0 msgr2=0x7f4d1c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:56.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.315+0000 7f4d39d08640 1 --2- 172.21.15.59:0/2695513650 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4d1c0b52e0 0x7f4d1c0b77a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4d24005fd0 tx=0x7f4d24009520 comp rx=0 tx=0).stop 2024-09-10T21:25:56.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.315+0000 7f4d39d08640 1 -- 172.21.15.59:0/2695513650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d34108020 msgr2=0x7f4d340fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:56.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.315+0000 7f4d39d08640 1 --2- 172.21.15.59:0/2695513650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d34108020 0x7f4d340fe680 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c004770 tx=0x7f4d2c004270 comp rx=0 tx=0).stop 2024-09-10T21:25:56.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.315+0000 7f4d39d08640 1 -- 172.21.15.59:0/2695513650 shutdown_connections 2024-09-10T21:25:56.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.315+0000 7f4d39d08640 1 --2- 172.21.15.59:0/2695513650 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4d1c0b52e0 0x7f4d1c0b77a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:56.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.315+0000 7f4d39d08640 1 --2- 172.21.15.59:0/2695513650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d34108020 0x7f4d340fe680 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:56.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.315+0000 7f4d39d08640 1 --2- 172.21.15.59:0/2695513650 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d341076a0 0x7f4d340fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:56.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.315+0000 7f4d39d08640 1 --2- 172.21.15.59:0/2695513650 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d34101c90 0x7f4d340fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:56.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.315+0000 7f4d39d08640 1 -- 172.21.15.59:0/2695513650 >> 172.21.15.59:0/2695513650 conn(0x7f4d340fd700 msgr2=0x7f4d3406adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:56.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.315+0000 7f4d39d08640 1 -- 172.21.15.59:0/2695513650 shutdown_connections 2024-09-10T21:25:56.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:56.316+0000 7f4d39d08640 1 -- 172.21.15.59:0/2695513650 wait complete. 2024-09-10T21:25:56.930 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:25:57.159 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:56 smithi059 ceph-mon[30888]: pgmap v660: 97 pgs: 97 active+clean; 7.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:25:57.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:56 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2695513650' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:25:57.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:56 smithi154 ceph-mon[35041]: pgmap v660: 97 pgs: 97 active+clean; 7.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:25:57.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:56 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2695513650' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:25:57.190 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:25:57.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:56 smithi192 ceph-mon[35363]: pgmap v660: 97 pgs: 97 active+clean; 7.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:25:57.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:56 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2695513650' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:25:57.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.698+0000 7f390241f640 1 -- 172.21.15.59:0/2516640045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38fc101c90 msgr2=0x7f38fc102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:57.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.698+0000 7f390241f640 1 --2- 172.21.15.59:0/2516640045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38fc101c90 0x7f38fc102070 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009900 tx=0x7f38ec02a410 comp rx=0 tx=0).stop 2024-09-10T21:25:57.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.698+0000 7f390241f640 1 -- 172.21.15.59:0/2516640045 shutdown_connections 2024-09-10T21:25:57.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.698+0000 7f390241f640 1 --2- 172.21.15.59:0/2516640045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38fc108020 0x7f38fc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.698+0000 7f390241f640 1 --2- 172.21.15.59:0/2516640045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38fc1076a0 0x7f38fc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.698+0000 7f390241f640 1 --2- 172.21.15.59:0/2516640045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38fc101c90 0x7f38fc102070 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.698+0000 7f390241f640 1 -- 172.21.15.59:0/2516640045 >> 172.21.15.59:0/2516640045 conn(0x7f38fc0fd700 msgr2=0x7f38fc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:57.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.698+0000 7f390241f640 1 -- 172.21.15.59:0/2516640045 shutdown_connections 2024-09-10T21:25:57.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.698+0000 7f390241f640 1 -- 172.21.15.59:0/2516640045 wait complete. 2024-09-10T21:25:57.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.699+0000 7f390241f640 1 Processor -- start 2024-09-10T21:25:57.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.699+0000 7f390241f640 1 -- start start 2024-09-10T21:25:57.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.699+0000 7f390241f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38fc101c90 0x7f38fc199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:57.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.699+0000 7f390241f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38fc1076a0 0x7f38fc199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:57.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.699+0000 7f390241f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38fc108020 0x7f38fc19ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:57.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.699+0000 7f390241f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc111ce0 con 0x7f38fc1076a0 2024-09-10T21:25:57.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.699+0000 7f390241f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc111b60 con 0x7f38fc108020 2024-09-10T21:25:57.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.699+0000 7f390241f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc111e60 con 0x7f38fc101c90 2024-09-10T21:25:57.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.699+0000 7f38f3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38fc1076a0 0x7f38fc199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:57.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.699+0000 7f38f3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38fc1076a0 0x7f38fc199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41256/0 (socket says 172.21.15.59:41256) 2024-09-10T21:25:57.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.699+0000 7f38f3fff640 1 -- 172.21.15.59:0/2209173623 learned_addr learned my addr 172.21.15.59:0/2209173623 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:57.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.699+0000 7f38fbfff640 1 --2- 172.21.15.59:0/2209173623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38fc101c90 0x7f38fc199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:57.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.699+0000 7f39009bc640 1 --2- 172.21.15.59:0/2209173623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38fc108020 0x7f38fc19ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:57.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.700+0000 7f38f3fff640 1 -- 172.21.15.59:0/2209173623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38fc101c90 msgr2=0x7f38fc199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:57.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.700+0000 7f38f3fff640 1 --2- 172.21.15.59:0/2209173623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38fc101c90 0x7f38fc199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.700+0000 7f38f3fff640 1 -- 172.21.15.59:0/2209173623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38fc108020 msgr2=0x7f38fc19ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:57.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.700+0000 7f38f3fff640 1 --2- 172.21.15.59:0/2209173623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38fc108020 0x7f38fc19ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.700+0000 7f38f3fff640 1 -- 172.21.15.59:0/2209173623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38fc19f400 con 0x7f38fc1076a0 2024-09-10T21:25:57.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.700+0000 7f38f3fff640 1 --2- 172.21.15.59:0/2209173623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38fc1076a0 0x7f38fc199890 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f38e400d770 tx=0x7f38e400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:57.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.700+0000 7f38f9ffb640 1 -- 172.21.15.59:0/2209173623 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e4017070 con 0x7f38fc1076a0 2024-09-10T21:25:57.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.700+0000 7f38f9ffb640 1 -- 172.21.15.59:0/2209173623 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38e40054d0 con 0x7f38fc1076a0 2024-09-10T21:25:57.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.700+0000 7f390241f640 1 -- 172.21.15.59:0/2209173623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38fc19f6f0 con 0x7f38fc1076a0 2024-09-10T21:25:57.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.700+0000 7f38f9ffb640 1 -- 172.21.15.59:0/2209173623 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e4004c30 con 0x7f38fc1076a0 2024-09-10T21:25:57.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.700+0000 7f390241f640 1 -- 172.21.15.59:0/2209173623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38fc1a5db0 con 0x7f38fc1076a0 2024-09-10T21:25:57.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f39047f4740 1 Processor -- start 2024-09-10T21:25:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f39047f4740 1 -- start start 2024-09-10T21:25:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f38f9ffb640 1 -- 172.21.15.59:0/2209173623 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f38e4004e10 con 0x7f38fc1076a0 2024-09-10T21:25:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f39047f4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56078687b4d0 0x56078687b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f39047f4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687bdf0 0x560786887840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f39047f4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560786887d80 0x56078688a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f39047f4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5607867f1ea0 con 0x56078687bdf0 2024-09-10T21:25:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f39047f4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5607867e12d0 con 0x560786887d80 2024-09-10T21:25:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f39047f4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5607867e50e0 con 0x56078687b4d0 2024-09-10T21:25:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f38fbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687bdf0 0x560786887840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f38fbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687bdf0 0x560786887840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41262/0 (socket says 172.21.15.59:41262) 2024-09-10T21:25:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f38fbfff640 1 -- 172.21.15.59:0/2139502176 learned_addr learned my addr 172.21.15.59:0/2139502176 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:57.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f39009bc640 1 --2- 172.21.15.59:0/2139502176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56078687b4d0 0x56078687b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:57.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f38f3fff640 1 --2- 172.21.15.59:0/2139502176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560786887d80 0x56078688a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:57.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f38fbfff640 1 -- 172.21.15.59:0/2139502176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56078687b4d0 msgr2=0x56078687b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:57.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f38fbfff640 1 --2- 172.21.15.59:0/2139502176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56078687b4d0 0x56078687b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f38fbfff640 1 -- 172.21.15.59:0/2139502176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560786887d80 msgr2=0x56078688a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:57.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f38fbfff640 1 --2- 172.21.15.59:0/2139502176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560786887d80 0x56078688a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f38fbfff640 1 -- 172.21.15.59:0/2139502176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56078653f650 con 0x56078687bdf0 2024-09-10T21:25:57.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.703+0000 7f38f3fff640 1 --2- 172.21.15.59:0/2139502176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560786887d80 0x56078688a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:57.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.704+0000 7f38fbfff640 1 --2- 172.21.15.59:0/2139502176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687bdf0 0x560786887840 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009900 tx=0x7f38ec032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23e8f0c894b8323 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:57.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.704+0000 7f38f27fc640 1 -- 172.21.15.59:0/2139502176 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec040070 con 0x56078687bdf0 2024-09-10T21:25:57.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.704+0000 7f38f27fc640 1 -- 172.21.15.59:0/2139502176 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38ec0316a0 con 0x56078687bdf0 2024-09-10T21:25:57.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.704+0000 7f38f27fc640 1 -- 172.21.15.59:0/2139502176 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec035040 con 0x56078687bdf0 2024-09-10T21:25:57.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.704+0000 7f38f9ffb640 1 --2- 172.21.15.59:0/2209173623 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f38e80b5360 0x7f38e80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:57.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.704+0000 7f39009bc640 1 --2- 172.21.15.59:0/2209173623 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f38e80b5360 0x7f38e80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:57.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.704+0000 7f38f9ffb640 1 -- 172.21.15.59:0/2209173623 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f38e40e5570 con 0x7f38fc1076a0 2024-09-10T21:25:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.705+0000 7f39047f4740 1 -- 172.21.15.59:0/2139502176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687bdf0 msgr2=0x560786887840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.705+0000 7f39009bc640 1 --2- 172.21.15.59:0/2209173623 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f38e80b5360 0x7f38e80b7820 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f38f400ae40 tx=0x7f38f400a4d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.705+0000 7f39047f4740 1 --2- 172.21.15.59:0/2139502176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687bdf0 0x560786887840 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009900 tx=0x7f38ec032e60 comp rx=0 tx=0).stop 2024-09-10T21:25:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.705+0000 7f39047f4740 1 -- 172.21.15.59:0/2139502176 shutdown_connections 2024-09-10T21:25:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.705+0000 7f39047f4740 1 --2- 172.21.15.59:0/2139502176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560786887d80 0x56078688a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.705+0000 7f39047f4740 1 --2- 172.21.15.59:0/2139502176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687bdf0 0x560786887840 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.705+0000 7f39047f4740 1 --2- 172.21.15.59:0/2139502176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56078687b4d0 0x56078687b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.705+0000 7f39047f4740 1 -- 172.21.15.59:0/2139502176 >> 172.21.15.59:0/2139502176 conn(0x560786879300 msgr2=0x56078687a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.705+0000 7f39047f4740 1 -- 172.21.15.59:0/2139502176 shutdown_connections 2024-09-10T21:25:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.705+0000 7f39047f4740 1 -- 172.21.15.59:0/2139502176 wait complete. 2024-09-10T21:25:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.705+0000 7f39047f4740 1 -- start start 2024-09-10T21:25:57.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.706+0000 7f39047f4740 1 Processor -- start 2024-09-10T21:25:57.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.706+0000 7f39047f4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 0x560786887590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:57.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.706+0000 7f39047f4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56078687bdf0 0x5607868849e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:57.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.706+0000 7f39047f4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560786887d80 0x560786884f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:57.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.706+0000 7f39047f4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560786642700 con 0x56078687b4d0 2024-09-10T21:25:57.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.706+0000 7f39047f4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56078677c160 con 0x560786887d80 2024-09-10T21:25:57.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.706+0000 7f39047f4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x56078688a9a0 con 0x56078687bdf0 2024-09-10T21:25:57.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.706+0000 7f38fbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 0x560786887590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:57.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.706+0000 7f38fbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 0x560786887590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41276/0 (socket says 172.21.15.59:41276) 2024-09-10T21:25:57.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.706+0000 7f38fbfff640 1 -- 172.21.15.59:0/3649379714 learned_addr learned my addr 172.21.15.59:0/3649379714 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:57.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.706+0000 7f39047f4740 10 client.0 _ll_register_callbacks cb 0x5607867959e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:57.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.706+0000 7f38f3fff640 1 --2- 172.21.15.59:0/3649379714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56078687bdf0 0x5607868849e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:57.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.706+0000 7f39009bc640 1 --2- 172.21.15.59:0/3649379714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560786887d80 0x560786884f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:57.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.706+0000 7f38fbfff640 1 -- 172.21.15.59:0/3649379714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56078687bdf0 msgr2=0x5607868849e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:57.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.706+0000 7f38fbfff640 1 --2- 172.21.15.59:0/3649379714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56078687bdf0 0x5607868849e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.706+0000 7f38fbfff640 1 -- 172.21.15.59:0/3649379714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560786887d80 msgr2=0x560786884f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:57.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.706+0000 7f38fbfff640 1 --2- 172.21.15.59:0/3649379714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560786887d80 0x560786884f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.706+0000 7f38fbfff640 1 -- 172.21.15.59:0/3649379714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607867a9c90 con 0x56078687b4d0 2024-09-10T21:25:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.707+0000 7f38fbfff640 1 --2- 172.21.15.59:0/3649379714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 0x560786887590 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f38ec031a80 tx=0x7f38ec031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=961e0cc2c539dee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.707+0000 7f38db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.707+0000 7f38db7fe640 1 -- 172.21.15.59:0/3649379714 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec035040 con 0x56078687b4d0 2024-09-10T21:25:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.707+0000 7f38db7fe640 1 -- 172.21.15.59:0/3649379714 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f38ec03c640 con 0x56078687b4d0 2024-09-10T21:25:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.707+0000 7f39047f4740 1 -- 172.21.15.59:0/3649379714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38ec0316a0 con 0x56078687b4d0 2024-09-10T21:25:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.707+0000 7f38db7fe640 1 -- 172.21.15.59:0/3649379714 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f38ec040040 con 0x56078687b4d0 2024-09-10T21:25:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.707+0000 7f39047f4740 10 client.18006 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.707+0000 7f39047f4740 1 -- 172.21.15.59:0/3649379714 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5607868961a0 con 0x56078687b4d0 2024-09-10T21:25:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.707+0000 7f38db7fe640 1 -- 172.21.15.59:0/3649379714 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38ec0316a0 con 0x56078687b4d0 2024-09-10T21:25:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.707+0000 7f38db7fe640 1 -- 172.21.15.59:0/3649379714 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f38ec058890 con 0x56078687b4d0 2024-09-10T21:25:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.707+0000 7f39047f4740 10 client.18006 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:57.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.707+0000 7f39047f4740 10 client.18006 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:25:57.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.707+0000 7f39047f4740 20 client.18006 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:57.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.707+0000 7f39047f4740 1 --2- 172.21.15.59:0/3649379714 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5607868974f0 0x5607868998e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:57.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.707+0000 7f39047f4740 4 client.18006 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:25:57.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.707+0000 7f39047f4740 1 -- 172.21.15.59:0/3649379714 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607867f3df0 con 0x5607868974f0 2024-09-10T21:25:57.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.708+0000 7f38f3fff640 1 --2- 172.21.15.59:0/3649379714 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5607868974f0 0x5607868998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:57.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.708+0000 7f38f3fff640 1 --2- 172.21.15.59:0/3649379714 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5607868974f0 0x5607868998e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=926da13aed342dcc server_cookie=d855fe0689dc2fc6 in_seq=0 out_seq=0 2024-09-10T21:25:57.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.708+0000 7f38db7fe640 10 client.18006 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:25:57.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.709+0000 7f38db7fe640 1 -- 172.21.15.59:0/3649379714 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5607867f3df0 con 0x5607868974f0 2024-09-10T21:25:57.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.709+0000 7f38db7fe640 10 client.18006 handle_command_reply: tid=0 2024-09-10T21:25:57.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.709+0000 7f39047f4740 1 client.18006 shutdown 2024-09-10T21:25:57.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.709+0000 7f39047f4740 1 -- 172.21.15.59:0/3649379714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 msgr2=0x560786887590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:57.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.709+0000 7f39047f4740 1 --2- 172.21.15.59:0/3649379714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 0x560786887590 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f38ec031a80 tx=0x7f38ec031400 comp rx=0 tx=0).stop 2024-09-10T21:25:57.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.709+0000 7f39047f4740 1 -- 172.21.15.59:0/3649379714 shutdown_connections 2024-09-10T21:25:57.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.709+0000 7f39047f4740 1 --2- 172.21.15.59:0/3649379714 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5607868974f0 0x5607868998e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.709+0000 7f39047f4740 1 --2- 172.21.15.59:0/3649379714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560786887d80 0x560786884f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.709+0000 7f39047f4740 1 --2- 172.21.15.59:0/3649379714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56078687bdf0 0x5607868849e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.709+0000 7f39047f4740 1 --2- 172.21.15.59:0/3649379714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 0x560786887590 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.709+0000 7f38db7fe640 0 client.18006 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:25:57.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.709+0000 7f39047f4740 1 -- 172.21.15.59:0/3649379714 >> 172.21.15.59:0/3649379714 conn(0x560786879300 msgr2=0x56078687eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:57.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.709+0000 7f39047f4740 1 -- 172.21.15.59:0/3649379714 shutdown_connections 2024-09-10T21:25:57.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.709+0000 7f39047f4740 1 -- 172.21.15.59:0/3649379714 wait complete. 2024-09-10T21:25:57.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.709+0000 7f39047f4740 20 client.18006 trim_cache size 0 max 16384 2024-09-10T21:25:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.722+0000 7f39047f4740 1 Processor -- start 2024-09-10T21:25:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.722+0000 7f39047f4740 1 -- start start 2024-09-10T21:25:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.722+0000 7f39047f4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 0x56078687a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.722+0000 7f39047f4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56078687bdf0 0x560786878310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.722+0000 7f39047f4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560786887d80 0x560786881c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.723+0000 7f39047f4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc1ae350 con 0x56078687b4d0 2024-09-10T21:25:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.723+0000 7f39047f4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc1afe90 con 0x56078687bdf0 2024-09-10T21:25:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.723+0000 7f39047f4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc1aea20 con 0x560786887d80 2024-09-10T21:25:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.723+0000 7f38fbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 0x56078687a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.723+0000 7f38fbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 0x56078687a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41284/0 (socket says 172.21.15.59:41284) 2024-09-10T21:25:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.723+0000 7f38fbfff640 1 -- 172.21.15.59:0/2834143601 learned_addr learned my addr 172.21.15.59:0/2834143601 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:57.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.723+0000 7f38f3fff640 1 --2- 172.21.15.59:0/2834143601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56078687bdf0 0x560786878310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:57.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.723+0000 7f39009bc640 1 --2- 172.21.15.59:0/2834143601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560786887d80 0x560786881c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:57.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.723+0000 7f38fbfff640 1 -- 172.21.15.59:0/2834143601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560786887d80 msgr2=0x560786881c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:57.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.723+0000 7f38fbfff640 1 --2- 172.21.15.59:0/2834143601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560786887d80 0x560786881c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.723+0000 7f38fbfff640 1 -- 172.21.15.59:0/2834143601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56078687bdf0 msgr2=0x560786878310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:57.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.723+0000 7f38fbfff640 1 --2- 172.21.15.59:0/2834143601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56078687bdf0 0x560786878310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.723+0000 7f38fbfff640 1 -- 172.21.15.59:0/2834143601 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560786879d80 con 0x56078687b4d0 2024-09-10T21:25:57.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.723+0000 7f39009bc640 1 --2- 172.21.15.59:0/2834143601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560786887d80 0x560786881c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:25:57.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.723+0000 7f38fbfff640 1 --2- 172.21.15.59:0/2834143601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 0x56078687a9e0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f38ec02a930 tx=0x7f38ec032d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e0a0d77d401c27 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:57.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.723+0000 7f38f1ffb640 1 -- 172.21.15.59:0/2834143601 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec035040 con 0x56078687b4d0 2024-09-10T21:25:57.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.723+0000 7f38f1ffb640 1 -- 172.21.15.59:0/2834143601 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38ec058480 con 0x56078687b4d0 2024-09-10T21:25:57.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.723+0000 7f38f1ffb640 1 -- 172.21.15.59:0/2834143601 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec03c6a0 con 0x56078687b4d0 2024-09-10T21:25:57.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.724+0000 7f39047f4740 1 -- 172.21.15.59:0/2834143601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 msgr2=0x56078687a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:57.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.724+0000 7f39047f4740 1 --2- 172.21.15.59:0/2834143601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 0x56078687a9e0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f38ec02a930 tx=0x7f38ec032d40 comp rx=0 tx=0).stop 2024-09-10T21:25:57.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.724+0000 7f39047f4740 1 -- 172.21.15.59:0/2834143601 shutdown_connections 2024-09-10T21:25:57.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.724+0000 7f39047f4740 1 --2- 172.21.15.59:0/2834143601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560786887d80 0x560786881c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.724+0000 7f39047f4740 1 --2- 172.21.15.59:0/2834143601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56078687bdf0 0x560786878310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.724+0000 7f39047f4740 1 --2- 172.21.15.59:0/2834143601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 0x56078687a9e0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.724+0000 7f39047f4740 1 -- 172.21.15.59:0/2834143601 >> 172.21.15.59:0/2834143601 conn(0x560786879300 msgr2=0x560786877c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:57.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.724+0000 7f39047f4740 1 -- 172.21.15.59:0/2834143601 shutdown_connections 2024-09-10T21:25:57.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.724+0000 7f39047f4740 1 -- 172.21.15.59:0/2834143601 wait complete. 2024-09-10T21:25:57.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.724+0000 7f39047f4740 1 -- start start 2024-09-10T21:25:57.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f39047f4740 1 Processor -- start 2024-09-10T21:25:57.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f39047f4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 0x56078689b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:57.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f39047f4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56078687bdf0 0x56078689b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:57.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f39047f4740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560786887d80 0x5607868fc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f39047f4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc1af7c0 con 0x56078687b4d0 2024-09-10T21:25:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f39047f4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc1af0f0 con 0x56078687bdf0 2024-09-10T21:25:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f39047f4740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc1ac330 con 0x560786887d80 2024-09-10T21:25:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f39047f4740 10 client.0 _ll_register_callbacks cb 0x7f38ec032db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f38fbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 0x56078689b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f38fbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 0x56078689b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41292/0 (socket says 172.21.15.59:41292) 2024-09-10T21:25:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f38fbfff640 1 -- 172.21.15.59:0/2677836448 learned_addr learned my addr 172.21.15.59:0/2677836448 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f39009bc640 1 --2- 172.21.15.59:0/2677836448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560786887d80 0x5607868fc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f38f3fff640 1 --2- 172.21.15.59:0/2677836448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56078687bdf0 0x56078689b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f38fbfff640 1 -- 172.21.15.59:0/2677836448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560786887d80 msgr2=0x5607868fc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f38fbfff640 1 --2- 172.21.15.59:0/2677836448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560786887d80 0x5607868fc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f38fbfff640 1 -- 172.21.15.59:0/2677836448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56078687bdf0 msgr2=0x56078689b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:57.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f38fbfff640 1 --2- 172.21.15.59:0/2677836448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56078687bdf0 0x56078689b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f38fbfff640 1 -- 172.21.15.59:0/2677836448 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607868fc760 con 0x56078687b4d0 2024-09-10T21:25:57.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f38fbfff640 1 --2- 172.21.15.59:0/2677836448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 0x56078689b330 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f38ec031820 tx=0x7f38ec031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17f65cd5ff1dfe server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:57.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.725+0000 7f38db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:57.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.726+0000 7f38db7fe640 1 -- 172.21.15.59:0/2677836448 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ec066030 con 0x56078687b4d0 2024-09-10T21:25:57.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.726+0000 7f38db7fe640 1 -- 172.21.15.59:0/2677836448 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f38ec03c440 con 0x56078687b4d0 2024-09-10T21:25:57.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.726+0000 7f39047f4740 1 -- 172.21.15.59:0/2677836448 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38ec058480 con 0x56078687b4d0 2024-09-10T21:25:57.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.726+0000 7f38db7fe640 1 -- 172.21.15.59:0/2677836448 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f38ec035040 con 0x56078687b4d0 2024-09-10T21:25:57.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.726+0000 7f39047f4740 10 client.18012 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:57.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.726+0000 7f39047f4740 1 -- 172.21.15.59:0/2677836448 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560786904bf0 con 0x56078687b4d0 2024-09-10T21:25:57.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.726+0000 7f38db7fe640 1 -- 172.21.15.59:0/2677836448 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38ec058480 con 0x56078687b4d0 2024-09-10T21:25:57.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.726+0000 7f38db7fe640 1 -- 172.21.15.59:0/2677836448 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f38ec06b7f0 con 0x56078687b4d0 2024-09-10T21:25:57.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.726+0000 7f39047f4740 10 client.18012 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:57.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.726+0000 7f39047f4740 10 client.18012 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:25:57.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.726+0000 7f39047f4740 20 client.18012 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:57.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.726+0000 7f39047f4740 1 --2- 172.21.15.59:0/2677836448 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5607869052d0 0x5607869076f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:57.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.726+0000 7f39047f4740 4 client.18012 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:25:57.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.726+0000 7f39047f4740 1 -- 172.21.15.59:0/2677836448 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5607867ef8a0 con 0x5607869052d0 2024-09-10T21:25:57.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.727+0000 7f38f3fff640 1 --2- 172.21.15.59:0/2677836448 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5607869052d0 0x5607869076f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:57.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.727+0000 7f38f3fff640 1 --2- 172.21.15.59:0/2677836448 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5607869052d0 0x5607869076f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2c15a6a3d28a51e server_cookie=75437f596faf5ce6 in_seq=0 out_seq=0 2024-09-10T21:25:57.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.727+0000 7f38db7fe640 10 client.18012 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:25:57.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.727+0000 7f38db7fe640 1 -- 172.21.15.59:0/2677836448 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5607867ef8a0 con 0x5607869052d0 2024-09-10T21:25:57.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.727+0000 7f38db7fe640 10 client.18012 handle_command_reply: tid=0 2024-09-10T21:25:57.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.727+0000 7f39047f4740 1 client.18012 shutdown 2024-09-10T21:25:57.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.727+0000 7f39047f4740 1 -- 172.21.15.59:0/2677836448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 msgr2=0x56078689b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:57.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.727+0000 7f39047f4740 1 --2- 172.21.15.59:0/2677836448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 0x56078689b330 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f38ec031820 tx=0x7f38ec031400 comp rx=0 tx=0).stop 2024-09-10T21:25:57.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.727+0000 7f39047f4740 1 -- 172.21.15.59:0/2677836448 shutdown_connections 2024-09-10T21:25:57.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.727+0000 7f39047f4740 1 --2- 172.21.15.59:0/2677836448 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5607869052d0 0x5607869076f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.727+0000 7f39047f4740 1 --2- 172.21.15.59:0/2677836448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560786887d80 0x5607868fc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.727+0000 7f39047f4740 1 --2- 172.21.15.59:0/2677836448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56078687bdf0 0x56078689b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.727+0000 7f39047f4740 1 --2- 172.21.15.59:0/2677836448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56078687b4d0 0x56078689b330 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.727+0000 7f39047f4740 1 -- 172.21.15.59:0/2677836448 >> 172.21.15.59:0/2677836448 conn(0x560786879300 msgr2=0x560786878420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:57.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.727+0000 7f38db7fe640 0 client.18012 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:25:57.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.728+0000 7f39047f4740 1 -- 172.21.15.59:0/2677836448 shutdown_connections 2024-09-10T21:25:57.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.728+0000 7f39047f4740 1 -- 172.21.15.59:0/2677836448 wait complete. 2024-09-10T21:25:57.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.728+0000 7f39047f4740 20 client.18012 trim_cache size 0 max 16384 2024-09-10T21:25:57.736 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:25:57.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.728+0000 7f390241f640 1 -- 172.21.15.59:0/2209173623 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f38e80b5360 msgr2=0x7f38e80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:57.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.728+0000 7f390241f640 1 --2- 172.21.15.59:0/2209173623 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f38e80b5360 0x7f38e80b7820 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f38f400ae40 tx=0x7f38f400a4d0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.728+0000 7f390241f640 1 -- 172.21.15.59:0/2209173623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38fc1076a0 msgr2=0x7f38fc199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:57.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.728+0000 7f390241f640 1 --2- 172.21.15.59:0/2209173623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38fc1076a0 0x7f38fc199890 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f38e400d770 tx=0x7f38e400dc30 comp rx=0 tx=0).stop 2024-09-10T21:25:57.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.728+0000 7f390241f640 1 -- 172.21.15.59:0/2209173623 shutdown_connections 2024-09-10T21:25:57.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.728+0000 7f390241f640 1 --2- 172.21.15.59:0/2209173623 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f38e80b5360 0x7f38e80b7820 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.728+0000 7f390241f640 1 --2- 172.21.15.59:0/2209173623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38fc108020 0x7f38fc19ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.728+0000 7f390241f640 1 --2- 172.21.15.59:0/2209173623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38fc1076a0 0x7f38fc199890 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.728+0000 7f390241f640 1 --2- 172.21.15.59:0/2209173623 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f38fc101c90 0x7f38fc199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:57.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.728+0000 7f390241f640 1 -- 172.21.15.59:0/2209173623 >> 172.21.15.59:0/2209173623 conn(0x7f38fc0fd700 msgr2=0x7f38fc06ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:57.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.728+0000 7f390241f640 1 -- 172.21.15.59:0/2209173623 shutdown_connections 2024-09-10T21:25:57.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:57.728+0000 7f390241f640 1 -- 172.21.15.59:0/2209173623 wait complete. 2024-09-10T21:25:58.452 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:25:58.712 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:25:59.118 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:25:58 smithi059 ceph-mon[30888]: pgmap v661: 97 pgs: 97 active+clean; 7.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:25:59.144 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:25:58 smithi192 ceph-mon[35363]: pgmap v661: 97 pgs: 97 active+clean; 7.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:25:59.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:25:58 smithi154 ceph-mon[35041]: pgmap v661: 97 pgs: 97 active+clean; 7.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:25:59.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.198+0000 7f4489c35640 1 -- 172.21.15.59:0/1294197035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4484108020 msgr2=0x7f448410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:59.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.198+0000 7f4489c35640 1 --2- 172.21.15.59:0/1294197035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4484108020 0x7f448410e820 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f447c009ca0 tx=0x7f447c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.198+0000 7f4489c35640 1 -- 172.21.15.59:0/1294197035 shutdown_connections 2024-09-10T21:25:59.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.198+0000 7f4489c35640 1 --2- 172.21.15.59:0/1294197035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4484108020 0x7f448410e820 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.198+0000 7f4489c35640 1 --2- 172.21.15.59:0/1294197035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44841076a0 0x7f4484107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.198+0000 7f4489c35640 1 --2- 172.21.15.59:0/1294197035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4484101c90 0x7f4484102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.198+0000 7f4489c35640 1 -- 172.21.15.59:0/1294197035 >> 172.21.15.59:0/1294197035 conn(0x7f44840fd700 msgr2=0x7f44840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:59.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.198+0000 7f4489c35640 1 -- 172.21.15.59:0/1294197035 shutdown_connections 2024-09-10T21:25:59.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.198+0000 7f4489c35640 1 -- 172.21.15.59:0/1294197035 wait complete. 2024-09-10T21:25:59.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.198+0000 7f4489c35640 1 Processor -- start 2024-09-10T21:25:59.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.198+0000 7f4489c35640 1 -- start start 2024-09-10T21:25:59.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.199+0000 7f4489c35640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4484101c90 0x7f44841992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.199+0000 7f4489c35640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44841076a0 0x7f4484199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.199+0000 7f4489c35640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4484108020 0x7f448419ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.199+0000 7f4489c35640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4484111ca0 con 0x7f44841076a0 2024-09-10T21:25:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.199+0000 7f4489c35640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4484111b20 con 0x7f4484108020 2024-09-10T21:25:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.199+0000 7f4489c35640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4484111e20 con 0x7f4484101c90 2024-09-10T21:25:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.199+0000 7f4482ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44841076a0 0x7f4484199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.199+0000 7f4482ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44841076a0 0x7f4484199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41318/0 (socket says 172.21.15.59:41318) 2024-09-10T21:25:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.199+0000 7f4482ffd640 1 -- 172.21.15.59:0/651488885 learned_addr learned my addr 172.21.15.59:0/651488885 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.199+0000 7f44837fe640 1 --2- 172.21.15.59:0/651488885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4484101c90 0x7f44841992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.199+0000 7f4483fff640 1 --2- 172.21.15.59:0/651488885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4484108020 0x7f448419ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.199+0000 7f4482ffd640 1 -- 172.21.15.59:0/651488885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4484101c90 msgr2=0x7f44841992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:59.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.199+0000 7f4482ffd640 1 --2- 172.21.15.59:0/651488885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4484101c90 0x7f44841992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.199+0000 7f4482ffd640 1 -- 172.21.15.59:0/651488885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4484108020 msgr2=0x7f448419ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.199+0000 7f4482ffd640 1 --2- 172.21.15.59:0/651488885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4484108020 0x7f448419ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.199+0000 7f4482ffd640 1 -- 172.21.15.59:0/651488885 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448419f3a0 con 0x7f44841076a0 2024-09-10T21:25:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.199+0000 7f4482ffd640 1 --2- 172.21.15.59:0/651488885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44841076a0 0x7f4484199830 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f447800d950 tx=0x7f447800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.200+0000 7f4480ff9640 1 -- 172.21.15.59:0/651488885 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478017070 con 0x7f44841076a0 2024-09-10T21:25:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.200+0000 7f4489c35640 1 -- 172.21.15.59:0/651488885 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f448419f690 con 0x7f44841076a0 2024-09-10T21:25:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.200+0000 7f4480ff9640 1 -- 172.21.15.59:0/651488885 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4478009c30 con 0x7f44841076a0 2024-09-10T21:25:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.200+0000 7f4480ff9640 1 -- 172.21.15.59:0/651488885 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447800f620 con 0x7f44841076a0 2024-09-10T21:25:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.200+0000 7f4489c35640 1 -- 172.21.15.59:0/651488885 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44841a5f20 con 0x7f44841076a0 2024-09-10T21:25:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.202+0000 7f448c00a740 1 Processor -- start 2024-09-10T21:25:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.202+0000 7f448c00a740 1 -- start start 2024-09-10T21:25:59.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.203+0000 7f448c00a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a00f0 0x561c916a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.203+0000 7f448c00a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916a0a10 0x561c916ac460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.203+0000 7f448c00a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916ac9a0 0x561c916aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.203+0000 7f448c00a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561c91616ea0 con 0x561c916ac9a0 2024-09-10T21:25:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.203+0000 7f448c00a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561c916062d0 con 0x561c916a00f0 2024-09-10T21:25:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.203+0000 7f448c00a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561c9160a0e0 con 0x561c916a0a10 2024-09-10T21:25:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.203+0000 7f4480ff9640 1 -- 172.21.15.59:0/651488885 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f4478010460 con 0x7f44841076a0 2024-09-10T21:25:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.203+0000 7f4482ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916ac9a0 0x561c916aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.203+0000 7f44837fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916a0a10 0x561c916ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.203+0000 7f44837fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916a0a10 0x561c916ac460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:37760/0 (socket says 172.21.15.59:37760) 2024-09-10T21:25:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.203+0000 7f44837fe640 1 -- 172.21.15.59:0/4049308163 learned_addr learned my addr 172.21.15.59:0/4049308163 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.203+0000 7f4483fff640 1 --2- 172.21.15.59:0/4049308163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a00f0 0x561c916a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.203+0000 7f44837fe640 1 -- 172.21.15.59:0/4049308163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a00f0 msgr2=0x561c916a04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.203+0000 7f44837fe640 1 --2- 172.21.15.59:0/4049308163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a00f0 0x561c916a04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.203+0000 7f44837fe640 1 -- 172.21.15.59:0/4049308163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916ac9a0 msgr2=0x561c916aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.203+0000 7f44837fe640 1 --2- 172.21.15.59:0/4049308163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916ac9a0 0x561c916aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.203+0000 7f44837fe640 1 -- 172.21.15.59:0/4049308163 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c91364650 con 0x561c916a0a10 2024-09-10T21:25:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.203+0000 7f4482ffd640 1 --2- 172.21.15.59:0/4049308163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916ac9a0 0x561c916aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:25:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.204+0000 7f44837fe640 1 --2- 172.21.15.59:0/4049308163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916a0a10 0x561c916ac460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f447400bd10 tx=0x7f44740107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6be0f2174b24301 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.204+0000 7f4480ff9640 1 --2- 172.21.15.59:0/651488885 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f446c0b52e0 0x7f446c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.204+0000 7f4483fff640 1 --2- 172.21.15.59:0/651488885 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f446c0b52e0 0x7f446c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.204+0000 7f4469ffb640 1 -- 172.21.15.59:0/4049308163 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474004030 con 0x561c916a0a10 2024-09-10T21:25:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.204+0000 7f4480ff9640 1 -- 172.21.15.59:0/651488885 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f44780e5810 con 0x7f44841076a0 2024-09-10T21:25:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.204+0000 7f4469ffb640 1 -- 172.21.15.59:0/4049308163 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44740035f0 con 0x561c916a0a10 2024-09-10T21:25:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.204+0000 7f4469ffb640 1 -- 172.21.15.59:0/4049308163 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474011770 con 0x561c916a0a10 2024-09-10T21:25:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.204+0000 7f448c00a740 1 -- 172.21.15.59:0/4049308163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916a0a10 msgr2=0x561c916ac460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.204+0000 7f448c00a740 1 --2- 172.21.15.59:0/4049308163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916a0a10 0x561c916ac460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f447400bd10 tx=0x7f44740107a0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.204+0000 7f4483fff640 1 --2- 172.21.15.59:0/651488885 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f446c0b52e0 0x7f446c0b77a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f447c005e30 tx=0x7f447c005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:59.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.205+0000 7f448c00a740 1 -- 172.21.15.59:0/4049308163 shutdown_connections 2024-09-10T21:25:59.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.205+0000 7f448c00a740 1 --2- 172.21.15.59:0/4049308163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916ac9a0 0x561c916aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.205+0000 7f448c00a740 1 --2- 172.21.15.59:0/4049308163 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916a0a10 0x561c916ac460 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.205+0000 7f448c00a740 1 --2- 172.21.15.59:0/4049308163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a00f0 0x561c916a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.205+0000 7f448c00a740 1 -- 172.21.15.59:0/4049308163 >> 172.21.15.59:0/4049308163 conn(0x561c9169df20 msgr2=0x561c9169f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:59.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.205+0000 7f448c00a740 1 -- 172.21.15.59:0/4049308163 shutdown_connections 2024-09-10T21:25:59.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.205+0000 7f448c00a740 1 -- 172.21.15.59:0/4049308163 wait complete. 2024-09-10T21:25:59.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.205+0000 7f448c00a740 1 -- start start 2024-09-10T21:25:59.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.205+0000 7f448c00a740 1 Processor -- start 2024-09-10T21:25:59.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f448c00a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916a00f0 0x561c916ac250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:59.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f448c00a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a0a10 0x561c916a96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:59.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f448c00a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916ac9a0 0x561c916a9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:59.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f448c00a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561c91467700 con 0x561c916a00f0 2024-09-10T21:25:59.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f448c00a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561c915a1160 con 0x561c916a0a10 2024-09-10T21:25:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f448c00a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561c916af620 con 0x561c916ac9a0 2024-09-10T21:25:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f448c00a740 10 client.0 _ll_register_callbacks cb 0x561c915ba9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f44837fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916a00f0 0x561c916ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f44837fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916a00f0 0x561c916ac250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51096/0 (socket says 172.21.15.59:51096) 2024-09-10T21:25:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f44837fe640 1 -- 172.21.15.59:0/221897898 learned_addr learned my addr 172.21.15.59:0/221897898 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f4483fff640 1 --2- 172.21.15.59:0/221897898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916ac9a0 0x561c916a9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f4482ffd640 1 --2- 172.21.15.59:0/221897898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a0a10 0x561c916a96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f44837fe640 1 -- 172.21.15.59:0/221897898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916ac9a0 msgr2=0x561c916a9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f44837fe640 1 --2- 172.21.15.59:0/221897898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916ac9a0 0x561c916a9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f44837fe640 1 -- 172.21.15.59:0/221897898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a0a10 msgr2=0x561c916a96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f44837fe640 1 --2- 172.21.15.59:0/221897898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a0a10 0x561c916a96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f44837fe640 1 -- 172.21.15.59:0/221897898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c915cec90 con 0x561c916a00f0 2024-09-10T21:25:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f44837fe640 1 --2- 172.21.15.59:0/221897898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916a00f0 0x561c916ac250 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f4474000c00 tx=0x7f4474003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed2fb147f78c4c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f4462ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f4462ffd640 1 -- 172.21.15.59:0/221897898 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474029060 con 0x561c916a00f0 2024-09-10T21:25:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f448c00a740 1 -- 172.21.15.59:0/221897898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44740035f0 con 0x561c916a00f0 2024-09-10T21:25:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.206+0000 7f4462ffd640 1 -- 172.21.15.59:0/221897898 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4474003fe0 con 0x561c916a00f0 2024-09-10T21:25:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.207+0000 7f4462ffd640 1 -- 172.21.15.59:0/221897898 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f44740041e0 con 0x561c916a00f0 2024-09-10T21:25:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.207+0000 7f448c00a740 10 client.18024 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.207+0000 7f448c00a740 1 -- 172.21.15.59:0/221897898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561c916baf40 con 0x561c916a00f0 2024-09-10T21:25:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.207+0000 7f4462ffd640 1 -- 172.21.15.59:0/221897898 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44740035f0 con 0x561c916a00f0 2024-09-10T21:25:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.207+0000 7f4462ffd640 1 -- 172.21.15.59:0/221897898 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4474023030 con 0x561c916a00f0 2024-09-10T21:25:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.207+0000 7f448c00a740 10 client.18024 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.207+0000 7f448c00a740 10 client.18024 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:25:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.207+0000 7f448c00a740 20 client.18024 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:59.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.207+0000 7f448c00a740 1 --2- 172.21.15.59:0/221897898 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x561c916bc340 0x561c916be730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.207+0000 7f448c00a740 4 client.18024 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:25:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.207+0000 7f448c00a740 1 -- 172.21.15.59:0/221897898 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c91618df0 con 0x561c916bc340 2024-09-10T21:25:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.207+0000 7f4482ffd640 1 --2- 172.21.15.59:0/221897898 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x561c916bc340 0x561c916be730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.208+0000 7f4462ffd640 10 client.18024 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:25:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.208+0000 7f4482ffd640 1 --2- 172.21.15.59:0/221897898 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x561c916bc340 0x561c916be730 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=79e71d0f80af1a44 server_cookie=3ce727b7e42564f5 in_seq=0 out_seq=0 2024-09-10T21:25:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.208+0000 7f4462ffd640 1 -- 172.21.15.59:0/221897898 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561c91618df0 con 0x561c916bc340 2024-09-10T21:25:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.208+0000 7f4462ffd640 10 client.18024 handle_command_reply: tid=0 2024-09-10T21:25:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.209+0000 7f448c00a740 1 client.18024 shutdown 2024-09-10T21:25:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.209+0000 7f448c00a740 1 -- 172.21.15.59:0/221897898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916a00f0 msgr2=0x561c916ac250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.209+0000 7f448c00a740 1 --2- 172.21.15.59:0/221897898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916a00f0 0x561c916ac250 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f4474000c00 tx=0x7f4474003d20 comp rx=0 tx=0).stop 2024-09-10T21:25:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.209+0000 7f448c00a740 1 -- 172.21.15.59:0/221897898 shutdown_connections 2024-09-10T21:25:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.209+0000 7f448c00a740 1 --2- 172.21.15.59:0/221897898 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x561c916bc340 0x561c916be730 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.209+0000 7f448c00a740 1 --2- 172.21.15.59:0/221897898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916ac9a0 0x561c916a9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.209+0000 7f448c00a740 1 --2- 172.21.15.59:0/221897898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a0a10 0x561c916a96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.209+0000 7f4462ffd640 0 client.18024 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:25:59.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.209+0000 7f448c00a740 1 --2- 172.21.15.59:0/221897898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916a00f0 0x561c916ac250 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.209+0000 7f448c00a740 1 -- 172.21.15.59:0/221897898 >> 172.21.15.59:0/221897898 conn(0x561c9169df20 msgr2=0x561c916a3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:59.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.209+0000 7f448c00a740 1 -- 172.21.15.59:0/221897898 shutdown_connections 2024-09-10T21:25:59.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.209+0000 7f448c00a740 1 -- 172.21.15.59:0/221897898 wait complete. 2024-09-10T21:25:59.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.209+0000 7f448c00a740 20 client.18024 trim_cache size 0 max 16384 2024-09-10T21:25:59.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.223+0000 7f448c00a740 1 Processor -- start 2024-09-10T21:25:59.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.223+0000 7f448c00a740 1 -- start start 2024-09-10T21:25:59.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.223+0000 7f448c00a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a00f0 0x561c916b8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:59.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.223+0000 7f448c00a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916a0a10 0x561c9169ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:59.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.223+0000 7f448c00a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916ac9a0 0x561c9169f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:59.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.223+0000 7f448c00a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f44841ae440 con 0x561c916ac9a0 2024-09-10T21:25:59.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.223+0000 7f448c00a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f44841aff80 con 0x561c916a00f0 2024-09-10T21:25:59.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.223+0000 7f448c00a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f44841aeb10 con 0x561c916a0a10 2024-09-10T21:25:59.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.223+0000 7f4483fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916ac9a0 0x561c9169f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:59.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.223+0000 7f4483fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916ac9a0 0x561c9169f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51102/0 (socket says 172.21.15.59:51102) 2024-09-10T21:25:59.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.223+0000 7f4483fff640 1 -- 172.21.15.59:0/2007175684 learned_addr learned my addr 172.21.15.59:0/2007175684 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:59.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.223+0000 7f4482ffd640 1 --2- 172.21.15.59:0/2007175684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916a0a10 0x561c9169ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:59.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.223+0000 7f44837fe640 1 --2- 172.21.15.59:0/2007175684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a00f0 0x561c916b8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:59.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.223+0000 7f4483fff640 1 -- 172.21.15.59:0/2007175684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916a0a10 msgr2=0x561c9169ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:59.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.223+0000 7f4483fff640 1 --2- 172.21.15.59:0/2007175684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916a0a10 0x561c9169ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.223+0000 7f4483fff640 1 -- 172.21.15.59:0/2007175684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a00f0 msgr2=0x561c916b8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:59.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.223+0000 7f4483fff640 1 --2- 172.21.15.59:0/2007175684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a00f0 0x561c916b8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.223+0000 7f4483fff640 1 -- 172.21.15.59:0/2007175684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c9169e9a0 con 0x561c916ac9a0 2024-09-10T21:25:59.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.224+0000 7f4483fff640 1 --2- 172.21.15.59:0/2007175684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916ac9a0 0x561c9169f140 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f447c035000 tx=0x7f447c044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a9bef195ca9368 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:59.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.224+0000 7f44697fa640 1 -- 172.21.15.59:0/2007175684 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c003970 con 0x561c916ac9a0 2024-09-10T21:25:59.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.224+0000 7f44697fa640 1 -- 172.21.15.59:0/2007175684 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f447c036040 con 0x561c916ac9a0 2024-09-10T21:25:59.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.224+0000 7f44697fa640 1 -- 172.21.15.59:0/2007175684 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c02f8c0 con 0x561c916ac9a0 2024-09-10T21:25:59.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.224+0000 7f448c00a740 1 -- 172.21.15.59:0/2007175684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916ac9a0 msgr2=0x561c9169f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:59.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.225+0000 7f448c00a740 1 --2- 172.21.15.59:0/2007175684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916ac9a0 0x561c9169f140 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f447c035000 tx=0x7f447c044000 comp rx=0 tx=0).stop 2024-09-10T21:25:59.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.225+0000 7f448c00a740 1 -- 172.21.15.59:0/2007175684 shutdown_connections 2024-09-10T21:25:59.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.225+0000 7f448c00a740 1 --2- 172.21.15.59:0/2007175684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916ac9a0 0x561c9169f140 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.225+0000 7f448c00a740 1 --2- 172.21.15.59:0/2007175684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916a0a10 0x561c9169ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.225+0000 7f448c00a740 1 --2- 172.21.15.59:0/2007175684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a00f0 0x561c916b8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.225+0000 7f448c00a740 1 -- 172.21.15.59:0/2007175684 >> 172.21.15.59:0/2007175684 conn(0x561c9169df20 msgr2=0x561c916a4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:59.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.225+0000 7f448c00a740 1 -- 172.21.15.59:0/2007175684 shutdown_connections 2024-09-10T21:25:59.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.225+0000 7f448c00a740 1 -- 172.21.15.59:0/2007175684 wait complete. 2024-09-10T21:25:59.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.225+0000 7f448c00a740 1 -- start start 2024-09-10T21:25:59.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.225+0000 7f448c00a740 1 Processor -- start 2024-09-10T21:25:59.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.225+0000 7f448c00a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916a00f0 0x561c916a7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:59.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.225+0000 7f448c00a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a0a10 0x561c916b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:59.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.225+0000 7f448c00a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916ac9a0 0x561c916b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:59.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f448c00a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f44841af8b0 con 0x561c916a00f0 2024-09-10T21:25:59.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f448c00a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f44841af1e0 con 0x561c916a0a10 2024-09-10T21:25:59.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f448c00a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f44841ac420 con 0x561c916ac9a0 2024-09-10T21:25:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f448c00a740 10 client.0 _ll_register_callbacks cb 0x7f44780eb400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:25:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f44837fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916a00f0 0x561c916a7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f44837fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916a00f0 0x561c916a7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51116/0 (socket says 172.21.15.59:51116) 2024-09-10T21:25:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f44837fe640 1 -- 172.21.15.59:0/2360508992 learned_addr learned my addr 172.21.15.59:0/2360508992 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:25:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f4482ffd640 1 --2- 172.21.15.59:0/2360508992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a0a10 0x561c916b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f4483fff640 1 --2- 172.21.15.59:0/2360508992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916ac9a0 0x561c916b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f44837fe640 1 -- 172.21.15.59:0/2360508992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916ac9a0 msgr2=0x561c916b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f44837fe640 1 --2- 172.21.15.59:0/2360508992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916ac9a0 0x561c916b4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f44837fe640 1 -- 172.21.15.59:0/2360508992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a0a10 msgr2=0x561c916b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:25:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f44837fe640 1 --2- 172.21.15.59:0/2360508992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a0a10 0x561c916b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f44837fe640 1 -- 172.21.15.59:0/2360508992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c916b5560 con 0x561c916a00f0 2024-09-10T21:25:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f44837fe640 1 --2- 172.21.15.59:0/2360508992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916a00f0 0x561c916a7040 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f44740107e0 tx=0x7f4474004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e56c00c3159fbed5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:25:59.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f4462ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:25:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f4462ffd640 1 -- 172.21.15.59:0/2360508992 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474034070 con 0x561c916a00f0 2024-09-10T21:25:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f4462ffd640 1 -- 172.21.15.59:0/2360508992 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4474004380 con 0x561c916a00f0 2024-09-10T21:25:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f448c00a740 1 -- 172.21.15.59:0/2360508992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f447c036040 con 0x561c916a00f0 2024-09-10T21:25:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.226+0000 7f4462ffd640 1 -- 172.21.15.59:0/2360508992 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4474040070 con 0x561c916a00f0 2024-09-10T21:25:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.227+0000 7f448c00a740 10 client.18030 fetch_fsmap learned FSMap version 28 2024-09-10T21:25:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.227+0000 7f448c00a740 1 -- 172.21.15.59:0/2360508992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561c91729ff0 con 0x561c916a00f0 2024-09-10T21:25:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.227+0000 7f4462ffd640 1 -- 172.21.15.59:0/2360508992 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f447c036040 con 0x561c916a00f0 2024-09-10T21:25:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.227+0000 7f4462ffd640 1 -- 172.21.15.59:0/2360508992 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4474023070 con 0x561c916a00f0 2024-09-10T21:25:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.227+0000 7f448c00a740 10 client.18030 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:25:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.227+0000 7f448c00a740 10 client.18030 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:25:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.227+0000 7f448c00a740 20 client.18030 populate_metadata read hostname 'smithi059' 2024-09-10T21:25:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.227+0000 7f448c00a740 1 --2- 172.21.15.59:0/2360508992 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x561c9172a740 0x561c9172cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:25:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.227+0000 7f448c00a740 4 client.18030 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:25:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.227+0000 7f448c00a740 1 -- 172.21.15.59:0/2360508992 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561c916148a0 con 0x561c9172a740 2024-09-10T21:25:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.227+0000 7f4482ffd640 1 --2- 172.21.15.59:0/2360508992 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x561c9172a740 0x561c9172cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:25:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.228+0000 7f4462ffd640 10 client.18030 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:25:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.228+0000 7f4482ffd640 1 --2- 172.21.15.59:0/2360508992 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x561c9172a740 0x561c9172cb60 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9345317bfa552473 server_cookie=21e4ba53d7773cb3 in_seq=0 out_seq=0 2024-09-10T21:25:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.228+0000 7f4462ffd640 1 -- 172.21.15.59:0/2360508992 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561c916148a0 con 0x561c9172a740 2024-09-10T21:25:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.228+0000 7f4462ffd640 10 client.18030 handle_command_reply: tid=0 2024-09-10T21:25:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.228+0000 7f448c00a740 1 client.18030 shutdown 2024-09-10T21:25:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.228+0000 7f448c00a740 1 -- 172.21.15.59:0/2360508992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916a00f0 msgr2=0x561c916a7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.228+0000 7f448c00a740 1 --2- 172.21.15.59:0/2360508992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916a00f0 0x561c916a7040 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f44740107e0 tx=0x7f4474004db0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.228+0000 7f448c00a740 1 -- 172.21.15.59:0/2360508992 shutdown_connections 2024-09-10T21:25:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.228+0000 7f448c00a740 1 --2- 172.21.15.59:0/2360508992 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x561c9172a740 0x561c9172cb60 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.228+0000 7f448c00a740 1 --2- 172.21.15.59:0/2360508992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561c916ac9a0 0x561c916b4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.228+0000 7f4462ffd640 0 client.18030 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:25:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.228+0000 7f448c00a740 1 --2- 172.21.15.59:0/2360508992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561c916a0a10 0x561c916b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.228+0000 7f448c00a740 1 --2- 172.21.15.59:0/2360508992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561c916a00f0 0x561c916a7040 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.228+0000 7f448c00a740 1 -- 172.21.15.59:0/2360508992 >> 172.21.15.59:0/2360508992 conn(0x561c9169df20 msgr2=0x561c9169ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:59.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.228+0000 7f448c00a740 1 -- 172.21.15.59:0/2360508992 shutdown_connections 2024-09-10T21:25:59.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.228+0000 7f448c00a740 1 -- 172.21.15.59:0/2360508992 wait complete. 2024-09-10T21:25:59.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.228+0000 7f448c00a740 20 client.18030 trim_cache size 0 max 16384 2024-09-10T21:25:59.239 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:25:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.229+0000 7f4489c35640 1 -- 172.21.15.59:0/651488885 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f446c0b52e0 msgr2=0x7f446c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.229+0000 7f4489c35640 1 --2- 172.21.15.59:0/651488885 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f446c0b52e0 0x7f446c0b77a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f447c005e30 tx=0x7f447c005c30 comp rx=0 tx=0).stop 2024-09-10T21:25:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.229+0000 7f4489c35640 1 -- 172.21.15.59:0/651488885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44841076a0 msgr2=0x7f4484199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:25:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.229+0000 7f4489c35640 1 --2- 172.21.15.59:0/651488885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44841076a0 0x7f4484199830 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f447800d950 tx=0x7f447800de10 comp rx=0 tx=0).stop 2024-09-10T21:25:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.229+0000 7f4489c35640 1 -- 172.21.15.59:0/651488885 shutdown_connections 2024-09-10T21:25:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.229+0000 7f4489c35640 1 --2- 172.21.15.59:0/651488885 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f446c0b52e0 0x7f446c0b77a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.229+0000 7f4489c35640 1 --2- 172.21.15.59:0/651488885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4484108020 0x7f448419ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.229+0000 7f4489c35640 1 --2- 172.21.15.59:0/651488885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44841076a0 0x7f4484199830 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.229+0000 7f4489c35640 1 --2- 172.21.15.59:0/651488885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4484101c90 0x7f44841992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:25:59.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.229+0000 7f4489c35640 1 -- 172.21.15.59:0/651488885 >> 172.21.15.59:0/651488885 conn(0x7f44840fd700 msgr2=0x7f4484104b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:25:59.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.229+0000 7f4489c35640 1 -- 172.21.15.59:0/651488885 shutdown_connections 2024-09-10T21:25:59.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:25:59.229+0000 7f4489c35640 1 -- 172.21.15.59:0/651488885 wait complete. 2024-09-10T21:25:59.891 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:26:00.154 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:26:00.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.675+0000 7f817a049640 1 -- 172.21.15.59:0/661957054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8174102dc0 msgr2=0x7f81741031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:00.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.675+0000 7f817a049640 1 --2- 172.21.15.59:0/661957054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8174102dc0 0x7f81741031a0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f8164009900 tx=0x7f816402a3f0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.675+0000 7f817a049640 1 -- 172.21.15.59:0/661957054 shutdown_connections 2024-09-10T21:26:00.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.675+0000 7f817a049640 1 --2- 172.21.15.59:0/661957054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8174109150 0x7f817410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.675+0000 7f817a049640 1 --2- 172.21.15.59:0/661957054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81741087d0 0x7f8174108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.675+0000 7f817a049640 1 --2- 172.21.15.59:0/661957054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8174102dc0 0x7f81741031a0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.675+0000 7f817a049640 1 -- 172.21.15.59:0/661957054 >> 172.21.15.59:0/661957054 conn(0x7f81740fe830 msgr2=0x7f8174100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.675+0000 7f817a049640 1 -- 172.21.15.59:0/661957054 shutdown_connections 2024-09-10T21:26:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.675+0000 7f817a049640 1 -- 172.21.15.59:0/661957054 wait complete. 2024-09-10T21:26:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.675+0000 7f817a049640 1 Processor -- start 2024-09-10T21:26:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f817a049640 1 -- start start 2024-09-10T21:26:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f817a049640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8174102dc0 0x7f817419b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f817a049640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81741087d0 0x7f817419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f817a049640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8174109150 0x7f81741a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f817a049640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8174114fd0 con 0x7f81741087d0 2024-09-10T21:26:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f817a049640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8174114e50 con 0x7f8174109150 2024-09-10T21:26:00.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f817a049640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8174115150 con 0x7f8174102dc0 2024-09-10T21:26:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f8172ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81741087d0 0x7f817419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f8172ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81741087d0 0x7f817419b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51132/0 (socket says 172.21.15.59:51132) 2024-09-10T21:26:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f8172ffd640 1 -- 172.21.15.59:0/2767931188 learned_addr learned my addr 172.21.15.59:0/2767931188 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f81737fe640 1 --2- 172.21.15.59:0/2767931188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8174102dc0 0x7f817419b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f8173fff640 1 --2- 172.21.15.59:0/2767931188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8174109150 0x7f81741a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f8172ffd640 1 -- 172.21.15.59:0/2767931188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8174102dc0 msgr2=0x7f817419b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f8172ffd640 1 --2- 172.21.15.59:0/2767931188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8174102dc0 0x7f817419b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f8172ffd640 1 -- 172.21.15.59:0/2767931188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8174109150 msgr2=0x7f81741a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f8172ffd640 1 --2- 172.21.15.59:0/2767931188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8174109150 0x7f81741a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f8172ffd640 1 -- 172.21.15.59:0/2767931188 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81741a1530 con 0x7f81741087d0 2024-09-10T21:26:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f8173fff640 1 --2- 172.21.15.59:0/2767931188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8174109150 0x7f81741a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:26:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f81737fe640 1 --2- 172.21.15.59:0/2767931188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8174102dc0 0x7f817419b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:00.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.676+0000 7f8172ffd640 1 --2- 172.21.15.59:0/2767931188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81741087d0 0x7f817419b9c0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f816800b4a0 tx=0x7f816800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.677+0000 7f8170ff9640 1 -- 172.21.15.59:0/2767931188 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8168014070 con 0x7f81741087d0 2024-09-10T21:26:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.677+0000 7f8170ff9640 1 -- 172.21.15.59:0/2767931188 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8168010ac0 con 0x7f81741087d0 2024-09-10T21:26:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.677+0000 7f817a049640 1 -- 172.21.15.59:0/2767931188 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81741a1820 con 0x7f81741087d0 2024-09-10T21:26:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.677+0000 7f8170ff9640 1 -- 172.21.15.59:0/2767931188 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8168017c30 con 0x7f81741087d0 2024-09-10T21:26:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.677+0000 7f817a049640 1 -- 172.21.15.59:0/2767931188 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81741a7ee0 con 0x7f81741087d0 2024-09-10T21:26:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.679+0000 7f817c41e740 1 Processor -- start 2024-09-10T21:26:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.679+0000 7f8170ff9640 1 -- 172.21.15.59:0/2767931188 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f8168010610 con 0x7f81741087d0 2024-09-10T21:26:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.679+0000 7f817c41e740 1 -- start start 2024-09-10T21:26:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.679+0000 7f817c41e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef9680f0 0x561aef9684d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.679+0000 7f817c41e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef968a10 0x561aef974460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.679+0000 7f817c41e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef9749a0 0x561aef976d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:00.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.679+0000 7f817c41e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561aef8deea0 con 0x561aef968a10 2024-09-10T21:26:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.679+0000 7f817c41e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561aef8ce2d0 con 0x561aef9749a0 2024-09-10T21:26:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.679+0000 7f817c41e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561aef8d20e0 con 0x561aef9680f0 2024-09-10T21:26:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.680+0000 7f81737fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef968a10 0x561aef974460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.680+0000 7f81737fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef968a10 0x561aef974460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51148/0 (socket says 172.21.15.59:51148) 2024-09-10T21:26:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.680+0000 7f81737fe640 1 -- 172.21.15.59:0/4067553676 learned_addr learned my addr 172.21.15.59:0/4067553676 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.680+0000 7f8173fff640 1 --2- 172.21.15.59:0/4067553676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef9680f0 0x561aef9684d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.680+0000 7f8172ffd640 1 --2- 172.21.15.59:0/4067553676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef9749a0 0x561aef976d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.680+0000 7f81737fe640 1 -- 172.21.15.59:0/4067553676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef9680f0 msgr2=0x561aef9684d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.680+0000 7f81737fe640 1 --2- 172.21.15.59:0/4067553676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef9680f0 0x561aef9684d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.680+0000 7f81737fe640 1 -- 172.21.15.59:0/4067553676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef9749a0 msgr2=0x561aef976d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.680+0000 7f81737fe640 1 --2- 172.21.15.59:0/4067553676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef9749a0 0x561aef976d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.680+0000 7f81737fe640 1 -- 172.21.15.59:0/4067553676 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561aef62c650 con 0x561aef968a10 2024-09-10T21:26:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.680+0000 7f81737fe640 1 --2- 172.21.15.59:0/4067553676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef968a10 0x561aef974460 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f816402a910 tx=0x7f8164031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d849fbe8614e390e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.680+0000 7f8170ff9640 1 --2- 172.21.15.59:0/2767931188 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f815c0b5360 0x7f815c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.680+0000 7f8159ffb640 1 -- 172.21.15.59:0/4067553676 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816403f070 con 0x561aef968a10 2024-09-10T21:26:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.680+0000 7f8173fff640 1 --2- 172.21.15.59:0/2767931188 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f815c0b5360 0x7f815c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.680+0000 7f8159ffb640 1 -- 172.21.15.59:0/4067553676 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81640316a0 con 0x561aef968a10 2024-09-10T21:26:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.680+0000 7f8170ff9640 1 -- 172.21.15.59:0/2767931188 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f81680e54b0 con 0x7f81741087d0 2024-09-10T21:26:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.681+0000 7f8159ffb640 1 -- 172.21.15.59:0/4067553676 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8164035070 con 0x561aef968a10 2024-09-10T21:26:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.681+0000 7f817c41e740 1 -- 172.21.15.59:0/4067553676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef968a10 msgr2=0x561aef974460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.681+0000 7f8173fff640 1 --2- 172.21.15.59:0/2767931188 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f815c0b5360 0x7f815c0b7820 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f816c005fd0 tx=0x7f816c0086a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.681+0000 7f817c41e740 1 --2- 172.21.15.59:0/4067553676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef968a10 0x561aef974460 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f816402a910 tx=0x7f8164031e60 comp rx=0 tx=0).stop 2024-09-10T21:26:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.681+0000 7f817c41e740 1 -- 172.21.15.59:0/4067553676 shutdown_connections 2024-09-10T21:26:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.681+0000 7f817c41e740 1 --2- 172.21.15.59:0/4067553676 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef9749a0 0x561aef976d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.681+0000 7f817c41e740 1 --2- 172.21.15.59:0/4067553676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef968a10 0x561aef974460 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.681+0000 7f817c41e740 1 --2- 172.21.15.59:0/4067553676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef9680f0 0x561aef9684d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.681+0000 7f817c41e740 1 -- 172.21.15.59:0/4067553676 >> 172.21.15.59:0/4067553676 conn(0x561aef965f20 msgr2=0x561aef9670c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.681+0000 7f817c41e740 1 -- 172.21.15.59:0/4067553676 shutdown_connections 2024-09-10T21:26:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.681+0000 7f817c41e740 1 -- 172.21.15.59:0/4067553676 wait complete. 2024-09-10T21:26:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.682+0000 7f817c41e740 1 -- start start 2024-09-10T21:26:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.682+0000 7f817c41e740 1 Processor -- start 2024-09-10T21:26:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.682+0000 7f817c41e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef9680f0 0x561aef9741d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.682+0000 7f817c41e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef968a10 0x561aef971620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.682+0000 7f817c41e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef9749a0 0x561aef971b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.682+0000 7f817c41e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561aef72f700 con 0x561aef9680f0 2024-09-10T21:26:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.682+0000 7f817c41e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561aef869160 con 0x561aef9749a0 2024-09-10T21:26:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.682+0000 7f817c41e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x561aef977610 con 0x561aef968a10 2024-09-10T21:26:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.682+0000 7f817c41e740 10 client.0 _ll_register_callbacks cb 0x561aef8829e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.682+0000 7f81737fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef9680f0 0x561aef9741d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.682+0000 7f81737fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef9680f0 0x561aef9741d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51158/0 (socket says 172.21.15.59:51158) 2024-09-10T21:26:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.682+0000 7f81737fe640 1 -- 172.21.15.59:0/1559278745 learned_addr learned my addr 172.21.15.59:0/1559278745 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.682+0000 7f8172ffd640 1 --2- 172.21.15.59:0/1559278745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef968a10 0x561aef971620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.683+0000 7f81737fe640 1 -- 172.21.15.59:0/1559278745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef968a10 msgr2=0x561aef971620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.683+0000 7f81737fe640 1 --2- 172.21.15.59:0/1559278745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef968a10 0x561aef971620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.683+0000 7f8173fff640 1 --2- 172.21.15.59:0/1559278745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef9749a0 0x561aef971b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.683+0000 7f81737fe640 1 -- 172.21.15.59:0/1559278745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef9749a0 msgr2=0x561aef971b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.683+0000 7f81737fe640 1 --2- 172.21.15.59:0/1559278745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef9749a0 0x561aef971b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.683+0000 7f81737fe640 1 -- 172.21.15.59:0/1559278745 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561aef896c90 con 0x561aef9680f0 2024-09-10T21:26:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.683+0000 7f8173fff640 1 --2- 172.21.15.59:0/1559278745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef9749a0 0x561aef971b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:26:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.683+0000 7f81737fe640 1 --2- 172.21.15.59:0/1559278745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef9680f0 0x561aef9741d0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f8164005940 tx=0x7f816402a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8b89a5b3c72fdf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:00.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.683+0000 7f8152ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:00.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.683+0000 7f8152ffd640 1 -- 172.21.15.59:0/1559278745 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816404b030 con 0x561aef9680f0 2024-09-10T21:26:00.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.683+0000 7f8152ffd640 1 -- 172.21.15.59:0/1559278745 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8164004020 con 0x561aef9680f0 2024-09-10T21:26:00.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.683+0000 7f817c41e740 1 -- 172.21.15.59:0/1559278745 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81640316a0 con 0x561aef9680f0 2024-09-10T21:26:00.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.683+0000 7f8152ffd640 1 -- 172.21.15.59:0/1559278745 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8164035070 con 0x561aef9680f0 2024-09-10T21:26:00.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.683+0000 7f817c41e740 10 client.18042 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:00.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.683+0000 7f817c41e740 1 -- 172.21.15.59:0/1559278745 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561aef982eb0 con 0x561aef9680f0 2024-09-10T21:26:00.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.683+0000 7f8152ffd640 1 -- 172.21.15.59:0/1559278745 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81640316a0 con 0x561aef9680f0 2024-09-10T21:26:00.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.684+0000 7f8152ffd640 1 -- 172.21.15.59:0/1559278745 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f81640035f0 con 0x561aef9680f0 2024-09-10T21:26:00.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.684+0000 7f817c41e740 10 client.18042 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:00.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.684+0000 7f817c41e740 10 client.18042 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:26:00.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.684+0000 7f817c41e740 20 client.18042 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:00.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.684+0000 7f817c41e740 1 --2- 172.21.15.59:0/1559278745 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x561aef984200 0x561aef9865f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:00.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.684+0000 7f817c41e740 4 client.18042 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:26:00.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.684+0000 7f817c41e740 1 -- 172.21.15.59:0/1559278745 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561aef8e0df0 con 0x561aef984200 2024-09-10T21:26:00.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.684+0000 7f8172ffd640 1 --2- 172.21.15.59:0/1559278745 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x561aef984200 0x561aef9865f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:00.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.684+0000 7f8152ffd640 10 client.18042 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:26:00.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.684+0000 7f8172ffd640 1 --2- 172.21.15.59:0/1559278745 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x561aef984200 0x561aef9865f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b478b71a709a4378 server_cookie=9b74e2503f9b07c6 in_seq=0 out_seq=0 2024-09-10T21:26:00.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.685+0000 7f8152ffd640 1 -- 172.21.15.59:0/1559278745 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561aef8e0df0 con 0x561aef984200 2024-09-10T21:26:00.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.685+0000 7f8152ffd640 10 client.18042 handle_command_reply: tid=0 2024-09-10T21:26:00.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.685+0000 7f817c41e740 1 client.18042 shutdown 2024-09-10T21:26:00.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.685+0000 7f817c41e740 1 -- 172.21.15.59:0/1559278745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef9680f0 msgr2=0x561aef9741d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:00.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.685+0000 7f817c41e740 1 --2- 172.21.15.59:0/1559278745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef9680f0 0x561aef9741d0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f8164005940 tx=0x7f816402a3f0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.685+0000 7f817c41e740 1 -- 172.21.15.59:0/1559278745 shutdown_connections 2024-09-10T21:26:00.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.685+0000 7f817c41e740 1 --2- 172.21.15.59:0/1559278745 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x561aef984200 0x561aef9865f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.685+0000 7f817c41e740 1 --2- 172.21.15.59:0/1559278745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef9749a0 0x561aef971b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.685+0000 7f8152ffd640 0 client.18042 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:26:00.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.685+0000 7f817c41e740 1 --2- 172.21.15.59:0/1559278745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef968a10 0x561aef971620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.685+0000 7f817c41e740 1 --2- 172.21.15.59:0/1559278745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef9680f0 0x561aef9741d0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.685+0000 7f817c41e740 1 -- 172.21.15.59:0/1559278745 >> 172.21.15.59:0/1559278745 conn(0x561aef965f20 msgr2=0x561aef96bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:00.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.685+0000 7f817c41e740 1 -- 172.21.15.59:0/1559278745 shutdown_connections 2024-09-10T21:26:00.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.685+0000 7f817c41e740 1 -- 172.21.15.59:0/1559278745 wait complete. 2024-09-10T21:26:00.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.686+0000 7f817c41e740 20 client.18042 trim_cache size 0 max 16384 2024-09-10T21:26:00.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.699+0000 7f817c41e740 1 Processor -- start 2024-09-10T21:26:00.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.699+0000 7f817c41e740 1 -- start start 2024-09-10T21:26:00.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.699+0000 7f817c41e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef9680f0 0x561aef965760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:00.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.699+0000 7f817c41e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef968a10 0x561aef973360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:00.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.700+0000 7f817c41e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef9749a0 0x561aef96e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:00.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.700+0000 7f817c41e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f81741b0520 con 0x561aef968a10 2024-09-10T21:26:00.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.700+0000 7f817c41e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81741b2060 con 0x561aef9749a0 2024-09-10T21:26:00.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.700+0000 7f817c41e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f81741b0bf0 con 0x561aef9680f0 2024-09-10T21:26:00.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.700+0000 7f8172ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef968a10 0x561aef973360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:00.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.700+0000 7f8172ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef968a10 0x561aef973360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51168/0 (socket says 172.21.15.59:51168) 2024-09-10T21:26:00.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.700+0000 7f8172ffd640 1 -- 172.21.15.59:0/2520098318 learned_addr learned my addr 172.21.15.59:0/2520098318 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:00.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.700+0000 7f81737fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef9680f0 0x561aef965760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:00.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.700+0000 7f8173fff640 1 --2- 172.21.15.59:0/2520098318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef9749a0 0x561aef96e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:00.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.700+0000 7f8172ffd640 1 -- 172.21.15.59:0/2520098318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef9680f0 msgr2=0x561aef965760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:00.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.700+0000 7f8172ffd640 1 --2- 172.21.15.59:0/2520098318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef9680f0 0x561aef965760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.700+0000 7f8172ffd640 1 -- 172.21.15.59:0/2520098318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef9749a0 msgr2=0x561aef96e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:00.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.700+0000 7f8172ffd640 1 --2- 172.21.15.59:0/2520098318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef9749a0 0x561aef96e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.700+0000 7f8172ffd640 1 -- 172.21.15.59:0/2520098318 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561aef9669a0 con 0x561aef968a10 2024-09-10T21:26:00.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.700+0000 7f8172ffd640 1 --2- 172.21.15.59:0/2520098318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef968a10 0x561aef973360 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f81680a8f10 tx=0x7f816800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56024bd8097ad342 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:00.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.700+0000 7f81597fa640 1 -- 172.21.15.59:0/2520098318 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816801e070 con 0x561aef968a10 2024-09-10T21:26:00.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.700+0000 7f81597fa640 1 -- 172.21.15.59:0/2520098318 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81680ac3a0 con 0x561aef968a10 2024-09-10T21:26:00.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.700+0000 7f81597fa640 1 -- 172.21.15.59:0/2520098318 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81680930e0 con 0x561aef968a10 2024-09-10T21:26:00.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.701+0000 7f817c41e740 1 -- 172.21.15.59:0/2520098318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef968a10 msgr2=0x561aef973360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:00.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.701+0000 7f817c41e740 1 --2- 172.21.15.59:0/2520098318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef968a10 0x561aef973360 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f81680a8f10 tx=0x7f816800bf90 comp rx=0 tx=0).stop 2024-09-10T21:26:00.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.701+0000 7f817c41e740 1 -- 172.21.15.59:0/2520098318 shutdown_connections 2024-09-10T21:26:00.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.701+0000 7f817c41e740 1 --2- 172.21.15.59:0/2520098318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef9749a0 0x561aef96e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.701+0000 7f817c41e740 1 --2- 172.21.15.59:0/2520098318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef968a10 0x561aef973360 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.701+0000 7f817c41e740 1 --2- 172.21.15.59:0/2520098318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef9680f0 0x561aef965760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.701+0000 7f817c41e740 1 -- 172.21.15.59:0/2520098318 >> 172.21.15.59:0/2520098318 conn(0x561aef965f20 msgr2=0x561aef972c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:00.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.701+0000 7f817c41e740 1 -- 172.21.15.59:0/2520098318 shutdown_connections 2024-09-10T21:26:00.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.701+0000 7f817c41e740 1 -- 172.21.15.59:0/2520098318 wait complete. 2024-09-10T21:26:00.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.702+0000 7f817c41e740 1 -- start start 2024-09-10T21:26:00.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.702+0000 7f817c41e740 1 Processor -- start 2024-09-10T21:26:00.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.702+0000 7f817c41e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef9680f0 0x561aef978fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:00.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.702+0000 7f817c41e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef968a10 0x561aef9794f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:00.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.702+0000 7f817c41e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef9749a0 0x561aef9efe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:00.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.702+0000 7f817c41e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f81741b1990 con 0x561aef9680f0 2024-09-10T21:26:00.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.702+0000 7f817c41e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81741b12c0 con 0x561aef968a10 2024-09-10T21:26:00.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.702+0000 7f817c41e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f81741ae500 con 0x561aef9749a0 2024-09-10T21:26:00.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.702+0000 7f817c41e740 10 client.0 _ll_register_callbacks cb 0x7f816c008570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:00.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.702+0000 7f81737fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef9680f0 0x561aef978fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:00.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.702+0000 7f81737fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef9680f0 0x561aef978fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51184/0 (socket says 172.21.15.59:51184) 2024-09-10T21:26:00.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.702+0000 7f81737fe640 1 -- 172.21.15.59:0/2103456123 learned_addr learned my addr 172.21.15.59:0/2103456123 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:00.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.702+0000 7f8172ffd640 1 --2- 172.21.15.59:0/2103456123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef968a10 0x561aef9794f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:00.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.702+0000 7f8173fff640 1 --2- 172.21.15.59:0/2103456123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef9749a0 0x561aef9efe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:00.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.703+0000 7f81737fe640 1 -- 172.21.15.59:0/2103456123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef9749a0 msgr2=0x561aef9efe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:00.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.703+0000 7f81737fe640 1 --2- 172.21.15.59:0/2103456123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef9749a0 0x561aef9efe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.703+0000 7f81737fe640 1 -- 172.21.15.59:0/2103456123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef968a10 msgr2=0x561aef9794f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:00.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.703+0000 7f81737fe640 1 --2- 172.21.15.59:0/2103456123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef968a10 0x561aef9794f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.703+0000 7f81737fe640 1 -- 172.21.15.59:0/2103456123 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561aef9f0440 con 0x561aef9680f0 2024-09-10T21:26:00.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.703+0000 7f81737fe640 1 --2- 172.21.15.59:0/2103456123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef9680f0 0x561aef978fb0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f8164003c00 tx=0x7f8164004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e1b56e0b180c91 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:00.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.703+0000 7f8152ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:00.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.703+0000 7f8152ffd640 1 -- 172.21.15.59:0/2103456123 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816404b040 con 0x561aef9680f0 2024-09-10T21:26:00.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.703+0000 7f8152ffd640 1 -- 172.21.15.59:0/2103456123 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8164003e80 con 0x561aef9680f0 2024-09-10T21:26:00.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.703+0000 7f817c41e740 1 -- 172.21.15.59:0/2103456123 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81680ac3a0 con 0x561aef9680f0 2024-09-10T21:26:00.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.703+0000 7f8152ffd640 1 -- 172.21.15.59:0/2103456123 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8164063050 con 0x561aef9680f0 2024-09-10T21:26:00.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.703+0000 7f817c41e740 10 client.18048 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:00.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.703+0000 7f817c41e740 1 -- 172.21.15.59:0/2103456123 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561aef9f1740 con 0x561aef9680f0 2024-09-10T21:26:00.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.703+0000 7f8152ffd640 1 -- 172.21.15.59:0/2103456123 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81680ac3a0 con 0x561aef9680f0 2024-09-10T21:26:00.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.704+0000 7f8152ffd640 1 -- 172.21.15.59:0/2103456123 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f816405a070 con 0x561aef9680f0 2024-09-10T21:26:00.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.704+0000 7f817c41e740 10 client.18048 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:00.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.704+0000 7f817c41e740 10 client.18048 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:26:00.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.704+0000 7f817c41e740 20 client.18048 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:00.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.704+0000 7f817c41e740 1 --2- 172.21.15.59:0/2103456123 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x561aef9f1ee0 0x561aef9f4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:00.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.704+0000 7f817c41e740 4 client.18048 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:26:00.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.704+0000 7f817c41e740 1 -- 172.21.15.59:0/2103456123 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561aef8dc8a0 con 0x561aef9f1ee0 2024-09-10T21:26:00.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.704+0000 7f8172ffd640 1 --2- 172.21.15.59:0/2103456123 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x561aef9f1ee0 0x561aef9f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:00.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.704+0000 7f8172ffd640 1 --2- 172.21.15.59:0/2103456123 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x561aef9f1ee0 0x561aef9f4300 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d85401ff05517f19 server_cookie=8da705f76a57bce3 in_seq=0 out_seq=0 2024-09-10T21:26:00.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.704+0000 7f8152ffd640 10 client.18048 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:26:00.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.705+0000 7f8152ffd640 1 -- 172.21.15.59:0/2103456123 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561aef8dc8a0 con 0x561aef9f1ee0 2024-09-10T21:26:00.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.705+0000 7f8152ffd640 10 client.18048 handle_command_reply: tid=0 2024-09-10T21:26:00.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.705+0000 7f817c41e740 1 client.18048 shutdown 2024-09-10T21:26:00.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.705+0000 7f817c41e740 1 -- 172.21.15.59:0/2103456123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef9680f0 msgr2=0x561aef978fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:00.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.705+0000 7f817c41e740 1 --2- 172.21.15.59:0/2103456123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef9680f0 0x561aef978fb0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f8164003c00 tx=0x7f8164004730 comp rx=0 tx=0).stop 2024-09-10T21:26:00.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.705+0000 7f817c41e740 1 -- 172.21.15.59:0/2103456123 shutdown_connections 2024-09-10T21:26:00.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.705+0000 7f817c41e740 1 --2- 172.21.15.59:0/2103456123 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x561aef9f1ee0 0x561aef9f4300 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.705+0000 7f817c41e740 1 --2- 172.21.15.59:0/2103456123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561aef9749a0 0x561aef9efe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.705+0000 7f817c41e740 1 --2- 172.21.15.59:0/2103456123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561aef968a10 0x561aef9794f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.705+0000 7f817c41e740 1 --2- 172.21.15.59:0/2103456123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561aef9680f0 0x561aef978fb0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.705+0000 7f817c41e740 1 -- 172.21.15.59:0/2103456123 >> 172.21.15.59:0/2103456123 conn(0x561aef965f20 msgr2=0x561aef973470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:00.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.705+0000 7f8152ffd640 0 client.18048 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:26:00.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.705+0000 7f817c41e740 1 -- 172.21.15.59:0/2103456123 shutdown_connections 2024-09-10T21:26:00.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.705+0000 7f817c41e740 1 -- 172.21.15.59:0/2103456123 wait complete. 2024-09-10T21:26:00.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.705+0000 7f817c41e740 20 client.18048 trim_cache size 0 max 16384 2024-09-10T21:26:00.717 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:26:00.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.706+0000 7f817a049640 1 -- 172.21.15.59:0/2767931188 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f815c0b5360 msgr2=0x7f815c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:00.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.706+0000 7f817a049640 1 --2- 172.21.15.59:0/2767931188 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f815c0b5360 0x7f815c0b7820 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f816c005fd0 tx=0x7f816c0086a0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.706+0000 7f817a049640 1 -- 172.21.15.59:0/2767931188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81741087d0 msgr2=0x7f817419b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:00.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.706+0000 7f817a049640 1 --2- 172.21.15.59:0/2767931188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81741087d0 0x7f817419b9c0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f816800b4a0 tx=0x7f816800b960 comp rx=0 tx=0).stop 2024-09-10T21:26:00.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.706+0000 7f817a049640 1 -- 172.21.15.59:0/2767931188 shutdown_connections 2024-09-10T21:26:00.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.706+0000 7f817a049640 1 --2- 172.21.15.59:0/2767931188 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f815c0b5360 0x7f815c0b7820 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.706+0000 7f817a049640 1 --2- 172.21.15.59:0/2767931188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8174109150 0x7f81741a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.706+0000 7f817a049640 1 --2- 172.21.15.59:0/2767931188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81741087d0 0x7f817419b9c0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.706+0000 7f817a049640 1 --2- 172.21.15.59:0/2767931188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8174102dc0 0x7f817419b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:00.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.706+0000 7f817a049640 1 -- 172.21.15.59:0/2767931188 >> 172.21.15.59:0/2767931188 conn(0x7f81740fe830 msgr2=0x7f8174100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:00.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.706+0000 7f817a049640 1 -- 172.21.15.59:0/2767931188 shutdown_connections 2024-09-10T21:26:00.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:00.706+0000 7f817a049640 1 -- 172.21.15.59:0/2767931188 wait complete. 2024-09-10T21:26:01.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:00 smithi059 ceph-mon[30888]: pgmap v662: 97 pgs: 97 active+clean; 7.4 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:26:01.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:00 smithi154 ceph-mon[35041]: pgmap v662: 97 pgs: 97 active+clean; 7.4 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:26:01.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:00 smithi192 ceph-mon[35363]: pgmap v662: 97 pgs: 97 active+clean; 7.4 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:26:01.374 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:26:01.640 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:26:02.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.099+0000 7f02d38f0640 1 -- 172.21.15.59:0/2783568884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc109150 msgr2=0x7f02cc10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:02.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.099+0000 7f02d38f0640 1 --2- 172.21.15.59:0/2783568884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc109150 0x7f02cc10f950 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009900 tx=0x7f02c402a410 comp rx=0 tx=0).stop 2024-09-10T21:26:02.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.100+0000 7f02d38f0640 1 -- 172.21.15.59:0/2783568884 shutdown_connections 2024-09-10T21:26:02.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.100+0000 7f02d38f0640 1 --2- 172.21.15.59:0/2783568884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc109150 0x7f02cc10f950 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.100+0000 7f02d38f0640 1 --2- 172.21.15.59:0/2783568884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02cc1087d0 0x7f02cc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.100+0000 7f02d38f0640 1 --2- 172.21.15.59:0/2783568884 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02cc102dc0 0x7f02cc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.100+0000 7f02d38f0640 1 -- 172.21.15.59:0/2783568884 >> 172.21.15.59:0/2783568884 conn(0x7f02cc0fe830 msgr2=0x7f02cc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:02.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.100+0000 7f02d38f0640 1 -- 172.21.15.59:0/2783568884 shutdown_connections 2024-09-10T21:26:02.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.100+0000 7f02d38f0640 1 -- 172.21.15.59:0/2783568884 wait complete. 2024-09-10T21:26:02.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.100+0000 7f02d38f0640 1 Processor -- start 2024-09-10T21:26:02.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d38f0640 1 -- start start 2024-09-10T21:26:02.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d38f0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc102dc0 0x7f02cc199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:02.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d38f0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02cc1087d0 0x7f02cc199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:02.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d38f0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02cc109150 0x7f02cc19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:02.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d38f0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc112dd0 con 0x7f02cc102dc0 2024-09-10T21:26:02.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d38f0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc112c50 con 0x7f02cc109150 2024-09-10T21:26:02.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d38f0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc112f50 con 0x7f02cc1087d0 2024-09-10T21:26:02.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d168c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc102dc0 0x7f02cc199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:02.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d168c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc102dc0 0x7f02cc199220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51208/0 (socket says 172.21.15.59:51208) 2024-09-10T21:26:02.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d168c640 1 -- 172.21.15.59:0/2182731595 learned_addr learned my addr 172.21.15.59:0/2182731595 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:02.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d1e8d640 1 --2- 172.21.15.59:0/2182731595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02cc109150 0x7f02cc19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:02.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d0e8b640 1 --2- 172.21.15.59:0/2182731595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02cc1087d0 0x7f02cc199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:02.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d168c640 1 -- 172.21.15.59:0/2182731595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02cc1087d0 msgr2=0x7f02cc199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:02.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d168c640 1 --2- 172.21.15.59:0/2182731595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02cc1087d0 0x7f02cc199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d168c640 1 -- 172.21.15.59:0/2182731595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02cc109150 msgr2=0x7f02cc19eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:02.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d168c640 1 --2- 172.21.15.59:0/2182731595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02cc109150 0x7f02cc19eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d168c640 1 -- 172.21.15.59:0/2182731595 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02cc19f2d0 con 0x7f02cc102dc0 2024-09-10T21:26:02.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d1e8d640 1 --2- 172.21.15.59:0/2182731595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02cc109150 0x7f02cc19eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:02.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d0e8b640 1 --2- 172.21.15.59:0/2182731595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02cc1087d0 0x7f02cc199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:26:02.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.101+0000 7f02d168c640 1 --2- 172.21.15.59:0/2182731595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc102dc0 0x7f02cc199220 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f02c800ea80 tx=0x7f02c800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:02.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.102+0000 7f02c27fc640 1 -- 172.21.15.59:0/2182731595 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c800ce40 con 0x7f02cc102dc0 2024-09-10T21:26:02.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.102+0000 7f02d38f0640 1 -- 172.21.15.59:0/2182731595 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02cc19f5c0 con 0x7f02cc102dc0 2024-09-10T21:26:02.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.102+0000 7f02c27fc640 1 -- 172.21.15.59:0/2182731595 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02c8005020 con 0x7f02cc102dc0 2024-09-10T21:26:02.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.102+0000 7f02c27fc640 1 -- 172.21.15.59:0/2182731595 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c80116d0 con 0x7f02cc102dc0 2024-09-10T21:26:02.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.102+0000 7f02d38f0640 1 -- 172.21.15.59:0/2182731595 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02cc1a5c80 con 0x7f02cc102dc0 2024-09-10T21:26:02.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.105+0000 7f02d5cc5740 1 Processor -- start 2024-09-10T21:26:02.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.105+0000 7f02d5cc5740 1 -- start start 2024-09-10T21:26:02.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.105+0000 7f02c27fc640 1 -- 172.21.15.59:0/2182731595 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f02c800f040 con 0x7f02cc102dc0 2024-09-10T21:26:02.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.105+0000 7f02d5cc5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6150724d0 0x55c6150728b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:02.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.105+0000 7f02d5cc5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c615072df0 0x55c61507e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:02.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.105+0000 7f02d5cc5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c61507ed80 0x55c615081170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:02.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.105+0000 7f02d5cc5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c614fe8ea0 con 0x55c6150724d0 2024-09-10T21:26:02.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.105+0000 7f02d5cc5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c614fd82d0 con 0x55c61507ed80 2024-09-10T21:26:02.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.105+0000 7f02d5cc5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c614fdc0e0 con 0x55c615072df0 2024-09-10T21:26:02.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.105+0000 7f02d1e8d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6150724d0 0x55c6150728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:02.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.106+0000 7f02d1e8d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6150724d0 0x55c6150728b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51222/0 (socket says 172.21.15.59:51222) 2024-09-10T21:26:02.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.106+0000 7f02d1e8d640 1 -- 172.21.15.59:0/2899152079 learned_addr learned my addr 172.21.15.59:0/2899152079 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:02.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.106+0000 7f02d0e8b640 1 --2- 172.21.15.59:0/2899152079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c61507ed80 0x55c615081170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:02.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.106+0000 7f02d168c640 1 --2- 172.21.15.59:0/2899152079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c615072df0 0x55c61507e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:02.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.106+0000 7f02d0e8b640 1 -- 172.21.15.59:0/2899152079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c615072df0 msgr2=0x55c61507e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:02.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.106+0000 7f02d0e8b640 1 --2- 172.21.15.59:0/2899152079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c615072df0 0x55c61507e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.106+0000 7f02d0e8b640 1 -- 172.21.15.59:0/2899152079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6150724d0 msgr2=0x55c6150728b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:02.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.106+0000 7f02d0e8b640 1 --2- 172.21.15.59:0/2899152079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6150724d0 0x55c6150728b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.106+0000 7f02d0e8b640 1 -- 172.21.15.59:0/2899152079 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c614d36650 con 0x55c61507ed80 2024-09-10T21:26:02.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.106+0000 7f02d168c640 1 --2- 172.21.15.59:0/2899152079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c615072df0 0x55c61507e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:02.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.106+0000 7f02d1e8d640 1 --2- 172.21.15.59:0/2899152079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6150724d0 0x55c6150728b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:26:02.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.106+0000 7f02d0e8b640 1 --2- 172.21.15.59:0/2899152079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c61507ed80 0x55c615081170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009c10 tx=0x7f02bc010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=175d90f6223a22ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.106+0000 7f02c27fc640 1 --2- 172.21.15.59:0/2182731595 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f02b80b52e0 0x7f02b80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.106+0000 7f02b77fe640 1 -- 172.21.15.59:0/2899152079 <== mon.2 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc004030 con 0x55c61507ed80 2024-09-10T21:26:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.106+0000 7f02b77fe640 1 -- 172.21.15.59:0/2899152079 <== mon.2 v2:172.21.15.154:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02bc0035f0 con 0x55c61507ed80 2024-09-10T21:26:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.106+0000 7f02b77fe640 1 -- 172.21.15.59:0/2899152079 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc012650 con 0x55c61507ed80 2024-09-10T21:26:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.106+0000 7f02d1e8d640 1 --2- 172.21.15.59:0/2182731595 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f02b80b52e0 0x7f02b80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.107+0000 7f02c27fc640 1 -- 172.21.15.59:0/2182731595 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f02c80e5c00 con 0x7f02cc102dc0 2024-09-10T21:26:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.107+0000 7f02d5cc5740 1 -- 172.21.15.59:0/2899152079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c61507ed80 msgr2=0x55c615081170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.107+0000 7f02d1e8d640 1 --2- 172.21.15.59:0/2182731595 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f02b80b52e0 0x7f02b80b77a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f02c4005940 tx=0x7f02c40058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.107+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/2899152079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c61507ed80 0x55c615081170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009c10 tx=0x7f02bc010740 comp rx=0 tx=0).stop 2024-09-10T21:26:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.107+0000 7f02d5cc5740 1 -- 172.21.15.59:0/2899152079 shutdown_connections 2024-09-10T21:26:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.107+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/2899152079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c61507ed80 0x55c615081170 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.107+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/2899152079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c615072df0 0x55c61507e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.107+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/2899152079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c6150724d0 0x55c6150728b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.107+0000 7f02d5cc5740 1 -- 172.21.15.59:0/2899152079 >> 172.21.15.59:0/2899152079 conn(0x55c615070300 msgr2=0x55c6150714a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:02.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.107+0000 7f02d5cc5740 1 -- 172.21.15.59:0/2899152079 shutdown_connections 2024-09-10T21:26:02.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.107+0000 7f02d5cc5740 1 -- 172.21.15.59:0/2899152079 wait complete. 2024-09-10T21:26:02.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.108+0000 7f02d5cc5740 1 -- start start 2024-09-10T21:26:02.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.108+0000 7f02d5cc5740 1 Processor -- start 2024-09-10T21:26:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.108+0000 7f02d5cc5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6150724d0 0x55c61507e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.108+0000 7f02d5cc5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c615072df0 0x55c61507ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.108+0000 7f02d5cc5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c61507ed80 0x55c61507c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.108+0000 7f02d5cc5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c614e39700 con 0x55c615072df0 2024-09-10T21:26:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.108+0000 7f02d5cc5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c614f73160 con 0x55c6150724d0 2024-09-10T21:26:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.108+0000 7f02d5cc5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c615081a00 con 0x55c61507ed80 2024-09-10T21:26:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.108+0000 7f02d5cc5740 10 client.0 _ll_register_callbacks cb 0x55c614f8c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.109+0000 7f02d0e8b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c615072df0 0x55c61507ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.109+0000 7f02d0e8b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c615072df0 0x55c61507ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51234/0 (socket says 172.21.15.59:51234) 2024-09-10T21:26:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.109+0000 7f02d0e8b640 1 -- 172.21.15.59:0/979162722 learned_addr learned my addr 172.21.15.59:0/979162722 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.109+0000 7f02d168c640 1 --2- 172.21.15.59:0/979162722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6150724d0 0x55c61507e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.109+0000 7f02d1e8d640 1 --2- 172.21.15.59:0/979162722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c61507ed80 0x55c61507c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.109+0000 7f02d0e8b640 1 -- 172.21.15.59:0/979162722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c61507ed80 msgr2=0x55c61507c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.109+0000 7f02d0e8b640 1 --2- 172.21.15.59:0/979162722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c61507ed80 0x55c61507c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.109+0000 7f02d0e8b640 1 -- 172.21.15.59:0/979162722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6150724d0 msgr2=0x55c61507e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.109+0000 7f02d0e8b640 1 --2- 172.21.15.59:0/979162722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6150724d0 0x55c61507e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.109+0000 7f02d0e8b640 1 -- 172.21.15.59:0/979162722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c614fa0c90 con 0x55c615072df0 2024-09-10T21:26:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.109+0000 7f02d1e8d640 1 --2- 172.21.15.59:0/979162722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c61507ed80 0x55c61507c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.109+0000 7f02d0e8b640 1 --2- 172.21.15.59:0/979162722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c615072df0 0x55c61507ba80 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f02bc011010 tx=0x7f02bc003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6fe19c36ca5c94 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.109+0000 7f02b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.109+0000 7f02b4ff9640 1 -- 172.21.15.59:0/979162722 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc02a060 con 0x55c615072df0 2024-09-10T21:26:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.109+0000 7f02b4ff9640 1 -- 172.21.15.59:0/979162722 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f02bc0041d0 con 0x55c615072df0 2024-09-10T21:26:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.109+0000 7f02d5cc5740 1 -- 172.21.15.59:0/979162722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02bc0035f0 con 0x55c615072df0 2024-09-10T21:26:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.110+0000 7f02b4ff9640 1 -- 172.21.15.59:0/979162722 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f02bc0043d0 con 0x55c615072df0 2024-09-10T21:26:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.110+0000 7f02d5cc5740 10 client.18060 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.110+0000 7f02d5cc5740 1 -- 172.21.15.59:0/979162722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c61508d380 con 0x55c615072df0 2024-09-10T21:26:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.110+0000 7f02b4ff9640 1 -- 172.21.15.59:0/979162722 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02bc0035f0 con 0x55c615072df0 2024-09-10T21:26:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.110+0000 7f02b4ff9640 1 -- 172.21.15.59:0/979162722 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f02bc00f040 con 0x55c615072df0 2024-09-10T21:26:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.110+0000 7f02d5cc5740 10 client.18060 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.110+0000 7f02d5cc5740 10 client.18060 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:26:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.110+0000 7f02d5cc5740 20 client.18060 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.110+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/979162722 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55c61508e780 0x55c615090b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.110+0000 7f02d5cc5740 4 client.18060 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:26:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.110+0000 7f02d5cc5740 1 -- 172.21.15.59:0/979162722 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c614feadf0 con 0x55c61508e780 2024-09-10T21:26:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.111+0000 7f02d168c640 1 --2- 172.21.15.59:0/979162722 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55c61508e780 0x55c615090b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:02.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.111+0000 7f02b4ff9640 10 client.18060 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:26:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.111+0000 7f02d168c640 1 --2- 172.21.15.59:0/979162722 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55c61508e780 0x55c615090b70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2463f3a9aac0af server_cookie=647c4c9ca723ea0e in_seq=0 out_seq=0 2024-09-10T21:26:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.112+0000 7f02b4ff9640 1 -- 172.21.15.59:0/979162722 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c614feadf0 con 0x55c61508e780 2024-09-10T21:26:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.112+0000 7f02b4ff9640 10 client.18060 handle_command_reply: tid=0 2024-09-10T21:26:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.112+0000 7f02d5cc5740 1 client.18060 shutdown 2024-09-10T21:26:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.112+0000 7f02d5cc5740 1 -- 172.21.15.59:0/979162722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c615072df0 msgr2=0x55c61507ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.112+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/979162722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c615072df0 0x55c61507ba80 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f02bc011010 tx=0x7f02bc003ca0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.112+0000 7f02d5cc5740 1 -- 172.21.15.59:0/979162722 shutdown_connections 2024-09-10T21:26:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.112+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/979162722 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55c61508e780 0x55c615090b70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.112+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/979162722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c61507ed80 0x55c61507c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.112+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/979162722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c615072df0 0x55c61507ba80 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.112+0000 7f02b4ff9640 0 client.18060 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:26:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.112+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/979162722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6150724d0 0x55c61507e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.112+0000 7f02d5cc5740 1 -- 172.21.15.59:0/979162722 >> 172.21.15.59:0/979162722 conn(0x55c615070300 msgr2=0x55c615075e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:02.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.112+0000 7f02d5cc5740 1 -- 172.21.15.59:0/979162722 shutdown_connections 2024-09-10T21:26:02.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.112+0000 7f02d5cc5740 1 -- 172.21.15.59:0/979162722 wait complete. 2024-09-10T21:26:02.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.112+0000 7f02d5cc5740 20 client.18060 trim_cache size 0 max 16384 2024-09-10T21:26:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.125+0000 7f02d5cc5740 1 Processor -- start 2024-09-10T21:26:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.125+0000 7f02d5cc5740 1 -- start start 2024-09-10T21:26:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.126+0000 7f02d5cc5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6150724d0 0x55c61507d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.126+0000 7f02d5cc5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c615072df0 0x55c615080170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.126+0000 7f02d5cc5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c61507ed80 0x55c6150806b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.126+0000 7f02d5cc5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc1ae2f0 con 0x55c61507ed80 2024-09-10T21:26:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.126+0000 7f02d5cc5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc1afe30 con 0x55c6150724d0 2024-09-10T21:26:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.126+0000 7f02d5cc5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc1ae9c0 con 0x55c615072df0 2024-09-10T21:26:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.126+0000 7f02d1e8d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c61507ed80 0x55c6150806b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:02.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.126+0000 7f02d1e8d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c61507ed80 0x55c6150806b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51246/0 (socket says 172.21.15.59:51246) 2024-09-10T21:26:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.126+0000 7f02d168c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6150724d0 0x55c61507d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.126+0000 7f02d1e8d640 1 -- 172.21.15.59:0/3707667476 learned_addr learned my addr 172.21.15.59:0/3707667476 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.126+0000 7f02d0e8b640 1 --2- 172.21.15.59:0/3707667476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c615072df0 0x55c615080170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.126+0000 7f02d1e8d640 1 -- 172.21.15.59:0/3707667476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c615072df0 msgr2=0x55c615080170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.126+0000 7f02d1e8d640 1 --2- 172.21.15.59:0/3707667476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c615072df0 0x55c615080170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.126+0000 7f02d1e8d640 1 -- 172.21.15.59:0/3707667476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6150724d0 msgr2=0x55c61507d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.126+0000 7f02d1e8d640 1 --2- 172.21.15.59:0/3707667476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6150724d0 0x55c61507d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.126+0000 7f02d1e8d640 1 -- 172.21.15.59:0/3707667476 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c615091100 con 0x55c61507ed80 2024-09-10T21:26:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.126+0000 7f02d168c640 1 --2- 172.21.15.59:0/3707667476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6150724d0 0x55c61507d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:26:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.126+0000 7f02d1e8d640 1 --2- 172.21.15.59:0/3707667476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c61507ed80 0x55c6150806b0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009900 tx=0x7f02c403e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38656345af1c4162 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.127+0000 7f02b6ffd640 1 -- 172.21.15.59:0/3707667476 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4035040 con 0x55c61507ed80 2024-09-10T21:26:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.127+0000 7f02b6ffd640 1 -- 172.21.15.59:0/3707667476 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02c4004480 con 0x55c61507ed80 2024-09-10T21:26:02.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.127+0000 7f02b6ffd640 1 -- 172.21.15.59:0/3707667476 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c40035f0 con 0x55c61507ed80 2024-09-10T21:26:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.127+0000 7f02d5cc5740 1 -- 172.21.15.59:0/3707667476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c61507ed80 msgr2=0x55c6150806b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:02.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.127+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/3707667476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c61507ed80 0x55c6150806b0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009900 tx=0x7f02c403e000 comp rx=0 tx=0).stop 2024-09-10T21:26:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.127+0000 7f02d5cc5740 1 -- 172.21.15.59:0/3707667476 shutdown_connections 2024-09-10T21:26:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.127+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/3707667476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c61507ed80 0x55c6150806b0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.127+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/3707667476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c615072df0 0x55c615080170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.127+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/3707667476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6150724d0 0x55c61507d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.127+0000 7f02d5cc5740 1 -- 172.21.15.59:0/3707667476 >> 172.21.15.59:0/3707667476 conn(0x55c615070300 msgr2=0x55c61507d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.127+0000 7f02d5cc5740 1 -- 172.21.15.59:0/3707667476 shutdown_connections 2024-09-10T21:26:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.127+0000 7f02d5cc5740 1 -- 172.21.15.59:0/3707667476 wait complete. 2024-09-10T21:26:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.128+0000 7f02d5cc5740 1 -- start start 2024-09-10T21:26:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.128+0000 7f02d5cc5740 1 Processor -- start 2024-09-10T21:26:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.128+0000 7f02d5cc5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6150724d0 0x55c615087530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.128+0000 7f02d5cc5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c615072df0 0x55c615081ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:02.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.128+0000 7f02d5cc5740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c61507ed80 0x55c6150822a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.128+0000 7f02d5cc5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc1af760 con 0x55c615072df0 2024-09-10T21:26:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.128+0000 7f02d5cc5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc1af090 con 0x55c6150724d0 2024-09-10T21:26:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.128+0000 7f02d5cc5740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc1ac2d0 con 0x55c61507ed80 2024-09-10T21:26:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.128+0000 7f02d5cc5740 10 client.0 _ll_register_callbacks cb 0x7f02bc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.128+0000 7f02d0e8b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c615072df0 0x55c615081ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.128+0000 7f02d168c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6150724d0 0x55c615087530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.128+0000 7f02d0e8b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c615072df0 0x55c615081ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51262/0 (socket says 172.21.15.59:51262) 2024-09-10T21:26:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.128+0000 7f02d0e8b640 1 -- 172.21.15.59:0/1038022917 learned_addr learned my addr 172.21.15.59:0/1038022917 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.129+0000 7f02d1e8d640 1 --2- 172.21.15.59:0/1038022917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c61507ed80 0x55c6150822a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.129+0000 7f02d0e8b640 1 -- 172.21.15.59:0/1038022917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c61507ed80 msgr2=0x55c6150822a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.129+0000 7f02d0e8b640 1 --2- 172.21.15.59:0/1038022917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c61507ed80 0x55c6150822a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.129+0000 7f02d0e8b640 1 -- 172.21.15.59:0/1038022917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6150724d0 msgr2=0x55c615087530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.129+0000 7f02d0e8b640 1 --2- 172.21.15.59:0/1038022917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6150724d0 0x55c615087530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.129+0000 7f02d0e8b640 1 -- 172.21.15.59:0/1038022917 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c615070d80 con 0x55c615072df0 2024-09-10T21:26:02.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.129+0000 7f02d168c640 1 --2- 172.21.15.59:0/1038022917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6150724d0 0x55c615087530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:26:02.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.129+0000 7f02d1e8d640 1 --2- 172.21.15.59:0/1038022917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c61507ed80 0x55c6150822a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:02.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.129+0000 7f02d0e8b640 1 --2- 172.21.15.59:0/1038022917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c615072df0 0x55c615081ce0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f02bc001eb0 tx=0x7f02bc005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8093d43b5057d97c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:02.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.129+0000 7f02b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:02.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.129+0000 7f02b4ff9640 1 -- 172.21.15.59:0/1038022917 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc035040 con 0x55c615072df0 2024-09-10T21:26:02.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.129+0000 7f02d5cc5740 1 -- 172.21.15.59:0/1038022917 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02c4004480 con 0x55c615072df0 2024-09-10T21:26:02.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.129+0000 7f02b4ff9640 1 -- 172.21.15.59:0/1038022917 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f02bc0057f0 con 0x55c615072df0 2024-09-10T21:26:02.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.129+0000 7f02b4ff9640 1 -- 172.21.15.59:0/1038022917 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f02bc02a040 con 0x55c615072df0 2024-09-10T21:26:02.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.129+0000 7f02d5cc5740 10 client.18066 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:02.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.129+0000 7f02d5cc5740 1 -- 172.21.15.59:0/1038022917 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c6150fc440 con 0x55c615072df0 2024-09-10T21:26:02.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.129+0000 7f02b4ff9640 1 -- 172.21.15.59:0/1038022917 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02c4004480 con 0x55c615072df0 2024-09-10T21:26:02.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.130+0000 7f02b4ff9640 1 -- 172.21.15.59:0/1038022917 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f02bc003d10 con 0x55c615072df0 2024-09-10T21:26:02.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.130+0000 7f02d5cc5740 10 client.18066 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:02.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.130+0000 7f02d5cc5740 10 client.18066 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:26:02.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.130+0000 7f02d5cc5740 20 client.18066 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:02.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.130+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/1038022917 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55c6150fcbf0 0x55c6150ff010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:02.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.130+0000 7f02d5cc5740 4 client.18066 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:26:02.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.130+0000 7f02d5cc5740 1 -- 172.21.15.59:0/1038022917 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c614fe68a0 con 0x55c6150fcbf0 2024-09-10T21:26:02.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.130+0000 7f02d168c640 1 --2- 172.21.15.59:0/1038022917 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55c6150fcbf0 0x55c6150ff010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:02.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.130+0000 7f02d168c640 1 --2- 172.21.15.59:0/1038022917 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55c6150fcbf0 0x55c6150ff010 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5094ad245f95134e server_cookie=226e31a4d7422daa in_seq=0 out_seq=0 2024-09-10T21:26:02.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.130+0000 7f02b4ff9640 10 client.18066 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:26:02.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.131+0000 7f02b4ff9640 1 -- 172.21.15.59:0/1038022917 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c614fe68a0 con 0x55c6150fcbf0 2024-09-10T21:26:02.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.131+0000 7f02b4ff9640 10 client.18066 handle_command_reply: tid=0 2024-09-10T21:26:02.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.131+0000 7f02d5cc5740 1 client.18066 shutdown 2024-09-10T21:26:02.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.131+0000 7f02d5cc5740 1 -- 172.21.15.59:0/1038022917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c615072df0 msgr2=0x55c615081ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:02.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.131+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/1038022917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c615072df0 0x55c615081ce0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f02bc001eb0 tx=0x7f02bc005db0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.131+0000 7f02d5cc5740 1 -- 172.21.15.59:0/1038022917 shutdown_connections 2024-09-10T21:26:02.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.131+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/1038022917 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55c6150fcbf0 0x55c6150ff010 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.131+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/1038022917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c61507ed80 0x55c6150822a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.131+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/1038022917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c615072df0 0x55c615081ce0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.131+0000 7f02b4ff9640 0 client.18066 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:26:02.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.131+0000 7f02d5cc5740 1 --2- 172.21.15.59:0/1038022917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c6150724d0 0x55c615087530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.131+0000 7f02d5cc5740 1 -- 172.21.15.59:0/1038022917 >> 172.21.15.59:0/1038022917 conn(0x55c615070300 msgr2=0x55c615079f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:02.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.131+0000 7f02d5cc5740 1 -- 172.21.15.59:0/1038022917 shutdown_connections 2024-09-10T21:26:02.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.131+0000 7f02d5cc5740 1 -- 172.21.15.59:0/1038022917 wait complete. 2024-09-10T21:26:02.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.131+0000 7f02d5cc5740 20 client.18066 trim_cache size 0 max 16384 2024-09-10T21:26:02.140 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:26:02.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.132+0000 7f02d38f0640 1 -- 172.21.15.59:0/2182731595 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f02b80b52e0 msgr2=0x7f02b80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:02.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.132+0000 7f02d38f0640 1 --2- 172.21.15.59:0/2182731595 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f02b80b52e0 0x7f02b80b77a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f02c4005940 tx=0x7f02c40058b0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.132+0000 7f02d38f0640 1 -- 172.21.15.59:0/2182731595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc102dc0 msgr2=0x7f02cc199220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:02.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.132+0000 7f02d38f0640 1 --2- 172.21.15.59:0/2182731595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc102dc0 0x7f02cc199220 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f02c800ea80 tx=0x7f02c800ef40 comp rx=0 tx=0).stop 2024-09-10T21:26:02.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.132+0000 7f02d38f0640 1 -- 172.21.15.59:0/2182731595 shutdown_connections 2024-09-10T21:26:02.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.132+0000 7f02d38f0640 1 --2- 172.21.15.59:0/2182731595 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f02b80b52e0 0x7f02b80b77a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.132+0000 7f02d38f0640 1 --2- 172.21.15.59:0/2182731595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f02cc109150 0x7f02cc19eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.132+0000 7f02d38f0640 1 --2- 172.21.15.59:0/2182731595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02cc1087d0 0x7f02cc199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.132+0000 7f02d38f0640 1 --2- 172.21.15.59:0/2182731595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02cc102dc0 0x7f02cc199220 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:02.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.132+0000 7f02d38f0640 1 -- 172.21.15.59:0/2182731595 >> 172.21.15.59:0/2182731595 conn(0x7f02cc0fe830 msgr2=0x7f02cc0ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:02.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.132+0000 7f02d38f0640 1 -- 172.21.15.59:0/2182731595 shutdown_connections 2024-09-10T21:26:02.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:02.132+0000 7f02d38f0640 1 -- 172.21.15.59:0/2182731595 wait complete. 2024-09-10T21:26:02.940 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:26:03.159 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:02 smithi059 ceph-mon[30888]: pgmap v663: 97 pgs: 97 active+clean; 7.4 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:26:03.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:02 smithi154 ceph-mon[35041]: pgmap v663: 97 pgs: 97 active+clean; 7.4 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:26:03.205 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:26:03.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:02 smithi192 ceph-mon[35363]: pgmap v663: 97 pgs: 97 active+clean; 7.4 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:26:03.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.741+0000 7fab3cfa2640 1 -- 172.21.15.59:0/499941751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab38102dc0 msgr2=0x7fab381031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:03.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.741+0000 7fab3cfa2640 1 --2- 172.21.15.59:0/499941751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab38102dc0 0x7fab381031a0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fab28009900 tx=0x7fab2802a410 comp rx=0 tx=0).stop 2024-09-10T21:26:03.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.741+0000 7fab3cfa2640 1 -- 172.21.15.59:0/499941751 shutdown_connections 2024-09-10T21:26:03.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.741+0000 7fab3cfa2640 1 --2- 172.21.15.59:0/499941751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab38109150 0x7fab3810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.741+0000 7fab3cfa2640 1 --2- 172.21.15.59:0/499941751 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab381087d0 0x7fab38108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.741+0000 7fab3cfa2640 1 --2- 172.21.15.59:0/499941751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab38102dc0 0x7fab381031a0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.741+0000 7fab3cfa2640 1 -- 172.21.15.59:0/499941751 >> 172.21.15.59:0/499941751 conn(0x7fab380fe870 msgr2=0x7fab38100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:03.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.741+0000 7fab3cfa2640 1 -- 172.21.15.59:0/499941751 shutdown_connections 2024-09-10T21:26:03.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.741+0000 7fab3cfa2640 1 -- 172.21.15.59:0/499941751 wait complete. 2024-09-10T21:26:03.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.742+0000 7fab3cfa2640 1 Processor -- start 2024-09-10T21:26:03.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.742+0000 7fab3cfa2640 1 -- start start 2024-09-10T21:26:03.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.742+0000 7fab3cfa2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab38102dc0 0x7fab38199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:03.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.742+0000 7fab3cfa2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab381087d0 0x7fab381998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:03.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.742+0000 7fab3cfa2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab38109150 0x7fab3819ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:03.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.742+0000 7fab3cfa2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fab38112e10 con 0x7fab381087d0 2024-09-10T21:26:03.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.742+0000 7fab3cfa2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fab38112c90 con 0x7fab38102dc0 2024-09-10T21:26:03.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.742+0000 7fab3cfa2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fab38112f90 con 0x7fab38109150 2024-09-10T21:26:03.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.742+0000 7fab35d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab381087d0 0x7fab381998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:03.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.742+0000 7fab35d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab381087d0 0x7fab381998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51290/0 (socket says 172.21.15.59:51290) 2024-09-10T21:26:03.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.742+0000 7fab35d9b640 1 -- 172.21.15.59:0/3270887094 learned_addr learned my addr 172.21.15.59:0/3270887094 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:03.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.743+0000 7fab36d9d640 1 --2- 172.21.15.59:0/3270887094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab38109150 0x7fab3819ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:03.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.743+0000 7fab35d9b640 1 -- 172.21.15.59:0/3270887094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab38109150 msgr2=0x7fab3819ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:03.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.743+0000 7fab35d9b640 1 --2- 172.21.15.59:0/3270887094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab38109150 0x7fab3819ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.743+0000 7fab35d9b640 1 -- 172.21.15.59:0/3270887094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab38102dc0 msgr2=0x7fab38199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:03.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.743+0000 7fab35d9b640 1 --2- 172.21.15.59:0/3270887094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab38102dc0 0x7fab38199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.743+0000 7fab35d9b640 1 -- 172.21.15.59:0/3270887094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3819f430 con 0x7fab381087d0 2024-09-10T21:26:03.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.743+0000 7fab35d9b640 1 --2- 172.21.15.59:0/3270887094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab381087d0 0x7fab381998c0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fab2000d950 tx=0x7fab2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:03.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.743+0000 7fab2f7fe640 1 -- 172.21.15.59:0/3270887094 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab20017070 con 0x7fab381087d0 2024-09-10T21:26:03.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.743+0000 7fab2f7fe640 1 -- 172.21.15.59:0/3270887094 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab20009c30 con 0x7fab381087d0 2024-09-10T21:26:03.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.743+0000 7fab3cfa2640 1 -- 172.21.15.59:0/3270887094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab3819f720 con 0x7fab381087d0 2024-09-10T21:26:03.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.743+0000 7fab2f7fe640 1 -- 172.21.15.59:0/3270887094 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2000f620 con 0x7fab381087d0 2024-09-10T21:26:03.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.743+0000 7fab3cfa2640 1 -- 172.21.15.59:0/3270887094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab381a5de0 con 0x7fab381087d0 2024-09-10T21:26:03.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.746+0000 7fab3f377740 1 Processor -- start 2024-09-10T21:26:03.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.746+0000 7fab3f377740 1 -- start start 2024-09-10T21:26:03.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.746+0000 7fab3f377740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d34d0 0x562d3e3d38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:03.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.746+0000 7fab3f377740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3d3df0 0x562d3e3df840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:03.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.746+0000 7fab3f377740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3dfd80 0x562d3e3e2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:03.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.746+0000 7fab3f377740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562d3e349ea0 con 0x562d3e3d34d0 2024-09-10T21:26:03.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.746+0000 7fab3f377740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562d3e3392d0 con 0x562d3e3d3df0 2024-09-10T21:26:03.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.746+0000 7fab3f377740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562d3e33d0e0 con 0x562d3e3dfd80 2024-09-10T21:26:03.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.746+0000 7fab36d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d34d0 0x562d3e3d38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:03.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.746+0000 7fab36d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d34d0 0x562d3e3d38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51292/0 (socket says 172.21.15.59:51292) 2024-09-10T21:26:03.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.746+0000 7fab36d9d640 1 -- 172.21.15.59:0/2526454308 learned_addr learned my addr 172.21.15.59:0/2526454308 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:03.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.746+0000 7fab3659c640 1 --2- 172.21.15.59:0/2526454308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3d3df0 0x562d3e3df840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:03.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.746+0000 7fab2f7fe640 1 -- 172.21.15.59:0/3270887094 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fab20010460 con 0x7fab381087d0 2024-09-10T21:26:03.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.747+0000 7fab36d9d640 1 -- 172.21.15.59:0/2526454308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3dfd80 msgr2=0x562d3e3e2170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T21:26:03.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.747+0000 7fab36d9d640 1 --2- 172.21.15.59:0/2526454308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3dfd80 0x562d3e3e2170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.747+0000 7fab36d9d640 1 -- 172.21.15.59:0/2526454308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3d3df0 msgr2=0x562d3e3df840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:03.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.747+0000 7fab36d9d640 1 --2- 172.21.15.59:0/2526454308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3d3df0 0x562d3e3df840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.747+0000 7fab36d9d640 1 -- 172.21.15.59:0/2526454308 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d3e097650 con 0x562d3e3d34d0 2024-09-10T21:26:03.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.747+0000 7fab3659c640 1 --2- 172.21.15.59:0/2526454308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3d3df0 0x562d3e3df840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:03.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.747+0000 7fab36d9d640 1 --2- 172.21.15.59:0/2526454308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d34d0 0x562d3e3d38b0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fab30009e60 tx=0x7fab30010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c94cf3ba948443 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:03.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.747+0000 7fab2cff9640 1 -- 172.21.15.59:0/2526454308 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab30016070 con 0x562d3e3d34d0 2024-09-10T21:26:03.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.747+0000 7fab2cff9640 1 -- 172.21.15.59:0/2526454308 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab30004d20 con 0x562d3e3d34d0 2024-09-10T21:26:03.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.747+0000 7fab2cff9640 1 -- 172.21.15.59:0/2526454308 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab30012740 con 0x562d3e3d34d0 2024-09-10T21:26:03.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.747+0000 7fab2f7fe640 1 --2- 172.21.15.59:0/3270887094 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fab240b52e0 0x7fab240b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:03.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.748+0000 7fab3659c640 1 --2- 172.21.15.59:0/3270887094 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fab240b52e0 0x7fab240b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:03.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.748+0000 7fab2f7fe640 1 -- 172.21.15.59:0/3270887094 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fab200e58f0 con 0x7fab381087d0 2024-09-10T21:26:03.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.748+0000 7fab3f377740 1 -- 172.21.15.59:0/2526454308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d34d0 msgr2=0x562d3e3d38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:03.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.748+0000 7fab3f377740 1 --2- 172.21.15.59:0/2526454308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d34d0 0x562d3e3d38b0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fab30009e60 tx=0x7fab30010740 comp rx=0 tx=0).stop 2024-09-10T21:26:03.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.748+0000 7fab3f377740 1 -- 172.21.15.59:0/2526454308 shutdown_connections 2024-09-10T21:26:03.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.748+0000 7fab3f377740 1 --2- 172.21.15.59:0/2526454308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3dfd80 0x562d3e3e2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.748+0000 7fab3f377740 1 --2- 172.21.15.59:0/2526454308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3d3df0 0x562d3e3df840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.748+0000 7fab3659c640 1 --2- 172.21.15.59:0/3270887094 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fab240b52e0 0x7fab240b77a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fab28009230 tx=0x7fab28031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:03.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.748+0000 7fab3f377740 1 --2- 172.21.15.59:0/2526454308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d34d0 0x562d3e3d38b0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.748+0000 7fab3f377740 1 -- 172.21.15.59:0/2526454308 >> 172.21.15.59:0/2526454308 conn(0x562d3e3d1300 msgr2=0x562d3e3d24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:03.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.748+0000 7fab3f377740 1 -- 172.21.15.59:0/2526454308 shutdown_connections 2024-09-10T21:26:03.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.748+0000 7fab3f377740 1 -- 172.21.15.59:0/2526454308 wait complete. 2024-09-10T21:26:03.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.748+0000 7fab3f377740 1 -- start start 2024-09-10T21:26:03.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.749+0000 7fab3f377740 1 Processor -- start 2024-09-10T21:26:03.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.749+0000 7fab3f377740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3d34d0 0x562d3e3df6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:03.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.749+0000 7fab3f377740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d3df0 0x562d3e3dcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:03.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.749+0000 7fab3f377740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3dfd80 0x562d3e3dd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:03.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.749+0000 7fab3f377740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562d3e19a700 con 0x562d3e3d3df0 2024-09-10T21:26:03.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.749+0000 7fab3f377740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562d3e2d4160 con 0x562d3e3d34d0 2024-09-10T21:26:03.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.749+0000 7fab3f377740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x562d3e3e2a00 con 0x562d3e3dfd80 2024-09-10T21:26:03.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.749+0000 7fab3f377740 10 client.0 _ll_register_callbacks cb 0x562d3e2ed9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:03.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.749+0000 7fab35d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d3df0 0x562d3e3dcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:03.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.749+0000 7fab35d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d3df0 0x562d3e3dcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51296/0 (socket says 172.21.15.59:51296) 2024-09-10T21:26:03.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.749+0000 7fab35d9b640 1 -- 172.21.15.59:0/1876337605 learned_addr learned my addr 172.21.15.59:0/1876337605 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:03.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.749+0000 7fab3659c640 1 --2- 172.21.15.59:0/1876337605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3d34d0 0x562d3e3df6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:03.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.749+0000 7fab36d9d640 1 --2- 172.21.15.59:0/1876337605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3dfd80 0x562d3e3dd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:03.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.749+0000 7fab35d9b640 1 -- 172.21.15.59:0/1876337605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3dfd80 msgr2=0x562d3e3dd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:03.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.749+0000 7fab35d9b640 1 --2- 172.21.15.59:0/1876337605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3dfd80 0x562d3e3dd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.749+0000 7fab35d9b640 1 -- 172.21.15.59:0/1876337605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3d34d0 msgr2=0x562d3e3df6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:03.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.749+0000 7fab35d9b640 1 --2- 172.21.15.59:0/1876337605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3d34d0 0x562d3e3df6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.749+0000 7fab35d9b640 1 -- 172.21.15.59:0/1876337605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d3e301c90 con 0x562d3e3d3df0 2024-09-10T21:26:03.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.750+0000 7fab35d9b640 1 --2- 172.21.15.59:0/1876337605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d3df0 0x562d3e3dcb00 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fab200a9350 tx=0x7fab200a8840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d27d921b1b4f65 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:03.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.750+0000 7fab1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:03.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.750+0000 7fab1dffb640 1 -- 172.21.15.59:0/1876337605 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab20020070 con 0x562d3e3d3df0 2024-09-10T21:26:03.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.750+0000 7fab1dffb640 1 -- 172.21.15.59:0/1876337605 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fab200ab340 con 0x562d3e3d3df0 2024-09-10T21:26:03.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.750+0000 7fab3f377740 1 -- 172.21.15.59:0/1876337605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab30004d20 con 0x562d3e3d3df0 2024-09-10T21:26:03.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.750+0000 7fab1dffb640 1 -- 172.21.15.59:0/1876337605 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fab200ac7e0 con 0x562d3e3d3df0 2024-09-10T21:26:03.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.750+0000 7fab3f377740 10 client.18078 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:03.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.750+0000 7fab3f377740 1 -- 172.21.15.59:0/1876337605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562d3e3ee400 con 0x562d3e3d3df0 2024-09-10T21:26:03.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.750+0000 7fab1dffb640 1 -- 172.21.15.59:0/1876337605 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab30004d20 con 0x562d3e3d3df0 2024-09-10T21:26:03.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.750+0000 7fab1dffb640 1 -- 172.21.15.59:0/1876337605 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fab200a7a30 con 0x562d3e3d3df0 2024-09-10T21:26:03.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.750+0000 7fab3f377740 10 client.18078 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:03.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.750+0000 7fab3f377740 10 client.18078 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:26:03.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.750+0000 7fab3f377740 20 client.18078 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:03.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.750+0000 7fab3f377740 1 --2- 172.21.15.59:0/1876337605 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562d3e3ef8c0 0x562d3e3f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:03.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.750+0000 7fab3f377740 4 client.18078 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:26:03.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.750+0000 7fab3f377740 1 -- 172.21.15.59:0/1876337605 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d3e34bdf0 con 0x562d3e3ef8c0 2024-09-10T21:26:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.751+0000 7fab3659c640 1 --2- 172.21.15.59:0/1876337605 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562d3e3ef8c0 0x562d3e3f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.751+0000 7fab3659c640 1 --2- 172.21.15.59:0/1876337605 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562d3e3ef8c0 0x562d3e3f1cb0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46bd325bc376b01b server_cookie=3e755d3f1ca53639 in_seq=0 out_seq=0 2024-09-10T21:26:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.751+0000 7fab1dffb640 10 client.18078 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.752+0000 7fab1dffb640 1 -- 172.21.15.59:0/1876337605 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562d3e34bdf0 con 0x562d3e3ef8c0 2024-09-10T21:26:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.752+0000 7fab1dffb640 10 client.18078 handle_command_reply: tid=0 2024-09-10T21:26:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.752+0000 7fab3f377740 1 client.18078 shutdown 2024-09-10T21:26:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.752+0000 7fab3f377740 1 -- 172.21.15.59:0/1876337605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d3df0 msgr2=0x562d3e3dcb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.752+0000 7fab3f377740 1 --2- 172.21.15.59:0/1876337605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d3df0 0x562d3e3dcb00 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fab200a9350 tx=0x7fab200a8840 comp rx=0 tx=0).stop 2024-09-10T21:26:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.752+0000 7fab3f377740 1 -- 172.21.15.59:0/1876337605 shutdown_connections 2024-09-10T21:26:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.752+0000 7fab3f377740 1 --2- 172.21.15.59:0/1876337605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3dfd80 0x562d3e3dd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.752+0000 7fab3f377740 1 --2- 172.21.15.59:0/1876337605 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562d3e3ef8c0 0x562d3e3f1cb0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.752+0000 7fab3f377740 1 --2- 172.21.15.59:0/1876337605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d3df0 0x562d3e3dcb00 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.752+0000 7fab3f377740 1 --2- 172.21.15.59:0/1876337605 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3d34d0 0x562d3e3df6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.752+0000 7fab3f377740 1 -- 172.21.15.59:0/1876337605 >> 172.21.15.59:0/1876337605 conn(0x562d3e3d1300 msgr2=0x562d3e3d6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:03.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.752+0000 7fab1dffb640 0 client.18078 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:03.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.752+0000 7fab3f377740 1 -- 172.21.15.59:0/1876337605 shutdown_connections 2024-09-10T21:26:03.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.752+0000 7fab3f377740 1 -- 172.21.15.59:0/1876337605 wait complete. 2024-09-10T21:26:03.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.752+0000 7fab3f377740 20 client.18078 trim_cache size 0 max 16384 2024-09-10T21:26:03.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab3f377740 1 Processor -- start 2024-09-10T21:26:03.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab3f377740 1 -- start start 2024-09-10T21:26:03.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab3f377740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d34d0 0x562d3e3d0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:03.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab3f377740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3d3df0 0x562d3e3de840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:03.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab3f377740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3dfd80 0x562d3e3ded80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:03.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab3f377740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fab381ae360 con 0x562d3e3d34d0 2024-09-10T21:26:03.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab3f377740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fab381afea0 con 0x562d3e3dfd80 2024-09-10T21:26:03.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab3f377740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fab381aea30 con 0x562d3e3d3df0 2024-09-10T21:26:03.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab3659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d34d0 0x562d3e3d0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:03.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab3659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d34d0 0x562d3e3d0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51302/0 (socket says 172.21.15.59:51302) 2024-09-10T21:26:03.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab3659c640 1 -- 172.21.15.59:0/560543579 learned_addr learned my addr 172.21.15.59:0/560543579 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:03.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab35d9b640 1 --2- 172.21.15.59:0/560543579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3d3df0 0x562d3e3de840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:03.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab36d9d640 1 --2- 172.21.15.59:0/560543579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3dfd80 0x562d3e3ded80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:03.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab3659c640 1 -- 172.21.15.59:0/560543579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3d3df0 msgr2=0x562d3e3de840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:03.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab3659c640 1 --2- 172.21.15.59:0/560543579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3d3df0 0x562d3e3de840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab3659c640 1 -- 172.21.15.59:0/560543579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3dfd80 msgr2=0x562d3e3ded80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:03.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab3659c640 1 --2- 172.21.15.59:0/560543579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3dfd80 0x562d3e3ded80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab3659c640 1 -- 172.21.15.59:0/560543579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d3e3dc8b0 con 0x562d3e3d34d0 2024-09-10T21:26:03.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab35d9b640 1 --2- 172.21.15.59:0/560543579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3d3df0 0x562d3e3de840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:03.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab36d9d640 1 --2- 172.21.15.59:0/560543579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3dfd80 0x562d3e3ded80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:03.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.766+0000 7fab3659c640 1 --2- 172.21.15.59:0/560543579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d34d0 0x562d3e3d0c10 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fab28033000 tx=0x7fab2803c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186124d6c1ef05cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:03.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.767+0000 7fab1ffff640 1 -- 172.21.15.59:0/560543579 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab28035040 con 0x562d3e3d34d0 2024-09-10T21:26:03.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.767+0000 7fab1ffff640 1 -- 172.21.15.59:0/560543579 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab28005500 con 0x562d3e3d34d0 2024-09-10T21:26:03.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.767+0000 7fab1ffff640 1 -- 172.21.15.59:0/560543579 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab28004b80 con 0x562d3e3d34d0 2024-09-10T21:26:03.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.767+0000 7fab3f377740 1 -- 172.21.15.59:0/560543579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d34d0 msgr2=0x562d3e3d0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:03.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.767+0000 7fab3f377740 1 --2- 172.21.15.59:0/560543579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d34d0 0x562d3e3d0c10 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fab28033000 tx=0x7fab2803c000 comp rx=0 tx=0).stop 2024-09-10T21:26:03.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.767+0000 7fab3f377740 1 -- 172.21.15.59:0/560543579 shutdown_connections 2024-09-10T21:26:03.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.767+0000 7fab3f377740 1 --2- 172.21.15.59:0/560543579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3dfd80 0x562d3e3ded80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.767+0000 7fab3f377740 1 --2- 172.21.15.59:0/560543579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3d3df0 0x562d3e3de840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.767+0000 7fab3f377740 1 --2- 172.21.15.59:0/560543579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d34d0 0x562d3e3d0c10 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.767+0000 7fab3f377740 1 -- 172.21.15.59:0/560543579 >> 172.21.15.59:0/560543579 conn(0x562d3e3d1300 msgr2=0x562d3e3de130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:03.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.767+0000 7fab3f377740 1 -- 172.21.15.59:0/560543579 shutdown_connections 2024-09-10T21:26:03.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.767+0000 7fab3f377740 1 -- 172.21.15.59:0/560543579 wait complete. 2024-09-10T21:26:03.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.768+0000 7fab3f377740 1 -- start start 2024-09-10T21:26:03.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.768+0000 7fab3f377740 1 Processor -- start 2024-09-10T21:26:03.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.768+0000 7fab3f377740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3d34d0 0x562d3e3e7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:03.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.768+0000 7fab3f377740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d3df0 0x562d3e3e8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:03.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.768+0000 7fab3f377740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3dfd80 0x562d3e3e2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:03.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.768+0000 7fab3f377740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fab381af7d0 con 0x562d3e3d3df0 2024-09-10T21:26:03.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.768+0000 7fab3f377740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fab381af100 con 0x562d3e3dfd80 2024-09-10T21:26:03.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.768+0000 7fab3f377740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fab381ac340 con 0x562d3e3d34d0 2024-09-10T21:26:03.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.768+0000 7fab3f377740 10 client.0 _ll_register_callbacks cb 0x7fab2000df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:03.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.768+0000 7fab35d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d3df0 0x562d3e3e8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:03.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.768+0000 7fab35d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d3df0 0x562d3e3e8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51316/0 (socket says 172.21.15.59:51316) 2024-09-10T21:26:03.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.768+0000 7fab35d9b640 1 -- 172.21.15.59:0/1844788839 learned_addr learned my addr 172.21.15.59:0/1844788839 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:03.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.768+0000 7fab3659c640 1 --2- 172.21.15.59:0/1844788839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3d34d0 0x562d3e3e7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:03.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.768+0000 7fab36d9d640 1 --2- 172.21.15.59:0/1844788839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3dfd80 0x562d3e3e2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:03.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.769+0000 7fab35d9b640 1 -- 172.21.15.59:0/1844788839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3d34d0 msgr2=0x562d3e3e7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:03.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.769+0000 7fab35d9b640 1 --2- 172.21.15.59:0/1844788839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3d34d0 0x562d3e3e7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.769+0000 7fab35d9b640 1 -- 172.21.15.59:0/1844788839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3dfd80 msgr2=0x562d3e3e2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:03.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.769+0000 7fab35d9b640 1 --2- 172.21.15.59:0/1844788839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3dfd80 0x562d3e3e2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.769+0000 7fab35d9b640 1 -- 172.21.15.59:0/1844788839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d3e3e8a40 con 0x562d3e3d3df0 2024-09-10T21:26:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.769+0000 7fab35d9b640 1 --2- 172.21.15.59:0/1844788839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d3df0 0x562d3e3e8210 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fab200a7e20 tx=0x7fab200ab570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5f5f2a5744f193 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.769+0000 7fab1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.769+0000 7fab1dffb640 1 -- 172.21.15.59:0/1844788839 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab20020070 con 0x562d3e3d3df0 2024-09-10T21:26:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.769+0000 7fab1dffb640 1 -- 172.21.15.59:0/1844788839 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fab20010980 con 0x562d3e3d3df0 2024-09-10T21:26:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.769+0000 7fab3f377740 1 -- 172.21.15.59:0/1844788839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab28005500 con 0x562d3e3d3df0 2024-09-10T21:26:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.769+0000 7fab1dffb640 1 -- 172.21.15.59:0/1844788839 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fab20009de0 con 0x562d3e3d3df0 2024-09-10T21:26:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.769+0000 7fab3f377740 10 client.18084 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.769+0000 7fab3f377740 1 -- 172.21.15.59:0/1844788839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562d3e45ccc0 con 0x562d3e3d3df0 2024-09-10T21:26:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.769+0000 7fab1dffb640 1 -- 172.21.15.59:0/1844788839 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab28005500 con 0x562d3e3d3df0 2024-09-10T21:26:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.769+0000 7fab1dffb640 1 -- 172.21.15.59:0/1844788839 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fab200b1d50 con 0x562d3e3d3df0 2024-09-10T21:26:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.769+0000 7fab3f377740 10 client.18084 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.769+0000 7fab3f377740 10 client.18084 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:26:03.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.769+0000 7fab3f377740 20 client.18084 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.770+0000 7fab3f377740 1 --2- 172.21.15.59:0/1844788839 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562d3e45d360 0x562d3e45f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.770+0000 7fab3f377740 4 client.18084 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:26:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.770+0000 7fab3f377740 1 -- 172.21.15.59:0/1844788839 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562d3e3478a0 con 0x562d3e45d360 2024-09-10T21:26:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.770+0000 7fab3659c640 1 --2- 172.21.15.59:0/1844788839 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562d3e45d360 0x562d3e45f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.770+0000 7fab3659c640 1 --2- 172.21.15.59:0/1844788839 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562d3e45d360 0x562d3e45f780 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90ef7e2172c7fa65 server_cookie=d47087b97dfe9285 in_seq=0 out_seq=0 2024-09-10T21:26:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.770+0000 7fab1dffb640 10 client.18084 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.770+0000 7fab1dffb640 1 -- 172.21.15.59:0/1844788839 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562d3e3478a0 con 0x562d3e45d360 2024-09-10T21:26:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.770+0000 7fab1dffb640 10 client.18084 handle_command_reply: tid=0 2024-09-10T21:26:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.770+0000 7fab3f377740 1 client.18084 shutdown 2024-09-10T21:26:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.770+0000 7fab3f377740 1 -- 172.21.15.59:0/1844788839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d3df0 msgr2=0x562d3e3e8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.770+0000 7fab3f377740 1 --2- 172.21.15.59:0/1844788839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d3df0 0x562d3e3e8210 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fab200a7e20 tx=0x7fab200ab570 comp rx=0 tx=0).stop 2024-09-10T21:26:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.770+0000 7fab3f377740 1 -- 172.21.15.59:0/1844788839 shutdown_connections 2024-09-10T21:26:03.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3f377740 1 --2- 172.21.15.59:0/1844788839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d3e3dfd80 0x562d3e3e2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3f377740 1 --2- 172.21.15.59:0/1844788839 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x562d3e45d360 0x562d3e45f780 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3f377740 1 --2- 172.21.15.59:0/1844788839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562d3e3d3df0 0x562d3e3e8210 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3f377740 1 --2- 172.21.15.59:0/1844788839 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x562d3e3d34d0 0x562d3e3e7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3f377740 1 -- 172.21.15.59:0/1844788839 >> 172.21.15.59:0/1844788839 conn(0x562d3e3d1300 msgr2=0x562d3e3de950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab1dffb640 0 client.18084 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3f377740 1 -- 172.21.15.59:0/1844788839 shutdown_connections 2024-09-10T21:26:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3f377740 1 -- 172.21.15.59:0/1844788839 wait complete. 2024-09-10T21:26:03.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3f377740 20 client.18084 trim_cache size 0 max 16384 2024-09-10T21:26:03.780 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:26:03.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3cfa2640 1 -- 172.21.15.59:0/3270887094 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fab240b52e0 msgr2=0x7fab240b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:03.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3cfa2640 1 --2- 172.21.15.59:0/3270887094 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fab240b52e0 0x7fab240b77a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fab28009230 tx=0x7fab28031400 comp rx=0 tx=0).stop 2024-09-10T21:26:03.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3cfa2640 1 -- 172.21.15.59:0/3270887094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab381087d0 msgr2=0x7fab381998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:03.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3cfa2640 1 --2- 172.21.15.59:0/3270887094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab381087d0 0x7fab381998c0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fab2000d950 tx=0x7fab2000de10 comp rx=0 tx=0).stop 2024-09-10T21:26:03.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3cfa2640 1 -- 172.21.15.59:0/3270887094 shutdown_connections 2024-09-10T21:26:03.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3cfa2640 1 --2- 172.21.15.59:0/3270887094 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fab240b52e0 0x7fab240b77a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3cfa2640 1 --2- 172.21.15.59:0/3270887094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab38109150 0x7fab3819ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3cfa2640 1 --2- 172.21.15.59:0/3270887094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab381087d0 0x7fab381998c0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3cfa2640 1 --2- 172.21.15.59:0/3270887094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab38102dc0 0x7fab38199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:03.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3cfa2640 1 -- 172.21.15.59:0/3270887094 >> 172.21.15.59:0/3270887094 conn(0x7fab380fe870 msgr2=0x7fab38100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:03.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3cfa2640 1 -- 172.21.15.59:0/3270887094 shutdown_connections 2024-09-10T21:26:03.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:03.771+0000 7fab3cfa2640 1 -- 172.21.15.59:0/3270887094 wait complete. 2024-09-10T21:26:05.159 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:04 smithi059 ceph-mon[30888]: pgmap v664: 97 pgs: 97 active+clean; 7.4 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:26:05.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:04 smithi154 ceph-mon[35041]: pgmap v664: 97 pgs: 97 active+clean; 7.4 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:26:05.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:04 smithi192 ceph-mon[35363]: pgmap v664: 97 pgs: 97 active+clean; 7.4 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:26:05.530 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T21:26:05.530 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T21:26:05.807 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:26:06.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.236+0000 7f705c23e640 1 -- 172.21.15.59:0/1709167665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f705410d100 msgr2=0x7f705410f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:06.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.236+0000 7f705c23e640 1 --2- 172.21.15.59:0/1709167665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f705410d100 0x7f705410f560 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f704c009900 tx=0x7f704c02a410 comp rx=0 tx=0).stop 2024-09-10T21:26:06.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.236+0000 7f705c23e640 1 -- 172.21.15.59:0/1709167665 shutdown_connections 2024-09-10T21:26:06.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.236+0000 7f705c23e640 1 --2- 172.21.15.59:0/1709167665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f705410d100 0x7f705410f560 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.236+0000 7f705c23e640 1 --2- 172.21.15.59:0/1709167665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70541045c0 0x7f705410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.236+0000 7f705c23e640 1 --2- 172.21.15.59:0/1709167665 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7054103ca0 0x7f7054104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.236+0000 7f705c23e640 1 -- 172.21.15.59:0/1709167665 >> 172.21.15.59:0/1709167665 conn(0x7f70540fd700 msgr2=0x7f70540ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:06.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.236+0000 7f705c23e640 1 -- 172.21.15.59:0/1709167665 shutdown_connections 2024-09-10T21:26:06.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.236+0000 7f705c23e640 1 -- 172.21.15.59:0/1709167665 wait complete. 2024-09-10T21:26:06.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.237+0000 7f705c23e640 1 Processor -- start 2024-09-10T21:26:06.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.237+0000 7f705c23e640 1 -- start start 2024-09-10T21:26:06.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.237+0000 7f705c23e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7054103ca0 0x7f7054199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:06.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.237+0000 7f705c23e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70541045c0 0x7f7054199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:06.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.237+0000 7f705c23e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f705410d100 0x7f705419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:06.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.237+0000 7f705c23e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7054112dd0 con 0x7f7054103ca0 2024-09-10T21:26:06.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.237+0000 7f705c23e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7054112c50 con 0x7f70541045c0 2024-09-10T21:26:06.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.237+0000 7f705c23e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7054112f50 con 0x7f705410d100 2024-09-10T21:26:06.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.237+0000 7f7059fda640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7054103ca0 0x7f7054199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:06.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.237+0000 7f7059fda640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7054103ca0 0x7f7054199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51330/0 (socket says 172.21.15.59:51330) 2024-09-10T21:26:06.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.237+0000 7f7059fda640 1 -- 172.21.15.59:0/1902668528 learned_addr learned my addr 172.21.15.59:0/1902668528 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:06.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.237+0000 7f705a7db640 1 --2- 172.21.15.59:0/1902668528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f705410d100 0x7f705419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:06.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.237+0000 7f70597d9640 1 --2- 172.21.15.59:0/1902668528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70541045c0 0x7f7054199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:06.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.237+0000 7f7059fda640 1 -- 172.21.15.59:0/1902668528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f705410d100 msgr2=0x7f705419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:06.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.237+0000 7f7059fda640 1 --2- 172.21.15.59:0/1902668528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f705410d100 0x7f705419ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.237+0000 7f7059fda640 1 -- 172.21.15.59:0/1902668528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70541045c0 msgr2=0x7f7054199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:06.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.237+0000 7f7059fda640 1 --2- 172.21.15.59:0/1902668528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70541045c0 0x7f7054199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.237+0000 7f7059fda640 1 -- 172.21.15.59:0/1902668528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f705419f3b0 con 0x7f7054103ca0 2024-09-10T21:26:06.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.238+0000 7f7059fda640 1 --2- 172.21.15.59:0/1902668528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7054103ca0 0x7f7054199300 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f704400ba50 tx=0x7f704400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:06.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.238+0000 7f7052ffd640 1 -- 172.21.15.59:0/1902668528 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7044019070 con 0x7f7054103ca0 2024-09-10T21:26:06.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.238+0000 7f7052ffd640 1 -- 172.21.15.59:0/1902668528 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f704400cbe0 con 0x7f7054103ca0 2024-09-10T21:26:06.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.238+0000 7f705c23e640 1 -- 172.21.15.59:0/1902668528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f705419f6a0 con 0x7f7054103ca0 2024-09-10T21:26:06.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.238+0000 7f7052ffd640 1 -- 172.21.15.59:0/1902668528 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70440075d0 con 0x7f7054103ca0 2024-09-10T21:26:06.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.238+0000 7f705c23e640 1 -- 172.21.15.59:0/1902668528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70541a5de0 con 0x7f7054103ca0 2024-09-10T21:26:06.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.241+0000 7f705e613740 1 Processor -- start 2024-09-10T21:26:06.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.241+0000 7f705e613740 1 -- start start 2024-09-10T21:26:06.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.241+0000 7f7052ffd640 1 -- 172.21.15.59:0/1902668528 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f7044007830 con 0x7f7054103ca0 2024-09-10T21:26:06.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.241+0000 7f705e613740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbbeee0 0x55987bbbf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:06.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.241+0000 7f705e613740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbf800 0x55987bbcf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:06.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.241+0000 7f705e613740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbcfba0 0x55987bbd1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:06.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.241+0000 7f705e613740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55987bb35e60 con 0x55987bbbf800 2024-09-10T21:26:06.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.241+0000 7f705e613740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55987bb25290 con 0x55987bbbeee0 2024-09-10T21:26:06.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.241+0000 7f705e613740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55987bb290a0 con 0x55987bbcfba0 2024-09-10T21:26:06.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.242+0000 7f7059fda640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbf800 0x55987bbcf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:06.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.242+0000 7f7059fda640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbf800 0x55987bbcf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51340/0 (socket says 172.21.15.59:51340) 2024-09-10T21:26:06.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.242+0000 7f7059fda640 1 -- 172.21.15.59:0/2757957197 learned_addr learned my addr 172.21.15.59:0/2757957197 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:06.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.242+0000 7f70597d9640 1 --2- 172.21.15.59:0/2757957197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbcfba0 0x55987bbd1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:06.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.242+0000 7f705a7db640 1 --2- 172.21.15.59:0/2757957197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbbeee0 0x55987bbbf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:06.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.242+0000 7f7059fda640 1 -- 172.21.15.59:0/2757957197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbcfba0 msgr2=0x55987bbd1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:06.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.242+0000 7f7059fda640 1 --2- 172.21.15.59:0/2757957197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbcfba0 0x55987bbd1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.242+0000 7f7059fda640 1 -- 172.21.15.59:0/2757957197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbbeee0 msgr2=0x55987bbbf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:06.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.242+0000 7f7059fda640 1 --2- 172.21.15.59:0/2757957197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbbeee0 0x55987bbbf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.242+0000 7f7059fda640 1 -- 172.21.15.59:0/2757957197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55987b883930 con 0x55987bbbf800 2024-09-10T21:26:06.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.242+0000 7f70597d9640 1 --2- 172.21.15.59:0/2757957197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbcfba0 0x55987bbd1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:06.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.242+0000 7f7059fda640 1 --2- 172.21.15.59:0/2757957197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbf800 0x55987bbcf660 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f70440ed410 tx=0x7f70440ed500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b30513cd5909a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:06.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.242+0000 7f7052ffd640 1 --2- 172.21.15.59:0/1902668528 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f703c0b52e0 0x7f703c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:06.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.242+0000 7f703bfff640 1 -- 172.21.15.59:0/2757957197 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70440a8270 con 0x55987bbbf800 2024-09-10T21:26:06.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.242+0000 7f705a7db640 1 --2- 172.21.15.59:0/1902668528 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f703c0b52e0 0x7f703c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:06.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.243+0000 7f703bfff640 1 -- 172.21.15.59:0/2757957197 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70440a7710 con 0x55987bbbf800 2024-09-10T21:26:06.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.243+0000 7f703bfff640 1 -- 172.21.15.59:0/2757957197 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70440ab390 con 0x55987bbbf800 2024-09-10T21:26:06.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.243+0000 7f7052ffd640 1 -- 172.21.15.59:0/1902668528 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f70440e53e0 con 0x7f7054103ca0 2024-09-10T21:26:06.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.243+0000 7f705e613740 1 -- 172.21.15.59:0/2757957197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbf800 msgr2=0x55987bbcf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:06.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.243+0000 7f705a7db640 1 --2- 172.21.15.59:0/1902668528 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f703c0b52e0 0x7f703c0b77a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f704c006010 tx=0x7f704c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:06.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.243+0000 7f705e613740 1 --2- 172.21.15.59:0/2757957197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbf800 0x55987bbcf660 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f70440ed410 tx=0x7f70440ed500 comp rx=0 tx=0).stop 2024-09-10T21:26:06.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.243+0000 7f705e613740 1 -- 172.21.15.59:0/2757957197 shutdown_connections 2024-09-10T21:26:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.243+0000 7f705e613740 1 --2- 172.21.15.59:0/2757957197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbcfba0 0x55987bbd1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.243+0000 7f705e613740 1 --2- 172.21.15.59:0/2757957197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbf800 0x55987bbcf660 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.243+0000 7f705e613740 1 --2- 172.21.15.59:0/2757957197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbbeee0 0x55987bbbf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.243+0000 7f705e613740 1 -- 172.21.15.59:0/2757957197 >> 172.21.15.59:0/2757957197 conn(0x55987bbbcd10 msgr2=0x55987bbbdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.244+0000 7f705e613740 1 -- 172.21.15.59:0/2757957197 shutdown_connections 2024-09-10T21:26:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.244+0000 7f705e613740 1 -- 172.21.15.59:0/2757957197 wait complete. 2024-09-10T21:26:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.244+0000 7f705e613740 1 -- start start 2024-09-10T21:26:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.244+0000 7f705e613740 1 Processor -- start 2024-09-10T21:26:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.244+0000 7f705e613740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 0x55987bbccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.244+0000 7f705e613740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbbf800 0x55987bbcd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.244+0000 7f705e613740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbcfba0 0x55987bbcd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.244+0000 7f705e613740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55987b986890 con 0x55987bbbeee0 2024-09-10T21:26:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.244+0000 7f705e613740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55987babfd40 con 0x55987bbbf800 2024-09-10T21:26:06.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.244+0000 7f705e613740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55987bbd2850 con 0x55987bbcfba0 2024-09-10T21:26:06.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f705e613740 10 client.0 _ll_register_callbacks cb 0x55987bb23c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:06.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f7059fda640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 0x55987bbccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:06.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f7059fda640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 0x55987bbccad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51356/0 (socket says 172.21.15.59:51356) 2024-09-10T21:26:06.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f7059fda640 1 -- 172.21.15.59:0/2421582424 learned_addr learned my addr 172.21.15.59:0/2421582424 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:06.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f705a7db640 1 --2- 172.21.15.59:0/2421582424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbcfba0 0x55987bbcd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:06.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f70597d9640 1 --2- 172.21.15.59:0/2421582424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbbf800 0x55987bbcd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:06.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f7059fda640 1 -- 172.21.15.59:0/2421582424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbcfba0 msgr2=0x55987bbcd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:06.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f7059fda640 1 --2- 172.21.15.59:0/2421582424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbcfba0 0x55987bbcd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f7059fda640 1 -- 172.21.15.59:0/2421582424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbbf800 msgr2=0x55987bbcd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:06.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f7059fda640 1 --2- 172.21.15.59:0/2421582424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbbf800 0x55987bbcd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f7059fda640 1 -- 172.21.15.59:0/2421582424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55987bbdbbe0 con 0x55987bbbeee0 2024-09-10T21:26:06.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f705a7db640 1 --2- 172.21.15.59:0/2421582424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbcfba0 0x55987bbcd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:06.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f70597d9640 1 --2- 172.21.15.59:0/2421582424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbbf800 0x55987bbcd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:06.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f7059fda640 1 --2- 172.21.15.59:0/2421582424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 0x55987bbccad0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f7044009fd0 tx=0x7f70440e8c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6faa428a6783e54 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:06.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f70397fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:06.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f70397fa640 1 -- 172.21.15.59:0/2421582424 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70440ab570 con 0x55987bbbeee0 2024-09-10T21:26:06.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f70397fa640 1 -- 172.21.15.59:0/2421582424 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f70440abe80 con 0x55987bbbeee0 2024-09-10T21:26:06.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f705e613740 1 -- 172.21.15.59:0/2421582424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70440a7710 con 0x55987bbbeee0 2024-09-10T21:26:06.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f70397fa640 1 -- 172.21.15.59:0/2421582424 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f70440ab760 con 0x55987bbbeee0 2024-09-10T21:26:06.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f705e613740 10 client.18096 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:06.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.245+0000 7f705e613740 1 -- 172.21.15.59:0/2421582424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55987bbde570 con 0x55987bbbeee0 2024-09-10T21:26:06.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.246+0000 7f70397fa640 1 -- 172.21.15.59:0/2421582424 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70440a7710 con 0x55987bbbeee0 2024-09-10T21:26:06.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.246+0000 7f70397fa640 1 -- 172.21.15.59:0/2421582424 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f70440b4c70 con 0x55987bbbeee0 2024-09-10T21:26:06.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.246+0000 7f705e613740 10 client.18096 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:06.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.246+0000 7f705e613740 10 client.18096 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:26:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.246+0000 7f705e613740 20 client.18096 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.246+0000 7f705e613740 1 --2- 172.21.15.59:0/2421582424 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55987bbdf8c0 0x55987bbe1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.246+0000 7f705e613740 4 client.18096 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:26:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.246+0000 7f705e613740 1 -- 172.21.15.59:0/2421582424 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55987bb37db0 con 0x55987bbdf8c0 2024-09-10T21:26:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.246+0000 7f70597d9640 1 --2- 172.21.15.59:0/2421582424 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55987bbdf8c0 0x55987bbe1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.247+0000 7f70597d9640 1 --2- 172.21.15.59:0/2421582424 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55987bbdf8c0 0x55987bbe1cb0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79a50e0a9fe77534 server_cookie=98d2e7fb19aee7db in_seq=0 out_seq=0 2024-09-10T21:26:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.247+0000 7f70397fa640 10 client.18096 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.247+0000 7f70397fa640 1 -- 172.21.15.59:0/2421582424 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55987bb37db0 con 0x55987bbdf8c0 2024-09-10T21:26:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.247+0000 7f70397fa640 10 client.18096 handle_command_reply: tid=0 2024-09-10T21:26:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.247+0000 7f705e613740 1 client.18096 shutdown 2024-09-10T21:26:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.247+0000 7f705e613740 1 -- 172.21.15.59:0/2421582424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 msgr2=0x55987bbccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.247+0000 7f705e613740 1 --2- 172.21.15.59:0/2421582424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 0x55987bbccad0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f7044009fd0 tx=0x7f70440e8c70 comp rx=0 tx=0).stop 2024-09-10T21:26:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.248+0000 7f705e613740 1 -- 172.21.15.59:0/2421582424 shutdown_connections 2024-09-10T21:26:06.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.248+0000 7f705e613740 1 --2- 172.21.15.59:0/2421582424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbcfba0 0x55987bbcd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.248+0000 7f705e613740 1 --2- 172.21.15.59:0/2421582424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbbf800 0x55987bbcd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.248+0000 7f705e613740 1 --2- 172.21.15.59:0/2421582424 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55987bbdf8c0 0x55987bbe1cb0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.248+0000 7f705e613740 1 --2- 172.21.15.59:0/2421582424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 0x55987bbccad0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.248+0000 7f70397fa640 0 client.18096 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:06.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.248+0000 7f705e613740 1 -- 172.21.15.59:0/2421582424 >> 172.21.15.59:0/2421582424 conn(0x55987bbbcd10 msgr2=0x55987bbbbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:06.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.248+0000 7f705e613740 1 -- 172.21.15.59:0/2421582424 shutdown_connections 2024-09-10T21:26:06.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.248+0000 7f705e613740 1 -- 172.21.15.59:0/2421582424 wait complete. 2024-09-10T21:26:06.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.248+0000 7f705e613740 20 client.18096 trim_cache size 0 max 16384 2024-09-10T21:26:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f705e613740 1 Processor -- start 2024-09-10T21:26:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f705e613740 1 -- start start 2024-09-10T21:26:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f705e613740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 0x55987bbca630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f705e613740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbbf800 0x55987bbcc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f705e613740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbcfba0 0x55987bbe4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f705e613740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f70541ac180 con 0x55987bbbeee0 2024-09-10T21:26:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f705e613740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70541adcc0 con 0x55987bbbf800 2024-09-10T21:26:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f705e613740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f70541ac850 con 0x55987bbcfba0 2024-09-10T21:26:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f7059fda640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 0x55987bbca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f7059fda640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 0x55987bbca630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51368/0 (socket says 172.21.15.59:51368) 2024-09-10T21:26:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f7059fda640 1 -- 172.21.15.59:0/448471190 learned_addr learned my addr 172.21.15.59:0/448471190 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f70597d9640 1 --2- 172.21.15.59:0/448471190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbbf800 0x55987bbcc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f705a7db640 1 --2- 172.21.15.59:0/448471190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbcfba0 0x55987bbe4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:06.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f7059fda640 1 -- 172.21.15.59:0/448471190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbcfba0 msgr2=0x55987bbe4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:06.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f7059fda640 1 --2- 172.21.15.59:0/448471190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbcfba0 0x55987bbe4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f7059fda640 1 -- 172.21.15.59:0/448471190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbbf800 msgr2=0x55987bbcc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:06.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f7059fda640 1 --2- 172.21.15.59:0/448471190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbbf800 0x55987bbcc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f7059fda640 1 -- 172.21.15.59:0/448471190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55987bbcafd0 con 0x55987bbbeee0 2024-09-10T21:26:06.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f70597d9640 1 --2- 172.21.15.59:0/448471190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbbf800 0x55987bbcc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:06.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f705a7db640 1 --2- 172.21.15.59:0/448471190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbcfba0 0x55987bbe4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:26:06.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.266+0000 7f7059fda640 1 --2- 172.21.15.59:0/448471190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 0x55987bbca630 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f70440ab920 tx=0x7f70440ed230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88caeb1e60faea2d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:06.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.267+0000 7f703b7fe640 1 -- 172.21.15.59:0/448471190 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70440ab9f0 con 0x55987bbbeee0 2024-09-10T21:26:06.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.267+0000 7f703b7fe640 1 -- 172.21.15.59:0/448471190 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70440a7710 con 0x55987bbbeee0 2024-09-10T21:26:06.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.267+0000 7f703b7fe640 1 -- 172.21.15.59:0/448471190 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70440a7570 con 0x55987bbbeee0 2024-09-10T21:26:06.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.267+0000 7f705e613740 1 -- 172.21.15.59:0/448471190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 msgr2=0x55987bbca630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:06.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.267+0000 7f705e613740 1 --2- 172.21.15.59:0/448471190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 0x55987bbca630 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f70440ab920 tx=0x7f70440ed230 comp rx=0 tx=0).stop 2024-09-10T21:26:06.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.267+0000 7f705e613740 1 -- 172.21.15.59:0/448471190 shutdown_connections 2024-09-10T21:26:06.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.267+0000 7f705e613740 1 --2- 172.21.15.59:0/448471190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbcfba0 0x55987bbe4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.267+0000 7f705e613740 1 --2- 172.21.15.59:0/448471190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbbf800 0x55987bbcc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.267+0000 7f705e613740 1 --2- 172.21.15.59:0/448471190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 0x55987bbca630 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.267+0000 7f705e613740 1 -- 172.21.15.59:0/448471190 >> 172.21.15.59:0/448471190 conn(0x55987bbbcd10 msgr2=0x55987bbce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:06.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.267+0000 7f705e613740 1 -- 172.21.15.59:0/448471190 shutdown_connections 2024-09-10T21:26:06.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.267+0000 7f705e613740 1 -- 172.21.15.59:0/448471190 wait complete. 2024-09-10T21:26:06.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.268+0000 7f705e613740 1 -- start start 2024-09-10T21:26:06.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.268+0000 7f705e613740 1 Processor -- start 2024-09-10T21:26:06.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.268+0000 7f705e613740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 0x55987bbe5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:06.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.268+0000 7f705e613740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbbf800 0x55987bbe3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:06.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.268+0000 7f705e613740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbcfba0 0x55987bbe40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:06.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.268+0000 7f705e613740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f70541ad5f0 con 0x55987bbbeee0 2024-09-10T21:26:06.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.268+0000 7f705e613740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70541acf20 con 0x55987bbcfba0 2024-09-10T21:26:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.268+0000 7f705e613740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f70541aa180 con 0x55987bbbf800 2024-09-10T21:26:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.268+0000 7f705e613740 10 client.0 _ll_register_callbacks cb 0x7f704c005d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.268+0000 7f7059fda640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 0x55987bbe5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.268+0000 7f7059fda640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 0x55987bbe5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51380/0 (socket says 172.21.15.59:51380) 2024-09-10T21:26:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.268+0000 7f7059fda640 1 -- 172.21.15.59:0/3133364924 learned_addr learned my addr 172.21.15.59:0/3133364924 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.268+0000 7f70597d9640 1 --2- 172.21.15.59:0/3133364924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbbf800 0x55987bbe3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.269+0000 7f705a7db640 1 --2- 172.21.15.59:0/3133364924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbcfba0 0x55987bbe40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.269+0000 7f7059fda640 1 -- 172.21.15.59:0/3133364924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbbf800 msgr2=0x55987bbe3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.269+0000 7f7059fda640 1 --2- 172.21.15.59:0/3133364924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbbf800 0x55987bbe3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.269+0000 7f7059fda640 1 -- 172.21.15.59:0/3133364924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbcfba0 msgr2=0x55987bbe40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.269+0000 7f7059fda640 1 --2- 172.21.15.59:0/3133364924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbcfba0 0x55987bbe40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.269+0000 7f7059fda640 1 -- 172.21.15.59:0/3133364924 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55987bbe48f0 con 0x55987bbbeee0 2024-09-10T21:26:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.269+0000 7f7059fda640 1 --2- 172.21.15.59:0/3133364924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 0x55987bbe5560 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f7044000f80 tx=0x7f7044009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43825d4fb96ff353 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.269+0000 7f70397fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.269+0000 7f70397fa640 1 -- 172.21.15.59:0/3133364924 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70440a78f0 con 0x55987bbbeee0 2024-09-10T21:26:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.269+0000 7f70397fa640 1 -- 172.21.15.59:0/3133364924 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f70440ac080 con 0x55987bbbeee0 2024-09-10T21:26:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.269+0000 7f705e613740 1 -- 172.21.15.59:0/3133364924 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70440a7710 con 0x55987bbbeee0 2024-09-10T21:26:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.269+0000 7f70397fa640 1 -- 172.21.15.59:0/3133364924 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f70440a7ac0 con 0x55987bbbeee0 2024-09-10T21:26:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.269+0000 7f705e613740 10 client.18102 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.269+0000 7f705e613740 1 -- 172.21.15.59:0/3133364924 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55987bbe48f0 con 0x55987bbbeee0 2024-09-10T21:26:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.269+0000 7f70397fa640 1 -- 172.21.15.59:0/3133364924 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70440a7710 con 0x55987bbbeee0 2024-09-10T21:26:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.270+0000 7f70397fa640 1 -- 172.21.15.59:0/3133364924 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f70440b0190 con 0x55987bbbeee0 2024-09-10T21:26:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.270+0000 7f705e613740 10 client.18102 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.270+0000 7f705e613740 10 client.18102 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:26:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.270+0000 7f705e613740 20 client.18102 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.270+0000 7f705e613740 1 --2- 172.21.15.59:0/3133364924 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55987bc4d7d0 0x55987bc4fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.270+0000 7f705e613740 4 client.18102 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T21:26:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.270+0000 7f705e613740 1 -- 172.21.15.59:0/3133364924 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55987bb33860 con 0x55987bc4d7d0 2024-09-10T21:26:06.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.270+0000 7f70597d9640 1 --2- 172.21.15.59:0/3133364924 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55987bc4d7d0 0x55987bc4fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:06.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.270+0000 7f70597d9640 1 --2- 172.21.15.59:0/3133364924 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55987bc4d7d0 0x55987bc4fbc0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79ead436e87b4233 server_cookie=790c9e9cf2d1f4cb in_seq=0 out_seq=0 2024-09-10T21:26:06.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.270+0000 7f70397fa640 10 client.18102 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:06.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.272+0000 7f70397fa640 1 -- 172.21.15.59:0/3133364924 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55987bb33860 con 0x55987bc4d7d0 2024-09-10T21:26:06.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.272+0000 7f70397fa640 10 client.18102 handle_command_reply: tid=0 2024-09-10T21:26:06.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.272+0000 7f705e613740 1 client.18102 shutdown 2024-09-10T21:26:06.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.272+0000 7f705e613740 1 -- 172.21.15.59:0/3133364924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 msgr2=0x55987bbe5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:06.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.272+0000 7f705e613740 1 --2- 172.21.15.59:0/3133364924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 0x55987bbe5560 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f7044000f80 tx=0x7f7044009930 comp rx=0 tx=0).stop 2024-09-10T21:26:06.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.272+0000 7f705e613740 1 -- 172.21.15.59:0/3133364924 shutdown_connections 2024-09-10T21:26:06.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.272+0000 7f705e613740 1 --2- 172.21.15.59:0/3133364924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55987bbcfba0 0x55987bbe40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.272+0000 7f705e613740 1 --2- 172.21.15.59:0/3133364924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55987bbbf800 0x55987bbe3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.272+0000 7f705e613740 1 --2- 172.21.15.59:0/3133364924 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55987bc4d7d0 0x55987bc4fbc0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.272+0000 7f705e613740 1 --2- 172.21.15.59:0/3133364924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55987bbbeee0 0x55987bbe5560 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.272+0000 7f70397fa640 0 client.18102 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:06.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.272+0000 7f705e613740 1 -- 172.21.15.59:0/3133364924 >> 172.21.15.59:0/3133364924 conn(0x55987bbbcd10 msgr2=0x55987bbce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:06.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.272+0000 7f705e613740 1 -- 172.21.15.59:0/3133364924 shutdown_connections 2024-09-10T21:26:06.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.273+0000 7f705e613740 1 -- 172.21.15.59:0/3133364924 wait complete. 2024-09-10T21:26:06.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.273+0000 7f705e613740 20 client.18102 trim_cache size 0 max 16384 2024-09-10T21:26:06.282 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:26:06.282 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-09-10T21:26:06.282 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "664d252a-6d50-486a-95fb-89d9928b6edb", 2024-09-10T21:26:06.282 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-09-10T21:26:06.282 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:26:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.273+0000 7f705c23e640 1 -- 172.21.15.59:0/1902668528 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f703c0b52e0 msgr2=0x7f703c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.273+0000 7f705c23e640 1 --2- 172.21.15.59:0/1902668528 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f703c0b52e0 0x7f703c0b77a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f704c006010 tx=0x7f704c0058d0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.273+0000 7f705c23e640 1 -- 172.21.15.59:0/1902668528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7054103ca0 msgr2=0x7f7054199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.273+0000 7f705c23e640 1 --2- 172.21.15.59:0/1902668528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7054103ca0 0x7f7054199300 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f704400ba50 tx=0x7f704400bf10 comp rx=0 tx=0).stop 2024-09-10T21:26:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.273+0000 7f705c23e640 1 -- 172.21.15.59:0/1902668528 shutdown_connections 2024-09-10T21:26:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.273+0000 7f705c23e640 1 --2- 172.21.15.59:0/1902668528 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f703c0b52e0 0x7f703c0b77a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.273+0000 7f705c23e640 1 --2- 172.21.15.59:0/1902668528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f705410d100 0x7f705419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.273+0000 7f705c23e640 1 --2- 172.21.15.59:0/1902668528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70541045c0 0x7f7054199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.273+0000 7f705c23e640 1 --2- 172.21.15.59:0/1902668528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7054103ca0 0x7f7054199300 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.273+0000 7f705c23e640 1 -- 172.21.15.59:0/1902668528 >> 172.21.15.59:0/1902668528 conn(0x7f70540fd700 msgr2=0x7f70540fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.273+0000 7f705c23e640 1 -- 172.21.15.59:0/1902668528 shutdown_connections 2024-09-10T21:26:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:06.273+0000 7f705c23e640 1 -- 172.21.15.59:0/1902668528 wait complete. 2024-09-10T21:26:06.964 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:26:07.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:06 smithi059 ceph-mon[30888]: pgmap v665: 97 pgs: 97 active+clean; 7.4 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-10T21:26:07.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:06 smithi059 ceph-mon[30888]: scrub queued for path: / 2024-09-10T21:26:07.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:06 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:26:07.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:06 smithi059 ceph-mon[30888]: scrub summary: active paths [/] 2024-09-10T21:26:07.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:06 smithi059 ceph-mon[30888]: scrub summary: idle+waiting paths [/] 2024-09-10T21:26:07.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:06 smithi154 ceph-mon[35041]: pgmap v665: 97 pgs: 97 active+clean; 7.4 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-10T21:26:07.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:06 smithi154 ceph-mon[35041]: scrub queued for path: / 2024-09-10T21:26:07.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:06 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:26:07.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:06 smithi154 ceph-mon[35041]: scrub summary: active paths [/] 2024-09-10T21:26:07.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:06 smithi154 ceph-mon[35041]: scrub summary: idle+waiting paths [/] 2024-09-10T21:26:07.227 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:26:07.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:06 smithi192 ceph-mon[35363]: pgmap v665: 97 pgs: 97 active+clean; 7.4 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-10T21:26:07.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:06 smithi192 ceph-mon[35363]: scrub queued for path: / 2024-09-10T21:26:07.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:06 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:26:07.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:06 smithi192 ceph-mon[35363]: scrub summary: active paths [/] 2024-09-10T21:26:07.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:06 smithi192 ceph-mon[35363]: scrub summary: idle+waiting paths [/] 2024-09-10T21:26:07.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.684+0000 7f4fcd913640 1 -- 172.21.15.59:0/4086353104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fc8102de0 msgr2=0x7f4fc81031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:07.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.684+0000 7f4fcd913640 1 --2- 172.21.15.59:0/4086353104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fc8102de0 0x7f4fc81031c0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009900 tx=0x7f4fb802a410 comp rx=0 tx=0).stop 2024-09-10T21:26:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.684+0000 7f4fcd913640 1 -- 172.21.15.59:0/4086353104 shutdown_connections 2024-09-10T21:26:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.684+0000 7f4fcd913640 1 --2- 172.21.15.59:0/4086353104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fc8109170 0x7f4fc810f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.684+0000 7f4fcd913640 1 --2- 172.21.15.59:0/4086353104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fc81087f0 0x7f4fc8108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.684+0000 7f4fcd913640 1 --2- 172.21.15.59:0/4086353104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fc8102de0 0x7f4fc81031c0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.684+0000 7f4fcd913640 1 -- 172.21.15.59:0/4086353104 >> 172.21.15.59:0/4086353104 conn(0x7f4fc80fe830 msgr2=0x7f4fc8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.684+0000 7f4fcd913640 1 -- 172.21.15.59:0/4086353104 shutdown_connections 2024-09-10T21:26:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.684+0000 7f4fcd913640 1 -- 172.21.15.59:0/4086353104 wait complete. 2024-09-10T21:26:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.685+0000 7f4fcd913640 1 Processor -- start 2024-09-10T21:26:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.685+0000 7f4fcd913640 1 -- start start 2024-09-10T21:26:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.685+0000 7f4fcd913640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fc8102de0 0x7f4fc81992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.685+0000 7f4fcd913640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fc81087f0 0x7f4fc8199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.685+0000 7f4fcd913640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fc8109170 0x7f4fc819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.685+0000 7f4fcd913640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc8112e30 con 0x7f4fc81087f0 2024-09-10T21:26:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.685+0000 7f4fcd913640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc8112cb0 con 0x7f4fc8102de0 2024-09-10T21:26:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.685+0000 7f4fcd913640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc8112fb0 con 0x7f4fc8109170 2024-09-10T21:26:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.685+0000 7f4fc67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fc81087f0 0x7f4fc8199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.685+0000 7f4fc67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fc81087f0 0x7f4fc8199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51398/0 (socket says 172.21.15.59:51398) 2024-09-10T21:26:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.685+0000 7f4fc67fc640 1 -- 172.21.15.59:0/3566774851 learned_addr learned my addr 172.21.15.59:0/3566774851 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.685+0000 7f4fc77fe640 1 --2- 172.21.15.59:0/3566774851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fc8109170 0x7f4fc819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.686+0000 7f4fc6ffd640 1 --2- 172.21.15.59:0/3566774851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fc8102de0 0x7f4fc81992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:07.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.686+0000 7f4fc67fc640 1 -- 172.21.15.59:0/3566774851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fc8109170 msgr2=0x7f4fc819eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:07.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.686+0000 7f4fc67fc640 1 --2- 172.21.15.59:0/3566774851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fc8109170 0x7f4fc819eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.686+0000 7f4fc67fc640 1 -- 172.21.15.59:0/3566774851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fc8102de0 msgr2=0x7f4fc81992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:07.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.686+0000 7f4fc67fc640 1 --2- 172.21.15.59:0/3566774851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fc8102de0 0x7f4fc81992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.686+0000 7f4fc67fc640 1 -- 172.21.15.59:0/3566774851 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc819f370 con 0x7f4fc81087f0 2024-09-10T21:26:07.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.686+0000 7f4fc6ffd640 1 --2- 172.21.15.59:0/3566774851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fc8102de0 0x7f4fc81992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:26:07.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.686+0000 7f4fc67fc640 1 --2- 172.21.15.59:0/3566774851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fc81087f0 0x7f4fc8199800 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00d770 tx=0x7f4fbc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:07.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.686+0000 7f4fcc911640 1 -- 172.21.15.59:0/3566774851 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc017070 con 0x7f4fc81087f0 2024-09-10T21:26:07.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.686+0000 7f4fcd913640 1 -- 172.21.15.59:0/3566774851 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc819f660 con 0x7f4fc81087f0 2024-09-10T21:26:07.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.686+0000 7f4fcc911640 1 -- 172.21.15.59:0/3566774851 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fbc0054d0 con 0x7f4fc81087f0 2024-09-10T21:26:07.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.686+0000 7f4fcc911640 1 -- 172.21.15.59:0/3566774851 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc004c30 con 0x7f4fc81087f0 2024-09-10T21:26:07.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.686+0000 7f4fcd913640 1 -- 172.21.15.59:0/3566774851 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc81a5d20 con 0x7f4fc81087f0 2024-09-10T21:26:07.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.689+0000 7f4fcfce8740 1 Processor -- start 2024-09-10T21:26:07.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.689+0000 7f4fcfce8740 1 -- start start 2024-09-10T21:26:07.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.689+0000 7f4fcc911640 1 -- 172.21.15.59:0/3566774851 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f4fbc004e10 con 0x7f4fc81087f0 2024-09-10T21:26:07.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.689+0000 7f4fcfce8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6e9480 0x5591ca6e9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:07.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.689+0000 7f4fcfce8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6e9da0 0x5591ca6f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:07.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.689+0000 7f4fcfce8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6f5d30 0x5591ca6f8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:07.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.689+0000 7f4fcfce8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5591ca65fe50 con 0x5591ca6e9480 2024-09-10T21:26:07.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.689+0000 7f4fcfce8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5591ca64f280 con 0x5591ca6f5d30 2024-09-10T21:26:07.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.689+0000 7f4fcfce8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5591ca653090 con 0x5591ca6e9da0 2024-09-10T21:26:07.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.689+0000 7f4fc77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6e9480 0x5591ca6e9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:07.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.689+0000 7f4fc77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6e9480 0x5591ca6e9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51412/0 (socket says 172.21.15.59:51412) 2024-09-10T21:26:07.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.689+0000 7f4fc77fe640 1 -- 172.21.15.59:0/156344280 learned_addr learned my addr 172.21.15.59:0/156344280 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:07.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.690+0000 7f4fc6ffd640 1 --2- 172.21.15.59:0/156344280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6e9da0 0x5591ca6f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:07.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.690+0000 7f4fc77fe640 1 -- 172.21.15.59:0/156344280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6e9da0 msgr2=0x5591ca6f57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:07.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.690+0000 7f4fc77fe640 1 --2- 172.21.15.59:0/156344280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6e9da0 0x5591ca6f57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.690+0000 7f4fc77fe640 1 -- 172.21.15.59:0/156344280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6f5d30 msgr2=0x5591ca6f8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:07.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.690+0000 7f4fc67fc640 1 --2- 172.21.15.59:0/156344280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6f5d30 0x5591ca6f8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:07.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.690+0000 7f4fc77fe640 1 --2- 172.21.15.59:0/156344280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6f5d30 0x5591ca6f8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.690+0000 7f4fc77fe640 1 -- 172.21.15.59:0/156344280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591ca3ad650 con 0x5591ca6e9480 2024-09-10T21:26:07.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.690+0000 7f4fc67fc640 1 --2- 172.21.15.59:0/156344280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6f5d30 0x5591ca6f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:26:07.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.690+0000 7f4fc77fe640 1 --2- 172.21.15.59:0/156344280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6e9480 0x5591ca6e9860 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009fd0 tx=0x7f4fc00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caed5e94a006b511 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:07.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.690+0000 7f4fadffb640 1 -- 172.21.15.59:0/156344280 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0004d20 con 0x5591ca6e9480 2024-09-10T21:26:07.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.690+0000 7f4fadffb640 1 -- 172.21.15.59:0/156344280 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fc0004050 con 0x5591ca6e9480 2024-09-10T21:26:07.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.690+0000 7f4fadffb640 1 -- 172.21.15.59:0/156344280 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0005280 con 0x5591ca6e9480 2024-09-10T21:26:07.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.690+0000 7f4fcc911640 1 --2- 172.21.15.59:0/3566774851 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4fb00b52e0 0x7f4fb00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:07.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.690+0000 7f4fc6ffd640 1 --2- 172.21.15.59:0/3566774851 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4fb00b52e0 0x7f4fb00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:07.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.690+0000 7f4fcc911640 1 -- 172.21.15.59:0/3566774851 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4fbc0e56a0 con 0x7f4fc81087f0 2024-09-10T21:26:07.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.691+0000 7f4fcfce8740 1 -- 172.21.15.59:0/156344280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6e9480 msgr2=0x5591ca6e9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:07.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.691+0000 7f4fc6ffd640 1 --2- 172.21.15.59:0/3566774851 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4fb00b52e0 0x7f4fb00b77a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8005ab0 tx=0x7f4fb8032ce0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:07.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.691+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/156344280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6e9480 0x5591ca6e9860 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009fd0 tx=0x7f4fc00118d0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.691+0000 7f4fcfce8740 1 -- 172.21.15.59:0/156344280 shutdown_connections 2024-09-10T21:26:07.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.691+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/156344280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6f5d30 0x5591ca6f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.691+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/156344280 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6e9da0 0x5591ca6f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.691+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/156344280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6e9480 0x5591ca6e9860 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.691+0000 7f4fcfce8740 1 -- 172.21.15.59:0/156344280 >> 172.21.15.59:0/156344280 conn(0x5591ca6e72b0 msgr2=0x5591ca6e8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:07.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.691+0000 7f4fcfce8740 1 -- 172.21.15.59:0/156344280 shutdown_connections 2024-09-10T21:26:07.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.691+0000 7f4fcfce8740 1 -- 172.21.15.59:0/156344280 wait complete. 2024-09-10T21:26:07.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.691+0000 7f4fcfce8740 1 -- start start 2024-09-10T21:26:07.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.692+0000 7f4fcfce8740 1 Processor -- start 2024-09-10T21:26:07.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.692+0000 7f4fcfce8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6e9480 0x5591ca6f5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:07.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.692+0000 7f4fcfce8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6e9da0 0x5591ca6f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:07.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.692+0000 7f4fcfce8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6f5d30 0x5591ca6f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:07.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.692+0000 7f4fcfce8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5591ca4b0700 con 0x5591ca6e9480 2024-09-10T21:26:07.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.692+0000 7f4fcfce8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5591ca5ea110 con 0x5591ca6e9da0 2024-09-10T21:26:07.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.692+0000 7f4fcfce8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5591ca6f89b0 con 0x5591ca6f5d30 2024-09-10T21:26:07.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.692+0000 7f4fcfce8740 10 client.0 _ll_register_callbacks cb 0x5591ca603990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:07.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.692+0000 7f4fc6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6e9480 0x5591ca6f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:07.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.692+0000 7f4fc6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6e9480 0x5591ca6f5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51418/0 (socket says 172.21.15.59:51418) 2024-09-10T21:26:07.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.692+0000 7f4fc6ffd640 1 -- 172.21.15.59:0/3187458399 learned_addr learned my addr 172.21.15.59:0/3187458399 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:07.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.692+0000 7f4fc67fc640 1 --2- 172.21.15.59:0/3187458399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6e9da0 0x5591ca6f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:07.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.692+0000 7f4fc6ffd640 1 -- 172.21.15.59:0/3187458399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6f5d30 msgr2=0x5591ca6f2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:07.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.692+0000 7f4fc6ffd640 1 --2- 172.21.15.59:0/3187458399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6f5d30 0x5591ca6f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.692+0000 7f4fc6ffd640 1 -- 172.21.15.59:0/3187458399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6e9da0 msgr2=0x5591ca6f29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:07.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.692+0000 7f4fc6ffd640 1 --2- 172.21.15.59:0/3187458399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6e9da0 0x5591ca6f29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.692+0000 7f4fc6ffd640 1 -- 172.21.15.59:0/3187458399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591ca617c40 con 0x5591ca6e9480 2024-09-10T21:26:07.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.693+0000 7f4fc6ffd640 1 --2- 172.21.15.59:0/3187458399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6e9480 0x5591ca6f5560 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8033000 tx=0x7f4fb802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b4e9652fbbd5bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:07.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.693+0000 7f4fa6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:07.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.693+0000 7f4fa6ffd640 1 -- 172.21.15.59:0/3187458399 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8035050 con 0x5591ca6e9480 2024-09-10T21:26:07.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.693+0000 7f4fcfce8740 1 -- 172.21.15.59:0/3187458399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fc0004050 con 0x5591ca6e9480 2024-09-10T21:26:07.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.693+0000 7f4fa6ffd640 1 -- 172.21.15.59:0/3187458399 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4fb8004450 con 0x5591ca6e9480 2024-09-10T21:26:07.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.693+0000 7f4fa6ffd640 1 -- 172.21.15.59:0/3187458399 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4fb8031920 con 0x5591ca6e9480 2024-09-10T21:26:07.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.693+0000 7f4fcfce8740 10 client.18114 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:07.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.693+0000 7f4fcfce8740 1 -- 172.21.15.59:0/3187458399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5591ca704210 con 0x5591ca6e9480 2024-09-10T21:26:07.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.694+0000 7f4fa6ffd640 1 -- 172.21.15.59:0/3187458399 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fc0004050 con 0x5591ca6e9480 2024-09-10T21:26:07.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.694+0000 7f4fa6ffd640 1 -- 172.21.15.59:0/3187458399 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4fb8004ce0 con 0x5591ca6e9480 2024-09-10T21:26:07.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.694+0000 7f4fcfce8740 10 client.18114 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:07.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.694+0000 7f4fcfce8740 10 client.18114 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:26:07.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.694+0000 7f4fcfce8740 20 client.18114 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:07.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.694+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/3187458399 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5591ca705670 0x5591ca707af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:07.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.694+0000 7f4fcfce8740 4 client.18114 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:26:07.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.694+0000 7f4fcfce8740 1 -- 172.21.15.59:0/3187458399 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591ca661da0 con 0x5591ca705670 2024-09-10T21:26:07.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.694+0000 7f4fc67fc640 1 --2- 172.21.15.59:0/3187458399 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5591ca705670 0x5591ca707af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:07.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.695+0000 7f4fa6ffd640 10 client.18114 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:07.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.695+0000 7f4fc67fc640 1 --2- 172.21.15.59:0/3187458399 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5591ca705670 0x5591ca707af0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b14af1f29987d82 server_cookie=e5c149a5d292b825 in_seq=0 out_seq=0 2024-09-10T21:26:07.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.696+0000 7f4fa6ffd640 1 -- 172.21.15.59:0/3187458399 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f4fbc085e50 con 0x5591ca705670 2024-09-10T21:26:07.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.696+0000 7f4fa6ffd640 10 client.18114 handle_command_reply: tid=0 2024-09-10T21:26:07.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.696+0000 7f4fcfce8740 1 client.18114 shutdown 2024-09-10T21:26:07.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.696+0000 7f4fcfce8740 1 -- 172.21.15.59:0/3187458399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6e9480 msgr2=0x5591ca6f5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:07.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.696+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/3187458399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6e9480 0x5591ca6f5560 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8033000 tx=0x7f4fb802a410 comp rx=0 tx=0).stop 2024-09-10T21:26:07.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.696+0000 7f4fcfce8740 1 -- 172.21.15.59:0/3187458399 shutdown_connections 2024-09-10T21:26:07.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.696+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/3187458399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6f5d30 0x5591ca6f2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.696+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/3187458399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6e9da0 0x5591ca6f29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.696+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/3187458399 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5591ca705670 0x5591ca707af0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.696+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/3187458399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6e9480 0x5591ca6f5560 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.696+0000 7f4fcfce8740 1 -- 172.21.15.59:0/3187458399 >> 172.21.15.59:0/3187458399 conn(0x5591ca6e72b0 msgr2=0x5591ca6ece20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:07.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.696+0000 7f4fa6ffd640 0 client.18114 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:07.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.696+0000 7f4fcfce8740 1 -- 172.21.15.59:0/3187458399 shutdown_connections 2024-09-10T21:26:07.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.696+0000 7f4fcfce8740 1 -- 172.21.15.59:0/3187458399 wait complete. 2024-09-10T21:26:07.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.696+0000 7f4fcfce8740 20 client.18114 trim_cache size 0 max 16384 2024-09-10T21:26:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.714+0000 7f4fcfce8740 1 Processor -- start 2024-09-10T21:26:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.714+0000 7f4fcfce8740 1 -- start start 2024-09-10T21:26:07.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.714+0000 7f4fcfce8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6e9480 0x5591ca6e8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:07.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.714+0000 7f4fcfce8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6e9da0 0x5591ca6efbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.714+0000 7f4fcfce8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6f5d30 0x5591ca6f0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.714+0000 7f4fcfce8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81ac120 con 0x5591ca6f5d30 2024-09-10T21:26:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.714+0000 7f4fcfce8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81adc60 con 0x5591ca6e9da0 2024-09-10T21:26:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.714+0000 7f4fcfce8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81ac7f0 con 0x5591ca6e9480 2024-09-10T21:26:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.714+0000 7f4fc77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6f5d30 0x5591ca6f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.714+0000 7f4fc77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6f5d30 0x5591ca6f0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51422/0 (socket says 172.21.15.59:51422) 2024-09-10T21:26:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.714+0000 7f4fc77fe640 1 -- 172.21.15.59:0/2728211602 learned_addr learned my addr 172.21.15.59:0/2728211602 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.715+0000 7f4fc77fe640 1 -- 172.21.15.59:0/2728211602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6e9480 msgr2=0x5591ca6e8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.715+0000 7f4fc6ffd640 1 --2- 172.21.15.59:0/2728211602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6e9480 0x5591ca6e8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.715+0000 7f4fc67fc640 1 --2- 172.21.15.59:0/2728211602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6e9da0 0x5591ca6efbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.715+0000 7f4fc77fe640 1 --2- 172.21.15.59:0/2728211602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6e9480 0x5591ca6e8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.715+0000 7f4fc77fe640 1 -- 172.21.15.59:0/2728211602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6e9da0 msgr2=0x5591ca6efbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.715+0000 7f4fc77fe640 1 --2- 172.21.15.59:0/2728211602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6e9da0 0x5591ca6efbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.715+0000 7f4fc77fe640 1 -- 172.21.15.59:0/2728211602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591ca6f58d0 con 0x5591ca6f5d30 2024-09-10T21:26:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.715+0000 7f4fc77fe640 1 --2- 172.21.15.59:0/2728211602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6f5d30 0x5591ca6f0100 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f4fc001b040 tx=0x7f4fc0009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a086996d4772701 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.715+0000 7f4fad7fa640 1 -- 172.21.15.59:0/2728211602 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0003ab0 con 0x5591ca6f5d30 2024-09-10T21:26:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.715+0000 7f4fad7fa640 1 -- 172.21.15.59:0/2728211602 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fc0003c50 con 0x5591ca6f5d30 2024-09-10T21:26:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.715+0000 7f4fad7fa640 1 -- 172.21.15.59:0/2728211602 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc000f850 con 0x5591ca6f5d30 2024-09-10T21:26:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.716+0000 7f4fcfce8740 1 -- 172.21.15.59:0/2728211602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6f5d30 msgr2=0x5591ca6f0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.716+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/2728211602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6f5d30 0x5591ca6f0100 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f4fc001b040 tx=0x7f4fc0009c90 comp rx=0 tx=0).stop 2024-09-10T21:26:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.716+0000 7f4fcfce8740 1 -- 172.21.15.59:0/2728211602 shutdown_connections 2024-09-10T21:26:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.716+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/2728211602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6f5d30 0x5591ca6f0100 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.716+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/2728211602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6e9da0 0x5591ca6efbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.716+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/2728211602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6e9480 0x5591ca6e8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.716+0000 7f4fcfce8740 1 -- 172.21.15.59:0/2728211602 >> 172.21.15.59:0/2728211602 conn(0x5591ca6e72b0 msgr2=0x5591ca6e8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:07.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.716+0000 7f4fcfce8740 1 -- 172.21.15.59:0/2728211602 shutdown_connections 2024-09-10T21:26:07.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.716+0000 7f4fcfce8740 1 -- 172.21.15.59:0/2728211602 wait complete. 2024-09-10T21:26:07.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.716+0000 7f4fcfce8740 1 -- start start 2024-09-10T21:26:07.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.716+0000 7f4fcfce8740 1 Processor -- start 2024-09-10T21:26:07.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fcfce8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6e9480 0x5591ca6f9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:07.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fcfce8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6e9da0 0x5591ca6fa520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:07.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fcfce8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6f5d30 0x5591ca7715c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:07.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fcfce8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81ad590 con 0x5591ca6f5d30 2024-09-10T21:26:07.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fcfce8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81acec0 con 0x5591ca6e9480 2024-09-10T21:26:07.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fcfce8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81aa100 con 0x5591ca6e9da0 2024-09-10T21:26:07.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fcfce8740 10 client.0 _ll_register_callbacks cb 0x7f4fc00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:07.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fc77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6f5d30 0x5591ca7715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:07.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fc77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6f5d30 0x5591ca7715c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51430/0 (socket says 172.21.15.59:51430) 2024-09-10T21:26:07.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fc77fe640 1 -- 172.21.15.59:0/4224021418 learned_addr learned my addr 172.21.15.59:0/4224021418 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:07.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fc6ffd640 1 --2- 172.21.15.59:0/4224021418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6e9480 0x5591ca6f9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:07.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fc67fc640 1 --2- 172.21.15.59:0/4224021418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6e9da0 0x5591ca6fa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:07.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fc77fe640 1 -- 172.21.15.59:0/4224021418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6e9da0 msgr2=0x5591ca6fa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:07.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fc77fe640 1 --2- 172.21.15.59:0/4224021418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6e9da0 0x5591ca6fa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fc77fe640 1 -- 172.21.15.59:0/4224021418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6e9480 msgr2=0x5591ca6f9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:07.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fc77fe640 1 --2- 172.21.15.59:0/4224021418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6e9480 0x5591ca6f9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fc77fe640 1 -- 172.21.15.59:0/4224021418 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591ca771b00 con 0x5591ca6f5d30 2024-09-10T21:26:07.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fc67fc640 1 --2- 172.21.15.59:0/4224021418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6e9da0 0x5591ca6fa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:07.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fc77fe640 1 --2- 172.21.15.59:0/4224021418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6f5d30 0x5591ca7715c0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0005980 tx=0x7f4fc00057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60114e60a01db42e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:07.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.717+0000 7f4fa6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:07.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.718+0000 7f4fa6ffd640 1 -- 172.21.15.59:0/4224021418 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0031070 con 0x5591ca6f5d30 2024-09-10T21:26:07.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.718+0000 7f4fa6ffd640 1 -- 172.21.15.59:0/4224021418 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f4fc000f6f0 con 0x5591ca6f5d30 2024-09-10T21:26:07.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.718+0000 7f4fcfce8740 1 -- 172.21.15.59:0/4224021418 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fc0003c50 con 0x5591ca6f5d30 2024-09-10T21:26:07.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.718+0000 7f4fa6ffd640 1 -- 172.21.15.59:0/4224021418 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4fc003d050 con 0x5591ca6f5d30 2024-09-10T21:26:07.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.718+0000 7f4fcfce8740 10 client.18120 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:07.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.718+0000 7f4fcfce8740 1 -- 172.21.15.59:0/4224021418 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5591ca772d20 con 0x5591ca6f5d30 2024-09-10T21:26:07.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.718+0000 7f4fa6ffd640 1 -- 172.21.15.59:0/4224021418 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fc0003c50 con 0x5591ca6f5d30 2024-09-10T21:26:07.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.718+0000 7f4fa6ffd640 1 -- 172.21.15.59:0/4224021418 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4fc00197d0 con 0x5591ca6f5d30 2024-09-10T21:26:07.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.718+0000 7f4fcfce8740 10 client.18120 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:07.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.718+0000 7f4fcfce8740 10 client.18120 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:26:07.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.718+0000 7f4fcfce8740 20 client.18120 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:07.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.718+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/4224021418 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5591ca7731c0 0x5591ca7755e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:07.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.718+0000 7f4fcfce8740 4 client.18120 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:26:07.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.718+0000 7f4fcfce8740 1 -- 172.21.15.59:0/4224021418 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5591ca65d850 con 0x5591ca7731c0 2024-09-10T21:26:07.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.718+0000 7f4fc6ffd640 1 --2- 172.21.15.59:0/4224021418 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5591ca7731c0 0x5591ca7755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:07.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.719+0000 7f4fc6ffd640 1 --2- 172.21.15.59:0/4224021418 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5591ca7731c0 0x5591ca7755e0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c9273843373975b server_cookie=964fd2d64bf91b3b in_seq=0 out_seq=0 2024-09-10T21:26:07.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.719+0000 7f4fa6ffd640 10 client.18120 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:07.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.719+0000 7f4fa6ffd640 1 -- 172.21.15.59:0/4224021418 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5966 (crc 0 0 0) 0x5591ca65d850 con 0x5591ca7731c0 2024-09-10T21:26:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.719+0000 7f4fa6ffd640 10 client.18120 handle_command_reply: tid=0 2024-09-10T21:26:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.719+0000 7f4fcfce8740 1 client.18120 shutdown 2024-09-10T21:26:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.719+0000 7f4fcfce8740 1 -- 172.21.15.59:0/4224021418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6f5d30 msgr2=0x5591ca7715c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.719+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/4224021418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6f5d30 0x5591ca7715c0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0005980 tx=0x7f4fc00057d0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.719+0000 7f4fcfce8740 1 -- 172.21.15.59:0/4224021418 shutdown_connections 2024-09-10T21:26:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.719+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/4224021418 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x5591ca7731c0 0x5591ca7755e0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.719+0000 7f4fa6ffd640 0 client.18120 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.719+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/4224021418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5591ca6f5d30 0x5591ca7715c0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.719+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/4224021418 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5591ca6e9da0 0x5591ca6fa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.719+0000 7f4fcfce8740 1 --2- 172.21.15.59:0/4224021418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591ca6e9480 0x5591ca6f9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.719+0000 7f4fcfce8740 1 -- 172.21.15.59:0/4224021418 >> 172.21.15.59:0/4224021418 conn(0x5591ca6e72b0 msgr2=0x5591ca6e5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.720+0000 7f4fcfce8740 1 -- 172.21.15.59:0/4224021418 shutdown_connections 2024-09-10T21:26:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.720+0000 7f4fcfce8740 1 -- 172.21.15.59:0/4224021418 wait complete. 2024-09-10T21:26:07.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.720+0000 7f4fcfce8740 20 client.18120 trim_cache size 0 max 16384 2024-09-10T21:26:07.728 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:26:07.728 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T21:26:07.728 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-09-10T21:26:07.728 INFO:teuthology.orchestra.run.smithi059.stdout: "664d252a-6d50-486a-95fb-89d9928b6edb": { 2024-09-10T21:26:07.728 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.728 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "664d252a-6d50-486a-95fb-89d9928b6edb", 2024-09-10T21:26:07.728 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,force" 2024-09-10T21:26:07.728 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:07.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.729 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:26:07.729 INFO:teuthology.orchestra.run.smithi059.stdout: "664d252a-6d50-486a-95fb-89d9928b6edb": { 2024-09-10T21:26:07.729 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:26:06.272557+0000", 2024-09-10T21:26:07.729 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.729 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.729 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.729 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.729 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.729 INFO:teuthology.orchestra.run.smithi059.stdout: "c1d7b6a9-2cd5-4680-80e3-076ef527cd5d": { 2024-09-10T21:26:07.729 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:25:52.833923+0000", 2024-09-10T21:26:07.729 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.730 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.730 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.730 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.730 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.730 INFO:teuthology.orchestra.run.smithi059.stdout: "5e9056fa-94a3-4be5-a66c-5033a946ad88": { 2024-09-10T21:26:07.730 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:25:07.346164+0000", 2024-09-10T21:26:07.730 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.730 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.730 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.730 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.730 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.730 INFO:teuthology.orchestra.run.smithi059.stdout: "3ac3cde1-bbc5-4c68-9fc6-bc3e3022aea8": { 2024-09-10T21:26:07.731 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:24:53.320547+0000", 2024-09-10T21:26:07.731 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.731 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.731 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.731 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.731 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.731 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.731 INFO:teuthology.orchestra.run.smithi059.stdout: "0fb476f2-3572-4daf-8d42-5cf40259db46": { 2024-09-10T21:26:07.731 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:53.136187+0000", 2024-09-10T21:26:07.731 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.731 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.731 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.731 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.731 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.732 INFO:teuthology.orchestra.run.smithi059.stdout: "cb01ac69-57ce-4c62-b57a-054abf74df29": { 2024-09-10T21:26:07.732 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:07.589420+0000", 2024-09-10T21:26:07.732 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.732 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.732 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.732 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.732 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.732 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:26:07.732 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:26:07.732 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.732 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.732 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.733 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.733 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.733 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:26:07.733 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:26:07.733 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.733 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.733 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.733 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.733 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.733 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:26:07.733 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:07.066301+0000", 2024-09-10T21:26:07.734 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.734 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.734 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.734 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.734 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.734 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:26:07.734 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:26:07.734 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.734 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.734 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.734 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.734 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.734 INFO:teuthology.orchestra.run.smithi059.stdout: "7de1e6cf-02c2-41f2-b957-563f88bae8ef": { 2024-09-10T21:26:07.735 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:22:22.098651+0000", 2024-09-10T21:26:07.735 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.735 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.735 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.735 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.735 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.735 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:26:07.735 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:26:07.735 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.735 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.735 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.735 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.735 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.736 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:26:07.736 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:26:07.736 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.736 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.736 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.736 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.736 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.736 INFO:teuthology.orchestra.run.smithi059.stdout: "ec2c29bb-febd-4190-959f-09af3764b7ad": { 2024-09-10T21:26:07.736 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:24:07.378801+0000", 2024-09-10T21:26:07.736 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.736 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.736 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.737 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.737 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.737 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:26:07.737 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:26:07.737 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.737 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.737 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.737 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.737 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.737 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.737 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:26:07.737 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:26:07.738 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.738 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.738 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.738 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.738 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.738 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:26:07.738 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:26:07.738 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.738 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.738 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.738 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.738 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.739 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:26:07.739 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:26:07.739 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.739 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.739 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.739 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.739 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.739 INFO:teuthology.orchestra.run.smithi059.stdout: "800cdb00-6a99-4c42-8a9e-4b1c599c6af0": { 2024-09-10T21:26:07.739 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:52.224081+0000", 2024-09-10T21:26:07.739 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.739 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.739 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.739 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.740 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:07.740 INFO:teuthology.orchestra.run.smithi059.stdout: "d82f24b1-930e-4f83-a379-3084f22918d0": { 2024-09-10T21:26:07.740 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:21:37.203865+0000", 2024-09-10T21:26:07.740 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:07.740 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:07.740 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:07.740 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:07.740 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:07.740 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:07.740 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:07.740 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:26:07.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.720+0000 7f4fcd913640 1 -- 172.21.15.59:0/3566774851 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4fb00b52e0 msgr2=0x7f4fb00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:07.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.720+0000 7f4fcd913640 1 --2- 172.21.15.59:0/3566774851 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4fb00b52e0 0x7f4fb00b77a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8005ab0 tx=0x7f4fb8032ce0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.720+0000 7f4fcd913640 1 -- 172.21.15.59:0/3566774851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fc81087f0 msgr2=0x7f4fc8199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:07.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.720+0000 7f4fcd913640 1 --2- 172.21.15.59:0/3566774851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fc81087f0 0x7f4fc8199800 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00d770 tx=0x7f4fbc00dc30 comp rx=0 tx=0).stop 2024-09-10T21:26:07.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.720+0000 7f4fcd913640 1 -- 172.21.15.59:0/3566774851 shutdown_connections 2024-09-10T21:26:07.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.720+0000 7f4fcd913640 1 --2- 172.21.15.59:0/3566774851 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f4fb00b52e0 0x7f4fb00b77a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.720+0000 7f4fcd913640 1 --2- 172.21.15.59:0/3566774851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4fc8109170 0x7f4fc819eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.720+0000 7f4fcd913640 1 --2- 172.21.15.59:0/3566774851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4fc81087f0 0x7f4fc8199800 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.720+0000 7f4fcd913640 1 --2- 172.21.15.59:0/3566774851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4fc8102de0 0x7f4fc81992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:07.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.720+0000 7f4fcd913640 1 -- 172.21.15.59:0/3566774851 >> 172.21.15.59:0/3566774851 conn(0x7f4fc80fe830 msgr2=0x7f4fc8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:07.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.720+0000 7f4fcd913640 1 -- 172.21.15.59:0/3566774851 shutdown_connections 2024-09-10T21:26:07.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:07.720+0000 7f4fcd913640 1 -- 172.21.15.59:0/3566774851 wait complete. 2024-09-10T21:26:08.423 INFO:tasks.cephfs.filesystem:scrub status for tag:664d252a-6d50-486a-95fb-89d9928b6edb - {'path': '/', 'tag': '664d252a-6d50-486a-95fb-89d9928b6edb', 'options': 'recursive,force'} 2024-09-10T21:26:09.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:08 smithi059 ceph-mon[30888]: pgmap v666: 97 pgs: 97 active+clean; 7.4 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:26:09.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:08 smithi154 ceph-mon[35041]: pgmap v666: 97 pgs: 97 active+clean; 7.4 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:26:09.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:08 smithi192 ceph-mon[35363]: pgmap v666: 97 pgs: 97 active+clean; 7.4 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 15 op/s 2024-09-10T21:26:10.159 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:09 smithi059 ceph-mon[30888]: scrub summary: idle 2024-09-10T21:26:10.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:09 smithi154 ceph-mon[35041]: scrub summary: idle 2024-09-10T21:26:10.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:09 smithi192 ceph-mon[35363]: scrub summary: idle 2024-09-10T21:26:11.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:10 smithi059 ceph-mon[30888]: pgmap v667: 97 pgs: 97 active+clean; 7.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:26:11.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:10 smithi154 ceph-mon[35041]: pgmap v667: 97 pgs: 97 active+clean; 7.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:26:11.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:10 smithi192 ceph-mon[35363]: pgmap v667: 97 pgs: 97 active+clean; 7.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:26:13.159 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:12 smithi059 ceph-mon[30888]: pgmap v668: 97 pgs: 97 active+clean; 7.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:26:13.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:12 smithi154 ceph-mon[35041]: pgmap v668: 97 pgs: 97 active+clean; 7.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:26:13.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:12 smithi192 ceph-mon[35363]: pgmap v668: 97 pgs: 97 active+clean; 7.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:26:15.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:14 smithi154 ceph-mon[35041]: pgmap v669: 97 pgs: 97 active+clean; 7.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:26:15.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:14 smithi192 ceph-mon[35363]: pgmap v669: 97 pgs: 97 active+clean; 7.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:26:15.409 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:14 smithi059 ceph-mon[30888]: pgmap v669: 97 pgs: 97 active+clean; 7.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 18 op/s 2024-09-10T21:26:17.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:16 smithi154 ceph-mon[35041]: pgmap v670: 97 pgs: 97 active+clean; 7.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:26:17.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:16 smithi192 ceph-mon[35363]: pgmap v670: 97 pgs: 97 active+clean; 7.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:26:17.409 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:16 smithi059 ceph-mon[30888]: pgmap v670: 97 pgs: 97 active+clean; 7.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-10T21:26:19.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:18 smithi154 ceph-mon[35041]: pgmap v671: 97 pgs: 97 active+clean; 7.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:26:19.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:18 smithi192 ceph-mon[35363]: pgmap v671: 97 pgs: 97 active+clean; 7.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:26:19.409 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:18 smithi059 ceph-mon[30888]: pgmap v671: 97 pgs: 97 active+clean; 7.5 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:26:20.147 INFO:tasks.workunit.client.0.smithi059.stdout:561/600: open fd = 3 2024-09-10T21:26:20.148 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.148 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.148 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.148 INFO:tasks.workunit.client.0.smithi059.stdout:562/600: open fd = 3 2024-09-10T21:26:20.148 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.148 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.148 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.148 INFO:tasks.workunit.client.0.smithi059.stdout:563/600: open fd = 3 2024-09-10T21:26:20.148 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.148 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.148 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.148 INFO:tasks.workunit.client.0.smithi059.stdout:564/600: open fd = 3 2024-09-10T21:26:20.149 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.149 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.149 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.149 INFO:tasks.workunit.client.0.smithi059.stdout:565/600: open fd = 3 2024-09-10T21:26:20.149 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.149 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.149 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.149 INFO:tasks.workunit.client.0.smithi059.stdout:566/600: open fd = 3 2024-09-10T21:26:20.149 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.149 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.149 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.149 INFO:tasks.workunit.client.0.smithi059.stdout:567/600: open fd = 3 2024-09-10T21:26:20.149 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.149 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.150 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.150 INFO:tasks.workunit.client.0.smithi059.stdout:568/600: open fd = 3 2024-09-10T21:26:20.150 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.150 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.150 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.150 INFO:tasks.workunit.client.0.smithi059.stdout:569/600: open fd = 3 2024-09-10T21:26:20.150 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.150 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.150 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.150 INFO:tasks.workunit.client.0.smithi059.stdout:570/600: open fd = 3 2024-09-10T21:26:20.150 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.150 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.150 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.151 INFO:tasks.workunit.client.0.smithi059.stdout:571/600: open fd = 3 2024-09-10T21:26:20.151 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.151 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.151 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.151 INFO:tasks.workunit.client.0.smithi059.stdout:572/600: open fd = 3 2024-09-10T21:26:20.151 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.151 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.151 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.151 INFO:tasks.workunit.client.0.smithi059.stdout:573/600: open fd = 3 2024-09-10T21:26:20.151 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.151 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.151 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.151 INFO:tasks.workunit.client.0.smithi059.stdout:574/600: open fd = 3 2024-09-10T21:26:20.151 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.151 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.152 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.152 INFO:tasks.workunit.client.0.smithi059.stdout:575/600: open fd = 3 2024-09-10T21:26:20.152 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.152 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.152 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.152 INFO:tasks.workunit.client.0.smithi059.stdout:576/600: open fd = 3 2024-09-10T21:26:20.152 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.152 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.152 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.152 INFO:tasks.workunit.client.0.smithi059.stdout:577/600: open fd = 3 2024-09-10T21:26:20.152 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.152 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.152 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.152 INFO:tasks.workunit.client.0.smithi059.stdout:578/600: open fd = 3 2024-09-10T21:26:20.153 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.153 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.153 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.153 INFO:tasks.workunit.client.0.smithi059.stdout:579/600: open fd = 3 2024-09-10T21:26:20.153 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.153 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.153 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.153 INFO:tasks.workunit.client.0.smithi059.stdout:580/600: open fd = 3 2024-09-10T21:26:20.153 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.153 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.153 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.153 INFO:tasks.workunit.client.0.smithi059.stdout:581/600: open fd = 3 2024-09-10T21:26:20.153 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.153 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.154 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.154 INFO:tasks.workunit.client.0.smithi059.stdout:582/600: open fd = 3 2024-09-10T21:26:20.154 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.154 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.154 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.154 INFO:tasks.workunit.client.0.smithi059.stdout:583/600: open fd = 3 2024-09-10T21:26:20.154 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.154 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.154 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.154 INFO:tasks.workunit.client.0.smithi059.stdout:584/600: open fd = 3 2024-09-10T21:26:20.154 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.154 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.154 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.154 INFO:tasks.workunit.client.0.smithi059.stdout:585/600: open fd = 3 2024-09-10T21:26:20.155 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.155 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.155 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.155 INFO:tasks.workunit.client.0.smithi059.stdout:586/600: open fd = 3 2024-09-10T21:26:20.155 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.155 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.155 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.155 INFO:tasks.workunit.client.0.smithi059.stdout:587/600: open fd = 3 2024-09-10T21:26:20.155 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.155 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.155 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.155 INFO:tasks.workunit.client.0.smithi059.stdout:588/600: open fd = 3 2024-09-10T21:26:20.155 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.155 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.155 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.156 INFO:tasks.workunit.client.0.smithi059.stdout:589/600: open fd = 3 2024-09-10T21:26:20.156 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.156 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.156 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.156 INFO:tasks.workunit.client.0.smithi059.stdout:590/600: open fd = 3 2024-09-10T21:26:20.156 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.156 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.156 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.156 INFO:tasks.workunit.client.0.smithi059.stdout:591/600: open fd = 3 2024-09-10T21:26:20.156 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.156 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.156 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.156 INFO:tasks.workunit.client.0.smithi059.stdout:592/600: open fd = 3 2024-09-10T21:26:20.156 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.157 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.157 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.157 INFO:tasks.workunit.client.0.smithi059.stdout:593/600: open fd = 3 2024-09-10T21:26:20.157 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.157 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.157 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.157 INFO:tasks.workunit.client.0.smithi059.stdout:594/600: open fd = 3 2024-09-10T21:26:20.157 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.157 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.157 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.157 INFO:tasks.workunit.client.0.smithi059.stdout:595/600: open fd = 3 2024-09-10T21:26:20.157 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.157 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.157 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.158 INFO:tasks.workunit.client.0.smithi059.stdout:596/600: open fd = 3 2024-09-10T21:26:20.158 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.158 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.158 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.158 INFO:tasks.workunit.client.0.smithi059.stdout:597/600: open fd = 3 2024-09-10T21:26:20.158 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.158 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.158 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.158 INFO:tasks.workunit.client.0.smithi059.stdout:598/600: open fd = 3 2024-09-10T21:26:20.158 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.158 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.158 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.158 INFO:tasks.workunit.client.0.smithi059.stdout:599/600: open fd = 3 2024-09-10T21:26:20.158 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.158 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.159 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.159 INFO:tasks.workunit.client.0.smithi059.stdout:600/600: open fd = 3 2024-09-10T21:26:20.159 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.159 INFO:tasks.workunit.client.0.smithi059.stdout:write ret = 32 2024-09-10T21:26:20.159 INFO:tasks.workunit.client.0.smithi059.stdout:pread ret = 64 2024-09-10T21:26:20.159 INFO:tasks.workunit.client.0.smithi059.stderr:+ echo OK 2024-09-10T21:26:20.160 INFO:tasks.workunit.client.0.smithi059.stdout:OK 2024-09-10T21:26:20.160 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T21:26:20.161 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T21:26:20.205 INFO:tasks.workunit:Stopping ['fs/test_o_trunc.sh'] on client.0... 2024-09-10T21:26:20.205 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T21:26:20.561 DEBUG:teuthology.parallel:result is None 2024-09-10T21:26:20.561 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T21:26:20.599 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T21:26:20.599 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-10T21:26:20.611 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-10T21:26:21.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:20 smithi154 ceph-mon[35041]: pgmap v672: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:26:21.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:20 smithi192 ceph-mon[35363]: pgmap v672: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:26:21.409 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:20 smithi059 ceph-mon[30888]: pgmap v672: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 18 op/s 2024-09-10T21:26:23.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:22 smithi154 ceph-mon[35041]: pgmap v673: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:26:23.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:22 smithi192 ceph-mon[35363]: pgmap v673: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:26:23.409 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:22 smithi059 ceph-mon[30888]: pgmap v673: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 14 op/s 2024-09-10T21:26:25.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:24 smithi154 ceph-mon[35041]: pgmap v674: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-10T21:26:25.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:24 smithi192 ceph-mon[35363]: pgmap v674: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-10T21:26:25.409 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:24 smithi059 ceph-mon[30888]: pgmap v674: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-10T21:26:27.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:26 smithi154 ceph-mon[35041]: pgmap v675: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 KiB/s wr, 12 op/s 2024-09-10T21:26:27.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:26 smithi192 ceph-mon[35363]: pgmap v675: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 KiB/s wr, 12 op/s 2024-09-10T21:26:27.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:26 smithi059 ceph-mon[30888]: pgmap v675: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 KiB/s wr, 12 op/s 2024-09-10T21:26:29.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:28 smithi192 ceph-mon[35363]: pgmap v676: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.8 KiB/s wr, 14 op/s 2024-09-10T21:26:29.409 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:28 smithi059 ceph-mon[30888]: pgmap v676: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.8 KiB/s wr, 14 op/s 2024-09-10T21:26:29.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:28 smithi154 ceph-mon[35041]: pgmap v676: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.8 KiB/s wr, 14 op/s 2024-09-10T21:26:31.233 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:30 smithi154 ceph-mon[35041]: pgmap v677: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:26:31.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:30 smithi192 ceph-mon[35363]: pgmap v677: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:26:31.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:30 smithi059 ceph-mon[30888]: pgmap v677: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-10T21:26:33.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:32 smithi192 ceph-mon[35363]: pgmap v678: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.5 KiB/s wr, 12 op/s 2024-09-10T21:26:33.409 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:32 smithi059 ceph-mon[30888]: pgmap v678: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.5 KiB/s wr, 12 op/s 2024-09-10T21:26:33.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:32 smithi154 ceph-mon[35041]: pgmap v678: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.5 KiB/s wr, 12 op/s 2024-09-10T21:26:35.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:34 smithi192 ceph-mon[35363]: pgmap v679: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-09-10T21:26:35.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:26:35.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:26:35.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:26:35.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:26:35.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:34 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:26:35.409 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:34 smithi059 ceph-mon[30888]: pgmap v679: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-09-10T21:26:35.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:26:35.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:26:35.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:26:35.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:26:35.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:34 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:26:35.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:34 smithi154 ceph-mon[35041]: pgmap v679: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-09-10T21:26:35.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T21:26:35.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:26:35.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:26:35.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:26:35.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:34 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:26:36.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:35 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:26:36.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:35 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:26:36.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:35 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:26:36.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:35 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:26:36.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:35 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:26:36.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:35 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:26:36.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:35 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T21:26:36.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:35 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T21:26:36.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:35 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' 2024-09-10T21:26:37.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:37 smithi059 ceph-mon[30888]: pgmap v680: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-10T21:26:37.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:37 smithi154 ceph-mon[35041]: pgmap v680: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-10T21:26:37.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:37 smithi192 ceph-mon[35363]: pgmap v680: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-10T21:26:38.424 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T21:26:38.699 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:26:39.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.281+0000 7fe0be280640 1 -- 172.21.15.59:0/1909895096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b8108060 msgr2=0x7fe0b810e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:39.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.281+0000 7fe0be280640 1 --2- 172.21.15.59:0/1909895096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b8108060 0x7fe0b810e860 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0009ca0 tx=0x7fe0b002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.281+0000 7fe0be280640 1 -- 172.21.15.59:0/1909895096 shutdown_connections 2024-09-10T21:26:39.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.281+0000 7fe0be280640 1 --2- 172.21.15.59:0/1909895096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b8108060 0x7fe0b810e860 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.281+0000 7fe0be280640 1 --2- 172.21.15.59:0/1909895096 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b81076e0 0x7fe0b8107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.281+0000 7fe0be280640 1 --2- 172.21.15.59:0/1909895096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0b8101cd0 0x7fe0b81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.281+0000 7fe0be280640 1 -- 172.21.15.59:0/1909895096 >> 172.21.15.59:0/1909895096 conn(0x7fe0b80fd700 msgr2=0x7fe0b80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:39.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.281+0000 7fe0be280640 1 -- 172.21.15.59:0/1909895096 shutdown_connections 2024-09-10T21:26:39.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.281+0000 7fe0be280640 1 -- 172.21.15.59:0/1909895096 wait complete. 2024-09-10T21:26:39.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.282+0000 7fe0be280640 1 Processor -- start 2024-09-10T21:26:39.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.282+0000 7fe0be280640 1 -- start start 2024-09-10T21:26:39.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.282+0000 7fe0be280640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0b8101cd0 0x7fe0b8199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.282+0000 7fe0be280640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b81076e0 0x7fe0b8199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.282+0000 7fe0be280640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b8108060 0x7fe0b819eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.282+0000 7fe0be280640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b8112e00 con 0x7fe0b81076e0 2024-09-10T21:26:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.282+0000 7fe0be280640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b8112c80 con 0x7fe0b8108060 2024-09-10T21:26:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.282+0000 7fe0be280640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b8112f80 con 0x7fe0b8101cd0 2024-09-10T21:26:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.282+0000 7fe0affff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b81076e0 0x7fe0b8199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.283+0000 7fe0affff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b81076e0 0x7fe0b8199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39544/0 (socket says 172.21.15.59:39544) 2024-09-10T21:26:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.283+0000 7fe0affff640 1 -- 172.21.15.59:0/3851124104 learned_addr learned my addr 172.21.15.59:0/3851124104 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.283+0000 7fe0b7fff640 1 --2- 172.21.15.59:0/3851124104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0b8101cd0 0x7fe0b8199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.283+0000 7fe0bc81d640 1 --2- 172.21.15.59:0/3851124104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b8108060 0x7fe0b819eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.283+0000 7fe0affff640 1 -- 172.21.15.59:0/3851124104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0b8101cd0 msgr2=0x7fe0b8199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.283+0000 7fe0affff640 1 --2- 172.21.15.59:0/3851124104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0b8101cd0 0x7fe0b8199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.283+0000 7fe0affff640 1 -- 172.21.15.59:0/3851124104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b8108060 msgr2=0x7fe0b819eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:39.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.283+0000 7fe0affff640 1 --2- 172.21.15.59:0/3851124104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b8108060 0x7fe0b819eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.283+0000 7fe0affff640 1 -- 172.21.15.59:0/3851124104 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b819f2e0 con 0x7fe0b81076e0 2024-09-10T21:26:39.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.283+0000 7fe0b7fff640 1 --2- 172.21.15.59:0/3851124104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0b8101cd0 0x7fe0b8199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:26:39.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.283+0000 7fe0affff640 1 --2- 172.21.15.59:0/3851124104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b81076e0 0x7fe0b8199770 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000c890 tx=0x7fe0a000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:39.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.283+0000 7fe0b5ffb640 1 -- 172.21.15.59:0/3851124104 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0004220 con 0x7fe0b81076e0 2024-09-10T21:26:39.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.283+0000 7fe0b5ffb640 1 -- 172.21.15.59:0/3851124104 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0a00043c0 con 0x7fe0b81076e0 2024-09-10T21:26:39.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.283+0000 7fe0be280640 1 -- 172.21.15.59:0/3851124104 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b819f5d0 con 0x7fe0b81076e0 2024-09-10T21:26:39.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.283+0000 7fe0b5ffb640 1 -- 172.21.15.59:0/3851124104 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0004a00 con 0x7fe0b81076e0 2024-09-10T21:26:39.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.284+0000 7fe0be280640 1 -- 172.21.15.59:0/3851124104 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b81a5e60 con 0x7fe0b81076e0 2024-09-10T21:26:39.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.286+0000 7fe0b5ffb640 1 -- 172.21.15.59:0/3851124104 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fe0a00079b0 con 0x7fe0b81076e0 2024-09-10T21:26:39.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.286+0000 7fe0c0655740 1 Processor -- start 2024-09-10T21:26:39.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.286+0000 7fe0c0655740 1 -- start start 2024-09-10T21:26:39.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.286+0000 7fe0c0655740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e97050a0 0x55d0e9705480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:39.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.286+0000 7fe0c0655740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e97059c0 0x55d0e9715820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:39.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.287+0000 7fe0c0655740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e9715d60 0x55d0e9718150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:39.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.287+0000 7fe0c0655740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d0e967be50 con 0x55d0e9715d60 2024-09-10T21:26:39.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.287+0000 7fe0c0655740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d0e966b280 con 0x55d0e97059c0 2024-09-10T21:26:39.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.287+0000 7fe0c0655740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d0e966f090 con 0x55d0e97050a0 2024-09-10T21:26:39.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.287+0000 7fe0affff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e9715d60 0x55d0e9718150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:39.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.287+0000 7fe0bc81d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e97050a0 0x55d0e9705480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:39.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.287+0000 7fe0affff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e9715d60 0x55d0e9718150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39558/0 (socket says 172.21.15.59:39558) 2024-09-10T21:26:39.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.287+0000 7fe0affff640 1 -- 172.21.15.59:0/818405888 learned_addr learned my addr 172.21.15.59:0/818405888 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:39.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.287+0000 7fe0bc81d640 1 --2- 172.21.15.59:0/818405888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e97050a0 0x55d0e9705480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.59:45434/0 (socket says 172.21.15.59:45434) 2024-09-10T21:26:39.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.287+0000 7fe0b7fff640 1 --2- 172.21.15.59:0/818405888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e97059c0 0x55d0e9715820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:39.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.287+0000 7fe0affff640 1 -- 172.21.15.59:0/818405888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e97050a0 msgr2=0x55d0e9705480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:39.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.287+0000 7fe0affff640 1 --2- 172.21.15.59:0/818405888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e97050a0 0x55d0e9705480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.287+0000 7fe0affff640 1 -- 172.21.15.59:0/818405888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e97059c0 msgr2=0x55d0e9715820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:39.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.287+0000 7fe0affff640 1 --2- 172.21.15.59:0/818405888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e97059c0 0x55d0e9715820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.287+0000 7fe0affff640 1 -- 172.21.15.59:0/818405888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0e93c9650 con 0x55d0e9715d60 2024-09-10T21:26:39.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.287+0000 7fe0bc81d640 1 --2- 172.21.15.59:0/818405888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e97050a0 0x55d0e9705480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:26:39.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.287+0000 7fe0b5ffb640 1 --2- 172.21.15.59:0/3851124104 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe0a40b5360 0x7fe0a40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:39.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.287+0000 7fe0bc81d640 1 --2- 172.21.15.59:0/3851124104 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe0a40b5360 0x7fe0a40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:39.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.287+0000 7fe0affff640 1 --2- 172.21.15.59:0/818405888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e9715d60 0x55d0e9718150 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00ebc50 tx=0x7fe0a00ed670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313f147383b3b9b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:39.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.288+0000 7fe0b5ffb640 1 -- 172.21.15.59:0/3851124104 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe0a00e5770 con 0x7fe0b81076e0 2024-09-10T21:26:39.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.288+0000 7fe0ae7fc640 1 -- 172.21.15.59:0/818405888 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a001d020 con 0x55d0e9715d60 2024-09-10T21:26:39.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.288+0000 7fe0ae7fc640 1 -- 172.21.15.59:0/818405888 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0a00aba10 con 0x55d0e9715d60 2024-09-10T21:26:39.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.288+0000 7fe0ae7fc640 1 -- 172.21.15.59:0/818405888 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a00a8550 con 0x55d0e9715d60 2024-09-10T21:26:39.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.288+0000 7fe0c0655740 1 -- 172.21.15.59:0/818405888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e9715d60 msgr2=0x55d0e9718150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:39.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.288+0000 7fe0bc81d640 1 --2- 172.21.15.59:0/3851124104 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe0a40b5360 0x7fe0a40b7820 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00098d0 tx=0x7fe0b002f450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:39.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.288+0000 7fe0c0655740 1 --2- 172.21.15.59:0/818405888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e9715d60 0x55d0e9718150 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00ebc50 tx=0x7fe0a00ed670 comp rx=0 tx=0).stop 2024-09-10T21:26:39.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.289+0000 7fe0c0655740 1 -- 172.21.15.59:0/818405888 shutdown_connections 2024-09-10T21:26:39.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.289+0000 7fe0c0655740 1 --2- 172.21.15.59:0/818405888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e9715d60 0x55d0e9718150 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.289+0000 7fe0c0655740 1 --2- 172.21.15.59:0/818405888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e97059c0 0x55d0e9715820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.289+0000 7fe0c0655740 1 --2- 172.21.15.59:0/818405888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e97050a0 0x55d0e9705480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.289+0000 7fe0c0655740 1 -- 172.21.15.59:0/818405888 >> 172.21.15.59:0/818405888 conn(0x55d0e9702ed0 msgr2=0x55d0e9704070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:39.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.289+0000 7fe0c0655740 1 -- 172.21.15.59:0/818405888 shutdown_connections 2024-09-10T21:26:39.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.289+0000 7fe0c0655740 1 -- 172.21.15.59:0/818405888 wait complete. 2024-09-10T21:26:39.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.289+0000 7fe0c0655740 1 -- start start 2024-09-10T21:26:39.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.289+0000 7fe0c0655740 1 Processor -- start 2024-09-10T21:26:39.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.289+0000 7fe0c0655740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e97050a0 0x55d0e9715660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:39.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.289+0000 7fe0c0655740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e97059c0 0x55d0e9712ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:39.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.289+0000 7fe0c0655740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e9715d60 0x55d0e97130c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:39.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0c0655740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d0e94cc700 con 0x55d0e9715d60 2024-09-10T21:26:39.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0c0655740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d0e9606110 con 0x55d0e97059c0 2024-09-10T21:26:39.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0c0655740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55d0e9718a10 con 0x55d0e97050a0 2024-09-10T21:26:39.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0c0655740 10 client.0 _ll_register_callbacks cb 0x55d0e961f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:39.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0bc81d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e9715d60 0x55d0e97130c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:39.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0bc81d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e9715d60 0x55d0e97130c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39562/0 (socket says 172.21.15.59:39562) 2024-09-10T21:26:39.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0bc81d640 1 -- 172.21.15.59:0/905671842 learned_addr learned my addr 172.21.15.59:0/905671842 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:39.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0b7fff640 1 --2- 172.21.15.59:0/905671842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e97050a0 0x55d0e9715660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:39.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0affff640 1 --2- 172.21.15.59:0/905671842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e97059c0 0x55d0e9712ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:39.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0bc81d640 1 -- 172.21.15.59:0/905671842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e97050a0 msgr2=0x55d0e9715660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:39.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0bc81d640 1 --2- 172.21.15.59:0/905671842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e97050a0 0x55d0e9715660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0bc81d640 1 -- 172.21.15.59:0/905671842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e97059c0 msgr2=0x55d0e9712ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:39.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0bc81d640 1 --2- 172.21.15.59:0/905671842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e97059c0 0x55d0e9712ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0bc81d640 1 -- 172.21.15.59:0/905671842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0e9633c40 con 0x55d0e9715d60 2024-09-10T21:26:39.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0affff640 1 --2- 172.21.15.59:0/905671842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e97059c0 0x55d0e9712ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:39.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0bc81d640 1 --2- 172.21.15.59:0/905671842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e9715d60 0x55d0e97130c0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0035000 tx=0x7fe0b002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b80e16ea69db76c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:39.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0977fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:39.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0977fe640 1 -- 172.21.15.59:0/905671842 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0031ea0 con 0x55d0e9715d60 2024-09-10T21:26:39.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0977fe640 1 -- 172.21.15.59:0/905671842 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe0b0004250 con 0x55d0e9715d60 2024-09-10T21:26:39.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.290+0000 7fe0c0655740 1 -- 172.21.15.59:0/905671842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0a00aba10 con 0x55d0e9715d60 2024-09-10T21:26:39.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.291+0000 7fe0977fe640 1 -- 172.21.15.59:0/905671842 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0b0004450 con 0x55d0e9715d60 2024-09-10T21:26:39.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.291+0000 7fe0c0655740 10 client.18132 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:39.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.291+0000 7fe0c0655740 1 -- 172.21.15.59:0/905671842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d0e9724390 con 0x55d0e9715d60 2024-09-10T21:26:39.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.291+0000 7fe0977fe640 1 -- 172.21.15.59:0/905671842 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0a00aba10 con 0x55d0e9715d60 2024-09-10T21:26:39.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.291+0000 7fe0977fe640 1 -- 172.21.15.59:0/905671842 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe0b0051070 con 0x55d0e9715d60 2024-09-10T21:26:39.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.291+0000 7fe0c0655740 10 client.18132 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:39.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.291+0000 7fe0c0655740 10 client.18132 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:26:39.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.291+0000 7fe0c0655740 20 client.18132 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:39.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.291+0000 7fe0c0655740 1 --2- 172.21.15.59:0/905671842 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d0e9725840 0x55d0e9727c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:39.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.291+0000 7fe0c0655740 4 client.18132 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:26:39.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.291+0000 7fe0c0655740 1 -- 172.21.15.59:0/905671842 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0e967dda0 con 0x55d0e9725840 2024-09-10T21:26:39.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.291+0000 7fe0b7fff640 1 --2- 172.21.15.59:0/905671842 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d0e9725840 0x55d0e9727c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:39.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.292+0000 7fe0b7fff640 1 --2- 172.21.15.59:0/905671842 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d0e9725840 0x55d0e9727c60 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=182041df7b192e server_cookie=76bdc2046d2424d8 in_seq=0 out_seq=0 2024-09-10T21:26:39.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.292+0000 7fe0977fe640 10 client.18132 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:39.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.292+0000 7fe0977fe640 1 -- 172.21.15.59:0/905671842 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d0e967dda0 con 0x55d0e9725840 2024-09-10T21:26:39.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.292+0000 7fe0977fe640 10 client.18132 handle_command_reply: tid=0 2024-09-10T21:26:39.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.293+0000 7fe0c0655740 1 client.18132 shutdown 2024-09-10T21:26:39.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.293+0000 7fe0c0655740 1 -- 172.21.15.59:0/905671842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e9715d60 msgr2=0x55d0e97130c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:39.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.293+0000 7fe0c0655740 1 --2- 172.21.15.59:0/905671842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e9715d60 0x55d0e97130c0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0035000 tx=0x7fe0b002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.293+0000 7fe0c0655740 1 -- 172.21.15.59:0/905671842 shutdown_connections 2024-09-10T21:26:39.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.293+0000 7fe0c0655740 1 --2- 172.21.15.59:0/905671842 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d0e9725840 0x55d0e9727c60 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.293+0000 7fe0c0655740 1 --2- 172.21.15.59:0/905671842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e9715d60 0x55d0e97130c0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.293+0000 7fe0c0655740 1 --2- 172.21.15.59:0/905671842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e97059c0 0x55d0e9712ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.293+0000 7fe0c0655740 1 --2- 172.21.15.59:0/905671842 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e97050a0 0x55d0e9715660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.293+0000 7fe0c0655740 1 -- 172.21.15.59:0/905671842 >> 172.21.15.59:0/905671842 conn(0x55d0e9702ed0 msgr2=0x55d0e9708a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:39.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.293+0000 7fe0977fe640 0 client.18132 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:39.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.293+0000 7fe0c0655740 1 -- 172.21.15.59:0/905671842 shutdown_connections 2024-09-10T21:26:39.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.293+0000 7fe0c0655740 1 -- 172.21.15.59:0/905671842 wait complete. 2024-09-10T21:26:39.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.293+0000 7fe0c0655740 20 client.18132 trim_cache size 0 max 16384 2024-09-10T21:26:39.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.310+0000 7fe0c0655740 1 Processor -- start 2024-09-10T21:26:39.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.310+0000 7fe0c0655740 1 -- start start 2024-09-10T21:26:39.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.311+0000 7fe0c0655740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e97050a0 0x55d0e9721c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:39.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.311+0000 7fe0c0655740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e97059c0 0x55d0e9712a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:39.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.311+0000 7fe0c0655740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e9715d60 0x55d0e9712fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:39.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.311+0000 7fe0c0655740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b81ac080 con 0x55d0e97059c0 2024-09-10T21:26:39.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.311+0000 7fe0c0655740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b81adbc0 con 0x55d0e97050a0 2024-09-10T21:26:39.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.311+0000 7fe0c0655740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b81ac750 con 0x55d0e9715d60 2024-09-10T21:26:39.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.311+0000 7fe0affff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e97059c0 0x55d0e9712a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:39.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.311+0000 7fe0affff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e97059c0 0x55d0e9712a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39564/0 (socket says 172.21.15.59:39564) 2024-09-10T21:26:39.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.311+0000 7fe0affff640 1 -- 172.21.15.59:0/1429624293 learned_addr learned my addr 172.21.15.59:0/1429624293 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:39.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.311+0000 7fe0bc81d640 1 --2- 172.21.15.59:0/1429624293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e9715d60 0x55d0e9712fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:39.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.311+0000 7fe0b7fff640 1 --2- 172.21.15.59:0/1429624293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e97050a0 0x55d0e9721c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:39.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.311+0000 7fe0affff640 1 -- 172.21.15.59:0/1429624293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e9715d60 msgr2=0x55d0e9712fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:39.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.311+0000 7fe0affff640 1 --2- 172.21.15.59:0/1429624293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e9715d60 0x55d0e9712fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.311+0000 7fe0affff640 1 -- 172.21.15.59:0/1429624293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e97050a0 msgr2=0x55d0e9721c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:39.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.311+0000 7fe0affff640 1 --2- 172.21.15.59:0/1429624293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e97050a0 0x55d0e9721c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.311+0000 7fe0affff640 1 -- 172.21.15.59:0/1429624293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0e9702d00 con 0x55d0e97059c0 2024-09-10T21:26:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.311+0000 7fe0b7fff640 1 --2- 172.21.15.59:0/1429624293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e97050a0 0x55d0e9721c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.311+0000 7fe0affff640 1 --2- 172.21.15.59:0/1429624293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e97059c0 0x55d0e9712a80 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00a84d0 tx=0x7fe0a00052e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74369f9b8b7874e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.312+0000 7fe0adffb640 1 -- 172.21.15.59:0/1429624293 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a001d040 con 0x55d0e97059c0 2024-09-10T21:26:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.312+0000 7fe0adffb640 1 -- 172.21.15.59:0/1429624293 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0a00eb380 con 0x55d0e97059c0 2024-09-10T21:26:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.312+0000 7fe0adffb640 1 -- 172.21.15.59:0/1429624293 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a00ab670 con 0x55d0e97059c0 2024-09-10T21:26:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.312+0000 7fe0c0655740 1 -- 172.21.15.59:0/1429624293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e97059c0 msgr2=0x55d0e9712a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.312+0000 7fe0c0655740 1 --2- 172.21.15.59:0/1429624293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e97059c0 0x55d0e9712a80 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00a84d0 tx=0x7fe0a00052e0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.312+0000 7fe0c0655740 1 -- 172.21.15.59:0/1429624293 shutdown_connections 2024-09-10T21:26:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.312+0000 7fe0c0655740 1 --2- 172.21.15.59:0/1429624293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e9715d60 0x55d0e9712fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.312+0000 7fe0c0655740 1 --2- 172.21.15.59:0/1429624293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e97059c0 0x55d0e9712a80 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.312+0000 7fe0c0655740 1 --2- 172.21.15.59:0/1429624293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e97050a0 0x55d0e9721c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.312+0000 7fe0c0655740 1 -- 172.21.15.59:0/1429624293 >> 172.21.15.59:0/1429624293 conn(0x55d0e9702ed0 msgr2=0x55d0e9716b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:39.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.312+0000 7fe0c0655740 1 -- 172.21.15.59:0/1429624293 shutdown_connections 2024-09-10T21:26:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.312+0000 7fe0c0655740 1 -- 172.21.15.59:0/1429624293 wait complete. 2024-09-10T21:26:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.313+0000 7fe0c0655740 1 -- start start 2024-09-10T21:26:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.313+0000 7fe0c0655740 1 Processor -- start 2024-09-10T21:26:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.313+0000 7fe0c0655740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e97050a0 0x55d0e971dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.313+0000 7fe0c0655740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e97059c0 0x55d0e971e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.313+0000 7fe0c0655740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e9715d60 0x55d0e9718c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.313+0000 7fe0c0655740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b81ad4f0 con 0x55d0e97050a0 2024-09-10T21:26:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.313+0000 7fe0c0655740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b81ace20 con 0x55d0e9715d60 2024-09-10T21:26:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.313+0000 7fe0c0655740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b81aa080 con 0x55d0e97059c0 2024-09-10T21:26:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.313+0000 7fe0c0655740 10 client.0 _ll_register_callbacks cb 0x7fe0b0005d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.313+0000 7fe0b7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e97050a0 0x55d0e971dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.313+0000 7fe0b7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e97050a0 0x55d0e971dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39574/0 (socket says 172.21.15.59:39574) 2024-09-10T21:26:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.313+0000 7fe0b7fff640 1 -- 172.21.15.59:0/2568458637 learned_addr learned my addr 172.21.15.59:0/2568458637 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.314+0000 7fe0affff640 1 --2- 172.21.15.59:0/2568458637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e97059c0 0x55d0e971e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:39.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.314+0000 7fe0bc81d640 1 --2- 172.21.15.59:0/2568458637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e9715d60 0x55d0e9718c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:39.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.314+0000 7fe0b7fff640 1 -- 172.21.15.59:0/2568458637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e97059c0 msgr2=0x55d0e971e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:39.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.314+0000 7fe0b7fff640 1 --2- 172.21.15.59:0/2568458637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e97059c0 0x55d0e971e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.314+0000 7fe0b7fff640 1 -- 172.21.15.59:0/2568458637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e9715d60 msgr2=0x55d0e9718c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:39.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.314+0000 7fe0b7fff640 1 --2- 172.21.15.59:0/2568458637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e9715d60 0x55d0e9718c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.314+0000 7fe0b7fff640 1 -- 172.21.15.59:0/2568458637 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0e97191d0 con 0x55d0e97050a0 2024-09-10T21:26:39.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.314+0000 7fe0b7fff640 1 --2- 172.21.15.59:0/2568458637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e97050a0 0x55d0e971dce0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8010940 tx=0x7fe0a8010e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82cb44e9d33144c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:39.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.314+0000 7fe0977fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:39.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.314+0000 7fe0977fe640 1 -- 172.21.15.59:0/2568458637 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8005030 con 0x55d0e97050a0 2024-09-10T21:26:39.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.314+0000 7fe0977fe640 1 -- 172.21.15.59:0/2568458637 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fe0a80051d0 con 0x55d0e97050a0 2024-09-10T21:26:39.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.314+0000 7fe0c0655740 1 -- 172.21.15.59:0/2568458637 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0a00eb380 con 0x55d0e97050a0 2024-09-10T21:26:39.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.314+0000 7fe0977fe640 1 -- 172.21.15.59:0/2568458637 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0a80053d0 con 0x55d0e97050a0 2024-09-10T21:26:39.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.314+0000 7fe0c0655740 10 client.18138 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:39.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.314+0000 7fe0c0655740 1 -- 172.21.15.59:0/2568458637 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d0e9792ee0 con 0x55d0e97050a0 2024-09-10T21:26:39.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.315+0000 7fe0977fe640 1 -- 172.21.15.59:0/2568458637 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0a00eb380 con 0x55d0e97050a0 2024-09-10T21:26:39.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.315+0000 7fe0977fe640 1 -- 172.21.15.59:0/2568458637 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe0a80245a0 con 0x55d0e97050a0 2024-09-10T21:26:39.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.315+0000 7fe0c0655740 10 client.18138 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:39.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.315+0000 7fe0c0655740 10 client.18138 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:26:39.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.315+0000 7fe0c0655740 20 client.18138 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:39.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.315+0000 7fe0c0655740 1 --2- 172.21.15.59:0/2568458637 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d0e9793690 0x55d0e9795ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:39.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.315+0000 7fe0c0655740 4 client.18138 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T21:26:39.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.315+0000 7fe0c0655740 1 -- 172.21.15.59:0/2568458637 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d0e9679850 con 0x55d0e9793690 2024-09-10T21:26:39.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.315+0000 7fe0affff640 1 --2- 172.21.15.59:0/2568458637 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d0e9793690 0x55d0e9795ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:39.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.315+0000 7fe0affff640 1 --2- 172.21.15.59:0/2568458637 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d0e9793690 0x55d0e9795ab0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dbf6b89ad5e2b10 server_cookie=b0a9767cc8a0f989 in_seq=0 out_seq=0 2024-09-10T21:26:39.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.315+0000 7fe0977fe640 10 client.18138 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:39.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.316+0000 7fe0977fe640 1 -- 172.21.15.59:0/2568458637 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5770 (crc 0 0 0) 0x55d0e9679850 con 0x55d0e9793690 2024-09-10T21:26:39.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.316+0000 7fe0977fe640 10 client.18138 handle_command_reply: tid=0 2024-09-10T21:26:39.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.316+0000 7fe0c0655740 1 client.18138 shutdown 2024-09-10T21:26:39.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.316+0000 7fe0c0655740 1 -- 172.21.15.59:0/2568458637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e97050a0 msgr2=0x55d0e971dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:39.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.316+0000 7fe0c0655740 1 --2- 172.21.15.59:0/2568458637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e97050a0 0x55d0e971dce0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8010940 tx=0x7fe0a8010e00 comp rx=0 tx=0).stop 2024-09-10T21:26:39.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.316+0000 7fe0c0655740 1 -- 172.21.15.59:0/2568458637 shutdown_connections 2024-09-10T21:26:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.316+0000 7fe0c0655740 1 --2- 172.21.15.59:0/2568458637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0e9715d60 0x55d0e9718c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.316+0000 7fe0c0655740 1 --2- 172.21.15.59:0/2568458637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55d0e97059c0 0x55d0e971e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.316+0000 7fe0c0655740 1 --2- 172.21.15.59:0/2568458637 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55d0e9793690 0x55d0e9795ab0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.316+0000 7fe0c0655740 1 --2- 172.21.15.59:0/2568458637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d0e97050a0 0x55d0e971dce0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.316+0000 7fe0c0655740 1 -- 172.21.15.59:0/2568458637 >> 172.21.15.59:0/2568458637 conn(0x55d0e9702ed0 msgr2=0x55d0e9704000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.316+0000 7fe0977fe640 0 client.18138 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.316+0000 7fe0c0655740 1 -- 172.21.15.59:0/2568458637 shutdown_connections 2024-09-10T21:26:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.316+0000 7fe0c0655740 1 -- 172.21.15.59:0/2568458637 wait complete. 2024-09-10T21:26:39.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.316+0000 7fe0c0655740 20 client.18138 trim_cache size 0 max 16384 2024-09-10T21:26:39.325 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:26:39.328 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-09-10T21:26:39.328 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {}, 2024-09-10T21:26:39.328 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_stats": { 2024-09-10T21:26:39.328 INFO:teuthology.orchestra.run.smithi059.stdout: "664d252a-6d50-486a-95fb-89d9928b6edb": { 2024-09-10T21:26:39.328 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:26:06.272557+0000", 2024-09-10T21:26:39.328 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: "c1d7b6a9-2cd5-4680-80e3-076ef527cd5d": { 2024-09-10T21:26:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:25:52.833923+0000", 2024-09-10T21:26:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:39.329 INFO:teuthology.orchestra.run.smithi059.stdout: "5e9056fa-94a3-4be5-a66c-5033a946ad88": { 2024-09-10T21:26:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:25:07.346164+0000", 2024-09-10T21:26:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "3ac3cde1-bbc5-4c68-9fc6-bc3e3022aea8": { 2024-09-10T21:26:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:24:53.320547+0000", 2024-09-10T21:26:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: "0fb476f2-3572-4daf-8d42-5cf40259db46": { 2024-09-10T21:26:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:53.136187+0000", 2024-09-10T21:26:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: "cb01ac69-57ce-4c62-b57a-054abf74df29": { 2024-09-10T21:26:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:23:07.589420+0000", 2024-09-10T21:26:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.331 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "e25ed439-dea8-471d-8eaa-846b9bc0b6b2": { 2024-09-10T21:26:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:08.268728+0000", 2024-09-10T21:26:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "5159b619-53a5-44b8-9752-1966beb29939": { 2024-09-10T21:26:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:07.621137+0000", 2024-09-10T21:26:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.332 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: "508715bf-5f30-4951-ac58-28c6e503af11": { 2024-09-10T21:26:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:07.066301+0000", 2024-09-10T21:26:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:39.333 INFO:teuthology.orchestra.run.smithi059.stdout: "3015d1d1-d386-4ffb-9222-3fd73032185b": { 2024-09-10T21:26:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:17:53.561905+0000", 2024-09-10T21:26:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: "7de1e6cf-02c2-41f2-b957-563f88bae8ef": { 2024-09-10T21:26:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:22:22.098651+0000", 2024-09-10T21:26:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "fd4fecc0-22d7-47c0-92e7-a9953c988c74": { 2024-09-10T21:26:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:15:20.361013+0000", 2024-09-10T21:26:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "f8c32dfe-dde0-4d7e-898f-021c024019e0": { 2024-09-10T21:26:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:07.301534+0000", 2024-09-10T21:26:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.335 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: "ec2c29bb-febd-4190-959f-09af3764b7ad": { 2024-09-10T21:26:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:24:07.378801+0000", 2024-09-10T21:26:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: "bab9510a-4461-4875-9c64-5fdb6a2556e4": { 2024-09-10T21:26:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:16:22.688341+0000", 2024-09-10T21:26:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.336 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: "aa7d3145-fc16-4c86-b6cd-995ce03e73a9": { 2024-09-10T21:26:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:07.281916+0000", 2024-09-10T21:26:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: "423e6232-f4ea-4996-bf2f-e554320ff5d0": { 2024-09-10T21:26:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:18:53.093300+0000", 2024-09-10T21:26:39.337 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.338 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.338 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.338 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.338 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:39.338 INFO:teuthology.orchestra.run.smithi059.stdout: "7d0d52cc-d54e-4fd7-98d2-9564c72db6f4": { 2024-09-10T21:26:39.338 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:19:52.948683+0000", 2024-09-10T21:26:39.338 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.338 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.338 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.338 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "800cdb00-6a99-4c42-8a9e-4b1c599c6af0": { 2024-09-10T21:26:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:20:52.224081+0000", 2024-09-10T21:26:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "d82f24b1-930e-4f83-a379-3084f22918d0": { 2024-09-10T21:26:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "start_time": "2024-09-10T21:21:37.203865+0000", 2024-09-10T21:26:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-09-10T21:26:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:39.339 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_passed": 0, 2024-09-10T21:26:39.340 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_failed": 0, 2024-09-10T21:26:39.340 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_skipped": 0 2024-09-10T21:26:39.340 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:39.340 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:39.340 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:26:39.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.317+0000 7fe0be280640 1 -- 172.21.15.59:0/3851124104 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe0a40b5360 msgr2=0x7fe0a40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:39.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.317+0000 7fe0be280640 1 --2- 172.21.15.59:0/3851124104 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe0a40b5360 0x7fe0a40b7820 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00098d0 tx=0x7fe0b002f450 comp rx=0 tx=0).stop 2024-09-10T21:26:39.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.317+0000 7fe0be280640 1 -- 172.21.15.59:0/3851124104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b81076e0 msgr2=0x7fe0b8199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:39.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.317+0000 7fe0be280640 1 --2- 172.21.15.59:0/3851124104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b81076e0 0x7fe0b8199770 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000c890 tx=0x7fe0a000cc90 comp rx=0 tx=0).stop 2024-09-10T21:26:39.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.317+0000 7fe0be280640 1 -- 172.21.15.59:0/3851124104 shutdown_connections 2024-09-10T21:26:39.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.317+0000 7fe0be280640 1 --2- 172.21.15.59:0/3851124104 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fe0a40b5360 0x7fe0a40b7820 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.317+0000 7fe0be280640 1 --2- 172.21.15.59:0/3851124104 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0b8108060 0x7fe0b819eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.317+0000 7fe0be280640 1 --2- 172.21.15.59:0/3851124104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b81076e0 0x7fe0b8199770 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.317+0000 7fe0be280640 1 --2- 172.21.15.59:0/3851124104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0b8101cd0 0x7fe0b8199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:39.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.317+0000 7fe0be280640 1 -- 172.21.15.59:0/3851124104 >> 172.21.15.59:0/3851124104 conn(0x7fe0b80fd700 msgr2=0x7fe0b80fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:39.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.317+0000 7fe0be280640 1 -- 172.21.15.59:0/3851124104 shutdown_connections 2024-09-10T21:26:39.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:39.317+0000 7fe0be280640 1 -- 172.21.15.59:0/3851124104 wait complete. 2024-09-10T21:26:39.341 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:39 smithi059 ceph-mon[30888]: pgmap v681: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-09-10T21:26:39.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:39 smithi154 ceph-mon[35041]: pgmap v681: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-09-10T21:26:39.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:39 smithi192 ceph-mon[35363]: pgmap v681: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-09-10T21:26:40.250 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T21:26:40.251 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:26:40.509 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:26:40.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.937+0000 7f9868dfa640 1 -- 172.21.15.59:0/3375497699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9864104570 msgr2=0x7f986410cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:40.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.937+0000 7f9868dfa640 1 --2- 172.21.15.59:0/3375497699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9864104570 0x7f986410cb50 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f984c009900 tx=0x7f984c02a410 comp rx=0 tx=0).stop 2024-09-10T21:26:40.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.937+0000 7f9868dfa640 1 -- 172.21.15.59:0/3375497699 shutdown_connections 2024-09-10T21:26:40.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.937+0000 7f9868dfa640 1 --2- 172.21.15.59:0/3375497699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f986410d120 0x7f986410f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:40.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.937+0000 7f9868dfa640 1 --2- 172.21.15.59:0/3375497699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9864104570 0x7f986410cb50 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:40.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.937+0000 7f9868dfa640 1 --2- 172.21.15.59:0/3375497699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9864103b70 0x7f9864103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:40.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.937+0000 7f9868dfa640 1 -- 172.21.15.59:0/3375497699 >> 172.21.15.59:0/3375497699 conn(0x7f98640fd700 msgr2=0x7f98640ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:40.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.937+0000 7f9868dfa640 1 -- 172.21.15.59:0/3375497699 shutdown_connections 2024-09-10T21:26:40.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.937+0000 7f9868dfa640 1 -- 172.21.15.59:0/3375497699 wait complete. 2024-09-10T21:26:40.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.938+0000 7f9868dfa640 1 Processor -- start 2024-09-10T21:26:40.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.938+0000 7f9868dfa640 1 -- start start 2024-09-10T21:26:40.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.938+0000 7f9868dfa640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9864103b70 0x7f9864199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:40.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.938+0000 7f9868dfa640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9864104570 0x7f9864199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:40.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.938+0000 7f9868dfa640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f986410d120 0x7f986419eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:40.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.938+0000 7f9868dfa640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9864112da0 con 0x7f986410d120 2024-09-10T21:26:40.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.938+0000 7f9868dfa640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9864112c20 con 0x7f9864104570 2024-09-10T21:26:40.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.938+0000 7f9868dfa640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9864112f20 con 0x7f9864103b70 2024-09-10T21:26:40.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.939+0000 7f9862d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f986410d120 0x7f986419eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:40.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.939+0000 7f9862d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f986410d120 0x7f986419eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39590/0 (socket says 172.21.15.59:39590) 2024-09-10T21:26:40.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.939+0000 7f9862d9d640 1 -- 172.21.15.59:0/332156281 learned_addr learned my addr 172.21.15.59:0/332156281 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:40.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.939+0000 7f985bfff640 1 --2- 172.21.15.59:0/332156281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9864104570 0x7f9864199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:40.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.939+0000 7f986259c640 1 --2- 172.21.15.59:0/332156281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9864103b70 0x7f9864199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:40.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.939+0000 7f9862d9d640 1 -- 172.21.15.59:0/332156281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9864103b70 msgr2=0x7f9864199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:40.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.939+0000 7f9862d9d640 1 --2- 172.21.15.59:0/332156281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9864103b70 0x7f9864199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:40.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.939+0000 7f9862d9d640 1 -- 172.21.15.59:0/332156281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9864104570 msgr2=0x7f9864199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:40.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.939+0000 7f9862d9d640 1 --2- 172.21.15.59:0/332156281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9864104570 0x7f9864199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:40.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.939+0000 7f9862d9d640 1 -- 172.21.15.59:0/332156281 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986419f300 con 0x7f986410d120 2024-09-10T21:26:40.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.939+0000 7f986259c640 1 --2- 172.21.15.59:0/332156281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9864103b70 0x7f9864199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:40.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.939+0000 7f9862d9d640 1 --2- 172.21.15.59:0/332156281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f986410d120 0x7f986419eb30 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f985c00eaa0 tx=0x7f985c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:40.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.939+0000 7f985b7fe640 1 -- 172.21.15.59:0/332156281 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985c00cdb0 con 0x7f986410d120 2024-09-10T21:26:40.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.939+0000 7f985b7fe640 1 -- 172.21.15.59:0/332156281 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f985c005020 con 0x7f986410d120 2024-09-10T21:26:40.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.939+0000 7f9868dfa640 1 -- 172.21.15.59:0/332156281 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f986419f5f0 con 0x7f986410d120 2024-09-10T21:26:40.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.939+0000 7f985b7fe640 1 -- 172.21.15.59:0/332156281 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985c0116d0 con 0x7f986410d120 2024-09-10T21:26:40.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.939+0000 7f9868dfa640 1 -- 172.21.15.59:0/332156281 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98641a5cb0 con 0x7f986410d120 2024-09-10T21:26:40.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.940+0000 7f9868dfa640 1 -- 172.21.15.59:0/332156281 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9864103f50 con 0x7f986410d120 2024-09-10T21:26:40.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.942+0000 7f985b7fe640 1 -- 172.21.15.59:0/332156281 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f985c00f040 con 0x7f986410d120 2024-09-10T21:26:40.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.942+0000 7f985b7fe640 1 --2- 172.21.15.59:0/332156281 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f98500b52e0 0x7f98500b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:40.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.943+0000 7f985b7fe640 1 -- 172.21.15.59:0/332156281 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f985c0e5e20 con 0x7f986410d120 2024-09-10T21:26:40.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.943+0000 7f986259c640 1 --2- 172.21.15.59:0/332156281 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f98500b52e0 0x7f98500b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:40.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.943+0000 7f986259c640 1 --2- 172.21.15.59:0/332156281 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f98500b52e0 0x7f98500b77a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f985400abe0 tx=0x7f985400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:40.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:40.946+0000 7f985b7fe640 1 -- 172.21.15.59:0/332156281 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f985c016030 con 0x7f986410d120 2024-09-10T21:26:41.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:41.170+0000 7f9868dfa640 1 -- 172.21.15.59:0/332156281 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98641a5f70 con 0x7f986410d120 2024-09-10T21:26:41.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:41.171+0000 7f985b7fe640 1 -- 172.21.15.59:0/332156281 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f985c0acd10 con 0x7f986410d120 2024-09-10T21:26:41.173 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:26:41.174 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:26:41.174 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:26:41.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:41.173+0000 7f9868dfa640 1 -- 172.21.15.59:0/332156281 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f98500b52e0 msgr2=0x7f98500b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:41.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:41.173+0000 7f9868dfa640 1 --2- 172.21.15.59:0/332156281 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f98500b52e0 0x7f98500b77a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f985400abe0 tx=0x7f985400a5c0 comp rx=0 tx=0).stop 2024-09-10T21:26:41.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:41.173+0000 7f9868dfa640 1 -- 172.21.15.59:0/332156281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f986410d120 msgr2=0x7f986419eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:41.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:41.173+0000 7f9868dfa640 1 --2- 172.21.15.59:0/332156281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f986410d120 0x7f986419eb30 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f985c00eaa0 tx=0x7f985c00ef60 comp rx=0 tx=0).stop 2024-09-10T21:26:41.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:41.173+0000 7f9868dfa640 1 -- 172.21.15.59:0/332156281 shutdown_connections 2024-09-10T21:26:41.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:41.173+0000 7f9868dfa640 1 --2- 172.21.15.59:0/332156281 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f98500b52e0 0x7f98500b77a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:41.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:41.173+0000 7f9868dfa640 1 --2- 172.21.15.59:0/332156281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f986410d120 0x7f986419eb30 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:41.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:41.173+0000 7f9868dfa640 1 --2- 172.21.15.59:0/332156281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9864104570 0x7f9864199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:41.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:41.173+0000 7f9868dfa640 1 --2- 172.21.15.59:0/332156281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9864103b70 0x7f9864199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:41.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:41.173+0000 7f9868dfa640 1 -- 172.21.15.59:0/332156281 >> 172.21.15.59:0/332156281 conn(0x7f98640fd700 msgr2=0x7f98640fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:41.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:41.174+0000 7f9868dfa640 1 -- 172.21.15.59:0/332156281 shutdown_connections 2024-09-10T21:26:41.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:41.174+0000 7f9868dfa640 1 -- 172.21.15.59:0/332156281 wait complete. 2024-09-10T21:26:41.409 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:41 smithi059 ceph-mon[30888]: pgmap v682: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-09-10T21:26:41.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:41 smithi154 ceph-mon[35041]: pgmap v682: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-09-10T21:26:41.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:41 smithi192 ceph-mon[35363]: pgmap v682: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-09-10T21:26:41.827 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-10T21:26:42.087 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:26:42.409 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:42 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/332156281' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:26:42.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:42 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/332156281' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:26:42.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:42 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/332156281' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:26:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.564+0000 7fc303e81640 1 -- 172.21.15.59:0/2166076091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2fc10d140 msgr2=0x7fc2fc10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.564+0000 7fc303e81640 1 --2- 172.21.15.59:0/2166076091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2fc10d140 0x7fc2fc10f5a0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4009ca0 tx=0x7fc2f402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.564+0000 7fc303e81640 1 -- 172.21.15.59:0/2166076091 shutdown_connections 2024-09-10T21:26:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.564+0000 7fc303e81640 1 --2- 172.21.15.59:0/2166076091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2fc10d140 0x7fc2fc10f5a0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.564+0000 7fc303e81640 1 --2- 172.21.15.59:0/2166076091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2fc104600 0x7fc2fc10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.564+0000 7fc303e81640 1 --2- 172.21.15.59:0/2166076091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2fc103ce0 0x7fc2fc1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.564+0000 7fc303e81640 1 -- 172.21.15.59:0/2166076091 >> 172.21.15.59:0/2166076091 conn(0x7fc2fc0fd700 msgr2=0x7fc2fc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.564+0000 7fc303e81640 1 -- 172.21.15.59:0/2166076091 shutdown_connections 2024-09-10T21:26:42.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.564+0000 7fc303e81640 1 -- 172.21.15.59:0/2166076091 wait complete. 2024-09-10T21:26:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.564+0000 7fc303e81640 1 Processor -- start 2024-09-10T21:26:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc303e81640 1 -- start start 2024-09-10T21:26:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc303e81640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2fc103ce0 0x7fc2fc1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc303e81640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2fc104600 0x7fc2fc199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc303e81640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2fc10d140 0x7fc2fc19ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc303e81640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc112ee0 con 0x7fc2fc10d140 2024-09-10T21:26:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc303e81640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc112d60 con 0x7fc2fc104600 2024-09-10T21:26:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc303e81640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc113060 con 0x7fc2fc103ce0 2024-09-10T21:26:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc30241e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2fc10d140 0x7fc2fc19ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:42.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc30241e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2fc10d140 0x7fc2fc19ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39608/0 (socket says 172.21.15.59:39608) 2024-09-10T21:26:42.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc30241e640 1 -- 172.21.15.59:0/2325638658 learned_addr learned my addr 172.21.15.59:0/2325638658 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:42.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc30141c640 1 --2- 172.21.15.59:0/2325638658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2fc104600 0x7fc2fc199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:42.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc301c1d640 1 --2- 172.21.15.59:0/2325638658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2fc103ce0 0x7fc2fc1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:42.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc30241e640 1 -- 172.21.15.59:0/2325638658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2fc103ce0 msgr2=0x7fc2fc1993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:42.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc30241e640 1 --2- 172.21.15.59:0/2325638658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2fc103ce0 0x7fc2fc1993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc30241e640 1 -- 172.21.15.59:0/2325638658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2fc104600 msgr2=0x7fc2fc199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:42.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc30241e640 1 --2- 172.21.15.59:0/2325638658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2fc104600 0x7fc2fc199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc30241e640 1 -- 172.21.15.59:0/2325638658 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2fc19f480 con 0x7fc2fc10d140 2024-09-10T21:26:42.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc301c1d640 1 --2- 172.21.15.59:0/2325638658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2fc103ce0 0x7fc2fc1993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:26:42.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc30141c640 1 --2- 172.21.15.59:0/2325638658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2fc104600 0x7fc2fc199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:26:42.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc30241e640 1 --2- 172.21.15.59:0/2325638658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2fc10d140 0x7fc2fc19ecb0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4031a20 tx=0x7fc2f4031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:42.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.565+0000 7fc2f2ffd640 1 -- 172.21.15.59:0/2325638658 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4003d30 con 0x7fc2fc10d140 2024-09-10T21:26:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.566+0000 7fc303e81640 1 -- 172.21.15.59:0/2325638658 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2fc19f710 con 0x7fc2fc10d140 2024-09-10T21:26:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.566+0000 7fc2f2ffd640 1 -- 172.21.15.59:0/2325638658 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2f40044f0 con 0x7fc2fc10d140 2024-09-10T21:26:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.566+0000 7fc2f2ffd640 1 -- 172.21.15.59:0/2325638658 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f402fd90 con 0x7fc2fc10d140 2024-09-10T21:26:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.566+0000 7fc303e81640 1 -- 172.21.15.59:0/2325638658 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2fc1a5eb0 con 0x7fc2fc10d140 2024-09-10T21:26:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.568+0000 7fc2f2ffd640 1 -- 172.21.15.59:0/2325638658 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fc2f4004040 con 0x7fc2fc10d140 2024-09-10T21:26:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.568+0000 7fc306256740 1 Processor -- start 2024-09-10T21:26:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.568+0000 7fc306256740 1 -- start start 2024-09-10T21:26:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc306256740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981660f0 0x5584981664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc306256740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558498166a10 0x558498172460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc306256740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584981729a0 0x558498174d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:42.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc306256740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5584980dcea0 con 0x5584981660f0 2024-09-10T21:26:42.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc306256740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5584980cc2d0 con 0x558498166a10 2024-09-10T21:26:42.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc306256740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5584980d00e0 con 0x5584981729a0 2024-09-10T21:26:42.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc30141c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981660f0 0x5584981664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:42.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc30141c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981660f0 0x5584981664d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39624/0 (socket says 172.21.15.59:39624) 2024-09-10T21:26:42.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc30141c640 1 -- 172.21.15.59:0/1560108980 learned_addr learned my addr 172.21.15.59:0/1560108980 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:42.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc301c1d640 1 --2- 172.21.15.59:0/1560108980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558498166a10 0x558498172460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:42.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc30141c640 1 -- 172.21.15.59:0/1560108980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584981729a0 msgr2=0x558498174d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:42.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc30141c640 1 --2- 172.21.15.59:0/1560108980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584981729a0 0x558498174d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc30141c640 1 -- 172.21.15.59:0/1560108980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558498166a10 msgr2=0x558498172460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:42.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc30141c640 1 --2- 172.21.15.59:0/1560108980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558498166a10 0x558498172460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc30141c640 1 -- 172.21.15.59:0/1560108980 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558497e2a650 con 0x5584981660f0 2024-09-10T21:26:42.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc301c1d640 1 --2- 172.21.15.59:0/1560108980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558498166a10 0x558498172460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:42.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc2f2ffd640 1 --2- 172.21.15.59:0/2325638658 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc2e80b52e0 0x7fc2e80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:42.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc301c1d640 1 --2- 172.21.15.59:0/2325638658 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc2e80b52e0 0x7fc2e80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:42.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc30141c640 1 --2- 172.21.15.59:0/1560108980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981660f0 0x5584981664d0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00aa00 tx=0x7fc2ec00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46675f0c3f85ec48 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:42.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.569+0000 7fc2f2ffd640 1 -- 172.21.15.59:0/2325638658 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc2f4107070 con 0x7fc2fc10d140 2024-09-10T21:26:42.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.570+0000 7fc2e7fff640 1 -- 172.21.15.59:0/1560108980 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec00f040 con 0x5584981660f0 2024-09-10T21:26:42.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.570+0000 7fc2e7fff640 1 -- 172.21.15.59:0/1560108980 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2ec013460 con 0x5584981660f0 2024-09-10T21:26:42.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.570+0000 7fc2e7fff640 1 -- 172.21.15.59:0/1560108980 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0125c0 con 0x5584981660f0 2024-09-10T21:26:42.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.570+0000 7fc306256740 1 -- 172.21.15.59:0/1560108980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981660f0 msgr2=0x5584981664d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:42.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.570+0000 7fc301c1d640 1 --2- 172.21.15.59:0/2325638658 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc2e80b52e0 0x7fc2e80b77a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x558498164e00 tx=0x7fc2f8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:42.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.570+0000 7fc306256740 1 --2- 172.21.15.59:0/1560108980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981660f0 0x5584981664d0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00aa00 tx=0x7fc2ec00aec0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.570+0000 7fc306256740 1 -- 172.21.15.59:0/1560108980 shutdown_connections 2024-09-10T21:26:42.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.570+0000 7fc306256740 1 --2- 172.21.15.59:0/1560108980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584981729a0 0x558498174d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.570+0000 7fc306256740 1 --2- 172.21.15.59:0/1560108980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558498166a10 0x558498172460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.570+0000 7fc306256740 1 --2- 172.21.15.59:0/1560108980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981660f0 0x5584981664d0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.570+0000 7fc306256740 1 -- 172.21.15.59:0/1560108980 >> 172.21.15.59:0/1560108980 conn(0x558498163f20 msgr2=0x5584981650c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:42.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.571+0000 7fc306256740 1 -- 172.21.15.59:0/1560108980 shutdown_connections 2024-09-10T21:26:42.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.571+0000 7fc306256740 1 -- 172.21.15.59:0/1560108980 wait complete. 2024-09-10T21:26:42.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.571+0000 7fc306256740 1 -- start start 2024-09-10T21:26:42.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.571+0000 7fc306256740 1 Processor -- start 2024-09-10T21:26:42.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.571+0000 7fc306256740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981660f0 0x5584981721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:42.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.571+0000 7fc306256740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558498166a10 0x55849816f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:42.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.571+0000 7fc306256740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584981729a0 0x55849816fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:42.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.571+0000 7fc306256740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558497f2d700 con 0x5584981660f0 2024-09-10T21:26:42.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.571+0000 7fc306256740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558498067160 con 0x558498166a10 2024-09-10T21:26:42.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.571+0000 7fc306256740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x558498175620 con 0x5584981729a0 2024-09-10T21:26:42.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.572+0000 7fc306256740 10 client.0 _ll_register_callbacks cb 0x5584980809e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:42.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.572+0000 7fc301c1d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981660f0 0x5584981721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:42.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.572+0000 7fc301c1d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981660f0 0x5584981721b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39632/0 (socket says 172.21.15.59:39632) 2024-09-10T21:26:42.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.572+0000 7fc301c1d640 1 -- 172.21.15.59:0/4157982380 learned_addr learned my addr 172.21.15.59:0/4157982380 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:42.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.572+0000 7fc30141c640 1 --2- 172.21.15.59:0/4157982380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558498166a10 0x55849816f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:42.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.572+0000 7fc30241e640 1 --2- 172.21.15.59:0/4157982380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584981729a0 0x55849816fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:42.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.572+0000 7fc301c1d640 1 -- 172.21.15.59:0/4157982380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584981729a0 msgr2=0x55849816fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:42.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.572+0000 7fc301c1d640 1 --2- 172.21.15.59:0/4157982380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584981729a0 0x55849816fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.572+0000 7fc301c1d640 1 -- 172.21.15.59:0/4157982380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558498166a10 msgr2=0x55849816f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:42.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.572+0000 7fc301c1d640 1 --2- 172.21.15.59:0/4157982380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558498166a10 0x55849816f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.572+0000 7fc301c1d640 1 -- 172.21.15.59:0/4157982380 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558498094c90 con 0x5584981660f0 2024-09-10T21:26:42.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.572+0000 7fc301c1d640 1 --2- 172.21.15.59:0/4157982380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981660f0 0x5584981721b0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8014710 tx=0x7fc2f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641f746a89abd53b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:42.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.572+0000 7fc2e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:42.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.572+0000 7fc2e57fa640 1 -- 172.21.15.59:0/4157982380 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f801b050 con 0x5584981660f0 2024-09-10T21:26:42.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.572+0000 7fc2e57fa640 1 -- 172.21.15.59:0/4157982380 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc2f8015820 con 0x5584981660f0 2024-09-10T21:26:42.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.572+0000 7fc306256740 1 -- 172.21.15.59:0/4157982380 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2ec013460 con 0x5584981660f0 2024-09-10T21:26:42.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.572+0000 7fc2e57fa640 1 -- 172.21.15.59:0/4157982380 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc2f8015a20 con 0x5584981660f0 2024-09-10T21:26:42.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.573+0000 7fc306256740 10 client.18156 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:42.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.573+0000 7fc306256740 1 -- 172.21.15.59:0/4157982380 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558498180f30 con 0x5584981660f0 2024-09-10T21:26:42.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.573+0000 7fc2e57fa640 1 -- 172.21.15.59:0/4157982380 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2ec013460 con 0x5584981660f0 2024-09-10T21:26:42.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.573+0000 7fc2e57fa640 1 -- 172.21.15.59:0/4157982380 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc2f8006320 con 0x5584981660f0 2024-09-10T21:26:42.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.573+0000 7fc306256740 10 client.18156 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:42.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.573+0000 7fc306256740 10 client.18156 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:26:42.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.573+0000 7fc306256740 20 client.18156 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:42.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.573+0000 7fc306256740 1 --2- 172.21.15.59:0/4157982380 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x558498182440 0x5584981848b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:42.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.573+0000 7fc306256740 4 client.18156 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:26:42.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.573+0000 7fc306256740 1 -- 172.21.15.59:0/4157982380 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584980dedf0 con 0x558498182440 2024-09-10T21:26:42.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.573+0000 7fc30141c640 1 --2- 172.21.15.59:0/4157982380 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x558498182440 0x5584981848b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:42.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.574+0000 7fc30141c640 1 --2- 172.21.15.59:0/4157982380 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x558498182440 0x5584981848b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e8393c296a5860d6 server_cookie=1b66d8550c6e6554 in_seq=0 out_seq=0 2024-09-10T21:26:42.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.574+0000 7fc2e57fa640 10 client.18156 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:26:42.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.575+0000 7fc2e57fa640 1 -- 172.21.15.59:0/4157982380 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5584980dedf0 con 0x558498182440 2024-09-10T21:26:42.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.575+0000 7fc2e57fa640 10 client.18156 handle_command_reply: tid=0 2024-09-10T21:26:42.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.575+0000 7fc306256740 1 client.18156 shutdown 2024-09-10T21:26:42.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.575+0000 7fc306256740 1 -- 172.21.15.59:0/4157982380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981660f0 msgr2=0x5584981721b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:42.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.575+0000 7fc306256740 1 --2- 172.21.15.59:0/4157982380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981660f0 0x5584981721b0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8014710 tx=0x7fc2f80046c0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.575+0000 7fc306256740 1 -- 172.21.15.59:0/4157982380 shutdown_connections 2024-09-10T21:26:42.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.575+0000 7fc306256740 1 --2- 172.21.15.59:0/4157982380 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x558498182440 0x5584981848b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.575+0000 7fc306256740 1 --2- 172.21.15.59:0/4157982380 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584981729a0 0x55849816fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.575+0000 7fc306256740 1 --2- 172.21.15.59:0/4157982380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558498166a10 0x55849816f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.575+0000 7fc2e57fa640 0 client.18156 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:26:42.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.575+0000 7fc306256740 1 --2- 172.21.15.59:0/4157982380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981660f0 0x5584981721b0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.575+0000 7fc306256740 1 -- 172.21.15.59:0/4157982380 >> 172.21.15.59:0/4157982380 conn(0x558498163f20 msgr2=0x558498169a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:42.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.575+0000 7fc306256740 1 -- 172.21.15.59:0/4157982380 shutdown_connections 2024-09-10T21:26:42.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.575+0000 7fc306256740 1 -- 172.21.15.59:0/4157982380 wait complete. 2024-09-10T21:26:42.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.575+0000 7fc306256740 20 client.18156 trim_cache size 0 max 16384 2024-09-10T21:26:42.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.588+0000 7fc306256740 1 Processor -- start 2024-09-10T21:26:42.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.588+0000 7fc306256740 1 -- start start 2024-09-10T21:26:42.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc306256740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584981660f0 0x55849817acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:42.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc306256740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558498166a10 0x55849817b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:42.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc306256740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584981729a0 0x558498169860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc306256740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc1ae420 con 0x558498166a10 2024-09-10T21:26:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc306256740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc1aff60 con 0x5584981729a0 2024-09-10T21:26:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc306256740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc1aeaf0 con 0x5584981660f0 2024-09-10T21:26:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc30141c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558498166a10 0x55849817b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:42.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc30141c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558498166a10 0x55849817b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39644/0 (socket says 172.21.15.59:39644) 2024-09-10T21:26:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc30141c640 1 -- 172.21.15.59:0/1405216919 learned_addr learned my addr 172.21.15.59:0/1405216919 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc301c1d640 1 --2- 172.21.15.59:0/1405216919 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584981660f0 0x55849817acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc30241e640 1 --2- 172.21.15.59:0/1405216919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584981729a0 0x558498169860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc30141c640 1 -- 172.21.15.59:0/1405216919 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584981660f0 msgr2=0x55849817acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc30141c640 1 --2- 172.21.15.59:0/1405216919 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584981660f0 0x55849817acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc30141c640 1 -- 172.21.15.59:0/1405216919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584981729a0 msgr2=0x558498169860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc30141c640 1 --2- 172.21.15.59:0/1405216919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584981729a0 0x558498169860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc30141c640 1 -- 172.21.15.59:0/1405216919 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558498171de0 con 0x558498166a10 2024-09-10T21:26:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc30141c640 1 --2- 172.21.15.59:0/1405216919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558498166a10 0x55849817b230 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec008010 tx=0x7fc2ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29985a97fc66a5e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc2e77fe640 1 -- 172.21.15.59:0/1405216919 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0138c0 con 0x558498166a10 2024-09-10T21:26:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc2e77fe640 1 -- 172.21.15.59:0/1405216919 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2ec013a60 con 0x558498166a10 2024-09-10T21:26:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.589+0000 7fc2e77fe640 1 -- 172.21.15.59:0/1405216919 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec01e860 con 0x558498166a10 2024-09-10T21:26:42.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.590+0000 7fc306256740 1 -- 172.21.15.59:0/1405216919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558498166a10 msgr2=0x55849817b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.590+0000 7fc306256740 1 --2- 172.21.15.59:0/1405216919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558498166a10 0x55849817b230 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec008010 tx=0x7fc2ec008040 comp rx=0 tx=0).stop 2024-09-10T21:26:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.590+0000 7fc306256740 1 -- 172.21.15.59:0/1405216919 shutdown_connections 2024-09-10T21:26:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.590+0000 7fc306256740 1 --2- 172.21.15.59:0/1405216919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584981729a0 0x558498169860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.590+0000 7fc306256740 1 --2- 172.21.15.59:0/1405216919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558498166a10 0x55849817b230 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.590+0000 7fc306256740 1 --2- 172.21.15.59:0/1405216919 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5584981660f0 0x55849817acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.590+0000 7fc306256740 1 -- 172.21.15.59:0/1405216919 >> 172.21.15.59:0/1405216919 conn(0x558498163f20 msgr2=0x558498169150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.590+0000 7fc306256740 1 -- 172.21.15.59:0/1405216919 shutdown_connections 2024-09-10T21:26:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.590+0000 7fc306256740 1 -- 172.21.15.59:0/1405216919 wait complete. 2024-09-10T21:26:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.590+0000 7fc306256740 1 -- start start 2024-09-10T21:26:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.591+0000 7fc306256740 1 Processor -- start 2024-09-10T21:26:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.591+0000 7fc306256740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584981660f0 0x5584981e7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.591+0000 7fc306256740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558498166a10 0x5584981e7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.591+0000 7fc306256740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981729a0 0x5584981e9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.591+0000 7fc306256740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc1af890 con 0x5584981729a0 2024-09-10T21:26:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.591+0000 7fc306256740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc1af1c0 con 0x5584981660f0 2024-09-10T21:26:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.591+0000 7fc306256740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc1ac400 con 0x558498166a10 2024-09-10T21:26:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.591+0000 7fc306256740 10 client.0 _ll_register_callbacks cb 0x7fc2f800fd90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.591+0000 7fc30241e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981729a0 0x5584981e9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.591+0000 7fc30241e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981729a0 0x5584981e9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39648/0 (socket says 172.21.15.59:39648) 2024-09-10T21:26:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.591+0000 7fc30241e640 1 -- 172.21.15.59:0/74000160 learned_addr learned my addr 172.21.15.59:0/74000160 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.591+0000 7fc301c1d640 1 --2- 172.21.15.59:0/74000160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584981660f0 0x5584981e7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.591+0000 7fc30141c640 1 --2- 172.21.15.59:0/74000160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558498166a10 0x5584981e7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.592+0000 7fc30241e640 1 -- 172.21.15.59:0/74000160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558498166a10 msgr2=0x5584981e7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.592+0000 7fc30241e640 1 --2- 172.21.15.59:0/74000160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558498166a10 0x5584981e7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.592+0000 7fc30241e640 1 -- 172.21.15.59:0/74000160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584981660f0 msgr2=0x5584981e7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:42.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.592+0000 7fc30241e640 1 --2- 172.21.15.59:0/74000160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584981660f0 0x5584981e7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.592+0000 7fc30241e640 1 -- 172.21.15.59:0/74000160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584981e9fc0 con 0x5584981729a0 2024-09-10T21:26:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.592+0000 7fc30141c640 1 --2- 172.21.15.59:0/74000160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558498166a10 0x5584981e7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:26:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.592+0000 7fc301c1d640 1 --2- 172.21.15.59:0/74000160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584981660f0 0x5584981e7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T21:26:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.592+0000 7fc30241e640 1 --2- 172.21.15.59:0/74000160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981729a0 0x5584981e9880 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40cd880 tx=0x7fc2f40cd060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5912aa5a4f12c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.592+0000 7fc2e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.592+0000 7fc2e57fa640 1 -- 172.21.15.59:0/74000160 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f40cdff0 con 0x5584981729a0 2024-09-10T21:26:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.592+0000 7fc2e57fa640 1 -- 172.21.15.59:0/74000160 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc2f40d2070 con 0x5584981729a0 2024-09-10T21:26:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.592+0000 7fc306256740 1 -- 172.21.15.59:0/74000160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2ec013a60 con 0x5584981729a0 2024-09-10T21:26:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.592+0000 7fc2e57fa640 1 -- 172.21.15.59:0/74000160 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc2f40cd8f0 con 0x5584981729a0 2024-09-10T21:26:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.592+0000 7fc306256740 10 client.18162 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.592+0000 7fc306256740 1 -- 172.21.15.59:0/74000160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5584981f46e0 con 0x5584981729a0 2024-09-10T21:26:42.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.592+0000 7fc2e57fa640 1 -- 172.21.15.59:0/74000160 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2ec013a60 con 0x5584981729a0 2024-09-10T21:26:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.593+0000 7fc2e57fa640 1 -- 172.21.15.59:0/74000160 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc2f40443d0 con 0x5584981729a0 2024-09-10T21:26:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.593+0000 7fc306256740 10 client.18162 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.593+0000 7fc306256740 10 client.18162 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-10T21:26:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.593+0000 7fc306256740 20 client.18162 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.593+0000 7fc306256740 1 --2- 172.21.15.59:0/74000160 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5584981f4e60 0x5584981f7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.593+0000 7fc306256740 4 client.18162 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:26:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.593+0000 7fc306256740 1 -- 172.21.15.59:0/74000160 --> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5584980da8a0 con 0x5584981f4e60 2024-09-10T21:26:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.593+0000 7fc301c1d640 1 --2- 172.21.15.59:0/74000160 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5584981f4e60 0x5584981f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.593+0000 7fc301c1d640 1 --2- 172.21.15.59:0/74000160 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5584981f4e60 0x5584981f7280 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3e3205399322f3dd server_cookie=1d59c6c2eca99d20 in_seq=0 out_seq=0 2024-09-10T21:26:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.593+0000 7fc2e57fa640 10 client.18162 ms_handle_connect on v2:172.21.15.192:6834/3608050805 2024-09-10T21:26:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.593+0000 7fc2e57fa640 1 -- 172.21.15.59:0/74000160 <== mds.4 v2:172.21.15.192:6834/3608050805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5584980da8a0 con 0x5584981f4e60 2024-09-10T21:26:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.593+0000 7fc2e57fa640 10 client.18162 handle_command_reply: tid=0 2024-09-10T21:26:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.593+0000 7fc306256740 1 client.18162 shutdown 2024-09-10T21:26:42.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.594+0000 7fc306256740 1 -- 172.21.15.59:0/74000160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981729a0 msgr2=0x5584981e9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.594+0000 7fc306256740 1 --2- 172.21.15.59:0/74000160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981729a0 0x5584981e9880 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40cd880 tx=0x7fc2f40cd060 comp rx=0 tx=0).stop 2024-09-10T21:26:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.594+0000 7fc306256740 1 -- 172.21.15.59:0/74000160 shutdown_connections 2024-09-10T21:26:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.594+0000 7fc306256740 1 --2- 172.21.15.59:0/74000160 >> [v2:172.21.15.192:6834/3608050805,v1:172.21.15.192:6835/3608050805] conn(0x5584981f4e60 0x5584981f7280 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.594+0000 7fc306256740 1 --2- 172.21.15.59:0/74000160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584981729a0 0x5584981e9880 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.594+0000 7fc306256740 1 --2- 172.21.15.59:0/74000160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x558498166a10 0x5584981e7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.594+0000 7fc2e57fa640 0 client.18162 ms_handle_reset on v2:172.21.15.192:6834/3608050805 2024-09-10T21:26:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.594+0000 7fc306256740 1 --2- 172.21.15.59:0/74000160 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5584981660f0 0x5584981e7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.594+0000 7fc306256740 1 -- 172.21.15.59:0/74000160 >> 172.21.15.59:0/74000160 conn(0x558498163f20 msgr2=0x558498169970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.594+0000 7fc306256740 1 -- 172.21.15.59:0/74000160 shutdown_connections 2024-09-10T21:26:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.594+0000 7fc306256740 1 -- 172.21.15.59:0/74000160 wait complete. 2024-09-10T21:26:42.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.594+0000 7fc306256740 20 client.18162 trim_cache size 0 max 16384 2024-09-10T21:26:42.612 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:26:42.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.594+0000 7fc303e81640 1 -- 172.21.15.59:0/2325638658 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc2e80b52e0 msgr2=0x7fc2e80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:42.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.594+0000 7fc303e81640 1 --2- 172.21.15.59:0/2325638658 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc2e80b52e0 0x7fc2e80b77a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x558498164e00 tx=0x7fc2f8008040 comp rx=0 tx=0).stop 2024-09-10T21:26:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.594+0000 7fc303e81640 1 -- 172.21.15.59:0/2325638658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2fc10d140 msgr2=0x7fc2fc19ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.594+0000 7fc303e81640 1 --2- 172.21.15.59:0/2325638658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2fc10d140 0x7fc2fc19ecb0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4031a20 tx=0x7fc2f4031a50 comp rx=0 tx=0).stop 2024-09-10T21:26:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.595+0000 7fc303e81640 1 -- 172.21.15.59:0/2325638658 shutdown_connections 2024-09-10T21:26:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.595+0000 7fc303e81640 1 --2- 172.21.15.59:0/2325638658 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc2e80b52e0 0x7fc2e80b77a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.595+0000 7fc303e81640 1 --2- 172.21.15.59:0/2325638658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2fc10d140 0x7fc2fc19ecb0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.595+0000 7fc303e81640 1 --2- 172.21.15.59:0/2325638658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2fc104600 0x7fc2fc199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.595+0000 7fc303e81640 1 --2- 172.21.15.59:0/2325638658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2fc103ce0 0x7fc2fc1993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.595+0000 7fc303e81640 1 -- 172.21.15.59:0/2325638658 >> 172.21.15.59:0/2325638658 conn(0x7fc2fc0fd700 msgr2=0x7fc2fc0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.595+0000 7fc303e81640 1 -- 172.21.15.59:0/2325638658 shutdown_connections 2024-09-10T21:26:42.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:42.595+0000 7fc303e81640 1 -- 172.21.15.59:0/2325638658 wait complete. 2024-09-10T21:26:43.337 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:43 smithi059 ceph-mon[30888]: pgmap v683: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-10T21:26:43.370 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-10T21:26:43.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:43 smithi154 ceph-mon[35041]: pgmap v683: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-10T21:26:43.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:43 smithi192 ceph-mon[35363]: pgmap v683: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-10T21:26:43.630 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:26:44.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.143+0000 7f77e565b640 1 -- 172.21.15.59:0/3105901911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e0102dc0 msgr2=0x7f77e01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:44.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.143+0000 7f77e565b640 1 --2- 172.21.15.59:0/3105901911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e0102dc0 0x7f77e01031a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009860 tx=0x7f77d002a340 comp rx=0 tx=0).stop 2024-09-10T21:26:44.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.143+0000 7f77e565b640 1 -- 172.21.15.59:0/3105901911 shutdown_connections 2024-09-10T21:26:44.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.143+0000 7f77e565b640 1 --2- 172.21.15.59:0/3105901911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77e0109150 0x7f77e010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.143+0000 7f77e565b640 1 --2- 172.21.15.59:0/3105901911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e01087d0 0x7f77e0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.143+0000 7f77e565b640 1 --2- 172.21.15.59:0/3105901911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e0102dc0 0x7f77e01031a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.143+0000 7f77e565b640 1 -- 172.21.15.59:0/3105901911 >> 172.21.15.59:0/3105901911 conn(0x7f77e00fe830 msgr2=0x7f77e0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:44.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.143+0000 7f77e565b640 1 -- 172.21.15.59:0/3105901911 shutdown_connections 2024-09-10T21:26:44.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.144+0000 7f77e565b640 1 -- 172.21.15.59:0/3105901911 wait complete. 2024-09-10T21:26:44.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.144+0000 7f77e565b640 1 Processor -- start 2024-09-10T21:26:44.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.144+0000 7f77e565b640 1 -- start start 2024-09-10T21:26:44.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.145+0000 7f77e565b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e0102dc0 0x7f77e01992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:44.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.145+0000 7f77e565b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e01087d0 0x7f77e0199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:44.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.145+0000 7f77e565b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77e0109150 0x7f77e019eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:44.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.145+0000 7f77e565b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f77e0112dd0 con 0x7f77e01087d0 2024-09-10T21:26:44.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.145+0000 7f77e565b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f77e0112c50 con 0x7f77e0109150 2024-09-10T21:26:44.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.145+0000 7f77e565b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f77e0112f50 con 0x7f77e0102dc0 2024-09-10T21:26:44.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.145+0000 7f77de7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e01087d0 0x7f77e0199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:44.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.145+0000 7f77de7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e01087d0 0x7f77e0199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39668/0 (socket says 172.21.15.59:39668) 2024-09-10T21:26:44.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.145+0000 7f77deffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e0102dc0 0x7f77e01992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.145+0000 7f77de7fc640 1 -- 172.21.15.59:0/2314212699 learned_addr learned my addr 172.21.15.59:0/2314212699 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.145+0000 7f77df7fe640 1 --2- 172.21.15.59:0/2314212699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77e0109150 0x7f77e019eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.145+0000 7f77de7fc640 1 -- 172.21.15.59:0/2314212699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e0102dc0 msgr2=0x7f77e01992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.145+0000 7f77de7fc640 1 --2- 172.21.15.59:0/2314212699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e0102dc0 0x7f77e01992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.145+0000 7f77de7fc640 1 -- 172.21.15.59:0/2314212699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77e0109150 msgr2=0x7f77e019eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.145+0000 7f77de7fc640 1 --2- 172.21.15.59:0/2314212699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77e0109150 0x7f77e019eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.145+0000 7f77de7fc640 1 -- 172.21.15.59:0/2314212699 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e019f370 con 0x7f77e01087d0 2024-09-10T21:26:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.146+0000 7f77de7fc640 1 --2- 172.21.15.59:0/2314212699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e01087d0 0x7f77e0199800 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f77d400d950 tx=0x7f77d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.146+0000 7f77c7fff640 1 -- 172.21.15.59:0/2314212699 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d4017070 con 0x7f77e01087d0 2024-09-10T21:26:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.146+0000 7f77e565b640 1 -- 172.21.15.59:0/2314212699 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e019f660 con 0x7f77e01087d0 2024-09-10T21:26:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.146+0000 7f77c7fff640 1 -- 172.21.15.59:0/2314212699 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77d4009c30 con 0x7f77e01087d0 2024-09-10T21:26:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.146+0000 7f77c7fff640 1 -- 172.21.15.59:0/2314212699 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d400f620 con 0x7f77e01087d0 2024-09-10T21:26:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.146+0000 7f77e565b640 1 -- 172.21.15.59:0/2314212699 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e01a5ef0 con 0x7f77e01087d0 2024-09-10T21:26:44.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.148+0000 7f77c7fff640 1 -- 172.21.15.59:0/2314212699 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f77d4010460 con 0x7f77e01087d0 2024-09-10T21:26:44.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.148+0000 7f77e7a30740 1 Processor -- start 2024-09-10T21:26:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.149+0000 7f77e7a30740 1 -- start start 2024-09-10T21:26:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.149+0000 7f77e7a30740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642853550f0 0x5642853554d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.149+0000 7f77e7a30740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564285355a10 0x564285365870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.149+0000 7f77e7a30740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564285365db0 0x5642853681a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.149+0000 7f77e7a30740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5642852cbea0 con 0x5642853550f0 2024-09-10T21:26:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.149+0000 7f77e7a30740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5642852bb2d0 con 0x564285365db0 2024-09-10T21:26:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.149+0000 7f77e7a30740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x5642852bf0e0 con 0x564285355a10 2024-09-10T21:26:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.149+0000 7f77df7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642853550f0 0x5642853554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.149+0000 7f77df7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642853550f0 0x5642853554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39676/0 (socket says 172.21.15.59:39676) 2024-09-10T21:26:44.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.149+0000 7f77df7fe640 1 -- 172.21.15.59:0/4083331401 learned_addr learned my addr 172.21.15.59:0/4083331401 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.149+0000 7f77deffd640 1 --2- 172.21.15.59:0/4083331401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564285355a10 0x564285365870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.149+0000 7f77c7fff640 1 --2- 172.21.15.59:0/2314212699 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f77c80b52e0 0x7f77c80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.149+0000 7f77de7fc640 1 --2- 172.21.15.59:0/4083331401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564285365db0 0x5642853681a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.149+0000 7f77df7fe640 1 -- 172.21.15.59:0/4083331401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564285355a10 msgr2=0x564285365870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.149+0000 7f77df7fe640 1 --2- 172.21.15.59:0/4083331401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564285355a10 0x564285365870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.149+0000 7f77df7fe640 1 -- 172.21.15.59:0/4083331401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564285365db0 msgr2=0x5642853681a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.149+0000 7f77df7fe640 1 --2- 172.21.15.59:0/4083331401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564285365db0 0x5642853681a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.150+0000 7f77df7fe640 1 -- 172.21.15.59:0/4083331401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564285019650 con 0x5642853550f0 2024-09-10T21:26:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.150+0000 7f77c7fff640 1 -- 172.21.15.59:0/2314212699 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f77d40e5890 con 0x7f77e01087d0 2024-09-10T21:26:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.150+0000 7f77de7fc640 1 --2- 172.21.15.59:0/4083331401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564285365db0 0x5642853681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:26:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.150+0000 7f77df7fe640 1 --2- 172.21.15.59:0/2314212699 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f77c80b52e0 0x7f77c80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.150+0000 7f77df7fe640 1 --2- 172.21.15.59:0/4083331401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642853550f0 0x5642853554d0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f77d8008f70 tx=0x7f77d800e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498cadbe3f93c4f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.150+0000 7f77c57fa640 1 -- 172.21.15.59:0/4083331401 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d8022070 con 0x5642853550f0 2024-09-10T21:26:44.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.150+0000 7f77c57fa640 1 -- 172.21.15.59:0/4083331401 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77d8011b70 con 0x5642853550f0 2024-09-10T21:26:44.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.150+0000 7f77c57fa640 1 -- 172.21.15.59:0/4083331401 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d801cb80 con 0x5642853550f0 2024-09-10T21:26:44.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.150+0000 7f77df7fe640 1 --2- 172.21.15.59:0/2314212699 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f77c80b52e0 0x7f77c80b77a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f77d801f000 tx=0x7f77d8020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.151+0000 7f77e7a30740 1 -- 172.21.15.59:0/4083331401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642853550f0 msgr2=0x5642853554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.151+0000 7f77e7a30740 1 --2- 172.21.15.59:0/4083331401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642853550f0 0x5642853554d0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f77d8008f70 tx=0x7f77d800e7e0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.151+0000 7f77e7a30740 1 -- 172.21.15.59:0/4083331401 shutdown_connections 2024-09-10T21:26:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.151+0000 7f77e7a30740 1 --2- 172.21.15.59:0/4083331401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564285365db0 0x5642853681a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.151+0000 7f77e7a30740 1 --2- 172.21.15.59:0/4083331401 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564285355a10 0x564285365870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.151+0000 7f77e7a30740 1 --2- 172.21.15.59:0/4083331401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642853550f0 0x5642853554d0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.151+0000 7f77e7a30740 1 -- 172.21.15.59:0/4083331401 >> 172.21.15.59:0/4083331401 conn(0x564285352f20 msgr2=0x5642853540c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.151+0000 7f77e7a30740 1 -- 172.21.15.59:0/4083331401 shutdown_connections 2024-09-10T21:26:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.151+0000 7f77e7a30740 1 -- 172.21.15.59:0/4083331401 wait complete. 2024-09-10T21:26:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.151+0000 7f77e7a30740 1 -- start start 2024-09-10T21:26:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.151+0000 7f77e7a30740 1 Processor -- start 2024-09-10T21:26:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.152+0000 7f77e7a30740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5642853550f0 0x564285365720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.152+0000 7f77e7a30740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564285355a10 0x564285362b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.152+0000 7f77e7a30740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564285365db0 0x5642853631f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.152+0000 7f77e7a30740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56428511c700 con 0x564285355a10 2024-09-10T21:26:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.152+0000 7f77e7a30740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564285256160 con 0x564285365db0 2024-09-10T21:26:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.152+0000 7f77e7a30740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x564285368a60 con 0x5642853550f0 2024-09-10T21:26:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.152+0000 7f77e7a30740 10 client.0 _ll_register_callbacks cb 0x56428526f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.152+0000 7f77de7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564285355a10 0x564285362b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.152+0000 7f77de7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564285355a10 0x564285362b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39686/0 (socket says 172.21.15.59:39686) 2024-09-10T21:26:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.152+0000 7f77de7fc640 1 -- 172.21.15.59:0/1272307121 learned_addr learned my addr 172.21.15.59:0/1272307121 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.152+0000 7f77deffd640 1 --2- 172.21.15.59:0/1272307121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5642853550f0 0x564285365720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.152+0000 7f77df7fe640 1 --2- 172.21.15.59:0/1272307121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564285365db0 0x5642853631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.152+0000 7f77de7fc640 1 -- 172.21.15.59:0/1272307121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5642853550f0 msgr2=0x564285365720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.152+0000 7f77de7fc640 1 --2- 172.21.15.59:0/1272307121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5642853550f0 0x564285365720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.152+0000 7f77de7fc640 1 -- 172.21.15.59:0/1272307121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564285365db0 msgr2=0x5642853631f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.152+0000 7f77de7fc640 1 --2- 172.21.15.59:0/1272307121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564285365db0 0x5642853631f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.152+0000 7f77de7fc640 1 -- 172.21.15.59:0/1272307121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564285283c90 con 0x564285355a10 2024-09-10T21:26:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.153+0000 7f77de7fc640 1 --2- 172.21.15.59:0/1272307121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564285355a10 0x564285362b70 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f77d40e3360 tx=0x7f77d4018c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43ebd72551772bd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.153+0000 7f77c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.153+0000 7f77c2ff5640 1 -- 172.21.15.59:0/1272307121 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d4020040 con 0x564285355a10 2024-09-10T21:26:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.153+0000 7f77c2ff5640 1 -- 172.21.15.59:0/1272307121 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f77d4010780 con 0x564285355a10 2024-09-10T21:26:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.153+0000 7f77e7a30740 1 -- 172.21.15.59:0/1272307121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77d8011b70 con 0x564285355a10 2024-09-10T21:26:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.153+0000 7f77c2ff5640 1 -- 172.21.15.59:0/1272307121 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f77d4018ec0 con 0x564285355a10 2024-09-10T21:26:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.153+0000 7f77e7a30740 10 client.18174 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.153+0000 7f77e7a30740 1 -- 172.21.15.59:0/1272307121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564285374380 con 0x564285355a10 2024-09-10T21:26:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.153+0000 7f77c2ff5640 1 -- 172.21.15.59:0/1272307121 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77d8011b70 con 0x564285355a10 2024-09-10T21:26:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.154+0000 7f77c2ff5640 1 -- 172.21.15.59:0/1272307121 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f77d40a7970 con 0x564285355a10 2024-09-10T21:26:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.154+0000 7f77e7a30740 10 client.18174 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.154+0000 7f77e7a30740 10 client.18174 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:26:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.154+0000 7f77e7a30740 20 client.18174 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.154+0000 7f77e7a30740 1 --2- 172.21.15.59:0/1272307121 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5642853758b0 0x564285377cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.154+0000 7f77e7a30740 4 client.18174 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:26:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.154+0000 7f77e7a30740 1 -- 172.21.15.59:0/1272307121 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642852cddf0 con 0x5642853758b0 2024-09-10T21:26:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.154+0000 7f77deffd640 1 --2- 172.21.15.59:0/1272307121 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5642853758b0 0x564285377cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.154+0000 7f77c2ff5640 10 client.18174 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:26:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.154+0000 7f77deffd640 1 --2- 172.21.15.59:0/1272307121 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5642853758b0 0x564285377cd0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1e5e3dd700e345f3 server_cookie=2416662664bfa14c in_seq=0 out_seq=0 2024-09-10T21:26:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.155+0000 7f77c2ff5640 1 -- 172.21.15.59:0/1272307121 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5642852cddf0 con 0x5642853758b0 2024-09-10T21:26:44.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.155+0000 7f77c2ff5640 10 client.18174 handle_command_reply: tid=0 2024-09-10T21:26:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.155+0000 7f77e7a30740 1 client.18174 shutdown 2024-09-10T21:26:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.155+0000 7f77e7a30740 1 -- 172.21.15.59:0/1272307121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564285355a10 msgr2=0x564285362b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.155+0000 7f77e7a30740 1 --2- 172.21.15.59:0/1272307121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564285355a10 0x564285362b70 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f77d40e3360 tx=0x7f77d4018c50 comp rx=0 tx=0).stop 2024-09-10T21:26:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.155+0000 7f77e7a30740 1 -- 172.21.15.59:0/1272307121 shutdown_connections 2024-09-10T21:26:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.155+0000 7f77e7a30740 1 --2- 172.21.15.59:0/1272307121 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5642853758b0 0x564285377cd0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.155+0000 7f77e7a30740 1 --2- 172.21.15.59:0/1272307121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564285365db0 0x5642853631f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.155+0000 7f77e7a30740 1 --2- 172.21.15.59:0/1272307121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564285355a10 0x564285362b70 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.155+0000 7f77c2ff5640 0 client.18174 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:26:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.155+0000 7f77e7a30740 1 --2- 172.21.15.59:0/1272307121 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5642853550f0 0x564285365720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.155+0000 7f77e7a30740 1 -- 172.21.15.59:0/1272307121 >> 172.21.15.59:0/1272307121 conn(0x564285352f20 msgr2=0x564285358a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.155+0000 7f77e7a30740 1 -- 172.21.15.59:0/1272307121 shutdown_connections 2024-09-10T21:26:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.156+0000 7f77e7a30740 1 -- 172.21.15.59:0/1272307121 wait complete. 2024-09-10T21:26:44.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.156+0000 7f77e7a30740 20 client.18174 trim_cache size 0 max 16384 2024-09-10T21:26:44.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.169+0000 7f77e7a30740 1 Processor -- start 2024-09-10T21:26:44.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.169+0000 7f77e7a30740 1 -- start start 2024-09-10T21:26:44.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.169+0000 7f77e7a30740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642853550f0 0x564285371c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:44.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.169+0000 7f77e7a30740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564285355a10 0x5642853620a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:44.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.169+0000 7f77e7a30740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564285365db0 0x564285362920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:44.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.169+0000 7f77e7a30740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f77e01ac0c0 con 0x564285365db0 2024-09-10T21:26:44.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.169+0000 7f77e7a30740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f77e01adc00 con 0x5642853550f0 2024-09-10T21:26:44.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.169+0000 7f77e7a30740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f77e01ac790 con 0x564285355a10 2024-09-10T21:26:44.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.169+0000 7f77df7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564285365db0 0x564285362920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:44.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.169+0000 7f77df7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564285365db0 0x564285362920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39694/0 (socket says 172.21.15.59:39694) 2024-09-10T21:26:44.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.169+0000 7f77df7fe640 1 -- 172.21.15.59:0/3303231233 learned_addr learned my addr 172.21.15.59:0/3303231233 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:44.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.169+0000 7f77de7fc640 1 --2- 172.21.15.59:0/3303231233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564285355a10 0x5642853620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:44.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.170+0000 7f77deffd640 1 --2- 172.21.15.59:0/3303231233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642853550f0 0x564285371c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:44.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.170+0000 7f77df7fe640 1 -- 172.21.15.59:0/3303231233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564285355a10 msgr2=0x5642853620a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.170+0000 7f77df7fe640 1 --2- 172.21.15.59:0/3303231233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564285355a10 0x5642853620a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.170+0000 7f77df7fe640 1 -- 172.21.15.59:0/3303231233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642853550f0 msgr2=0x564285371c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.170+0000 7f77df7fe640 1 --2- 172.21.15.59:0/3303231233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642853550f0 0x564285371c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.170+0000 7f77df7fe640 1 -- 172.21.15.59:0/3303231233 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564285354790 con 0x564285365db0 2024-09-10T21:26:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.170+0000 7f77de7fc640 1 --2- 172.21.15.59:0/3303231233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564285355a10 0x5642853620a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.170+0000 7f77df7fe640 1 --2- 172.21.15.59:0/3303231233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564285365db0 0x564285362920 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f77d8012670 tx=0x7f77d80126a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6477f44decb1f633 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.170+0000 7f77c4ff9640 1 -- 172.21.15.59:0/3303231233 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d8022040 con 0x564285365db0 2024-09-10T21:26:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.170+0000 7f77c4ff9640 1 -- 172.21.15.59:0/3303231233 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77d80087c0 con 0x564285365db0 2024-09-10T21:26:44.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.170+0000 7f77c4ff9640 1 -- 172.21.15.59:0/3303231233 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d801c560 con 0x564285365db0 2024-09-10T21:26:44.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.171+0000 7f77e7a30740 1 -- 172.21.15.59:0/3303231233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564285365db0 msgr2=0x564285362920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:44.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.171+0000 7f77e7a30740 1 --2- 172.21.15.59:0/3303231233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564285365db0 0x564285362920 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f77d8012670 tx=0x7f77d80126a0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.171+0000 7f77e7a30740 1 -- 172.21.15.59:0/3303231233 shutdown_connections 2024-09-10T21:26:44.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.171+0000 7f77e7a30740 1 --2- 172.21.15.59:0/3303231233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564285365db0 0x564285362920 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.171+0000 7f77e7a30740 1 --2- 172.21.15.59:0/3303231233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564285355a10 0x5642853620a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.171+0000 7f77e7a30740 1 --2- 172.21.15.59:0/3303231233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642853550f0 0x564285371c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.171+0000 7f77e7a30740 1 -- 172.21.15.59:0/3303231233 >> 172.21.15.59:0/3303231233 conn(0x564285352f20 msgr2=0x564285367c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.171+0000 7f77e7a30740 1 -- 172.21.15.59:0/3303231233 shutdown_connections 2024-09-10T21:26:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.171+0000 7f77e7a30740 1 -- 172.21.15.59:0/3303231233 wait complete. 2024-09-10T21:26:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.171+0000 7f77e7a30740 1 -- start start 2024-09-10T21:26:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.171+0000 7f77e7a30740 1 Processor -- start 2024-09-10T21:26:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.171+0000 7f77e7a30740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642853550f0 0x56428536ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.171+0000 7f77e7a30740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564285355a10 0x56428536e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.171+0000 7f77e7a30740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564285365db0 0x56428536acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.171+0000 7f77e7a30740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f77e01ad530 con 0x5642853550f0 2024-09-10T21:26:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.171+0000 7f77e7a30740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f77e01ace60 con 0x564285355a10 2024-09-10T21:26:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.171+0000 7f77e7a30740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f77e01aa0a0 con 0x564285365db0 2024-09-10T21:26:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.171+0000 7f77e7a30740 10 client.0 _ll_register_callbacks cb 0x7f77d400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.171+0000 7f77deffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642853550f0 0x56428536ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:44.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.172+0000 7f77deffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642853550f0 0x56428536ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39706/0 (socket says 172.21.15.59:39706) 2024-09-10T21:26:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.172+0000 7f77deffd640 1 -- 172.21.15.59:0/1683634340 learned_addr learned my addr 172.21.15.59:0/1683634340 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.172+0000 7f77df7fe640 1 --2- 172.21.15.59:0/1683634340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564285365db0 0x56428536acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.172+0000 7f77de7fc640 1 --2- 172.21.15.59:0/1683634340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564285355a10 0x56428536e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.172+0000 7f77deffd640 1 -- 172.21.15.59:0/1683634340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564285365db0 msgr2=0x56428536acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.172+0000 7f77deffd640 1 --2- 172.21.15.59:0/1683634340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564285365db0 0x56428536acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.172+0000 7f77deffd640 1 -- 172.21.15.59:0/1683634340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564285355a10 msgr2=0x56428536e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.172+0000 7f77deffd640 1 --2- 172.21.15.59:0/1683634340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564285355a10 0x56428536e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.172+0000 7f77deffd640 1 -- 172.21.15.59:0/1683634340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56428536b4f0 con 0x5642853550f0 2024-09-10T21:26:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.172+0000 7f77de7fc640 1 --2- 172.21.15.59:0/1683634340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564285355a10 0x56428536e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:26:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.172+0000 7f77deffd640 1 --2- 172.21.15.59:0/1683634340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642853550f0 0x56428536ded0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f77d002a860 tx=0x7f77d002a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5fd112fbaf5a1ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.172+0000 7f77c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.172+0000 7f77c2ff5640 1 -- 172.21.15.59:0/1683634340 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d004e060 con 0x5642853550f0 2024-09-10T21:26:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.172+0000 7f77c2ff5640 1 -- 172.21.15.59:0/1683634340 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f77d0004100 con 0x5642853550f0 2024-09-10T21:26:44.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.172+0000 7f77e7a30740 1 -- 172.21.15.59:0/1683634340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77d80087c0 con 0x5642853550f0 2024-09-10T21:26:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.172+0000 7f77c2ff5640 1 -- 172.21.15.59:0/1683634340 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f77d0037040 con 0x5642853550f0 2024-09-10T21:26:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.172+0000 7f77e7a30740 10 client.18180 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.172+0000 7f77e7a30740 1 -- 172.21.15.59:0/1683634340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5642853e31b0 con 0x5642853550f0 2024-09-10T21:26:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.173+0000 7f77c2ff5640 1 -- 172.21.15.59:0/1683634340 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77d80087c0 con 0x5642853550f0 2024-09-10T21:26:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.173+0000 7f77c2ff5640 1 -- 172.21.15.59:0/1683634340 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f77d0003ab0 con 0x5642853550f0 2024-09-10T21:26:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.173+0000 7f77e7a30740 10 client.18180 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.173+0000 7f77e7a30740 10 client.18180 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-10T21:26:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.173+0000 7f77e7a30740 20 client.18180 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.173+0000 7f77e7a30740 1 --2- 172.21.15.59:0/1683634340 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5642853e3900 0x5642853e5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.173+0000 7f77e7a30740 4 client.18180 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:26:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.173+0000 7f77e7a30740 1 -- 172.21.15.59:0/1683634340 --> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5642852c98a0 con 0x5642853e3900 2024-09-10T21:26:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.173+0000 7f77de7fc640 1 --2- 172.21.15.59:0/1683634340 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5642853e3900 0x5642853e5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:44.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.174+0000 7f77de7fc640 1 --2- 172.21.15.59:0/1683634340 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5642853e3900 0x5642853e5d20 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a4d436a83d527ad3 server_cookie=a4c460689e1c0de8 in_seq=0 out_seq=0 2024-09-10T21:26:44.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.174+0000 7f77c2ff5640 10 client.18180 ms_handle_connect on v2:172.21.15.192:6836/266289113 2024-09-10T21:26:44.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.174+0000 7f77c2ff5640 1 -- 172.21.15.59:0/1683634340 <== mds.3 v2:172.21.15.192:6836/266289113 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5642852c98a0 con 0x5642853e3900 2024-09-10T21:26:44.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.174+0000 7f77c2ff5640 10 client.18180 handle_command_reply: tid=0 2024-09-10T21:26:44.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.174+0000 7f77e7a30740 1 client.18180 shutdown 2024-09-10T21:26:44.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.174+0000 7f77e7a30740 1 -- 172.21.15.59:0/1683634340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642853550f0 msgr2=0x56428536ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:44.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.174+0000 7f77e7a30740 1 --2- 172.21.15.59:0/1683634340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642853550f0 0x56428536ded0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f77d002a860 tx=0x7f77d002a8e0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.174+0000 7f77e7a30740 1 -- 172.21.15.59:0/1683634340 shutdown_connections 2024-09-10T21:26:44.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.174+0000 7f77e7a30740 1 --2- 172.21.15.59:0/1683634340 >> [v2:172.21.15.192:6836/266289113,v1:172.21.15.192:6837/266289113] conn(0x5642853e3900 0x5642853e5d20 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.174+0000 7f77e7a30740 1 --2- 172.21.15.59:0/1683634340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x564285365db0 0x56428536acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.174+0000 7f77e7a30740 1 --2- 172.21.15.59:0/1683634340 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564285355a10 0x56428536e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.174+0000 7f77c2ff5640 0 client.18180 ms_handle_reset on v2:172.21.15.192:6836/266289113 2024-09-10T21:26:44.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.174+0000 7f77e7a30740 1 --2- 172.21.15.59:0/1683634340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642853550f0 0x56428536ded0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.174+0000 7f77e7a30740 1 -- 172.21.15.59:0/1683634340 >> 172.21.15.59:0/1683634340 conn(0x564285352f20 msgr2=0x564285366c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:44.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.174+0000 7f77e7a30740 1 -- 172.21.15.59:0/1683634340 shutdown_connections 2024-09-10T21:26:44.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.174+0000 7f77e7a30740 1 -- 172.21.15.59:0/1683634340 wait complete. 2024-09-10T21:26:44.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.174+0000 7f77e7a30740 20 client.18180 trim_cache size 0 max 16384 2024-09-10T21:26:44.183 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:26:44.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.175+0000 7f77e565b640 1 -- 172.21.15.59:0/2314212699 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f77c80b52e0 msgr2=0x7f77c80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:44.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.175+0000 7f77e565b640 1 --2- 172.21.15.59:0/2314212699 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f77c80b52e0 0x7f77c80b77a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f77d801f000 tx=0x7f77d8020000 comp rx=0 tx=0).stop 2024-09-10T21:26:44.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.175+0000 7f77e565b640 1 -- 172.21.15.59:0/2314212699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e01087d0 msgr2=0x7f77e0199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:44.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.175+0000 7f77e565b640 1 --2- 172.21.15.59:0/2314212699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e01087d0 0x7f77e0199800 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f77d400d950 tx=0x7f77d400de10 comp rx=0 tx=0).stop 2024-09-10T21:26:44.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.175+0000 7f77e565b640 1 -- 172.21.15.59:0/2314212699 shutdown_connections 2024-09-10T21:26:44.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.175+0000 7f77e565b640 1 --2- 172.21.15.59:0/2314212699 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f77c80b52e0 0x7f77c80b77a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.175+0000 7f77e565b640 1 --2- 172.21.15.59:0/2314212699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77e0109150 0x7f77e019eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.175+0000 7f77e565b640 1 --2- 172.21.15.59:0/2314212699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77e01087d0 0x7f77e0199800 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.175+0000 7f77e565b640 1 --2- 172.21.15.59:0/2314212699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77e0102dc0 0x7f77e01992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:44.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.175+0000 7f77e565b640 1 -- 172.21.15.59:0/2314212699 >> 172.21.15.59:0/2314212699 conn(0x7f77e00fe830 msgr2=0x7f77e0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:44.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.175+0000 7f77e565b640 1 -- 172.21.15.59:0/2314212699 shutdown_connections 2024-09-10T21:26:44.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:44.175+0000 7f77e565b640 1 -- 172.21.15.59:0/2314212699 wait complete. 2024-09-10T21:26:44.819 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T21:26:45.077 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:26:45.409 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:45 smithi059 ceph-mon[30888]: pgmap v684: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-10T21:26:45.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:45 smithi154 ceph-mon[35041]: pgmap v684: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-10T21:26:45.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:45 smithi192 ceph-mon[35363]: pgmap v684: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-10T21:26:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.579+0000 7fc012d67640 1 -- 172.21.15.59:0/1526711682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc00c109170 msgr2=0x7fc00c10f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.579+0000 7fc012d67640 1 --2- 172.21.15.59:0/1526711682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc00c109170 0x7fc00c10f970 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fc004009ca0 tx=0x7fc00402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.579+0000 7fc012d67640 1 -- 172.21.15.59:0/1526711682 shutdown_connections 2024-09-10T21:26:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.579+0000 7fc012d67640 1 --2- 172.21.15.59:0/1526711682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc00c109170 0x7fc00c10f970 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.579+0000 7fc012d67640 1 --2- 172.21.15.59:0/1526711682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc00c1087f0 0x7fc00c108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.579+0000 7fc012d67640 1 --2- 172.21.15.59:0/1526711682 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc00c102de0 0x7fc00c1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.579+0000 7fc012d67640 1 -- 172.21.15.59:0/1526711682 >> 172.21.15.59:0/1526711682 conn(0x7fc00c0fe830 msgr2=0x7fc00c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.579+0000 7fc012d67640 1 -- 172.21.15.59:0/1526711682 shutdown_connections 2024-09-10T21:26:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.579+0000 7fc012d67640 1 -- 172.21.15.59:0/1526711682 wait complete. 2024-09-10T21:26:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc012d67640 1 Processor -- start 2024-09-10T21:26:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc012d67640 1 -- start start 2024-09-10T21:26:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc012d67640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc00c102de0 0x7fc00c199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc012d67640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc00c1087f0 0x7fc00c1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc012d67640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc00c109170 0x7fc00c19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc012d67640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c112e30 con 0x7fc00c1087f0 2024-09-10T21:26:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc012d67640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c112cb0 con 0x7fc00c109170 2024-09-10T21:26:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc012d67640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c112fb0 con 0x7fc00c102de0 2024-09-10T21:26:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc00bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc00c1087f0 0x7fc00c1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc00bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc00c1087f0 0x7fc00c1997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39716/0 (socket says 172.21.15.59:39716) 2024-09-10T21:26:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc00bfff640 1 -- 172.21.15.59:0/1237129284 learned_addr learned my addr 172.21.15.59:0/1237129284 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc011304640 1 --2- 172.21.15.59:0/1237129284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc00c109170 0x7fc00c19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc010b03640 1 --2- 172.21.15.59:0/1237129284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc00c102de0 0x7fc00c199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:45.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc00bfff640 1 -- 172.21.15.59:0/1237129284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc00c102de0 msgr2=0x7fc00c199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:45.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc00bfff640 1 --2- 172.21.15.59:0/1237129284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc00c102de0 0x7fc00c199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc00bfff640 1 -- 172.21.15.59:0/1237129284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc00c109170 msgr2=0x7fc00c19eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:45.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc00bfff640 1 --2- 172.21.15.59:0/1237129284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc00c109170 0x7fc00c19eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc00bfff640 1 -- 172.21.15.59:0/1237129284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00c19f330 con 0x7fc00c1087f0 2024-09-10T21:26:45.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc010b03640 1 --2- 172.21.15.59:0/1237129284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc00c102de0 0x7fc00c199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:26:45.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.580+0000 7fc00bfff640 1 --2- 172.21.15.59:0/1237129284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc00c1087f0 0x7fc00c1997c0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fc00000c920 tx=0x7fc00000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:45.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.581+0000 7fc009ffb640 1 -- 172.21.15.59:0/1237129284 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc000007c70 con 0x7fc00c1087f0 2024-09-10T21:26:45.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.581+0000 7fc012d67640 1 -- 172.21.15.59:0/1237129284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc00c19f620 con 0x7fc00c1087f0 2024-09-10T21:26:45.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.581+0000 7fc009ffb640 1 -- 172.21.15.59:0/1237129284 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc000007e10 con 0x7fc00c1087f0 2024-09-10T21:26:45.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.581+0000 7fc009ffb640 1 -- 172.21.15.59:0/1237129284 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc000018820 con 0x7fc00c1087f0 2024-09-10T21:26:45.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.581+0000 7fc012d67640 1 -- 172.21.15.59:0/1237129284 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc00c1a5ce0 con 0x7fc00c1087f0 2024-09-10T21:26:45.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.584+0000 7fc01513c740 1 Processor -- start 2024-09-10T21:26:45.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.584+0000 7fc01513c740 1 -- start start 2024-09-10T21:26:45.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.584+0000 7fc009ffb640 1 -- 172.21.15.59:0/1237129284 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fc00000f450 con 0x7fc00c1087f0 2024-09-10T21:26:45.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.584+0000 7fc01513c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c7be3004d0 0x55c7be3008b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:45.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.584+0000 7fc01513c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be300df0 0x55c7be30c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:45.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.584+0000 7fc01513c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be30cd80 0x55c7be30f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:45.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.584+0000 7fc01513c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c7be276ea0 con 0x55c7be300df0 2024-09-10T21:26:45.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.584+0000 7fc01513c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c7be2662d0 con 0x55c7be30cd80 2024-09-10T21:26:45.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.584+0000 7fc01513c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c7be26a0e0 con 0x55c7be3004d0 2024-09-10T21:26:45.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.585+0000 7fc010b03640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be300df0 0x55c7be30c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:45.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.585+0000 7fc011304640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c7be3004d0 0x55c7be3008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:45.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.585+0000 7fc010b03640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be300df0 0x55c7be30c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39732/0 (socket says 172.21.15.59:39732) 2024-09-10T21:26:45.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.585+0000 7fc010b03640 1 -- 172.21.15.59:0/3918973870 learned_addr learned my addr 172.21.15.59:0/3918973870 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:45.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.585+0000 7fc00bfff640 1 --2- 172.21.15.59:0/3918973870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be30cd80 0x55c7be30f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:45.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.585+0000 7fc010b03640 1 -- 172.21.15.59:0/3918973870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c7be3004d0 msgr2=0x55c7be3008b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:45.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.585+0000 7fc010b03640 1 --2- 172.21.15.59:0/3918973870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c7be3004d0 0x55c7be3008b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.585+0000 7fc010b03640 1 -- 172.21.15.59:0/3918973870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be30cd80 msgr2=0x55c7be30f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:45.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.585+0000 7fc010b03640 1 --2- 172.21.15.59:0/3918973870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be30cd80 0x55c7be30f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.585+0000 7fc010b03640 1 -- 172.21.15.59:0/3918973870 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7bdfc4650 con 0x55c7be300df0 2024-09-10T21:26:45.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.585+0000 7fc010b03640 1 --2- 172.21.15.59:0/3918973870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be300df0 0x55c7be30c840 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00aa10 tx=0x7fbffc00aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac5c47490b52389 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:45.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.585+0000 7fc009ffb640 1 --2- 172.21.15.59:0/1237129284 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbff40b52e0 0x7fbff40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:45.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.586+0000 7fbff2ffd640 1 -- 172.21.15.59:0/3918973870 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc015070 con 0x55c7be300df0 2024-09-10T21:26:45.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.586+0000 7fbff2ffd640 1 -- 172.21.15.59:0/3918973870 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbffc00cc60 con 0x55c7be300df0 2024-09-10T21:26:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.586+0000 7fc011304640 1 --2- 172.21.15.59:0/1237129284 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbff40b52e0 0x7fbff40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.586+0000 7fbff2ffd640 1 -- 172.21.15.59:0/3918973870 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc018580 con 0x55c7be300df0 2024-09-10T21:26:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.586+0000 7fc009ffb640 1 -- 172.21.15.59:0/1237129284 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc0000e5dd0 con 0x7fc00c1087f0 2024-09-10T21:26:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.586+0000 7fc011304640 1 --2- 172.21.15.59:0/1237129284 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbff40b52e0 0x7fbff40b77a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc004005fa0 tx=0x7fc004005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.586+0000 7fc01513c740 1 -- 172.21.15.59:0/3918973870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be300df0 msgr2=0x55c7be30c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.586+0000 7fc01513c740 1 --2- 172.21.15.59:0/3918973870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be300df0 0x55c7be30c840 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00aa10 tx=0x7fbffc00aed0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.586+0000 7fc01513c740 1 -- 172.21.15.59:0/3918973870 shutdown_connections 2024-09-10T21:26:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.586+0000 7fc01513c740 1 --2- 172.21.15.59:0/3918973870 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be30cd80 0x55c7be30f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.586+0000 7fc01513c740 1 --2- 172.21.15.59:0/3918973870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be300df0 0x55c7be30c840 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.586+0000 7fc01513c740 1 --2- 172.21.15.59:0/3918973870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c7be3004d0 0x55c7be3008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.586+0000 7fc01513c740 1 -- 172.21.15.59:0/3918973870 >> 172.21.15.59:0/3918973870 conn(0x55c7be2fe300 msgr2=0x55c7be2ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.587+0000 7fc01513c740 1 -- 172.21.15.59:0/3918973870 shutdown_connections 2024-09-10T21:26:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.587+0000 7fc01513c740 1 -- 172.21.15.59:0/3918973870 wait complete. 2024-09-10T21:26:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.587+0000 7fc01513c740 1 -- start start 2024-09-10T21:26:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.587+0000 7fc01513c740 1 Processor -- start 2024-09-10T21:26:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.587+0000 7fc01513c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be3004d0 0x55c7be30c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.587+0000 7fc01513c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c7be300df0 0x55c7be309a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.587+0000 7fc01513c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be30cd80 0x55c7be309fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.587+0000 7fc01513c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c7be0c7700 con 0x55c7be3004d0 2024-09-10T21:26:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.587+0000 7fc01513c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c7be201160 con 0x55c7be30cd80 2024-09-10T21:26:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.587+0000 7fc01513c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55c7be30fa00 con 0x55c7be300df0 2024-09-10T21:26:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.588+0000 7fc010b03640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be3004d0 0x55c7be30c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.588+0000 7fc01513c740 10 client.0 _ll_register_callbacks cb 0x55c7be21a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.588+0000 7fc010b03640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be3004d0 0x55c7be30c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39744/0 (socket says 172.21.15.59:39744) 2024-09-10T21:26:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.588+0000 7fc010b03640 1 -- 172.21.15.59:0/3014224634 learned_addr learned my addr 172.21.15.59:0/3014224634 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.588+0000 7fc00bfff640 1 --2- 172.21.15.59:0/3014224634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c7be300df0 0x55c7be309a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.588+0000 7fc011304640 1 --2- 172.21.15.59:0/3014224634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be30cd80 0x55c7be309fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.588+0000 7fc010b03640 1 -- 172.21.15.59:0/3014224634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c7be300df0 msgr2=0x55c7be309a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.588+0000 7fc010b03640 1 --2- 172.21.15.59:0/3014224634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c7be300df0 0x55c7be309a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.588+0000 7fc010b03640 1 -- 172.21.15.59:0/3014224634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be30cd80 msgr2=0x55c7be309fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.588+0000 7fc010b03640 1 --2- 172.21.15.59:0/3014224634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be30cd80 0x55c7be309fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.588+0000 7fc010b03640 1 -- 172.21.15.59:0/3014224634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7be22ec90 con 0x55c7be3004d0 2024-09-10T21:26:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.588+0000 7fc011304640 1 --2- 172.21.15.59:0/3014224634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be30cd80 0x55c7be309fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.588+0000 7fc010b03640 1 --2- 172.21.15.59:0/3014224634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be3004d0 0x55c7be30c5e0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fbffc006fd0 tx=0x7fbffc011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420783456e598b45 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.588+0000 7fbfebfff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.588+0000 7fbfebfff640 1 -- 172.21.15.59:0/3014224634 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc028070 con 0x55c7be3004d0 2024-09-10T21:26:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.588+0000 7fc01513c740 1 -- 172.21.15.59:0/3014224634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbffc00cc60 con 0x55c7be3004d0 2024-09-10T21:26:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.588+0000 7fbfebfff640 1 -- 172.21.15.59:0/3014224634 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fbffc02b3b0 con 0x55c7be3004d0 2024-09-10T21:26:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.589+0000 7fbfebfff640 1 -- 172.21.15.59:0/3014224634 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbffc015040 con 0x55c7be3004d0 2024-09-10T21:26:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.589+0000 7fc01513c740 10 client.18192 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.589+0000 7fc01513c740 1 -- 172.21.15.59:0/3014224634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c7be31b2e0 con 0x55c7be3004d0 2024-09-10T21:26:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.589+0000 7fbfebfff640 1 -- 172.21.15.59:0/3014224634 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbffc00cc60 con 0x55c7be3004d0 2024-09-10T21:26:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.589+0000 7fbfebfff640 1 -- 172.21.15.59:0/3014224634 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbffc037430 con 0x55c7be3004d0 2024-09-10T21:26:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.589+0000 7fc01513c740 10 client.18192 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.589+0000 7fc01513c740 10 client.18192 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:26:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.589+0000 7fc01513c740 20 client.18192 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.589+0000 7fc01513c740 1 --2- 172.21.15.59:0/3014224634 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55c7be31c6e0 0x55c7be31ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.589+0000 7fc01513c740 4 client.18192 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:26:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.589+0000 7fc01513c740 1 -- 172.21.15.59:0/3014224634 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7be278df0 con 0x55c7be31c6e0 2024-09-10T21:26:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.589+0000 7fc00bfff640 1 --2- 172.21.15.59:0/3014224634 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55c7be31c6e0 0x55c7be31ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.590+0000 7fbfebfff640 10 client.18192 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:26:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.590+0000 7fc00bfff640 1 --2- 172.21.15.59:0/3014224634 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55c7be31c6e0 0x55c7be31ead0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9a79ff801504c4ff server_cookie=f09a36a1768c381e in_seq=0 out_seq=0 2024-09-10T21:26:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.591+0000 7fbfebfff640 1 -- 172.21.15.59:0/3014224634 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c7be278df0 con 0x55c7be31c6e0 2024-09-10T21:26:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.591+0000 7fbfebfff640 10 client.18192 handle_command_reply: tid=0 2024-09-10T21:26:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.591+0000 7fc01513c740 1 client.18192 shutdown 2024-09-10T21:26:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.591+0000 7fc01513c740 1 -- 172.21.15.59:0/3014224634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be3004d0 msgr2=0x55c7be30c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.591+0000 7fc01513c740 1 --2- 172.21.15.59:0/3014224634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be3004d0 0x55c7be30c5e0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fbffc006fd0 tx=0x7fbffc011a50 comp rx=0 tx=0).stop 2024-09-10T21:26:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.591+0000 7fc01513c740 1 -- 172.21.15.59:0/3014224634 shutdown_connections 2024-09-10T21:26:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.591+0000 7fc01513c740 1 --2- 172.21.15.59:0/3014224634 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55c7be31c6e0 0x55c7be31ead0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.591+0000 7fc01513c740 1 --2- 172.21.15.59:0/3014224634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be30cd80 0x55c7be309fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.591+0000 7fc01513c740 1 --2- 172.21.15.59:0/3014224634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c7be300df0 0x55c7be309a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.591+0000 7fbfebfff640 0 client.18192 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:26:45.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.591+0000 7fc01513c740 1 --2- 172.21.15.59:0/3014224634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be3004d0 0x55c7be30c5e0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.591+0000 7fc01513c740 1 -- 172.21.15.59:0/3014224634 >> 172.21.15.59:0/3014224634 conn(0x55c7be2fe300 msgr2=0x55c7be303ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:45.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.591+0000 7fc01513c740 1 -- 172.21.15.59:0/3014224634 shutdown_connections 2024-09-10T21:26:45.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.591+0000 7fc01513c740 1 -- 172.21.15.59:0/3014224634 wait complete. 2024-09-10T21:26:45.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.591+0000 7fc01513c740 20 client.18192 trim_cache size 0 max 16384 2024-09-10T21:26:45.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.604+0000 7fc01513c740 1 Processor -- start 2024-09-10T21:26:45.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.604+0000 7fc01513c740 1 -- start start 2024-09-10T21:26:45.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.604+0000 7fc01513c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be3004d0 0x55c7be308f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:45.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.604+0000 7fc01513c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be300df0 0x55c7be2fdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:45.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.605+0000 7fc01513c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c7be30cd80 0x55c7be30e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:45.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.605+0000 7fc01513c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c1ac090 con 0x55c7be3004d0 2024-09-10T21:26:45.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.605+0000 7fc01513c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c1adbd0 con 0x55c7be300df0 2024-09-10T21:26:45.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.605+0000 7fc01513c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c1ac760 con 0x55c7be30cd80 2024-09-10T21:26:45.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.605+0000 7fc010b03640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be3004d0 0x55c7be308f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:45.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.605+0000 7fc010b03640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be3004d0 0x55c7be308f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39760/0 (socket says 172.21.15.59:39760) 2024-09-10T21:26:45.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.605+0000 7fc010b03640 1 -- 172.21.15.59:0/3023004737 learned_addr learned my addr 172.21.15.59:0/3023004737 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:45.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.605+0000 7fc00bfff640 1 --2- 172.21.15.59:0/3023004737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be300df0 0x55c7be2fdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:45.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.605+0000 7fc010b03640 1 -- 172.21.15.59:0/3023004737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c7be30cd80 msgr2=0x55c7be30e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:45.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.605+0000 7fc010b03640 1 --2- 172.21.15.59:0/3023004737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c7be30cd80 0x55c7be30e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.605+0000 7fc010b03640 1 -- 172.21.15.59:0/3023004737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be300df0 msgr2=0x55c7be2fdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:45.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.605+0000 7fc010b03640 1 --2- 172.21.15.59:0/3023004737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be300df0 0x55c7be2fdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.605+0000 7fc010b03640 1 -- 172.21.15.59:0/3023004737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7be2fed80 con 0x55c7be3004d0 2024-09-10T21:26:45.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.605+0000 7fc010b03640 1 --2- 172.21.15.59:0/3023004737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be3004d0 0x55c7be308f20 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00af10 tx=0x7fbffc037f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c83364b62bee80 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:45.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.605+0000 7fbff27fc640 1 -- 172.21.15.59:0/3023004737 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc028040 con 0x55c7be3004d0 2024-09-10T21:26:45.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.605+0000 7fbff27fc640 1 -- 172.21.15.59:0/3023004737 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbffc03b020 con 0x55c7be3004d0 2024-09-10T21:26:45.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.605+0000 7fbff27fc640 1 -- 172.21.15.59:0/3023004737 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc00ca60 con 0x55c7be3004d0 2024-09-10T21:26:45.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.606+0000 7fc01513c740 1 -- 172.21.15.59:0/3023004737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be3004d0 msgr2=0x55c7be308f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:45.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.606+0000 7fc01513c740 1 --2- 172.21.15.59:0/3023004737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be3004d0 0x55c7be308f20 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00af10 tx=0x7fbffc037f70 comp rx=0 tx=0).stop 2024-09-10T21:26:45.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.606+0000 7fc01513c740 1 -- 172.21.15.59:0/3023004737 shutdown_connections 2024-09-10T21:26:45.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.606+0000 7fc01513c740 1 --2- 172.21.15.59:0/3023004737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c7be30cd80 0x55c7be30e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.606+0000 7fc01513c740 1 --2- 172.21.15.59:0/3023004737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be300df0 0x55c7be2fdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.606+0000 7fc01513c740 1 --2- 172.21.15.59:0/3023004737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be3004d0 0x55c7be308f20 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.606+0000 7fc01513c740 1 -- 172.21.15.59:0/3023004737 >> 172.21.15.59:0/3023004737 conn(0x55c7be2fe300 msgr2=0x55c7be3082b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:45.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.606+0000 7fc01513c740 1 -- 172.21.15.59:0/3023004737 shutdown_connections 2024-09-10T21:26:45.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.606+0000 7fc01513c740 1 -- 172.21.15.59:0/3023004737 wait complete. 2024-09-10T21:26:45.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.606+0000 7fc01513c740 1 -- start start 2024-09-10T21:26:45.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.606+0000 7fc01513c740 1 Processor -- start 2024-09-10T21:26:45.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.607+0000 7fc01513c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be3004d0 0x55c7be315060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:45.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.607+0000 7fc01513c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be300df0 0x55c7be3155c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:45.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.607+0000 7fc01513c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c7be30cd80 0x55c7be30fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:45.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.607+0000 7fc01513c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c1ad500 con 0x55c7be300df0 2024-09-10T21:26:45.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.607+0000 7fc01513c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c1ace30 con 0x55c7be3004d0 2024-09-10T21:26:45.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.607+0000 7fc01513c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c1aa070 con 0x55c7be30cd80 2024-09-10T21:26:45.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.607+0000 7fc01513c740 10 client.0 _ll_register_callbacks cb 0x7fc004009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:45.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.607+0000 7fc00bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be300df0 0x55c7be3155c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:45.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.607+0000 7fc00bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be300df0 0x55c7be3155c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39776/0 (socket says 172.21.15.59:39776) 2024-09-10T21:26:45.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.607+0000 7fc00bfff640 1 -- 172.21.15.59:0/4265628675 learned_addr learned my addr 172.21.15.59:0/4265628675 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:45.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.607+0000 7fc010b03640 1 --2- 172.21.15.59:0/4265628675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be3004d0 0x55c7be315060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:45.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.607+0000 7fc011304640 1 --2- 172.21.15.59:0/4265628675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c7be30cd80 0x55c7be30fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:45.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.607+0000 7fc00bfff640 1 -- 172.21.15.59:0/4265628675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c7be30cd80 msgr2=0x55c7be30fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:45.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.607+0000 7fc00bfff640 1 --2- 172.21.15.59:0/4265628675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c7be30cd80 0x55c7be30fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.607+0000 7fc00bfff640 1 -- 172.21.15.59:0/4265628675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be3004d0 msgr2=0x55c7be315060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:45.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.607+0000 7fc00bfff640 1 --2- 172.21.15.59:0/4265628675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be3004d0 0x55c7be315060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.607+0000 7fc00bfff640 1 -- 172.21.15.59:0/4265628675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7be3105c0 con 0x55c7be300df0 2024-09-10T21:26:45.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.608+0000 7fc00bfff640 1 --2- 172.21.15.59:0/4265628675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be300df0 0x55c7be3155c0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fc00000c8f0 tx=0x7fc00000fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58705f31115d8a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:45.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.608+0000 7fbfebfff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:45.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.608+0000 7fbfebfff640 1 -- 172.21.15.59:0/4265628675 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0000ac5c0 con 0x55c7be300df0 2024-09-10T21:26:45.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.608+0000 7fbfebfff640 1 -- 172.21.15.59:0/4265628675 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7fc0000a8830 con 0x55c7be300df0 2024-09-10T21:26:45.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.608+0000 7fc01513c740 1 -- 172.21.15.59:0/4265628675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbffc03b020 con 0x55c7be300df0 2024-09-10T21:26:45.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.608+0000 7fbfebfff640 1 -- 172.21.15.59:0/4265628675 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc0000b10a0 con 0x55c7be300df0 2024-09-10T21:26:45.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.608+0000 7fc01513c740 10 client.18198 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:45.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.608+0000 7fc01513c740 1 -- 172.21.15.59:0/4265628675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c7be389f70 con 0x55c7be300df0 2024-09-10T21:26:45.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.608+0000 7fbfebfff640 1 -- 172.21.15.59:0/4265628675 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbffc03b020 con 0x55c7be300df0 2024-09-10T21:26:45.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.608+0000 7fbfebfff640 1 -- 172.21.15.59:0/4265628675 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc0000e9040 con 0x55c7be300df0 2024-09-10T21:26:45.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.608+0000 7fc01513c740 10 client.18198 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:45.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.608+0000 7fc01513c740 10 client.18198 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-10T21:26:45.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.608+0000 7fc01513c740 20 client.18198 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:45.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.608+0000 7fc01513c740 1 --2- 172.21.15.59:0/4265628675 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55c7be38a640 0x55c7be38ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:45.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.608+0000 7fc01513c740 4 client.18198 mds_command: new command op to 24542 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:26:45.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.608+0000 7fc01513c740 1 -- 172.21.15.59:0/4265628675 --> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c7be2748a0 con 0x55c7be38a640 2024-09-10T21:26:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.609+0000 7fc010b03640 1 --2- 172.21.15.59:0/4265628675 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55c7be38a640 0x55c7be38ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.609+0000 7fc010b03640 1 --2- 172.21.15.59:0/4265628675 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55c7be38a640 0x55c7be38ca30 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=62d4a2686093d7ae server_cookie=f69e71e75e1a3286 in_seq=0 out_seq=0 2024-09-10T21:26:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.609+0000 7fbfebfff640 10 client.18198 ms_handle_connect on v2:172.21.15.154:6836/3954687054 2024-09-10T21:26:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.609+0000 7fbfebfff640 1 -- 172.21.15.59:0/4265628675 <== mds.2 v2:172.21.15.154:6836/3954687054 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c7be2748a0 con 0x55c7be38a640 2024-09-10T21:26:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.609+0000 7fbfebfff640 10 client.18198 handle_command_reply: tid=0 2024-09-10T21:26:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.609+0000 7fc01513c740 1 client.18198 shutdown 2024-09-10T21:26:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.609+0000 7fc01513c740 1 -- 172.21.15.59:0/4265628675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be300df0 msgr2=0x55c7be3155c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.609+0000 7fc01513c740 1 --2- 172.21.15.59:0/4265628675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be300df0 0x55c7be3155c0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fc00000c8f0 tx=0x7fc00000fe60 comp rx=0 tx=0).stop 2024-09-10T21:26:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.609+0000 7fc01513c740 1 -- 172.21.15.59:0/4265628675 shutdown_connections 2024-09-10T21:26:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.609+0000 7fc01513c740 1 --2- 172.21.15.59:0/4265628675 >> [v2:172.21.15.154:6836/3954687054,v1:172.21.15.154:6837/3954687054] conn(0x55c7be38a640 0x55c7be38ca30 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.609+0000 7fc01513c740 1 --2- 172.21.15.59:0/4265628675 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55c7be30cd80 0x55c7be30fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.609+0000 7fc01513c740 1 --2- 172.21.15.59:0/4265628675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c7be300df0 0x55c7be3155c0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.609+0000 7fc01513c740 1 --2- 172.21.15.59:0/4265628675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c7be3004d0 0x55c7be315060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.609+0000 7fc01513c740 1 -- 172.21.15.59:0/4265628675 >> 172.21.15.59:0/4265628675 conn(0x55c7be2fe300 msgr2=0x55c7be303530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:45.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.610+0000 7fbfebfff640 0 client.18198 ms_handle_reset on v2:172.21.15.154:6836/3954687054 2024-09-10T21:26:45.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.610+0000 7fc01513c740 1 -- 172.21.15.59:0/4265628675 shutdown_connections 2024-09-10T21:26:45.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.610+0000 7fc01513c740 1 -- 172.21.15.59:0/4265628675 wait complete. 2024-09-10T21:26:45.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.610+0000 7fc01513c740 20 client.18198 trim_cache size 0 max 16384 2024-09-10T21:26:45.618 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:26:45.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.610+0000 7fc012d67640 1 -- 172.21.15.59:0/1237129284 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbff40b52e0 msgr2=0x7fbff40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:45.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.610+0000 7fc012d67640 1 --2- 172.21.15.59:0/1237129284 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbff40b52e0 0x7fbff40b77a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc004005fa0 tx=0x7fc004005c30 comp rx=0 tx=0).stop 2024-09-10T21:26:45.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.610+0000 7fc012d67640 1 -- 172.21.15.59:0/1237129284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc00c1087f0 msgr2=0x7fc00c1997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:45.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.610+0000 7fc012d67640 1 --2- 172.21.15.59:0/1237129284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc00c1087f0 0x7fc00c1997c0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fc00000c920 tx=0x7fc00000cde0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.610+0000 7fc012d67640 1 -- 172.21.15.59:0/1237129284 shutdown_connections 2024-09-10T21:26:45.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.610+0000 7fc012d67640 1 --2- 172.21.15.59:0/1237129284 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fbff40b52e0 0x7fbff40b77a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.610+0000 7fc012d67640 1 --2- 172.21.15.59:0/1237129284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc00c109170 0x7fc00c19eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.610+0000 7fc012d67640 1 --2- 172.21.15.59:0/1237129284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc00c1087f0 0x7fc00c1997c0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.610+0000 7fc012d67640 1 --2- 172.21.15.59:0/1237129284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc00c102de0 0x7fc00c199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:45.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.610+0000 7fc012d67640 1 -- 172.21.15.59:0/1237129284 >> 172.21.15.59:0/1237129284 conn(0x7fc00c0fe830 msgr2=0x7fc00c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:45.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.611+0000 7fc012d67640 1 -- 172.21.15.59:0/1237129284 shutdown_connections 2024-09-10T21:26:45.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:45.611+0000 7fc012d67640 1 -- 172.21.15.59:0/1237129284 wait complete. 2024-09-10T21:26:46.370 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T21:26:46.628 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:26:47.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.141+0000 7f788eb80640 1 -- 172.21.15.59:0/3496304048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7888108060 msgr2=0x7f788810e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:47.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.141+0000 7f788eb80640 1 --2- 172.21.15.59:0/3496304048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7888108060 0x7f788810e860 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f7880009ca0 tx=0x7f788002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.141+0000 7f788eb80640 1 -- 172.21.15.59:0/3496304048 shutdown_connections 2024-09-10T21:26:47.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.141+0000 7f788eb80640 1 --2- 172.21.15.59:0/3496304048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7888108060 0x7f788810e860 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.141+0000 7f788eb80640 1 --2- 172.21.15.59:0/3496304048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78881076e0 0x7f7888107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.141+0000 7f788eb80640 1 --2- 172.21.15.59:0/3496304048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7888101cd0 0x7f78881020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.141+0000 7f788eb80640 1 -- 172.21.15.59:0/3496304048 >> 172.21.15.59:0/3496304048 conn(0x7f78880fd700 msgr2=0x7f78880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:47.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.141+0000 7f788eb80640 1 -- 172.21.15.59:0/3496304048 shutdown_connections 2024-09-10T21:26:47.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.142+0000 7f788eb80640 1 -- 172.21.15.59:0/3496304048 wait complete. 2024-09-10T21:26:47.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.142+0000 7f788eb80640 1 Processor -- start 2024-09-10T21:26:47.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.142+0000 7f788eb80640 1 -- start start 2024-09-10T21:26:47.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.142+0000 7f788eb80640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7888101cd0 0x7f788819a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:47.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.142+0000 7f788eb80640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78881076e0 0x7f788819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:47.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.142+0000 7f788eb80640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7888108060 0x7f788819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:47.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.142+0000 7f788eb80640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7888111d20 con 0x7f78881076e0 2024-09-10T21:26:47.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.142+0000 7f788eb80640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7888111ba0 con 0x7f7888101cd0 2024-09-10T21:26:47.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.142+0000 7f788eb80640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7888111ea0 con 0x7f7888108060 2024-09-10T21:26:47.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.142+0000 7f7887fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78881076e0 0x7f788819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:47.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.142+0000 7f7887fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78881076e0 0x7f788819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39792/0 (socket says 172.21.15.59:39792) 2024-09-10T21:26:47.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.142+0000 7f7887fff640 1 -- 172.21.15.59:0/744659470 learned_addr learned my addr 172.21.15.59:0/744659470 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:47.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.142+0000 7f788d11d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7888108060 0x7f788819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:47.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.143+0000 7f788c91c640 1 --2- 172.21.15.59:0/744659470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7888101cd0 0x7f788819a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:47.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.143+0000 7f7887fff640 1 -- 172.21.15.59:0/744659470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7888108060 msgr2=0x7f788819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:47.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.143+0000 7f7887fff640 1 --2- 172.21.15.59:0/744659470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7888108060 0x7f788819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.143+0000 7f7887fff640 1 -- 172.21.15.59:0/744659470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7888101cd0 msgr2=0x7f788819a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:47.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.143+0000 7f7887fff640 1 --2- 172.21.15.59:0/744659470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7888101cd0 0x7f788819a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.143+0000 7f7887fff640 1 -- 172.21.15.59:0/744659470 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78881a5430 con 0x7f78881076e0 2024-09-10T21:26:47.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.143+0000 7f7887fff640 1 --2- 172.21.15.59:0/744659470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78881076e0 0x7f788819a590 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f787400d950 tx=0x7f787400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:47.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.143+0000 7f7885ffb640 1 -- 172.21.15.59:0/744659470 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7874017030 con 0x7f78881076e0 2024-09-10T21:26:47.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.143+0000 7f7885ffb640 1 -- 172.21.15.59:0/744659470 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7874004020 con 0x7f78881076e0 2024-09-10T21:26:47.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.143+0000 7f788eb80640 1 -- 172.21.15.59:0/744659470 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78881a5720 con 0x7f78881076e0 2024-09-10T21:26:47.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.143+0000 7f7885ffb640 1 -- 172.21.15.59:0/744659470 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78740047a0 con 0x7f78881076e0 2024-09-10T21:26:47.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.143+0000 7f788eb80640 1 -- 172.21.15.59:0/744659470 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78881a5cb0 con 0x7f78881076e0 2024-09-10T21:26:47.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.146+0000 7f7890f55740 1 Processor -- start 2024-09-10T21:26:47.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.146+0000 7f7885ffb640 1 -- 172.21.15.59:0/744659470 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f7874009a30 con 0x7f78881076e0 2024-09-10T21:26:47.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.146+0000 7f7890f55740 1 -- start start 2024-09-10T21:26:47.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.146+0000 7f7890f55740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a1544d0 0x55b81a1548b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:47.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.146+0000 7f7890f55740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a154df0 0x55b81a164c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:47.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.146+0000 7f7890f55740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a165190 0x55b81a167580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:47.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.146+0000 7f7890f55740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b81a0caea0 con 0x55b81a165190 2024-09-10T21:26:47.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.146+0000 7f7890f55740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b81a0ba2d0 con 0x55b81a154df0 2024-09-10T21:26:47.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.146+0000 7f7890f55740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b81a0be0e0 con 0x55b81a1544d0 2024-09-10T21:26:47.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.147+0000 7f7887fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a165190 0x55b81a167580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:47.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.147+0000 7f7887fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a165190 0x55b81a167580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39804/0 (socket says 172.21.15.59:39804) 2024-09-10T21:26:47.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.147+0000 7f7887fff640 1 -- 172.21.15.59:0/3084496361 learned_addr learned my addr 172.21.15.59:0/3084496361 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:47.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.147+0000 7f788c91c640 1 --2- 172.21.15.59:0/3084496361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a154df0 0x55b81a164c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:47.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.147+0000 7f788d11d640 1 --2- 172.21.15.59:0/3084496361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a1544d0 0x55b81a1548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:47.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.147+0000 7f7887fff640 1 -- 172.21.15.59:0/3084496361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a1544d0 msgr2=0x55b81a1548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:47.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.147+0000 7f7887fff640 1 --2- 172.21.15.59:0/3084496361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a1544d0 0x55b81a1548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.147+0000 7f7887fff640 1 -- 172.21.15.59:0/3084496361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a154df0 msgr2=0x55b81a164c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:47.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.147+0000 7f7887fff640 1 --2- 172.21.15.59:0/3084496361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a154df0 0x55b81a164c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.147+0000 7f7887fff640 1 -- 172.21.15.59:0/3084496361 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b819e18650 con 0x55b81a165190 2024-09-10T21:26:47.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.147+0000 7f7885ffb640 1 --2- 172.21.15.59:0/744659470 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f78780b5360 0x7f78780b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:47.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.147+0000 7f788d11d640 1 --2- 172.21.15.59:0/744659470 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f78780b5360 0x7f78780b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:47.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.147+0000 7f7887fff640 1 --2- 172.21.15.59:0/3084496361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a165190 0x55b81a167580 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f78740eb4c0 tx=0x7f78740eb980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e53d289691be25 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:47.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.147+0000 7f7885ffb640 1 -- 172.21.15.59:0/744659470 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f78740e54d0 con 0x7f78881076e0 2024-09-10T21:26:47.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.148+0000 7f7872ffd640 1 -- 172.21.15.59:0/3084496361 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78740a7b60 con 0x55b81a165190 2024-09-10T21:26:47.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.148+0000 7f7872ffd640 1 -- 172.21.15.59:0/3084496361 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78740ab7d0 con 0x55b81a165190 2024-09-10T21:26:47.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.148+0000 7f7872ffd640 1 -- 172.21.15.59:0/3084496361 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78740ab430 con 0x55b81a165190 2024-09-10T21:26:47.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.148+0000 7f7890f55740 1 -- 172.21.15.59:0/3084496361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a165190 msgr2=0x55b81a167580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:47.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.148+0000 7f7890f55740 1 --2- 172.21.15.59:0/3084496361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a165190 0x55b81a167580 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f78740eb4c0 tx=0x7f78740eb980 comp rx=0 tx=0).stop 2024-09-10T21:26:47.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.148+0000 7f788d11d640 1 --2- 172.21.15.59:0/744659470 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f78780b5360 0x7f78780b7820 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7880006010 tx=0x7f7880005fa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:47.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.148+0000 7f7890f55740 1 -- 172.21.15.59:0/3084496361 shutdown_connections 2024-09-10T21:26:47.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.148+0000 7f7890f55740 1 --2- 172.21.15.59:0/3084496361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a165190 0x55b81a167580 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.148+0000 7f7890f55740 1 --2- 172.21.15.59:0/3084496361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a154df0 0x55b81a164c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.148+0000 7f7890f55740 1 --2- 172.21.15.59:0/3084496361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a1544d0 0x55b81a1548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.148+0000 7f7890f55740 1 -- 172.21.15.59:0/3084496361 >> 172.21.15.59:0/3084496361 conn(0x55b81a152300 msgr2=0x55b81a1534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:47.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.148+0000 7f7890f55740 1 -- 172.21.15.59:0/3084496361 shutdown_connections 2024-09-10T21:26:47.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.148+0000 7f7890f55740 1 -- 172.21.15.59:0/3084496361 wait complete. 2024-09-10T21:26:47.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.149+0000 7f7890f55740 1 -- start start 2024-09-10T21:26:47.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.149+0000 7f7890f55740 1 Processor -- start 2024-09-10T21:26:47.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.149+0000 7f7890f55740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a1544d0 0x55b81a164ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:47.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.149+0000 7f7890f55740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a154df0 0x55b81a161f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:47.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.149+0000 7f7890f55740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a165190 0x55b81a162590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:47.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.149+0000 7f7890f55740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b819f1b700 con 0x55b81a154df0 2024-09-10T21:26:47.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.149+0000 7f7890f55740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b81a055160 con 0x55b81a165190 2024-09-10T21:26:47.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.149+0000 7f7890f55740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55b81a167e40 con 0x55b81a1544d0 2024-09-10T21:26:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.149+0000 7f7890f55740 10 client.0 _ll_register_callbacks cb 0x55b81a06e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f7887fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a154df0 0x55b81a161f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f7887fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a154df0 0x55b81a161f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39812/0 (socket says 172.21.15.59:39812) 2024-09-10T21:26:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f7887fff640 1 -- 172.21.15.59:0/2997879784 learned_addr learned my addr 172.21.15.59:0/2997879784 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f788c91c640 1 --2- 172.21.15.59:0/2997879784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a1544d0 0x55b81a164ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f788d11d640 1 --2- 172.21.15.59:0/2997879784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a165190 0x55b81a162590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f7887fff640 1 -- 172.21.15.59:0/2997879784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a1544d0 msgr2=0x55b81a164ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f7887fff640 1 --2- 172.21.15.59:0/2997879784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a1544d0 0x55b81a164ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f7887fff640 1 -- 172.21.15.59:0/2997879784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a165190 msgr2=0x55b81a162590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f7887fff640 1 --2- 172.21.15.59:0/2997879784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a165190 0x55b81a162590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f7887fff640 1 -- 172.21.15.59:0/2997879784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b81a082c90 con 0x55b81a154df0 2024-09-10T21:26:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f788c91c640 1 --2- 172.21.15.59:0/2997879784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a1544d0 0x55b81a164ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:47.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f788d11d640 1 --2- 172.21.15.59:0/2997879784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a165190 0x55b81a162590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:26:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f7887fff640 1 --2- 172.21.15.59:0/2997879784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a154df0 0x55b81a161f10 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f78740abc50 tx=0x7f78740e57d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df8aec3ab529a1e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f7867fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f7867fff640 1 -- 172.21.15.59:0/2997879784 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78740ab610 con 0x55b81a154df0 2024-09-10T21:26:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f7867fff640 1 -- 172.21.15.59:0/2997879784 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f78740041d0 con 0x55b81a154df0 2024-09-10T21:26:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f7890f55740 1 -- 172.21.15.59:0/2997879784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78740ab7d0 con 0x55b81a154df0 2024-09-10T21:26:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f7867fff640 1 -- 172.21.15.59:0/2997879784 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f78740aba90 con 0x55b81a154df0 2024-09-10T21:26:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f7890f55740 10 client.18210 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.150+0000 7f7890f55740 1 -- 172.21.15.59:0/2997879784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b81a1737e0 con 0x55b81a154df0 2024-09-10T21:26:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.151+0000 7f7867fff640 1 -- 172.21.15.59:0/2997879784 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78740ab7d0 con 0x55b81a154df0 2024-09-10T21:26:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.151+0000 7f7867fff640 1 -- 172.21.15.59:0/2997879784 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f78740e50e0 con 0x55b81a154df0 2024-09-10T21:26:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.151+0000 7f7890f55740 10 client.18210 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.151+0000 7f7890f55740 10 client.18210 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:26:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.151+0000 7f7890f55740 20 client.18210 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:47.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.151+0000 7f7890f55740 1 --2- 172.21.15.59:0/2997879784 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55b81a174b30 0x55b81a176f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.151+0000 7f7890f55740 4 client.18210 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:26:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.151+0000 7f7890f55740 1 -- 172.21.15.59:0/2997879784 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b81a0ccdf0 con 0x55b81a174b30 2024-09-10T21:26:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.151+0000 7f788c91c640 1 --2- 172.21.15.59:0/2997879784 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55b81a174b30 0x55b81a176f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.151+0000 7f788c91c640 1 --2- 172.21.15.59:0/2997879784 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55b81a174b30 0x55b81a176f20 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ec07b41bab67e6b1 server_cookie=75dd9b1a7870b04 in_seq=0 out_seq=0 2024-09-10T21:26:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.151+0000 7f7867fff640 10 client.18210 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:26:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.152+0000 7f7867fff640 1 -- 172.21.15.59:0/2997879784 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b81a0ccdf0 con 0x55b81a174b30 2024-09-10T21:26:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.152+0000 7f7867fff640 10 client.18210 handle_command_reply: tid=0 2024-09-10T21:26:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.152+0000 7f7890f55740 1 client.18210 shutdown 2024-09-10T21:26:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.152+0000 7f7890f55740 1 -- 172.21.15.59:0/2997879784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a154df0 msgr2=0x55b81a161f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.152+0000 7f7890f55740 1 --2- 172.21.15.59:0/2997879784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a154df0 0x55b81a161f10 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f78740abc50 tx=0x7f78740e57d0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.152+0000 7f7890f55740 1 -- 172.21.15.59:0/2997879784 shutdown_connections 2024-09-10T21:26:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.152+0000 7f7890f55740 1 --2- 172.21.15.59:0/2997879784 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55b81a174b30 0x55b81a176f20 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.152+0000 7f7890f55740 1 --2- 172.21.15.59:0/2997879784 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a165190 0x55b81a162590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.152+0000 7f7890f55740 1 --2- 172.21.15.59:0/2997879784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a154df0 0x55b81a161f10 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.152+0000 7f7890f55740 1 --2- 172.21.15.59:0/2997879784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a1544d0 0x55b81a164ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.152+0000 7f7890f55740 1 -- 172.21.15.59:0/2997879784 >> 172.21.15.59:0/2997879784 conn(0x55b81a152300 msgr2=0x55b81a157e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.152+0000 7f7867fff640 0 client.18210 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:26:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.152+0000 7f7890f55740 1 -- 172.21.15.59:0/2997879784 shutdown_connections 2024-09-10T21:26:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.152+0000 7f7890f55740 1 -- 172.21.15.59:0/2997879784 wait complete. 2024-09-10T21:26:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.153+0000 7f7890f55740 20 client.18210 trim_cache size 0 max 16384 2024-09-10T21:26:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.166+0000 7f7890f55740 1 Processor -- start 2024-09-10T21:26:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.166+0000 7f7890f55740 1 -- start start 2024-09-10T21:26:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.166+0000 7f7890f55740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a1544d0 0x55b81a171110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.166+0000 7f7890f55740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a154df0 0x55b81a157d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.166+0000 7f7890f55740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a165190 0x55b81a163540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.166+0000 7f7890f55740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78881ac130 con 0x55b81a1544d0 2024-09-10T21:26:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.166+0000 7f7890f55740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78881adc70 con 0x55b81a154df0 2024-09-10T21:26:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.166+0000 7f7890f55740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f78881ac800 con 0x55b81a165190 2024-09-10T21:26:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.167+0000 7f788c91c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a1544d0 0x55b81a171110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.167+0000 7f788c91c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a1544d0 0x55b81a171110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39828/0 (socket says 172.21.15.59:39828) 2024-09-10T21:26:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.167+0000 7f788c91c640 1 -- 172.21.15.59:0/1621416672 learned_addr learned my addr 172.21.15.59:0/1621416672 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.167+0000 7f788d11d640 1 --2- 172.21.15.59:0/1621416672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a165190 0x55b81a163540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.167+0000 7f7887fff640 1 --2- 172.21.15.59:0/1621416672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a154df0 0x55b81a157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.167+0000 7f788c91c640 1 -- 172.21.15.59:0/1621416672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a165190 msgr2=0x55b81a163540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.167+0000 7f788c91c640 1 --2- 172.21.15.59:0/1621416672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a165190 0x55b81a163540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.167+0000 7f788c91c640 1 -- 172.21.15.59:0/1621416672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a154df0 msgr2=0x55b81a157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.167+0000 7f788c91c640 1 --2- 172.21.15.59:0/1621416672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a154df0 0x55b81a157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.167+0000 7f788c91c640 1 -- 172.21.15.59:0/1621416672 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b81a14dde0 con 0x55b81a1544d0 2024-09-10T21:26:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.167+0000 7f7887fff640 1 --2- 172.21.15.59:0/1621416672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a154df0 0x55b81a157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:47.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.167+0000 7f788d11d640 1 --2- 172.21.15.59:0/1621416672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a165190 0x55b81a163540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.167+0000 7f788c91c640 1 --2- 172.21.15.59:0/1621416672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a1544d0 0x55b81a171110 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f787c00acf0 tx=0x7f787c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba66fa109400f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.167+0000 7f78727fc640 1 -- 172.21.15.59:0/1621416672 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c004020 con 0x55b81a1544d0 2024-09-10T21:26:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.167+0000 7f78727fc640 1 -- 172.21.15.59:0/1621416672 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f787c0041c0 con 0x55b81a1544d0 2024-09-10T21:26:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.167+0000 7f78727fc640 1 -- 172.21.15.59:0/1621416672 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c024760 con 0x55b81a1544d0 2024-09-10T21:26:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.168+0000 7f7890f55740 1 -- 172.21.15.59:0/1621416672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a1544d0 msgr2=0x55b81a171110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:47.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.168+0000 7f7890f55740 1 --2- 172.21.15.59:0/1621416672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a1544d0 0x55b81a171110 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f787c00acf0 tx=0x7f787c010800 comp rx=0 tx=0).stop 2024-09-10T21:26:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.168+0000 7f7890f55740 1 -- 172.21.15.59:0/1621416672 shutdown_connections 2024-09-10T21:26:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.168+0000 7f7890f55740 1 --2- 172.21.15.59:0/1621416672 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a165190 0x55b81a163540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.168+0000 7f7890f55740 1 --2- 172.21.15.59:0/1621416672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a154df0 0x55b81a157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.168+0000 7f7890f55740 1 --2- 172.21.15.59:0/1621416672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a1544d0 0x55b81a171110 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.168+0000 7f7890f55740 1 -- 172.21.15.59:0/1621416672 >> 172.21.15.59:0/1621416672 conn(0x55b81a152300 msgr2=0x55b81a157610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.168+0000 7f7890f55740 1 -- 172.21.15.59:0/1621416672 shutdown_connections 2024-09-10T21:26:47.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.168+0000 7f7890f55740 1 -- 172.21.15.59:0/1621416672 wait complete. 2024-09-10T21:26:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.169+0000 7f7890f55740 1 -- start start 2024-09-10T21:26:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.169+0000 7f7890f55740 1 Processor -- start 2024-09-10T21:26:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.169+0000 7f7890f55740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a1544d0 0x55b81a1788e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.169+0000 7f7890f55740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a154df0 0x55b81a178e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.169+0000 7f7890f55740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a165190 0x55b81a1da670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:47.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.169+0000 7f7890f55740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78881ad5a0 con 0x55b81a165190 2024-09-10T21:26:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.169+0000 7f7890f55740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78881aced0 con 0x55b81a1544d0 2024-09-10T21:26:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.169+0000 7f7890f55740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f78881aa130 con 0x55b81a154df0 2024-09-10T21:26:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.169+0000 7f7890f55740 10 client.0 _ll_register_callbacks cb 0x7f787c00a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.169+0000 7f788d11d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a165190 0x55b81a1da670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.169+0000 7f788d11d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a165190 0x55b81a1da670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39838/0 (socket says 172.21.15.59:39838) 2024-09-10T21:26:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.169+0000 7f788d11d640 1 -- 172.21.15.59:0/2797967803 learned_addr learned my addr 172.21.15.59:0/2797967803 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.169+0000 7f7887fff640 1 --2- 172.21.15.59:0/2797967803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a154df0 0x55b81a178e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.170+0000 7f788c91c640 1 --2- 172.21.15.59:0/2797967803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a1544d0 0x55b81a1788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.170+0000 7f788d11d640 1 -- 172.21.15.59:0/2797967803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a154df0 msgr2=0x55b81a178e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.170+0000 7f788d11d640 1 --2- 172.21.15.59:0/2797967803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a154df0 0x55b81a178e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.170+0000 7f788d11d640 1 -- 172.21.15.59:0/2797967803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a1544d0 msgr2=0x55b81a1788e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:47.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.170+0000 7f788d11d640 1 --2- 172.21.15.59:0/2797967803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a1544d0 0x55b81a1788e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.170+0000 7f788d11d640 1 -- 172.21.15.59:0/2797967803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b81a1dadb0 con 0x55b81a165190 2024-09-10T21:26:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.170+0000 7f788c91c640 1 --2- 172.21.15.59:0/2797967803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a1544d0 0x55b81a1788e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:26:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.170+0000 7f788d11d640 1 --2- 172.21.15.59:0/2797967803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a165190 0x55b81a1da670 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f7880031a00 tx=0x7f788002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4426966c72224d5e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.170+0000 7f7867fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.170+0000 7f7867fff640 1 -- 172.21.15.59:0/2797967803 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7880004040 con 0x55b81a165190 2024-09-10T21:26:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.170+0000 7f7867fff640 1 -- 172.21.15.59:0/2797967803 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f7880042030 con 0x55b81a165190 2024-09-10T21:26:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.170+0000 7f7890f55740 1 -- 172.21.15.59:0/2797967803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f787c0041c0 con 0x55b81a165190 2024-09-10T21:26:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.170+0000 7f7867fff640 1 -- 172.21.15.59:0/2797967803 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f78800041e0 con 0x55b81a165190 2024-09-10T21:26:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.170+0000 7f7890f55740 10 client.18216 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.170+0000 7f7890f55740 1 -- 172.21.15.59:0/2797967803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b81a1e2230 con 0x55b81a165190 2024-09-10T21:26:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.170+0000 7f7867fff640 1 -- 172.21.15.59:0/2797967803 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f787c0041c0 con 0x55b81a165190 2024-09-10T21:26:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.171+0000 7f7867fff640 1 -- 172.21.15.59:0/2797967803 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f788002fba0 con 0x55b81a165190 2024-09-10T21:26:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.171+0000 7f7890f55740 10 client.18216 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:47.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.171+0000 7f7890f55740 10 client.18216 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-10T21:26:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.171+0000 7f7890f55740 20 client.18216 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.171+0000 7f7890f55740 1 --2- 172.21.15.59:0/2797967803 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55b81a1e29b0 0x55b81a1e4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.171+0000 7f7890f55740 4 client.18216 mds_command: new command op to 24550 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:26:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.171+0000 7f7890f55740 1 -- 172.21.15.59:0/2797967803 --> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b81a0c88a0 con 0x55b81a1e29b0 2024-09-10T21:26:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.171+0000 7f788c91c640 1 --2- 172.21.15.59:0/2797967803 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55b81a1e29b0 0x55b81a1e4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.171+0000 7f788c91c640 1 --2- 172.21.15.59:0/2797967803 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55b81a1e29b0 0x55b81a1e4dd0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fcffd4fd8bf51f6d server_cookie=70a01543f929ad6d in_seq=0 out_seq=0 2024-09-10T21:26:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.171+0000 7f7867fff640 10 client.18216 ms_handle_connect on v2:172.21.15.192:6838/677733026 2024-09-10T21:26:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.172+0000 7f7867fff640 1 -- 172.21.15.59:0/2797967803 <== mds.1 v2:172.21.15.192:6838/677733026 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b81a0c88a0 con 0x55b81a1e29b0 2024-09-10T21:26:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.172+0000 7f7867fff640 10 client.18216 handle_command_reply: tid=0 2024-09-10T21:26:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.172+0000 7f7890f55740 1 client.18216 shutdown 2024-09-10T21:26:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.172+0000 7f7890f55740 1 -- 172.21.15.59:0/2797967803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a165190 msgr2=0x55b81a1da670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.172+0000 7f7890f55740 1 --2- 172.21.15.59:0/2797967803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a165190 0x55b81a1da670 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f7880031a00 tx=0x7f788002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.172+0000 7f7890f55740 1 -- 172.21.15.59:0/2797967803 shutdown_connections 2024-09-10T21:26:47.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.172+0000 7f7890f55740 1 --2- 172.21.15.59:0/2797967803 >> [v2:172.21.15.192:6838/677733026,v1:172.21.15.192:6839/677733026] conn(0x55b81a1e29b0 0x55b81a1e4dd0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.172+0000 7f7890f55740 1 --2- 172.21.15.59:0/2797967803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b81a165190 0x55b81a1da670 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.172+0000 7f7890f55740 1 --2- 172.21.15.59:0/2797967803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b81a154df0 0x55b81a178e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.172+0000 7f7890f55740 1 --2- 172.21.15.59:0/2797967803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b81a1544d0 0x55b81a1788e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.172+0000 7f7890f55740 1 -- 172.21.15.59:0/2797967803 >> 172.21.15.59:0/2797967803 conn(0x55b81a152300 msgr2=0x55b81a150c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:47.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.172+0000 7f7867fff640 0 client.18216 ms_handle_reset on v2:172.21.15.192:6838/677733026 2024-09-10T21:26:47.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.172+0000 7f7890f55740 1 -- 172.21.15.59:0/2797967803 shutdown_connections 2024-09-10T21:26:47.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.172+0000 7f7890f55740 1 -- 172.21.15.59:0/2797967803 wait complete. 2024-09-10T21:26:47.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.172+0000 7f7890f55740 20 client.18216 trim_cache size 0 max 16384 2024-09-10T21:26:47.190 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:26:47.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.173+0000 7f788eb80640 1 -- 172.21.15.59:0/744659470 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f78780b5360 msgr2=0x7f78780b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:47.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.173+0000 7f788eb80640 1 --2- 172.21.15.59:0/744659470 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f78780b5360 0x7f78780b7820 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7880006010 tx=0x7f7880005fa0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.173+0000 7f788eb80640 1 -- 172.21.15.59:0/744659470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78881076e0 msgr2=0x7f788819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:47.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.173+0000 7f788eb80640 1 --2- 172.21.15.59:0/744659470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78881076e0 0x7f788819a590 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f787400d950 tx=0x7f787400de10 comp rx=0 tx=0).stop 2024-09-10T21:26:47.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.173+0000 7f788eb80640 1 -- 172.21.15.59:0/744659470 shutdown_connections 2024-09-10T21:26:47.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.173+0000 7f788eb80640 1 --2- 172.21.15.59:0/744659470 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f78780b5360 0x7f78780b7820 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.173+0000 7f788eb80640 1 --2- 172.21.15.59:0/744659470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7888108060 0x7f788819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.173+0000 7f788eb80640 1 --2- 172.21.15.59:0/744659470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78881076e0 0x7f788819a590 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.173+0000 7f788eb80640 1 --2- 172.21.15.59:0/744659470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7888101cd0 0x7f788819a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.173+0000 7f788eb80640 1 -- 172.21.15.59:0/744659470 >> 172.21.15.59:0/744659470 conn(0x7f78880fd700 msgr2=0x7f78880fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.173+0000 7f788eb80640 1 -- 172.21.15.59:0/744659470 shutdown_connections 2024-09-10T21:26:47.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:47.173+0000 7f788eb80640 1 -- 172.21.15.59:0/744659470 wait complete. 2024-09-10T21:26:47.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:47 smithi059 ceph-mon[30888]: pgmap v685: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-10T21:26:47.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:47 smithi154 ceph-mon[35041]: pgmap v685: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-10T21:26:47.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:47 smithi192 ceph-mon[35363]: pgmap v685: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-10T21:26:47.889 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T21:26:48.149 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:26:48.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.606+0000 7f3728eca640 1 -- 172.21.15.59:0/219689848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3724102dc0 msgr2=0x7f37241031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:48.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.606+0000 7f3728eca640 1 --2- 172.21.15.59:0/219689848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3724102dc0 0x7f37241031a0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f3714009900 tx=0x7f371402a410 comp rx=0 tx=0).stop 2024-09-10T21:26:48.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.606+0000 7f3728eca640 1 -- 172.21.15.59:0/219689848 shutdown_connections 2024-09-10T21:26:48.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.606+0000 7f3728eca640 1 --2- 172.21.15.59:0/219689848 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3724109150 0x7f372410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.606+0000 7f3728eca640 1 --2- 172.21.15.59:0/219689848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37241087d0 0x7f3724108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.606+0000 7f3728eca640 1 --2- 172.21.15.59:0/219689848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3724102dc0 0x7f37241031a0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.606+0000 7f3728eca640 1 -- 172.21.15.59:0/219689848 >> 172.21.15.59:0/219689848 conn(0x7f37240fe830 msgr2=0x7f3724100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:48.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.606+0000 7f3728eca640 1 -- 172.21.15.59:0/219689848 shutdown_connections 2024-09-10T21:26:48.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.606+0000 7f3728eca640 1 -- 172.21.15.59:0/219689848 wait complete. 2024-09-10T21:26:48.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.607+0000 7f3728eca640 1 Processor -- start 2024-09-10T21:26:48.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.607+0000 7f3728eca640 1 -- start start 2024-09-10T21:26:48.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.607+0000 7f3728eca640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3724102dc0 0x7f37240754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:48.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.607+0000 7f3728eca640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37241087d0 0x7f37240759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:48.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.607+0000 7f3728eca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3724109150 0x7f3724075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:48.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.607+0000 7f3728eca640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3724112e10 con 0x7f3724102dc0 2024-09-10T21:26:48.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.607+0000 7f3728eca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3724112c90 con 0x7f3724109150 2024-09-10T21:26:48.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.607+0000 7f3728eca640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3724112f90 con 0x7f37241087d0 2024-09-10T21:26:48.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.608+0000 7f372259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3724102dc0 0x7f37240754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:48.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.608+0000 7f372259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3724102dc0 0x7f37240754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39854/0 (socket says 172.21.15.59:39854) 2024-09-10T21:26:48.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.608+0000 7f372259c640 1 -- 172.21.15.59:0/1867896821 learned_addr learned my addr 172.21.15.59:0/1867896821 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:48.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.608+0000 7f3722d9d640 1 --2- 172.21.15.59:0/1867896821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3724109150 0x7f3724075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:48.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.608+0000 7f3721d9b640 1 --2- 172.21.15.59:0/1867896821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37241087d0 0x7f37240759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:48.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.608+0000 7f372259c640 1 -- 172.21.15.59:0/1867896821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37241087d0 msgr2=0x7f37240759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:48.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.608+0000 7f372259c640 1 --2- 172.21.15.59:0/1867896821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37241087d0 0x7f37240759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.608+0000 7f372259c640 1 -- 172.21.15.59:0/1867896821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3724109150 msgr2=0x7f3724075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:48.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.608+0000 7f372259c640 1 --2- 172.21.15.59:0/1867896821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3724109150 0x7f3724075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.608+0000 7f372259c640 1 -- 172.21.15.59:0/1867896821 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37241a7660 con 0x7f3724102dc0 2024-09-10T21:26:48.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.608+0000 7f3722d9d640 1 --2- 172.21.15.59:0/1867896821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3724109150 0x7f3724075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:48.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.608+0000 7f372259c640 1 --2- 172.21.15.59:0/1867896821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3724102dc0 0x7f37240754a0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f3714006010 tx=0x7f37140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:48.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.608+0000 7f37137fe640 1 -- 172.21.15.59:0/1867896821 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371403f030 con 0x7f3724102dc0 2024-09-10T21:26:48.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.608+0000 7f37137fe640 1 -- 172.21.15.59:0/1867896821 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3714003800 con 0x7f3724102dc0 2024-09-10T21:26:48.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.608+0000 7f3728eca640 1 -- 172.21.15.59:0/1867896821 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37241a78f0 con 0x7f3724102dc0 2024-09-10T21:26:48.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.608+0000 7f37137fe640 1 -- 172.21.15.59:0/1867896821 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714035070 con 0x7f3724102dc0 2024-09-10T21:26:48.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.608+0000 7f3728eca640 1 -- 172.21.15.59:0/1867896821 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37241a7e20 con 0x7f3724102dc0 2024-09-10T21:26:48.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.611+0000 7f37137fe640 1 -- 172.21.15.59:0/1867896821 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f3714031b10 con 0x7f3724102dc0 2024-09-10T21:26:48.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.611+0000 7f372b29f740 1 Processor -- start 2024-09-10T21:26:48.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.611+0000 7f372b29f740 1 -- start start 2024-09-10T21:26:48.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.611+0000 7f372b29f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a16a4d0 0x55a60a16a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:48.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.611+0000 7f372b29f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a16adf0 0x55a60a176840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:48.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.611+0000 7f372b29f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a176d80 0x55a60a179170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:48.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.611+0000 7f372b29f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a60a0e0ea0 con 0x55a60a176d80 2024-09-10T21:26:48.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.611+0000 7f372b29f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a60a0d02d0 con 0x55a60a16adf0 2024-09-10T21:26:48.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.611+0000 7f372b29f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a60a0d40e0 con 0x55a60a16a4d0 2024-09-10T21:26:48.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.611+0000 7f3721d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a176d80 0x55a60a179170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:48.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.611+0000 7f3721d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a176d80 0x55a60a179170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39868/0 (socket says 172.21.15.59:39868) 2024-09-10T21:26:48.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.611+0000 7f3721d9b640 1 -- 172.21.15.59:0/873172055 learned_addr learned my addr 172.21.15.59:0/873172055 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:48.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.611+0000 7f3722d9d640 1 --2- 172.21.15.59:0/873172055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a16a4d0 0x55a60a16a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:48.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.612+0000 7f372259c640 1 --2- 172.21.15.59:0/873172055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a16adf0 0x55a60a176840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:48.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.612+0000 7f3721d9b640 1 -- 172.21.15.59:0/873172055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a16a4d0 msgr2=0x55a60a16a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:48.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.612+0000 7f3721d9b640 1 --2- 172.21.15.59:0/873172055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a16a4d0 0x55a60a16a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.612+0000 7f3721d9b640 1 -- 172.21.15.59:0/873172055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a16adf0 msgr2=0x55a60a176840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:48.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.612+0000 7f3721d9b640 1 --2- 172.21.15.59:0/873172055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a16adf0 0x55a60a176840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.612+0000 7f3721d9b640 1 -- 172.21.15.59:0/873172055 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a609e2e650 con 0x55a60a176d80 2024-09-10T21:26:48.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.612+0000 7f3721d9b640 1 --2- 172.21.15.59:0/873172055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a176d80 0x55a60a179170 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f371800cc40 tx=0x7f371800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6228b355b38a4425 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:48.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.612+0000 7f37137fe640 1 --2- 172.21.15.59:0/1867896821 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f370c0b5360 0x7f370c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:48.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.612+0000 7f3722d9d640 1 --2- 172.21.15.59:0/1867896821 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f370c0b5360 0x7f370c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:48.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.612+0000 7f37137fe640 1 -- 172.21.15.59:0/1867896821 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3714106590 con 0x7f3724102dc0 2024-09-10T21:26:48.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.612+0000 7f3710ff9640 1 -- 172.21.15.59:0/873172055 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3718014070 con 0x55a60a176d80 2024-09-10T21:26:48.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.612+0000 7f3710ff9640 1 -- 172.21.15.59:0/873172055 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37180047a0 con 0x55a60a176d80 2024-09-10T21:26:48.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.612+0000 7f3710ff9640 1 -- 172.21.15.59:0/873172055 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3718010690 con 0x55a60a176d80 2024-09-10T21:26:48.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.613+0000 7f372b29f740 1 -- 172.21.15.59:0/873172055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a176d80 msgr2=0x55a60a179170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:48.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.613+0000 7f3722d9d640 1 --2- 172.21.15.59:0/1867896821 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f370c0b5360 0x7f370c0b7820 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3724077560 tx=0x7f371c00a750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:48.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.613+0000 7f372b29f740 1 --2- 172.21.15.59:0/873172055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a176d80 0x55a60a179170 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f371800cc40 tx=0x7f371800e720 comp rx=0 tx=0).stop 2024-09-10T21:26:48.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.613+0000 7f372b29f740 1 -- 172.21.15.59:0/873172055 shutdown_connections 2024-09-10T21:26:48.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.613+0000 7f372b29f740 1 --2- 172.21.15.59:0/873172055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a176d80 0x55a60a179170 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.613+0000 7f372b29f740 1 --2- 172.21.15.59:0/873172055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a16adf0 0x55a60a176840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.613+0000 7f372b29f740 1 --2- 172.21.15.59:0/873172055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a16a4d0 0x55a60a16a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.613+0000 7f372b29f740 1 -- 172.21.15.59:0/873172055 >> 172.21.15.59:0/873172055 conn(0x55a60a168300 msgr2=0x55a60a1694a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:48.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.613+0000 7f372b29f740 1 -- 172.21.15.59:0/873172055 shutdown_connections 2024-09-10T21:26:48.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.613+0000 7f372b29f740 1 -- 172.21.15.59:0/873172055 wait complete. 2024-09-10T21:26:48.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.614+0000 7f372b29f740 1 -- start start 2024-09-10T21:26:48.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.614+0000 7f372b29f740 1 Processor -- start 2024-09-10T21:26:48.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.614+0000 7f372b29f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a16a4d0 0x55a60a176670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:48.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.614+0000 7f372b29f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a16adf0 0x55a60a173ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:48.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.614+0000 7f372b29f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a176d80 0x55a60a1740f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:48.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.614+0000 7f372b29f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a609f31700 con 0x55a60a16adf0 2024-09-10T21:26:48.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.614+0000 7f372b29f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a60a06b160 con 0x55a60a176d80 2024-09-10T21:26:48.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.614+0000 7f372b29f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x55a60a179a00 con 0x55a60a16a4d0 2024-09-10T21:26:48.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.614+0000 7f372b29f740 10 client.0 _ll_register_callbacks cb 0x55a60a0849e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:48.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.614+0000 7f3721d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a16adf0 0x55a60a173ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:48.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.614+0000 7f3721d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a16adf0 0x55a60a173ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39874/0 (socket says 172.21.15.59:39874) 2024-09-10T21:26:48.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.614+0000 7f3721d9b640 1 -- 172.21.15.59:0/4284421968 learned_addr learned my addr 172.21.15.59:0/4284421968 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:48.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.614+0000 7f372259c640 1 --2- 172.21.15.59:0/4284421968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a16a4d0 0x55a60a176670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:48.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.614+0000 7f3722d9d640 1 --2- 172.21.15.59:0/4284421968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a176d80 0x55a60a1740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:48.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.614+0000 7f3721d9b640 1 -- 172.21.15.59:0/4284421968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a16a4d0 msgr2=0x55a60a176670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:48.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.614+0000 7f3721d9b640 1 --2- 172.21.15.59:0/4284421968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a16a4d0 0x55a60a176670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.614+0000 7f3721d9b640 1 -- 172.21.15.59:0/4284421968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a176d80 msgr2=0x55a60a1740f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:48.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.614+0000 7f3721d9b640 1 --2- 172.21.15.59:0/4284421968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a176d80 0x55a60a1740f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.614+0000 7f3721d9b640 1 -- 172.21.15.59:0/4284421968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a60a098c90 con 0x55a60a16adf0 2024-09-10T21:26:48.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.615+0000 7f3721d9b640 1 --2- 172.21.15.59:0/4284421968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a16adf0 0x55a60a173ac0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f371800cc10 tx=0x7f3718005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421335a86e03c4ef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:48.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.615+0000 7f3709ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:48.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.615+0000 7f3709ffb640 1 -- 172.21.15.59:0/4284421968 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3718014070 con 0x55a60a16adf0 2024-09-10T21:26:48.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.615+0000 7f3709ffb640 1 -- 172.21.15.59:0/4284421968 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3718004230 con 0x55a60a16adf0 2024-09-10T21:26:48.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.615+0000 7f372b29f740 1 -- 172.21.15.59:0/4284421968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37180047a0 con 0x55a60a16adf0 2024-09-10T21:26:48.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.615+0000 7f3709ffb640 1 -- 172.21.15.59:0/4284421968 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3718004e30 con 0x55a60a16adf0 2024-09-10T21:26:48.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.615+0000 7f372b29f740 10 client.18228 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:48.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.615+0000 7f372b29f740 1 -- 172.21.15.59:0/4284421968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a60a185360 con 0x55a60a16adf0 2024-09-10T21:26:48.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.615+0000 7f3709ffb640 1 -- 172.21.15.59:0/4284421968 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37180047a0 con 0x55a60a16adf0 2024-09-10T21:26:48.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.615+0000 7f3709ffb640 1 -- 172.21.15.59:0/4284421968 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3718003c80 con 0x55a60a16adf0 2024-09-10T21:26:48.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.615+0000 7f372b29f740 10 client.18228 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:48.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.615+0000 7f372b29f740 10 client.18228 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:26:48.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.615+0000 7f372b29f740 20 client.18228 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:48.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.615+0000 7f372b29f740 1 --2- 172.21.15.59:0/4284421968 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a60a1866b0 0x55a60a188aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:48.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.615+0000 7f372b29f740 4 client.18228 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T21:26:48.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.615+0000 7f372b29f740 1 -- 172.21.15.59:0/4284421968 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a60a0e2df0 con 0x55a60a1866b0 2024-09-10T21:26:48.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.616+0000 7f372259c640 1 --2- 172.21.15.59:0/4284421968 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a60a1866b0 0x55a60a188aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:48.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.616+0000 7f372259c640 1 --2- 172.21.15.59:0/4284421968 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a60a1866b0 0x55a60a188aa0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bf8f3223a61b04a server_cookie=f6f7b909a74f6a5b in_seq=0 out_seq=0 2024-09-10T21:26:48.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.616+0000 7f3709ffb640 10 client.18228 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:48.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.617+0000 7f3709ffb640 1 -- 172.21.15.59:0/4284421968 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a60a0e2df0 con 0x55a60a1866b0 2024-09-10T21:26:48.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.617+0000 7f3709ffb640 10 client.18228 handle_command_reply: tid=0 2024-09-10T21:26:48.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.617+0000 7f372b29f740 1 client.18228 shutdown 2024-09-10T21:26:48.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.617+0000 7f372b29f740 1 -- 172.21.15.59:0/4284421968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a16adf0 msgr2=0x55a60a173ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:48.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.617+0000 7f372b29f740 1 --2- 172.21.15.59:0/4284421968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a16adf0 0x55a60a173ac0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f371800cc10 tx=0x7f3718005230 comp rx=0 tx=0).stop 2024-09-10T21:26:48.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.617+0000 7f372b29f740 1 -- 172.21.15.59:0/4284421968 shutdown_connections 2024-09-10T21:26:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.617+0000 7f372b29f740 1 --2- 172.21.15.59:0/4284421968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a176d80 0x55a60a1740f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.617+0000 7f372b29f740 1 --2- 172.21.15.59:0/4284421968 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a60a1866b0 0x55a60a188aa0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.617+0000 7f372b29f740 1 --2- 172.21.15.59:0/4284421968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a16adf0 0x55a60a173ac0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.617+0000 7f372b29f740 1 --2- 172.21.15.59:0/4284421968 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a16a4d0 0x55a60a176670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.617+0000 7f3709ffb640 0 client.18228 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:48.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.617+0000 7f372b29f740 1 -- 172.21.15.59:0/4284421968 >> 172.21.15.59:0/4284421968 conn(0x55a60a168300 msgr2=0x55a60a16de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:48.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.617+0000 7f372b29f740 1 -- 172.21.15.59:0/4284421968 shutdown_connections 2024-09-10T21:26:48.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.617+0000 7f372b29f740 1 -- 172.21.15.59:0/4284421968 wait complete. 2024-09-10T21:26:48.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.617+0000 7f372b29f740 20 client.18228 trim_cache size 0 max 16384 2024-09-10T21:26:48.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.630+0000 7f372b29f740 1 Processor -- start 2024-09-10T21:26:48.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.630+0000 7f372b29f740 1 -- start start 2024-09-10T21:26:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.630+0000 7f372b29f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a16a4d0 0x55a60a182c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.631+0000 7f372b29f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a16adf0 0x55a60a172fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.631+0000 7f372b29f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a176d80 0x55a60a172340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.631+0000 7f372b29f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f37241b04f0 con 0x55a60a176d80 2024-09-10T21:26:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.631+0000 7f372b29f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37241b2030 con 0x55a60a16adf0 2024-09-10T21:26:48.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.631+0000 7f372b29f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f37241b0bc0 con 0x55a60a16a4d0 2024-09-10T21:26:48.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.631+0000 7f3722d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a176d80 0x55a60a172340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:48.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.631+0000 7f3722d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a176d80 0x55a60a172340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39878/0 (socket says 172.21.15.59:39878) 2024-09-10T21:26:48.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.631+0000 7f3722d9d640 1 -- 172.21.15.59:0/3177855144 learned_addr learned my addr 172.21.15.59:0/3177855144 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:48.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.631+0000 7f372259c640 1 --2- 172.21.15.59:0/3177855144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a16a4d0 0x55a60a182c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:48.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.631+0000 7f3721d9b640 1 --2- 172.21.15.59:0/3177855144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a16adf0 0x55a60a172fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:48.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.631+0000 7f3722d9d640 1 -- 172.21.15.59:0/3177855144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a16a4d0 msgr2=0x55a60a182c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:48.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.631+0000 7f3722d9d640 1 --2- 172.21.15.59:0/3177855144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a16a4d0 0x55a60a182c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.631+0000 7f3722d9d640 1 -- 172.21.15.59:0/3177855144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a16adf0 msgr2=0x55a60a172fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:48.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.631+0000 7f3722d9d640 1 --2- 172.21.15.59:0/3177855144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a16adf0 0x55a60a172fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.631+0000 7f3722d9d640 1 -- 172.21.15.59:0/3177855144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a60a174d90 con 0x55a60a176d80 2024-09-10T21:26:48.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.631+0000 7f3721d9b640 1 --2- 172.21.15.59:0/3177855144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a16adf0 0x55a60a172fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:26:48.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.631+0000 7f3722d9d640 1 --2- 172.21.15.59:0/3177855144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a176d80 0x55a60a172340 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f371c00a720 tx=0x7f371c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e989b3a578bf6007 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:48.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.632+0000 7f370bfff640 1 -- 172.21.15.59:0/3177855144 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c01e320 con 0x55a60a176d80 2024-09-10T21:26:48.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.632+0000 7f370bfff640 1 -- 172.21.15.59:0/3177855144 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f371c01cb30 con 0x55a60a176d80 2024-09-10T21:26:48.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.632+0000 7f370bfff640 1 -- 172.21.15.59:0/3177855144 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c01dc90 con 0x55a60a176d80 2024-09-10T21:26:48.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.633+0000 7f372b29f740 1 -- 172.21.15.59:0/3177855144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a176d80 msgr2=0x55a60a172340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:48.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.633+0000 7f372b29f740 1 --2- 172.21.15.59:0/3177855144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a176d80 0x55a60a172340 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f371c00a720 tx=0x7f371c014000 comp rx=0 tx=0).stop 2024-09-10T21:26:48.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.633+0000 7f372b29f740 1 -- 172.21.15.59:0/3177855144 shutdown_connections 2024-09-10T21:26:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.633+0000 7f372b29f740 1 --2- 172.21.15.59:0/3177855144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a176d80 0x55a60a172340 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.633+0000 7f372b29f740 1 --2- 172.21.15.59:0/3177855144 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a16adf0 0x55a60a172fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.633+0000 7f372b29f740 1 --2- 172.21.15.59:0/3177855144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a16a4d0 0x55a60a182c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.633+0000 7f372b29f740 1 -- 172.21.15.59:0/3177855144 >> 172.21.15.59:0/3177855144 conn(0x55a60a168300 msgr2=0x55a60a16ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.633+0000 7f372b29f740 1 -- 172.21.15.59:0/3177855144 shutdown_connections 2024-09-10T21:26:48.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.633+0000 7f372b29f740 1 -- 172.21.15.59:0/3177855144 wait complete. 2024-09-10T21:26:48.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.633+0000 7f372b29f740 1 -- start start 2024-09-10T21:26:48.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.633+0000 7f372b29f740 1 Processor -- start 2024-09-10T21:26:48.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.634+0000 7f372b29f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a16a4d0 0x55a60a17eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:48.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.634+0000 7f372b29f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a16adf0 0x55a60a17f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:48.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.634+0000 7f372b29f740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a176d80 0x55a60a179c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:48.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.634+0000 7f372b29f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f37241b1960 con 0x55a60a16a4d0 2024-09-10T21:26:48.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.634+0000 7f372b29f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37241b1290 con 0x55a60a16adf0 2024-09-10T21:26:48.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.634+0000 7f372b29f740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f37241ae4d0 con 0x55a60a176d80 2024-09-10T21:26:48.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.634+0000 7f372b29f740 10 client.0 _ll_register_callbacks cb 0x7f371c00a5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T21:26:48.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.634+0000 7f372259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a16a4d0 0x55a60a17eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:48.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.634+0000 7f372259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a16a4d0 0x55a60a17eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:39890/0 (socket says 172.21.15.59:39890) 2024-09-10T21:26:48.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.634+0000 7f372259c640 1 -- 172.21.15.59:0/1464640664 learned_addr learned my addr 172.21.15.59:0/1464640664 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:48.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.634+0000 7f3721d9b640 1 --2- 172.21.15.59:0/1464640664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a16adf0 0x55a60a17f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:48.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.634+0000 7f3722d9d640 1 --2- 172.21.15.59:0/1464640664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a176d80 0x55a60a179c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:48.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.634+0000 7f372259c640 1 -- 172.21.15.59:0/1464640664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a176d80 msgr2=0x55a60a179c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:48.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.634+0000 7f372259c640 1 --2- 172.21.15.59:0/1464640664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a176d80 0x55a60a179c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.634+0000 7f372259c640 1 -- 172.21.15.59:0/1464640664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a16adf0 msgr2=0x55a60a17f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T21:26:48.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.634+0000 7f372259c640 1 --2- 172.21.15.59:0/1464640664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a16adf0 0x55a60a17f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.634+0000 7f372259c640 1 -- 172.21.15.59:0/1464640664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a60a17a290 con 0x55a60a16a4d0 2024-09-10T21:26:48.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.634+0000 7f372259c640 1 --2- 172.21.15.59:0/1464640664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a16a4d0 0x55a60a17eeb0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f3714104060 tx=0x7f3714003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b80da1722d9d1a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:48.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.634+0000 7f3709ffb640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-10T21:26:48.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.635+0000 7f3709ffb640 1 -- 172.21.15.59:0/1464640664 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714049040 con 0x55a60a16a4d0 2024-09-10T21:26:48.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.635+0000 7f3709ffb640 1 -- 172.21.15.59:0/1464640664 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f37140b40d0 con 0x55a60a16a4d0 2024-09-10T21:26:48.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.635+0000 7f372b29f740 1 -- 172.21.15.59:0/1464640664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f371c01cb30 con 0x55a60a16a4d0 2024-09-10T21:26:48.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.635+0000 7f3709ffb640 1 -- 172.21.15.59:0/1464640664 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f37140cc490 con 0x55a60a16a4d0 2024-09-10T21:26:48.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.635+0000 7f372b29f740 10 client.18234 fetch_fsmap learned FSMap version 28 2024-09-10T21:26:48.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.635+0000 7f372b29f740 1 -- 172.21.15.59:0/1464640664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a60a1f3b40 con 0x55a60a16a4d0 2024-09-10T21:26:48.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.635+0000 7f3709ffb640 1 -- 172.21.15.59:0/1464640664 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f371c01cb30 con 0x55a60a16a4d0 2024-09-10T21:26:48.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.635+0000 7f3709ffb640 1 -- 172.21.15.59:0/1464640664 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f37140a6ce0 con 0x55a60a16a4d0 2024-09-10T21:26:48.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.635+0000 7f372b29f740 10 client.18234 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T21:26:48.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.635+0000 7f372b29f740 10 client.18234 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T21:26:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.635+0000 7f372b29f740 20 client.18234 populate_metadata read hostname 'smithi059' 2024-09-10T21:26:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.635+0000 7f372b29f740 1 --2- 172.21.15.59:0/1464640664 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a60a1f4290 0x55a60a1f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.635+0000 7f372b29f740 4 client.18234 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T21:26:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.635+0000 7f372b29f740 1 -- 172.21.15.59:0/1464640664 --> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a60a0de8a0 con 0x55a60a1f4290 2024-09-10T21:26:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.635+0000 7f3721d9b640 1 --2- 172.21.15.59:0/1464640664 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a60a1f4290 0x55a60a1f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.636+0000 7f3721d9b640 1 --2- 172.21.15.59:0/1464640664 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a60a1f4290 0x55a60a1f66b0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3286e5eda2cf75d server_cookie=dd02f693e70c75f9 in_seq=0 out_seq=0 2024-09-10T21:26:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.636+0000 7f3709ffb640 10 client.18234 ms_handle_connect on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.636+0000 7f3709ffb640 1 -- 172.21.15.59:0/1464640664 <== mds.0 v2:172.21.15.154:6838/3664432388 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a60a0de8a0 con 0x55a60a1f4290 2024-09-10T21:26:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.636+0000 7f3709ffb640 10 client.18234 handle_command_reply: tid=0 2024-09-10T21:26:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.636+0000 7f372b29f740 1 client.18234 shutdown 2024-09-10T21:26:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.636+0000 7f372b29f740 1 -- 172.21.15.59:0/1464640664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a16a4d0 msgr2=0x55a60a17eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:48.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.636+0000 7f372b29f740 1 --2- 172.21.15.59:0/1464640664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a16a4d0 0x55a60a17eeb0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f3714104060 tx=0x7f3714003c20 comp rx=0 tx=0).stop 2024-09-10T21:26:48.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.636+0000 7f372b29f740 1 -- 172.21.15.59:0/1464640664 shutdown_connections 2024-09-10T21:26:48.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.636+0000 7f372b29f740 1 --2- 172.21.15.59:0/1464640664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55a60a176d80 0x55a60a179c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.636+0000 7f372b29f740 1 --2- 172.21.15.59:0/1464640664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a60a16adf0 0x55a60a17f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.636+0000 7f372b29f740 1 --2- 172.21.15.59:0/1464640664 >> [v2:172.21.15.154:6838/3664432388,v1:172.21.15.154:6839/3664432388] conn(0x55a60a1f4290 0x55a60a1f66b0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.636+0000 7f372b29f740 1 --2- 172.21.15.59:0/1464640664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a60a16a4d0 0x55a60a17eeb0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.636+0000 7f372b29f740 1 -- 172.21.15.59:0/1464640664 >> 172.21.15.59:0/1464640664 conn(0x55a60a168300 msgr2=0x55a60a171f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:48.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.636+0000 7f3709ffb640 0 client.18234 ms_handle_reset on v2:172.21.15.154:6838/3664432388 2024-09-10T21:26:48.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.636+0000 7f372b29f740 1 -- 172.21.15.59:0/1464640664 shutdown_connections 2024-09-10T21:26:48.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.636+0000 7f372b29f740 1 -- 172.21.15.59:0/1464640664 wait complete. 2024-09-10T21:26:48.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.636+0000 7f372b29f740 20 client.18234 trim_cache size 0 max 16384 2024-09-10T21:26:48.673 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-09-10T21:26:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.637+0000 7f3728eca640 1 -- 172.21.15.59:0/1867896821 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f370c0b5360 msgr2=0x7f370c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.637+0000 7f3728eca640 1 --2- 172.21.15.59:0/1867896821 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f370c0b5360 0x7f370c0b7820 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3724077560 tx=0x7f371c00a750 comp rx=0 tx=0).stop 2024-09-10T21:26:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.637+0000 7f3728eca640 1 -- 172.21.15.59:0/1867896821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3724102dc0 msgr2=0x7f37240754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.637+0000 7f3728eca640 1 --2- 172.21.15.59:0/1867896821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3724102dc0 0x7f37240754a0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f3714006010 tx=0x7f37140042f0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.637+0000 7f3728eca640 1 -- 172.21.15.59:0/1867896821 shutdown_connections 2024-09-10T21:26:48.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.637+0000 7f3728eca640 1 --2- 172.21.15.59:0/1867896821 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f370c0b5360 0x7f370c0b7820 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.637+0000 7f3728eca640 1 --2- 172.21.15.59:0/1867896821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3724109150 0x7f3724075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.637+0000 7f3728eca640 1 --2- 172.21.15.59:0/1867896821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37241087d0 0x7f37240759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.637+0000 7f3728eca640 1 --2- 172.21.15.59:0/1867896821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3724102dc0 0x7f37240754a0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:48.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.637+0000 7f3728eca640 1 -- 172.21.15.59:0/1867896821 >> 172.21.15.59:0/1867896821 conn(0x7f37240fe830 msgr2=0x7f3724100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:48.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.637+0000 7f3728eca640 1 -- 172.21.15.59:0/1867896821 shutdown_connections 2024-09-10T21:26:48.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:48.637+0000 7f3728eca640 1 -- 172.21.15.59:0/1867896821 wait complete. 2024-09-10T21:26:49.313 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:49 smithi059 ceph-mon[30888]: pgmap v686: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T21:26:49.343 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-10T21:26:49.344 INFO:tasks.fwd_scrub:done joining 2024-09-10T21:26:49.344 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-10T21:26:49.355 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T21:26:49.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:49 smithi154 ceph-mon[35041]: pgmap v686: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T21:26:49.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.460+0000 7f0961cd6640 1 -- 172.21.15.59:0/4026180443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f095c1086c0 msgr2=0x7f095c10ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:49.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.460+0000 7f0961cd6640 1 --2- 172.21.15.59:0/4026180443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f095c1086c0 0x7f095c10ab80 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f0954009900 tx=0x7f095402a410 comp rx=0 tx=0).stop 2024-09-10T21:26:49.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.460+0000 7f0961cd6640 1 -- 172.21.15.59:0/4026180443 shutdown_connections 2024-09-10T21:26:49.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.460+0000 7f0961cd6640 1 --2- 172.21.15.59:0/4026180443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f095c1086c0 0x7f095c10ab80 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:49.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.460+0000 7f0961cd6640 1 --2- 172.21.15.59:0/4026180443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f095c105b30 0x7f095c107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:49.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.460+0000 7f0961cd6640 1 --2- 172.21.15.59:0/4026180443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f095c06af40 0x7f095c1055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:49.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.460+0000 7f0961cd6640 1 -- 172.21.15.59:0/4026180443 >> 172.21.15.59:0/4026180443 conn(0x7f095c0fd180 msgr2=0x7f095c0ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:49.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.460+0000 7f0961cd6640 1 -- 172.21.15.59:0/4026180443 shutdown_connections 2024-09-10T21:26:49.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.460+0000 7f0961cd6640 1 -- 172.21.15.59:0/4026180443 wait complete. 2024-09-10T21:26:49.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.460+0000 7f0961cd6640 1 Processor -- start 2024-09-10T21:26:49.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.461+0000 7f0961cd6640 1 -- start start 2024-09-10T21:26:49.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.461+0000 7f0961cd6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f095c06af40 0x7f095c198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:49.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.461+0000 7f0961cd6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f095c105b30 0x7f095c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:49.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.461+0000 7f0961cd6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f095c1086c0 0x7f095c199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:49.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.461+0000 7f0961cd6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f095c10e620 con 0x7f095c1086c0 2024-09-10T21:26:49.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.461+0000 7f0961cd6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f095c10e4a0 con 0x7f095c06af40 2024-09-10T21:26:49.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.461+0000 7f0961cd6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f095c10e7a0 con 0x7f095c105b30 2024-09-10T21:26:49.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.461+0000 7f095bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f095c1086c0 0x7f095c199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:49.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.461+0000 7f095bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f095c1086c0 0x7f095c199f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57308/0 (socket says 172.21.15.59:57308) 2024-09-10T21:26:49.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.461+0000 7f095bfff640 1 -- 172.21.15.59:0/1200699680 learned_addr learned my addr 172.21.15.59:0/1200699680 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:49.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.461+0000 7f095affd640 1 --2- 172.21.15.59:0/1200699680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f095c105b30 0x7f095c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:49.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.461+0000 7f095b7fe640 1 --2- 172.21.15.59:0/1200699680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f095c06af40 0x7f095c198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:49.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.461+0000 7f095bfff640 1 -- 172.21.15.59:0/1200699680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f095c105b30 msgr2=0x7f095c199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:49.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.461+0000 7f095bfff640 1 --2- 172.21.15.59:0/1200699680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f095c105b30 0x7f095c199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:49.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.461+0000 7f095bfff640 1 -- 172.21.15.59:0/1200699680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f095c06af40 msgr2=0x7f095c198ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:49.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.461+0000 7f095bfff640 1 --2- 172.21.15.59:0/1200699680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f095c06af40 0x7f095c198ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:49.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.461+0000 7f095bfff640 1 -- 172.21.15.59:0/1200699680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095c19a820 con 0x7f095c1086c0 2024-09-10T21:26:49.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.461+0000 7f095b7fe640 1 --2- 172.21.15.59:0/1200699680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f095c06af40 0x7f095c198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:26:49.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.462+0000 7f095bfff640 1 --2- 172.21.15.59:0/1200699680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f095c1086c0 0x7f095c199f60 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f0954031500 tx=0x7f0954031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:49.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.462+0000 7f0958ff9640 1 -- 172.21.15.59:0/1200699680 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095403f030 con 0x7f095c1086c0 2024-09-10T21:26:49.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.462+0000 7f0958ff9640 1 -- 172.21.15.59:0/1200699680 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0954003aa0 con 0x7f095c1086c0 2024-09-10T21:26:49.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.462+0000 7f0961cd6640 1 -- 172.21.15.59:0/1200699680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f095c19aab0 con 0x7f095c1086c0 2024-09-10T21:26:49.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.462+0000 7f0958ff9640 1 -- 172.21.15.59:0/1200699680 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954035070 con 0x7f095c1086c0 2024-09-10T21:26:49.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.462+0000 7f0961cd6640 1 -- 172.21.15.59:0/1200699680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f095c1a11e0 con 0x7f095c1086c0 2024-09-10T21:26:49.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.463+0000 7f0961cd6640 1 -- 172.21.15.59:0/1200699680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f095c105f70 con 0x7f095c1086c0 2024-09-10T21:26:49.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.464+0000 7f0958ff9640 1 -- 172.21.15.59:0/1200699680 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f095403bc30 con 0x7f095c1086c0 2024-09-10T21:26:49.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.465+0000 7f0958ff9640 1 --2- 172.21.15.59:0/1200699680 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f09440b5360 0x7f09440b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:49.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.465+0000 7f0958ff9640 1 -- 172.21.15.59:0/1200699680 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f09541064b0 con 0x7f095c1086c0 2024-09-10T21:26:49.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.465+0000 7f095b7fe640 1 --2- 172.21.15.59:0/1200699680 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f09440b5360 0x7f09440b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:49.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.466+0000 7f095b7fe640 1 --2- 172.21.15.59:0/1200699680 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f09440b5360 0x7f09440b7820 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f094c008e00 tx=0x7f094c008350 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:49.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.469+0000 7f0958ff9640 1 -- 172.21.15.59:0/1200699680 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f09540cd3a0 con 0x7f095c1086c0 2024-09-10T21:26:49.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:49 smithi192 ceph-mon[35363]: pgmap v686: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 10 op/s 2024-09-10T21:26:49.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.658+0000 7f0961cd6640 1 -- 172.21.15.59:0/1200699680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f095c0fec70 con 0x7f095c1086c0 2024-09-10T21:26:49.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.659+0000 7f0958ff9640 1 -- 172.21.15.59:0/1200699680 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22633 (secure 0 0 0) 0x7f09540ccca0 con 0x7f095c1086c0 2024-09-10T21:26:49.662 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:26:49.662 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":75,"fsid":"3c26b952-6fb8-11ef-bcea-c7b262605968","created":"2024-09-10T21:05:18.196881+0000","modified":"2024-09-10T21:14:06.297762+0000","last_up_change":"2024-09-10T21:12:31.909004+0000","last_in_change":"2024-09-10T21:12:08.116727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:08:47.611285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:13:15.562661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:13:17.272280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e88abf3-8592-4b5f-8ba9-5969e01e12d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6803","nonce":1237328951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6805","nonce":1237328951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6809","nonce":1237328951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6807","nonce":1237328951}]},"public_addr":"172.21.15.59:6803/1237328951","cluster_addr":"172.21.15.59:6805/1237328951","heartbeat_back_addr":"172.21.15.59:6809/1237328951","heartbeat_front_addr":"172.21.15.59:6807/1237328951","state":["exists","up"]},{"osd":1,"uuid":"7908eefd-bbfa-4fe4-9db9-7a92d0e77acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6801","nonce":3376412264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6803","nonce":3376412264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6807","nonce":3376412264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6805","nonce":3376412264}]},"public_addr":"172.21.15.154:6801/3376412264","cluster_addr":"172.21.15.154:6803/3376412264","heartbeat_back_addr":"172.21.15.154:6807/3376412264","heartbeat_front_addr":"172.21.15.154:6805/3376412264","state":["exists","up"]},{"osd":2,"uuid":"2351b9f0-bca1-48b2-afb8-0e2b7856c52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6801","nonce":440750253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6803","nonce":440750253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6807","nonce":440750253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6805","nonce":440750253}]},"public_addr":"172.21.15.192:6801/440750253","cluster_addr":"172.21.15.192:6803/440750253","heartbeat_back_addr":"172.21.15.192:6807/440750253","heartbeat_front_addr":"172.21.15.192:6805/440750253","state":["exists","up"]},{"osd":3,"uuid":"f26969d1-7b48-4f20-9077-c55c59775ed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6811","nonce":1483798393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6813","nonce":1483798393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6817","nonce":1483798393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6815","nonce":1483798393}]},"public_addr":"172.21.15.59:6811/1483798393","cluster_addr":"172.21.15.59:6813/1483798393","heartbeat_back_addr":"172.21.15.59:6817/1483798393","heartbeat_front_addr":"172.21.15.59:6815/1483798393","state":["exists","up"]},{"osd":4,"uuid":"21e1a472-1ae1-454b-aee5-2ad92f6eff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6809","nonce":1817188525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6811","nonce":1817188525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6815","nonce":1817188525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6813","nonce":1817188525}]},"public_addr":"172.21.15.154:6809/1817188525","cluster_addr":"172.21.15.154:6811/1817188525","heartbeat_back_addr":"172.21.15.154:6815/1817188525","heartbeat_front_addr":"172.21.15.154:6813/1817188525","state":["exists","up"]},{"osd":5,"uuid":"6191b10a-5cbd-4225-b0ec-70d05023d5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6809","nonce":1221386274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6811","nonce":1221386274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6815","nonce":1221386274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6813","nonce":1221386274}]},"public_addr":"172.21.15.192:6809/1221386274","cluster_addr":"172.21.15.192:6811/1221386274","heartbeat_back_addr":"172.21.15.192:6815/1221386274","heartbeat_front_addr":"172.21.15.192:6813/1221386274","state":["exists","up"]},{"osd":6,"uuid":"609c11f7-ce82-4714-bf73-a4f16f4483ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6819","nonce":3006857566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6821","nonce":3006857566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6825","nonce":3006857566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6823","nonce":3006857566}]},"public_addr":"172.21.15.59:6819/3006857566","cluster_addr":"172.21.15.59:6821/3006857566","heartbeat_back_addr":"172.21.15.59:6825/3006857566","heartbeat_front_addr":"172.21.15.59:6823/3006857566","state":["exists","up"]},{"osd":7,"uuid":"bff3a29f-47cc-4e66-92e4-14e9b7faf498","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6817","nonce":175260385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6819","nonce":175260385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6823","nonce":175260385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6821","nonce":175260385}]},"public_addr":"172.21.15.154:6817/175260385","cluster_addr":"172.21.15.154:6819/175260385","heartbeat_back_addr":"172.21.15.154:6823/175260385","heartbeat_front_addr":"172.21.15.154:6821/175260385","state":["exists","up"]},{"osd":8,"uuid":"56dabafd-9bb9-409a-88cd-4b5b5ecf810a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6817","nonce":3138189462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6819","nonce":3138189462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6823","nonce":3138189462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6821","nonce":3138189462}]},"public_addr":"172.21.15.192:6817/3138189462","cluster_addr":"172.21.15.192:6819/3138189462","heartbeat_back_addr":"172.21.15.192:6823/3138189462","heartbeat_front_addr":"172.21.15.192:6821/3138189462","state":["exists","up"]},{"osd":9,"uuid":"044f934d-3df5-47aa-85f5-c3b63b267ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6827","nonce":2446500753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6829","nonce":2446500753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6833","nonce":2446500753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6831","nonce":2446500753}]},"public_addr":"172.21.15.59:6827/2446500753","cluster_addr":"172.21.15.59:6829/2446500753","heartbeat_back_addr":"172.21.15.59:6833/2446500753","heartbeat_front_addr":"172.21.15.59:6831/2446500753","state":["exists","up"]},{"osd":10,"uuid":"8d3b735b-e4fe-4a8e-8c75-a49313c6fabb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6825","nonce":1139781446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6827","nonce":1139781446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6831","nonce":1139781446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6829","nonce":1139781446}]},"public_addr":"172.21.15.154:6825/1139781446","cluster_addr":"172.21.15.154:6827/1139781446","heartbeat_back_addr":"172.21.15.154:6831/1139781446","heartbeat_front_addr":"172.21.15.154:6829/1139781446","state":["exists","up"]},{"osd":11,"uuid":"fd6a6d06-c6aa-42e3-aa38-fc583319f6bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6825","nonce":1041494458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6827","nonce":1041494458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6831","nonce":1041494458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6829","nonce":1041494458}]},"public_addr":"172.21.15.192:6825/1041494458","cluster_addr":"172.21.15.192:6827/1041494458","heartbeat_back_addr":"172.21.15.192:6831/1041494458","heartbeat_front_addr":"172.21.15.192:6829/1041494458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:07:53.974382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:19.552358+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:44.251670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:09.430992+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:34.043343+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:59.903679+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:25.733171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:49.795257+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:14.485648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:40.485165+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:04.655475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:29.308456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/212243638":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/3305207692":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6801/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/2965147556":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/1174570395":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/2934865748":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:6801/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/3377179776":"2024-09-11T21:05:40.304807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:26:49.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.662+0000 7f0961cd6640 1 -- 172.21.15.59:0/1200699680 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f09440b5360 msgr2=0x7f09440b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:49.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.662+0000 7f0961cd6640 1 --2- 172.21.15.59:0/1200699680 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f09440b5360 0x7f09440b7820 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f094c008e00 tx=0x7f094c008350 comp rx=0 tx=0).stop 2024-09-10T21:26:49.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.662+0000 7f0961cd6640 1 -- 172.21.15.59:0/1200699680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f095c1086c0 msgr2=0x7f095c199f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:49.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.662+0000 7f0961cd6640 1 --2- 172.21.15.59:0/1200699680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f095c1086c0 0x7f095c199f60 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f0954031500 tx=0x7f0954031a50 comp rx=0 tx=0).stop 2024-09-10T21:26:49.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.662+0000 7f0961cd6640 1 -- 172.21.15.59:0/1200699680 shutdown_connections 2024-09-10T21:26:49.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.662+0000 7f0961cd6640 1 --2- 172.21.15.59:0/1200699680 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f09440b5360 0x7f09440b7820 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:49.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.662+0000 7f0961cd6640 1 --2- 172.21.15.59:0/1200699680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f095c1086c0 0x7f095c199f60 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:49.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.662+0000 7f0961cd6640 1 --2- 172.21.15.59:0/1200699680 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f095c105b30 0x7f095c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:49.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.662+0000 7f0961cd6640 1 --2- 172.21.15.59:0/1200699680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f095c06af40 0x7f095c198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:49.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.662+0000 7f0961cd6640 1 -- 172.21.15.59:0/1200699680 >> 172.21.15.59:0/1200699680 conn(0x7f095c0fd180 msgr2=0x7f095c103e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:49.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.662+0000 7f0961cd6640 1 -- 172.21.15.59:0/1200699680 shutdown_connections 2024-09-10T21:26:49.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.662+0000 7f0961cd6640 1 -- 172.21.15.59:0/1200699680 wait complete. 2024-09-10T21:26:49.676 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T21:08:47.611285+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T21:13:15.562661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T21:13:17.272280+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T21:26:49.676 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T21:26:49.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.782+0000 7f2be6a2a640 1 -- 172.21.15.59:0/549818176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2be00743d0 msgr2=0x7f2be00747d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:49.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.782+0000 7f2be6a2a640 1 --2- 172.21.15.59:0/549818176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2be00743d0 0x7f2be00747d0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009900 tx=0x7f2bd002a410 comp rx=0 tx=0).stop 2024-09-10T21:26:49.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.782+0000 7f2be6a2a640 1 -- 172.21.15.59:0/549818176 shutdown_connections 2024-09-10T21:26:49.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.782+0000 7f2be6a2a640 1 --2- 172.21.15.59:0/549818176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2be010a930 0x7f2be01136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:49.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.782+0000 7f2be6a2a640 1 --2- 172.21.15.59:0/549818176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2be0074e10 0x7f2be010a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:49.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.782+0000 7f2be6a2a640 1 --2- 172.21.15.59:0/549818176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2be00743d0 0x7f2be00747d0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:49.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.782+0000 7f2be6a2a640 1 -- 172.21.15.59:0/549818176 >> 172.21.15.59:0/549818176 conn(0x7f2be006fb20 msgr2=0x7f2be0071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.782+0000 7f2be6a2a640 1 -- 172.21.15.59:0/549818176 shutdown_connections 2024-09-10T21:26:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.782+0000 7f2be6a2a640 1 -- 172.21.15.59:0/549818176 wait complete. 2024-09-10T21:26:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.782+0000 7f2be6a2a640 1 Processor -- start 2024-09-10T21:26:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.783+0000 7f2be6a2a640 1 -- start start 2024-09-10T21:26:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.783+0000 7f2be6a2a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2be00743d0 0x7f2be01a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.783+0000 7f2be6a2a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2be010a930 0x7f2be01a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.783+0000 7f2be6a2a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2be01a2800 0x7f2be01a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.783+0000 7f2be6a2a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2be0116da0 con 0x7f2be00743d0 2024-09-10T21:26:49.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.783+0000 7f2be6a2a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2be0116c20 con 0x7f2be010a930 2024-09-10T21:26:49.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.783+0000 7f2be6a2a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2be0116f20 con 0x7f2be01a2800 2024-09-10T21:26:49.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.783+0000 7f2bdffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2be00743d0 0x7f2be01a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:49.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.783+0000 7f2bdffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2be00743d0 0x7f2be01a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57338/0 (socket says 172.21.15.59:57338) 2024-09-10T21:26:49.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.783+0000 7f2bdffff640 1 -- 172.21.15.59:0/959261577 learned_addr learned my addr 172.21.15.59:0/959261577 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:49.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.783+0000 7f2be4fc7640 1 --2- 172.21.15.59:0/959261577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2be01a2800 0x7f2be01a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:49.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.783+0000 7f2bdf7fe640 1 --2- 172.21.15.59:0/959261577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2be010a930 0x7f2be01a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:49.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.783+0000 7f2bdffff640 1 -- 172.21.15.59:0/959261577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2be01a2800 msgr2=0x7f2be01a2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.783+0000 7f2bdffff640 1 --2- 172.21.15.59:0/959261577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2be01a2800 0x7f2be01a2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.783+0000 7f2bdffff640 1 -- 172.21.15.59:0/959261577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2be010a930 msgr2=0x7f2be01a1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.783+0000 7f2bdffff640 1 --2- 172.21.15.59:0/959261577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2be010a930 0x7f2be01a1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.783+0000 7f2bdffff640 1 -- 172.21.15.59:0/959261577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be01a34b0 con 0x7f2be00743d0 2024-09-10T21:26:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.783+0000 7f2bdf7fe640 1 --2- 172.21.15.59:0/959261577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2be010a930 0x7f2be01a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T21:26:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.784+0000 7f2bdffff640 1 --2- 172.21.15.59:0/959261577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2be00743d0 0x7f2be01a1580 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0005940 tx=0x7f2bd0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.784+0000 7f2bdd7fa640 1 -- 172.21.15.59:0/959261577 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd003f030 con 0x7f2be00743d0 2024-09-10T21:26:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.784+0000 7f2bdd7fa640 1 -- 172.21.15.59:0/959261577 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bd0003cb0 con 0x7f2be00743d0 2024-09-10T21:26:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.784+0000 7f2be6a2a640 1 -- 172.21.15.59:0/959261577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be01a98a0 con 0x7f2be00743d0 2024-09-10T21:26:49.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.784+0000 7f2bdd7fa640 1 -- 172.21.15.59:0/959261577 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0035070 con 0x7f2be00743d0 2024-09-10T21:26:49.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.784+0000 7f2be6a2a640 1 -- 172.21.15.59:0/959261577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be01a9d10 con 0x7f2be00743d0 2024-09-10T21:26:49.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.785+0000 7f2be6a2a640 1 -- 172.21.15.59:0/959261577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be0112590 con 0x7f2be00743d0 2024-09-10T21:26:49.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.786+0000 7f2bdd7fa640 1 -- 172.21.15.59:0/959261577 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f2bd003b460 con 0x7f2be00743d0 2024-09-10T21:26:49.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.787+0000 7f2bdd7fa640 1 --2- 172.21.15.59:0/959261577 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2bc80b5360 0x7f2bc80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:49.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.787+0000 7f2bdf7fe640 1 --2- 172.21.15.59:0/959261577 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2bc80b5360 0x7f2bc80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:49.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.787+0000 7f2bdd7fa640 1 -- 172.21.15.59:0/959261577 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f2bd0106b10 con 0x7f2be00743d0 2024-09-10T21:26:49.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.787+0000 7f2bdf7fe640 1 --2- 172.21.15.59:0/959261577 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2bc80b5360 0x7f2bc80b7820 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4005d00 tx=0x7f2bd4005ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:49.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.790+0000 7f2bdd7fa640 1 -- 172.21.15.59:0/959261577 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2bd00cd9a0 con 0x7f2be00743d0 2024-09-10T21:26:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.974+0000 7f2be6a2a640 1 -- 172.21.15.59:0/959261577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2be002e6d0 con 0x7f2be00743d0 2024-09-10T21:26:49.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.974+0000 7f2bdd7fa640 1 -- 172.21.15.59:0/959261577 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f2bd0003e60 con 0x7f2be00743d0 2024-09-10T21:26:49.977 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-09-10T21:26:49.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.976+0000 7f2be6a2a640 1 -- 172.21.15.59:0/959261577 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2bc80b5360 msgr2=0x7f2bc80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.976+0000 7f2be6a2a640 1 --2- 172.21.15.59:0/959261577 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2bc80b5360 0x7f2bc80b7820 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4005d00 tx=0x7f2bd4005ed0 comp rx=0 tx=0).stop 2024-09-10T21:26:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.976+0000 7f2be6a2a640 1 -- 172.21.15.59:0/959261577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2be00743d0 msgr2=0x7f2be01a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.976+0000 7f2be6a2a640 1 --2- 172.21.15.59:0/959261577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2be00743d0 0x7f2be01a1580 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0005940 tx=0x7f2bd0004430 comp rx=0 tx=0).stop 2024-09-10T21:26:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.976+0000 7f2be6a2a640 1 -- 172.21.15.59:0/959261577 shutdown_connections 2024-09-10T21:26:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.976+0000 7f2be6a2a640 1 --2- 172.21.15.59:0/959261577 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f2bc80b5360 0x7f2bc80b7820 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.976+0000 7f2be6a2a640 1 --2- 172.21.15.59:0/959261577 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2be01a2800 0x7f2be01a2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.976+0000 7f2be6a2a640 1 --2- 172.21.15.59:0/959261577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2be010a930 0x7f2be01a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.976+0000 7f2be6a2a640 1 --2- 172.21.15.59:0/959261577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2be00743d0 0x7f2be01a1580 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.976+0000 7f2be6a2a640 1 -- 172.21.15.59:0/959261577 >> 172.21.15.59:0/959261577 conn(0x7f2be006fb20 msgr2=0x7f2be010f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.976+0000 7f2be6a2a640 1 -- 172.21.15.59:0/959261577 shutdown_connections 2024-09-10T21:26:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:49.976+0000 7f2be6a2a640 1 -- 172.21.15.59:0/959261577 wait complete. 2024-09-10T21:26:49.990 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T21:26:50.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.094+0000 7f3ae3eed640 1 -- 172.21.15.59:0/2603095031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3adc105b00 msgr2=0x7f3adc107f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:50.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.094+0000 7f3ae3eed640 1 --2- 172.21.15.59:0/2603095031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3adc105b00 0x7f3adc107f70 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009900 tx=0x7f3acc02a410 comp rx=0 tx=0).stop 2024-09-10T21:26:50.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.094+0000 7f3ae3eed640 1 -- 172.21.15.59:0/2603095031 shutdown_connections 2024-09-10T21:26:50.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.094+0000 7f3ae3eed640 1 --2- 172.21.15.59:0/2603095031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3adc1086b0 0x7f3adc10ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.094+0000 7f3ae3eed640 1 --2- 172.21.15.59:0/2603095031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3adc105b00 0x7f3adc107f70 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.094+0000 7f3ae3eed640 1 --2- 172.21.15.59:0/2603095031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3adc06be40 0x7f3adc1055c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.094+0000 7f3ae3eed640 1 -- 172.21.15.59:0/2603095031 >> 172.21.15.59:0/2603095031 conn(0x7f3adc0fd150 msgr2=0x7f3adc0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.094+0000 7f3ae3eed640 1 -- 172.21.15.59:0/2603095031 shutdown_connections 2024-09-10T21:26:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.094+0000 7f3ae3eed640 1 -- 172.21.15.59:0/2603095031 wait complete. 2024-09-10T21:26:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae3eed640 1 Processor -- start 2024-09-10T21:26:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae3eed640 1 -- start start 2024-09-10T21:26:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae3eed640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3adc06be40 0x7f3adc198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae3eed640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3adc105b00 0x7f3adc199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae3eed640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3adc1086b0 0x7f3adc19a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae3eed640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc10e5e0 con 0x7f3adc105b00 2024-09-10T21:26:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae3eed640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc10e460 con 0x7f3adc1086b0 2024-09-10T21:26:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae3eed640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc10e760 con 0x7f3adc06be40 2024-09-10T21:26:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae1488640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3adc105b00 0x7f3adc199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae1488640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3adc105b00 0x7f3adc199460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57360/0 (socket says 172.21.15.59:57360) 2024-09-10T21:26:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae1488640 1 -- 172.21.15.59:0/100914095 learned_addr learned my addr 172.21.15.59:0/100914095 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae248a640 1 --2- 172.21.15.59:0/100914095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3adc1086b0 0x7f3adc19a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae1c89640 1 --2- 172.21.15.59:0/100914095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3adc06be40 0x7f3adc198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae1488640 1 -- 172.21.15.59:0/100914095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3adc06be40 msgr2=0x7f3adc198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae1488640 1 --2- 172.21.15.59:0/100914095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3adc06be40 0x7f3adc198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae1488640 1 -- 172.21.15.59:0/100914095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3adc1086b0 msgr2=0x7f3adc19a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae1488640 1 --2- 172.21.15.59:0/100914095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3adc1086b0 0x7f3adc19a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae1488640 1 -- 172.21.15.59:0/100914095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3adc19a950 con 0x7f3adc105b00 2024-09-10T21:26:50.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae1c89640 1 --2- 172.21.15.59:0/100914095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3adc06be40 0x7f3adc198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.095+0000 7f3ae1488640 1 --2- 172.21.15.59:0/100914095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3adc105b00 0x7f3adc199460 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f3acc006010 tx=0x7f3acc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.096+0000 7f3ad2ffd640 1 -- 172.21.15.59:0/100914095 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc03f030 con 0x7f3adc105b00 2024-09-10T21:26:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.096+0000 7f3ad2ffd640 1 -- 172.21.15.59:0/100914095 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3acc003cb0 con 0x7f3adc105b00 2024-09-10T21:26:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.096+0000 7f3ae3eed640 1 -- 172.21.15.59:0/100914095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3adc19abe0 con 0x7f3adc105b00 2024-09-10T21:26:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.096+0000 7f3ad2ffd640 1 -- 172.21.15.59:0/100914095 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc035070 con 0x7f3adc105b00 2024-09-10T21:26:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.096+0000 7f3ae3eed640 1 -- 172.21.15.59:0/100914095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3adc1a1310 con 0x7f3adc105b00 2024-09-10T21:26:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.097+0000 7f3ae3eed640 1 -- 172.21.15.59:0/100914095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3adc105f60 con 0x7f3adc105b00 2024-09-10T21:26:50.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.098+0000 7f3ad2ffd640 1 -- 172.21.15.59:0/100914095 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f3acc03bbb0 con 0x7f3adc105b00 2024-09-10T21:26:50.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.099+0000 7f3ad2ffd640 1 --2- 172.21.15.59:0/100914095 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3ac80b52e0 0x7f3ac80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:50.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.099+0000 7f3ae1c89640 1 --2- 172.21.15.59:0/100914095 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3ac80b52e0 0x7f3ac80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:50.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.099+0000 7f3ad2ffd640 1 -- 172.21.15.59:0/100914095 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3acc1068e0 con 0x7f3adc105b00 2024-09-10T21:26:50.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.099+0000 7f3ae1c89640 1 --2- 172.21.15.59:0/100914095 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3ac80b52e0 0x7f3ac80b77a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8005d00 tx=0x7f3ad8005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:50.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.102+0000 7f3ad2ffd640 1 -- 172.21.15.59:0/100914095 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3acc0cd7d0 con 0x7f3adc105b00 2024-09-10T21:26:50.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.291+0000 7f3ae3eed640 1 -- 172.21.15.59:0/100914095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3adc02e5c0 con 0x7f3adc105b00 2024-09-10T21:26:50.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.291+0000 7f3ad2ffd640 1 -- 172.21.15.59:0/100914095 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) ==== 104+0+11 (secure 0 0 0) 0x7f3acc0cd0d0 con 0x7f3adc105b00 2024-09-10T21:26:50.294 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-09-10T21:26:50.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.294+0000 7f3ae3eed640 1 -- 172.21.15.59:0/100914095 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3ac80b52e0 msgr2=0x7f3ac80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:50.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.294+0000 7f3ae3eed640 1 --2- 172.21.15.59:0/100914095 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3ac80b52e0 0x7f3ac80b77a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8005d00 tx=0x7f3ad8005c70 comp rx=0 tx=0).stop 2024-09-10T21:26:50.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.294+0000 7f3ae3eed640 1 -- 172.21.15.59:0/100914095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3adc105b00 msgr2=0x7f3adc199460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:50.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.294+0000 7f3ae3eed640 1 --2- 172.21.15.59:0/100914095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3adc105b00 0x7f3adc199460 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f3acc006010 tx=0x7f3acc0042f0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.294+0000 7f3ae3eed640 1 -- 172.21.15.59:0/100914095 shutdown_connections 2024-09-10T21:26:50.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.294+0000 7f3ae3eed640 1 --2- 172.21.15.59:0/100914095 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3ac80b52e0 0x7f3ac80b77a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.294+0000 7f3ae3eed640 1 --2- 172.21.15.59:0/100914095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3adc1086b0 0x7f3adc19a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.294+0000 7f3ae3eed640 1 --2- 172.21.15.59:0/100914095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3adc105b00 0x7f3adc199460 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.294+0000 7f3ae3eed640 1 --2- 172.21.15.59:0/100914095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3adc06be40 0x7f3adc198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.294+0000 7f3ae3eed640 1 -- 172.21.15.59:0/100914095 >> 172.21.15.59:0/100914095 conn(0x7f3adc0fd150 msgr2=0x7f3adc103ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:50.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.294+0000 7f3ae3eed640 1 -- 172.21.15.59:0/100914095 shutdown_connections 2024-09-10T21:26:50.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.294+0000 7f3ae3eed640 1 -- 172.21.15.59:0/100914095 wait complete. 2024-09-10T21:26:50.305 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:50 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1200699680' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:26:50.306 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:50 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/959261577' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T21:26:50.307 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T21:26:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.411+0000 7f8e6bea3640 1 -- 172.21.15.59:0/1570178785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e641029e0 msgr2=0x7f8e64102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.411+0000 7f8e6bea3640 1 --2- 172.21.15.59:0/1570178785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e641029e0 0x7f8e64102e60 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009930 tx=0x7f8e5402a420 comp rx=0 tx=0).stop 2024-09-10T21:26:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.411+0000 7f8e6bea3640 1 -- 172.21.15.59:0/1570178785 shutdown_connections 2024-09-10T21:26:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.411+0000 7f8e6bea3640 1 --2- 172.21.15.59:0/1570178785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e641033a0 0x7f8e64109d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.411+0000 7f8e6bea3640 1 --2- 172.21.15.59:0/1570178785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e641029e0 0x7f8e64102e60 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.411+0000 7f8e6bea3640 1 --2- 172.21.15.59:0/1570178785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e64101890 0x7f8e64101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.411+0000 7f8e6bea3640 1 -- 172.21.15.59:0/1570178785 >> 172.21.15.59:0/1570178785 conn(0x7f8e640fd150 msgr2=0x7f8e640ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.411+0000 7f8e6bea3640 1 -- 172.21.15.59:0/1570178785 shutdown_connections 2024-09-10T21:26:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.411+0000 7f8e6bea3640 1 -- 172.21.15.59:0/1570178785 wait complete. 2024-09-10T21:26:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.412+0000 7f8e6bea3640 1 Processor -- start 2024-09-10T21:26:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.412+0000 7f8e6bea3640 1 -- start start 2024-09-10T21:26:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.412+0000 7f8e6bea3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e64101890 0x7f8e64105650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.412+0000 7f8e6bea3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e641029e0 0x7f8e64103eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.412+0000 7f8e6bea3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e641033a0 0x7f8e641043f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.412+0000 7f8e6bea3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6410d4e0 con 0x7f8e64101890 2024-09-10T21:26:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.412+0000 7f8e6bea3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6410d360 con 0x7f8e641033a0 2024-09-10T21:26:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.412+0000 7f8e6bea3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6410d660 con 0x7f8e641029e0 2024-09-10T21:26:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.412+0000 7f8e69c3f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e64101890 0x7f8e64105650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.412+0000 7f8e69c3f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e64101890 0x7f8e64105650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57380/0 (socket says 172.21.15.59:57380) 2024-09-10T21:26:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.412+0000 7f8e69c3f640 1 -- 172.21.15.59:0/3484901850 learned_addr learned my addr 172.21.15.59:0/3484901850 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.412+0000 7f8e6943e640 1 --2- 172.21.15.59:0/3484901850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e641029e0 0x7f8e64103eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.412+0000 7f8e6a440640 1 --2- 172.21.15.59:0/3484901850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e641033a0 0x7f8e641043f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.413+0000 7f8e69c3f640 1 -- 172.21.15.59:0/3484901850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e641029e0 msgr2=0x7f8e64103eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.413+0000 7f8e69c3f640 1 --2- 172.21.15.59:0/3484901850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e641029e0 0x7f8e64103eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.413+0000 7f8e69c3f640 1 -- 172.21.15.59:0/3484901850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e641033a0 msgr2=0x7f8e641043f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.413+0000 7f8e69c3f640 1 --2- 172.21.15.59:0/3484901850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e641033a0 0x7f8e641043f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.413+0000 7f8e69c3f640 1 -- 172.21.15.59:0/3484901850 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e64104c60 con 0x7f8e64101890 2024-09-10T21:26:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.413+0000 7f8e6943e640 1 --2- 172.21.15.59:0/3484901850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e641029e0 0x7f8e64103eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.413+0000 7f8e6a440640 1 --2- 172.21.15.59:0/3484901850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e641033a0 0x7f8e641043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:26:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.413+0000 7f8e69c3f640 1 --2- 172.21.15.59:0/3484901850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e64101890 0x7f8e64105650 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000c920 tx=0x7f8e6000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.413+0000 7f8e5affd640 1 -- 172.21.15.59:0/3484901850 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e60007c70 con 0x7f8e64101890 2024-09-10T21:26:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.413+0000 7f8e5affd640 1 -- 172.21.15.59:0/3484901850 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e60007e10 con 0x7f8e64101890 2024-09-10T21:26:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.413+0000 7f8e6bea3640 1 -- 172.21.15.59:0/3484901850 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e641a2e20 con 0x7f8e64101890 2024-09-10T21:26:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.413+0000 7f8e5affd640 1 -- 172.21.15.59:0/3484901850 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e60018820 con 0x7f8e64101890 2024-09-10T21:26:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.413+0000 7f8e6bea3640 1 -- 172.21.15.59:0/3484901850 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e641a3280 con 0x7f8e64101890 2024-09-10T21:26:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.414+0000 7f8e6bea3640 1 -- 172.21.15.59:0/3484901850 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e641a3510 con 0x7f8e64101890 2024-09-10T21:26:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.415+0000 7f8e5affd640 1 -- 172.21.15.59:0/3484901850 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f8e6000f450 con 0x7f8e64101890 2024-09-10T21:26:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.416+0000 7f8e5affd640 1 --2- 172.21.15.59:0/3484901850 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8e500b52e0 0x7f8e500b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.416+0000 7f8e6943e640 1 --2- 172.21.15.59:0/3484901850 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8e500b52e0 0x7f8e500b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.416+0000 7f8e5affd640 1 -- 172.21.15.59:0/3484901850 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f8e600e6000 con 0x7f8e64101890 2024-09-10T21:26:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.417+0000 7f8e6943e640 1 --2- 172.21.15.59:0/3484901850 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8e500b52e0 0x7f8e500b77a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8e54000c00 tx=0x7f8e540314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.419+0000 7f8e5affd640 1 -- 172.21.15.59:0/3484901850 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8e60014030 con 0x7f8e64101890 2024-09-10T21:26:50.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:50 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1200699680' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:26:50.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:50 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/959261577' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T21:26:50.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:50 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1200699680' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:26:50.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:50 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/959261577' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T21:26:50.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.605+0000 7f8e6bea3640 1 -- 172.21.15.59:0/3484901850 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8e641a3850 con 0x7f8e64101890 2024-09-10T21:26:50.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.605+0000 7f8e5affd640 1 -- 172.21.15.59:0/3484901850 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) ==== 100+0+11 (secure 0 0 0) 0x7f8e600acf80 con 0x7f8e64101890 2024-09-10T21:26:50.608 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-09-10T21:26:50.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.607+0000 7f8e6bea3640 1 -- 172.21.15.59:0/3484901850 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8e500b52e0 msgr2=0x7f8e500b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:50.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.607+0000 7f8e6bea3640 1 --2- 172.21.15.59:0/3484901850 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8e500b52e0 0x7f8e500b77a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8e54000c00 tx=0x7f8e540314a0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.607+0000 7f8e6bea3640 1 -- 172.21.15.59:0/3484901850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e64101890 msgr2=0x7f8e64105650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:50.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.607+0000 7f8e6bea3640 1 --2- 172.21.15.59:0/3484901850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e64101890 0x7f8e64105650 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000c920 tx=0x7f8e6000cde0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.607+0000 7f8e6bea3640 1 -- 172.21.15.59:0/3484901850 shutdown_connections 2024-09-10T21:26:50.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.607+0000 7f8e6bea3640 1 --2- 172.21.15.59:0/3484901850 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f8e500b52e0 0x7f8e500b77a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.607+0000 7f8e6bea3640 1 --2- 172.21.15.59:0/3484901850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e641033a0 0x7f8e641043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.607+0000 7f8e6bea3640 1 --2- 172.21.15.59:0/3484901850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e641029e0 0x7f8e64103eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.607+0000 7f8e6bea3640 1 --2- 172.21.15.59:0/3484901850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e64101890 0x7f8e64105650 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.607+0000 7f8e6bea3640 1 -- 172.21.15.59:0/3484901850 >> 172.21.15.59:0/3484901850 conn(0x7f8e640fd150 msgr2=0x7f8e640feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:50.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.608+0000 7f8e6bea3640 1 -- 172.21.15.59:0/3484901850 shutdown_connections 2024-09-10T21:26:50.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.608+0000 7f8e6bea3640 1 -- 172.21.15.59:0/3484901850 wait complete. 2024-09-10T21:26:50.621 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-10T21:26:50.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.721+0000 7f27856d6640 1 -- 172.21.15.59:0/1212888365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27801029f0 msgr2=0x7f2780102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:50.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.721+0000 7f27856d6640 1 --2- 172.21.15.59:0/1212888365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27801029f0 0x7f2780102e70 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f2774009930 tx=0x7f277402a420 comp rx=0 tx=0).stop 2024-09-10T21:26:50.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.722+0000 7f27856d6640 1 -- 172.21.15.59:0/1212888365 shutdown_connections 2024-09-10T21:26:50.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.722+0000 7f27856d6640 1 --2- 172.21.15.59:0/1212888365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27801033b0 0x7f2780109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.722+0000 7f27856d6640 1 --2- 172.21.15.59:0/1212888365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27801029f0 0x7f2780102e70 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.722+0000 7f27856d6640 1 --2- 172.21.15.59:0/1212888365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27801018a0 0x7f2780101ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.722+0000 7f27856d6640 1 -- 172.21.15.59:0/1212888365 >> 172.21.15.59:0/1212888365 conn(0x7f27800fd180 msgr2=0x7f27800ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:50.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.722+0000 7f27856d6640 1 -- 172.21.15.59:0/1212888365 shutdown_connections 2024-09-10T21:26:50.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.722+0000 7f27856d6640 1 -- 172.21.15.59:0/1212888365 wait complete. 2024-09-10T21:26:50.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.722+0000 7f27856d6640 1 Processor -- start 2024-09-10T21:26:50.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.722+0000 7f27856d6640 1 -- start start 2024-09-10T21:26:50.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.722+0000 7f27856d6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27801018a0 0x7f278006acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:50.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.722+0000 7f27856d6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27801029f0 0x7f278019db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:50.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f27856d6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27801033b0 0x7f27801a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:50.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f27856d6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f278010d510 con 0x7f27801033b0 2024-09-10T21:26:50.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f27856d6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f278010d390 con 0x7f27801018a0 2024-09-10T21:26:50.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f27856d6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f278010d690 con 0x7f27801029f0 2024-09-10T21:26:50.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f277f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27801033b0 0x7f27801a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:50.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f277f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27801033b0 0x7f27801a00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:57402/0 (socket says 172.21.15.59:57402) 2024-09-10T21:26:50.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f277f7fe640 1 -- 172.21.15.59:0/668342915 learned_addr learned my addr 172.21.15.59:0/668342915 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:26:50.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f277effd640 1 --2- 172.21.15.59:0/668342915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27801018a0 0x7f278006acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:50.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f277e7fc640 1 --2- 172.21.15.59:0/668342915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27801029f0 0x7f278019db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:50.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f277f7fe640 1 -- 172.21.15.59:0/668342915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27801029f0 msgr2=0x7f278019db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:50.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f277f7fe640 1 --2- 172.21.15.59:0/668342915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27801029f0 0x7f278019db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f277f7fe640 1 -- 172.21.15.59:0/668342915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27801018a0 msgr2=0x7f278006acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:50.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f277f7fe640 1 --2- 172.21.15.59:0/668342915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27801018a0 0x7f278006acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:50.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f277f7fe640 1 -- 172.21.15.59:0/668342915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27801a09b0 con 0x7f27801033b0 2024-09-10T21:26:50.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f277f7fe640 1 --2- 172.21.15.59:0/668342915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27801033b0 0x7f27801a00f0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f277800eb10 tx=0x7f277800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:50.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f2767fff640 1 -- 172.21.15.59:0/668342915 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778004b20 con 0x7f27801033b0 2024-09-10T21:26:50.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f2767fff640 1 -- 172.21.15.59:0/668342915 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2778004cc0 con 0x7f27801033b0 2024-09-10T21:26:50.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f27856d6640 1 -- 172.21.15.59:0/668342915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27801a0ca0 con 0x7f27801033b0 2024-09-10T21:26:50.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f2767fff640 1 -- 172.21.15.59:0/668342915 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778010670 con 0x7f27801033b0 2024-09-10T21:26:50.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.723+0000 7f27856d6640 1 -- 172.21.15.59:0/668342915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27801a11a0 con 0x7f27801033b0 2024-09-10T21:26:50.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.724+0000 7f27856d6640 1 -- 172.21.15.59:0/668342915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2780108bb0 con 0x7f27801033b0 2024-09-10T21:26:50.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.726+0000 7f2767fff640 1 -- 172.21.15.59:0/668342915 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f2778005000 con 0x7f27801033b0 2024-09-10T21:26:50.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.727+0000 7f2767fff640 1 --2- 172.21.15.59:0/668342915 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f27680b52e0 0x7f27680b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:26:50.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.727+0000 7f277effd640 1 --2- 172.21.15.59:0/668342915 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f27680b52e0 0x7f27680b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:26:50.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.727+0000 7f2767fff640 1 -- 172.21.15.59:0/668342915 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f27780e63c0 con 0x7f27801033b0 2024-09-10T21:26:50.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.727+0000 7f277effd640 1 --2- 172.21.15.59:0/668342915 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f27680b52e0 0x7f27680b77a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2770005d00 tx=0x7f277000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:26:50.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.730+0000 7f2767fff640 1 -- 172.21.15.59:0/668342915 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2778056220 con 0x7f27801033b0 2024-09-10T21:26:50.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.965+0000 7f27856d6640 1 -- 172.21.15.59:0/668342915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f278002e790 con 0x7f27801033b0 2024-09-10T21:26:50.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.974+0000 7f2767fff640 1 -- 172.21.15.59:0/668342915 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+827939 (secure 0 0 0) 0x7f27780ad250 con 0x7f27801033b0 2024-09-10T21:26:50.987 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:26:50.987 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:26:50.987 INFO:teuthology.orchestra.run.smithi059.stdout: "epoch": 18, 2024-09-10T21:26:50.987 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:50.987 INFO:teuthology.orchestra.run.smithi059.stdout: "active_gid": 14150, 2024-09-10T21:26:50.987 INFO:teuthology.orchestra.run.smithi059.stdout: "active_name": "x", 2024-09-10T21:26:50.987 INFO:teuthology.orchestra.run.smithi059.stdout: "active_addrs": { 2024-09-10T21:26:50.987 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-10T21:26:50.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:50.987 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-10T21:26:50.988 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6800", 2024-09-10T21:26:50.988 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 123832859 2024-09-10T21:26:50.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:50.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:50.988 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-09-10T21:26:50.988 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:6801", 2024-09-10T21:26:50.988 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 123832859 2024-09-10T21:26:50.988 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:50.989 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T21:26:50.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:50.989 INFO:teuthology.orchestra.run.smithi059.stdout: "active_addr": "172.21.15.59:6801/123832859", 2024-09-10T21:26:50.989 INFO:teuthology.orchestra.run.smithi059.stdout: "active_change": "2024-09-10T21:06:05.141052+0000", 2024-09-10T21:26:50.989 INFO:teuthology.orchestra.run.smithi059.stdout: "active_mgr_features": 4540719139924082687, 2024-09-10T21:26:50.989 INFO:teuthology.orchestra.run.smithi059.stdout: "available": true, 2024-09-10T21:26:50.989 INFO:teuthology.orchestra.run.smithi059.stdout: "standbys": [ 2024-09-10T21:26:50.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:50.989 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 24127, 2024-09-10T21:26:50.989 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "z", 2024-09-10T21:26:50.989 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_features": 4540719139924082687, 2024-09-10T21:26:50.989 INFO:teuthology.orchestra.run.smithi059.stdout: "available_modules": [ 2024-09-10T21:26:50.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:50.989 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "alerts", 2024-09-10T21:26:50.989 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:50.990 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:50.990 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:50.990 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T21:26:50.990 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T21:26:50.990 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:50.990 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:50.990 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:50.990 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T21:26:50.990 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:50.990 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:50.990 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:50.990 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T21:26:50.990 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:50.990 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:50.991 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:50.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:50.991 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:50.991 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:50.991 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:50.991 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:50.991 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:50.991 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:50.991 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:50.991 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:50.991 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:50.991 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:50.991 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:50.991 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:50.991 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:50.992 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:50.992 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:50.992 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:50.992 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:50.992 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:50.992 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:50.992 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:50.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:50.992 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:50.992 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:50.992 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:50.992 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:50.992 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:50.993 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:50.993 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:50.993 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:50.993 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:50.993 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:50.993 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:50.993 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:50.993 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:50.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:50.993 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:50.993 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:50.993 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:50.993 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:50.993 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:50.994 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:50.994 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:50.994 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:50.994 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:50.994 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:50.994 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:50.994 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:50.994 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:50.994 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:50.994 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:50.994 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:50.994 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:50.994 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:50.994 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:50.995 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:50.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:50.995 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:50.995 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:50.995 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:50.995 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:50.995 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:50.995 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:50.995 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:50.995 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:50.995 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:50.995 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:50.995 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:50.995 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:50.995 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:50.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:50.996 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_destination": { 2024-09-10T21:26:50.996 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_destination", 2024-09-10T21:26:50.996 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:50.996 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:50.996 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:50.996 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:50.996 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:50.996 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:50.996 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:50.996 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T21:26:50.996 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:50.996 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:50.996 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:50.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:50.997 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_from_name": { 2024-09-10T21:26:50.997 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_from_name", 2024-09-10T21:26:50.997 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:50.997 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:50.997 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:50.997 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "Ceph", 2024-09-10T21:26:50.997 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:50.997 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:50.997 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:50.997 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Email From: name", 2024-09-10T21:26:50.997 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:50.997 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:50.997 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:50.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:50.997 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_host": { 2024-09-10T21:26:50.998 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_host", 2024-09-10T21:26:50.998 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:50.998 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:50.998 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:50.998 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:50.998 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:50.998 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:50.998 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:50.998 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP server", 2024-09-10T21:26:50.998 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:50.998 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:50.998 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:50.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:50.998 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_password": { 2024-09-10T21:26:50.998 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_password", 2024-09-10T21:26:50.999 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:50.999 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:50.999 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:50.999 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:50.999 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:50.999 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:50.999 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:50.999 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Password to authenticate with", 2024-09-10T21:26:50.999 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:50.999 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:50.999 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:50.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:50.999 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_port": { 2024-09-10T21:26:50.999 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_port", 2024-09-10T21:26:51.000 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.000 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.000 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.000 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "465", 2024-09-10T21:26:51.000 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.000 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.000 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.000 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP port", 2024-09-10T21:26:51.000 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.000 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.000 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.001 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_sender": { 2024-09-10T21:26:51.001 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_sender", 2024-09-10T21:26:51.001 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.001 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.001 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.001 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.001 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.001 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.001 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.001 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP envelope sender", 2024-09-10T21:26:51.001 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.001 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.001 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.002 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_ssl": { 2024-09-10T21:26:51.002 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_ssl", 2024-09-10T21:26:51.002 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.002 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.002 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.002 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.002 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.002 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.002 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.002 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T21:26:51.002 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.002 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.002 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.003 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_user": { 2024-09-10T21:26:51.003 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_user", 2024-09-10T21:26:51.003 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.003 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.003 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.003 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.003 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.003 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.003 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.003 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "User to authenticate as", 2024-09-10T21:26:51.003 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.004 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.004 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.004 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.004 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.004 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.004 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.004 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.004 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.004 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.004 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.004 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.004 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.005 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.005 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.005 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.005 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.005 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.005 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "balancer", 2024-09-10T21:26:51.005 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.005 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.005 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.005 INFO:teuthology.orchestra.run.smithi059.stdout: "active": { 2024-09-10T21:26:51.005 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "active", 2024-09-10T21:26:51.006 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.006 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.006 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.006 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.006 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.006 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.006 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.006 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T21:26:51.006 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.006 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.006 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.006 INFO:teuthology.orchestra.run.smithi059.stdout: "begin_time": { 2024-09-10T21:26:51.007 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "begin_time", 2024-09-10T21:26:51.007 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.007 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.007 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.007 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0000", 2024-09-10T21:26:51.007 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.007 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.007 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.007 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T21:26:51.007 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T21:26:51.007 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.007 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.008 INFO:teuthology.orchestra.run.smithi059.stdout: "begin_weekday": { 2024-09-10T21:26:51.008 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "begin_weekday", 2024-09-10T21:26:51.008 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T21:26:51.008 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.008 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.008 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.008 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0", 2024-09-10T21:26:51.008 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "6", 2024-09-10T21:26:51.008 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.008 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T21:26:51.008 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T21:26:51.008 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.008 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.009 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_max_iterations": { 2024-09-10T21:26:51.009 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_max_iterations", 2024-09-10T21:26:51.009 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T21:26:51.009 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.009 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.009 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "25", 2024-09-10T21:26:51.009 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T21:26:51.009 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "250", 2024-09-10T21:26:51.009 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.009 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T21:26:51.009 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.009 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.010 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.010 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_metrics": { 2024-09-10T21:26:51.010 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_metrics", 2024-09-10T21:26:51.010 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.010 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.010 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.010 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T21:26:51.010 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.010 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.010 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.010 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T21:26:51.011 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T21:26:51.011 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.011 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.011 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_step": { 2024-09-10T21:26:51.011 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_step", 2024-09-10T21:26:51.011 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:51.011 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.011 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.011 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0.5", 2024-09-10T21:26:51.011 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0.001", 2024-09-10T21:26:51.011 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "0.999", 2024-09-10T21:26:51.011 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.011 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "aggressiveness of optimization", 2024-09-10T21:26:51.012 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T21:26:51.012 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.012 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.012 INFO:teuthology.orchestra.run.smithi059.stdout: "end_time": { 2024-09-10T21:26:51.012 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "end_time", 2024-09-10T21:26:51.012 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.012 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.012 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.012 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "2359", 2024-09-10T21:26:51.012 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.012 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.012 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.013 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T21:26:51.013 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T21:26:51.013 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.013 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.013 INFO:teuthology.orchestra.run.smithi059.stdout: "end_weekday": { 2024-09-10T21:26:51.013 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "end_weekday", 2024-09-10T21:26:51.013 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T21:26:51.013 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.013 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.013 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.013 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0", 2024-09-10T21:26:51.013 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "6", 2024-09-10T21:26:51.013 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.014 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T21:26:51.014 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T21:26:51.014 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.014 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.014 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.014 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.014 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.014 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.014 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.014 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.014 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.014 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.015 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.015 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.015 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.015 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.015 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.015 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.015 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.015 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.015 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.015 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.015 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.015 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.016 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.016 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.016 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.016 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.016 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.016 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.016 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.016 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.016 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.016 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.016 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.016 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.016 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.017 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.017 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.017 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.017 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.017 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.017 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.017 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.017 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.017 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.017 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.017 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.018 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.018 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.018 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.018 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.018 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.018 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.018 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.018 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.018 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.018 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.018 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.018 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.019 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.019 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.019 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.019 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.019 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.019 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.019 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.019 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.019 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.019 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.019 INFO:teuthology.orchestra.run.smithi059.stdout: "min_score": { 2024-09-10T21:26:51.019 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "min_score", 2024-09-10T21:26:51.020 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:51.020 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.020 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.020 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.020 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.020 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.020 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.020 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T21:26:51.020 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.020 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.020 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.020 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": { 2024-09-10T21:26:51.021 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mode", 2024-09-10T21:26:51.021 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.021 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.021 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.021 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "upmap", 2024-09-10T21:26:51.021 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.021 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.021 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.021 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-compat", 2024-09-10T21:26:51.021 INFO:teuthology.orchestra.run.smithi059.stdout: "none", 2024-09-10T21:26:51.021 INFO:teuthology.orchestra.run.smithi059.stdout: "read", 2024-09-10T21:26:51.021 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap", 2024-09-10T21:26:51.021 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap-read" 2024-09-10T21:26:51.021 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.022 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Balancer mode", 2024-09-10T21:26:51.022 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.022 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.022 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.022 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_ids": { 2024-09-10T21:26:51.022 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pool_ids", 2024-09-10T21:26:51.022 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.022 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.022 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.022 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.022 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.022 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.023 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.023 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T21:26:51.023 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.023 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.023 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.023 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T21:26:51.023 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T21:26:51.023 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.023 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.023 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.023 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T21:26:51.023 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.023 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.024 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.024 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T21:26:51.024 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.024 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.024 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.024 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.024 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.024 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.024 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.024 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.024 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.024 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.024 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.025 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.025 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.025 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.025 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.025 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.025 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap_max_deviation": { 2024-09-10T21:26:51.025 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "upmap_max_deviation", 2024-09-10T21:26:51.025 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.025 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.025 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.025 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T21:26:51.025 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T21:26:51.026 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.026 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.026 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T21:26:51.026 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T21:26:51.026 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.026 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.026 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap_max_optimizations": { 2024-09-10T21:26:51.026 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "upmap_max_optimizations", 2024-09-10T21:26:51.026 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T21:26:51.026 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.026 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.026 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:51.026 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.026 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.027 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.027 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T21:26:51.027 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.027 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.027 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.027 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.027 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.027 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephadm", 2024-09-10T21:26:51.027 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.027 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.027 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.027 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_down_multiplier": { 2024-09-10T21:26:51.027 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_down_multiplier", 2024-09-10T21:26:51.028 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:51.028 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.028 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.028 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3.0", 2024-09-10T21:26:51.028 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.028 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.028 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.028 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T21:26:51.028 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.028 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.028 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.028 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_refresh_rate": { 2024-09-10T21:26:51.029 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_refresh_rate", 2024-09-10T21:26:51.029 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.029 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.029 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.029 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "20", 2024-09-10T21:26:51.029 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.029 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.029 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.029 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T21:26:51.029 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.029 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.029 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.029 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_starting_port": { 2024-09-10T21:26:51.030 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_starting_port", 2024-09-10T21:26:51.030 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.030 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.030 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.030 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "4721", 2024-09-10T21:26:51.030 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.030 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.030 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.030 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T21:26:51.030 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.030 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.030 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.031 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_ptrace": { 2024-09-10T21:26:51.031 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_ptrace", 2024-09-10T21:26:51.031 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.031 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.031 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.031 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.031 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.031 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.031 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.031 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T21:26:51.031 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T21:26:51.031 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.031 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.032 INFO:teuthology.orchestra.run.smithi059.stdout: "autotune_interval": { 2024-09-10T21:26:51.032 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "autotune_interval", 2024-09-10T21:26:51.032 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.032 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.032 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.032 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T21:26:51.032 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.032 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.032 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.032 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T21:26:51.032 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.032 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.032 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.032 INFO:teuthology.orchestra.run.smithi059.stdout: "autotune_memory_target_ratio": { 2024-09-10T21:26:51.033 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T21:26:51.033 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:51.033 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.033 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.033 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0.7", 2024-09-10T21:26:51.033 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.033 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.033 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.033 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T21:26:51.033 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.033 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.033 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.034 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm_log_destination": { 2024-09-10T21:26:51.034 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephadm_log_destination", 2024-09-10T21:26:51.034 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.034 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.034 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.034 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.034 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.034 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.034 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.034 INFO:teuthology.orchestra.run.smithi059.stdout: "file", 2024-09-10T21:26:51.034 INFO:teuthology.orchestra.run.smithi059.stdout: "file,syslog", 2024-09-10T21:26:51.034 INFO:teuthology.orchestra.run.smithi059.stdout: "syslog" 2024-09-10T21:26:51.034 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.034 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T21:26:51.035 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.035 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.035 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.035 INFO:teuthology.orchestra.run.smithi059.stdout: "cgroups_split": { 2024-09-10T21:26:51.035 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cgroups_split", 2024-09-10T21:26:51.035 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.035 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.035 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.035 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.035 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.035 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.035 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.035 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T21:26:51.036 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.036 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.036 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.036 INFO:teuthology.orchestra.run.smithi059.stdout: "config_checks_enabled": { 2024-09-10T21:26:51.036 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_checks_enabled", 2024-09-10T21:26:51.036 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.036 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.036 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.036 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.036 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.036 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.036 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.037 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T21:26:51.037 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.037 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.037 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.038 INFO:teuthology.orchestra.run.smithi059.stdout: "config_dashboard": { 2024-09-10T21:26:51.038 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_dashboard", 2024-09-10T21:26:51.038 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.038 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.038 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.038 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.038 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.038 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.038 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.038 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T21:26:51.038 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.038 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.038 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.039 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_alertmanager": { 2024-09-10T21:26:51.039 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_alertmanager", 2024-09-10T21:26:51.039 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.039 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.039 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.039 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T21:26:51.039 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.039 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.039 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.039 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T21:26:51.039 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.040 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.040 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.040 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_base": { 2024-09-10T21:26:51.040 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_base", 2024-09-10T21:26:51.040 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.040 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.040 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.040 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T21:26:51.040 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.040 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.040 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.040 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Container image name, without the tag", 2024-09-10T21:26:51.040 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.041 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.041 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.041 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_elasticsearch": { 2024-09-10T21:26:51.041 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_elasticsearch", 2024-09-10T21:26:51.041 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.041 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.041 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.041 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T21:26:51.041 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.041 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.041 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.041 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "elasticsearch container image", 2024-09-10T21:26:51.042 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.042 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.042 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.042 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_grafana": { 2024-09-10T21:26:51.042 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_grafana", 2024-09-10T21:26:51.042 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.042 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.042 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.042 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T21:26:51.042 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.042 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.042 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.043 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T21:26:51.043 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.043 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.043 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.043 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_haproxy": { 2024-09-10T21:26:51.043 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_haproxy", 2024-09-10T21:26:51.043 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.043 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.043 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.043 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T21:26:51.043 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.043 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.044 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.044 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "HAproxy container image", 2024-09-10T21:26:51.044 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.044 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.044 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.044 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_agent": { 2024-09-10T21:26:51.044 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_agent", 2024-09-10T21:26:51.044 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.044 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.044 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.044 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T21:26:51.044 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.045 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.045 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.045 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger agent container image", 2024-09-10T21:26:51.045 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.045 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.045 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.045 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_collector": { 2024-09-10T21:26:51.045 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_collector", 2024-09-10T21:26:51.045 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.045 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.045 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.045 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T21:26:51.046 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.046 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.046 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.046 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger collector container image", 2024-09-10T21:26:51.046 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.046 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.046 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.046 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_query": { 2024-09-10T21:26:51.046 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_query", 2024-09-10T21:26:51.046 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.046 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.046 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.046 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T21:26:51.047 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.047 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.047 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.047 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger query container image", 2024-09-10T21:26:51.047 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.047 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.047 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.047 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_keepalived": { 2024-09-10T21:26:51.047 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_keepalived", 2024-09-10T21:26:51.047 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.047 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.047 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.047 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T21:26:51.048 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.048 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.048 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.048 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Keepalived container image", 2024-09-10T21:26:51.048 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.048 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.048 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.048 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_loki": { 2024-09-10T21:26:51.048 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_loki", 2024-09-10T21:26:51.048 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.048 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.048 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.049 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T21:26:51.049 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.049 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.049 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.049 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Loki container image", 2024-09-10T21:26:51.049 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.049 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.049 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.049 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_nginx": { 2024-09-10T21:26:51.049 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_nginx", 2024-09-10T21:26:51.049 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.049 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.049 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.050 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T21:26:51.050 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.050 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.050 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.050 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Nginx container image", 2024-09-10T21:26:51.050 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.050 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.050 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.050 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_node_exporter": { 2024-09-10T21:26:51.050 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_node_exporter", 2024-09-10T21:26:51.050 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.050 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.050 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.051 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T21:26:51.051 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.051 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.051 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.051 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T21:26:51.051 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.051 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.051 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.051 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_nvmeof": { 2024-09-10T21:26:51.051 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_nvmeof", 2024-09-10T21:26:51.051 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.051 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.052 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.052 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T21:26:51.052 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.052 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.052 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.052 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Nvme-of container image", 2024-09-10T21:26:51.052 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.052 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.052 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.052 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_oauth2_proxy": { 2024-09-10T21:26:51.052 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T21:26:51.052 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.052 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.053 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.053 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T21:26:51.053 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.053 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.053 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.053 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "oauth2-proxy container image", 2024-09-10T21:26:51.053 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.053 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.053 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.053 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_prometheus": { 2024-09-10T21:26:51.053 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_prometheus", 2024-09-10T21:26:51.053 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.053 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.054 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.054 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T21:26:51.054 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.054 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.054 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.054 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T21:26:51.054 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.054 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.054 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.054 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_promtail": { 2024-09-10T21:26:51.055 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_promtail", 2024-09-10T21:26:51.055 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.055 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.055 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.055 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T21:26:51.055 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.055 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.055 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.055 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Promtail container image", 2024-09-10T21:26:51.055 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.055 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.055 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.056 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_samba": { 2024-09-10T21:26:51.056 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_samba", 2024-09-10T21:26:51.056 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.056 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.056 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.056 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T21:26:51.056 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.056 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.056 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.056 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Samba/SMB container image", 2024-09-10T21:26:51.056 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.056 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.056 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.057 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_samba_metrics": { 2024-09-10T21:26:51.057 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_samba_metrics", 2024-09-10T21:26:51.057 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.057 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.057 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.057 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T21:26:51.057 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.057 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.057 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.057 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T21:26:51.057 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.057 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.058 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.058 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_snmp_gateway": { 2024-09-10T21:26:51.058 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_snmp_gateway", 2024-09-10T21:26:51.058 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.058 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.058 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.058 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T21:26:51.058 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.058 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.058 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.058 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SNMP Gateway container image", 2024-09-10T21:26:51.058 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.059 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.059 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.059 INFO:teuthology.orchestra.run.smithi059.stdout: "container_init": { 2024-09-10T21:26:51.059 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_init", 2024-09-10T21:26:51.059 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.059 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.059 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.059 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.059 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.059 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.059 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.059 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T21:26:51.060 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.060 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.060 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.060 INFO:teuthology.orchestra.run.smithi059.stdout: "daemon_cache_timeout": { 2024-09-10T21:26:51.060 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "daemon_cache_timeout", 2024-09-10T21:26:51.060 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.060 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.060 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.060 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T21:26:51.060 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.060 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.060 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.061 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T21:26:51.061 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.061 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.061 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.061 INFO:teuthology.orchestra.run.smithi059.stdout: "default_cephadm_command_timeout": { 2024-09-10T21:26:51.061 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T21:26:51.061 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.061 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.061 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.061 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "900", 2024-09-10T21:26:51.061 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.061 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.061 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.062 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T21:26:51.062 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.062 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.062 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.062 INFO:teuthology.orchestra.run.smithi059.stdout: "default_registry": { 2024-09-10T21:26:51.062 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "default_registry", 2024-09-10T21:26:51.062 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.062 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.062 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.062 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io", 2024-09-10T21:26:51.062 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.062 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.062 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.062 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T21:26:51.063 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.063 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.063 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.063 INFO:teuthology.orchestra.run.smithi059.stdout: "device_cache_timeout": { 2024-09-10T21:26:51.063 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_cache_timeout", 2024-09-10T21:26:51.063 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.063 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.063 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.063 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1800", 2024-09-10T21:26:51.063 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.063 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.063 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.063 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache device inventory", 2024-09-10T21:26:51.063 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.063 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.064 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.064 INFO:teuthology.orchestra.run.smithi059.stdout: "device_enhanced_scan": { 2024-09-10T21:26:51.064 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_enhanced_scan", 2024-09-10T21:26:51.064 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.064 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.064 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.064 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.064 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.064 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.064 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.064 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T21:26:51.064 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.065 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.065 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.065 INFO:teuthology.orchestra.run.smithi059.stdout: "facts_cache_timeout": { 2024-09-10T21:26:51.065 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "facts_cache_timeout", 2024-09-10T21:26:51.065 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.065 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.065 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.065 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T21:26:51.065 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.065 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.065 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.065 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache host facts data", 2024-09-10T21:26:51.065 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.066 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.066 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.066 INFO:teuthology.orchestra.run.smithi059.stdout: "grafana_dashboards_path": { 2024-09-10T21:26:51.066 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "grafana_dashboards_path", 2024-09-10T21:26:51.066 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.066 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.066 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.066 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T21:26:51.066 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.066 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.066 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.066 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T21:26:51.066 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.067 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.067 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.067 INFO:teuthology.orchestra.run.smithi059.stdout: "host_check_interval": { 2024-09-10T21:26:51.067 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "host_check_interval", 2024-09-10T21:26:51.067 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.067 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.067 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.067 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T21:26:51.067 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.067 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.067 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.067 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to perform a host check", 2024-09-10T21:26:51.067 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.068 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.068 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.068 INFO:teuthology.orchestra.run.smithi059.stdout: "hw_monitoring": { 2024-09-10T21:26:51.068 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "hw_monitoring", 2024-09-10T21:26:51.068 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.068 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.068 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.068 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.068 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.068 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.068 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.068 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T21:26:51.068 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.069 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.069 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.069 INFO:teuthology.orchestra.run.smithi059.stdout: "inventory_list_all": { 2024-09-10T21:26:51.069 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "inventory_list_all", 2024-09-10T21:26:51.069 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.069 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.069 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.069 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.069 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.069 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.069 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.069 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T21:26:51.070 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.070 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.070 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.070 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.070 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.070 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.070 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.070 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.070 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.070 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.070 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.070 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.070 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.070 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.071 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.071 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.071 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.071 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.071 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.071 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.071 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.071 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.071 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.071 INFO:teuthology.orchestra.run.smithi059.stdout: "log_refresh_metadata": { 2024-09-10T21:26:51.071 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_refresh_metadata", 2024-09-10T21:26:51.071 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.071 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.072 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.072 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.072 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.072 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.072 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.072 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T21:26:51.072 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.072 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.072 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.072 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.072 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.072 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.072 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.073 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.073 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.073 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.073 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.073 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.073 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T21:26:51.073 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.073 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.073 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.073 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.073 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.074 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.074 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.074 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.074 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.074 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.074 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.074 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.074 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.074 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.074 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.074 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.074 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.074 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.074 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.075 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.075 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.075 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.075 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.075 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.075 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.075 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.075 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.075 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.075 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.075 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.075 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.076 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.076 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.076 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.076 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.076 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.076 INFO:teuthology.orchestra.run.smithi059.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T21:26:51.076 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T21:26:51.076 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.076 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.076 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.076 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.076 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.076 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.077 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.077 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T21:26:51.077 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.077 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.077 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.077 INFO:teuthology.orchestra.run.smithi059.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T21:26:51.077 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T21:26:51.077 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.077 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.077 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.077 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "*", 2024-09-10T21:26:51.077 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.078 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.078 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.078 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T21:26:51.078 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.078 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.078 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.078 INFO:teuthology.orchestra.run.smithi059.stdout: "max_count_per_host": { 2024-09-10T21:26:51.078 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_count_per_host", 2024-09-10T21:26:51.078 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.078 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.078 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.078 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:51.079 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.079 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.079 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.079 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "max number of daemons per service per host", 2024-09-10T21:26:51.079 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.079 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.079 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.079 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd_draining_count": { 2024-09-10T21:26:51.079 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_osd_draining_count", 2024-09-10T21:26:51.079 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.079 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.080 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.080 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:51.080 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.080 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.080 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.080 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T21:26:51.080 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.080 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.080 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.080 INFO:teuthology.orchestra.run.smithi059.stdout: "migration_current": { 2024-09-10T21:26:51.080 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "migration_current", 2024-09-10T21:26:51.080 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.080 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.081 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.081 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.081 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.081 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.081 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.081 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "internal - do not modify", 2024-09-10T21:26:51.081 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.081 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.081 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.081 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": { 2024-09-10T21:26:51.081 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mode", 2024-09-10T21:26:51.081 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.081 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.082 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.082 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "root", 2024-09-10T21:26:51.082 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.082 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.082 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.082 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm-package", 2024-09-10T21:26:51.082 INFO:teuthology.orchestra.run.smithi059.stdout: "root" 2024-09-10T21:26:51.082 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.082 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T21:26:51.082 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.082 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.082 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.082 INFO:teuthology.orchestra.run.smithi059.stdout: "oob_default_addr": { 2024-09-10T21:26:51.083 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "oob_default_addr", 2024-09-10T21:26:51.083 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.083 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.083 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.083 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "169.254.1.1", 2024-09-10T21:26:51.083 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.083 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.083 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.083 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T21:26:51.083 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.083 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.083 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.084 INFO:teuthology.orchestra.run.smithi059.stdout: "prometheus_alerts_path": { 2024-09-10T21:26:51.084 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prometheus_alerts_path", 2024-09-10T21:26:51.084 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.084 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.084 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.084 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T21:26:51.084 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.084 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.084 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.084 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T21:26:51.084 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.084 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.084 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.085 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_insecure": { 2024-09-10T21:26:51.085 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_insecure", 2024-09-10T21:26:51.085 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.085 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.085 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.085 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.085 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.085 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.085 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.085 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T21:26:51.085 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.085 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.085 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.086 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_password": { 2024-09-10T21:26:51.086 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_password", 2024-09-10T21:26:51.086 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.086 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.086 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.086 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.086 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.086 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.086 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.086 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T21:26:51.086 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.086 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.086 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.087 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_url": { 2024-09-10T21:26:51.087 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_url", 2024-09-10T21:26:51.087 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.087 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.087 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.087 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.087 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.087 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.087 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.087 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T21:26:51.087 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.087 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.087 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.087 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_username": { 2024-09-10T21:26:51.087 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_username", 2024-09-10T21:26:51.088 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.088 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.088 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.088 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.088 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.088 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.088 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.088 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T21:26:51.088 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.088 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.088 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.088 INFO:teuthology.orchestra.run.smithi059.stdout: "secure_monitoring_stack": { 2024-09-10T21:26:51.088 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "secure_monitoring_stack", 2024-09-10T21:26:51.089 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.089 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.089 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.089 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.089 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.089 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.089 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.089 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T21:26:51.089 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.089 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.089 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.089 INFO:teuthology.orchestra.run.smithi059.stdout: "service_discovery_port": { 2024-09-10T21:26:51.089 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "service_discovery_port", 2024-09-10T21:26:51.089 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.090 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.090 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.090 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8765", 2024-09-10T21:26:51.090 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.090 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.090 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.090 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "cephadm service discovery port", 2024-09-10T21:26:51.090 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.090 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.090 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.090 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.090 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.090 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.090 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.091 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.091 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.091 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.091 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.091 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.091 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.091 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.091 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.091 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.091 INFO:teuthology.orchestra.run.smithi059.stdout: "ssh_config_file": { 2024-09-10T21:26:51.091 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssh_config_file", 2024-09-10T21:26:51.091 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.091 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.091 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.091 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.092 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.092 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.092 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.092 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T21:26:51.092 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.092 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.092 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.092 INFO:teuthology.orchestra.run.smithi059.stdout: "use_agent": { 2024-09-10T21:26:51.092 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "use_agent", 2024-09-10T21:26:51.092 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.092 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.092 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.093 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.093 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.093 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.093 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.093 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T21:26:51.093 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.093 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.093 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.093 INFO:teuthology.orchestra.run.smithi059.stdout: "use_repo_digest": { 2024-09-10T21:26:51.093 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "use_repo_digest", 2024-09-10T21:26:51.093 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.093 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.094 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.094 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.094 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.094 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.094 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.094 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T21:26:51.094 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.094 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.094 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.094 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_failed_host_check": { 2024-09-10T21:26:51.094 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_failed_host_check", 2024-09-10T21:26:51.094 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.094 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.095 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.095 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.095 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.095 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.095 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.095 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T21:26:51.095 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.095 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.095 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.095 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_stray_daemons": { 2024-09-10T21:26:51.095 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_stray_daemons", 2024-09-10T21:26:51.095 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.096 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.096 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.096 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.096 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.096 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.096 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.096 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T21:26:51.096 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.096 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.096 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.096 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_stray_hosts": { 2024-09-10T21:26:51.096 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_stray_hosts", 2024-09-10T21:26:51.096 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.097 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.097 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.097 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.097 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.097 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.097 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.097 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T21:26:51.097 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.097 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.097 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.097 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.097 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.097 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crash", 2024-09-10T21:26:51.098 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.098 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.098 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.098 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.098 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.098 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.098 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.098 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.098 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.098 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.098 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.098 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.098 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.098 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.098 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.099 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.099 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.099 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.099 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.099 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.099 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.099 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.099 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.099 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.099 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.099 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.099 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.099 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.100 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.100 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.100 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.100 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.100 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.100 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.100 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.100 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.100 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.100 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.101 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.101 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.101 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.101 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.101 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.101 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.101 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.101 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.101 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.101 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.101 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.101 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.101 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.102 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.102 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.102 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.102 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.102 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.102 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.102 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.102 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.102 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.102 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.102 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.102 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.102 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.103 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.103 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.103 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.103 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.103 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.103 INFO:teuthology.orchestra.run.smithi059.stdout: "retain_interval": { 2024-09-10T21:26:51.103 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "retain_interval", 2024-09-10T21:26:51.103 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.103 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.103 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.103 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "31536000", 2024-09-10T21:26:51.103 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.104 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.104 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.104 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T21:26:51.104 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.104 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.104 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.104 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.104 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.104 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.104 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.104 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.104 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.105 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.105 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.105 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.105 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.105 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.105 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.105 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.105 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_recent_interval": { 2024-09-10T21:26:51.105 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_recent_interval", 2024-09-10T21:26:51.105 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.106 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.106 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.106 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1209600", 2024-09-10T21:26:51.106 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.106 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.106 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.106 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T21:26:51.106 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.106 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.106 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.106 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.106 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.107 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "dashboard", 2024-09-10T21:26:51.107 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.107 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.107 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.107 INFO:teuthology.orchestra.run.smithi059.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T21:26:51.107 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T21:26:51.107 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.107 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.107 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.107 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:51.107 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.107 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.108 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.108 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.108 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.108 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.108 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.108 INFO:teuthology.orchestra.run.smithi059.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T21:26:51.108 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T21:26:51.108 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.108 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.108 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.108 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.108 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.109 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.109 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.109 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.109 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.109 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.109 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.109 INFO:teuthology.orchestra.run.smithi059.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T21:26:51.109 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T21:26:51.109 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.109 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.109 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.109 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.110 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.110 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.110 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.110 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.110 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.110 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.110 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.110 INFO:teuthology.orchestra.run.smithi059.stdout: "AUDIT_API_ENABLED": { 2024-09-10T21:26:51.110 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T21:26:51.110 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.110 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.110 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.110 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.111 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.111 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.111 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.111 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.111 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.111 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.111 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.111 INFO:teuthology.orchestra.run.smithi059.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T21:26:51.111 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T21:26:51.111 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.111 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.111 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.112 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.112 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.112 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.112 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.112 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.112 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.112 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.112 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.112 INFO:teuthology.orchestra.run.smithi059.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T21:26:51.112 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T21:26:51.112 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.112 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.112 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.113 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.113 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.113 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.113 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.113 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.113 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.113 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.113 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.113 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T21:26:51.113 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T21:26:51.113 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.113 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.113 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.114 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.114 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.114 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.114 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.114 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.114 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.114 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.114 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.114 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T21:26:51.114 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T21:26:51.114 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.114 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.114 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.115 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.115 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.115 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.115 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.115 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.115 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.115 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.115 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.115 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T21:26:51.115 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T21:26:51.115 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.115 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.116 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.116 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.116 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.116 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.116 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.116 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.116 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.116 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.116 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.116 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T21:26:51.116 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T21:26:51.116 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.116 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.117 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.117 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.117 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.117 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.117 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.117 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.117 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.117 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.117 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.117 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T21:26:51.117 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T21:26:51.117 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.117 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.118 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.118 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.118 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.118 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.118 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.118 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.118 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.118 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.118 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.118 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T21:26:51.118 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T21:26:51.119 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.119 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.119 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.119 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.119 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.119 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.119 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.119 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.119 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.119 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.119 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.120 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T21:26:51.120 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T21:26:51.120 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.120 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.120 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.120 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.120 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.120 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.120 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.120 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.120 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.120 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.120 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.121 INFO:teuthology.orchestra.run.smithi059.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T21:26:51.121 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T21:26:51.121 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.121 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.121 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.121 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.121 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.121 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.121 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.121 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.121 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.122 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.122 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.122 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T21:26:51.122 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T21:26:51.122 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.122 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.122 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.122 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2024-09-10T21:26:51.122 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.122 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.122 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.122 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.123 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.123 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.123 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.123 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T21:26:51.123 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T21:26:51.123 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.123 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.123 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.123 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.123 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.123 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.124 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.124 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.124 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.124 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.124 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.124 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_URL": { 2024-09-10T21:26:51.124 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_URL", 2024-09-10T21:26:51.124 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.124 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.125 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.125 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.125 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.125 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.125 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.125 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.125 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.125 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.125 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.125 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T21:26:51.125 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T21:26:51.125 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.126 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.126 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.126 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2024-09-10T21:26:51.126 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.126 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.126 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.126 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.126 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.126 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.126 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.126 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T21:26:51.126 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T21:26:51.126 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.127 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.127 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.127 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.127 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.127 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.127 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.127 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.127 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.127 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.127 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.127 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T21:26:51.127 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T21:26:51.128 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.128 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.128 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.128 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.128 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.128 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.128 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.128 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.128 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.128 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.128 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.128 INFO:teuthology.orchestra.run.smithi059.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T21:26:51.128 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T21:26:51.129 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.129 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.129 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.129 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.129 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.129 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.129 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.129 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.129 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.129 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.129 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.129 INFO:teuthology.orchestra.run.smithi059.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T21:26:51.130 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T21:26:51.130 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.130 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.130 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.130 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.130 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.130 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.130 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.130 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.130 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.130 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.130 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.130 INFO:teuthology.orchestra.run.smithi059.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T21:26:51.131 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T21:26:51.131 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.131 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.131 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.131 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "[]", 2024-09-10T21:26:51.131 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.131 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.131 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.131 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.131 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.131 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.131 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.132 INFO:teuthology.orchestra.run.smithi059.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T21:26:51.132 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T21:26:51.132 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.132 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.132 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.132 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "{}", 2024-09-10T21:26:51.132 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.132 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.132 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.132 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.132 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.132 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.132 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.133 INFO:teuthology.orchestra.run.smithi059.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T21:26:51.133 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T21:26:51.133 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.133 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.133 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.133 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.133 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.133 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.133 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.133 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.133 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.133 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.133 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.134 INFO:teuthology.orchestra.run.smithi059.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T21:26:51.134 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T21:26:51.134 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.134 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.134 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.134 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.134 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.134 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.134 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.134 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.134 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.135 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.135 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.135 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T21:26:51.135 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T21:26:51.135 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.135 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.135 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.135 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.135 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.135 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.135 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.136 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.136 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.136 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.136 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.136 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T21:26:51.136 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T21:26:51.136 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.136 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.136 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.136 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.136 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.136 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.137 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.137 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.137 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.137 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.137 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.137 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T21:26:51.137 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T21:26:51.137 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.137 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.137 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.137 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.137 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.138 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.138 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.138 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.138 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.138 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.138 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.138 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T21:26:51.138 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T21:26:51.138 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.138 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.138 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.138 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.139 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.139 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.139 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.139 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.139 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.139 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.139 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.139 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T21:26:51.139 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T21:26:51.139 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.139 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.139 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.140 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.140 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.140 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.140 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.140 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.140 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.140 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.140 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.140 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T21:26:51.140 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T21:26:51.140 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.140 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.141 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.141 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.141 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.141 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.141 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.141 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.141 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.141 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.141 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.141 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T21:26:51.141 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T21:26:51.141 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.141 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.142 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.142 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.142 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.142 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.142 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.142 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.142 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.142 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.142 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.142 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T21:26:51.142 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T21:26:51.143 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.143 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.143 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.143 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.143 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.143 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.143 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.143 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.143 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.143 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.143 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.143 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T21:26:51.143 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T21:26:51.144 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.144 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.144 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.144 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T21:26:51.144 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.144 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.144 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.144 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.144 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.144 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.144 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.145 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T21:26:51.145 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T21:26:51.145 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.145 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.145 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.145 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:51.145 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.145 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.145 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.145 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.145 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.145 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.145 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.146 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T21:26:51.146 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T21:26:51.146 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.146 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.146 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.146 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8", 2024-09-10T21:26:51.146 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.146 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.146 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.146 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.146 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.146 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.146 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.147 INFO:teuthology.orchestra.run.smithi059.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T21:26:51.147 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T21:26:51.147 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.147 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.147 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.147 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "45", 2024-09-10T21:26:51.147 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.147 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.147 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.147 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.147 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.148 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.148 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.148 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T21:26:51.148 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T21:26:51.148 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.148 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.148 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.148 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.148 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.148 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.148 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.149 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.149 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.149 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.149 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.149 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T21:26:51.149 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T21:26:51.149 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.149 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.149 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.149 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2024-09-10T21:26:51.149 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.149 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.150 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.150 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.150 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.150 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.150 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.150 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T21:26:51.150 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T21:26:51.150 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.150 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.150 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.150 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.150 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.151 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.151 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.151 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.151 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.151 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.151 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.151 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T21:26:51.151 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T21:26:51.151 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.151 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.151 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.151 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.151 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.152 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.152 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.152 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.152 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.152 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.152 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.152 INFO:teuthology.orchestra.run.smithi059.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T21:26:51.152 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T21:26:51.152 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.152 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.152 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.152 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.153 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.153 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.153 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.153 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.153 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.153 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.153 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.153 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T21:26:51.153 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T21:26:51.153 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.153 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.153 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.153 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.154 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.154 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.154 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.154 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.154 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.154 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.154 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.154 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T21:26:51.154 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T21:26:51.154 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.154 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.154 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.155 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:51.155 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.155 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.155 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.155 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.155 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.155 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.155 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.155 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T21:26:51.155 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T21:26:51.155 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.155 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.155 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.156 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T21:26:51.156 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.156 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.156 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.156 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.156 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.156 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.156 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.156 INFO:teuthology.orchestra.run.smithi059.stdout: "cross_origin_url": { 2024-09-10T21:26:51.156 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cross_origin_url", 2024-09-10T21:26:51.156 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.156 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.156 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.157 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.157 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.157 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.157 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.157 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.157 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.157 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.157 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.157 INFO:teuthology.orchestra.run.smithi059.stdout: "crt_file": { 2024-09-10T21:26:51.157 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crt_file", 2024-09-10T21:26:51.157 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.157 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.157 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.158 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.158 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.158 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.158 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.158 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.158 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.158 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.158 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.158 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.158 INFO:teuthology.orchestra.run.smithi059.stdout: "debug": { 2024-09-10T21:26:51.158 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "debug", 2024-09-10T21:26:51.158 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.158 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.158 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.159 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.159 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.159 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.159 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.159 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable/disable debug options", 2024-09-10T21:26:51.159 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.159 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.159 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.159 INFO:teuthology.orchestra.run.smithi059.stdout: "jwt_token_ttl": { 2024-09-10T21:26:51.159 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "jwt_token_ttl", 2024-09-10T21:26:51.159 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.159 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.159 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.159 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "28800", 2024-09-10T21:26:51.160 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.160 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.160 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.160 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.160 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.160 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.160 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.160 INFO:teuthology.orchestra.run.smithi059.stdout: "key_file": { 2024-09-10T21:26:51.160 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "key_file", 2024-09-10T21:26:51.160 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.160 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.160 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.160 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.160 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.161 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.161 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.161 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.161 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.161 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.161 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.161 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.161 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.161 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.161 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.161 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.162 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.162 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.162 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.162 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.162 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.162 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.162 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.162 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.162 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.162 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.162 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.162 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.163 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.163 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.163 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.163 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.163 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.163 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.163 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.163 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.163 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.163 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.163 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.163 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.164 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.164 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.164 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.164 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.164 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.164 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.164 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.164 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.164 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.164 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.164 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.164 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.165 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.165 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.165 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.165 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.165 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.165 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.165 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.165 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.165 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.165 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.165 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.165 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.165 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.166 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.166 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.166 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.166 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.166 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.166 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.166 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.166 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.166 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.166 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.166 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.166 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.166 INFO:teuthology.orchestra.run.smithi059.stdout: "motd": { 2024-09-10T21:26:51.167 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "motd", 2024-09-10T21:26:51.167 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.167 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.167 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.167 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.167 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.167 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.167 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.167 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "The message of the day", 2024-09-10T21:26:51.167 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.167 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.167 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.168 INFO:teuthology.orchestra.run.smithi059.stdout: "redirect_resolve_ip_addr": { 2024-09-10T21:26:51.168 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T21:26:51.168 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.168 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.168 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.168 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.168 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.168 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.168 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.168 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.168 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.168 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.168 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.169 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2024-09-10T21:26:51.169 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2024-09-10T21:26:51.169 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.169 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.169 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.169 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "::", 2024-09-10T21:26:51.169 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.169 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.169 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.169 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.169 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.169 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.169 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.170 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2024-09-10T21:26:51.170 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2024-09-10T21:26:51.170 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.170 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.170 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.170 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8080", 2024-09-10T21:26:51.170 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.170 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.170 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.170 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.170 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.170 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.170 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.171 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.171 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.171 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.171 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.171 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.171 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.171 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.171 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.171 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.171 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.171 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.171 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.171 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.171 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.172 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl": { 2024-09-10T21:26:51.172 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl", 2024-09-10T21:26:51.172 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.172 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.172 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.172 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.172 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.172 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.172 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.172 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.172 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.172 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.172 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.173 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl_server_port": { 2024-09-10T21:26:51.173 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl_server_port", 2024-09-10T21:26:51.173 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.173 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.173 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.173 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8443", 2024-09-10T21:26:51.173 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.173 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.173 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.173 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.173 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.173 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.173 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.174 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.174 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_behaviour": { 2024-09-10T21:26:51.174 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_behaviour", 2024-09-10T21:26:51.174 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.174 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.174 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.174 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "redirect", 2024-09-10T21:26:51.174 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.174 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.174 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.174 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.174 INFO:teuthology.orchestra.run.smithi059.stdout: "redirect" 2024-09-10T21:26:51.174 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.174 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.175 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.175 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.175 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.175 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_error_status_code": { 2024-09-10T21:26:51.175 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_error_status_code", 2024-09-10T21:26:51.175 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.175 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.175 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.175 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2024-09-10T21:26:51.175 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "400", 2024-09-10T21:26:51.175 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "599", 2024-09-10T21:26:51.175 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.176 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.176 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.176 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.176 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.176 INFO:teuthology.orchestra.run.smithi059.stdout: "url_prefix": { 2024-09-10T21:26:51.176 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "url_prefix", 2024-09-10T21:26:51.176 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.176 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.176 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.176 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.176 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.177 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.177 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.177 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.177 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.177 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.177 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.177 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.177 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.177 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.177 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "devicehealth", 2024-09-10T21:26:51.177 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.177 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.178 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.178 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_monitoring": { 2024-09-10T21:26:51.178 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enable_monitoring", 2024-09-10T21:26:51.178 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.178 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.178 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.178 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.178 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.178 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.178 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.178 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "monitor device health metrics", 2024-09-10T21:26:51.178 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.178 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.178 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.179 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.179 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.179 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.179 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.179 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.179 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.179 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.179 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.179 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.179 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.179 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.179 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.179 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.180 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.180 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.180 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.180 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.180 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.180 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.180 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.180 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.180 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.180 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.180 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.180 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.181 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.181 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.181 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.181 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.181 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.181 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.181 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.181 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.181 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.181 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.181 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.181 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.181 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.182 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.182 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.182 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.182 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.182 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.182 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.182 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.182 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.182 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.182 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.182 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.182 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.182 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.183 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.183 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.183 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.183 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.183 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.183 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.183 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.183 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.183 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.183 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.183 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.183 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.184 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.184 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.184 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.184 INFO:teuthology.orchestra.run.smithi059.stdout: "mark_out_threshold": { 2024-09-10T21:26:51.184 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mark_out_threshold", 2024-09-10T21:26:51.184 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.184 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.184 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.184 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "2419200", 2024-09-10T21:26:51.184 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.184 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.184 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.184 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T21:26:51.185 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.185 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.185 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.185 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.185 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": { 2024-09-10T21:26:51.185 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pool_name", 2024-09-10T21:26:51.185 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.185 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.185 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.185 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "device_health_metrics", 2024-09-10T21:26:51.185 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.185 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.185 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.186 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T21:26:51.186 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.186 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.186 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.186 INFO:teuthology.orchestra.run.smithi059.stdout: "retention_period": { 2024-09-10T21:26:51.186 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "retention_period", 2024-09-10T21:26:51.186 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.186 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.186 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.186 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15552000", 2024-09-10T21:26:51.186 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.186 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.187 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.187 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long to retain device health metrics", 2024-09-10T21:26:51.187 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.187 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.187 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.187 INFO:teuthology.orchestra.run.smithi059.stdout: "scrape_frequency": { 2024-09-10T21:26:51.187 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "scrape_frequency", 2024-09-10T21:26:51.187 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.187 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.187 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.187 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "86400", 2024-09-10T21:26:51.187 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.187 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.188 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.188 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T21:26:51.188 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.188 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.188 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.188 INFO:teuthology.orchestra.run.smithi059.stdout: "self_heal": { 2024-09-10T21:26:51.188 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "self_heal", 2024-09-10T21:26:51.188 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.188 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.188 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.188 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.188 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.189 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.189 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.189 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T21:26:51.189 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.189 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.189 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.189 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.189 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T21:26:51.189 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T21:26:51.189 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.189 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.189 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.190 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T21:26:51.190 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.190 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.190 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.190 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T21:26:51.190 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.190 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.190 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.190 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.190 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.190 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.191 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.191 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.191 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.191 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.191 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.191 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.191 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.191 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.191 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.191 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.191 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_threshold": { 2024-09-10T21:26:51.191 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_threshold", 2024-09-10T21:26:51.192 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.192 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.192 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.192 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "7257600", 2024-09-10T21:26:51.192 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.192 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.192 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.192 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T21:26:51.192 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.192 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.192 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.192 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.192 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.193 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.193 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "diskprediction_local", 2024-09-10T21:26:51.193 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.193 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.193 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.193 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.193 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.193 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.193 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.193 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.193 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.193 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.194 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.194 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.194 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.194 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.194 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.194 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.194 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.194 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.194 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.194 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.194 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.194 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.194 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.195 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.195 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.195 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.195 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.195 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.195 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.195 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.195 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.195 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.195 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.195 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.195 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.196 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.196 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.196 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.196 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.196 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.196 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.196 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.196 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.196 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.196 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.196 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.196 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.196 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.196 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.196 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.197 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.197 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.197 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.197 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.197 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.197 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.197 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.197 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.197 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.197 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.197 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.197 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.197 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.198 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.198 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.198 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.198 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.198 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.198 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.198 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.198 INFO:teuthology.orchestra.run.smithi059.stdout: "predict_interval": { 2024-09-10T21:26:51.198 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "predict_interval", 2024-09-10T21:26:51.198 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.198 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.198 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.198 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "86400", 2024-09-10T21:26:51.198 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.199 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.199 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.199 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.199 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.199 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.199 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.199 INFO:teuthology.orchestra.run.smithi059.stdout: "predictor_model": { 2024-09-10T21:26:51.199 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "predictor_model", 2024-09-10T21:26:51.199 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.199 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.199 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.199 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "prophetstor", 2024-09-10T21:26:51.200 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.200 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.200 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.200 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.200 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.200 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.200 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.200 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T21:26:51.200 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T21:26:51.200 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.200 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.200 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.200 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T21:26:51.201 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.201 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.201 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.201 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.201 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.201 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.201 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.201 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.201 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.201 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.201 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.201 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.201 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.202 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.202 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.202 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.202 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.202 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.202 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.202 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.202 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.202 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.202 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.202 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "influx", 2024-09-10T21:26:51.203 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": false, 2024-09-10T21:26:51.203 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "influxdb python module not found", 2024-09-10T21:26:51.203 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.203 INFO:teuthology.orchestra.run.smithi059.stdout: "batch_size": { 2024-09-10T21:26:51.203 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "batch_size", 2024-09-10T21:26:51.203 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.203 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.203 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.203 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5000", 2024-09-10T21:26:51.203 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.203 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.204 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.204 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T21:26:51.204 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.204 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.204 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.204 INFO:teuthology.orchestra.run.smithi059.stdout: "database": { 2024-09-10T21:26:51.204 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "database", 2024-09-10T21:26:51.204 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.204 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.204 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.205 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "ceph", 2024-09-10T21:26:51.205 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.205 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.205 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.205 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T21:26:51.205 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.205 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.205 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.205 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": { 2024-09-10T21:26:51.205 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "hostname", 2024-09-10T21:26:51.206 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.206 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.206 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.206 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.206 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.206 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.206 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.206 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB server hostname", 2024-09-10T21:26:51.206 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.206 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.206 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.206 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T21:26:51.207 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T21:26:51.207 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.207 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.207 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.207 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "30", 2024-09-10T21:26:51.207 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "5", 2024-09-10T21:26:51.207 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.207 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.207 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T21:26:51.207 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.207 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.207 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.208 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.208 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.208 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.208 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.208 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.208 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.208 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.208 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.208 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.208 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.208 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.208 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.209 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.209 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.209 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.209 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.209 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.209 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.209 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.209 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.209 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.209 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.209 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.210 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.210 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.210 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.210 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.210 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.210 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.210 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.210 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.210 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.210 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.211 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.211 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.211 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.211 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.211 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.211 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.211 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.211 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.211 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.211 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.211 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.211 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.212 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.212 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.212 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.212 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.212 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.212 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.212 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.212 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.212 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.212 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.212 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.212 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.213 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.213 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.213 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.213 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.213 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.213 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.213 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.213 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.213 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.213 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.213 INFO:teuthology.orchestra.run.smithi059.stdout: "password": { 2024-09-10T21:26:51.213 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "password", 2024-09-10T21:26:51.214 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.214 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.214 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.214 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.214 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.214 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.214 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.214 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "password of InfluxDB server user", 2024-09-10T21:26:51.214 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.214 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.214 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.214 INFO:teuthology.orchestra.run.smithi059.stdout: "port": { 2024-09-10T21:26:51.214 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "port", 2024-09-10T21:26:51.215 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.215 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.215 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.215 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8086", 2024-09-10T21:26:51.215 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.215 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.215 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.215 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB server port", 2024-09-10T21:26:51.215 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.215 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.215 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.215 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.215 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.216 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.216 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.216 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.216 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.216 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.216 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.216 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.216 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.216 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.216 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.216 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.216 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.216 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl": { 2024-09-10T21:26:51.217 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl", 2024-09-10T21:26:51.217 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.217 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.217 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.217 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "false", 2024-09-10T21:26:51.217 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.217 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.217 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.217 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T21:26:51.217 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.217 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.217 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.217 INFO:teuthology.orchestra.run.smithi059.stdout: "threads": { 2024-09-10T21:26:51.218 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "threads", 2024-09-10T21:26:51.218 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.218 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.218 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.218 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T21:26:51.218 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T21:26:51.218 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "32", 2024-09-10T21:26:51.218 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.218 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T21:26:51.218 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.218 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.218 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.218 INFO:teuthology.orchestra.run.smithi059.stdout: "username": { 2024-09-10T21:26:51.218 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "username", 2024-09-10T21:26:51.219 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.219 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.219 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.219 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.219 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.219 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.219 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.219 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "username of InfluxDB server user", 2024-09-10T21:26:51.219 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.219 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.219 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.220 INFO:teuthology.orchestra.run.smithi059.stdout: "verify_ssl": { 2024-09-10T21:26:51.220 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "verify_ssl", 2024-09-10T21:26:51.220 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.220 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.220 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.220 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "true", 2024-09-10T21:26:51.220 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.220 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.220 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.220 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T21:26:51.220 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.220 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.220 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.221 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.221 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.221 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.221 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "insights", 2024-09-10T21:26:51.221 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.221 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.221 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.221 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.221 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.221 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.221 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.222 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.222 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.222 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.222 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.222 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.222 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.222 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.222 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.222 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.222 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.222 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.222 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.222 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.223 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.223 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.223 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.223 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.223 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.223 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.223 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.223 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.223 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.223 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.223 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.223 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.223 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.223 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.224 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.224 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.224 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.224 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.224 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.224 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.224 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.224 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.224 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.224 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.225 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.225 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.225 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.225 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.225 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.225 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.225 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.225 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.225 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.225 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.225 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.225 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.225 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.226 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.226 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.226 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.226 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.226 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.226 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.226 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.226 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.226 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.226 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.226 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.226 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.227 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.227 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.227 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.227 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.227 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.227 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.227 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.227 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.227 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.227 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.227 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.227 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.227 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.227 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.227 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.228 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.228 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.228 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.228 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "iostat", 2024-09-10T21:26:51.228 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.228 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.228 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.228 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.228 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.228 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.228 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.228 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.228 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.229 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.229 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.229 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.229 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.229 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.229 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.229 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.229 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.229 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.229 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.229 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.229 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.229 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.230 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.230 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.230 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.230 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.230 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.230 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.230 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.230 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.230 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.230 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.230 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.231 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.231 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.231 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.231 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.231 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.231 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.231 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.231 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.231 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.231 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.231 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.231 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.232 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.232 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.232 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.232 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.232 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.232 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.232 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.232 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.232 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.232 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.232 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.232 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.232 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.232 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.233 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.233 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.233 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.233 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.233 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.233 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.233 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.233 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.233 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.233 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.233 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.233 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.234 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.234 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.234 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.234 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.234 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.234 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.234 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.234 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.234 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.234 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.234 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.234 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.235 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.235 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.235 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "k8sevents", 2024-09-10T21:26:51.235 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.235 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.235 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.235 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_event_retention_days": { 2024-09-10T21:26:51.235 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ceph_event_retention_days", 2024-09-10T21:26:51.235 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.235 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.235 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.236 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "7", 2024-09-10T21:26:51.236 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.236 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.236 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.236 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T21:26:51.236 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.236 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.236 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.236 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.236 INFO:teuthology.orchestra.run.smithi059.stdout: "config_check_secs": { 2024-09-10T21:26:51.236 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_check_secs", 2024-09-10T21:26:51.236 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.236 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.236 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.237 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:51.237 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "10", 2024-09-10T21:26:51.237 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.237 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.237 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T21:26:51.237 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.237 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.237 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.237 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.237 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.237 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.237 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.237 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.238 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.238 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.238 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.238 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.238 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.238 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.238 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.238 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.238 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.238 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.238 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.238 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.238 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.238 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.238 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.239 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.239 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.239 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.239 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.239 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.239 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.239 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.239 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.239 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.239 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.239 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.240 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.240 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.240 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.240 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.240 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.240 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.240 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.240 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.240 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.240 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.240 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.240 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.240 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.241 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.241 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.241 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.241 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.241 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.241 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.241 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.241 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.241 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.241 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.241 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.242 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.242 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.242 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.242 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.242 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.242 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.242 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.242 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.242 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.242 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.242 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.242 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.242 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.243 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.243 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.243 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.243 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.243 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.243 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.243 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.243 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.243 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.243 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.243 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.243 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.243 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.244 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.244 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.244 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.244 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "localpool", 2024-09-10T21:26:51.244 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.244 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.244 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.244 INFO:teuthology.orchestra.run.smithi059.stdout: "failure_domain": { 2024-09-10T21:26:51.244 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "failure_domain", 2024-09-10T21:26:51.244 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.244 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.244 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.244 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "host", 2024-09-10T21:26:51.245 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.245 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.245 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.245 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "failure domain for any created local pool", 2024-09-10T21:26:51.245 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T21:26:51.245 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.245 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.245 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.245 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.245 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.245 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.245 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.246 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.246 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.246 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.246 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.246 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.246 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.246 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.246 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.246 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.246 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.246 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.246 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.246 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.246 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.247 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.247 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.247 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.247 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.247 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.247 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.247 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.247 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.247 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.247 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.247 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.247 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.247 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.247 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.248 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.248 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.248 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.248 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.248 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.248 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.248 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.248 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.248 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.248 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.248 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.248 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.248 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.249 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.249 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.249 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.249 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.249 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.249 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.249 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.249 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.249 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.249 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.249 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.249 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.249 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.250 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.250 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.250 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.250 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.250 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.250 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.250 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.250 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": { 2024-09-10T21:26:51.250 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "min_size", 2024-09-10T21:26:51.250 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.250 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.250 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.251 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.251 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.251 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.251 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.251 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default min_size for any created local pool", 2024-09-10T21:26:51.251 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T21:26:51.251 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.251 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.251 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.251 INFO:teuthology.orchestra.run.smithi059.stdout: "num_rep": { 2024-09-10T21:26:51.251 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "num_rep", 2024-09-10T21:26:51.251 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.251 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.251 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.252 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3", 2024-09-10T21:26:51.252 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.252 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.252 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.252 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default replica count for any created local pool", 2024-09-10T21:26:51.252 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.252 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.252 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.252 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": { 2024-09-10T21:26:51.252 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pg_num", 2024-09-10T21:26:51.252 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.252 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.252 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.253 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "128", 2024-09-10T21:26:51.253 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.253 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.253 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.253 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T21:26:51.253 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.253 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.253 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.253 INFO:teuthology.orchestra.run.smithi059.stdout: "prefix": { 2024-09-10T21:26:51.253 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prefix", 2024-09-10T21:26:51.253 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.253 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.253 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.254 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.254 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.254 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.254 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.254 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "name prefix for any created local pool", 2024-09-10T21:26:51.254 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.254 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.254 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.254 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.254 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.254 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.254 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.254 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.255 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.255 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.255 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.255 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.255 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.255 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.255 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.255 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.255 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.255 INFO:teuthology.orchestra.run.smithi059.stdout: "subtree": { 2024-09-10T21:26:51.255 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subtree", 2024-09-10T21:26:51.255 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.255 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.256 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.256 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "rack", 2024-09-10T21:26:51.256 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.256 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.256 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.256 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T21:26:51.256 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T21:26:51.256 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.256 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.256 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.256 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.256 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.256 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.257 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mds_autoscaler", 2024-09-10T21:26:51.257 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.257 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.257 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.257 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.257 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.257 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.257 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.257 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.257 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.257 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.257 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.257 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.257 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.257 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.258 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.258 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.258 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.258 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.258 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.258 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.258 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.258 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.258 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.258 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.258 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.258 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.258 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.258 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.258 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.259 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.259 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.259 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.259 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.259 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.259 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.259 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.259 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.259 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.259 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.259 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.259 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.260 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.260 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.260 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.260 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.260 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.260 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.260 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.260 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.260 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.260 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.260 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.260 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.260 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.260 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.260 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.261 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.261 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.261 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.261 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.261 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.261 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.261 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.261 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.261 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.261 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.261 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.262 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.262 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.262 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.262 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.262 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.262 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.262 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.262 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.262 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.262 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.262 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.262 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.262 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.262 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.263 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.263 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.263 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.263 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.263 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.263 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.263 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mirroring", 2024-09-10T21:26:51.263 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.263 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.263 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.263 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.263 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.263 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.263 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.264 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.264 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.264 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.264 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.264 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.264 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.264 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.264 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.264 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.264 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.264 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.264 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.264 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.265 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.265 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.265 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.265 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.265 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.265 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.265 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.265 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.265 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.265 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.265 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.265 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.265 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.266 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.266 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.266 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.266 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.266 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.266 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.266 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.266 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.266 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.266 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.266 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.266 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.266 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.267 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.267 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.267 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.267 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.267 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.267 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.267 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.267 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.267 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.267 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.267 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.267 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.268 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.268 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.268 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.268 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.268 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.268 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.268 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.268 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.268 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.268 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.268 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.268 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.268 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.268 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.269 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.269 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.269 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.269 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.269 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.269 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.269 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.269 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.269 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.269 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.269 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.269 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.269 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.269 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.270 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "nfs", 2024-09-10T21:26:51.270 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.270 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.270 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.270 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.270 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.270 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.270 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.270 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.270 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.270 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.270 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.271 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.271 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.271 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.271 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.271 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.271 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.271 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.271 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.271 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.271 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.271 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.271 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.271 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.271 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.271 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.272 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.272 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.272 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.272 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.272 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.272 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.272 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.272 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.272 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.272 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.272 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.273 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.273 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.273 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.273 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.273 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.273 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.273 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.273 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.273 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.273 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.273 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.273 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.273 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.273 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.274 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.274 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.274 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.274 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.274 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.274 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.274 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.274 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.274 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.274 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.274 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.274 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.274 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.275 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.275 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.275 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.275 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.275 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.275 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.275 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.275 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.275 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.275 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.275 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.275 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.275 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.276 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.276 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.276 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.276 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.276 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.276 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.276 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.276 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.276 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.276 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "orchestrator", 2024-09-10T21:26:51.276 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.277 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.277 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.277 INFO:teuthology.orchestra.run.smithi059.stdout: "fail_fs": { 2024-09-10T21:26:51.277 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "fail_fs", 2024-09-10T21:26:51.277 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.277 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.277 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.277 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.277 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.277 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.277 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.277 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T21:26:51.278 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.278 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.278 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.278 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.278 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.278 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.278 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.278 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.278 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.278 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.278 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.278 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.278 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.279 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.279 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.279 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.279 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.279 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.279 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.279 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.279 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.279 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.279 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.279 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.279 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.279 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.279 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.280 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.280 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.280 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.280 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.280 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.280 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.280 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.280 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.280 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.280 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.280 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.280 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.280 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.281 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.281 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.281 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.281 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.281 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.281 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.281 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.281 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.281 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.281 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.281 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.281 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.281 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.282 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.282 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.282 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.282 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.282 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.282 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.282 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.282 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.282 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.282 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.282 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.282 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.282 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.282 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.283 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.283 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.283 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.283 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.283 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator": { 2024-09-10T21:26:51.283 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "orchestrator", 2024-09-10T21:26:51.283 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.283 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.283 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.283 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.283 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.283 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.283 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.283 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm", 2024-09-10T21:26:51.284 INFO:teuthology.orchestra.run.smithi059.stdout: "rook", 2024-09-10T21:26:51.284 INFO:teuthology.orchestra.run.smithi059.stdout: "test_orchestrator" 2024-09-10T21:26:51.284 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.284 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Orchestrator backend", 2024-09-10T21:26:51.284 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.284 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.284 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.284 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.284 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.284 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.284 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.284 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.285 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.285 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.285 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.285 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.285 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.285 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.285 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.285 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.285 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.285 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.286 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "osd_perf_query", 2024-09-10T21:26:51.286 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.286 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.286 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.286 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.286 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.286 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.286 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.286 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.286 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.286 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.286 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.286 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.286 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.287 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.287 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.287 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.287 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.287 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.287 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.287 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.287 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.287 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.287 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.287 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.287 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.287 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.288 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.288 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.288 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.288 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.288 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.288 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.288 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.288 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.288 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.288 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.288 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.288 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.289 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.289 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.289 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.289 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.289 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.289 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.289 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.289 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.289 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.289 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.289 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.289 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.289 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.289 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.290 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.290 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.290 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.290 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.290 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.290 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.290 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.290 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.290 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.290 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.290 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.290 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.291 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.291 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.291 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.291 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.291 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.291 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.291 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.291 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.291 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.291 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.291 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.291 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.292 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.292 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.292 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.292 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.292 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.292 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.292 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.292 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.292 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "osd_support", 2024-09-10T21:26:51.292 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.292 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.293 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.293 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.293 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.293 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.293 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.293 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.293 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.293 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.293 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.293 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.293 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.293 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.293 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.294 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.294 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.294 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.294 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.294 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.294 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.294 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.294 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.294 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.294 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.294 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.295 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.295 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.295 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.295 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.295 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.295 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.295 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.295 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.295 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.295 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.295 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.295 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.296 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.296 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.296 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.296 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.296 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.296 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.296 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.296 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.296 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.296 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.296 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.296 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.297 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.297 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.297 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.297 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.297 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.297 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.297 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.297 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.297 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.297 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.297 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.297 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.297 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.298 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.298 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.298 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.298 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.298 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.298 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.298 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.298 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.298 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.298 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.298 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.298 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.298 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.299 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.299 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.299 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.299 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.299 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.299 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.299 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.299 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.299 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pg_autoscaler", 2024-09-10T21:26:51.299 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.299 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.299 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.299 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.300 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.300 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.300 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.300 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.300 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.300 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.300 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.300 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.300 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.300 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.300 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.300 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.300 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.300 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.301 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.301 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.301 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.301 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.301 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.301 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.301 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.301 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.301 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.301 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.301 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.301 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.301 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.302 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.302 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.302 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.302 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.302 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.302 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.302 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.302 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.302 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.302 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.302 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.302 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.303 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.303 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.303 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.303 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.303 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.303 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.303 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.303 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.303 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.303 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.303 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.303 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.303 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.304 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.304 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.304 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.304 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.304 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.304 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.304 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.304 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.304 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.304 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.304 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.304 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.304 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.305 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T21:26:51.305 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T21:26:51.305 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.305 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.305 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.305 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T21:26:51.305 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.305 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.305 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.305 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.305 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.306 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.306 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.306 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.306 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.306 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.306 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.306 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.306 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.306 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.306 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.306 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.306 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.306 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.306 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.307 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.307 INFO:teuthology.orchestra.run.smithi059.stdout: "threshold": { 2024-09-10T21:26:51.307 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "threshold", 2024-09-10T21:26:51.307 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:51.307 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.307 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.307 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3.0", 2024-09-10T21:26:51.307 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1.0", 2024-09-10T21:26:51.307 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.307 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.307 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "scaling threshold", 2024-09-10T21:26:51.307 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T21:26:51.307 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.308 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.308 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.308 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.308 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "progress", 2024-09-10T21:26:51.308 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.308 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.308 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.308 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_pg_recovery_event": { 2024-09-10T21:26:51.308 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_pg_recovery_event", 2024-09-10T21:26:51.308 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.308 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.308 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.309 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.309 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.309 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.309 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.309 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T21:26:51.309 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.309 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.309 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.309 INFO:teuthology.orchestra.run.smithi059.stdout: "enabled": { 2024-09-10T21:26:51.309 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enabled", 2024-09-10T21:26:51.309 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.309 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.310 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.310 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.310 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.310 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.310 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.310 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.310 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.310 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.310 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.310 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.310 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.311 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.311 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.311 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.311 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.311 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.311 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.311 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.311 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.311 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.311 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.311 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.311 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.311 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.311 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.312 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.312 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.312 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.312 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.312 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.312 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.312 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.312 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.312 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.312 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.312 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.312 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.312 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.313 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.313 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.313 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.313 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.313 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.313 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.313 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.313 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.313 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.313 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.313 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.313 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.314 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.314 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.314 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.314 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.314 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.314 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.314 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.314 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.314 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.314 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.314 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.314 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.314 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.315 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.315 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.315 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.315 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.315 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.315 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.315 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.315 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.315 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.315 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.315 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.315 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.316 INFO:teuthology.orchestra.run.smithi059.stdout: "max_completed_events": { 2024-09-10T21:26:51.316 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_completed_events", 2024-09-10T21:26:51.316 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.316 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.316 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.316 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "50", 2024-09-10T21:26:51.316 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.316 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.316 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.316 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "number of past completed events to remember", 2024-09-10T21:26:51.316 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.316 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.316 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.317 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T21:26:51.317 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T21:26:51.317 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.317 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.317 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.317 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T21:26:51.317 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.317 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.317 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.317 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long the module is going to sleep", 2024-09-10T21:26:51.317 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.317 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.317 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.318 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.318 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.318 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.318 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.318 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.318 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.318 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.318 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.318 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.318 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.318 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.318 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.318 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.319 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.319 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.319 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prometheus", 2024-09-10T21:26:51.319 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.319 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.319 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.319 INFO:teuthology.orchestra.run.smithi059.stdout: "cache": { 2024-09-10T21:26:51.319 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cache", 2024-09-10T21:26:51.320 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.320 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.320 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.320 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.320 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.320 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.320 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.320 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.320 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.320 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.320 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.321 INFO:teuthology.orchestra.run.smithi059.stdout: "exclude_perf_counters": { 2024-09-10T21:26:51.321 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "exclude_perf_counters", 2024-09-10T21:26:51.321 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.321 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.321 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.321 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.321 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.321 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.321 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.321 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T21:26:51.321 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T21:26:51.321 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.321 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.322 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.322 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.322 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.322 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.322 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.322 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.322 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.322 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.322 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.322 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.322 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.322 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.323 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.323 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.323 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.323 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.323 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.323 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.323 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.323 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.323 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.323 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.323 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.323 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.324 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.324 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.324 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.324 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.324 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.324 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.324 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.324 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.324 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.324 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.324 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.324 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.324 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.325 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.325 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.325 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.325 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.325 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.325 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.325 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.325 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.325 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.325 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.325 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.325 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.325 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.326 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.326 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.326 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.326 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.326 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.326 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.326 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.326 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.326 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.326 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.326 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.326 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.327 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.327 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.327 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.327 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.327 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_stats_pools": { 2024-09-10T21:26:51.327 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_stats_pools", 2024-09-10T21:26:51.327 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.327 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.327 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.327 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.327 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.327 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.328 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.328 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.328 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.328 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.328 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.328 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T21:26:51.328 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T21:26:51.328 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.328 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.328 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.328 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "300", 2024-09-10T21:26:51.328 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.329 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.329 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.329 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.329 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.329 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.329 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.329 INFO:teuthology.orchestra.run.smithi059.stdout: "scrape_interval": { 2024-09-10T21:26:51.329 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "scrape_interval", 2024-09-10T21:26:51.329 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:51.329 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.329 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.329 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15.0", 2024-09-10T21:26:51.330 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.330 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.330 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.330 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.330 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.330 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.330 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.330 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2024-09-10T21:26:51.330 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2024-09-10T21:26:51.330 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.330 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.330 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.330 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "::", 2024-09-10T21:26:51.330 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.330 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.331 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.331 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T21:26:51.331 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.331 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.331 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.331 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2024-09-10T21:26:51.331 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2024-09-10T21:26:51.331 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.331 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.331 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.331 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "9283", 2024-09-10T21:26:51.331 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.332 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.332 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.332 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T21:26:51.332 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.332 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.332 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.332 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.332 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.332 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.332 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.332 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.332 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.332 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.333 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.333 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.333 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.333 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.333 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.333 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.333 INFO:teuthology.orchestra.run.smithi059.stdout: "stale_cache_strategy": { 2024-09-10T21:26:51.333 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "stale_cache_strategy", 2024-09-10T21:26:51.333 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.333 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.333 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.333 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "log", 2024-09-10T21:26:51.334 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.334 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.334 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.334 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.334 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.334 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.334 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.334 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_behaviour": { 2024-09-10T21:26:51.334 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_behaviour", 2024-09-10T21:26:51.334 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.334 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.334 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.334 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "default", 2024-09-10T21:26:51.334 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.335 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.335 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.335 INFO:teuthology.orchestra.run.smithi059.stdout: "default", 2024-09-10T21:26:51.335 INFO:teuthology.orchestra.run.smithi059.stdout: "error" 2024-09-10T21:26:51.335 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.335 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.335 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.335 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.335 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.335 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_error_status_code": { 2024-09-10T21:26:51.335 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_error_status_code", 2024-09-10T21:26:51.335 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.335 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.336 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.336 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2024-09-10T21:26:51.336 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "400", 2024-09-10T21:26:51.336 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "599", 2024-09-10T21:26:51.336 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.336 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.336 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.336 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.336 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.336 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.336 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.337 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_support", 2024-09-10T21:26:51.337 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.337 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.337 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.337 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.337 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.337 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.337 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.337 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.337 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.337 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.337 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.337 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.338 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.338 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.338 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.338 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.338 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.338 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.338 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.338 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.338 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.338 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.338 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.338 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.338 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.339 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.339 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.339 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.339 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.339 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.339 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.339 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.339 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.339 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.339 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.339 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.339 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.339 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.340 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.340 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.340 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.340 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.340 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.340 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.340 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.340 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.340 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.340 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.340 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.340 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.340 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.340 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.341 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.341 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.341 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.341 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.341 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.341 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.341 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.341 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.341 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.341 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.341 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.342 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.342 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.342 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.342 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.342 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.342 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.342 INFO:teuthology.orchestra.run.smithi059.stdout: "max_concurrent_snap_create": { 2024-09-10T21:26:51.342 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_concurrent_snap_create", 2024-09-10T21:26:51.342 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.342 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.342 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.342 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:51.343 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.343 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.343 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.343 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.343 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.343 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.343 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.343 INFO:teuthology.orchestra.run.smithi059.stdout: "mirror_snapshot_schedule": { 2024-09-10T21:26:51.343 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T21:26:51.343 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.343 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.344 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.344 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.344 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.344 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.344 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.344 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.344 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.344 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.344 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.344 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.344 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.345 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.345 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.345 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.345 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.345 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.345 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.345 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.345 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.345 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.345 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.345 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.346 INFO:teuthology.orchestra.run.smithi059.stdout: "trash_purge_schedule": { 2024-09-10T21:26:51.346 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "trash_purge_schedule", 2024-09-10T21:26:51.346 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.346 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.346 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.346 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.346 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.346 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.346 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.346 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.346 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.346 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.346 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.347 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.347 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.347 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "restful", 2024-09-10T21:26:51.347 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.347 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.347 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.347 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_auth": { 2024-09-10T21:26:51.347 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enable_auth", 2024-09-10T21:26:51.347 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.347 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.347 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.348 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.348 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.348 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.348 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.348 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.348 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.348 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.348 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.348 INFO:teuthology.orchestra.run.smithi059.stdout: "key_file": { 2024-09-10T21:26:51.348 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "key_file", 2024-09-10T21:26:51.348 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.349 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.349 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.349 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.349 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.349 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.349 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.349 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.349 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.349 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.349 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.349 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.350 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.350 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.350 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.350 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.350 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.350 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.350 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.350 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.350 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.350 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.350 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.350 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.350 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.351 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.351 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.351 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.351 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.351 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.351 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.351 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.351 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.351 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.351 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.351 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.352 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.352 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.352 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.352 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.352 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.352 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.352 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.352 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.352 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.352 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.352 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.352 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.352 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.353 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.353 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.353 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.353 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.353 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.353 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.353 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.353 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.353 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.353 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.353 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.353 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.353 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.354 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.354 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.354 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.354 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.354 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.354 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.354 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.354 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.354 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.354 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.354 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.354 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.354 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.355 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.355 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.355 INFO:teuthology.orchestra.run.smithi059.stdout: "max_requests": { 2024-09-10T21:26:51.355 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_requests", 2024-09-10T21:26:51.355 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.355 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.355 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.355 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2024-09-10T21:26:51.355 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.355 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.355 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.355 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T21:26:51.355 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.355 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.356 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.356 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2024-09-10T21:26:51.356 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2024-09-10T21:26:51.356 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.356 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.356 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.356 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.356 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.356 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.356 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.356 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.356 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.357 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.357 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.357 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2024-09-10T21:26:51.357 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2024-09-10T21:26:51.357 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.357 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.357 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.357 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.357 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.357 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.357 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.357 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.358 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.358 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.358 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.358 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.358 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.358 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.358 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.358 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.358 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.358 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.358 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.358 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.358 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.358 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.359 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.359 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.359 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.359 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.359 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rgw", 2024-09-10T21:26:51.359 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.359 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.359 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.359 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.359 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.359 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.359 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.360 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.360 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.360 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.360 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.360 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.360 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.360 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.360 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.360 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.360 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.360 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.360 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.360 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.360 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.361 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.361 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.361 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.361 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.361 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.361 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.361 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.361 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.361 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.361 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.361 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.361 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.361 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.362 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.362 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.362 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.362 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.362 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.362 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.362 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.362 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.362 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.362 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.362 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.362 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.363 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.363 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.363 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.363 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.363 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.363 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.363 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.363 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.363 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.363 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.363 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.363 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.363 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.363 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.364 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.364 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.364 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.364 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.364 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.364 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.364 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.364 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.364 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.364 INFO:teuthology.orchestra.run.smithi059.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T21:26:51.364 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T21:26:51.364 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.364 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.365 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.365 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T21:26:51.365 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.365 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.365 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.365 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T21:26:51.365 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.365 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.365 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.365 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.365 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.365 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.365 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.366 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.366 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.366 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.366 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.366 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.366 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.366 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.366 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.366 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.366 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.366 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.366 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rook", 2024-09-10T21:26:51.366 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.367 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.367 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.367 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.367 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.367 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.367 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.367 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.367 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.367 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.367 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.367 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.367 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.367 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.367 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.368 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.368 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.368 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.368 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.368 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.368 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.368 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.368 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.368 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.368 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.368 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.368 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.369 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.369 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.369 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.369 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.369 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.369 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.369 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.369 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.369 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.369 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.369 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.370 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.370 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.370 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.370 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.370 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.370 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.370 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.370 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.370 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.370 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.370 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.370 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.370 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.370 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.371 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.371 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.371 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.371 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.371 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.371 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.371 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.371 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.371 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.371 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.371 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.371 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.371 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.372 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.372 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.372 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.372 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.372 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.372 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.372 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.372 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.372 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.372 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.372 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.372 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.372 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.373 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.373 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.373 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.373 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.373 INFO:teuthology.orchestra.run.smithi059.stdout: "storage_class": { 2024-09-10T21:26:51.373 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "storage_class", 2024-09-10T21:26:51.373 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.373 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.373 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.373 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "local", 2024-09-10T21:26:51.373 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.373 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.374 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.374 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T21:26:51.374 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.374 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.374 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.374 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.374 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.374 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "selftest", 2024-09-10T21:26:51.374 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.374 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.374 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.374 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.374 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.375 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.375 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.375 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.375 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.375 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.375 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.375 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.375 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.375 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.375 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.375 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.375 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.375 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.375 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.375 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.376 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.376 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.376 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.376 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.376 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.376 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.376 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.376 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.376 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.376 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.376 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.377 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.377 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.377 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.377 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.377 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.377 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.377 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.377 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.377 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.377 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.377 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.377 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.377 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.378 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.378 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.378 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.378 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.378 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.378 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.378 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.378 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.378 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.378 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.378 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.378 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.379 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.379 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.379 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.379 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.379 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.379 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.379 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.379 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.379 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.379 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.379 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.379 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.379 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.380 INFO:teuthology.orchestra.run.smithi059.stdout: "roption1": { 2024-09-10T21:26:51.380 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "roption1", 2024-09-10T21:26:51.380 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.380 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.380 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.380 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.380 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.380 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.380 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.380 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.380 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.380 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.381 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.381 INFO:teuthology.orchestra.run.smithi059.stdout: "roption2": { 2024-09-10T21:26:51.381 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "roption2", 2024-09-10T21:26:51.381 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.381 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.381 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.381 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "xyz", 2024-09-10T21:26:51.381 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.381 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.381 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.381 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.381 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.382 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.382 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.382 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption1": { 2024-09-10T21:26:51.382 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption1", 2024-09-10T21:26:51.382 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.382 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.382 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.382 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.382 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.382 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.382 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.382 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.382 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.383 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.383 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.383 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption2": { 2024-09-10T21:26:51.383 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption2", 2024-09-10T21:26:51.383 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.383 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.383 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.383 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.383 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.383 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.383 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.383 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.383 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.384 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.384 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.384 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption3": { 2024-09-10T21:26:51.384 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption3", 2024-09-10T21:26:51.384 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:51.384 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.384 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.384 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.384 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.384 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.384 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.384 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.385 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.385 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.385 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.385 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption4": { 2024-09-10T21:26:51.385 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption4", 2024-09-10T21:26:51.385 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.385 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.385 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.385 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.385 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.385 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.385 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.385 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.386 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.386 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.386 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.386 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption5": { 2024-09-10T21:26:51.386 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption5", 2024-09-10T21:26:51.386 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.386 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.386 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.386 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.386 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.386 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.386 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.386 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.387 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.387 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.387 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.387 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption6": { 2024-09-10T21:26:51.387 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption6", 2024-09-10T21:26:51.387 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.387 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.387 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.387 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.387 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.387 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.387 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.387 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.388 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.388 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.388 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.388 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption7": { 2024-09-10T21:26:51.388 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption7", 2024-09-10T21:26:51.388 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.388 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.388 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.388 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.388 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T21:26:51.388 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "42", 2024-09-10T21:26:51.388 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.389 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.389 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.389 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.389 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.389 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.389 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.389 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.389 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.389 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.389 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.389 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.389 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.390 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.390 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.390 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.390 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.390 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.390 INFO:teuthology.orchestra.run.smithi059.stdout: "testkey": { 2024-09-10T21:26:51.390 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testkey", 2024-09-10T21:26:51.390 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.390 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.390 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.390 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.390 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.391 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.391 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.391 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.391 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.391 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.391 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.391 INFO:teuthology.orchestra.run.smithi059.stdout: "testlkey": { 2024-09-10T21:26:51.391 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testlkey", 2024-09-10T21:26:51.391 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.391 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.391 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.391 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.392 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.392 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.392 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.392 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.392 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.392 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.392 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.392 INFO:teuthology.orchestra.run.smithi059.stdout: "testnewline": { 2024-09-10T21:26:51.392 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testnewline", 2024-09-10T21:26:51.392 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.392 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.392 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.393 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.393 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.393 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.393 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.393 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.393 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.393 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.393 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.393 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.393 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.393 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smb", 2024-09-10T21:26:51.394 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.394 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.394 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.394 INFO:teuthology.orchestra.run.smithi059.stdout: "internal_store_backend": { 2024-09-10T21:26:51.394 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "internal_store_backend", 2024-09-10T21:26:51.394 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.394 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.394 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.394 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.394 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.395 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.395 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.395 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T21:26:51.395 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.395 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.395 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.395 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.395 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.395 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.395 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.395 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.395 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.396 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.396 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.396 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.396 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.396 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.396 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.396 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.396 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.396 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.396 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.396 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.396 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.396 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.397 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.397 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.397 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.397 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.397 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.397 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.397 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.397 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.397 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.397 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.397 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.397 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.397 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.398 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.398 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.398 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.398 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.398 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.398 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.398 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.398 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.398 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.398 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.398 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.398 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.399 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.399 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.399 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.399 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.399 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.399 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.399 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.399 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.399 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.399 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.399 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.399 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.400 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.400 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.400 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.400 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.400 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.400 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.400 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.400 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.400 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.400 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.400 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.401 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.401 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.401 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.401 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.401 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.401 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.401 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.401 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.401 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.401 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.401 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.401 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.402 INFO:teuthology.orchestra.run.smithi059.stdout: "update_orchestration": { 2024-09-10T21:26:51.402 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "update_orchestration", 2024-09-10T21:26:51.402 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.402 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.402 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.402 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.402 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.402 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.402 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.402 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T21:26:51.402 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.403 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.403 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.403 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.403 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.403 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snap_schedule", 2024-09-10T21:26:51.403 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.403 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.403 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.403 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_m_granularity": { 2024-09-10T21:26:51.403 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_m_granularity", 2024-09-10T21:26:51.403 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.403 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.404 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.404 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.404 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.404 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.404 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.404 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T21:26:51.404 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.404 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.404 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.404 INFO:teuthology.orchestra.run.smithi059.stdout: "dump_on_update": { 2024-09-10T21:26:51.404 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "dump_on_update", 2024-09-10T21:26:51.404 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.405 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.405 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.405 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.405 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.405 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.405 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.405 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "dump database to debug log on update", 2024-09-10T21:26:51.405 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.405 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.405 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.405 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.406 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.406 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.406 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.406 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.406 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.406 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.406 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.406 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.406 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.406 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.406 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.406 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.406 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.406 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.407 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.407 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.407 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.407 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.407 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.407 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.407 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.407 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.407 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.407 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.407 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.407 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.408 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.408 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.408 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.408 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.408 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.408 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.408 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.408 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.408 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.408 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.408 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.408 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.408 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.409 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.409 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.409 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.409 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.409 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.409 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.409 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.409 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.409 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.409 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.409 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.409 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.409 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.410 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.410 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.410 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.410 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.410 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.410 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.410 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.410 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.410 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.410 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.410 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.410 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.411 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.411 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.411 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.411 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.411 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.411 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.411 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.411 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.411 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.411 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.411 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.411 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.411 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.412 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.412 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.412 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.412 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "stats", 2024-09-10T21:26:51.412 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.412 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.412 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.412 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.412 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.412 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.412 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.413 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.413 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.413 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.413 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.413 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.413 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.413 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.413 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.413 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.413 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.413 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.413 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.413 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.414 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.414 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.414 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.414 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.414 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.414 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.414 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.414 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.414 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.414 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.414 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.414 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.415 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.415 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.415 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.415 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.415 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.415 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.415 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.415 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.415 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.415 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.415 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.415 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.416 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.416 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.416 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.416 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.416 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.416 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.416 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.416 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.416 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.416 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.416 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.416 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.417 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.417 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.417 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.417 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.417 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.417 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.417 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.417 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.417 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.417 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.417 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.417 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.418 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.418 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.418 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.418 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.418 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.418 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.418 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.420 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.420 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.420 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.420 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.420 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.420 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.420 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.420 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.420 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.420 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "status", 2024-09-10T21:26:51.421 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.421 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.421 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.421 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.421 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.421 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.421 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.421 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.421 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.421 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.421 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.421 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.421 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.422 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.422 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.422 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.422 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.422 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.422 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.422 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.422 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.422 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.422 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.423 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.423 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.423 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.423 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.423 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.423 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.423 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.423 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.423 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.423 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.423 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.423 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.423 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.424 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.424 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.424 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.424 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.424 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.424 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.424 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.424 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.424 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.424 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.424 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.425 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.425 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.425 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.425 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.425 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.425 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.425 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.425 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.425 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.425 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.425 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.425 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.425 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.426 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.426 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.426 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.426 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.426 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.426 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.426 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.426 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.426 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.426 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.426 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.426 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.427 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.427 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.427 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.427 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.427 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.427 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.427 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.427 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.427 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.427 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.427 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.427 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.428 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "telegraf", 2024-09-10T21:26:51.428 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.428 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.428 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.428 INFO:teuthology.orchestra.run.smithi059.stdout: "address": { 2024-09-10T21:26:51.428 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "address", 2024-09-10T21:26:51.428 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.428 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.428 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.428 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T21:26:51.428 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.428 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.429 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.429 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.429 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.429 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.429 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.429 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T21:26:51.429 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T21:26:51.429 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.429 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.429 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.429 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15", 2024-09-10T21:26:51.429 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.430 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.430 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.430 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.430 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.430 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.430 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.430 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.430 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.430 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.430 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.430 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.430 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.430 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.430 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.431 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.431 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.431 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.431 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.431 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.431 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.431 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.431 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.431 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.431 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.431 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.431 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.432 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.432 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.432 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.432 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.432 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.432 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.432 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.432 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.432 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.432 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.432 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.432 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.432 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.433 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.433 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.433 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.433 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.433 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.433 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.433 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.433 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.433 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.433 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.433 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.433 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.434 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.434 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.434 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.434 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.434 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.434 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.434 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.434 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.434 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.434 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.434 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.434 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.435 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.435 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.435 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.435 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.435 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.435 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.435 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.435 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.435 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.435 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.435 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.435 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.435 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.436 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.436 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.436 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.436 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.436 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.436 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.436 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.436 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.436 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.436 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.436 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.437 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "telemetry", 2024-09-10T21:26:51.437 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.437 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.437 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.437 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_basic": { 2024-09-10T21:26:51.437 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_basic", 2024-09-10T21:26:51.437 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.437 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.437 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.437 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.437 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.437 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.438 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.438 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T21:26:51.438 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.438 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.438 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.438 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_crash": { 2024-09-10T21:26:51.438 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_crash", 2024-09-10T21:26:51.438 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.438 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.438 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.438 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.438 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.439 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.439 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.439 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T21:26:51.439 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.439 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.439 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.439 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_device": { 2024-09-10T21:26:51.439 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_device", 2024-09-10T21:26:51.439 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.439 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.439 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.439 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.439 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.440 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.440 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.440 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T21:26:51.440 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.440 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.440 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.440 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_ident": { 2024-09-10T21:26:51.440 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_ident", 2024-09-10T21:26:51.440 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.440 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.440 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.440 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.440 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.441 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.441 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.441 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T21:26:51.441 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.441 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.441 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.441 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_perf": { 2024-09-10T21:26:51.441 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_perf", 2024-09-10T21:26:51.441 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.441 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.441 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.441 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.441 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.442 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.442 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.442 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T21:26:51.442 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.442 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.442 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.442 INFO:teuthology.orchestra.run.smithi059.stdout: "contact": { 2024-09-10T21:26:51.442 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "contact", 2024-09-10T21:26:51.442 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.442 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.442 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.442 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.442 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.443 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.443 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.443 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.443 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.443 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.443 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.443 INFO:teuthology.orchestra.run.smithi059.stdout: "description": { 2024-09-10T21:26:51.443 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "description", 2024-09-10T21:26:51.443 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.443 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.443 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.443 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.443 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.444 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.444 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.444 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.444 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.444 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.444 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.444 INFO:teuthology.orchestra.run.smithi059.stdout: "device_url": { 2024-09-10T21:26:51.444 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_url", 2024-09-10T21:26:51.444 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.444 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.444 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.444 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T21:26:51.444 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.445 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.445 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.445 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.445 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.445 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.445 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.445 INFO:teuthology.orchestra.run.smithi059.stdout: "enabled": { 2024-09-10T21:26:51.445 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enabled", 2024-09-10T21:26:51.445 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.445 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.445 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.445 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.446 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.446 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.446 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.446 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.446 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.446 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.446 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.446 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T21:26:51.446 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T21:26:51.446 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.446 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.446 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.446 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "24", 2024-09-10T21:26:51.447 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "8", 2024-09-10T21:26:51.447 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.447 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.447 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.447 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.447 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.447 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.447 INFO:teuthology.orchestra.run.smithi059.stdout: "last_opt_revision": { 2024-09-10T21:26:51.447 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "last_opt_revision", 2024-09-10T21:26:51.447 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.447 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.447 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.447 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1", 2024-09-10T21:26:51.448 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.448 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.448 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.448 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.448 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.448 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.448 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.448 INFO:teuthology.orchestra.run.smithi059.stdout: "leaderboard": { 2024-09-10T21:26:51.448 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "leaderboard", 2024-09-10T21:26:51.448 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.448 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.448 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.448 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.448 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.449 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.449 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.449 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.449 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.449 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.449 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.449 INFO:teuthology.orchestra.run.smithi059.stdout: "leaderboard_description": { 2024-09-10T21:26:51.449 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "leaderboard_description", 2024-09-10T21:26:51.449 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.449 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.449 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.449 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.449 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.450 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.450 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.450 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.450 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.450 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.450 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.450 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.450 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.450 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.450 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.450 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.450 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.451 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.451 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.451 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.451 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.451 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.451 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.451 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.451 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.451 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.451 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.451 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.451 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.451 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.451 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.452 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.452 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.452 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.452 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.452 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.452 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.452 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.452 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.452 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.452 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.452 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.452 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.452 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.452 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.453 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.453 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.453 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.453 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.453 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.453 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.453 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.453 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.453 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.453 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.453 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.453 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.453 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.454 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.454 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.454 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.454 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.454 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.454 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.454 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.454 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.454 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.454 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.454 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.454 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.454 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.454 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.455 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.455 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.455 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.455 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.455 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.455 INFO:teuthology.orchestra.run.smithi059.stdout: "organization": { 2024-09-10T21:26:51.455 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "organization", 2024-09-10T21:26:51.455 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.455 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.455 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.455 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.455 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.455 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.455 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.456 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.456 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.456 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.456 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.456 INFO:teuthology.orchestra.run.smithi059.stdout: "proxy": { 2024-09-10T21:26:51.456 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "proxy", 2024-09-10T21:26:51.456 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.456 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.456 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.456 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.456 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.456 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.457 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.457 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.457 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.457 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.457 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.457 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.457 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.457 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.457 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.457 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.457 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.457 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.458 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.458 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.458 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.458 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.458 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.458 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.458 INFO:teuthology.orchestra.run.smithi059.stdout: "url": { 2024-09-10T21:26:51.458 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "url", 2024-09-10T21:26:51.458 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.458 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.458 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.458 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T21:26:51.458 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.458 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.459 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.459 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.459 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.459 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.459 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.459 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.459 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.459 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "test_orchestrator", 2024-09-10T21:26:51.459 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.459 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.459 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.459 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.459 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.460 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.460 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.460 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.460 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.460 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.460 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.460 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.460 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.460 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.460 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.460 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.460 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.461 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.461 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.461 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.461 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.461 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.461 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.461 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.461 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.461 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.461 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.461 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.461 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.461 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.462 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.462 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.462 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.462 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.462 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.462 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.462 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.462 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.462 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.462 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.462 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.462 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.462 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.462 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.463 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.463 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.463 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.463 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.463 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.463 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.463 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.463 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.463 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.463 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.463 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.463 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.463 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.464 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.464 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.464 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.464 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.464 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.464 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.464 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.464 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.464 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.464 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.464 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.464 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.465 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "volumes", 2024-09-10T21:26:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.466 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.467 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.467 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.467 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.467 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.467 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.467 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.467 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.467 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.467 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.467 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.467 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.467 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.468 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.469 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.471 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: "max_concurrent_clones": { 2024-09-10T21:26:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_concurrent_clones", 2024-09-10T21:26:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "4", 2024-09-10T21:26:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T21:26:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.472 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.473 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.473 INFO:teuthology.orchestra.run.smithi059.stdout: "periodic_async_work": { 2024-09-10T21:26:51.473 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "periodic_async_work", 2024-09-10T21:26:51.473 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.473 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.473 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.473 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.473 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.473 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.473 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.473 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Periodically check for async work", 2024-09-10T21:26:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot_clone_delay": { 2024-09-10T21:26:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snapshot_clone_delay", 2024-09-10T21:26:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.474 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T21:26:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot_clone_no_wait": { 2024-09-10T21:26:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T21:26:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.475 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T21:26:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.476 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix", 2024-09-10T21:26:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.477 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: "discovery_interval": { 2024-09-10T21:26:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "discovery_interval", 2024-09-10T21:26:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T21:26:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "100", 2024-09-10T21:26:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.478 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: "identifier": { 2024-09-10T21:26:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "identifier", 2024-09-10T21:26:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.479 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T21:26:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T21:26:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T21:26:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.480 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.481 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.482 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.483 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.484 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.485 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.486 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_host": { 2024-09-10T21:26:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_host", 2024-09-10T21:26:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.487 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_port": { 2024-09-10T21:26:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_port", 2024-09-10T21:26:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10051", 2024-09-10T21:26:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.488 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_sender": { 2024-09-10T21:26:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_sender", 2024-09-10T21:26:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T21:26:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.489 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T21:26:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: "gid": 24128, 2024-09-10T21:26:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "y", 2024-09-10T21:26:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_features": 4540719139924082687, 2024-09-10T21:26:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: "available_modules": [ 2024-09-10T21:26:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "alerts", 2024-09-10T21:26:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T21:26:51.490 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T21:26:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T21:26:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T21:26:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.491 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.492 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.493 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.494 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.496 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.497 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.497 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_destination": { 2024-09-10T21:26:51.497 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_destination", 2024-09-10T21:26:51.497 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.497 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.497 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.497 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.497 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.497 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.497 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.497 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T21:26:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_from_name": { 2024-09-10T21:26:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_from_name", 2024-09-10T21:26:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "Ceph", 2024-09-10T21:26:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.498 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Email From: name", 2024-09-10T21:26:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_host": { 2024-09-10T21:26:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_host", 2024-09-10T21:26:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.499 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP server", 2024-09-10T21:26:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_password": { 2024-09-10T21:26:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_password", 2024-09-10T21:26:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.500 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Password to authenticate with", 2024-09-10T21:26:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_port": { 2024-09-10T21:26:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_port", 2024-09-10T21:26:51.501 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "465", 2024-09-10T21:26:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP port", 2024-09-10T21:26:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_sender": { 2024-09-10T21:26:51.502 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_sender", 2024-09-10T21:26:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP envelope sender", 2024-09-10T21:26:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.503 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_ssl": { 2024-09-10T21:26:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_ssl", 2024-09-10T21:26:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T21:26:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.504 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_user": { 2024-09-10T21:26:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_user", 2024-09-10T21:26:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "User to authenticate as", 2024-09-10T21:26:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.506 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "balancer", 2024-09-10T21:26:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: "active": { 2024-09-10T21:26:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "active", 2024-09-10T21:26:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.507 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T21:26:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: "begin_time": { 2024-09-10T21:26:51.508 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "begin_time", 2024-09-10T21:26:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0000", 2024-09-10T21:26:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T21:26:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T21:26:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.509 INFO:teuthology.orchestra.run.smithi059.stdout: "begin_weekday": { 2024-09-10T21:26:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "begin_weekday", 2024-09-10T21:26:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T21:26:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0", 2024-09-10T21:26:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "6", 2024-09-10T21:26:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T21:26:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T21:26:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.510 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_max_iterations": { 2024-09-10T21:26:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_max_iterations", 2024-09-10T21:26:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T21:26:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "25", 2024-09-10T21:26:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T21:26:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "250", 2024-09-10T21:26:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T21:26:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_metrics": { 2024-09-10T21:26:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_metrics", 2024-09-10T21:26:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T21:26:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T21:26:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T21:26:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.512 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_step": { 2024-09-10T21:26:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_step", 2024-09-10T21:26:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0.5", 2024-09-10T21:26:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0.001", 2024-09-10T21:26:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "0.999", 2024-09-10T21:26:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "aggressiveness of optimization", 2024-09-10T21:26:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T21:26:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.513 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: "end_time": { 2024-09-10T21:26:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "end_time", 2024-09-10T21:26:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "2359", 2024-09-10T21:26:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T21:26:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T21:26:51.514 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: "end_weekday": { 2024-09-10T21:26:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "end_weekday", 2024-09-10T21:26:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T21:26:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0", 2024-09-10T21:26:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "6", 2024-09-10T21:26:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T21:26:51.515 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T21:26:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.516 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.517 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.518 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.519 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.520 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "min_score": { 2024-09-10T21:26:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "min_score", 2024-09-10T21:26:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.521 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T21:26:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": { 2024-09-10T21:26:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mode", 2024-09-10T21:26:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.522 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "upmap", 2024-09-10T21:26:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-compat", 2024-09-10T21:26:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "none", 2024-09-10T21:26:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "read", 2024-09-10T21:26:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap", 2024-09-10T21:26:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap-read" 2024-09-10T21:26:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Balancer mode", 2024-09-10T21:26:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_ids": { 2024-09-10T21:26:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pool_ids", 2024-09-10T21:26:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T21:26:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.524 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T21:26:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T21:26:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T21:26:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T21:26:51.525 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.526 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap_max_deviation": { 2024-09-10T21:26:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "upmap_max_deviation", 2024-09-10T21:26:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T21:26:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T21:26:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T21:26:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T21:26:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.527 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap_max_optimizations": { 2024-09-10T21:26:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "upmap_max_optimizations", 2024-09-10T21:26:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T21:26:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T21:26:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.528 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.529 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.529 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.529 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephadm", 2024-09-10T21:26:51.529 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.529 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.529 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.529 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_down_multiplier": { 2024-09-10T21:26:51.529 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_down_multiplier", 2024-09-10T21:26:51.529 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:51.529 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3.0", 2024-09-10T21:26:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T21:26:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_refresh_rate": { 2024-09-10T21:26:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_refresh_rate", 2024-09-10T21:26:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.530 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "20", 2024-09-10T21:26:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T21:26:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_starting_port": { 2024-09-10T21:26:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_starting_port", 2024-09-10T21:26:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "4721", 2024-09-10T21:26:51.531 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T21:26:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_ptrace": { 2024-09-10T21:26:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_ptrace", 2024-09-10T21:26:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.532 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T21:26:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T21:26:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: "autotune_interval": { 2024-09-10T21:26:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "autotune_interval", 2024-09-10T21:26:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T21:26:51.533 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T21:26:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: "autotune_memory_target_ratio": { 2024-09-10T21:26:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T21:26:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.534 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0.7", 2024-09-10T21:26:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T21:26:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm_log_destination": { 2024-09-10T21:26:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephadm_log_destination", 2024-09-10T21:26:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.535 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.536 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.536 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.536 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.536 INFO:teuthology.orchestra.run.smithi059.stdout: "file", 2024-09-10T21:26:51.536 INFO:teuthology.orchestra.run.smithi059.stdout: "file,syslog", 2024-09-10T21:26:51.536 INFO:teuthology.orchestra.run.smithi059.stdout: "syslog" 2024-09-10T21:26:51.536 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.536 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T21:26:51.536 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.536 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.536 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: "cgroups_split": { 2024-09-10T21:26:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cgroups_split", 2024-09-10T21:26:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T21:26:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.537 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: "config_checks_enabled": { 2024-09-10T21:26:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_checks_enabled", 2024-09-10T21:26:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T21:26:51.538 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.539 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.539 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.539 INFO:teuthology.orchestra.run.smithi059.stdout: "config_dashboard": { 2024-09-10T21:26:51.539 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_dashboard", 2024-09-10T21:26:51.539 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.539 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.539 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.539 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.539 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.539 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.539 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.539 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T21:26:51.539 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_alertmanager": { 2024-09-10T21:26:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_alertmanager", 2024-09-10T21:26:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T21:26:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T21:26:51.540 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_base": { 2024-09-10T21:26:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_base", 2024-09-10T21:26:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T21:26:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Container image name, without the tag", 2024-09-10T21:26:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.541 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_elasticsearch": { 2024-09-10T21:26:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_elasticsearch", 2024-09-10T21:26:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T21:26:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "elasticsearch container image", 2024-09-10T21:26:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.542 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_grafana": { 2024-09-10T21:26:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_grafana", 2024-09-10T21:26:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T21:26:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T21:26:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_haproxy": { 2024-09-10T21:26:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_haproxy", 2024-09-10T21:26:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T21:26:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "HAproxy container image", 2024-09-10T21:26:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.544 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_agent": { 2024-09-10T21:26:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_agent", 2024-09-10T21:26:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T21:26:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger agent container image", 2024-09-10T21:26:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.545 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_collector": { 2024-09-10T21:26:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_collector", 2024-09-10T21:26:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T21:26:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger collector container image", 2024-09-10T21:26:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_query": { 2024-09-10T21:26:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_query", 2024-09-10T21:26:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T21:26:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger query container image", 2024-09-10T21:26:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.547 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_keepalived": { 2024-09-10T21:26:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_keepalived", 2024-09-10T21:26:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T21:26:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Keepalived container image", 2024-09-10T21:26:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.548 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_loki": { 2024-09-10T21:26:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_loki", 2024-09-10T21:26:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T21:26:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Loki container image", 2024-09-10T21:26:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.549 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_nginx": { 2024-09-10T21:26:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_nginx", 2024-09-10T21:26:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T21:26:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Nginx container image", 2024-09-10T21:26:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.550 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_node_exporter": { 2024-09-10T21:26:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_node_exporter", 2024-09-10T21:26:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T21:26:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T21:26:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_nvmeof": { 2024-09-10T21:26:51.551 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_nvmeof", 2024-09-10T21:26:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T21:26:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Nvme-of container image", 2024-09-10T21:26:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_oauth2_proxy": { 2024-09-10T21:26:51.552 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T21:26:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T21:26:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "oauth2-proxy container image", 2024-09-10T21:26:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.553 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_prometheus": { 2024-09-10T21:26:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_prometheus", 2024-09-10T21:26:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T21:26:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T21:26:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_promtail": { 2024-09-10T21:26:51.554 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_promtail", 2024-09-10T21:26:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T21:26:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Promtail container image", 2024-09-10T21:26:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_samba": { 2024-09-10T21:26:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_samba", 2024-09-10T21:26:51.555 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T21:26:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Samba/SMB container image", 2024-09-10T21:26:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_samba_metrics": { 2024-09-10T21:26:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_samba_metrics", 2024-09-10T21:26:51.556 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T21:26:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T21:26:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.557 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_snmp_gateway": { 2024-09-10T21:26:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_snmp_gateway", 2024-09-10T21:26:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T21:26:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SNMP Gateway container image", 2024-09-10T21:26:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: "container_init": { 2024-09-10T21:26:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_init", 2024-09-10T21:26:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T21:26:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.559 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: "daemon_cache_timeout": { 2024-09-10T21:26:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "daemon_cache_timeout", 2024-09-10T21:26:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T21:26:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T21:26:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.560 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: "default_cephadm_command_timeout": { 2024-09-10T21:26:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T21:26:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "900", 2024-09-10T21:26:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.561 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T21:26:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: "default_registry": { 2024-09-10T21:26:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "default_registry", 2024-09-10T21:26:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io", 2024-09-10T21:26:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.562 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T21:26:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: "device_cache_timeout": { 2024-09-10T21:26:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_cache_timeout", 2024-09-10T21:26:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1800", 2024-09-10T21:26:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.563 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache device inventory", 2024-09-10T21:26:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: "device_enhanced_scan": { 2024-09-10T21:26:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_enhanced_scan", 2024-09-10T21:26:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.564 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T21:26:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: "facts_cache_timeout": { 2024-09-10T21:26:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "facts_cache_timeout", 2024-09-10T21:26:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.565 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T21:26:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache host facts data", 2024-09-10T21:26:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: "grafana_dashboards_path": { 2024-09-10T21:26:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "grafana_dashboards_path", 2024-09-10T21:26:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.566 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T21:26:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T21:26:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: "host_check_interval": { 2024-09-10T21:26:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "host_check_interval", 2024-09-10T21:26:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.567 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T21:26:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to perform a host check", 2024-09-10T21:26:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: "hw_monitoring": { 2024-09-10T21:26:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "hw_monitoring", 2024-09-10T21:26:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.568 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T21:26:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: "inventory_list_all": { 2024-09-10T21:26:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "inventory_list_all", 2024-09-10T21:26:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T21:26:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.570 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.571 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: "log_refresh_metadata": { 2024-09-10T21:26:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_refresh_metadata", 2024-09-10T21:26:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.572 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T21:26:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.573 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T21:26:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.574 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.575 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.576 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T21:26:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T21:26:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.577 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T21:26:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T21:26:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T21:26:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "*", 2024-09-10T21:26:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.578 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T21:26:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: "max_count_per_host": { 2024-09-10T21:26:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_count_per_host", 2024-09-10T21:26:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.579 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "max number of daemons per service per host", 2024-09-10T21:26:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd_draining_count": { 2024-09-10T21:26:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_osd_draining_count", 2024-09-10T21:26:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.580 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T21:26:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: "migration_current": { 2024-09-10T21:26:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "migration_current", 2024-09-10T21:26:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.581 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "internal - do not modify", 2024-09-10T21:26:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": { 2024-09-10T21:26:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mode", 2024-09-10T21:26:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.582 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "root", 2024-09-10T21:26:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm-package", 2024-09-10T21:26:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: "root" 2024-09-10T21:26:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T21:26:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: "oob_default_addr": { 2024-09-10T21:26:51.583 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "oob_default_addr", 2024-09-10T21:26:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "169.254.1.1", 2024-09-10T21:26:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T21:26:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.584 INFO:teuthology.orchestra.run.smithi059.stdout: "prometheus_alerts_path": { 2024-09-10T21:26:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prometheus_alerts_path", 2024-09-10T21:26:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T21:26:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T21:26:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.585 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_insecure": { 2024-09-10T21:26:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_insecure", 2024-09-10T21:26:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T21:26:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_password": { 2024-09-10T21:26:51.586 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_password", 2024-09-10T21:26:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T21:26:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_url": { 2024-09-10T21:26:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_url", 2024-09-10T21:26:51.587 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T21:26:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_username": { 2024-09-10T21:26:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_username", 2024-09-10T21:26:51.588 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T21:26:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: "secure_monitoring_stack": { 2024-09-10T21:26:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "secure_monitoring_stack", 2024-09-10T21:26:51.589 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T21:26:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: "service_discovery_port": { 2024-09-10T21:26:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "service_discovery_port", 2024-09-10T21:26:51.590 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8765", 2024-09-10T21:26:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "cephadm service discovery port", 2024-09-10T21:26:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.591 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: "ssh_config_file": { 2024-09-10T21:26:51.592 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssh_config_file", 2024-09-10T21:26:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T21:26:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: "use_agent": { 2024-09-10T21:26:51.593 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "use_agent", 2024-09-10T21:26:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T21:26:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.594 INFO:teuthology.orchestra.run.smithi059.stdout: "use_repo_digest": { 2024-09-10T21:26:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "use_repo_digest", 2024-09-10T21:26:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T21:26:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_failed_host_check": { 2024-09-10T21:26:51.595 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_failed_host_check", 2024-09-10T21:26:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T21:26:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_stray_daemons": { 2024-09-10T21:26:51.596 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_stray_daemons", 2024-09-10T21:26:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T21:26:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_stray_hosts": { 2024-09-10T21:26:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_stray_hosts", 2024-09-10T21:26:51.597 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T21:26:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crash", 2024-09-10T21:26:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.599 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.600 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.601 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.602 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.603 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: "retain_interval": { 2024-09-10T21:26:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "retain_interval", 2024-09-10T21:26:51.604 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "31536000", 2024-09-10T21:26:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T21:26:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.605 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_recent_interval": { 2024-09-10T21:26:51.606 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_recent_interval", 2024-09-10T21:26:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1209600", 2024-09-10T21:26:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T21:26:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "dashboard", 2024-09-10T21:26:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T21:26:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T21:26:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.608 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T21:26:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T21:26:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.609 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T21:26:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T21:26:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.610 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: "AUDIT_API_ENABLED": { 2024-09-10T21:26:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T21:26:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.611 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T21:26:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T21:26:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.612 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T21:26:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T21:26:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.613 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T21:26:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T21:26:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.614 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T21:26:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T21:26:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.615 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T21:26:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T21:26:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.616 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T21:26:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T21:26:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.617 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T21:26:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T21:26:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.618 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T21:26:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T21:26:51.619 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.620 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T21:26:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T21:26:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T21:26:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T21:26:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.622 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T21:26:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T21:26:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2024-09-10T21:26:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T21:26:51.623 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T21:26:51.624 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.624 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.624 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.624 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.624 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.624 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.624 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.624 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.624 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.624 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.624 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_URL": { 2024-09-10T21:26:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_URL", 2024-09-10T21:26:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.625 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T21:26:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T21:26:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2024-09-10T21:26:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.626 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T21:26:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T21:26:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.627 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.628 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T21:26:51.628 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T21:26:51.628 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.628 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.628 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.628 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.628 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.628 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.628 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.628 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.628 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.628 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.628 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.628 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.629 INFO:teuthology.orchestra.run.smithi059.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T21:26:51.629 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T21:26:51.629 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.629 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.629 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.629 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.629 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.629 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.629 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.629 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.629 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.629 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.629 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.630 INFO:teuthology.orchestra.run.smithi059.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T21:26:51.630 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T21:26:51.630 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.630 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.630 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.630 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.630 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.630 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.630 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.630 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.630 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.630 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.630 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.630 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.631 INFO:teuthology.orchestra.run.smithi059.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T21:26:51.631 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T21:26:51.631 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.631 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.631 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.631 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "[]", 2024-09-10T21:26:51.631 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.631 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.631 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.631 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.631 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.631 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.631 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.631 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.631 INFO:teuthology.orchestra.run.smithi059.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T21:26:51.632 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T21:26:51.632 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.632 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.632 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.632 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "{}", 2024-09-10T21:26:51.632 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.632 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.632 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.632 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.632 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.632 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.632 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.632 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.632 INFO:teuthology.orchestra.run.smithi059.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T21:26:51.633 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T21:26:51.633 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.633 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.633 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.633 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.633 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.633 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.633 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.633 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.633 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.633 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.633 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.633 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.633 INFO:teuthology.orchestra.run.smithi059.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T21:26:51.634 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T21:26:51.634 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.634 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.634 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.634 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.634 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.634 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.634 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.634 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.634 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.634 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.634 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.634 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.634 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T21:26:51.634 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T21:26:51.635 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.635 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.635 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.635 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.635 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.635 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.635 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.635 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.635 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.635 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.635 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.635 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.635 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T21:26:51.635 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T21:26:51.635 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.636 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.636 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.636 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.636 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.636 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.636 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.636 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.636 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.636 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.636 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.636 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.636 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T21:26:51.637 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T21:26:51.637 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.637 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.637 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.637 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.637 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.637 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.637 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.637 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.637 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.637 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.637 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.637 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.638 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T21:26:51.638 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T21:26:51.638 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.638 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.638 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.638 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.638 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.638 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.638 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.638 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.638 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.638 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.638 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.639 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.639 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T21:26:51.639 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T21:26:51.639 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.639 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.639 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.639 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.639 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.639 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.639 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.639 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.639 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.639 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.640 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.640 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.640 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T21:26:51.640 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T21:26:51.640 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.640 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.640 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.640 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.640 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.640 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.640 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.640 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.640 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.641 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.641 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.641 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.641 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T21:26:51.641 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T21:26:51.641 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.641 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.641 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.641 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.641 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.641 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.641 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.641 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.642 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.642 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.642 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.642 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.642 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T21:26:51.642 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T21:26:51.642 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.642 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.642 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.642 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.642 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.642 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.642 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.643 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.643 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.643 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.643 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.643 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.643 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T21:26:51.643 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T21:26:51.643 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.643 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.643 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.643 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T21:26:51.643 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.643 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.644 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.644 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.644 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.644 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.644 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.644 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.644 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T21:26:51.644 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T21:26:51.644 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.644 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.644 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.644 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:51.644 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.645 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.645 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.645 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.645 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.645 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.645 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.645 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.645 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T21:26:51.645 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T21:26:51.645 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.645 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.645 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.645 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8", 2024-09-10T21:26:51.646 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.646 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.646 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.646 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.646 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.646 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.646 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.646 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.646 INFO:teuthology.orchestra.run.smithi059.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T21:26:51.646 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T21:26:51.646 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.646 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.646 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.646 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "45", 2024-09-10T21:26:51.647 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.647 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.647 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.647 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.647 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.647 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.647 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.647 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.647 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T21:26:51.647 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T21:26:51.647 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.647 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.647 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.648 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.648 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.648 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.648 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.648 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.648 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.648 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.648 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.648 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.648 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T21:26:51.648 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T21:26:51.648 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.648 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.648 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.649 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2024-09-10T21:26:51.649 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.649 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.649 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.649 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.649 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.649 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.649 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.649 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.649 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T21:26:51.649 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T21:26:51.649 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.649 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.649 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.649 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.650 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.650 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.650 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.650 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.650 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.650 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.650 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.650 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T21:26:51.650 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T21:26:51.650 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.651 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.651 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.651 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.651 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.651 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.651 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.651 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.652 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.652 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.652 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.652 INFO:teuthology.orchestra.run.smithi059.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T21:26:51.652 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T21:26:51.652 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.652 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.652 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.652 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.652 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.652 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.652 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.653 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.653 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.653 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.653 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.653 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T21:26:51.653 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T21:26:51.653 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.653 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.653 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.653 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.653 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.653 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.653 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.654 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.654 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.654 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.654 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.654 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T21:26:51.654 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T21:26:51.654 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.654 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.654 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.654 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:51.654 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.654 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.655 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.655 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.655 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.655 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.655 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.655 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T21:26:51.655 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T21:26:51.655 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.655 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.655 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.655 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T21:26:51.655 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.655 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.656 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.656 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.656 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.656 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.656 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.656 INFO:teuthology.orchestra.run.smithi059.stdout: "cross_origin_url": { 2024-09-10T21:26:51.656 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cross_origin_url", 2024-09-10T21:26:51.656 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.656 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.656 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.656 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.656 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.657 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.657 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.657 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.657 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.657 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.657 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.657 INFO:teuthology.orchestra.run.smithi059.stdout: "crt_file": { 2024-09-10T21:26:51.657 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crt_file", 2024-09-10T21:26:51.657 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.657 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.657 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.657 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.658 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.658 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.658 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.658 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.658 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.658 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.658 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.658 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.658 INFO:teuthology.orchestra.run.smithi059.stdout: "debug": { 2024-09-10T21:26:51.658 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "debug", 2024-09-10T21:26:51.658 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.658 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.658 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.658 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.659 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.659 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.659 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.659 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable/disable debug options", 2024-09-10T21:26:51.659 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.659 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.659 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.659 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.659 INFO:teuthology.orchestra.run.smithi059.stdout: "jwt_token_ttl": { 2024-09-10T21:26:51.659 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "jwt_token_ttl", 2024-09-10T21:26:51.659 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.659 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.659 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.660 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "28800", 2024-09-10T21:26:51.660 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.660 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.660 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.660 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.660 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.660 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.660 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.660 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.660 INFO:teuthology.orchestra.run.smithi059.stdout: "key_file": { 2024-09-10T21:26:51.660 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "key_file", 2024-09-10T21:26:51.660 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.660 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.660 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.661 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.661 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.661 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.661 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.661 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.661 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.661 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.661 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.661 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.661 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.661 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.661 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.661 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.661 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.662 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.662 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.662 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.662 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.662 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.662 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.662 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.662 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.662 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.662 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.662 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.662 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.662 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.663 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.663 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.663 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.663 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.663 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.663 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.663 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.663 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.663 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.663 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.663 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.663 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.663 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.664 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.664 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.664 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.664 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.664 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.664 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.664 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.664 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.664 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.664 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.664 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.664 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.664 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.665 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.665 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.665 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.665 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.665 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.665 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.665 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.665 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.665 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.665 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.665 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.665 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.666 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.666 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.666 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.666 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.666 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.666 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.666 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.666 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.666 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.666 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.666 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.666 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.666 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.666 INFO:teuthology.orchestra.run.smithi059.stdout: "motd": { 2024-09-10T21:26:51.667 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "motd", 2024-09-10T21:26:51.667 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.667 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.667 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.667 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.667 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.667 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.667 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.667 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "The message of the day", 2024-09-10T21:26:51.667 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.667 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.667 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.667 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.668 INFO:teuthology.orchestra.run.smithi059.stdout: "redirect_resolve_ip_addr": { 2024-09-10T21:26:51.668 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T21:26:51.668 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.668 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.668 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.668 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.668 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.668 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.668 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.668 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.668 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.668 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.668 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.669 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2024-09-10T21:26:51.669 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2024-09-10T21:26:51.669 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.669 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.669 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.669 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "::", 2024-09-10T21:26:51.669 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.669 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.669 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.669 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.669 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.669 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.670 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.670 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.670 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2024-09-10T21:26:51.670 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2024-09-10T21:26:51.670 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.670 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.670 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.670 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8080", 2024-09-10T21:26:51.670 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.670 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.670 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.670 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.670 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.670 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.671 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.671 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.671 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.671 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.671 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.671 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.671 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.671 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.671 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.671 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.671 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.671 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.671 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.672 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.672 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl": { 2024-09-10T21:26:51.672 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl", 2024-09-10T21:26:51.672 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.672 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.672 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.672 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.672 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.672 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.672 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.672 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.672 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.673 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.673 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.673 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl_server_port": { 2024-09-10T21:26:51.673 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl_server_port", 2024-09-10T21:26:51.673 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.673 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.673 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.673 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8443", 2024-09-10T21:26:51.673 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.673 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.673 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.673 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.674 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.674 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.674 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.674 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_behaviour": { 2024-09-10T21:26:51.674 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_behaviour", 2024-09-10T21:26:51.674 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.674 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.674 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.674 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "redirect", 2024-09-10T21:26:51.674 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.674 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.674 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.674 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.675 INFO:teuthology.orchestra.run.smithi059.stdout: "redirect" 2024-09-10T21:26:51.675 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.675 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.675 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.675 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.675 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.675 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_error_status_code": { 2024-09-10T21:26:51.675 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_error_status_code", 2024-09-10T21:26:51.675 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.675 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.675 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.675 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2024-09-10T21:26:51.676 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "400", 2024-09-10T21:26:51.676 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "599", 2024-09-10T21:26:51.676 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.676 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.676 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.676 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.676 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.676 INFO:teuthology.orchestra.run.smithi059.stdout: "url_prefix": { 2024-09-10T21:26:51.676 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "url_prefix", 2024-09-10T21:26:51.676 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.676 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.676 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.676 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.677 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.677 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.677 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.677 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.677 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.677 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.677 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.677 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.677 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.677 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.677 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "devicehealth", 2024-09-10T21:26:51.677 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.678 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.678 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.678 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_monitoring": { 2024-09-10T21:26:51.678 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enable_monitoring", 2024-09-10T21:26:51.678 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.678 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.678 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.678 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.678 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.678 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.678 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.678 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "monitor device health metrics", 2024-09-10T21:26:51.678 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.679 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.679 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.679 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.679 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.679 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.679 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.679 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.679 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.679 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.679 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.679 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.679 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.680 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.680 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.680 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.680 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.680 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.680 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.680 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.680 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.680 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.680 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.681 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.681 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.681 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.681 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.681 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.681 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.681 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.681 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.681 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.681 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.681 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.682 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.682 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.682 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.682 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.682 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.682 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.682 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.682 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.682 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.682 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.682 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.683 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.683 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.683 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.683 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.683 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.683 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.683 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.683 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.683 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.683 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.683 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.683 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.684 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.684 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.684 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.684 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.684 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.684 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.684 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.684 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.684 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.684 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.684 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.684 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.685 INFO:teuthology.orchestra.run.smithi059.stdout: "mark_out_threshold": { 2024-09-10T21:26:51.685 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mark_out_threshold", 2024-09-10T21:26:51.685 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.685 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.685 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.685 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "2419200", 2024-09-10T21:26:51.685 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.685 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.685 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.685 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T21:26:51.685 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.685 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.686 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.686 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": { 2024-09-10T21:26:51.686 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pool_name", 2024-09-10T21:26:51.686 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.686 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.686 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.686 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "device_health_metrics", 2024-09-10T21:26:51.686 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.686 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.686 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.686 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T21:26:51.687 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.687 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.687 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.687 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.687 INFO:teuthology.orchestra.run.smithi059.stdout: "retention_period": { 2024-09-10T21:26:51.687 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "retention_period", 2024-09-10T21:26:51.687 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.687 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.687 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.687 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15552000", 2024-09-10T21:26:51.687 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.687 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.687 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.687 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long to retain device health metrics", 2024-09-10T21:26:51.688 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.688 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.688 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.688 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.688 INFO:teuthology.orchestra.run.smithi059.stdout: "scrape_frequency": { 2024-09-10T21:26:51.688 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "scrape_frequency", 2024-09-10T21:26:51.688 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.688 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.688 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.688 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "86400", 2024-09-10T21:26:51.688 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.688 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.688 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.688 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T21:26:51.689 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.689 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.689 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.689 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.689 INFO:teuthology.orchestra.run.smithi059.stdout: "self_heal": { 2024-09-10T21:26:51.689 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "self_heal", 2024-09-10T21:26:51.689 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.689 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.689 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.689 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.689 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.689 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.690 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.690 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T21:26:51.690 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.690 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.690 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.690 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T21:26:51.690 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T21:26:51.690 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.690 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.690 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.690 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T21:26:51.690 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.691 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.691 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.691 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T21:26:51.691 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.691 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.691 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.691 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.691 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.691 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.691 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.691 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.691 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.691 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.691 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.692 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.692 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.692 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.692 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.692 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.692 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_threshold": { 2024-09-10T21:26:51.692 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_threshold", 2024-09-10T21:26:51.692 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.692 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.692 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.692 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "7257600", 2024-09-10T21:26:51.692 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.692 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.693 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.693 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T21:26:51.693 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.693 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.693 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.693 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.693 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.693 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "diskprediction_local", 2024-09-10T21:26:51.693 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.693 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.693 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.694 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.694 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.694 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.694 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.694 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.694 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.694 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.694 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.694 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.694 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.694 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.694 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.695 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.695 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.695 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.695 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.695 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.695 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.695 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.695 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.695 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.695 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.695 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.695 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.695 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.696 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.696 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.696 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.696 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.696 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.696 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.696 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.696 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.696 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.696 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.696 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.696 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.697 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.697 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.697 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.697 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.697 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.697 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.697 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.697 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.697 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.697 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.697 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.697 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.697 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.698 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.698 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.698 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.698 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.698 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.698 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.698 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.698 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.698 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.698 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.698 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.698 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.698 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.699 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.699 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.699 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.699 INFO:teuthology.orchestra.run.smithi059.stdout: "predict_interval": { 2024-09-10T21:26:51.699 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "predict_interval", 2024-09-10T21:26:51.699 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.699 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.699 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.699 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "86400", 2024-09-10T21:26:51.699 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.699 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.699 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.700 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.700 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.700 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.700 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.700 INFO:teuthology.orchestra.run.smithi059.stdout: "predictor_model": { 2024-09-10T21:26:51.700 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "predictor_model", 2024-09-10T21:26:51.700 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.700 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.700 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.700 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "prophetstor", 2024-09-10T21:26:51.700 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.700 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.700 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.701 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.701 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.701 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.701 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.701 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T21:26:51.701 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T21:26:51.701 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.701 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.701 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.701 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T21:26:51.701 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.701 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.701 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.702 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.702 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.702 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.702 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.702 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.702 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.702 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.702 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.702 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.702 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.702 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.702 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.702 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.703 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.703 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.703 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.703 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.703 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.703 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.703 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "influx", 2024-09-10T21:26:51.703 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": false, 2024-09-10T21:26:51.703 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "influxdb python module not found", 2024-09-10T21:26:51.703 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.703 INFO:teuthology.orchestra.run.smithi059.stdout: "batch_size": { 2024-09-10T21:26:51.704 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "batch_size", 2024-09-10T21:26:51.704 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.704 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.704 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.704 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5000", 2024-09-10T21:26:51.704 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.704 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.704 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.704 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T21:26:51.704 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.704 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.704 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.705 INFO:teuthology.orchestra.run.smithi059.stdout: "database": { 2024-09-10T21:26:51.705 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "database", 2024-09-10T21:26:51.705 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.705 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.705 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.705 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "ceph", 2024-09-10T21:26:51.705 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.705 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.705 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.705 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T21:26:51.705 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.705 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.705 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.705 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.706 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": { 2024-09-10T21:26:51.706 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "hostname", 2024-09-10T21:26:51.706 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.706 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.706 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.706 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.706 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.706 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.706 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.706 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB server hostname", 2024-09-10T21:26:51.706 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.706 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.706 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.706 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.706 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T21:26:51.707 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T21:26:51.707 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.707 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.707 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.707 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "30", 2024-09-10T21:26:51.707 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "5", 2024-09-10T21:26:51.707 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.707 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.707 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T21:26:51.707 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.707 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.707 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.707 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.707 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.708 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.708 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.708 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.708 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.708 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.708 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.708 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.708 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.708 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.708 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.708 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.709 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.709 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.709 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.709 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.709 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.709 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.709 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.709 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.709 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.709 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.709 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.709 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.709 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.709 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.710 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.710 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.710 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.710 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.710 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.710 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.710 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.710 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.710 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.710 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.710 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.710 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.711 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.711 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.711 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.711 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.711 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.711 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.711 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.711 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.711 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.711 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.711 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.711 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.712 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.712 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.712 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.712 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.712 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.712 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.712 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.712 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.712 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.712 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.712 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.712 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.712 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.713 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.713 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.713 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.713 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.713 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.713 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.713 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.713 INFO:teuthology.orchestra.run.smithi059.stdout: "password": { 2024-09-10T21:26:51.713 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "password", 2024-09-10T21:26:51.713 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.713 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.713 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.714 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.714 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.714 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.714 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.714 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "password of InfluxDB server user", 2024-09-10T21:26:51.714 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.714 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.714 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.714 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.714 INFO:teuthology.orchestra.run.smithi059.stdout: "port": { 2024-09-10T21:26:51.714 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "port", 2024-09-10T21:26:51.714 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.714 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.715 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.715 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8086", 2024-09-10T21:26:51.715 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.715 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.715 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.715 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB server port", 2024-09-10T21:26:51.715 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.715 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.715 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.715 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.715 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.715 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.715 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.715 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.716 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.716 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.716 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.716 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.716 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.716 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.716 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.716 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.716 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.716 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.716 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl": { 2024-09-10T21:26:51.716 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl", 2024-09-10T21:26:51.716 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.717 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.717 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.717 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "false", 2024-09-10T21:26:51.717 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.717 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.717 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.717 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T21:26:51.717 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.717 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.717 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.717 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.717 INFO:teuthology.orchestra.run.smithi059.stdout: "threads": { 2024-09-10T21:26:51.717 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "threads", 2024-09-10T21:26:51.717 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.718 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.718 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.718 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T21:26:51.718 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T21:26:51.718 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "32", 2024-09-10T21:26:51.718 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.718 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T21:26:51.718 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.718 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.718 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.718 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.718 INFO:teuthology.orchestra.run.smithi059.stdout: "username": { 2024-09-10T21:26:51.718 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "username", 2024-09-10T21:26:51.718 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.719 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.719 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.719 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.719 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.719 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.719 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.719 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "username of InfluxDB server user", 2024-09-10T21:26:51.719 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.719 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.719 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.719 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.719 INFO:teuthology.orchestra.run.smithi059.stdout: "verify_ssl": { 2024-09-10T21:26:51.719 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "verify_ssl", 2024-09-10T21:26:51.719 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.719 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.720 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.720 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "true", 2024-09-10T21:26:51.720 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.720 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.720 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.720 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T21:26:51.720 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.720 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.720 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.720 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.720 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.720 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.720 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.721 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "insights", 2024-09-10T21:26:51.721 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.721 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.721 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.721 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.721 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.721 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.721 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.721 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.721 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.721 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.721 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.721 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.721 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.721 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.722 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.722 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.722 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.722 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.722 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.722 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.722 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.722 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.722 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.722 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.722 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.722 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.722 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.723 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.723 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.723 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.723 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.723 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.723 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.723 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.723 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.723 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.723 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.723 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.723 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.724 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.724 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.724 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.724 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.724 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.724 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.724 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.724 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.724 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.724 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.724 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.724 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.724 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.725 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.725 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.725 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.725 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.725 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.725 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.725 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.725 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.725 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.725 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.725 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.725 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.726 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.726 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.726 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.726 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.726 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.726 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.726 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.726 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.726 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.726 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.726 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.726 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.726 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.726 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.727 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.727 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.727 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.727 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.727 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.727 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.727 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.727 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.727 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.727 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.727 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.727 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "iostat", 2024-09-10T21:26:51.727 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.728 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.728 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.728 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.728 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.728 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.728 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.728 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.728 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.728 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.728 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.728 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.728 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.728 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.729 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.729 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.729 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.729 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.729 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.729 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.729 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.729 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.729 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.729 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.729 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.729 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.729 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.729 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.730 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.730 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.730 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.730 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.730 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.730 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.730 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.730 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.730 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.730 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.730 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.730 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.730 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.731 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.731 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.731 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.731 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.731 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.731 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.731 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.731 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.731 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.731 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.731 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.731 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.731 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.731 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.731 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.732 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.732 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.732 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.732 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.732 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.732 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.732 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.732 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.732 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.732 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.732 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.732 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.732 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.732 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.733 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.733 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.733 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.733 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.733 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.733 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.733 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.733 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.733 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.733 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.733 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.733 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.734 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.734 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.734 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.734 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.734 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.734 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.734 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.734 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.734 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "k8sevents", 2024-09-10T21:26:51.734 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.734 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.734 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.734 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_event_retention_days": { 2024-09-10T21:26:51.734 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ceph_event_retention_days", 2024-09-10T21:26:51.735 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.735 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.735 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.735 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "7", 2024-09-10T21:26:51.735 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.735 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.735 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.735 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T21:26:51.735 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.735 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.735 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.735 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.735 INFO:teuthology.orchestra.run.smithi059.stdout: "config_check_secs": { 2024-09-10T21:26:51.735 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_check_secs", 2024-09-10T21:26:51.736 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.736 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.736 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.736 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:51.736 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "10", 2024-09-10T21:26:51.736 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.736 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.736 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T21:26:51.736 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.736 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.736 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.736 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.736 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.736 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.736 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.737 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.737 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.737 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.737 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.737 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.737 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.737 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.737 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.737 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.737 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.737 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.738 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.738 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.738 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.738 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.738 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.738 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.738 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.738 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.738 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.738 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.738 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.738 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.739 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.739 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.739 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.739 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.739 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.739 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.739 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.739 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.739 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.739 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.739 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.739 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.740 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.740 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.740 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.740 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.740 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.740 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.740 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.740 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.740 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.740 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.740 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.740 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.741 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.741 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.741 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.741 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.741 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.741 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.741 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.741 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.741 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.741 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.741 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.741 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.741 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.742 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.742 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.742 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.742 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.742 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.742 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.742 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.742 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.742 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.742 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.742 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.742 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.743 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.743 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.743 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.743 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.743 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.743 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.743 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.743 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.743 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.743 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.743 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "localpool", 2024-09-10T21:26:51.743 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.744 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.744 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.744 INFO:teuthology.orchestra.run.smithi059.stdout: "failure_domain": { 2024-09-10T21:26:51.744 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "failure_domain", 2024-09-10T21:26:51.744 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.744 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.744 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.744 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "host", 2024-09-10T21:26:51.744 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.744 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.744 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.744 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "failure domain for any created local pool", 2024-09-10T21:26:51.744 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T21:26:51.745 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.745 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.745 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.745 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.745 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.745 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.745 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.745 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.745 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.745 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.745 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.745 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.745 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.746 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.746 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.746 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.746 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.746 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.746 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.746 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.746 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.746 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.746 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.746 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.746 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.746 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.746 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.747 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.747 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.747 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.747 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.747 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.747 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.747 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.747 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.747 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.747 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.747 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.747 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.747 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.747 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.748 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.748 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.748 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.748 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.748 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.748 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.748 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.748 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.748 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.748 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.748 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.748 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.748 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.748 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.749 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.749 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.749 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.749 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.749 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.749 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.749 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.749 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.749 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.749 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.749 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.749 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.749 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.749 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.750 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.750 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.750 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.750 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.750 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": { 2024-09-10T21:26:51.750 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "min_size", 2024-09-10T21:26:51.750 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.750 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.750 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.750 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.750 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.750 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.750 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.750 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default min_size for any created local pool", 2024-09-10T21:26:51.751 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T21:26:51.751 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.751 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.751 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.751 INFO:teuthology.orchestra.run.smithi059.stdout: "num_rep": { 2024-09-10T21:26:51.751 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "num_rep", 2024-09-10T21:26:51.751 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.751 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.751 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.751 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3", 2024-09-10T21:26:51.751 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.751 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.751 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.751 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default replica count for any created local pool", 2024-09-10T21:26:51.751 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.752 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.752 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.752 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.752 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": { 2024-09-10T21:26:51.752 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pg_num", 2024-09-10T21:26:51.752 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.752 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.752 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.752 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "128", 2024-09-10T21:26:51.752 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.752 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.752 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.752 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T21:26:51.753 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.753 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.753 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.753 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.753 INFO:teuthology.orchestra.run.smithi059.stdout: "prefix": { 2024-09-10T21:26:51.753 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prefix", 2024-09-10T21:26:51.753 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.753 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.753 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.753 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.753 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.753 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.753 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.753 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "name prefix for any created local pool", 2024-09-10T21:26:51.754 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.754 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.754 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.754 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.754 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.754 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.754 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.754 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.754 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.754 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.754 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.754 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.754 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.754 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.754 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.755 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.755 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.755 INFO:teuthology.orchestra.run.smithi059.stdout: "subtree": { 2024-09-10T21:26:51.755 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subtree", 2024-09-10T21:26:51.755 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.755 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.755 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.755 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "rack", 2024-09-10T21:26:51.755 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.755 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.755 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.755 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T21:26:51.755 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T21:26:51.756 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.756 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.756 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.756 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.756 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mds_autoscaler", 2024-09-10T21:26:51.756 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.756 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.756 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.756 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.756 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.757 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.757 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.757 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.757 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.757 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.757 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.757 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.757 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.757 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.757 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.757 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.757 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.757 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.758 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.758 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.758 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.758 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.758 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.758 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.758 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.758 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.758 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.758 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.758 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.758 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.758 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.758 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.759 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.759 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.759 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.759 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.759 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.759 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.759 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.759 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.759 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.759 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.759 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.759 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.759 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.760 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.760 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.760 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.760 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.760 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.760 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.760 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.760 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.760 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.760 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.760 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.760 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.760 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.761 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.761 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.761 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.761 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.761 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.761 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.761 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.761 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.761 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.761 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.761 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.761 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.762 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.762 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.762 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.762 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.762 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.762 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.762 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.762 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.762 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.762 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.762 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.762 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.762 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.762 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.763 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mirroring", 2024-09-10T21:26:51.763 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.763 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.763 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.763 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.763 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.763 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.763 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.763 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.763 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.763 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.763 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.763 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.764 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.764 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.764 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.764 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.764 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.764 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.764 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.764 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.764 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.764 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.764 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.765 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.765 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.765 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.765 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.765 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.765 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.765 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.765 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.765 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.765 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.765 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.765 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.765 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.766 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.766 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.766 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.766 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.766 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.766 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.766 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.766 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.766 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.766 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.766 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.766 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.766 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.766 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.767 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.767 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.767 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.767 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.767 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.767 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.767 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.767 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.767 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.767 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.767 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.767 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.767 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.768 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.768 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.768 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.768 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.768 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.768 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.768 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.768 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.768 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.768 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.768 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.768 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.769 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.769 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.769 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.769 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.769 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.769 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.769 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.769 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.769 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.769 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "nfs", 2024-09-10T21:26:51.769 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.770 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.770 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.770 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.770 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.770 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.770 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.770 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.770 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.770 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.770 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.770 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.770 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.770 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.770 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.771 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.771 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.771 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.771 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.771 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.771 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.771 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.771 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.771 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.771 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.771 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.771 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.771 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.772 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.772 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.772 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.772 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.772 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.772 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.772 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.772 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.772 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.772 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.772 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.772 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.773 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.773 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.773 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.773 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.773 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.773 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.773 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.773 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.773 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.773 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.773 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.773 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.773 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.773 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.774 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.774 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.774 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.774 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.774 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.774 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.774 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.774 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.774 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.774 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.774 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.774 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.775 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.775 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.775 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.775 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.775 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.775 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.775 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.775 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.775 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.775 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.775 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.775 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.775 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.776 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.776 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.776 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.776 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.776 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.776 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "orchestrator", 2024-09-10T21:26:51.776 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.776 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.776 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.776 INFO:teuthology.orchestra.run.smithi059.stdout: "fail_fs": { 2024-09-10T21:26:51.776 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "fail_fs", 2024-09-10T21:26:51.776 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.777 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.777 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.777 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.777 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.777 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.777 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.777 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T21:26:51.777 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.777 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.777 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.777 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.777 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.778 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.778 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.778 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.778 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.778 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.778 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.778 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.778 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.778 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.778 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.778 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.778 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.778 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.778 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.778 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.779 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.779 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.779 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.779 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.779 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.779 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.779 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.779 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.779 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.779 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.779 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.779 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.780 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.780 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.780 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.780 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.780 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.780 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.780 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.780 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.780 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.780 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.780 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.780 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.781 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.781 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.781 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.781 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.781 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.781 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.781 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.781 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.781 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.781 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.781 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.781 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.782 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.782 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.782 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.782 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.782 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.782 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.782 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.782 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.782 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.782 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.782 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.783 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.783 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.783 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator": { 2024-09-10T21:26:51.783 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "orchestrator", 2024-09-10T21:26:51.783 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.783 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.783 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.783 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.783 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.783 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.783 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.783 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm", 2024-09-10T21:26:51.784 INFO:teuthology.orchestra.run.smithi059.stdout: "rook", 2024-09-10T21:26:51.784 INFO:teuthology.orchestra.run.smithi059.stdout: "test_orchestrator" 2024-09-10T21:26:51.784 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.784 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Orchestrator backend", 2024-09-10T21:26:51.784 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.784 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.784 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.784 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.784 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.784 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.784 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.785 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.785 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.785 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.785 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.785 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.785 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.785 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.785 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.785 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.785 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.785 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.786 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "osd_perf_query", 2024-09-10T21:26:51.786 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.786 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.786 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.786 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.786 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.786 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.786 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.786 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.786 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.786 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.786 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.786 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.786 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.787 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.787 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.787 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.787 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.787 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.787 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.787 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.787 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.787 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.787 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.787 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.787 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.787 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.787 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.787 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.788 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.788 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.788 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.788 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.788 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.788 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.788 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.788 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.788 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.788 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.788 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.788 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.788 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.789 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.789 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.789 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.789 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.789 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.789 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.789 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.789 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.789 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.789 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.789 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.789 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.789 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.789 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.789 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.790 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.790 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.790 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.790 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.790 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.790 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.790 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.790 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.790 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.790 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.790 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.790 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.790 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.791 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.791 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.791 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.791 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.791 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.791 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.791 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.791 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.791 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.791 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.791 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.791 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.791 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.792 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.792 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.792 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "osd_support", 2024-09-10T21:26:51.792 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.792 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.792 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.792 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.792 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.792 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.792 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.792 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.792 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.793 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.793 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.793 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.793 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.793 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.793 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.793 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.793 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.793 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.793 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.793 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.793 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.793 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.793 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.794 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.794 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.794 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.794 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.794 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.794 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.794 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.794 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.794 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.794 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.794 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.794 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.795 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.795 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.795 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.795 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.795 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.795 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.795 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.795 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.795 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.795 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.795 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.795 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.796 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.796 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.796 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.796 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.796 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.796 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.796 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.796 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.796 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.796 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.796 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.796 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.797 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.797 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.797 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.797 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.797 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.797 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.797 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.797 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.797 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.797 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.797 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.797 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.798 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.798 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.798 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.798 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.798 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.798 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.798 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.798 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.798 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.798 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.798 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.798 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.798 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.799 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pg_autoscaler", 2024-09-10T21:26:51.799 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.799 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.799 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.799 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.799 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.799 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.799 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.799 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.799 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.799 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.799 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.800 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.800 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.800 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.800 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.800 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.800 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.800 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.800 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.800 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.800 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.800 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.800 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.800 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.801 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.801 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.801 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.801 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.801 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.801 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.801 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.801 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.801 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.801 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.801 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.801 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.802 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.802 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.802 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.802 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.802 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.802 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.802 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.802 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.802 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.802 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.802 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.802 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.802 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.802 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.803 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.803 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.803 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.803 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.803 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.803 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.803 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.803 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.803 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.803 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.803 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.804 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.804 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.804 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.804 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.804 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.804 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.804 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.804 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.804 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T21:26:51.804 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T21:26:51.804 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.804 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.805 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.805 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T21:26:51.805 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.805 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.805 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.805 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.805 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.805 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.805 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.805 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.805 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.805 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.806 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.806 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.806 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.806 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.806 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.806 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.806 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.806 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.806 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.806 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.806 INFO:teuthology.orchestra.run.smithi059.stdout: "threshold": { 2024-09-10T21:26:51.806 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "threshold", 2024-09-10T21:26:51.806 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:51.807 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.807 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.807 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3.0", 2024-09-10T21:26:51.807 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1.0", 2024-09-10T21:26:51.807 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.807 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.807 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "scaling threshold", 2024-09-10T21:26:51.807 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T21:26:51.807 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.807 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.807 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.807 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.808 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "progress", 2024-09-10T21:26:51.808 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.808 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.808 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.808 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_pg_recovery_event": { 2024-09-10T21:26:51.808 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_pg_recovery_event", 2024-09-10T21:26:51.808 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.808 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.808 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.808 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.808 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.809 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.809 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.809 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T21:26:51.809 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.809 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.809 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.809 INFO:teuthology.orchestra.run.smithi059.stdout: "enabled": { 2024-09-10T21:26:51.809 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enabled", 2024-09-10T21:26:51.809 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.809 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.809 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.810 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.810 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.810 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.810 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.810 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.810 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.810 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.810 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.810 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.810 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.810 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.810 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.810 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.811 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.811 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.811 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.811 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.811 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.811 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.811 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.811 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.811 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.811 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.811 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.811 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.811 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.811 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.812 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.812 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.812 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.812 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.812 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.812 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.812 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.812 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.812 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.812 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.812 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.813 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.813 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.813 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.813 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.813 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.813 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.813 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.813 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.813 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.813 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.813 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.813 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.813 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.814 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.814 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.814 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.814 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.814 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.814 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.814 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.814 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.814 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.814 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.814 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.814 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.815 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.815 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.815 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.815 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.815 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.815 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.815 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.815 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.815 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.815 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.815 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.815 INFO:teuthology.orchestra.run.smithi059.stdout: "max_completed_events": { 2024-09-10T21:26:51.815 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_completed_events", 2024-09-10T21:26:51.815 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.816 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.816 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.816 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "50", 2024-09-10T21:26:51.816 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.816 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.816 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.816 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "number of past completed events to remember", 2024-09-10T21:26:51.816 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.816 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.816 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.816 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T21:26:51.816 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T21:26:51.817 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.817 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.817 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.817 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T21:26:51.817 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.817 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.817 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.817 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long the module is going to sleep", 2024-09-10T21:26:51.817 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.817 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.817 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.817 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.818 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.818 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.818 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.818 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.818 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.818 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.818 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.818 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.818 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.818 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.818 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.818 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.818 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.818 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.819 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prometheus", 2024-09-10T21:26:51.819 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.819 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.819 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.819 INFO:teuthology.orchestra.run.smithi059.stdout: "cache": { 2024-09-10T21:26:51.819 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cache", 2024-09-10T21:26:51.819 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.819 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.819 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.819 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.819 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.819 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.820 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.820 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.820 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.820 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.820 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.820 INFO:teuthology.orchestra.run.smithi059.stdout: "exclude_perf_counters": { 2024-09-10T21:26:51.820 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "exclude_perf_counters", 2024-09-10T21:26:51.820 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.820 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.820 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.820 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.820 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.820 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.821 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.821 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T21:26:51.821 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T21:26:51.821 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.821 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.821 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.821 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.821 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.821 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.821 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.821 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.821 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.821 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.822 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.822 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.822 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.822 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.822 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.822 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.822 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.822 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.822 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.822 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.822 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.822 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.823 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.823 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.823 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.823 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.823 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.823 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.823 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.823 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.823 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.823 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.823 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.823 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.823 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.824 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.824 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.824 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.824 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.824 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.824 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.824 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.824 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.824 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.824 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.824 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.825 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.825 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.825 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.825 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.825 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.825 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.825 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.825 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.825 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.825 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.825 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.825 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.826 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.826 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.826 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.826 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.826 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.826 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.826 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.826 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.826 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.826 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.826 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_stats_pools": { 2024-09-10T21:26:51.826 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_stats_pools", 2024-09-10T21:26:51.827 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.827 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.827 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.827 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.827 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.827 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.827 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.827 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.827 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.827 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.827 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.828 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T21:26:51.828 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T21:26:51.828 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.828 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.828 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.828 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "300", 2024-09-10T21:26:51.828 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.828 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.828 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.828 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.828 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.828 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.828 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.829 INFO:teuthology.orchestra.run.smithi059.stdout: "scrape_interval": { 2024-09-10T21:26:51.829 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "scrape_interval", 2024-09-10T21:26:51.829 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:51.829 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.829 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.829 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15.0", 2024-09-10T21:26:51.829 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.829 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.829 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.829 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.829 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.829 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.830 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.830 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2024-09-10T21:26:51.830 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2024-09-10T21:26:51.830 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.830 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.830 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.830 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "::", 2024-09-10T21:26:51.831 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.832 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.832 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.832 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T21:26:51.832 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.832 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.832 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.832 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2024-09-10T21:26:51.832 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2024-09-10T21:26:51.832 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.832 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.832 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.833 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "9283", 2024-09-10T21:26:51.833 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.833 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.833 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.833 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T21:26:51.833 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.833 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.833 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.833 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.833 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.833 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.833 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.833 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.834 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.834 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.834 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.834 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.834 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.834 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.834 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.834 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.834 INFO:teuthology.orchestra.run.smithi059.stdout: "stale_cache_strategy": { 2024-09-10T21:26:51.834 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "stale_cache_strategy", 2024-09-10T21:26:51.834 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.834 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.835 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.835 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "log", 2024-09-10T21:26:51.835 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.835 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.835 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.835 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.835 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.835 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.835 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.835 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_behaviour": { 2024-09-10T21:26:51.835 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_behaviour", 2024-09-10T21:26:51.835 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.836 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.836 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.836 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "default", 2024-09-10T21:26:51.836 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.836 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.836 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.836 INFO:teuthology.orchestra.run.smithi059.stdout: "default", 2024-09-10T21:26:51.836 INFO:teuthology.orchestra.run.smithi059.stdout: "error" 2024-09-10T21:26:51.836 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.836 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.836 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.836 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.836 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.837 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_error_status_code": { 2024-09-10T21:26:51.837 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_error_status_code", 2024-09-10T21:26:51.837 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.837 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.837 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.837 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2024-09-10T21:26:51.837 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "400", 2024-09-10T21:26:51.837 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "599", 2024-09-10T21:26:51.837 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.837 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.837 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.837 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.837 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.838 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.838 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.838 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_support", 2024-09-10T21:26:51.838 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.838 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.838 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.838 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.838 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.838 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.838 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.839 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.839 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.839 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.839 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.839 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.839 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.839 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.839 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.839 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.839 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.839 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.839 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.839 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.840 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.840 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.840 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.840 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.840 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.840 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.840 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.840 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.840 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.840 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.840 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.840 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.841 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.841 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.841 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.841 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.841 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.841 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.841 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.841 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.841 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.841 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.841 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.841 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.842 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.842 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.842 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.842 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.842 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.842 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.842 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.842 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.842 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.842 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.842 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.842 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.843 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.843 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.843 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.843 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.843 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.843 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.843 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.843 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.843 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.843 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.843 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.843 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.844 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.844 INFO:teuthology.orchestra.run.smithi059.stdout: "max_concurrent_snap_create": { 2024-09-10T21:26:51.844 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_concurrent_snap_create", 2024-09-10T21:26:51.844 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.844 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.844 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.844 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:51.844 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.844 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.844 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.844 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.844 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.844 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.845 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.845 INFO:teuthology.orchestra.run.smithi059.stdout: "mirror_snapshot_schedule": { 2024-09-10T21:26:51.845 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T21:26:51.845 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.845 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.845 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.845 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.845 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.845 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.845 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.845 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.845 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.846 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.846 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.846 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.846 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.846 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.846 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.846 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.846 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.846 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.846 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.846 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.846 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.846 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.847 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.847 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.847 INFO:teuthology.orchestra.run.smithi059.stdout: "trash_purge_schedule": { 2024-09-10T21:26:51.847 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "trash_purge_schedule", 2024-09-10T21:26:51.847 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.847 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.847 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.847 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.847 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.847 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.847 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.847 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.847 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.848 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.848 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.848 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.848 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.848 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "restful", 2024-09-10T21:26:51.848 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.848 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.848 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.848 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_auth": { 2024-09-10T21:26:51.848 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enable_auth", 2024-09-10T21:26:51.848 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.849 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.849 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.849 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.849 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.849 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.849 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.849 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.849 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.849 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.849 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.849 INFO:teuthology.orchestra.run.smithi059.stdout: "key_file": { 2024-09-10T21:26:51.849 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "key_file", 2024-09-10T21:26:51.850 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.850 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.850 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.850 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.850 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.850 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.850 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.850 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.850 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.850 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.850 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.850 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.850 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.851 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.851 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.851 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.851 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.851 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.851 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.851 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.851 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.851 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.851 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.851 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.851 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.851 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.852 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.852 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.852 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.852 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.852 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.852 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.852 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.852 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.852 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.852 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.852 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.852 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.852 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.853 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.853 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.853 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.853 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.853 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.853 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.853 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.853 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.853 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.853 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.853 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.854 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.854 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.854 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.854 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.854 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.854 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.854 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.854 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.854 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.854 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.854 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.854 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.854 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.855 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.855 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.855 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.855 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.855 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.855 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.855 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.855 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.855 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.855 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.855 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.855 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.856 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.856 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.856 INFO:teuthology.orchestra.run.smithi059.stdout: "max_requests": { 2024-09-10T21:26:51.856 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_requests", 2024-09-10T21:26:51.856 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.856 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.856 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.856 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2024-09-10T21:26:51.856 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.856 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.856 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.856 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T21:26:51.856 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.857 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.857 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.857 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2024-09-10T21:26:51.857 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2024-09-10T21:26:51.857 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.857 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.857 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.857 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.857 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.857 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.857 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.858 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.858 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.858 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.858 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.858 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2024-09-10T21:26:51.858 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2024-09-10T21:26:51.858 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.858 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.858 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.858 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.858 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.858 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.858 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.858 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.859 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.859 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.859 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.859 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.859 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.859 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.859 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.859 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.859 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.859 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.859 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.859 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.859 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.860 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.860 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.860 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.860 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.860 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.860 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rgw", 2024-09-10T21:26:51.860 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.860 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.860 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.860 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.860 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.860 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.861 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.861 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.861 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.861 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.861 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.861 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.861 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.861 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.861 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.861 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.861 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.861 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.861 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.861 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.862 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.863 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.864 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.865 INFO:teuthology.orchestra.run.smithi059.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T21:26:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T21:26:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T21:26:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T21:26:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.867 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rook", 2024-09-10T21:26:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.868 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.869 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.870 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.871 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.872 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.873 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.874 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.874 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.874 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.874 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.874 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.874 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.874 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.874 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.874 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.874 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.874 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.874 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.874 INFO:teuthology.orchestra.run.smithi059.stdout: "storage_class": { 2024-09-10T21:26:51.875 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "storage_class", 2024-09-10T21:26:51.875 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.875 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.875 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.875 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "local", 2024-09-10T21:26:51.875 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.875 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.875 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.875 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T21:26:51.875 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.875 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.875 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.875 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.875 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.876 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.876 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.876 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "selftest", 2024-09-10T21:26:51.876 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.876 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.876 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.876 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.876 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.876 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.876 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.876 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.876 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.876 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.877 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.877 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.877 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.877 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.877 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.877 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.877 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.877 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.877 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.877 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.877 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.877 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.878 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.878 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.878 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.878 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.878 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.878 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.878 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.878 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.878 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.878 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.878 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.878 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.878 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.878 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.879 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.879 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.879 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.879 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.879 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.879 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.879 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.879 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.879 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.879 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.879 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.879 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.879 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.880 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.880 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.880 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.880 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.880 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.880 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.880 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.880 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.880 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.880 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.880 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.880 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.880 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.881 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.881 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.881 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.881 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.881 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.881 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.881 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.881 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.881 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.881 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.881 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.882 INFO:teuthology.orchestra.run.smithi059.stdout: "roption1": { 2024-09-10T21:26:51.882 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "roption1", 2024-09-10T21:26:51.882 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.882 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.882 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.882 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.882 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.882 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.882 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.882 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.882 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.882 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.883 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.883 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.883 INFO:teuthology.orchestra.run.smithi059.stdout: "roption2": { 2024-09-10T21:26:51.883 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "roption2", 2024-09-10T21:26:51.883 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.883 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.883 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.883 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "xyz", 2024-09-10T21:26:51.883 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.883 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.883 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.883 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.883 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.884 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.884 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.884 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.884 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption1": { 2024-09-10T21:26:51.884 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption1", 2024-09-10T21:26:51.884 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.884 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.884 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.884 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.884 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.884 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.884 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.884 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.885 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.885 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.885 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.885 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.885 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption2": { 2024-09-10T21:26:51.885 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption2", 2024-09-10T21:26:51.885 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.885 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.885 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.885 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.885 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.885 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.885 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.885 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.886 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.886 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.886 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.886 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.886 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption3": { 2024-09-10T21:26:51.886 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption3", 2024-09-10T21:26:51.886 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:51.886 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.886 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.886 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.886 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.886 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.887 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.887 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.887 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.887 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.887 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.887 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.887 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption4": { 2024-09-10T21:26:51.887 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption4", 2024-09-10T21:26:51.887 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.887 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.887 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.887 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.887 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.887 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.888 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.888 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.888 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.888 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.888 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.888 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.888 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption5": { 2024-09-10T21:26:51.888 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption5", 2024-09-10T21:26:51.888 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.888 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.888 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.888 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.888 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.888 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.889 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.889 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.889 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.889 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.889 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.889 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.889 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption6": { 2024-09-10T21:26:51.889 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption6", 2024-09-10T21:26:51.889 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.889 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.889 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.889 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.889 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.889 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.890 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.890 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.890 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.890 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.890 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.890 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.890 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption7": { 2024-09-10T21:26:51.890 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption7", 2024-09-10T21:26:51.890 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.890 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.890 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.890 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.890 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T21:26:51.890 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "42", 2024-09-10T21:26:51.890 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.891 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.891 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.891 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.891 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.891 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.891 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.891 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.891 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.891 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.891 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.891 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.891 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.891 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.891 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.891 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.892 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.892 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.892 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.892 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.892 INFO:teuthology.orchestra.run.smithi059.stdout: "testkey": { 2024-09-10T21:26:51.892 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testkey", 2024-09-10T21:26:51.892 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.892 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.892 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.892 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.892 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.892 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.892 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.892 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.893 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.893 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.893 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.893 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.893 INFO:teuthology.orchestra.run.smithi059.stdout: "testlkey": { 2024-09-10T21:26:51.893 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testlkey", 2024-09-10T21:26:51.893 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.893 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.893 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.893 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.893 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.893 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.893 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.893 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.893 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.894 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.894 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.894 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.894 INFO:teuthology.orchestra.run.smithi059.stdout: "testnewline": { 2024-09-10T21:26:51.894 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testnewline", 2024-09-10T21:26:51.894 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.894 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.894 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.894 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.894 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.894 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.894 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.894 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.894 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.895 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.895 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.895 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.895 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.895 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.895 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.895 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smb", 2024-09-10T21:26:51.895 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.895 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.895 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.895 INFO:teuthology.orchestra.run.smithi059.stdout: "internal_store_backend": { 2024-09-10T21:26:51.895 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "internal_store_backend", 2024-09-10T21:26:51.895 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.895 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.895 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.896 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.896 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.896 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.896 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.896 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T21:26:51.896 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.896 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.896 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.896 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.896 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.896 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.896 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.896 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.896 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.897 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.897 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.897 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.897 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.897 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.897 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.897 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.897 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.897 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.897 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.897 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.897 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.897 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.898 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.898 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.898 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.898 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.898 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.898 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.898 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.898 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.898 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.898 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.898 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.898 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.898 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.898 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.898 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.899 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.899 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.899 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.899 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.899 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.899 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.899 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.899 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.899 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.899 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.899 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.899 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.899 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.899 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.899 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.899 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.900 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.900 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.900 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.900 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.900 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.900 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.900 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.900 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.900 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.900 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.900 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.900 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.900 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.900 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.901 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.901 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.901 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.901 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.901 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.901 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.901 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.901 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.901 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.901 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.901 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.901 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.901 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.901 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.901 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.902 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.902 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.902 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.902 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.902 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.902 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.902 INFO:teuthology.orchestra.run.smithi059.stdout: "update_orchestration": { 2024-09-10T21:26:51.902 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "update_orchestration", 2024-09-10T21:26:51.902 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.902 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.902 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.902 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.902 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.902 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.902 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.903 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T21:26:51.903 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.903 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.903 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.903 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.903 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.903 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.903 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.903 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snap_schedule", 2024-09-10T21:26:51.903 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.903 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.903 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.903 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_m_granularity": { 2024-09-10T21:26:51.903 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_m_granularity", 2024-09-10T21:26:51.903 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.904 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.904 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.904 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.904 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.904 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.904 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.904 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T21:26:51.904 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.904 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.904 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.904 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.904 INFO:teuthology.orchestra.run.smithi059.stdout: "dump_on_update": { 2024-09-10T21:26:51.904 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "dump_on_update", 2024-09-10T21:26:51.905 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.905 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.905 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.905 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.905 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.905 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.905 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.905 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "dump database to debug log on update", 2024-09-10T21:26:51.905 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.905 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.905 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.905 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.905 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.905 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.905 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.906 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.906 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.906 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.906 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.906 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.906 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.906 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.906 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.906 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.906 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.906 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.906 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.906 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.906 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.906 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.907 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.907 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.907 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.907 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.907 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.907 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.907 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.907 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.907 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.907 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.907 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.907 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.907 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.907 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.908 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.908 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.908 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.908 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.908 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.908 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.908 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.908 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.908 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.908 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.908 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.908 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.908 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.908 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.908 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.909 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.909 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.909 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.909 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.909 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.909 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.909 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.909 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.909 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.909 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.909 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.909 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.910 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.910 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.910 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.910 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.910 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.910 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.910 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.910 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.910 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.910 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.910 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.910 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.910 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.911 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.911 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.911 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.911 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.911 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.911 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.911 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.911 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.911 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.911 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.911 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.911 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.911 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.911 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.912 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.912 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "stats", 2024-09-10T21:26:51.912 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.912 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.912 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.912 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.912 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.912 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.912 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.912 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.912 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.912 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.912 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.913 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.913 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.913 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.913 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.913 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.913 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.913 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.913 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.913 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.913 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.913 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.913 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.914 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.914 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.914 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.914 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.914 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.914 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.914 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.914 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.914 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.914 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.914 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.914 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.914 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.914 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.915 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.915 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.915 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.915 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.915 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.915 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.915 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.915 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.915 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.915 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.915 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.915 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.915 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.915 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.916 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.916 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.916 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.916 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.916 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.916 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.916 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.916 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.916 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.916 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.916 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.916 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.916 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.917 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.917 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.917 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.917 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.917 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.917 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.917 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.917 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.917 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.917 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.917 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.917 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.917 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.918 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.918 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.918 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.918 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.918 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.918 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.918 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.918 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.918 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "status", 2024-09-10T21:26:51.918 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.918 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.918 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.918 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.919 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.919 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.919 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.919 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.919 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.919 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.919 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.919 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.919 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.919 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.919 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.919 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.919 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.920 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.920 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.920 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.920 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.920 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.920 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.920 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.920 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.920 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.920 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.920 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.920 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.921 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.921 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.921 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.921 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.921 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.921 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.921 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.921 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.921 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.921 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.921 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.921 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.922 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.922 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.922 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.922 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.922 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.922 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.922 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.922 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.922 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.922 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.922 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.922 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.922 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.923 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.923 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.923 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.923 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.923 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.923 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.923 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.923 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.923 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.923 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.923 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.923 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.924 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.924 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.924 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.924 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.924 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.924 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.924 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.924 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.924 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.924 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.924 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.924 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.925 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.925 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.925 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.925 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.925 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.925 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.925 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "telegraf", 2024-09-10T21:26:51.925 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.925 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.925 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.926 INFO:teuthology.orchestra.run.smithi059.stdout: "address": { 2024-09-10T21:26:51.926 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "address", 2024-09-10T21:26:51.926 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.926 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.926 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.926 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T21:26:51.926 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.926 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.926 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.926 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.926 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.926 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.926 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.927 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T21:26:51.927 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T21:26:51.927 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.927 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.927 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.927 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15", 2024-09-10T21:26:51.927 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.927 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.927 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.927 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.927 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.927 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.928 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.928 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.928 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.928 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.928 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.928 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.928 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.928 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.928 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.928 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.928 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.928 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.929 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.929 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.929 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.929 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.929 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.929 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.929 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.929 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.929 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.929 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.929 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.929 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.929 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.930 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.930 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.930 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.930 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.930 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.930 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.930 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.930 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.930 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.930 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.930 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.931 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.931 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.931 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.931 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.931 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.931 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.931 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.931 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.931 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.931 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.931 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.931 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.931 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.932 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.932 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.932 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.932 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.932 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.932 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.932 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.932 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.932 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.932 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.932 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.932 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.932 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.933 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.933 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.933 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.933 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.933 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.933 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.933 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.933 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.933 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.933 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.933 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.934 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.934 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.934 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.934 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.934 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.934 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.934 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.934 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.934 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.934 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "telemetry", 2024-09-10T21:26:51.934 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.934 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.935 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.935 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_basic": { 2024-09-10T21:26:51.935 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_basic", 2024-09-10T21:26:51.935 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.935 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.935 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.935 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.935 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.935 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.935 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.935 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T21:26:51.935 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.935 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.935 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.936 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_crash": { 2024-09-10T21:26:51.936 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_crash", 2024-09-10T21:26:51.936 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.936 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.936 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.936 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.936 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.936 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.936 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.936 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T21:26:51.936 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.936 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.936 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.937 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_device": { 2024-09-10T21:26:51.937 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_device", 2024-09-10T21:26:51.937 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.937 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.937 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.937 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.937 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.937 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.937 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.937 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T21:26:51.937 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.937 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.937 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.938 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_ident": { 2024-09-10T21:26:51.938 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_ident", 2024-09-10T21:26:51.938 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.938 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.938 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.938 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.938 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.938 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.938 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.938 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T21:26:51.938 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.938 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.939 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.939 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_perf": { 2024-09-10T21:26:51.939 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_perf", 2024-09-10T21:26:51.939 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.939 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.939 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.939 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.939 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.939 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.939 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.939 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T21:26:51.939 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.939 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.940 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.940 INFO:teuthology.orchestra.run.smithi059.stdout: "contact": { 2024-09-10T21:26:51.940 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "contact", 2024-09-10T21:26:51.940 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.940 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.940 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.940 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.940 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.940 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.940 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.940 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.940 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.941 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.941 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.941 INFO:teuthology.orchestra.run.smithi059.stdout: "description": { 2024-09-10T21:26:51.941 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "description", 2024-09-10T21:26:51.941 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.941 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.941 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.941 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.941 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.941 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.941 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.941 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.941 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.942 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.942 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.942 INFO:teuthology.orchestra.run.smithi059.stdout: "device_url": { 2024-09-10T21:26:51.942 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_url", 2024-09-10T21:26:51.942 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.942 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.942 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.942 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T21:26:51.942 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.942 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.942 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.942 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.942 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.943 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.943 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.943 INFO:teuthology.orchestra.run.smithi059.stdout: "enabled": { 2024-09-10T21:26:51.943 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enabled", 2024-09-10T21:26:51.943 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.943 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.943 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.943 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.943 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.943 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.943 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.943 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.943 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.944 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.944 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.944 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T21:26:51.944 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T21:26:51.944 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.944 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.944 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.944 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "24", 2024-09-10T21:26:51.944 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "8", 2024-09-10T21:26:51.944 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.944 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.944 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.945 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.945 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.945 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.945 INFO:teuthology.orchestra.run.smithi059.stdout: "last_opt_revision": { 2024-09-10T21:26:51.945 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "last_opt_revision", 2024-09-10T21:26:51.945 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.945 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.945 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.945 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1", 2024-09-10T21:26:51.945 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.945 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.945 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.945 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.946 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.946 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.946 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.946 INFO:teuthology.orchestra.run.smithi059.stdout: "leaderboard": { 2024-09-10T21:26:51.946 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "leaderboard", 2024-09-10T21:26:51.946 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.946 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.946 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.946 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.946 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.946 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.946 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.946 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.946 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.947 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.947 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.947 INFO:teuthology.orchestra.run.smithi059.stdout: "leaderboard_description": { 2024-09-10T21:26:51.947 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "leaderboard_description", 2024-09-10T21:26:51.947 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.947 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.947 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.947 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.947 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.947 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.947 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.947 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.947 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.948 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.948 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.948 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.948 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.948 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.948 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.948 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.948 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.948 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.948 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.948 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.948 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.948 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.949 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.949 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.949 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.949 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.949 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.949 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.949 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.949 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.949 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.949 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.949 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.949 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.949 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.949 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.950 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.950 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.950 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.950 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.950 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.950 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.950 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.950 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.950 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.950 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.950 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.950 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.950 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.950 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.951 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.951 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.951 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.951 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.951 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.951 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.951 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.951 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.951 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.951 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.951 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.951 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.951 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.951 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.952 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.952 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.952 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.952 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.952 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.952 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.952 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.952 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.952 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.952 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.952 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.952 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.952 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.953 INFO:teuthology.orchestra.run.smithi059.stdout: "organization": { 2024-09-10T21:26:51.953 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "organization", 2024-09-10T21:26:51.953 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.953 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.953 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.953 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.953 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.953 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.953 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.953 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.953 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.953 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.953 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.954 INFO:teuthology.orchestra.run.smithi059.stdout: "proxy": { 2024-09-10T21:26:51.954 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "proxy", 2024-09-10T21:26:51.954 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.954 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.954 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.954 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.954 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.954 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.954 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.954 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.954 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.954 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.954 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.955 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.955 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.955 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.955 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.955 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.955 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.955 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.955 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.955 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.955 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.955 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.955 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.955 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.955 INFO:teuthology.orchestra.run.smithi059.stdout: "url": { 2024-09-10T21:26:51.956 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "url", 2024-09-10T21:26:51.956 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.956 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.956 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.956 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T21:26:51.956 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.956 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.956 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.956 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.956 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.956 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.956 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.956 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.956 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.957 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "test_orchestrator", 2024-09-10T21:26:51.957 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.957 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.957 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.957 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.957 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.957 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.957 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.957 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.957 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.957 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.957 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.958 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.958 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.958 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.958 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.958 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.958 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.958 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.958 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.958 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.958 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.958 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.958 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.958 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.958 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.959 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.959 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.959 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.959 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.959 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.959 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.959 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.959 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.959 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.959 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.959 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.959 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.959 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.959 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.959 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.960 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.960 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.960 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.960 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.960 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.960 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.960 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.960 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.960 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.960 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.960 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.960 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.960 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.960 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.960 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.961 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.961 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.961 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.961 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.961 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.961 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.961 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.961 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.961 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.961 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.961 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.961 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.962 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.962 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.962 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.962 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.962 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.962 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.962 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.962 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.962 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.962 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.962 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.962 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.962 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.963 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.963 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.963 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.963 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.963 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "volumes", 2024-09-10T21:26:51.963 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.963 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.963 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.963 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.963 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.963 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.963 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.963 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.964 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.964 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.964 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.964 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.964 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.964 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.964 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.964 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.964 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.964 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.964 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.964 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.964 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.964 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.964 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.965 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.965 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.965 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.965 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.965 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.965 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.965 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.965 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.965 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.965 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.965 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.965 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.966 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.966 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.966 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.966 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.966 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.966 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.966 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.966 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.966 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.966 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.966 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.966 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.966 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.966 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.966 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.967 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.967 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.967 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.967 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.967 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.967 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.967 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.967 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.967 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.967 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.967 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.967 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.967 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.967 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.968 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.968 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.968 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.968 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.968 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.968 INFO:teuthology.orchestra.run.smithi059.stdout: "max_concurrent_clones": { 2024-09-10T21:26:51.968 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_concurrent_clones", 2024-09-10T21:26:51.968 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.968 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.968 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.968 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "4", 2024-09-10T21:26:51.968 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.968 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.969 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.969 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T21:26:51.969 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.969 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.969 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.969 INFO:teuthology.orchestra.run.smithi059.stdout: "periodic_async_work": { 2024-09-10T21:26:51.969 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "periodic_async_work", 2024-09-10T21:26:51.969 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.969 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.969 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.969 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.969 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.970 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.970 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.970 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Periodically check for async work", 2024-09-10T21:26:51.970 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.970 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.970 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.970 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot_clone_delay": { 2024-09-10T21:26:51.970 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snapshot_clone_delay", 2024-09-10T21:26:51.970 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.970 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.970 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.970 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.970 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.970 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.971 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.971 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T21:26:51.971 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.971 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.971 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.971 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot_clone_no_wait": { 2024-09-10T21:26:51.971 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T21:26:51.971 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.971 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.971 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.971 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:51.971 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.971 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.972 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.972 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T21:26:51.972 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.972 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.972 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.972 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.972 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.972 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.972 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.972 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.972 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.972 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.973 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.973 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.973 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.973 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.973 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.973 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.973 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.973 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.973 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix", 2024-09-10T21:26:51.973 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.973 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.973 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.974 INFO:teuthology.orchestra.run.smithi059.stdout: "discovery_interval": { 2024-09-10T21:26:51.974 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "discovery_interval", 2024-09-10T21:26:51.974 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T21:26:51.974 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.974 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.974 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "100", 2024-09-10T21:26:51.974 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.974 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.974 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.974 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.974 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.974 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.974 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.975 INFO:teuthology.orchestra.run.smithi059.stdout: "identifier": { 2024-09-10T21:26:51.975 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "identifier", 2024-09-10T21:26:51.975 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.975 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.975 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.975 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.975 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.975 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.975 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.975 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.975 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.975 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.975 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.975 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T21:26:51.976 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T21:26:51.976 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.976 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.976 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.976 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T21:26:51.976 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.976 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.976 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.976 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.976 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.976 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.976 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.977 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.977 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.977 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.977 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.977 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.977 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.977 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.977 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.977 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.977 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.977 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.977 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.977 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.978 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.978 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.978 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.978 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.978 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.978 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.978 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.978 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.978 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.978 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.978 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.978 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.979 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.979 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.979 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.979 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.979 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.979 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.979 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.979 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.979 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.979 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.979 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.979 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.980 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.980 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.980 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.980 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.980 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.980 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.980 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.980 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.980 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.980 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.980 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.980 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.981 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.981 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.981 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.981 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.981 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.981 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.981 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.981 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.981 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.981 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.981 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.981 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.982 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.982 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.982 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.982 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.982 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.982 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:51.982 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:51.982 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.982 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:51.982 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.982 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:51.982 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.983 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.983 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.983 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.983 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.983 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.983 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.983 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_host": { 2024-09-10T21:26:51.983 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_host", 2024-09-10T21:26:51.983 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.983 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.983 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.983 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.983 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.984 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.984 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.984 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.984 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.984 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.984 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.984 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_port": { 2024-09-10T21:26:51.984 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_port", 2024-09-10T21:26:51.984 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.984 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.984 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.985 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10051", 2024-09-10T21:26:51.985 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.985 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.985 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.985 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.985 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.985 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.985 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.985 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_sender": { 2024-09-10T21:26:51.985 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_sender", 2024-09-10T21:26:51.985 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.985 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T21:26:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.986 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T21:26:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: "modules": [ 2024-09-10T21:26:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm", 2024-09-10T21:26:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: "dashboard", 2024-09-10T21:26:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: "iostat", 2024-09-10T21:26:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: "nfs", 2024-09-10T21:26:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: "restful" 2024-09-10T21:26:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: "available_modules": [ 2024-09-10T21:26:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "alerts", 2024-09-10T21:26:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:51.987 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T21:26:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T21:26:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T21:26:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T21:26:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.988 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.989 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.990 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.991 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.992 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:51.993 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_destination": { 2024-09-10T21:26:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_destination", 2024-09-10T21:26:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T21:26:51.994 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_from_name": { 2024-09-10T21:26:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_from_name", 2024-09-10T21:26:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "Ceph", 2024-09-10T21:26:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.995 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Email From: name", 2024-09-10T21:26:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_host": { 2024-09-10T21:26:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_host", 2024-09-10T21:26:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP server", 2024-09-10T21:26:51.996 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_password": { 2024-09-10T21:26:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_password", 2024-09-10T21:26:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Password to authenticate with", 2024-09-10T21:26:51.997 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_port": { 2024-09-10T21:26:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_port", 2024-09-10T21:26:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "465", 2024-09-10T21:26:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP port", 2024-09-10T21:26:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.998 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_sender": { 2024-09-10T21:26:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_sender", 2024-09-10T21:26:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SMTP envelope sender", 2024-09-10T21:26:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:51.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_ssl": { 2024-09-10T21:26:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_ssl", 2024-09-10T21:26:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T21:26:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.000 INFO:teuthology.orchestra.run.smithi059.stdout: "smtp_user": { 2024-09-10T21:26:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smtp_user", 2024-09-10T21:26:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "User to authenticate as", 2024-09-10T21:26:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "balancer", 2024-09-10T21:26:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "active": { 2024-09-10T21:26:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "active", 2024-09-10T21:26:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T21:26:52.003 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "begin_time": { 2024-09-10T21:26:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "begin_time", 2024-09-10T21:26:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0000", 2024-09-10T21:26:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T21:26:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T21:26:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: "begin_weekday": { 2024-09-10T21:26:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "begin_weekday", 2024-09-10T21:26:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T21:26:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0", 2024-09-10T21:26:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "6", 2024-09-10T21:26:52.005 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T21:26:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T21:26:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_max_iterations": { 2024-09-10T21:26:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_max_iterations", 2024-09-10T21:26:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T21:26:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "25", 2024-09-10T21:26:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T21:26:52.006 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "250", 2024-09-10T21:26:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T21:26:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_metrics": { 2024-09-10T21:26:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_metrics", 2024-09-10T21:26:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T21:26:52.007 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T21:26:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T21:26:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_compat_step": { 2024-09-10T21:26:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crush_compat_step", 2024-09-10T21:26:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.008 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0.5", 2024-09-10T21:26:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0.001", 2024-09-10T21:26:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "0.999", 2024-09-10T21:26:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "aggressiveness of optimization", 2024-09-10T21:26:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T21:26:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "end_time": { 2024-09-10T21:26:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "end_time", 2024-09-10T21:26:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.009 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "2359", 2024-09-10T21:26:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T21:26:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T21:26:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "end_weekday": { 2024-09-10T21:26:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "end_weekday", 2024-09-10T21:26:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T21:26:52.010 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "0", 2024-09-10T21:26:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "6", 2024-09-10T21:26:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T21:26:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T21:26:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.011 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.012 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.013 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.014 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.015 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "min_score": { 2024-09-10T21:26:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "min_score", 2024-09-10T21:26:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T21:26:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.017 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": { 2024-09-10T21:26:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mode", 2024-09-10T21:26:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "upmap", 2024-09-10T21:26:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "crush-compat", 2024-09-10T21:26:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "none", 2024-09-10T21:26:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "read", 2024-09-10T21:26:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap", 2024-09-10T21:26:52.018 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap-read" 2024-09-10T21:26:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Balancer mode", 2024-09-10T21:26:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_ids": { 2024-09-10T21:26:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pool_ids", 2024-09-10T21:26:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.019 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T21:26:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T21:26:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T21:26:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T21:26:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.020 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T21:26:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.021 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap_max_deviation": { 2024-09-10T21:26:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "upmap_max_deviation", 2024-09-10T21:26:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T21:26:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T21:26:52.022 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T21:26:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T21:26:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: "upmap_max_optimizations": { 2024-09-10T21:26:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "upmap_max_optimizations", 2024-09-10T21:26:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T21:26:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.023 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T21:26:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephadm", 2024-09-10T21:26:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_down_multiplier": { 2024-09-10T21:26:52.024 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_down_multiplier", 2024-09-10T21:26:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3.0", 2024-09-10T21:26:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T21:26:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_refresh_rate": { 2024-09-10T21:26:52.025 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_refresh_rate", 2024-09-10T21:26:52.026 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:52.026 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.026 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.026 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "20", 2024-09-10T21:26:52.026 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.026 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.026 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.026 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T21:26:52.026 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.026 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.026 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.026 INFO:teuthology.orchestra.run.smithi059.stdout: "agent_starting_port": { 2024-09-10T21:26:52.026 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "agent_starting_port", 2024-09-10T21:26:52.026 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "4721", 2024-09-10T21:26:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T21:26:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_ptrace": { 2024-09-10T21:26:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_ptrace", 2024-09-10T21:26:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.027 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T21:26:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T21:26:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "autotune_interval": { 2024-09-10T21:26:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "autotune_interval", 2024-09-10T21:26:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.028 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T21:26:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T21:26:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "autotune_memory_target_ratio": { 2024-09-10T21:26:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T21:26:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.029 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0.7", 2024-09-10T21:26:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T21:26:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm_log_destination": { 2024-09-10T21:26:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cephadm_log_destination", 2024-09-10T21:26:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.030 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "file", 2024-09-10T21:26:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "file,syslog", 2024-09-10T21:26:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "syslog" 2024-09-10T21:26:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T21:26:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "cgroups_split": { 2024-09-10T21:26:52.031 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cgroups_split", 2024-09-10T21:26:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T21:26:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: "config_checks_enabled": { 2024-09-10T21:26:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_checks_enabled", 2024-09-10T21:26:52.032 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.033 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.033 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.033 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.033 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.033 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.033 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.033 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T21:26:52.033 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.033 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.033 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.033 INFO:teuthology.orchestra.run.smithi059.stdout: "config_dashboard": { 2024-09-10T21:26:52.033 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_dashboard", 2024-09-10T21:26:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T21:26:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_alertmanager": { 2024-09-10T21:26:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_alertmanager", 2024-09-10T21:26:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T21:26:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T21:26:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.035 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_base": { 2024-09-10T21:26:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_base", 2024-09-10T21:26:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T21:26:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Container image name, without the tag", 2024-09-10T21:26:52.036 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_elasticsearch": { 2024-09-10T21:26:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_elasticsearch", 2024-09-10T21:26:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T21:26:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.037 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "elasticsearch container image", 2024-09-10T21:26:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_grafana": { 2024-09-10T21:26:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_grafana", 2024-09-10T21:26:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T21:26:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.038 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T21:26:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_haproxy": { 2024-09-10T21:26:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_haproxy", 2024-09-10T21:26:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T21:26:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.039 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "HAproxy container image", 2024-09-10T21:26:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_agent": { 2024-09-10T21:26:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_agent", 2024-09-10T21:26:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T21:26:52.040 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger agent container image", 2024-09-10T21:26:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_collector": { 2024-09-10T21:26:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_collector", 2024-09-10T21:26:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.041 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T21:26:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger collector container image", 2024-09-10T21:26:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_jaeger_query": { 2024-09-10T21:26:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_jaeger_query", 2024-09-10T21:26:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T21:26:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Jaeger query container image", 2024-09-10T21:26:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_keepalived": { 2024-09-10T21:26:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_keepalived", 2024-09-10T21:26:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.043 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T21:26:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Keepalived container image", 2024-09-10T21:26:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_loki": { 2024-09-10T21:26:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_loki", 2024-09-10T21:26:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.044 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T21:26:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Loki container image", 2024-09-10T21:26:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_nginx": { 2024-09-10T21:26:52.045 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_nginx", 2024-09-10T21:26:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T21:26:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Nginx container image", 2024-09-10T21:26:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_node_exporter": { 2024-09-10T21:26:52.046 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_node_exporter", 2024-09-10T21:26:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T21:26:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T21:26:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_nvmeof": { 2024-09-10T21:26:52.047 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_nvmeof", 2024-09-10T21:26:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T21:26:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Nvme-of container image", 2024-09-10T21:26:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_oauth2_proxy": { 2024-09-10T21:26:52.048 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T21:26:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T21:26:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "oauth2-proxy container image", 2024-09-10T21:26:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_prometheus": { 2024-09-10T21:26:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_prometheus", 2024-09-10T21:26:52.049 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T21:26:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Prometheus container image", 2024-09-10T21:26:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_promtail": { 2024-09-10T21:26:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_promtail", 2024-09-10T21:26:52.050 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T21:26:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Promtail container image", 2024-09-10T21:26:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_samba": { 2024-09-10T21:26:52.051 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_samba", 2024-09-10T21:26:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T21:26:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Samba/SMB container image", 2024-09-10T21:26:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_samba_metrics": { 2024-09-10T21:26:52.052 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_samba_metrics", 2024-09-10T21:26:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T21:26:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T21:26:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.053 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image_snmp_gateway": { 2024-09-10T21:26:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_image_snmp_gateway", 2024-09-10T21:26:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T21:26:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "SNMP Gateway container image", 2024-09-10T21:26:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.054 INFO:teuthology.orchestra.run.smithi059.stdout: "container_init": { 2024-09-10T21:26:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "container_init", 2024-09-10T21:26:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T21:26:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "daemon_cache_timeout": { 2024-09-10T21:26:52.055 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "daemon_cache_timeout", 2024-09-10T21:26:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T21:26:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T21:26:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.056 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "default_cephadm_command_timeout": { 2024-09-10T21:26:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T21:26:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "900", 2024-09-10T21:26:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T21:26:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.057 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "default_registry": { 2024-09-10T21:26:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "default_registry", 2024-09-10T21:26:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "docker.io", 2024-09-10T21:26:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T21:26:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.058 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "device_cache_timeout": { 2024-09-10T21:26:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_cache_timeout", 2024-09-10T21:26:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1800", 2024-09-10T21:26:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache device inventory", 2024-09-10T21:26:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.059 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "device_enhanced_scan": { 2024-09-10T21:26:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_enhanced_scan", 2024-09-10T21:26:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T21:26:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.060 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "facts_cache_timeout": { 2024-09-10T21:26:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "facts_cache_timeout", 2024-09-10T21:26:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T21:26:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "seconds to cache host facts data", 2024-09-10T21:26:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.061 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "grafana_dashboards_path": { 2024-09-10T21:26:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "grafana_dashboards_path", 2024-09-10T21:26:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T21:26:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T21:26:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.062 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "host_check_interval": { 2024-09-10T21:26:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "host_check_interval", 2024-09-10T21:26:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T21:26:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to perform a host check", 2024-09-10T21:26:52.063 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "hw_monitoring": { 2024-09-10T21:26:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "hw_monitoring", 2024-09-10T21:26:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.064 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T21:26:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: "inventory_list_all": { 2024-09-10T21:26:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "inventory_list_all", 2024-09-10T21:26:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.065 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T21:26:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.066 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.067 INFO:teuthology.orchestra.run.smithi059.stdout: "log_refresh_metadata": { 2024-09-10T21:26:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_refresh_metadata", 2024-09-10T21:26:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T21:26:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.068 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T21:26:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.069 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.070 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.071 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T21:26:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T21:26:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.072 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T21:26:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T21:26:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T21:26:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "*", 2024-09-10T21:26:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.073 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T21:26:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "max_count_per_host": { 2024-09-10T21:26:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_count_per_host", 2024-09-10T21:26:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.074 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "max number of daemons per service per host", 2024-09-10T21:26:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "max_osd_draining_count": { 2024-09-10T21:26:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_osd_draining_count", 2024-09-10T21:26:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.075 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T21:26:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "migration_current": { 2024-09-10T21:26:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "migration_current", 2024-09-10T21:26:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.076 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "internal - do not modify", 2024-09-10T21:26:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": { 2024-09-10T21:26:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mode", 2024-09-10T21:26:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.077 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "root", 2024-09-10T21:26:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm-package", 2024-09-10T21:26:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "root" 2024-09-10T21:26:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T21:26:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "oob_default_addr": { 2024-09-10T21:26:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "oob_default_addr", 2024-09-10T21:26:52.078 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "169.254.1.1", 2024-09-10T21:26:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T21:26:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "prometheus_alerts_path": { 2024-09-10T21:26:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prometheus_alerts_path", 2024-09-10T21:26:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.079 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T21:26:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T21:26:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_insecure": { 2024-09-10T21:26:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_insecure", 2024-09-10T21:26:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T21:26:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_password": { 2024-09-10T21:26:52.081 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_password", 2024-09-10T21:26:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T21:26:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_url": { 2024-09-10T21:26:52.082 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_url", 2024-09-10T21:26:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T21:26:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "registry_username": { 2024-09-10T21:26:52.083 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "registry_username", 2024-09-10T21:26:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T21:26:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.084 INFO:teuthology.orchestra.run.smithi059.stdout: "secure_monitoring_stack": { 2024-09-10T21:26:52.085 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "secure_monitoring_stack", 2024-09-10T21:26:52.085 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.085 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.085 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.085 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.085 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.085 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.085 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.085 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T21:26:52.085 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.085 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.085 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.085 INFO:teuthology.orchestra.run.smithi059.stdout: "service_discovery_port": { 2024-09-10T21:26:52.085 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "service_discovery_port", 2024-09-10T21:26:52.086 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.086 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.086 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.086 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8765", 2024-09-10T21:26:52.086 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.086 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.086 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.086 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "cephadm service discovery port", 2024-09-10T21:26:52.086 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.086 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.086 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.086 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.086 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.087 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.087 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.087 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.087 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.087 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.087 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.087 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.087 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.087 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.087 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.087 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.087 INFO:teuthology.orchestra.run.smithi059.stdout: "ssh_config_file": { 2024-09-10T21:26:52.087 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssh_config_file", 2024-09-10T21:26:52.087 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.088 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.088 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.088 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.088 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.088 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.088 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.088 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T21:26:52.088 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.088 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.088 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.088 INFO:teuthology.orchestra.run.smithi059.stdout: "use_agent": { 2024-09-10T21:26:52.088 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "use_agent", 2024-09-10T21:26:52.088 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.088 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.089 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.089 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.089 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.089 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.089 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.089 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T21:26:52.089 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.089 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.089 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.089 INFO:teuthology.orchestra.run.smithi059.stdout: "use_repo_digest": { 2024-09-10T21:26:52.089 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "use_repo_digest", 2024-09-10T21:26:52.089 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.089 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.089 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.090 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.090 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.090 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.090 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.090 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T21:26:52.090 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.090 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.090 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.090 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_failed_host_check": { 2024-09-10T21:26:52.090 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_failed_host_check", 2024-09-10T21:26:52.090 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.090 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.091 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.091 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.091 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.091 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.091 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.091 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T21:26:52.091 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.091 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.091 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.091 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_stray_daemons": { 2024-09-10T21:26:52.091 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_stray_daemons", 2024-09-10T21:26:52.091 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.092 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.092 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.092 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.092 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.092 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.092 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.092 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T21:26:52.092 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.092 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.092 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.092 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_on_stray_hosts": { 2024-09-10T21:26:52.092 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_on_stray_hosts", 2024-09-10T21:26:52.092 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.093 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.093 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.093 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.093 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.093 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.093 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.093 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T21:26:52.093 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.093 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.093 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.093 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.093 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.094 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crash", 2024-09-10T21:26:52.094 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.094 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.094 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.094 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.094 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.094 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.094 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.094 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.094 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.094 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.094 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.095 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.095 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.095 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.095 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.095 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.095 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.095 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.095 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.095 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.095 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.095 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.095 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.095 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.095 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.096 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.096 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.096 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.096 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.096 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.096 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.096 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.096 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.096 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.096 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.096 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.096 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.096 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.096 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.097 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.097 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.097 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.097 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.097 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.097 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.097 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.097 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.097 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.097 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.097 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.097 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.097 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.097 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.097 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.098 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.098 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.098 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.098 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.098 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.098 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.098 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.098 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.098 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.098 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.098 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.098 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.098 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.098 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.098 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.099 INFO:teuthology.orchestra.run.smithi059.stdout: "retain_interval": { 2024-09-10T21:26:52.099 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "retain_interval", 2024-09-10T21:26:52.099 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:52.099 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.099 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.099 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "31536000", 2024-09-10T21:26:52.099 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.099 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.099 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.099 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T21:26:52.099 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.099 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.099 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.100 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.100 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.100 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.100 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.100 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.100 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.100 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.100 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.100 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.100 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.100 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.100 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.100 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.100 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_recent_interval": { 2024-09-10T21:26:52.101 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_recent_interval", 2024-09-10T21:26:52.101 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:52.101 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.101 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.101 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1209600", 2024-09-10T21:26:52.101 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.101 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.101 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.101 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T21:26:52.101 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.101 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.101 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.102 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.102 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.102 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "dashboard", 2024-09-10T21:26:52.102 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.102 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.102 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.102 INFO:teuthology.orchestra.run.smithi059.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T21:26:52.102 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T21:26:52.102 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.102 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.103 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.103 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:52.103 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.103 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.103 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.103 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.103 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.103 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.103 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.103 INFO:teuthology.orchestra.run.smithi059.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T21:26:52.103 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T21:26:52.103 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.104 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.104 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.104 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.104 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.104 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.104 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.104 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.104 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.104 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.104 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.104 INFO:teuthology.orchestra.run.smithi059.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T21:26:52.105 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T21:26:52.105 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.105 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.105 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.105 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.105 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.105 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.105 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.105 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.105 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.105 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.105 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.106 INFO:teuthology.orchestra.run.smithi059.stdout: "AUDIT_API_ENABLED": { 2024-09-10T21:26:52.106 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T21:26:52.106 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.106 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.106 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.106 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.106 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.106 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.106 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.106 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.106 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.107 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.107 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.107 INFO:teuthology.orchestra.run.smithi059.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T21:26:52.107 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T21:26:52.107 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.107 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.107 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.107 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.107 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.107 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.107 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.108 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.108 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.108 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.108 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.108 INFO:teuthology.orchestra.run.smithi059.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T21:26:52.108 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T21:26:52.108 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.108 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.108 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.108 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.108 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.109 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.109 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.109 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.109 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.109 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.109 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.109 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T21:26:52.109 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T21:26:52.109 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.109 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.109 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.109 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.109 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.110 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.110 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.110 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.110 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.110 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.110 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.110 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T21:26:52.110 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T21:26:52.110 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.110 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.110 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.110 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.110 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.111 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.111 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.111 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.111 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.111 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.111 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.111 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T21:26:52.111 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T21:26:52.111 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.111 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.111 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.111 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.112 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.112 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.112 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.112 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.112 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.112 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.112 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.112 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T21:26:52.112 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T21:26:52.112 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.112 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.112 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.112 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.113 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.113 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.113 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.113 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.113 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.113 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.113 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.113 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T21:26:52.113 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T21:26:52.113 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.113 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.113 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.114 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.114 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.114 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.114 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.114 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.114 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.114 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.114 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.114 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T21:26:52.114 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T21:26:52.114 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.115 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.115 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.115 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.115 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.115 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.115 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.115 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.115 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.115 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.115 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.115 INFO:teuthology.orchestra.run.smithi059.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T21:26:52.115 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T21:26:52.116 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.116 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.116 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.116 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.116 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.116 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.116 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.116 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.116 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.116 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.116 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.116 INFO:teuthology.orchestra.run.smithi059.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T21:26:52.116 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T21:26:52.117 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.117 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.117 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.117 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.117 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.117 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.117 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.117 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.117 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.117 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.117 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.117 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T21:26:52.118 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T21:26:52.118 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.118 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.118 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.118 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2024-09-10T21:26:52.118 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.118 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.118 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.118 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.118 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.118 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.118 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.118 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T21:26:52.119 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T21:26:52.119 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.119 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.119 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.119 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.119 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.119 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.119 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.119 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.119 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.119 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.119 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.120 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_URL": { 2024-09-10T21:26:52.120 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_URL", 2024-09-10T21:26:52.120 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.120 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.120 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.120 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.120 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.120 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.120 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.120 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.120 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.120 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.120 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.121 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T21:26:52.121 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T21:26:52.121 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.121 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.121 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.121 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2024-09-10T21:26:52.121 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.121 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.121 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.121 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.121 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.121 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.122 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.122 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T21:26:52.122 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T21:26:52.122 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.122 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.122 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.122 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.122 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.122 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.122 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.122 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.122 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.122 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.123 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.123 INFO:teuthology.orchestra.run.smithi059.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T21:26:52.123 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T21:26:52.123 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.123 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.123 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.123 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.123 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.123 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.123 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.123 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.123 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.124 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.124 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.124 INFO:teuthology.orchestra.run.smithi059.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T21:26:52.124 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T21:26:52.124 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.124 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.124 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.124 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.124 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.124 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.124 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.124 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.125 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.125 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.125 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.125 INFO:teuthology.orchestra.run.smithi059.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T21:26:52.125 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T21:26:52.125 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.125 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.125 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.125 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.125 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.125 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.125 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.126 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.126 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.126 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.126 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.126 INFO:teuthology.orchestra.run.smithi059.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T21:26:52.126 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T21:26:52.126 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.126 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.126 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.126 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "[]", 2024-09-10T21:26:52.126 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.126 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.126 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.126 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.127 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.127 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.127 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.127 INFO:teuthology.orchestra.run.smithi059.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T21:26:52.127 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T21:26:52.127 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.127 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.127 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.127 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "{}", 2024-09-10T21:26:52.127 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.127 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.127 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.127 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.127 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.127 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.128 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.128 INFO:teuthology.orchestra.run.smithi059.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T21:26:52.128 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T21:26:52.128 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.128 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.128 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.128 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.128 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.128 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.128 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.128 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.128 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.128 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.129 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.129 INFO:teuthology.orchestra.run.smithi059.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T21:26:52.129 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T21:26:52.129 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.129 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.129 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.129 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.129 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.129 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.129 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.129 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.129 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.129 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.129 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.130 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T21:26:52.130 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T21:26:52.130 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.130 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.130 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.130 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.130 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.130 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.130 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.130 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.130 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.130 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.131 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.131 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T21:26:52.131 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T21:26:52.131 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.131 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.131 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.131 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.131 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.131 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.131 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.131 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.131 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.132 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.132 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.132 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T21:26:52.132 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T21:26:52.132 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.132 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.132 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.132 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.132 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.132 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.132 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.132 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.133 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.133 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.133 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.133 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T21:26:52.133 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T21:26:52.133 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.133 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.133 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.133 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.133 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.133 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.133 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.133 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.134 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.134 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.134 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.134 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T21:26:52.134 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T21:26:52.134 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.134 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.134 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.134 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.134 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.134 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.134 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.135 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.135 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.135 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.135 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.135 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T21:26:52.135 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T21:26:52.135 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.135 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.135 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.135 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.135 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.135 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.136 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.136 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.136 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.136 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.136 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.136 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T21:26:52.136 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T21:26:52.136 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.136 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.136 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.136 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.136 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.137 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.137 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.137 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.137 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.137 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.137 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.137 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T21:26:52.137 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T21:26:52.137 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.137 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.137 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.137 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.138 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.138 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.138 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.138 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.138 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.138 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.138 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.138 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T21:26:52.138 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T21:26:52.138 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.138 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.138 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.138 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T21:26:52.139 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.139 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.139 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.139 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.139 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.139 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.139 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.139 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T21:26:52.139 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T21:26:52.139 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.139 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.140 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.140 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:52.140 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.140 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.140 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.140 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.140 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.140 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.140 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.140 INFO:teuthology.orchestra.run.smithi059.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T21:26:52.140 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T21:26:52.140 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.140 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.141 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.141 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8", 2024-09-10T21:26:52.141 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.141 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.141 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.141 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.141 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.141 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.141 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.141 INFO:teuthology.orchestra.run.smithi059.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T21:26:52.141 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T21:26:52.141 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.141 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.142 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.142 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "45", 2024-09-10T21:26:52.142 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.142 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.142 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.142 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.142 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.142 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.142 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.142 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T21:26:52.142 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T21:26:52.142 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.143 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.143 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.143 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.143 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.143 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.143 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.143 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.143 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.143 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.143 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.143 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T21:26:52.143 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T21:26:52.143 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.143 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.144 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.144 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "admin", 2024-09-10T21:26:52.144 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.144 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.144 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.144 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.144 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.144 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.144 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.144 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T21:26:52.144 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T21:26:52.144 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.145 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.145 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.145 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.145 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.145 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.145 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.145 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.145 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.145 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.145 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.145 INFO:teuthology.orchestra.run.smithi059.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T21:26:52.145 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T21:26:52.145 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.145 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.146 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.146 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.146 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.146 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.146 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.146 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.146 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.146 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.146 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.146 INFO:teuthology.orchestra.run.smithi059.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T21:26:52.146 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T21:26:52.146 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.146 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.146 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.147 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.147 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.147 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.147 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.147 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.147 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.147 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.147 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.147 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T21:26:52.147 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T21:26:52.147 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.147 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.147 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.147 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.147 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.148 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.148 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.148 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.148 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.148 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.148 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.148 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T21:26:52.148 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T21:26:52.148 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.148 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.148 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.148 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:52.148 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.148 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.149 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.149 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.149 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.149 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.149 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.149 INFO:teuthology.orchestra.run.smithi059.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T21:26:52.149 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T21:26:52.149 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.149 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.149 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.149 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T21:26:52.149 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.149 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.150 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.150 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.150 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.150 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.150 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.150 INFO:teuthology.orchestra.run.smithi059.stdout: "cross_origin_url": { 2024-09-10T21:26:52.150 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cross_origin_url", 2024-09-10T21:26:52.150 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.150 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.150 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.150 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.150 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.150 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.150 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.151 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.151 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.151 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.151 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.151 INFO:teuthology.orchestra.run.smithi059.stdout: "crt_file": { 2024-09-10T21:26:52.151 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "crt_file", 2024-09-10T21:26:52.151 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.151 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.151 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.151 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.151 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.151 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.152 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.152 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.152 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.152 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.152 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.152 INFO:teuthology.orchestra.run.smithi059.stdout: "debug": { 2024-09-10T21:26:52.152 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "debug", 2024-09-10T21:26:52.152 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.152 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.152 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.152 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.152 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.152 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.153 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.153 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Enable/disable debug options", 2024-09-10T21:26:52.153 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.153 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.153 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.153 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.153 INFO:teuthology.orchestra.run.smithi059.stdout: "jwt_token_ttl": { 2024-09-10T21:26:52.153 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "jwt_token_ttl", 2024-09-10T21:26:52.153 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.153 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.153 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.153 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "28800", 2024-09-10T21:26:52.153 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.154 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.154 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.154 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.154 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.154 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.154 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.154 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.154 INFO:teuthology.orchestra.run.smithi059.stdout: "key_file": { 2024-09-10T21:26:52.154 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "key_file", 2024-09-10T21:26:52.154 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.154 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.154 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.154 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.155 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.155 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.155 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.155 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.155 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.155 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.155 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.155 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.155 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.155 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.155 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.155 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.155 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.156 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.156 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.156 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.156 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.156 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.156 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.156 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.156 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.156 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.156 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.156 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.156 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.156 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.156 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.157 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.157 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.157 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.157 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.157 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.157 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.157 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.157 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.157 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.157 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.157 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.157 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.157 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.158 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.158 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.158 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.158 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.158 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.158 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.158 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.158 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.158 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.158 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.158 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.158 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.158 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.158 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.159 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.159 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.159 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.159 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.159 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.159 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.159 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.159 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.159 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.159 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.159 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.159 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.159 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.159 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.159 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.160 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.160 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.160 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.160 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.160 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.160 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.160 INFO:teuthology.orchestra.run.smithi059.stdout: "motd": { 2024-09-10T21:26:52.160 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "motd", 2024-09-10T21:26:52.160 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.160 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.160 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.160 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.160 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.161 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.161 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.161 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "The message of the day", 2024-09-10T21:26:52.161 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.161 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.161 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.161 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.161 INFO:teuthology.orchestra.run.smithi059.stdout: "redirect_resolve_ip_addr": { 2024-09-10T21:26:52.161 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T21:26:52.161 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.161 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.161 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.161 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.161 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.162 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.162 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.162 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.162 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.162 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.162 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.162 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.162 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2024-09-10T21:26:52.162 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2024-09-10T21:26:52.162 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.162 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.162 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.162 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "::", 2024-09-10T21:26:52.162 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.162 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.163 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.163 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.163 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.163 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.163 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.163 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.163 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2024-09-10T21:26:52.163 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2024-09-10T21:26:52.163 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.163 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.163 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.163 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8080", 2024-09-10T21:26:52.163 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.163 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.164 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.164 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.164 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.164 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.164 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.164 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.164 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.164 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.164 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.164 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.164 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.164 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.164 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.164 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.165 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.165 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.165 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.165 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.165 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.165 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.165 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl": { 2024-09-10T21:26:52.165 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl", 2024-09-10T21:26:52.165 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.165 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.165 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.165 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.165 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.165 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.166 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.166 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.166 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.166 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.166 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.166 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.166 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl_server_port": { 2024-09-10T21:26:52.166 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl_server_port", 2024-09-10T21:26:52.166 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.166 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.166 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.166 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8443", 2024-09-10T21:26:52.166 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.166 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.167 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.167 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.167 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.167 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.167 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.167 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.167 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_behaviour": { 2024-09-10T21:26:52.167 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_behaviour", 2024-09-10T21:26:52.167 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.167 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.167 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.167 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "redirect", 2024-09-10T21:26:52.167 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.167 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.168 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.168 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.168 INFO:teuthology.orchestra.run.smithi059.stdout: "redirect" 2024-09-10T21:26:52.168 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.168 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.168 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.168 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.168 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.168 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.168 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_error_status_code": { 2024-09-10T21:26:52.168 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_error_status_code", 2024-09-10T21:26:52.168 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.168 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.168 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.169 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2024-09-10T21:26:52.169 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "400", 2024-09-10T21:26:52.169 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "599", 2024-09-10T21:26:52.169 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.169 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.169 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.169 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.169 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.169 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.169 INFO:teuthology.orchestra.run.smithi059.stdout: "url_prefix": { 2024-09-10T21:26:52.169 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "url_prefix", 2024-09-10T21:26:52.169 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.169 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.170 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.170 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.170 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.170 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.170 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.170 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.170 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.170 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.170 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.170 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.170 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.170 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.170 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.170 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "devicehealth", 2024-09-10T21:26:52.171 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.171 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.171 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.171 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_monitoring": { 2024-09-10T21:26:52.171 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enable_monitoring", 2024-09-10T21:26:52.171 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.171 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.171 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.171 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.171 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.171 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.171 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.171 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "monitor device health metrics", 2024-09-10T21:26:52.171 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.172 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.172 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.172 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.172 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.172 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.172 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.172 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.172 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.172 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.172 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.172 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.173 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.173 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.173 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.173 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.173 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.173 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.173 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.173 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.173 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.173 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.173 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.173 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.173 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.174 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.174 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.174 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.174 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.174 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.174 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.174 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.174 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.174 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.174 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.174 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.174 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.174 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.175 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.175 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.175 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.175 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.175 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.175 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.175 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.175 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.175 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.175 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.175 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.175 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.176 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.176 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.176 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.176 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.176 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.176 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.176 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.176 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.176 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.176 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.176 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.176 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.176 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.177 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.177 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.177 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.177 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.177 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.177 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.177 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.177 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.177 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.177 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.177 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.177 INFO:teuthology.orchestra.run.smithi059.stdout: "mark_out_threshold": { 2024-09-10T21:26:52.177 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mark_out_threshold", 2024-09-10T21:26:52.177 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:52.178 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.178 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.178 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "2419200", 2024-09-10T21:26:52.178 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.178 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.178 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.178 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T21:26:52.178 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.178 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.178 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.178 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.178 INFO:teuthology.orchestra.run.smithi059.stdout: "pool_name": { 2024-09-10T21:26:52.178 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pool_name", 2024-09-10T21:26:52.179 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.179 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.179 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.179 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "device_health_metrics", 2024-09-10T21:26:52.179 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.179 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.179 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.179 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T21:26:52.179 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.179 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.179 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.179 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.179 INFO:teuthology.orchestra.run.smithi059.stdout: "retention_period": { 2024-09-10T21:26:52.179 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "retention_period", 2024-09-10T21:26:52.180 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:52.180 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.180 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.180 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15552000", 2024-09-10T21:26:52.180 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.180 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.180 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.180 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long to retain device health metrics", 2024-09-10T21:26:52.180 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.180 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.180 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.180 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.180 INFO:teuthology.orchestra.run.smithi059.stdout: "scrape_frequency": { 2024-09-10T21:26:52.180 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "scrape_frequency", 2024-09-10T21:26:52.181 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:52.181 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.181 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.181 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "86400", 2024-09-10T21:26:52.181 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.181 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.181 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.181 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T21:26:52.181 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.181 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.181 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.181 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.181 INFO:teuthology.orchestra.run.smithi059.stdout: "self_heal": { 2024-09-10T21:26:52.182 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "self_heal", 2024-09-10T21:26:52.182 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.182 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.182 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.182 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.182 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.182 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.182 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.182 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T21:26:52.182 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.182 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.182 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.182 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.182 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T21:26:52.183 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T21:26:52.183 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:52.183 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.183 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.183 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T21:26:52.183 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.183 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.183 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.183 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T21:26:52.183 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.183 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.183 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.183 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.183 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.184 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.184 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.184 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.184 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.184 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.184 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.184 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.184 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.184 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.184 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.184 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.184 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.184 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.185 INFO:teuthology.orchestra.run.smithi059.stdout: "warn_threshold": { 2024-09-10T21:26:52.185 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "warn_threshold", 2024-09-10T21:26:52.185 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:52.185 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.185 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.185 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "7257600", 2024-09-10T21:26:52.185 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.185 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.185 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.185 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T21:26:52.185 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.185 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.185 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.185 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.186 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.186 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.186 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.186 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "diskprediction_local", 2024-09-10T21:26:52.186 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.186 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.186 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.186 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.186 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.186 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.186 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.186 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.186 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.186 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.187 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.187 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.187 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.187 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.187 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.187 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.187 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.187 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.187 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.187 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.187 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.187 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.187 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.187 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.188 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.188 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.188 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.188 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.188 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.188 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.188 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.188 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.188 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.188 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.188 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.188 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.188 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.188 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.189 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.189 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.189 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.189 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.189 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.189 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.189 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.189 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.189 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.189 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.189 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.189 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.189 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.190 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.190 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.190 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.190 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.190 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.190 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.190 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.190 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.190 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.190 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.190 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.190 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.190 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.190 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.191 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.191 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.191 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.191 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.191 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.191 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.191 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.191 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.191 INFO:teuthology.orchestra.run.smithi059.stdout: "predict_interval": { 2024-09-10T21:26:52.191 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "predict_interval", 2024-09-10T21:26:52.191 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.191 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.191 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.192 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "86400", 2024-09-10T21:26:52.192 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.192 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.192 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.192 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.192 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.192 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.192 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.192 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.192 INFO:teuthology.orchestra.run.smithi059.stdout: "predictor_model": { 2024-09-10T21:26:52.192 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "predictor_model", 2024-09-10T21:26:52.192 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.192 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.192 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.193 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "prophetstor", 2024-09-10T21:26:52.193 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.193 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.193 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.193 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.193 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.193 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.193 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.193 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.193 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T21:26:52.193 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T21:26:52.193 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.193 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.194 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.194 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "600", 2024-09-10T21:26:52.194 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.194 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.194 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.194 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.194 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.194 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.194 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.194 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.194 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.194 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.194 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.194 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.195 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.195 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.195 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.195 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.195 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.195 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.195 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.195 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.195 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.195 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.195 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.195 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.195 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.195 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "influx", 2024-09-10T21:26:52.196 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": false, 2024-09-10T21:26:52.196 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "influxdb python module not found", 2024-09-10T21:26:52.196 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.196 INFO:teuthology.orchestra.run.smithi059.stdout: "batch_size": { 2024-09-10T21:26:52.196 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "batch_size", 2024-09-10T21:26:52.196 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.196 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.196 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.196 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5000", 2024-09-10T21:26:52.196 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.196 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.196 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.196 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T21:26:52.196 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.197 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.197 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.197 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.197 INFO:teuthology.orchestra.run.smithi059.stdout: "database": { 2024-09-10T21:26:52.197 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "database", 2024-09-10T21:26:52.197 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.197 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.197 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.197 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "ceph", 2024-09-10T21:26:52.197 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.197 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.197 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.197 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T21:26:52.197 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.198 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.198 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.198 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.198 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": { 2024-09-10T21:26:52.198 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "hostname", 2024-09-10T21:26:52.198 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.198 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.198 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.198 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.198 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.198 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.198 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.198 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB server hostname", 2024-09-10T21:26:52.199 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.199 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.199 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.199 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.199 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T21:26:52.199 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T21:26:52.199 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:52.199 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.199 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.199 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "30", 2024-09-10T21:26:52.199 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "5", 2024-09-10T21:26:52.199 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.199 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.199 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T21:26:52.200 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.200 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.200 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.200 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.200 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.200 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.200 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.200 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.200 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.200 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.200 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.200 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.200 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.201 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.201 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.201 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.201 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.201 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.201 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.201 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.201 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.201 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.201 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.201 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.201 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.201 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.201 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.202 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.202 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.202 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.202 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.202 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.202 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.202 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.202 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.202 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.202 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.202 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.202 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.202 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.203 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.203 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.203 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.203 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.203 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.203 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.203 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.203 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.203 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.203 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.203 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.203 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.203 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.203 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.204 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.204 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.204 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.204 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.204 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.204 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.204 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.204 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.204 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.204 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.204 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.204 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.204 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.205 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.205 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.205 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.205 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.205 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.205 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.205 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.205 INFO:teuthology.orchestra.run.smithi059.stdout: "password": { 2024-09-10T21:26:52.205 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "password", 2024-09-10T21:26:52.205 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.205 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.205 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.205 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.205 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.206 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.206 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.206 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "password of InfluxDB server user", 2024-09-10T21:26:52.206 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.206 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.206 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.206 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.206 INFO:teuthology.orchestra.run.smithi059.stdout: "port": { 2024-09-10T21:26:52.206 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "port", 2024-09-10T21:26:52.206 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.206 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.206 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.206 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "8086", 2024-09-10T21:26:52.206 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.207 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.207 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.207 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "InfluxDB server port", 2024-09-10T21:26:52.207 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.207 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.207 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.207 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.207 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.207 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.207 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.207 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.207 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.207 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.207 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.208 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.208 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.208 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.208 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.208 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.208 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.208 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.208 INFO:teuthology.orchestra.run.smithi059.stdout: "ssl": { 2024-09-10T21:26:52.208 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ssl", 2024-09-10T21:26:52.208 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.208 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.208 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.208 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "false", 2024-09-10T21:26:52.209 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.209 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.209 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.209 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T21:26:52.209 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.209 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.209 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.209 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.209 INFO:teuthology.orchestra.run.smithi059.stdout: "threads": { 2024-09-10T21:26:52.209 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "threads", 2024-09-10T21:26:52.209 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.209 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.209 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.209 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T21:26:52.210 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T21:26:52.210 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "32", 2024-09-10T21:26:52.210 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.210 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T21:26:52.210 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.210 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.210 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.210 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.210 INFO:teuthology.orchestra.run.smithi059.stdout: "username": { 2024-09-10T21:26:52.210 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "username", 2024-09-10T21:26:52.210 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.210 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.210 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.211 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.211 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.211 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.211 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.211 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "username of InfluxDB server user", 2024-09-10T21:26:52.211 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.211 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.211 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.211 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.211 INFO:teuthology.orchestra.run.smithi059.stdout: "verify_ssl": { 2024-09-10T21:26:52.211 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "verify_ssl", 2024-09-10T21:26:52.211 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.211 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.211 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.212 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "true", 2024-09-10T21:26:52.212 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.212 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.212 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.212 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T21:26:52.212 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.212 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.212 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.212 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.212 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.212 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.212 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.212 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "insights", 2024-09-10T21:26:52.213 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.213 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.213 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.213 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.213 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.213 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.213 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.213 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.213 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.213 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.213 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.213 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.213 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.213 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.214 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.215 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.215 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.215 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.215 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.215 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.215 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.215 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.215 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.215 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.215 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.215 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.215 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.215 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.216 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.216 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.216 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.216 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.216 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.216 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.216 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.216 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.216 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.216 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.216 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.216 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.216 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.217 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.217 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.217 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.217 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.217 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.217 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.217 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.217 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.217 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.217 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.217 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.217 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.218 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.218 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.218 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.218 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.218 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.218 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.218 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.218 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.218 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.218 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.218 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.218 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.218 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.219 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.219 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.219 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.219 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.219 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.219 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.219 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.219 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.219 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.219 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.219 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.219 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "iostat", 2024-09-10T21:26:52.219 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.219 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.220 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.220 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.220 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.220 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.220 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.220 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.220 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.220 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.220 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.220 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.220 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.220 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.221 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.222 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.223 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.224 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.225 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "k8sevents", 2024-09-10T21:26:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_event_retention_days": { 2024-09-10T21:26:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "ceph_event_retention_days", 2024-09-10T21:26:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "7", 2024-09-10T21:26:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.227 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T21:26:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "config_check_secs": { 2024-09-10T21:26:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "config_check_secs", 2024-09-10T21:26:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "10", 2024-09-10T21:26:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.228 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T21:26:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.229 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.230 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.230 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.230 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.230 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.230 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.230 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.230 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.230 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.230 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.230 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.230 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.230 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.230 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.230 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.231 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.231 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.231 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.231 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.231 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.231 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.231 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.231 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.231 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.231 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.231 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.231 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.231 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.232 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.232 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.232 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.232 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.232 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.232 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.232 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.232 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.232 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.232 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.232 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.232 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.232 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.232 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.233 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.233 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.233 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.233 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.233 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.233 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.233 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.233 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.233 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.233 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.233 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.233 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.233 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.234 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.234 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.234 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.234 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.234 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.234 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.234 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.234 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.234 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.234 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.234 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.234 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.234 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.234 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.234 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.235 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.235 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.235 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.235 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.235 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.235 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.235 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.235 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.235 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.235 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "localpool", 2024-09-10T21:26:52.235 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.235 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.236 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.236 INFO:teuthology.orchestra.run.smithi059.stdout: "failure_domain": { 2024-09-10T21:26:52.236 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "failure_domain", 2024-09-10T21:26:52.236 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.236 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.236 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.236 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "host", 2024-09-10T21:26:52.236 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.236 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.236 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.236 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "failure domain for any created local pool", 2024-09-10T21:26:52.236 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T21:26:52.236 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.237 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.237 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.237 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.237 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.237 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.237 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.237 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.237 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.237 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.237 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.237 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.237 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.238 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.238 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.238 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.238 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.238 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.238 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.238 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.238 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.238 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.238 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.238 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.238 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.238 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.238 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.239 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.239 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.239 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.239 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.239 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.239 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.239 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.239 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.239 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.239 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.239 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.239 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.239 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.240 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.240 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.240 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.240 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.240 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.240 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.240 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.240 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.240 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.240 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.240 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.240 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.240 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.241 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.241 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.241 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.241 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.241 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.241 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.241 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.241 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.241 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.241 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.241 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.241 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.241 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.242 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.242 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.242 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.242 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.242 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.242 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.244 INFO:teuthology.orchestra.run.smithi059.stdout: "min_size": { 2024-09-10T21:26:52.244 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "min_size", 2024-09-10T21:26:52.244 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.244 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.244 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.244 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.244 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.244 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.244 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.244 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default min_size for any created local pool", 2024-09-10T21:26:52.244 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T21:26:52.244 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.245 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.245 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.245 INFO:teuthology.orchestra.run.smithi059.stdout: "num_rep": { 2024-09-10T21:26:52.245 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "num_rep", 2024-09-10T21:26:52.245 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.245 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.245 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.245 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3", 2024-09-10T21:26:52.245 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.245 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.245 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.245 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default replica count for any created local pool", 2024-09-10T21:26:52.246 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.246 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.246 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.246 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.246 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_num": { 2024-09-10T21:26:52.246 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pg_num", 2024-09-10T21:26:52.246 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.246 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.246 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.246 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "128", 2024-09-10T21:26:52.246 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.246 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.247 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.247 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T21:26:52.247 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.247 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.247 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.247 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.247 INFO:teuthology.orchestra.run.smithi059.stdout: "prefix": { 2024-09-10T21:26:52.247 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prefix", 2024-09-10T21:26:52.247 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.247 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.247 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.247 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.247 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.247 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.248 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.248 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "name prefix for any created local pool", 2024-09-10T21:26:52.248 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.248 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.248 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.248 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.248 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.248 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.248 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.248 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.248 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.248 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.248 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.249 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.249 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.249 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.249 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.249 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.249 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.249 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.249 INFO:teuthology.orchestra.run.smithi059.stdout: "subtree": { 2024-09-10T21:26:52.249 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "subtree", 2024-09-10T21:26:52.249 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.249 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.249 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.250 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "rack", 2024-09-10T21:26:52.250 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.250 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.250 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.250 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T21:26:52.250 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T21:26:52.250 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.250 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.250 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.250 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.250 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.250 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.250 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mds_autoscaler", 2024-09-10T21:26:52.250 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.250 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.251 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.251 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.251 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.251 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.251 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.251 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.251 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.251 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.251 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.251 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.251 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.251 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.251 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.251 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.252 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.252 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.252 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.252 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.252 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.252 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.252 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.252 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.252 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.252 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.252 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.252 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.252 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.252 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.253 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.253 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.253 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.253 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.253 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.253 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.253 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.253 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.253 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.253 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.253 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.253 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.253 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.253 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.253 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.254 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.254 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.254 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.254 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.254 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.254 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.254 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.254 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.254 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.254 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.254 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.254 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.254 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.256 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.256 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.256 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.256 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.256 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.256 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.256 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.256 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.256 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.256 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.256 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.256 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.256 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.256 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.257 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.257 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.257 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.257 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mirroring", 2024-09-10T21:26:52.257 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.257 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.257 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.257 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.257 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.257 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.257 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.257 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.258 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.258 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.258 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.258 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.258 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.258 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.258 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.258 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.258 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.258 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.258 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.258 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.258 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.259 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.259 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.259 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.259 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.259 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.259 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.259 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.259 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.259 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.259 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.259 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.259 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.259 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.259 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.260 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.260 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.260 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.260 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.260 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.260 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.260 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.260 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.260 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.260 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.260 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.260 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.261 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.261 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.261 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.261 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.261 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.261 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.261 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.261 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.261 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.261 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.261 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.261 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.261 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.261 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.262 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.262 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.262 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.262 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.262 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.262 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.262 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.262 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.262 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.262 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.262 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.262 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.262 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.263 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.263 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.263 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.263 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.263 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.263 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.263 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.263 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.263 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.263 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.263 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.263 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.263 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.264 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.264 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.264 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.264 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "nfs", 2024-09-10T21:26:52.264 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.264 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.264 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.264 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.264 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.264 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.264 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.264 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.265 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.265 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.265 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.265 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.265 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.265 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.265 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.265 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.265 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.265 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.265 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.265 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.266 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.266 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.266 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.266 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.266 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.266 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.266 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.266 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.266 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.266 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.266 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.266 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.266 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.266 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.267 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.267 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.267 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.267 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.267 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.267 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.267 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.267 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.267 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.267 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.267 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.267 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.267 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.268 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.268 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.268 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.268 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.268 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.268 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.268 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.268 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.268 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.268 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.268 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.268 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.268 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.269 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.269 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.269 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.269 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.269 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.269 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.269 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.269 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.269 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.269 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.269 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.269 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.269 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.270 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.270 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.270 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.270 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.270 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.270 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.270 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.270 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.270 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.270 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.270 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.270 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.270 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.271 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.271 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.271 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.271 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.271 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "orchestrator", 2024-09-10T21:26:52.271 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.271 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.271 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.271 INFO:teuthology.orchestra.run.smithi059.stdout: "fail_fs": { 2024-09-10T21:26:52.271 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "fail_fs", 2024-09-10T21:26:52.271 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.271 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.271 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.271 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.271 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.272 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.272 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.272 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T21:26:52.272 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.272 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.272 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.272 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.272 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.272 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.272 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.272 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.272 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.272 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.272 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.272 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.273 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.273 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.273 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.273 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.273 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.273 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.273 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.273 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.273 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.273 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.273 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.273 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.273 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.274 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.274 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.274 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.274 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.274 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.274 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.274 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.274 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.274 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.274 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.274 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.274 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.274 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.274 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.274 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.275 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.275 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.275 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.275 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.275 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.275 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.275 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.275 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.275 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.275 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.275 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.275 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.275 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.275 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.276 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.276 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.276 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.276 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.276 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.276 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.276 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.276 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.276 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.276 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.276 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.276 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.276 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.276 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.277 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.277 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.277 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.277 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.277 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.277 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.277 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator": { 2024-09-10T21:26:52.277 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "orchestrator", 2024-09-10T21:26:52.277 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.277 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.277 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.277 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.277 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.278 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.278 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.278 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm", 2024-09-10T21:26:52.278 INFO:teuthology.orchestra.run.smithi059.stdout: "rook", 2024-09-10T21:26:52.278 INFO:teuthology.orchestra.run.smithi059.stdout: "test_orchestrator" 2024-09-10T21:26:52.278 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.278 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Orchestrator backend", 2024-09-10T21:26:52.278 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.278 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.278 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.278 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.278 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.279 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.279 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.279 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.279 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.279 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.279 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.279 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.279 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.279 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.279 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.279 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.279 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.279 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.280 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.280 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.280 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.280 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "osd_perf_query", 2024-09-10T21:26:52.280 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.280 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.280 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.280 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.280 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.280 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.280 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.280 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.280 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.280 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.281 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.281 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.281 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.281 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.281 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.281 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.281 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.281 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.281 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.281 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.281 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.281 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.281 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.282 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.282 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.282 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.282 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.282 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.282 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.282 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.282 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.282 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.282 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.282 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.282 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.283 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.283 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.283 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.283 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.283 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.283 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.283 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.283 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.283 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.283 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.283 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.283 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.283 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.283 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.284 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.284 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.284 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.284 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.284 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.284 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.284 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.284 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.284 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.284 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.284 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.284 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.284 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.285 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.285 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.285 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.285 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.285 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.285 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.285 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.285 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.285 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.285 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.285 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.285 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.285 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.286 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.286 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.286 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.286 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.286 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.286 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.286 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.286 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.286 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.286 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.286 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.286 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.287 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "osd_support", 2024-09-10T21:26:52.287 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.287 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.287 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.287 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.287 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.287 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.287 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.287 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.287 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.287 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.287 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.287 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.288 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.288 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.288 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.288 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.288 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.288 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.288 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.288 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.288 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.288 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.288 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.288 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.288 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.289 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.289 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.289 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.289 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.289 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.289 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.289 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.289 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.289 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.289 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.289 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.289 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.290 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.290 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.290 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.290 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.290 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.290 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.290 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.290 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.290 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.290 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.290 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.290 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.290 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.290 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.290 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.291 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.291 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.291 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.291 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.291 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.291 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.291 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.291 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.291 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.291 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.291 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.291 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.291 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.291 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.292 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.292 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.292 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.292 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.292 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.292 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.292 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.292 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.292 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.292 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.292 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.292 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.292 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.293 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.293 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.293 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.293 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.293 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.293 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "pg_autoscaler", 2024-09-10T21:26:52.293 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.293 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.293 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.293 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.293 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.293 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.294 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.294 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.294 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.294 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.294 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.294 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.294 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.294 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.294 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.294 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.294 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.294 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.294 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.294 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.295 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.295 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.295 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.295 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.295 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.295 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.295 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.295 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.295 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.295 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.295 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.295 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.296 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.296 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.296 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.296 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.296 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.296 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.296 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.296 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.296 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.296 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.296 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.296 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.296 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.297 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.297 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.297 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.297 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.297 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.297 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.297 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.297 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.297 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.297 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.297 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.297 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.297 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.298 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.298 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.298 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.298 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.298 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.298 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.298 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.298 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.298 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.298 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.298 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.298 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T21:26:52.298 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T21:26:52.298 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:52.298 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.299 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.299 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T21:26:52.299 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.299 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.299 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.299 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.299 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.299 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.299 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.299 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.299 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.299 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.299 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.299 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.300 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.300 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.300 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.300 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.300 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.300 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.300 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.300 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.300 INFO:teuthology.orchestra.run.smithi059.stdout: "threshold": { 2024-09-10T21:26:52.300 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "threshold", 2024-09-10T21:26:52.300 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:52.300 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.300 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.300 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "3.0", 2024-09-10T21:26:52.301 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1.0", 2024-09-10T21:26:52.301 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.301 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.301 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "scaling threshold", 2024-09-10T21:26:52.301 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T21:26:52.301 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.301 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.301 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.301 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.301 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "progress", 2024-09-10T21:26:52.301 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.301 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.301 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.302 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_pg_recovery_event": { 2024-09-10T21:26:52.302 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_pg_recovery_event", 2024-09-10T21:26:52.302 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.302 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.302 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.302 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.302 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.302 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.302 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.302 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T21:26:52.302 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.302 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.302 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.302 INFO:teuthology.orchestra.run.smithi059.stdout: "enabled": { 2024-09-10T21:26:52.303 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enabled", 2024-09-10T21:26:52.303 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.303 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.303 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.303 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.303 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.303 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.303 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.303 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.303 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.303 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.303 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.303 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.303 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.304 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.304 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.304 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.304 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.304 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.304 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.304 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.304 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.304 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.304 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.304 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.304 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.304 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.305 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.305 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.305 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.305 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.305 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.305 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.305 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.305 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.305 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.305 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.305 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.305 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.306 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.306 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.306 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.306 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.306 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.306 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.306 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.306 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.306 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.306 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.306 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.306 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.306 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.307 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.307 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.307 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.307 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.307 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.307 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.307 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.307 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.307 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.307 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.307 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.307 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.307 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.308 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.308 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.308 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.308 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.308 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.308 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.308 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.308 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.308 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.308 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.308 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.308 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.308 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.309 INFO:teuthology.orchestra.run.smithi059.stdout: "max_completed_events": { 2024-09-10T21:26:52.309 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_completed_events", 2024-09-10T21:26:52.309 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.309 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.309 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.309 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "50", 2024-09-10T21:26:52.309 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.309 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.309 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.309 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "number of past completed events to remember", 2024-09-10T21:26:52.309 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.310 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.310 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.310 INFO:teuthology.orchestra.run.smithi059.stdout: "sleep_interval": { 2024-09-10T21:26:52.310 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sleep_interval", 2024-09-10T21:26:52.310 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:52.310 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.310 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.310 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T21:26:52.310 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.310 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.310 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.310 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "how long the module is going to sleep", 2024-09-10T21:26:52.310 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.311 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.311 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.311 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.311 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.311 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.311 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.311 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.311 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.311 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.311 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.311 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.311 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.312 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.312 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.312 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.312 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.312 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.312 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "prometheus", 2024-09-10T21:26:52.312 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.312 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.312 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.312 INFO:teuthology.orchestra.run.smithi059.stdout: "cache": { 2024-09-10T21:26:52.312 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "cache", 2024-09-10T21:26:52.313 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.313 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.313 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.313 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.313 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.313 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.313 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.313 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.313 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.313 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.313 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.313 INFO:teuthology.orchestra.run.smithi059.stdout: "exclude_perf_counters": { 2024-09-10T21:26:52.313 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "exclude_perf_counters", 2024-09-10T21:26:52.314 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.314 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.314 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.314 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.314 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.314 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.314 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.314 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T21:26:52.314 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T21:26:52.314 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.314 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.314 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.315 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.315 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.315 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.315 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.315 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.315 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.315 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.315 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.315 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.315 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.315 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.315 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.315 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.316 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.316 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.316 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.316 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.316 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.316 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.316 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.316 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.316 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.316 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.316 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.316 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.317 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.317 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.317 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.317 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.317 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.317 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.317 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.317 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.317 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.317 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.317 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.317 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.318 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.318 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.318 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.318 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.318 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.318 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.318 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.318 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.318 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.318 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.318 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.318 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.318 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.318 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.319 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.319 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.319 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.319 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.319 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.319 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.319 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.319 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.319 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.319 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.319 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.319 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.320 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.320 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.320 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_stats_pools": { 2024-09-10T21:26:52.320 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_stats_pools", 2024-09-10T21:26:52.320 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.320 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.320 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.320 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.320 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.320 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.320 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.320 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.321 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.321 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.321 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.321 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T21:26:52.321 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T21:26:52.321 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.321 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.321 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.321 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "300", 2024-09-10T21:26:52.321 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.321 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.321 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.321 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.322 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.322 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.322 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.322 INFO:teuthology.orchestra.run.smithi059.stdout: "scrape_interval": { 2024-09-10T21:26:52.322 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "scrape_interval", 2024-09-10T21:26:52.322 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:52.322 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.322 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.322 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15.0", 2024-09-10T21:26:52.322 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.322 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.322 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.322 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.323 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.323 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.323 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.323 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2024-09-10T21:26:52.323 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2024-09-10T21:26:52.323 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.323 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.323 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.323 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "::", 2024-09-10T21:26:52.323 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.323 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.323 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.323 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T21:26:52.324 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.324 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.324 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.324 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2024-09-10T21:26:52.324 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2024-09-10T21:26:52.324 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.324 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.324 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.324 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "9283", 2024-09-10T21:26:52.324 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.324 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.324 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.324 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T21:26:52.325 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.325 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.325 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.325 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.325 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.325 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.325 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.325 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.325 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.325 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.325 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.325 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.326 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.326 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.326 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.326 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.326 INFO:teuthology.orchestra.run.smithi059.stdout: "stale_cache_strategy": { 2024-09-10T21:26:52.326 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "stale_cache_strategy", 2024-09-10T21:26:52.326 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.326 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.326 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.326 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "log", 2024-09-10T21:26:52.326 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_behaviour": { 2024-09-10T21:26:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_behaviour", 2024-09-10T21:26:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "default", 2024-09-10T21:26:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.327 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: "default", 2024-09-10T21:26:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: "error" 2024-09-10T21:26:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: "standby_error_status_code": { 2024-09-10T21:26:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "standby_error_status_code", 2024-09-10T21:26:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.328 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2024-09-10T21:26:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "400", 2024-09-10T21:26:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "599", 2024-09-10T21:26:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_support", 2024-09-10T21:26:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.329 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.330 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.331 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.332 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.334 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "max_concurrent_snap_create": { 2024-09-10T21:26:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_concurrent_snap_create", 2024-09-10T21:26:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10", 2024-09-10T21:26:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "mirror_snapshot_schedule": { 2024-09-10T21:26:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T21:26:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.337 INFO:teuthology.orchestra.run.smithi059.stdout: "trash_purge_schedule": { 2024-09-10T21:26:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "trash_purge_schedule", 2024-09-10T21:26:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.339 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "restful", 2024-09-10T21:26:52.339 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.339 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.339 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.339 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_auth": { 2024-09-10T21:26:52.339 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enable_auth", 2024-09-10T21:26:52.339 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.339 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.339 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.339 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.339 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.339 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.339 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.340 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.340 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.340 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.340 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.340 INFO:teuthology.orchestra.run.smithi059.stdout: "key_file": { 2024-09-10T21:26:52.340 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "key_file", 2024-09-10T21:26:52.340 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.340 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.340 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.340 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.340 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.340 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.340 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.340 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.341 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.341 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.341 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.341 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.341 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.341 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.341 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.341 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.341 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.341 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.341 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.341 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.341 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.342 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.342 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.342 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.342 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.342 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.342 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.342 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.342 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.342 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.342 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.342 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.342 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.342 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.342 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.343 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.343 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.343 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.343 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.343 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.343 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.343 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.343 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.343 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.343 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.343 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.344 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.344 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.344 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.344 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.344 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.344 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.344 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.344 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.344 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.344 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.344 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.344 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.345 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.345 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.345 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.345 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.345 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.345 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.345 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.345 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.345 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.345 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.345 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.346 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.346 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.346 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.346 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.346 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.346 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.346 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.346 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.346 INFO:teuthology.orchestra.run.smithi059.stdout: "max_requests": { 2024-09-10T21:26:52.346 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_requests", 2024-09-10T21:26:52.346 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.347 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.347 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.347 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "500", 2024-09-10T21:26:52.347 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.347 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.347 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.347 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T21:26:52.347 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.347 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.347 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.347 INFO:teuthology.orchestra.run.smithi059.stdout: "server_addr": { 2024-09-10T21:26:52.348 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_addr", 2024-09-10T21:26:52.348 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.348 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.348 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.348 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.348 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.348 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.348 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.348 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.348 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.348 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.348 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.349 INFO:teuthology.orchestra.run.smithi059.stdout: "server_port": { 2024-09-10T21:26:52.349 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "server_port", 2024-09-10T21:26:52.349 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.349 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.349 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.349 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.349 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.349 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.349 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.349 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.349 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.349 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.349 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.350 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.350 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.350 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.350 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.350 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.350 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.350 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.350 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.350 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.350 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.350 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.351 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.351 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.351 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.351 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.351 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rgw", 2024-09-10T21:26:52.351 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.351 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.351 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.351 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.351 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.351 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.352 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.352 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.352 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.352 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.352 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.352 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.352 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.352 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.352 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.352 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.352 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.352 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.352 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.352 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.353 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.353 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.353 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.353 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.353 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.353 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.353 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.353 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.353 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.353 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.353 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.353 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.353 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.353 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.354 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.354 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.354 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.354 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.354 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.354 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.354 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.354 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.354 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.354 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.354 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.354 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.355 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.355 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.355 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.355 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.355 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.355 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.355 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.355 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.355 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.355 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.355 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.355 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.355 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.356 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.356 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.356 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.356 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.356 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.356 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.356 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.356 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.356 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.356 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.356 INFO:teuthology.orchestra.run.smithi059.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T21:26:52.356 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T21:26:52.357 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.357 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.357 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.357 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "5", 2024-09-10T21:26:52.357 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.357 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.357 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.357 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T21:26:52.357 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.357 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.357 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.357 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.357 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.357 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.358 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.358 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.358 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.358 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.358 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.358 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.358 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.358 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.358 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.358 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.358 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.358 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.358 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rook", 2024-09-10T21:26:52.358 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.359 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.359 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.359 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.359 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.359 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.359 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.359 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.359 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.359 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.359 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.359 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.359 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.359 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.359 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.359 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.360 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.360 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.360 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.360 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.360 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.360 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.360 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.360 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.360 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.360 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.360 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.360 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.361 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.361 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.361 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.361 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.361 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.361 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.361 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.361 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.361 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.361 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.361 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.361 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.361 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.361 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.362 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.362 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.362 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.362 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.362 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.362 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.362 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.362 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.362 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.362 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.362 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.362 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.362 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.362 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.363 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.363 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.363 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.363 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.363 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.363 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.363 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.363 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.363 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.363 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.363 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.363 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.363 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.363 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.364 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.364 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.364 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.364 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.364 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.364 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.364 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.364 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.364 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.364 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.364 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.364 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.365 INFO:teuthology.orchestra.run.smithi059.stdout: "storage_class": { 2024-09-10T21:26:52.365 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "storage_class", 2024-09-10T21:26:52.365 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.365 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.365 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.365 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "local", 2024-09-10T21:26:52.365 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.365 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.365 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.365 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T21:26:52.365 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.365 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.365 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.365 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.365 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.366 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "selftest", 2024-09-10T21:26:52.366 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.366 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.366 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.366 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.366 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.366 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.366 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.366 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.366 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.366 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.366 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.366 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.367 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.367 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.367 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.367 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.367 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.367 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.367 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.367 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.367 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.367 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.367 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.367 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.367 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.367 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.367 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.368 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.368 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.368 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.368 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.368 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.368 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.368 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.368 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.368 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.368 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.368 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.368 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.368 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.369 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.369 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.369 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.369 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.369 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.369 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.369 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.369 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.369 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.369 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.369 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.369 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.369 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.369 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.370 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.370 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.370 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.370 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.370 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.370 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.370 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.370 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.370 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.370 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.370 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.370 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.370 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.370 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.371 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.371 INFO:teuthology.orchestra.run.smithi059.stdout: "roption1": { 2024-09-10T21:26:52.371 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "roption1", 2024-09-10T21:26:52.371 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.371 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.371 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.371 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.371 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.371 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.371 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.371 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.371 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.371 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.371 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.372 INFO:teuthology.orchestra.run.smithi059.stdout: "roption2": { 2024-09-10T21:26:52.372 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "roption2", 2024-09-10T21:26:52.372 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.372 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.372 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.372 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "xyz", 2024-09-10T21:26:52.372 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.372 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.372 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.372 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.372 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.372 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.372 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.373 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption1": { 2024-09-10T21:26:52.373 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption1", 2024-09-10T21:26:52.373 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.373 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.373 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.373 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.373 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.373 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.373 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.373 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.373 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.373 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.373 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.374 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption2": { 2024-09-10T21:26:52.374 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption2", 2024-09-10T21:26:52.374 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.374 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.374 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.374 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.374 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.374 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.374 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.374 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.374 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.374 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.375 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.375 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption3": { 2024-09-10T21:26:52.375 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption3", 2024-09-10T21:26:52.375 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "float", 2024-09-10T21:26:52.375 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.375 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.375 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.375 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.375 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.375 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.375 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.375 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.375 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.376 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.376 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption4": { 2024-09-10T21:26:52.376 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption4", 2024-09-10T21:26:52.376 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.376 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.376 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.376 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.376 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.376 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.376 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.376 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.376 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.377 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.377 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.377 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption5": { 2024-09-10T21:26:52.377 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption5", 2024-09-10T21:26:52.377 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.377 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.377 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.377 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.377 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.377 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.377 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.377 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.378 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.378 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.378 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.378 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption6": { 2024-09-10T21:26:52.378 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption6", 2024-09-10T21:26:52.378 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.378 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.378 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.378 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.378 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.378 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.378 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.379 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.379 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.379 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.379 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.379 INFO:teuthology.orchestra.run.smithi059.stdout: "rwoption7": { 2024-09-10T21:26:52.379 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rwoption7", 2024-09-10T21:26:52.379 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.379 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.379 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.379 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.379 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "1", 2024-09-10T21:26:52.379 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "42", 2024-09-10T21:26:52.380 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.380 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.380 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.380 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.380 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.380 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.380 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.380 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.380 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.380 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.380 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.380 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.381 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.381 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.381 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.381 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.381 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.381 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.381 INFO:teuthology.orchestra.run.smithi059.stdout: "testkey": { 2024-09-10T21:26:52.381 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testkey", 2024-09-10T21:26:52.381 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.381 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.381 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.381 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.382 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.382 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.382 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.382 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.382 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.382 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.382 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.382 INFO:teuthology.orchestra.run.smithi059.stdout: "testlkey": { 2024-09-10T21:26:52.382 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testlkey", 2024-09-10T21:26:52.382 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.382 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.382 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.383 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.383 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.383 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.383 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.383 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.383 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.383 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.383 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.383 INFO:teuthology.orchestra.run.smithi059.stdout: "testnewline": { 2024-09-10T21:26:52.383 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "testnewline", 2024-09-10T21:26:52.383 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.383 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.384 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.384 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.384 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.384 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.384 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.384 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.384 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.384 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.384 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.384 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.384 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.385 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "smb", 2024-09-10T21:26:52.385 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.385 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.385 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.385 INFO:teuthology.orchestra.run.smithi059.stdout: "internal_store_backend": { 2024-09-10T21:26:52.385 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "internal_store_backend", 2024-09-10T21:26:52.385 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.385 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.385 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.385 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.385 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.385 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.385 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.385 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T21:26:52.386 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.386 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.386 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.386 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.386 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.386 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.386 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.386 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.386 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.386 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.386 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.386 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.386 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.387 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.387 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.387 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.387 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.387 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.387 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.387 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.387 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.387 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.387 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.387 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.387 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.387 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.388 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.388 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.388 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.388 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.388 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.388 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.388 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.388 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.388 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.388 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.388 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.388 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.388 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.389 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.389 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.389 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.389 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.389 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.389 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.389 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.389 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.389 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.389 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.389 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.389 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.389 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.389 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.389 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.390 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.390 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.390 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.390 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.390 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.390 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.390 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.390 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.390 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.390 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.390 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.390 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.390 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.391 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.391 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.391 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.391 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.391 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.391 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.391 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.391 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.391 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.391 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.391 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.391 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.391 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.392 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.392 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.392 INFO:teuthology.orchestra.run.smithi059.stdout: "update_orchestration": { 2024-09-10T21:26:52.392 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "update_orchestration", 2024-09-10T21:26:52.392 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.392 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.392 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.392 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.392 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.392 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.392 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.392 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T21:26:52.393 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.393 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.393 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.393 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.393 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.393 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snap_schedule", 2024-09-10T21:26:52.393 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.393 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.393 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.393 INFO:teuthology.orchestra.run.smithi059.stdout: "allow_m_granularity": { 2024-09-10T21:26:52.393 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "allow_m_granularity", 2024-09-10T21:26:52.394 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.394 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.394 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.394 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.394 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.394 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.394 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.394 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T21:26:52.394 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.394 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.394 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.394 INFO:teuthology.orchestra.run.smithi059.stdout: "dump_on_update": { 2024-09-10T21:26:52.394 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "dump_on_update", 2024-09-10T21:26:52.395 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.395 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.395 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.395 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.395 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.395 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.395 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.395 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "dump database to debug log on update", 2024-09-10T21:26:52.395 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.395 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.395 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.395 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.396 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.396 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.396 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.396 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.396 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.396 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.396 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.396 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.396 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.396 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.396 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.396 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.396 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.397 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.397 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.397 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.397 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.397 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.397 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.397 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.397 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.397 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.397 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.397 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.397 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.397 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.398 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.398 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.398 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.398 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.398 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.398 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.398 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.398 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.398 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.398 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.398 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.398 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.398 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.398 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.399 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.399 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.399 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.399 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.399 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.399 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.399 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.399 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.399 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.399 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.399 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.399 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.400 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.400 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.400 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.400 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.400 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.400 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.400 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.400 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.400 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.400 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.400 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.400 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.400 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.400 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.401 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.401 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.401 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.401 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.401 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.401 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.401 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.401 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.401 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.401 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.401 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.401 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.401 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.401 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.402 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "stats", 2024-09-10T21:26:52.402 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.402 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.402 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.402 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.402 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.402 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.402 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.402 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.402 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.402 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.403 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.403 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.403 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.403 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.403 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.403 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.403 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.403 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.403 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.403 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.403 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.403 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.403 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.404 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.404 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.404 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.404 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.404 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.404 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.404 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.404 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.404 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.404 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.404 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.404 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.404 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.405 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.405 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.405 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.405 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.405 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.405 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.405 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.405 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.405 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.405 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.405 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.405 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.405 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.405 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.406 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.406 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.406 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.406 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.406 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.406 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.406 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.406 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.406 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.406 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.406 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.406 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.406 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.406 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.407 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.407 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.407 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.407 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.407 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.407 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.407 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.407 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.407 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.407 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.407 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.407 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.408 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.408 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.408 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.408 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.408 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.408 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.408 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.408 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.408 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "status", 2024-09-10T21:26:52.408 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.408 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.409 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.409 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.409 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.409 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.409 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.409 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.409 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.409 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.409 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.409 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.409 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.409 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.409 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.409 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.410 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.410 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.410 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.410 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.410 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.410 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.410 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.410 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.410 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.410 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.410 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.410 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.410 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.410 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.411 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.411 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.411 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.411 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.411 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.411 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.411 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.411 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.411 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.411 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.411 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.411 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.412 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.412 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.412 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.412 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.412 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.412 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.412 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.412 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.412 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.412 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.412 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.412 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.412 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.413 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.413 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.413 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.413 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.413 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.413 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.413 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.413 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.413 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.413 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.413 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.413 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.414 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.414 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.414 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.414 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.414 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.414 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.414 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.414 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.414 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.414 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.414 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.414 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.414 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.415 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.415 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.415 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.415 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.415 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "telegraf", 2024-09-10T21:26:52.415 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.415 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.415 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.415 INFO:teuthology.orchestra.run.smithi059.stdout: "address": { 2024-09-10T21:26:52.415 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "address", 2024-09-10T21:26:52.415 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.416 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.416 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.416 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T21:26:52.416 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.416 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.416 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.416 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.416 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.416 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.416 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.417 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T21:26:52.417 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T21:26:52.417 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:52.417 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.417 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.417 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "15", 2024-09-10T21:26:52.417 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.417 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.417 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.417 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.417 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.417 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.417 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.418 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.418 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.418 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.418 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.418 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.418 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.418 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.418 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.418 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.418 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.418 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.418 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.418 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.419 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.419 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.419 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.419 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.419 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.419 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.419 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.419 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.419 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.419 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.419 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.419 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.419 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.419 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.420 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.420 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.420 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.420 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.420 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.420 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.420 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.420 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.420 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.420 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.420 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.420 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.420 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.420 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.421 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.421 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.421 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.421 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.421 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.421 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.421 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.421 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.421 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.421 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.421 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.421 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.421 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.422 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.422 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.422 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.422 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.422 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.422 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.422 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.422 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.422 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.422 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.422 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.422 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.422 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.422 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.423 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.423 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.423 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.423 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.423 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.423 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.423 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.423 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.423 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.423 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.423 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.423 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.423 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.424 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "telemetry", 2024-09-10T21:26:52.424 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.424 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.424 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.424 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_basic": { 2024-09-10T21:26:52.424 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_basic", 2024-09-10T21:26:52.424 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.424 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.424 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.424 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.424 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.424 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.424 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.425 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T21:26:52.425 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.425 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.425 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.425 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_crash": { 2024-09-10T21:26:52.425 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_crash", 2024-09-10T21:26:52.425 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.425 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.425 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.425 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.425 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.425 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.425 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.426 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T21:26:52.426 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.426 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.426 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.426 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_device": { 2024-09-10T21:26:52.426 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_device", 2024-09-10T21:26:52.426 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.426 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.426 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.426 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.426 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.426 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.427 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.427 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T21:26:52.427 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.427 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.427 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.427 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_ident": { 2024-09-10T21:26:52.427 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_ident", 2024-09-10T21:26:52.427 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.427 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.427 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.427 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.427 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.427 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.427 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.427 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T21:26:52.428 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.428 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.428 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.428 INFO:teuthology.orchestra.run.smithi059.stdout: "channel_perf": { 2024-09-10T21:26:52.428 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "channel_perf", 2024-09-10T21:26:52.428 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.428 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.428 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.428 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.428 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.428 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.428 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.429 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T21:26:52.429 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.429 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.429 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.429 INFO:teuthology.orchestra.run.smithi059.stdout: "contact": { 2024-09-10T21:26:52.429 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "contact", 2024-09-10T21:26:52.429 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.429 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.429 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.429 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.429 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.429 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.429 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.430 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.430 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.430 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.430 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.430 INFO:teuthology.orchestra.run.smithi059.stdout: "description": { 2024-09-10T21:26:52.430 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "description", 2024-09-10T21:26:52.430 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.430 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.430 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.430 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.430 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.430 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.431 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.431 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.431 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.431 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.431 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.431 INFO:teuthology.orchestra.run.smithi059.stdout: "device_url": { 2024-09-10T21:26:52.431 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "device_url", 2024-09-10T21:26:52.431 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.431 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.431 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.431 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T21:26:52.431 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.432 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.432 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.432 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.432 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.432 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.432 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.432 INFO:teuthology.orchestra.run.smithi059.stdout: "enabled": { 2024-09-10T21:26:52.432 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "enabled", 2024-09-10T21:26:52.432 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.432 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.432 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.432 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.432 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.433 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.433 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.433 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.433 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.433 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.433 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.433 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T21:26:52.433 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T21:26:52.433 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.433 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.433 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.433 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "24", 2024-09-10T21:26:52.434 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "8", 2024-09-10T21:26:52.434 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.434 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.434 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.434 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.434 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.434 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.434 INFO:teuthology.orchestra.run.smithi059.stdout: "last_opt_revision": { 2024-09-10T21:26:52.434 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "last_opt_revision", 2024-09-10T21:26:52.434 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.434 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.435 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.435 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "1", 2024-09-10T21:26:52.435 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.435 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.435 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.435 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.435 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.435 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.435 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.435 INFO:teuthology.orchestra.run.smithi059.stdout: "leaderboard": { 2024-09-10T21:26:52.435 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "leaderboard", 2024-09-10T21:26:52.435 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.436 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.436 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.436 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.436 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.436 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.436 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.436 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.436 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.436 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.436 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.436 INFO:teuthology.orchestra.run.smithi059.stdout: "leaderboard_description": { 2024-09-10T21:26:52.436 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "leaderboard_description", 2024-09-10T21:26:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "organization": { 2024-09-10T21:26:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "organization", 2024-09-10T21:26:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "proxy": { 2024-09-10T21:26:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "proxy", 2024-09-10T21:26:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "url": { 2024-09-10T21:26:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "url", 2024-09-10T21:26:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T21:26:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "test_orchestrator", 2024-09-10T21:26:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.451 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.451 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.451 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "volumes", 2024-09-10T21:26:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "max_concurrent_clones": { 2024-09-10T21:26:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "max_concurrent_clones", 2024-09-10T21:26:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "4", 2024-09-10T21:26:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T21:26:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: "periodic_async_work": { 2024-09-10T21:26:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "periodic_async_work", 2024-09-10T21:26:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Periodically check for async work", 2024-09-10T21:26:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot_clone_delay": { 2024-09-10T21:26:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snapshot_clone_delay", 2024-09-10T21:26:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T21:26:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "snapshot_clone_no_wait": { 2024-09-10T21:26:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T21:26:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "True", 2024-09-10T21:26:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T21:26:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix", 2024-09-10T21:26:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "can_run": true, 2024-09-10T21:26:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "error_string": "", 2024-09-10T21:26:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "module_options": { 2024-09-10T21:26:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "discovery_interval": { 2024-09-10T21:26:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "discovery_interval", 2024-09-10T21:26:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "uint", 2024-09-10T21:26:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "100", 2024-09-10T21:26:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "identifier": { 2024-09-10T21:26:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "identifier", 2024-09-10T21:26:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "interval": { 2024-09-10T21:26:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "interval", 2024-09-10T21:26:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "secs", 2024-09-10T21:26:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "60", 2024-09-10T21:26:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "log_level": { 2024-09-10T21:26:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_level", 2024-09-10T21:26:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster": { 2024-09-10T21:26:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster", 2024-09-10T21:26:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_cluster_level": { 2024-09-10T21:26:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_cluster_level", 2024-09-10T21:26:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "info", 2024-09-10T21:26:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [ 2024-09-10T21:26:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "", 2024-09-10T21:26:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "critical", 2024-09-10T21:26:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "debug", 2024-09-10T21:26:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "error", 2024-09-10T21:26:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "info", 2024-09-10T21:26:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "warning" 2024-09-10T21:26:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": { 2024-09-10T21:26:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "log_to_file", 2024-09-10T21:26:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "bool", 2024-09-10T21:26:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "False", 2024-09-10T21:26:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "sqlite3_killpoint": { 2024-09-10T21:26:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "sqlite3_killpoint", 2024-09-10T21:26:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "dev", 2024-09-10T21:26:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 1, 2024-09-10T21:26:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "0", 2024-09-10T21:26:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_host": { 2024-09-10T21:26:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_host", 2024-09-10T21:26:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "", 2024-09-10T21:26:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_port": { 2024-09-10T21:26:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_port", 2024-09-10T21:26:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "int", 2024-09-10T21:26:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "10051", 2024-09-10T21:26:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "zabbix_sender": { 2024-09-10T21:26:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "zabbix_sender", 2024-09-10T21:26:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "str", 2024-09-10T21:26:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "level": "advanced", 2024-09-10T21:26:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "flags": 0, 2024-09-10T21:26:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T21:26:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "min": "", 2024-09-10T21:26:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "max": "", 2024-09-10T21:26:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "enum_allowed": [], 2024-09-10T21:26:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "desc": "", 2024-09-10T21:26:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "long_desc": "", 2024-09-10T21:26:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "tags": [], 2024-09-10T21:26:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "see_also": [] 2024-09-10T21:26:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "services": { 2024-09-10T21:26:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "dashboard": "https://172.21.15.59:8443/" 2024-09-10T21:26:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "always_on_modules": { 2024-09-10T21:26:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "octopus": [ 2024-09-10T21:26:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "balancer", 2024-09-10T21:26:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "crash", 2024-09-10T21:26:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "devicehealth", 2024-09-10T21:26:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator", 2024-09-10T21:26:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscaler", 2024-09-10T21:26:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "progress", 2024-09-10T21:26:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_support", 2024-09-10T21:26:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "status", 2024-09-10T21:26:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "telemetry", 2024-09-10T21:26:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "volumes" 2024-09-10T21:26:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "pacific": [ 2024-09-10T21:26:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "balancer", 2024-09-10T21:26:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "crash", 2024-09-10T21:26:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "devicehealth", 2024-09-10T21:26:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator", 2024-09-10T21:26:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscaler", 2024-09-10T21:26:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "progress", 2024-09-10T21:26:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_support", 2024-09-10T21:26:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "status", 2024-09-10T21:26:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "telemetry", 2024-09-10T21:26:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "volumes" 2024-09-10T21:26:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "quincy": [ 2024-09-10T21:26:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "balancer", 2024-09-10T21:26:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "crash", 2024-09-10T21:26:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "devicehealth", 2024-09-10T21:26:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator", 2024-09-10T21:26:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscaler", 2024-09-10T21:26:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "progress", 2024-09-10T21:26:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_support", 2024-09-10T21:26:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "status", 2024-09-10T21:26:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "telemetry", 2024-09-10T21:26:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "volumes" 2024-09-10T21:26:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "reef": [ 2024-09-10T21:26:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "balancer", 2024-09-10T21:26:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "crash", 2024-09-10T21:26:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "devicehealth", 2024-09-10T21:26:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator", 2024-09-10T21:26:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscaler", 2024-09-10T21:26:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "progress", 2024-09-10T21:26:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_support", 2024-09-10T21:26:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "status", 2024-09-10T21:26:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "telemetry", 2024-09-10T21:26:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "volumes" 2024-09-10T21:26:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-09-10T21:26:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "squid": [ 2024-09-10T21:26:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "balancer", 2024-09-10T21:26:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "crash", 2024-09-10T21:26:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "devicehealth", 2024-09-10T21:26:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "orchestrator", 2024-09-10T21:26:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "pg_autoscaler", 2024-09-10T21:26:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "progress", 2024-09-10T21:26:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_support", 2024-09-10T21:26:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "status", 2024-09-10T21:26:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "telemetry", 2024-09-10T21:26:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "volumes" 2024-09-10T21:26:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T21:26:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "force_disabled_modules": {}, 2024-09-10T21:26:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "last_failure_osd_epoch": 3, 2024-09-10T21:26:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "active_clients": [ 2024-09-10T21:26:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "devicehealth", 2024-09-10T21:26:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-10T21:26:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-10T21:26:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:0", 2024-09-10T21:26:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3251423687 2024-09-10T21:26:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T21:26:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "libcephsqlite", 2024-09-10T21:26:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-10T21:26:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-10T21:26:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:0", 2024-09-10T21:26:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 872522677 2024-09-10T21:26:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T21:26:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "rbd_support", 2024-09-10T21:26:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-10T21:26:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-10T21:26:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:0", 2024-09-10T21:26:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2779156397 2024-09-10T21:26:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T21:26:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "volumes", 2024-09-10T21:26:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: "addrvec": [ 2024-09-10T21:26:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-09-10T21:26:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v2", 2024-09-10T21:26:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "172.21.15.59:0", 2024-09-10T21:26:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 174460377 2024-09-10T21:26:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.486 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T21:26:52.486 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:52.486 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-10T21:26:52.486 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:26:52.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.979+0000 7f27856d6640 1 -- 172.21.15.59:0/668342915 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f27680b52e0 msgr2=0x7f27680b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:52.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.979+0000 7f27856d6640 1 --2- 172.21.15.59:0/668342915 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f27680b52e0 0x7f27680b77a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2770005d00 tx=0x7f277000b410 comp rx=0 tx=0).stop 2024-09-10T21:26:52.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.979+0000 7f27856d6640 1 -- 172.21.15.59:0/668342915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27801033b0 msgr2=0x7f27801a00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:26:52.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.979+0000 7f27856d6640 1 --2- 172.21.15.59:0/668342915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27801033b0 0x7f27801a00f0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f277800eb10 tx=0x7f277800c2d0 comp rx=0 tx=0).stop 2024-09-10T21:26:52.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.979+0000 7f27856d6640 1 -- 172.21.15.59:0/668342915 shutdown_connections 2024-09-10T21:26:52.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.979+0000 7f27856d6640 1 --2- 172.21.15.59:0/668342915 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f27680b52e0 0x7f27680b77a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:52.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.979+0000 7f27856d6640 1 --2- 172.21.15.59:0/668342915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27801033b0 0x7f27801a00f0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:52.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.979+0000 7f27856d6640 1 --2- 172.21.15.59:0/668342915 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27801029f0 0x7f278019db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:52.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.979+0000 7f27856d6640 1 --2- 172.21.15.59:0/668342915 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27801018a0 0x7f278006acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:26:52.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.979+0000 7f27856d6640 1 -- 172.21.15.59:0/668342915 >> 172.21.15.59:0/668342915 conn(0x7f27800fd180 msgr2=0x7f2780105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:26:52.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.979+0000 7f27856d6640 1 -- 172.21.15.59:0/668342915 shutdown_connections 2024-09-10T21:26:52.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:26:50.980+0000 7f27856d6640 1 -- 172.21.15.59:0/668342915 wait complete. 2024-09-10T21:26:52.496 DEBUG:tasks.check_counter:Getting stats from a 2024-09-10T21:26:52.496 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-10T21:26:52.497 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:51 smithi059 ceph-mon[30888]: pgmap v687: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-10T21:26:52.497 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:51 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/100914095' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T21:26:52.497 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:51 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/3484901850' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T21:26:52.497 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:51 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/668342915' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T21:26:52.498 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:51 smithi192 ceph-mon[35363]: pgmap v687: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-10T21:26:52.498 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:51 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/100914095' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T21:26:52.498 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:51 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/3484901850' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T21:26:52.498 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:51 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/668342915' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T21:26:52.498 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:51 smithi154 ceph-mon[35041]: pgmap v687: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-10T21:26:52.498 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:51 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/100914095' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T21:26:52.498 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:51 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/3484901850' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T21:26:52.498 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:51 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/668342915' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T21:26:52.498 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:52 smithi154 ceph-mon[35041]: pgmap v688: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T21:26:52.525 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:52 smithi059 ceph-mon[30888]: pgmap v688: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T21:26:52.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:52 smithi192 ceph-mon[35363]: pgmap v688: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T21:26:52.769 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:26:53.340 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:26:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:26:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 1607, 2024-09-10T21:26:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 1609, 2024-09-10T21:26:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 481265, 2024-09-10T21:26:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 511027, 2024-09-10T21:26:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 6, 2024-09-10T21:26:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 2, 2024-09-10T21:26:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.148887636, 2024-09-10T21:26:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.070053483, 2024-09-10T21:26:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.031277927, 2024-09-10T21:26:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.034835171, 2024-09-10T21:26:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:26:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1607, 2024-09-10T21:26:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.046761193, 2024-09-10T21:26:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000029098 2024-09-10T21:26:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:26:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T21:26:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T21:26:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:26:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 697, 2024-09-10T21:26:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 865, 2024-09-10T21:26:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 172028, 2024-09-10T21:26:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 606340, 2024-09-10T21:26:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 5, 2024-09-10T21:26:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 4, 2024-09-10T21:26:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.082097044, 2024-09-10T21:26:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.040189130, 2024-09-10T21:26:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.014705380, 2024-09-10T21:26:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.020576302, 2024-09-10T21:26:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:26:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 863, 2024-09-10T21:26:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.026842367, 2024-09-10T21:26:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000031103 2024-09-10T21:26:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:26:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T21:26:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 384944 2024-09-10T21:26:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:26:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 238, 2024-09-10T21:26:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 232, 2024-09-10T21:26:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 552540, 2024-09-10T21:26:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 138334, 2024-09-10T21:26:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 3, 2024-09-10T21:26:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 2, 2024-09-10T21:26:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.039291579, 2024-09-10T21:26:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.020773281, 2024-09-10T21:26:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.021635055, 2024-09-10T21:26:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000027271, 2024-09-10T21:26:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:26:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 232, 2024-09-10T21:26:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.018538571, 2024-09-10T21:26:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000079907 2024-09-10T21:26:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:26:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 552272, 2024-09-10T21:26:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 138016 2024-09-10T21:26:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-09-10T21:26:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 1, 2024-09-10T21:26:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-09-10T21:26:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-MDSRank": { 2024-09-10T21:26:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-09-10T21:26:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-09-10T21:26:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 3785, 2024-09-10T21:26:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.085661115, 2024-09-10T21:26:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000022631 2024-09-10T21:26:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-PurgeQueue": { 2024-09-10T21:26:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-09-10T21:26:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-09-10T21:26:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-09-10T21:26:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: "request": 0, 2024-09-10T21:26:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: "reply": 0, 2024-09-10T21:26:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: "reply_latency": { 2024-09-10T21:26:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_reply": 0, 2024-09-10T21:26:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: "forward": 0, 2024-09-10T21:26:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_complete": 0, 2024-09-10T21:26:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_keys": 0, 2024-09-10T21:26:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_commit": 0, 2024-09-10T21:26:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_split": 0, 2024-09-10T21:26:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_merge": 0, 2024-09-10T21:26:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes": 0, 2024-09-10T21:26:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_top": 0, 2024-09-10T21:26:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_bottom": 0, 2024-09-10T21:26:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pin_tail": 0, 2024-09-10T21:26:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pinned": 0, 2024-09-10T21:26:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_expired": 0, 2024-09-10T21:26:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_with_caps": 0, 2024-09-10T21:26:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": 0, 2024-09-10T21:26:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "subtrees": 1, 2024-09-10T21:26:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse": 0, 2024-09-10T21:26:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_hit": 0, 2024-09-10T21:26:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_forward": 0, 2024-09-10T21:26:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_discover": 0, 2024-09-10T21:26:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_dir_fetch": 0, 2024-09-10T21:26:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_remote_ino": 0, 2024-09-10T21:26:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_lock": 0, 2024-09-10T21:26:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "load_cent": 0, 2024-09-10T21:26:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "q": 0, 2024-09-10T21:26:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "exported": 0, 2024-09-10T21:26:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "exported_inodes": 0, 2024-09-10T21:26:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "imported": 0, 2024-09-10T21:26:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "imported_inodes": 0, 2024-09-10T21:26:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_dir_fetch": 0, 2024-09-10T21:26:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_backtrace_fetch": 0, 2024-09-10T21:26:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_peer_discover": 0, 2024-09-10T21:26:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rfiles": 0, 2024-09-10T21:26:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rbytes": 0, 2024-09-10T21:26:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rsnaps": 0, 2024-09-10T21:26:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T21:26:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_set_tag": 0, 2024-09-10T21:26:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T21:26:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_inotable_repaired": 0, 2024-09-10T21:26:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_inodes": 0, 2024-09-10T21:26:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T21:26:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T21:26:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_file_inodes": 0, 2024-09-10T21:26:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_inode_file_caps": 0, 2024-09-10T21:26:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T21:26:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_grant": 0, 2024-09-10T21:26:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T21:26:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T21:26:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T21:26:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps": 0, 2024-09-10T21:26:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps_dirty": 0, 2024-09-10T21:26:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_cap_release": 0, 2024-09-10T21:26:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "process_request_cap_release": 0 2024-09-10T21:26:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache": { 2024-09-10T21:26:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update": 0, 2024-09-10T21:26:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update_receipt": 0, 2024-09-10T21:26:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_try_discover": 0, 2024-09-10T21:26:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_send_discover": 0, 2024-09-10T21:26:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_handle_discover": 0, 2024-09-10T21:26:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays": 0, 2024-09-10T21:26:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_delayed": 0, 2024-09-10T21:26:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_enqueuing": 0, 2024-09-10T21:26:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_created": 0, 2024-09-10T21:26:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_enqueued": 0, 2024-09-10T21:26:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_reintegrated": 0, 2024-09-10T21:26:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_migrated": 0, 2024-09-10T21:26:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_processing": 0, 2024-09-10T21:26:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_enqueued": 0, 2024-09-10T21:26:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_prioritized": 0, 2024-09-10T21:26:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_started": 0, 2024-09-10T21:26:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_completed": 0, 2024-09-10T21:26:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_path": 0, 2024-09-10T21:26:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_inode": 0, 2024-09-10T21:26:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T21:26:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_exportdir": 0, 2024-09-10T21:26:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_flush": 0, 2024-09-10T21:26:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragmentdir": 0, 2024-09-10T21:26:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragstats": 0, 2024-09-10T21:26:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_inodestats": 0, 2024-09-10T21:26:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_succeeded": 0, 2024-09-10T21:26:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_write_failed": 0 2024-09-10T21:26:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log": { 2024-09-10T21:26:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "evlrg": 0, 2024-09-10T21:26:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "evadd": 0, 2024-09-10T21:26:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "evex": 0, 2024-09-10T21:26:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "evtrm": 0, 2024-09-10T21:26:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "ev": 3, 2024-09-10T21:26:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "evexg": 0, 2024-09-10T21:26:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "evexd": 0, 2024-09-10T21:26:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "segadd": 0, 2024-09-10T21:26:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "segex": 0, 2024-09-10T21:26:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "segtrm": 0, 2024-09-10T21:26:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "seg": 2, 2024-09-10T21:26:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "segmjr": 2, 2024-09-10T21:26:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "segexg": 0, 2024-09-10T21:26:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "segexd": 0, 2024-09-10T21:26:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "expos": 4194304, 2024-09-10T21:26:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "wrpos": 4195200, 2024-09-10T21:26:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "rdpos": 4194892, 2024-09-10T21:26:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "jlat": { 2024-09-10T21:26:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: "replayed": 3 2024-09-10T21:26:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_mem": { 2024-09-10T21:26:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 3, 2024-09-10T21:26:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: "ino+": 3, 2024-09-10T21:26:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: "ino-": 0, 2024-09-10T21:26:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: "dir": 1, 2024-09-10T21:26:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: "dir+": 1, 2024-09-10T21:26:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: "dir-": 0, 2024-09-10T21:26:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: "dn": 0, 2024-09-10T21:26:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: "dn+": 0, 2024-09-10T21:26:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: "dn-": 0, 2024-09-10T21:26:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: "cap": 0, 2024-09-10T21:26:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: "cap+": 0, 2024-09-10T21:26:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: "cap-": 0, 2024-09-10T21:26:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: "rss": 50448, 2024-09-10T21:26:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: "heap": 248242176 2024-09-10T21:26:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_server": { 2024-09-10T21:26:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_client_request": 0, 2024-09-10T21:26:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_server_request": 0, 2024-09-10T21:26:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_request": 0, 2024-09-10T21:26:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_session": 0, 2024-09-10T21:26:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_peer_request": 0, 2024-09-10T21:26:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: "req_create_latency": { 2024-09-10T21:26:53.359 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.359 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.359 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.359 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getattr_latency": { 2024-09-10T21:26:53.359 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.359 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.359 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.359 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getfilelock_latency": { 2024-09-10T21:26:53.359 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.359 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.359 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.360 INFO:teuthology.orchestra.run.smithi059.stdout: "req_link_latency": { 2024-09-10T21:26:53.360 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.360 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.360 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.360 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookup_latency": { 2024-09-10T21:26:53.360 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.360 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.360 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.360 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookuphash_latency": { 2024-09-10T21:26:53.360 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.361 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.361 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.361 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupino_latency": { 2024-09-10T21:26:53.361 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.361 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.361 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.361 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupname_latency": { 2024-09-10T21:26:53.361 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.361 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.361 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupparent_latency": { 2024-09-10T21:26:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupsnap_latency": { 2024-09-10T21:26:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lssnap_latency": { 2024-09-10T21:26:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mkdir_latency": { 2024-09-10T21:26:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mknod_latency": { 2024-09-10T21:26:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mksnap_latency": { 2024-09-10T21:26:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: "req_open_latency": { 2024-09-10T21:26:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: "req_readdir_latency": { 2024-09-10T21:26:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rename_latency": { 2024-09-10T21:26:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: "req_renamesnap_latency": { 2024-09-10T21:26:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: "req_snapdiff_latency": { 2024-09-10T21:26:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmdir_latency": { 2024-09-10T21:26:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmsnap_latency": { 2024-09-10T21:26:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmxattr_latency": { 2024-09-10T21:26:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setattr_latency": { 2024-09-10T21:26:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setdirlayout_latency": { 2024-09-10T21:26:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setfilelock_latency": { 2024-09-10T21:26:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setlayout_latency": { 2024-09-10T21:26:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setxattr_latency": { 2024-09-10T21:26:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: "req_symlink_latency": { 2024-09-10T21:26:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: "req_unlink_latency": { 2024-09-10T21:26:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_revoke_eviction": 0, 2024-09-10T21:26:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_acquisition_throttle": 0, 2024-09-10T21:26:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getvxattr_latency": { 2024-09-10T21:26:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_sessions": { 2024-09-10T21:26:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: "session_count": 1, 2024-09-10T21:26:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: "session_add": 1, 2024-09-10T21:26:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: "session_remove": 0, 2024-09-10T21:26:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_open": 1, 2024-09-10T21:26:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_stale": 0, 2024-09-10T21:26:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: "total_load": 0, 2024-09-10T21:26:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: "average_load": 0, 2024-09-10T21:26:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: "avg_session_uptime": 1755, 2024-09-10T21:26:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: "mdthresh_evicted": 0 2024-09-10T21:26:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-09-10T21:26:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:26:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-09-10T21:26:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:26:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:26:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:26:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:26:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:26:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:26:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:26:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:26:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:26:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:26:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:26:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:26:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:26:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-09-10T21:26:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:26:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-09-10T21:26:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:26:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:26:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:26:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:26:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:26:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:26:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:26:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-09-10T21:26:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:26:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:26:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:26:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-09-10T21:26:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-09-10T21:26:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-09-10T21:26:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:26:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:26:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:26:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:26:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 189440, 2024-09-10T21:26:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 52, 2024-09-10T21:26:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:26:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2024-09-10T21:26:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-09-10T21:26:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-09-10T21:26:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:26:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-09-10T21:26:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:26:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-09-10T21:26:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 7400, 2024-09-10T21:26:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 152, 2024-09-10T21:26:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:26:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:26:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-09-10T21:26:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-09-10T21:26:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 8672, 2024-09-10T21:26:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 13, 2024-09-10T21:26:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-09-10T21:26:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-09-10T21:26:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-09-10T21:26:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-09-10T21:26:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter": { 2024-09-10T21:26:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: "op_active": 0, 2024-09-10T21:26:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: "op_laggy": 0, 2024-09-10T21:26:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send": 2304, 2024-09-10T21:26:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send_bytes": 21, 2024-09-10T21:26:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: "op_resend": 3, 2024-09-10T21:26:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: "op_reply": 2304, 2024-09-10T21:26:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: "op_latency": { 2024-09-10T21:26:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2304, 2024-09-10T21:26:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 1.258983589, 2024-09-10T21:26:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000546433 2024-09-10T21:26:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: "op_inflight": 0, 2024-09-10T21:26:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: "oplen_avg": { 2024-09-10T21:26:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2304, 2024-09-10T21:26:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 2305 2024-09-10T21:26:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "op": 2304, 2024-09-10T21:26:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "op_r": 2304, 2024-09-10T21:26:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "op_w": 0, 2024-09-10T21:26:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "op_rmw": 0, 2024-09-10T21:26:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "op_pg": 0, 2024-09-10T21:26:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_stat": 1495, 2024-09-10T21:26:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_create": 0, 2024-09-10T21:26:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_read": 807, 2024-09-10T21:26:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_write": 0, 2024-09-10T21:26:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writefull": 0, 2024-09-10T21:26:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writesame": 0, 2024-09-10T21:26:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_append": 0, 2024-09-10T21:26:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_zero": 0, 2024-09-10T21:26:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_truncate": 0, 2024-09-10T21:26:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_delete": 0, 2024-09-10T21:26:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_mapext": 0, 2024-09-10T21:26:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_sparse_read": 0, 2024-09-10T21:26:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_clonerange": 0, 2024-09-10T21:26:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_getxattr": 1, 2024-09-10T21:26:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_setxattr": 0, 2024-09-10T21:26:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_cmpxattr": 0, 2024-09-10T21:26:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_rmxattr": 0, 2024-09-10T21:26:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_resetxattrs": 0, 2024-09-10T21:26:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_call": 0, 2024-09-10T21:26:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_watch": 0, 2024-09-10T21:26:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_notify": 0, 2024-09-10T21:26:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T21:26:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls": 0, 2024-09-10T21:26:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls_filter": 0, 2024-09-10T21:26:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_other": 0, 2024-09-10T21:26:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_active": 0, 2024-09-10T21:26:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_send": 0, 2024-09-10T21:26:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_resend": 0, 2024-09-10T21:26:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_ping": 0, 2024-09-10T21:26:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_active": 0, 2024-09-10T21:26:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_send": 0, 2024-09-10T21:26:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_resend": 0, 2024-09-10T21:26:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_active": 0, 2024-09-10T21:26:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_send": 0, 2024-09-10T21:26:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_resend": 0, 2024-09-10T21:26:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_active": 0, 2024-09-10T21:26:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_send": 0, 2024-09-10T21:26:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_resend": 0, 2024-09-10T21:26:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "command_active": 0, 2024-09-10T21:26:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "command_send": 0, 2024-09-10T21:26:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "command_resend": 0, 2024-09-10T21:26:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "map_epoch": 75, 2024-09-10T21:26:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "map_full": 0, 2024-09-10T21:26:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "map_inc": 2, 2024-09-10T21:26:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_sessions": 5, 2024-09-10T21:26:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_open": 5, 2024-09-10T21:26:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_close": 0, 2024-09-10T21:26:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_laggy": 0, 2024-09-10T21:26:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_wr": 0, 2024-09-10T21:26:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_rd": 2, 2024-09-10T21:26:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_del": 0 2024-09-10T21:26:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "oft": { 2024-09-10T21:26:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_objs": 0, 2024-09-10T21:26:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_kv_pairs": 0, 2024-09-10T21:26:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_updates": 0, 2024-09-10T21:26:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_removes": 0 2024-09-10T21:26:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "purge_queue": { 2024-09-10T21:26:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops": 0, 2024-09-10T21:26:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T21:26:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing": 0, 2024-09-10T21:26:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_high_water": 0, 2024-09-10T21:26:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed_ops": 0, 2024-09-10T21:26:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed": 0, 2024-09-10T21:26:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_item_in_journal": 0 2024-09-10T21:26:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.382 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:26:53.382 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-10T21:26:53.382 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-09-10T21:26:53.382 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-10T21:26:53.382 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 2538, 2024-09-10T21:26:53.382 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 962420, 2024-09-10T21:26:53.382 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-10T21:26:53.382 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 2538, 2024-09-10T21:26:53.382 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-10T21:26:53.382 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-10T21:26:53.382 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2538, 2024-09-10T21:26:53.382 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 962420, 2024-09-10T21:26:53.382 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-10T21:26:53.382 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.382 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.382 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.383 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:53.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.383 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_bytes": { 2024-09-10T21:26:53.383 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-10T21:26:53.383 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-09-10T21:26:53.383 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-10T21:26:53.383 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-10T21:26:53.383 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-10T21:26:53.383 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-10T21:26:53.383 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-10T21:26:53.383 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 2304, 2024-09-10T21:26:53.383 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 901, 2024-09-10T21:26:53.383 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2304, 2024-09-10T21:26:53.383 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 901, 2024-09-10T21:26:53.383 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-10T21:26:53.383 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.384 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.384 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.384 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:53.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.384 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_ops": { 2024-09-10T21:26:53.384 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-10T21:26:53.384 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1024, 2024-09-10T21:26:53.384 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-10T21:26:53.384 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-10T21:26:53.384 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-10T21:26:53.384 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-10T21:26:53.384 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-10T21:26:53.384 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 2304, 2024-09-10T21:26:53.384 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 2304, 2024-09-10T21:26:53.385 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2304, 2024-09-10T21:26:53.385 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 2304, 2024-09-10T21:26:53.385 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-10T21:26:53.385 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.385 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.385 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.385 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:53.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.385 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle": { 2024-09-10T21:26:53.385 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-10T21:26:53.385 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-09-10T21:26:53.385 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-10T21:26:53.385 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-10T21:26:53.385 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-10T21:26:53.386 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-10T21:26:53.386 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-10T21:26:53.386 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-10T21:26:53.386 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-10T21:26:53.386 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 0, 2024-09-10T21:26:53.386 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 0, 2024-09-10T21:26:53.386 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-10T21:26:53.386 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.386 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.386 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.386 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:53.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.386 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle-0x556ce9345180": { 2024-09-10T21:26:53.386 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-10T21:26:53.386 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-09-10T21:26:53.386 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-10T21:26:53.387 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-10T21:26:53.387 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-10T21:26:53.387 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-10T21:26:53.387 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-10T21:26:53.387 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-10T21:26:53.387 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-10T21:26:53.387 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 0, 2024-09-10T21:26:53.387 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 0, 2024-09-10T21:26:53.387 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-10T21:26:53.387 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:53.387 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:53.387 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:53.387 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:53.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:53.388 INFO:teuthology.orchestra.run.smithi059.stdout: "trackedop": { 2024-09-10T21:26:53.388 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_ops_count": 0 2024-09-10T21:26:53.388 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:53.388 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:26:54.207 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-10T21:26:54.207 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-10T21:26:54.207 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-09-10T21:26:54.207 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-09-10T21:26:54.207 DEBUG:tasks.check_counter:Getting stats from d 2024-09-10T21:26:54.207 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-10T21:26:54.508 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:26:54.768 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:54 smithi059 ceph-mon[30888]: pgmap v689: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T21:26:54.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:54 smithi192 ceph-mon[35363]: pgmap v689: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T21:26:54.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:54 smithi154 ceph-mon[35041]: pgmap v689: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T21:26:54.984 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:26:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:26:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 0, 2024-09-10T21:26:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 2, 2024-09-10T21:26:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 0, 2024-09-10T21:26:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 0, 2024-09-10T21:26:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 4, 2024-09-10T21:26:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 0, 2024-09-10T21:26:54.984 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.001496813, 2024-09-10T21:26:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T21:26:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.000285587, 2024-09-10T21:26:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:26:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:26:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:26:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:54.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T21:26:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T21:26:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:26:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 5, 2024-09-10T21:26:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 175, 2024-09-10T21:26:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 3152, 2024-09-10T21:26:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 111136, 2024-09-10T21:26:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 3, 2024-09-10T21:26:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 2, 2024-09-10T21:26:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.020388912, 2024-09-10T21:26:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.014758715, 2024-09-10T21:26:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.003774710, 2024-09-10T21:26:54.986 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:26:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:26:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 174, 2024-09-10T21:26:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.013721564, 2024-09-10T21:26:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000078859 2024-09-10T21:26:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:26:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T21:26:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 111136 2024-09-10T21:26:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:26:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 230, 2024-09-10T21:26:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 227, 2024-09-10T21:26:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 527504, 2024-09-10T21:26:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 139568, 2024-09-10T21:26:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 2, 2024-09-10T21:26:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 1, 2024-09-10T21:26:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.036997676, 2024-09-10T21:26:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.020329402, 2024-09-10T21:26:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.019846599, 2024-09-10T21:26:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:26:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:26:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 226, 2024-09-10T21:26:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.011881680, 2024-09-10T21:26:54.988 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000052573 2024-09-10T21:26:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:26:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 527504, 2024-09-10T21:26:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 139568 2024-09-10T21:26:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-09-10T21:26:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 0, 2024-09-10T21:26:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-09-10T21:26:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:54.989 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-09-10T21:26:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:26:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-09-10T21:26:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:26:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:26:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:26:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:26:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:26:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:26:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:26:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:26:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:26:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:26:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:26:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:26:54.990 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:26:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-09-10T21:26:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:26:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-09-10T21:26:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:26:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:26:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:26:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:26:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:26:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:26:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:26:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-09-10T21:26:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:26:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:26:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:26:54.991 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-09-10T21:26:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-09-10T21:26:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-09-10T21:26:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:26:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:26:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:26:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:26:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 148984, 2024-09-10T21:26:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 30, 2024-09-10T21:26:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:26:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2024-09-10T21:26:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-09-10T21:26:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-09-10T21:26:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:26:54.992 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-09-10T21:26:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:26:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-09-10T21:26:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 0, 2024-09-10T21:26:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 0, 2024-09-10T21:26:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:26:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:26:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-09-10T21:26:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-09-10T21:26:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 968, 2024-09-10T21:26:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 2, 2024-09-10T21:26:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-09-10T21:26:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-09-10T21:26:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-09-10T21:26:54.993 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-09-10T21:26:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:26:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-10T21:26:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-09-10T21:26:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-10T21:26:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 231, 2024-09-10T21:26:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 494973, 2024-09-10T21:26:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-10T21:26:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 231, 2024-09-10T21:26:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-10T21:26:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-10T21:26:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 231, 2024-09-10T21:26:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 494973, 2024-09-10T21:26:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-10T21:26:54.994 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:54.995 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:54.995 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:54.995 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:54.995 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:54.995 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:26:55.628 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-10T21:26:55.628 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-10T21:26:55.628 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-10T21:26:55.628 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-10T21:26:55.628 DEBUG:tasks.check_counter:Getting stats from g 2024-09-10T21:26:55.628 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-10T21:26:55.886 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:26:56.431 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:26:56.431 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:26:56.431 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 1040, 2024-09-10T21:26:56.431 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 1036, 2024-09-10T21:26:56.431 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 820304, 2024-09-10T21:26:56.431 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 394838, 2024-09-10T21:26:56.431 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 5, 2024-09-10T21:26:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 1, 2024-09-10T21:26:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.144763942, 2024-09-10T21:26:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.078759558, 2024-09-10T21:26:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.038322951, 2024-09-10T21:26:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.021551415, 2024-09-10T21:26:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:26:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1035, 2024-09-10T21:26:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.056437466, 2024-09-10T21:26:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000054528 2024-09-10T21:26:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:26:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.432 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 549824, 2024-09-10T21:26:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 138848 2024-09-10T21:26:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:26:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 1514, 2024-09-10T21:26:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 1683, 2024-09-10T21:26:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 386198, 2024-09-10T21:26:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 866327, 2024-09-10T21:26:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 5, 2024-09-10T21:26:56.433 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 4, 2024-09-10T21:26:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.130203890, 2024-09-10T21:26:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.061415719, 2024-09-10T21:26:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.025343780, 2024-09-10T21:26:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.034403406, 2024-09-10T21:26:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:26:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1681, 2024-09-10T21:26:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.063765912, 2024-09-10T21:26:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000037933 2024-09-10T21:26:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:26:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T21:26:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 385136 2024-09-10T21:26:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:26:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 8, 2024-09-10T21:26:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 8, 2024-09-10T21:26:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 4621, 2024-09-10T21:26:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 1732, 2024-09-10T21:26:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 5, 2024-09-10T21:26:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 4, 2024-09-10T21:26:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.003555906, 2024-09-10T21:26:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.000158967, 2024-09-10T21:26:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.003248026, 2024-09-10T21:26:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000093516, 2024-09-10T21:26:56.435 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:26:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 7, 2024-09-10T21:26:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.006953689, 2024-09-10T21:26:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000993384 2024-09-10T21:26:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:26:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T21:26:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T21:26:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.436 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-09-10T21:26:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 1, 2024-09-10T21:26:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-09-10T21:26:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-MDSRank": { 2024-09-10T21:26:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-09-10T21:26:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-09-10T21:26:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 3926, 2024-09-10T21:26:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.095606004, 2024-09-10T21:26:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000024352 2024-09-10T21:26:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.437 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-PurgeQueue": { 2024-09-10T21:26:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-09-10T21:26:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-09-10T21:26:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-09-10T21:26:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: "request": 0, 2024-09-10T21:26:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: "reply": 0, 2024-09-10T21:26:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: "reply_latency": { 2024-09-10T21:26:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.438 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_reply": 0, 2024-09-10T21:26:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "forward": 0, 2024-09-10T21:26:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_complete": 0, 2024-09-10T21:26:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_keys": 0, 2024-09-10T21:26:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_commit": 0, 2024-09-10T21:26:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_split": 0, 2024-09-10T21:26:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_merge": 0, 2024-09-10T21:26:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes": 0, 2024-09-10T21:26:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_top": 0, 2024-09-10T21:26:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_bottom": 0, 2024-09-10T21:26:56.439 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pin_tail": 0, 2024-09-10T21:26:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pinned": 0, 2024-09-10T21:26:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_expired": 0, 2024-09-10T21:26:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_with_caps": 0, 2024-09-10T21:26:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": 0, 2024-09-10T21:26:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "subtrees": 1, 2024-09-10T21:26:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse": 0, 2024-09-10T21:26:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_hit": 0, 2024-09-10T21:26:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_forward": 0, 2024-09-10T21:26:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_discover": 0, 2024-09-10T21:26:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_dir_fetch": 0, 2024-09-10T21:26:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_remote_ino": 0, 2024-09-10T21:26:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_lock": 0, 2024-09-10T21:26:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "load_cent": 0, 2024-09-10T21:26:56.440 INFO:teuthology.orchestra.run.smithi059.stdout: "q": 0, 2024-09-10T21:26:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "exported": 0, 2024-09-10T21:26:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "exported_inodes": 0, 2024-09-10T21:26:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "imported": 0, 2024-09-10T21:26:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "imported_inodes": 0, 2024-09-10T21:26:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_dir_fetch": 0, 2024-09-10T21:26:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_backtrace_fetch": 0, 2024-09-10T21:26:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_peer_discover": 0, 2024-09-10T21:26:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rfiles": 0, 2024-09-10T21:26:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rbytes": 0, 2024-09-10T21:26:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rsnaps": 0, 2024-09-10T21:26:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T21:26:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_set_tag": 0, 2024-09-10T21:26:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T21:26:56.441 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_inotable_repaired": 0, 2024-09-10T21:26:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_inodes": 0, 2024-09-10T21:26:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T21:26:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T21:26:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_file_inodes": 0, 2024-09-10T21:26:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_inode_file_caps": 0, 2024-09-10T21:26:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T21:26:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_grant": 0, 2024-09-10T21:26:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T21:26:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T21:26:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T21:26:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps": 0, 2024-09-10T21:26:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps_dirty": 0, 2024-09-10T21:26:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_cap_release": 0, 2024-09-10T21:26:56.442 INFO:teuthology.orchestra.run.smithi059.stdout: "process_request_cap_release": 0 2024-09-10T21:26:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache": { 2024-09-10T21:26:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update": 0, 2024-09-10T21:26:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update_receipt": 0, 2024-09-10T21:26:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_try_discover": 0, 2024-09-10T21:26:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_send_discover": 0, 2024-09-10T21:26:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_handle_discover": 0, 2024-09-10T21:26:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays": 0, 2024-09-10T21:26:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_delayed": 0, 2024-09-10T21:26:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_enqueuing": 0, 2024-09-10T21:26:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_created": 0, 2024-09-10T21:26:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_enqueued": 0, 2024-09-10T21:26:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_reintegrated": 0, 2024-09-10T21:26:56.443 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_migrated": 0, 2024-09-10T21:26:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_processing": 0, 2024-09-10T21:26:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_enqueued": 0, 2024-09-10T21:26:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_prioritized": 0, 2024-09-10T21:26:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_started": 0, 2024-09-10T21:26:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_completed": 0, 2024-09-10T21:26:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_path": 0, 2024-09-10T21:26:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_inode": 0, 2024-09-10T21:26:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T21:26:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_exportdir": 0, 2024-09-10T21:26:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_flush": 0, 2024-09-10T21:26:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragmentdir": 0, 2024-09-10T21:26:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragstats": 0, 2024-09-10T21:26:56.444 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_inodestats": 0, 2024-09-10T21:26:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_started": 0, 2024-09-10T21:26:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_succeeded": 0, 2024-09-10T21:26:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: "uninline_write_failed": 0 2024-09-10T21:26:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log": { 2024-09-10T21:26:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: "evlrg": 0, 2024-09-10T21:26:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: "evadd": 0, 2024-09-10T21:26:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: "evex": 0, 2024-09-10T21:26:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: "evtrm": 0, 2024-09-10T21:26:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: "ev": 3, 2024-09-10T21:26:56.445 INFO:teuthology.orchestra.run.smithi059.stdout: "evexg": 0, 2024-09-10T21:26:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "evexd": 0, 2024-09-10T21:26:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "segadd": 0, 2024-09-10T21:26:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "segex": 0, 2024-09-10T21:26:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "segtrm": 0, 2024-09-10T21:26:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "seg": 2, 2024-09-10T21:26:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "segmjr": 2, 2024-09-10T21:26:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "segexg": 0, 2024-09-10T21:26:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "segexd": 0, 2024-09-10T21:26:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "expos": 4194304, 2024-09-10T21:26:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "wrpos": 4195200, 2024-09-10T21:26:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "rdpos": 4194892, 2024-09-10T21:26:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "jlat": { 2024-09-10T21:26:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.446 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "replayed": 3 2024-09-10T21:26:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_mem": { 2024-09-10T21:26:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 3, 2024-09-10T21:26:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "ino+": 3, 2024-09-10T21:26:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "ino-": 0, 2024-09-10T21:26:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "dir": 1, 2024-09-10T21:26:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "dir+": 1, 2024-09-10T21:26:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "dir-": 0, 2024-09-10T21:26:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "dn": 0, 2024-09-10T21:26:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "dn+": 0, 2024-09-10T21:26:56.447 INFO:teuthology.orchestra.run.smithi059.stdout: "dn-": 0, 2024-09-10T21:26:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "cap": 0, 2024-09-10T21:26:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "cap+": 0, 2024-09-10T21:26:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "cap-": 0, 2024-09-10T21:26:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "rss": 49136, 2024-09-10T21:26:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "heap": 248242176 2024-09-10T21:26:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_server": { 2024-09-10T21:26:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_client_request": 0, 2024-09-10T21:26:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_server_request": 0, 2024-09-10T21:26:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_request": 0, 2024-09-10T21:26:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_session": 0, 2024-09-10T21:26:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_peer_request": 0, 2024-09-10T21:26:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "req_create_latency": { 2024-09-10T21:26:56.448 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getattr_latency": { 2024-09-10T21:26:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getfilelock_latency": { 2024-09-10T21:26:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "req_link_latency": { 2024-09-10T21:26:56.449 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookup_latency": { 2024-09-10T21:26:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookuphash_latency": { 2024-09-10T21:26:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.450 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupino_latency": { 2024-09-10T21:26:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupname_latency": { 2024-09-10T21:26:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupparent_latency": { 2024-09-10T21:26:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.451 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupsnap_latency": { 2024-09-10T21:26:56.452 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.452 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.452 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.452 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lssnap_latency": { 2024-09-10T21:26:56.452 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.452 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.453 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.453 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mkdir_latency": { 2024-09-10T21:26:56.453 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.453 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.453 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mknod_latency": { 2024-09-10T21:26:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mksnap_latency": { 2024-09-10T21:26:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "req_open_latency": { 2024-09-10T21:26:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.454 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: "req_readdir_latency": { 2024-09-10T21:26:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rename_latency": { 2024-09-10T21:26:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: "req_renamesnap_latency": { 2024-09-10T21:26:56.455 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: "req_snapdiff_latency": { 2024-09-10T21:26:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmdir_latency": { 2024-09-10T21:26:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmsnap_latency": { 2024-09-10T21:26:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmxattr_latency": { 2024-09-10T21:26:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setattr_latency": { 2024-09-10T21:26:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.457 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setdirlayout_latency": { 2024-09-10T21:26:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setfilelock_latency": { 2024-09-10T21:26:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setlayout_latency": { 2024-09-10T21:26:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.458 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setxattr_latency": { 2024-09-10T21:26:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "req_symlink_latency": { 2024-09-10T21:26:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "req_unlink_latency": { 2024-09-10T21:26:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.459 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_revoke_eviction": 0, 2024-09-10T21:26:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_acquisition_throttle": 0, 2024-09-10T21:26:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getvxattr_latency": { 2024-09-10T21:26:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_sessions": { 2024-09-10T21:26:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: "session_count": 1, 2024-09-10T21:26:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: "session_add": 1, 2024-09-10T21:26:56.460 INFO:teuthology.orchestra.run.smithi059.stdout: "session_remove": 0, 2024-09-10T21:26:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_open": 1, 2024-09-10T21:26:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_stale": 0, 2024-09-10T21:26:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: "total_load": 0, 2024-09-10T21:26:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: "average_load": 0, 2024-09-10T21:26:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: "avg_session_uptime": 1757, 2024-09-10T21:26:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: "mdthresh_evicted": 0 2024-09-10T21:26:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-09-10T21:26:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:26:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-09-10T21:26:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:26:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:26:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:26:56.461 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:26:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:26:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:26:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:26:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:26:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:26:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:26:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:26:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:26:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:26:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-09-10T21:26:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:26:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-09-10T21:26:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:26:56.462 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:26:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:26:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:26:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:26:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:26:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:26:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-09-10T21:26:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:26:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:26:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:26:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-09-10T21:26:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-09-10T21:26:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-09-10T21:26:56.463 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:26:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:26:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:26:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:26:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 197503, 2024-09-10T21:26:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 55, 2024-09-10T21:26:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:26:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2024-09-10T21:26:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-09-10T21:26:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-09-10T21:26:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:26:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-09-10T21:26:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:26:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-09-10T21:26:56.464 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 7400, 2024-09-10T21:26:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 152, 2024-09-10T21:26:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:26:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:26:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-09-10T21:26:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-09-10T21:26:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 8672, 2024-09-10T21:26:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 13, 2024-09-10T21:26:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-09-10T21:26:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-09-10T21:26:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-09-10T21:26:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-09-10T21:26:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.465 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter": { 2024-09-10T21:26:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "op_active": 0, 2024-09-10T21:26:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "op_laggy": 0, 2024-09-10T21:26:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send": 2322, 2024-09-10T21:26:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send_bytes": 21, 2024-09-10T21:26:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "op_resend": 3, 2024-09-10T21:26:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "op_reply": 2322, 2024-09-10T21:26:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "op_latency": { 2024-09-10T21:26:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2322, 2024-09-10T21:26:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 1.176984633, 2024-09-10T21:26:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000506883 2024-09-10T21:26:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "op_inflight": 0, 2024-09-10T21:26:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "oplen_avg": { 2024-09-10T21:26:56.466 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2322, 2024-09-10T21:26:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 2323 2024-09-10T21:26:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: "op": 2322, 2024-09-10T21:26:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: "op_r": 2322, 2024-09-10T21:26:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: "op_w": 0, 2024-09-10T21:26:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: "op_rmw": 0, 2024-09-10T21:26:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: "op_pg": 0, 2024-09-10T21:26:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_stat": 1510, 2024-09-10T21:26:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_create": 0, 2024-09-10T21:26:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_read": 810, 2024-09-10T21:26:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_write": 0, 2024-09-10T21:26:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writefull": 0, 2024-09-10T21:26:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writesame": 0, 2024-09-10T21:26:56.467 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_append": 0, 2024-09-10T21:26:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_zero": 0, 2024-09-10T21:26:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_truncate": 0, 2024-09-10T21:26:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_delete": 0, 2024-09-10T21:26:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_mapext": 0, 2024-09-10T21:26:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_sparse_read": 0, 2024-09-10T21:26:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_clonerange": 0, 2024-09-10T21:26:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_getxattr": 1, 2024-09-10T21:26:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_setxattr": 0, 2024-09-10T21:26:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_cmpxattr": 0, 2024-09-10T21:26:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_rmxattr": 0, 2024-09-10T21:26:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_resetxattrs": 0, 2024-09-10T21:26:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_call": 0, 2024-09-10T21:26:56.468 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_watch": 0, 2024-09-10T21:26:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_notify": 0, 2024-09-10T21:26:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T21:26:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls": 0, 2024-09-10T21:26:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls_filter": 0, 2024-09-10T21:26:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_other": 0, 2024-09-10T21:26:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_active": 0, 2024-09-10T21:26:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_send": 0, 2024-09-10T21:26:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_resend": 0, 2024-09-10T21:26:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_ping": 0, 2024-09-10T21:26:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_active": 0, 2024-09-10T21:26:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_send": 0, 2024-09-10T21:26:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_resend": 0, 2024-09-10T21:26:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_active": 0, 2024-09-10T21:26:56.469 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_send": 0, 2024-09-10T21:26:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_resend": 0, 2024-09-10T21:26:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_active": 0, 2024-09-10T21:26:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_send": 0, 2024-09-10T21:26:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_resend": 0, 2024-09-10T21:26:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "command_active": 0, 2024-09-10T21:26:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "command_send": 0, 2024-09-10T21:26:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "command_resend": 0, 2024-09-10T21:26:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "map_epoch": 75, 2024-09-10T21:26:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "map_full": 0, 2024-09-10T21:26:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "map_inc": 2, 2024-09-10T21:26:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_sessions": 6, 2024-09-10T21:26:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_open": 6, 2024-09-10T21:26:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_close": 0, 2024-09-10T21:26:56.470 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_laggy": 0, 2024-09-10T21:26:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_wr": 0, 2024-09-10T21:26:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_rd": 2, 2024-09-10T21:26:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_del": 0 2024-09-10T21:26:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: "oft": { 2024-09-10T21:26:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_objs": 0, 2024-09-10T21:26:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_kv_pairs": 0, 2024-09-10T21:26:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_updates": 0, 2024-09-10T21:26:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_removes": 0 2024-09-10T21:26:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: "purge_queue": { 2024-09-10T21:26:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops": 0, 2024-09-10T21:26:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T21:26:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing": 0, 2024-09-10T21:26:56.471 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_high_water": 0, 2024-09-10T21:26:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed_ops": 0, 2024-09-10T21:26:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed": 0, 2024-09-10T21:26:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_item_in_journal": 0 2024-09-10T21:26:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:26:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-10T21:26:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-09-10T21:26:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-10T21:26:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 2558, 2024-09-10T21:26:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 965806, 2024-09-10T21:26:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-10T21:26:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 2558, 2024-09-10T21:26:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-10T21:26:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-10T21:26:56.472 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2558, 2024-09-10T21:26:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 965806, 2024-09-10T21:26:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-10T21:26:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_bytes": { 2024-09-10T21:26:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-10T21:26:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-09-10T21:26:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-10T21:26:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-10T21:26:56.473 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-10T21:26:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-10T21:26:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-10T21:26:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 2322, 2024-09-10T21:26:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 901, 2024-09-10T21:26:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2322, 2024-09-10T21:26:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 901, 2024-09-10T21:26:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-10T21:26:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_ops": { 2024-09-10T21:26:56.474 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-10T21:26:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1024, 2024-09-10T21:26:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-10T21:26:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-10T21:26:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-10T21:26:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-10T21:26:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-10T21:26:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 2322, 2024-09-10T21:26:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 2322, 2024-09-10T21:26:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2322, 2024-09-10T21:26:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 2322, 2024-09-10T21:26:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-10T21:26:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.475 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle": { 2024-09-10T21:26:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-10T21:26:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-09-10T21:26:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-10T21:26:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-10T21:26:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-10T21:26:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-10T21:26:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-10T21:26:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-10T21:26:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-10T21:26:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 0, 2024-09-10T21:26:56.476 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 0, 2024-09-10T21:26:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-10T21:26:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle-0x55eabf3b5040": { 2024-09-10T21:26:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-10T21:26:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-09-10T21:26:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-10T21:26:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-10T21:26:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-10T21:26:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-10T21:26:56.477 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-10T21:26:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-10T21:26:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-10T21:26:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 0, 2024-09-10T21:26:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 0, 2024-09-10T21:26:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-10T21:26:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: "trackedop": { 2024-09-10T21:26:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_ops_count": 0 2024-09-10T21:26:56.478 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:56.478 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:26:56.660 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:56 smithi059 ceph-mon[30888]: pgmap v690: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-10T21:26:56.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:56 smithi192 ceph-mon[35363]: pgmap v690: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-10T21:26:56.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:56 smithi154 ceph-mon[35041]: pgmap v690: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-10T21:26:57.317 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-10T21:26:57.317 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-10T21:26:57.317 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-09-10T21:26:57.318 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-09-10T21:26:57.318 DEBUG:tasks.check_counter:Getting stats from j 2024-09-10T21:26:57.318 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-10T21:26:57.580 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:26:58.116 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-10T21:26:58.117 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:26:58.117 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 236, 2024-09-10T21:26:58.117 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 231, 2024-09-10T21:26:58.117 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 531040, 2024-09-10T21:26:58.117 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 141312, 2024-09-10T21:26:58.117 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 4, 2024-09-10T21:26:58.117 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 0, 2024-09-10T21:26:58.117 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.041021647, 2024-09-10T21:26:58.117 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.020429700, 2024-09-10T21:26:58.117 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.023386439, 2024-09-10T21:26:58.118 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:26:58.118 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:26:58.118 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 231, 2024-09-10T21:26:58.118 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.018187277, 2024-09-10T21:26:58.118 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000078732 2024-09-10T21:26:58.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:58.118 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:26:58.118 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:58.118 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:58.118 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:58.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:58.119 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 531040, 2024-09-10T21:26:58.119 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 141312 2024-09-10T21:26:58.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:58.119 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:26:58.119 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 1, 2024-09-10T21:26:58.119 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 174, 2024-09-10T21:26:58.119 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 160, 2024-09-10T21:26:58.119 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 110864, 2024-09-10T21:26:58.119 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 3, 2024-09-10T21:26:58.119 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 2, 2024-09-10T21:26:58.119 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.017583184, 2024-09-10T21:26:58.120 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.014327507, 2024-09-10T21:26:58.120 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.001272804, 2024-09-10T21:26:58.120 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:26:58.120 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:26:58.120 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 172, 2024-09-10T21:26:58.120 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.009493966, 2024-09-10T21:26:58.120 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000055197 2024-09-10T21:26:58.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:58.120 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:26:58.120 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:58.120 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:58.120 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:58.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:58.121 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T21:26:58.121 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 110864 2024-09-10T21:26:58.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:58.121 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:26:58.121 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 0, 2024-09-10T21:26:58.121 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 2, 2024-09-10T21:26:58.122 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 0, 2024-09-10T21:26:58.122 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 0, 2024-09-10T21:26:58.122 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 2, 2024-09-10T21:26:58.122 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 1, 2024-09-10T21:26:58.122 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.000346354, 2024-09-10T21:26:58.122 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T21:26:58.122 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.000279621, 2024-09-10T21:26:58.122 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T21:26:58.122 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:26:58.122 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:58.122 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:58.122 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:58.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:58.122 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:26:58.122 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:58.123 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:58.123 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:58.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:58.123 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T21:26:58.123 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T21:26:58.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:58.123 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-09-10T21:26:58.123 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 0, 2024-09-10T21:26:58.123 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-09-10T21:26:58.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:58.123 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-09-10T21:26:58.123 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:26:58.123 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-09-10T21:26:58.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:26:58.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:26:58.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:26:58.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:26:58.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:26:58.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:26:58.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:26:58.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:26:58.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:26:58.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:26:58.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:26:58.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:26:58.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:26:58.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-09-10T21:26:58.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:26:58.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-09-10T21:26:58.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:26:58.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:26:58.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:26:58.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:26:58.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:26:58.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:26:58.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:26:58.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-09-10T21:26:58.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:26:58.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:26:58.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:26:58.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-09-10T21:26:58.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-09-10T21:26:58.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-09-10T21:26:58.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:26:58.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:26:58.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:26:58.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:26:58.126 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 148967, 2024-09-10T21:26:58.126 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 29, 2024-09-10T21:26:58.126 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:26:58.127 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2024-09-10T21:26:58.127 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-09-10T21:26:58.127 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-09-10T21:26:58.127 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:26:58.127 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-09-10T21:26:58.127 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:26:58.127 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-09-10T21:26:58.127 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 0, 2024-09-10T21:26:58.127 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 0, 2024-09-10T21:26:58.127 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:26:58.127 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:26:58.127 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-09-10T21:26:58.128 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-09-10T21:26:58.128 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 968, 2024-09-10T21:26:58.128 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 2, 2024-09-10T21:26:58.128 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-09-10T21:26:58.128 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-09-10T21:26:58.128 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-09-10T21:26:58.128 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-09-10T21:26:58.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-10T21:26:58.128 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:26:58.128 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-10T21:26:58.128 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-09-10T21:26:58.128 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-10T21:26:58.128 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 233, 2024-09-10T21:26:58.129 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 495233, 2024-09-10T21:26:58.129 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-10T21:26:58.129 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 233, 2024-09-10T21:26:58.129 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-10T21:26:58.129 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-10T21:26:58.129 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 233, 2024-09-10T21:26:58.129 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 495233, 2024-09-10T21:26:58.129 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-10T21:26:58.129 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-10T21:26:58.129 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-10T21:26:58.129 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-10T21:26:58.129 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:58.129 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-10T21:26:58.129 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-10T21:26:58.799 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:26:58 smithi059 ceph-mon[30888]: pgmap v691: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T21:26:58.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:26:58 smithi192 ceph-mon[35363]: pgmap v691: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T21:26:58.830 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-10T21:26:58.830 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-10T21:26:58.830 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-10T21:26:58.830 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-10T21:26:58.830 DEBUG:tasks.check_counter:Getting stats from b 2024-09-10T21:26:58.830 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-10T21:26:58.858 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:26:58 smithi154 ceph-mon[35041]: pgmap v691: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T21:26:59.095 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:26:59.574 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-10T21:26:59.574 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:26:59.574 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 4586, 2024-09-10T21:26:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 4810, 2024-09-10T21:26:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 1196788, 2024-09-10T21:26:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 8853921, 2024-09-10T21:26:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 10, 2024-09-10T21:26:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 5, 2024-09-10T21:26:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.458520028, 2024-09-10T21:26:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.220690920, 2024-09-10T21:26:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.150107468, 2024-09-10T21:26:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.075030416, 2024-09-10T21:26:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:26:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 4809, 2024-09-10T21:26:59.575 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1.836395393, 2024-09-10T21:26:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000381866 2024-09-10T21:26:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:26:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2895, 2024-09-10T21:26:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000620548, 2024-09-10T21:26:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000214 2024-09-10T21:26:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T21:26:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T21:26:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:26:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 1015, 2024-09-10T21:26:59.576 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 1293, 2024-09-10T21:26:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 328542, 2024-09-10T21:26:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 725151, 2024-09-10T21:26:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 12, 2024-09-10T21:26:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 7, 2024-09-10T21:26:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.113810855, 2024-09-10T21:26:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.060286384, 2024-09-10T21:26:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.054656995, 2024-09-10T21:26:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.006268823, 2024-09-10T21:26:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:26:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1291, 2024-09-10T21:26:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.759709679, 2024-09-10T21:26:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000588466 2024-09-10T21:26:59.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:26:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1450, 2024-09-10T21:26:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000321302, 2024-09-10T21:26:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000221 2024-09-10T21:26:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T21:26:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 393072 2024-09-10T21:26:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:26:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 3646, 2024-09-10T21:26:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 5389, 2024-09-10T21:26:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 1713374, 2024-09-10T21:26:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 3913257, 2024-09-10T21:26:59.578 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 159, 2024-09-10T21:26:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 8, 2024-09-10T21:26:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.608957958, 2024-09-10T21:26:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.289440472, 2024-09-10T21:26:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.294403523, 2024-09-10T21:26:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.053696058, 2024-09-10T21:26:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:26:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 5388, 2024-09-10T21:26:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.426374216, 2024-09-10T21:26:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000079134 2024-09-10T21:26:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:26:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 6612, 2024-09-10T21:26:59.579 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.001436242, 2024-09-10T21:26:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000217 2024-09-10T21:26:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 1491984, 2024-09-10T21:26:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 1691568 2024-09-10T21:26:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-10T21:26:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-10T21:26:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-10T21:26:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-10T21:26:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-10T21:26:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-10T21:26:59.580 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 5144, 2024-09-10T21:26:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1.591485940, 2024-09-10T21:26:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000309386 2024-09-10T21:26:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:26:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-10T21:26:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-10T21:26:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-10T21:26:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 24, 2024-09-10T21:26:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000609391, 2024-09-10T21:26:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000025391 2024-09-10T21:26:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:26:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-10T21:26:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 644, 2024-09-10T21:26:59.581 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 644, 2024-09-10T21:26:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-10T21:26:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 644, 2024-09-10T21:26:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 3.072432327, 2024-09-10T21:26:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.004770857 2024-09-10T21:26:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-10T21:26:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-09-10T21:26:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-10T21:26:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-10T21:26:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 12, 2024-09-10T21:26:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-10T21:26:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-10T21:26:59.582 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 24, 2024-09-10T21:26:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-09-10T21:26:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 24, 2024-09-10T21:26:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-10T21:26:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 23, 2024-09-10T21:26:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-09-10T21:26:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 1, 2024-09-10T21:26:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 1, 2024-09-10T21:26:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 2, 2024-09-10T21:26:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 780, 2024-09-10T21:26:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 771, 2024-09-10T21:26:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-10T21:26:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-09-10T21:26:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-10T21:26:59.583 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-10T21:26:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-10T21:26:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 3, 2024-09-10T21:26:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-10T21:26:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-10T21:26:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-10T21:26:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-10T21:26:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-10T21:26:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-10T21:26:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 276, 2024-09-10T21:26:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-10T21:26:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 4, 2024-09-10T21:26:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 234, 2024-09-10T21:26:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-10T21:26:59.584 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 276, 2024-09-10T21:26:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-10T21:26:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T21:26:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-10T21:26:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 178, 2024-09-10T21:26:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 20, 2024-09-10T21:26:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 158, 2024-09-10T21:26:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 98, 2024-09-10T21:26:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-10T21:26:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 647, 2024-09-10T21:26:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 630, 2024-09-10T21:26:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 599, 2024-09-10T21:26:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T21:26:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T21:26:59.585 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 753, 2024-09-10T21:26:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 714, 2024-09-10T21:26:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 2, 2024-09-10T21:26:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 621 2024-09-10T21:26:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-10T21:26:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 15, 2024-09-10T21:26:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-10T21:26:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-10T21:26:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-09-10T21:26:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 32, 2024-09-10T21:26:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-10T21:26:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-10T21:26:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-10T21:26:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 3, 2024-09-10T21:26:59.586 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 3, 2024-09-10T21:26:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-10T21:26:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-10T21:26:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-10T21:26:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-10T21:26:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-10T21:26:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-10T21:26:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-10T21:26:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-10T21:26:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-10T21:26:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 20, 2024-09-10T21:26:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-10T21:26:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-10T21:26:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-10T21:26:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-10T21:26:59.587 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0, 2024-09-10T21:26:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_started": 0, 2024-09-10T21:26:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_succeeded": 0, 2024-09-10T21:26:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_write_failed": 0 2024-09-10T21:26:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-10T21:26:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-10T21:26:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 2226, 2024-09-10T21:26:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-10T21:26:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-10T21:26:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 2226, 2024-09-10T21:26:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-10T21:26:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-10T21:26:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 4, 2024-09-10T21:26:59.588 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-10T21:26:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-10T21:26:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 4, 2024-09-10T21:26:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-09-10T21:26:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-10T21:26:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-10T21:26:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-09-10T21:26:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 11613151, 2024-09-10T21:26:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 0, 2024-09-10T21:26:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-10T21:26:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2211, 2024-09-10T21:26:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 4.444303888, 2024-09-10T21:26:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.002010087 2024-09-10T21:26:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 0 2024-09-10T21:26:59.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-10T21:26:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 23, 2024-09-10T21:26:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 46, 2024-09-10T21:26:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 23, 2024-09-10T21:26:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 18, 2024-09-10T21:26:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 20, 2024-09-10T21:26:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 2, 2024-09-10T21:26:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 24, 2024-09-10T21:26:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 29, 2024-09-10T21:26:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 5, 2024-09-10T21:26:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 1, 2024-09-10T21:26:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 15, 2024-09-10T21:26:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 14, 2024-09-10T21:26:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 58628, 2024-09-10T21:26:59.590 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 272424960 2024-09-10T21:26:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-10T21:26:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 1866, 2024-09-10T21:26:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-10T21:26:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 644, 2024-09-10T21:26:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 16, 2024-09-10T21:26:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-10T21:26:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-10T21:26:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 5, 2024-09-10T21:26:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.003263937, 2024-09-10T21:26:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000652787 2024-09-10T21:26:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-10T21:26:59.591 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 16, 2024-09-10T21:26:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.003636075, 2024-09-10T21:26:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000227254 2024-09-10T21:26:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-10T21:26:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-10T21:26:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-10T21:26:59.592 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-10T21:26:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-10T21:26:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-10T21:26:59.593 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-10T21:26:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-10T21:26:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-10T21:26:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-10T21:26:59.595 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 8, 2024-09-10T21:26:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.012871795, 2024-09-10T21:26:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001608974 2024-09-10T21:26:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-10T21:26:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-10T21:26:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.596 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-10T21:26:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1, 2024-09-10T21:26:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000208361, 2024-09-10T21:26:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000208361 2024-09-10T21:26:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-10T21:26:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-09-10T21:26:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.004336501, 2024-09-10T21:26:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.002168250 2024-09-10T21:26:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-10T21:26:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-09-10T21:26:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.002213485, 2024-09-10T21:26:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001106742 2024-09-10T21:26:59.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-10T21:26:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-10T21:26:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.598 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.600 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.600 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-10T21:26:59.600 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-09-10T21:26:59.600 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.013096518, 2024-09-10T21:26:59.600 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.006548259 2024-09-10T21:26:59.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.600 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-10T21:26:59.600 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-10T21:26:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-10T21:26:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 600, 2024-09-10T21:26:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 3.012519263, 2024-09-10T21:26:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.005020865 2024-09-10T21:26:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.601 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-10T21:26:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-10T21:26:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-10T21:26:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.602 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-10T21:26:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 7, 2024-09-10T21:26:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.018650274, 2024-09-10T21:26:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.002664324 2024-09-10T21:26:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-10T21:26:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-10T21:26:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1, 2024-09-10T21:26:59.603 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.001636118, 2024-09-10T21:26:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001636118 2024-09-10T21:26:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-10T21:26:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-10T21:26:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-10T21:26:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:26:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-10T21:26:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-09-10T21:26:59.604 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 2, 2024-09-10T21:26:59.605 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 1, 2024-09-10T21:26:59.605 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 1, 2024-09-10T21:26:59.605 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-10T21:26:59.605 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 89, 2024-09-10T21:26:59.605 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 89, 2024-09-10T21:26:59.605 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 708, 2024-09-10T21:26:59.605 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-10T21:26:59.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.605 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-10T21:26:59.605 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:26:59.605 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-10T21:26:59.605 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:26:59.606 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:26:59.606 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:26:59.606 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:26:59.606 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:26:59.606 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:26:59.606 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:26:59.606 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:26:59.606 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:26:59.606 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:26:59.606 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:26:59.606 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:26:59.606 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:26:59.606 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-10T21:26:59.606 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:26:59.607 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-10T21:26:59.607 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:26:59.607 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:26:59.607 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:26:59.607 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:26:59.607 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:26:59.607 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:26:59.607 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:26:59.607 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-10T21:26:59.607 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:26:59.607 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:26:59.607 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:26:59.607 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-10T21:26:59.607 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-10T21:26:59.608 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-10T21:26:59.608 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:26:59.608 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:26:59.608 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:26:59.608 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:26:59.608 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 323255, 2024-09-10T21:26:59.608 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 130, 2024-09-10T21:26:59.608 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:26:59.608 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-10T21:26:59.608 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-10T21:26:59.608 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-10T21:26:59.608 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:26:59.608 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-10T21:26:59.608 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:26:59.608 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-10T21:26:59.609 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 7400, 2024-09-10T21:26:59.609 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 152, 2024-09-10T21:26:59.609 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:26:59.609 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:26:59.609 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-10T21:26:59.609 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-10T21:26:59.609 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 97458, 2024-09-10T21:26:59.609 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 706, 2024-09-10T21:26:59.609 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-10T21:26:59.609 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-10T21:26:59.609 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-10T21:26:59.609 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-10T21:26:59.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.610 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-10T21:26:59.610 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-10T21:26:59.610 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-10T21:26:59.610 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 3745, 2024-09-10T21:26:59.610 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 7439499, 2024-09-10T21:26:59.610 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 37, 2024-09-10T21:26:59.610 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 3745, 2024-09-10T21:26:59.610 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-10T21:26:59.610 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3745, 2024-09-10T21:26:59.610 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 23.871360228, 2024-09-10T21:26:59.610 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.006374194 2024-09-10T21:26:59.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.610 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-10T21:26:59.610 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-10T21:26:59.610 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3745, 2024-09-10T21:26:59.611 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 3789 2024-09-10T21:26:59.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.611 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 3745, 2024-09-10T21:26:59.611 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 318, 2024-09-10T21:26:59.611 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 3427, 2024-09-10T21:26:59.611 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-10T21:26:59.611 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-10T21:26:59.611 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 0, 2024-09-10T21:26:59.611 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 11, 2024-09-10T21:26:59.611 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 22, 2024-09-10T21:26:59.611 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 2213, 2024-09-10T21:26:59.611 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 55, 2024-09-10T21:26:59.611 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-10T21:26:59.611 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-10T21:26:59.612 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-10T21:26:59.612 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-10T21:26:59.612 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 516, 2024-09-10T21:26:59.612 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-10T21:26:59.612 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-10T21:26:59.612 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-10T21:26:59.612 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 296, 2024-09-10T21:26:59.612 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 22, 2024-09-10T21:26:59.612 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-10T21:26:59.612 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-10T21:26:59.612 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-10T21:26:59.612 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-10T21:26:59.612 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-10T21:26:59.612 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-10T21:26:59.613 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T21:26:59.613 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-10T21:26:59.613 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-10T21:26:59.613 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 599, 2024-09-10T21:26:59.613 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-10T21:26:59.613 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-10T21:26:59.613 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-10T21:26:59.613 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-10T21:26:59.613 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-10T21:26:59.613 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-10T21:26:59.613 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-10T21:26:59.613 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-10T21:26:59.613 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-10T21:26:59.614 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-10T21:26:59.614 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-10T21:26:59.614 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-10T21:26:59.614 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-10T21:26:59.614 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-10T21:26:59.614 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-10T21:26:59.614 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-10T21:26:59.614 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 75, 2024-09-10T21:26:59.614 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-10T21:26:59.614 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 2, 2024-09-10T21:26:59.614 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 12, 2024-09-10T21:26:59.614 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 12, 2024-09-10T21:26:59.614 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-10T21:26:59.614 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-10T21:26:59.615 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 46, 2024-09-10T21:26:59.615 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 0, 2024-09-10T21:26:59.615 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 9 2024-09-10T21:26:59.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.615 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-10T21:26:59.615 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 1, 2024-09-10T21:26:59.615 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-10T21:26:59.615 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-10T21:26:59.615 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-10T21:26:59.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.615 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-10T21:26:59.615 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-10T21:26:59.615 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 2, 2024-09-10T21:26:59.615 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-10T21:26:59.615 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 2, 2024-09-10T21:26:59.616 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 3, 2024-09-10T21:26:59.616 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 3, 2024-09-10T21:26:59.616 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-10T21:26:59.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.616 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:26:59.616 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:26:59.616 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-10T21:26:59.616 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:26:59.616 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 9243, 2024-09-10T21:26:59.616 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 2287893, 2024-09-10T21:26:59.616 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:26:59.616 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 9243, 2024-09-10T21:26:59.616 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T21:26:59.616 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T21:26:59.617 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 9243, 2024-09-10T21:26:59.617 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 2287893, 2024-09-10T21:26:59.617 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:26:59.617 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.617 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.617 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.617 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:26:59.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.617 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-10T21:26:59.617 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:26:59.617 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-10T21:26:59.617 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:26:59.617 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T21:26:59.617 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T21:26:59.618 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:26:59.618 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T21:26:59.618 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 3745, 2024-09-10T21:26:59.618 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 7439802, 2024-09-10T21:26:59.618 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 3745, 2024-09-10T21:26:59.618 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 7439802, 2024-09-10T21:26:59.618 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:26:59.618 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.618 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.618 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.618 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:26:59.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.618 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-10T21:26:59.618 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:26:59.619 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-10T21:26:59.619 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:26:59.619 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T21:26:59.619 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T21:26:59.619 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:26:59.619 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T21:26:59.619 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 3745, 2024-09-10T21:26:59.619 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 3745, 2024-09-10T21:26:59.619 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 3745, 2024-09-10T21:26:59.619 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 3745, 2024-09-10T21:26:59.619 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:26:59.619 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.619 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.619 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.620 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:26:59.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.620 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-10T21:26:59.620 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:26:59.620 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-10T21:26:59.620 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:26:59.620 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 3, 2024-09-10T21:26:59.620 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 303, 2024-09-10T21:26:59.620 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:26:59.620 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 3, 2024-09-10T21:26:59.620 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T21:26:59.620 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T21:26:59.620 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2, 2024-09-10T21:26:59.620 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 303, 2024-09-10T21:26:59.621 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:26:59.621 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.621 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.621 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.621 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:26:59.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.621 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x562d923c2dc0": { 2024-09-10T21:26:59.621 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:26:59.621 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-10T21:26:59.621 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:26:59.621 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 2226, 2024-09-10T21:26:59.621 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 7418847, 2024-09-10T21:26:59.621 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:26:59.621 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 2226, 2024-09-10T21:26:59.622 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T21:26:59.622 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T21:26:59.622 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2211, 2024-09-10T21:26:59.622 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 7418847, 2024-09-10T21:26:59.622 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:26:59.622 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:26:59.622 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:26:59.622 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:26:59.622 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:26:59.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:26:59.622 INFO:teuthology.orchestra.run.smithi154.stdout: "trackedop": { 2024-09-10T21:26:59.622 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-10T21:26:59.622 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:26:59.622 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-10T21:27:00.563 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-10T21:27:00.563 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-10T21:27:00.563 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=15 2024-09-10T21:27:00.563 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-10T21:27:00.563 DEBUG:tasks.check_counter:Getting stats from e 2024-09-10T21:27:00.564 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-10T21:27:00.828 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:00 smithi192 ceph-mon[35363]: pgmap v692: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T21:27:00.856 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:27:00.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:00 smithi059 ceph-mon[30888]: pgmap v692: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T21:27:00.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:00 smithi154 ceph-mon[35041]: pgmap v692: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-10T21:27:01.355 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-10T21:27:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:27:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 1915, 2024-09-10T21:27:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 1911, 2024-09-10T21:27:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 5239030, 2024-09-10T21:27:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 674222, 2024-09-10T21:27:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 5, 2024-09-10T21:27:01.355 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 1, 2024-09-10T21:27:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.220860279, 2024-09-10T21:27:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.112336526, 2024-09-10T21:27:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.061411070, 2024-09-10T21:27:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.037788983, 2024-09-10T21:27:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1910, 2024-09-10T21:27:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.077638902, 2024-09-10T21:27:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000040648 2024-09-10T21:27:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.356 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 551072, 2024-09-10T21:27:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 141568 2024-09-10T21:27:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:27:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 301, 2024-09-10T21:27:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 473, 2024-09-10T21:27:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 74632, 2024-09-10T21:27:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 482762, 2024-09-10T21:27:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 5, 2024-09-10T21:27:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-09-10T21:27:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.043775850, 2024-09-10T21:27:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.021451372, 2024-09-10T21:27:01.357 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.008205358, 2024-09-10T21:27:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.010076363, 2024-09-10T21:27:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 471, 2024-09-10T21:27:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.022683653, 2024-09-10T21:27:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000048160 2024-09-10T21:27:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T21:27:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 387296 2024-09-10T21:27:01.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:27:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 1077, 2024-09-10T21:27:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 1077, 2024-09-10T21:27:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 3496463, 2024-09-10T21:27:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 341669, 2024-09-10T21:27:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 4, 2024-09-10T21:27:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 3, 2024-09-10T21:27:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.107897450, 2024-09-10T21:27:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.041933210, 2024-09-10T21:27:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.029232489, 2024-09-10T21:27:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.029118713, 2024-09-10T21:27:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1076, 2024-09-10T21:27:01.359 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.034802337, 2024-09-10T21:27:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000032344 2024-09-10T21:27:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T21:27:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T21:27:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-10T21:27:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-10T21:27:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-10T21:27:01.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-10T21:27:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-10T21:27:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-10T21:27:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 5180, 2024-09-10T21:27:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.119428157, 2024-09-10T21:27:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000023055 2024-09-10T21:27:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-10T21:27:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-10T21:27:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-10T21:27:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.361 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-10T21:27:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-09-10T21:27:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-09-10T21:27:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-10T21:27:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-10T21:27:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-09-10T21:27:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-10T21:27:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-10T21:27:01.362 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 0, 2024-09-10T21:27:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-10T21:27:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-10T21:27:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 17, 2024-09-10T21:27:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-09-10T21:27:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 17, 2024-09-10T21:27:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-10T21:27:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 17, 2024-09-10T21:27:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-09-10T21:27:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-10T21:27:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-10T21:27:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 2, 2024-09-10T21:27:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-09-10T21:27:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-09-10T21:27:01.363 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-10T21:27:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-09-10T21:27:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-10T21:27:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-10T21:27:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-10T21:27:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-10T21:27:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-10T21:27:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-10T21:27:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-10T21:27:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-10T21:27:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-10T21:27:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-10T21:27:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-10T21:27:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-10T21:27:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 4, 2024-09-10T21:27:01.364 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 234, 2024-09-10T21:27:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-10T21:27:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T21:27:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-10T21:27:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T21:27:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-10T21:27:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-10T21:27:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T21:27:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T21:27:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-10T21:27:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-10T21:27:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T21:27:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-09-10T21:27:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T21:27:01.365 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T21:27:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T21:27:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-09-10T21:27:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-09-10T21:27:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-09-10T21:27:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-09-10T21:27:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-10T21:27:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-10T21:27:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-10T21:27:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-10T21:27:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-09-10T21:27:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-09-10T21:27:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-10T21:27:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-10T21:27:01.366 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-10T21:27:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-09-10T21:27:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-09-10T21:27:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-10T21:27:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-10T21:27:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-10T21:27:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-10T21:27:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-10T21:27:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-10T21:27:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-10T21:27:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-10T21:27:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-10T21:27:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T21:27:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-10T21:27:01.367 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-10T21:27:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-10T21:27:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-10T21:27:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0, 2024-09-10T21:27:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_started": 0, 2024-09-10T21:27:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_succeeded": 0, 2024-09-10T21:27:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_write_failed": 0 2024-09-10T21:27:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-10T21:27:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-10T21:27:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 0, 2024-09-10T21:27:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-10T21:27:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-10T21:27:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 2226, 2024-09-10T21:27:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-10T21:27:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-10T21:27:01.368 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 0, 2024-09-10T21:27:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-10T21:27:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-10T21:27:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 4, 2024-09-10T21:27:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-09-10T21:27:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-10T21:27:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-10T21:27:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-09-10T21:27:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 11613151, 2024-09-10T21:27:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 11611499, 2024-09-10T21:27:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-10T21:27:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.369 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 2226 2024-09-10T21:27:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-10T21:27:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 14, 2024-09-10T21:27:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 17, 2024-09-10T21:27:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 3, 2024-09-10T21:27:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 9, 2024-09-10T21:27:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 11, 2024-09-10T21:27:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 2, 2024-09-10T21:27:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 17, 2024-09-10T21:27:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 19, 2024-09-10T21:27:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 2, 2024-09-10T21:27:01.370 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-10T21:27:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-09-10T21:27:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-09-10T21:27:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 48424, 2024-09-10T21:27:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 249290752 2024-09-10T21:27:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-10T21:27:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-09-10T21:27:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-10T21:27:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-09-10T21:27:01.371 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 0, 2024-09-10T21:27:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-10T21:27:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-10T21:27:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-10T21:27:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.372 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-10T21:27:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-10T21:27:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-10T21:27:01.373 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-10T21:27:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-10T21:27:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-10T21:27:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-10T21:27:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-10T21:27:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.376 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-10T21:27:01.376 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.376 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.376 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.376 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-10T21:27:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-10T21:27:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-10T21:27:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.377 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-10T21:27:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-10T21:27:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-10T21:27:01.378 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-10T21:27:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-10T21:27:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.379 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-10T21:27:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-10T21:27:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-10T21:27:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-10T21:27:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-10T21:27:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-10T21:27:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.381 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-10T21:27:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-10T21:27:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-10T21:27:01.382 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-10T21:27:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-10T21:27:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-10T21:27:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-10T21:27:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.383 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-10T21:27:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 1, 2024-09-10T21:27:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 2, 2024-09-10T21:27:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 1, 2024-09-10T21:27:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 1, 2024-09-10T21:27:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-10T21:27:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-09-10T21:27:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-09-10T21:27:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 1980, 2024-09-10T21:27:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-10T21:27:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-10T21:27:01.384 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:27:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-10T21:27:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:27:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:27:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:27:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:27:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:27:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:27:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:27:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:27:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:27:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:27:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:27:01.385 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:27:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:27:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-10T21:27:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:27:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-10T21:27:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:27:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:27:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:27:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:27:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:27:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:27:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:27:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-10T21:27:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:27:01.386 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:27:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:27:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-10T21:27:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-10T21:27:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-10T21:27:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:27:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:27:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:27:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:27:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 189400, 2024-09-10T21:27:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 51, 2024-09-10T21:27:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:27:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-10T21:27:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-10T21:27:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-10T21:27:01.387 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:27:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-10T21:27:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:27:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-10T21:27:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 7400, 2024-09-10T21:27:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 152, 2024-09-10T21:27:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:27:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:27:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-10T21:27:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-10T21:27:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 55010, 2024-09-10T21:27:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 257, 2024-09-10T21:27:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-10T21:27:01.388 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-10T21:27:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-10T21:27:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-10T21:27:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-10T21:27:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-10T21:27:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-10T21:27:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 3048, 2024-09-10T21:27:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 26, 2024-09-10T21:27:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 4, 2024-09-10T21:27:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 3048, 2024-09-10T21:27:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-10T21:27:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3048, 2024-09-10T21:27:01.389 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1.347963589, 2024-09-10T21:27:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000442245 2024-09-10T21:27:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-10T21:27:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-10T21:27:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3048, 2024-09-10T21:27:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 3049 2024-09-10T21:27:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 3048, 2024-09-10T21:27:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 3048, 2024-09-10T21:27:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 0, 2024-09-10T21:27:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-10T21:27:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-10T21:27:01.390 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 1611, 2024-09-10T21:27:01.391 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 0, 2024-09-10T21:27:01.391 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 1434, 2024-09-10T21:27:01.391 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 0, 2024-09-10T21:27:01.391 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 0, 2024-09-10T21:27:01.391 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-10T21:27:01.391 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-10T21:27:01.391 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-10T21:27:01.391 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-10T21:27:01.391 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 0, 2024-09-10T21:27:01.391 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-10T21:27:01.391 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-10T21:27:01.391 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-10T21:27:01.391 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 2, 2024-09-10T21:27:01.391 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 0, 2024-09-10T21:27:01.391 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-10T21:27:01.392 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-10T21:27:01.392 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-10T21:27:01.392 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-10T21:27:01.392 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-10T21:27:01.392 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-10T21:27:01.392 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T21:27:01.392 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-10T21:27:01.392 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-10T21:27:01.392 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-10T21:27:01.392 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-10T21:27:01.392 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-10T21:27:01.392 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-10T21:27:01.392 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-10T21:27:01.393 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-10T21:27:01.393 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-10T21:27:01.393 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-10T21:27:01.393 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-10T21:27:01.393 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-10T21:27:01.393 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-10T21:27:01.393 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-10T21:27:01.393 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-10T21:27:01.393 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-10T21:27:01.393 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-10T21:27:01.393 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-10T21:27:01.393 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-10T21:27:01.393 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 75, 2024-09-10T21:27:01.394 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-10T21:27:01.394 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 2, 2024-09-10T21:27:01.394 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 5, 2024-09-10T21:27:01.394 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 5, 2024-09-10T21:27:01.394 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-10T21:27:01.394 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-10T21:27:01.394 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 0, 2024-09-10T21:27:01.394 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 2, 2024-09-10T21:27:01.394 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 0 2024-09-10T21:27:01.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.394 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-10T21:27:01.394 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 0, 2024-09-10T21:27:01.394 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-10T21:27:01.395 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-10T21:27:01.395 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-10T21:27:01.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.395 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-10T21:27:01.395 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-10T21:27:01.395 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T21:27:01.395 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-10T21:27:01.395 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-09-10T21:27:01.395 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-09-10T21:27:01.395 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-09-10T21:27:01.395 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-10T21:27:01.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.395 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:27:01.395 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:27:01.396 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-10T21:27:01.396 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:27:01.396 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 3289, 2024-09-10T21:27:01.396 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 8498764, 2024-09-10T21:27:01.396 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:01.396 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 3289, 2024-09-10T21:27:01.396 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T21:27:01.396 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T21:27:01.396 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 3289, 2024-09-10T21:27:01.396 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 8498764, 2024-09-10T21:27:01.396 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:27:01.396 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.396 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.396 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.396 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:01.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.397 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-10T21:27:01.397 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:27:01.397 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-10T21:27:01.397 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:27:01.397 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T21:27:01.397 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T21:27:01.397 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:01.397 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:01.397 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 3048, 2024-09-10T21:27:01.397 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 7418857, 2024-09-10T21:27:01.397 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 3048, 2024-09-10T21:27:01.397 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 7418857, 2024-09-10T21:27:01.398 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:27:01.398 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.398 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.398 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.398 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:01.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.398 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-10T21:27:01.398 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:27:01.398 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-10T21:27:01.398 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:27:01.398 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T21:27:01.398 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T21:27:01.398 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:01.398 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:01.399 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 3048, 2024-09-10T21:27:01.399 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 3048, 2024-09-10T21:27:01.399 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 3048, 2024-09-10T21:27:01.399 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 3048, 2024-09-10T21:27:01.399 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:27:01.399 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.399 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.399 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.399 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:01.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.399 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-10T21:27:01.399 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:27:01.399 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-10T21:27:01.399 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:27:01.400 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T21:27:01.400 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T21:27:01.400 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:01.400 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:01.400 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T21:27:01.400 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T21:27:01.400 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-10T21:27:01.400 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-10T21:27:01.400 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:27:01.400 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.400 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.400 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.400 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:01.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.401 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x55a87b2ab040": { 2024-09-10T21:27:01.401 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:27:01.401 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-10T21:27:01.401 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:27:01.401 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T21:27:01.401 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T21:27:01.401 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:01.401 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:01.401 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T21:27:01.401 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T21:27:01.401 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-10T21:27:01.401 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-10T21:27:01.401 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:27:01.402 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:01.402 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:01.402 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:01.402 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:01.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:01.402 INFO:teuthology.orchestra.run.smithi154.stdout: "trackedop": { 2024-09-10T21:27:01.402 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-10T21:27:01.402 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:01.402 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-10T21:27:02.157 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-10T21:27:02.157 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-10T21:27:02.158 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-10T21:27:02.158 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-10T21:27:02.158 DEBUG:tasks.check_counter:Getting stats from h 2024-09-10T21:27:02.158 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-10T21:27:02.414 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:27:02.814 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:02 smithi154 ceph-mon[35041]: pgmap v693: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:27:02.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:02 smithi192 ceph-mon[35363]: pgmap v693: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:27:02.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:02 smithi059 ceph-mon[30888]: pgmap v693: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:27:02.922 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-10T21:27:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:27:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 870, 2024-09-10T21:27:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 762, 2024-09-10T21:27:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 212152, 2024-09-10T21:27:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 633046, 2024-09-10T21:27:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 49, 2024-09-10T21:27:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-09-10T21:27:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.117903885, 2024-09-10T21:27:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.054454672, 2024-09-10T21:27:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.058283995, 2024-09-10T21:27:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.004311934, 2024-09-10T21:27:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 762, 2024-09-10T21:27:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.052761766, 2024-09-10T21:27:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000069241 2024-09-10T21:27:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1538, 2024-09-10T21:27:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000320841, 2024-09-10T21:27:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000208 2024-09-10T21:27:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T21:27:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T21:27:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:27:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 75, 2024-09-10T21:27:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 244, 2024-09-10T21:27:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 29469, 2024-09-10T21:27:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 423847, 2024-09-10T21:27:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 8, 2024-09-10T21:27:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 5, 2024-09-10T21:27:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.022109557, 2024-09-10T21:27:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.012527774, 2024-09-10T21:27:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.007994009, 2024-09-10T21:27:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000343037, 2024-09-10T21:27:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 243, 2024-09-10T21:27:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.035040495, 2024-09-10T21:27:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000144199 2024-09-10T21:27:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 97, 2024-09-10T21:27:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000023977, 2024-09-10T21:27:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000247 2024-09-10T21:27:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T21:27:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 389216 2024-09-10T21:27:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:27:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 394, 2024-09-10T21:27:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 386, 2024-09-10T21:27:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 621568, 2024-09-10T21:27:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 242899, 2024-09-10T21:27:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 12, 2024-09-10T21:27:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 6, 2024-09-10T21:27:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.052397739, 2024-09-10T21:27:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.025285149, 2024-09-10T21:27:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.040240673, 2024-09-10T21:27:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000104470, 2024-09-10T21:27:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 383, 2024-09-10T21:27:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.032320179, 2024-09-10T21:27:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000084386 2024-09-10T21:27:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 195, 2024-09-10T21:27:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000036992, 2024-09-10T21:27:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000189 2024-09-10T21:27:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 574544, 2024-09-10T21:27:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 145408 2024-09-10T21:27:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-10T21:27:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-10T21:27:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-10T21:27:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-10T21:27:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-10T21:27:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-10T21:27:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 40, 2024-09-10T21:27:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.001320924, 2024-09-10T21:27:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000033023 2024-09-10T21:27:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-10T21:27:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-10T21:27:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-10T21:27:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-09-10T21:27:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000008329, 2024-09-10T21:27:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000004164 2024-09-10T21:27:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-10T21:27:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-09-10T21:27:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-09-10T21:27:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-10T21:27:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-10T21:27:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-09-10T21:27:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-10T21:27:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-10T21:27:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 11, 2024-09-10T21:27:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-10T21:27:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-10T21:27:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 16, 2024-09-10T21:27:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-09-10T21:27:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 16, 2024-09-10T21:27:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-10T21:27:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 13, 2024-09-10T21:27:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 4, 2024-09-10T21:27:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-10T21:27:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-10T21:27:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 3, 2024-09-10T21:27:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 7, 2024-09-10T21:27:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 4, 2024-09-10T21:27:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-10T21:27:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 3, 2024-09-10T21:27:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-10T21:27:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-10T21:27:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-10T21:27:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-10T21:27:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-10T21:27:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-10T21:27:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-10T21:27:02.932 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-10T21:27:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-10T21:27:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-10T21:27:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-10T21:27:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-10T21:27:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 4, 2024-09-10T21:27:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 234, 2024-09-10T21:27:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-10T21:27:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T21:27:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-10T21:27:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T21:27:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-10T21:27:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-10T21:27:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T21:27:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T21:27:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-10T21:27:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-10T21:27:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T21:27:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-09-10T21:27:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T21:27:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T21:27:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T21:27:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-09-10T21:27:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-09-10T21:27:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-09-10T21:27:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-09-10T21:27:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-10T21:27:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-10T21:27:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 11, 2024-09-10T21:27:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 7, 2024-09-10T21:27:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 8, 2024-09-10T21:27:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-09-10T21:27:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-10T21:27:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-10T21:27:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-10T21:27:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-09-10T21:27:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-09-10T21:27:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-10T21:27:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-10T21:27:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-10T21:27:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-10T21:27:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-10T21:27:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-10T21:27:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-10T21:27:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-10T21:27:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-10T21:27:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T21:27:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-10T21:27:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-10T21:27:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-10T21:27:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-10T21:27:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0, 2024-09-10T21:27:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_started": 0, 2024-09-10T21:27:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_succeeded": 0, 2024-09-10T21:27:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_write_failed": 0 2024-09-10T21:27:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-10T21:27:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-10T21:27:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 2, 2024-09-10T21:27:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-10T21:27:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-10T21:27:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 2, 2024-09-10T21:27:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-10T21:27:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-10T21:27:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 2, 2024-09-10T21:27:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-10T21:27:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-10T21:27:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-09-10T21:27:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-09-10T21:27:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-10T21:27:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-10T21:27:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-09-10T21:27:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4194892, 2024-09-10T21:27:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 0, 2024-09-10T21:27:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-10T21:27:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1, 2024-09-10T21:27:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.001438242, 2024-09-10T21:27:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001438242 2024-09-10T21:27:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 0 2024-09-10T21:27:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-10T21:27:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 20, 2024-09-10T21:27:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 22, 2024-09-10T21:27:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 2, 2024-09-10T21:27:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 19, 2024-09-10T21:27:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 23, 2024-09-10T21:27:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 4, 2024-09-10T21:27:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 16, 2024-09-10T21:27:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 20, 2024-09-10T21:27:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 4, 2024-09-10T21:27:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-10T21:27:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-09-10T21:27:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-09-10T21:27:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 52420, 2024-09-10T21:27:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 257679360 2024-09-10T21:27:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-10T21:27:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-09-10T21:27:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-10T21:27:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-09-10T21:27:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 0, 2024-09-10T21:27:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-10T21:27:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-10T21:27:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-10T21:27:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-10T21:27:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-10T21:27:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-10T21:27:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-10T21:27:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-10T21:27:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-10T21:27:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-10T21:27:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-10T21:27:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-10T21:27:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-10T21:27:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-10T21:27:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-10T21:27:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-10T21:27:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-10T21:27:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-10T21:27:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-10T21:27:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-10T21:27:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-10T21:27:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-10T21:27:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-10T21:27:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-10T21:27:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-10T21:27:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-10T21:27:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-10T21:27:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-10T21:27:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.949 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-10T21:27:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-10T21:27:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-10T21:27:02.950 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-10T21:27:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-10T21:27:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-10T21:27:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 0, 2024-09-10T21:27:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 0, 2024-09-10T21:27:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 0, 2024-09-10T21:27:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 0, 2024-09-10T21:27:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-10T21:27:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-09-10T21:27:02.951 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-09-10T21:27:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 0, 2024-09-10T21:27:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-10T21:27:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-10T21:27:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:27:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-10T21:27:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:27:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:27:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:27:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:27:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:27:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:27:02.952 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:27:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:27:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:27:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:27:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:27:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:27:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:27:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-10T21:27:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:27:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-10T21:27:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:27:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:27:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:27:02.953 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:27:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:27:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:27:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:27:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-10T21:27:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:27:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:27:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:27:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-10T21:27:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-10T21:27:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-10T21:27:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:27:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:27:02.954 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:27:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:27:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 245863, 2024-09-10T21:27:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 76, 2024-09-10T21:27:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:27:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-10T21:27:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-10T21:27:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-10T21:27:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:27:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-10T21:27:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:27:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-10T21:27:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 7400, 2024-09-10T21:27:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 152, 2024-09-10T21:27:02.955 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:27:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:27:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-10T21:27:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-10T21:27:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 81365, 2024-09-10T21:27:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 320, 2024-09-10T21:27:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-10T21:27:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-10T21:27:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-10T21:27:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-10T21:27:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-10T21:27:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-10T21:27:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-10T21:27:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 35, 2024-09-10T21:27:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 10710, 2024-09-10T21:27:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 32, 2024-09-10T21:27:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 35, 2024-09-10T21:27:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-10T21:27:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 35, 2024-09-10T21:27:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.207994454, 2024-09-10T21:27:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.005942698 2024-09-10T21:27:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-10T21:27:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-10T21:27:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 35, 2024-09-10T21:27:02.957 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 57 2024-09-10T21:27:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 35, 2024-09-10T21:27:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 0, 2024-09-10T21:27:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 35, 2024-09-10T21:27:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-10T21:27:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-10T21:27:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 0, 2024-09-10T21:27:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 10, 2024-09-10T21:27:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 0, 2024-09-10T21:27:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 1, 2024-09-10T21:27:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 5, 2024-09-10T21:27:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-10T21:27:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-10T21:27:02.958 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-10T21:27:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-10T21:27:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 6, 2024-09-10T21:27:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-10T21:27:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-10T21:27:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-10T21:27:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 0, 2024-09-10T21:27:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 20, 2024-09-10T21:27:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-10T21:27:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-10T21:27:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-10T21:27:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-10T21:27:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-10T21:27:02.959 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-10T21:27:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T21:27:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-10T21:27:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-10T21:27:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-10T21:27:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-10T21:27:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-10T21:27:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-10T21:27:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-10T21:27:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-10T21:27:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-10T21:27:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-10T21:27:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-10T21:27:02.960 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-10T21:27:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-10T21:27:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-10T21:27:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-10T21:27:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-10T21:27:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-10T21:27:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-10T21:27:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-10T21:27:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 75, 2024-09-10T21:27:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-10T21:27:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 2, 2024-09-10T21:27:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 8, 2024-09-10T21:27:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 8, 2024-09-10T21:27:02.961 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-10T21:27:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-10T21:27:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 14, 2024-09-10T21:27:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 0, 2024-09-10T21:27:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 1 2024-09-10T21:27:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-10T21:27:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 1, 2024-09-10T21:27:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-10T21:27:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-10T21:27:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-10T21:27:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-10T21:27:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-10T21:27:02.962 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T21:27:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-10T21:27:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-09-10T21:27:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-09-10T21:27:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-09-10T21:27:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-10T21:27:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:27:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:27:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-10T21:27:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:27:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 1335, 2024-09-10T21:27:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 726178, 2024-09-10T21:27:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:02.963 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 1335, 2024-09-10T21:27:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T21:27:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T21:27:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1335, 2024-09-10T21:27:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 726178, 2024-09-10T21:27:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:27:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-10T21:27:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:27:02.964 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-10T21:27:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:27:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T21:27:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T21:27:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 35, 2024-09-10T21:27:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 10710, 2024-09-10T21:27:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 35, 2024-09-10T21:27:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 10710, 2024-09-10T21:27:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:27:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.965 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-10T21:27:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:27:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-10T21:27:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:27:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T21:27:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T21:27:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 35, 2024-09-10T21:27:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 35, 2024-09-10T21:27:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 35, 2024-09-10T21:27:02.966 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 35, 2024-09-10T21:27:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:27:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-10T21:27:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:27:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-10T21:27:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:27:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T21:27:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T21:27:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:02.967 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T21:27:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T21:27:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-10T21:27:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-10T21:27:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:27:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x561cf5014dc0": { 2024-09-10T21:27:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:27:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-10T21:27:02.968 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:27:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 2, 2024-09-10T21:27:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 588, 2024-09-10T21:27:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 2, 2024-09-10T21:27:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T21:27:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T21:27:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1, 2024-09-10T21:27:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 588, 2024-09-10T21:27:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:27:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:02.969 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:02.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:02.970 INFO:teuthology.orchestra.run.smithi154.stdout: "trackedop": { 2024-09-10T21:27:02.970 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-10T21:27:02.970 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:02.970 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-10T21:27:03.721 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-10T21:27:03.721 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-10T21:27:03.721 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-10T21:27:03.721 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=11 2024-09-10T21:27:03.721 DEBUG:tasks.check_counter:Getting stats from k 2024-09-10T21:27:03.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-10T21:27:03.972 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T21:27:04.485 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-09-10T21:27:04.485 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:27:04.485 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 2353, 2024-09-10T21:27:04.485 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 2353, 2024-09-10T21:27:04.485 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 668767, 2024-09-10T21:27:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 747437, 2024-09-10T21:27:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 6, 2024-09-10T21:27:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-09-10T21:27:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.220501095, 2024-09-10T21:27:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.106133427, 2024-09-10T21:27:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.043865735, 2024-09-10T21:27:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.055399005, 2024-09-10T21:27:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2352, 2024-09-10T21:27:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.088671654, 2024-09-10T21:27:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000037700 2024-09-10T21:27:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.486 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T21:27:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T21:27:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:27:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 3, 2024-09-10T21:27:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 178, 2024-09-10T21:27:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 716, 2024-09-10T21:27:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 390170, 2024-09-10T21:27:04.487 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 4, 2024-09-10T21:27:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 3, 2024-09-10T21:27:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.013479853, 2024-09-10T21:27:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.010255753, 2024-09-10T21:27:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.001354489, 2024-09-10T21:27:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000051802, 2024-09-10T21:27:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 176, 2024-09-10T21:27:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.011740202, 2024-09-10T21:27:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000066705 2024-09-10T21:27:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.488 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T21:27:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 389472 2024-09-10T21:27:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:27:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 243, 2024-09-10T21:27:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 239, 2024-09-10T21:27:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 551996, 2024-09-10T21:27:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 143646, 2024-09-10T21:27:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 3, 2024-09-10T21:27:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-09-10T21:27:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.041505783, 2024-09-10T21:27:04.489 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.021734179, 2024-09-10T21:27:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.025193236, 2024-09-10T21:27:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000028469, 2024-09-10T21:27:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 238, 2024-09-10T21:27:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.016499316, 2024-09-10T21:27:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000069324 2024-09-10T21:27:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 551728, 2024-09-10T21:27:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 143328 2024-09-10T21:27:04.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-09-10T21:27:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-09-10T21:27:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-09-10T21:27:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-09-10T21:27:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-10T21:27:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-10T21:27:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3976, 2024-09-10T21:27:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.094043224, 2024-09-10T21:27:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000023652 2024-09-10T21:27:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-09-10T21:27:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-09-10T21:27:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-09-10T21:27:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-09-10T21:27:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-09-10T21:27:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-09-10T21:27:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-09-10T21:27:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.492 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-09-10T21:27:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-09-10T21:27:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-09-10T21:27:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-09-10T21:27:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 0, 2024-09-10T21:27:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-09-10T21:27:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-09-10T21:27:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 0, 2024-09-10T21:27:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-09-10T21:27:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 0, 2024-09-10T21:27:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-09-10T21:27:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 0, 2024-09-10T21:27:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-09-10T21:27:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-09-10T21:27:04.493 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-09-10T21:27:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 1, 2024-09-10T21:27:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-09-10T21:27:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-09-10T21:27:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-09-10T21:27:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-09-10T21:27:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-09-10T21:27:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-09-10T21:27:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-09-10T21:27:04.494 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-09-10T21:27:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-09-10T21:27:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-09-10T21:27:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-09-10T21:27:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-09-10T21:27:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-09-10T21:27:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-09-10T21:27:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-09-10T21:27:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-09-10T21:27:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 0, 2024-09-10T21:27:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 0, 2024-09-10T21:27:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-09-10T21:27:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T21:27:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-09-10T21:27:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T21:27:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-09-10T21:27:04.495 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-09-10T21:27:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T21:27:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T21:27:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-09-10T21:27:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-09-10T21:27:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T21:27:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-09-10T21:27:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T21:27:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T21:27:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T21:27:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-09-10T21:27:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-09-10T21:27:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-09-10T21:27:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-09-10T21:27:04.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-09-10T21:27:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-09-10T21:27:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-09-10T21:27:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-09-10T21:27:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-09-10T21:27:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-09-10T21:27:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-09-10T21:27:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-09-10T21:27:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-09-10T21:27:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-09-10T21:27:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-09-10T21:27:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-09-10T21:27:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-09-10T21:27:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-09-10T21:27:04.497 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-09-10T21:27:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-09-10T21:27:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-09-10T21:27:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-09-10T21:27:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-09-10T21:27:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-09-10T21:27:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T21:27:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-09-10T21:27:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-09-10T21:27:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-09-10T21:27:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-09-10T21:27:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0, 2024-09-10T21:27:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_started": 0, 2024-09-10T21:27:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_succeeded": 0, 2024-09-10T21:27:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "uninline_write_failed": 0 2024-09-10T21:27:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.498 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-09-10T21:27:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-09-10T21:27:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 0, 2024-09-10T21:27:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-09-10T21:27:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-09-10T21:27:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 4, 2024-09-10T21:27:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-09-10T21:27:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-09-10T21:27:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 0, 2024-09-10T21:27:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-09-10T21:27:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-09-10T21:27:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-09-10T21:27:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-09-10T21:27:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-09-10T21:27:04.499 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-09-10T21:27:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-09-10T21:27:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4195424, 2024-09-10T21:27:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 4195283, 2024-09-10T21:27:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-09-10T21:27:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 4 2024-09-10T21:27:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-09-10T21:27:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 3, 2024-09-10T21:27:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 3, 2024-09-10T21:27:04.500 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 0, 2024-09-10T21:27:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 1, 2024-09-10T21:27:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 1, 2024-09-10T21:27:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 0, 2024-09-10T21:27:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 0, 2024-09-10T21:27:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 0, 2024-09-10T21:27:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 0, 2024-09-10T21:27:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-09-10T21:27:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-09-10T21:27:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-09-10T21:27:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 48772, 2024-09-10T21:27:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 248242176 2024-09-10T21:27:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.501 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-09-10T21:27:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-09-10T21:27:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-09-10T21:27:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-09-10T21:27:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 0, 2024-09-10T21:27:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-09-10T21:27:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-09-10T21:27:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-09-10T21:27:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-09-10T21:27:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-09-10T21:27:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-09-10T21:27:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.503 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-09-10T21:27:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-09-10T21:27:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-09-10T21:27:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-09-10T21:27:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-09-10T21:27:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-09-10T21:27:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.505 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-09-10T21:27:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-09-10T21:27:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-09-10T21:27:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-09-10T21:27:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-09-10T21:27:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-09-10T21:27:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-09-10T21:27:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.508 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-09-10T21:27:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-09-10T21:27:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-09-10T21:27:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.509 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-09-10T21:27:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-09-10T21:27:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.510 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-09-10T21:27:04.513 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.513 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.513 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.513 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-09-10T21:27:04.513 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.513 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.513 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-09-10T21:27:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-09-10T21:27:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-09-10T21:27:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.514 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-09-10T21:27:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-09-10T21:27:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-09-10T21:27:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-09-10T21:27:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:04.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-09-10T21:27:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 0, 2024-09-10T21:27:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 1, 2024-09-10T21:27:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 1, 2024-09-10T21:27:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 1, 2024-09-10T21:27:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-09-10T21:27:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-09-10T21:27:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-09-10T21:27:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 1266, 2024-09-10T21:27:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-09-10T21:27:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-09-10T21:27:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:27:04.516 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-09-10T21:27:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:27:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:27:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:27:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:27:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:27:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:27:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:27:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:27:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:27:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:27:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:27:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:27:04.517 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:27:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-09-10T21:27:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:27:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-09-10T21:27:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:27:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:27:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:27:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:27:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:27:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:27:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:27:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-09-10T21:27:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:27:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:27:04.518 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:27:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-09-10T21:27:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-09-10T21:27:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-09-10T21:27:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:27:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:27:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:27:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:27:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 181343, 2024-09-10T21:27:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 47, 2024-09-10T21:27:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:27:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-09-10T21:27:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-09-10T21:27:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-09-10T21:27:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:27:04.519 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-09-10T21:27:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:27:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-09-10T21:27:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 7400, 2024-09-10T21:27:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 152, 2024-09-10T21:27:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:27:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:27:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-09-10T21:27:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-09-10T21:27:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 8672, 2024-09-10T21:27:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 13, 2024-09-10T21:27:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-09-10T21:27:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-09-10T21:27:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-09-10T21:27:04.520 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-09-10T21:27:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-09-10T21:27:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-09-10T21:27:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-09-10T21:27:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 2352, 2024-09-10T21:27:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 21, 2024-09-10T21:27:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 3, 2024-09-10T21:27:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 2352, 2024-09-10T21:27:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-09-10T21:27:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2352, 2024-09-10T21:27:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1.128969513, 2024-09-10T21:27:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000480004 2024-09-10T21:27:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.521 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-09-10T21:27:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-09-10T21:27:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2352, 2024-09-10T21:27:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 2353 2024-09-10T21:27:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 2352, 2024-09-10T21:27:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 2352, 2024-09-10T21:27:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 0, 2024-09-10T21:27:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-09-10T21:27:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-09-10T21:27:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 1531, 2024-09-10T21:27:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 0, 2024-09-10T21:27:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 819, 2024-09-10T21:27:04.522 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 0, 2024-09-10T21:27:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 0, 2024-09-10T21:27:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-09-10T21:27:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-09-10T21:27:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-09-10T21:27:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-09-10T21:27:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 0, 2024-09-10T21:27:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-09-10T21:27:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-09-10T21:27:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-09-10T21:27:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 1, 2024-09-10T21:27:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 0, 2024-09-10T21:27:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-09-10T21:27:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-09-10T21:27:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-09-10T21:27:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-09-10T21:27:04.523 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-09-10T21:27:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-09-10T21:27:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T21:27:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-09-10T21:27:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-09-10T21:27:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-09-10T21:27:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-09-10T21:27:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-09-10T21:27:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-09-10T21:27:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-09-10T21:27:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-09-10T21:27:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-09-10T21:27:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-09-10T21:27:04.524 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-09-10T21:27:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-09-10T21:27:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-09-10T21:27:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-09-10T21:27:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-09-10T21:27:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-09-10T21:27:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-09-10T21:27:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-09-10T21:27:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-09-10T21:27:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 75, 2024-09-10T21:27:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-09-10T21:27:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 2, 2024-09-10T21:27:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 4, 2024-09-10T21:27:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 4, 2024-09-10T21:27:04.525 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-09-10T21:27:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-09-10T21:27:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 0, 2024-09-10T21:27:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 2, 2024-09-10T21:27:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 0 2024-09-10T21:27:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-09-10T21:27:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 0, 2024-09-10T21:27:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-09-10T21:27:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-09-10T21:27:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-09-10T21:27:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-09-10T21:27:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-09-10T21:27:04.526 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T21:27:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-09-10T21:27:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-09-10T21:27:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-09-10T21:27:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-09-10T21:27:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-09-10T21:27:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:27:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:27:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-10T21:27:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:27:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 2595, 2024-09-10T21:27:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 972468, 2024-09-10T21:27:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 2595, 2024-09-10T21:27:04.527 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T21:27:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T21:27:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2595, 2024-09-10T21:27:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 972468, 2024-09-10T21:27:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:27:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-09-10T21:27:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:27:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-09-10T21:27:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:27:04.528 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T21:27:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T21:27:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 2352, 2024-09-10T21:27:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 1125, 2024-09-10T21:27:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2352, 2024-09-10T21:27:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1125, 2024-09-10T21:27:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:27:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.529 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-09-10T21:27:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:27:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-09-10T21:27:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:27:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T21:27:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T21:27:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 2352, 2024-09-10T21:27:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 2352, 2024-09-10T21:27:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2352, 2024-09-10T21:27:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 2352, 2024-09-10T21:27:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:27:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.530 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-09-10T21:27:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:27:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-10T21:27:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:27:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T21:27:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T21:27:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T21:27:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T21:27:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-10T21:27:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-10T21:27:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:27:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.531 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x55f2d88f9040": { 2024-09-10T21:27:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-09-10T21:27:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-09-10T21:27:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-09-10T21:27:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-09-10T21:27:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-09-10T21:27:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-09-10T21:27:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-09-10T21:27:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-09-10T21:27:04.532 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-09-10T21:27:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-09-10T21:27:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-09-10T21:27:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-09-10T21:27:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-09-10T21:27:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-09-10T21:27:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: "trackedop": { 2024-09-10T21:27:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-09-10T21:27:04.533 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-09-10T21:27:04.533 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-09-10T21:27:04.681 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:04 smithi154 ceph-mon[35041]: pgmap v694: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-10T21:27:04.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:04 smithi192 ceph-mon[35363]: pgmap v694: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-10T21:27:04.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:04 smithi059 ceph-mon[30888]: pgmap v694: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-10T21:27:05.275 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-10T21:27:05.275 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-10T21:27:05.275 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-09-10T21:27:05.275 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-09-10T21:27:05.275 DEBUG:tasks.check_counter:Getting stats from c 2024-09-10T21:27:05.276 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-10T21:27:05.536 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:27:06.012 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-10T21:27:06.012 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:27:06.013 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 893, 2024-09-10T21:27:06.013 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 780, 2024-09-10T21:27:06.013 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 233243, 2024-09-10T21:27:06.013 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 282481, 2024-09-10T21:27:06.013 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 9, 2024-09-10T21:27:06.013 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 2, 2024-09-10T21:27:06.013 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.107209299, 2024-09-10T21:27:06.013 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.048704495, 2024-09-10T21:27:06.013 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.054092532, 2024-09-10T21:27:06.013 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.006006415, 2024-09-10T21:27:06.013 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:06.013 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 783, 2024-09-10T21:27:06.014 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.068592892, 2024-09-10T21:27:06.014 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000087602 2024-09-10T21:27:06.014 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.014 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:06.014 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1603, 2024-09-10T21:27:06.014 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000400542, 2024-09-10T21:27:06.014 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000249 2024-09-10T21:27:06.014 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.014 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T21:27:06.014 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T21:27:06.014 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.014 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:27:06.014 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 298, 2024-09-10T21:27:06.015 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 294, 2024-09-10T21:27:06.015 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 575711, 2024-09-10T21:27:06.015 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 155378, 2024-09-10T21:27:06.015 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 9, 2024-09-10T21:27:06.015 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 8, 2024-09-10T21:27:06.015 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.054285371, 2024-09-10T21:27:06.015 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.024899043, 2024-09-10T21:27:06.015 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.037708814, 2024-09-10T21:27:06.015 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000324144, 2024-09-10T21:27:06.015 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:06.015 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 289, 2024-09-10T21:27:06.015 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.035158071, 2024-09-10T21:27:06.015 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000121654 2024-09-10T21:27:06.015 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.016 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:06.016 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 21, 2024-09-10T21:27:06.016 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000004395, 2024-09-10T21:27:06.016 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000209 2024-09-10T21:27:06.016 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.016 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 572128, 2024-09-10T21:27:06.016 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 149136 2024-09-10T21:27:06.016 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.016 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:27:06.016 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 163, 2024-09-10T21:27:06.016 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 335, 2024-09-10T21:27:06.016 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 53174, 2024-09-10T21:27:06.016 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 985364, 2024-09-10T21:27:06.017 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 53, 2024-09-10T21:27:06.017 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 5, 2024-09-10T21:27:06.017 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.042292001, 2024-09-10T21:27:06.017 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.017509955, 2024-09-10T21:27:06.017 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.022129765, 2024-09-10T21:27:06.017 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000225891, 2024-09-10T21:27:06.017 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:06.017 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 333, 2024-09-10T21:27:06.017 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.031937508, 2024-09-10T21:27:06.017 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000095908 2024-09-10T21:27:06.017 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.017 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:06.017 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 259, 2024-09-10T21:27:06.018 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000061576, 2024-09-10T21:27:06.018 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000237 2024-09-10T21:27:06.018 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.018 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T21:27:06.018 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 388960 2024-09-10T21:27:06.018 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.018 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-09-10T21:27:06.018 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 1, 2024-09-10T21:27:06.018 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-09-10T21:27:06.018 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.018 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-MDSRank": { 2024-09-10T21:27:06.018 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-10T21:27:06.019 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-10T21:27:06.019 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 33, 2024-09-10T21:27:06.019 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.001468492, 2024-09-10T21:27:06.019 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000044499 2024-09-10T21:27:06.019 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:06.019 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.019 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-PurgeQueue": { 2024-09-10T21:27:06.019 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-10T21:27:06.019 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-10T21:27:06.019 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2, 2024-09-10T21:27:06.019 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000012363, 2024-09-10T21:27:06.020 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000006181 2024-09-10T21:27:06.020 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:06.020 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.020 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": { 2024-09-10T21:27:06.020 INFO:teuthology.orchestra.run.smithi192.stdout: "request": 1, 2024-09-10T21:27:06.020 INFO:teuthology.orchestra.run.smithi192.stdout: "reply": 1, 2024-09-10T21:27:06.020 INFO:teuthology.orchestra.run.smithi192.stdout: "reply_latency": { 2024-09-10T21:27:06.020 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1, 2024-09-10T21:27:06.020 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000136349, 2024-09-10T21:27:06.020 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000136349 2024-09-10T21:27:06.020 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.020 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_reply": 0, 2024-09-10T21:27:06.020 INFO:teuthology.orchestra.run.smithi192.stdout: "forward": 0, 2024-09-10T21:27:06.021 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_complete": 0, 2024-09-10T21:27:06.021 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_keys": 0, 2024-09-10T21:27:06.021 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_commit": 11, 2024-09-10T21:27:06.021 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_split": 0, 2024-09-10T21:27:06.021 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_merge": 0, 2024-09-10T21:27:06.021 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes": 16, 2024-09-10T21:27:06.021 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_top": 0, 2024-09-10T21:27:06.021 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_bottom": 16, 2024-09-10T21:27:06.021 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pin_tail": 0, 2024-09-10T21:27:06.021 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pinned": 13, 2024-09-10T21:27:06.021 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_expired": 4, 2024-09-10T21:27:06.021 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_with_caps": 1, 2024-09-10T21:27:06.021 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": 1, 2024-09-10T21:27:06.022 INFO:teuthology.orchestra.run.smithi192.stdout: "subtrees": 3, 2024-09-10T21:27:06.022 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse": 7, 2024-09-10T21:27:06.022 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_hit": 4, 2024-09-10T21:27:06.022 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_forward": 0, 2024-09-10T21:27:06.022 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_discover": 3, 2024-09-10T21:27:06.022 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_dir_fetch": 0, 2024-09-10T21:27:06.022 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_remote_ino": 0, 2024-09-10T21:27:06.022 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_lock": 0, 2024-09-10T21:27:06.022 INFO:teuthology.orchestra.run.smithi192.stdout: "load_cent": 0, 2024-09-10T21:27:06.022 INFO:teuthology.orchestra.run.smithi192.stdout: "q": 0, 2024-09-10T21:27:06.022 INFO:teuthology.orchestra.run.smithi192.stdout: "exported": 0, 2024-09-10T21:27:06.022 INFO:teuthology.orchestra.run.smithi192.stdout: "exported_inodes": 0, 2024-09-10T21:27:06.022 INFO:teuthology.orchestra.run.smithi192.stdout: "imported": 0, 2024-09-10T21:27:06.022 INFO:teuthology.orchestra.run.smithi192.stdout: "imported_inodes": 0, 2024-09-10T21:27:06.023 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_dir_fetch": 0, 2024-09-10T21:27:06.023 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_backtrace_fetch": 0, 2024-09-10T21:27:06.023 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_peer_discover": 0, 2024-09-10T21:27:06.023 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rfiles": 4, 2024-09-10T21:27:06.023 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rbytes": 234, 2024-09-10T21:27:06.023 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rsnaps": 0, 2024-09-10T21:27:06.023 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T21:27:06.023 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_set_tag": 0, 2024-09-10T21:27:06.023 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T21:27:06.023 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_inotable_repaired": 0, 2024-09-10T21:27:06.023 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_inodes": 0, 2024-09-10T21:27:06.023 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T21:27:06.023 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T21:27:06.023 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_file_inodes": 0, 2024-09-10T21:27:06.023 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_inode_file_caps": 0, 2024-09-10T21:27:06.023 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T21:27:06.024 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_grant": 0, 2024-09-10T21:27:06.024 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T21:27:06.024 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T21:27:06.024 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T21:27:06.024 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps": 0, 2024-09-10T21:27:06.024 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps_dirty": 0, 2024-09-10T21:27:06.024 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_cap_release": 0, 2024-09-10T21:27:06.024 INFO:teuthology.orchestra.run.smithi192.stdout: "process_request_cap_release": 0 2024-09-10T21:27:06.024 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.024 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_cache": { 2024-09-10T21:27:06.024 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update": 0, 2024-09-10T21:27:06.024 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update_receipt": 11, 2024-09-10T21:27:06.024 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_try_discover": 7, 2024-09-10T21:27:06.024 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_send_discover": 8, 2024-09-10T21:27:06.025 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_handle_discover": 0, 2024-09-10T21:27:06.025 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays": 0, 2024-09-10T21:27:06.025 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_delayed": 0, 2024-09-10T21:27:06.025 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_enqueuing": 0, 2024-09-10T21:27:06.025 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_created": 0, 2024-09-10T21:27:06.025 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_enqueued": 0, 2024-09-10T21:27:06.025 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_reintegrated": 0, 2024-09-10T21:27:06.025 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_migrated": 0, 2024-09-10T21:27:06.025 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_processing": 0, 2024-09-10T21:27:06.025 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_enqueued": 0, 2024-09-10T21:27:06.025 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_prioritized": 0, 2024-09-10T21:27:06.025 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_started": 0, 2024-09-10T21:27:06.025 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_completed": 0, 2024-09-10T21:27:06.025 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_path": 0, 2024-09-10T21:27:06.026 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_inode": 0, 2024-09-10T21:27:06.026 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T21:27:06.026 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_exportdir": 0, 2024-09-10T21:27:06.026 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_flush": 0, 2024-09-10T21:27:06.026 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragmentdir": 0, 2024-09-10T21:27:06.026 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragstats": 0, 2024-09-10T21:27:06.026 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_inodestats": 0, 2024-09-10T21:27:06.026 INFO:teuthology.orchestra.run.smithi192.stdout: "uninline_started": 0, 2024-09-10T21:27:06.026 INFO:teuthology.orchestra.run.smithi192.stdout: "uninline_succeeded": 0, 2024-09-10T21:27:06.026 INFO:teuthology.orchestra.run.smithi192.stdout: "uninline_write_failed": 0 2024-09-10T21:27:06.026 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.026 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_log": { 2024-09-10T21:27:06.026 INFO:teuthology.orchestra.run.smithi192.stdout: "evlrg": 0, 2024-09-10T21:27:06.026 INFO:teuthology.orchestra.run.smithi192.stdout: "evadd": 3, 2024-09-10T21:27:06.026 INFO:teuthology.orchestra.run.smithi192.stdout: "evex": 0, 2024-09-10T21:27:06.027 INFO:teuthology.orchestra.run.smithi192.stdout: "evtrm": 0, 2024-09-10T21:27:06.027 INFO:teuthology.orchestra.run.smithi192.stdout: "ev": 3, 2024-09-10T21:27:06.027 INFO:teuthology.orchestra.run.smithi192.stdout: "evexg": 0, 2024-09-10T21:27:06.027 INFO:teuthology.orchestra.run.smithi192.stdout: "evexd": 0, 2024-09-10T21:27:06.027 INFO:teuthology.orchestra.run.smithi192.stdout: "segadd": 2, 2024-09-10T21:27:06.027 INFO:teuthology.orchestra.run.smithi192.stdout: "segex": 0, 2024-09-10T21:27:06.027 INFO:teuthology.orchestra.run.smithi192.stdout: "segtrm": 0, 2024-09-10T21:27:06.027 INFO:teuthology.orchestra.run.smithi192.stdout: "seg": 2, 2024-09-10T21:27:06.027 INFO:teuthology.orchestra.run.smithi192.stdout: "segmjr": 2, 2024-09-10T21:27:06.027 INFO:teuthology.orchestra.run.smithi192.stdout: "segexg": 0, 2024-09-10T21:27:06.027 INFO:teuthology.orchestra.run.smithi192.stdout: "segexd": 0, 2024-09-10T21:27:06.028 INFO:teuthology.orchestra.run.smithi192.stdout: "expos": 4194304, 2024-09-10T21:27:06.028 INFO:teuthology.orchestra.run.smithi192.stdout: "wrpos": 4195200, 2024-09-10T21:27:06.028 INFO:teuthology.orchestra.run.smithi192.stdout: "rdpos": 0, 2024-09-10T21:27:06.028 INFO:teuthology.orchestra.run.smithi192.stdout: "jlat": { 2024-09-10T21:27:06.028 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2, 2024-09-10T21:27:06.028 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.003375783, 2024-09-10T21:27:06.028 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001687891 2024-09-10T21:27:06.028 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.029 INFO:teuthology.orchestra.run.smithi192.stdout: "replayed": 0 2024-09-10T21:27:06.029 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.029 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_mem": { 2024-09-10T21:27:06.029 INFO:teuthology.orchestra.run.smithi192.stdout: "ino": 20, 2024-09-10T21:27:06.029 INFO:teuthology.orchestra.run.smithi192.stdout: "ino+": 22, 2024-09-10T21:27:06.029 INFO:teuthology.orchestra.run.smithi192.stdout: "ino-": 2, 2024-09-10T21:27:06.029 INFO:teuthology.orchestra.run.smithi192.stdout: "dir": 19, 2024-09-10T21:27:06.029 INFO:teuthology.orchestra.run.smithi192.stdout: "dir+": 23, 2024-09-10T21:27:06.029 INFO:teuthology.orchestra.run.smithi192.stdout: "dir-": 4, 2024-09-10T21:27:06.029 INFO:teuthology.orchestra.run.smithi192.stdout: "dn": 16, 2024-09-10T21:27:06.029 INFO:teuthology.orchestra.run.smithi192.stdout: "dn+": 20, 2024-09-10T21:27:06.029 INFO:teuthology.orchestra.run.smithi192.stdout: "dn-": 4, 2024-09-10T21:27:06.030 INFO:teuthology.orchestra.run.smithi192.stdout: "cap": 1, 2024-09-10T21:27:06.030 INFO:teuthology.orchestra.run.smithi192.stdout: "cap+": 1, 2024-09-10T21:27:06.030 INFO:teuthology.orchestra.run.smithi192.stdout: "cap-": 0, 2024-09-10T21:27:06.030 INFO:teuthology.orchestra.run.smithi192.stdout: "rss": 50284, 2024-09-10T21:27:06.030 INFO:teuthology.orchestra.run.smithi192.stdout: "heap": 257679360 2024-09-10T21:27:06.030 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.030 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_server": { 2024-09-10T21:27:06.030 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_client_request": 1, 2024-09-10T21:27:06.030 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_server_request": 0, 2024-09-10T21:27:06.030 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_request": 1, 2024-09-10T21:27:06.030 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_session": 10, 2024-09-10T21:27:06.030 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_peer_request": 0, 2024-09-10T21:27:06.031 INFO:teuthology.orchestra.run.smithi192.stdout: "req_create_latency": { 2024-09-10T21:27:06.031 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.031 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.031 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.031 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.031 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getattr_latency": { 2024-09-10T21:27:06.031 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.031 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.031 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.031 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.031 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getfilelock_latency": { 2024-09-10T21:27:06.031 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.032 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.032 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.032 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.032 INFO:teuthology.orchestra.run.smithi192.stdout: "req_link_latency": { 2024-09-10T21:27:06.032 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.032 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.032 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.032 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.032 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookup_latency": { 2024-09-10T21:27:06.032 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.032 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.032 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.033 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.033 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookuphash_latency": { 2024-09-10T21:27:06.033 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.033 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.033 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.033 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.033 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupino_latency": { 2024-09-10T21:27:06.033 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1, 2024-09-10T21:27:06.033 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000136349, 2024-09-10T21:27:06.033 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000136349 2024-09-10T21:27:06.033 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.033 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupname_latency": { 2024-09-10T21:27:06.034 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.034 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.034 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.034 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.034 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupparent_latency": { 2024-09-10T21:27:06.034 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.034 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.034 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.034 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.034 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupsnap_latency": { 2024-09-10T21:27:06.034 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.034 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.034 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.034 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.035 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lssnap_latency": { 2024-09-10T21:27:06.035 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.035 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.035 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.036 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.036 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mkdir_latency": { 2024-09-10T21:27:06.036 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.036 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.036 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.036 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.036 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mknod_latency": { 2024-09-10T21:27:06.036 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.036 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.036 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.036 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.036 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mksnap_latency": { 2024-09-10T21:27:06.036 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.037 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.037 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.037 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.037 INFO:teuthology.orchestra.run.smithi192.stdout: "req_open_latency": { 2024-09-10T21:27:06.037 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.037 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.037 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.037 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.037 INFO:teuthology.orchestra.run.smithi192.stdout: "req_readdir_latency": { 2024-09-10T21:27:06.037 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.037 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.037 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.037 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.038 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rename_latency": { 2024-09-10T21:27:06.038 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.038 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.038 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.038 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.038 INFO:teuthology.orchestra.run.smithi192.stdout: "req_renamesnap_latency": { 2024-09-10T21:27:06.038 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.038 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.038 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.038 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.038 INFO:teuthology.orchestra.run.smithi192.stdout: "req_snapdiff_latency": { 2024-09-10T21:27:06.038 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.038 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.038 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.039 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.039 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmdir_latency": { 2024-09-10T21:27:06.039 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.039 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.039 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.039 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.039 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmsnap_latency": { 2024-09-10T21:27:06.039 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.039 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.039 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.039 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.039 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmxattr_latency": { 2024-09-10T21:27:06.039 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.039 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.040 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.040 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.040 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setattr_latency": { 2024-09-10T21:27:06.040 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.040 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.040 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.040 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.040 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setdirlayout_latency": { 2024-09-10T21:27:06.040 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.040 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.040 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.040 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.040 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setfilelock_latency": { 2024-09-10T21:27:06.040 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.041 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.041 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.041 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.041 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setlayout_latency": { 2024-09-10T21:27:06.041 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.041 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.041 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.041 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.041 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setxattr_latency": { 2024-09-10T21:27:06.041 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.041 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.041 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.041 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.042 INFO:teuthology.orchestra.run.smithi192.stdout: "req_symlink_latency": { 2024-09-10T21:27:06.042 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.042 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.042 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.042 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.042 INFO:teuthology.orchestra.run.smithi192.stdout: "req_unlink_latency": { 2024-09-10T21:27:06.042 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.042 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.042 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.042 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.042 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_revoke_eviction": 0, 2024-09-10T21:27:06.042 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_acquisition_throttle": 0, 2024-09-10T21:27:06.042 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getvxattr_latency": { 2024-09-10T21:27:06.042 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.043 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.043 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.043 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:06.043 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.043 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_sessions": { 2024-09-10T21:27:06.043 INFO:teuthology.orchestra.run.smithi192.stdout: "session_count": 1, 2024-09-10T21:27:06.043 INFO:teuthology.orchestra.run.smithi192.stdout: "session_add": 1, 2024-09-10T21:27:06.043 INFO:teuthology.orchestra.run.smithi192.stdout: "session_remove": 0, 2024-09-10T21:27:06.043 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_open": 1, 2024-09-10T21:27:06.043 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_stale": 0, 2024-09-10T21:27:06.043 INFO:teuthology.orchestra.run.smithi192.stdout: "total_load": 1, 2024-09-10T21:27:06.043 INFO:teuthology.orchestra.run.smithi192.stdout: "average_load": 1, 2024-09-10T21:27:06.043 INFO:teuthology.orchestra.run.smithi192.stdout: "avg_session_uptime": 701, 2024-09-10T21:27:06.043 INFO:teuthology.orchestra.run.smithi192.stdout: "mdthresh_evicted": 0 2024-09-10T21:27:06.044 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.044 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-09-10T21:27:06.044 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:27:06.044 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-09-10T21:27:06.044 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:27:06.044 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:27:06.044 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:27:06.044 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:27:06.044 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:27:06.044 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:27:06.044 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:27:06.044 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:27:06.044 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:27:06.045 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:27:06.045 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:27:06.045 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:27:06.045 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:27:06.045 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-09-10T21:27:06.045 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:27:06.045 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-09-10T21:27:06.045 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:27:06.045 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:27:06.045 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:27:06.045 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:27:06.045 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:27:06.045 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:27:06.046 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:27:06.046 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-09-10T21:27:06.046 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:27:06.046 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:27:06.046 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:27:06.046 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-09-10T21:27:06.046 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-09-10T21:27:06.046 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-09-10T21:27:06.046 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:27:06.046 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:27:06.046 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:27:06.046 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:27:06.046 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 246215, 2024-09-10T21:27:06.046 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 79, 2024-09-10T21:27:06.047 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:27:06.047 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 0, 2024-09-10T21:27:06.047 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-09-10T21:27:06.047 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-09-10T21:27:06.047 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:27:06.047 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-09-10T21:27:06.047 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:27:06.047 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-09-10T21:27:06.047 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 7400, 2024-09-10T21:27:06.047 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 152, 2024-09-10T21:27:06.047 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:27:06.047 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:27:06.047 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-09-10T21:27:06.047 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-09-10T21:27:06.048 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 81693, 2024-09-10T21:27:06.048 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 323, 2024-09-10T21:27:06.048 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-09-10T21:27:06.048 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-09-10T21:27:06.048 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-09-10T21:27:06.048 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-09-10T21:27:06.048 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.048 INFO:teuthology.orchestra.run.smithi192.stdout: "objecter": { 2024-09-10T21:27:06.048 INFO:teuthology.orchestra.run.smithi192.stdout: "op_active": 0, 2024-09-10T21:27:06.048 INFO:teuthology.orchestra.run.smithi192.stdout: "op_laggy": 0, 2024-09-10T21:27:06.048 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send": 38, 2024-09-10T21:27:06.048 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send_bytes": 11319, 2024-09-10T21:27:06.048 INFO:teuthology.orchestra.run.smithi192.stdout: "op_resend": 33, 2024-09-10T21:27:06.049 INFO:teuthology.orchestra.run.smithi192.stdout: "op_reply": 38, 2024-09-10T21:27:06.049 INFO:teuthology.orchestra.run.smithi192.stdout: "op_latency": { 2024-09-10T21:27:06.049 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 38, 2024-09-10T21:27:06.049 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.193996210, 2024-09-10T21:27:06.049 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.005105163 2024-09-10T21:27:06.049 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.049 INFO:teuthology.orchestra.run.smithi192.stdout: "op_inflight": 0, 2024-09-10T21:27:06.049 INFO:teuthology.orchestra.run.smithi192.stdout: "oplen_avg": { 2024-09-10T21:27:06.049 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 38, 2024-09-10T21:27:06.049 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 61 2024-09-10T21:27:06.049 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.049 INFO:teuthology.orchestra.run.smithi192.stdout: "op": 38, 2024-09-10T21:27:06.049 INFO:teuthology.orchestra.run.smithi192.stdout: "op_r": 0, 2024-09-10T21:27:06.049 INFO:teuthology.orchestra.run.smithi192.stdout: "op_w": 38, 2024-09-10T21:27:06.050 INFO:teuthology.orchestra.run.smithi192.stdout: "op_rmw": 0, 2024-09-10T21:27:06.050 INFO:teuthology.orchestra.run.smithi192.stdout: "op_pg": 0, 2024-09-10T21:27:06.050 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_stat": 0, 2024-09-10T21:27:06.050 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_create": 10, 2024-09-10T21:27:06.050 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_read": 0, 2024-09-10T21:27:06.050 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_write": 2, 2024-09-10T21:27:06.050 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writefull": 6, 2024-09-10T21:27:06.050 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writesame": 0, 2024-09-10T21:27:06.050 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_append": 0, 2024-09-10T21:27:06.050 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_zero": 0, 2024-09-10T21:27:06.050 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_truncate": 0, 2024-09-10T21:27:06.050 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_delete": 6, 2024-09-10T21:27:06.050 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_mapext": 0, 2024-09-10T21:27:06.050 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_sparse_read": 0, 2024-09-10T21:27:06.050 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_clonerange": 0, 2024-09-10T21:27:06.051 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_getxattr": 0, 2024-09-10T21:27:06.051 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_setxattr": 20, 2024-09-10T21:27:06.051 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_cmpxattr": 0, 2024-09-10T21:27:06.051 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_rmxattr": 0, 2024-09-10T21:27:06.051 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_resetxattrs": 0, 2024-09-10T21:27:06.051 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_call": 0, 2024-09-10T21:27:06.051 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_watch": 0, 2024-09-10T21:27:06.051 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_notify": 0, 2024-09-10T21:27:06.051 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T21:27:06.051 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls": 0, 2024-09-10T21:27:06.051 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls_filter": 0, 2024-09-10T21:27:06.051 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_other": 0, 2024-09-10T21:27:06.051 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_active": 0, 2024-09-10T21:27:06.051 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_send": 0, 2024-09-10T21:27:06.052 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_resend": 0, 2024-09-10T21:27:06.052 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_ping": 0, 2024-09-10T21:27:06.052 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_active": 0, 2024-09-10T21:27:06.052 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_send": 0, 2024-09-10T21:27:06.052 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_resend": 0, 2024-09-10T21:27:06.052 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_active": 0, 2024-09-10T21:27:06.052 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_send": 0, 2024-09-10T21:27:06.052 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_resend": 0, 2024-09-10T21:27:06.052 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_active": 0, 2024-09-10T21:27:06.052 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_send": 0, 2024-09-10T21:27:06.052 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_resend": 0, 2024-09-10T21:27:06.052 INFO:teuthology.orchestra.run.smithi192.stdout: "command_active": 0, 2024-09-10T21:27:06.052 INFO:teuthology.orchestra.run.smithi192.stdout: "command_send": 0, 2024-09-10T21:27:06.053 INFO:teuthology.orchestra.run.smithi192.stdout: "command_resend": 0, 2024-09-10T21:27:06.053 INFO:teuthology.orchestra.run.smithi192.stdout: "map_epoch": 75, 2024-09-10T21:27:06.053 INFO:teuthology.orchestra.run.smithi192.stdout: "map_full": 0, 2024-09-10T21:27:06.053 INFO:teuthology.orchestra.run.smithi192.stdout: "map_inc": 2, 2024-09-10T21:27:06.053 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_sessions": 9, 2024-09-10T21:27:06.053 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_open": 9, 2024-09-10T21:27:06.053 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_close": 0, 2024-09-10T21:27:06.053 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_laggy": 0, 2024-09-10T21:27:06.053 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_wr": 16, 2024-09-10T21:27:06.053 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_rd": 0, 2024-09-10T21:27:06.053 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_del": 1 2024-09-10T21:27:06.053 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.053 INFO:teuthology.orchestra.run.smithi192.stdout: "oft": { 2024-09-10T21:27:06.053 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_objs": 1, 2024-09-10T21:27:06.054 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_kv_pairs": 0, 2024-09-10T21:27:06.054 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_updates": 0, 2024-09-10T21:27:06.054 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_removes": 0 2024-09-10T21:27:06.054 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.054 INFO:teuthology.orchestra.run.smithi192.stdout: "purge_queue": { 2024-09-10T21:27:06.054 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops": 0, 2024-09-10T21:27:06.054 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T21:27:06.054 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing": 0, 2024-09-10T21:27:06.054 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_high_water": 0, 2024-09-10T21:27:06.054 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed_ops": 0, 2024-09-10T21:27:06.054 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed": 0, 2024-09-10T21:27:06.054 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_item_in_journal": 0 2024-09-10T21:27:06.054 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.054 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:27:06.055 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:06.055 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-10T21:27:06.055 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:06.055 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 1350, 2024-09-10T21:27:06.055 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 723244, 2024-09-10T21:27:06.055 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:06.055 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 1350, 2024-09-10T21:27:06.055 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-10T21:27:06.055 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-10T21:27:06.055 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 1350, 2024-09-10T21:27:06.055 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 723244, 2024-09-10T21:27:06.055 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:06.055 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.056 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.056 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.056 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:06.056 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.056 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_bytes": { 2024-09-10T21:27:06.056 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:06.056 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-10T21:27:06.056 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:06.056 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-10T21:27:06.056 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-10T21:27:06.056 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:06.056 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:06.056 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 38, 2024-09-10T21:27:06.057 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 11319, 2024-09-10T21:27:06.057 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 38, 2024-09-10T21:27:06.057 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 11319, 2024-09-10T21:27:06.057 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:06.057 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.057 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.057 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.057 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:06.057 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.057 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_ops": { 2024-09-10T21:27:06.057 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:06.057 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 1024, 2024-09-10T21:27:06.057 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:06.057 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-10T21:27:06.058 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-10T21:27:06.058 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:06.058 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:06.058 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 38, 2024-09-10T21:27:06.058 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 38, 2024-09-10T21:27:06.058 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 38, 2024-09-10T21:27:06.058 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 38, 2024-09-10T21:27:06.058 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:06.058 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.058 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.058 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.058 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:06.058 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.059 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle": { 2024-09-10T21:27:06.059 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:06.059 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-10T21:27:06.059 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:06.059 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-10T21:27:06.059 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-10T21:27:06.059 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:06.059 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:06.059 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-10T21:27:06.059 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-10T21:27:06.059 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 0, 2024-09-10T21:27:06.059 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 0, 2024-09-10T21:27:06.059 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:06.059 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.060 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.060 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.060 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:06.060 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.060 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle-0x55653063adc0": { 2024-09-10T21:27:06.060 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:06.060 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-10T21:27:06.060 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:06.060 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 3, 2024-09-10T21:27:06.060 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 896, 2024-09-10T21:27:06.060 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:06.060 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 3, 2024-09-10T21:27:06.060 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-10T21:27:06.061 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-10T21:27:06.061 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 2, 2024-09-10T21:27:06.061 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 896, 2024-09-10T21:27:06.061 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:06.061 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:06.061 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:06.061 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:06.061 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:06.061 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:06.061 INFO:teuthology.orchestra.run.smithi192.stdout: "trackedop": { 2024-09-10T21:27:06.061 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_ops_count": 0 2024-09-10T21:27:06.061 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:06.061 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-10T21:27:06.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:06 smithi192 ceph-mon[35363]: pgmap v695: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:27:06.864 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-10T21:27:06.864 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-10T21:27:06.864 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-10T21:27:06.865 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=11 2024-09-10T21:27:06.865 DEBUG:tasks.check_counter:Getting stats from f 2024-09-10T21:27:06.865 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-10T21:27:06.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:06 smithi059 ceph-mon[30888]: pgmap v695: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:27:06.930 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:06 smithi154 ceph-mon[35041]: pgmap v695: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:27:07.115 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:27:07.585 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-10T21:27:07.586 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:27:07.586 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 69, 2024-09-10T21:27:07.586 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 75, 2024-09-10T21:27:07.586 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 12218, 2024-09-10T21:27:07.586 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 551750, 2024-09-10T21:27:07.586 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 55, 2024-09-10T21:27:07.586 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 5, 2024-09-10T21:27:07.586 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.032964289, 2024-09-10T21:27:07.586 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.005023596, 2024-09-10T21:27:07.586 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.022136161, 2024-09-10T21:27:07.586 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000283838, 2024-09-10T21:27:07.587 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:07.587 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 69, 2024-09-10T21:27:07.587 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.008629833, 2024-09-10T21:27:07.587 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000125070 2024-09-10T21:27:07.587 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.587 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:07.587 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 67, 2024-09-10T21:27:07.587 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000009157, 2024-09-10T21:27:07.587 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000136 2024-09-10T21:27:07.587 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.587 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 2416, 2024-09-10T21:27:07.587 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 2384 2024-09-10T21:27:07.587 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.588 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:27:07.588 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 881, 2024-09-10T21:27:07.588 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 942, 2024-09-10T21:27:07.588 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 231006, 2024-09-10T21:27:07.588 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 670554, 2024-09-10T21:27:07.588 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 9, 2024-09-10T21:27:07.588 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 5, 2024-09-10T21:27:07.588 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.111952126, 2024-09-10T21:27:07.588 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.056526285, 2024-09-10T21:27:07.588 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.054233889, 2024-09-10T21:27:07.588 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.005488936, 2024-09-10T21:27:07.588 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:07.589 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 943, 2024-09-10T21:27:07.589 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.062987627, 2024-09-10T21:27:07.589 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000066794 2024-09-10T21:27:07.589 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.589 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:07.589 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1590, 2024-09-10T21:27:07.589 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000427679, 2024-09-10T21:27:07.589 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000268 2024-09-10T21:27:07.589 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.589 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T21:27:07.589 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 389584 2024-09-10T21:27:07.589 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.590 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:27:07.590 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 395, 2024-09-10T21:27:07.590 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 387, 2024-09-10T21:27:07.590 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 612239, 2024-09-10T21:27:07.590 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 199107, 2024-09-10T21:27:07.590 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 7, 2024-09-10T21:27:07.590 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 5, 2024-09-10T21:27:07.590 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.054595401, 2024-09-10T21:27:07.590 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.027793921, 2024-09-10T21:27:07.590 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.033994000, 2024-09-10T21:27:07.590 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000458892, 2024-09-10T21:27:07.590 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:07.590 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 388, 2024-09-10T21:27:07.591 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.040973993, 2024-09-10T21:27:07.591 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000105603 2024-09-10T21:27:07.591 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.591 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:07.591 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 214, 2024-09-10T21:27:07.591 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000058470, 2024-09-10T21:27:07.591 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000273 2024-09-10T21:27:07.591 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.591 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 563104, 2024-09-10T21:27:07.591 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 146688 2024-09-10T21:27:07.591 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.591 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-09-10T21:27:07.591 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 1, 2024-09-10T21:27:07.592 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-09-10T21:27:07.592 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.592 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-MDSRank": { 2024-09-10T21:27:07.592 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-10T21:27:07.592 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-10T21:27:07.592 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 42, 2024-09-10T21:27:07.592 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.001700056, 2024-09-10T21:27:07.592 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000040477 2024-09-10T21:27:07.592 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:07.592 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.592 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-PurgeQueue": { 2024-09-10T21:27:07.592 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-10T21:27:07.593 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-10T21:27:07.593 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2, 2024-09-10T21:27:07.593 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000031460, 2024-09-10T21:27:07.593 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000015730 2024-09-10T21:27:07.593 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:07.593 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.593 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": { 2024-09-10T21:27:07.593 INFO:teuthology.orchestra.run.smithi192.stdout: "request": 2, 2024-09-10T21:27:07.593 INFO:teuthology.orchestra.run.smithi192.stdout: "reply": 1, 2024-09-10T21:27:07.593 INFO:teuthology.orchestra.run.smithi192.stdout: "reply_latency": { 2024-09-10T21:27:07.593 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1, 2024-09-10T21:27:07.593 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000116909, 2024-09-10T21:27:07.594 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000116909 2024-09-10T21:27:07.594 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.594 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_reply": 0, 2024-09-10T21:27:07.594 INFO:teuthology.orchestra.run.smithi192.stdout: "forward": 1, 2024-09-10T21:27:07.594 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_complete": 0, 2024-09-10T21:27:07.594 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_keys": 0, 2024-09-10T21:27:07.594 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_commit": 11, 2024-09-10T21:27:07.594 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_split": 0, 2024-09-10T21:27:07.594 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_merge": 0, 2024-09-10T21:27:07.594 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes": 16, 2024-09-10T21:27:07.594 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_top": 0, 2024-09-10T21:27:07.594 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_bottom": 16, 2024-09-10T21:27:07.595 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pin_tail": 0, 2024-09-10T21:27:07.595 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pinned": 13, 2024-09-10T21:27:07.595 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_expired": 4, 2024-09-10T21:27:07.595 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_with_caps": 1, 2024-09-10T21:27:07.595 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": 1, 2024-09-10T21:27:07.595 INFO:teuthology.orchestra.run.smithi192.stdout: "subtrees": 3, 2024-09-10T21:27:07.595 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse": 8, 2024-09-10T21:27:07.595 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_hit": 4, 2024-09-10T21:27:07.595 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_forward": 1, 2024-09-10T21:27:07.596 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_discover": 3, 2024-09-10T21:27:07.596 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_dir_fetch": 0, 2024-09-10T21:27:07.596 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_remote_ino": 0, 2024-09-10T21:27:07.596 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_lock": 0, 2024-09-10T21:27:07.596 INFO:teuthology.orchestra.run.smithi192.stdout: "load_cent": 0, 2024-09-10T21:27:07.596 INFO:teuthology.orchestra.run.smithi192.stdout: "q": 0, 2024-09-10T21:27:07.596 INFO:teuthology.orchestra.run.smithi192.stdout: "exported": 0, 2024-09-10T21:27:07.596 INFO:teuthology.orchestra.run.smithi192.stdout: "exported_inodes": 0, 2024-09-10T21:27:07.596 INFO:teuthology.orchestra.run.smithi192.stdout: "imported": 0, 2024-09-10T21:27:07.596 INFO:teuthology.orchestra.run.smithi192.stdout: "imported_inodes": 0, 2024-09-10T21:27:07.596 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_dir_fetch": 0, 2024-09-10T21:27:07.596 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_backtrace_fetch": 0, 2024-09-10T21:27:07.596 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_peer_discover": 0, 2024-09-10T21:27:07.597 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rfiles": 4, 2024-09-10T21:27:07.597 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rbytes": 234, 2024-09-10T21:27:07.597 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rsnaps": 0, 2024-09-10T21:27:07.597 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T21:27:07.597 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_set_tag": 0, 2024-09-10T21:27:07.597 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T21:27:07.597 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_inotable_repaired": 0, 2024-09-10T21:27:07.597 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_inodes": 0, 2024-09-10T21:27:07.597 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T21:27:07.597 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T21:27:07.597 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_file_inodes": 0, 2024-09-10T21:27:07.597 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_inode_file_caps": 0, 2024-09-10T21:27:07.598 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T21:27:07.598 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_grant": 0, 2024-09-10T21:27:07.598 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T21:27:07.598 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T21:27:07.598 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T21:27:07.598 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps": 0, 2024-09-10T21:27:07.598 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps_dirty": 0, 2024-09-10T21:27:07.598 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_cap_release": 0, 2024-09-10T21:27:07.598 INFO:teuthology.orchestra.run.smithi192.stdout: "process_request_cap_release": 0 2024-09-10T21:27:07.598 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.598 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_cache": { 2024-09-10T21:27:07.598 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update": 0, 2024-09-10T21:27:07.598 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update_receipt": 11, 2024-09-10T21:27:07.599 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_try_discover": 7, 2024-09-10T21:27:07.599 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_send_discover": 8, 2024-09-10T21:27:07.599 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_handle_discover": 0, 2024-09-10T21:27:07.599 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays": 0, 2024-09-10T21:27:07.599 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_delayed": 0, 2024-09-10T21:27:07.599 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_enqueuing": 0, 2024-09-10T21:27:07.599 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_created": 0, 2024-09-10T21:27:07.599 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_enqueued": 0, 2024-09-10T21:27:07.599 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_reintegrated": 0, 2024-09-10T21:27:07.599 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_migrated": 0, 2024-09-10T21:27:07.599 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_processing": 0, 2024-09-10T21:27:07.599 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_enqueued": 0, 2024-09-10T21:27:07.599 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_prioritized": 0, 2024-09-10T21:27:07.599 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_started": 0, 2024-09-10T21:27:07.599 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_completed": 0, 2024-09-10T21:27:07.600 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_path": 0, 2024-09-10T21:27:07.600 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_inode": 0, 2024-09-10T21:27:07.600 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T21:27:07.600 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_exportdir": 0, 2024-09-10T21:27:07.600 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_flush": 0, 2024-09-10T21:27:07.600 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragmentdir": 0, 2024-09-10T21:27:07.600 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragstats": 0, 2024-09-10T21:27:07.600 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_inodestats": 0, 2024-09-10T21:27:07.600 INFO:teuthology.orchestra.run.smithi192.stdout: "uninline_started": 0, 2024-09-10T21:27:07.600 INFO:teuthology.orchestra.run.smithi192.stdout: "uninline_succeeded": 0, 2024-09-10T21:27:07.600 INFO:teuthology.orchestra.run.smithi192.stdout: "uninline_write_failed": 0 2024-09-10T21:27:07.600 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.600 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_log": { 2024-09-10T21:27:07.601 INFO:teuthology.orchestra.run.smithi192.stdout: "evlrg": 0, 2024-09-10T21:27:07.601 INFO:teuthology.orchestra.run.smithi192.stdout: "evadd": 3, 2024-09-10T21:27:07.601 INFO:teuthology.orchestra.run.smithi192.stdout: "evex": 0, 2024-09-10T21:27:07.601 INFO:teuthology.orchestra.run.smithi192.stdout: "evtrm": 0, 2024-09-10T21:27:07.601 INFO:teuthology.orchestra.run.smithi192.stdout: "ev": 3, 2024-09-10T21:27:07.601 INFO:teuthology.orchestra.run.smithi192.stdout: "evexg": 0, 2024-09-10T21:27:07.601 INFO:teuthology.orchestra.run.smithi192.stdout: "evexd": 0, 2024-09-10T21:27:07.601 INFO:teuthology.orchestra.run.smithi192.stdout: "segadd": 2, 2024-09-10T21:27:07.601 INFO:teuthology.orchestra.run.smithi192.stdout: "segex": 0, 2024-09-10T21:27:07.601 INFO:teuthology.orchestra.run.smithi192.stdout: "segtrm": 0, 2024-09-10T21:27:07.601 INFO:teuthology.orchestra.run.smithi192.stdout: "seg": 2, 2024-09-10T21:27:07.601 INFO:teuthology.orchestra.run.smithi192.stdout: "segmjr": 2, 2024-09-10T21:27:07.601 INFO:teuthology.orchestra.run.smithi192.stdout: "segexg": 0, 2024-09-10T21:27:07.601 INFO:teuthology.orchestra.run.smithi192.stdout: "segexd": 0, 2024-09-10T21:27:07.601 INFO:teuthology.orchestra.run.smithi192.stdout: "expos": 4194304, 2024-09-10T21:27:07.602 INFO:teuthology.orchestra.run.smithi192.stdout: "wrpos": 4195200, 2024-09-10T21:27:07.602 INFO:teuthology.orchestra.run.smithi192.stdout: "rdpos": 0, 2024-09-10T21:27:07.602 INFO:teuthology.orchestra.run.smithi192.stdout: "jlat": { 2024-09-10T21:27:07.602 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2, 2024-09-10T21:27:07.602 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.003512732, 2024-09-10T21:27:07.602 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001756366 2024-09-10T21:27:07.602 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.602 INFO:teuthology.orchestra.run.smithi192.stdout: "replayed": 0 2024-09-10T21:27:07.602 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.602 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_mem": { 2024-09-10T21:27:07.602 INFO:teuthology.orchestra.run.smithi192.stdout: "ino": 20, 2024-09-10T21:27:07.602 INFO:teuthology.orchestra.run.smithi192.stdout: "ino+": 22, 2024-09-10T21:27:07.602 INFO:teuthology.orchestra.run.smithi192.stdout: "ino-": 2, 2024-09-10T21:27:07.603 INFO:teuthology.orchestra.run.smithi192.stdout: "dir": 19, 2024-09-10T21:27:07.603 INFO:teuthology.orchestra.run.smithi192.stdout: "dir+": 23, 2024-09-10T21:27:07.603 INFO:teuthology.orchestra.run.smithi192.stdout: "dir-": 4, 2024-09-10T21:27:07.603 INFO:teuthology.orchestra.run.smithi192.stdout: "dn": 16, 2024-09-10T21:27:07.603 INFO:teuthology.orchestra.run.smithi192.stdout: "dn+": 20, 2024-09-10T21:27:07.603 INFO:teuthology.orchestra.run.smithi192.stdout: "dn-": 4, 2024-09-10T21:27:07.603 INFO:teuthology.orchestra.run.smithi192.stdout: "cap": 1, 2024-09-10T21:27:07.603 INFO:teuthology.orchestra.run.smithi192.stdout: "cap+": 1, 2024-09-10T21:27:07.603 INFO:teuthology.orchestra.run.smithi192.stdout: "cap-": 0, 2024-09-10T21:27:07.603 INFO:teuthology.orchestra.run.smithi192.stdout: "rss": 50276, 2024-09-10T21:27:07.603 INFO:teuthology.orchestra.run.smithi192.stdout: "heap": 257679360 2024-09-10T21:27:07.603 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.603 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_server": { 2024-09-10T21:27:07.604 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_client_request": 2, 2024-09-10T21:27:07.604 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_server_request": 0, 2024-09-10T21:27:07.604 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_request": 2, 2024-09-10T21:27:07.604 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_session": 10, 2024-09-10T21:27:07.604 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_peer_request": 0, 2024-09-10T21:27:07.604 INFO:teuthology.orchestra.run.smithi192.stdout: "req_create_latency": { 2024-09-10T21:27:07.604 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.604 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.604 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.605 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.605 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getattr_latency": { 2024-09-10T21:27:07.605 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.605 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.605 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.605 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.605 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getfilelock_latency": { 2024-09-10T21:27:07.605 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.605 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.605 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.605 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.605 INFO:teuthology.orchestra.run.smithi192.stdout: "req_link_latency": { 2024-09-10T21:27:07.605 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.606 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.606 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.606 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.606 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookup_latency": { 2024-09-10T21:27:07.606 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.606 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.606 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.606 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.606 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookuphash_latency": { 2024-09-10T21:27:07.606 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.606 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.606 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.606 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.607 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupino_latency": { 2024-09-10T21:27:07.607 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1, 2024-09-10T21:27:07.607 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000116909, 2024-09-10T21:27:07.607 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000116909 2024-09-10T21:27:07.607 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.607 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupname_latency": { 2024-09-10T21:27:07.607 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.607 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.607 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.607 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.607 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupparent_latency": { 2024-09-10T21:27:07.607 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.607 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.607 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.607 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.608 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupsnap_latency": { 2024-09-10T21:27:07.608 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.608 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.608 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.608 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.608 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lssnap_latency": { 2024-09-10T21:27:07.608 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.608 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.608 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.608 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.608 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mkdir_latency": { 2024-09-10T21:27:07.608 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.608 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.609 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.609 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.609 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mknod_latency": { 2024-09-10T21:27:07.609 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.609 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.609 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.609 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.609 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mksnap_latency": { 2024-09-10T21:27:07.609 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.609 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.609 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.609 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.610 INFO:teuthology.orchestra.run.smithi192.stdout: "req_open_latency": { 2024-09-10T21:27:07.610 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.610 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.610 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.610 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.610 INFO:teuthology.orchestra.run.smithi192.stdout: "req_readdir_latency": { 2024-09-10T21:27:07.610 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.610 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.610 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.610 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.610 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rename_latency": { 2024-09-10T21:27:07.611 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.611 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.611 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.611 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.611 INFO:teuthology.orchestra.run.smithi192.stdout: "req_renamesnap_latency": { 2024-09-10T21:27:07.611 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.611 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.611 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.611 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.611 INFO:teuthology.orchestra.run.smithi192.stdout: "req_snapdiff_latency": { 2024-09-10T21:27:07.611 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.611 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.611 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.612 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.612 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmdir_latency": { 2024-09-10T21:27:07.612 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.612 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.612 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.612 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.612 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmsnap_latency": { 2024-09-10T21:27:07.612 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.612 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.612 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.612 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.612 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmxattr_latency": { 2024-09-10T21:27:07.612 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.612 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.613 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.613 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.613 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setattr_latency": { 2024-09-10T21:27:07.613 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.613 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.613 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.613 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.613 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setdirlayout_latency": { 2024-09-10T21:27:07.613 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.613 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.613 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.613 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.613 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setfilelock_latency": { 2024-09-10T21:27:07.614 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.614 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.614 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.614 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.614 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setlayout_latency": { 2024-09-10T21:27:07.614 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.614 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.614 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.614 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.614 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setxattr_latency": { 2024-09-10T21:27:07.614 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.614 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.615 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.615 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.615 INFO:teuthology.orchestra.run.smithi192.stdout: "req_symlink_latency": { 2024-09-10T21:27:07.615 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.615 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.615 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.615 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.615 INFO:teuthology.orchestra.run.smithi192.stdout: "req_unlink_latency": { 2024-09-10T21:27:07.615 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.615 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.615 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.615 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.616 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_revoke_eviction": 0, 2024-09-10T21:27:07.616 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_acquisition_throttle": 0, 2024-09-10T21:27:07.616 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getvxattr_latency": { 2024-09-10T21:27:07.616 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.616 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.616 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.616 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:07.616 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.616 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_sessions": { 2024-09-10T21:27:07.616 INFO:teuthology.orchestra.run.smithi192.stdout: "session_count": 1, 2024-09-10T21:27:07.616 INFO:teuthology.orchestra.run.smithi192.stdout: "session_add": 1, 2024-09-10T21:27:07.616 INFO:teuthology.orchestra.run.smithi192.stdout: "session_remove": 0, 2024-09-10T21:27:07.617 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_open": 1, 2024-09-10T21:27:07.617 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_stale": 0, 2024-09-10T21:27:07.617 INFO:teuthology.orchestra.run.smithi192.stdout: "total_load": 1, 2024-09-10T21:27:07.617 INFO:teuthology.orchestra.run.smithi192.stdout: "average_load": 1, 2024-09-10T21:27:07.617 INFO:teuthology.orchestra.run.smithi192.stdout: "avg_session_uptime": 713, 2024-09-10T21:27:07.617 INFO:teuthology.orchestra.run.smithi192.stdout: "mdthresh_evicted": 0 2024-09-10T21:27:07.617 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.617 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-09-10T21:27:07.617 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:27:07.617 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-09-10T21:27:07.617 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:27:07.617 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:27:07.618 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:27:07.618 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:27:07.618 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:27:07.618 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:27:07.618 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:27:07.618 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:27:07.618 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:27:07.618 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:27:07.618 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:27:07.618 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:27:07.618 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:27:07.618 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-09-10T21:27:07.619 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:27:07.619 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-09-10T21:27:07.619 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:27:07.619 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:27:07.619 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:27:07.619 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:27:07.619 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:27:07.619 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:27:07.619 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:27:07.619 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-09-10T21:27:07.619 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:27:07.619 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:27:07.619 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:27:07.619 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-09-10T21:27:07.620 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-09-10T21:27:07.620 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-09-10T21:27:07.620 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:27:07.620 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:27:07.620 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:27:07.620 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:27:07.620 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 254503, 2024-09-10T21:27:07.620 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 84, 2024-09-10T21:27:07.620 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:27:07.620 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 0, 2024-09-10T21:27:07.620 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-09-10T21:27:07.620 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-09-10T21:27:07.620 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:27:07.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-09-10T21:27:07.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:27:07.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-09-10T21:27:07.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 7400, 2024-09-10T21:27:07.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 152, 2024-09-10T21:27:07.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:27:07.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:27:07.621 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-09-10T21:27:07.621 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-09-10T21:27:07.621 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 81717, 2024-09-10T21:27:07.621 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 326, 2024-09-10T21:27:07.621 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-09-10T21:27:07.621 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-09-10T21:27:07.622 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-09-10T21:27:07.622 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-09-10T21:27:07.622 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.622 INFO:teuthology.orchestra.run.smithi192.stdout: "objecter": { 2024-09-10T21:27:07.622 INFO:teuthology.orchestra.run.smithi192.stdout: "op_active": 0, 2024-09-10T21:27:07.622 INFO:teuthology.orchestra.run.smithi192.stdout: "op_laggy": 0, 2024-09-10T21:27:07.622 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send": 37, 2024-09-10T21:27:07.622 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send_bytes": 11108, 2024-09-10T21:27:07.622 INFO:teuthology.orchestra.run.smithi192.stdout: "op_resend": 28, 2024-09-10T21:27:07.622 INFO:teuthology.orchestra.run.smithi192.stdout: "op_reply": 37, 2024-09-10T21:27:07.622 INFO:teuthology.orchestra.run.smithi192.stdout: "op_latency": { 2024-09-10T21:27:07.622 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 37, 2024-09-10T21:27:07.622 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.197996109, 2024-09-10T21:27:07.623 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.005351246 2024-09-10T21:27:07.623 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.623 INFO:teuthology.orchestra.run.smithi192.stdout: "op_inflight": 0, 2024-09-10T21:27:07.623 INFO:teuthology.orchestra.run.smithi192.stdout: "oplen_avg": { 2024-09-10T21:27:07.623 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 37, 2024-09-10T21:27:07.623 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 59 2024-09-10T21:27:07.623 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.623 INFO:teuthology.orchestra.run.smithi192.stdout: "op": 37, 2024-09-10T21:27:07.623 INFO:teuthology.orchestra.run.smithi192.stdout: "op_r": 0, 2024-09-10T21:27:07.623 INFO:teuthology.orchestra.run.smithi192.stdout: "op_w": 37, 2024-09-10T21:27:07.623 INFO:teuthology.orchestra.run.smithi192.stdout: "op_rmw": 0, 2024-09-10T21:27:07.623 INFO:teuthology.orchestra.run.smithi192.stdout: "op_pg": 0, 2024-09-10T21:27:07.623 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_stat": 0, 2024-09-10T21:27:07.624 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_create": 10, 2024-09-10T21:27:07.624 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_read": 0, 2024-09-10T21:27:07.624 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_write": 2, 2024-09-10T21:27:07.624 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writefull": 6, 2024-09-10T21:27:07.624 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writesame": 0, 2024-09-10T21:27:07.624 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_append": 0, 2024-09-10T21:27:07.624 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_zero": 0, 2024-09-10T21:27:07.624 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_truncate": 0, 2024-09-10T21:27:07.624 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_delete": 6, 2024-09-10T21:27:07.624 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_mapext": 0, 2024-09-10T21:27:07.624 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_sparse_read": 0, 2024-09-10T21:27:07.624 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_clonerange": 0, 2024-09-10T21:27:07.624 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_getxattr": 0, 2024-09-10T21:27:07.625 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_setxattr": 20, 2024-09-10T21:27:07.625 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_cmpxattr": 0, 2024-09-10T21:27:07.625 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_rmxattr": 0, 2024-09-10T21:27:07.625 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_resetxattrs": 0, 2024-09-10T21:27:07.625 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_call": 0, 2024-09-10T21:27:07.625 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_watch": 0, 2024-09-10T21:27:07.625 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_notify": 0, 2024-09-10T21:27:07.625 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T21:27:07.625 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls": 0, 2024-09-10T21:27:07.625 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls_filter": 0, 2024-09-10T21:27:07.625 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_other": 0, 2024-09-10T21:27:07.625 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_active": 0, 2024-09-10T21:27:07.625 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_send": 0, 2024-09-10T21:27:07.626 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_resend": 0, 2024-09-10T21:27:07.626 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_ping": 0, 2024-09-10T21:27:07.626 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_active": 0, 2024-09-10T21:27:07.626 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_send": 0, 2024-09-10T21:27:07.626 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_resend": 0, 2024-09-10T21:27:07.626 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_active": 0, 2024-09-10T21:27:07.626 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_send": 0, 2024-09-10T21:27:07.626 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_resend": 0, 2024-09-10T21:27:07.626 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_active": 0, 2024-09-10T21:27:07.626 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_send": 0, 2024-09-10T21:27:07.626 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_resend": 0, 2024-09-10T21:27:07.626 INFO:teuthology.orchestra.run.smithi192.stdout: "command_active": 0, 2024-09-10T21:27:07.626 INFO:teuthology.orchestra.run.smithi192.stdout: "command_send": 0, 2024-09-10T21:27:07.626 INFO:teuthology.orchestra.run.smithi192.stdout: "command_resend": 0, 2024-09-10T21:27:07.627 INFO:teuthology.orchestra.run.smithi192.stdout: "map_epoch": 75, 2024-09-10T21:27:07.627 INFO:teuthology.orchestra.run.smithi192.stdout: "map_full": 0, 2024-09-10T21:27:07.627 INFO:teuthology.orchestra.run.smithi192.stdout: "map_inc": 2, 2024-09-10T21:27:07.627 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_sessions": 9, 2024-09-10T21:27:07.627 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_open": 9, 2024-09-10T21:27:07.627 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_close": 0, 2024-09-10T21:27:07.627 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_laggy": 0, 2024-09-10T21:27:07.627 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_wr": 14, 2024-09-10T21:27:07.627 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_rd": 0, 2024-09-10T21:27:07.627 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_del": 1 2024-09-10T21:27:07.627 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.627 INFO:teuthology.orchestra.run.smithi192.stdout: "oft": { 2024-09-10T21:27:07.627 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_objs": 1, 2024-09-10T21:27:07.627 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_kv_pairs": 0, 2024-09-10T21:27:07.628 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_updates": 0, 2024-09-10T21:27:07.628 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_removes": 0 2024-09-10T21:27:07.628 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.628 INFO:teuthology.orchestra.run.smithi192.stdout: "purge_queue": { 2024-09-10T21:27:07.628 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops": 0, 2024-09-10T21:27:07.628 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T21:27:07.628 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing": 0, 2024-09-10T21:27:07.628 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_high_water": 0, 2024-09-10T21:27:07.628 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed_ops": 0, 2024-09-10T21:27:07.628 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed": 0, 2024-09-10T21:27:07.628 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_item_in_journal": 0 2024-09-10T21:27:07.629 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.629 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:27:07.629 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:07.629 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-10T21:27:07.629 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:07.629 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 1341, 2024-09-10T21:27:07.629 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 717615, 2024-09-10T21:27:07.629 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:07.629 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 1341, 2024-09-10T21:27:07.629 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-10T21:27:07.629 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-10T21:27:07.629 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 1341, 2024-09-10T21:27:07.629 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 717615, 2024-09-10T21:27:07.630 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:07.630 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.630 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.630 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.630 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:07.630 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.630 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_bytes": { 2024-09-10T21:27:07.630 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:07.630 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-10T21:27:07.630 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:07.630 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-10T21:27:07.630 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-10T21:27:07.630 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:07.631 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:07.631 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 37, 2024-09-10T21:27:07.631 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 11108, 2024-09-10T21:27:07.631 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 37, 2024-09-10T21:27:07.631 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 11108, 2024-09-10T21:27:07.631 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:07.631 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.631 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.631 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.631 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:07.631 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.631 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_ops": { 2024-09-10T21:27:07.632 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:07.632 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 1024, 2024-09-10T21:27:07.632 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:07.632 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-10T21:27:07.632 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-10T21:27:07.632 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:07.632 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:07.632 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 37, 2024-09-10T21:27:07.632 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 37, 2024-09-10T21:27:07.632 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 37, 2024-09-10T21:27:07.632 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 37, 2024-09-10T21:27:07.632 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:07.632 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.633 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.633 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.633 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:07.633 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.633 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle": { 2024-09-10T21:27:07.633 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:07.633 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-10T21:27:07.633 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:07.633 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-10T21:27:07.633 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-10T21:27:07.633 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:07.633 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:07.633 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-10T21:27:07.633 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-10T21:27:07.634 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 0, 2024-09-10T21:27:07.634 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 0, 2024-09-10T21:27:07.634 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:07.634 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.634 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.634 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.634 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:07.634 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.634 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle-0x563f22648dc0": { 2024-09-10T21:27:07.634 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:07.634 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-10T21:27:07.634 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:07.635 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 3, 2024-09-10T21:27:07.635 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 896, 2024-09-10T21:27:07.635 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:07.635 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 3, 2024-09-10T21:27:07.635 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-10T21:27:07.635 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-10T21:27:07.635 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 2, 2024-09-10T21:27:07.635 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 896, 2024-09-10T21:27:07.635 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:07.635 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:07.635 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:07.635 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:07.635 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:07.636 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:07.636 INFO:teuthology.orchestra.run.smithi192.stdout: "trackedop": { 2024-09-10T21:27:07.636 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_ops_count": 0 2024-09-10T21:27:07.636 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:07.636 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-10T21:27:08.335 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-10T21:27:08.336 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-10T21:27:08.336 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-10T21:27:08.336 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=11 2024-09-10T21:27:08.336 DEBUG:tasks.check_counter:Getting stats from i 2024-09-10T21:27:08.336 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-10T21:27:08.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:08 smithi192 ceph-mon[35363]: pgmap v696: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:27:08.582 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:27:08.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:08 smithi059 ceph-mon[30888]: pgmap v696: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:27:08.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:08 smithi154 ceph-mon[35041]: pgmap v696: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T21:27:09.097 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-10T21:27:09.097 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:27:09.097 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 142, 2024-09-10T21:27:09.098 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 142, 2024-09-10T21:27:09.098 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 54893, 2024-09-10T21:27:09.098 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 57131, 2024-09-10T21:27:09.098 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 12, 2024-09-10T21:27:09.098 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 4, 2024-09-10T21:27:09.098 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.022690226, 2024-09-10T21:27:09.098 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.006756270, 2024-09-10T21:27:09.098 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.011936932, 2024-09-10T21:27:09.098 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000444081, 2024-09-10T21:27:09.098 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:09.098 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 141, 2024-09-10T21:27:09.098 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.033761493, 2024-09-10T21:27:09.099 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000239443 2024-09-10T21:27:09.099 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.099 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:09.099 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 222, 2024-09-10T21:27:09.099 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000117804, 2024-09-10T21:27:09.099 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000530 2024-09-10T21:27:09.099 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.099 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 4576, 2024-09-10T21:27:09.099 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 1888 2024-09-10T21:27:09.099 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.099 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:27:09.099 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 1147, 2024-09-10T21:27:09.100 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 1024, 2024-09-10T21:27:09.100 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 789822, 2024-09-10T21:27:09.100 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 790790, 2024-09-10T21:27:09.100 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 47, 2024-09-10T21:27:09.100 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 6, 2024-09-10T21:27:09.100 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.151265159, 2024-09-10T21:27:09.100 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.068736011, 2024-09-10T21:27:09.100 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.088060397, 2024-09-10T21:27:09.100 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.005781098, 2024-09-10T21:27:09.100 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:09.100 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1023, 2024-09-10T21:27:09.100 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.067618037, 2024-09-10T21:27:09.100 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000066097 2024-09-10T21:27:09.101 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.101 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:09.101 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1554, 2024-09-10T21:27:09.101 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000454815, 2024-09-10T21:27:09.101 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000292 2024-09-10T21:27:09.101 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.101 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 578464, 2024-09-10T21:27:09.101 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 145728 2024-09-10T21:27:09.101 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.101 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:27:09.101 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 69, 2024-09-10T21:27:09.101 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 241, 2024-09-10T21:27:09.102 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 25486, 2024-09-10T21:27:09.102 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 473770, 2024-09-10T21:27:09.102 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 12, 2024-09-10T21:27:09.102 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 5, 2024-09-10T21:27:09.102 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.022142801, 2024-09-10T21:27:09.102 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.012693922, 2024-09-10T21:27:09.102 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.007024426, 2024-09-10T21:27:09.102 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000401092, 2024-09-10T21:27:09.102 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:09.102 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 239, 2024-09-10T21:27:09.102 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.023316578, 2024-09-10T21:27:09.102 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000097558 2024-09-10T21:27:09.102 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.102 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:09.103 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 109, 2024-09-10T21:27:09.103 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000059114, 2024-09-10T21:27:09.103 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000542 2024-09-10T21:27:09.103 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.103 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T21:27:09.103 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 392240 2024-09-10T21:27:09.103 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.103 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-09-10T21:27:09.103 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 1, 2024-09-10T21:27:09.103 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-09-10T21:27:09.103 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.103 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-MDSRank": { 2024-09-10T21:27:09.103 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-10T21:27:09.103 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-10T21:27:09.104 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 39, 2024-09-10T21:27:09.104 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.001466109, 2024-09-10T21:27:09.104 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000037592 2024-09-10T21:27:09.104 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:09.104 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.104 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-PurgeQueue": { 2024-09-10T21:27:09.104 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-10T21:27:09.104 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-10T21:27:09.104 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 2, 2024-09-10T21:27:09.104 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000012046, 2024-09-10T21:27:09.104 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000006023 2024-09-10T21:27:09.104 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:09.104 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.105 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": { 2024-09-10T21:27:09.105 INFO:teuthology.orchestra.run.smithi192.stdout: "request": 2, 2024-09-10T21:27:09.105 INFO:teuthology.orchestra.run.smithi192.stdout: "reply": 1, 2024-09-10T21:27:09.105 INFO:teuthology.orchestra.run.smithi192.stdout: "reply_latency": { 2024-09-10T21:27:09.105 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1, 2024-09-10T21:27:09.105 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000210647, 2024-09-10T21:27:09.105 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000210647 2024-09-10T21:27:09.105 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.105 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_reply": 0, 2024-09-10T21:27:09.105 INFO:teuthology.orchestra.run.smithi192.stdout: "forward": 1, 2024-09-10T21:27:09.105 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_complete": 0, 2024-09-10T21:27:09.106 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_keys": 0, 2024-09-10T21:27:09.106 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_commit": 11, 2024-09-10T21:27:09.106 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_split": 0, 2024-09-10T21:27:09.106 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_merge": 0, 2024-09-10T21:27:09.106 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes": 16, 2024-09-10T21:27:09.106 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_top": 0, 2024-09-10T21:27:09.106 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_bottom": 16, 2024-09-10T21:27:09.106 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pin_tail": 0, 2024-09-10T21:27:09.106 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pinned": 13, 2024-09-10T21:27:09.106 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_expired": 4, 2024-09-10T21:27:09.106 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_with_caps": 0, 2024-09-10T21:27:09.106 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": 0, 2024-09-10T21:27:09.106 INFO:teuthology.orchestra.run.smithi192.stdout: "subtrees": 3, 2024-09-10T21:27:09.106 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse": 10, 2024-09-10T21:27:09.106 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_hit": 5, 2024-09-10T21:27:09.107 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_forward": 0, 2024-09-10T21:27:09.107 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_discover": 4, 2024-09-10T21:27:09.107 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_dir_fetch": 0, 2024-09-10T21:27:09.107 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_remote_ino": 0, 2024-09-10T21:27:09.107 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_lock": 0, 2024-09-10T21:27:09.107 INFO:teuthology.orchestra.run.smithi192.stdout: "load_cent": 0, 2024-09-10T21:27:09.107 INFO:teuthology.orchestra.run.smithi192.stdout: "q": 0, 2024-09-10T21:27:09.107 INFO:teuthology.orchestra.run.smithi192.stdout: "exported": 0, 2024-09-10T21:27:09.107 INFO:teuthology.orchestra.run.smithi192.stdout: "exported_inodes": 0, 2024-09-10T21:27:09.107 INFO:teuthology.orchestra.run.smithi192.stdout: "imported": 0, 2024-09-10T21:27:09.107 INFO:teuthology.orchestra.run.smithi192.stdout: "imported_inodes": 0, 2024-09-10T21:27:09.107 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_dir_fetch": 0, 2024-09-10T21:27:09.108 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_backtrace_fetch": 0, 2024-09-10T21:27:09.108 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_peer_discover": 0, 2024-09-10T21:27:09.108 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rfiles": 4, 2024-09-10T21:27:09.108 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rbytes": 234, 2024-09-10T21:27:09.108 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rsnaps": 0, 2024-09-10T21:27:09.108 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T21:27:09.108 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_set_tag": 0, 2024-09-10T21:27:09.108 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T21:27:09.108 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_inotable_repaired": 0, 2024-09-10T21:27:09.108 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_inodes": 0, 2024-09-10T21:27:09.108 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T21:27:09.108 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T21:27:09.108 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_file_inodes": 0, 2024-09-10T21:27:09.109 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_inode_file_caps": 0, 2024-09-10T21:27:09.109 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T21:27:09.109 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_grant": 0, 2024-09-10T21:27:09.109 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T21:27:09.109 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T21:27:09.109 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T21:27:09.109 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps": 0, 2024-09-10T21:27:09.109 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps_dirty": 0, 2024-09-10T21:27:09.109 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_cap_release": 0, 2024-09-10T21:27:09.109 INFO:teuthology.orchestra.run.smithi192.stdout: "process_request_cap_release": 1 2024-09-10T21:27:09.109 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.109 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_cache": { 2024-09-10T21:27:09.110 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update": 0, 2024-09-10T21:27:09.110 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update_receipt": 9, 2024-09-10T21:27:09.110 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_try_discover": 6, 2024-09-10T21:27:09.110 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_send_discover": 8, 2024-09-10T21:27:09.110 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_handle_discover": 0, 2024-09-10T21:27:09.110 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays": 0, 2024-09-10T21:27:09.110 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_delayed": 0, 2024-09-10T21:27:09.110 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_enqueuing": 0, 2024-09-10T21:27:09.110 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_created": 0, 2024-09-10T21:27:09.110 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_enqueued": 0, 2024-09-10T21:27:09.110 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_reintegrated": 0, 2024-09-10T21:27:09.110 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_migrated": 0, 2024-09-10T21:27:09.111 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_processing": 0, 2024-09-10T21:27:09.111 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_enqueued": 0, 2024-09-10T21:27:09.111 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_prioritized": 0, 2024-09-10T21:27:09.111 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_started": 0, 2024-09-10T21:27:09.111 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_completed": 0, 2024-09-10T21:27:09.111 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_path": 0, 2024-09-10T21:27:09.111 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_inode": 0, 2024-09-10T21:27:09.111 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T21:27:09.111 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_exportdir": 0, 2024-09-10T21:27:09.111 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_flush": 0, 2024-09-10T21:27:09.111 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragmentdir": 0, 2024-09-10T21:27:09.111 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragstats": 0, 2024-09-10T21:27:09.112 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_inodestats": 0, 2024-09-10T21:27:09.112 INFO:teuthology.orchestra.run.smithi192.stdout: "uninline_started": 0, 2024-09-10T21:27:09.112 INFO:teuthology.orchestra.run.smithi192.stdout: "uninline_succeeded": 0, 2024-09-10T21:27:09.112 INFO:teuthology.orchestra.run.smithi192.stdout: "uninline_write_failed": 0 2024-09-10T21:27:09.112 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.112 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_log": { 2024-09-10T21:27:09.112 INFO:teuthology.orchestra.run.smithi192.stdout: "evlrg": 0, 2024-09-10T21:27:09.112 INFO:teuthology.orchestra.run.smithi192.stdout: "evadd": 4, 2024-09-10T21:27:09.112 INFO:teuthology.orchestra.run.smithi192.stdout: "evex": 0, 2024-09-10T21:27:09.112 INFO:teuthology.orchestra.run.smithi192.stdout: "evtrm": 0, 2024-09-10T21:27:09.112 INFO:teuthology.orchestra.run.smithi192.stdout: "ev": 4, 2024-09-10T21:27:09.112 INFO:teuthology.orchestra.run.smithi192.stdout: "evexg": 0, 2024-09-10T21:27:09.112 INFO:teuthology.orchestra.run.smithi192.stdout: "evexd": 0, 2024-09-10T21:27:09.113 INFO:teuthology.orchestra.run.smithi192.stdout: "segadd": 2, 2024-09-10T21:27:09.113 INFO:teuthology.orchestra.run.smithi192.stdout: "segex": 0, 2024-09-10T21:27:09.113 INFO:teuthology.orchestra.run.smithi192.stdout: "segtrm": 0, 2024-09-10T21:27:09.113 INFO:teuthology.orchestra.run.smithi192.stdout: "seg": 2, 2024-09-10T21:27:09.113 INFO:teuthology.orchestra.run.smithi192.stdout: "segmjr": 2, 2024-09-10T21:27:09.113 INFO:teuthology.orchestra.run.smithi192.stdout: "segexg": 0, 2024-09-10T21:27:09.113 INFO:teuthology.orchestra.run.smithi192.stdout: "segexd": 0, 2024-09-10T21:27:09.113 INFO:teuthology.orchestra.run.smithi192.stdout: "expos": 4194304, 2024-09-10T21:27:09.113 INFO:teuthology.orchestra.run.smithi192.stdout: "wrpos": 4195424, 2024-09-10T21:27:09.113 INFO:teuthology.orchestra.run.smithi192.stdout: "rdpos": 0, 2024-09-10T21:27:09.113 INFO:teuthology.orchestra.run.smithi192.stdout: "jlat": { 2024-09-10T21:27:09.113 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3, 2024-09-10T21:27:09.114 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.005294230, 2024-09-10T21:27:09.114 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.001764743 2024-09-10T21:27:09.114 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.114 INFO:teuthology.orchestra.run.smithi192.stdout: "replayed": 0 2024-09-10T21:27:09.114 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.114 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_mem": { 2024-09-10T21:27:09.114 INFO:teuthology.orchestra.run.smithi192.stdout: "ino": 20, 2024-09-10T21:27:09.114 INFO:teuthology.orchestra.run.smithi192.stdout: "ino+": 22, 2024-09-10T21:27:09.114 INFO:teuthology.orchestra.run.smithi192.stdout: "ino-": 2, 2024-09-10T21:27:09.114 INFO:teuthology.orchestra.run.smithi192.stdout: "dir": 19, 2024-09-10T21:27:09.114 INFO:teuthology.orchestra.run.smithi192.stdout: "dir+": 22, 2024-09-10T21:27:09.114 INFO:teuthology.orchestra.run.smithi192.stdout: "dir-": 3, 2024-09-10T21:27:09.115 INFO:teuthology.orchestra.run.smithi192.stdout: "dn": 16, 2024-09-10T21:27:09.115 INFO:teuthology.orchestra.run.smithi192.stdout: "dn+": 20, 2024-09-10T21:27:09.115 INFO:teuthology.orchestra.run.smithi192.stdout: "dn-": 4, 2024-09-10T21:27:09.115 INFO:teuthology.orchestra.run.smithi192.stdout: "cap": 0, 2024-09-10T21:27:09.115 INFO:teuthology.orchestra.run.smithi192.stdout: "cap+": 1, 2024-09-10T21:27:09.115 INFO:teuthology.orchestra.run.smithi192.stdout: "cap-": 1, 2024-09-10T21:27:09.115 INFO:teuthology.orchestra.run.smithi192.stdout: "rss": 50244, 2024-09-10T21:27:09.115 INFO:teuthology.orchestra.run.smithi192.stdout: "heap": 257679360 2024-09-10T21:27:09.115 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.115 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_server": { 2024-09-10T21:27:09.115 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_client_request": 3, 2024-09-10T21:27:09.115 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_server_request": 0, 2024-09-10T21:27:09.115 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_request": 2, 2024-09-10T21:27:09.115 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_session": 4, 2024-09-10T21:27:09.116 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_peer_request": 0, 2024-09-10T21:27:09.116 INFO:teuthology.orchestra.run.smithi192.stdout: "req_create_latency": { 2024-09-10T21:27:09.116 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.116 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.116 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.116 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.116 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getattr_latency": { 2024-09-10T21:27:09.116 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1, 2024-09-10T21:27:09.116 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000210647, 2024-09-10T21:27:09.116 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000210647 2024-09-10T21:27:09.116 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.116 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getfilelock_latency": { 2024-09-10T21:27:09.116 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.117 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.117 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.117 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.117 INFO:teuthology.orchestra.run.smithi192.stdout: "req_link_latency": { 2024-09-10T21:27:09.117 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.117 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.117 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.117 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.117 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookup_latency": { 2024-09-10T21:27:09.117 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.117 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.117 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.118 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.118 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookuphash_latency": { 2024-09-10T21:27:09.118 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.118 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.118 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.118 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.118 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupino_latency": { 2024-09-10T21:27:09.118 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.118 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.118 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.118 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.118 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupname_latency": { 2024-09-10T21:27:09.119 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.119 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.119 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.119 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.119 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupparent_latency": { 2024-09-10T21:27:09.119 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.119 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.119 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.119 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.119 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupsnap_latency": { 2024-09-10T21:27:09.119 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.119 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.119 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.119 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.120 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lssnap_latency": { 2024-09-10T21:27:09.120 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.120 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.120 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.120 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.120 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mkdir_latency": { 2024-09-10T21:27:09.120 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.120 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.120 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.120 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.120 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mknod_latency": { 2024-09-10T21:27:09.120 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.121 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.121 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.121 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.121 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mksnap_latency": { 2024-09-10T21:27:09.121 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.121 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.121 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.121 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.121 INFO:teuthology.orchestra.run.smithi192.stdout: "req_open_latency": { 2024-09-10T21:27:09.121 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.121 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.121 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.121 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.122 INFO:teuthology.orchestra.run.smithi192.stdout: "req_readdir_latency": { 2024-09-10T21:27:09.122 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.122 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.122 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.122 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.122 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rename_latency": { 2024-09-10T21:27:09.122 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.122 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.122 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.122 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.122 INFO:teuthology.orchestra.run.smithi192.stdout: "req_renamesnap_latency": { 2024-09-10T21:27:09.122 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.122 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.123 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.123 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.123 INFO:teuthology.orchestra.run.smithi192.stdout: "req_snapdiff_latency": { 2024-09-10T21:27:09.123 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.123 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.123 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.123 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.123 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmdir_latency": { 2024-09-10T21:27:09.123 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.123 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.123 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.123 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.123 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmsnap_latency": { 2024-09-10T21:27:09.123 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.124 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.124 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.124 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.124 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmxattr_latency": { 2024-09-10T21:27:09.124 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.124 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.124 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.124 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.124 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setattr_latency": { 2024-09-10T21:27:09.124 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.124 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.124 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.124 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.125 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setdirlayout_latency": { 2024-09-10T21:27:09.125 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.125 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.125 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.125 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.125 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setfilelock_latency": { 2024-09-10T21:27:09.125 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.125 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.125 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.125 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.126 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setlayout_latency": { 2024-09-10T21:27:09.126 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.126 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.126 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.126 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.126 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setxattr_latency": { 2024-09-10T21:27:09.126 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.126 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.126 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.126 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.126 INFO:teuthology.orchestra.run.smithi192.stdout: "req_symlink_latency": { 2024-09-10T21:27:09.126 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.127 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.127 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.127 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.127 INFO:teuthology.orchestra.run.smithi192.stdout: "req_unlink_latency": { 2024-09-10T21:27:09.127 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.127 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.127 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.127 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.127 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_revoke_eviction": 0, 2024-09-10T21:27:09.127 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_acquisition_throttle": 0, 2024-09-10T21:27:09.127 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getvxattr_latency": { 2024-09-10T21:27:09.127 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.127 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.128 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.128 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:09.128 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.128 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_sessions": { 2024-09-10T21:27:09.128 INFO:teuthology.orchestra.run.smithi192.stdout: "session_count": 0, 2024-09-10T21:27:09.128 INFO:teuthology.orchestra.run.smithi192.stdout: "session_add": 1, 2024-09-10T21:27:09.128 INFO:teuthology.orchestra.run.smithi192.stdout: "session_remove": 1, 2024-09-10T21:27:09.128 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_open": 0, 2024-09-10T21:27:09.128 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_stale": 0, 2024-09-10T21:27:09.128 INFO:teuthology.orchestra.run.smithi192.stdout: "total_load": 1, 2024-09-10T21:27:09.128 INFO:teuthology.orchestra.run.smithi192.stdout: "average_load": 1, 2024-09-10T21:27:09.128 INFO:teuthology.orchestra.run.smithi192.stdout: "avg_session_uptime": 88, 2024-09-10T21:27:09.128 INFO:teuthology.orchestra.run.smithi192.stdout: "mdthresh_evicted": 0 2024-09-10T21:27:09.128 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.129 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-09-10T21:27:09.129 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:27:09.129 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-09-10T21:27:09.129 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:27:09.129 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:27:09.129 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:27:09.129 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:27:09.129 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:27:09.129 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:27:09.129 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:27:09.129 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:27:09.129 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:27:09.130 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:27:09.130 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:27:09.130 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:27:09.130 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:27:09.130 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-09-10T21:27:09.130 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:27:09.130 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-09-10T21:27:09.130 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:27:09.130 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:27:09.130 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:27:09.130 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:27:09.130 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:27:09.130 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:27:09.130 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:27:09.131 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-09-10T21:27:09.131 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:27:09.131 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:27:09.131 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:27:09.131 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-09-10T21:27:09.131 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-09-10T21:27:09.131 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-09-10T21:27:09.131 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:27:09.131 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:27:09.131 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:27:09.131 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:27:09.131 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 246615, 2024-09-10T21:27:09.131 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 82, 2024-09-10T21:27:09.132 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:27:09.132 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 0, 2024-09-10T21:27:09.132 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-09-10T21:27:09.132 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-09-10T21:27:09.132 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:27:09.132 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-09-10T21:27:09.132 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:27:09.132 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-09-10T21:27:09.132 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 7400, 2024-09-10T21:27:09.132 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 152, 2024-09-10T21:27:09.132 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:27:09.132 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:27:09.133 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-09-10T21:27:09.133 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-09-10T21:27:09.133 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 81397, 2024-09-10T21:27:09.133 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 324, 2024-09-10T21:27:09.133 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-09-10T21:27:09.133 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-09-10T21:27:09.133 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-09-10T21:27:09.133 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-09-10T21:27:09.133 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.133 INFO:teuthology.orchestra.run.smithi192.stdout: "objecter": { 2024-09-10T21:27:09.133 INFO:teuthology.orchestra.run.smithi192.stdout: "op_active": 0, 2024-09-10T21:27:09.133 INFO:teuthology.orchestra.run.smithi192.stdout: "op_laggy": 0, 2024-09-10T21:27:09.134 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send": 38, 2024-09-10T21:27:09.134 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send_bytes": 11332, 2024-09-10T21:27:09.134 INFO:teuthology.orchestra.run.smithi192.stdout: "op_resend": 30, 2024-09-10T21:27:09.134 INFO:teuthology.orchestra.run.smithi192.stdout: "op_reply": 38, 2024-09-10T21:27:09.134 INFO:teuthology.orchestra.run.smithi192.stdout: "op_latency": { 2024-09-10T21:27:09.134 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 38, 2024-09-10T21:27:09.134 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.221995644, 2024-09-10T21:27:09.134 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.005841990 2024-09-10T21:27:09.134 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.134 INFO:teuthology.orchestra.run.smithi192.stdout: "op_inflight": 0, 2024-09-10T21:27:09.134 INFO:teuthology.orchestra.run.smithi192.stdout: "oplen_avg": { 2024-09-10T21:27:09.134 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 38, 2024-09-10T21:27:09.134 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 60 2024-09-10T21:27:09.135 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.135 INFO:teuthology.orchestra.run.smithi192.stdout: "op": 38, 2024-09-10T21:27:09.135 INFO:teuthology.orchestra.run.smithi192.stdout: "op_r": 0, 2024-09-10T21:27:09.135 INFO:teuthology.orchestra.run.smithi192.stdout: "op_w": 38, 2024-09-10T21:27:09.135 INFO:teuthology.orchestra.run.smithi192.stdout: "op_rmw": 0, 2024-09-10T21:27:09.135 INFO:teuthology.orchestra.run.smithi192.stdout: "op_pg": 0, 2024-09-10T21:27:09.135 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_stat": 0, 2024-09-10T21:27:09.135 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_create": 10, 2024-09-10T21:27:09.135 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_read": 0, 2024-09-10T21:27:09.135 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_write": 3, 2024-09-10T21:27:09.135 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writefull": 6, 2024-09-10T21:27:09.135 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writesame": 0, 2024-09-10T21:27:09.135 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_append": 0, 2024-09-10T21:27:09.136 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_zero": 0, 2024-09-10T21:27:09.136 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_truncate": 0, 2024-09-10T21:27:09.136 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_delete": 6, 2024-09-10T21:27:09.136 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_mapext": 0, 2024-09-10T21:27:09.136 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_sparse_read": 0, 2024-09-10T21:27:09.136 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_clonerange": 0, 2024-09-10T21:27:09.136 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_getxattr": 0, 2024-09-10T21:27:09.136 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_setxattr": 20, 2024-09-10T21:27:09.136 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_cmpxattr": 0, 2024-09-10T21:27:09.136 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_rmxattr": 0, 2024-09-10T21:27:09.136 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_resetxattrs": 0, 2024-09-10T21:27:09.136 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_call": 0, 2024-09-10T21:27:09.136 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_watch": 0, 2024-09-10T21:27:09.136 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_notify": 0, 2024-09-10T21:27:09.137 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T21:27:09.137 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls": 0, 2024-09-10T21:27:09.137 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls_filter": 0, 2024-09-10T21:27:09.137 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_other": 0, 2024-09-10T21:27:09.137 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_active": 0, 2024-09-10T21:27:09.137 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_send": 0, 2024-09-10T21:27:09.137 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_resend": 0, 2024-09-10T21:27:09.137 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_ping": 0, 2024-09-10T21:27:09.137 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_active": 0, 2024-09-10T21:27:09.137 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_send": 0, 2024-09-10T21:27:09.137 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_resend": 0, 2024-09-10T21:27:09.137 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_active": 0, 2024-09-10T21:27:09.138 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_send": 0, 2024-09-10T21:27:09.138 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_resend": 0, 2024-09-10T21:27:09.138 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_active": 0, 2024-09-10T21:27:09.138 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_send": 0, 2024-09-10T21:27:09.138 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_resend": 0, 2024-09-10T21:27:09.138 INFO:teuthology.orchestra.run.smithi192.stdout: "command_active": 0, 2024-09-10T21:27:09.138 INFO:teuthology.orchestra.run.smithi192.stdout: "command_send": 0, 2024-09-10T21:27:09.138 INFO:teuthology.orchestra.run.smithi192.stdout: "command_resend": 0, 2024-09-10T21:27:09.138 INFO:teuthology.orchestra.run.smithi192.stdout: "map_epoch": 75, 2024-09-10T21:27:09.138 INFO:teuthology.orchestra.run.smithi192.stdout: "map_full": 0, 2024-09-10T21:27:09.138 INFO:teuthology.orchestra.run.smithi192.stdout: "map_inc": 2, 2024-09-10T21:27:09.138 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_sessions": 9, 2024-09-10T21:27:09.138 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_open": 9, 2024-09-10T21:27:09.138 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_close": 0, 2024-09-10T21:27:09.139 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_laggy": 0, 2024-09-10T21:27:09.139 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_wr": 14, 2024-09-10T21:27:09.139 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_rd": 0, 2024-09-10T21:27:09.139 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_del": 1 2024-09-10T21:27:09.139 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.139 INFO:teuthology.orchestra.run.smithi192.stdout: "oft": { 2024-09-10T21:27:09.139 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_objs": 1, 2024-09-10T21:27:09.139 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_kv_pairs": 0, 2024-09-10T21:27:09.139 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_updates": 0, 2024-09-10T21:27:09.139 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_removes": 0 2024-09-10T21:27:09.139 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.139 INFO:teuthology.orchestra.run.smithi192.stdout: "purge_queue": { 2024-09-10T21:27:09.140 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops": 0, 2024-09-10T21:27:09.140 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T21:27:09.140 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing": 0, 2024-09-10T21:27:09.140 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_high_water": 0, 2024-09-10T21:27:09.140 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed_ops": 0, 2024-09-10T21:27:09.140 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed": 0, 2024-09-10T21:27:09.140 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_item_in_journal": 0 2024-09-10T21:27:09.140 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.140 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:27:09.140 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:09.140 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-10T21:27:09.140 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:09.141 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 1354, 2024-09-10T21:27:09.141 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 731169, 2024-09-10T21:27:09.141 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:09.141 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 1354, 2024-09-10T21:27:09.141 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-10T21:27:09.141 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-10T21:27:09.141 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 1354, 2024-09-10T21:27:09.141 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 731169, 2024-09-10T21:27:09.141 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:09.141 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.141 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.141 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.141 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:09.142 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.142 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_bytes": { 2024-09-10T21:27:09.142 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:09.142 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-10T21:27:09.142 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:09.142 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-10T21:27:09.142 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-10T21:27:09.142 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:09.142 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:09.142 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 38, 2024-09-10T21:27:09.142 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 11332, 2024-09-10T21:27:09.142 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 38, 2024-09-10T21:27:09.142 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 11332, 2024-09-10T21:27:09.142 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:09.143 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.143 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.143 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.143 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:09.143 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.143 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_ops": { 2024-09-10T21:27:09.143 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:09.143 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 1024, 2024-09-10T21:27:09.143 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:09.143 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-10T21:27:09.143 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-10T21:27:09.143 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:09.143 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:09.144 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 38, 2024-09-10T21:27:09.144 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 38, 2024-09-10T21:27:09.144 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 38, 2024-09-10T21:27:09.144 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 38, 2024-09-10T21:27:09.144 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:09.144 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.144 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.144 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.144 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:09.144 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.144 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle": { 2024-09-10T21:27:09.144 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:09.145 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-10T21:27:09.145 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:09.145 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-10T21:27:09.145 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-10T21:27:09.145 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:09.145 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:09.145 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-10T21:27:09.145 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-10T21:27:09.145 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 0, 2024-09-10T21:27:09.145 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 0, 2024-09-10T21:27:09.145 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:09.145 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.145 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.145 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.146 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:09.146 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.146 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle-0x55dee164cdc0": { 2024-09-10T21:27:09.146 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:09.146 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-10T21:27:09.146 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:09.146 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 4, 2024-09-10T21:27:09.146 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 1120, 2024-09-10T21:27:09.146 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:09.146 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 4, 2024-09-10T21:27:09.146 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-10T21:27:09.146 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-10T21:27:09.146 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 3, 2024-09-10T21:27:09.147 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 1120, 2024-09-10T21:27:09.147 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:09.147 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:09.147 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:09.147 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:09.147 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:09.147 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:09.147 INFO:teuthology.orchestra.run.smithi192.stdout: "trackedop": { 2024-09-10T21:27:09.147 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_ops_count": 0 2024-09-10T21:27:09.147 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:09.147 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-10T21:27:09.846 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-10T21:27:09.846 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-10T21:27:09.846 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-09-10T21:27:09.846 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=9 2024-09-10T21:27:09.846 DEBUG:tasks.check_counter:Getting stats from l 2024-09-10T21:27:09.846 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-10T21:27:10.093 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T21:27:10.640 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-10T21:27:10.641 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T21:27:10.641 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 245, 2024-09-10T21:27:10.641 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 241, 2024-09-10T21:27:10.641 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 553106, 2024-09-10T21:27:10.641 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 144932, 2024-09-10T21:27:10.641 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 5, 2024-09-10T21:27:10.641 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 1, 2024-09-10T21:27:10.641 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.041879408, 2024-09-10T21:27:10.641 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.021328332, 2024-09-10T21:27:10.641 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.025677032, 2024-09-10T21:27:10.641 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000024784, 2024-09-10T21:27:10.642 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:10.642 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 240, 2024-09-10T21:27:10.642 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.016262381, 2024-09-10T21:27:10.642 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000067759 2024-09-10T21:27:10.642 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.642 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:10.642 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.642 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.642 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.642 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.642 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 552272, 2024-09-10T21:27:10.642 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 144608 2024-09-10T21:27:10.642 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.643 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T21:27:10.643 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 3, 2024-09-10T21:27:10.643 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 180, 2024-09-10T21:27:10.643 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 674, 2024-09-10T21:27:10.643 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 392129, 2024-09-10T21:27:10.643 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 4, 2024-09-10T21:27:10.643 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 3, 2024-09-10T21:27:10.643 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.012785739, 2024-09-10T21:27:10.643 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.010012806, 2024-09-10T21:27:10.643 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.001065005, 2024-09-10T21:27:10.643 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.000062794, 2024-09-10T21:27:10.644 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:10.644 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 178, 2024-09-10T21:27:10.644 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.009633251, 2024-09-10T21:27:10.644 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000054119 2024-09-10T21:27:10.644 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.644 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:10.644 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.644 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.644 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.644 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.644 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T21:27:10.644 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 391488 2024-09-10T21:27:10.644 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.645 INFO:teuthology.orchestra.run.smithi192.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T21:27:10.645 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_messages": 1645, 2024-09-10T21:27:10.645 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages": 1645, 2024-09-10T21:27:10.645 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_bytes": 494179, 2024-09-10T21:27:10.645 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_bytes": 522344, 2024-09-10T21:27:10.645 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_created_connections": 4, 2024-09-10T21:27:10.645 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_active_connections": 3, 2024-09-10T21:27:10.645 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_total_time": 0.210042785, 2024-09-10T21:27:10.645 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_send_time": 0.092011458, 2024-09-10T21:27:10.645 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_recv_time": 0.046616389, 2024-09-10T21:27:10.645 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_running_fast_dispatch_time": 0.054418180, 2024-09-10T21:27:10.645 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T21:27:10.645 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1644, 2024-09-10T21:27:10.646 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.082013733, 2024-09-10T21:27:10.646 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000049886 2024-09-10T21:27:10.646 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.646 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_handle_ack_lat": { 2024-09-10T21:27:10.646 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.646 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.646 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.646 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.646 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T21:27:10.646 INFO:teuthology.orchestra.run.smithi192.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T21:27:10.647 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.647 INFO:teuthology.orchestra.run.smithi192.stdout: "cct": { 2024-09-10T21:27:10.647 INFO:teuthology.orchestra.run.smithi192.stdout: "total_workers": 1, 2024-09-10T21:27:10.647 INFO:teuthology.orchestra.run.smithi192.stdout: "unhealthy_workers": 0 2024-09-10T21:27:10.647 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.647 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-MDSRank": { 2024-09-10T21:27:10.647 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-10T21:27:10.647 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-10T21:27:10.647 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 3281, 2024-09-10T21:27:10.647 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.105193539, 2024-09-10T21:27:10.647 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000032061 2024-09-10T21:27:10.647 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:10.647 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.647 INFO:teuthology.orchestra.run.smithi192.stdout: "finisher-PurgeQueue": { 2024-09-10T21:27:10.648 INFO:teuthology.orchestra.run.smithi192.stdout: "queue_len": 0, 2024-09-10T21:27:10.648 INFO:teuthology.orchestra.run.smithi192.stdout: "complete_latency": { 2024-09-10T21:27:10.648 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.648 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.648 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.648 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:10.648 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.648 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": { 2024-09-10T21:27:10.648 INFO:teuthology.orchestra.run.smithi192.stdout: "request": 0, 2024-09-10T21:27:10.648 INFO:teuthology.orchestra.run.smithi192.stdout: "reply": 0, 2024-09-10T21:27:10.649 INFO:teuthology.orchestra.run.smithi192.stdout: "reply_latency": { 2024-09-10T21:27:10.649 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.649 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.649 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.649 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.649 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_reply": 0, 2024-09-10T21:27:10.649 INFO:teuthology.orchestra.run.smithi192.stdout: "forward": 0, 2024-09-10T21:27:10.649 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_complete": 0, 2024-09-10T21:27:10.649 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_fetch_keys": 0, 2024-09-10T21:27:10.649 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_commit": 0, 2024-09-10T21:27:10.649 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_split": 0, 2024-09-10T21:27:10.649 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_merge": 0, 2024-09-10T21:27:10.649 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes": 0, 2024-09-10T21:27:10.650 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_top": 0, 2024-09-10T21:27:10.650 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_bottom": 0, 2024-09-10T21:27:10.650 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pin_tail": 0, 2024-09-10T21:27:10.650 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_pinned": 0, 2024-09-10T21:27:10.650 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_expired": 0, 2024-09-10T21:27:10.650 INFO:teuthology.orchestra.run.smithi192.stdout: "inodes_with_caps": 0, 2024-09-10T21:27:10.650 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": 0, 2024-09-10T21:27:10.650 INFO:teuthology.orchestra.run.smithi192.stdout: "subtrees": 1, 2024-09-10T21:27:10.650 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse": 0, 2024-09-10T21:27:10.650 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_hit": 0, 2024-09-10T21:27:10.650 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_forward": 0, 2024-09-10T21:27:10.650 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_discover": 0, 2024-09-10T21:27:10.650 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_dir_fetch": 0, 2024-09-10T21:27:10.651 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_remote_ino": 0, 2024-09-10T21:27:10.651 INFO:teuthology.orchestra.run.smithi192.stdout: "traverse_lock": 0, 2024-09-10T21:27:10.651 INFO:teuthology.orchestra.run.smithi192.stdout: "load_cent": 0, 2024-09-10T21:27:10.651 INFO:teuthology.orchestra.run.smithi192.stdout: "q": 0, 2024-09-10T21:27:10.651 INFO:teuthology.orchestra.run.smithi192.stdout: "exported": 0, 2024-09-10T21:27:10.651 INFO:teuthology.orchestra.run.smithi192.stdout: "exported_inodes": 0, 2024-09-10T21:27:10.651 INFO:teuthology.orchestra.run.smithi192.stdout: "imported": 0, 2024-09-10T21:27:10.651 INFO:teuthology.orchestra.run.smithi192.stdout: "imported_inodes": 0, 2024-09-10T21:27:10.651 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_dir_fetch": 0, 2024-09-10T21:27:10.651 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_backtrace_fetch": 0, 2024-09-10T21:27:10.651 INFO:teuthology.orchestra.run.smithi192.stdout: "openino_peer_discover": 0, 2024-09-10T21:27:10.651 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rfiles": 0, 2024-09-10T21:27:10.651 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rbytes": 0, 2024-09-10T21:27:10.652 INFO:teuthology.orchestra.run.smithi192.stdout: "root_rsnaps": 0, 2024-09-10T21:27:10.652 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T21:27:10.652 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_set_tag": 0, 2024-09-10T21:27:10.652 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T21:27:10.652 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_inotable_repaired": 0, 2024-09-10T21:27:10.652 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_inodes": 0, 2024-09-10T21:27:10.652 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T21:27:10.652 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T21:27:10.652 INFO:teuthology.orchestra.run.smithi192.stdout: "scrub_file_inodes": 0, 2024-09-10T21:27:10.652 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_inode_file_caps": 0, 2024-09-10T21:27:10.652 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T21:27:10.652 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_grant": 0, 2024-09-10T21:27:10.652 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T21:27:10.653 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T21:27:10.653 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T21:27:10.653 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps": 0, 2024-09-10T21:27:10.653 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_caps_dirty": 0, 2024-09-10T21:27:10.653 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_cap_release": 0, 2024-09-10T21:27:10.653 INFO:teuthology.orchestra.run.smithi192.stdout: "process_request_cap_release": 0 2024-09-10T21:27:10.653 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.653 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_cache": { 2024-09-10T21:27:10.653 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update": 0, 2024-09-10T21:27:10.653 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_update_receipt": 0, 2024-09-10T21:27:10.653 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_try_discover": 0, 2024-09-10T21:27:10.653 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_send_discover": 0, 2024-09-10T21:27:10.653 INFO:teuthology.orchestra.run.smithi192.stdout: "dir_handle_discover": 0, 2024-09-10T21:27:10.653 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays": 0, 2024-09-10T21:27:10.654 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_delayed": 0, 2024-09-10T21:27:10.654 INFO:teuthology.orchestra.run.smithi192.stdout: "num_strays_enqueuing": 0, 2024-09-10T21:27:10.654 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_created": 0, 2024-09-10T21:27:10.654 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_enqueued": 0, 2024-09-10T21:27:10.654 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_reintegrated": 0, 2024-09-10T21:27:10.654 INFO:teuthology.orchestra.run.smithi192.stdout: "strays_migrated": 0, 2024-09-10T21:27:10.654 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_processing": 0, 2024-09-10T21:27:10.654 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_enqueued": 0, 2024-09-10T21:27:10.654 INFO:teuthology.orchestra.run.smithi192.stdout: "num_recovering_prioritized": 0, 2024-09-10T21:27:10.654 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_started": 0, 2024-09-10T21:27:10.654 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_completed": 0, 2024-09-10T21:27:10.654 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_path": 0, 2024-09-10T21:27:10.654 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_quiesce_inode": 0, 2024-09-10T21:27:10.655 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T21:27:10.655 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_exportdir": 0, 2024-09-10T21:27:10.655 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_flush": 0, 2024-09-10T21:27:10.655 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragmentdir": 0, 2024-09-10T21:27:10.655 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_fragstats": 0, 2024-09-10T21:27:10.655 INFO:teuthology.orchestra.run.smithi192.stdout: "ireq_inodestats": 0, 2024-09-10T21:27:10.655 INFO:teuthology.orchestra.run.smithi192.stdout: "uninline_started": 0, 2024-09-10T21:27:10.655 INFO:teuthology.orchestra.run.smithi192.stdout: "uninline_succeeded": 0, 2024-09-10T21:27:10.655 INFO:teuthology.orchestra.run.smithi192.stdout: "uninline_write_failed": 0 2024-09-10T21:27:10.655 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.655 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_log": { 2024-09-10T21:27:10.655 INFO:teuthology.orchestra.run.smithi192.stdout: "evlrg": 0, 2024-09-10T21:27:10.656 INFO:teuthology.orchestra.run.smithi192.stdout: "evadd": 0, 2024-09-10T21:27:10.656 INFO:teuthology.orchestra.run.smithi192.stdout: "evex": 0, 2024-09-10T21:27:10.656 INFO:teuthology.orchestra.run.smithi192.stdout: "evtrm": 0, 2024-09-10T21:27:10.656 INFO:teuthology.orchestra.run.smithi192.stdout: "ev": 2, 2024-09-10T21:27:10.656 INFO:teuthology.orchestra.run.smithi192.stdout: "evexg": 0, 2024-09-10T21:27:10.656 INFO:teuthology.orchestra.run.smithi192.stdout: "evexd": 0, 2024-09-10T21:27:10.656 INFO:teuthology.orchestra.run.smithi192.stdout: "segadd": 0, 2024-09-10T21:27:10.656 INFO:teuthology.orchestra.run.smithi192.stdout: "segex": 0, 2024-09-10T21:27:10.656 INFO:teuthology.orchestra.run.smithi192.stdout: "segtrm": 0, 2024-09-10T21:27:10.656 INFO:teuthology.orchestra.run.smithi192.stdout: "seg": 2, 2024-09-10T21:27:10.657 INFO:teuthology.orchestra.run.smithi192.stdout: "segmjr": 2, 2024-09-10T21:27:10.657 INFO:teuthology.orchestra.run.smithi192.stdout: "segexg": 0, 2024-09-10T21:27:10.657 INFO:teuthology.orchestra.run.smithi192.stdout: "segexd": 0, 2024-09-10T21:27:10.657 INFO:teuthology.orchestra.run.smithi192.stdout: "expos": 4194304, 2024-09-10T21:27:10.657 INFO:teuthology.orchestra.run.smithi192.stdout: "wrpos": 4194892, 2024-09-10T21:27:10.657 INFO:teuthology.orchestra.run.smithi192.stdout: "rdpos": 4194352, 2024-09-10T21:27:10.657 INFO:teuthology.orchestra.run.smithi192.stdout: "jlat": { 2024-09-10T21:27:10.657 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.657 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.657 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.657 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.657 INFO:teuthology.orchestra.run.smithi192.stdout: "replayed": 2 2024-09-10T21:27:10.657 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.658 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_mem": { 2024-09-10T21:27:10.658 INFO:teuthology.orchestra.run.smithi192.stdout: "ino": 3, 2024-09-10T21:27:10.658 INFO:teuthology.orchestra.run.smithi192.stdout: "ino+": 3, 2024-09-10T21:27:10.658 INFO:teuthology.orchestra.run.smithi192.stdout: "ino-": 0, 2024-09-10T21:27:10.658 INFO:teuthology.orchestra.run.smithi192.stdout: "dir": 1, 2024-09-10T21:27:10.658 INFO:teuthology.orchestra.run.smithi192.stdout: "dir+": 1, 2024-09-10T21:27:10.658 INFO:teuthology.orchestra.run.smithi192.stdout: "dir-": 0, 2024-09-10T21:27:10.658 INFO:teuthology.orchestra.run.smithi192.stdout: "dn": 0, 2024-09-10T21:27:10.658 INFO:teuthology.orchestra.run.smithi192.stdout: "dn+": 0, 2024-09-10T21:27:10.658 INFO:teuthology.orchestra.run.smithi192.stdout: "dn-": 0, 2024-09-10T21:27:10.658 INFO:teuthology.orchestra.run.smithi192.stdout: "cap": 0, 2024-09-10T21:27:10.658 INFO:teuthology.orchestra.run.smithi192.stdout: "cap+": 0, 2024-09-10T21:27:10.658 INFO:teuthology.orchestra.run.smithi192.stdout: "cap-": 0, 2024-09-10T21:27:10.658 INFO:teuthology.orchestra.run.smithi192.stdout: "rss": 48888, 2024-09-10T21:27:10.659 INFO:teuthology.orchestra.run.smithi192.stdout: "heap": 248242176 2024-09-10T21:27:10.659 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.659 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_server": { 2024-09-10T21:27:10.659 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_client_request": 0, 2024-09-10T21:27:10.659 INFO:teuthology.orchestra.run.smithi192.stdout: "dispatch_server_request": 0, 2024-09-10T21:27:10.659 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_request": 0, 2024-09-10T21:27:10.659 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_client_session": 0, 2024-09-10T21:27:10.659 INFO:teuthology.orchestra.run.smithi192.stdout: "handle_peer_request": 0, 2024-09-10T21:27:10.659 INFO:teuthology.orchestra.run.smithi192.stdout: "req_create_latency": { 2024-09-10T21:27:10.659 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.659 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.659 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.659 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.659 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getattr_latency": { 2024-09-10T21:27:10.660 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.660 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.660 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.660 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.660 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getfilelock_latency": { 2024-09-10T21:27:10.660 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.660 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.660 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.660 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.660 INFO:teuthology.orchestra.run.smithi192.stdout: "req_link_latency": { 2024-09-10T21:27:10.660 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.660 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.660 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.660 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.661 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookup_latency": { 2024-09-10T21:27:10.661 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.661 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.661 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.661 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.661 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookuphash_latency": { 2024-09-10T21:27:10.661 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.661 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.661 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.661 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.661 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupino_latency": { 2024-09-10T21:27:10.661 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.661 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.662 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.662 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.662 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupname_latency": { 2024-09-10T21:27:10.662 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.662 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.662 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.662 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.662 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupparent_latency": { 2024-09-10T21:27:10.662 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.662 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.662 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.662 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.662 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lookupsnap_latency": { 2024-09-10T21:27:10.663 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.663 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.663 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.663 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.663 INFO:teuthology.orchestra.run.smithi192.stdout: "req_lssnap_latency": { 2024-09-10T21:27:10.663 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.663 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.664 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.664 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.664 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mkdir_latency": { 2024-09-10T21:27:10.664 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.664 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.664 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.664 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.664 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mknod_latency": { 2024-09-10T21:27:10.664 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.664 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.665 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.665 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.665 INFO:teuthology.orchestra.run.smithi192.stdout: "req_mksnap_latency": { 2024-09-10T21:27:10.665 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.665 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.665 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.665 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.665 INFO:teuthology.orchestra.run.smithi192.stdout: "req_open_latency": { 2024-09-10T21:27:10.665 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.665 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.666 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.666 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.666 INFO:teuthology.orchestra.run.smithi192.stdout: "req_readdir_latency": { 2024-09-10T21:27:10.666 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.666 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.666 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.666 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.666 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rename_latency": { 2024-09-10T21:27:10.666 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.666 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.666 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.666 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.666 INFO:teuthology.orchestra.run.smithi192.stdout: "req_renamesnap_latency": { 2024-09-10T21:27:10.667 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.667 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.667 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.667 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.667 INFO:teuthology.orchestra.run.smithi192.stdout: "req_snapdiff_latency": { 2024-09-10T21:27:10.667 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.667 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.667 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.667 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.667 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmdir_latency": { 2024-09-10T21:27:10.667 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.668 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.668 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.668 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.668 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmsnap_latency": { 2024-09-10T21:27:10.668 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.668 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.668 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.668 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.668 INFO:teuthology.orchestra.run.smithi192.stdout: "req_rmxattr_latency": { 2024-09-10T21:27:10.668 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.668 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.668 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.669 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.669 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setattr_latency": { 2024-09-10T21:27:10.669 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.669 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.669 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.669 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.669 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setdirlayout_latency": { 2024-09-10T21:27:10.669 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.669 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.669 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.669 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.669 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setfilelock_latency": { 2024-09-10T21:27:10.669 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.670 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.670 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.670 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.670 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setlayout_latency": { 2024-09-10T21:27:10.670 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.670 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.670 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.670 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.670 INFO:teuthology.orchestra.run.smithi192.stdout: "req_setxattr_latency": { 2024-09-10T21:27:10.670 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.670 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.670 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.670 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.671 INFO:teuthology.orchestra.run.smithi192.stdout: "req_symlink_latency": { 2024-09-10T21:27:10.671 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.671 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.671 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.671 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.671 INFO:teuthology.orchestra.run.smithi192.stdout: "req_unlink_latency": { 2024-09-10T21:27:10.671 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.671 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.671 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.672 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.672 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_revoke_eviction": 0, 2024-09-10T21:27:10.672 INFO:teuthology.orchestra.run.smithi192.stdout: "cap_acquisition_throttle": 0, 2024-09-10T21:27:10.672 INFO:teuthology.orchestra.run.smithi192.stdout: "req_getvxattr_latency": { 2024-09-10T21:27:10.672 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.672 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.672 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.672 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:10.672 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.672 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_sessions": { 2024-09-10T21:27:10.672 INFO:teuthology.orchestra.run.smithi192.stdout: "session_count": 0, 2024-09-10T21:27:10.673 INFO:teuthology.orchestra.run.smithi192.stdout: "session_add": 0, 2024-09-10T21:27:10.673 INFO:teuthology.orchestra.run.smithi192.stdout: "session_remove": 0, 2024-09-10T21:27:10.673 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_open": 0, 2024-09-10T21:27:10.673 INFO:teuthology.orchestra.run.smithi192.stdout: "sessions_stale": 0, 2024-09-10T21:27:10.673 INFO:teuthology.orchestra.run.smithi192.stdout: "total_load": 0, 2024-09-10T21:27:10.673 INFO:teuthology.orchestra.run.smithi192.stdout: "average_load": 0, 2024-09-10T21:27:10.673 INFO:teuthology.orchestra.run.smithi192.stdout: "avg_session_uptime": 0, 2024-09-10T21:27:10.673 INFO:teuthology.orchestra.run.smithi192.stdout: "mdthresh_evicted": 0 2024-09-10T21:27:10.673 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.673 INFO:teuthology.orchestra.run.smithi192.stdout: "mempool": { 2024-09-10T21:27:10.673 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_bytes": 0, 2024-09-10T21:27:10.673 INFO:teuthology.orchestra.run.smithi192.stdout: "bloom_filter_items": 0, 2024-09-10T21:27:10.673 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T21:27:10.674 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_alloc_items": 0, 2024-09-10T21:27:10.674 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T21:27:10.674 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_data_items": 0, 2024-09-10T21:27:10.674 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T21:27:10.674 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T21:27:10.674 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T21:27:10.674 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T21:27:10.674 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T21:27:10.674 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_other_items": 0, 2024-09-10T21:27:10.674 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T21:27:10.674 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T21:27:10.674 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_bytes": 0, 2024-09-10T21:27:10.674 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_extent_items": 0, 2024-09-10T21:27:10.674 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_bytes": 0, 2024-09-10T21:27:10.675 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_blob_items": 0, 2024-09-10T21:27:10.675 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T21:27:10.675 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T21:27:10.675 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T21:27:10.675 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T21:27:10.675 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T21:27:10.675 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_fsck_items": 0, 2024-09-10T21:27:10.675 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_bytes": 0, 2024-09-10T21:27:10.675 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_txc_items": 0, 2024-09-10T21:27:10.675 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T21:27:10.675 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T21:27:10.675 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_bytes": 0, 2024-09-10T21:27:10.675 INFO:teuthology.orchestra.run.smithi192.stdout: "bluestore_writing_items": 0, 2024-09-10T21:27:10.676 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_bytes": 0, 2024-09-10T21:27:10.676 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_items": 0, 2024-09-10T21:27:10.676 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T21:27:10.676 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_reader_items": 0, 2024-09-10T21:27:10.676 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T21:27:10.676 INFO:teuthology.orchestra.run.smithi192.stdout: "bluefs_file_writer_items": 0, 2024-09-10T21:27:10.676 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_bytes": 181303, 2024-09-10T21:27:10.676 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_anon_items": 46, 2024-09-10T21:27:10.676 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_bytes": 0, 2024-09-10T21:27:10.676 INFO:teuthology.orchestra.run.smithi192.stdout: "buffer_meta_items": 0, 2024-09-10T21:27:10.676 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_bytes": 0, 2024-09-10T21:27:10.676 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_items": 0, 2024-09-10T21:27:10.676 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_bytes": 0, 2024-09-10T21:27:10.676 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_mapbl_items": 0, 2024-09-10T21:27:10.677 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_bytes": 0, 2024-09-10T21:27:10.677 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_pglog_items": 0, 2024-09-10T21:27:10.677 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_bytes": 7400, 2024-09-10T21:27:10.677 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_items": 152, 2024-09-10T21:27:10.677 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T21:27:10.677 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_mapping_items": 0, 2024-09-10T21:27:10.677 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_bytes": 0, 2024-09-10T21:27:10.677 INFO:teuthology.orchestra.run.smithi192.stdout: "pgmap_items": 0, 2024-09-10T21:27:10.677 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_bytes": 8672, 2024-09-10T21:27:10.677 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_co_items": 13, 2024-09-10T21:27:10.677 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_bytes": 0, 2024-09-10T21:27:10.677 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_1_items": 0, 2024-09-10T21:27:10.677 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_bytes": 0, 2024-09-10T21:27:10.677 INFO:teuthology.orchestra.run.smithi192.stdout: "unittest_2_items": 0 2024-09-10T21:27:10.678 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.678 INFO:teuthology.orchestra.run.smithi192.stdout: "objecter": { 2024-09-10T21:27:10.678 INFO:teuthology.orchestra.run.smithi192.stdout: "op_active": 0, 2024-09-10T21:27:10.678 INFO:teuthology.orchestra.run.smithi192.stdout: "op_laggy": 0, 2024-09-10T21:27:10.678 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send": 1644, 2024-09-10T21:27:10.678 INFO:teuthology.orchestra.run.smithi192.stdout: "op_send_bytes": 21, 2024-09-10T21:27:10.678 INFO:teuthology.orchestra.run.smithi192.stdout: "op_resend": 3, 2024-09-10T21:27:10.678 INFO:teuthology.orchestra.run.smithi192.stdout: "op_reply": 1644, 2024-09-10T21:27:10.678 INFO:teuthology.orchestra.run.smithi192.stdout: "op_latency": { 2024-09-10T21:27:10.678 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1644, 2024-09-10T21:27:10.678 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.735985423, 2024-09-10T21:27:10.678 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000447679 2024-09-10T21:27:10.679 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.679 INFO:teuthology.orchestra.run.smithi192.stdout: "op_inflight": 0, 2024-09-10T21:27:10.679 INFO:teuthology.orchestra.run.smithi192.stdout: "oplen_avg": { 2024-09-10T21:27:10.679 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 1644, 2024-09-10T21:27:10.679 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 1645 2024-09-10T21:27:10.679 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.679 INFO:teuthology.orchestra.run.smithi192.stdout: "op": 1644, 2024-09-10T21:27:10.679 INFO:teuthology.orchestra.run.smithi192.stdout: "op_r": 1644, 2024-09-10T21:27:10.679 INFO:teuthology.orchestra.run.smithi192.stdout: "op_w": 0, 2024-09-10T21:27:10.679 INFO:teuthology.orchestra.run.smithi192.stdout: "op_rmw": 0, 2024-09-10T21:27:10.679 INFO:teuthology.orchestra.run.smithi192.stdout: "op_pg": 0, 2024-09-10T21:27:10.679 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_stat": 819, 2024-09-10T21:27:10.680 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_create": 0, 2024-09-10T21:27:10.680 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_read": 823, 2024-09-10T21:27:10.680 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_write": 0, 2024-09-10T21:27:10.680 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writefull": 0, 2024-09-10T21:27:10.680 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_writesame": 0, 2024-09-10T21:27:10.680 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_append": 0, 2024-09-10T21:27:10.680 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_zero": 0, 2024-09-10T21:27:10.680 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_truncate": 0, 2024-09-10T21:27:10.680 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_delete": 0, 2024-09-10T21:27:10.680 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_mapext": 0, 2024-09-10T21:27:10.680 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_sparse_read": 0, 2024-09-10T21:27:10.680 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_clonerange": 0, 2024-09-10T21:27:10.680 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_getxattr": 1, 2024-09-10T21:27:10.681 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_setxattr": 0, 2024-09-10T21:27:10.681 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_cmpxattr": 0, 2024-09-10T21:27:10.681 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_rmxattr": 0, 2024-09-10T21:27:10.681 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_resetxattrs": 0, 2024-09-10T21:27:10.681 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_call": 0, 2024-09-10T21:27:10.681 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_watch": 0, 2024-09-10T21:27:10.681 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_notify": 0, 2024-09-10T21:27:10.681 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T21:27:10.681 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls": 0, 2024-09-10T21:27:10.681 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_pgls_filter": 0, 2024-09-10T21:27:10.681 INFO:teuthology.orchestra.run.smithi192.stdout: "osdop_other": 0, 2024-09-10T21:27:10.681 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_active": 0, 2024-09-10T21:27:10.682 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_send": 0, 2024-09-10T21:27:10.682 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_resend": 0, 2024-09-10T21:27:10.682 INFO:teuthology.orchestra.run.smithi192.stdout: "linger_ping": 0, 2024-09-10T21:27:10.682 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_active": 0, 2024-09-10T21:27:10.682 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_send": 0, 2024-09-10T21:27:10.682 INFO:teuthology.orchestra.run.smithi192.stdout: "poolop_resend": 0, 2024-09-10T21:27:10.682 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_active": 0, 2024-09-10T21:27:10.682 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_send": 0, 2024-09-10T21:27:10.682 INFO:teuthology.orchestra.run.smithi192.stdout: "poolstat_resend": 0, 2024-09-10T21:27:10.682 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_active": 0, 2024-09-10T21:27:10.682 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_send": 0, 2024-09-10T21:27:10.683 INFO:teuthology.orchestra.run.smithi192.stdout: "statfs_resend": 0, 2024-09-10T21:27:10.683 INFO:teuthology.orchestra.run.smithi192.stdout: "command_active": 0, 2024-09-10T21:27:10.683 INFO:teuthology.orchestra.run.smithi192.stdout: "command_send": 0, 2024-09-10T21:27:10.683 INFO:teuthology.orchestra.run.smithi192.stdout: "command_resend": 0, 2024-09-10T21:27:10.683 INFO:teuthology.orchestra.run.smithi192.stdout: "map_epoch": 75, 2024-09-10T21:27:10.683 INFO:teuthology.orchestra.run.smithi192.stdout: "map_full": 0, 2024-09-10T21:27:10.683 INFO:teuthology.orchestra.run.smithi192.stdout: "map_inc": 2, 2024-09-10T21:27:10.683 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_sessions": 4, 2024-09-10T21:27:10.683 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_open": 4, 2024-09-10T21:27:10.683 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_session_close": 0, 2024-09-10T21:27:10.683 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_laggy": 0, 2024-09-10T21:27:10.683 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_wr": 0, 2024-09-10T21:27:10.684 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_rd": 2, 2024-09-10T21:27:10.684 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_del": 0 2024-09-10T21:27:10.684 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.684 INFO:teuthology.orchestra.run.smithi192.stdout: "oft": { 2024-09-10T21:27:10.684 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_objs": 0, 2024-09-10T21:27:10.684 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_kv_pairs": 0, 2024-09-10T21:27:10.684 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_updates": 0, 2024-09-10T21:27:10.684 INFO:teuthology.orchestra.run.smithi192.stdout: "omap_total_removes": 0 2024-09-10T21:27:10.684 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.684 INFO:teuthology.orchestra.run.smithi192.stdout: "purge_queue": { 2024-09-10T21:27:10.684 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops": 0, 2024-09-10T21:27:10.684 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T21:27:10.684 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing": 0, 2024-09-10T21:27:10.685 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executing_high_water": 0, 2024-09-10T21:27:10.685 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed_ops": 0, 2024-09-10T21:27:10.685 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_executed": 0, 2024-09-10T21:27:10.685 INFO:teuthology.orchestra.run.smithi192.stdout: "pq_item_in_journal": 0 2024-09-10T21:27:10.685 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.685 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T21:27:10.685 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:10.685 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-10T21:27:10.685 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:10.685 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 1889, 2024-09-10T21:27:10.685 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 862384, 2024-09-10T21:27:10.685 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:10.685 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 1889, 2024-09-10T21:27:10.686 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-10T21:27:10.686 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-10T21:27:10.686 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 1889, 2024-09-10T21:27:10.686 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 862384, 2024-09-10T21:27:10.686 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:10.686 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.686 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.686 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.686 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:10.686 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.686 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_bytes": { 2024-09-10T21:27:10.686 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:10.686 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 104857600, 2024-09-10T21:27:10.687 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:10.687 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-10T21:27:10.687 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-10T21:27:10.687 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:10.687 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:10.687 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 1644, 2024-09-10T21:27:10.687 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 593, 2024-09-10T21:27:10.687 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 1644, 2024-09-10T21:27:10.687 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 593, 2024-09-10T21:27:10.687 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:10.687 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.687 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.687 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.687 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:10.688 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.688 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-objecter_ops": { 2024-09-10T21:27:10.688 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:10.688 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 1024, 2024-09-10T21:27:10.688 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:10.688 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-10T21:27:10.688 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-10T21:27:10.688 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:10.688 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:10.688 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 1644, 2024-09-10T21:27:10.688 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 1644, 2024-09-10T21:27:10.688 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 1644, 2024-09-10T21:27:10.688 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 1644, 2024-09-10T21:27:10.689 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:10.689 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.689 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.689 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.689 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:10.689 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.689 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle": { 2024-09-10T21:27:10.689 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:10.689 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-10T21:27:10.689 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:10.689 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-10T21:27:10.689 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-10T21:27:10.690 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:10.690 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:10.690 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-10T21:27:10.690 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-10T21:27:10.690 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 0, 2024-09-10T21:27:10.690 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 0, 2024-09-10T21:27:10.690 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:10.690 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.690 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.690 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.690 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:10.690 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.690 INFO:teuthology.orchestra.run.smithi192.stdout: "throttle-write_buf_throttle-0x563b77931040": { 2024-09-10T21:27:10.690 INFO:teuthology.orchestra.run.smithi192.stdout: "val": 0, 2024-09-10T21:27:10.690 INFO:teuthology.orchestra.run.smithi192.stdout: "max": 3758096384, 2024-09-10T21:27:10.691 INFO:teuthology.orchestra.run.smithi192.stdout: "get_started": 0, 2024-09-10T21:27:10.691 INFO:teuthology.orchestra.run.smithi192.stdout: "get": 0, 2024-09-10T21:27:10.691 INFO:teuthology.orchestra.run.smithi192.stdout: "get_sum": 0, 2024-09-10T21:27:10.691 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_fail": 0, 2024-09-10T21:27:10.691 INFO:teuthology.orchestra.run.smithi192.stdout: "get_or_fail_success": 0, 2024-09-10T21:27:10.691 INFO:teuthology.orchestra.run.smithi192.stdout: "take": 0, 2024-09-10T21:27:10.691 INFO:teuthology.orchestra.run.smithi192.stdout: "take_sum": 0, 2024-09-10T21:27:10.691 INFO:teuthology.orchestra.run.smithi192.stdout: "put": 0, 2024-09-10T21:27:10.691 INFO:teuthology.orchestra.run.smithi192.stdout: "put_sum": 0, 2024-09-10T21:27:10.691 INFO:teuthology.orchestra.run.smithi192.stdout: "wait": { 2024-09-10T21:27:10.691 INFO:teuthology.orchestra.run.smithi192.stdout: "avgcount": 0, 2024-09-10T21:27:10.691 INFO:teuthology.orchestra.run.smithi192.stdout: "sum": 0.000000000, 2024-09-10T21:27:10.691 INFO:teuthology.orchestra.run.smithi192.stdout: "avgtime": 0.000000000 2024-09-10T21:27:10.692 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:10.692 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-10T21:27:10.692 INFO:teuthology.orchestra.run.smithi192.stdout: "trackedop": { 2024-09-10T21:27:10.692 INFO:teuthology.orchestra.run.smithi192.stdout: "slow_ops_count": 0 2024-09-10T21:27:10.692 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-10T21:27:10.692 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-10T21:27:10.692 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:10 smithi192 ceph-mon[35363]: pgmap v697: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T21:27:10.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:10 smithi059 ceph-mon[30888]: pgmap v697: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T21:27:10.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:10 smithi154 ceph-mon[35041]: pgmap v697: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-09-10T21:27:11.415 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-10T21:27:11.415 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-10T21:27:11.415 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-10T21:27:11.416 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-10T21:27:11.416 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-10T21:27:11.425 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-10T21:27:11.426 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T21:27:11.426 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:27:11.448 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-10T21:27:11.448 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T21:27:11.507 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T21:27:11.813 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:27:12.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.325+0000 7f6ba8fe2640 1 -- 172.21.15.59:0/1403805448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba4108060 msgr2=0x7f6ba410e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:12.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.325+0000 7f6ba8fe2640 1 --2- 172.21.15.59:0/1403805448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba4108060 0x7f6ba410e860 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009ca0 tx=0x7f6b9c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:27:12.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.326+0000 7f6ba8fe2640 1 -- 172.21.15.59:0/1403805448 shutdown_connections 2024-09-10T21:27:12.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.326+0000 7f6ba8fe2640 1 --2- 172.21.15.59:0/1403805448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba4108060 0x7f6ba410e860 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:12.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.326+0000 7f6ba8fe2640 1 --2- 172.21.15.59:0/1403805448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ba41076e0 0x7f6ba4107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.326+0000 7f6ba8fe2640 1 --2- 172.21.15.59:0/1403805448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ba4101cd0 0x7f6ba41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.326+0000 7f6ba8fe2640 1 -- 172.21.15.59:0/1403805448 >> 172.21.15.59:0/1403805448 conn(0x7f6ba40fd720 msgr2=0x7f6ba40ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:27:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.326+0000 7f6ba8fe2640 1 -- 172.21.15.59:0/1403805448 shutdown_connections 2024-09-10T21:27:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.326+0000 7f6ba8fe2640 1 -- 172.21.15.59:0/1403805448 wait complete. 2024-09-10T21:27:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.326+0000 7f6ba8fe2640 1 Processor -- start 2024-09-10T21:27:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.326+0000 7f6ba8fe2640 1 -- start start 2024-09-10T21:27:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.327+0000 7f6ba8fe2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba4101cd0 0x7f6ba41991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.327+0000 7f6ba8fe2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ba41076e0 0x7f6ba4199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.327+0000 7f6ba8fe2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ba4108060 0x7f6ba419eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.327+0000 7f6ba8fe2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba4112e00 con 0x7f6ba4101cd0 2024-09-10T21:27:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.327+0000 7f6ba8fe2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba4112c80 con 0x7f6ba41076e0 2024-09-10T21:27:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.327+0000 7f6ba8fe2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba4112f80 con 0x7f6ba4108060 2024-09-10T21:27:12.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.327+0000 7f6ba259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba4101cd0 0x7f6ba41991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:12.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.327+0000 7f6ba259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba4101cd0 0x7f6ba41991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38070/0 (socket says 172.21.15.59:38070) 2024-09-10T21:27:12.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.327+0000 7f6ba259c640 1 -- 172.21.15.59:0/1711138309 learned_addr learned my addr 172.21.15.59:0/1711138309 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:27:12.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.327+0000 7f6ba2d9d640 1 --2- 172.21.15.59:0/1711138309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ba4108060 0x7f6ba419eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:12.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.327+0000 7f6ba1d9b640 1 --2- 172.21.15.59:0/1711138309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ba41076e0 0x7f6ba4199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:12.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.327+0000 7f6ba259c640 1 -- 172.21.15.59:0/1711138309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ba4108060 msgr2=0x7f6ba419eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:12.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.327+0000 7f6ba259c640 1 --2- 172.21.15.59:0/1711138309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ba4108060 0x7f6ba419eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:12.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.327+0000 7f6ba259c640 1 -- 172.21.15.59:0/1711138309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ba41076e0 msgr2=0x7f6ba4199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:12.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.327+0000 7f6ba259c640 1 --2- 172.21.15.59:0/1711138309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ba41076e0 0x7f6ba4199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:12.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.327+0000 7f6ba259c640 1 -- 172.21.15.59:0/1711138309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba419f280 con 0x7f6ba4101cd0 2024-09-10T21:27:12.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.327+0000 7f6ba259c640 1 --2- 172.21.15.59:0/1711138309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba4101cd0 0x7f6ba41991d0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400c920 tx=0x7f6b9400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:27:12.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.328+0000 7f6b937fe640 1 -- 172.21.15.59:0/1711138309 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b94007c70 con 0x7f6ba4101cd0 2024-09-10T21:27:12.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.328+0000 7f6ba8fe2640 1 -- 172.21.15.59:0/1711138309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba419f570 con 0x7f6ba4101cd0 2024-09-10T21:27:12.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.328+0000 7f6b937fe640 1 -- 172.21.15.59:0/1711138309 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b94007e10 con 0x7f6ba4101cd0 2024-09-10T21:27:12.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.328+0000 7f6b937fe640 1 -- 172.21.15.59:0/1711138309 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b94018820 con 0x7f6ba4101cd0 2024-09-10T21:27:12.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.328+0000 7f6ba8fe2640 1 -- 172.21.15.59:0/1711138309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba41a5c30 con 0x7f6ba4101cd0 2024-09-10T21:27:12.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.329+0000 7f6ba8fe2640 1 -- 172.21.15.59:0/1711138309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ba41020b0 con 0x7f6ba4101cd0 2024-09-10T21:27:12.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.330+0000 7f6b937fe640 1 -- 172.21.15.59:0/1711138309 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f6b9400f450 con 0x7f6ba4101cd0 2024-09-10T21:27:12.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.331+0000 7f6b937fe640 1 --2- 172.21.15.59:0/1711138309 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6b8c0b52e0 0x7f6b8c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:12.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.331+0000 7f6b937fe640 1 -- 172.21.15.59:0/1711138309 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f6b940e6080 con 0x7f6ba4101cd0 2024-09-10T21:27:12.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.331+0000 7f6ba1d9b640 1 --2- 172.21.15.59:0/1711138309 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6b8c0b52e0 0x7f6b8c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:12.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.332+0000 7f6ba1d9b640 1 --2- 172.21.15.59:0/1711138309 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6b8c0b52e0 0x7f6b8c0b77a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4101030 tx=0x7f6b98005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:27:12.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.334+0000 7f6b937fe640 1 -- 172.21.15.59:0/1711138309 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6b94014030 con 0x7f6ba4101cd0 2024-09-10T21:27:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.532+0000 7f6ba8fe2640 1 -- 172.21.15.59:0/1711138309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6ba419a300 con 0x7f6ba4101cd0 2024-09-10T21:27:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.533+0000 7f6b937fe640 1 -- 172.21.15.59:0/1711138309 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v75) ==== 81+0+591 (secure 0 0 0) 0x7f6ba419a300 con 0x7f6ba4101cd0 2024-09-10T21:27:12.536 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/212243638 2024-09-11T21:06:05.140902+0000 2024-09-10T21:27:12.536 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/3305207692 2024-09-11T21:06:05.140902+0000 2024-09-10T21:27:12.536 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6801/1576322369 2024-09-11T21:06:05.140902+0000 2024-09-10T21:27:12.536 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6800/1576322369 2024-09-11T21:06:05.140902+0000 2024-09-10T21:27:12.536 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/2965147556 2024-09-11T21:05:40.304807+0000 2024-09-10T21:27:12.537 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/1174570395 2024-09-11T21:05:40.304807+0000 2024-09-10T21:27:12.537 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/2934865748 2024-09-11T21:06:05.140902+0000 2024-09-10T21:27:12.537 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6800/3633609115 2024-09-11T21:05:40.304807+0000 2024-09-10T21:27:12.537 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6801/3633609115 2024-09-11T21:05:40.304807+0000 2024-09-10T21:27:12.537 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:0/3377179776 2024-09-11T21:05:40.304807+0000 2024-09-10T21:27:12.537 INFO:teuthology.orchestra.run.smithi059.stderr:listed 10 entries 2024-09-10T21:27:12.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.535+0000 7f6ba8fe2640 1 -- 172.21.15.59:0/1711138309 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6b8c0b52e0 msgr2=0x7f6b8c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:12.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.535+0000 7f6ba8fe2640 1 --2- 172.21.15.59:0/1711138309 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6b8c0b52e0 0x7f6b8c0b77a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4101030 tx=0x7f6b98005f90 comp rx=0 tx=0).stop 2024-09-10T21:27:12.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.535+0000 7f6ba8fe2640 1 -- 172.21.15.59:0/1711138309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba4101cd0 msgr2=0x7f6ba41991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:12.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.535+0000 7f6ba8fe2640 1 --2- 172.21.15.59:0/1711138309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba4101cd0 0x7f6ba41991d0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400c920 tx=0x7f6b9400cde0 comp rx=0 tx=0).stop 2024-09-10T21:27:12.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.535+0000 7f6ba8fe2640 1 -- 172.21.15.59:0/1711138309 shutdown_connections 2024-09-10T21:27:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.535+0000 7f6ba8fe2640 1 --2- 172.21.15.59:0/1711138309 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f6b8c0b52e0 0x7f6b8c0b77a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.535+0000 7f6ba8fe2640 1 --2- 172.21.15.59:0/1711138309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ba4108060 0x7f6ba419eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.535+0000 7f6ba8fe2640 1 --2- 172.21.15.59:0/1711138309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6ba41076e0 0x7f6ba4199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.535+0000 7f6ba8fe2640 1 --2- 172.21.15.59:0/1711138309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ba4101cd0 0x7f6ba41991d0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.535+0000 7f6ba8fe2640 1 -- 172.21.15.59:0/1711138309 >> 172.21.15.59:0/1711138309 conn(0x7f6ba40fd720 msgr2=0x7f6ba40ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:27:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.535+0000 7f6ba8fe2640 1 -- 172.21.15.59:0/1711138309 shutdown_connections 2024-09-10T21:27:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:12.535+0000 7f6ba8fe2640 1 -- 172.21.15.59:0/1711138309 wait complete. 2024-09-10T21:27:12.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:12 smithi192 ceph-mon[35363]: pgmap v698: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:27:12.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:12 smithi059 ceph-mon[30888]: pgmap v698: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:27:12.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:12 smithi154 ceph-mon[35041]: pgmap v698: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-10T21:27:13.289 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T21:27:13.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:27:13.289 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T21:27:13.337 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-09-10T21:27:13.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:27:13.338 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T21:27:13.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:27:13.370 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-09-10T21:27:13.426 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T21:27:13.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:27:13.427 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T21:27:13.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T21:27:13.494 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2024-09-10T21:27:13.601 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-10T21:27:13.610 INFO:tasks.cephadm:Teardown begin 2024-09-10T21:27:13.610 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T21:27:13.611 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:27:13.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:13 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1711138309' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T21:27:13.870 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:27:13.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:13 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1711138309' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T21:27:13.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:13 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1711138309' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T21:27:14.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.393+0000 7f3c41bda640 1 -- 172.21.15.59:0/2980993556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c3c10d0f0 msgr2=0x7f3c3c10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:14.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.393+0000 7f3c41bda640 1 --2- 172.21.15.59:0/2980993556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c3c10d0f0 0x7f3c3c10f560 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009ca0 tx=0x7f3c3402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:27:14.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.393+0000 7f3c41bda640 1 -- 172.21.15.59:0/2980993556 shutdown_connections 2024-09-10T21:27:14.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.393+0000 7f3c41bda640 1 --2- 172.21.15.59:0/2980993556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c3c10d0f0 0x7f3c3c10f560 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:14.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.393+0000 7f3c41bda640 1 --2- 172.21.15.59:0/2980993556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c3c104540 0x7f3c3c10cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:14.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.393+0000 7f3c41bda640 1 --2- 172.21.15.59:0/2980993556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c3c103b40 0x7f3c3c103f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:14.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.393+0000 7f3c41bda640 1 -- 172.21.15.59:0/2980993556 >> 172.21.15.59:0/2980993556 conn(0x7f3c3c0fd730 msgr2=0x7f3c3c0ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:27:14.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.393+0000 7f3c41bda640 1 -- 172.21.15.59:0/2980993556 shutdown_connections 2024-09-10T21:27:14.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.393+0000 7f3c41bda640 1 -- 172.21.15.59:0/2980993556 wait complete. 2024-09-10T21:27:14.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.394+0000 7f3c41bda640 1 Processor -- start 2024-09-10T21:27:14.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.394+0000 7f3c41bda640 1 -- start start 2024-09-10T21:27:14.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.394+0000 7f3c41bda640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c3c103b40 0x7f3c3c1991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:14.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.394+0000 7f3c41bda640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c3c104540 0x7f3c3c199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:14.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.394+0000 7f3c41bda640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c3c10d0f0 0x7f3c3c19eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:14.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.394+0000 7f3c41bda640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c112e00 con 0x7f3c3c103b40 2024-09-10T21:27:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.394+0000 7f3c41bda640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c112c80 con 0x7f3c3c10d0f0 2024-09-10T21:27:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.394+0000 7f3c41bda640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c112f80 con 0x7f3c3c104540 2024-09-10T21:27:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.394+0000 7f3c3b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c3c103b40 0x7f3c3c1991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.394+0000 7f3c3b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c3c103b40 0x7f3c3c1991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38076/0 (socket says 172.21.15.59:38076) 2024-09-10T21:27:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.394+0000 7f3c3b7fe640 1 -- 172.21.15.59:0/1531497186 learned_addr learned my addr 172.21.15.59:0/1531497186 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:27:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.394+0000 7f3c3affd640 1 --2- 172.21.15.59:0/1531497186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c3c104540 0x7f3c3c199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.394+0000 7f3c3bfff640 1 --2- 172.21.15.59:0/1531497186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c3c10d0f0 0x7f3c3c19eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.395+0000 7f3c3b7fe640 1 -- 172.21.15.59:0/1531497186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c3c104540 msgr2=0x7f3c3c199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.395+0000 7f3c3b7fe640 1 --2- 172.21.15.59:0/1531497186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c3c104540 0x7f3c3c199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.395+0000 7f3c3b7fe640 1 -- 172.21.15.59:0/1531497186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c3c10d0f0 msgr2=0x7f3c3c19eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.395+0000 7f3c3b7fe640 1 --2- 172.21.15.59:0/1531497186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c3c10d0f0 0x7f3c3c19eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.395+0000 7f3c3b7fe640 1 -- 172.21.15.59:0/1531497186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c3c19f280 con 0x7f3c3c103b40 2024-09-10T21:27:14.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.395+0000 7f3c3bfff640 1 --2- 172.21.15.59:0/1531497186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c3c10d0f0 0x7f3c3c19eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:27:14.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.395+0000 7f3c3b7fe640 1 --2- 172.21.15.59:0/1531497186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c3c103b40 0x7f3c3c1991d0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00b4a0 tx=0x7f3c2c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:27:14.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.395+0000 7f3c38ff9640 1 -- 172.21.15.59:0/1531497186 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c015020 con 0x7f3c3c103b40 2024-09-10T21:27:14.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.395+0000 7f3c38ff9640 1 -- 172.21.15.59:0/1531497186 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c2c011ce0 con 0x7f3c3c103b40 2024-09-10T21:27:14.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.395+0000 7f3c41bda640 1 -- 172.21.15.59:0/1531497186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c3c19f570 con 0x7f3c3c103b40 2024-09-10T21:27:14.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.395+0000 7f3c38ff9640 1 -- 172.21.15.59:0/1531497186 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c010dc0 con 0x7f3c3c103b40 2024-09-10T21:27:14.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.395+0000 7f3c41bda640 1 -- 172.21.15.59:0/1531497186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c3c1a5e00 con 0x7f3c3c103b40 2024-09-10T21:27:14.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.396+0000 7f3c41bda640 1 -- 172.21.15.59:0/1531497186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c3c103f20 con 0x7f3c3c103b40 2024-09-10T21:27:14.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.398+0000 7f3c38ff9640 1 -- 172.21.15.59:0/1531497186 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f3c2c011830 con 0x7f3c3c103b40 2024-09-10T21:27:14.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.398+0000 7f3c38ff9640 1 --2- 172.21.15.59:0/1531497186 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3c240b5360 0x7f3c240b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:14.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.399+0000 7f3c3affd640 1 --2- 172.21.15.59:0/1531497186 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3c240b5360 0x7f3c240b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:14.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.399+0000 7f3c38ff9640 1 -- 172.21.15.59:0/1531497186 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f3c2c0e5b70 con 0x7f3c3c103b40 2024-09-10T21:27:14.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.399+0000 7f3c3affd640 1 --2- 172.21.15.59:0/1531497186 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3c240b5360 0x7f3c240b7820 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0fff80 tx=0x7f3c3000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:27:14.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.401+0000 7f3c38ff9640 1 -- 172.21.15.59:0/1531497186 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3c2c01f020 con 0x7f3c3c103b40 2024-09-10T21:27:14.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.625+0000 7f3c41bda640 1 -- 172.21.15.59:0/1531497186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c3c19a300 con 0x7f3c3c103b40 2024-09-10T21:27:14.629 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:14 smithi059 ceph-mon[30888]: pgmap v699: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-10T21:27:14.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.626+0000 7f3c38ff9640 1 -- 172.21.15.59:0/1531497186 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f3c3c19a300 con 0x7f3c3c103b40 2024-09-10T21:27:14.630 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:27:14.630 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:27:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:27:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.628+0000 7f3c41bda640 1 -- 172.21.15.59:0/1531497186 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3c240b5360 msgr2=0x7f3c240b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.628+0000 7f3c41bda640 1 --2- 172.21.15.59:0/1531497186 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3c240b5360 0x7f3c240b7820 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0fff80 tx=0x7f3c3000a2d0 comp rx=0 tx=0).stop 2024-09-10T21:27:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.628+0000 7f3c41bda640 1 -- 172.21.15.59:0/1531497186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c3c103b40 msgr2=0x7f3c3c1991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.628+0000 7f3c41bda640 1 --2- 172.21.15.59:0/1531497186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c3c103b40 0x7f3c3c1991d0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00b4a0 tx=0x7f3c2c00b8a0 comp rx=0 tx=0).stop 2024-09-10T21:27:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.628+0000 7f3c41bda640 1 -- 172.21.15.59:0/1531497186 shutdown_connections 2024-09-10T21:27:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.628+0000 7f3c41bda640 1 --2- 172.21.15.59:0/1531497186 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f3c240b5360 0x7f3c240b7820 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.628+0000 7f3c41bda640 1 --2- 172.21.15.59:0/1531497186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c3c10d0f0 0x7f3c3c19eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.628+0000 7f3c41bda640 1 --2- 172.21.15.59:0/1531497186 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c3c104540 0x7f3c3c199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.628+0000 7f3c41bda640 1 --2- 172.21.15.59:0/1531497186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c3c103b40 0x7f3c3c1991d0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.628+0000 7f3c41bda640 1 -- 172.21.15.59:0/1531497186 >> 172.21.15.59:0/1531497186 conn(0x7f3c3c0fd730 msgr2=0x7f3c3c104a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:27:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.628+0000 7f3c41bda640 1 -- 172.21.15.59:0/1531497186 shutdown_connections 2024-09-10T21:27:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:14.628+0000 7f3c41bda640 1 -- 172.21.15.59:0/1531497186 wait complete. 2024-09-10T21:27:14.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:14 smithi192 ceph-mon[35363]: pgmap v699: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-10T21:27:14.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:14 smithi154 ceph-mon[35041]: pgmap v699: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-10T21:27:15.402 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T21:27:15.659 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:15 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1531497186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:27:15.668 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:27:15.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:15 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1531497186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:27:15.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:15 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1531497186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:27:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.158+0000 7f081b2b3640 1 -- 172.21.15.59:0/2478719419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814102dc0 msgr2=0x7f08141031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.158+0000 7f081b2b3640 1 --2- 172.21.15.59:0/2478719419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814102dc0 0x7f08141031a0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f0804009ca0 tx=0x7f080402a8f0 comp rx=0 tx=0).stop 2024-09-10T21:27:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.158+0000 7f081b2b3640 1 -- 172.21.15.59:0/2478719419 shutdown_connections 2024-09-10T21:27:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.158+0000 7f081b2b3640 1 --2- 172.21.15.59:0/2478719419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0814109150 0x7f081410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.158+0000 7f081b2b3640 1 --2- 172.21.15.59:0/2478719419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08141087d0 0x7f0814108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.158+0000 7f081b2b3640 1 --2- 172.21.15.59:0/2478719419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814102dc0 0x7f08141031a0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.158+0000 7f081b2b3640 1 -- 172.21.15.59:0/2478719419 >> 172.21.15.59:0/2478719419 conn(0x7f08140fe830 msgr2=0x7f0814100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:27:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.158+0000 7f081b2b3640 1 -- 172.21.15.59:0/2478719419 shutdown_connections 2024-09-10T21:27:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.158+0000 7f081b2b3640 1 -- 172.21.15.59:0/2478719419 wait complete. 2024-09-10T21:27:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.159+0000 7f081b2b3640 1 Processor -- start 2024-09-10T21:27:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.159+0000 7f081b2b3640 1 -- start start 2024-09-10T21:27:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.159+0000 7f081b2b3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0814102dc0 0x7f0814199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.159+0000 7f081b2b3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08141087d0 0x7f0814199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.159+0000 7f081b2b3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814109150 0x7f081419ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.159+0000 7f081b2b3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0814112e90 con 0x7f0814109150 2024-09-10T21:27:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.159+0000 7f081b2b3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0814112d10 con 0x7f08141087d0 2024-09-10T21:27:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.159+0000 7f081b2b3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0814113010 con 0x7f0814102dc0 2024-09-10T21:27:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.159+0000 7f0819850640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814109150 0x7f081419ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.159+0000 7f0819850640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814109150 0x7f081419ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38100/0 (socket says 172.21.15.59:38100) 2024-09-10T21:27:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.159+0000 7f0819850640 1 -- 172.21.15.59:0/4204267477 learned_addr learned my addr 172.21.15.59:0/4204267477 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:27:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.160+0000 7f0819850640 1 -- 172.21.15.59:0/4204267477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0814102dc0 msgr2=0x7f0814199420 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T21:27:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.160+0000 7f0819850640 1 --2- 172.21.15.59:0/4204267477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0814102dc0 0x7f0814199420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.160+0000 7f0819850640 1 -- 172.21.15.59:0/4204267477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08141087d0 msgr2=0x7f0814199960 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T21:27:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.160+0000 7f0819850640 1 --2- 172.21.15.59:0/4204267477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08141087d0 0x7f0814199960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.160+0000 7f0819850640 1 -- 172.21.15.59:0/4204267477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f081419f4d0 con 0x7f0814109150 2024-09-10T21:27:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.160+0000 7f0819850640 1 --2- 172.21.15.59:0/4204267477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814109150 0x7f081419ed00 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f080c00b3f0 tx=0x7f080c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:27:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.160+0000 7f08127fc640 1 -- 172.21.15.59:0/4204267477 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c015020 con 0x7f0814109150 2024-09-10T21:27:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.160+0000 7f08127fc640 1 -- 172.21.15.59:0/4204267477 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f080c011ce0 con 0x7f0814109150 2024-09-10T21:27:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.160+0000 7f081b2b3640 1 -- 172.21.15.59:0/4204267477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f081419f7c0 con 0x7f0814109150 2024-09-10T21:27:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.160+0000 7f08127fc640 1 -- 172.21.15.59:0/4204267477 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c010da0 con 0x7f0814109150 2024-09-10T21:27:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.160+0000 7f081b2b3640 1 -- 172.21.15.59:0/4204267477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08141a5f00 con 0x7f0814109150 2024-09-10T21:27:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.161+0000 7f081b2b3640 1 -- 172.21.15.59:0/4204267477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0814103220 con 0x7f0814109150 2024-09-10T21:27:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.162+0000 7f08127fc640 1 -- 172.21.15.59:0/4204267477 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f080c011830 con 0x7f0814109150 2024-09-10T21:27:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.163+0000 7f08127fc640 1 --2- 172.21.15.59:0/4204267477 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f07fc0b52e0 0x7f07fc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.164+0000 7f081904f640 1 --2- 172.21.15.59:0/4204267477 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f07fc0b52e0 0x7f07fc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.164+0000 7f08127fc640 1 -- 172.21.15.59:0/4204267477 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f080c0e5c60 con 0x7f0814109150 2024-09-10T21:27:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.164+0000 7f081904f640 1 --2- 172.21.15.59:0/4204267477 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f07fc0b52e0 0x7f07fc0b77a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0804006010 tx=0x7f08040093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:27:16.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.167+0000 7f08127fc640 1 -- 172.21.15.59:0/4204267477 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f080c01f020 con 0x7f0814109150 2024-09-10T21:27:16.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.392+0000 7f081b2b3640 1 -- 172.21.15.59:0/4204267477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f081419a550 con 0x7f0814109150 2024-09-10T21:27:16.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.393+0000 7f08127fc640 1 -- 172.21.15.59:0/4204267477 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f080c0acaf0 con 0x7f0814109150 2024-09-10T21:27:16.397 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:27:16.397 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"btime":"2024-09-10T21:15:11:928140+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14640,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1242047500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1242047500},{"type":"v1","addr":"172.21.15.59:6835","nonce":1242047500}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/90543201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":90543201},{"type":"v1","addr":"172.21.15.59:6837","nonce":90543201}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T21:13:19.283837+0000","modified":"2024-09-10T21:15:11.387175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24563,"mds_1":24550,"mds_2":24542,"mds_3":24538,"mds_4":24529},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14703":{"gid":14703,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6839/4138885833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":4138885833},{"type":"v1","addr":"172.21.15.59:6839","nonce":4138885833}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14709":{"gid":14709,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6841/1675735841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6840","nonce":1675735841},{"type":"v1","addr":"172.21.15.59:6841","nonce":1675735841}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24499":{"gid":24499,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.192:6833/2513372486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2513372486},{"type":"v1","addr":"172.21.15.192:6833","nonce":2513372486}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24503":{"gid":24503,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/2006948406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":2006948406},{"type":"v1","addr":"172.21.15.154:6833","nonce":2006948406}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6835/294213384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":294213384},{"type":"v1","addr":"172.21.15.154:6835","nonce":294213384}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.192:6835/3608050805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3608050805},{"type":"v1","addr":"172.21.15.192:6835","nonce":3608050805}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":10,"addr":"172.21.15.192:6837/266289113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":266289113},{"type":"v1","addr":"172.21.15.192:6837","nonce":266289113}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24542":{"gid":24542,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.154:6837/3954687054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":3954687054},{"type":"v1","addr":"172.21.15.154:6837","nonce":3954687054}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24550":{"gid":24550,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.192:6839/677733026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6838","nonce":677733026},{"type":"v1","addr":"172.21.15.192:6839","nonce":677733026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.154:6839/3664432388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":3664432388},{"type":"v1","addr":"172.21.15.154:6839","nonce":3664432388}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24563,"qdb_cluster":[24529,24542,24538,24550,24563]},"id":1}]} 2024-09-10T21:27:16.397 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-09-10T21:27:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.396+0000 7f081b2b3640 1 -- 172.21.15.59:0/4204267477 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f07fc0b52e0 msgr2=0x7f07fc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.396+0000 7f081b2b3640 1 --2- 172.21.15.59:0/4204267477 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f07fc0b52e0 0x7f07fc0b77a0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0804006010 tx=0x7f08040093f0 comp rx=0 tx=0).stop 2024-09-10T21:27:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.396+0000 7f081b2b3640 1 -- 172.21.15.59:0/4204267477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814109150 msgr2=0x7f081419ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.396+0000 7f081b2b3640 1 --2- 172.21.15.59:0/4204267477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814109150 0x7f081419ed00 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f080c00b3f0 tx=0x7f080c00b8b0 comp rx=0 tx=0).stop 2024-09-10T21:27:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.396+0000 7f081b2b3640 1 -- 172.21.15.59:0/4204267477 shutdown_connections 2024-09-10T21:27:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.396+0000 7f081b2b3640 1 --2- 172.21.15.59:0/4204267477 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f07fc0b52e0 0x7f07fc0b77a0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.396+0000 7f081b2b3640 1 --2- 172.21.15.59:0/4204267477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0814109150 0x7f081419ed00 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.396+0000 7f081b2b3640 1 --2- 172.21.15.59:0/4204267477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f08141087d0 0x7f0814199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.396+0000 7f081b2b3640 1 --2- 172.21.15.59:0/4204267477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0814102dc0 0x7f0814199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.396+0000 7f081b2b3640 1 -- 172.21.15.59:0/4204267477 >> 172.21.15.59:0/4204267477 conn(0x7f08140fe830 msgr2=0x7f0814100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:27:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.396+0000 7f081b2b3640 1 -- 172.21.15.59:0/4204267477 shutdown_connections 2024-09-10T21:27:16.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:16.396+0000 7f081b2b3640 1 -- 172.21.15.59:0/4204267477 wait complete. 2024-09-10T21:27:16.659 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:16 smithi059 ceph-mon[30888]: pgmap v700: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:27:16.660 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:16 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/4204267477' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:27:16.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:16 smithi192 ceph-mon[35363]: pgmap v700: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:27:16.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:16 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/4204267477' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:27:16.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:16 smithi154 ceph-mon[35041]: pgmap v700: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T21:27:16.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:16 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/4204267477' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T21:27:17.112 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T21:27:17.373 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:27:17.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.899+0000 7ff6b4217640 1 -- 172.21.15.59:0/1656517102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6ac10d140 msgr2=0x7ff6ac10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:17.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.899+0000 7ff6b4217640 1 --2- 172.21.15.59:0/1656517102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6ac10d140 0x7ff6ac10f5a0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009900 tx=0x7ff6a402a410 comp rx=0 tx=0).stop 2024-09-10T21:27:17.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.899+0000 7ff6b4217640 1 -- 172.21.15.59:0/1656517102 shutdown_connections 2024-09-10T21:27:17.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.899+0000 7ff6b4217640 1 --2- 172.21.15.59:0/1656517102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6ac10d140 0x7ff6ac10f5a0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:17.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.899+0000 7ff6b4217640 1 --2- 172.21.15.59:0/1656517102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ac104600 0x7ff6ac10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:17.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.899+0000 7ff6b4217640 1 --2- 172.21.15.59:0/1656517102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6ac103ce0 0x7ff6ac1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:17.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.899+0000 7ff6b4217640 1 -- 172.21.15.59:0/1656517102 >> 172.21.15.59:0/1656517102 conn(0x7ff6ac0fd700 msgr2=0x7ff6ac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:27:17.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.899+0000 7ff6b4217640 1 -- 172.21.15.59:0/1656517102 shutdown_connections 2024-09-10T21:27:17.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.899+0000 7ff6b4217640 1 -- 172.21.15.59:0/1656517102 wait complete. 2024-09-10T21:27:17.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.900+0000 7ff6b4217640 1 Processor -- start 2024-09-10T21:27:17.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.900+0000 7ff6b4217640 1 -- start start 2024-09-10T21:27:17.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.900+0000 7ff6b4217640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ac103ce0 0x7ff6ac101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:17.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.900+0000 7ff6b4217640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6ac104600 0x7ff6ac101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:17.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.900+0000 7ff6b4217640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6ac10d140 0x7ff6ac102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:17.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.900+0000 7ff6b4217640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac112d70 con 0x7ff6ac104600 2024-09-10T21:27:17.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.900+0000 7ff6b4217640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac112bf0 con 0x7ff6ac103ce0 2024-09-10T21:27:17.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.900+0000 7ff6b4217640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac112ef0 con 0x7ff6ac10d140 2024-09-10T21:27:17.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.900+0000 7ff6b17b2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6ac104600 0x7ff6ac101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:17.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.900+0000 7ff6b17b2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6ac104600 0x7ff6ac101ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38118/0 (socket says 172.21.15.59:38118) 2024-09-10T21:27:17.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.900+0000 7ff6b17b2640 1 -- 172.21.15.59:0/1203129490 learned_addr learned my addr 172.21.15.59:0/1203129490 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:27:17.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.900+0000 7ff6b1fb3640 1 --2- 172.21.15.59:0/1203129490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ac103ce0 0x7ff6ac101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:17.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.900+0000 7ff6b27b4640 1 --2- 172.21.15.59:0/1203129490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6ac10d140 0x7ff6ac102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:17.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.901+0000 7ff6b17b2640 1 -- 172.21.15.59:0/1203129490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6ac10d140 msgr2=0x7ff6ac102410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:17.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.901+0000 7ff6b17b2640 1 --2- 172.21.15.59:0/1203129490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6ac10d140 0x7ff6ac102410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:17.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.901+0000 7ff6b17b2640 1 -- 172.21.15.59:0/1203129490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ac103ce0 msgr2=0x7ff6ac101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:17.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.901+0000 7ff6b17b2640 1 --2- 172.21.15.59:0/1203129490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ac103ce0 0x7ff6ac101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:17.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.901+0000 7ff6b17b2640 1 -- 172.21.15.59:0/1203129490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ac1a7660 con 0x7ff6ac104600 2024-09-10T21:27:17.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.901+0000 7ff6b17b2640 1 --2- 172.21.15.59:0/1203129490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6ac104600 0x7ff6ac101ed0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000d750 tx=0x7ff6a000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:27:17.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.901+0000 7ff6aaffd640 1 -- 172.21.15.59:0/1203129490 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0017070 con 0x7ff6ac104600 2024-09-10T21:27:17.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.901+0000 7ff6aaffd640 1 -- 172.21.15.59:0/1203129490 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6a0004020 con 0x7ff6ac104600 2024-09-10T21:27:17.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.901+0000 7ff6b4217640 1 -- 172.21.15.59:0/1203129490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ac1a7950 con 0x7ff6ac104600 2024-09-10T21:27:17.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.901+0000 7ff6aaffd640 1 -- 172.21.15.59:0/1203129490 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0003c00 con 0x7ff6ac104600 2024-09-10T21:27:17.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.901+0000 7ff6b4217640 1 -- 172.21.15.59:0/1203129490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ac1a7e90 con 0x7ff6ac104600 2024-09-10T21:27:17.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.902+0000 7ff6b4217640 1 -- 172.21.15.59:0/1203129490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6ac1040c0 con 0x7ff6ac104600 2024-09-10T21:27:17.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.903+0000 7ff6aaffd640 1 -- 172.21.15.59:0/1203129490 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7ff6a0009a30 con 0x7ff6ac104600 2024-09-10T21:27:17.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.904+0000 7ff6aaffd640 1 --2- 172.21.15.59:0/1203129490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff6940b52e0 0x7ff6940b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:17.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.904+0000 7ff6b1fb3640 1 --2- 172.21.15.59:0/1203129490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff6940b52e0 0x7ff6940b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:17.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.904+0000 7ff6aaffd640 1 -- 172.21.15.59:0/1203129490 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7ff6a00e5810 con 0x7ff6ac104600 2024-09-10T21:27:17.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.905+0000 7ff6b1fb3640 1 --2- 172.21.15.59:0/1203129490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff6940b52e0 0x7ff6940b77a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff69c005fd0 tx=0x7ff69c009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:27:17.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:17.907+0000 7ff6aaffd640 1 -- 172.21.15.59:0/1203129490 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff6a00ac700 con 0x7ff6ac104600 2024-09-10T21:27:18.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:18.092+0000 7ff6b4217640 1 -- 172.21.15.59:0/1203129490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6ac1a82e0 con 0x7ff6ac104600 2024-09-10T21:27:18.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:18.093+0000 7ff6aaffd640 1 -- 172.21.15.59:0/1203129490 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22633 (secure 0 0 0) 0x7ff6a00ac000 con 0x7ff6ac104600 2024-09-10T21:27:18.097 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-10T21:27:18.097 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":75,"fsid":"3c26b952-6fb8-11ef-bcea-c7b262605968","created":"2024-09-10T21:05:18.196881+0000","modified":"2024-09-10T21:14:06.297762+0000","last_up_change":"2024-09-10T21:12:31.909004+0000","last_in_change":"2024-09-10T21:12:08.116727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T21:08:47.611285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T21:13:15.562661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T21:13:17.272280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4e88abf3-8592-4b5f-8ba9-5969e01e12d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6803","nonce":1237328951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6805","nonce":1237328951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6809","nonce":1237328951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1237328951},{"type":"v1","addr":"172.21.15.59:6807","nonce":1237328951}]},"public_addr":"172.21.15.59:6803/1237328951","cluster_addr":"172.21.15.59:6805/1237328951","heartbeat_back_addr":"172.21.15.59:6809/1237328951","heartbeat_front_addr":"172.21.15.59:6807/1237328951","state":["exists","up"]},{"osd":1,"uuid":"7908eefd-bbfa-4fe4-9db9-7a92d0e77acb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6801","nonce":3376412264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6803","nonce":3376412264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6807","nonce":3376412264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3376412264},{"type":"v1","addr":"172.21.15.154:6805","nonce":3376412264}]},"public_addr":"172.21.15.154:6801/3376412264","cluster_addr":"172.21.15.154:6803/3376412264","heartbeat_back_addr":"172.21.15.154:6807/3376412264","heartbeat_front_addr":"172.21.15.154:6805/3376412264","state":["exists","up"]},{"osd":2,"uuid":"2351b9f0-bca1-48b2-afb8-0e2b7856c52e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6801","nonce":440750253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6803","nonce":440750253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6807","nonce":440750253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":440750253},{"type":"v1","addr":"172.21.15.192:6805","nonce":440750253}]},"public_addr":"172.21.15.192:6801/440750253","cluster_addr":"172.21.15.192:6803/440750253","heartbeat_back_addr":"172.21.15.192:6807/440750253","heartbeat_front_addr":"172.21.15.192:6805/440750253","state":["exists","up"]},{"osd":3,"uuid":"f26969d1-7b48-4f20-9077-c55c59775ed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6811","nonce":1483798393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6813","nonce":1483798393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6817","nonce":1483798393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1483798393},{"type":"v1","addr":"172.21.15.59:6815","nonce":1483798393}]},"public_addr":"172.21.15.59:6811/1483798393","cluster_addr":"172.21.15.59:6813/1483798393","heartbeat_back_addr":"172.21.15.59:6817/1483798393","heartbeat_front_addr":"172.21.15.59:6815/1483798393","state":["exists","up"]},{"osd":4,"uuid":"21e1a472-1ae1-454b-aee5-2ad92f6eff17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6809","nonce":1817188525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6811","nonce":1817188525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6815","nonce":1817188525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1817188525},{"type":"v1","addr":"172.21.15.154:6813","nonce":1817188525}]},"public_addr":"172.21.15.154:6809/1817188525","cluster_addr":"172.21.15.154:6811/1817188525","heartbeat_back_addr":"172.21.15.154:6815/1817188525","heartbeat_front_addr":"172.21.15.154:6813/1817188525","state":["exists","up"]},{"osd":5,"uuid":"6191b10a-5cbd-4225-b0ec-70d05023d5d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6809","nonce":1221386274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6811","nonce":1221386274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6815","nonce":1221386274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1221386274},{"type":"v1","addr":"172.21.15.192:6813","nonce":1221386274}]},"public_addr":"172.21.15.192:6809/1221386274","cluster_addr":"172.21.15.192:6811/1221386274","heartbeat_back_addr":"172.21.15.192:6815/1221386274","heartbeat_front_addr":"172.21.15.192:6813/1221386274","state":["exists","up"]},{"osd":6,"uuid":"609c11f7-ce82-4714-bf73-a4f16f4483ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6819","nonce":3006857566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6821","nonce":3006857566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6825","nonce":3006857566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":3006857566},{"type":"v1","addr":"172.21.15.59:6823","nonce":3006857566}]},"public_addr":"172.21.15.59:6819/3006857566","cluster_addr":"172.21.15.59:6821/3006857566","heartbeat_back_addr":"172.21.15.59:6825/3006857566","heartbeat_front_addr":"172.21.15.59:6823/3006857566","state":["exists","up"]},{"osd":7,"uuid":"bff3a29f-47cc-4e66-92e4-14e9b7faf498","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6817","nonce":175260385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6819","nonce":175260385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6823","nonce":175260385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":175260385},{"type":"v1","addr":"172.21.15.154:6821","nonce":175260385}]},"public_addr":"172.21.15.154:6817/175260385","cluster_addr":"172.21.15.154:6819/175260385","heartbeat_back_addr":"172.21.15.154:6823/175260385","heartbeat_front_addr":"172.21.15.154:6821/175260385","state":["exists","up"]},{"osd":8,"uuid":"56dabafd-9bb9-409a-88cd-4b5b5ecf810a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6817","nonce":3138189462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6819","nonce":3138189462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6823","nonce":3138189462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":3138189462},{"type":"v1","addr":"172.21.15.192:6821","nonce":3138189462}]},"public_addr":"172.21.15.192:6817/3138189462","cluster_addr":"172.21.15.192:6819/3138189462","heartbeat_back_addr":"172.21.15.192:6823/3138189462","heartbeat_front_addr":"172.21.15.192:6821/3138189462","state":["exists","up"]},{"osd":9,"uuid":"044f934d-3df5-47aa-85f5-c3b63b267ecd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6827","nonce":2446500753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6829","nonce":2446500753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6833","nonce":2446500753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":2446500753},{"type":"v1","addr":"172.21.15.59:6831","nonce":2446500753}]},"public_addr":"172.21.15.59:6827/2446500753","cluster_addr":"172.21.15.59:6829/2446500753","heartbeat_back_addr":"172.21.15.59:6833/2446500753","heartbeat_front_addr":"172.21.15.59:6831/2446500753","state":["exists","up"]},{"osd":10,"uuid":"8d3b735b-e4fe-4a8e-8c75-a49313c6fabb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6825","nonce":1139781446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6827","nonce":1139781446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6831","nonce":1139781446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":1139781446},{"type":"v1","addr":"172.21.15.154:6829","nonce":1139781446}]},"public_addr":"172.21.15.154:6825/1139781446","cluster_addr":"172.21.15.154:6827/1139781446","heartbeat_back_addr":"172.21.15.154:6831/1139781446","heartbeat_front_addr":"172.21.15.154:6829/1139781446","state":["exists","up"]},{"osd":11,"uuid":"fd6a6d06-c6aa-42e3-aa38-fc583319f6bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6825","nonce":1041494458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6827","nonce":1041494458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6831","nonce":1041494458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":1041494458},{"type":"v1","addr":"172.21.15.192:6829","nonce":1041494458}]},"public_addr":"172.21.15.192:6825/1041494458","cluster_addr":"172.21.15.192:6827/1041494458","heartbeat_back_addr":"172.21.15.192:6831/1041494458","heartbeat_front_addr":"172.21.15.192:6829/1041494458","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:07:53.974382+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:19.552358+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:08:44.251670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:09.430992+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:34.043343+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:09:59.903679+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:25.733171+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:10:49.795257+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:14.485648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:11:40.485165+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:04.655475+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T21:12:29.308456+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:0/212243638":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/3305207692":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6801/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/1576322369":"2024-09-11T21:06:05.140902+0000","172.21.15.59:0/2965147556":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/1174570395":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/2934865748":"2024-09-11T21:06:05.140902+0000","172.21.15.59:6800/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:6801/3633609115":"2024-09-11T21:05:40.304807+0000","172.21.15.59:0/3377179776":"2024-09-11T21:05:40.304807+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T21:27:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:18.096+0000 7ff6b4217640 1 -- 172.21.15.59:0/1203129490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff6940b52e0 msgr2=0x7ff6940b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:18.096+0000 7ff6b4217640 1 --2- 172.21.15.59:0/1203129490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff6940b52e0 0x7ff6940b77a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff69c005fd0 tx=0x7ff69c009760 comp rx=0 tx=0).stop 2024-09-10T21:27:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:18.096+0000 7ff6b4217640 1 -- 172.21.15.59:0/1203129490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6ac104600 msgr2=0x7ff6ac101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:18.096+0000 7ff6b4217640 1 --2- 172.21.15.59:0/1203129490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6ac104600 0x7ff6ac101ed0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000d750 tx=0x7ff6a000dc10 comp rx=0 tx=0).stop 2024-09-10T21:27:18.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:18.096+0000 7ff6b4217640 1 -- 172.21.15.59:0/1203129490 shutdown_connections 2024-09-10T21:27:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:18.096+0000 7ff6b4217640 1 --2- 172.21.15.59:0/1203129490 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7ff6940b52e0 0x7ff6940b77a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:18.096+0000 7ff6b4217640 1 --2- 172.21.15.59:0/1203129490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6ac10d140 0x7ff6ac102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:18.096+0000 7ff6b4217640 1 --2- 172.21.15.59:0/1203129490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6ac104600 0x7ff6ac101ed0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:18.096+0000 7ff6b4217640 1 --2- 172.21.15.59:0/1203129490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ac103ce0 0x7ff6ac101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:18.096+0000 7ff6b4217640 1 -- 172.21.15.59:0/1203129490 >> 172.21.15.59:0/1203129490 conn(0x7ff6ac0fd700 msgr2=0x7ff6ac0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:27:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:18.096+0000 7ff6b4217640 1 -- 172.21.15.59:0/1203129490 shutdown_connections 2024-09-10T21:27:18.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:18.096+0000 7ff6b4217640 1 -- 172.21.15.59:0/1203129490 wait complete. 2024-09-10T21:27:18.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:18 smithi192 ceph-mon[35363]: pgmap v701: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T21:27:18.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:18 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1203129490' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:27:18.859 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:18 smithi059 ceph-mon[30888]: pgmap v701: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T21:27:18.859 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:18 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1203129490' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:27:18.891 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-10T21:27:18.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:18 smithi154 ceph-mon[35041]: pgmap v701: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-10T21:27:18.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:18 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1203129490' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T21:27:19.150 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:27:19.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.601+0000 7f962f551640 1 -- 172.21.15.59:0/1201130792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f962810f2f0 msgr2=0x7f9628111770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:19.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.601+0000 7f962f551640 1 --2- 172.21.15.59:0/1201130792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f962810f2f0 0x7f9628111770 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f9620009ca0 tx=0x7f962002a8c0 comp rx=0 tx=0).stop 2024-09-10T21:27:19.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.601+0000 7f962f551640 1 -- 172.21.15.59:0/1201130792 shutdown_connections 2024-09-10T21:27:19.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.601+0000 7f962f551640 1 --2- 172.21.15.59:0/1201130792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f962810f2f0 0x7f9628111770 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:19.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.601+0000 7f962f551640 1 --2- 172.21.15.59:0/1201130792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9628102130 0x7f962810ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:19.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.601+0000 7f962f551640 1 --2- 172.21.15.59:0/1201130792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9628101810 0x7f9628101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:19.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.601+0000 7f962f551640 1 -- 172.21.15.59:0/1201130792 >> 172.21.15.59:0/1201130792 conn(0x7f9628076f50 msgr2=0x7f9628077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:27:19.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.601+0000 7f962f551640 1 -- 172.21.15.59:0/1201130792 shutdown_connections 2024-09-10T21:27:19.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.601+0000 7f962f551640 1 -- 172.21.15.59:0/1201130792 wait complete. 2024-09-10T21:27:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.602+0000 7f962f551640 1 Processor -- start 2024-09-10T21:27:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.602+0000 7f962f551640 1 -- start start 2024-09-10T21:27:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.602+0000 7f962f551640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9628101810 0x7f962819b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.602+0000 7f962f551640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9628102130 0x7f962819bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.602+0000 7f962f551640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f962810f2f0 0x7f96281a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.602+0000 7f962f551640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9628115060 con 0x7f962810f2f0 2024-09-10T21:27:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.602+0000 7f962f551640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9628114ee0 con 0x7f9628102130 2024-09-10T21:27:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.602+0000 7f962f551640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f96281151e0 con 0x7f9628101810 2024-09-10T21:27:19.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.602+0000 7f962daee640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f962810f2f0 0x7f96281a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:19.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.602+0000 7f962daee640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f962810f2f0 0x7f96281a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41544/0 (socket says 172.21.15.59:41544) 2024-09-10T21:27:19.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.602+0000 7f962daee640 1 -- 172.21.15.59:0/1618033607 learned_addr learned my addr 172.21.15.59:0/1618033607 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:27:19.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.602+0000 7f962caec640 1 --2- 172.21.15.59:0/1618033607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9628102130 0x7f962819bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:19.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.602+0000 7f962d2ed640 1 --2- 172.21.15.59:0/1618033607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9628101810 0x7f962819b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:19.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.603+0000 7f962daee640 1 -- 172.21.15.59:0/1618033607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9628101810 msgr2=0x7f962819b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:19.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.603+0000 7f962daee640 1 --2- 172.21.15.59:0/1618033607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9628101810 0x7f962819b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:19.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.603+0000 7f962daee640 1 -- 172.21.15.59:0/1618033607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9628102130 msgr2=0x7f962819bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:19.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.603+0000 7f962daee640 1 --2- 172.21.15.59:0/1618033607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9628102130 0x7f962819bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:19.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.603+0000 7f962daee640 1 -- 172.21.15.59:0/1618033607 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96281a16c0 con 0x7f962810f2f0 2024-09-10T21:27:19.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.603+0000 7f962d2ed640 1 --2- 172.21.15.59:0/1618033607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9628101810 0x7f962819b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:27:19.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.603+0000 7f962daee640 1 --2- 172.21.15.59:0/1618033607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f962810f2f0 0x7f96281a0ef0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f9620005cc0 tx=0x7f962002f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:27:19.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.603+0000 7f961e7fc640 1 -- 172.21.15.59:0/1618033607 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9620003cf0 con 0x7f962810f2f0 2024-09-10T21:27:19.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.603+0000 7f962f551640 1 -- 172.21.15.59:0/1618033607 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96281a1950 con 0x7f962810f2f0 2024-09-10T21:27:19.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.603+0000 7f961e7fc640 1 -- 172.21.15.59:0/1618033607 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96200044f0 con 0x7f962810f2f0 2024-09-10T21:27:19.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.603+0000 7f961e7fc640 1 -- 172.21.15.59:0/1618033607 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962002fc30 con 0x7f962810f2f0 2024-09-10T21:27:19.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.603+0000 7f962f551640 1 -- 172.21.15.59:0/1618033607 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96281a8070 con 0x7f962810f2f0 2024-09-10T21:27:19.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.604+0000 7f962f551640 1 -- 172.21.15.59:0/1618033607 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9628101c70 con 0x7f962810f2f0 2024-09-10T21:27:19.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.606+0000 7f961e7fc640 1 -- 172.21.15.59:0/1618033607 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f9620004040 con 0x7f962810f2f0 2024-09-10T21:27:19.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.607+0000 7f961e7fc640 1 --2- 172.21.15.59:0/1618033607 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f96140b52e0 0x7f96140b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:19.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.607+0000 7f961e7fc640 1 -- 172.21.15.59:0/1618033607 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8182+0+0 (secure 0 0 0) 0x7f96201071b0 con 0x7f962810f2f0 2024-09-10T21:27:19.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.607+0000 7f962d2ed640 1 --2- 172.21.15.59:0/1618033607 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f96140b52e0 0x7f96140b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:19.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.608+0000 7f962d2ed640 1 --2- 172.21.15.59:0/1618033607 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f96140b52e0 0x7f96140b77a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9624009930 tx=0x7f9624008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:27:19.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.610+0000 7f961e7fc640 1 -- 172.21.15.59:0/1618033607 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f96200ce130 con 0x7f962810f2f0 2024-09-10T21:27:19.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.836+0000 7f962f551640 1 -- 172.21.15.59:0/1618033607 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f96281a8330 con 0x7f962810f2f0 2024-09-10T21:27:19.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.838+0000 7f961e7fc640 1 -- 172.21.15.59:0/1618033607 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7f96200cda30 con 0x7f962810f2f0 2024-09-10T21:27:19.842 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T21:27:19.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.842+0000 7f962f551640 1 -- 172.21.15.59:0/1618033607 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f96140b52e0 msgr2=0x7f96140b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:19.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.842+0000 7f962f551640 1 --2- 172.21.15.59:0/1618033607 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f96140b52e0 0x7f96140b77a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9624009930 tx=0x7f9624008040 comp rx=0 tx=0).stop 2024-09-10T21:27:19.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.842+0000 7f962f551640 1 -- 172.21.15.59:0/1618033607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f962810f2f0 msgr2=0x7f96281a0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:19.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.842+0000 7f962f551640 1 --2- 172.21.15.59:0/1618033607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f962810f2f0 0x7f96281a0ef0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f9620005cc0 tx=0x7f962002f470 comp rx=0 tx=0).stop 2024-09-10T21:27:19.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.842+0000 7f962f551640 1 -- 172.21.15.59:0/1618033607 shutdown_connections 2024-09-10T21:27:19.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.842+0000 7f962f551640 1 --2- 172.21.15.59:0/1618033607 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f96140b52e0 0x7f96140b77a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:19.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.842+0000 7f962f551640 1 --2- 172.21.15.59:0/1618033607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f962810f2f0 0x7f96281a0ef0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:19.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.842+0000 7f962f551640 1 --2- 172.21.15.59:0/1618033607 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9628102130 0x7f962819bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:19.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.842+0000 7f962f551640 1 --2- 172.21.15.59:0/1618033607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9628101810 0x7f962819b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:19.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.842+0000 7f962f551640 1 -- 172.21.15.59:0/1618033607 >> 172.21.15.59:0/1618033607 conn(0x7f9628076f50 msgr2=0x7f962810f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:27:19.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.842+0000 7f962f551640 1 -- 172.21.15.59:0/1618033607 shutdown_connections 2024-09-10T21:27:19.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:19.842+0000 7f962f551640 1 -- 172.21.15.59:0/1618033607 wait complete. 2024-09-10T21:27:20.158 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:19 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-a[30883]: 2024-09-10T21:27:19.837+0000 7f0dae732640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T21:27:20.158 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:27:19 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-a[74032]: ignoring --setuser ceph since I am not root 2024-09-10T21:27:20.158 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:27:19 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-a[74032]: ignoring --setgroup ceph since I am not root 2024-09-10T21:27:20.158 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:27:19 smithi059 ceph-mds[74036]: -- 172.21.15.59:0/1933258113 <== mon.0 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ac7d211860 con 0x55ac7d1ef000 2024-09-10T21:27:20.158 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:27:19 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-a[74032]: starting mds.a at 2024-09-10T21:27:20.159 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 21:27:19 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-g[73682]: ignoring --setuser ceph since I am not root 2024-09-10T21:27:20.159 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 21:27:19 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-g[73682]: ignoring --setgroup ceph since I am not root 2024-09-10T21:27:20.159 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 21:27:19 smithi059 ceph-mds[73690]: --2- 172.21.15.59:0/1912540548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559cf5613400 0x559cf576ab00 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x559cf56deba0 tx=0x559cf56e4540 comp rx=0 tx=0).write_message sending message m=0x559cf5672540 seq=3 auth(proto 2 2 bytes epoch 0) 2024-09-10T21:27:20.159 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 21:27:19 smithi059 ceph-mds[73690]: -- 172.21.15.59:0/1912540548 <== mon.0 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559cf5635860 con 0x559cf5613400 2024-09-10T21:27:20.159 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 21:27:19 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-g[73682]: starting mds.g at 2024-09-10T21:27:20.181 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 21:27:19 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-h[64635]: ignoring --setuser ceph since I am not root 2024-09-10T21:27:20.181 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 21:27:19 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-h[64635]: ignoring --setgroup ceph since I am not root 2024-09-10T21:27:20.181 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 21:27:19 smithi154 ceph-mds[64639]: -- 172.21.15.154:0/3141423024 <== mon.0 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5567f1365860 con 0x5567f1342800 2024-09-10T21:27:20.181 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 21:27:19 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-h[64635]: starting mds.h at 2024-09-10T21:27:20.181 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 21:27:19 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-k[64021]: ignoring --setuser ceph since I am not root 2024-09-10T21:27:20.181 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 21:27:19 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-k[64021]: ignoring --setgroup ceph since I am not root 2024-09-10T21:27:20.181 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 21:27:19 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-k[64021]: starting mds.k at 2024-09-10T21:27:20.182 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 21:27:19 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-e[64334]: ignoring --setuser ceph since I am not root 2024-09-10T21:27:20.182 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 21:27:19 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-e[64334]: ignoring --setgroup ceph since I am not root 2024-09-10T21:27:20.182 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 21:27:19 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-e[64334]: starting mds.e at 2024-09-10T21:27:20.182 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 21:27:19 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-b[64936]: ignoring --setuser ceph since I am not root 2024-09-10T21:27:20.182 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 21:27:19 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-b[64936]: ignoring --setgroup ceph since I am not root 2024-09-10T21:27:20.182 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 21:27:19 smithi154 ceph-mds[64940]: -- 172.21.15.154:0/2661145069 <== mon.0 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56538119f860 con 0x56538117d400 2024-09-10T21:27:20.182 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 21:27:19 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-b[64936]: starting mds.b at 2024-09-10T21:27:20.326 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:27:19 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-f[64466]: ignoring --setuser ceph since I am not root 2024-09-10T21:27:20.326 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:27:19 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-f[64466]: ignoring --setgroup ceph since I am not root 2024-09-10T21:27:20.326 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:27:19 smithi192 ceph-mds[64470]: -- 172.21.15.192:0/3260951543 <== mon.2 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x558c8a5d0ea0 con 0x558c8a5a5400 2024-09-10T21:27:20.326 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:27:19 smithi192 ceph-mds[64470]: -- 172.21.15.192:0/3260951543 <== mon.2 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558c8a5c7c20 con 0x558c8a5a5400 2024-09-10T21:27:20.326 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:27:19 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-f[64466]: starting mds.f at 2024-09-10T21:27:20.327 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:27:19 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-i[65069]: ignoring --setuser ceph since I am not root 2024-09-10T21:27:20.327 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:27:19 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-i[65069]: ignoring --setgroup ceph since I am not root 2024-09-10T21:27:20.327 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:27:19 smithi192 ceph-mds[65073]: --2- 172.21.15.192:0/3044513172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d9ddab400 0x564d9df02b00 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x564d9de76b70 tx=0x564d9de7c540 comp rx=0 tx=0).write_message sending message m=0x564d9de0a8c0 seq=3 auth(proto 2 2 bytes epoch 0) 2024-09-10T21:27:20.327 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:27:19 smithi192 ceph-mds[65073]: -- 172.21.15.192:0/3044513172 <== mon.0 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564d9ddcd860 con 0x564d9ddab400 2024-09-10T21:27:20.327 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:27:19 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-i[65069]: starting mds.i at 2024-09-10T21:27:20.327 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 10 21:27:19 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-l[64155]: ignoring --setuser ceph since I am not root 2024-09-10T21:27:20.328 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 10 21:27:19 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-l[64155]: ignoring --setgroup ceph since I am not root 2024-09-10T21:27:20.328 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 10 21:27:19 smithi192 ceph-mds[64159]: -- 172.21.15.192:0/3054414260 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557a9e88b860 con 0x557a9e869400 2024-09-10T21:27:20.328 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 10 21:27:19 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-l[64155]: starting mds.l at 2024-09-10T21:27:20.328 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 10 21:27:19 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-c[64767]: ignoring --setuser ceph since I am not root 2024-09-10T21:27:20.328 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 10 21:27:19 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-c[64767]: ignoring --setgroup ceph since I am not root 2024-09-10T21:27:20.328 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 10 21:27:19 smithi192 ceph-mds[64771]: -- 172.21.15.192:0/3948453687 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56477278b860 con 0x564772769000 2024-09-10T21:27:20.328 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 10 21:27:19 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-c[64767]: starting mds.c at 2024-09-10T21:27:20.542 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T21:27:20.806 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:27:20.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:20 smithi192 ceph-mon[35363]: pgmap v702: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-10T21:27:20.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:20 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1618033607' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T21:27:20.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:20 smithi192 ceph-mon[35363]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T21:27:20.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:20 smithi192 ceph-mon[35363]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T21:27:20.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:20 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1618033607' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T21:27:20.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:20 smithi192 ceph-mon[35363]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T21:27:20.826 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:20 smithi192 ceph-mon[35363]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-10T21:27:20.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:20 smithi059 ceph-mon[30888]: pgmap v702: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-10T21:27:20.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:20 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1618033607' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T21:27:20.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:20 smithi059 ceph-mon[30888]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T21:27:20.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:20 smithi059 ceph-mon[30888]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T21:27:20.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:20 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1618033607' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T21:27:20.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:20 smithi059 ceph-mon[30888]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T21:27:20.910 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:20 smithi059 ceph-mon[30888]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-10T21:27:20.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:20 smithi154 ceph-mon[35041]: pgmap v702: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-10T21:27:20.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:20 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1618033607' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T21:27:20.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:20 smithi154 ceph-mon[35041]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T21:27:20.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:20 smithi154 ceph-mon[35041]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T21:27:20.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:20 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1618033607' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T21:27:20.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:20 smithi154 ceph-mon[35041]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T21:27:20.931 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:20 smithi154 ceph-mon[35041]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-10T21:27:21.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.311+0000 7fc349f81640 1 -- 172.21.15.59:0/2124754267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc344102dc0 msgr2=0x7fc3441031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:21.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.311+0000 7fc349f81640 1 --2- 172.21.15.59:0/2124754267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc344102dc0 0x7fc3441031a0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fc334009900 tx=0x7fc33402a410 comp rx=0 tx=0).stop 2024-09-10T21:27:21.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.311+0000 7fc349f81640 1 -- 172.21.15.59:0/2124754267 shutdown_connections 2024-09-10T21:27:21.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.311+0000 7fc349f81640 1 --2- 172.21.15.59:0/2124754267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc344109150 0x7fc34410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:21.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.311+0000 7fc349f81640 1 --2- 172.21.15.59:0/2124754267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc3441087d0 0x7fc344108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:21.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.311+0000 7fc349f81640 1 --2- 172.21.15.59:0/2124754267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc344102dc0 0x7fc3441031a0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:21.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.311+0000 7fc349f81640 1 -- 172.21.15.59:0/2124754267 >> 172.21.15.59:0/2124754267 conn(0x7fc3440fe830 msgr2=0x7fc344100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:27:21.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.311+0000 7fc349f81640 1 -- 172.21.15.59:0/2124754267 shutdown_connections 2024-09-10T21:27:21.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.311+0000 7fc349f81640 1 -- 172.21.15.59:0/2124754267 wait complete. 2024-09-10T21:27:21.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.311+0000 7fc349f81640 1 Processor -- start 2024-09-10T21:27:21.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.312+0000 7fc349f81640 1 -- start start 2024-09-10T21:27:21.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.312+0000 7fc349f81640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc344102dc0 0x7fc3440754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:21.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.312+0000 7fc349f81640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3441087d0 0x7fc3440759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:21.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.312+0000 7fc349f81640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc344109150 0x7fc344075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:21.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.312+0000 7fc349f81640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc344112e10 con 0x7fc3441087d0 2024-09-10T21:27:21.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.312+0000 7fc349f81640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc344112c90 con 0x7fc344102dc0 2024-09-10T21:27:21.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.312+0000 7fc349f81640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc344112f90 con 0x7fc344109150 2024-09-10T21:27:21.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.312+0000 7fc342ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3441087d0 0x7fc3440759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:21.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.312+0000 7fc342ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3441087d0 0x7fc3440759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41620/0 (socket says 172.21.15.59:41620) 2024-09-10T21:27:21.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.312+0000 7fc342ffd640 1 -- 172.21.15.59:0/1982840685 learned_addr learned my addr 172.21.15.59:0/1982840685 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:27:21.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.312+0000 7fc3437fe640 1 --2- 172.21.15.59:0/1982840685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc344102dc0 0x7fc3440754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:21.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.312+0000 7fc343fff640 1 --2- 172.21.15.59:0/1982840685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc344109150 0x7fc344075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:21.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.312+0000 7fc342ffd640 1 -- 172.21.15.59:0/1982840685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc344109150 msgr2=0x7fc344075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:21.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.312+0000 7fc342ffd640 1 --2- 172.21.15.59:0/1982840685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc344109150 0x7fc344075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:21.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.312+0000 7fc342ffd640 1 -- 172.21.15.59:0/1982840685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc344102dc0 msgr2=0x7fc3440754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:21.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.312+0000 7fc342ffd640 1 --2- 172.21.15.59:0/1982840685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc344102dc0 0x7fc3440754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:21.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.312+0000 7fc342ffd640 1 -- 172.21.15.59:0/1982840685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3441a76a0 con 0x7fc3441087d0 2024-09-10T21:27:21.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.312+0000 7fc3437fe640 1 --2- 172.21.15.59:0/1982840685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc344102dc0 0x7fc3440754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:27:21.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.312+0000 7fc342ffd640 1 --2- 172.21.15.59:0/1982840685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3441087d0 0x7fc3440759e0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fc33800d950 tx=0x7fc33800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:27:21.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.313+0000 7fc340ff9640 1 -- 172.21.15.59:0/1982840685 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338017070 con 0x7fc3441087d0 2024-09-10T21:27:21.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.313+0000 7fc340ff9640 1 -- 172.21.15.59:0/1982840685 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc338009c30 con 0x7fc3441087d0 2024-09-10T21:27:21.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.313+0000 7fc349f81640 1 -- 172.21.15.59:0/1982840685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3441a7990 con 0x7fc3441087d0 2024-09-10T21:27:21.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.313+0000 7fc340ff9640 1 -- 172.21.15.59:0/1982840685 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33800f620 con 0x7fc3441087d0 2024-09-10T21:27:21.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.313+0000 7fc349f81640 1 -- 172.21.15.59:0/1982840685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3441a7f20 con 0x7fc3441087d0 2024-09-10T21:27:21.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.314+0000 7fc349f81640 1 -- 172.21.15.59:0/1982840685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3441031a0 con 0x7fc3441087d0 2024-09-10T21:27:21.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.315+0000 7fc340ff9640 1 -- 172.21.15.59:0/1982840685 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7fc338010460 con 0x7fc3441087d0 2024-09-10T21:27:21.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.316+0000 7fc340ff9640 1 --2- 172.21.15.59:0/1982840685 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc32c0b5360 0x7fc32c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:21.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.316+0000 7fc3437fe640 1 --2- 172.21.15.59:0/1982840685 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc32c0b5360 0x7fc32c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:21.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.316+0000 7fc340ff9640 1 -- 172.21.15.59:0/1982840685 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8612+0+0 (secure 0 0 0) 0x7fc3380e5a20 con 0x7fc3441087d0 2024-09-10T21:27:21.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.317+0000 7fc3437fe640 1 --2- 172.21.15.59:0/1982840685 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc32c0b5360 0x7fc32c0b7820 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc334031440 tx=0x7fc334005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:27:21.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.319+0000 7fc340ff9640 1 -- 172.21.15.59:0/1982840685 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc3380ac780 con 0x7fc3441087d0 2024-09-10T21:27:21.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.541+0000 7fc349f81640 1 -- 172.21.15.59:0/1982840685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc3441a82b0 con 0x7fc3441087d0 2024-09-10T21:27:21.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.847+0000 7fc340ff9640 1 -- 172.21.15.59:0/1982840685 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7fc338009de0 con 0x7fc3441087d0 2024-09-10T21:27:21.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.850+0000 7fc349f81640 1 -- 172.21.15.59:0/1982840685 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc32c0b5360 msgr2=0x7fc32c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:21.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.850+0000 7fc349f81640 1 --2- 172.21.15.59:0/1982840685 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc32c0b5360 0x7fc32c0b7820 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc334031440 tx=0x7fc334005a20 comp rx=0 tx=0).stop 2024-09-10T21:27:21.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.850+0000 7fc349f81640 1 -- 172.21.15.59:0/1982840685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3441087d0 msgr2=0x7fc3440759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:21.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.850+0000 7fc349f81640 1 --2- 172.21.15.59:0/1982840685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3441087d0 0x7fc3440759e0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fc33800d950 tx=0x7fc33800de10 comp rx=0 tx=0).stop 2024-09-10T21:27:21.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.850+0000 7fc349f81640 1 -- 172.21.15.59:0/1982840685 shutdown_connections 2024-09-10T21:27:21.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.850+0000 7fc349f81640 1 --2- 172.21.15.59:0/1982840685 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7fc32c0b5360 0x7fc32c0b7820 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:21.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.850+0000 7fc349f81640 1 --2- 172.21.15.59:0/1982840685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc344109150 0x7fc344075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:21.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.850+0000 7fc349f81640 1 --2- 172.21.15.59:0/1982840685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3441087d0 0x7fc3440759e0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:21.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.850+0000 7fc349f81640 1 --2- 172.21.15.59:0/1982840685 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc344102dc0 0x7fc3440754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:21.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.850+0000 7fc349f81640 1 -- 172.21.15.59:0/1982840685 >> 172.21.15.59:0/1982840685 conn(0x7fc3440fe830 msgr2=0x7fc3441000b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:27:21.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.850+0000 7fc349f81640 1 -- 172.21.15.59:0/1982840685 shutdown_connections 2024-09-10T21:27:21.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:21.850+0000 7fc349f81640 1 -- 172.21.15.59:0/1982840685 wait complete. 2024-09-10T21:27:21.853 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.192:6832/104291745,v1:172.21.15.192:6834/104291745] up:boot 2024-09-10T21:27:21.854 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.192:6833/4294025438,v1:172.21.15.192:6835/4294025438] up:boot 2024-09-10T21:27:21.854 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.59:6838/1870608252,v1:172.21.15.59:6839/1870608252] up:boot 2024-09-10T21:27:21.854 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.154:6832/2153180842,v1:172.21.15.154:6834/2153180842] up:boot 2024-09-10T21:27:21.854 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.154:6833/4104224242,v1:172.21.15.154:6835/4104224242] up:boot 2024-09-10T21:27:21.854 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.192:6836/2194016398,v1:172.21.15.192:6838/2194016398] up:boot 2024-09-10T21:27:21.854 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.192:6837/1394280573,v1:172.21.15.192:6839/1394280573] up:boot 2024-09-10T21:27:21.854 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.59:6840/1488996779,v1:172.21.15.59:6841/1488996779] up:boot 2024-09-10T21:27:21.854 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.154:6836/2172757604,v1:172.21.15.154:6837/2172757604] up:boot 2024-09-10T21:27:21.854 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: mds.? [v2:172.21.15.154:6838/1072290121,v1:172.21.15.154:6839/1072290121] up:boot 2024-09-10T21:27:21.854 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-10T21:27:21.854 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T21:27:21.854 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T21:27:21.854 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T21:27:21.854 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T21:27:21.855 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T21:27:21.855 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T21:27:21.855 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T21:27:21.855 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T21:27:21.855 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T21:27:21.855 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T21:27:21.855 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:21 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1982840685' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T21:27:22.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.192:6832/104291745,v1:172.21.15.192:6834/104291745] up:boot 2024-09-10T21:27:22.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.192:6833/4294025438,v1:172.21.15.192:6835/4294025438] up:boot 2024-09-10T21:27:22.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.59:6838/1870608252,v1:172.21.15.59:6839/1870608252] up:boot 2024-09-10T21:27:22.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.154:6832/2153180842,v1:172.21.15.154:6834/2153180842] up:boot 2024-09-10T21:27:22.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.154:6833/4104224242,v1:172.21.15.154:6835/4104224242] up:boot 2024-09-10T21:27:22.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.192:6836/2194016398,v1:172.21.15.192:6838/2194016398] up:boot 2024-09-10T21:27:22.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.192:6837/1394280573,v1:172.21.15.192:6839/1394280573] up:boot 2024-09-10T21:27:22.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.59:6840/1488996779,v1:172.21.15.59:6841/1488996779] up:boot 2024-09-10T21:27:22.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.154:6836/2172757604,v1:172.21.15.154:6837/2172757604] up:boot 2024-09-10T21:27:22.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: mds.? [v2:172.21.15.154:6838/1072290121,v1:172.21.15.154:6839/1072290121] up:boot 2024-09-10T21:27:22.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-10T21:27:22.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T21:27:22.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T21:27:22.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T21:27:22.161 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T21:27:22.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T21:27:22.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T21:27:22.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T21:27:22.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T21:27:22.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T21:27:22.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T21:27:22.162 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:21 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1982840685' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T21:27:22.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.192:6832/104291745,v1:172.21.15.192:6834/104291745] up:boot 2024-09-10T21:27:22.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.192:6833/4294025438,v1:172.21.15.192:6835/4294025438] up:boot 2024-09-10T21:27:22.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.59:6838/1870608252,v1:172.21.15.59:6839/1870608252] up:boot 2024-09-10T21:27:22.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.154:6832/2153180842,v1:172.21.15.154:6834/2153180842] up:boot 2024-09-10T21:27:22.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.154:6833/4104224242,v1:172.21.15.154:6835/4104224242] up:boot 2024-09-10T21:27:22.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.192:6836/2194016398,v1:172.21.15.192:6838/2194016398] up:boot 2024-09-10T21:27:22.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.192:6837/1394280573,v1:172.21.15.192:6839/1394280573] up:boot 2024-09-10T21:27:22.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.59:6840/1488996779,v1:172.21.15.59:6841/1488996779] up:boot 2024-09-10T21:27:22.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.154:6836/2172757604,v1:172.21.15.154:6837/2172757604] up:boot 2024-09-10T21:27:22.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: mds.? [v2:172.21.15.154:6838/1072290121,v1:172.21.15.154:6839/1072290121] up:boot 2024-09-10T21:27:22.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-10T21:27:22.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T21:27:22.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T21:27:22.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T21:27:22.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T21:27:22.327 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T21:27:22.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T21:27:22.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T21:27:22.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T21:27:22.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T21:27:22.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: from='mgr.14150 172.21.15.59:0/565277997' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T21:27:22.328 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:21 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1982840685' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T21:27:22.570 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T21:27:22.835 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:27:23.102 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:22 smithi059 ceph-mon[30888]: pgmap v704: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-10T21:27:23.102 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:22 smithi059 ceph-mon[30888]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T21:27:23.102 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:22 smithi059 ceph-mon[30888]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T21:27:23.102 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:22 smithi059 ceph-mon[30888]: Cluster is now healthy 2024-09-10T21:27:23.103 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:22 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/1982840685' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T21:27:23.103 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:22 smithi059 ceph-mon[30888]: fsmap 12 up:standby 2024-09-10T21:27:23.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:22 smithi154 ceph-mon[35041]: pgmap v704: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-10T21:27:23.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:22 smithi154 ceph-mon[35041]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T21:27:23.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:22 smithi154 ceph-mon[35041]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T21:27:23.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:22 smithi154 ceph-mon[35041]: Cluster is now healthy 2024-09-10T21:27:23.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:22 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/1982840685' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T21:27:23.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:22 smithi154 ceph-mon[35041]: fsmap 12 up:standby 2024-09-10T21:27:23.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.304+0000 7f9292aea640 1 -- 172.21.15.59:0/3605105411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f928c10f420 msgr2=0x7f928c111810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.304+0000 7f9292aea640 1 --2- 172.21.15.59:0/3605105411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f928c10f420 0x7f928c111810 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f9284009ca0 tx=0x7f928402a8c0 comp rx=0 tx=0).stop 2024-09-10T21:27:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.304+0000 7f9292aea640 1 -- 172.21.15.59:0/3605105411 shutdown_connections 2024-09-10T21:27:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.304+0000 7f9292aea640 1 --2- 172.21.15.59:0/3605105411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f928c10f420 0x7f928c111810 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.304+0000 7f9292aea640 1 --2- 172.21.15.59:0/3605105411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928c102190 0x7f928c10eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.304+0000 7f9292aea640 1 --2- 172.21.15.59:0/3605105411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f928c101870 0x7f928c101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.304+0000 7f9292aea640 1 -- 172.21.15.59:0/3605105411 >> 172.21.15.59:0/3605105411 conn(0x7f928c0fd700 msgr2=0x7f928c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:27:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.304+0000 7f9292aea640 1 -- 172.21.15.59:0/3605105411 shutdown_connections 2024-09-10T21:27:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.304+0000 7f9292aea640 1 -- 172.21.15.59:0/3605105411 wait complete. 2024-09-10T21:27:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.304+0000 7f9292aea640 1 Processor -- start 2024-09-10T21:27:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.304+0000 7f9292aea640 1 -- start start 2024-09-10T21:27:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.305+0000 7f9292aea640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928c101870 0x7f928c19b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:23.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.305+0000 7f9292aea640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f928c102190 0x7f928c19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.305+0000 7f9292aea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f928c10f420 0x7f928c1a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.305+0000 7f9292aea640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f928c114f80 con 0x7f928c10f420 2024-09-10T21:27:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.305+0000 7f9292aea640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f928c114e00 con 0x7f928c101870 2024-09-10T21:27:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.305+0000 7f9292aea640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f928c115100 con 0x7f928c102190 2024-09-10T21:27:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.305+0000 7f9291087640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f928c10f420 0x7f928c1a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.305+0000 7f9291087640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f928c10f420 0x7f928c1a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41642/0 (socket says 172.21.15.59:41642) 2024-09-10T21:27:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.305+0000 7f9291087640 1 -- 172.21.15.59:0/2870059140 learned_addr learned my addr 172.21.15.59:0/2870059140 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:27:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.305+0000 7f928bfff640 1 --2- 172.21.15.59:0/2870059140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f928c102190 0x7f928c19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.305+0000 7f9290886640 1 --2- 172.21.15.59:0/2870059140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928c101870 0x7f928c19b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.305+0000 7f9291087640 1 -- 172.21.15.59:0/2870059140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f928c102190 msgr2=0x7f928c19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.305+0000 7f9291087640 1 --2- 172.21.15.59:0/2870059140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f928c102190 0x7f928c19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:23.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.305+0000 7f9291087640 1 -- 172.21.15.59:0/2870059140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928c101870 msgr2=0x7f928c19b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:23.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.305+0000 7f9291087640 1 --2- 172.21.15.59:0/2870059140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928c101870 0x7f928c19b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:23.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.305+0000 7f9291087640 1 -- 172.21.15.59:0/2870059140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928c1a1520 con 0x7f928c10f420 2024-09-10T21:27:23.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.306+0000 7f9291087640 1 --2- 172.21.15.59:0/2870059140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f928c10f420 0x7f928c1a0d50 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f92840319f0 tx=0x7f9284031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:27:23.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.306+0000 7f9289ffb640 1 -- 172.21.15.59:0/2870059140 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284003bf0 con 0x7f928c10f420 2024-09-10T21:27:23.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.306+0000 7f9289ffb640 1 -- 172.21.15.59:0/2870059140 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9284003d90 con 0x7f928c10f420 2024-09-10T21:27:23.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.306+0000 7f9292aea640 1 -- 172.21.15.59:0/2870059140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f928c1a17b0 con 0x7f928c10f420 2024-09-10T21:27:23.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.306+0000 7f9289ffb640 1 -- 172.21.15.59:0/2870059140 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928402fc00 con 0x7f928c10f420 2024-09-10T21:27:23.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.306+0000 7f9292aea640 1 -- 172.21.15.59:0/2870059140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f928c1a7ed0 con 0x7f928c10f420 2024-09-10T21:27:23.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.307+0000 7f9292aea640 1 -- 172.21.15.59:0/2870059140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f928c101c50 con 0x7f928c10f420 2024-09-10T21:27:23.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.308+0000 7f9289ffb640 1 -- 172.21.15.59:0/2870059140 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f9284004610 con 0x7f928c10f420 2024-09-10T21:27:23.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.309+0000 7f9289ffb640 1 --2- 172.21.15.59:0/2870059140 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f927c0b52e0 0x7f927c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:23.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.309+0000 7f9289ffb640 1 -- 172.21.15.59:0/2870059140 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8612+0+0 (secure 0 0 0) 0x7f92841071a0 con 0x7f928c10f420 2024-09-10T21:27:23.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.309+0000 7f9290886640 1 --2- 172.21.15.59:0/2870059140 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f927c0b52e0 0x7f927c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:23.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.310+0000 7f9290886640 1 --2- 172.21.15.59:0/2870059140 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f927c0b52e0 0x7f927c0b77a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9280005fd0 tx=0x7f928000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:27:23.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.313+0000 7f9289ffb640 1 -- 172.21.15.59:0/2870059140 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f92840cdee0 con 0x7f928c10f420 2024-09-10T21:27:23.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:22 smithi192 ceph-mon[35363]: pgmap v704: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-10T21:27:23.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:22 smithi192 ceph-mon[35363]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T21:27:23.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:22 smithi192 ceph-mon[35363]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T21:27:23.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:22 smithi192 ceph-mon[35363]: Cluster is now healthy 2024-09-10T21:27:23.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:22 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/1982840685' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T21:27:23.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:22 smithi192 ceph-mon[35363]: fsmap 12 up:standby 2024-09-10T21:27:23.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:23.498+0000 7f9292aea640 1 -- 172.21.15.59:0/2870059140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f928c1a8170 con 0x7f928c10f420 2024-09-10T21:27:24.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:24.094+0000 7f9289ffb640 1 -- 172.21.15.59:0/2870059140 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) ==== 181+0+0 (secure 0 0 0) 0x7f92840098b0 con 0x7f928c10f420 2024-09-10T21:27:24.097 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2024-09-10T21:27:24.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:24.098+0000 7f9292aea640 1 -- 172.21.15.59:0/2870059140 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f927c0b52e0 msgr2=0x7f927c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:24.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:24.098+0000 7f9292aea640 1 --2- 172.21.15.59:0/2870059140 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f927c0b52e0 0x7f927c0b77a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f9280005fd0 tx=0x7f928000b390 comp rx=0 tx=0).stop 2024-09-10T21:27:24.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:24.098+0000 7f9292aea640 1 -- 172.21.15.59:0/2870059140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f928c10f420 msgr2=0x7f928c1a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:24.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:24.098+0000 7f9292aea640 1 --2- 172.21.15.59:0/2870059140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f928c10f420 0x7f928c1a0d50 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f92840319f0 tx=0x7f9284031a20 comp rx=0 tx=0).stop 2024-09-10T21:27:24.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:24.099+0000 7f9292aea640 1 -- 172.21.15.59:0/2870059140 shutdown_connections 2024-09-10T21:27:24.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:24.099+0000 7f9292aea640 1 --2- 172.21.15.59:0/2870059140 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f927c0b52e0 0x7f927c0b77a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:24.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:24.099+0000 7f9292aea640 1 --2- 172.21.15.59:0/2870059140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f928c10f420 0x7f928c1a0d50 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:24.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:24.099+0000 7f9292aea640 1 --2- 172.21.15.59:0/2870059140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f928c102190 0x7f928c19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:24.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:24.099+0000 7f9292aea640 1 --2- 172.21.15.59:0/2870059140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f928c101870 0x7f928c19b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:24.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:24.099+0000 7f9292aea640 1 -- 172.21.15.59:0/2870059140 >> 172.21.15.59:0/2870059140 conn(0x7f928c0fd700 msgr2=0x7f928c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:27:24.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:24.099+0000 7f9292aea640 1 -- 172.21.15.59:0/2870059140 shutdown_connections 2024-09-10T21:27:24.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:24.099+0000 7f9292aea640 1 -- 172.21.15.59:0/2870059140 wait complete. 2024-09-10T21:27:24.409 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:24 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2870059140' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T21:27:24.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:24 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2870059140' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T21:27:24.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:24 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2870059140' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T21:27:24.893 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T21:27:25.159 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:25 smithi059 ceph-mon[30888]: pgmap v705: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 716 B/s wr, 9 op/s 2024-09-10T21:27:25.159 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:25 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2870059140' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T21:27:25.160 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:25 smithi059 ceph-mon[30888]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T21:27:25.161 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T21:27:25.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:25 smithi154 ceph-mon[35041]: pgmap v705: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 716 B/s wr, 9 op/s 2024-09-10T21:27:25.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:25 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2870059140' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T21:27:25.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:25 smithi154 ceph-mon[35041]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T21:27:25.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:25 smithi192 ceph-mon[35363]: pgmap v705: 97 pgs: 97 active+clean; 7.6 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 716 B/s wr, 9 op/s 2024-09-10T21:27:25.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:25 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2870059140' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T21:27:25.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:25 smithi192 ceph-mon[35363]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T21:27:25.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.648+0000 7f6829f65640 1 -- 172.21.15.59:0/1451874237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6824109120 msgr2=0x7f682410f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.648+0000 7f6829f65640 1 --2- 172.21.15.59:0/1451874237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6824109120 0x7f682410f920 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f681c009ca0 tx=0x7f681c02a8c0 comp rx=0 tx=0).stop 2024-09-10T21:27:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.648+0000 7f6829f65640 1 -- 172.21.15.59:0/1451874237 shutdown_connections 2024-09-10T21:27:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.648+0000 7f6829f65640 1 --2- 172.21.15.59:0/1451874237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6824109120 0x7f682410f920 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.648+0000 7f6829f65640 1 --2- 172.21.15.59:0/1451874237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68241087a0 0x7f6824108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.648+0000 7f6829f65640 1 --2- 172.21.15.59:0/1451874237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6824102d90 0x7f6824103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.648+0000 7f6829f65640 1 -- 172.21.15.59:0/1451874237 >> 172.21.15.59:0/1451874237 conn(0x7f68240fe820 msgr2=0x7f6824100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:27:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.648+0000 7f6829f65640 1 -- 172.21.15.59:0/1451874237 shutdown_connections 2024-09-10T21:27:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.648+0000 7f6829f65640 1 -- 172.21.15.59:0/1451874237 wait complete. 2024-09-10T21:27:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.649+0000 7f6829f65640 1 Processor -- start 2024-09-10T21:27:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.649+0000 7f6829f65640 1 -- start start 2024-09-10T21:27:25.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.649+0000 7f6829f65640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6824102d90 0x7f6824199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.649+0000 7f6829f65640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68241087a0 0x7f6824199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.649+0000 7f6829f65640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6824109120 0x7f682419eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.649+0000 7f6829f65640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6824112de0 con 0x7f6824109120 2024-09-10T21:27:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.649+0000 7f6829f65640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6824112c60 con 0x7f68241087a0 2024-09-10T21:27:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.649+0000 7f6829f65640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6824112f60 con 0x7f6824102d90 2024-09-10T21:27:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.649+0000 7f6823fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6824109120 0x7f682419eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.649+0000 7f6823fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6824109120 0x7f682419eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41666/0 (socket says 172.21.15.59:41666) 2024-09-10T21:27:25.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.649+0000 7f6823fff640 1 -- 172.21.15.59:0/2404725602 learned_addr learned my addr 172.21.15.59:0/2404725602 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-10T21:27:25.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.649+0000 7f6822ffd640 1 --2- 172.21.15.59:0/2404725602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68241087a0 0x7f6824199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:25.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.649+0000 7f68237fe640 1 --2- 172.21.15.59:0/2404725602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6824102d90 0x7f6824199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:25.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.650+0000 7f6823fff640 1 -- 172.21.15.59:0/2404725602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6824102d90 msgr2=0x7f6824199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:25.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.650+0000 7f6823fff640 1 --2- 172.21.15.59:0/2404725602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6824102d90 0x7f6824199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:25.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.650+0000 7f6823fff640 1 -- 172.21.15.59:0/2404725602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68241087a0 msgr2=0x7f6824199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:25.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.650+0000 7f6823fff640 1 --2- 172.21.15.59:0/2404725602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68241087a0 0x7f6824199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:25.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.650+0000 7f6823fff640 1 -- 172.21.15.59:0/2404725602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682419f2c0 con 0x7f6824109120 2024-09-10T21:27:25.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.650+0000 7f6822ffd640 1 --2- 172.21.15.59:0/2404725602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68241087a0 0x7f6824199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T21:27:25.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.650+0000 7f6823fff640 1 --2- 172.21.15.59:0/2404725602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6824109120 0x7f682419eaf0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f681c005cc0 tx=0x7f681c02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:27:25.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.650+0000 7f6820ff9640 1 -- 172.21.15.59:0/2404725602 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681c003cf0 con 0x7f6824109120 2024-09-10T21:27:25.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.650+0000 7f6829f65640 1 -- 172.21.15.59:0/2404725602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f682419f550 con 0x7f6824109120 2024-09-10T21:27:25.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.650+0000 7f6820ff9640 1 -- 172.21.15.59:0/2404725602 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f681c0044f0 con 0x7f6824109120 2024-09-10T21:27:25.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.650+0000 7f6820ff9640 1 -- 172.21.15.59:0/2404725602 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681c02fd10 con 0x7f6824109120 2024-09-10T21:27:25.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.650+0000 7f6829f65640 1 -- 172.21.15.59:0/2404725602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68241a5cf0 con 0x7f6824109120 2024-09-10T21:27:25.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.651+0000 7f6829f65640 1 -- 172.21.15.59:0/2404725602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6824103170 con 0x7f6824109120 2024-09-10T21:27:25.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.653+0000 7f6820ff9640 1 -- 172.21.15.59:0/2404725602 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 153250+0+0 (secure 0 0 0) 0x7f681c004040 con 0x7f6824109120 2024-09-10T21:27:25.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.653+0000 7f6820ff9640 1 --2- 172.21.15.59:0/2404725602 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f680c0b52e0 0x7f680c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T21:27:25.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.654+0000 7f68237fe640 1 --2- 172.21.15.59:0/2404725602 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f680c0b52e0 0x7f680c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T21:27:25.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.654+0000 7f6820ff9640 1 -- 172.21.15.59:0/2404725602 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8087+0+0 (secure 0 0 0) 0x7f681c107490 con 0x7f6824109120 2024-09-10T21:27:25.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.654+0000 7f68237fe640 1 --2- 172.21.15.59:0/2404725602 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f680c0b52e0 0x7f680c0b77a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6814009890 tx=0x7f6814008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T21:27:25.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.656+0000 7f6820ff9640 1 -- 172.21.15.59:0/2404725602 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f681c083220 con 0x7f6824109120 2024-09-10T21:27:25.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:25.846+0000 7f6829f65640 1 -- 172.21.15.59:0/2404725602 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f68241a6040 con 0x7f6824109120 2024-09-10T21:27:26.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:26.102+0000 7f6820ff9640 1 -- 172.21.15.59:0/2404725602 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) ==== 169+0+0 (secure 0 0 0) 0x7f681c0ce390 con 0x7f6824109120 2024-09-10T21:27:26.104 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2024-09-10T21:27:26.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:26.106+0000 7f6829f65640 1 -- 172.21.15.59:0/2404725602 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f680c0b52e0 msgr2=0x7f680c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:26.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:26.106+0000 7f6829f65640 1 --2- 172.21.15.59:0/2404725602 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f680c0b52e0 0x7f680c0b77a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6814009890 tx=0x7f6814008040 comp rx=0 tx=0).stop 2024-09-10T21:27:26.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:26.106+0000 7f6829f65640 1 -- 172.21.15.59:0/2404725602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6824109120 msgr2=0x7f682419eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T21:27:26.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:26.106+0000 7f6829f65640 1 --2- 172.21.15.59:0/2404725602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6824109120 0x7f682419eaf0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f681c005cc0 tx=0x7f681c02f470 comp rx=0 tx=0).stop 2024-09-10T21:27:26.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:26.106+0000 7f6829f65640 1 -- 172.21.15.59:0/2404725602 shutdown_connections 2024-09-10T21:27:26.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:26.106+0000 7f6829f65640 1 --2- 172.21.15.59:0/2404725602 >> [v2:172.21.15.59:6800/123832859,v1:172.21.15.59:6801/123832859] conn(0x7f680c0b52e0 0x7f680c0b77a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:26.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:26.106+0000 7f6829f65640 1 --2- 172.21.15.59:0/2404725602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6824109120 0x7f682419eaf0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:26.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:26.106+0000 7f6829f65640 1 --2- 172.21.15.59:0/2404725602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68241087a0 0x7f6824199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:26.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:26.106+0000 7f6829f65640 1 --2- 172.21.15.59:0/2404725602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6824102d90 0x7f6824199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T21:27:26.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:26.106+0000 7f6829f65640 1 -- 172.21.15.59:0/2404725602 >> 172.21.15.59:0/2404725602 conn(0x7f68240fe820 msgr2=0x7f6824100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T21:27:26.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:26.106+0000 7f6829f65640 1 -- 172.21.15.59:0/2404725602 shutdown_connections 2024-09-10T21:27:26.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-10T21:27:26.106+0000 7f6829f65640 1 -- 172.21.15.59:0/2404725602 wait complete. 2024-09-10T21:27:26.409 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:26 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2404725602' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T21:27:26.431 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:26 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2404725602' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T21:27:26.576 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:26 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2404725602' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T21:27:26.807 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T21:27:26.835 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T21:27:26.870 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T21:27:26.903 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-10T21:27:26.903 DEBUG:teuthology.orchestra.run.smithi059:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T21:27:26.920 DEBUG:teuthology.orchestra.run.smithi154:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T21:27:26.938 DEBUG:teuthology.orchestra.run.smithi192:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T21:27:26.961 INFO:tasks.cephadm:Stopping all daemons... 2024-09-10T21:27:26.962 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-10T21:27:26.962 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mon.a 2024-09-10T21:27:27.106 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:27 smithi059 systemd[1]: Stopping Ceph mon.a for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:27:27.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:27 smithi154 ceph-mon[35041]: pgmap v707: 65 pgs: 65 active+clean; 577 KiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:27:27.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:27 smithi154 ceph-mon[35041]: from='client.? 172.21.15.59:0/2404725602' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T21:27:27.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:27 smithi154 ceph-mon[35041]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T21:27:27.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:27 smithi192 ceph-mon[35363]: pgmap v707: 65 pgs: 65 active+clean; 577 KiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:27:27.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:27 smithi192 ceph-mon[35363]: from='client.? 172.21.15.59:0/2404725602' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T21:27:27.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:27 smithi192 ceph-mon[35363]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T21:27:27.409 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:27 smithi059 ceph-mon[30888]: pgmap v707: 65 pgs: 65 active+clean; 577 KiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T21:27:27.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:27 smithi059 ceph-mon[30888]: from='client.? 172.21.15.59:0/2404725602' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T21:27:27.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:27 smithi059 ceph-mon[30888]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T21:27:27.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:27 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-a[30883]: 2024-09-10T21:27:27.276+0000 7f0db3f3d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:27:27.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:27 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-a[30883]: 2024-09-10T21:27:27.276+0000 7f0db3f3d640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-10T21:27:27.410 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:27 smithi059 podman[113644]: 2024-09-10 21:27:27.338182465 +0000 UTC m=+0.175911711 container died 6c68aa69a9170330616bd4718b2c0bf6e6d1e5ed0380f3924209fb03f65c5889 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-10T21:27:27.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:27 smithi059 podman[113644]: 2024-09-10 21:27:27.693021901 +0000 UTC m=+0.530751144 container cleanup 6c68aa69a9170330616bd4718b2c0bf6e6d1e5ed0380f3924209fb03f65c5889 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2) 2024-09-10T21:27:27.909 INFO:journalctl@ceph.mon.a.smithi059.stdout:Sep 10 21:27:27 smithi059 bash[113644]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-a 2024-09-10T21:27:28.187 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mon.a.service' 2024-09-10T21:27:28.233 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:27:28.234 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-10T21:27:28.234 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-10T21:27:28.234 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mon.b 2024-09-10T21:27:28.681 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:28 smithi154 systemd[1]: Stopping Ceph mon.b for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:27:29.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:28 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-b[35037]: 2024-09-10T21:27:28.722+0000 7fe9325aa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:27:29.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:28 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-b[35037]: 2024-09-10T21:27:28.722+0000 7fe9325aa640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-10T21:27:29.181 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:28 smithi154 podman[69863]: 2024-09-10 21:27:28.957763033 +0000 UTC m=+0.523075469 container died e3a53235f8607c8b9a8d0262b4c01eba96a0a0437b6dfd4d4c3365217134e806 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-b, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731) 2024-09-10T21:27:29.491 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:29 smithi154 podman[69863]: 2024-09-10 21:27:29.280785884 +0000 UTC m=+0.846098309 container cleanup e3a53235f8607c8b9a8d0262b4c01eba96a0a0437b6dfd4d4c3365217134e806 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-b, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T21:27:29.492 INFO:journalctl@ceph.mon.b.smithi154.stdout:Sep 10 21:27:29 smithi154 bash[69863]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-b 2024-09-10T21:27:29.704 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mon.b.service' 2024-09-10T21:27:29.748 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:27:29.749 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-10T21:27:29.749 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-10T21:27:29.749 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mon.c 2024-09-10T21:27:30.029 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:29 smithi192 systemd[1]: Stopping Ceph mon.c for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:27:30.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:30 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-c[35358]: 2024-09-10T21:27:30.038+0000 7f186c49c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:27:30.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:30 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-c[35358]: 2024-09-10T21:27:30.038+0000 7f186c49c640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-10T21:27:30.326 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:30 smithi192 podman[69288]: 2024-09-10 21:27:30.181979635 +0000 UTC m=+0.235904797 container died 6e6bf3764ceab5c59be372a128e2f84874e7d1526b30eadcd634d8f60dd05b5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-c, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-09-10T21:27:30.647 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:30 smithi192 podman[69288]: 2024-09-10 21:27:30.547548642 +0000 UTC m=+0.601473813 container cleanup 6e6bf3764ceab5c59be372a128e2f84874e7d1526b30eadcd634d8f60dd05b5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-10T21:27:30.647 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:30 smithi192 bash[69288]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-c 2024-09-10T21:27:30.976 INFO:journalctl@ceph.mon.c.smithi192.stdout:Sep 10 21:27:30 smithi192 podman[69300]: 2024-09-10 21:27:30.815801924 +0000 UTC m=+0.637623505 container remove 6e6bf3764ceab5c59be372a128e2f84874e7d1526b30eadcd634d8f60dd05b5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T21:27:30.997 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mon.c.service' 2024-09-10T21:27:31.044 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:27:31.045 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-10T21:27:31.045 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-10T21:27:31.045 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mgr.x 2024-09-10T21:27:31.349 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:27:31 smithi059 systemd[1]: Stopping Ceph mgr.x for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:27:31.659 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:27:31 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: 2024-09-10T21:27:31.347+0000 7f41a9929640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:27:31.660 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:27:31 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x[31113]: 2024-09-10T21:27:31.347+0000 7f41a9929640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-10T21:27:31.660 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:27:31 smithi059 podman[113767]: 2024-09-10 21:27:31.37850623 +0000 UTC m=+0.133744509 container died c1d7dced6f3a4909e5af2b10e98f3e31ecf89a7cebf57d82b20a341666c66b71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T21:27:32.034 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:27:31 smithi059 podman[113767]: 2024-09-10 21:27:31.739639711 +0000 UTC m=+0.494877979 container cleanup c1d7dced6f3a4909e5af2b10e98f3e31ecf89a7cebf57d82b20a341666c66b71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-10T21:27:32.034 INFO:journalctl@ceph.mgr.x.smithi059.stdout:Sep 10 21:27:31 smithi059 bash[113767]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-x 2024-09-10T21:27:32.173 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-10T21:27:32.209 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:27:32.209 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-10T21:27:32.209 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-10T21:27:32.210 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mgr.y 2024-09-10T21:27:32.574 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 21:27:32 smithi154 systemd[1]: Stopping Ceph mgr.y for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:27:32.846 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 21:27:32 smithi154 podman[69999]: 2024-09-10 21:27:32.57259088 +0000 UTC m=+0.171934529 container died 8868cafc2947df0743b3442df100635a49ae5af98f2e0dabc5b0938593bc62ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-y, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-10T21:27:33.181 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 21:27:32 smithi154 podman[69999]: 2024-09-10 21:27:32.926924832 +0000 UTC m=+0.526268470 container cleanup 8868cafc2947df0743b3442df100635a49ae5af98f2e0dabc5b0938593bc62ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-10T21:27:33.181 INFO:journalctl@ceph.mgr.y.smithi154.stdout:Sep 10 21:27:32 smithi154 bash[69999]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-y 2024-09-10T21:27:33.356 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-10T21:27:33.393 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:27:33.393 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-10T21:27:33.393 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-10T21:27:33.394 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mgr.z 2024-09-10T21:27:33.743 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 10 21:27:33 smithi192 systemd[1]: Stopping Ceph mgr.z for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:27:34.005 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 10 21:27:33 smithi192 podman[69423]: 2024-09-10 21:27:33.74228215 +0000 UTC m=+0.148904682 container died 71c1ee07190ee290cdb1d2bb8cbfb4a6a746bd34dae1c2c0f06094dc71ff6b6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T21:27:34.263 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 10 21:27:34 smithi192 podman[69423]: 2024-09-10 21:27:34.077887873 +0000 UTC m=+0.484510412 container cleanup 71c1ee07190ee290cdb1d2bb8cbfb4a6a746bd34dae1c2c0f06094dc71ff6b6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-z, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:27:34.264 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 10 21:27:34 smithi192 bash[69423]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-z 2024-09-10T21:27:34.507 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-10T21:27:34.529 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 10 21:27:34 smithi192 podman[69435]: 2024-09-10 21:27:34.262256229 +0000 UTC m=+0.524001498 container remove 71c1ee07190ee290cdb1d2bb8cbfb4a6a746bd34dae1c2c0f06094dc71ff6b6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mgr-z, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-10T21:27:34.529 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 10 21:27:34 smithi192 systemd[1]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-10T21:27:34.529 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 10 21:27:34 smithi192 systemd[1]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mgr.z.service: Failed with result 'exit-code'. 2024-09-10T21:27:34.529 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 10 21:27:34 smithi192 systemd[1]: Stopped Ceph mgr.z for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:27:34.529 INFO:journalctl@ceph.mgr.z.smithi192.stdout:Sep 10 21:27:34 smithi192 systemd[1]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mgr.z.service: Consumed 7.110s CPU time. 2024-09-10T21:27:34.543 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:27:34.543 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-10T21:27:34.543 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-10T21:27:34.544 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.0 2024-09-10T21:27:34.829 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:27:34 smithi059 systemd[1]: Stopping Ceph osd.0 for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:27:35.159 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:27:34 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-0[47096]: 2024-09-10T21:27:34.826+0000 7f678c811640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:27:35.160 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:27:34 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-0[47096]: 2024-09-10T21:27:34.826+0000 7f678c811640 -1 osd.0 78 *** Got signal Terminated *** 2024-09-10T21:27:35.160 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:27:34 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-0[47096]: 2024-09-10T21:27:34.826+0000 7f678c811640 -1 osd.0 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:27:40.631 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:27:40 smithi059 podman[113890]: 2024-09-10 21:27:40.266906806 +0000 UTC m=+5.531994990 container died 2426eaffeec70ffcfd167c849761badef30b807e4506e956555046130e25fd3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-10T21:27:40.909 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:27:40 smithi059 podman[113890]: 2024-09-10 21:27:40.727040694 +0000 UTC m=+5.992128867 container cleanup 2426eaffeec70ffcfd167c849761badef30b807e4506e956555046130e25fd3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:27:40.909 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:27:40 smithi059 bash[113890]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-0 2024-09-10T21:27:41.361 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:27:41 smithi059 podman[113905]: 2024-09-10 21:27:41.028770863 +0000 UTC m=+0.762226286 container remove 2426eaffeec70ffcfd167c849761badef30b807e4506e956555046130e25fd3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-10T21:27:41.617 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:27:41 smithi059 podman[113992]: 2024-09-10 21:27:41.263017056 +0000 UTC m=+0.016362784 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:27:41.617 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:27:41 smithi059 podman[113992]: 2024-09-10 21:27:41.362899052 +0000 UTC m=+0.116244780 container create 3d8aa4e0a4789615489ac4dee119d06fcf6fe802f66eea19a7741f359b38365d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-10T21:27:41.909 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:27:41 smithi059 podman[113992]: 2024-09-10 21:27:41.615296983 +0000 UTC m=+0.368642711 container init 3d8aa4e0a4789615489ac4dee119d06fcf6fe802f66eea19a7741f359b38365d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T21:27:41.910 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:27:41 smithi059 podman[113992]: 2024-09-10 21:27:41.619709398 +0000 UTC m=+0.373055130 container start 3d8aa4e0a4789615489ac4dee119d06fcf6fe802f66eea19a7741f359b38365d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-09-10T21:27:41.910 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:27:41 smithi059 podman[113992]: 2024-09-10 21:27:41.715228809 +0000 UTC m=+0.468574537 container attach 3d8aa4e0a4789615489ac4dee119d06fcf6fe802f66eea19a7741f359b38365d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:27:41.910 INFO:journalctl@ceph.osd.0.smithi059.stdout:Sep 10 21:27:41 smithi059 podman[113992]: 2024-09-10 21:27:41.821065542 +0000 UTC m=+0.574411270 container died 3d8aa4e0a4789615489ac4dee119d06fcf6fe802f66eea19a7741f359b38365d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:27:42.425 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.0.service' 2024-09-10T21:27:42.467 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:27:42.467 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-10T21:27:42.467 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-10T21:27:42.467 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.1 2024-09-10T21:27:42.791 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:27:42 smithi154 systemd[1]: Stopping Ceph osd.1 for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:27:43.181 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:27:42 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-1[39506]: 2024-09-10T21:27:42.788+0000 7f07a90f6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:27:43.181 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:27:42 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-1[39506]: 2024-09-10T21:27:42.788+0000 7f07a90f6640 -1 osd.1 78 *** Got signal Terminated *** 2024-09-10T21:27:43.181 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:27:42 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-1[39506]: 2024-09-10T21:27:42.788+0000 7f07a90f6640 -1 osd.1 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:27:48.431 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:27:48 smithi154 podman[70126]: 2024-09-10 21:27:48.126472749 +0000 UTC m=+5.464839240 container died a93ff1f9b99a0b2be86c51b1b970bd8ee7d6320fe45a2d23184acb2303d8d5c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-10T21:27:48.733 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:27:48 smithi154 podman[70126]: 2024-09-10 21:27:48.539411838 +0000 UTC m=+5.877778325 container cleanup a93ff1f9b99a0b2be86c51b1b970bd8ee7d6320fe45a2d23184acb2303d8d5c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-1, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-10T21:27:48.733 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:27:48 smithi154 bash[70126]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-1 2024-09-10T21:27:49.151 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:27:48 smithi154 podman[70141]: 2024-09-10 21:27:48.732142271 +0000 UTC m=+0.605432383 container remove a93ff1f9b99a0b2be86c51b1b970bd8ee7d6320fe45a2d23184acb2303d8d5c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-1, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:27:49.431 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:27:49 smithi154 podman[70230]: 2024-09-10 21:27:49.149628115 +0000 UTC m=+0.101870490 container create b07728d406986a7b0d15a502733b6d311db098cf293694c190f14a4bf8db5087 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:27:49.431 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:27:49 smithi154 podman[70230]: 2024-09-10 21:27:49.063965273 +0000 UTC m=+0.016207656 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:27:49.431 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:27:49 smithi154 podman[70230]: 2024-09-10 21:27:49.352814961 +0000 UTC m=+0.305057338 container init b07728d406986a7b0d15a502733b6d311db098cf293694c190f14a4bf8db5087 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-10T21:27:49.431 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:27:49 smithi154 podman[70230]: 2024-09-10 21:27:49.356393914 +0000 UTC m=+0.308636296 container start b07728d406986a7b0d15a502733b6d311db098cf293694c190f14a4bf8db5087 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-1-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True) 2024-09-10T21:27:49.840 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:27:49 smithi154 podman[70230]: 2024-09-10 21:27:49.435856903 +0000 UTC m=+0.388099294 container attach b07728d406986a7b0d15a502733b6d311db098cf293694c190f14a4bf8db5087 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:27:49.840 INFO:journalctl@ceph.osd.1.smithi154.stdout:Sep 10 21:27:49 smithi154 podman[70230]: 2024-09-10 21:27:49.546717427 +0000 UTC m=+0.498959803 container died b07728d406986a7b0d15a502733b6d311db098cf293694c190f14a4bf8db5087 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-10T21:27:50.165 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.1.service' 2024-09-10T21:27:50.204 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:27:50.204 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-10T21:27:50.205 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-10T21:27:50.205 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.2 2024-09-10T21:27:50.492 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:27:50 smithi192 systemd[1]: Stopping Ceph osd.2 for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:27:50.826 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:27:50 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-2[40332]: 2024-09-10T21:27:50.488+0000 7fa81b67e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:27:50.826 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:27:50 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-2[40332]: 2024-09-10T21:27:50.488+0000 7fa81b67e640 -1 osd.2 78 *** Got signal Terminated *** 2024-09-10T21:27:50.826 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:27:50 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-2[40332]: 2024-09-10T21:27:50.488+0000 7fa81b67e640 -1 osd.2 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:27:56.293 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:27:55 smithi192 podman[69548]: 2024-09-10 21:27:55.98596339 +0000 UTC m=+5.586551608 container died da58a1406bd048c2cb9f52f8d79eb2ce9d347678139406ce5f647ef9c1cc0f6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:27:56.576 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:27:56 smithi192 podman[69548]: 2024-09-10 21:27:56.373263514 +0000 UTC m=+5.973851730 container cleanup da58a1406bd048c2cb9f52f8d79eb2ce9d347678139406ce5f647ef9c1cc0f6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T21:27:56.576 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:27:56 smithi192 bash[69548]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-2 2024-09-10T21:27:56.988 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:27:56 smithi192 podman[69563]: 2024-09-10 21:27:56.624891067 +0000 UTC m=+0.630240167 container remove da58a1406bd048c2cb9f52f8d79eb2ce9d347678139406ce5f647ef9c1cc0f6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T21:27:57.296 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:27:56 smithi192 podman[69654]: 2024-09-10 21:27:56.889504882 +0000 UTC m=+0.015935299 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:27:57.296 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:27:57 smithi192 podman[69654]: 2024-09-10 21:27:57.017440298 +0000 UTC m=+0.143870707 container create 621caf4215adf9d98964ab5d9eba060930c4a0dce261f4927153e5bad27d72a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-2-deactivate, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T21:27:57.296 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:27:57 smithi192 podman[69654]: 2024-09-10 21:27:57.219905115 +0000 UTC m=+0.346335520 container init 621caf4215adf9d98964ab5d9eba060930c4a0dce261f4927153e5bad27d72a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T21:27:57.296 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:27:57 smithi192 podman[69654]: 2024-09-10 21:27:57.224173757 +0000 UTC m=+0.350604179 container start 621caf4215adf9d98964ab5d9eba060930c4a0dce261f4927153e5bad27d72a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T21:27:57.296 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:27:57 smithi192 podman[69654]: 2024-09-10 21:27:57.294752339 +0000 UTC m=+0.421182761 container attach 621caf4215adf9d98964ab5d9eba060930c4a0dce261f4927153e5bad27d72a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:27:57.576 INFO:journalctl@ceph.osd.2.smithi192.stdout:Sep 10 21:27:57 smithi192 podman[69654]: 2024-09-10 21:27:57.41176906 +0000 UTC m=+0.538199467 container died 621caf4215adf9d98964ab5d9eba060930c4a0dce261f4927153e5bad27d72a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:27:58.032 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.2.service' 2024-09-10T21:27:58.074 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:27:58.074 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-10T21:27:58.074 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-10T21:27:58.074 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.3 2024-09-10T21:27:58.373 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 21:27:58 smithi059 systemd[1]: Stopping Ceph osd.3 for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:27:58.659 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 21:27:58 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-3[53650]: 2024-09-10T21:27:58.370+0000 7f73fc8d6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:27:58.659 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 21:27:58 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-3[53650]: 2024-09-10T21:27:58.370+0000 7f73fc8d6640 -1 osd.3 78 *** Got signal Terminated *** 2024-09-10T21:27:58.659 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 21:27:58 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-3[53650]: 2024-09-10T21:27:58.370+0000 7f73fc8d6640 -1 osd.3 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:28:01.378 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:01 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:01.107+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.325213+0000 front 2024-09-10T21:27:38.325121+0000 (oldest deadline 2024-09-10T21:28:00.625117+0000) 2024-09-10T21:28:02.391 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:02 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:02.195+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:02.391 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:02 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:02.101+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.325213+0000 front 2024-09-10T21:27:38.325121+0000 (oldest deadline 2024-09-10T21:28:00.625117+0000) 2024-09-10T21:28:02.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:02 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:02.410+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:03.576 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:03 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:03.091+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.325213+0000 front 2024-09-10T21:27:38.325121+0000 (oldest deadline 2024-09-10T21:28:00.625117+0000) 2024-09-10T21:28:03.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:03 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:03.190+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:03.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:03 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:03.416+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:03.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:03 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:03.358+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:04.098 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 21:28:03 smithi059 podman[114097]: 2024-09-10 21:28:03.816740114 +0000 UTC m=+5.543182380 container died 9714147b549a73717bd7762ff233e4823e2ca57f8e9ef8e3a08b99e606035b6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-3, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T21:28:04.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:04 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:04.048+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.325213+0000 front 2024-09-10T21:27:38.325121+0000 (oldest deadline 2024-09-10T21:28:00.625117+0000) 2024-09-10T21:28:04.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:04 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:04.147+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:04.386 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 21:28:04 smithi059 podman[114097]: 2024-09-10 21:28:04.270971892 +0000 UTC m=+5.997414149 container cleanup 9714147b549a73717bd7762ff233e4823e2ca57f8e9ef8e3a08b99e606035b6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T21:28:04.386 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 21:28:04 smithi059 bash[114097]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-3 2024-09-10T21:28:04.659 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 21:28:04 smithi059 podman[114114]: 2024-09-10 21:28:04.564006868 +0000 UTC m=+0.747785408 container remove 9714147b549a73717bd7762ff233e4823e2ca57f8e9ef8e3a08b99e606035b6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T21:28:04.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:04 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:04.384+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:04.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:04 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:04.465+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:04.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:04 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:04.580+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:05.159 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 21:28:04 smithi059 podman[114199]: 2024-09-10 21:28:04.815049337 +0000 UTC m=+0.023002912 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:28:05.160 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 21:28:04 smithi059 podman[114199]: 2024-09-10 21:28:04.940062878 +0000 UTC m=+0.148016483 container create 3fd86b678f296b25558b78143a067ea652c4ab33e7548f8788b2a1df128f3199 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T21:28:05.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:05 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:05.009+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.325213+0000 front 2024-09-10T21:27:38.325121+0000 (oldest deadline 2024-09-10T21:28:00.625117+0000) 2024-09-10T21:28:05.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:05 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:05.139+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:05.473 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:05 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:05.347+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:05.473 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 21:28:05 smithi059 podman[114199]: 2024-09-10 21:28:05.200613913 +0000 UTC m=+0.408567475 container init 3fd86b678f296b25558b78143a067ea652c4ab33e7548f8788b2a1df128f3199 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True) 2024-09-10T21:28:05.473 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 21:28:05 smithi059 podman[114199]: 2024-09-10 21:28:05.204191259 +0000 UTC m=+0.412144822 container start 3fd86b678f296b25558b78143a067ea652c4ab33e7548f8788b2a1df128f3199 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-3-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-10T21:28:05.473 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 21:28:05 smithi059 podman[114199]: 2024-09-10 21:28:05.292632909 +0000 UTC m=+0.500586472 container attach 3fd86b678f296b25558b78143a067ea652c4ab33e7548f8788b2a1df128f3199 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-3-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T21:28:05.473 INFO:journalctl@ceph.osd.3.smithi059.stdout:Sep 10 21:28:05 smithi059 podman[114199]: 2024-09-10 21:28:05.403757569 +0000 UTC m=+0.611711154 container died 3fd86b678f296b25558b78143a067ea652c4ab33e7548f8788b2a1df128f3199 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T21:28:05.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:05 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:05.471+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:05.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:05 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:05.572+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:06.133 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.3.service' 2024-09-10T21:28:06.180 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:28:06.180 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-10T21:28:06.180 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-10T21:28:06.180 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.4 2024-09-10T21:28:06.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:06 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:05.999+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.325213+0000 front 2024-09-10T21:27:38.325121+0000 (oldest deadline 2024-09-10T21:28:00.625117+0000) 2024-09-10T21:28:06.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:06 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:06.146+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:06.409 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:06 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:06.323+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:06.485 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 21:28:06 smithi154 systemd[1]: Stopping Ceph osd.4 for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:28:06.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:06 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:06.491+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:06.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:06 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:06.619+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:06.931 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 21:28:06 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-4[46282]: 2024-09-10T21:28:06.482+0000 7f9c985db640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:28:06.931 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 21:28:06 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-4[46282]: 2024-09-10T21:28:06.482+0000 7f9c985db640 -1 osd.4 78 *** Got signal Terminated *** 2024-09-10T21:28:06.931 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 21:28:06 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-4[46282]: 2024-09-10T21:28:06.482+0000 7f9c985db640 -1 osd.4 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:28:07.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:07 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:07.172+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:07.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:07 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:07.043+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.325213+0000 front 2024-09-10T21:27:38.325121+0000 (oldest deadline 2024-09-10T21:28:00.625117+0000) 2024-09-10T21:28:07.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:07.508+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:07.659 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:07 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:07.329+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:07.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:07 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:07.655+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:08.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:08 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:08.021+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.325213+0000 front 2024-09-10T21:27:38.325121+0000 (oldest deadline 2024-09-10T21:28:00.625117+0000) 2024-09-10T21:28:08.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:08 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:08.218+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:08.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:08 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:08.218+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:08.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:08 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:08.504+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:08.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:08 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:08.370+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:08.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:08 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:08.370+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:09.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:08 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:08.695+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:09.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:08 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:08.695+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:09.231 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:08 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:08.974+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.325213+0000 front 2024-09-10T21:27:38.325121+0000 (oldest deadline 2024-09-10T21:28:00.625117+0000) 2024-09-10T21:28:09.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:09 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:09.229+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:09.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:09 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:09.229+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:09.659 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:09 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:09.348+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:09.659 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:09 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:09.348+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:09.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:09 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:09.502+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:09.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:09 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:09.502+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:09.990 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:09 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:09.664+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:10.181 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:09 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:09.682+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:10.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:09 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:09.691+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:10.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:09 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:09.691+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:10.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:09 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:09.988+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.325213+0000 front 2024-09-10T21:27:38.325121+0000 (oldest deadline 2024-09-10T21:28:00.625117+0000) 2024-09-10T21:28:10.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:09 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:09.988+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:44.726178+0000 front 2024-09-10T21:27:44.726052+0000 (oldest deadline 2024-09-10T21:28:09.426120+0000) 2024-09-10T21:28:10.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:10 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:10.217+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:10.327 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:10 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:10.217+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:10.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:10 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:10.517+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:10.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:10 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:10.517+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:10.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:10 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:10.358+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:10.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:10 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:10.358+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:10.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:10 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:10.678+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:10.931 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 21:28:10 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-4[46282]: 2024-09-10T21:28:10.804+0000 7f9c94bf0640 -1 osd.4 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.419287+0000 front 2024-09-10T21:27:45.419260+0000 (oldest deadline 2024-09-10T21:28:10.119363+0000) 2024-09-10T21:28:10.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:10 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:10.655+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:10.932 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:10 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:10.655+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:10.961 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:10 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:10.617+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:11.219 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:10 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:10.959+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.325213+0000 front 2024-09-10T21:27:38.325121+0000 (oldest deadline 2024-09-10T21:28:00.625117+0000) 2024-09-10T21:28:11.220 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:10 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:10.959+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:44.726178+0000 front 2024-09-10T21:27:44.726052+0000 (oldest deadline 2024-09-10T21:28:09.426120+0000) 2024-09-10T21:28:11.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:11 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:11.217+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:11.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:11 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:11.217+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:11.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:11 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:11.476+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:11.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:11 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:11.476+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:11.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:11 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:11.393+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:11.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:11 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:11.393+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:11.903 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:11 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:11.620+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:11.903 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:11 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:11.620+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:11.903 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:11 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:11.660+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:11.967 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:11 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:11.592+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:12.181 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 21:28:11 smithi154 podman[70348]: 2024-09-10 21:28:11.901811567 +0000 UTC m=+5.524972468 container died c0b8270af282724dc03442ee2be8a16b99e58e989d9f0e5e9036ae5d4b671abd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-10T21:28:12.258 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:11 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:11.965+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.325213+0000 front 2024-09-10T21:27:38.325121+0000 (oldest deadline 2024-09-10T21:28:00.625117+0000) 2024-09-10T21:28:12.258 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:11 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:11.965+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:44.726178+0000 front 2024-09-10T21:27:44.726052+0000 (oldest deadline 2024-09-10T21:28:09.426120+0000) 2024-09-10T21:28:12.552 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 21:28:12 smithi154 podman[70348]: 2024-09-10 21:28:12.30860569 +0000 UTC m=+5.931766590 container cleanup c0b8270af282724dc03442ee2be8a16b99e58e989d9f0e5e9036ae5d4b671abd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-4, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T21:28:12.552 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 21:28:12 smithi154 bash[70348]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-4 2024-09-10T21:28:12.561 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:12 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:12.256+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:12.561 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:12 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:12.256+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:12.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:12 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:12.462+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:12.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:12 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:12.462+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:12.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:12 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:12.355+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:12.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:12 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:12.355+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:12.826 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:12 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:12.558+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:12.862 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:12 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:12.706+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:12.862 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 21:28:12 smithi154 podman[70364]: 2024-09-10 21:28:12.551079408 +0000 UTC m=+0.644535300 container remove c0b8270af282724dc03442ee2be8a16b99e58e989d9f0e5e9036ae5d4b671abd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-10T21:28:12.862 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:12 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:12.649+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:12.863 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:12 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:12.649+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:13.181 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 21:28:12 smithi154 podman[70455]: 2024-09-10 21:28:12.763290339 +0000 UTC m=+0.015827487 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:28:13.181 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 21:28:12 smithi154 podman[70455]: 2024-09-10 21:28:12.868414703 +0000 UTC m=+0.120951886 container create 30bf55d7cba7644f5054599b38d5414c73add5d87c1e5f9c263a3c36f535889d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-10T21:28:13.181 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 21:28:13 smithi154 podman[70455]: 2024-09-10 21:28:13.104094266 +0000 UTC m=+0.356631419 container init 30bf55d7cba7644f5054599b38d5414c73add5d87c1e5f9c263a3c36f535889d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-10T21:28:13.181 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 21:28:13 smithi154 podman[70455]: 2024-09-10 21:28:13.107382973 +0000 UTC m=+0.359920111 container start 30bf55d7cba7644f5054599b38d5414c73add5d87c1e5f9c263a3c36f535889d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T21:28:13.295 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:12 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:12.967+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.325213+0000 front 2024-09-10T21:27:38.325121+0000 (oldest deadline 2024-09-10T21:28:00.625117+0000) 2024-09-10T21:28:13.295 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:12 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:12.967+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:44.726178+0000 front 2024-09-10T21:27:44.726052+0000 (oldest deadline 2024-09-10T21:28:09.426120+0000) 2024-09-10T21:28:13.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:13 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:13.293+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:13.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:13 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:13.293+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:13.609 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 21:28:13 smithi154 podman[70455]: 2024-09-10 21:28:13.187276844 +0000 UTC m=+0.439813993 container attach 30bf55d7cba7644f5054599b38d5414c73add5d87c1e5f9c263a3c36f535889d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:28:13.609 INFO:journalctl@ceph.osd.4.smithi154.stdout:Sep 10 21:28:13 smithi154 podman[70455]: 2024-09-10 21:28:13.295852908 +0000 UTC m=+0.548390045 container died 30bf55d7cba7644f5054599b38d5414c73add5d87c1e5f9c263a3c36f535889d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-10T21:28:13.659 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:13 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:13.335+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:13.659 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:13 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:13.335+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:13.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:13 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:13.482+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:13.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:13 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:13.482+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:13.901 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:13 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:13.619+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:13.901 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:13 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:13.619+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:13.901 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:13 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:13.669+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:13.928 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.4.service' 2024-09-10T21:28:13.968 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:28:13.968 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-10T21:28:13.968 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-10T21:28:13.968 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.5 2024-09-10T21:28:13.995 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:13 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:13.591+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:14.262 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:14 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:14.010+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.325213+0000 front 2024-09-10T21:27:38.325121+0000 (oldest deadline 2024-09-10T21:28:00.625117+0000) 2024-09-10T21:28:14.262 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:14 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:14.010+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:44.726178+0000 front 2024-09-10T21:27:44.726052+0000 (oldest deadline 2024-09-10T21:28:09.426120+0000) 2024-09-10T21:28:14.262 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:14 smithi192 systemd[1]: Stopping Ceph osd.5 for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:28:14.262 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:14 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:14.259+0000 7fa52d17d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:28:14.262 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:14 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:14.259+0000 7fa52d17d640 -1 osd.5 78 *** Got signal Terminated *** 2024-09-10T21:28:14.262 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:14 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:14.259+0000 7fa52d17d640 -1 osd.5 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:28:14.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:14 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:14.271+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:14.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:14 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:14.271+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:14.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:14 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:14.453+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:14.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:14 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:14.453+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:14.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:14 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:14.347+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:14.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:14 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:14.347+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:14.930 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:14 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:14.619+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:14.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:14 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:14.619+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:14.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:14 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:14.658+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:14.995 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:14 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:14.639+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:15.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:14 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:14.993+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.325213+0000 front 2024-09-10T21:27:38.325121+0000 (oldest deadline 2024-09-10T21:28:00.625117+0000) 2024-09-10T21:28:15.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:14 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:14.993+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:44.726178+0000 front 2024-09-10T21:27:44.726052+0000 (oldest deadline 2024-09-10T21:28:09.426120+0000) 2024-09-10T21:28:15.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:15 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:15.241+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:15.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:15 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:15.241+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:15.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:15 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:15.438+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:15.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:15 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:15.438+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:15.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:15 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:15.393+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:15.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:15 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:15.393+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:15.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:15 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:15.706+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:15.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:15 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:15.656+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:15.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:15 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:15.656+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:16.005 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:15 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:15.619+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:16.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:16 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:16.003+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.325213+0000 front 2024-09-10T21:27:38.325121+0000 (oldest deadline 2024-09-10T21:28:00.625117+0000) 2024-09-10T21:28:16.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:16 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:16.003+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:44.726178+0000 front 2024-09-10T21:27:44.726052+0000 (oldest deadline 2024-09-10T21:28:09.426120+0000) 2024-09-10T21:28:16.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:16 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:16.223+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:16.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:16 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:16.223+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:16.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:16 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:16.488+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:16.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:16 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:16.488+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:16.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:16 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:16.359+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:16.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:16 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:16.359+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:16.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:16 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:16.734+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:16.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:16 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:16.621+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:16.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:16 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:16.621+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:16.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:16 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:16.621+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:17.031 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:16 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:16.618+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:17.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:17 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:17.256+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:17.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:17 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:17.256+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:17.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:17 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:17.029+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.325213+0000 front 2024-09-10T21:27:38.325121+0000 (oldest deadline 2024-09-10T21:28:00.625117+0000) 2024-09-10T21:28:17.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:17 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:17.029+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:44.726178+0000 front 2024-09-10T21:27:44.726052+0000 (oldest deadline 2024-09-10T21:28:09.426120+0000) 2024-09-10T21:28:17.659 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:17 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:17.326+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:17.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:17 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:17.326+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:17.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:17 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:17.326+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.998715+0000 front 2024-09-10T21:27:54.998796+0000 (oldest deadline 2024-09-10T21:28:16.698582+0000) 2024-09-10T21:28:17.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:17 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:17.509+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:17.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:17 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:17.509+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:17.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:17 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:17.706+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:17.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:17 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:17.706+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:55.093971+0000 front 2024-09-10T21:27:55.093992+0000 (oldest deadline 2024-09-10T21:28:17.394088+0000) 2024-09-10T21:28:17.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:17 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:17.670+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:17.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:17 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:17.670+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:17.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:17 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:17.670+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:18.049 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:17 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:17.588+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:18.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:18 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:18.208+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:18.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:18 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:18.208+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:18.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:18 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:18.047+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.325213+0000 front 2024-09-10T21:27:38.325121+0000 (oldest deadline 2024-09-10T21:28:00.625117+0000) 2024-09-10T21:28:18.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:18 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:18.047+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:44.726178+0000 front 2024-09-10T21:27:44.726052+0000 (oldest deadline 2024-09-10T21:28:09.426120+0000) 2024-09-10T21:28:18.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:18 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:18.535+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:18.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:18 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:18.535+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:18.661 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:18 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:18.321+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:18.661 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:18 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:18.321+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:18.661 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:18 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:18.321+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.998715+0000 front 2024-09-10T21:27:54.998796+0000 (oldest deadline 2024-09-10T21:28:16.698582+0000) 2024-09-10T21:28:19.021 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:18 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:18.614+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:19.021 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:18 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:18.614+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:19.181 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:18 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:18.697+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:19.181 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:18 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:18.697+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:55.093971+0000 front 2024-09-10T21:27:55.093992+0000 (oldest deadline 2024-09-10T21:28:17.394088+0000) 2024-09-10T21:28:19.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:18 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:18.692+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:19.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:18 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:18.692+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:19.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:18 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:18.692+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:19.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:19 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:19.019+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.325213+0000 front 2024-09-10T21:27:38.325121+0000 (oldest deadline 2024-09-10T21:28:00.625117+0000) 2024-09-10T21:28:19.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:19 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5[46812]: 2024-09-10T21:28:19.019+0000 7fa529792640 -1 osd.5 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:44.726178+0000 front 2024-09-10T21:27:44.726052+0000 (oldest deadline 2024-09-10T21:28:09.426120+0000) 2024-09-10T21:28:19.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:19 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:19.198+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:19.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:19 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:19.198+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:19.327 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:19 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:19.198+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:19.659 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:19 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:19.329+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:19.659 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:19 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:19.329+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:19.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:19 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:19.329+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.998715+0000 front 2024-09-10T21:27:54.998796+0000 (oldest deadline 2024-09-10T21:28:16.698582+0000) 2024-09-10T21:28:19.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:19 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:19.528+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:19.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:19 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:19.528+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:19.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:19 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:19.528+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:19.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:19 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:19.707+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:19.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:19 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:19.707+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:19.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:19 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:19.707+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:19.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:19 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:19.655+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:19.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:19 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:19.655+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:55.093971+0000 front 2024-09-10T21:27:55.093992+0000 (oldest deadline 2024-09-10T21:28:17.394088+0000) 2024-09-10T21:28:20.028 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:19 smithi192 podman[69769]: 2024-09-10 21:28:19.777845072 +0000 UTC m=+5.618744645 container died 772273d8208d209cc2f90f3cb5f8ca2745dc30de93d87c997aaaa11e4dafffcd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True) 2024-09-10T21:28:20.029 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:19 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:19.655+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:20.029 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:19 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:19.655+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:20.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:20 smithi192 podman[69769]: 2024-09-10 21:28:20.134912047 +0000 UTC m=+5.975811609 container cleanup 772273d8208d209cc2f90f3cb5f8ca2745dc30de93d87c997aaaa11e4dafffcd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T21:28:20.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:20 smithi192 bash[69769]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5 2024-09-10T21:28:20.327 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:20 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:20.167+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:20.327 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:20 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:20.167+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:20.327 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:20 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:20.167+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:20.624 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:20 smithi192 podman[69784]: 2024-09-10 21:28:20.327755319 +0000 UTC m=+0.550298363 container remove 772273d8208d209cc2f90f3cb5f8ca2745dc30de93d87c997aaaa11e4dafffcd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:28:20.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:20 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:20.488+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:20.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:20 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:20.488+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:20.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:20 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:20.488+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:20.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:20 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:20.316+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:20.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:20 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:20.316+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:20.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:20 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:20.316+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.998715+0000 front 2024-09-10T21:27:54.998796+0000 (oldest deadline 2024-09-10T21:28:16.698582+0000) 2024-09-10T21:28:20.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:20 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:20.610+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:20.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:20 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:20.610+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:55.093971+0000 front 2024-09-10T21:27:55.093992+0000 (oldest deadline 2024-09-10T21:28:17.394088+0000) 2024-09-10T21:28:20.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:20 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:20.698+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:20.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:20 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:20.698+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:20.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:20 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:20.698+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:20.949 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:20 smithi192 podman[69876]: 2024-09-10 21:28:20.745564573 +0000 UTC m=+0.111126790 container create b91c780d4575ac702cd80848d43a154e8da00ea67351078ad4923fc47106bd56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-10T21:28:20.950 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:20 smithi192 podman[69876]: 2024-09-10 21:28:20.650224291 +0000 UTC m=+0.015786510 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:28:20.950 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:20 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:20.621+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:20.950 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:20 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:20.621+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:21.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:21 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:21.149+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:21.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:21 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:21.150+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:21.326 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:21 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:21.150+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:21.326 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:20 smithi192 podman[69876]: 2024-09-10 21:28:20.948189261 +0000 UTC m=+0.313751479 container init b91c780d4575ac702cd80848d43a154e8da00ea67351078ad4923fc47106bd56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-10T21:28:21.327 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:20 smithi192 podman[69876]: 2024-09-10 21:28:20.951611008 +0000 UTC m=+0.317173227 container start b91c780d4575ac702cd80848d43a154e8da00ea67351078ad4923fc47106bd56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731) 2024-09-10T21:28:21.327 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:21 smithi192 podman[69876]: 2024-09-10 21:28:21.047937717 +0000 UTC m=+0.413499937 container attach b91c780d4575ac702cd80848d43a154e8da00ea67351078ad4923fc47106bd56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-09-10T21:28:21.327 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 10 21:28:21 smithi192 podman[69876]: 2024-09-10 21:28:21.139575463 +0000 UTC m=+0.505137682 container died b91c780d4575ac702cd80848d43a154e8da00ea67351078ad4923fc47106bd56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T21:28:21.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:21 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:21.465+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:21.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:21 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:21.465+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:21.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:21 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:21.465+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:21.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:21 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:21.291+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:21.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:21 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:21.291+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:21.660 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:21 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:21.291+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.998715+0000 front 2024-09-10T21:27:54.998796+0000 (oldest deadline 2024-09-10T21:28:16.698582+0000) 2024-09-10T21:28:21.678 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:21 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:21.580+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:21.678 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:21 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:21.580+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:21.704 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.5.service' 2024-09-10T21:28:21.785 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:28:21.785 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-10T21:28:21.785 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-10T21:28:21.785 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.6 2024-09-10T21:28:21.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:21 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:21.596+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:21.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:21 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:21.596+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:55.093971+0000 front 2024-09-10T21:27:55.093992+0000 (oldest deadline 2024-09-10T21:28:17.394088+0000) 2024-09-10T21:28:21.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:21 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:21.698+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:21.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:21 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:21.698+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:21.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:21 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:21.698+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:22.159 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:21 smithi059 systemd[1]: Stopping Ceph osd.6 for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:28:22.507 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:22 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:22.240+0000 7f6d90a83640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:28:22.507 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:22 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:22.240+0000 7f6d90a83640 -1 osd.6 78 *** Got signal Terminated *** 2024-09-10T21:28:22.508 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:22 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:22.240+0000 7f6d90a83640 -1 osd.6 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:28:22.508 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:22 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:22.245+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:22.508 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:22 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:22.245+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:22.508 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:22 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:22.245+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.998715+0000 front 2024-09-10T21:27:54.998796+0000 (oldest deadline 2024-09-10T21:28:16.698582+0000) 2024-09-10T21:28:22.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:22 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:22.184+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:22.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:22 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:22.184+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:22.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:22 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:22.184+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:22.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:22 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:22.505+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:22.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:22 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:22.505+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:22.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:22 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:22.505+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:22.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:22 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:22.592+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:22.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:22 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:22.592+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:55.093971+0000 front 2024-09-10T21:27:55.093992+0000 (oldest deadline 2024-09-10T21:28:17.394088+0000) 2024-09-10T21:28:22.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:22 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:22.714+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:22.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:22 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:22.714+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:22.932 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:22 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:22.714+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:23.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:22 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:22.599+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:23.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:22 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:22.599+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:23.543 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:23 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:23.229+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:23.543 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:23 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:23.229+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:23.543 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:23 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:23.229+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.998715+0000 front 2024-09-10T21:27:54.998796+0000 (oldest deadline 2024-09-10T21:28:16.698582+0000) 2024-09-10T21:28:23.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:23 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:23.218+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:23.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:23 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:23.218+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:23.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:23 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:23.218+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:23.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:23 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:23.541+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:23.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:23 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:23.541+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:23.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:23 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:23.541+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:23.930 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:23 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:23.610+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:23.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:23 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:23.610+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:55.093971+0000 front 2024-09-10T21:27:55.093992+0000 (oldest deadline 2024-09-10T21:28:17.394088+0000) 2024-09-10T21:28:23.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:23 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:23.753+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:23.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:23 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:23.753+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:23.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:23 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:23.753+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:24.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:23 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:23.588+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:24.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:23 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:23.588+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:24.496 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:24 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:24.182+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:24.496 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:24 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:24.182+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:24.496 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:24 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:24.182+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.998715+0000 front 2024-09-10T21:27:54.998796+0000 (oldest deadline 2024-09-10T21:28:16.698582+0000) 2024-09-10T21:28:24.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:24 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:24.204+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:24.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:24 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:24.204+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:24.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:24 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:24.204+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:24.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:24 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:24.204+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:24.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:24 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:24.494+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:24.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:24 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:24.494+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:24.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:24 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:24.494+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:24.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:24 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:24.619+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:24.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:24 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:24.619+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:55.093971+0000 front 2024-09-10T21:27:55.093992+0000 (oldest deadline 2024-09-10T21:28:17.394088+0000) 2024-09-10T21:28:24.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:24 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:24.719+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:24.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:24 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:24.719+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:24.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:24 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:24.719+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:25.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:24 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:24.592+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:25.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:24 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:24.592+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:25.485 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:25 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:25.186+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:25.485 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:25 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:25.186+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:25.485 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:25 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:25.186+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.998715+0000 front 2024-09-10T21:27:54.998796+0000 (oldest deadline 2024-09-10T21:28:16.698582+0000) 2024-09-10T21:28:25.485 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:25 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:25.186+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:01.399632+0000 front 2024-09-10T21:28:01.399880+0000 (oldest deadline 2024-09-10T21:28:24.899712+0000) 2024-09-10T21:28:25.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:25 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:25.176+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:25.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:25 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:25.176+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:25.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:25 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:25.176+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:25.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:25 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:25.176+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:25.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:25 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:25.482+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:25.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:25 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:25.482+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:25.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:25 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:25.482+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:25.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:25 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:25.482+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:25.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:25 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:25.596+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:25.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:25 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:25.596+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:55.093971+0000 front 2024-09-10T21:27:55.093992+0000 (oldest deadline 2024-09-10T21:28:17.394088+0000) 2024-09-10T21:28:25.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:25 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:25.769+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:25.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:25 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:25.769+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:25.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:25 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:25.769+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:25.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:25 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:25.769+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:26.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:25 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:25.580+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:26.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:25 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:25.580+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:26.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:25 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:25.580+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:02.320191+0000 front 2024-09-10T21:28:02.320309+0000 (oldest deadline 2024-09-10T21:28:24.620096+0000) 2024-09-10T21:28:26.534 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:26 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:26.224+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:26.534 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:26 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:26.224+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:26.534 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:26 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:26.224+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.998715+0000 front 2024-09-10T21:27:54.998796+0000 (oldest deadline 2024-09-10T21:28:16.698582+0000) 2024-09-10T21:28:26.534 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:26 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:26.224+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:01.399632+0000 front 2024-09-10T21:28:01.399880+0000 (oldest deadline 2024-09-10T21:28:24.899712+0000) 2024-09-10T21:28:26.541 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:26 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:26.210+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:26.542 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:26 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:26.210+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:26.542 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:26 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:26.210+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:26.542 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:26 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:26.210+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:26.826 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:26 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:26.540+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:26.826 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:26 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:26.540+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:26.826 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:26 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:26.540+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:02.320191+0000 front 2024-09-10T21:28:02.320309+0000 (oldest deadline 2024-09-10T21:28:24.620096+0000) 2024-09-10T21:28:26.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:26 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:26.531+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:26.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:26 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:26.531+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:26.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:26 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:26.531+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:26.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:26 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:26.531+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:26.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:26 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:26.640+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:26.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:26 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:26.640+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:55.093971+0000 front 2024-09-10T21:27:55.093992+0000 (oldest deadline 2024-09-10T21:28:17.394088+0000) 2024-09-10T21:28:26.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:26 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:26.640+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:58.495239+0000 front 2024-09-10T21:27:58.495178+0000 (oldest deadline 2024-09-10T21:28:26.095531+0000) 2024-09-10T21:28:26.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:26 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:26.766+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:26.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:26 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:26.766+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:26.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:26 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:26.766+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:26.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:26 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:26.766+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:27.492 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:27 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:27.223+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:39.395415+0000 front 2024-09-10T21:27:39.395474+0000 (oldest deadline 2024-09-10T21:28:02.895624+0000) 2024-09-10T21:28:27.492 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:27 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:27.223+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:42.896483+0000 front 2024-09-10T21:27:42.896397+0000 (oldest deadline 2024-09-10T21:28:08.196146+0000) 2024-09-10T21:28:27.492 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:27 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:27.223+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.998715+0000 front 2024-09-10T21:27:54.998796+0000 (oldest deadline 2024-09-10T21:28:16.698582+0000) 2024-09-10T21:28:27.492 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:27 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6[60133]: 2024-09-10T21:28:27.223+0000 7f6d89090640 -1 osd.6 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:01.399632+0000 front 2024-09-10T21:28:01.399880+0000 (oldest deadline 2024-09-10T21:28:24.899712+0000) 2024-09-10T21:28:27.560 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:27 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:27.218+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:27.560 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:27 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:27.218+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:27.560 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:27 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:27.218+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:27.560 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:27 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:27.218+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:27.826 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:27 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:27.558+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:27.826 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:27 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:27.558+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:27.826 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:27 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:27.558+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:02.320191+0000 front 2024-09-10T21:28:02.320309+0000 (oldest deadline 2024-09-10T21:28:24.620096+0000) 2024-09-10T21:28:27.909 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:27 smithi059 podman[114301]: 2024-09-10 21:28:27.635707338 +0000 UTC m=+5.645223572 container died 260974bda5ad3db41ad1eaf7cef18bafc7bbe3563523f358dcf112e3908860cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-10T21:28:27.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:27 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:27.489+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:27.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:27 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:27.489+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:27.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:27 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:27.489+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:27.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:27 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:27.489+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:27.930 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:27 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:27.622+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:27.930 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:27 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:27.622+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:55.093971+0000 front 2024-09-10T21:27:55.093992+0000 (oldest deadline 2024-09-10T21:28:17.394088+0000) 2024-09-10T21:28:27.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:27 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:27.622+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:58.495239+0000 front 2024-09-10T21:27:58.495178+0000 (oldest deadline 2024-09-10T21:28:26.095531+0000) 2024-09-10T21:28:27.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:27 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:27.808+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:27.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:27 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:27.808+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:27.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:27 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:27.808+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:27.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:27 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:27.808+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:28.393 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:28 smithi059 podman[114301]: 2024-09-10 21:28:28.09893995 +0000 UTC m=+6.108456237 container cleanup 260974bda5ad3db41ad1eaf7cef18bafc7bbe3563523f358dcf112e3908860cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T21:28:28.393 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:28 smithi059 bash[114301]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6 2024-09-10T21:28:28.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:28 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:28.256+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:28.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:28 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:28.256+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:28.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:28 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:28.256+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:28.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:28 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:28.256+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:28.659 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:28 smithi059 podman[114319]: 2024-09-10 21:28:28.391927685 +0000 UTC m=+0.747227800 container remove 260974bda5ad3db41ad1eaf7cef18bafc7bbe3563523f358dcf112e3908860cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T21:28:28.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:28 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:28.527+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:28.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:28 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:28.527+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:28.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:28 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:28.527+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:28.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:28 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:28.527+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:28.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:28 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:28.592+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:28.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:28 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:28.592+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:55.093971+0000 front 2024-09-10T21:27:55.093992+0000 (oldest deadline 2024-09-10T21:28:17.394088+0000) 2024-09-10T21:28:28.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:28 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:28.592+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:58.495239+0000 front 2024-09-10T21:27:58.495178+0000 (oldest deadline 2024-09-10T21:28:26.095531+0000) 2024-09-10T21:28:28.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:28 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:28.795+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:28.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:28 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:28.795+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:28.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:28 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:28.795+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:28.932 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:28 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:28.795+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:29.005 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:28 smithi059 podman[114402]: 2024-09-10 21:28:28.627837222 +0000 UTC m=+0.016622180 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:28:29.005 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:28 smithi059 podman[114402]: 2024-09-10 21:28:28.750899231 +0000 UTC m=+0.139684188 container create a0e0ba5da2398c088755cf6bdcbc19eb720c481fda73e139c8d915c9958d60cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-10T21:28:29.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:28 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:28.587+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:29.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:28 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:28.587+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:29.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:28 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:28.587+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:02.320191+0000 front 2024-09-10T21:28:02.320309+0000 (oldest deadline 2024-09-10T21:28:24.620096+0000) 2024-09-10T21:28:29.410 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:29 smithi059 podman[114402]: 2024-09-10 21:28:29.003450495 +0000 UTC m=+0.392235456 container init a0e0ba5da2398c088755cf6bdcbc19eb720c481fda73e139c8d915c9958d60cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:28:29.410 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:29 smithi059 podman[114402]: 2024-09-10 21:28:29.007791474 +0000 UTC m=+0.396576434 container start a0e0ba5da2398c088755cf6bdcbc19eb720c481fda73e139c8d915c9958d60cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T21:28:29.410 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:29 smithi059 podman[114402]: 2024-09-10 21:28:29.086663404 +0000 UTC m=+0.475448385 container attach a0e0ba5da2398c088755cf6bdcbc19eb720c481fda73e139c8d915c9958d60cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T21:28:29.410 INFO:journalctl@ceph.osd.6.smithi059.stdout:Sep 10 21:28:29 smithi059 podman[114402]: 2024-09-10 21:28:29.20381685 +0000 UTC m=+0.592601806 container died a0e0ba5da2398c088755cf6bdcbc19eb720c481fda73e139c8d915c9958d60cd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T21:28:29.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:29 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:29.225+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:29.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:29 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:29.225+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:29.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:29 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:29.225+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:29.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:29 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:29.225+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:29.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:29 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:29.558+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:29.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:29 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:29.558+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:29.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:29 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:29.558+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:29.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:29 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:29.558+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:29.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:29 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:29.842+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:29.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:29 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:29.842+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:29.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:29 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:29.842+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:29.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:29 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:29.842+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:29.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:29 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:29.635+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:29.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:29 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:29.635+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:55.093971+0000 front 2024-09-10T21:27:55.093992+0000 (oldest deadline 2024-09-10T21:28:17.394088+0000) 2024-09-10T21:28:29.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:29 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:29.635+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:58.495239+0000 front 2024-09-10T21:27:58.495178+0000 (oldest deadline 2024-09-10T21:28:26.095531+0000) 2024-09-10T21:28:29.939 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.6.service' 2024-09-10T21:28:29.982 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:28:29.983 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-10T21:28:29.983 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-10T21:28:29.983 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.7 2024-09-10T21:28:30.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:29 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:29.609+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:30.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:29 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:29.609+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:30.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:29 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:29.609+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:02.320191+0000 front 2024-09-10T21:28:02.320309+0000 (oldest deadline 2024-09-10T21:28:24.620096+0000) 2024-09-10T21:28:30.311 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:30 smithi154 systemd[1]: Stopping Ceph osd.7 for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:28:30.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:30 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:30.219+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:30.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:30 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:30.219+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:30.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:30 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:30.219+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:30.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:30 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:30.219+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:30.654 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:30 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:30.309+0000 7f4f7f882640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:28:30.654 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:30 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:30.309+0000 7f4f7f882640 -1 osd.7 78 *** Got signal Terminated *** 2024-09-10T21:28:30.654 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:30 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:30.309+0000 7f4f7f882640 -1 osd.7 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:28:30.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:30 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:30.575+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:30.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:30 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:30.575+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:30.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:30 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:30.575+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:30.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:30 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:30.575+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:30.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:30 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:30.820+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:30.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:30 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:30.820+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:30.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:30 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:30.820+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:30.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:30 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:30.820+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:30.932 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:30 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:30.652+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:30.932 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:30 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:30.652+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:55.093971+0000 front 2024-09-10T21:27:55.093992+0000 (oldest deadline 2024-09-10T21:28:17.394088+0000) 2024-09-10T21:28:30.932 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:30 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:30.652+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:58.495239+0000 front 2024-09-10T21:27:58.495178+0000 (oldest deadline 2024-09-10T21:28:26.095531+0000) 2024-09-10T21:28:31.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:30 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:30.611+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:31.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:30 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:30.611+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:31.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:30 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:30.611+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:02.320191+0000 front 2024-09-10T21:28:02.320309+0000 (oldest deadline 2024-09-10T21:28:24.620096+0000) 2024-09-10T21:28:31.354 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:31 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:31.207+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:31.354 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:31 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:31.207+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:31.354 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:31 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:31.207+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:31.354 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:31 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:31.207+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:31.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:31 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:31.530+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:31.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:31 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:31.530+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:31.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:31 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:31.530+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:31.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:31 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:31.530+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:31.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:31 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:31.636+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:31.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:31 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:31.636+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:55.093971+0000 front 2024-09-10T21:27:55.093992+0000 (oldest deadline 2024-09-10T21:28:17.394088+0000) 2024-09-10T21:28:31.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:31 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:31.636+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:58.495239+0000 front 2024-09-10T21:27:58.495178+0000 (oldest deadline 2024-09-10T21:28:26.095531+0000) 2024-09-10T21:28:31.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:31 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:31.822+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:31.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:31 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:31.822+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:31.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:31 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:31.822+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:31.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:31 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:31.822+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:32.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:31 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:31.653+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:32.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:31 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:31.653+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:32.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:31 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:31.653+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:02.320191+0000 front 2024-09-10T21:28:02.320309+0000 (oldest deadline 2024-09-10T21:28:24.620096+0000) 2024-09-10T21:28:32.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:32 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:32.238+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:32.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:32 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:32.238+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:32.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:32 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:32.238+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:32.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:32 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:32.238+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:32.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:32 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:32.481+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:32.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:32 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:32.481+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:32.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:32 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:32.481+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:32.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:32 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:32.481+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:33.076 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:32 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:32.678+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:33.076 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:32 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:32.678+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:55.093971+0000 front 2024-09-10T21:27:55.093992+0000 (oldest deadline 2024-09-10T21:28:17.394088+0000) 2024-09-10T21:28:33.076 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:32 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:32.678+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:58.495239+0000 front 2024-09-10T21:27:58.495178+0000 (oldest deadline 2024-09-10T21:28:26.095531+0000) 2024-09-10T21:28:33.077 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:32 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:32.609+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:33.077 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:32 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:32.609+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:33.077 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:32 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:32.609+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:02.320191+0000 front 2024-09-10T21:28:02.320309+0000 (oldest deadline 2024-09-10T21:28:24.620096+0000) 2024-09-10T21:28:33.077 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:32 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:32.609+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.121288+0000 front 2024-09-10T21:28:08.121275+0000 (oldest deadline 2024-09-10T21:28:32.221148+0000) 2024-09-10T21:28:33.077 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:32 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:32.827+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:33.077 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:32 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:32.827+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:33.077 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:32 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:32.827+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:33.077 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:32 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:32.827+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:33.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:33 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:33.259+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:33.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:33 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:33.259+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:33.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:33 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:33.259+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:33.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:33 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:33.259+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:33.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:33 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:33.259+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:33.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:33 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:33.454+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:33.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:33 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:33.454+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:33.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:33 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:33.454+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:33.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:33 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:33.454+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:33.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:33 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:33.651+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:33.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:33 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:33.651+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:55.093971+0000 front 2024-09-10T21:27:55.093992+0000 (oldest deadline 2024-09-10T21:28:17.394088+0000) 2024-09-10T21:28:33.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:33 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:33.651+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:58.495239+0000 front 2024-09-10T21:27:58.495178+0000 (oldest deadline 2024-09-10T21:28:26.095531+0000) 2024-09-10T21:28:33.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:33 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:33.651+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.996191+0000 front 2024-09-10T21:28:08.996207+0000 (oldest deadline 2024-09-10T21:28:33.096348+0000) 2024-09-10T21:28:33.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:33 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:33.869+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:33.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:33 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:33.869+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:33.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:33 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:33.869+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:33.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:33 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:33.869+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:34.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:33 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:33.621+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:34.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:33 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:33.621+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:34.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:33 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:33.621+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:02.320191+0000 front 2024-09-10T21:28:02.320309+0000 (oldest deadline 2024-09-10T21:28:24.620096+0000) 2024-09-10T21:28:34.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:33 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:33.621+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.121288+0000 front 2024-09-10T21:28:08.121275+0000 (oldest deadline 2024-09-10T21:28:32.221148+0000) 2024-09-10T21:28:34.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:34 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:34.263+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:34.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:34 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:34.263+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:34.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:34 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:34.263+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:34.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:34 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:34.263+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:34.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:34 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:34.263+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:34.811 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:34 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:34.411+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:34.811 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:34 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:34.411+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:34.811 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:34 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:34.411+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:34.811 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:34 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:34.411+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:34.811 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:34 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:34.411+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.308634+0000 front 2024-09-10T21:28:11.308843+0000 (oldest deadline 2024-09-10T21:28:34.208621+0000) 2024-09-10T21:28:35.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:34 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:34.638+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:35.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:34 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:34.638+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:35.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:34 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:34.638+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:02.320191+0000 front 2024-09-10T21:28:02.320309+0000 (oldest deadline 2024-09-10T21:28:24.620096+0000) 2024-09-10T21:28:35.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:34 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:34.638+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.121288+0000 front 2024-09-10T21:28:08.121275+0000 (oldest deadline 2024-09-10T21:28:32.221148+0000) 2024-09-10T21:28:35.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:34 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:34.837+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:35.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:34 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:34.837+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:35.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:34 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:34.837+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:35.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:34 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:34.837+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:35.181 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:34 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:34.688+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:43.892756+0000 front 2024-09-10T21:27:43.892692+0000 (oldest deadline 2024-09-10T21:28:09.192801+0000) 2024-09-10T21:28:35.181 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:34 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:34.688+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:55.093971+0000 front 2024-09-10T21:27:55.093992+0000 (oldest deadline 2024-09-10T21:28:17.394088+0000) 2024-09-10T21:28:35.181 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:34 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:34.688+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:58.495239+0000 front 2024-09-10T21:27:58.495178+0000 (oldest deadline 2024-09-10T21:28:26.095531+0000) 2024-09-10T21:28:35.181 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:34 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7[53055]: 2024-09-10T21:28:34.688+0000 7f4f7be97640 -1 osd.7 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.996191+0000 front 2024-09-10T21:28:08.996207+0000 (oldest deadline 2024-09-10T21:28:33.096348+0000) 2024-09-10T21:28:35.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:35 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:35.300+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:35.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:35 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:35.300+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:35.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:35 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:35.300+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:35.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:35 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:35.300+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:35.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:35 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:35.300+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:35.824 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:35 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:35.447+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:35.824 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:35 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:35.447+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:35.824 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:35 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:35.447+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:35.824 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:35 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:35.447+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:35.824 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:35 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:35.447+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.308634+0000 front 2024-09-10T21:28:11.308843+0000 (oldest deadline 2024-09-10T21:28:34.208621+0000) 2024-09-10T21:28:35.970 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:35 smithi154 podman[70558]: 2024-09-10 21:28:35.702381722 +0000 UTC m=+5.524842654 container died 62a10b15d775df8aa77c190ebd6ec8f7495e56fc7d07702076e7540266834291 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:28:35.970 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:35 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:35.860+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:35.970 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:35 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:35.860+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:35.970 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:35 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:35.860+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:35.970 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:35 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:35.860+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:36.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:35 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:35.683+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:36.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:35 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:35.683+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:36.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:35 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:35.683+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:02.320191+0000 front 2024-09-10T21:28:02.320309+0000 (oldest deadline 2024-09-10T21:28:24.620096+0000) 2024-09-10T21:28:36.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:35 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:35.683+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.121288+0000 front 2024-09-10T21:28:08.121275+0000 (oldest deadline 2024-09-10T21:28:32.221148+0000) 2024-09-10T21:28:36.303 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:36 smithi154 podman[70558]: 2024-09-10 21:28:36.067583034 +0000 UTC m=+5.890043964 container cleanup 62a10b15d775df8aa77c190ebd6ec8f7495e56fc7d07702076e7540266834291 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T21:28:36.303 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:36 smithi154 bash[70558]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7 2024-09-10T21:28:36.644 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:36 smithi154 podman[70584]: 2024-09-10 21:28:36.3019992 +0000 UTC m=+0.599036370 container remove 62a10b15d775df8aa77c190ebd6ec8f7495e56fc7d07702076e7540266834291 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T21:28:36.673 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:36 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:36.346+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:36.673 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:36 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:36.346+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:36.673 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:36 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:36.346+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:36.673 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:36 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:36.346+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:36.673 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:36 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:36.346+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:36.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:36 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:36.495+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:36.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:36 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:36.495+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:36.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:36 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:36.495+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:36.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:36 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:36.495+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:36.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:36 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:36.495+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.308634+0000 front 2024-09-10T21:28:11.308843+0000 (oldest deadline 2024-09-10T21:28:34.208621+0000) 2024-09-10T21:28:36.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:36 smithi154 podman[70675]: 2024-09-10 21:28:36.545292127 +0000 UTC m=+0.016201131 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:28:36.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:36 smithi154 podman[70675]: 2024-09-10 21:28:36.653033496 +0000 UTC m=+0.123942506 container create 790d937545aade667cdc104e3289dca9b48fc8f24b7c21033c45786bbf169185 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-10T21:28:36.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:36 smithi154 podman[70675]: 2024-09-10 21:28:36.855604211 +0000 UTC m=+0.326513215 container init 790d937545aade667cdc104e3289dca9b48fc8f24b7c21033c45786bbf169185 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-10T21:28:36.931 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:36 smithi154 podman[70675]: 2024-09-10 21:28:36.858753267 +0000 UTC m=+0.329662271 container start 790d937545aade667cdc104e3289dca9b48fc8f24b7c21033c45786bbf169185 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:28:36.932 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:36 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:36.820+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:36.932 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:36 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:36.820+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:36.932 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:36 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:36.820+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:36.932 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:36 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:36.820+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:36.932 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:36 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:36.820+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:37.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:36 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:36.671+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:37.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:36 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:36.671+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:37.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:36 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:36.671+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:02.320191+0000 front 2024-09-10T21:28:02.320309+0000 (oldest deadline 2024-09-10T21:28:24.620096+0000) 2024-09-10T21:28:37.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:36 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:36.671+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.121288+0000 front 2024-09-10T21:28:08.121275+0000 (oldest deadline 2024-09-10T21:28:32.221148+0000) 2024-09-10T21:28:37.335 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:36 smithi154 podman[70675]: 2024-09-10 21:28:36.938638028 +0000 UTC m=+0.409547043 container attach 790d937545aade667cdc104e3289dca9b48fc8f24b7c21033c45786bbf169185 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True) 2024-09-10T21:28:37.335 INFO:journalctl@ceph.osd.7.smithi154.stdout:Sep 10 21:28:37 smithi154 podman[70675]: 2024-09-10 21:28:37.045417785 +0000 UTC m=+0.516326790 container died 790d937545aade667cdc104e3289dca9b48fc8f24b7c21033c45786bbf169185 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-10T21:28:37.599 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.7.service' 2024-09-10T21:28:37.639 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:28:37.639 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-10T21:28:37.639 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-10T21:28:37.639 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.8 2024-09-10T21:28:37.668 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:37 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:37.332+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:37.668 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:37 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:37.332+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:37.669 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:37 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:37.332+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:37.669 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:37 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:37.332+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:37.669 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:37 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:37.332+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:37.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:37 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:37.466+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:37.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:37 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:37.466+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:37.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:37 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:37.466+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:37.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:37 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:37.466+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:37.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:37 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:37.466+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.308634+0000 front 2024-09-10T21:28:11.308843+0000 (oldest deadline 2024-09-10T21:28:34.208621+0000) 2024-09-10T21:28:37.989 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:37 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:37.668+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:37.990 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:37 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:37.668+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:37.990 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:37 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:37.668+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:02.320191+0000 front 2024-09-10T21:28:02.320309+0000 (oldest deadline 2024-09-10T21:28:24.620096+0000) 2024-09-10T21:28:37.990 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:37 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:37.668+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.121288+0000 front 2024-09-10T21:28:08.121275+0000 (oldest deadline 2024-09-10T21:28:32.221148+0000) 2024-09-10T21:28:37.990 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:37 smithi192 systemd[1]: Stopping Ceph osd.8 for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:28:37.990 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:37 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:37.987+0000 7f99e22e4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:28:37.990 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:37 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:37.987+0000 7f99e22e4640 -1 osd.8 78 *** Got signal Terminated *** 2024-09-10T21:28:37.990 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:37 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:37.987+0000 7f99e22e4640 -1 osd.8 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:28:38.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:37 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:37.870+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:38.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:37 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:37.870+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:38.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:37 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:37.870+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:38.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:37 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:37.870+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:38.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:37 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:37.870+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:38.667 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:38 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:38.363+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:38.668 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:38 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:38.363+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:38.668 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:38 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:38.363+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:38.668 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:38 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:38.363+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:38.668 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:38 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:38.363+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:38.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:38 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:38.418+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:38.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:38 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:38.418+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:38.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:38 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:38.418+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:38.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:38 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:38.418+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:38.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:38 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:38.418+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.308634+0000 front 2024-09-10T21:28:11.308843+0000 (oldest deadline 2024-09-10T21:28:34.208621+0000) 2024-09-10T21:28:39.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:38 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:38.665+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:39.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:38 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:38.665+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:39.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:38 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:38.665+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:02.320191+0000 front 2024-09-10T21:28:02.320309+0000 (oldest deadline 2024-09-10T21:28:24.620096+0000) 2024-09-10T21:28:39.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:38 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:38.665+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.121288+0000 front 2024-09-10T21:28:08.121275+0000 (oldest deadline 2024-09-10T21:28:32.221148+0000) 2024-09-10T21:28:39.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:38 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:38.822+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:39.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:38 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:38.822+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:39.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:38 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:38.822+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:39.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:38 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:38.822+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:39.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:38 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:38.822+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:39.701 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:39 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:39.324+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:39.701 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:39 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:39.324+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:39.701 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:39 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:39.324+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:39.701 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:39 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:39.324+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:39.701 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:39 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:39.324+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:39.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:39 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:39.432+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:39.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:39 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:39.432+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:39.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:39 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:39.432+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:39.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:39 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:39.432+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:39.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:39 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:39.432+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.308634+0000 front 2024-09-10T21:28:11.308843+0000 (oldest deadline 2024-09-10T21:28:34.208621+0000) 2024-09-10T21:28:40.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:39 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:39.698+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:40.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:39 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:39.698+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:40.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:39 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:39.698+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:02.320191+0000 front 2024-09-10T21:28:02.320309+0000 (oldest deadline 2024-09-10T21:28:24.620096+0000) 2024-09-10T21:28:40.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:39 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:39.698+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.121288+0000 front 2024-09-10T21:28:08.121275+0000 (oldest deadline 2024-09-10T21:28:32.221148+0000) 2024-09-10T21:28:40.180 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:39 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:39.811+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:40.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:39 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:39.811+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:40.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:39 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:39.811+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:40.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:39 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:39.811+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:40.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:39 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:39.811+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:40.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:40 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:40.302+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:40.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:40 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:40.302+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:40.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:40 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:40.302+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:40.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:40 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:40.302+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:40.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:40 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:40.302+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:40.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:40 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:40.302+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:40.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:40 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:40.462+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:40.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:40 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:40.462+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:40.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:40 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:40.462+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:40.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:40 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:40.462+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:40.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:40 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:40.462+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.308634+0000 front 2024-09-10T21:28:11.308843+0000 (oldest deadline 2024-09-10T21:28:34.208621+0000) 2024-09-10T21:28:41.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:40 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:40.718+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:41.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:40 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:40.718+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:41.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:40 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:40.718+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:02.320191+0000 front 2024-09-10T21:28:02.320309+0000 (oldest deadline 2024-09-10T21:28:24.620096+0000) 2024-09-10T21:28:41.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:40 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:40.718+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.121288+0000 front 2024-09-10T21:28:08.121275+0000 (oldest deadline 2024-09-10T21:28:32.221148+0000) 2024-09-10T21:28:41.180 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:40 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:40.776+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:41.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:40 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:40.776+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:41.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:40 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:40.776+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:41.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:40 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:40.776+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:41.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:40 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:40.776+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:41.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:40 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:40.776+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:16.502548+0000 front 2024-09-10T21:28:16.502570+0000 (oldest deadline 2024-09-10T21:28:40.002582+0000) 2024-09-10T21:28:41.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:41 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:41.285+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:41.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:41 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:41.285+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:41.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:41 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:41.285+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:41.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:41 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:41.285+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:41.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:41 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:41.285+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:41.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:41 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:41.285+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:41.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:41 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:41.433+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:41.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:41 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:41.433+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:41.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:41 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:41.433+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:41.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:41 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:41.433+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:41.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:41 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:41.433+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.308634+0000 front 2024-09-10T21:28:11.308843+0000 (oldest deadline 2024-09-10T21:28:34.208621+0000) 2024-09-10T21:28:42.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:41 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:41.765+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:42.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:41 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:41.765+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:42.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:41 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:41.765+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:02.320191+0000 front 2024-09-10T21:28:02.320309+0000 (oldest deadline 2024-09-10T21:28:24.620096+0000) 2024-09-10T21:28:42.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:41 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:41.765+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.121288+0000 front 2024-09-10T21:28:08.121275+0000 (oldest deadline 2024-09-10T21:28:32.221148+0000) 2024-09-10T21:28:42.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:41 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:41.797+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:42.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:41 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:41.797+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:42.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:41 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:41.797+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:42.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:41 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:41.797+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:42.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:41 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:41.797+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:42.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:41 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:41.797+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:16.502548+0000 front 2024-09-10T21:28:16.502570+0000 (oldest deadline 2024-09-10T21:28:40.002582+0000) 2024-09-10T21:28:42.760 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:42 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:42.324+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:42.761 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:42 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:42.324+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:42.761 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:42 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:42.324+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:42.761 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:42 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:42.324+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:42.761 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:42 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:42.324+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:42.761 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:42 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:42.324+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:42.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:42 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:42.422+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:42.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:42 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:42.422+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:42.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:42 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:42.422+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:42.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:42 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:42.422+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:42.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:42 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:42.422+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.308634+0000 front 2024-09-10T21:28:11.308843+0000 (oldest deadline 2024-09-10T21:28:34.208621+0000) 2024-09-10T21:28:43.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:42 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:42.757+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.217519+0000 front 2024-09-10T21:27:47.217464+0000 (oldest deadline 2024-09-10T21:28:08.917576+0000) 2024-09-10T21:28:43.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:42 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:42.757+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.718947+0000 front 2024-09-10T21:27:54.718976+0000 (oldest deadline 2024-09-10T21:28:17.619115+0000) 2024-09-10T21:28:43.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:42 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:42.757+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:02.320191+0000 front 2024-09-10T21:28:02.320309+0000 (oldest deadline 2024-09-10T21:28:24.620096+0000) 2024-09-10T21:28:43.076 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:42 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8[53289]: 2024-09-10T21:28:42.757+0000 7f99da8f1640 -1 osd.8 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.121288+0000 front 2024-09-10T21:28:08.121275+0000 (oldest deadline 2024-09-10T21:28:32.221148+0000) 2024-09-10T21:28:43.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:42 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:42.814+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:43.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:42 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:42.814+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:43.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:42 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:42.814+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:43.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:42 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:42.814+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:43.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:42 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:42.814+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:43.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:42 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:42.814+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:16.502548+0000 front 2024-09-10T21:28:16.502570+0000 (oldest deadline 2024-09-10T21:28:40.002582+0000) 2024-09-10T21:28:43.631 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:43 smithi192 podman[69990]: 2024-09-10 21:28:43.341190715 +0000 UTC m=+5.497010949 container died dc3badf41d42a1437c5f09dd6aad9c787c9c5f91f47eb5ab3c5cbba85103ce95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:28:43.631 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:43 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:43.364+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:43.632 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:43 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:43.364+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:43.632 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:43 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:43.364+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:43.632 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:43 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:43.364+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:43.632 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:43 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:43.364+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:43.632 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:43 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:43.364+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:43.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:43 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:43.401+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:43.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:43 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:43.401+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:43.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:43 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:43.401+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:43.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:43 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:43.401+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:43.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:43 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:43.401+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.308634+0000 front 2024-09-10T21:28:11.308843+0000 (oldest deadline 2024-09-10T21:28:34.208621+0000) 2024-09-10T21:28:43.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:43 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:43.401+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:18.810229+0000 front 2024-09-10T21:28:18.810065+0000 (oldest deadline 2024-09-10T21:28:42.909882+0000) 2024-09-10T21:28:43.973 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:43 smithi192 podman[69990]: 2024-09-10 21:28:43.729132831 +0000 UTC m=+5.884953065 container cleanup dc3badf41d42a1437c5f09dd6aad9c787c9c5f91f47eb5ab3c5cbba85103ce95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:28:43.974 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:43 smithi192 bash[69990]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8 2024-09-10T21:28:44.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:43 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:43.845+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:44.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:43 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:43.845+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:44.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:43 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:43.845+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:44.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:43 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:43.845+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:44.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:43 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:43.845+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:44.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:43 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:43.845+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:16.502548+0000 front 2024-09-10T21:28:16.502570+0000 (oldest deadline 2024-09-10T21:28:40.002582+0000) 2024-09-10T21:28:44.301 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:43 smithi192 podman[70006]: 2024-09-10 21:28:43.972286081 +0000 UTC m=+0.630936463 container remove dc3badf41d42a1437c5f09dd6aad9c787c9c5f91f47eb5ab3c5cbba85103ce95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T21:28:44.576 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:44 smithi192 podman[70095]: 2024-09-10 21:28:44.202975779 +0000 UTC m=+0.015921541 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:28:44.576 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:44 smithi192 podman[70095]: 2024-09-10 21:28:44.323371016 +0000 UTC m=+0.136316770 container create 2f65bd4e28748e1a19c1efa972de4cac64ac17b7c0f7627ccc67bc293cd4f258 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-10T21:28:44.576 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:44 smithi192 podman[70095]: 2024-09-10 21:28:44.542498705 +0000 UTC m=+0.355444458 container init 2f65bd4e28748e1a19c1efa972de4cac64ac17b7c0f7627ccc67bc293cd4f258 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T21:28:44.576 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:44 smithi192 podman[70095]: 2024-09-10 21:28:44.545760011 +0000 UTC m=+0.358705771 container start 2f65bd4e28748e1a19c1efa972de4cac64ac17b7c0f7627ccc67bc293cd4f258 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-10T21:28:44.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:44 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:44.369+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:44.577 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:44 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:44.369+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:44.577 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:44 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:44.369+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:44.577 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:44 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:44.369+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:44.577 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:44 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:44.369+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:44.577 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:44 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:44.369+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:44.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:44.389+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:44.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:44.389+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:44.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:44.389+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:44.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:44.389+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:44.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:44.389+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.308634+0000 front 2024-09-10T21:28:11.308843+0000 (oldest deadline 2024-09-10T21:28:34.208621+0000) 2024-09-10T21:28:44.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:44 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:44.389+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:18.810229+0000 front 2024-09-10T21:28:18.810065+0000 (oldest deadline 2024-09-10T21:28:42.909882+0000) 2024-09-10T21:28:45.030 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:44 smithi192 podman[70095]: 2024-09-10 21:28:44.642831008 +0000 UTC m=+0.455776780 container attach 2f65bd4e28748e1a19c1efa972de4cac64ac17b7c0f7627ccc67bc293cd4f258 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-10T21:28:45.030 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:44 smithi192 podman[70095]: 2024-09-10 21:28:44.734965406 +0000 UTC m=+0.547911161 container died 2f65bd4e28748e1a19c1efa972de4cac64ac17b7c0f7627ccc67bc293cd4f258 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:28:45.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:44 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:44.849+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:45.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:44 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:44.849+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:45.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:44 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:44.849+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:45.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:44 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:44.849+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:45.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:44 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:44.849+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:45.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:44 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:44.849+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:16.502548+0000 front 2024-09-10T21:28:16.502570+0000 (oldest deadline 2024-09-10T21:28:40.002582+0000) 2024-09-10T21:28:45.300 INFO:journalctl@ceph.osd.8.smithi192.stdout:Sep 10 21:28:45 smithi192 podman[70119]: 2024-09-10 21:28:45.271125003 +0000 UTC m=+0.530458932 container remove 2f65bd4e28748e1a19c1efa972de4cac64ac17b7c0f7627ccc67bc293cd4f258 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-8-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:28:45.303 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.8.service' 2024-09-10T21:28:45.384 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:28:45.384 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-10T21:28:45.384 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-10T21:28:45.384 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.9 2024-09-10T21:28:45.556 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:45 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:45.324+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:45.556 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:45 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:45.324+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:45.556 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:45 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:45.324+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:45.556 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:45 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:45.324+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:45.556 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:45 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:45.324+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:45.556 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:45 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:45.324+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:45.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:45 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:45.397+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:45.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:45 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:45.397+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:45.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:45 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:45.397+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:45.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:45 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:45.397+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:45.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:45 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:45.397+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.308634+0000 front 2024-09-10T21:28:11.308843+0000 (oldest deadline 2024-09-10T21:28:34.208621+0000) 2024-09-10T21:28:45.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:45 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:45.397+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:18.810229+0000 front 2024-09-10T21:28:18.810065+0000 (oldest deadline 2024-09-10T21:28:42.909882+0000) 2024-09-10T21:28:45.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:45 smithi059 systemd[1]: Stopping Ceph osd.9 for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:28:46.159 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:45 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:45.709+0000 7f72d3aca640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:28:46.159 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:45 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:45.709+0000 7f72d3aca640 -1 osd.9 78 *** Got signal Terminated *** 2024-09-10T21:28:46.160 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:45 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:45.709+0000 7f72d3aca640 -1 osd.9 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:28:46.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:45 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:45.872+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:46.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:45 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:45.872+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:46.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:45 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:45.872+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:46.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:45 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:45.872+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:46.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:45 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:45.872+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:46.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:45 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:45.872+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:16.502548+0000 front 2024-09-10T21:28:16.502570+0000 (oldest deadline 2024-09-10T21:28:40.002582+0000) 2024-09-10T21:28:46.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:46 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:46.286+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:46.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:46 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:46.286+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:46.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:46 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:46.286+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:46.577 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:46 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:46.286+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:46.577 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:46 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:46.286+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:46.577 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:46 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:46.286+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:46.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:46 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:46.348+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:46.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:46 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:46.348+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:46.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:46 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:46.348+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:46.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:46 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:46.348+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:46.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:46 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:46.348+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.308634+0000 front 2024-09-10T21:28:11.308843+0000 (oldest deadline 2024-09-10T21:28:34.208621+0000) 2024-09-10T21:28:46.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:46 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:46.348+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:18.810229+0000 front 2024-09-10T21:28:18.810065+0000 (oldest deadline 2024-09-10T21:28:42.909882+0000) 2024-09-10T21:28:47.145 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:46 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:46.885+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:47.145 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:46 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:46.885+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:47.145 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:46 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:46.885+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:47.145 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:46 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:46.885+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:47.145 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:46 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:46.885+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:47.145 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:46 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:46.885+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:16.502548+0000 front 2024-09-10T21:28:16.502570+0000 (oldest deadline 2024-09-10T21:28:40.002582+0000) 2024-09-10T21:28:47.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:47 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:47.256+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:47.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:47 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:47.256+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:47.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:47 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:47.256+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:47.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:47 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:47.256+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:47.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:47 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:47.256+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:47.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:47 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:47.256+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:47.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:47 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:47.391+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:47.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:47 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:47.391+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:47.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:47 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:47.391+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:47.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:47 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:47.391+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:47.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:47 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:47.391+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.308634+0000 front 2024-09-10T21:28:11.308843+0000 (oldest deadline 2024-09-10T21:28:34.208621+0000) 2024-09-10T21:28:47.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:47 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:47.391+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:18.810229+0000 front 2024-09-10T21:28:18.810065+0000 (oldest deadline 2024-09-10T21:28:42.909882+0000) 2024-09-10T21:28:48.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:47 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:47.907+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:48.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:47 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:47.907+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:48.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:47 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:47.907+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:48.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:47 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:47.907+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:48.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:47 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:47.907+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:48.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:47 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:47.907+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:16.502548+0000 front 2024-09-10T21:28:16.502570+0000 (oldest deadline 2024-09-10T21:28:40.002582+0000) 2024-09-10T21:28:48.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:48 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:48.267+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:48.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:48 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:48.267+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:48.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:48 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:48.267+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:48.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:48 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:48.267+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:48.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:48 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:48.267+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:48.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:48 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:48.267+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:48.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:48 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:48.355+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:48.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:48 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:48.355+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:48.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:48 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:48.355+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:48.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:48 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:48.355+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:48.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:48 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:48.355+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.308634+0000 front 2024-09-10T21:28:11.308843+0000 (oldest deadline 2024-09-10T21:28:34.208621+0000) 2024-09-10T21:28:48.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:48 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:48.355+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:18.810229+0000 front 2024-09-10T21:28:18.810065+0000 (oldest deadline 2024-09-10T21:28:42.909882+0000) 2024-09-10T21:28:49.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:48 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:48.928+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:49.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:48 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:48.928+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:49.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:48 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:48.928+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:49.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:48 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:48.928+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:49.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:48 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:48.928+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:49.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:48 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:48.928+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:16.502548+0000 front 2024-09-10T21:28:16.502570+0000 (oldest deadline 2024-09-10T21:28:40.002582+0000) 2024-09-10T21:28:49.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:48 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:48.928+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T21:28:22.903662+0000 front 2024-09-10T21:28:22.903682+0000 (oldest deadline 2024-09-10T21:28:48.203518+0000) 2024-09-10T21:28:49.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:49 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:49.311+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:49.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:49 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:49.311+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:49.577 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:49 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:49.311+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:49.577 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:49 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:49.311+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:49.577 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:49 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:49.311+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:49.577 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:49 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:49.311+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:49.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:49 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:49.307+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:49.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:49 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:49.307+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:49.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:49 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:49.307+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:49.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:49 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:49.307+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:49.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:49 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:49.307+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.308634+0000 front 2024-09-10T21:28:11.308843+0000 (oldest deadline 2024-09-10T21:28:34.208621+0000) 2024-09-10T21:28:49.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:49 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:49.307+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:18.810229+0000 front 2024-09-10T21:28:18.810065+0000 (oldest deadline 2024-09-10T21:28:42.909882+0000) 2024-09-10T21:28:50.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:49 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:49.936+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:50.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:49 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:49.936+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:50.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:49 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:49.936+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:50.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:49 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:49.936+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:50.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:49 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:49.936+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:50.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:49 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:49.936+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:16.502548+0000 front 2024-09-10T21:28:16.502570+0000 (oldest deadline 2024-09-10T21:28:40.002582+0000) 2024-09-10T21:28:50.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:49 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:49.936+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T21:28:22.903662+0000 front 2024-09-10T21:28:22.903682+0000 (oldest deadline 2024-09-10T21:28:48.203518+0000) 2024-09-10T21:28:50.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:50 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:50.270+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:50.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:50 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:50.270+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:50.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:50 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:50.270+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:50.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:50 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:50.270+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:50.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:50 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:50.270+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:50.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:50 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:50.270+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:50.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:50 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:50.288+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.101615+0000 front 2024-09-10T21:27:36.101759+0000 (oldest deadline 2024-09-10T21:28:01.902610+0000) 2024-09-10T21:28:50.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:50 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:50.288+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:45.904262+0000 front 2024-09-10T21:27:45.904296+0000 (oldest deadline 2024-09-10T21:28:08.804210+0000) 2024-09-10T21:28:50.659 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:50 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:50.288+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:54.606061+0000 front 2024-09-10T21:27:54.606075+0000 (oldest deadline 2024-09-10T21:28:18.705761+0000) 2024-09-10T21:28:50.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:50 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:50.288+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.307045+0000 front 2024-09-10T21:28:00.306991+0000 (oldest deadline 2024-09-10T21:28:25.007056+0000) 2024-09-10T21:28:50.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:50 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:50.288+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.308634+0000 front 2024-09-10T21:28:11.308843+0000 (oldest deadline 2024-09-10T21:28:34.208621+0000) 2024-09-10T21:28:50.660 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:50 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9[67062]: 2024-09-10T21:28:50.288+0000 7f72d00df640 -1 osd.9 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:18.810229+0000 front 2024-09-10T21:28:18.810065+0000 (oldest deadline 2024-09-10T21:28:42.909882+0000) 2024-09-10T21:28:51.395 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:51 smithi059 podman[114516]: 2024-09-10 21:28:51.110576079 +0000 UTC m=+5.519121647 container died bd18f32b2159be8cd9a199395281be22a82798664d51813c7a5f2b6df004aaf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T21:28:51.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:50 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:50.978+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:51.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:50 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:50.978+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:51.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:50 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:50.978+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:51.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:50 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:50.978+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:51.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:50 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:50.978+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:51.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:50 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:50.978+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:16.502548+0000 front 2024-09-10T21:28:16.502570+0000 (oldest deadline 2024-09-10T21:28:40.002582+0000) 2024-09-10T21:28:51.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:50 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:50.978+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T21:28:22.903662+0000 front 2024-09-10T21:28:22.903682+0000 (oldest deadline 2024-09-10T21:28:48.203518+0000) 2024-09-10T21:28:51.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:51 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:51.281+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:51.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:51 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:51.281+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:51.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:51 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:51.281+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:51.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:51 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:51.281+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:51.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:51 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:51.281+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:51.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:51 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:51.281+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:51.962 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:51 smithi059 podman[114516]: 2024-09-10 21:28:51.692724032 +0000 UTC m=+6.101269638 container cleanup bd18f32b2159be8cd9a199395281be22a82798664d51813c7a5f2b6df004aaf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-10T21:28:51.962 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:51 smithi059 bash[114516]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9 2024-09-10T21:28:52.322 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:51 smithi059 podman[114531]: 2024-09-10 21:28:51.960762192 +0000 UTC m=+0.839026859 container remove bd18f32b2159be8cd9a199395281be22a82798664d51813c7a5f2b6df004aaf9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-10T21:28:52.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:51 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:51.968+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:52.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:51 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:51.968+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:52.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:51 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:51.968+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:52.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:51 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:51.968+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:52.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:51 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:51.968+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:52.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:51 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:51.968+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:16.502548+0000 front 2024-09-10T21:28:16.502570+0000 (oldest deadline 2024-09-10T21:28:40.002582+0000) 2024-09-10T21:28:52.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:51 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:51.968+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T21:28:22.903662+0000 front 2024-09-10T21:28:22.903682+0000 (oldest deadline 2024-09-10T21:28:48.203518+0000) 2024-09-10T21:28:52.573 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:52 smithi059 podman[114619]: 2024-09-10 21:28:52.224138785 +0000 UTC m=+0.016147279 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:28:52.574 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:52 smithi059 podman[114619]: 2024-09-10 21:28:52.336587807 +0000 UTC m=+0.128596348 container create 9d2e67333281d7a44698cfd759746aa096f91761390b4eeb989e51ce5bf5f595 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-10T21:28:52.574 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:52 smithi059 podman[114619]: 2024-09-10 21:28:52.572476563 +0000 UTC m=+0.364485058 container init 9d2e67333281d7a44698cfd759746aa096f91761390b4eeb989e51ce5bf5f595 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T21:28:52.575 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:52 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:52.268+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:52.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:52 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:52.268+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:52.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:52 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:52.268+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:52.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:52 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:52.268+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:52.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:52 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:52.268+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:52.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:52 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:52.268+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:52.909 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:52 smithi059 podman[114619]: 2024-09-10 21:28:52.576188356 +0000 UTC m=+0.368196842 container start 9d2e67333281d7a44698cfd759746aa096f91761390b4eeb989e51ce5bf5f595 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T21:28:52.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:52 smithi059 podman[114619]: 2024-09-10 21:28:52.66417335 +0000 UTC m=+0.456181856 container attach 9d2e67333281d7a44698cfd759746aa096f91761390b4eeb989e51ce5bf5f595 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-10T21:28:52.910 INFO:journalctl@ceph.osd.9.smithi059.stdout:Sep 10 21:28:52 smithi059 podman[114619]: 2024-09-10 21:28:52.769867869 +0000 UTC m=+0.561876354 container died 9d2e67333281d7a44698cfd759746aa096f91761390b4eeb989e51ce5bf5f595 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T21:28:53.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:52 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:52.970+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:53.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:52 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:52.970+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:53.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:52 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:52.970+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:53.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:52 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:52.970+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:53.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:52 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:52.970+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:53.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:52 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:52.970+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:16.502548+0000 front 2024-09-10T21:28:16.502570+0000 (oldest deadline 2024-09-10T21:28:40.002582+0000) 2024-09-10T21:28:53.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:52 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:52.970+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T21:28:22.903662+0000 front 2024-09-10T21:28:22.903682+0000 (oldest deadline 2024-09-10T21:28:48.203518+0000) 2024-09-10T21:28:53.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:53 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:53.241+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:53.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:53 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:53.241+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:53.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:53 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:53.241+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:53.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:53 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:53.241+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:53.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:53 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:53.241+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:53.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:53 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:53.241+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:53.632 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.9.service' 2024-09-10T21:28:53.676 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:28:53.677 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-10T21:28:53.677 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-10T21:28:53.677 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.10 2024-09-10T21:28:53.996 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:53 smithi154 systemd[1]: Stopping Ceph osd.10 for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:28:53.996 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:53 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:53.923+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:53.996 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:53 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:53.923+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:53.996 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:53 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:53.923+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:53.996 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:53 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:53.923+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:53.996 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:53 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:53.923+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:53.996 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:53 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:53.923+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:16.502548+0000 front 2024-09-10T21:28:16.502570+0000 (oldest deadline 2024-09-10T21:28:40.002582+0000) 2024-09-10T21:28:53.996 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:53 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:53.923+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T21:28:22.903662+0000 front 2024-09-10T21:28:22.903682+0000 (oldest deadline 2024-09-10T21:28:48.203518+0000) 2024-09-10T21:28:53.996 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:53 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:53.992+0000 7f26645d0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:28:53.996 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:53 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:53.992+0000 7f26645d0640 -1 osd.10 78 *** Got signal Terminated *** 2024-09-10T21:28:53.996 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:53 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:53.992+0000 7f26645d0640 -1 osd.10 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:28:54.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:54 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:54.268+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:54.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:54 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:54.268+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:54.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:54 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:54.268+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:54.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:54 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:54.268+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:54.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:54 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:54.268+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:54.577 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:54 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:54.268+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:55.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:54 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:54.935+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:55.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:54 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:54.935+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:55.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:54 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:54.935+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:55.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:54 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:54.935+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:55.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:54 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:54.935+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:55.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:54 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:54.935+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:16.502548+0000 front 2024-09-10T21:28:16.502570+0000 (oldest deadline 2024-09-10T21:28:40.002582+0000) 2024-09-10T21:28:55.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:54 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:54.935+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T21:28:22.903662+0000 front 2024-09-10T21:28:22.903682+0000 (oldest deadline 2024-09-10T21:28:48.203518+0000) 2024-09-10T21:28:55.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:55 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:55.314+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:55.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:55 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:55.314+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:55.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:55 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:55.314+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:55.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:55 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:55.314+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:55.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:55 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:55.314+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:55.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:55 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:55.314+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:56.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:55 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:55.919+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:56.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:55 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:55.919+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:56.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:55 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:55.919+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:56.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:55 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:55.919+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:56.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:55 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:55.919+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:56.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:55 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:55.919+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:16.502548+0000 front 2024-09-10T21:28:16.502570+0000 (oldest deadline 2024-09-10T21:28:40.002582+0000) 2024-09-10T21:28:56.181 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:55 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:55.919+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T21:28:22.903662+0000 front 2024-09-10T21:28:22.903682+0000 (oldest deadline 2024-09-10T21:28:48.203518+0000) 2024-09-10T21:28:56.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:56 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:56.318+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:56.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:56 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:56.318+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:56.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:56 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:56.318+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:56.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:56 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:56.318+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:56.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:56 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:56.318+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:56.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:56 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:56.318+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:56.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:56 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:56.318+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T21:28:29.973558+0000 front 2024-09-10T21:28:29.973493+0000 (oldest deadline 2024-09-10T21:28:55.873324+0000) 2024-09-10T21:28:57.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:56 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:56.948+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:57.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:56 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:56.948+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:57.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:56 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:56.948+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:57.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:56 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:56.948+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:57.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:56 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:56.948+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:57.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:56 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:56.948+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:16.502548+0000 front 2024-09-10T21:28:16.502570+0000 (oldest deadline 2024-09-10T21:28:40.002582+0000) 2024-09-10T21:28:57.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:56 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:56.948+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T21:28:22.903662+0000 front 2024-09-10T21:28:22.903682+0000 (oldest deadline 2024-09-10T21:28:48.203518+0000) 2024-09-10T21:28:57.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:57 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:57.360+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:57.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:57 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:57.360+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:57.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:57 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:57.360+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:57.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:57 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:57.360+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:57.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:57 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:57.360+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:57.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:57 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:57.360+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:57.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:57 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:57.360+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T21:28:29.973558+0000 front 2024-09-10T21:28:29.973493+0000 (oldest deadline 2024-09-10T21:28:55.873324+0000) 2024-09-10T21:28:58.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:57 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:57.948+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:58.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:57 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:57.948+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:58.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:57 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:57.948+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:58.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:57 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:57.948+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:58.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:57 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:57.948+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:58.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:57 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:57.948+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:16.502548+0000 front 2024-09-10T21:28:16.502570+0000 (oldest deadline 2024-09-10T21:28:40.002582+0000) 2024-09-10T21:28:58.431 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:57 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:57.948+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T21:28:22.903662+0000 front 2024-09-10T21:28:22.903682+0000 (oldest deadline 2024-09-10T21:28:48.203518+0000) 2024-09-10T21:28:58.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:58 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:58.368+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:58.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:58 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:58.368+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:58.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:58 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:58.368+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:58.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:58 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:58.368+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:58.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:58 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:58.368+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:58.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:58 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:58.368+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:58.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:58 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:58.368+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T21:28:29.973558+0000 front 2024-09-10T21:28:29.973493+0000 (oldest deadline 2024-09-10T21:28:55.873324+0000) 2024-09-10T21:28:59.306 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:58 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:58.961+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:38.995782+0000 front 2024-09-10T21:27:38.995615+0000 (oldest deadline 2024-09-10T21:28:03.695524+0000) 2024-09-10T21:28:59.306 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:58 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:58.961+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:46.898086+0000 front 2024-09-10T21:27:46.898163+0000 (oldest deadline 2024-09-10T21:28:08.598205+0000) 2024-09-10T21:28:59.306 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:58 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:58.961+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:50.199670+0000 front 2024-09-10T21:27:50.199775+0000 (oldest deadline 2024-09-10T21:28:16.099613+0000) 2024-09-10T21:28:59.306 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:58 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:58.961+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:28:00.101142+0000 front 2024-09-10T21:28:00.100985+0000 (oldest deadline 2024-09-10T21:28:25.400904+0000) 2024-09-10T21:28:59.306 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:58 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:58.961+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:11.202058+0000 front 2024-09-10T21:28:11.202083+0000 (oldest deadline 2024-09-10T21:28:36.502163+0000) 2024-09-10T21:28:59.306 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:58 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:58.961+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:16.502548+0000 front 2024-09-10T21:28:16.502570+0000 (oldest deadline 2024-09-10T21:28:40.002582+0000) 2024-09-10T21:28:59.306 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:58 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10[59614]: 2024-09-10T21:28:58.961+0000 7f2660be5640 -1 osd.10 78 heartbeat_check: no reply from 172.21.15.59:6822 osd.6 since back 2024-09-10T21:28:22.903662+0000 front 2024-09-10T21:28:22.903682+0000 (oldest deadline 2024-09-10T21:28:48.203518+0000) 2024-09-10T21:28:59.570 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:59 smithi154 podman[70778]: 2024-09-10 21:28:59.304558228 +0000 UTC m=+5.431463861 container died 8cd66e8d7bf638a48f413682589096d009a8814dace511f9e7117a1d7dfc4ec5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:28:59.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:59 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:59.377+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:28:59.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:59 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:59.377+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:28:59.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:59 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:59.377+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:28:59.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:59 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:59.377+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:28:59.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:59 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:59.377+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:28:59.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:59 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:59.377+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:28:59.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:28:59 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:28:59.377+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T21:28:29.973558+0000 front 2024-09-10T21:28:29.973493+0000 (oldest deadline 2024-09-10T21:28:55.873324+0000) 2024-09-10T21:28:59.930 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:59 smithi154 podman[70778]: 2024-09-10 21:28:59.635032008 +0000 UTC m=+5.761937643 container cleanup 8cd66e8d7bf638a48f413682589096d009a8814dace511f9e7117a1d7dfc4ec5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-10T21:28:59.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:59 smithi154 bash[70778]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10 2024-09-10T21:28:59.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:28:59 smithi154 podman[70792]: 2024-09-10 21:28:59.811115163 +0000 UTC m=+0.498519040 container remove 8cd66e8d7bf638a48f413682589096d009a8814dace511f9e7117a1d7dfc4ec5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731) 2024-09-10T21:29:00.557 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:29:00 smithi154 podman[70881]: 2024-09-10 21:29:00.157367819 +0000 UTC m=+0.015843945 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:29:00.558 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:29:00 smithi154 podman[70881]: 2024-09-10 21:29:00.261755252 +0000 UTC m=+0.120231365 container create 232ab2ee2e6b5e1df4ca80ded0b0e05469485c57e0bb0c44598b3f3343ca83f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T21:29:00.558 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:29:00 smithi154 podman[70881]: 2024-09-10 21:29:00.47254027 +0000 UTC m=+0.331016383 container init 232ab2ee2e6b5e1df4ca80ded0b0e05469485c57e0bb0c44598b3f3343ca83f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:29:00.558 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:29:00 smithi154 podman[70881]: 2024-09-10 21:29:00.475771529 +0000 UTC m=+0.334247648 container start 232ab2ee2e6b5e1df4ca80ded0b0e05469485c57e0bb0c44598b3f3343ca83f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T21:29:00.558 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:29:00 smithi154 podman[70881]: 2024-09-10 21:29:00.555765058 +0000 UTC m=+0.414241172 container attach 232ab2ee2e6b5e1df4ca80ded0b0e05469485c57e0bb0c44598b3f3343ca83f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-10T21:29:00.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:00 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:00.378+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:29:00.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:00 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:00.378+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:29:00.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:00 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:00.378+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:29:00.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:00 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:00.378+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:29:00.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:00 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:00.378+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:29:00.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:00 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:00.378+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:29:00.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:00 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:00.378+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T21:28:29.973558+0000 front 2024-09-10T21:28:29.973493+0000 (oldest deadline 2024-09-10T21:28:55.873324+0000) 2024-09-10T21:29:00.931 INFO:journalctl@ceph.osd.10.smithi154.stdout:Sep 10 21:29:00 smithi154 podman[70881]: 2024-09-10 21:29:00.670585753 +0000 UTC m=+0.529061876 container died 232ab2ee2e6b5e1df4ca80ded0b0e05469485c57e0bb0c44598b3f3343ca83f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:29:01.245 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.10.service' 2024-09-10T21:29:01.286 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:29:01.286 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-10T21:29:01.286 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-10T21:29:01.286 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.11 2024-09-10T21:29:01.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:01 smithi192 systemd[1]: Stopping Ceph osd.11 for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:29:01.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:01 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:01.346+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:29:01.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:01 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:01.346+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:29:01.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:01 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:01.346+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:29:01.577 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:01 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:01.346+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:29:01.577 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:01 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:01.346+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:29:01.577 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:01 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:01.346+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:29:01.577 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:01 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:01.346+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T21:28:29.973558+0000 front 2024-09-10T21:28:29.973493+0000 (oldest deadline 2024-09-10T21:28:55.873324+0000) 2024-09-10T21:29:02.075 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:01 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:01.598+0000 7fb48bc7e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:29:02.076 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:01 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:01.598+0000 7fb48bc7e640 -1 osd.11 78 *** Got signal Terminated *** 2024-09-10T21:29:02.076 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:01 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:01.598+0000 7fb48bc7e640 -1 osd.11 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T21:29:02.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:02 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:02.385+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:29:02.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:02 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:02.385+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:29:02.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:02 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:02.385+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:29:02.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:02 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:02.385+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:29:02.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:02 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:02.385+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:29:02.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:02 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:02.385+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:29:02.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:02 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:02.385+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T21:28:29.973558+0000 front 2024-09-10T21:28:29.973493+0000 (oldest deadline 2024-09-10T21:28:55.873324+0000) 2024-09-10T21:29:03.802 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:03 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:03.365+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:29:03.802 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:03 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:03.365+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:29:03.802 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:03 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:03.365+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:29:03.802 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:03 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:03.365+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:29:03.802 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:03 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:03.365+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:29:03.802 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:03 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:03.365+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:29:03.802 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:03 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:03.365+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T21:28:29.973558+0000 front 2024-09-10T21:28:29.973493+0000 (oldest deadline 2024-09-10T21:28:55.873324+0000) 2024-09-10T21:29:04.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:04 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:04.390+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:29:04.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:04 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:04.390+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:29:04.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:04 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:04.390+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:29:04.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:04 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:04.390+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:29:04.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:04 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:04.390+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:29:04.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:04 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:04.390+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:29:04.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:04 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:04.390+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T21:28:29.973558+0000 front 2024-09-10T21:28:29.973493+0000 (oldest deadline 2024-09-10T21:28:55.873324+0000) 2024-09-10T21:29:05.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:05 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:05.394+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:29:05.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:05 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:05.394+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:29:05.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:05 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:05.394+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:29:05.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:05 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:05.394+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:29:05.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:05 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:05.394+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:29:05.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:05 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:05.394+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:29:05.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:05 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:05.394+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T21:28:29.973558+0000 front 2024-09-10T21:28:29.973493+0000 (oldest deadline 2024-09-10T21:28:55.873324+0000) 2024-09-10T21:29:06.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:06 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:06.394+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6806 osd.0 since back 2024-09-10T21:27:36.565609+0000 front 2024-09-10T21:27:36.565710+0000 (oldest deadline 2024-09-10T21:28:01.865569+0000) 2024-09-10T21:29:06.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:06 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:06.394+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6804 osd.1 since back 2024-09-10T21:27:47.666966+0000 front 2024-09-10T21:27:47.666828+0000 (oldest deadline 2024-09-10T21:28:08.166684+0000) 2024-09-10T21:29:06.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:06 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:06.394+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6804 osd.2 since back 2024-09-10T21:27:53.967893+0000 front 2024-09-10T21:27:53.967923+0000 (oldest deadline 2024-09-10T21:28:19.168525+0000) 2024-09-10T21:29:06.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:06 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:06.394+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.59:6814 osd.3 since back 2024-09-10T21:27:59.169054+0000 front 2024-09-10T21:27:59.168955+0000 (oldest deadline 2024-09-10T21:28:23.868937+0000) 2024-09-10T21:29:06.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:06 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:06.394+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6812 osd.4 since back 2024-09-10T21:28:08.470401+0000 front 2024-09-10T21:28:08.470290+0000 (oldest deadline 2024-09-10T21:28:32.570214+0000) 2024-09-10T21:29:06.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:06 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:06.394+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6812 osd.5 since back 2024-09-10T21:28:14.870966+0000 front 2024-09-10T21:28:14.870952+0000 (oldest deadline 2024-09-10T21:28:40.171035+0000) 2024-09-10T21:29:06.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:06 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:06.394+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.154:6820 osd.7 since back 2024-09-10T21:28:29.973558+0000 front 2024-09-10T21:28:29.973493+0000 (oldest deadline 2024-09-10T21:28:55.873324+0000) 2024-09-10T21:29:06.826 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:06 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11[59834]: 2024-09-10T21:29:06.394+0000 7fb48428b640 -1 osd.11 78 heartbeat_check: no reply from 172.21.15.192:6820 osd.8 since back 2024-09-10T21:28:42.274525+0000 front 2024-09-10T21:28:42.274502+0000 (oldest deadline 2024-09-10T21:29:06.374458+0000) 2024-09-10T21:29:07.192 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:06 smithi192 podman[70209]: 2024-09-10 21:29:06.931450564 +0000 UTC m=+5.444898392 container died 462d0851d2a535dda47ec2395ff889eeb43a6be9d26eb9156db36c942cf3c65c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T21:29:07.542 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:07 smithi192 podman[70209]: 2024-09-10 21:29:07.290215153 +0000 UTC m=+5.803662980 container cleanup 462d0851d2a535dda47ec2395ff889eeb43a6be9d26eb9156db36c942cf3c65c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731) 2024-09-10T21:29:07.543 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:07 smithi192 bash[70209]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11 2024-09-10T21:29:07.828 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:07 smithi192 podman[70238]: 2024-09-10 21:29:07.541321251 +0000 UTC m=+0.610944821 container remove 462d0851d2a535dda47ec2395ff889eeb43a6be9d26eb9156db36c942cf3c65c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-10T21:29:08.162 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:07 smithi192 podman[70327]: 2024-09-10 21:29:07.806258862 +0000 UTC m=+0.015676041 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T21:29:08.162 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:07 smithi192 podman[70327]: 2024-09-10 21:29:07.934004373 +0000 UTC m=+0.143421587 container create 7f535b01d9b2856bf4989fe17b21169fd69afa2de2aef841db433ba8655aa15a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:29:08.163 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:08 smithi192 podman[70327]: 2024-09-10 21:29:08.161387327 +0000 UTC m=+0.370804496 container init 7f535b01d9b2856bf4989fe17b21169fd69afa2de2aef841db433ba8655aa15a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:29:08.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:08 smithi192 podman[70327]: 2024-09-10 21:29:08.164788075 +0000 UTC m=+0.374205244 container start 7f535b01d9b2856bf4989fe17b21169fd69afa2de2aef841db433ba8655aa15a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2) 2024-09-10T21:29:08.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:08 smithi192 podman[70327]: 2024-09-10 21:29:08.253016264 +0000 UTC m=+0.462433435 container attach 7f535b01d9b2856bf4989fe17b21169fd69afa2de2aef841db433ba8655aa15a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11-deactivate, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-10T21:29:08.576 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:08 smithi192 podman[70327]: 2024-09-10 21:29:08.359485222 +0000 UTC m=+0.568902397 container died 7f535b01d9b2856bf4989fe17b21169fd69afa2de2aef841db433ba8655aa15a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-10T21:29:08.912 INFO:journalctl@ceph.osd.11.smithi192.stdout:Sep 10 21:29:08 smithi192 podman[70351]: 2024-09-10 21:29:08.898614585 +0000 UTC m=+0.532968923 container remove 7f535b01d9b2856bf4989fe17b21169fd69afa2de2aef841db433ba8655aa15a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T21:29:08.917 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@osd.11.service' 2024-09-10T21:29:08.957 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:29:08.957 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-10T21:29:08.957 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-10T21:29:08.957 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.a 2024-09-10T21:29:09.241 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:29:09 smithi059 systemd[1]: Stopping Ceph mds.a for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:29:09.501 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:29:09 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-a[74032]: 2024-09-10T21:29:09.270+0000 7f083bbd5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:29:09.501 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:29:09 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-a[74032]: 2024-09-10T21:29:09.270+0000 7f083bbd5640 -1 mds.a *** got signal Terminated *** 2024-09-10T21:29:12.180 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:29:11 smithi059 podman[114721]: 2024-09-10 21:29:11.917411235 +0000 UTC m=+2.757868497 container died a31d4854ededf69a0df2b1a7b62a8310f9cdbe3bd2c1e905e328e1d1b89e3078 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T21:29:12.564 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:29:12 smithi059 podman[114721]: 2024-09-10 21:29:12.352977207 +0000 UTC m=+3.193434459 container cleanup a31d4854ededf69a0df2b1a7b62a8310f9cdbe3bd2c1e905e328e1d1b89e3078 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T21:29:12.564 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:29:12 smithi059 bash[114721]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-a 2024-09-10T21:29:12.793 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.a.service' 2024-09-10T21:29:12.816 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:29:12 smithi059 podman[114744]: 2024-09-10 21:29:12.562678126 +0000 UTC m=+0.642662733 container remove a31d4854ededf69a0df2b1a7b62a8310f9cdbe3bd2c1e905e328e1d1b89e3078 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T21:29:12.816 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:29:12 smithi059 systemd[1]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.a.service: Deactivated successfully. 2024-09-10T21:29:12.816 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:29:12 smithi059 systemd[1]: Stopped Ceph mds.a for 3c26b952-6fb8-11ef-bcea-c7b262605968. 2024-09-10T21:29:12.817 INFO:journalctl@ceph.mds.a.smithi059.stdout:Sep 10 21:29:12 smithi059 systemd[1]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.a.service: Consumed 2.143s CPU time. 2024-09-10T21:29:12.831 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:29:12.831 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-10T21:29:12.831 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-10T21:29:12.831 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.d 2024-09-10T21:29:13.159 INFO:journalctl@ceph.mds.d.smithi059.stdout:Sep 10 21:29:12 smithi059 systemd[1]: Stopping Ceph mds.d for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:29:13.409 INFO:journalctl@ceph.mds.d.smithi059.stdout:Sep 10 21:29:13 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-d[72911]: 2024-09-10T21:29:13.157+0000 7f5d63eb1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:29:13.409 INFO:journalctl@ceph.mds.d.smithi059.stdout:Sep 10 21:29:13 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-d[72911]: 2024-09-10T21:29:13.157+0000 7f5d63eb1640 -1 mds.d *** got signal Terminated *** 2024-09-10T21:29:17.358 INFO:journalctl@ceph.mds.d.smithi059.stdout:Sep 10 21:29:16 smithi059 podman[114854]: 2024-09-10 21:29:16.95283491 +0000 UTC m=+3.896130146 container died d195de98ee051cbedeb958b934258e4eb61e02f423b6e607fbba2ee8ed4b2e2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-d, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:29:17.659 INFO:journalctl@ceph.mds.d.smithi059.stdout:Sep 10 21:29:17 smithi059 podman[114854]: 2024-09-10 21:29:17.44000903 +0000 UTC m=+4.383304277 container cleanup d195de98ee051cbedeb958b934258e4eb61e02f423b6e607fbba2ee8ed4b2e2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-10T21:29:17.659 INFO:journalctl@ceph.mds.d.smithi059.stdout:Sep 10 21:29:17 smithi059 bash[114854]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-d 2024-09-10T21:29:17.883 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.d.service' 2024-09-10T21:29:17.917 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:29:17.918 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-10T21:29:17.918 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-10T21:29:17.918 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.g 2024-09-10T21:29:18.354 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 21:29:17 smithi059 systemd[1]: Stopping Ceph mds.g for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:29:18.659 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 21:29:18 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-g[73682]: 2024-09-10T21:29:18.352+0000 7f769baf3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:29:18.659 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 21:29:18 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-g[73682]: 2024-09-10T21:29:18.352+0000 7f769baf3640 -1 mds.g *** got signal Terminated *** 2024-09-10T21:29:20.213 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 21:29:19 smithi059 podman[114976]: 2024-09-10 21:29:19.923964794 +0000 UTC m=+1.781801395 container died 0eb009049ea79db3fe391501a236f33099ef4cca3255539c98142896fd0db5f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T21:29:20.569 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 21:29:20 smithi059 podman[114976]: 2024-09-10 21:29:20.310569592 +0000 UTC m=+2.168406192 container cleanup 0eb009049ea79db3fe391501a236f33099ef4cca3255539c98142896fd0db5f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-10T21:29:20.569 INFO:journalctl@ceph.mds.g.smithi059.stdout:Sep 10 21:29:20 smithi059 bash[114976]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-g 2024-09-10T21:29:20.715 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.g.service' 2024-09-10T21:29:20.748 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:29:20.749 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-10T21:29:20.749 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-10T21:29:20.749 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.j 2024-09-10T21:29:21.159 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 21:29:20 smithi059 systemd[1]: Stopping Ceph mds.j for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:29:21.659 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 21:29:21 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-j[72501]: 2024-09-10T21:29:21.197+0000 7fdf4e1ae640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:29:21.659 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 21:29:21 smithi059 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-j[72501]: 2024-09-10T21:29:21.197+0000 7fdf4e1ae640 -1 mds.j *** got signal Terminated *** 2024-09-10T21:29:25.475 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 21:29:25 smithi059 podman[115095]: 2024-09-10 21:29:25.206003784 +0000 UTC m=+4.234862243 container died 5956a89a0aebf4fcdc3d92e784292f549413f066888bd6072188aecc3b312a7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-j, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T21:29:25.909 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 21:29:25 smithi059 podman[115095]: 2024-09-10 21:29:25.672581659 +0000 UTC m=+4.701440105 container cleanup 5956a89a0aebf4fcdc3d92e784292f549413f066888bd6072188aecc3b312a7b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-j, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:29:25.909 INFO:journalctl@ceph.mds.j.smithi059.stdout:Sep 10 21:29:25 smithi059 bash[115095]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-j 2024-09-10T21:29:26.112 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.j.service' 2024-09-10T21:29:26.145 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:29:26.145 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-10T21:29:26.145 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-10T21:29:26.145 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.b 2024-09-10T21:29:26.431 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 21:29:26 smithi154 systemd[1]: Stopping Ceph mds.b for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:29:26.931 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 21:29:26 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-b[64936]: 2024-09-10T21:29:26.450+0000 7f680536b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:29:26.931 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 21:29:26 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-b[64936]: 2024-09-10T21:29:26.450+0000 7f680536b640 -1 mds.b *** got signal Terminated *** 2024-09-10T21:29:28.181 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 21:29:27 smithi154 podman[70995]: 2024-09-10 21:29:27.913205372 +0000 UTC m=+1.569848335 container died d24ac9fe33d6fd66370eff82d2c4d5ed0263e0482ea83fe5c7a0f665fde79f10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-b, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T21:29:28.576 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 21:29:28 smithi154 podman[70995]: 2024-09-10 21:29:28.225550449 +0000 UTC m=+1.882193414 container cleanup d24ac9fe33d6fd66370eff82d2c4d5ed0263e0482ea83fe5c7a0f665fde79f10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T21:29:28.576 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 21:29:28 smithi154 bash[70995]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-b 2024-09-10T21:29:28.577 INFO:journalctl@ceph.mds.b.smithi154.stdout:Sep 10 21:29:28 smithi154 podman[71009]: 2024-09-10 21:29:28.460059269 +0000 UTC m=+0.538339796 container remove d24ac9fe33d6fd66370eff82d2c4d5ed0263e0482ea83fe5c7a0f665fde79f10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-b, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-10T21:29:28.591 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.b.service' 2024-09-10T21:29:28.626 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:29:28.626 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-10T21:29:28.626 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-10T21:29:28.626 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.e 2024-09-10T21:29:28.931 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 21:29:28 smithi154 systemd[1]: Stopping Ceph mds.e for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:29:29.430 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 21:29:28 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-e[64334]: 2024-09-10T21:29:28.955+0000 7fb6a553f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:29:29.431 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 21:29:28 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-e[64334]: 2024-09-10T21:29:28.955+0000 7fb6a553f640 -1 mds.e *** got signal Terminated *** 2024-09-10T21:29:32.180 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 21:29:31 smithi154 podman[71116]: 2024-09-10 21:29:31.923725692 +0000 UTC m=+3.080112641 container died 0611dfb906c69e8f3b84fa810d4abf085622a1d5b04f491c4d95bb4fd1d7e2a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-10T21:29:32.540 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 21:29:32 smithi154 podman[71116]: 2024-09-10 21:29:32.288112244 +0000 UTC m=+3.444499193 container cleanup 0611dfb906c69e8f3b84fa810d4abf085622a1d5b04f491c4d95bb4fd1d7e2a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-e, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-10T21:29:32.540 INFO:journalctl@ceph.mds.e.smithi154.stdout:Sep 10 21:29:32 smithi154 bash[71116]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-e 2024-09-10T21:29:32.671 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.e.service' 2024-09-10T21:29:32.705 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:29:32.705 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-10T21:29:32.705 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-10T21:29:32.705 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.h 2024-09-10T21:29:32.930 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 21:29:32 smithi154 systemd[1]: Stopping Ceph mds.h for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:29:33.430 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 21:29:33 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-h[64635]: 2024-09-10T21:29:33.015+0000 7f49ca1fc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:29:33.431 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 21:29:33 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-h[64635]: 2024-09-10T21:29:33.015+0000 7f49ca1fc640 -1 mds.h *** got signal Terminated *** 2024-09-10T21:29:36.180 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 21:29:35 smithi154 podman[71234]: 2024-09-10 21:29:35.918786675 +0000 UTC m=+2.999028811 container died d9b31ea9966a2525469ea04e3d1f9c6f807fb990af91402e5fb46a86651be376 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-h, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T21:29:36.544 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 21:29:36 smithi154 podman[71234]: 2024-09-10 21:29:36.274496137 +0000 UTC m=+3.354738282 container cleanup d9b31ea9966a2525469ea04e3d1f9c6f807fb990af91402e5fb46a86651be376 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-h, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:29:36.544 INFO:journalctl@ceph.mds.h.smithi154.stdout:Sep 10 21:29:36 smithi154 bash[71234]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-h 2024-09-10T21:29:36.701 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.h.service' 2024-09-10T21:29:36.737 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:29:36.737 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-10T21:29:36.738 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-10T21:29:36.738 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.k 2024-09-10T21:29:37.063 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 21:29:36 smithi154 systemd[1]: Stopping Ceph mds.k for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:29:37.430 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 21:29:37 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-k[64021]: 2024-09-10T21:29:37.061+0000 7f722d40f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:29:37.431 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 21:29:37 smithi154 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-k[64021]: 2024-09-10T21:29:37.061+0000 7f722d40f640 -1 mds.k *** got signal Terminated *** 2024-09-10T21:29:40.181 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 21:29:39 smithi154 podman[71369]: 2024-09-10 21:29:39.91852936 +0000 UTC m=+2.962766639 container died c0f664d5812a441020cda453daf5880f79fcccbcca4292ac08b01bdddb829ea5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-10T21:29:40.747 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 21:29:40 smithi154 podman[71369]: 2024-09-10 21:29:40.56213963 +0000 UTC m=+3.606376908 container cleanup c0f664d5812a441020cda453daf5880f79fcccbcca4292ac08b01bdddb829ea5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T21:29:40.747 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 21:29:40 smithi154 bash[71369]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-k 2024-09-10T21:29:40.998 INFO:journalctl@ceph.mds.k.smithi154.stdout:Sep 10 21:29:40 smithi154 podman[71382]: 2024-09-10 21:29:40.746117189 +0000 UTC m=+0.817905402 container remove c0f664d5812a441020cda453daf5880f79fcccbcca4292ac08b01bdddb829ea5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-10T21:29:41.001 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.k.service' 2024-09-10T21:29:41.035 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:29:41.035 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-10T21:29:41.035 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-10T21:29:41.036 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.c 2024-09-10T21:29:41.326 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 10 21:29:41 smithi192 systemd[1]: Stopping Ceph mds.c for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:29:41.581 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 10 21:29:41 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-c[64767]: 2024-09-10T21:29:41.415+0000 7f43d22ab640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:29:41.581 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 10 21:29:41 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-c[64767]: 2024-09-10T21:29:41.415+0000 7f43d22ab640 -1 mds.c *** got signal Terminated *** 2024-09-10T21:29:44.183 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 10 21:29:43 smithi192 podman[70430]: 2024-09-10 21:29:43.9103161 +0000 UTC m=+2.683783196 container died f6a5aacb6973b71ed575f74592f5e04bd187239d529aa4de300e9aa4e08ff5c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-c, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T21:29:44.534 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 10 21:29:44 smithi192 podman[70430]: 2024-09-10 21:29:44.290105493 +0000 UTC m=+3.063572578 container cleanup f6a5aacb6973b71ed575f74592f5e04bd187239d529aa4de300e9aa4e08ff5c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-c, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T21:29:44.534 INFO:journalctl@ceph.mds.c.smithi192.stdout:Sep 10 21:29:44 smithi192 bash[70430]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-c 2024-09-10T21:29:44.676 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.c.service' 2024-09-10T21:29:44.712 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:29:44.712 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-10T21:29:44.712 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-10T21:29:44.712 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.f 2024-09-10T21:29:45.076 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:29:44 smithi192 systemd[1]: Stopping Ceph mds.f for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:29:45.076 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:29:45 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-f[64466]: 2024-09-10T21:29:45.035+0000 7f298d47f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:29:45.076 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:29:45 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-f[64466]: 2024-09-10T21:29:45.035+0000 7f298d47f640 -1 mds.f *** got signal Terminated *** 2024-09-10T21:29:48.187 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:29:47 smithi192 podman[70561]: 2024-09-10 21:29:47.920715924 +0000 UTC m=+2.990172853 container died 107fe9555a11651252cddaaa6d59dcedf7593be085dca1976ee5e3562392f8db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T21:29:48.521 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:29:48 smithi192 podman[70561]: 2024-09-10 21:29:48.285497206 +0000 UTC m=+3.354954132 container cleanup 107fe9555a11651252cddaaa6d59dcedf7593be085dca1976ee5e3562392f8db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-f, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T21:29:48.521 INFO:journalctl@ceph.mds.f.smithi192.stdout:Sep 10 21:29:48 smithi192 bash[70561]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-f 2024-09-10T21:29:48.670 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.f.service' 2024-09-10T21:29:48.703 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:29:48.704 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-10T21:29:48.704 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-10T21:29:48.704 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.i 2024-09-10T21:29:49.076 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:29:48 smithi192 systemd[1]: Stopping Ceph mds.i for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:29:49.076 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:29:49 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-i[65069]: 2024-09-10T21:29:49.014+0000 7f568ede1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:29:49.076 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:29:49 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-i[65069]: 2024-09-10T21:29:49.014+0000 7f568ede1640 -1 mds.i *** got signal Terminated *** 2024-09-10T21:29:52.326 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:29:51 smithi192 podman[70682]: 2024-09-10 21:29:51.920999407 +0000 UTC m=+3.000112873 container died eeea3014e75f9a683e5be85ec08b91aa3c54c430ed498830defe1c0f00853e48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-i, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T21:29:52.614 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:29:52 smithi192 podman[70682]: 2024-09-10 21:29:52.422918005 +0000 UTC m=+3.502031469 container cleanup eeea3014e75f9a683e5be85ec08b91aa3c54c430ed498830defe1c0f00853e48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-i, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-10T21:29:52.614 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:29:52 smithi192 bash[70682]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-i 2024-09-10T21:29:52.890 INFO:journalctl@ceph.mds.i.smithi192.stdout:Sep 10 21:29:52 smithi192 podman[70697]: 2024-09-10 21:29:52.657806835 +0000 UTC m=+0.735238960 container remove eeea3014e75f9a683e5be85ec08b91aa3c54c430ed498830defe1c0f00853e48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-i, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T21:29:52.905 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.i.service' 2024-09-10T21:29:52.940 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:29:52.941 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-10T21:29:52.941 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-10T21:29:52.941 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.l 2024-09-10T21:29:53.261 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 10 21:29:53 smithi192 systemd[1]: Stopping Ceph mds.l for 3c26b952-6fb8-11ef-bcea-c7b262605968... 2024-09-10T21:29:53.575 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 10 21:29:53 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-l[64155]: 2024-09-10T21:29:53.259+0000 7f0bf38ac640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T21:29:53.576 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 10 21:29:53 smithi192 ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-l[64155]: 2024-09-10T21:29:53.259+0000 7f0bf38ac640 -1 mds.l *** got signal Terminated *** 2024-09-10T21:29:56.326 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 10 21:29:55 smithi192 podman[70803]: 2024-09-10 21:29:55.913777311 +0000 UTC m=+2.760193700 container died 28fd568548958029a72f975c57e24d6e5d3b8669b46a12956ed174354e8d1721 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T21:29:56.737 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 10 21:29:56 smithi192 podman[70803]: 2024-09-10 21:29:56.46844731 +0000 UTC m=+3.314863699 container cleanup 28fd568548958029a72f975c57e24d6e5d3b8669b46a12956ed174354e8d1721 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T21:29:56.737 INFO:journalctl@ceph.mds.l.smithi192.stdout:Sep 10 21:29:56 smithi192 bash[70803]: ceph-3c26b952-6fb8-11ef-bcea-c7b262605968-mds-l 2024-09-10T21:29:56.883 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3c26b952-6fb8-11ef-bcea-c7b262605968@mds.l.service' 2024-09-10T21:29:56.915 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T21:29:56.915 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-10T21:29:56.915 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T21:29:57.131 INFO:teuthology.orchestra.run.smithi059.stdout:Deleting cluster with fsid: 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:29:59.658 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T21:29:59.860 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:30:02.520 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T21:30:02.722 INFO:teuthology.orchestra.run.smithi192.stdout:Deleting cluster with fsid: 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:30:05.134 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T21:30:05.170 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T21:30:05.199 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T21:30:05.227 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-10T21:30:05.229 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899662/remote/smithi059/crash 2024-09-10T21:30:05.230 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/crash -- . 2024-09-10T21:30:05.275 INFO:teuthology.orchestra.run.smithi059.stderr:tar: /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T21:30:05.276 INFO:teuthology.orchestra.run.smithi059.stderr:tar: Error is not recoverable: exiting now 2024-09-10T21:30:05.278 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899662/remote/smithi154/crash 2024-09-10T21:30:05.279 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/crash -- . 2024-09-10T21:30:05.333 INFO:teuthology.orchestra.run.smithi154.stderr:tar: /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T21:30:05.333 INFO:teuthology.orchestra.run.smithi154.stderr:tar: Error is not recoverable: exiting now 2024-09-10T21:30:05.335 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899662/remote/smithi192/crash 2024-09-10T21:30:05.336 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/crash -- . 2024-09-10T21:30:05.370 INFO:teuthology.orchestra.run.smithi192.stderr:tar: /var/lib/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T21:30:05.370 INFO:teuthology.orchestra.run.smithi192.stderr:tar: Error is not recoverable: exiting now 2024-09-10T21:30:05.371 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-10T21:30:05.371 DEBUG:teuthology.orchestra.run.smithi059:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T21:30:05.411 INFO:tasks.cephadm:Compressing logs... 2024-09-10T21:30:05.411 DEBUG:teuthology.orchestra.run.smithi059:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T21:30:05.455 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T21:30:05.458 DEBUG:teuthology.orchestra.run.smithi192:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T21:30:05.480 INFO:teuthology.orchestra.run.smithi059.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-10T21:30:05.480 INFO:teuthology.orchestra.run.smithi059.stderr:: No such file or directory 2024-09-10T21:30:05.481 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-10T21:30:05.481 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T21:30:05.481 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.0.log: /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T21:30:05.481 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-10T21:30:05.485 INFO:teuthology.orchestra.run.smithi154.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-10T21:30:05.485 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-10T21:30:05.485 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-10T21:30:05.485 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose --/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.10.log: /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-10T21:30:05.485 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T21:30:05.485 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-10T21:30:05.486 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-10T21:30:05.486 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-10T21:30:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T21:30:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-10T21:30:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-10T21:30:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mon.a.log: 82.6% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T21:30:05.487 INFO:teuthology.orchestra.run.smithi059.stderr: 90.2% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T21:30:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-10T21:30:05.487 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.log 2024-09-10T21:30:05.494 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T21:30:05.494 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.4.log: /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.audit.log: 90.3% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T21:30:05.494 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T21:30:05.494 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-10T21:30:05.494 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.cephadm.log: 82.7% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T21:30:05.494 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.log 2024-09-10T21:30:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T21:30:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:: No such file or directory 2024-09-10T21:30:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T21:30:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-10T21:30:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-10T21:30:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T21:30:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-10T21:30:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mon.c.log: /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-10T21:30:05.496 INFO:teuthology.orchestra.run.smithi192.stderr: 82.6%/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.11.log: -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T21:30:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-10T21:30:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.log 2024-09-10T21:30:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-10T21:30:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.log: 90.4% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T21:30:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-10T21:30:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.l.log: 87.8% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T21:30:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-10T21:30:05.499 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.6.log: 91.1% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T21:30:05.499 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-10T21:30:05.500 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.8.log: 91.0% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T21:30:05.500 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-10T21:30:05.502 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mgr.y.log: 92.6% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-10T21:30:05.502 INFO:teuthology.orchestra.run.smithi154.stderr: 91.0% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T21:30:05.502 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-10T21:30:05.502 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-10T21:30:05.502 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.h.log: 87.9% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T21:30:05.502 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-10T21:30:05.503 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.log: 87.8% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T21:30:05.503 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-10T21:30:05.504 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mgr.z.log: 92.6% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-10T21:30:05.509 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.d.log: 95.0% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-10T21:30:05.510 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-10T21:30:05.512 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-10T21:30:05.517 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T21:30:05.519 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-10T21:30:05.525 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T21:30:05.527 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T21:30:05.533 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T21:30:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.3.log: 95.1% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-10T21:30:05.548 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T21:30:05.562 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/cephadm.log: 94.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T21:30:05.565 INFO:teuthology.orchestra.run.smithi192.stderr: 94.6% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-10T21:30:05.570 INFO:teuthology.orchestra.run.smithi192.stderr: 92.7% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-10T21:30:05.571 INFO:teuthology.orchestra.run.smithi154.stderr: 94.6% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-10T21:30:05.585 INFO:teuthology.orchestra.run.smithi059.stderr: 94.4% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-10T21:30:05.615 INFO:teuthology.orchestra.run.smithi154.stderr: 92.8% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-10T21:30:05.626 INFO:teuthology.orchestra.run.smithi059.stderr: 94.4% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-10T21:30:05.627 INFO:teuthology.orchestra.run.smithi192.stderr: 92.6% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-10T21:30:05.631 INFO:teuthology.orchestra.run.smithi192.stderr: 92.6% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-10T21:30:05.763 INFO:teuthology.orchestra.run.smithi154.stderr: 94.0% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-10T21:30:05.777 INFO:teuthology.orchestra.run.smithi059.stderr: 90.6% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-10T21:30:05.809 INFO:teuthology.orchestra.run.smithi192.stderr: 91.9% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-10T21:30:05.921 INFO:teuthology.orchestra.run.smithi154.stderr: 91.8% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-10T21:30:05.951 INFO:teuthology.orchestra.run.smithi059.stderr: 92.9% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-10T21:30:05.958 INFO:teuthology.orchestra.run.smithi192.stderr: 92.9% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-10T21:30:06.004 INFO:teuthology.orchestra.run.smithi192.stderr: 92.5% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-10T21:30:06.079 INFO:teuthology.orchestra.run.smithi059.stderr: 92.8% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-10T21:30:06.113 INFO:teuthology.orchestra.run.smithi059.stderr: 92.7% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-10T21:30:06.128 INFO:teuthology.orchestra.run.smithi059.stderr: 92.5% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-10T21:30:06.161 INFO:teuthology.orchestra.run.smithi192.stderr: 92.4% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-10T21:30:06.184 INFO:teuthology.orchestra.run.smithi154.stderr: 92.7% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-10T21:30:06.233 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-10T21:30:06.309 INFO:teuthology.orchestra.run.smithi154.stderr: 92.8% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-10T21:30:06.479 INFO:teuthology.orchestra.run.smithi059.stderr: 90.4% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-10T21:30:06.481 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-10T21:30:06.481 INFO:teuthology.orchestra.run.smithi059.stderr:real 0m1.012s 2024-09-10T21:30:06.481 INFO:teuthology.orchestra.run.smithi059.stderr:user 0m3.594s 2024-09-10T21:30:06.481 INFO:teuthology.orchestra.run.smithi059.stderr:sys 0m0.134s 2024-09-10T21:30:06.533 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-10T21:30:06.653 INFO:teuthology.orchestra.run.smithi192.stderr: 93.2% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-10T21:30:07.056 INFO:teuthology.orchestra.run.smithi192.stderr: 2024-09-10T21:30:07.057 INFO:teuthology.orchestra.run.smithi192.stderr:real 0m1.182s 2024-09-10T21:30:07.057 INFO:teuthology.orchestra.run.smithi192.stderr:user 0m3.415s 2024-09-10T21:30:07.057 INFO:teuthology.orchestra.run.smithi192.stderr:sys 0m0.139s 2024-09-10T21:30:07.263 INFO:teuthology.orchestra.run.smithi154.stderr: 92.8% -- replaced with /var/log/ceph/3c26b952-6fb8-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-10T21:30:07.265 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-09-10T21:30:07.265 INFO:teuthology.orchestra.run.smithi154.stderr:real 0m1.794s 2024-09-10T21:30:07.265 INFO:teuthology.orchestra.run.smithi154.stderr:user 0m5.761s 2024-09-10T21:30:07.265 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m0.215s 2024-09-10T21:30:07.265 INFO:tasks.cephadm:Archiving logs... 2024-09-10T21:30:07.265 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899662/remote/smithi059/log 2024-09-10T21:30:07.266 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T21:30:07.781 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899662/remote/smithi154/log 2024-09-10T21:30:07.782 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T21:30:08.660 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899662/remote/smithi192/log 2024-09-10T21:30:08.661 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T21:30:09.216 INFO:tasks.cephadm:Removing cluster... 2024-09-10T21:30:09.216 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 --force 2024-09-10T21:30:09.432 INFO:teuthology.orchestra.run.smithi059.stdout:Deleting cluster with fsid: 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:30:09.699 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 --force 2024-09-10T21:30:09.908 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:30:10.174 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3c26b952-6fb8-11ef-bcea-c7b262605968 --force 2024-09-10T21:30:10.377 INFO:teuthology.orchestra.run.smithi192.stdout:Deleting cluster with fsid: 3c26b952-6fb8-11ef-bcea-c7b262605968 2024-09-10T21:30:10.634 INFO:tasks.cephadm:Removing cephadm ... 2024-09-10T21:30:10.635 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T21:30:10.656 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T21:30:10.675 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T21:30:10.693 INFO:tasks.cephadm:Teardown complete 2024-09-10T21:30:10.693 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T21:30:10.948 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T21:30:10.948 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T21:30:10.951 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T21:30:10.955 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T21:30:11.076 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T21:30:11.803 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T21:30:11.803 DEBUG:teuthology.orchestra.run.smithi059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T21:30:11.806 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T21:30:11.809 DEBUG:teuthology.orchestra.run.smithi192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T21:30:11.821 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2024-09-10T21:30:11.824 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-09-10T21:30:11.826 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2024-09-10T21:30:11.827 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T21:30:11.827 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2024-09-10T21:30:11.827 INFO:teuthology.orchestra.run.smithi059.stdout:^* hv01.front.sepia.ceph.com 3 6 377 37 -533us[ -516us] +/- 56ms 2024-09-10T21:30:11.827 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 39 +1540us[+1556us] +/- 67ms 2024-09-10T21:30:11.827 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 -1142us[-1142us] +/- 85ms 2024-09-10T21:30:11.827 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:30:11.830 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T21:30:11.830 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-09-10T21:30:11.830 INFO:teuthology.orchestra.run.smithi154.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 -518us[ -530us] +/- 56ms 2024-09-10T21:30:11.830 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 38 +1567us[+1556us] +/- 67ms 2024-09-10T21:30:11.830 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 -1113us[-1124us] +/- 85ms 2024-09-10T21:30:11.830 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:30:11.831 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T21:30:11.831 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-09-10T21:30:11.831 INFO:teuthology.orchestra.run.smithi192.stdout:^* hv01.front.sepia.ceph.com 3 6 377 40 -501us[ -515us] +/- 56ms 2024-09-10T21:30:11.832 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 +1593us[+1579us] +/- 67ms 2024-09-10T21:30:11.832 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 -1090us[-1090us] +/- 85ms 2024-09-10T21:30:11.832 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T21:30:11.832 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T21:30:12.077 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T21:30:12.077 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T21:30:12.504 DEBUG:teuthology.orchestra.run.smithi059:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T21:30:12.597 DEBUG:teuthology.orchestra.run.smithi154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T21:30:12.672 DEBUG:teuthology.orchestra.run.smithi192:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T21:30:12.749 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T21:30:12.785 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:30:12.785 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T21:30:12.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:30:12.818 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T21:30:12.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:30:12.849 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T21:30:13.075 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T21:30:13.204 INFO:teuthology.task.internal:Duration was 1901.243752 seconds 2024-09-10T21:30:13.205 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T21:30:13.314 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T21:30:13.314 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T21:30:13.320 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T21:30:13.327 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T21:30:13.366 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T21:30:13.371 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T21:30:13.373 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T21:30:13.866 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T21:30:13.867 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi059.front.sepia.ceph.com 2024-09-10T21:30:13.867 DEBUG:teuthology.orchestra.run.smithi059:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T21:30:13.894 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-09-10T21:30:13.894 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T21:30:13.919 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi192.front.sepia.ceph.com 2024-09-10T21:30:13.919 DEBUG:teuthology.orchestra.run.smithi192:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T21:30:13.940 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T21:30:13.940 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T21:30:13.943 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T21:30:13.962 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T21:30:14.006 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T21:30:14.006 DEBUG:teuthology.orchestra.run.smithi059:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T21:30:14.014 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T21:30:14.029 DEBUG:teuthology.orchestra.run.smithi192:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T21:30:15.396 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T21:30:15.406 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T21:30:15.407 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T21:30:15.433 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T21:30:15.461 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T21:30:15.491 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T21:30:15.502 DEBUG:teuthology.orchestra.run.smithi059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T21:30:15.505 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T21:30:15.507 DEBUG:teuthology.orchestra.run.smithi192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T21:30:15.527 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = core 2024-09-10T21:30:15.530 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-09-10T21:30:15.559 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = core 2024-09-10T21:30:15.582 DEBUG:teuthology.orchestra.run.smithi059:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T21:30:15.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:30:15.597 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T21:30:15.612 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:30:15.613 DEBUG:teuthology.orchestra.run.smithi192:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T21:30:15.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:30:15.639 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T21:30:15.649 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T21:30:15.650 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899662/remote/smithi059 2024-09-10T21:30:15.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T21:30:15.718 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899662/remote/smithi154 2024-09-10T21:30:15.718 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T21:30:15.755 DEBUG:teuthology.misc:Transferring archived files from smithi192:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899662/remote/smithi192 2024-09-10T21:30:15.755 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T21:30:15.796 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T21:30:15.796 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T21:30:15.799 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T21:30:15.801 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T21:30:15.845 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T21:30:15.857 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T21:30:15.857 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T21:30:15.895 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T21:30:15.895 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T21:30:15.898 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T21:30:15.900 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T21:30:15.911 INFO:teuthology.orchestra.run.smithi059.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 21:30 /home/ubuntu/cephtest 2024-09-10T21:30:15.913 INFO:teuthology.orchestra.run.smithi154.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 21:30 /home/ubuntu/cephtest 2024-09-10T21:30:15.916 INFO:teuthology.orchestra.run.smithi192.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 21:30 /home/ubuntu/cephtest 2024-09-10T21:30:15.917 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T21:30:15.941 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T21:30:16.026 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/fs/test_o_trunc}} duration: 1901.243751525879 flavor: default owner: scheduled_hyelloji@teuthology success: true 2024-09-10T21:30:16.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T21:30:16.116 INFO:teuthology.run:pass